2024-09-20T18:13:56.286 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-20T18:13:56.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-20T18:13:56.418 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912681 branch: wip-guits-main-2024-09-20-1028 description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: gabrioux@ibm.com first_in_suite: false job_id: '7912681' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/squid ' name: gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-guits-main-2024-09-20-1028 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-guits-main-2024-09-20-1028 sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 owner: scheduled_gabrioux@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 9945 sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-main-2024-09-20-1028 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD+9XEbRNYz3XyRAxrF3T/FeHSRJmKlU+dr7xKAa1OtIH/zqLMbCHHE/rs5NqvZO4z3/TEap6xbyTtIshPfHi9c= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLqT8Pzzv254e79fsx1fLKuuwGyBKNfX+sNigQqWZSxrw0OOMZt46OgdKm1EKwYLOU42PkEToLlMVP3kY6Hedtk= tasks: - install: branch: squid exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: squid conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:squid roleless: true - print: '**** done end installing squid cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_12:24:58 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: gabrioux verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-20T18:13:56.418 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa; will attempt to use it 2024-09-20T18:13:56.419 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks 2024-09-20T18:13:56.419 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-20T18:13:56.420 INFO:teuthology.task.internal:Checking packages... 2024-09-20T18:13:56.440 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '88deadb8082f4a33832e228ccefc59cedba158a5' 2024-09-20T18:13:56.440 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T18:13:56.440 INFO:teuthology.packaging:ref: None 2024-09-20T18:13:56.440 INFO:teuthology.packaging:tag: None 2024-09-20T18:13:56.441 INFO:teuthology.packaging:branch: wip-guits-main-2024-09-20-1028 2024-09-20T18:13:56.441 INFO:teuthology.packaging:sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:13:56.441 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-guits-main-2024-09-20-1028 2024-09-20T18:13:56.579 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5099.g88deadb8 2024-09-20T18:13:56.580 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-20T18:13:56.587 INFO:teuthology.task.internal:no buildpackages task found 2024-09-20T18:13:56.587 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-20T18:13:56.595 INFO:teuthology.task.internal:Saving configuration 2024-09-20T18:13:56.615 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-20T18:13:56.622 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-20T18:13:56.647 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912681', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 18:04:38.285497', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD+9XEbRNYz3XyRAxrF3T/FeHSRJmKlU+dr7xKAa1OtIH/zqLMbCHHE/rs5NqvZO4z3/TEap6xbyTtIshPfHi9c='} 2024-09-20T18:13:56.670 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912681', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-20 18:04:38.287968', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLqT8Pzzv254e79fsx1fLKuuwGyBKNfX+sNigQqWZSxrw0OOMZt46OgdKm1EKwYLOU42PkEToLlMVP3kY6Hedtk='} 2024-09-20T18:13:56.670 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-20T18:13:56.676 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-20T18:13:56.676 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-20T18:13:56.676 INFO:teuthology.run_tasks:Running task console_log... 2024-09-20T18:13:56.735 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa6ce3bc280>, signals=[15]) 2024-09-20T18:13:56.735 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-20T18:13:56.741 INFO:teuthology.task.internal:Opening connections... 2024-09-20T18:13:56.741 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2024-09-20T18:13:56.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:13:56.823 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-09-20T18:13:56.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:13:56.900 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-20T18:13:56.907 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-09-20T18:13:56.926 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-09-20T18:13:56.926 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-09-20T18:13:56.986 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-09-20T18:13:56.987 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2024-09-20T18:13:56.987 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-09-20T18:13:56.987 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-09-20T18:13:56.987 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2024-09-20T18:13:56.987 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2024-09-20T18:13:56.987 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-20T18:13:56.988 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-09-20T18:13:56.988 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2024-09-20T18:13:56.988 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-20T18:13:56.988 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-09-20T18:13:56.988 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-20T18:13:56.988 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-20T18:13:56.988 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-20T18:13:56.989 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-09-20T18:13:57.010 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-09-20T18:13:57.028 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-09-20T18:13:57.029 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-09-20T18:13:57.087 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-09-20T18:13:57.087 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-09-20T18:13:57.087 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-09-20T18:13:57.087 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-09-20T18:13:57.088 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-09-20T18:13:57.088 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-09-20T18:13:57.088 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-20T18:13:57.088 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-09-20T18:13:57.088 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-09-20T18:13:57.088 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-20T18:13:57.088 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-09-20T18:13:57.088 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-20T18:13:57.088 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-20T18:13:57.088 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-20T18:13:57.088 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-09-20T18:13:57.109 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-20T18:13:57.118 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-20T18:13:57.123 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-20T18:13:57.123 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2024-09-20T18:13:57.126 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-09-20T18:13:57.143 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-20T18:13:57.149 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-20T18:13:57.149 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2024-09-20T18:13:57.183 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-09-20T18:13:57.287 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-20T18:13:57.339 INFO:teuthology.run_tasks:Running task kernel... 2024-09-20T18:13:57.353 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-20T18:13:57.353 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-20T18:13:57.353 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-20T18:13:57.354 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-20T18:13:57.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T18:13:57.371 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-20T18:13:57.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T18:13:57.372 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-09-20T18:13:57.428 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-503.el9.x86_64 2024-09-20T18:13:57.429 INFO:teuthology.task.kernel:Running kernel on smithi017: 5.14.0-503.el9.x86_64 2024-09-20T18:13:57.429 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum install -y kernel 2024-09-20T18:13:57.430 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-503.el9.x86_64 2024-09-20T18:13:57.430 INFO:teuthology.task.kernel:Running kernel on smithi172: 5.14.0-503.el9.x86_64 2024-09-20T18:13:57.430 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum install -y kernel 2024-09-20T18:13:59.739 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-20T18:13:59.903 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.3 MB 00:00 2024-09-20T18:14:03.129 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 20 MB 00:02 2024-09-20T18:14:03.798 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 6.8 MB/s | 20 MB 00:02 2024-09-20T18:14:07.480 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-20T18:14:09.231 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-20T18:14:09.415 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-20T18:14:10.144 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-20T18:14:10.949 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-20T18:14:12.028 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-20T18:14:15.832 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-20T18:14:17.375 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-20T18:14:17.772 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-20T18:14:17.772 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-20T18:14:17.880 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:14:17.891 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:14:17.891 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-09-20T18:14:17.891 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:14:17.891 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-20T18:14:17.891 INFO:teuthology.orchestra.run.smithi017.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-20T18:14:17.891 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-20T18:14:17.891 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-20T18:14:17.891 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-20T18:14:17.891 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-20T18:14:17.891 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:14:17.891 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-20T18:14:17.892 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:14:17.892 INFO:teuthology.orchestra.run.smithi017.stdout:Install 4 Packages 2024-09-20T18:14:17.892 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:14:17.892 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 79 M 2024-09-20T18:14:17.892 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 126 M 2024-09-20T18:14:17.892 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-20T18:14:18.117 INFO:teuthology.orchestra.run.smithi017.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 450 kB/s | 36 kB 00:00 2024-09-20T18:14:18.501 INFO:teuthology.orchestra.run.smithi017.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-20T18:14:18.926 INFO:teuthology.orchestra.run.smithi017.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 39 MB/s | 35 MB 00:00 2024-09-20T18:14:19.235 INFO:teuthology.orchestra.run.smithi017.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-20T18:14:19.235 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:14:19.235 INFO:teuthology.orchestra.run.smithi017.stdout:Total 59 MB/s | 79 MB 00:01 2024-09-20T18:14:19.248 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-20T18:14:19.249 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-20T18:14:19.342 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:14:19.347 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:14:19.347 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-09-20T18:14:19.347 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:14:19.348 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-20T18:14:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-20T18:14:19.348 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-20T18:14:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-20T18:14:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-20T18:14:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-20T18:14:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:14:19.348 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-20T18:14:19.348 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:14:19.348 INFO:teuthology.orchestra.run.smithi172.stdout:Install 4 Packages 2024-09-20T18:14:19.348 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:14:19.349 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 79 M 2024-09-20T18:14:19.349 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 126 M 2024-09-20T18:14:19.349 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-20T18:14:19.947 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-20T18:14:19.952 INFO:teuthology.orchestra.run.smithi172.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 65 kB/s | 36 kB 00:00 2024-09-20T18:14:20.305 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-20T18:14:20.305 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-20T18:14:20.794 INFO:teuthology.orchestra.run.smithi172.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-20T18:14:21.278 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-20T18:14:21.279 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-20T18:14:21.483 INFO:teuthology.orchestra.run.smithi172.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-20T18:14:22.336 INFO:teuthology.orchestra.run.smithi172.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 12 MB/s | 29 MB 00:02 2024-09-20T18:14:22.336 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:14:22.337 INFO:teuthology.orchestra.run.smithi172.stdout:Total 26 MB/s | 79 MB 00:02 2024-09-20T18:14:23.021 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-20T18:14:23.371 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-20T18:14:23.371 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-20T18:14:23.820 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-20T18:14:24.308 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-20T18:14:24.309 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-20T18:14:24.488 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-20T18:14:24.578 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T18:14:26.864 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-20T18:14:27.325 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T18:14:27.454 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T18:14:27.497 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-20T18:14:27.587 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T18:14:30.337 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T18:14:30.465 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T18:14:32.578 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T18:14:32.621 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:14:35.308 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T18:14:35.349 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:14:37.771 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:14:40.179 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:15:17.347 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:15:17.388 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:15:17.775 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:15:17.775 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-20T18:15:17.775 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T18:15:17.775 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T18:15:18.408 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:15:18.457 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:15:18.561 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:15:18.561 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:15:18.561 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-20T18:15:18.561 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-20T18:15:18.561 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-20T18:15:18.561 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-20T18:15:18.561 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-20T18:15:18.561 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:15:18.561 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:15:18.820 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:15:18.821 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-20T18:15:18.821 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-20T18:15:18.821 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-20T18:15:18.921 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-09-20T18:15:19.005 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-20T18:15:19.006 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-20T18:15:19.006 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-20T18:15:19.006 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-20T18:15:19.006 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-20T18:15:19.006 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-20T18:15:19.006 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi017.front.sepia.ceph.com, path=None, version=distro) 2024-09-20T18:15:19.006 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-09-20T18:15:19.064 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-20T18:15:19.065 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-20T18:15:19.065 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -qi grub2-tools 2024-09-20T18:15:19.096 INFO:teuthology.orchestra.run.smithi017.stdout:Name : grub2-tools 2024-09-20T18:15:19.096 INFO:teuthology.orchestra.run.smithi017.stdout:Epoch : 1 2024-09-20T18:15:19.096 INFO:teuthology.orchestra.run.smithi017.stdout:Version : 2.06 2024-09-20T18:15:19.096 INFO:teuthology.orchestra.run.smithi017.stdout:Release : 82.el9 2024-09-20T18:15:19.096 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: x86_64 2024-09-20T18:15:19.096 INFO:teuthology.orchestra.run.smithi017.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-20T18:15:19.096 INFO:teuthology.orchestra.run.smithi017.stdout:Group : Unspecified 2024-09-20T18:15:19.097 INFO:teuthology.orchestra.run.smithi017.stdout:Size : 8274670 2024-09-20T18:15:19.097 INFO:teuthology.orchestra.run.smithi017.stdout:License : GPLv3+ 2024-09-20T18:15:19.097 INFO:teuthology.orchestra.run.smithi017.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-20T18:15:19.097 INFO:teuthology.orchestra.run.smithi017.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-20T18:15:19.097 INFO:teuthology.orchestra.run.smithi017.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-20T18:15:19.097 INFO:teuthology.orchestra.run.smithi017.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-20T18:15:19.097 INFO:teuthology.orchestra.run.smithi017.stdout:Packager : builder@centos.org 2024-09-20T18:15:19.097 INFO:teuthology.orchestra.run.smithi017.stdout:Vendor : CentOS 2024-09-20T18:15:19.097 INFO:teuthology.orchestra.run.smithi017.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-20T18:15:19.097 INFO:teuthology.orchestra.run.smithi017.stdout:Summary : Support tools for GRUB. 2024-09-20T18:15:19.097 INFO:teuthology.orchestra.run.smithi017.stdout:Description : 2024-09-20T18:15:19.097 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:15:19.097 INFO:teuthology.orchestra.run.smithi017.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-20T18:15:19.098 INFO:teuthology.orchestra.run.smithi017.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-20T18:15:19.098 INFO:teuthology.orchestra.run.smithi017.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-20T18:15:19.098 INFO:teuthology.orchestra.run.smithi017.stdout:hardware devices. 2024-09-20T18:15:19.098 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:15:19.098 INFO:teuthology.orchestra.run.smithi017.stdout:This subpackage provides tools for support of all platforms. 2024-09-20T18:15:19.099 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-20T18:15:19.099 INFO:teuthology.task.kernel:Updating grub on smithi017 to boot 5.14.0-508.el9.x86_64 2024-09-20T18:15:19.099 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-20T18:15:19.648 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-20T18:15:19.648 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:15:19.648 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-20T18:15:19.648 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-20T18:15:19.648 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-20T18:15:19.648 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-20T18:15:19.648 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-20T18:15:19.648 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:15:19.648 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:15:19.758 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2024-09-20T18:15:19.995 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-09-20T18:15:20.075 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-20T18:15:20.075 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-20T18:15:20.075 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-20T18:15:20.075 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-20T18:15:20.075 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-20T18:15:20.075 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-20T18:15:20.076 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi172.front.sepia.ceph.com, path=None, version=distro) 2024-09-20T18:15:20.076 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-09-20T18:15:20.134 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-20T18:15:20.134 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-20T18:15:20.134 DEBUG:teuthology.orchestra.run.smithi172:> sudo rpm -qi grub2-tools 2024-09-20T18:15:20.166 INFO:teuthology.orchestra.run.smithi172.stdout:Name : grub2-tools 2024-09-20T18:15:20.167 INFO:teuthology.orchestra.run.smithi172.stdout:Epoch : 1 2024-09-20T18:15:20.167 INFO:teuthology.orchestra.run.smithi172.stdout:Version : 2.06 2024-09-20T18:15:20.167 INFO:teuthology.orchestra.run.smithi172.stdout:Release : 82.el9 2024-09-20T18:15:20.167 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: x86_64 2024-09-20T18:15:20.167 INFO:teuthology.orchestra.run.smithi172.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-20T18:15:20.167 INFO:teuthology.orchestra.run.smithi172.stdout:Group : Unspecified 2024-09-20T18:15:20.167 INFO:teuthology.orchestra.run.smithi172.stdout:Size : 8274670 2024-09-20T18:15:20.167 INFO:teuthology.orchestra.run.smithi172.stdout:License : GPLv3+ 2024-09-20T18:15:20.167 INFO:teuthology.orchestra.run.smithi172.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-20T18:15:20.167 INFO:teuthology.orchestra.run.smithi172.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-20T18:15:20.167 INFO:teuthology.orchestra.run.smithi172.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-20T18:15:20.167 INFO:teuthology.orchestra.run.smithi172.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-20T18:15:20.168 INFO:teuthology.orchestra.run.smithi172.stdout:Packager : builder@centos.org 2024-09-20T18:15:20.168 INFO:teuthology.orchestra.run.smithi172.stdout:Vendor : CentOS 2024-09-20T18:15:20.168 INFO:teuthology.orchestra.run.smithi172.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-20T18:15:20.168 INFO:teuthology.orchestra.run.smithi172.stdout:Summary : Support tools for GRUB. 2024-09-20T18:15:20.168 INFO:teuthology.orchestra.run.smithi172.stdout:Description : 2024-09-20T18:15:20.168 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:15:20.168 INFO:teuthology.orchestra.run.smithi172.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-20T18:15:20.168 INFO:teuthology.orchestra.run.smithi172.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-20T18:15:20.168 INFO:teuthology.orchestra.run.smithi172.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-20T18:15:20.168 INFO:teuthology.orchestra.run.smithi172.stdout:hardware devices. 2024-09-20T18:15:20.168 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:15:20.168 INFO:teuthology.orchestra.run.smithi172.stdout:This subpackage provides tools for support of all platforms. 2024-09-20T18:15:20.169 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-20T18:15:20.169 INFO:teuthology.task.kernel:Updating grub on smithi172 to boot 5.14.0-508.el9.x86_64 2024-09-20T18:15:20.169 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-20T18:15:20.846 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2024-09-20T18:15:21.109 INFO:teuthology.orchestra.run.smithi017.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-20T18:15:21.156 INFO:teuthology.orchestra.run.smithi017.stderr:done 2024-09-20T18:15:21.159 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-20T18:15:21.177 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.NdoiwvEbaW 2024-09-20T18:15:21.177 DEBUG:teuthology.orchestra.run.smithi017:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NdoiwvEbaW 2024-09-20T18:15:21.245 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.NdoiwvEbaW 2024-09-20T18:15:21.406 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.NdoiwvEbaW is 6KB 2024-09-20T18:15:21.454 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.NdoiwvEbaW 2024-09-20T18:15:21.469 DEBUG:teuthology.orchestra.run.smithi017:> sudo /bin/ls /boot/loader/entries || true 2024-09-20T18:15:21.530 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-20T18:15:21.530 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-20T18:15:21.531 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-20T18:15:21.531 INFO:teuthology.orchestra.run.smithi017.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-20T18:15:21.532 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-20T18:15:21.688 DEBUG:teuthology.orchestra.run.smithi017:> sudo shutdown -r now 2024-09-20T18:15:22.174 INFO:teuthology.orchestra.run.smithi172.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-20T18:15:22.201 INFO:teuthology.orchestra.run.smithi172.stderr:done 2024-09-20T18:15:22.211 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-09-20T18:15:22.227 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.9BQM4B0C2R 2024-09-20T18:15:22.227 DEBUG:teuthology.orchestra.run.smithi172:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9BQM4B0C2R 2024-09-20T18:15:22.294 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.9BQM4B0C2R 2024-09-20T18:15:22.433 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.9BQM4B0C2R is 6KB 2024-09-20T18:15:22.481 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.9BQM4B0C2R 2024-09-20T18:15:22.496 DEBUG:teuthology.orchestra.run.smithi172:> sudo /bin/ls /boot/loader/entries || true 2024-09-20T18:15:22.571 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-20T18:15:22.571 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-20T18:15:22.571 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-20T18:15:22.571 INFO:teuthology.orchestra.run.smithi172.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-20T18:15:22.573 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-20T18:15:22.715 DEBUG:teuthology.orchestra.run.smithi172:> sudo shutdown -r now 2024-09-20T18:15:51.718 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-20T18:15:51.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-20T18:15:51.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:15:52.720 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-20T18:15:52.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-20T18:15:52.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:16:51.779 DEBUG:teuthology.orchestra.remote:timed out 2024-09-20T18:16:52.724 DEBUG:teuthology.orchestra.remote:timed out 2024-09-20T18:17:00.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-20T18:17:00.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:17:01.185 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-20T18:17:01.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-20T18:17:01.577 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-20T18:17:01.577 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-20T18:17:01.593 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-508.el9.x86_64 2024-09-20T18:17:01.593 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-20T18:17:01.593 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-20T18:17:01.593 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-20T18:17:01.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-20T18:17:01.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:17:02.594 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-20T18:17:02.594 DEBUG:teuthology.orchestra.run.smithi017:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-20T18:17:02.674 INFO:teuthology.orchestra.run.smithi017.stdout:ttyS1 2024-09-20T18:17:02.704 DEBUG:teuthology.parallel:result is None 2024-09-20T18:17:09.204 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-09-20T18:17:09.555 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-20T18:17:09.555 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-20T18:17:09.556 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-09-20T18:17:09.571 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-508.el9.x86_64 2024-09-20T18:17:09.571 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-20T18:17:09.571 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-20T18:17:09.571 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-20T18:17:10.572 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-20T18:17:10.572 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-20T18:17:10.664 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2024-09-20T18:17:10.698 DEBUG:teuthology.parallel:result is None 2024-09-20T18:17:10.698 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-20T18:17:10.706 INFO:teuthology.task.internal:Creating test directory... 2024-09-20T18:17:10.706 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-20T18:17:10.709 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-20T18:17:10.727 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-20T18:17:10.737 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-20T18:17:10.745 INFO:teuthology.task.internal:Creating archive directory... 2024-09-20T18:17:10.746 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-20T18:17:10.771 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-20T18:17:10.816 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-20T18:17:10.823 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-20T18:17:10.824 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-20T18:17:10.850 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-20T18:17:10.879 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T18:17:10.879 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T18:17:10.889 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T18:17:10.891 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-20T18:17:10.893 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-20T18:17:10.900 INFO:teuthology.task.internal:Configuring sudo... 2024-09-20T18:17:10.900 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-20T18:17:10.935 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-20T18:17:10.962 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-20T18:17:10.971 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-20T18:17:10.971 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-20T18:17:11.004 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-20T18:17:11.029 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T18:17:11.115 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T18:17:11.165 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T18:17:11.252 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T18:17:11.295 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T18:17:11.296 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-20T18:17:11.363 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T18:17:11.405 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-20T18:17:11.460 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T18:17:11.540 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-20T18:17:11.577 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-20T18:17:11.577 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-20T18:17:11.642 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2024-09-20T18:17:11.644 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-09-20T18:17:11.697 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-20T18:17:11.723 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-20T18:17:12.200 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-20T18:17:12.214 INFO:teuthology.task.internal:Starting timer... 2024-09-20T18:17:12.214 INFO:teuthology.run_tasks:Running task pcp... 2024-09-20T18:17:12.253 INFO:teuthology.run_tasks:Running task selinux... 2024-09-20T18:17:12.277 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-20T18:17:12.277 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2024-09-20T18:17:12.336 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: 2024-09-20T18:17:12.336 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-09-20T18:17:12.398 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-09-20T18:17:12.400 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-20T18:17:12.400 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2024-09-20T18:17:12.431 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2024-09-20T18:17:12.432 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-09-20T18:17:12.464 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-09-20T18:17:12.464 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2024-09-20T18:17:12.464 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-20T18:17:12.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T18:17:12.503 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-20T18:17:12.530 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T18:17:12.531 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-20T18:17:12.531 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2024-09-20T18:17:12.583 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-09-20T18:17:12.617 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-20T18:17:12.627 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-20T18:17:12.659 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-20T18:17:12.660 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-20T18:21:26.968 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-09-20T18:21:26.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-20T18:21:26.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:21:27.075 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-20T18:21:27.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-20T18:21:27.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-20T18:21:27.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-20T18:21:27.237 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-09-20T18:21:27.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-20T18:21:27.318 INFO:teuthology.run_tasks:Running task clock... 2024-09-20T18:21:27.328 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-20T18:21:27.329 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-20T18:21:27.329 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T18:21:27.332 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-20T18:21:27.332 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T18:21:27.362 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-20T18:21:27.378 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-20T18:21:27.386 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-20T18:21:27.400 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-20T18:21:27.404 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2024-09-20T18:21:27.417 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2024-09-20T18:21:27.424 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-09-20T18:21:27.432 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-20T18:21:27.436 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-09-20T18:21:27.447 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-20T18:21:27.450 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-20T18:21:27.464 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-20T18:21:27.511 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-09-20T18:21:27.514 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-20T18:21:27.514 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-09-20T18:21:27.514 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T18:21:27.515 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T18:21:27.515 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T18:21:27.515 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T18:21:27.529 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-20T18:21:27.534 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-20T18:21:27.534 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-20T18:21:27.534 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T18:21:27.534 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T18:21:27.534 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T18:21:27.534 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T18:21:27.534 INFO:teuthology.run_tasks:Running task install... 2024-09-20T18:21:27.542 DEBUG:teuthology.task.install:project ceph 2024-09-20T18:21:27.542 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '88deadb8082f4a33832e228ccefc59cedba158a5'}} 2024-09-20T18:21:27.543 DEBUG:teuthology.task.install:config {'branch': 'squid', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '88deadb8082f4a33832e228ccefc59cedba158a5'} 2024-09-20T18:21:27.543 INFO:teuthology.task.install:Using flavor: default 2024-09-20T18:21:27.554 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-20T18:21:27.554 INFO:teuthology.task.install:extra packages: [] 2024-09-20T18:21:27.555 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '88deadb8082f4a33832e228ccefc59cedba158a5', 'tag': None, 'wait_for_package': False} 2024-09-20T18:21:27.555 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T18:21:27.555 INFO:teuthology.packaging:ref: None 2024-09-20T18:21:27.555 INFO:teuthology.packaging:tag: None 2024-09-20T18:21:27.555 INFO:teuthology.packaging:branch: squid 2024-09-20T18:21:27.556 INFO:teuthology.packaging:sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:21:27.556 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-20T18:21:27.558 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '88deadb8082f4a33832e228ccefc59cedba158a5', 'tag': None, 'wait_for_package': False} 2024-09-20T18:21:27.559 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T18:21:27.559 INFO:teuthology.packaging:ref: None 2024-09-20T18:21:27.559 INFO:teuthology.packaging:tag: None 2024-09-20T18:21:27.559 INFO:teuthology.packaging:branch: squid 2024-09-20T18:21:27.559 INFO:teuthology.packaging:sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:21:27.559 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-20T18:21:27.770 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/flavors/default/ 2024-09-20T18:21:27.771 INFO:teuthology.task.install.rpm:Package version is 19.1.1-369.ged8ee0f2 2024-09-20T18:21:27.833 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/flavors/default/ 2024-09-20T18:21:27.833 INFO:teuthology.task.install.rpm:Package version is 19.1.1-369.ged8ee0f2 2024-09-20T18:21:27.901 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-20T18:21:27.901 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T18:21:27.901 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-20T18:21:27.929 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-20T18:21:27.929 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T18:21:27.929 INFO:teuthology.packaging:ref: None 2024-09-20T18:21:27.929 INFO:teuthology.packaging:tag: None 2024-09-20T18:21:27.929 INFO:teuthology.packaging:branch: squid 2024-09-20T18:21:27.929 INFO:teuthology.packaging:sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:21:27.929 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-20T18:21:27.944 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-20T18:21:27.945 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-20T18:21:27.945 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-20T18:21:27.971 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-20T18:21:27.971 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T18:21:27.971 INFO:teuthology.packaging:ref: None 2024-09-20T18:21:27.971 INFO:teuthology.packaging:tag: None 2024-09-20T18:21:27.971 INFO:teuthology.packaging:branch: squid 2024-09-20T18:21:27.972 INFO:teuthology.packaging:sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:21:27.972 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-20T18:21:27.997 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-20T18:21:28.038 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-20T18:21:28.075 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-20T18:21:28.113 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-20T18:21:28.140 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2024-09-20T18:21:28.141 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2024-09-20T18:21:28.177 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-09-20T18:21:28.178 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-09-20T18:21:28.373 INFO:teuthology.orchestra.run.smithi017.stdout:45 files removed 2024-09-20T18:21:28.426 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw 2024-09-20T18:21:28.427 INFO:teuthology.orchestra.run.smithi172.stdout:45 files removed 2024-09-20T18:21:28.436 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw 2024-09-20T18:21:29.013 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 289 kB/s | 84 kB 00:00 2024-09-20T18:21:29.014 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 292 kB/s | 84 kB 00:00 2024-09-20T18:21:29.306 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-20T18:21:29.313 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-20T18:21:29.591 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-20T18:21:29.596 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-20T18:21:30.205 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-20T18:21:30.290 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-20T18:21:32.165 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-20T18:21:35.083 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 5.5 MB/s | 20 MB 00:03 2024-09-20T18:21:36.741 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.5 MB 00:00 2024-09-20T18:21:40.718 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-20T18:21:42.179 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 4.5 kB/s | 19 kB 00:04 2024-09-20T18:21:42.493 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-20T18:21:43.188 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-20T18:21:43.431 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-20T18:21:48.802 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-20T18:21:49.145 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-20T18:21:51.037 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:21:51.045 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:21:51.045 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-20T18:21:51.045 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:21:51.045 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-20T18:21:51.045 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 11 M 2024-09-20T18:21:51.045 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-09-20T18:21:51.045 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 3.4 M 2024-09-20T18:21:51.046 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 3.2 M 2024-09-20T18:21:51.046 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-20T18:21:51.046 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-20T18:21:51.046 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 5.4 M 2024-09-20T18:21:51.046 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 21 M 2024-09-20T18:21:51.046 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 25 k 2024-09-20T18:21:51.046 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-20T18:21:51.046 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-20T18:21:51.046 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-20T18:21:51.046 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 751 k 2024-09-20T18:21:51.046 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-20T18:21:51.046 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-20T18:21:51.046 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-20T18:21:51.047 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 506 k 2024-09-20T18:21:51.047 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-20T18:21:51.047 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 5.3 M 2024-09-20T18:21:51.047 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-20T18:21:51.047 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-20T18:21:51.047 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-20T18:21:51.047 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 45 k 2024-09-20T18:21:51.047 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 136 k 2024-09-20T18:21:51.047 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 162 k 2024-09-20T18:21:51.047 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-20T18:21:51.047 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 320 k 2024-09-20T18:21:51.047 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 301 k 2024-09-20T18:21:51.047 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 99 k 2024-09-20T18:21:51.048 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-20T18:21:51.048 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-20T18:21:51.048 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-20T18:21:51.048 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-20T18:21:51.048 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-09-20T18:21:51.048 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-20T18:21:51.048 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:21:51.048 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-20T18:21:51.048 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:21:51.048 INFO:teuthology.orchestra.run.smithi172.stdout:Install 30 Packages 2024-09-20T18:21:51.048 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 2 Packages 2024-09-20T18:21:51.048 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:21:51.049 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 60 M 2024-09-20T18:21:51.049 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-20T18:21:51.440 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:21:51.443 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:21:51.443 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-20T18:21:51.444 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:21:51.444 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-20T18:21:51.444 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 11 M 2024-09-20T18:21:51.444 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2024-09-20T18:21:51.444 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 3.4 M 2024-09-20T18:21:51.444 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 3.2 M 2024-09-20T18:21:51.444 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-20T18:21:51.444 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-20T18:21:51.444 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 5.4 M 2024-09-20T18:21:51.444 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 21 M 2024-09-20T18:21:51.444 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 25 k 2024-09-20T18:21:51.444 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-20T18:21:51.444 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-20T18:21:51.444 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-20T18:21:51.445 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 751 k 2024-09-20T18:21:51.445 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-20T18:21:51.445 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-20T18:21:51.445 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-20T18:21:51.445 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 506 k 2024-09-20T18:21:51.445 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-20T18:21:51.445 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 5.3 M 2024-09-20T18:21:51.445 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-20T18:21:51.445 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-20T18:21:51.445 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-20T18:21:51.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 45 k 2024-09-20T18:21:51.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 136 k 2024-09-20T18:21:51.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 162 k 2024-09-20T18:21:51.445 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-20T18:21:51.446 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 320 k 2024-09-20T18:21:51.446 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 301 k 2024-09-20T18:21:51.446 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 99 k 2024-09-20T18:21:51.446 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-20T18:21:51.446 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-20T18:21:51.446 INFO:teuthology.orchestra.run.smithi017.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-20T18:21:51.446 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-20T18:21:51.446 INFO:teuthology.orchestra.run.smithi017.stdout:Installing weak dependencies: 2024-09-20T18:21:51.446 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-20T18:21:51.446 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:21:51.446 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-20T18:21:51.446 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:21:51.446 INFO:teuthology.orchestra.run.smithi017.stdout:Install 30 Packages 2024-09-20T18:21:51.446 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 2 Packages 2024-09-20T18:21:51.447 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:21:51.447 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 60 M 2024-09-20T18:21:51.447 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-20T18:21:52.003 INFO:teuthology.orchestra.run.smithi172.stdout:(1/32): ceph-base-19.1.1-369.ged8ee0f2.el9.x86_ 6.4 MB/s | 5.4 MB 00:00 2024-09-20T18:21:52.079 INFO:teuthology.orchestra.run.smithi172.stdout:(2/32): ceph-selinux-19.1.1-369.ged8ee0f2.el9.x 336 kB/s | 25 kB 00:00 2024-09-20T18:21:52.163 INFO:teuthology.orchestra.run.smithi017.stdout:(1/32): ceph-base-19.1.1-369.ged8ee0f2.el9.x86_ 9.3 MB/s | 5.4 MB 00:00 2024-09-20T18:21:52.196 INFO:teuthology.orchestra.run.smithi172.stdout:(3/32): libcephfs2-19.1.1-369.ged8ee0f2.el9.x86 6.3 MB/s | 751 kB 00:00 2024-09-20T18:21:52.230 INFO:teuthology.orchestra.run.smithi017.stdout:(2/32): ceph-selinux-19.1.1-369.ged8ee0f2.el9.x 378 kB/s | 25 kB 00:00 2024-09-20T18:21:52.339 INFO:teuthology.orchestra.run.smithi017.stdout:(3/32): libcephfs2-19.1.1-369.ged8ee0f2.el9.x86 6.8 MB/s | 751 kB 00:00 2024-09-20T18:21:52.354 INFO:teuthology.orchestra.run.smithi172.stdout:(4/32): libradosstriper1-19.1.1-369.ged8ee0f2.e 3.1 MB/s | 506 kB 00:00 2024-09-20T18:21:52.439 INFO:teuthology.orchestra.run.smithi017.stdout:(4/32): libradosstriper1-19.1.1-369.ged8ee0f2.e 4.9 MB/s | 506 kB 00:00 2024-09-20T18:21:52.605 INFO:teuthology.orchestra.run.smithi172.stdout:(5/32): ceph-radosgw-19.1.1-369.ged8ee0f2.el9.x 7.3 MB/s | 11 MB 00:01 2024-09-20T18:21:52.688 INFO:teuthology.orchestra.run.smithi172.stdout:(6/32): python3-ceph-argparse-19.1.1-369.ged8ee 544 kB/s | 45 kB 00:00 2024-09-20T18:21:52.723 INFO:teuthology.orchestra.run.smithi017.stdout:(5/32): ceph-radosgw-19.1.1-369.ged8ee0f2.el9.x 9.3 MB/s | 11 MB 00:01 2024-09-20T18:21:52.755 INFO:teuthology.orchestra.run.smithi172.stdout:(7/32): python3-ceph-common-19.1.1-369.ged8ee0f 2.0 MB/s | 136 kB 00:00 2024-09-20T18:21:52.815 INFO:teuthology.orchestra.run.smithi017.stdout:(6/32): python3-ceph-argparse-19.1.1-369.ged8ee 492 kB/s | 45 kB 00:00 2024-09-20T18:21:52.847 INFO:teuthology.orchestra.run.smithi172.stdout:(8/32): python3-cephfs-19.1.1-369.ged8ee0f2.el9 1.7 MB/s | 162 kB 00:00 2024-09-20T18:21:52.907 INFO:teuthology.orchestra.run.smithi017.stdout:(7/32): python3-ceph-common-19.1.1-369.ged8ee0f 1.5 MB/s | 136 kB 00:00 2024-09-20T18:21:52.939 INFO:teuthology.orchestra.run.smithi172.stdout:(9/32): python3-rados-19.1.1-369.ged8ee0f2.el9. 3.4 MB/s | 320 kB 00:00 2024-09-20T18:21:52.982 INFO:teuthology.orchestra.run.smithi017.stdout:(8/32): librgw2-19.1.1-369.ged8ee0f2.el9.x86_64 9.9 MB/s | 5.3 MB 00:00 2024-09-20T18:21:53.007 INFO:teuthology.orchestra.run.smithi017.stdout:(9/32): python3-cephfs-19.1.1-369.ged8ee0f2.el9 1.6 MB/s | 162 kB 00:00 2024-09-20T18:21:53.039 INFO:teuthology.orchestra.run.smithi172.stdout:(10/32): librgw2-19.1.1-369.ged8ee0f2.el9.x86_6 7.8 MB/s | 5.3 MB 00:00 2024-09-20T18:21:53.129 INFO:teuthology.orchestra.run.smithi172.stdout:(11/32): python3-rbd-19.1.1-369.ged8ee0f2.el9.x 2.2 MB/s | 301 kB 00:00 2024-09-20T18:21:53.129 INFO:teuthology.orchestra.run.smithi172.stdout:(12/32): python3-rgw-19.1.1-369.ged8ee0f2.el9.x 1.7 MB/s | 99 kB 00:00 2024-09-20T18:21:53.130 INFO:teuthology.orchestra.run.smithi017.stdout:(10/32): python3-rados-19.1.1-369.ged8ee0f2.el9 5.3 MB/s | 320 kB 00:00 2024-09-20T18:21:53.130 INFO:teuthology.orchestra.run.smithi017.stdout:(11/32): python3-rbd-19.1.1-369.ged8ee0f2.el9.x 5.0 MB/s | 301 kB 00:00 2024-09-20T18:21:53.130 INFO:teuthology.orchestra.run.smithi017.stdout:(12/32): python3-rgw-19.1.1-369.ged8ee0f2.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-20T18:21:53.300 INFO:teuthology.orchestra.run.smithi017.stdout:(13/32): ceph-common-19.1.1-369.ged8ee0f2.el9.x 12 MB/s | 21 MB 00:01 2024-09-20T18:21:53.434 INFO:teuthology.orchestra.run.smithi017.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 291 kB/s | 107 kB 00:00 2024-09-20T18:21:53.451 INFO:teuthology.orchestra.run.smithi017.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 301 kB/s | 45 kB 00:00 2024-09-20T18:21:53.476 INFO:teuthology.orchestra.run.smithi017.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 417 kB/s | 160 kB 00:00 2024-09-20T18:21:53.515 INFO:teuthology.orchestra.run.smithi172.stdout:(13/32): ceph-common-19.1.1-369.ged8ee0f2.el9.x 9.0 MB/s | 21 MB 00:02 2024-09-20T18:21:53.517 INFO:teuthology.orchestra.run.smithi017.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-20T18:21:53.540 INFO:teuthology.orchestra.run.smithi172.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 229 kB/s | 107 kB 00:00 2024-09-20T18:21:53.566 INFO:teuthology.orchestra.run.smithi172.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 343 kB/s | 160 kB 00:00 2024-09-20T18:21:53.601 INFO:teuthology.orchestra.run.smithi017.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-20T18:21:53.627 INFO:teuthology.orchestra.run.smithi017.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-20T18:21:53.652 INFO:teuthology.orchestra.run.smithi017.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-09-20T18:21:53.724 INFO:teuthology.orchestra.run.smithi172.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 217 kB/s | 45 kB 00:00 2024-09-20T18:21:53.746 INFO:teuthology.orchestra.run.smithi017.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 249 kB/s | 36 kB 00:00 2024-09-20T18:21:53.808 INFO:teuthology.orchestra.run.smithi172.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.2 MB/s | 292 kB 00:00 2024-09-20T18:21:53.841 INFO:teuthology.orchestra.run.smithi172.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 361 kB/s | 42 kB 00:00 2024-09-20T18:21:53.869 INFO:teuthology.orchestra.run.smithi017.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 196 kB/s | 47 kB 00:00 2024-09-20T18:21:53.916 INFO:teuthology.orchestra.run.smithi172.stdout:(19/32): qatlib-service-24.02.0-1.el9.x86_64.rp 479 kB/s | 36 kB 00:00 2024-09-20T18:21:53.937 INFO:teuthology.orchestra.run.smithi017.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.1 MB/s | 308 kB 00:00 2024-09-20T18:21:53.965 INFO:teuthology.orchestra.run.smithi017.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-20T18:21:53.975 INFO:teuthology.orchestra.run.smithi172.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.3 MB/s | 221 kB 00:00 2024-09-20T18:21:53.987 INFO:teuthology.orchestra.run.smithi017.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 256 kB/s | 26 kB 00:00 2024-09-20T18:21:54.000 INFO:teuthology.orchestra.run.smithi172.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-09-20T18:21:54.012 INFO:teuthology.orchestra.run.smithi017.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-20T18:21:54.054 INFO:teuthology.orchestra.run.smithi017.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-20T18:21:54.059 INFO:teuthology.orchestra.run.smithi172.stdout:(22/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.6 MB/s | 308 kB 00:00 2024-09-20T18:21:54.084 INFO:teuthology.orchestra.run.smithi172.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-20T18:21:54.096 INFO:teuthology.orchestra.run.smithi017.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-20T18:21:54.110 INFO:teuthology.orchestra.run.smithi172.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-20T18:21:54.135 INFO:teuthology.orchestra.run.smithi172.stdout:(25/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.1 MB/s | 662 kB 00:00 2024-09-20T18:21:54.160 INFO:teuthology.orchestra.run.smithi172.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-20T18:21:54.172 INFO:teuthology.orchestra.run.smithi017.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-20T18:21:54.202 INFO:teuthology.orchestra.run.smithi172.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.5 MB/s | 191 kB 00:00 2024-09-20T18:21:54.255 INFO:teuthology.orchestra.run.smithi017.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 8.7 MB/s | 4.4 MB 00:00 2024-09-20T18:21:54.278 INFO:teuthology.orchestra.run.smithi172.stdout:(28/32): thrift-0.15.0-2.el9.x86_64.rpm 22 MB/s | 1.6 MB 00:00 2024-09-20T18:21:54.320 INFO:teuthology.orchestra.run.smithi172.stdout:(29/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.4 MB/s | 839 kB 00:00 2024-09-20T18:21:54.387 INFO:teuthology.orchestra.run.smithi172.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-20T18:21:54.406 INFO:teuthology.orchestra.run.smithi017.stdout:(31/32): librbd1-19.1.1-369.ged8ee0f2.el9.x86_6 14 MB/s | 3.2 MB 00:00 2024-09-20T18:21:54.472 INFO:teuthology.orchestra.run.smithi017.stdout:(32/32): librados2-19.1.1-369.ged8ee0f2.el9.x86 9.1 MB/s | 3.4 MB 00:00 2024-09-20T18:21:54.477 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:21:54.477 INFO:teuthology.orchestra.run.smithi017.stdout:Total 20 MB/s | 60 MB 00:03 2024-09-20T18:21:54.582 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-20T18:21:54.587 INFO:teuthology.orchestra.run.smithi172.stdout:(31/32): librbd1-19.1.1-369.ged8ee0f2.el9.x86_6 12 MB/s | 3.2 MB 00:00 2024-09-20T18:21:54.623 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-20T18:21:54.623 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-20T18:21:54.803 INFO:teuthology.orchestra.run.smithi172.stdout:(32/32): librados2-19.1.1-369.ged8ee0f2.el9.x86 6.5 MB/s | 3.4 MB 00:00 2024-09-20T18:21:54.808 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:21:54.809 INFO:teuthology.orchestra.run.smithi172.stdout:Total 16 MB/s | 60 MB 00:03 2024-09-20T18:21:54.913 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-20T18:21:54.949 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-20T18:21:54.949 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-20T18:21:55.291 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-20T18:21:55.291 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-20T18:21:55.641 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-20T18:21:55.642 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-20T18:21:56.825 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-20T18:21:56.916 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-20T18:21:56.944 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-20T18:21:56.977 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-20T18:21:57.001 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-20T18:21:57.027 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-20T18:21:57.121 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-20T18:21:57.196 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-20T18:21:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-20T18:21:57.225 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-20T18:21:57.259 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-20T18:21:57.281 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-20T18:21:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-20T18:21:57.304 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-20T18:21:57.475 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-20T18:21:57.528 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-20T18:21:57.668 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-20T18:21:57.738 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 7/34 2024-09-20T18:21:57.814 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 7/34 2024-09-20T18:21:57.875 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-20T18:21:57.904 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:19.1.1-369.ged8ee0f2.el9.x86_64 8/34 2024-09-20T18:21:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 9/34 2024-09-20T18:21:57.968 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 7/34 2024-09-20T18:21:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 9/34 2024-09-20T18:21:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-20T18:21:58.050 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:19.1.1-369.ged8ee0f2.el9.x 11/34 2024-09-20T18:21:58.077 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 7/34 2024-09-20T18:21:58.123 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:19.1.1-369.ged8ee0f2.el9.x86_64 12/34 2024-09-20T18:21:58.150 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:19.1.1-369.ged8ee0f2.el9.x86_64 13/34 2024-09-20T18:21:58.164 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:19.1.1-369.ged8ee0f2.el9.x86_64 8/34 2024-09-20T18:21:58.195 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 9/34 2024-09-20T18:21:58.214 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:19.1.1-369.ged8ee0f2.el9.x86_64 13/34 2024-09-20T18:21:58.249 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-20T18:21:58.258 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 9/34 2024-09-20T18:21:58.303 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-20T18:21:58.355 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:19.1.1-369.ged8ee0f2.el9.x 11/34 2024-09-20T18:21:58.360 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-20T18:21:58.392 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-20T18:21:58.424 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:19.1.1-369.ged8ee0f2.el9.x86_64 12/34 2024-09-20T18:21:58.444 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-20T18:21:58.447 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:19.1.1-369.ged8ee0f2.el9.x86_64 13/34 2024-09-20T18:21:58.473 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-20T18:21:58.502 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-20T18:21:58.503 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:19.1.1-369.ged8ee0f2.el9.x86_64 13/34 2024-09-20T18:21:58.538 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-20T18:21:58.544 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-20T18:21:58.644 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-20T18:21:58.672 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-20T18:21:58.722 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-20T18:21:58.771 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-20T18:21:58.800 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-20T18:21:58.842 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-20T18:21:58.881 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-20T18:21:58.931 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 22/34 2024-09-20T18:21:59.056 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 22/34 2024-09-20T18:21:59.086 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 23/34 2024-09-20T18:21:59.131 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-20T18:21:59.176 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-20T18:21:59.220 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 22/34 2024-09-20T18:21:59.314 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 22/34 2024-09-20T18:21:59.347 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 23/34 2024-09-20T18:21:59.386 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-20T18:21:59.642 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-20T18:21:59.667 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:19.1.1-369.ged8ee0f2.el9.x86_64 26/34 2024-09-20T18:21:59.722 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:19.1.1-369.ged8ee0f2.el9.x86_64 26/34 2024-09-20T18:21:59.801 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 27/34 2024-09-20T18:21:59.836 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86 28/34 2024-09-20T18:21:59.888 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-20T18:21:59.914 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:19.1.1-369.ged8ee0f2.el9.x86_64 26/34 2024-09-20T18:21:59.995 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:19.1.1-369.ged8ee0f2.el9.x86_64 26/34 2024-09-20T18:22:00.071 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 27/34 2024-09-20T18:22:00.100 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86 28/34 2024-09-20T18:22:02.249 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 29/34 2024-09-20T18:22:02.282 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 29/34 2024-09-20T18:22:02.406 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 29/34 2024-09-20T18:22:02.438 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 29/34 2024-09-20T18:22:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 29/34 2024-09-20T18:22:02.920 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 30/34 2024-09-20T18:22:02.996 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 29/34 2024-09-20T18:22:03.011 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 30/34 2024-09-20T18:22:03.011 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-20T18:22:03.011 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-20T18:22:03.011 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:03.046 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:19.1.1-369.ged8ee0f2.el9.x86_64 31/34 2024-09-20T18:22:03.049 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 30/34 2024-09-20T18:22:03.143 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 30/34 2024-09-20T18:22:03.143 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-20T18:22:03.143 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-20T18:22:03.143 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:03.175 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:19.1.1-369.ged8ee0f2.el9.x86_64 31/34 2024-09-20T18:22:13.190 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:19.1.1-369.ged8ee0f2.el9.x86_64 31/34 2024-09-20T18:22:13.191 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-09-20T18:22:13.191 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-09-20T18:22:13.191 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-09-20T18:22:13.191 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-09-20T18:22:13.191 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-09-20T18:22:13.191 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-09-20T18:22:13.191 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-09-20T18:22:13.191 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:13.423 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:19.1.1-369.ged8ee0f2.el9.x86_64 31/34 2024-09-20T18:22:13.423 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2024-09-20T18:22:13.423 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2024-09-20T18:22:13.423 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2024-09-20T18:22:13.423 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2024-09-20T18:22:13.423 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2024-09-20T18:22:13.423 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /root 2024-09-20T18:22:13.424 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2024-09-20T18:22:13.424 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:14.200 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 32/34 2024-09-20T18:22:14.225 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 32/34 2024-09-20T18:22:14.225 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:22:14.225 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-20T18:22:14.225 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-20T18:22:14.225 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-20T18:22:14.225 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:14.227 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-20T18:22:14.319 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-20T18:22:14.319 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-20T18:22:14.456 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 32/34 2024-09-20T18:22:14.483 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 32/34 2024-09-20T18:22:14.483 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:22:14.483 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-20T18:22:14.483 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-20T18:22:14.483 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-20T18:22:14.483 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:14.485 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-20T18:22:14.576 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-20T18:22:14.576 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-20T18:22:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-20T18:22:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/34 2024-09-20T18:22:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/34 2024-09-20T18:22:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 3/34 2024-09-20T18:22:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:19.1.1-369.ged8ee0f2.el9.x86_64 4/34 2024-09-20T18:22:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 5/34 2024-09-20T18:22:15.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:19.1.1-369.ged8ee0f2.el9.x86_64 6/34 2024-09-20T18:22:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:19.1.1-369.ged8ee0f2.el9.x86_64 7/34 2024-09-20T18:22:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:19.1.1-369.ged8ee0f2.el9.x 8/34 2024-09-20T18:22:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86 9/34 2024-09-20T18:22:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:19.1.1-369.ged8ee0f2.el9.x86_64 10/34 2024-09-20T18:22:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:19.1.1-369.ged8ee0f2.el9.x86_64 11/34 2024-09-20T18:22:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 12/34 2024-09-20T18:22:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 13/34 2024-09-20T18:22:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-20T18:22:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-20T18:22:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-20T18:22:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-20T18:22:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-20T18:22:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-20T18:22:15.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-20T18:22:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-20T18:22:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-20T18:22:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-20T18:22:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-20T18:22:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-20T18:22:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-20T18:22:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-20T18:22:15.567 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-20T18:22:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-20T18:22:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-20T18:22:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 31/34 2024-09-20T18:22:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-20T18:22:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 33/34 2024-09-20T18:22:15.836 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-20T18:22:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/34 2024-09-20T18:22:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/34 2024-09-20T18:22:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 3/34 2024-09-20T18:22:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:19.1.1-369.ged8ee0f2.el9.x86_64 4/34 2024-09-20T18:22:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 5/34 2024-09-20T18:22:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:19.1.1-369.ged8ee0f2.el9.x86_64 6/34 2024-09-20T18:22:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:19.1.1-369.ged8ee0f2.el9.x86_64 7/34 2024-09-20T18:22:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:19.1.1-369.ged8ee0f2.el9.x 8/34 2024-09-20T18:22:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86 9/34 2024-09-20T18:22:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:19.1.1-369.ged8ee0f2.el9.x86_64 10/34 2024-09-20T18:22:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:19.1.1-369.ged8ee0f2.el9.x86_64 11/34 2024-09-20T18:22:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 12/34 2024-09-20T18:22:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 13/34 2024-09-20T18:22:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-20T18:22:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-20T18:22:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-20T18:22:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-20T18:22:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-20T18:22:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-20T18:22:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-20T18:22:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-20T18:22:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-20T18:22:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-20T18:22:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-20T18:22:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-20T18:22:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-20T18:22:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-20T18:22:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-20T18:22:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-20T18:22:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-20T18:22:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 31/34 2024-09-20T18:22:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-20T18:22:15.841 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 33/34 2024-09-20T18:22:16.585 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-20T18:22:16.585 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:16.585 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-09-20T18:22:16.585 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.585 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.586 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-20T18:22:16.586 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-20T18:22:16.586 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.586 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.586 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.586 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.586 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-20T18:22:16.586 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-20T18:22:16.586 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-20T18:22:16.586 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.586 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-20T18:22:16.586 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-20T18:22:16.586 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-20T18:22:16.586 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.587 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-20T18:22:16.587 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.587 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-20T18:22:16.587 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-20T18:22:16.587 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-20T18:22:16.587 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.587 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.587 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.587 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-20T18:22:16.587 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.587 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.587 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.587 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-20T18:22:16.587 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-20T18:22:16.588 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-20T18:22:16.588 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-20.el9.x86_64 2024-09-20T18:22:16.588 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-20T18:22:16.588 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:16.588 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:22:16.759 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-20T18:22:16.759 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:16.759 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2024-09-20T18:22:16.759 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.759 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.759 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-20T18:22:16.759 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-20T18:22:16.760 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.760 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.760 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.760 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.760 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-20T18:22:16.760 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-20T18:22:16.760 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-20T18:22:16.760 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.760 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-20T18:22:16.760 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-20T18:22:16.760 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-20T18:22:16.760 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.760 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-20T18:22:16.760 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.761 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-20T18:22:16.761 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-20T18:22:16.761 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-20T18:22:16.761 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.761 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.761 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.761 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-20T18:22:16.761 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.761 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.761 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:16.761 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-20T18:22:16.761 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-20T18:22:16.761 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-20T18:22:16.761 INFO:teuthology.orchestra.run.smithi017.stdout: re2-1:20211101-20.el9.x86_64 2024-09-20T18:22:16.762 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-20T18:22:16.762 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:16.762 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:22:16.939 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-test 2024-09-20T18:22:17.141 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-test 2024-09-20T18:22:17.524 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:29 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:22:17.665 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:22:17.666 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:22:17.666 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-20T18:22:17.666 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:22:17.666 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-20T18:22:17.666 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 49 M 2024-09-20T18:22:17.666 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-20T18:22:17.666 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 163 k 2024-09-20T18:22:17.666 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-20T18:22:17.666 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-20T18:22:17.667 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:17.667 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-20T18:22:17.667 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:22:17.667 INFO:teuthology.orchestra.run.smithi172.stdout:Install 4 Packages 2024-09-20T18:22:17.667 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:17.668 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 49 M 2024-09-20T18:22:17.668 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 209 M 2024-09-20T18:22:17.668 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-20T18:22:17.740 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:28 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:22:17.849 INFO:teuthology.orchestra.run.smithi172.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.9 MB/s | 304 kB 00:00 2024-09-20T18:22:17.882 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:22:17.883 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:22:17.883 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-20T18:22:17.883 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:22:17.883 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-20T18:22:17.883 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 49 M 2024-09-20T18:22:17.883 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-20T18:22:17.883 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 163 k 2024-09-20T18:22:17.883 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-20T18:22:17.883 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-20T18:22:17.884 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:17.884 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-20T18:22:17.884 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:22:17.884 INFO:teuthology.orchestra.run.smithi017.stdout:Install 4 Packages 2024-09-20T18:22:17.884 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:17.884 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 49 M 2024-09-20T18:22:17.884 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 209 M 2024-09-20T18:22:17.884 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-20T18:22:17.924 INFO:teuthology.orchestra.run.smithi172.stdout:(2/4): libcephsqlite-19.1.1-369.ged8ee0f2.el9.x 696 kB/s | 163 kB 00:00 2024-09-20T18:22:17.949 INFO:teuthology.orchestra.run.smithi172.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 637 kB/s | 64 kB 00:00 2024-09-20T18:22:18.265 INFO:teuthology.orchestra.run.smithi017.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-20T18:22:18.290 INFO:teuthology.orchestra.run.smithi017.stdout:(2/4): libcephsqlite-19.1.1-369.ged8ee0f2.el9.x 600 kB/s | 163 kB 00:00 2024-09-20T18:22:18.316 INFO:teuthology.orchestra.run.smithi017.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-20T18:22:19.233 INFO:teuthology.orchestra.run.smithi172.stdout:(4/4): ceph-test-19.1.1-369.ged8ee0f2.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-20T18:22:19.235 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:22:19.235 INFO:teuthology.orchestra.run.smithi172.stdout:Total 31 MB/s | 49 MB 00:01 2024-09-20T18:22:19.263 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-20T18:22:19.283 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-20T18:22:19.283 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-20T18:22:19.677 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-20T18:22:19.677 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-20T18:22:20.205 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-20T18:22:20.276 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-20T18:22:20.336 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-20T18:22:20.359 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:19.1.1-369.ged8ee0f2.el9.x86_64 3/4 2024-09-20T18:22:20.724 INFO:teuthology.orchestra.run.smithi017.stdout:(4/4): ceph-test-19.1.1-369.ged8ee0f2.el9.x86_6 18 MB/s | 49 MB 00:02 2024-09-20T18:22:20.726 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:22:20.726 INFO:teuthology.orchestra.run.smithi017.stdout:Total 17 MB/s | 49 MB 00:02 2024-09-20T18:22:20.755 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-20T18:22:20.778 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-20T18:22:20.778 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-20T18:22:21.188 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-20T18:22:21.189 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-20T18:22:21.743 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-20T18:22:21.819 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-20T18:22:21.858 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-20T18:22:21.885 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:19.1.1-369.ged8ee0f2.el9.x86_64 3/4 2024-09-20T18:22:24.970 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:19.1.1-369.ged8ee0f2.el9.x86_64 3/4 2024-09-20T18:22:25.057 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:19.1.1-369.ged8ee0f2.el9.x86_64 4/4 2024-09-20T18:22:26.762 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:19.1.1-369.ged8ee0f2.el9.x86_64 3/4 2024-09-20T18:22:26.844 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:19.1.1-369.ged8ee0f2.el9.x86_64 4/4 2024-09-20T18:22:27.412 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-test-2:19.1.1-369.ged8ee0f2.el9.x86_64 4/4 2024-09-20T18:22:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/4 2024-09-20T18:22:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/4 2024-09-20T18:22:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-20T18:22:27.718 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-20T18:22:27.718 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:27.718 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-20T18:22:27.719 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:27.719 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:27.719 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-20T18:22:27.719 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-20T18:22:27.719 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:27.719 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:22:27.981 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph 2024-09-20T18:22:28.577 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:40 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:22:28.716 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:22:28.719 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:22:28.719 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-20T18:22:28.719 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:22:28.719 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-20T18:22:28.719 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 6.5 k 2024-09-20T18:22:28.719 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-20T18:22:28.719 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 2.4 M 2024-09-20T18:22:28.720 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 1.5 M 2024-09-20T18:22:28.720 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 249 k 2024-09-20T18:22:28.720 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 4.7 M 2024-09-20T18:22:28.720 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 17 M 2024-09-20T18:22:28.720 INFO:teuthology.orchestra.run.smithi172.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-20T18:22:28.720 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-20T18:22:28.720 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-20T18:22:28.720 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-20T18:22:28.720 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-20T18:22:28.720 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-20T18:22:28.720 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-20T18:22:28.720 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-20T18:22:28.720 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-20T18:22:28.721 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-20T18:22:28.721 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-20T18:22:28.721 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-20T18:22:28.721 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-20T18:22:28.721 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-20T18:22:28.721 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-20T18:22:28.721 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-20T18:22:28.721 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-20T18:22:28.721 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-20T18:22:28.721 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-20T18:22:28.721 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-20T18:22:28.721 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-20T18:22:28.721 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-20T18:22:28.721 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-20T18:22:28.722 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-20T18:22:28.722 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-20T18:22:28.722 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-20T18:22:28.722 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-20T18:22:28.722 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-20T18:22:28.722 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-20T18:22:28.722 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-20T18:22:28.722 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-20T18:22:28.722 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:28.722 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-20T18:22:28.722 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:22:28.722 INFO:teuthology.orchestra.run.smithi172.stdout:Install 37 Packages 2024-09-20T18:22:28.722 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:28.723 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 30 M 2024-09-20T18:22:28.723 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 108 M 2024-09-20T18:22:28.723 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-20T18:22:29.184 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-test-2:19.1.1-369.ged8ee0f2.el9.x86_64 4/4 2024-09-20T18:22:29.184 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/4 2024-09-20T18:22:29.184 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/4 2024-09-20T18:22:29.184 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-20T18:22:29.466 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-20T18:22:29.466 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:29.466 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-20T18:22:29.466 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:29.466 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:29.467 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-20T18:22:29.467 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-20T18:22:29.467 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:29.467 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:22:29.703 INFO:teuthology.orchestra.run.smithi172.stdout:(1/37): ceph-19.1.1-369.ged8ee0f2.el9.x86_64.rp 26 kB/s | 6.5 kB 00:00 2024-09-20T18:22:29.777 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph 2024-09-20T18:22:30.375 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:41 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:22:30.517 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:22:30.520 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:22:30.520 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-20T18:22:30.520 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:22:30.520 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-20T18:22:30.520 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 6.5 k 2024-09-20T18:22:30.521 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-20T18:22:30.521 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 2.4 M 2024-09-20T18:22:30.521 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 1.5 M 2024-09-20T18:22:30.521 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 249 k 2024-09-20T18:22:30.521 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 4.7 M 2024-09-20T18:22:30.521 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 17 M 2024-09-20T18:22:30.521 INFO:teuthology.orchestra.run.smithi017.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-20T18:22:30.521 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-20T18:22:30.521 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-20T18:22:30.521 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-20T18:22:30.521 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-20T18:22:30.521 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-20T18:22:30.521 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-20T18:22:30.521 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-20T18:22:30.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-20T18:22:30.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-20T18:22:30.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-20T18:22:30.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-20T18:22:30.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-20T18:22:30.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-20T18:22:30.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-20T18:22:30.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-20T18:22:30.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-20T18:22:30.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-20T18:22:30.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-20T18:22:30.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-20T18:22:30.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-20T18:22:30.522 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-20T18:22:30.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-20T18:22:30.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-20T18:22:30.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-20T18:22:30.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-20T18:22:30.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-20T18:22:30.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-20T18:22:30.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-20T18:22:30.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-20T18:22:30.523 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-20T18:22:30.523 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:30.523 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-20T18:22:30.523 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:22:30.523 INFO:teuthology.orchestra.run.smithi017.stdout:Install 37 Packages 2024-09-20T18:22:30.523 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:30.524 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 30 M 2024-09-20T18:22:30.524 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 108 M 2024-09-20T18:22:30.524 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-20T18:22:30.603 INFO:teuthology.orchestra.run.smithi172.stdout:(2/37): ceph-mgr-19.1.1-369.ged8ee0f2.el9.x86_6 1.3 MB/s | 1.5 MB 00:01 2024-09-20T18:22:30.779 INFO:teuthology.orchestra.run.smithi172.stdout:(3/37): ceph-mds-19.1.1-369.ged8ee0f2.el9.x86_6 1.8 MB/s | 2.4 MB 00:01 2024-09-20T18:22:30.845 INFO:teuthology.orchestra.run.smithi172.stdout:(4/37): ceph-mgr-modules-core-19.1.1-369.ged8ee 3.7 MB/s | 249 kB 00:00 2024-09-20T18:22:30.893 INFO:teuthology.orchestra.run.smithi017.stdout:(1/37): ceph-19.1.1-369.ged8ee0f2.el9.x86_64.rp 47 kB/s | 6.5 kB 00:00 2024-09-20T18:22:30.963 INFO:teuthology.orchestra.run.smithi172.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-20T18:22:31.043 INFO:teuthology.orchestra.run.smithi017.stdout:(2/37): ceph-mgr-19.1.1-369.ged8ee0f2.el9.x86_6 5.3 MB/s | 1.5 MB 00:00 2024-09-20T18:22:31.071 INFO:teuthology.orchestra.run.smithi172.stdout:(6/37): ceph-mon-19.1.1-369.ged8ee0f2.el9.x86_6 3.4 MB/s | 4.7 MB 00:01 2024-09-20T18:22:31.110 INFO:teuthology.orchestra.run.smithi017.stdout:(3/37): ceph-mds-19.1.1-369.ged8ee0f2.el9.x86_6 6.7 MB/s | 2.4 MB 00:00 2024-09-20T18:22:31.113 INFO:teuthology.orchestra.run.smithi172.stdout:(7/37): python3-cryptography-36.0.1-4.el9.x86_6 8.2 MB/s | 1.2 MB 00:00 2024-09-20T18:22:31.155 INFO:teuthology.orchestra.run.smithi172.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-20T18:22:31.177 INFO:teuthology.orchestra.run.smithi017.stdout:(4/37): ceph-mgr-modules-core-19.1.1-369.ged8ee 3.7 MB/s | 249 kB 00:00 2024-09-20T18:22:31.205 INFO:teuthology.orchestra.run.smithi172.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-20T18:22:31.239 INFO:teuthology.orchestra.run.smithi172.stdout:(10/37): python3-ply-3.11-14.el9.noarch.rpm 637 kB/s | 106 kB 00:00 2024-09-20T18:22:31.264 INFO:teuthology.orchestra.run.smithi172.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-20T18:22:31.298 INFO:teuthology.orchestra.run.smithi172.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-20T18:22:31.331 INFO:teuthology.orchestra.run.smithi172.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-20T18:22:31.356 INFO:teuthology.orchestra.run.smithi172.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 594 kB/s | 35 kB 00:00 2024-09-20T18:22:31.382 INFO:teuthology.orchestra.run.smithi172.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-20T18:22:31.385 INFO:teuthology.orchestra.run.smithi017.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-20T18:22:31.407 INFO:teuthology.orchestra.run.smithi172.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-20T18:22:31.432 INFO:teuthology.orchestra.run.smithi172.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 827 kB/s | 42 kB 00:00 2024-09-20T18:22:31.475 INFO:teuthology.orchestra.run.smithi172.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-20T18:22:31.491 INFO:teuthology.orchestra.run.smithi172.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.6 MB/s | 43 kB 00:00 2024-09-20T18:22:31.519 INFO:teuthology.orchestra.run.smithi017.stdout:(6/37): ceph-mon-19.1.1-369.ged8ee0f2.el9.x86_6 7.5 MB/s | 4.7 MB 00:00 2024-09-20T18:22:31.525 INFO:teuthology.orchestra.run.smithi172.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 5.0 MB/s | 172 kB 00:00 2024-09-20T18:22:31.575 INFO:teuthology.orchestra.run.smithi172.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 7.0 MB/s | 358 kB 00:00 2024-09-20T18:22:31.592 INFO:teuthology.orchestra.run.smithi172.stdout:(22/37): lua-devel-5.4.4-4.el9.x86_64.rpm 121 kB/s | 22 kB 00:00 2024-09-20T18:22:31.643 INFO:teuthology.orchestra.run.smithi172.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 159 kB/s | 11 kB 00:00 2024-09-20T18:22:31.676 INFO:teuthology.orchestra.run.smithi172.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 869 kB/s | 23 kB 00:00 2024-09-20T18:22:31.694 INFO:teuthology.orchestra.run.smithi017.stdout:(7/37): ceph-osd-19.1.1-369.ged8ee0f2.el9.x86_6 26 MB/s | 17 MB 00:00 2024-09-20T18:22:31.701 INFO:teuthology.orchestra.run.smithi172.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 833 kB/s | 19 kB 00:00 2024-09-20T18:22:31.727 INFO:teuthology.orchestra.run.smithi172.stdout:(26/37): python3-jaraco-classes-3.2.1-5.el9.noa 132 kB/s | 18 kB 00:00 2024-09-20T18:22:31.728 INFO:teuthology.orchestra.run.smithi017.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 3.6 MB/s | 1.2 MB 00:00 2024-09-20T18:22:31.752 INFO:teuthology.orchestra.run.smithi172.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-20T18:22:31.777 INFO:teuthology.orchestra.run.smithi172.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-09-20T18:22:31.803 INFO:teuthology.orchestra.run.smithi172.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-20T18:22:31.812 INFO:teuthology.orchestra.run.smithi017.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.5 MB/s | 125 kB 00:00 2024-09-20T18:22:31.828 INFO:teuthology.orchestra.run.smithi172.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 660 kB/s | 16 kB 00:00 2024-09-20T18:22:31.837 INFO:teuthology.orchestra.run.smithi017.stdout:(10/37): python3-ply-3.11-14.el9.noarch.rpm 335 kB/s | 106 kB 00:00 2024-09-20T18:22:31.853 INFO:teuthology.orchestra.run.smithi172.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2024-09-20T18:22:31.871 INFO:teuthology.orchestra.run.smithi017.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-20T18:22:31.879 INFO:teuthology.orchestra.run.smithi172.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-20T18:22:31.896 INFO:teuthology.orchestra.run.smithi017.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 671 kB/s | 135 kB 00:00 2024-09-20T18:22:31.906 INFO:teuthology.orchestra.run.smithi172.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 710 kB/s | 36 kB 00:00 2024-09-20T18:22:31.929 INFO:teuthology.orchestra.run.smithi172.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-20T18:22:31.954 INFO:teuthology.orchestra.run.smithi172.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 806 kB/s | 20 kB 00:00 2024-09-20T18:22:31.988 INFO:teuthology.orchestra.run.smithi172.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-09-20T18:22:32.005 INFO:teuthology.orchestra.run.smithi017.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 321 kB/s | 35 kB 00:00 2024-09-20T18:22:32.030 INFO:teuthology.orchestra.run.smithi017.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 979 kB/s | 188 kB 00:00 2024-09-20T18:22:32.089 INFO:teuthology.orchestra.run.smithi017.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 924 kB/s | 77 kB 00:00 2024-09-20T18:22:32.114 INFO:teuthology.orchestra.run.smithi017.stdout:(16/37): python3-mako-1.1.4-6.el9.noarch.rpm 709 kB/s | 172 kB 00:00 2024-09-20T18:22:32.156 INFO:teuthology.orchestra.run.smithi017.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 406 kB/s | 51 kB 00:00 2024-09-20T18:22:32.181 INFO:teuthology.orchestra.run.smithi017.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 451 kB/s | 42 kB 00:00 2024-09-20T18:22:32.240 INFO:teuthology.orchestra.run.smithi017.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-20T18:22:32.265 INFO:teuthology.orchestra.run.smithi017.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-09-20T18:22:32.297 INFO:teuthology.orchestra.run.smithi172.stdout:(37/37): ceph-osd-19.1.1-369.ged8ee0f2.el9.x86_ 10 MB/s | 17 MB 00:01 2024-09-20T18:22:32.298 INFO:teuthology.orchestra.run.smithi017.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 371 kB/s | 43 kB 00:00 2024-09-20T18:22:32.301 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:22:32.301 INFO:teuthology.orchestra.run.smithi172.stdout:Total 8.5 MB/s | 30 MB 00:03 2024-09-20T18:22:32.324 INFO:teuthology.orchestra.run.smithi017.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 462 kB/s | 11 kB 00:00 2024-09-20T18:22:32.349 INFO:teuthology.orchestra.run.smithi017.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-20T18:22:32.374 INFO:teuthology.orchestra.run.smithi017.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-09-20T18:22:32.400 INFO:teuthology.orchestra.run.smithi017.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-20T18:22:32.425 INFO:teuthology.orchestra.run.smithi017.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-20T18:22:32.441 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-20T18:22:32.450 INFO:teuthology.orchestra.run.smithi017.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-20T18:22:32.476 INFO:teuthology.orchestra.run.smithi017.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 925 kB/s | 46 kB 00:00 2024-09-20T18:22:32.481 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-20T18:22:32.481 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-20T18:22:32.501 INFO:teuthology.orchestra.run.smithi017.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-20T18:22:32.526 INFO:teuthology.orchestra.run.smithi017.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 661 kB/s | 16 kB 00:00 2024-09-20T18:22:32.552 INFO:teuthology.orchestra.run.smithi017.stdout:(31/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-09-20T18:22:32.577 INFO:teuthology.orchestra.run.smithi017.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-20T18:22:32.602 INFO:teuthology.orchestra.run.smithi017.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-20T18:22:32.627 INFO:teuthology.orchestra.run.smithi017.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-20T18:22:32.653 INFO:teuthology.orchestra.run.smithi017.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 801 kB/s | 20 kB 00:00 2024-09-20T18:22:32.678 INFO:teuthology.orchestra.run.smithi017.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-20T18:22:32.720 INFO:teuthology.orchestra.run.smithi017.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.5 MB/s | 427 kB 00:00 2024-09-20T18:22:32.724 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:22:32.724 INFO:teuthology.orchestra.run.smithi017.stdout:Total 14 MB/s | 30 MB 00:02 2024-09-20T18:22:32.882 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-20T18:22:32.926 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-20T18:22:32.927 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-20T18:22:32.953 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-20T18:22:32.954 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-20T18:22:33.439 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-20T18:22:33.439 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-20T18:22:34.298 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-20T18:22:34.366 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-20T18:22:34.399 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-20T18:22:34.435 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-20T18:22:34.508 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-20T18:22:34.559 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-20T18:22:34.591 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-20T18:22:34.684 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-20T18:22:34.763 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-20T18:22:34.804 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-20T18:22:34.809 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-20T18:22:34.838 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-20T18:22:34.868 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-20T18:22:34.876 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-20T18:22:34.903 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-20T18:22:34.910 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-20T18:22:34.936 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-20T18:22:34.937 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-20T18:22:34.977 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-20T18:22:35.014 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-20T18:22:35.044 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-20T18:22:35.079 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-20T18:22:35.079 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-20T18:22:35.111 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-20T18:22:35.135 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-20T18:22:35.176 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-20T18:22:35.208 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-20T18:22:35.250 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-20T18:22:35.294 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-20T18:22:35.340 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-20T18:22:35.375 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-20T18:22:35.387 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-20T18:22:35.404 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-20T18:22:35.439 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-20T18:22:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-20T18:22:35.472 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-20T18:22:35.513 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-20T18:22:35.520 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-20T18:22:35.557 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-20T18:22:35.567 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-20T18:22:35.599 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-20T18:22:35.615 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-20T18:22:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-20T18:22:35.679 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-20T18:22:35.705 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-20T18:22:35.782 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-20T18:22:35.873 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-20T18:22:35.921 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-20T18:22:35.935 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-20T18:22:35.998 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-20T18:22:36.016 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-20T18:22:36.067 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-20T18:22:36.090 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-20T18:22:36.105 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-20T18:22:36.130 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-20T18:22:36.164 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-20T18:22:36.229 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-20T18:22:36.246 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-20T18:22:36.419 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-369.ged8ee0f2.el9.n 32/37 2024-09-20T18:22:36.439 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-20T18:22:36.449 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 33/37 2024-09-20T18:22:36.475 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 33/37 2024-09-20T18:22:36.475 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:22:36.476 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-20T18:22:36.476 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-20T18:22:36.476 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-20T18:22:36.476 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:36.486 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-20T18:22:36.568 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-20T18:22:36.666 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-20T18:22:36.710 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-20T18:22:36.833 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-20T18:22:37.017 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-369.ged8ee0f2.el9.n 32/37 2024-09-20T18:22:37.045 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 33/37 2024-09-20T18:22:37.073 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 33/37 2024-09-20T18:22:37.073 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:22:37.073 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-20T18:22:37.073 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-20T18:22:37.073 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-20T18:22:37.073 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:37.933 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:19.1.1-369.ged8ee0f2.el9.x86_64 34/37 2024-09-20T18:22:37.960 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:19.1.1-369.ged8ee0f2.el9.x86_64 34/37 2024-09-20T18:22:37.960 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:22:37.960 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-20T18:22:37.960 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-20T18:22:37.960 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-20T18:22:37.960 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:38.417 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:19.1.1-369.ged8ee0f2.el9.x86_64 35/37 2024-09-20T18:22:38.440 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:19.1.1-369.ged8ee0f2.el9.x86_64 35/37 2024-09-20T18:22:38.440 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:22:38.440 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-20T18:22:38.440 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-20T18:22:38.440 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-20T18:22:38.440 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:38.620 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:19.1.1-369.ged8ee0f2.el9.x86_64 34/37 2024-09-20T18:22:38.650 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:19.1.1-369.ged8ee0f2.el9.x86_64 34/37 2024-09-20T18:22:38.650 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:22:38.650 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-20T18:22:38.650 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-20T18:22:38.650 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-20T18:22:38.650 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:38.668 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:19.1.1-369.ged8ee0f2.el9.x86_64 36/37 2024-09-20T18:22:38.692 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:19.1.1-369.ged8ee0f2.el9.x86_64 36/37 2024-09-20T18:22:38.692 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:22:38.692 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-20T18:22:38.692 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-20T18:22:38.692 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-20T18:22:38.692 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:38.757 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:19.1.1-369.ged8ee0f2.el9.x86_64 37/37 2024-09-20T18:22:39.122 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:19.1.1-369.ged8ee0f2.el9.x86_64 35/37 2024-09-20T18:22:39.146 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:19.1.1-369.ged8ee0f2.el9.x86_64 35/37 2024-09-20T18:22:39.147 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:22:39.147 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-20T18:22:39.147 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-20T18:22:39.147 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-20T18:22:39.147 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:39.389 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:19.1.1-369.ged8ee0f2.el9.x86_64 36/37 2024-09-20T18:22:39.414 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:19.1.1-369.ged8ee0f2.el9.x86_64 36/37 2024-09-20T18:22:39.414 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:22:39.414 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-20T18:22:39.414 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-20T18:22:39.414 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-20T18:22:39.414 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:39.481 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:19.1.1-369.ged8ee0f2.el9.x86_64 37/37 2024-09-20T18:22:40.582 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-2:19.1.1-369.ged8ee0f2.el9.x86_64 37/37 2024-09-20T18:22:40.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/37 2024-09-20T18:22:40.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/37 2024-09-20T18:22:40.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 3/37 2024-09-20T18:22:40.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:19.1.1-369.ged8ee0f2.el9.x86_64 4/37 2024-09-20T18:22:40.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:19.1.1-369.ged8ee0f2.el9.x86_64 5/37 2024-09-20T18:22:40.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-369.ged8ee0f2.el9.n 6/37 2024-09-20T18:22:40.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-20T18:22:40.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-20T18:22:40.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-20T18:22:40.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-20T18:22:40.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-20T18:22:40.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-20T18:22:40.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-20T18:22:40.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-20T18:22:40.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-20T18:22:40.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-20T18:22:40.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-20T18:22:40.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-20T18:22:40.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-20T18:22:40.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-20T18:22:40.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-20T18:22:40.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-20T18:22:40.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-20T18:22:40.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-20T18:22:40.583 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-20T18:22:40.584 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-20T18:22:40.584 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-20T18:22:40.584 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-20T18:22:40.584 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-20T18:22:40.584 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-20T18:22:40.584 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-20T18:22:40.584 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-20T18:22:40.584 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-20T18:22:40.584 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-20T18:22:40.584 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-20T18:22:40.584 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-20T18:22:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-2:19.1.1-369.ged8ee0f2.el9.x86_64 37/37 2024-09-20T18:22:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/37 2024-09-20T18:22:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/37 2024-09-20T18:22:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 3/37 2024-09-20T18:22:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:19.1.1-369.ged8ee0f2.el9.x86_64 4/37 2024-09-20T18:22:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:19.1.1-369.ged8ee0f2.el9.x86_64 5/37 2024-09-20T18:22:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-369.ged8ee0f2.el9.n 6/37 2024-09-20T18:22:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-20T18:22:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-20T18:22:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-20T18:22:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-20T18:22:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-20T18:22:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-20T18:22:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-20T18:22:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-20T18:22:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-20T18:22:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-20T18:22:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-20T18:22:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-20T18:22:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-20T18:22:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-20T18:22:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-20T18:22:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-20T18:22:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-20T18:22:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-20T18:22:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-20T18:22:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-20T18:22:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-20T18:22:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-20T18:22:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-20T18:22:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-20T18:22:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-20T18:22:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-20T18:22:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-20T18:22:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-20T18:22:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-20T18:22:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-20T18:22:41.363 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-20T18:22:41.363 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:41.363 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-20T18:22:41.363 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:41.363 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:41.363 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:41.364 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:22:41.364 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:41.364 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:41.364 INFO:teuthology.orchestra.run.smithi172.stdout: lua-5.4.4-4.el9.x86_64 2024-09-20T18:22:41.364 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-20T18:22:41.364 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-20T18:22:41.364 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-20T18:22:41.364 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-20T18:22:41.364 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-20T18:22:41.364 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-20T18:22:41.364 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-20T18:22:41.364 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-20T18:22:41.364 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-20T18:22:41.364 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-20T18:22:41.365 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-20T18:22:41.365 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-20T18:22:41.365 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-20T18:22:41.365 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-20T18:22:41.365 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-20T18:22:41.365 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-20T18:22:41.365 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-20T18:22:41.365 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-20T18:22:41.365 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-09-20T18:22:41.365 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-20T18:22:41.365 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-20T18:22:41.365 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-20T18:22:41.366 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-20T18:22:41.366 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-20T18:22:41.366 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-20T18:22:41.366 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-20T18:22:41.366 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-20T18:22:41.366 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-20T18:22:41.366 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-20T18:22:41.366 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-20T18:22:41.366 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:41.366 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:22:41.720 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-base 2024-09-20T18:22:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-20T18:22:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:42.273 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-20T18:22:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:22:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: lua-5.4.4-4.el9.x86_64 2024-09-20T18:22:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-20T18:22:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-20T18:22:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-20T18:22:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-20T18:22:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-20T18:22:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-20T18:22:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-20T18:22:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-20T18:22:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-20T18:22:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-20T18:22:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-20T18:22:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-20T18:22:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-20T18:22:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-20T18:22:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-20T18:22:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-20T18:22:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-20T18:22:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-20T18:22:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply-3.11-14.el9.noarch 2024-09-20T18:22:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-20T18:22:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-20T18:22:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-20T18:22:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-20T18:22:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-20T18:22:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-20T18:22:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-20T18:22:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-20T18:22:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-20T18:22:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-20T18:22:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-20T18:22:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:42.276 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:22:42.300 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:54 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:22:42.389 INFO:teuthology.orchestra.run.smithi172.stdout:Package ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:22:42.431 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:22:42.432 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-20T18:22:42.432 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:22:42.511 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install cephadm 2024-09-20T18:22:42.594 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-base 2024-09-20T18:22:43.088 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:55 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:22:43.196 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:54 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:22:43.217 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:22:43.218 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:22:43.218 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-20T18:22:43.218 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:22:43.218 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-20T18:22:43.218 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 765 k 2024-09-20T18:22:43.218 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:43.218 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-20T18:22:43.218 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:22:43.218 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-20T18:22:43.219 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:43.219 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 765 k 2024-09-20T18:22:43.219 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 771 k 2024-09-20T18:22:43.219 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-20T18:22:43.289 INFO:teuthology.orchestra.run.smithi017.stdout:Package ceph-base-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:22:43.334 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:22:43.335 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-20T18:22:43.335 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:22:43.390 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install cephadm 2024-09-20T18:22:43.500 INFO:teuthology.orchestra.run.smithi172.stdout:cephadm-19.1.1-369.ged8ee0f2.el9.noarch.rpm 2.7 MB/s | 765 kB 00:00 2024-09-20T18:22:43.500 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:22:43.500 INFO:teuthology.orchestra.run.smithi172.stdout:Total 2.6 MB/s | 765 kB 00:00 2024-09-20T18:22:43.501 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-20T18:22:43.506 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-20T18:22:43.506 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-20T18:22:43.511 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-20T18:22:43.512 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-20T18:22:43.587 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-20T18:22:43.940 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/1 2024-09-20T18:22:43.992 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:54 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:22:44.020 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/1 2024-09-20T18:22:44.130 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:22:44.130 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:22:44.130 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-20T18:22:44.130 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:22:44.130 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-20T18:22:44.130 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 765 k 2024-09-20T18:22:44.131 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:44.131 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-20T18:22:44.131 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:22:44.131 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-20T18:22:44.131 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:44.131 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 765 k 2024-09-20T18:22:44.131 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 771 k 2024-09-20T18:22:44.132 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-20T18:22:44.390 INFO:teuthology.orchestra.run.smithi017.stdout:cephadm-19.1.1-369.ged8ee0f2.el9.noarch.rpm 2.9 MB/s | 765 kB 00:00 2024-09-20T18:22:44.390 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:22:44.391 INFO:teuthology.orchestra.run.smithi017.stdout:Total 2.9 MB/s | 765 kB 00:00 2024-09-20T18:22:44.391 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-20T18:22:44.397 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-20T18:22:44.397 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-20T18:22:44.403 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-20T18:22:44.403 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-20T18:22:44.409 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/1 2024-09-20T18:22:44.482 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-20T18:22:44.632 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/1 2024-09-20T18:22:44.633 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:44.633 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-20T18:22:44.633 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:22:44.633 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:44.633 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:22:44.845 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-immutable-object-cache 2024-09-20T18:22:44.975 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/1 2024-09-20T18:22:45.064 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/1 2024-09-20T18:22:45.405 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/1 2024-09-20T18:22:45.447 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:57 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:22:45.581 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:22:45.582 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:22:45.582 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-09-20T18:22:45.582 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:22:45.583 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-20T18:22:45.583 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 145 k 2024-09-20T18:22:45.583 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:45.583 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-20T18:22:45.583 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:22:45.583 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-20T18:22:45.583 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:45.583 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 145 k 2024-09-20T18:22:45.583 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 436 k 2024-09-20T18:22:45.583 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-20T18:22:45.660 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/1 2024-09-20T18:22:45.660 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:45.660 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-20T18:22:45.660 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:22:45.660 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:45.661 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:22:45.772 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-immutable-object-cache-19.1.1-369.ged8ee0f 769 kB/s | 145 kB 00:00 2024-09-20T18:22:45.772 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:22:45.773 INFO:teuthology.orchestra.run.smithi172.stdout:Total 763 kB/s | 145 kB 00:00 2024-09-20T18:22:45.773 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-20T18:22:45.780 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-20T18:22:45.780 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-20T18:22:45.837 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-20T18:22:45.838 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-20T18:22:45.895 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-immutable-object-cache 2024-09-20T18:22:45.982 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-20T18:22:46.039 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-369.ged8ee0f2.e 1/1 2024-09-20T18:22:46.065 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-369.ged8ee0f2.e 1/1 2024-09-20T18:22:46.065 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:22:46.065 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-20T18:22:46.065 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:46.507 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:57 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:22:46.649 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:22:46.649 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:22:46.649 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-09-20T18:22:46.649 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:22:46.650 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-20T18:22:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 145 k 2024-09-20T18:22:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:46.650 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-20T18:22:46.650 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:22:46.650 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-20T18:22:46.650 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:46.650 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 145 k 2024-09-20T18:22:46.651 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 436 k 2024-09-20T18:22:46.651 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-20T18:22:46.973 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-369.ged8ee0f2.e 1/1 2024-09-20T18:22:46.973 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:46.973 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-20T18:22:46.973 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:46.973 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:46.973 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:22:46.996 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-immutable-object-cache-19.1.1-369.ged8ee0f 420 kB/s | 145 kB 00:00 2024-09-20T18:22:46.996 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:22:46.997 INFO:teuthology.orchestra.run.smithi017.stdout:Total 418 kB/s | 145 kB 00:00 2024-09-20T18:22:46.997 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-20T18:22:47.005 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-20T18:22:47.006 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-20T18:22:47.067 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-20T18:22:47.067 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-20T18:22:47.213 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-20T18:22:47.219 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr 2024-09-20T18:22:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-369.ged8ee0f2.e 1/1 2024-09-20T18:22:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-369.ged8ee0f2.e 1/1 2024-09-20T18:22:47.299 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:22:47.299 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-20T18:22:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:47.814 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:59 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:22:47.906 INFO:teuthology.orchestra.run.smithi172.stdout:Package ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:22:47.949 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:22:47.950 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-20T18:22:47.950 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:22:48.019 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-dashboard 2024-09-20T18:22:48.278 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-369.ged8ee0f2.e 1/1 2024-09-20T18:22:48.278 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:48.278 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-20T18:22:48.279 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:22:48.279 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:48.279 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:22:48.501 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr 2024-09-20T18:22:48.595 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:00 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:22:48.729 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:22:48.730 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:22:48.730 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-20T18:22:48.730 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:22:48.731 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-20T18:22:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 3.6 M 2024-09-20T18:22:48.731 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-20T18:22:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-20T18:22:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 32 k 2024-09-20T18:22:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 16 k 2024-09-20T18:22:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-20T18:22:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-20T18:22:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-20T18:22:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-20T18:22:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-20T18:22:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-20T18:22:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-20T18:22:48.731 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-20T18:22:48.732 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:48.732 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-20T18:22:48.732 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:22:48.732 INFO:teuthology.orchestra.run.smithi172.stdout:Install 12 Packages 2024-09-20T18:22:48.732 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:48.732 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 8.7 M 2024-09-20T18:22:48.732 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 105 M 2024-09-20T18:22:48.732 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-20T18:22:49.111 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:00 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:22:49.202 INFO:teuthology.orchestra.run.smithi017.stdout:Package ceph-mgr-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:22:49.247 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:22:49.248 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-20T18:22:49.248 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:22:49.309 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-dashboard 2024-09-20T18:22:49.341 INFO:teuthology.orchestra.run.smithi172.stdout:(1/12): ceph-grafana-dashboards-19.1.1-369.ged8 144 kB/s | 32 kB 00:00 2024-09-20T18:22:49.366 INFO:teuthology.orchestra.run.smithi172.stdout:(2/12): ceph-prometheus-alerts-19.1.1-369.ged8e 67 kB/s | 16 kB 00:00 2024-09-20T18:22:49.492 INFO:teuthology.orchestra.run.smithi172.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.1 MB/s | 269 kB 00:00 2024-09-20T18:22:49.542 INFO:teuthology.orchestra.run.smithi172.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-09-20T18:22:49.601 INFO:teuthology.orchestra.run.smithi172.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-20T18:22:49.626 INFO:teuthology.orchestra.run.smithi172.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 787 kB/s | 19 kB 00:00 2024-09-20T18:22:49.693 INFO:teuthology.orchestra.run.smithi172.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-20T18:22:49.718 INFO:teuthology.orchestra.run.smithi172.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.6 MB/s | 144 kB 00:00 2024-09-20T18:22:49.744 INFO:teuthology.orchestra.run.smithi172.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-20T18:22:49.777 INFO:teuthology.orchestra.run.smithi172.stdout:(10/12): protobuf-compiler-3.14.0-13.el9.x86_64 3.0 MB/s | 863 kB 00:00 2024-09-20T18:22:49.802 INFO:teuthology.orchestra.run.smithi172.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.2 MB/s | 188 kB 00:00 2024-09-20T18:22:49.907 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:00 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:22:50.045 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:22:50.047 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:22:50.047 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-20T18:22:50.047 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:22:50.047 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-20T18:22:50.047 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 3.6 M 2024-09-20T18:22:50.047 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-20T18:22:50.047 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-20T18:22:50.047 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 32 k 2024-09-20T18:22:50.047 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 16 k 2024-09-20T18:22:50.047 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-20T18:22:50.047 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-20T18:22:50.047 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-20T18:22:50.048 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-20T18:22:50.048 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-20T18:22:50.048 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-20T18:22:50.048 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-20T18:22:50.048 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-20T18:22:50.048 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:50.048 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-20T18:22:50.048 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:22:50.048 INFO:teuthology.orchestra.run.smithi017.stdout:Install 12 Packages 2024-09-20T18:22:50.048 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:50.049 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 8.7 M 2024-09-20T18:22:50.049 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 105 M 2024-09-20T18:22:50.049 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-20T18:22:50.128 INFO:teuthology.orchestra.run.smithi172.stdout:(12/12): ceph-mgr-dashboard-19.1.1-369.ged8ee0f 3.5 MB/s | 3.6 MB 00:01 2024-09-20T18:22:50.131 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:22:50.131 INFO:teuthology.orchestra.run.smithi172.stdout:Total 6.2 MB/s | 8.7 MB 00:01 2024-09-20T18:22:50.181 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-20T18:22:50.199 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-20T18:22:50.199 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-20T18:22:50.422 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-20T18:22:50.423 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-20T18:22:50.626 INFO:teuthology.orchestra.run.smithi017.stdout:(1/12): ceph-grafana-dashboards-19.1.1-369.ged8 215 kB/s | 32 kB 00:00 2024-09-20T18:22:50.642 INFO:teuthology.orchestra.run.smithi017.stdout:(2/12): ceph-prometheus-alerts-19.1.1-369.ged8e 100 kB/s | 16 kB 00:00 2024-09-20T18:22:50.776 INFO:teuthology.orchestra.run.smithi017.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.0 MB/s | 269 kB 00:00 2024-09-20T18:22:50.826 INFO:teuthology.orchestra.run.smithi017.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-09-20T18:22:50.885 INFO:teuthology.orchestra.run.smithi017.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-20T18:22:50.910 INFO:teuthology.orchestra.run.smithi017.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-20T18:22:50.952 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-20T18:22:50.969 INFO:teuthology.orchestra.run.smithi017.stdout:(7/12): ceph-mgr-dashboard-19.1.1-369.ged8ee0f2 7.3 MB/s | 3.6 MB 00:00 2024-09-20T18:22:51.019 INFO:teuthology.orchestra.run.smithi017.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.5 MB/s | 863 kB 00:00 2024-09-20T18:22:51.028 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-20T18:22:51.053 INFO:teuthology.orchestra.run.smithi017.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.7 MB/s | 144 kB 00:00 2024-09-20T18:22:51.063 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-20T18:22:51.078 INFO:teuthology.orchestra.run.smithi017.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 543 kB/s | 31 kB 00:00 2024-09-20T18:22:51.103 INFO:teuthology.orchestra.run.smithi017.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.8 MB/s | 188 kB 00:00 2024-09-20T18:22:51.117 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-20T18:22:51.153 INFO:teuthology.orchestra.run.smithi017.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 8.4 MB/s | 2.0 MB 00:00 2024-09-20T18:22:51.157 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:22:51.157 INFO:teuthology.orchestra.run.smithi017.stdout:Total 7.8 MB/s | 8.7 MB 00:01 2024-09-20T18:22:51.157 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-20T18:22:51.206 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-20T18:22:51.224 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-20T18:22:51.224 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-20T18:22:51.255 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-20T18:22:51.382 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-20T18:22:51.441 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-20T18:22:51.441 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-20T18:22:51.475 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-20T18:22:51.520 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-20T18:22:51.549 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-20T18:22:51.588 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-369.ged8ee0f2.el9. 10/12 2024-09-20T18:22:51.992 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-20T18:22:52.072 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-20T18:22:52.115 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-20T18:22:52.163 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-20T18:22:52.191 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-20T18:22:52.293 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-20T18:22:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-20T18:22:52.525 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-20T18:22:52.581 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-20T18:22:52.617 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-20T18:22:52.643 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-369.ged8ee0f2.el9 11/12 2024-09-20T18:22:52.648 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-369.ged8ee0f2.el9. 10/12 2024-09-20T18:22:52.681 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-369.ged8ee0f2.el9.noar 12/12 2024-09-20T18:22:53.776 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-369.ged8ee0f2.el9 11/12 2024-09-20T18:22:53.858 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-369.ged8ee0f2.el9.noar 12/12 2024-09-20T18:22:54.103 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-369.ged8ee0f2.el9.noar 12/12 2024-09-20T18:22:54.103 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-369.ged8ee0f2.el9 1/12 2024-09-20T18:22:54.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-369.ged8ee0f2.el9.noar 2/12 2024-09-20T18:22:54.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-369.ged8ee0f2.el9. 3/12 2024-09-20T18:22:54.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-20T18:22:54.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-20T18:22:54.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-20T18:22:54.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-20T18:22:54.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-20T18:22:54.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-20T18:22:54.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-20T18:22:54.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-20T18:22:54.431 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-20T18:22:54.431 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:54.431 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-20T18:22:54.431 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-20T18:22:54.431 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:22:54.431 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:22:54.431 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:22:54.431 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-20T18:22:54.431 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-20T18:22:54.432 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-20T18:22:54.432 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-20T18:22:54.432 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-20T18:22:54.432 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-20T18:22:54.432 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-20T18:22:54.432 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-20T18:22:54.432 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:54.432 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:22:54.683 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-20T18:22:55.230 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-369.ged8ee0f2.el9.noar 12/12 2024-09-20T18:22:55.230 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-369.ged8ee0f2.el9 1/12 2024-09-20T18:22:55.230 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-369.ged8ee0f2.el9.noar 2/12 2024-09-20T18:22:55.230 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-369.ged8ee0f2.el9. 3/12 2024-09-20T18:22:55.230 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-20T18:22:55.230 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-20T18:22:55.230 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-20T18:22:55.231 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-20T18:22:55.231 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-20T18:22:55.231 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-20T18:22:55.231 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-20T18:22:55.231 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-20T18:22:55.265 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:07 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:22:55.399 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:22:55.400 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================== 2024-09-20T18:22:55.400 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-20T18:22:55.400 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================== 2024-09-20T18:22:55.400 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-20T18:22:55.400 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 7.4 M 2024-09-20T18:22:55.400 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-20T18:22:55.400 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-20T18:22:55.400 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-20T18:22:55.400 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-20T18:22:55.400 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-20T18:22:55.400 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-20T18:22:55.400 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-20T18:22:55.401 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-20T18:22:55.401 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-20T18:22:55.401 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-20T18:22:55.401 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-20T18:22:55.401 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-20T18:22:55.401 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:55.401 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-20T18:22:55.401 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================== 2024-09-20T18:22:55.401 INFO:teuthology.orchestra.run.smithi172.stdout:Install 12 Packages 2024-09-20T18:22:55.401 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:22:55.402 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 38 M 2024-09-20T18:22:55.402 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 212 M 2024-09-20T18:22:55.402 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-20T18:22:55.561 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-20T18:22:55.561 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:55.561 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-20T18:22:55.561 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-20T18:22:55.561 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:22:55.561 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:22:55.561 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:22:55.561 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-20T18:22:55.561 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-20T18:22:55.562 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-20T18:22:55.562 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-20T18:22:55.562 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-20T18:22:55.562 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-20T18:22:55.562 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-20T18:22:55.562 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-20T18:22:55.562 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:55.562 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:22:55.785 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-20T18:22:55.851 INFO:teuthology.orchestra.run.smithi172.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-20T18:22:55.885 INFO:teuthology.orchestra.run.smithi172.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.4 MB/s | 801 kB 00:00 2024-09-20T18:22:55.969 INFO:teuthology.orchestra.run.smithi172.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 281 kB/s | 33 kB 00:00 2024-09-20T18:22:56.027 INFO:teuthology.orchestra.run.smithi172.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 312 kB/s | 18 kB 00:00 2024-09-20T18:22:56.111 INFO:teuthology.orchestra.run.smithi172.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 462 kB/s | 38 kB 00:00 2024-09-20T18:22:56.186 INFO:teuthology.orchestra.run.smithi172.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.9 MB/s | 3.0 MB 00:00 2024-09-20T18:22:56.328 INFO:teuthology.orchestra.run.smithi172.stdout:(7/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 23 MB/s | 4.9 MB 00:00 2024-09-20T18:22:56.353 INFO:teuthology.orchestra.run.smithi172.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-20T18:22:56.392 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:07 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:22:56.470 INFO:teuthology.orchestra.run.smithi172.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-09-20T18:22:56.495 INFO:teuthology.orchestra.run.smithi172.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.7 MB/s | 250 kB 00:00 2024-09-20T18:22:56.530 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:22:56.531 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-09-20T18:22:56.531 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-20T18:22:56.532 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-09-20T18:22:56.532 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-20T18:22:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 7.4 M 2024-09-20T18:22:56.532 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-20T18:22:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-20T18:22:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-20T18:22:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-20T18:22:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-20T18:22:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-20T18:22:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-20T18:22:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-20T18:22:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-20T18:22:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-20T18:22:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-20T18:22:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-20T18:22:56.533 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:56.533 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-20T18:22:56.533 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-09-20T18:22:56.533 INFO:teuthology.orchestra.run.smithi017.stdout:Install 12 Packages 2024-09-20T18:22:56.533 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:22:56.533 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 38 M 2024-09-20T18:22:56.534 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 212 M 2024-09-20T18:22:56.534 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-20T18:22:56.963 INFO:teuthology.orchestra.run.smithi172.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-20T18:22:57.145 INFO:teuthology.orchestra.run.smithi017.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 893 kB/s | 191 kB 00:00 2024-09-20T18:22:57.262 INFO:teuthology.orchestra.run.smithi017.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-09-20T18:22:57.296 INFO:teuthology.orchestra.run.smithi017.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.1 MB/s | 801 kB 00:00 2024-09-20T18:22:57.304 INFO:teuthology.orchestra.run.smithi172.stdout:(12/12): ceph-mgr-diskprediction-local-19.1.1-3 4.6 MB/s | 7.4 MB 00:01 2024-09-20T18:22:57.305 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:22:57.306 INFO:teuthology.orchestra.run.smithi172.stdout:Total 20 MB/s | 38 MB 00:01 2024-09-20T18:22:57.421 INFO:teuthology.orchestra.run.smithi017.stdout:(4/12): ceph-mgr-diskprediction-local-19.1.1-36 15 MB/s | 7.4 MB 00:00 2024-09-20T18:22:57.446 INFO:teuthology.orchestra.run.smithi017.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 121 kB/s | 18 kB 00:00 2024-09-20T18:22:57.538 INFO:teuthology.orchestra.run.smithi017.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 329 kB/s | 38 kB 00:00 2024-09-20T18:22:57.660 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-20T18:22:57.686 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-20T18:22:57.686 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-20T18:22:57.689 INFO:teuthology.orchestra.run.smithi017.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-20T18:22:58.111 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-20T18:22:58.111 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-20T18:22:58.122 INFO:teuthology.orchestra.run.smithi017.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.5 MB/s | 3.0 MB 00:00 2024-09-20T18:22:58.265 INFO:teuthology.orchestra.run.smithi017.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.7 MB/s | 250 kB 00:00 2024-09-20T18:22:58.523 INFO:teuthology.orchestra.run.smithi017.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.1 MB/s | 5.1 MB 00:00 2024-09-20T18:22:58.871 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-20T18:22:58.951 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-20T18:22:59.002 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-20T18:22:59.110 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-20T18:22:59.145 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-20T18:22:59.331 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-20T18:22:59.361 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-20T18:22:59.390 INFO:teuthology.orchestra.run.smithi017.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.5 MB/s | 4.9 MB 00:01 2024-09-20T18:22:59.438 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-20T18:23:00.103 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-20T18:23:00.228 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-20T18:23:01.450 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-20T18:23:02.478 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-20T18:23:02.501 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-369.ged8ee0 12/12 2024-09-20T18:23:05.091 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-369.ged8ee0 12/12 2024-09-20T18:23:05.091 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-369.ged8ee0 1/12 2024-09-20T18:23:05.091 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-20T18:23:05.091 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-20T18:23:05.091 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-20T18:23:05.091 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-20T18:23:05.091 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-20T18:23:05.091 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-20T18:23:05.091 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-20T18:23:05.092 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-20T18:23:05.092 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-20T18:23:05.092 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-20T18:23:05.539 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-20T18:23:05.539 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:05.539 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-20T18:23:05.539 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:23:05.539 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-20T18:23:05.539 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-20T18:23:05.539 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-20T18:23:05.539 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-20T18:23:05.540 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-20T18:23:05.540 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-20T18:23:05.540 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-20T18:23:05.540 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-20T18:23:05.540 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-20T18:23:05.540 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-20T18:23:05.540 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-20T18:23:05.540 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:05.540 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:23:05.905 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-rook 2024-09-20T18:23:06.181 INFO:teuthology.orchestra.run.smithi017.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.1 MB/s | 16 MB 00:07 2024-09-20T18:23:06.182 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:23:06.183 INFO:teuthology.orchestra.run.smithi017.stdout:Total 4.0 MB/s | 38 MB 00:09 2024-09-20T18:23:06.492 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:18 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:23:06.553 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-20T18:23:06.580 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-20T18:23:06.580 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-20T18:23:06.624 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:23:06.625 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:06.625 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-20T18:23:06.625 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:06.625 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-20T18:23:06.625 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 49 k 2024-09-20T18:23:06.625 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-20T18:23:06.625 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-20T18:23:06.626 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-20T18:23:06.626 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-20T18:23:06.626 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-20T18:23:06.626 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-20T18:23:06.626 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-20T18:23:06.626 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-20T18:23:06.626 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-20T18:23:06.626 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-20T18:23:06.626 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-20T18:23:06.626 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-20T18:23:06.626 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-20T18:23:06.626 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:06.626 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-20T18:23:06.627 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:06.627 INFO:teuthology.orchestra.run.smithi172.stdout:Install 13 Packages 2024-09-20T18:23:06.627 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:06.627 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 2.2 M 2024-09-20T18:23:06.627 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 26 M 2024-09-20T18:23:06.627 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-20T18:23:06.984 INFO:teuthology.orchestra.run.smithi172.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 211 kB/s | 19 kB 00:00 2024-09-20T18:23:07.009 INFO:teuthology.orchestra.run.smithi172.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 221 kB/s | 26 kB 00:00 2024-09-20T18:23:07.027 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-20T18:23:07.027 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-20T18:23:07.110 INFO:teuthology.orchestra.run.smithi172.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.7 MB/s | 222 kB 00:00 2024-09-20T18:23:07.135 INFO:teuthology.orchestra.run.smithi172.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-20T18:23:07.160 INFO:teuthology.orchestra.run.smithi172.stdout:(5/13): ceph-mgr-rook-19.1.1-369.ged8ee0f2.el9. 184 kB/s | 49 kB 00:00 2024-09-20T18:23:07.186 INFO:teuthology.orchestra.run.smithi172.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-20T18:23:07.211 INFO:teuthology.orchestra.run.smithi172.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-09-20T18:23:07.261 INFO:teuthology.orchestra.run.smithi172.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-20T18:23:07.286 INFO:teuthology.orchestra.run.smithi172.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-20T18:23:07.312 INFO:teuthology.orchestra.run.smithi172.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-20T18:23:07.346 INFO:teuthology.orchestra.run.smithi172.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.8 MB/s | 220 kB 00:00 2024-09-20T18:23:07.371 INFO:teuthology.orchestra.run.smithi172.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-09-20T18:23:07.412 INFO:teuthology.orchestra.run.smithi172.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-20T18:23:07.415 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:23:07.416 INFO:teuthology.orchestra.run.smithi172.stdout:Total 2.8 MB/s | 2.2 MB 00:00 2024-09-20T18:23:07.478 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-20T18:23:07.493 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-20T18:23:07.494 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-20T18:23:07.584 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-20T18:23:07.585 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-20T18:23:07.843 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-20T18:23:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-20T18:23:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-20T18:23:08.076 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-20T18:23:08.093 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-20T18:23:08.114 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-20T18:23:08.277 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-20T18:23:08.306 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-20T18:23:08.330 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-20T18:23:08.338 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-20T18:23:08.386 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-20T18:23:08.417 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-20T18:23:08.431 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-20T18:23:08.473 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-20T18:23:08.575 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-20T18:23:08.685 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-20T18:23:08.741 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-20T18:23:09.111 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-20T18:23:09.230 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-20T18:23:09.462 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-20T18:23:09.521 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-20T18:23:09.555 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-20T18:23:09.603 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-20T18:23:09.633 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:19.1.1-369.ged8ee0f2.el9.noarch 13/13 2024-09-20T18:23:10.403 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-369.ged8ee0f2.el9.noarch 13/13 2024-09-20T18:23:10.403 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:19.1.1-369.ged8ee0f2.el9.noarch 1/13 2024-09-20T18:23:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-20T18:23:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-20T18:23:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-20T18:23:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-20T18:23:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-20T18:23:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-20T18:23:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-20T18:23:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-20T18:23:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-20T18:23:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-20T18:23:10.404 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-20T18:23:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-20T18:23:10.735 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-20T18:23:10.735 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:10.736 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-20T18:23:10.736 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:23:10.736 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-20T18:23:10.736 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-20T18:23:10.736 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-20T18:23:10.736 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-20T18:23:10.736 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-20T18:23:10.736 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-20T18:23:10.736 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-20T18:23:10.736 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-20T18:23:10.736 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-20T18:23:10.736 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-20T18:23:10.736 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-20T18:23:10.737 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-20T18:23:10.737 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:10.737 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:23:10.993 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-cephadm 2024-09-20T18:23:11.575 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:23 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:23:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-20T18:23:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-369.ged8ee0 12/12 2024-09-20T18:23:11.708 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:23:11.709 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:11.709 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-20T18:23:11.709 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:11.709 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-20T18:23:11.709 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 146 k 2024-09-20T18:23:11.709 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-20T18:23:11.709 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-20T18:23:11.709 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-20T18:23:11.710 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-20T18:23:11.710 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-20T18:23:11.710 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-20T18:23:11.710 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:11.710 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-20T18:23:11.710 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:11.710 INFO:teuthology.orchestra.run.smithi172.stdout:Install 6 Packages 2024-09-20T18:23:11.710 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:11.710 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 7.0 M 2024-09-20T18:23:11.711 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 33 M 2024-09-20T18:23:11.711 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-20T18:23:12.348 INFO:teuthology.orchestra.run.smithi172.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-20T18:23:12.398 INFO:teuthology.orchestra.run.smithi172.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-20T18:23:12.423 INFO:teuthology.orchestra.run.smithi172.stdout:(3/6): ceph-mgr-cephadm-19.1.1-369.ged8ee0f2.el 591 kB/s | 146 kB 00:00 2024-09-20T18:23:12.448 INFO:teuthology.orchestra.run.smithi172.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-20T18:23:12.490 INFO:teuthology.orchestra.run.smithi172.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-20T18:23:12.782 INFO:teuthology.orchestra.run.smithi172.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 9.8 MB/s | 6.0 MB 00:00 2024-09-20T18:23:12.785 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:23:12.785 INFO:teuthology.orchestra.run.smithi172.stdout:Total 6.5 MB/s | 7.0 MB 00:01 2024-09-20T18:23:12.856 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-20T18:23:12.868 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-20T18:23:12.868 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-20T18:23:12.967 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-20T18:23:12.968 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-20T18:23:13.268 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-20T18:23:13.442 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-20T18:23:13.493 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-20T18:23:14.029 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-20T18:23:14.113 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-20T18:23:14.176 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-20T18:23:14.205 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 6/6 2024-09-20T18:23:14.486 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-369.ged8ee0 12/12 2024-09-20T18:23:14.486 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-369.ged8ee0 1/12 2024-09-20T18:23:14.486 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-20T18:23:14.486 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-20T18:23:14.486 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-20T18:23:14.487 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-20T18:23:14.487 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-20T18:23:14.487 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-20T18:23:14.487 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-20T18:23:14.487 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-20T18:23:14.487 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-20T18:23:14.487 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-20T18:23:14.859 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-20T18:23:14.859 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:14.859 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-20T18:23:14.859 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:23:14.860 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-20T18:23:14.860 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-20T18:23:14.860 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-20T18:23:14.860 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-20T18:23:14.860 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-20T18:23:14.860 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-20T18:23:14.860 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-20T18:23:14.860 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-20T18:23:14.860 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-20T18:23:14.860 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-20T18:23:14.860 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-20T18:23:14.860 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:14.860 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:23:15.010 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 6/6 2024-09-20T18:23:15.010 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/6 2024-09-20T18:23:15.010 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-20T18:23:15.010 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-20T18:23:15.010 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-20T18:23:15.010 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-20T18:23:15.280 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-rook 2024-09-20T18:23:15.285 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-20T18:23:15.285 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:15.285 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-20T18:23:15.285 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:23:15.285 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-20T18:23:15.285 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-20T18:23:15.286 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-20T18:23:15.286 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-20T18:23:15.286 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-20T18:23:15.286 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:15.286 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:23:15.520 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-fuse 2024-09-20T18:23:15.883 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:26 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:23:16.020 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:23:16.021 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:16.022 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-20T18:23:16.022 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:16.022 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-20T18:23:16.022 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 49 k 2024-09-20T18:23:16.022 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-20T18:23:16.022 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-20T18:23:16.022 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-20T18:23:16.022 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-20T18:23:16.022 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-20T18:23:16.022 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-20T18:23:16.022 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-20T18:23:16.022 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-20T18:23:16.022 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-20T18:23:16.023 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-20T18:23:16.023 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-20T18:23:16.023 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-20T18:23:16.023 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-20T18:23:16.023 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:16.023 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-20T18:23:16.023 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:16.023 INFO:teuthology.orchestra.run.smithi017.stdout:Install 13 Packages 2024-09-20T18:23:16.023 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:16.024 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 2.2 M 2024-09-20T18:23:16.024 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 26 M 2024-09-20T18:23:16.024 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-20T18:23:16.103 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:28 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:23:16.237 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:23:16.238 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-20T18:23:16.238 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:16.238 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-20T18:23:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 897 k 2024-09-20T18:23:16.238 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-20T18:23:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-20T18:23:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:16.238 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-20T18:23:16.238 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:16.239 INFO:teuthology.orchestra.run.smithi172.stdout:Install 2 Packages 2024-09-20T18:23:16.239 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:16.239 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 976 k 2024-09-20T18:23:16.239 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 2.9 M 2024-09-20T18:23:16.239 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-20T18:23:16.534 INFO:teuthology.orchestra.run.smithi172.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 467 kB/s | 80 kB 00:00 2024-09-20T18:23:16.539 INFO:teuthology.orchestra.run.smithi017.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 288 kB/s | 26 kB 00:00 2024-09-20T18:23:16.556 INFO:teuthology.orchestra.run.smithi017.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 181 kB/s | 19 kB 00:00 2024-09-20T18:23:16.632 INFO:teuthology.orchestra.run.smithi017.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.9 MB/s | 222 kB 00:00 2024-09-20T18:23:16.657 INFO:teuthology.orchestra.run.smithi017.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-09-20T18:23:16.682 INFO:teuthology.orchestra.run.smithi017.stdout:(5/13): ceph-mgr-rook-19.1.1-369.ged8ee0f2.el9. 212 kB/s | 49 kB 00:00 2024-09-20T18:23:16.701 INFO:teuthology.orchestra.run.smithi172.stdout:(2/2): ceph-fuse-19.1.1-369.ged8ee0f2.el9.x86_6 2.6 MB/s | 897 kB 00:00 2024-09-20T18:23:16.702 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:23:16.702 INFO:teuthology.orchestra.run.smithi172.stdout:Total 2.1 MB/s | 976 kB 00:00 2024-09-20T18:23:16.707 INFO:teuthology.orchestra.run.smithi017.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-20T18:23:16.713 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-20T18:23:16.735 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-20T18:23:16.735 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-20T18:23:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.5 MB/s | 279 kB 00:00 2024-09-20T18:23:16.791 INFO:teuthology.orchestra.run.smithi017.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 295 kB/s | 32 kB 00:00 2024-09-20T18:23:16.816 INFO:teuthology.orchestra.run.smithi017.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 130 kB/s | 14 kB 00:00 2024-09-20T18:23:16.820 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-20T18:23:16.820 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-20T18:23:16.841 INFO:teuthology.orchestra.run.smithi017.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-20T18:23:16.867 INFO:teuthology.orchestra.run.smithi017.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-20T18:23:16.892 INFO:teuthology.orchestra.run.smithi017.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-20T18:23:16.934 INFO:teuthology.orchestra.run.smithi017.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.3 MB/s | 1.0 MB 00:00 2024-09-20T18:23:16.937 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:23:16.937 INFO:teuthology.orchestra.run.smithi017.stdout:Total 2.4 MB/s | 2.2 MB 00:00 2024-09-20T18:23:17.004 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-20T18:23:17.015 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-20T18:23:17.021 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-20T18:23:17.021 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-20T18:23:17.120 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-20T18:23:17.122 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-20T18:23:17.175 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-20T18:23:17.251 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/2 2024-09-20T18:23:17.642 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-20T18:23:17.831 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-20T18:23:17.884 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/2 2024-09-20T18:23:17.884 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/2 2024-09-20T18:23:17.895 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-20T18:23:17.960 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-20T18:23:17.995 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-20T18:23:18.038 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-20T18:23:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-20T18:23:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:18.161 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-20T18:23:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-20T18:23:18.161 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:18.161 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:23:18.162 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-20T18:23:18.271 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-20T18:23:18.332 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-20T18:23:18.463 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librados-devel 2024-09-20T18:23:19.054 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:31 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:23:19.094 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-20T18:23:19.153 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-20T18:23:19.186 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-20T18:23:19.192 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:23:19.193 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:19.193 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-09-20T18:23:19.193 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:19.193 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-20T18:23:19.193 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 126 k 2024-09-20T18:23:19.193 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:19.193 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-20T18:23:19.193 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:19.193 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-20T18:23:19.193 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:19.194 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 126 k 2024-09-20T18:23:19.194 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 456 k 2024-09-20T18:23:19.194 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-20T18:23:19.235 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-20T18:23:19.273 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:19.1.1-369.ged8ee0f2.el9.noarch 13/13 2024-09-20T18:23:19.389 INFO:teuthology.orchestra.run.smithi172.stdout:librados-devel-19.1.1-369.ged8ee0f2.el9.x86_64. 651 kB/s | 126 kB 00:00 2024-09-20T18:23:19.389 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:23:19.390 INFO:teuthology.orchestra.run.smithi172.stdout:Total 645 kB/s | 126 kB 00:00 2024-09-20T18:23:19.390 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-20T18:23:19.395 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-20T18:23:19.395 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-20T18:23:19.459 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-20T18:23:19.459 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-20T18:23:19.610 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-20T18:23:19.754 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-369.ged8ee0f2.el9.noarch 13/13 2024-09-20T18:23:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:19.1.1-369.ged8ee0f2.el9.noarch 1/13 2024-09-20T18:23:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-20T18:23:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-20T18:23:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-20T18:23:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-20T18:23:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-20T18:23:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-20T18:23:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-20T18:23:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-20T18:23:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-20T18:23:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-20T18:23:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-20T18:23:20.198 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:20.400 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-20T18:23:20.400 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:20.400 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-20T18:23:20.400 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:23:20.400 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-20T18:23:20.400 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-20T18:23:20.400 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-20T18:23:20.400 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-20T18:23:20.400 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-20T18:23:20.400 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-20T18:23:20.400 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-20T18:23:20.401 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-20T18:23:20.401 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-20T18:23:20.401 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-20T18:23:20.401 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-20T18:23:20.401 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-20T18:23:20.401 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:20.401 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:23:20.433 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:20.433 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:20.433 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-20T18:23:20.433 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:23:20.433 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:20.433 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:23:20.650 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-cephadm 2024-09-20T18:23:20.703 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install libcephfs2 2024-09-20T18:23:21.255 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:32 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:23:21.311 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:33 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:23:21.393 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:23:21.394 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:21.394 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-20T18:23:21.394 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:21.394 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-20T18:23:21.394 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:19.1.1-369.ged8ee0f2.el9 ceph-noarch 146 k 2024-09-20T18:23:21.395 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-20T18:23:21.395 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-20T18:23:21.395 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-20T18:23:21.395 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-20T18:23:21.395 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-20T18:23:21.395 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-20T18:23:21.395 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:21.395 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-20T18:23:21.395 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:21.395 INFO:teuthology.orchestra.run.smithi017.stdout:Install 6 Packages 2024-09-20T18:23:21.395 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:21.396 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 7.0 M 2024-09-20T18:23:21.396 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 33 M 2024-09-20T18:23:21.396 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-20T18:23:21.402 INFO:teuthology.orchestra.run.smithi172.stdout:Package libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:23:21.445 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:23:21.447 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-20T18:23:21.447 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:23:21.511 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install libcephfs-devel 2024-09-20T18:23:21.895 INFO:teuthology.orchestra.run.smithi017.stdout:(1/6): ceph-mgr-cephadm-19.1.1-369.ged8ee0f2.el 551 kB/s | 146 kB 00:00 2024-09-20T18:23:21.921 INFO:teuthology.orchestra.run.smithi017.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 855 kB/s | 248 kB 00:00 2024-09-20T18:23:21.979 INFO:teuthology.orchestra.run.smithi017.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-20T18:23:22.005 INFO:teuthology.orchestra.run.smithi017.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 691 kB/s | 58 kB 00:00 2024-09-20T18:23:22.030 INFO:teuthology.orchestra.run.smithi017.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-20T18:23:22.093 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:34 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:23:22.226 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:23:22.226 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:22.226 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-09-20T18:23:22.226 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:22.226 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-20T18:23:22.226 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 32 k 2024-09-20T18:23:22.226 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:22.226 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-20T18:23:22.227 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:22.227 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-20T18:23:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:22.227 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 32 k 2024-09-20T18:23:22.227 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 142 k 2024-09-20T18:23:22.227 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-20T18:23:22.425 INFO:teuthology.orchestra.run.smithi172.stdout:libcephfs-devel-19.1.1-369.ged8ee0f2.el9.x86_64 160 kB/s | 32 kB 00:00 2024-09-20T18:23:22.426 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:23:22.426 INFO:teuthology.orchestra.run.smithi172.stdout:Total 159 kB/s | 32 kB 00:00 2024-09-20T18:23:22.426 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-20T18:23:22.430 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-20T18:23:22.430 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-20T18:23:22.449 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-20T18:23:22.449 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-20T18:23:22.559 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-20T18:23:22.666 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:23.055 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:23.239 INFO:teuthology.orchestra.run.smithi017.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.7 MB/s | 6.0 MB 00:01 2024-09-20T18:23:23.241 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:23:23.242 INFO:teuthology.orchestra.run.smithi017.stdout:Total 3.8 MB/s | 7.0 MB 00:01 2024-09-20T18:23:23.298 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:23.299 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:23.299 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-20T18:23:23.299 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:23:23.299 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:23.299 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:23:23.321 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-20T18:23:23.338 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-20T18:23:23.338 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-20T18:23:23.444 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-20T18:23:23.445 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-20T18:23:23.482 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librados2 2024-09-20T18:23:23.764 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-20T18:23:23.957 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-20T18:23:24.025 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-20T18:23:24.057 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:36 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:23:24.145 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:23:24.188 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:23:24.189 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-20T18:23:24.189 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:23:24.260 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librbd1 2024-09-20T18:23:24.583 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-20T18:23:24.680 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-20T18:23:24.752 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-20T18:23:24.778 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 6/6 2024-09-20T18:23:24.840 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:36 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:23:24.931 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:23:24.975 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:23:24.976 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-20T18:23:24.976 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:23:25.073 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rados 2024-09-20T18:23:25.550 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 6/6 2024-09-20T18:23:25.551 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 1/6 2024-09-20T18:23:25.551 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-20T18:23:25.551 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-20T18:23:25.551 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-20T18:23:25.551 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-20T18:23:25.661 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:37 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:23:25.749 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rados-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:23:25.792 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:23:25.793 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-20T18:23:25.793 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:23:25.824 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-20T18:23:25.824 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:25.824 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-20T18:23:25.824 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:19.1.1-369.ged8ee0f2.el9.noarch 2024-09-20T18:23:25.824 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-20T18:23:25.824 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-20T18:23:25.824 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-20T18:23:25.824 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-20T18:23:25.824 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-20T18:23:25.824 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:25.824 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:23:25.861 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rgw 2024-09-20T18:23:26.079 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-fuse 2024-09-20T18:23:26.445 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:38 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:23:26.534 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:23:26.578 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:23:26.579 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-20T18:23:26.579 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:23:26.644 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-cephfs 2024-09-20T18:23:26.680 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:37 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:23:26.819 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:23:26.819 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:26.819 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-09-20T18:23:26.819 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:26.819 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-20T18:23:26.820 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 897 k 2024-09-20T18:23:26.820 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-09-20T18:23:26.820 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-20T18:23:26.820 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:26.820 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-20T18:23:26.820 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:26.820 INFO:teuthology.orchestra.run.smithi017.stdout:Install 2 Packages 2024-09-20T18:23:26.820 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:26.821 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 976 k 2024-09-20T18:23:26.821 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 2.9 M 2024-09-20T18:23:26.821 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-20T18:23:27.041 INFO:teuthology.orchestra.run.smithi017.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 458 kB/s | 80 kB 00:00 2024-09-20T18:23:27.141 INFO:teuthology.orchestra.run.smithi017.stdout:(2/2): ceph-fuse-19.1.1-369.ged8ee0f2.el9.x86_6 3.2 MB/s | 897 kB 00:00 2024-09-20T18:23:27.141 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:23:27.142 INFO:teuthology.orchestra.run.smithi017.stdout:Total 3.0 MB/s | 976 kB 00:00 2024-09-20T18:23:27.154 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-20T18:23:27.176 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-20T18:23:27.176 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-20T18:23:27.227 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:39 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:23:27.266 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-20T18:23:27.266 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-20T18:23:27.315 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-cephfs-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:23:27.359 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:23:27.360 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-20T18:23:27.360 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:23:27.430 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rbd 2024-09-20T18:23:27.466 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-20T18:23:27.623 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-20T18:23:27.694 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/2 2024-09-20T18:23:28.013 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:40 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:23:28.103 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:23:28.146 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:23:28.147 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-09-20T18:23:28.147 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:23:28.226 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-fuse 2024-09-20T18:23:28.415 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 2/2 2024-09-20T18:23:28.415 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/2 2024-09-20T18:23:28.690 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-20T18:23:28.690 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:28.690 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-20T18:23:28.690 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-20T18:23:28.690 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:28.690 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:23:28.800 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:40 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:23:28.931 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:23:28.932 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:28.932 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-09-20T18:23:28.932 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:28.932 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-20T18:23:28.932 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 85 k 2024-09-20T18:23:28.932 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:28.932 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-20T18:23:28.932 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:28.932 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-20T18:23:28.932 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:28.933 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 85 k 2024-09-20T18:23:28.933 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 231 k 2024-09-20T18:23:28.933 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-20T18:23:29.013 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install librados-devel 2024-09-20T18:23:29.137 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-fuse-19.1.1-369.ged8ee0f2.el9.x86_64.rpm 419 kB/s | 85 kB 00:00 2024-09-20T18:23:29.137 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:23:29.137 INFO:teuthology.orchestra.run.smithi172.stdout:Total 416 kB/s | 85 kB 00:00 2024-09-20T18:23:29.137 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-20T18:23:29.144 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-20T18:23:29.144 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-20T18:23:29.207 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-20T18:23:29.207 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-20T18:23:29.357 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-20T18:23:29.467 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:29.624 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:40 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:23:29.760 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:23:29.761 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:29.761 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-09-20T18:23:29.761 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:29.761 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-20T18:23:29.761 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 126 k 2024-09-20T18:23:29.761 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:29.761 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-20T18:23:29.762 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:29.762 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-20T18:23:29.762 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:29.762 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 126 k 2024-09-20T18:23:29.762 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 456 k 2024-09-20T18:23:29.762 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-20T18:23:29.826 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:29.963 INFO:teuthology.orchestra.run.smithi017.stdout:librados-devel-19.1.1-369.ged8ee0f2.el9.x86_64. 632 kB/s | 126 kB 00:00 2024-09-20T18:23:29.964 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:23:29.964 INFO:teuthology.orchestra.run.smithi017.stdout:Total 627 kB/s | 126 kB 00:00 2024-09-20T18:23:29.964 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-20T18:23:29.970 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-20T18:23:29.970 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-20T18:23:30.037 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-20T18:23:30.037 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-20T18:23:30.087 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:30.087 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:30.087 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-20T18:23:30.087 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:23:30.087 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:30.087 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:23:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-20T18:23:30.297 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:30.356 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-mirror 2024-09-20T18:23:30.749 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:30.958 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:42 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:23:30.972 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:30.972 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:30.972 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-20T18:23:30.972 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:23:30.972 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:30.972 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:23:31.093 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:23:31.093 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:31.094 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-09-20T18:23:31.094 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:31.094 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-20T18:23:31.094 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 3.1 M 2024-09-20T18:23:31.094 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:31.094 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-20T18:23:31.094 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:31.094 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-20T18:23:31.094 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:31.095 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 3.1 M 2024-09-20T18:23:31.095 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 13 M 2024-09-20T18:23:31.095 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-20T18:23:31.198 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install libcephfs2 2024-09-20T18:23:31.422 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-mirror-19.1.1-369.ged8ee0f2.el9.x86_64.rpm 9.5 MB/s | 3.1 MB 00:00 2024-09-20T18:23:31.423 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:23:31.424 INFO:teuthology.orchestra.run.smithi172.stdout:Total 9.4 MB/s | 3.1 MB 00:00 2024-09-20T18:23:31.424 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-20T18:23:31.432 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-20T18:23:31.432 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-20T18:23:31.514 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-20T18:23:31.514 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-20T18:23:31.814 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:42 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:23:31.907 INFO:teuthology.orchestra.run.smithi017.stdout:Package libcephfs2-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:23:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-20T18:23:31.953 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:23:31.954 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-20T18:23:31.954 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:23:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:32.011 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install libcephfs-devel 2024-09-20T18:23:32.031 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:32.031 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:23:32.031 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-20T18:23:32.031 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-20T18:23:32.031 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-20T18:23:32.031 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:32.617 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:43 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:23:32.754 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:23:32.755 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-09-20T18:23:32.755 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:32.755 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-20T18:23:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 32 k 2024-09-20T18:23:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:32.755 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-20T18:23:32.755 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:32.755 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-20T18:23:32.755 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:32.756 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 32 k 2024-09-20T18:23:32.756 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 142 k 2024-09-20T18:23:32.756 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-20T18:23:32.900 INFO:teuthology.orchestra.run.smithi017.stdout:libcephfs-devel-19.1.1-369.ged8ee0f2.el9.x86_64 220 kB/s | 32 kB 00:00 2024-09-20T18:23:32.900 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:23:32.901 INFO:teuthology.orchestra.run.smithi017.stdout:Total 218 kB/s | 32 kB 00:00 2024-09-20T18:23:32.901 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-20T18:23:32.905 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-20T18:23:32.905 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-20T18:23:32.918 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-20T18:23:32.918 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-20T18:23:33.013 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-20T18:23:33.134 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:33.216 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:33.217 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:33.217 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-20T18:23:33.217 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:23:33.217 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:33.217 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:23:33.485 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:33.494 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-nbd 2024-09-20T18:23:33.721 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:33.721 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:33.721 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-20T18:23:33.721 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:23:33.722 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:33.722 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:23:33.891 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install librados2 2024-09-20T18:23:34.095 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:46 ago on Fri 20 Sep 2024 06:21:48 PM UTC. 2024-09-20T18:23:34.228 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-20T18:23:34.228 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:34.228 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-09-20T18:23:34.228 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:34.228 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-20T18:23:34.229 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 170 k 2024-09-20T18:23:34.229 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:34.229 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-20T18:23:34.229 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-09-20T18:23:34.229 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-09-20T18:23:34.229 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:34.229 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 170 k 2024-09-20T18:23:34.229 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 494 k 2024-09-20T18:23:34.230 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-20T18:23:34.491 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:45 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:23:34.568 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-nbd-19.1.1-369.ged8ee0f2.el9.x86_64.rpm 504 kB/s | 170 kB 00:00 2024-09-20T18:23:34.569 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:23:34.569 INFO:teuthology.orchestra.run.smithi172.stdout:Total 501 kB/s | 170 kB 00:00 2024-09-20T18:23:34.569 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-20T18:23:34.577 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-20T18:23:34.577 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-20T18:23:34.583 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:23:34.628 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:23:34.630 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-20T18:23:34.630 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:23:34.641 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-20T18:23:34.641 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-20T18:23:34.698 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install librbd1 2024-09-20T18:23:34.795 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-20T18:23:34.899 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:35.304 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:46 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:23:35.321 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-nbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:35.397 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:23:35.443 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:23:35.444 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-20T18:23:35.444 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:23:35.508 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rados 2024-09-20T18:23:35.590 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:35.590 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:35.590 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-20T18:23:35.591 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:23:35.591 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:23:35.591 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-20T18:23:35.880 DEBUG:teuthology.parallel:result is None 2024-09-20T18:23:36.121 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:47 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:23:36.213 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rados-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:23:36.259 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:23:36.260 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-20T18:23:36.260 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:23:36.316 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rgw 2024-09-20T18:23:36.923 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:47 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:23:37.016 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rgw-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:23:37.062 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:23:37.063 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-20T18:23:37.063 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:23:37.135 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-cephfs 2024-09-20T18:23:37.742 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:48 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:23:37.833 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-cephfs-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:23:37.878 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:23:37.879 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-20T18:23:37.879 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:23:37.947 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rbd 2024-09-20T18:23:38.555 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:49 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:23:38.649 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 is already installed. 2024-09-20T18:23:38.695 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:23:38.696 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-09-20T18:23:38.696 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:23:38.761 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-fuse 2024-09-20T18:23:39.362 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:50 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:23:39.501 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:23:39.502 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-09-20T18:23:39.502 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:39.502 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-20T18:23:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 85 k 2024-09-20T18:23:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:39.502 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-20T18:23:39.502 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:39.502 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-20T18:23:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:39.503 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 85 k 2024-09-20T18:23:39.503 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 231 k 2024-09-20T18:23:39.503 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-20T18:23:39.687 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-fuse-19.1.1-369.ged8ee0f2.el9.x86_64.rpm 463 kB/s | 85 kB 00:00 2024-09-20T18:23:39.687 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:23:39.688 INFO:teuthology.orchestra.run.smithi017.stdout:Total 460 kB/s | 85 kB 00:00 2024-09-20T18:23:39.688 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-20T18:23:39.695 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-20T18:23:39.695 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-20T18:23:39.762 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-20T18:23:39.763 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-20T18:23:39.918 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-20T18:23:40.038 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:40.705 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-20T18:23:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:23:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:40.705 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:23:40.930 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-mirror 2024-09-20T18:23:41.550 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:52 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:23:41.693 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:23:41.696 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:41.696 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-09-20T18:23:41.696 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:41.696 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-20T18:23:41.696 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 3.1 M 2024-09-20T18:23:41.696 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:41.696 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-20T18:23:41.696 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:41.696 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-20T18:23:41.697 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:41.697 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 3.1 M 2024-09-20T18:23:41.697 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 13 M 2024-09-20T18:23:41.697 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-20T18:23:42.024 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-mirror-19.1.1-369.ged8ee0f2.el9.x86_64.rpm 9.5 MB/s | 3.1 MB 00:00 2024-09-20T18:23:42.025 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:23:42.025 INFO:teuthology.orchestra.run.smithi017.stdout:Total 9.4 MB/s | 3.1 MB 00:00 2024-09-20T18:23:42.025 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-20T18:23:42.035 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-20T18:23:42.035 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-20T18:23:42.135 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-20T18:23:42.135 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-20T18:23:42.588 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-20T18:23:42.667 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:42.695 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:42.695 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-20T18:23:42.695 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-20T18:23:42.695 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-20T18:23:42.695 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-20T18:23:42.695 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:43.871 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:43.871 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:43.871 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-20T18:23:43.871 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:23:43.871 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:43.871 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:23:44.114 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-nbd 2024-09-20T18:23:44.725 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:55 ago on Fri 20 Sep 2024 06:21:49 PM UTC. 2024-09-20T18:23:44.863 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-09-20T18:23:44.864 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:44.864 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-09-20T18:23:44.864 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:44.864 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-09-20T18:23:44.864 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:19.1.1-369.ged8ee0f2.el9 ceph 170 k 2024-09-20T18:23:44.864 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:44.864 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-09-20T18:23:44.864 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-09-20T18:23:44.864 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-09-20T18:23:44.864 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:44.865 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 170 k 2024-09-20T18:23:44.865 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 494 k 2024-09-20T18:23:44.865 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-09-20T18:23:45.061 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-nbd-19.1.1-369.ged8ee0f2.el9.x86_64.rpm 869 kB/s | 170 kB 00:00 2024-09-20T18:23:45.062 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:23:45.062 INFO:teuthology.orchestra.run.smithi017.stdout:Total 862 kB/s | 170 kB 00:00 2024-09-20T18:23:45.062 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-09-20T18:23:45.071 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-09-20T18:23:45.071 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-09-20T18:23:45.138 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-09-20T18:23:45.138 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-09-20T18:23:45.305 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-09-20T18:23:45.404 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:45.820 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-nbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:46.113 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 1/1 2024-09-20T18:23:46.113 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:46.113 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-09-20T18:23:46.113 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:19.1.1-369.ged8ee0f2.el9.x86_64 2024-09-20T18:23:46.113 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:23:46.113 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-09-20T18:23:46.323 DEBUG:teuthology.parallel:result is None 2024-09-20T18:23:46.323 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T18:23:46.323 INFO:teuthology.packaging:ref: None 2024-09-20T18:23:46.324 INFO:teuthology.packaging:tag: None 2024-09-20T18:23:46.324 INFO:teuthology.packaging:branch: squid 2024-09-20T18:23:46.324 INFO:teuthology.packaging:sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:23:46.324 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-20T18:23:46.560 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-20T18:23:46.582 INFO:teuthology.orchestra.run.smithi017.stdout:19.1.1-369.ged8ee0f2.el9 2024-09-20T18:23:46.582 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-369.ged8ee0f2.el9 2024-09-20T18:23:46.582 INFO:teuthology.task.install:The correct ceph version 19.1.1-369.ged8ee0f2 is installed. 2024-09-20T18:23:46.584 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-20T18:23:46.584 INFO:teuthology.packaging:ref: None 2024-09-20T18:23:46.584 INFO:teuthology.packaging:tag: None 2024-09-20T18:23:46.584 INFO:teuthology.packaging:branch: squid 2024-09-20T18:23:46.584 INFO:teuthology.packaging:sha1: 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:23:46.584 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-20T18:23:46.822 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-20T18:23:46.847 INFO:teuthology.orchestra.run.smithi172.stdout:19.1.1-369.ged8ee0f2.el9 2024-09-20T18:23:46.847 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-369.ged8ee0f2.el9 2024-09-20T18:23:46.848 INFO:teuthology.task.install:The correct ceph version 19.1.1-369.ged8ee0f2 is installed. 2024-09-20T18:23:46.849 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-20T18:23:46.849 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T18:23:46.849 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-20T18:23:46.878 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-20T18:23:46.878 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-20T18:23:46.918 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-20T18:23:46.918 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T18:23:46.918 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2024-09-20T18:23:46.945 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-20T18:23:47.012 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-20T18:23:47.012 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-09-20T18:23:47.039 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-20T18:23:47.106 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-20T18:23:47.107 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T18:23:47.107 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-20T18:23:47.134 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-20T18:23:47.201 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-20T18:23:47.201 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-20T18:23:47.228 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-20T18:23:47.294 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-20T18:23:47.294 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T18:23:47.294 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2024-09-20T18:23:47.321 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-20T18:23:47.387 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-20T18:23:47.388 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-09-20T18:23:47.413 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-20T18:23:47.479 INFO:teuthology.run_tasks:Running task print... 2024-09-20T18:23:47.488 INFO:teuthology.task.print:**** done install task... 2024-09-20T18:23:47.488 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-20T18:23:47.581 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'squid', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'global': {'mon pg warn min per osd': 0}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}}, 'image': 'quay.ceph.io/ceph-ci/ceph:squid', 'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '88deadb8082f4a33832e228ccefc59cedba158a5'} 2024-09-20T18:23:47.581 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:squid 2024-09-20T18:23:47.582 INFO:tasks.cephadm:Cluster fsid is 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:23:47.582 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-20T18:23:47.582 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-20T18:23:47.582 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi017': '172.21.15.17', 'mon.smithi172': '172.21.15.172'} 2024-09-20T18:23:47.582 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-20T18:23:47.582 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname $(hostname -s) 2024-09-20T18:23:47.609 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname $(hostname -s) 2024-09-20T18:23:47.635 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for squid 2024-09-20T18:23:47.635 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:23:47.772 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '88deadb8082f4a33832e228ccefc59cedba158a5', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83186/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5099-g88deadb8', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5099.g88deadb8'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-20-1028/88deadb8082f4a33832e228ccefc59cedba158a5/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 12:11:57.149019', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-guits-main-2024-09-20-1028', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-guits-main-2024-09-20-1028/88deadb8082f4a33832e228ccefc59cedba158a5/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-20T18:23:48.005 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 ed8ee0f26ef720e6504cefa8be1a2d0872192de7 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=squid 2024-09-20T18:23:48.006 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/x86_64/flavors/default/cephadm 2024-09-20T18:23:48.007 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/x86_64/flavors/default/cephadm 2024-09-20T18:23:48.007 DEBUG:teuthology.orchestra.run.smithi017:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-20T18:23:48.545 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r--. 1 ubuntu ubuntu 784376 Sep 20 18:23 /home/ubuntu/cephtest/cephadm 2024-09-20T18:23:48.545 DEBUG:teuthology.orchestra.run.smithi172:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/ed8ee0f26ef720e6504cefa8be1a2d0872192de7/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-20T18:23:49.141 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r--. 1 ubuntu ubuntu 784376 Sep 20 18:23 /home/ubuntu/cephtest/cephadm 2024-09-20T18:23:49.142 DEBUG:teuthology.orchestra.run.smithi017:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-20T18:23:49.162 DEBUG:teuthology.orchestra.run.smithi172:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-20T18:23:49.197 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:squid on all hosts... 2024-09-20T18:23:49.197 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-20T18:23:49.205 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-20T18:23:50.800 INFO:teuthology.orchestra.run.smithi017.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-20T18:23:50.851 INFO:teuthology.orchestra.run.smithi172.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-20T18:25:13.055 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:25:13.055 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)", 2024-09-20T18:25:13.055 INFO:teuthology.orchestra.run.smithi017.stdout: "image_id": "6acb0a031eab55fe07acc1e5695be48af529a148c2f67dce7aead6591509af30", 2024-09-20T18:25:13.055 INFO:teuthology.orchestra.run.smithi017.stdout: "repo_digests": [ 2024-09-20T18:25:13.055 INFO:teuthology.orchestra.run.smithi017.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65" 2024-09-20T18:25:13.055 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-20T18:25:13.055 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:26:05.704 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-20T18:26:05.704 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)", 2024-09-20T18:26:05.704 INFO:teuthology.orchestra.run.smithi172.stdout: "image_id": "6acb0a031eab55fe07acc1e5695be48af529a148c2f67dce7aead6591509af30", 2024-09-20T18:26:05.704 INFO:teuthology.orchestra.run.smithi172.stdout: "repo_digests": [ 2024-09-20T18:26:05.704 INFO:teuthology.orchestra.run.smithi172.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65" 2024-09-20T18:26:05.704 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-20T18:26:05.704 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-20T18:26:05.731 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph 2024-09-20T18:26:05.766 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph 2024-09-20T18:26:05.794 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /etc/ceph 2024-09-20T18:26:05.835 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /etc/ceph 2024-09-20T18:26:05.860 INFO:tasks.cephadm:Writing seed config... 2024-09-20T18:26:05.861 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-20T18:26:05.861 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-20T18:26:05.861 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-20T18:26:05.861 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-20T18:26:05.861 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-20T18:26:05.861 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-20T18:26:05.861 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-20T18:26:05.862 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-20T18:26:05.862 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-20T18:26:05.862 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-20T18:26:05.862 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-20T18:26:05.862 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-20T18:26:05.862 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-20T18:26:05.862 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-20T18:26:05.862 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-20T18:26:05.862 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-20T18:26:05.862 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-20T18:26:05.862 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-20T18:26:05.862 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-20T18:26:05.862 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-20T18:26:05.862 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-20T18:26:05.863 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-20T18:26:05.863 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-20T18:26:05.863 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-20T18:26:05.863 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-20T18:26:05.863 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-20T18:26:05.863 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T18:26:05.863 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-20T18:26:05.893 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7a27d282-777d-11ef-baf5-efdc52797490 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-20T18:26:05.893 DEBUG:teuthology.orchestra.run.smithi017:mon.smithi017> sudo journalctl -f -n 0 -u ceph-7a27d282-777d-11ef-baf5-efdc52797490@mon.smithi017.service 2024-09-20T18:26:05.936 INFO:tasks.cephadm:Bootstrapping... 2024-09-20T18:26:05.936 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid -v bootstrap --fsid 7a27d282-777d-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.17 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-20T18:26:06.149 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-09-20T18:26:06.149 INFO:teuthology.orchestra.run.smithi017.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:squid', '-v', 'bootstrap', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.17', '--skip-admin-label'] 2024-09-20T18:26:06.149 INFO:teuthology.orchestra.run.smithi017.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-20T18:26:06.149 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying podman|docker is present... 2024-09-20T18:26:06.192 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 5.2.2 2024-09-20T18:26:06.192 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying lvm2 is present... 2024-09-20T18:26:06.192 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying time synchronization is in place... 2024-09-20T18:26:06.200 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-20T18:26:06.200 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-20T18:26:06.207 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-20T18:26:06.207 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-20T18:26:06.214 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2024-09-20T18:26:06.220 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2024-09-20T18:26:06.220 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2024-09-20T18:26:06.220 INFO:teuthology.orchestra.run.smithi017.stdout:Repeating the final host check... 2024-09-20T18:26:06.249 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 5.2.2 2024-09-20T18:26:06.249 INFO:teuthology.orchestra.run.smithi017.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-20T18:26:06.249 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl is present 2024-09-20T18:26:06.249 INFO:teuthology.orchestra.run.smithi017.stdout:lvcreate is present 2024-09-20T18:26:06.256 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-20T18:26:06.256 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-20T18:26:06.262 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-20T18:26:06.262 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-20T18:26:06.269 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2024-09-20T18:26:06.276 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2024-09-20T18:26:06.276 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2024-09-20T18:26:06.276 INFO:teuthology.orchestra.run.smithi017.stdout:Host looks OK 2024-09-20T18:26:06.276 INFO:teuthology.orchestra.run.smithi017.stdout:Cluster fsid: 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:26:06.276 INFO:teuthology.orchestra.run.smithi017.stdout:Acquiring lock 139724892596064 on /run/cephadm/7a27d282-777d-11ef-baf5-efdc52797490.lock 2024-09-20T18:26:06.276 INFO:teuthology.orchestra.run.smithi017.stdout:Lock 139724892596064 acquired on /run/cephadm/7a27d282-777d-11ef-baf5-efdc52797490.lock 2024-09-20T18:26:06.277 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 3300 ... 2024-09-20T18:26:06.277 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 6789 ... 2024-09-20T18:26:06.277 INFO:teuthology.orchestra.run.smithi017.stdout:Base mon IP(s) is [172.21.15.17:3300, 172.21.15.17:6789], mon addrv is [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-09-20T18:26:06.280 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.17 metric 100 2024-09-20T18:26:06.280 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.17 metric 100 2024-09-20T18:26:06.283 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-20T18:26:06.283 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-20T18:26:06.283 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1707sec hoplimit 64 pref medium 2024-09-20T18:26:06.285 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-20T18:26:06.286 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-20T18:26:06.286 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-20T18:26:06.286 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-20T18:26:06.286 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-20T18:26:06.286 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-20T18:26:06.286 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2024-09-20T18:26:06.286 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2024-09-20T18:26:06.287 INFO:teuthology.orchestra.run.smithi017.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-20T18:26:06.287 INFO:teuthology.orchestra.run.smithi017.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-20T18:26:06.288 INFO:teuthology.orchestra.run.smithi017.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-20T18:26:08.574 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 6acb0a031eab55fe07acc1e5695be48af529a148c2f67dce7aead6591509af30 2024-09-20T18:26:08.574 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:squid... 2024-09-20T18:26:08.574 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Getting image source signatures 2024-09-20T18:26:08.574 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:92ea49144d6cc6e75ae91004beab5c92b7a8b7054f9361617c16e26264c87e92 2024-09-20T18:26:08.574 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-20T18:26:08.574 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying config sha256:6acb0a031eab55fe07acc1e5695be48af529a148c2f67dce7aead6591509af30 2024-09-20T18:26:08.574 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-20T18:26:09.469 INFO:teuthology.orchestra.run.smithi017.stdout:ceph: stdout ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable) 2024-09-20T18:26:09.469 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph version: ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable) 2024-09-20T18:26:09.469 INFO:teuthology.orchestra.run.smithi017.stdout:Extracting ceph user uid/gid from container image... 2024-09-20T18:26:10.333 INFO:teuthology.orchestra.run.smithi017.stdout:stat: stdout 167 167 2024-09-20T18:26:10.333 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial keys... 2024-09-20T18:26:11.305 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQBCvu1mUbyOJxAArjtaryjI5U/Jhkl65lHTZQ== 2024-09-20T18:26:12.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQBDvu1m6rlmJRAATCDafDvzGW2zV/mH3y/rHg== 2024-09-20T18:26:13.115 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQBEvu1mkfiqIRAAagZualxZjx76/fV4enCuDA== 2024-09-20T18:26:13.116 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial monmap... 2024-09-20T18:26:14.063 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-20T18:26:14.064 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-20T18:26:14.064 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:26:14.064 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-20T18:26:14.064 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool for smithi017 [v2:172.21.15.17:3300,v1:172.21.15.17:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-20T18:26:14.064 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = quincy 2024-09-20T18:26:14.064 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: set fsid to 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:26:14.064 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-20T18:26:14.064 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:26:14.064 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mon... 2024-09-20T18:26:15.010 INFO:teuthology.orchestra.run.smithi017.stdout:create mon.smithi017 on 2024-09-20T18:26:15.214 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-20T18:26:15.378 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-20T18:26:15.565 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-7a27d282-777d-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-7a27d282-777d-11ef-baf5-efdc52797490.target. 2024-09-20T18:26:15.565 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-7a27d282-777d-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-7a27d282-777d-11ef-baf5-efdc52797490.target. 2024-09-20T18:26:15.831 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7a27d282-777d-11ef-baf5-efdc52797490@mon.smithi017 2024-09-20T18:26:15.831 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7a27d282-777d-11ef-baf5-efdc52797490@mon.smithi017.service: Unit ceph-7a27d282-777d-11ef-baf5-efdc52797490@mon.smithi017.service not loaded. 2024-09-20T18:26:16.013 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7a27d282-777d-11ef-baf5-efdc52797490.target.wants/ceph-7a27d282-777d-11ef-baf5-efdc52797490@mon.smithi017.service → /etc/systemd/system/ceph-7a27d282-777d-11ef-baf5-efdc52797490@.service. 2024-09-20T18:26:16.073 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:16 smithi017 systemd[1]: Starting Ceph mon.smithi017 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:26:16.348 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:16 smithi017 podman[27671]: 2024-09-20 18:26:16.230137718 +0000 UTC m=+0.098785427 container create 4e8265a00aecf394032f3df459e5fb7235863fdc32724b4f240622eac8bd0b9c (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-ed8ee0f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-20T18:26:16.348 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:16 smithi017 podman[27671]: 2024-09-20 18:26:16.154135487 +0000 UTC m=+0.022783213 image pull 6acb0a031eab55fe07acc1e5695be48af529a148c2f67dce7aead6591509af30 quay.ceph.io/ceph-ci/ceph:squid 2024-09-20T18:26:16.534 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-20T18:26:16.535 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-20T18:26:16.542 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-20T18:26:16.542 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-20T18:26:16.542 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-20T18:26:16.542 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2024-09-20T18:26:16.543 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon to start... 2024-09-20T18:26:16.543 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon... 2024-09-20T18:26:16.789 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:16 smithi017 podman[27671]: 2024-09-20 18:26:16.432468461 +0000 UTC m=+0.301116192 container init 4e8265a00aecf394032f3df459e5fb7235863fdc32724b4f240622eac8bd0b9c (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, RELEASE=squid-ed8ee0f, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-20T18:26:16.789 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:16 smithi017 podman[27671]: 2024-09-20 18:26:16.435698326 +0000 UTC m=+0.304346034 container start 4e8265a00aecf394032f3df459e5fb7235863fdc32724b4f240622eac8bd0b9c (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ed8ee0f, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-20T18:26:16.789 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:16 smithi017 ceph-mon[27690]: mkfs 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:26:16.789 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:16 smithi017 ceph-mon[27690]: mon.smithi017 is new leader, mons smithi017 in quorum (ranks 0) 2024-09-20T18:26:16.789 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:16 smithi017 bash[27671]: 4e8265a00aecf394032f3df459e5fb7235863fdc32724b4f240622eac8bd0b9c 2024-09-20T18:26:16.789 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:16 smithi017 systemd[1]: Started Ceph mon.smithi017 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:26:17.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:17 smithi017 ceph-mon[27690]: mon.smithi017 is new leader, mons smithi017 in quorum (ranks 0) 2024-09-20T18:26:17.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:17 smithi017 ceph-mon[27690]: monmap epoch 1 2024-09-20T18:26:17.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:17 smithi017 ceph-mon[27690]: fsid 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:26:17.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:17 smithi017 ceph-mon[27690]: last_changed 2024-09-20T18:26:13.426622+0000 2024-09-20T18:26:17.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:17 smithi017 ceph-mon[27690]: created 2024-09-20T18:26:13.426622+0000 2024-09-20T18:26:17.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:17 smithi017 ceph-mon[27690]: min_mon_release 19 (squid) 2024-09-20T18:26:17.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:17 smithi017 ceph-mon[27690]: election_strategy: 1 2024-09-20T18:26:17.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:17 smithi017 ceph-mon[27690]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.smithi017 2024-09-20T18:26:17.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:17 smithi017 ceph-mon[27690]: fsmap 2024-09-20T18:26:17.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:17 smithi017 ceph-mon[27690]: osdmap e1: 0 total, 0 up, 0 in 2024-09-20T18:26:17.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:17 smithi017 ceph-mon[27690]: mgrmap e1: no daemons active 2024-09-20T18:26:17.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:17 smithi017 ceph-mon[27690]: from='client.? 172.21.15.17:0/3693504891' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-20T18:26:17.680 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout cluster: 2024-09-20T18:26:17.681 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout id: 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:26:17.681 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-20T18:26:17.681 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-20T18:26:17.681 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout services: 2024-09-20T18:26:17.681 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi017 (age 0.569184s) 2024-09-20T18:26:17.681 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-20T18:26:17.681 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-20T18:26:17.681 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-20T18:26:17.681 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout data: 2024-09-20T18:26:17.681 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-20T18:26:17.681 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-20T18:26:17.681 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-20T18:26:17.682 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pgs: 2024-09-20T18:26:17.682 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-20T18:26:17.682 INFO:teuthology.orchestra.run.smithi017.stdout:mon is available 2024-09-20T18:26:17.682 INFO:teuthology.orchestra.run.smithi017.stdout:Assimilating anything we can from ceph.conf... 2024-09-20T18:26:18.640 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:18 smithi017 ceph-mon[27690]: from='client.? 172.21.15.17:0/2383034278' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-20T18:26:18.640 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:18 smithi017 ceph-mon[27690]: from='client.? 172.21.15.17:0/2383034278' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-20T18:26:18.643 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-20T18:26:18.644 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2024-09-20T18:26:18.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:26:18.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-09-20T18:26:18.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-20T18:26:18.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-20T18:26:18.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-20T18:26:18.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-20T18:26:18.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-20T18:26:18.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-20T18:26:18.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-20T18:26:18.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-20T18:26:18.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2024-09-20T18:26:18.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-20T18:26:18.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-20T18:26:18.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-20T18:26:18.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-20T18:26:18.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-20T18:26:18.646 INFO:teuthology.orchestra.run.smithi017.stdout:Generating new minimal ceph.conf... 2024-09-20T18:26:19.648 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:19 smithi017 ceph-mon[27690]: from='client.? 172.21.15.17:0/1819189484' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:26:19.758 INFO:teuthology.orchestra.run.smithi017.stdout:Restarting the monitor... 2024-09-20T18:26:20.050 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:19 smithi017 systemd[1]: Stopping Ceph mon.smithi017 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:26:20.398 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:20 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[27686]: 2024-09-20T18:26:20.037+0000 7fe6d8783640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi017 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T18:26:20.398 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:20 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[27686]: 2024-09-20T18:26:20.037+0000 7fe6d8783640 -1 mon.smithi017@0(leader) e1 *** Got Signal Terminated *** 2024-09-20T18:26:20.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:20 smithi017 podman[27932]: 2024-09-20 18:26:20.170554845 +0000 UTC m=+0.254249908 container died 4e8265a00aecf394032f3df459e5fb7235863fdc32724b4f240622eac8bd0b9c (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, CEPH_POINT_RELEASE=, RELEASE=squid-ed8ee0f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-20T18:26:20.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:20 smithi017 podman[27932]: 2024-09-20 18:26:20.528418751 +0000 UTC m=+0.612113816 container cleanup 4e8265a00aecf394032f3df459e5fb7235863fdc32724b4f240622eac8bd0b9c (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-ed8ee0f) 2024-09-20T18:26:20.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:20 smithi017 bash[27932]: ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017 2024-09-20T18:26:21.329 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:20 smithi017 podman[27943]: 2024-09-20 18:26:20.887747068 +0000 UTC m=+0.714865859 container remove 4e8265a00aecf394032f3df459e5fb7235863fdc32724b4f240622eac8bd0b9c (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-ed8ee0f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-20T18:26:21.329 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 systemd[1]: ceph-7a27d282-777d-11ef-baf5-efdc52797490@mon.smithi017.service: Deactivated successfully. 2024-09-20T18:26:21.329 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 systemd[1]: Stopped Ceph mon.smithi017 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:26:21.329 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 systemd[1]: Starting Ceph mon.smithi017 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:26:21.581 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 podman[28039]: 2024-09-20 18:26:21.22001166 +0000 UTC m=+0.016248828 image pull 6acb0a031eab55fe07acc1e5695be48af529a148c2f67dce7aead6591509af30 quay.ceph.io/ceph-ci/ceph:squid 2024-09-20T18:26:21.581 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 podman[28039]: 2024-09-20 18:26:21.321628242 +0000 UTC m=+0.117865391 container create ab1f988c4cb28560ec54adfa85258fc26c34d7f2242a4450d96ac799313719db (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-ed8ee0f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-20T18:26:21.581 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 podman[28039]: 2024-09-20 18:26:21.540295796 +0000 UTC m=+0.336532959 container init ab1f988c4cb28560ec54adfa85258fc26c34d7f2242a4450d96ac799313719db (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-ed8ee0f, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T18:26:21.581 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 podman[28039]: 2024-09-20 18:26:21.543607965 +0000 UTC m=+0.339845113 container start ab1f988c4cb28560ec54adfa85258fc26c34d7f2242a4450d96ac799313719db (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-ed8ee0f, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-20T18:26:21.581 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: set uid:gid to 167:167 (ceph:ceph) 2024-09-20T18:26:21.581 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable), process ceph-mon, pid 2 2024-09-20T18:26:21.581 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: pidfile_write: ignore empty --pid-file 2024-09-20T18:26:21.581 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: load: jerasure load: lrc 2024-09-20T18:26:21.640 INFO:teuthology.orchestra.run.smithi017.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-20T18:26:21.865 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: RocksDB version: 7.9.2 2024-09-20T18:26:21.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Git sha 0 2024-09-20T18:26:21.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Compile date 2024-09-19 20:45:27 2024-09-20T18:26:21.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: DB SUMMARY 2024-09-20T18:26:21.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: DB Session ID: 5NGC0UKXLV3Z26XRKSCO 2024-09-20T18:26:21.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: CURRENT file: CURRENT 2024-09-20T18:26:21.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: IDENTITY file: IDENTITY 2024-09-20T18:26:21.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-20T18:26:21.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi017/store.db dir, Total Num: 1, files: 000008.sst 2024-09-20T18:26:21.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi017/store.db: 000009.log size: 95837 ; 2024-09-20T18:26:21.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.error_if_exists: 0 2024-09-20T18:26:21.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.create_if_missing: 0 2024-09-20T18:26:21.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.paranoid_checks: 1 2024-09-20T18:26:21.867 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-20T18:26:21.867 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T18:26:21.867 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-20T18:26:21.867 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.env: 0x55e10307d940 2024-09-20T18:26:21.867 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.fs: PosixFileSystem 2024-09-20T18:26:21.867 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.info_log: 0x55e104ccb8c0 2024-09-20T18:26:21.867 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_file_opening_threads: 16 2024-09-20T18:26:21.867 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.statistics: (nil) 2024-09-20T18:26:21.867 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.use_fsync: 0 2024-09-20T18:26:21.867 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_log_file_size: 0 2024-09-20T18:26:21.867 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T18:26:21.867 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T18:26:21.867 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.keep_log_file_num: 1000 2024-09-20T18:26:21.868 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.recycle_log_file_num: 0 2024-09-20T18:26:21.868 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.allow_fallocate: 1 2024-09-20T18:26:21.868 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.allow_mmap_reads: 0 2024-09-20T18:26:21.868 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.allow_mmap_writes: 0 2024-09-20T18:26:21.868 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.use_direct_reads: 0 2024-09-20T18:26:21.868 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T18:26:21.868 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.create_missing_column_families: 0 2024-09-20T18:26:21.868 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.db_log_dir: 2024-09-20T18:26:21.868 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.wal_dir: 2024-09-20T18:26:21.868 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T18:26:21.868 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T18:26:21.868 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T18:26:21.869 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T18:26:21.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T18:26:21.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T18:26:21.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.advise_random_on_open: 1 2024-09-20T18:26:21.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.db_write_buffer_size: 0 2024-09-20T18:26:21.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.write_buffer_manager: 0x55e104cdadc0 2024-09-20T18:26:21.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T18:26:21.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T18:26:21.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T18:26:21.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.rate_limiter: (nil) 2024-09-20T18:26:21.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T18:26:21.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.wal_recovery_mode: 2 2024-09-20T18:26:21.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.enable_thread_tracking: 0 2024-09-20T18:26:21.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.enable_pipelined_write: 0 2024-09-20T18:26:21.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.unordered_write: 0 2024-09-20T18:26:21.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T18:26:21.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T18:26:21.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T18:26:21.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T18:26:21.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.row_cache: None 2024-09-20T18:26:21.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.wal_filter: None 2024-09-20T18:26:21.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T18:26:21.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.allow_ingest_behind: 0 2024-09-20T18:26:21.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.two_write_queues: 0 2024-09-20T18:26:21.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.manual_wal_flush: 0 2024-09-20T18:26:21.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.wal_compression: 0 2024-09-20T18:26:21.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.atomic_flush: 0 2024-09-20T18:26:21.872 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T18:26:21.872 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T18:26:21.872 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T18:26:21.872 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.log_readahead_size: 0 2024-09-20T18:26:21.872 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T18:26:21.872 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.best_efforts_recovery: 0 2024-09-20T18:26:21.872 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T18:26:21.872 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T18:26:21.872 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.allow_data_in_errors: 0 2024-09-20T18:26:21.872 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.db_host_id: __hostname__ 2024-09-20T18:26:21.872 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-20T18:26:21.872 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_background_jobs: 2 2024-09-20T18:26:21.872 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_background_compactions: -1 2024-09-20T18:26:21.872 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_subcompactions: 1 2024-09-20T18:26:21.873 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T18:26:21.873 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T18:26:21.873 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T18:26:21.873 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_total_wal_size: 0 2024-09-20T18:26:21.873 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T18:26:21.873 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T18:26:21.873 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T18:26:21.873 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T18:26:21.873 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_open_files: -1 2024-09-20T18:26:21.873 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.bytes_per_sync: 0 2024-09-20T18:26:21.873 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T18:26:21.873 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T18:26:21.873 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compaction_readahead_size: 0 2024-09-20T18:26:21.873 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_background_flushes: -1 2024-09-20T18:26:21.873 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Compression algorithms supported: 2024-09-20T18:26:21.874 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: kZSTD supported: 0 2024-09-20T18:26:21.874 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: kXpressCompression supported: 0 2024-09-20T18:26:21.874 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: kBZip2Compression supported: 0 2024-09-20T18:26:21.874 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T18:26:21.874 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: kLZ4Compression supported: 1 2024-09-20T18:26:21.874 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: kZlibCompression supported: 1 2024-09-20T18:26:21.874 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: kLZ4HCCompression supported: 1 2024-09-20T18:26:21.874 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: kSnappyCompression supported: 1 2024-09-20T18:26:21.874 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T18:26:21.874 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-20T18:26:21.874 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi017/store.db/MANIFEST-000010 2024-09-20T18:26:21.874 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-20T18:26:21.874 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T18:26:21.874 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.merge_operator: 2024-09-20T18:26:21.874 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compaction_filter: None 2024-09-20T18:26:21.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compaction_filter_factory: None 2024-09-20T18:26:21.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.sst_partitioner_factory: None 2024-09-20T18:26:21.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T18:26:21.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T18:26:21.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e104ccb520) 2024-09-20T18:26:21.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: cache_index_and_filter_blocks: 1 2024-09-20T18:26:21.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T18:26:21.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T18:26:21.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: pin_top_level_index_and_filter: 1 2024-09-20T18:26:21.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: index_type: 0 2024-09-20T18:26:21.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: data_block_index_type: 0 2024-09-20T18:26:21.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: index_shortening: 1 2024-09-20T18:26:21.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-20T18:26:21.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: checksum: 4 2024-09-20T18:26:21.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: no_block_cache: 0 2024-09-20T18:26:21.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_cache: 0x55e104cbf1f0 2024-09-20T18:26:21.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_cache_name: BinnedLRUCache 2024-09-20T18:26:21.876 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_cache_options: 2024-09-20T18:26:21.876 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: capacity : 536870912 2024-09-20T18:26:21.876 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: num_shard_bits : 4 2024-09-20T18:26:21.876 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: strict_capacity_limit : 0 2024-09-20T18:26:21.876 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: high_pri_pool_ratio: 0.000 2024-09-20T18:26:21.876 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_cache_compressed: (nil) 2024-09-20T18:26:21.876 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: persistent_cache: (nil) 2024-09-20T18:26:21.876 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_size: 4096 2024-09-20T18:26:21.876 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_size_deviation: 10 2024-09-20T18:26:21.876 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_restart_interval: 16 2024-09-20T18:26:21.876 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: index_block_restart_interval: 1 2024-09-20T18:26:21.876 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: metadata_block_size: 4096 2024-09-20T18:26:21.876 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: partition_filters: 0 2024-09-20T18:26:21.876 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: use_delta_encoding: 1 2024-09-20T18:26:21.876 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: filter_policy: bloomfilter 2024-09-20T18:26:21.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: whole_key_filtering: 1 2024-09-20T18:26:21.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: verify_compression: 0 2024-09-20T18:26:21.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: read_amp_bytes_per_bit: 0 2024-09-20T18:26:21.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: format_version: 5 2024-09-20T18:26:21.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: enable_index_compression: 1 2024-09-20T18:26:21.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_align: 0 2024-09-20T18:26:21.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: max_auto_readahead_size: 262144 2024-09-20T18:26:21.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: prepopulate_block_cache: 0 2024-09-20T18:26:21.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: initial_auto_readahead_size: 8192 2024-09-20T18:26:21.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: num_file_reads_for_auto_readahead: 2 2024-09-20T18:26:21.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.write_buffer_size: 33554432 2024-09-20T18:26:21.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_write_buffer_number: 2 2024-09-20T18:26:21.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compression: NoCompression 2024-09-20T18:26:21.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.bottommost_compression: Disabled 2024-09-20T18:26:21.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.prefix_extractor: nullptr 2024-09-20T18:26:21.878 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T18:26:21.878 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.num_levels: 7 2024-09-20T18:26:21.878 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T18:26:21.878 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T18:26:21.878 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T18:26:21.878 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T18:26:21.878 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T18:26:21.878 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T18:26:21.878 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T18:26:21.878 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T18:26:21.878 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T18:26:21.878 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T18:26:21.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-20T18:26:21.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-20T18:26:21.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T18:26:21.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compression_opts.level: 32767 2024-09-20T18:26:21.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compression_opts.strategy: 0 2024-09-20T18:26:21.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T18:26:21.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T18:26:21.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-20T18:26:21.880 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T18:26:21.880 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compression_opts.enabled: false 2024-09-20T18:26:21.880 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-20T18:26:21.880 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T18:26:21.880 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T18:26:21.880 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T18:26:21.880 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.target_file_size_base: 67108864 2024-09-20T18:26:21.880 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T18:26:21.880 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T18:26:21.880 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T18:26:21.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T18:26:21.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T18:26:21.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T18:26:21.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T18:26:21.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T18:26:21.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T18:26:21.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T18:26:21.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T18:26:21.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T18:26:21.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T18:26:21.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-20T18:26:21.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.arena_block_size: 1048576 2024-09-20T18:26:21.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T18:26:21.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T18:26:21.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.disable_auto_compactions: 0 2024-09-20T18:26:21.882 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T18:26:21.882 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T18:26:21.882 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T18:26:21.882 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T18:26:21.882 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T18:26:21.882 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T18:26:21.882 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T18:26:21.882 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T18:26:21.882 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T18:26:21.882 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T18:26:21.882 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-20T18:26:21.882 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.inplace_update_support: 0 2024-09-20T18:26:21.882 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T18:26:21.883 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T18:26:21.883 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T18:26:21.883 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T18:26:21.883 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.bloom_locality: 0 2024-09-20T18:26:21.883 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.max_successive_merges: 0 2024-09-20T18:26:21.883 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T18:26:21.883 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.paranoid_file_checks: 0 2024-09-20T18:26:21.883 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.force_consistency_checks: 1 2024-09-20T18:26:21.883 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.report_bg_io_stats: 0 2024-09-20T18:26:21.883 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.ttl: 2592000 2024-09-20T18:26:21.883 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T18:26:21.883 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-20T18:26:21.883 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-20T18:26:21.883 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.enable_blob_files: false 2024-09-20T18:26:21.883 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.min_blob_size: 0 2024-09-20T18:26:21.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.blob_file_size: 268435456 2024-09-20T18:26:21.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T18:26:21.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T18:26:21.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T18:26:21.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-20T18:26:21.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-20T18:26:21.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.blob_file_starting_level: 0 2024-09-20T18:26:21.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-20T18:26:21.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi017/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-20T18:26:21.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-20T18:26:21.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d18da2d4-b303-45bd-aa85-26773614b9d1 2024-09-20T18:26:21.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726856781570704, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-20T18:26:21.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-20T18:26:21.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726856781571643, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91838, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 288, "table_properties": {"data_size": 89879, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11912, "raw_average_key_size": 48, "raw_value_size": 83247, "raw_average_value_size": 337, "num_data_blocks": 12, "num_entries": 247, "num_filter_entries": 247, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726856781, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d18da2d4-b303-45bd-aa85-26773614b9d1", "db_session_id": "5NGC0UKXLV3Z26XRKSCO", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-20T18:26:21.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726856781571750, "job": 1, "event": "recovery_finished"} 2024-09-20T18:26:21.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-20T18:26:21.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi017/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T18:26:21.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e104cece00 2024-09-20T18:26:21.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: DB pointer 0x55e104de8000 2024-09-20T18:26:21.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-20T18:26:21.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-20T18:26:21.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ** DB Stats ** 2024-09-20T18:26:21.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T18:26:21.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T18:26:21.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T18:26:21.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T18:26:21.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T18:26:21.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T18:26:21.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T18:26:21.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-09-20T18:26:21.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ** Compaction Stats [default] ** 2024-09-20T18:26:21.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T18:26:21.886 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-20T18:26:21.886 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: L0 2/0 91.58 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-20T18:26:21.886 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Sum 2/0 91.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-20T18:26:21.886 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 146.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-20T18:26:21.886 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-09-20T18:26:21.886 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ** Compaction Stats [default] ** 2024-09-20T18:26:21.886 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T18:26:21.886 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T18:26:21.886 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 146.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-20T18:26:21.886 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-09-20T18:26:21.886 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-20T18:26:21.886 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-09-20T18:26:21.886 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T18:26:21.886 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-20T18:26:21.887 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T18:26:21.887 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T18:26:21.887 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T18:26:21.887 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-20T18:26:21.887 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Cumulative compaction: 0.00 GB write, 27.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T18:26:21.887 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Interval compaction: 0.00 GB write, 27.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T18:26:21.887 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T18:26:21.887 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Block cache BinnedLRUCache@0x55e104cbf1f0#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-20T18:26:21.887 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-20T18:26:21.887 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-09-20T18:26:21.887 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-20T18:26:21.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: starting mon.smithi017 rank 0 at public addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] at bind addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi017 fsid 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:26:21.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: mon.smithi017@-1(???) e1 preinit fsid 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:26:21.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: mon.smithi017@-1(???).mds e1 new map 2024-09-20T18:26:21.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: mon.smithi017@-1(???).mds e1 print_map 2024-09-20T18:26:21.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: e1 2024-09-20T18:26:21.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: btime 2024-09-20T18:26:16:474210+0000 2024-09-20T18:26:21.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:26:21.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:26:21.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: legacy client fscid: -1 2024-09-20T18:26:21.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-09-20T18:26:21.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: No filesystems configured 2024-09-20T18:26:21.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: mon.smithi017@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-20T18:26:21.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: mon.smithi017@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T18:26:21.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: mon.smithi017@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T18:26:21.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: mon.smithi017@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T18:26:21.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: mon.smithi017@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-20T18:26:21.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 bash[28039]: ab1f988c4cb28560ec54adfa85258fc26c34d7f2242a4450d96ac799313719db 2024-09-20T18:26:21.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 systemd[1]: Started Ceph mon.smithi017 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:26:21.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: mon.smithi017 is new leader, mons smithi017 in quorum (ranks 0) 2024-09-20T18:26:21.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: monmap epoch 1 2024-09-20T18:26:21.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: fsid 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:26:21.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: last_changed 2024-09-20T18:26:13.426622+0000 2024-09-20T18:26:21.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: created 2024-09-20T18:26:13.426622+0000 2024-09-20T18:26:21.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: min_mon_release 19 (squid) 2024-09-20T18:26:21.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: election_strategy: 1 2024-09-20T18:26:21.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.smithi017 2024-09-20T18:26:21.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: fsmap 2024-09-20T18:26:21.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: osdmap e1: 0 total, 0 up, 0 in 2024-09-20T18:26:21.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:21 smithi017 ceph-mon[28058]: mgrmap e1: no daemons active 2024-09-20T18:26:22.636 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-20T18:26:22.658 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-20T18:26:22.658 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mgr... 2024-09-20T18:26:22.659 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-20T18:26:22.659 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-20T18:26:22.660 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-20T18:26:22.921 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7a27d282-777d-11ef-baf5-efdc52797490@mgr.smithi017.xusjwd 2024-09-20T18:26:22.921 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7a27d282-777d-11ef-baf5-efdc52797490@mgr.smithi017.xusjwd.service: Unit ceph-7a27d282-777d-11ef-baf5-efdc52797490@mgr.smithi017.xusjwd.service not loaded. 2024-09-20T18:26:23.082 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7a27d282-777d-11ef-baf5-efdc52797490.target.wants/ceph-7a27d282-777d-11ef-baf5-efdc52797490@mgr.smithi017.xusjwd.service → /etc/systemd/system/ceph-7a27d282-777d-11ef-baf5-efdc52797490@.service. 2024-09-20T18:26:23.398 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:23 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2345872831' entity='client.admin' 2024-09-20T18:26:23.629 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-20T18:26:23.630 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-20T18:26:23.638 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-20T18:26:23.638 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-20T18:26:23.638 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-20T18:26:23.638 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2024-09-20T18:26:23.647 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-20T18:26:23.647 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-20T18:26:23.655 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-20T18:26:23.655 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-20T18:26:23.655 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-20T18:26:23.655 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-20T18:26:23.655 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr to start... 2024-09-20T18:26:23.655 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr... 2024-09-20T18:26:24.259 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:24 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3296833208' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-20T18:26:24.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-20T18:26:24.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-20T18:26:24.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "7a27d282-777d-11ef-baf5-efdc52797490", 2024-09-20T18:26:24.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-09-20T18:26:24.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-20T18:26:24.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-20T18:26:24.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-20T18:26:24.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:24.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-20T18:26:24.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-20T18:26:24.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-09-20T18:26:24.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:26:24.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-20T18:26:24.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "smithi017" 2024-09-20T18:26:24.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:26:24.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-20T18:26:24.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-20T18:26:24.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:26:24.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-20T18:26:24.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-20T18:26:24.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:24.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-20T18:26:24.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:26:24.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-20T18:26:24.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-20T18:26:24.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-20T18:26:24.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-20T18:26:24.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-20T18:26:24.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-20T18:26:24.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:24.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-20T18:26:24.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-20T18:26:24.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-20T18:26:24.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-20T18:26:24.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-20T18:26:24.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-20T18:26:24.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-20T18:26:24.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-20T18:26:24.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-20T18:26:24.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:24.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-20T18:26:24.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:26:24.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "btime": "2024-09-20T18:26:16:474210+0000", 2024-09-20T18:26:24.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-20T18:26:24.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-20T18:26:24.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:24.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-20T18:26:24.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-20T18:26:24.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-20T18:26:24.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-20T18:26:24.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-20T18:26:24.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-20T18:26:24.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-09-20T18:26:24.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:26:24.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T18:26:24.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:24.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-20T18:26:24.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:26:24.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-09-20T18:26:16.474849+0000", 2024-09-20T18:26:24.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T18:26:24.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:24.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-20T18:26:24.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-20T18:26:24.756 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (1/15)... 2024-09-20T18:26:27.468 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:27 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1152025900' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-20T18:26:27.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-20T18:26:27.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-20T18:26:27.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "7a27d282-777d-11ef-baf5-efdc52797490", 2024-09-20T18:26:27.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-09-20T18:26:27.956 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-20T18:26:27.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-20T18:26:27.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-20T18:26:27.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:27.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-20T18:26:27.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-20T18:26:27.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-09-20T18:26:27.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:26:27.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-20T18:26:27.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "smithi017" 2024-09-20T18:26:27.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:26:27.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-20T18:26:27.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-20T18:26:27.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:26:27.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-20T18:26:27.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-20T18:26:27.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:27.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-20T18:26:27.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:26:27.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-20T18:26:27.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-20T18:26:27.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-20T18:26:27.958 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-20T18:26:27.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-20T18:26:27.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-20T18:26:27.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:27.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-20T18:26:27.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-20T18:26:27.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-20T18:26:27.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-20T18:26:27.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-20T18:26:27.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-20T18:26:27.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-20T18:26:27.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-20T18:26:27.961 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-20T18:26:27.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:27.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-20T18:26:27.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:26:27.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "btime": "2024-09-20T18:26:16:474210+0000", 2024-09-20T18:26:27.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-20T18:26:27.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-20T18:26:27.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:27.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-20T18:26:27.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-20T18:26:27.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-20T18:26:27.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-20T18:26:27.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-20T18:26:27.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-20T18:26:27.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-09-20T18:26:27.962 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:26:27.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T18:26:27.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:27.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-20T18:26:27.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:26:27.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-09-20T18:26:16.474849+0000", 2024-09-20T18:26:27.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T18:26:27.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:27.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-20T18:26:27.963 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-20T18:26:27.963 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (2/15)... 2024-09-20T18:26:28.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:28 smithi017 ceph-mon[28058]: Activating manager daemon smithi017.xusjwd 2024-09-20T18:26:28.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:28 smithi017 ceph-mon[28058]: mgrmap e2: smithi017.xusjwd(active, starting, since 0.00347627s) 2024-09-20T18:26:28.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:28 smithi017 ceph-mon[28058]: from='mgr.14100 172.21.15.17:0/2079469905' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T18:26:28.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:28 smithi017 ceph-mon[28058]: from='mgr.14100 172.21.15.17:0/2079469905' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T18:26:28.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:28 smithi017 ceph-mon[28058]: from='mgr.14100 172.21.15.17:0/2079469905' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T18:26:28.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:28 smithi017 ceph-mon[28058]: from='mgr.14100 172.21.15.17:0/2079469905' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-09-20T18:26:28.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:28 smithi017 ceph-mon[28058]: from='mgr.14100 172.21.15.17:0/2079469905' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr metadata", "who": "smithi017.xusjwd", "id": "smithi017.xusjwd"}]: dispatch 2024-09-20T18:26:28.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:28 smithi017 ceph-mon[28058]: Manager daemon smithi017.xusjwd is now available 2024-09-20T18:26:28.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:28 smithi017 ceph-mon[28058]: from='mgr.14100 172.21.15.17:0/2079469905' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/mirror_snapshot_schedule"}]: dispatch 2024-09-20T18:26:28.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:28 smithi017 ceph-mon[28058]: from='mgr.14100 172.21.15.17:0/2079469905' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/trash_purge_schedule"}]: dispatch 2024-09-20T18:26:28.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:28 smithi017 ceph-mon[28058]: from='mgr.14100 172.21.15.17:0/2079469905' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:28.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:28 smithi017 ceph-mon[28058]: from='mgr.14100 172.21.15.17:0/2079469905' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:28.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:28 smithi017 ceph-mon[28058]: from='mgr.14100 172.21.15.17:0/2079469905' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:30.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:30 smithi017 ceph-mon[28058]: mgrmap e3: smithi017.xusjwd(active, since 1.00764s) 2024-09-20T18:26:31.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-20T18:26:31.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-20T18:26:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "7a27d282-777d-11ef-baf5-efdc52797490", 2024-09-20T18:26:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-09-20T18:26:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-20T18:26:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-20T18:26:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-20T18:26:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-20T18:26:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-20T18:26:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-09-20T18:26:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:26:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-20T18:26:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "smithi017" 2024-09-20T18:26:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:26:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-20T18:26:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-20T18:26:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:26:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-20T18:26:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-20T18:26:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-20T18:26:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:26:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-20T18:26:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-20T18:26:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-20T18:26:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-20T18:26:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-20T18:26:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-20T18:26:31.191 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:31.191 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-20T18:26:31.191 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-20T18:26:31.191 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-20T18:26:31.191 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-20T18:26:31.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-20T18:26:31.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-20T18:26:31.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-20T18:26:31.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-20T18:26:31.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-20T18:26:31.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:31.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-20T18:26:31.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:26:31.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "btime": "2024-09-20T18:26:16:474210+0000", 2024-09-20T18:26:31.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-20T18:26:31.192 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-20T18:26:31.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:31.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-20T18:26:31.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-20T18:26:31.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-20T18:26:31.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-20T18:26:31.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-20T18:26:31.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-20T18:26:31.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-09-20T18:26:31.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-09-20T18:26:31.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T18:26:31.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:31.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-20T18:26:31.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-20T18:26:31.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-09-20T18:26:16.474849+0000", 2024-09-20T18:26:31.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-20T18:26:31.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-09-20T18:26:31.193 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-20T18:26:31.194 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-20T18:26:31.194 INFO:teuthology.orchestra.run.smithi017.stdout:mgr is available 2024-09-20T18:26:31.737 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:31 smithi017 ceph-mon[28058]: mgrmap e4: smithi017.xusjwd(active, since 2s) 2024-09-20T18:26:31.737 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:31 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1346655610' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-20T18:26:32.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-20T18:26:32.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2024-09-20T18:26:32.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:26:32.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-09-20T18:26:32.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-20T18:26:32.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-20T18:26:32.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-20T18:26:32.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-20T18:26:32.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-20T18:26:32.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-20T18:26:32.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-20T18:26:32.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-09-20T18:26:32.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2024-09-20T18:26:32.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-20T18:26:32.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-20T18:26:32.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-20T18:26:32.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-20T18:26:32.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-20T18:26:32.326 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling cephadm module... 2024-09-20T18:26:32.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:32 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3216701395' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-20T18:26:33.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:33 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2714140556' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-20T18:26:34.845 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:34 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2714140556' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-20T18:26:34.845 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:34 smithi017 ceph-mon[28058]: mgrmap e5: smithi017.xusjwd(active, since 5s) 2024-09-20T18:26:35.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-20T18:26:35.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-20T18:26:35.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-20T18:26:35.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "smithi017.xusjwd", 2024-09-20T18:26:35.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-20T18:26:35.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-20T18:26:35.386 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2024-09-20T18:26:35.386 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 5... 2024-09-20T18:26:35.818 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:35 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3739703001' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-20T18:26:39.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:38 smithi017 ceph-mon[28058]: Active manager daemon smithi017.xusjwd restarted 2024-09-20T18:26:39.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:38 smithi017 ceph-mon[28058]: Activating manager daemon smithi017.xusjwd 2024-09-20T18:26:39.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:38 smithi017 ceph-mon[28058]: osdmap e2: 0 total, 0 up, 0 in 2024-09-20T18:26:39.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:38 smithi017 ceph-mon[28058]: mgrmap e6: smithi017.xusjwd(active, starting, since 0.0030805s) 2024-09-20T18:26:39.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:38 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-09-20T18:26:39.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:38 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr metadata", "who": "smithi017.xusjwd", "id": "smithi017.xusjwd"}]: dispatch 2024-09-20T18:26:39.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:38 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T18:26:39.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:38 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T18:26:39.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:38 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T18:26:39.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:38 smithi017 ceph-mon[28058]: Manager daemon smithi017.xusjwd is now available 2024-09-20T18:26:39.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:38 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:39.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:38 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:39.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:38 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:26:39.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:38 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:26:39.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:38 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/mirror_snapshot_schedule"}]: dispatch 2024-09-20T18:26:39.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:38 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/trash_purge_schedule"}]: dispatch 2024-09-20T18:26:39.990 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:39 smithi017 ceph-mon[28058]: Found migration_current of "None". Setting to last migration. 2024-09-20T18:26:39.990 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:39 smithi017 ceph-mon[28058]: mgrmap e7: smithi017.xusjwd(active, since 1.00509s) 2024-09-20T18:26:40.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-20T18:26:40.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-20T18:26:40.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-20T18:26:40.252 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-20T18:26:40.252 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 5 is available 2024-09-20T18:26:40.252 INFO:teuthology.orchestra.run.smithi017.stdout:Setting orchestrator backend to cephadm... 2024-09-20T18:26:41.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:40 smithi017 ceph-mon[28058]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-20T18:26:41.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:40 smithi017 ceph-mon[28058]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-20T18:26:41.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:40 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:41.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:40 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:41.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:40 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:41.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:40 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:26:42.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:41 smithi017 ceph-mon[28058]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:26:42.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:41 smithi017 ceph-mon[28058]: mgrmap e8: smithi017.xusjwd(active, since 2s) 2024-09-20T18:26:42.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:41 smithi017 ceph-mon[28058]: [20/Sep/2024:18:26:41] ENGINE Bus STARTING 2024-09-20T18:26:42.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:41 smithi017 ceph-mon[28058]: [20/Sep/2024:18:26:41] ENGINE Serving on https://172.21.15.17:7150 2024-09-20T18:26:42.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:41 smithi017 ceph-mon[28058]: [20/Sep/2024:18:26:41] ENGINE Error in HTTPServer.serve 2024-09-20T18:26:42.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Traceback (most recent call last): 2024-09-20T18:26:42.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T18:26:42.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-09-20T18:26:42.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T18:26:42.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._run(expiration_interval) 2024-09-20T18:26:42.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T18:26:42.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T18:26:42.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T18:26:42.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T18:26:42.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T18:26:42.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s = self.context.wrap_socket( 2024-09-20T18:26:42.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T18:26:42.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: return self.sslsocket_class._create( 2024-09-20T18:26:42.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T18:26:42.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self.do_handshake() 2024-09-20T18:26:42.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T18:26:42.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._sslobj.do_handshake() 2024-09-20T18:26:42.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T18:26:42.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:41 smithi017 ceph-mon[28058]: [20/Sep/2024:18:26:41] ENGINE Serving on http://172.21.15.17:8765 2024-09-20T18:26:42.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:41 smithi017 ceph-mon[28058]: [20/Sep/2024:18:26:41] ENGINE Bus STARTED 2024-09-20T18:26:42.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:41 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:26:42.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-20T18:26:42.589 INFO:teuthology.orchestra.run.smithi017.stdout:Generating ssh key... 2024-09-20T18:26:43.021 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:42 smithi017 ceph-mon[28058]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:26:44.449 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:44 smithi017 ceph-mon[28058]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:26:44.449 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:44 smithi017 ceph-mon[28058]: Generating ssh key... 2024-09-20T18:26:44.449 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:44 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:44.449 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:44 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:45.026 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9w2xZix7V7ItEJweHZtQrkZE3p14uDO3qRl703N+nwlJgeLJdml2+IiuzOE2b93vppiqwJyW6DrxoLeFnnSjgVCBMqAaLNbA+OEOWb6VtxXJqqVInlnTadgAvmv98KyPTfuQ1TxAh48zNPemk88azMJbxVmTHG0Rfqtv6fvxRqzeo/oo9w8FKVMIg4fEoBcrodL2VWl8MwYmVcnnLThcDn0c4WLT56nPtK8v8qiyPUDIWx0pAWesyjmOvG5VYtNK0pFvgi/dK9keqZwyVUr9vgZOZP5ZP1OhJ4cqrNHixLooEjSV77vb57SYWEKKZ3EQJxfTLQ6D+M87sf2FcoOLdbuL3KYVyCOt1gyPoydNm4mebz28t16LUmMoGUxV8P1oZqvzuggf6oC9ZfAY8hhGgzOL4lYxONYF7BtUv5Jua9TMY7FdLNQe6XHMPlD1qyNq1iyer+tgI5VXuwXSPzNTUlhftPASCUrpineP4SFFMgOwco9I9ynnYUmLn16Bj1yU= ceph-7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:26:45.026 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-20T18:26:45.026 INFO:teuthology.orchestra.run.smithi017.stdout:Adding key to root@localhost authorized_keys... 2024-09-20T18:26:45.033 INFO:teuthology.orchestra.run.smithi017.stdout:Adding host smithi017... 2024-09-20T18:26:45.648 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:45 smithi017 ceph-mon[28058]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:26:46.636 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:46 smithi017 ceph-mon[28058]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi017", "addr": "172.21.15.17", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:26:47.832 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:47 smithi017 ceph-mon[28058]: Deploying cephadm binary to smithi017 2024-09-20T18:26:50.033 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Added host 'smithi017' with addr '172.21.15.17' 2024-09-20T18:26:50.033 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying mon service with default placement... 2024-09-20T18:26:50.612 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:50 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:50.612 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:50 smithi017 ceph-mon[28058]: Added host smithi017 2024-09-20T18:26:50.612 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:50 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:26:51.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-20T18:26:51.139 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying mgr service with default placement... 2024-09-20T18:26:51.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:51 smithi017 ceph-mon[28058]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:26:51.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:51 smithi017 ceph-mon[28058]: Saving service mon spec with placement count:5 2024-09-20T18:26:51.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:51 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:52.286 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-20T18:26:52.286 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying crash service with default placement... 2024-09-20T18:26:53.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:52 smithi017 ceph-mon[28058]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:26:53.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:52 smithi017 ceph-mon[28058]: Saving service mgr spec with placement count:2 2024-09-20T18:26:53.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:52 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:53.433 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-20T18:26:53.434 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying ceph-exporter service with default placement... 2024-09-20T18:26:54.041 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:53 smithi017 ceph-mon[28058]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:26:54.041 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:53 smithi017 ceph-mon[28058]: Saving service crash spec with placement * 2024-09-20T18:26:54.041 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:53 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:54.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-20T18:26:54.600 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying prometheus service with default placement... 2024-09-20T18:26:55.207 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:55 smithi017 ceph-mon[28058]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:26:55.207 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:55 smithi017 ceph-mon[28058]: Saving service ceph-exporter spec with placement * 2024-09-20T18:26:55.207 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:55 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:56.501 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:56 smithi017 ceph-mon[28058]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:26:56.501 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:56 smithi017 ceph-mon[28058]: Saving service prometheus spec with placement count:1 2024-09-20T18:26:56.501 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:56 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:56.501 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:56 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:56.503 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-20T18:26:56.503 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying grafana service with default placement... 2024-09-20T18:26:57.754 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:57 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:57.754 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:57 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:58.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-20T18:26:58.238 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying node-exporter service with default placement... 2024-09-20T18:26:58.621 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:58 smithi017 ceph-mon[28058]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:26:58.621 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:58 smithi017 ceph-mon[28058]: Saving service grafana spec with placement count:1 2024-09-20T18:26:58.621 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:58 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:26:59.553 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-20T18:26:59.553 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying alertmanager service with default placement... 2024-09-20T18:27:00.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:59 smithi017 ceph-mon[28058]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:27:00.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:59 smithi017 ceph-mon[28058]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:27:00.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:59 smithi017 ceph-mon[28058]: Saving service node-exporter spec with placement * 2024-09-20T18:27:00.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:59 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:00.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:26:59 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:01.045 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-20T18:27:01.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:01 smithi017 ceph-mon[28058]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:27:01.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:01 smithi017 ceph-mon[28058]: Saving service alertmanager spec with placement count:1 2024-09-20T18:27:01.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:01 smithi017 ceph-mon[28058]: from='mgr.14118 172.21.15.17:0/3811499383' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:02.305 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:02 smithi017 ceph-mon[28058]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:27:03.363 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:03 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3312878430' entity='client.admin' 2024-09-20T18:27:03.934 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling the dashboard module... 2024-09-20T18:27:04.648 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:04 smithi017 ceph-mon[28058]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:27:04.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:04 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2097667812' entity='client.admin' 2024-09-20T18:27:05.648 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:05 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1226843015' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-20T18:27:06.525 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:06 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1226843015' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-20T18:27:06.525 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:06 smithi017 ceph-mon[28058]: mgrmap e9: smithi017.xusjwd(active, since 26s) 2024-09-20T18:27:07.121 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-20T18:27:07.121 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-20T18:27:07.121 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-20T18:27:07.121 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "smithi017.xusjwd", 2024-09-20T18:27:07.121 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-20T18:27:07.121 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-20T18:27:07.121 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2024-09-20T18:27:07.121 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 9... 2024-09-20T18:27:07.520 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:07 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/899478222' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-20T18:27:10.793 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:10 smithi017 ceph-mon[28058]: Active manager daemon smithi017.xusjwd restarted 2024-09-20T18:27:10.793 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:10 smithi017 ceph-mon[28058]: Activating manager daemon smithi017.xusjwd 2024-09-20T18:27:10.793 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:10 smithi017 ceph-mon[28058]: osdmap e3: 0 total, 0 up, 0 in 2024-09-20T18:27:10.793 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:10 smithi017 ceph-mon[28058]: mgrmap e10: smithi017.xusjwd(active, starting, since 0.0031781s) 2024-09-20T18:27:10.793 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:10 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-09-20T18:27:10.793 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:10 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr metadata", "who": "smithi017.xusjwd", "id": "smithi017.xusjwd"}]: dispatch 2024-09-20T18:27:10.793 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:10 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T18:27:10.793 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:10 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T18:27:10.793 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:10 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T18:27:10.793 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:10 smithi017 ceph-mon[28058]: Manager daemon smithi017.xusjwd is now available 2024-09-20T18:27:10.793 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:10 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:27:10.793 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:10 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/mirror_snapshot_schedule"}]: dispatch 2024-09-20T18:27:10.794 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:10 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/trash_purge_schedule"}]: dispatch 2024-09-20T18:27:12.404 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-09-20T18:27:12.405 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-20T18:27:12.405 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-20T18:27:12.405 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-09-20T18:27:12.405 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 9 is available 2024-09-20T18:27:12.405 INFO:teuthology.orchestra.run.smithi017.stdout:Generating a dashboard self-signed certificate... 2024-09-20T18:27:12.830 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:12 smithi017 ceph-mon[28058]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-20T18:27:12.830 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:12 smithi017 ceph-mon[28058]: mgrmap e11: smithi017.xusjwd(active, since 1.00667s) 2024-09-20T18:27:12.830 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:12 smithi017 ceph-mon[28058]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-20T18:27:12.830 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:12 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:13.656 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-20T18:27:13.656 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial admin user... 2024-09-20T18:27:14.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:13 smithi017 ceph-mon[28058]: [20/Sep/2024:18:27:12] ENGINE Bus STARTING 2024-09-20T18:27:14.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:13 smithi017 ceph-mon[28058]: [20/Sep/2024:18:27:12] ENGINE Serving on http://172.21.15.17:8765 2024-09-20T18:27:14.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:13 smithi017 ceph-mon[28058]: [20/Sep/2024:18:27:12] ENGINE Serving on https://172.21.15.17:7150 2024-09-20T18:27:14.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:13 smithi017 ceph-mon[28058]: [20/Sep/2024:18:27:12] ENGINE Bus STARTED 2024-09-20T18:27:14.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:13 smithi017 ceph-mon[28058]: [20/Sep/2024:18:27:12] ENGINE Error in HTTPServer.serve 2024-09-20T18:27:14.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Traceback (most recent call last): 2024-09-20T18:27:14.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T18:27:14.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-09-20T18:27:14.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T18:27:14.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._run(expiration_interval) 2024-09-20T18:27:14.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T18:27:14.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T18:27:14.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T18:27:14.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T18:27:14.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T18:27:14.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s = self.context.wrap_socket( 2024-09-20T18:27:14.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T18:27:14.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: return self.sslsocket_class._create( 2024-09-20T18:27:14.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T18:27:14.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self.do_handshake() 2024-09-20T18:27:14.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T18:27:14.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._sslobj.do_handshake() 2024-09-20T18:27:14.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T18:27:14.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:13 smithi017 ceph-mon[28058]: mgrmap e12: smithi017.xusjwd(active, since 2s) 2024-09-20T18:27:14.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:13 smithi017 ceph-mon[28058]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:27:14.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:13 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:14.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:13 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:14.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:13 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:15.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:14 smithi017 ceph-mon[28058]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:27:15.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:14 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:15.304 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$h6aV6UeLtSDuVgHM6riqm.5zk5MRMKYFkiIYvQ7/SB4eyEfFyRpEe", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726856834, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-20T18:27:15.304 INFO:teuthology.orchestra.run.smithi017.stdout:Fetching dashboard port number... 2024-09-20T18:27:16.648 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:16 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2127050436' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-20T18:27:16.903 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 8443 2024-09-20T18:27:16.914 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-20T18:27:16.914 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-09-20T18:27:16.922 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-20T18:27:16.922 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-09-20T18:27:16.923 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-09-20T18:27:16.923 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-20T18:27:16.925 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph Dashboard is now available at: 2024-09-20T18:27:16.925 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:27:16.925 INFO:teuthology.orchestra.run.smithi017.stdout: URL: https://smithi017.front.sepia.ceph.com:8443/ 2024-09-20T18:27:16.925 INFO:teuthology.orchestra.run.smithi017.stdout: User: admin 2024-09-20T18:27:16.925 INFO:teuthology.orchestra.run.smithi017.stdout: Password: wdfx8wldc9 2024-09-20T18:27:16.925 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:27:16.926 INFO:teuthology.orchestra.run.smithi017.stdout:Saving cluster configuration to /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config directory 2024-09-20T18:27:18.143 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-20T18:27:18.143 INFO:teuthology.orchestra.run.smithi017.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-20T18:27:18.143 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:27:18.143 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-20T18:27:18.143 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:27:18.143 INFO:teuthology.orchestra.run.smithi017.stdout:Or, if you are only running a single cluster on this host: 2024-09-20T18:27:18.143 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:27:18.143 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-20T18:27:18.144 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:27:18.144 INFO:teuthology.orchestra.run.smithi017.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-20T18:27:18.144 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:27:18.144 INFO:teuthology.orchestra.run.smithi017.stdout: ceph telemetry on 2024-09-20T18:27:18.144 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:27:18.144 INFO:teuthology.orchestra.run.smithi017.stdout:For more information see: 2024-09-20T18:27:18.144 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:27:18.144 INFO:teuthology.orchestra.run.smithi017.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-20T18:27:18.144 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:27:18.144 INFO:teuthology.orchestra.run.smithi017.stdout:Bootstrap complete. 2024-09-20T18:27:18.184 INFO:tasks.cephadm:Fetching config... 2024-09-20T18:27:18.184 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T18:27:18.184 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-20T18:27:18.200 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-20T18:27:18.201 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T18:27:18.201 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-20T18:27:18.258 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-20T18:27:18.258 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T18:27:18.258 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/keyring of=/dev/stdout 2024-09-20T18:27:18.325 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-20T18:27:18.325 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T18:27:18.325 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-20T18:27:18.380 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-20T18:27:18.381 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9w2xZix7V7ItEJweHZtQrkZE3p14uDO3qRl703N+nwlJgeLJdml2+IiuzOE2b93vppiqwJyW6DrxoLeFnnSjgVCBMqAaLNbA+OEOWb6VtxXJqqVInlnTadgAvmv98KyPTfuQ1TxAh48zNPemk88azMJbxVmTHG0Rfqtv6fvxRqzeo/oo9w8FKVMIg4fEoBcrodL2VWl8MwYmVcnnLThcDn0c4WLT56nPtK8v8qiyPUDIWx0pAWesyjmOvG5VYtNK0pFvgi/dK9keqZwyVUr9vgZOZP5ZP1OhJ4cqrNHixLooEjSV77vb57SYWEKKZ3EQJxfTLQ6D+M87sf2FcoOLdbuL3KYVyCOt1gyPoydNm4mebz28t16LUmMoGUxV8P1oZqvzuggf6oC9ZfAY8hhGgzOL4lYxONYF7BtUv5Jua9TMY7FdLNQe6XHMPlD1qyNq1iyer+tgI5VXuwXSPzNTUlhftPASCUrpineP4SFFMgOwco9I9ynnYUmLn16Bj1yU= ceph-7a27d282-777d-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-20T18:27:18.456 INFO:teuthology.orchestra.run.smithi017.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9w2xZix7V7ItEJweHZtQrkZE3p14uDO3qRl703N+nwlJgeLJdml2+IiuzOE2b93vppiqwJyW6DrxoLeFnnSjgVCBMqAaLNbA+OEOWb6VtxXJqqVInlnTadgAvmv98KyPTfuQ1TxAh48zNPemk88azMJbxVmTHG0Rfqtv6fvxRqzeo/oo9w8FKVMIg4fEoBcrodL2VWl8MwYmVcnnLThcDn0c4WLT56nPtK8v8qiyPUDIWx0pAWesyjmOvG5VYtNK0pFvgi/dK9keqZwyVUr9vgZOZP5ZP1OhJ4cqrNHixLooEjSV77vb57SYWEKKZ3EQJxfTLQ6D+M87sf2FcoOLdbuL3KYVyCOt1gyPoydNm4mebz28t16LUmMoGUxV8P1oZqvzuggf6oC9ZfAY8hhGgzOL4lYxONYF7BtUv5Jua9TMY7FdLNQe6XHMPlD1qyNq1iyer+tgI5VXuwXSPzNTUlhftPASCUrpineP4SFFMgOwco9I9ynnYUmLn16Bj1yU= ceph-7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:27:18.468 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9w2xZix7V7ItEJweHZtQrkZE3p14uDO3qRl703N+nwlJgeLJdml2+IiuzOE2b93vppiqwJyW6DrxoLeFnnSjgVCBMqAaLNbA+OEOWb6VtxXJqqVInlnTadgAvmv98KyPTfuQ1TxAh48zNPemk88azMJbxVmTHG0Rfqtv6fvxRqzeo/oo9w8FKVMIg4fEoBcrodL2VWl8MwYmVcnnLThcDn0c4WLT56nPtK8v8qiyPUDIWx0pAWesyjmOvG5VYtNK0pFvgi/dK9keqZwyVUr9vgZOZP5ZP1OhJ4cqrNHixLooEjSV77vb57SYWEKKZ3EQJxfTLQ6D+M87sf2FcoOLdbuL3KYVyCOt1gyPoydNm4mebz28t16LUmMoGUxV8P1oZqvzuggf6oC9ZfAY8hhGgzOL4lYxONYF7BtUv5Jua9TMY7FdLNQe6XHMPlD1qyNq1iyer+tgI5VXuwXSPzNTUlhftPASCUrpineP4SFFMgOwco9I9ynnYUmLn16Bj1yU= ceph-7a27d282-777d-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-20T18:27:18.560 INFO:teuthology.orchestra.run.smithi172.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9w2xZix7V7ItEJweHZtQrkZE3p14uDO3qRl703N+nwlJgeLJdml2+IiuzOE2b93vppiqwJyW6DrxoLeFnnSjgVCBMqAaLNbA+OEOWb6VtxXJqqVInlnTadgAvmv98KyPTfuQ1TxAh48zNPemk88azMJbxVmTHG0Rfqtv6fvxRqzeo/oo9w8FKVMIg4fEoBcrodL2VWl8MwYmVcnnLThcDn0c4WLT56nPtK8v8qiyPUDIWx0pAWesyjmOvG5VYtNK0pFvgi/dK9keqZwyVUr9vgZOZP5ZP1OhJ4cqrNHixLooEjSV77vb57SYWEKKZ3EQJxfTLQ6D+M87sf2FcoOLdbuL3KYVyCOt1gyPoydNm4mebz28t16LUmMoGUxV8P1oZqvzuggf6oC9ZfAY8hhGgzOL4lYxONYF7BtUv5Jua9TMY7FdLNQe6XHMPlD1qyNq1iyer+tgI5VXuwXSPzNTUlhftPASCUrpineP4SFFMgOwco9I9ynnYUmLn16Bj1yU= ceph-7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:27:18.573 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-20T18:27:18.648 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:18 smithi017 ceph-mon[28058]: mgrmap e13: smithi017.xusjwd(active, since 6s) 2024-09-20T18:27:18.648 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:18 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1908308939' entity='client.admin' 2024-09-20T18:27:18.845 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:27:20.457 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-20T18:27:20.457 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-20T18:27:20.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:20 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/4140206610' entity='client.admin' 2024-09-20T18:27:20.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:20 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:20.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:20 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:20.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:20 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd/host:smithi017", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:27:20.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:20 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:20.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:20 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:27:20.689 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:20 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-20T18:27:20.689 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:20 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:27:20.689 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:20 smithi017 ceph-mon[28058]: Deploying daemon ceph-exporter.smithi017 on smithi017 2024-09-20T18:27:20.905 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:27:22.287 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi172 2024-09-20T18:27:22.287 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-20T18:27:22.287 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.conf 2024-09-20T18:27:22.307 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-20T18:27:22.307 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:27:22.365 INFO:tasks.cephadm:Adding host smithi172 to orchestrator... 2024-09-20T18:27:22.365 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph orch host add smithi172 2024-09-20T18:27:22.630 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:27:22.865 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:22 smithi017 ceph-mon[28058]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:27:22.865 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:22 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:24.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:24 smithi017 ceph-mon[28058]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:27:26.293 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:26 smithi017 ceph-mon[28058]: Deploying cephadm binary to smithi172 2024-09-20T18:27:26.293 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:26 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:26.293 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:26 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:26.293 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:26 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:26.293 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:26 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:26.293 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:26 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi017", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-20T18:27:26.294 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:26 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi017", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-20T18:27:26.294 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:26 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:27:26.294 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:26 smithi017 ceph-mon[28058]: Deploying daemon crash.smithi017 on smithi017 2024-09-20T18:27:26.294 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:26 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:27.442 INFO:teuthology.orchestra.run.smithi017.stdout:Added host 'smithi172' with addr '172.21.15.172' 2024-09-20T18:27:27.978 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-20T18:27:28.245 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:27:28.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:28 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:28.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:28 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:28.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:28 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:28.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:28 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:28.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:28 smithi017 ceph-mon[28058]: Deploying daemon node-exporter.smithi017 on smithi017 2024-09-20T18:27:28.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:28 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:28.972 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:27:28.972 INFO:teuthology.orchestra.run.smithi017.stdout:[{"addr": "172.21.15.17", "hostname": "smithi017", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}] 2024-09-20T18:27:29.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:29 smithi017 ceph-mon[28058]: Added host smithi172 2024-09-20T18:27:29.738 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-20T18:27:29.738 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-20T18:27:30.012 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:27:30.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:30 smithi017 ceph-mon[28058]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T18:27:31.581 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2024-09-20T18:27:31.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:31 smithi017 ceph-mon[28058]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:27:31.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:31 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:31.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:31 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1202333818' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-20T18:27:32.434 INFO:tasks.cephadm:Adding mon.smithi017 on smithi017 2024-09-20T18:27:32.434 INFO:tasks.cephadm:Adding mon.smithi172 on smithi172 2024-09-20T18:27:32.434 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph orch apply mon '2;smithi017:172.21.15.17=smithi017;smithi172:172.21.15.172=smithi172' 2024-09-20T18:27:32.648 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:32 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1202333818' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-20T18:27:32.648 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:32 smithi017 ceph-mon[28058]: osdmap e4: 0 total, 0 up, 0 in 2024-09-20T18:27:32.679 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:32.731 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:33.303 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mon update... 2024-09-20T18:27:33.803 DEBUG:teuthology.orchestra.run.smithi172:mon.smithi172> sudo journalctl -f -n 0 -u ceph-7a27d282-777d-11ef-baf5-efdc52797490@mon.smithi172.service 2024-09-20T18:27:33.806 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:27:33.806 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:27:33.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:33 smithi017 ceph-mon[28058]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:27:33.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:33 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:33.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:33 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:33.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:33 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:33.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:33 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:33.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:33 smithi017 ceph-mon[28058]: Deploying daemon alertmanager.smithi017 on smithi017 2024-09-20T18:27:33.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:33 smithi017 ceph-mon[28058]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi017:172.21.15.17=smithi017;smithi172:172.21.15.172=smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:27:33.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:33 smithi017 ceph-mon[28058]: Saving service mon spec with placement smithi017:172.21.15.17=smithi017;smithi172:172.21.15.172=smithi172;count:2 2024-09-20T18:27:33.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:33 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:34.082 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:34.126 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:34.775 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:27:34.775 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:27:34.775 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:27:35.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:35 smithi017 ceph-mon[28058]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:27:35.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:35 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/514527835' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:27:35.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:35 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:36.377 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:27:36.378 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:27:36.623 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:36.758 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:37.557 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:27:37.558 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:27:37.558 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:27:37.850 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:37 smithi017 ceph-mon[28058]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:27:37.850 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:37 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/1074022742' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:27:39.132 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:27:39.132 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:27:39.376 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:39.421 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:39.716 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:39 smithi017 ceph-mon[28058]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:27:40.040 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:27:40.040 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:27:40.041 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:27:40.818 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:40 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/727515458' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:27:41.674 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:27:41.674 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:27:41.917 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:41.961 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:42.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:41 smithi017 ceph-mon[28058]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:27:42.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:41 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:42.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:41 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:42.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:41 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:42.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:41 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:42.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:41 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:42.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:41 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:42.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:41 smithi017 ceph-mon[28058]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-20T18:27:42.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:41 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:42.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:41 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:42.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:41 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T18:27:42.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:41 smithi017 ceph-mon[28058]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T18:27:42.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:41 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:42.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:41 smithi017 ceph-mon[28058]: Deploying daemon grafana.smithi017 on smithi017 2024-09-20T18:27:42.608 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:27:42.609 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:27:42.609 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:27:43.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:42 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/2896646046' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:27:44.219 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:27:44.219 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:27:44.398 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:43 smithi017 ceph-mon[28058]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:27:44.459 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:44.503 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:45.119 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:27:45.119 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:27:45.119 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:27:46.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:45 smithi017 ceph-mon[28058]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:27:46.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:45 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/1973551972' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:27:46.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:45 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:46.709 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:27:46.710 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:27:46.953 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:46.997 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:47.618 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:27:47.618 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:27:47.619 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:27:48.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:47 smithi017 ceph-mon[28058]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:27:48.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:47 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/1390509679' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:27:49.315 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:27:49.316 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:27:49.567 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:49.613 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:50.276 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:27:50.276 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:27:50.277 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:27:50.380 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:49 smithi017 ceph-mon[28058]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:27:51.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:50 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/1518578479' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:27:51.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:50 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:51.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:50 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:51.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:50 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:51.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:50 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:51.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:50 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:51.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:50 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:51.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:50 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:51.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:50 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:51.879 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:27:51.879 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:27:52.083 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:51 smithi017 ceph-mon[28058]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:27:52.083 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:51 smithi017 ceph-mon[28058]: Deploying daemon prometheus.smithi017 on smithi017 2024-09-20T18:27:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:52.172 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:52.840 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:27:52.840 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:27:52.841 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:27:53.398 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:52 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/1255653796' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:27:54.398 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:53 smithi017 ceph-mon[28058]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:27:54.442 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:27:54.442 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:27:54.687 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:54.731 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:55.350 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:27:55.350 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:27:55.350 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:27:56.398 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:55 smithi017 ceph-mon[28058]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:27:56.398 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:55 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/3592442367' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:27:56.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:55 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:27:56.956 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:27:56.956 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:27:57.200 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:57.245 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:57.881 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:27:57.881 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:27:57.881 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:27:58.245 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:57 smithi017 ceph-mon[28058]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:27:58.245 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:57 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/2419356705' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:27:59.638 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:27:59.638 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:27:59.883 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:27:59.928 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:28:00.307 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:27:59 smithi017 ceph-mon[28058]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:00.547 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:28:00.547 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:28:00.547 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:28:01.238 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:00 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/1463999436' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:02.195 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:28:02.195 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:28:02.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:01 smithi017 ceph-mon[28058]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:02.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:01 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:02.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:01 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:02.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:01 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:02.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:01 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-20T18:28:02.439 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:28:02.491 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:28:03.157 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:28:03.157 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:28:03.158 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:28:03.771 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:03 smithi017 ceph-mon[28058]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-20T18:28:03.772 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:03 smithi017 ceph-mon[28058]: mgrmap e14: smithi017.xusjwd(active, since 51s) 2024-09-20T18:28:03.772 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:03 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/4044817208' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:04.721 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:28:04.721 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:28:04.964 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:28:05.008 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:28:05.662 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:28:05.662 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:28:05.662 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:28:05.786 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:05 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/4148236576' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:07.249 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:28:07.250 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:28:07.496 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:28:07.540 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:28:07.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:07 smithi017 ceph-mon[28058]: Active manager daemon smithi017.xusjwd restarted 2024-09-20T18:28:07.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:07 smithi017 ceph-mon[28058]: Activating manager daemon smithi017.xusjwd 2024-09-20T18:28:07.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:07 smithi017 ceph-mon[28058]: osdmap e5: 0 total, 0 up, 0 in 2024-09-20T18:28:07.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:07 smithi017 ceph-mon[28058]: mgrmap e15: smithi017.xusjwd(active, starting, since 0.00318687s) 2024-09-20T18:28:07.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:07 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-09-20T18:28:07.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:07 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr metadata", "who": "smithi017.xusjwd", "id": "smithi017.xusjwd"}]: dispatch 2024-09-20T18:28:07.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:07 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T18:28:07.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:07 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T18:28:07.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:07 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T18:28:07.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:07 smithi017 ceph-mon[28058]: Manager daemon smithi017.xusjwd is now available 2024-09-20T18:28:07.779 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:07 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:28:07.779 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:07 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:07.779 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:07 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:28:08.206 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:28:08.206 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:28:08.207 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:28:08.759 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:08 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/mirror_snapshot_schedule"}]: dispatch 2024-09-20T18:28:08.759 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:08 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/trash_purge_schedule"}]: dispatch 2024-09-20T18:28:08.759 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:08 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/3864858329' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:08.759 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:08 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:08.760 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:08 smithi017 ceph-mon[28058]: mgrmap e16: smithi017.xusjwd(active, since 1.00728s) 2024-09-20T18:28:09.810 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:28:09.810 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:28:10.037 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:09 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:10.037 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:09 smithi017 ceph-mon[28058]: [20/Sep/2024:18:28:09] ENGINE Bus STARTING 2024-09-20T18:28:10.037 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:09 smithi017 ceph-mon[28058]: [20/Sep/2024:18:28:09] ENGINE Serving on http://172.21.15.17:8765 2024-09-20T18:28:10.037 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:09 smithi017 ceph-mon[28058]: [20/Sep/2024:18:28:09] ENGINE Serving on https://172.21.15.17:7150 2024-09-20T18:28:10.037 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:09 smithi017 ceph-mon[28058]: [20/Sep/2024:18:28:09] ENGINE Bus STARTED 2024-09-20T18:28:10.037 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:09 smithi017 ceph-mon[28058]: [20/Sep/2024:18:28:09] ENGINE Error in HTTPServer.serve 2024-09-20T18:28:10.037 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Traceback (most recent call last): 2024-09-20T18:28:10.037 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T18:28:10.037 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-09-20T18:28:10.037 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T18:28:10.038 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._run(expiration_interval) 2024-09-20T18:28:10.038 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T18:28:10.038 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T18:28:10.038 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T18:28:10.038 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T18:28:10.038 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T18:28:10.038 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s = self.context.wrap_socket( 2024-09-20T18:28:10.038 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T18:28:10.038 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: return self.sslsocket_class._create( 2024-09-20T18:28:10.038 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T18:28:10.038 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self.do_handshake() 2024-09-20T18:28:10.038 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T18:28:10.038 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._sslobj.do_handshake() 2024-09-20T18:28:10.038 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T18:28:10.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:09 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:10.054 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:28:10.102 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-20T18:28:10.767 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:28:10.767 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:28:10.767 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:28:11.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:10 smithi017 ceph-mon[28058]: mgrmap e17: smithi017.xusjwd(active, since 2s) 2024-09-20T18:28:11.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:10 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/1407592611' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:13.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:13.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:13.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:13.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:13.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd/host:smithi017", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:28:13.591 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:28:13.591 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:28:13.841 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:28:14.587 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:28:14.587 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:28:14.587 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:28:14.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:14.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:14.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:14.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:14.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:28:14.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:14.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:28:14.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-20T18:28:14.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-20T18:28:14.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: Updating smithi172:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:28:14.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: Updating smithi017:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:28:14.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:14.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:14.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:14.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:14.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:14.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:28:14.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-20T18:28:14.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:14 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:15.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:15 smithi017 ceph-mon[28058]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:28:15.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:15 smithi017 ceph-mon[28058]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:28:15.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:15 smithi017 ceph-mon[28058]: Updating smithi172:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T18:28:15.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:15 smithi017 ceph-mon[28058]: Updating smithi017:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T18:28:15.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:15 smithi017 ceph-mon[28058]: Deploying daemon ceph-exporter.smithi172 on smithi172 2024-09-20T18:28:15.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:15 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/2114556556' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:16.196 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:28:16.196 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:28:16.452 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:28:17.152 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:28:17.152 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:28:17.152 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:28:17.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:17 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/1938200851' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:18.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:18 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:18.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:18 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:18.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:18 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:18.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:18 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:18.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:18 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-20T18:28:18.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:18 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-20T18:28:18.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:18 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:18.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:18 smithi017 ceph-mon[28058]: Deploying daemon crash.smithi172 on smithi172 2024-09-20T18:28:19.110 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:28:19.110 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:28:19.364 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:28:20.146 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:28:20.147 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:28:20.147 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:28:20.398 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:20 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/397584281' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:21.759 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:28:21.759 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:28:22.030 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:28:22.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:21 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:22.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:21 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:22.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:21 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:22.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:21 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:22.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:21 smithi017 ceph-mon[28058]: Deploying daemon node-exporter.smithi172 on smithi172 2024-09-20T18:28:22.720 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:28:22.720 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:28:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:28:23.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:23 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:23.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:23 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:28:23.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:23 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/838317416' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:25.338 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:28:25.338 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:28:25.761 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:28:26.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:25 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:26.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:25 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:26.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:25 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:26.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:25 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:26.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:25 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.jczphg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:28:26.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:25 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.jczphg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-20T18:28:26.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:25 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T18:28:26.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:25 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:26.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:25 smithi017 ceph-mon[28058]: Deploying daemon mgr.smithi172.jczphg on smithi172 2024-09-20T18:28:26.863 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:28:26.863 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:28:26.863 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:28:27.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:26 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/2995515897' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:28.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:27 smithi017 ceph-mon[28058]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:28.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:27 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:28.503 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:28:28.503 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:28:29.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:29 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:29.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:29 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:29.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:29 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:29.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:29 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:29.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:29 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T18:28:29.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:29 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:29.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:29 smithi017 ceph-mon[28058]: Deploying daemon mon.smithi172 on smithi172 2024-09-20T18:28:29.618 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:28:30.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:30 smithi017 ceph-mon[28058]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:31.226 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:28:31.226 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:26:13.426622Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-20T18:28:31.227 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-20T18:28:31.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:31 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/3316206026' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.323 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 podman[35437]: 2024-09-20 18:28:32.289349966 +0000 UTC m=+0.358688195 container start 9eea40352787c0d17a0de868f0aa621e40223af1f0ee82b70d057842e3b9729b (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi172, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-ed8ee0f, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-20T18:28:32.603 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: set uid:gid to 167:167 (ceph:ceph) 2024-09-20T18:28:32.603 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable), process ceph-mon, pid 2 2024-09-20T18:28:32.604 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pidfile_write: ignore empty --pid-file 2024-09-20T18:28:32.604 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: load: jerasure load: lrc 2024-09-20T18:28:32.604 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: RocksDB version: 7.9.2 2024-09-20T18:28:32.604 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Git sha 0 2024-09-20T18:28:32.604 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Compile date 2024-09-19 20:45:27 2024-09-20T18:28:32.604 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: DB SUMMARY 2024-09-20T18:28:32.604 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: DB Session ID: DMJEAGTHMCISSDCWU1YI 2024-09-20T18:28:32.604 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: CURRENT file: CURRENT 2024-09-20T18:28:32.604 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: IDENTITY file: IDENTITY 2024-09-20T18:28:32.605 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-20T18:28:32.605 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi172/store.db dir, Total Num: 0, files: 2024-09-20T18:28:32.605 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi172/store.db: 000004.log size: 511 ; 2024-09-20T18:28:32.605 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.error_if_exists: 0 2024-09-20T18:28:32.605 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.create_if_missing: 0 2024-09-20T18:28:32.605 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.paranoid_checks: 1 2024-09-20T18:28:32.605 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-20T18:28:32.605 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T18:28:32.606 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-20T18:28:32.606 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.env: 0x55e29adc8940 2024-09-20T18:28:32.606 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.fs: PosixFileSystem 2024-09-20T18:28:32.606 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.info_log: 0x55e29d1bf8c0 2024-09-20T18:28:32.606 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_file_opening_threads: 16 2024-09-20T18:28:32.606 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.statistics: (nil) 2024-09-20T18:28:32.606 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.use_fsync: 0 2024-09-20T18:28:32.606 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_log_file_size: 0 2024-09-20T18:28:32.607 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T18:28:32.607 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T18:28:32.607 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.keep_log_file_num: 1000 2024-09-20T18:28:32.607 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.recycle_log_file_num: 0 2024-09-20T18:28:32.607 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.allow_fallocate: 1 2024-09-20T18:28:32.607 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.allow_mmap_reads: 0 2024-09-20T18:28:32.607 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.allow_mmap_writes: 0 2024-09-20T18:28:32.607 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.use_direct_reads: 0 2024-09-20T18:28:32.607 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T18:28:32.608 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.create_missing_column_families: 0 2024-09-20T18:28:32.608 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.db_log_dir: 2024-09-20T18:28:32.608 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.wal_dir: 2024-09-20T18:28:32.608 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T18:28:32.608 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T18:28:32.608 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T18:28:32.609 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T18:28:32.609 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T18:28:32.609 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T18:28:32.609 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.advise_random_on_open: 1 2024-09-20T18:28:32.609 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.db_write_buffer_size: 0 2024-09-20T18:28:32.609 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.write_buffer_manager: 0x55e29d1cedc0 2024-09-20T18:28:32.609 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T18:28:32.609 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T18:28:32.609 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T18:28:32.609 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.rate_limiter: (nil) 2024-09-20T18:28:32.610 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T18:28:32.610 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.wal_recovery_mode: 2 2024-09-20T18:28:32.610 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.enable_thread_tracking: 0 2024-09-20T18:28:32.610 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.enable_pipelined_write: 0 2024-09-20T18:28:32.610 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.unordered_write: 0 2024-09-20T18:28:32.610 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T18:28:32.610 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T18:28:32.610 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T18:28:32.610 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T18:28:32.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.row_cache: None 2024-09-20T18:28:32.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.wal_filter: None 2024-09-20T18:28:32.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T18:28:32.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.allow_ingest_behind: 0 2024-09-20T18:28:32.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.two_write_queues: 0 2024-09-20T18:28:32.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.manual_wal_flush: 0 2024-09-20T18:28:32.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.wal_compression: 0 2024-09-20T18:28:32.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.atomic_flush: 0 2024-09-20T18:28:32.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T18:28:32.612 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T18:28:32.612 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T18:28:32.612 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.log_readahead_size: 0 2024-09-20T18:28:32.612 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T18:28:32.612 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.best_efforts_recovery: 0 2024-09-20T18:28:32.612 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T18:28:32.612 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T18:28:32.612 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.allow_data_in_errors: 0 2024-09-20T18:28:32.612 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.db_host_id: __hostname__ 2024-09-20T18:28:32.612 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-20T18:28:32.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_background_jobs: 2 2024-09-20T18:28:32.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_background_compactions: -1 2024-09-20T18:28:32.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_subcompactions: 1 2024-09-20T18:28:32.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T18:28:32.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T18:28:32.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T18:28:32.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_total_wal_size: 0 2024-09-20T18:28:32.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T18:28:32.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T18:28:32.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T18:28:32.616 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T18:28:32.616 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_open_files: -1 2024-09-20T18:28:32.616 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.bytes_per_sync: 0 2024-09-20T18:28:32.616 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T18:28:32.616 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T18:28:32.616 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compaction_readahead_size: 0 2024-09-20T18:28:32.616 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_background_flushes: -1 2024-09-20T18:28:32.616 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Compression algorithms supported: 2024-09-20T18:28:32.616 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: kZSTD supported: 0 2024-09-20T18:28:32.616 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: kXpressCompression supported: 0 2024-09-20T18:28:32.616 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: kBZip2Compression supported: 0 2024-09-20T18:28:32.617 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T18:28:32.617 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: kLZ4Compression supported: 1 2024-09-20T18:28:32.617 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: kZlibCompression supported: 1 2024-09-20T18:28:32.617 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: kLZ4HCCompression supported: 1 2024-09-20T18:28:32.617 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: kSnappyCompression supported: 1 2024-09-20T18:28:32.617 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T18:28:32.617 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-20T18:28:32.617 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi172/store.db/MANIFEST-000005 2024-09-20T18:28:32.617 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-20T18:28:32.617 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T18:28:32.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.merge_operator: 2024-09-20T18:28:32.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compaction_filter: None 2024-09-20T18:28:32.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compaction_filter_factory: None 2024-09-20T18:28:32.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.sst_partitioner_factory: None 2024-09-20T18:28:32.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T18:28:32.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T18:28:32.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e29d1bf520) 2024-09-20T18:28:32.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: cache_index_and_filter_blocks: 1 2024-09-20T18:28:32.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T18:28:32.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T18:28:32.618 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: pin_top_level_index_and_filter: 1 2024-09-20T18:28:32.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: index_type: 0 2024-09-20T18:28:32.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: data_block_index_type: 0 2024-09-20T18:28:32.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: index_shortening: 1 2024-09-20T18:28:32.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-20T18:28:32.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: checksum: 4 2024-09-20T18:28:32.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: no_block_cache: 0 2024-09-20T18:28:32.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_cache: 0x55e29d1b31f0 2024-09-20T18:28:32.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_cache_name: BinnedLRUCache 2024-09-20T18:28:32.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_cache_options: 2024-09-20T18:28:32.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: capacity : 536870912 2024-09-20T18:28:32.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: num_shard_bits : 4 2024-09-20T18:28:32.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: strict_capacity_limit : 0 2024-09-20T18:28:32.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: high_pri_pool_ratio: 0.000 2024-09-20T18:28:32.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_cache_compressed: (nil) 2024-09-20T18:28:32.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: persistent_cache: (nil) 2024-09-20T18:28:32.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_size: 4096 2024-09-20T18:28:32.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_size_deviation: 10 2024-09-20T18:28:32.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_restart_interval: 16 2024-09-20T18:28:32.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: index_block_restart_interval: 1 2024-09-20T18:28:32.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: metadata_block_size: 4096 2024-09-20T18:28:32.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: partition_filters: 0 2024-09-20T18:28:32.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: use_delta_encoding: 1 2024-09-20T18:28:32.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: filter_policy: bloomfilter 2024-09-20T18:28:32.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: whole_key_filtering: 1 2024-09-20T18:28:32.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: verify_compression: 0 2024-09-20T18:28:32.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: read_amp_bytes_per_bit: 0 2024-09-20T18:28:32.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: format_version: 5 2024-09-20T18:28:32.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: enable_index_compression: 1 2024-09-20T18:28:32.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_align: 0 2024-09-20T18:28:32.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: max_auto_readahead_size: 262144 2024-09-20T18:28:32.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: prepopulate_block_cache: 0 2024-09-20T18:28:32.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: initial_auto_readahead_size: 8192 2024-09-20T18:28:32.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: num_file_reads_for_auto_readahead: 2 2024-09-20T18:28:32.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.write_buffer_size: 33554432 2024-09-20T18:28:32.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_write_buffer_number: 2 2024-09-20T18:28:32.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compression: NoCompression 2024-09-20T18:28:32.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.bottommost_compression: Disabled 2024-09-20T18:28:32.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.prefix_extractor: nullptr 2024-09-20T18:28:32.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T18:28:32.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.num_levels: 7 2024-09-20T18:28:32.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T18:28:32.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T18:28:32.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T18:28:32.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T18:28:32.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T18:28:32.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T18:28:32.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T18:28:32.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T18:28:32.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T18:28:32.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T18:28:32.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-20T18:28:32.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-20T18:28:32.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T18:28:32.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compression_opts.level: 32767 2024-09-20T18:28:32.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compression_opts.strategy: 0 2024-09-20T18:28:32.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T18:28:32.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T18:28:32.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-20T18:28:32.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T18:28:32.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compression_opts.enabled: false 2024-09-20T18:28:32.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-20T18:28:32.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T18:28:32.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T18:28:32.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T18:28:32.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.target_file_size_base: 67108864 2024-09-20T18:28:32.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T18:28:32.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T18:28:32.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T18:28:32.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T18:28:32.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T18:28:32.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T18:28:32.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T18:28:32.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T18:28:32.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T18:28:32.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T18:28:32.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T18:28:32.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T18:28:32.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T18:28:32.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-20T18:28:32.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.arena_block_size: 1048576 2024-09-20T18:28:32.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T18:28:32.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T18:28:32.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.disable_auto_compactions: 0 2024-09-20T18:28:32.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T18:28:32.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T18:28:32.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T18:28:32.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T18:28:32.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T18:28:32.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T18:28:32.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T18:28:32.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T18:28:32.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T18:28:32.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T18:28:32.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-20T18:28:32.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.inplace_update_support: 0 2024-09-20T18:28:32.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T18:28:32.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T18:28:32.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T18:28:32.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T18:28:32.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.bloom_locality: 0 2024-09-20T18:28:32.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.max_successive_merges: 0 2024-09-20T18:28:32.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T18:28:32.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.paranoid_file_checks: 0 2024-09-20T18:28:32.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.force_consistency_checks: 1 2024-09-20T18:28:32.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.report_bg_io_stats: 0 2024-09-20T18:28:32.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.ttl: 2592000 2024-09-20T18:28:32.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T18:28:32.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-20T18:28:32.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-20T18:28:32.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.enable_blob_files: false 2024-09-20T18:28:32.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.min_blob_size: 0 2024-09-20T18:28:32.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.blob_file_size: 268435456 2024-09-20T18:28:32.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T18:28:32.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T18:28:32.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T18:28:32.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-20T18:28:32.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-20T18:28:32.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.blob_file_starting_level: 0 2024-09-20T18:28:32.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-20T18:28:32.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi172/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-20T18:28:32.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-20T18:28:32.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9b3c8b0e-985b-4980-ad30-66370ec6cb7b 2024-09-20T18:28:32.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726856912316272, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-20T18:28:32.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-20T18:28:32.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726856912316780, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726856912, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9b3c8b0e-985b-4980-ad30-66370ec6cb7b", "db_session_id": "DMJEAGTHMCISSDCWU1YI", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-20T18:28:32.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726856912316875, "job": 1, "event": "recovery_finished"} 2024-09-20T18:28:32.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-20T18:28:32.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi172/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T18:28:32.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e29d1e0e00 2024-09-20T18:28:32.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: DB pointer 0x55e29d2dc000 2024-09-20T18:28:32.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-20T18:28:32.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-20T18:28:32.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ** DB Stats ** 2024-09-20T18:28:32.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T18:28:32.631 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T18:28:32.631 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T18:28:32.631 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T18:28:32.631 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T18:28:32.631 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T18:28:32.631 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T18:28:32.631 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-09-20T18:28:32.631 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ** Compaction Stats [default] ** 2024-09-20T18:28:32.631 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T18:28:32.631 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-20T18:28:32.631 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-20T18:28:32.631 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-20T18:28:32.632 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-20T18:28:32.632 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-09-20T18:28:32.632 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ** Compaction Stats [default] ** 2024-09-20T18:28:32.632 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T18:28:32.632 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T18:28:32.632 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-20T18:28:32.632 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-09-20T18:28:32.632 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-20T18:28:32.632 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-09-20T18:28:32.632 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T18:28:32.632 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-20T18:28:32.632 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T18:28:32.633 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T18:28:32.633 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T18:28:32.633 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-20T18:28:32.633 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Cumulative compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T18:28:32.633 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Interval compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T18:28:32.633 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T18:28:32.633 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Block cache BinnedLRUCache@0x55e29d1b31f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-20T18:28:32.633 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-20T18:28:32.633 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-09-20T18:28:32.633 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-20T18:28:32.634 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mon.smithi172 does not exist in monmap, will attempt to join an existing cluster 2024-09-20T18:28:32.634 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: using public_addr v2:172.21.15.172:0/0 -> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-09-20T18:28:32.634 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: starting mon.smithi172 rank -1 at public addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] at bind addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi172 fsid 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:28:32.634 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mon.smithi172@-1(???) e0 preinit fsid 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:28:32.634 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mon.smithi172@-1(synchronizing).mds e1 new map 2024-09-20T18:28:32.634 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mon.smithi172@-1(synchronizing).mds e1 print_map 2024-09-20T18:28:32.634 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: e1 2024-09-20T18:28:32.634 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: btime 2024-09-20T18:26:16:474210+0000 2024-09-20T18:28:32.634 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:28:32.634 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:28:32.634 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: legacy client fscid: -1 2024-09-20T18:28:32.635 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-09-20T18:28:32.635 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: No filesystems configured 2024-09-20T18:28:32.635 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mon.smithi172@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-20T18:28:32.635 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mon.smithi172@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-20T18:28:32.635 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mon.smithi172@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-20T18:28:32.635 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mon.smithi172@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-20T18:28:32.635 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mon.smithi172@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-20T18:28:32.635 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mon.smithi172@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-20T18:28:32.635 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mon.smithi172@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-09-20T18:28:32.635 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mon.smithi172@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-20T18:28:32.635 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mon.smithi172@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T18:28:32.635 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mon.smithi172@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T18:28:32.636 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mon.smithi172@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-20T18:28:32.636 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.636 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.636 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.636 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.636 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Deploying daemon node-exporter.smithi017 on smithi017 2024-09-20T18:28:32.636 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.636 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Added host smithi172 2024-09-20T18:28:32.636 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T18:28:32.636 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.636 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.636 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/1202333818' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-20T18:28:32.637 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/1202333818' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-20T18:28:32.637 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: osdmap e4: 0 total, 0 up, 0 in 2024-09-20T18:28:32.637 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.637 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.637 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.637 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.637 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.637 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Deploying daemon alertmanager.smithi017 on smithi017 2024-09-20T18:28:32.637 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi017:172.21.15.17=smithi017;smithi172:172.21.15.172=smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:28:32.637 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Saving service mon spec with placement smithi017:172.21.15.17=smithi017;smithi172:172.21.15.172=smithi172;count:2 2024-09-20T18:28:32.637 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.637 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.637 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/514527835' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.638 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.638 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.638 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/1074022742' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.638 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.638 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/727515458' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.638 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.638 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.638 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.638 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.638 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.638 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.638 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.639 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-20T18:28:32.639 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.639 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.639 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T18:28:32.639 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-20T18:28:32.639 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.639 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Deploying daemon grafana.smithi017 on smithi017 2024-09-20T18:28:32.639 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/2896646046' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.639 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.639 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.639 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/1973551972' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.639 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.640 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.640 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/1390509679' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.640 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.640 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/1518578479' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.640 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.640 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.640 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.640 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.640 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.640 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.640 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.640 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.640 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.641 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Deploying daemon prometheus.smithi017 on smithi017 2024-09-20T18:28:32.641 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/1255653796' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.641 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.641 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.641 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/3592442367' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.641 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.641 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.641 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/2419356705' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.641 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.641 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/1463999436' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.641 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.641 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.641 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.642 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.642 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-20T18:28:32.642 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14162 172.21.15.17:0/3011694210' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-20T18:28:32.642 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mgrmap e14: smithi017.xusjwd(active, since 51s) 2024-09-20T18:28:32.642 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/4044817208' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.642 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/4148236576' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.642 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Active manager daemon smithi017.xusjwd restarted 2024-09-20T18:28:32.642 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Activating manager daemon smithi017.xusjwd 2024-09-20T18:28:32.642 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: osdmap e5: 0 total, 0 up, 0 in 2024-09-20T18:28:32.642 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mgrmap e15: smithi017.xusjwd(active, starting, since 0.00318687s) 2024-09-20T18:28:32.642 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-09-20T18:28:32.642 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr metadata", "who": "smithi017.xusjwd", "id": "smithi017.xusjwd"}]: dispatch 2024-09-20T18:28:32.643 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T18:28:32.643 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T18:28:32.643 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T18:28:32.643 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Manager daemon smithi017.xusjwd is now available 2024-09-20T18:28:32.643 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.643 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.643 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:28:32.643 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/mirror_snapshot_schedule"}]: dispatch 2024-09-20T18:28:32.643 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/trash_purge_schedule"}]: dispatch 2024-09-20T18:28:32.643 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/3864858329' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.643 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.643 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mgrmap e16: smithi017.xusjwd(active, since 1.00728s) 2024-09-20T18:28:32.643 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.644 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: [20/Sep/2024:18:28:09] ENGINE Bus STARTING 2024-09-20T18:28:32.644 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: [20/Sep/2024:18:28:09] ENGINE Serving on http://172.21.15.17:8765 2024-09-20T18:28:32.644 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: [20/Sep/2024:18:28:09] ENGINE Serving on https://172.21.15.17:7150 2024-09-20T18:28:32.644 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: [20/Sep/2024:18:28:09] ENGINE Bus STARTED 2024-09-20T18:28:32.644 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: [20/Sep/2024:18:28:09] ENGINE Error in HTTPServer.serve 2024-09-20T18:28:32.644 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Traceback (most recent call last): 2024-09-20T18:28:32.644 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T18:28:32.644 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: self._connections.run(self.expiration_interval) 2024-09-20T18:28:32.644 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T18:28:32.644 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: self._run(expiration_interval) 2024-09-20T18:28:32.644 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T18:28:32.644 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T18:28:32.645 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T18:28:32.645 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T18:28:32.645 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T18:28:32.645 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: s = self.context.wrap_socket( 2024-09-20T18:28:32.645 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T18:28:32.645 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: return self.sslsocket_class._create( 2024-09-20T18:28:32.645 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T18:28:32.645 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: self.do_handshake() 2024-09-20T18:28:32.645 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T18:28:32.645 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: self._sslobj.do_handshake() 2024-09-20T18:28:32.645 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T18:28:32.645 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.645 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mgrmap e17: smithi017.xusjwd(active, since 2s) 2024-09-20T18:28:32.645 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/1407592611' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.646 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.646 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.646 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.646 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.646 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd/host:smithi017", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:28:32.646 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.646 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.646 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.646 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.646 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:28:32.646 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:32.646 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:28:32.647 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-20T18:28:32.647 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-20T18:28:32.647 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Updating smithi172:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:28:32.647 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Updating smithi017:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:28:32.647 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.647 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.647 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.647 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.647 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.647 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:28:32.647 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-20T18:28:32.647 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:32.647 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:28:32.647 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:28:32.648 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Updating smithi172:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T18:28:32.648 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Updating smithi017:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T18:28:32.648 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Deploying daemon ceph-exporter.smithi172 on smithi172 2024-09-20T18:28:32.648 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/2114556556' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.648 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/1938200851' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.648 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.648 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.648 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.648 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.648 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-20T18:28:32.648 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-20T18:28:32.648 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:32.648 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Deploying daemon crash.smithi172 on smithi172 2024-09-20T18:28:32.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/397584281' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Deploying daemon node-exporter.smithi172 on smithi172 2024-09-20T18:28:32.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:28:32.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/838317416' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.649 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.jczphg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:28:32.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.jczphg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-20T18:28:32.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T18:28:32.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:32.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Deploying daemon mgr.smithi172.jczphg on smithi172 2024-09-20T18:28:32.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/2995515897' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.650 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:32.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T18:28:32.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:32.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: Deploying daemon mon.smithi172 on smithi172 2024-09-20T18:28:32.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/3316206026' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:32.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 ceph-mon[35456]: mon.smithi172@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-09-20T18:28:32.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 bash[35437]: 9eea40352787c0d17a0de868f0aa621e40223af1f0ee82b70d057842e3b9729b 2024-09-20T18:28:32.651 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:32 smithi172 systemd[1]: Started Ceph mon.smithi172 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:28:32.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:32 smithi017 ceph-mon[28058]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:32.917 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-20T18:28:32.918 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-20T18:28:33.160 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T18:28:37.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-09-20T18:28:37.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:28:37.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: mon.smithi017 calling monitor election 2024-09-20T18:28:37.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.172:0/800872907' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.jczphg/crt"}]: dispatch 2024-09-20T18:28:37.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:28:37.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:37.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:28:37.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: mon.smithi172 calling monitor election 2024-09-20T18:28:37.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:28:37.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:28:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:28:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: mon.smithi017 is new leader, mons smithi017,smithi172 in quorum (ranks 0,1) 2024-09-20T18:28:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: monmap epoch 2 2024-09-20T18:28:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: fsid 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:28:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: last_changed 2024-09-20T18:28:32.345344+0000 2024-09-20T18:28:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: created 2024-09-20T18:26:13.426622+0000 2024-09-20T18:28:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: min_mon_release 19 (squid) 2024-09-20T18:28:37.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: election_strategy: 1 2024-09-20T18:28:37.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.smithi017 2024-09-20T18:28:37.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.smithi172 2024-09-20T18:28:37.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: fsmap 2024-09-20T18:28:37.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: osdmap e5: 0 total, 0 up, 0 in 2024-09-20T18:28:37.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: mgrmap e17: smithi017.xusjwd(active, since 29s) 2024-09-20T18:28:37.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: overall HEALTH_OK 2024-09-20T18:28:37.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: Standby manager daemon smithi172.jczphg started 2024-09-20T18:28:37.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:37.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.172:0/800872907' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T18:28:37.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:37.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.172:0/800872907' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.jczphg/key"}]: dispatch 2024-09-20T18:28:37.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.172:0/800872907' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T18:28:37.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:37.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:37.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:37.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:37 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:37.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-09-20T18:28:37.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:28:37.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: mon.smithi017 calling monitor election 2024-09-20T18:28:37.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.172:0/800872907' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.jczphg/crt"}]: dispatch 2024-09-20T18:28:37.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:28:37.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:37.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:28:37.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: mon.smithi172 calling monitor election 2024-09-20T18:28:37.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:28:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:28:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:28:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: mon.smithi017 is new leader, mons smithi017,smithi172 in quorum (ranks 0,1) 2024-09-20T18:28:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: monmap epoch 2 2024-09-20T18:28:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: fsid 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:28:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: last_changed 2024-09-20T18:28:32.345344+0000 2024-09-20T18:28:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: created 2024-09-20T18:26:13.426622+0000 2024-09-20T18:28:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: min_mon_release 19 (squid) 2024-09-20T18:28:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: election_strategy: 1 2024-09-20T18:28:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.smithi017 2024-09-20T18:28:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.smithi172 2024-09-20T18:28:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: fsmap 2024-09-20T18:28:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: osdmap e5: 0 total, 0 up, 0 in 2024-09-20T18:28:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: mgrmap e17: smithi017.xusjwd(active, since 29s) 2024-09-20T18:28:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: overall HEALTH_OK 2024-09-20T18:28:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: Standby manager daemon smithi172.jczphg started 2024-09-20T18:28:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.172:0/800872907' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T18:28:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:37.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.172:0/800872907' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.jczphg/key"}]: dispatch 2024-09-20T18:28:37.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.172:0/800872907' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T18:28:37.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:37.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:37.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:37.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:37 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:38.234 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:28:38.234 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":2,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","modified":"2024-09-20T18:28:32.345344Z","created":"2024-09-20T18:26:13.426622Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi172","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-20T18:28:38.235 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 2 2024-09-20T18:28:38.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:38 smithi172 ceph-mon[35456]: mgrmap e18: smithi017.xusjwd(active, since 29s), standbys: smithi172.jczphg 2024-09-20T18:28:38.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:38 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr metadata", "who": "smithi172.jczphg", "id": "smithi172.jczphg"}]: dispatch 2024-09-20T18:28:38.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:38 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:28:38.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:38 smithi172 ceph-mon[35456]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:38.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:38 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:28:38.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:38 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/433283353' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:38.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:38 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:28:38.817 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-20T18:28:38.817 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-20T18:28:38.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:38 smithi017 ceph-mon[28058]: mgrmap e18: smithi017.xusjwd(active, since 29s), standbys: smithi172.jczphg 2024-09-20T18:28:38.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:38 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr metadata", "who": "smithi172.jczphg", "id": "smithi172.jczphg"}]: dispatch 2024-09-20T18:28:38.840 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:38 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:28:38.840 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:38 smithi017 ceph-mon[28058]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:38.840 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:38 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:28:38.840 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:38 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/433283353' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-20T18:28:38.840 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:38 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:28:39.096 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:39.635 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:39 smithi172 ceph-mon[35456]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:39.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:39 smithi017 ceph-mon[28058]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:39.741 INFO:teuthology.orchestra.run.smithi017.stdout:# minimal ceph.conf for 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:28:39.741 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-09-20T18:28:39.741 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:28:39.741 INFO:teuthology.orchestra.run.smithi017.stdout: mon_host = [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-09-20T18:28:40.467 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-20T18:28:40.467 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T18:28:40.467 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.conf 2024-09-20T18:28:40.534 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T18:28:40.535 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:28:40.604 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-20T18:28:40.604 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.conf 2024-09-20T18:28:40.630 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-20T18:28:40.630 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:28:40.694 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-20T18:28:40.694 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-20T18:28:40.697 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-20T18:28:40.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-20T18:28:40.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3587936221' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:40.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:40.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:40.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:40.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:28:40.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-20T18:28:40.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-20T18:28:40.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: Updating smithi172:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:28:40.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: Updating smithi017:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:28:40.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:40.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:40.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:40.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:40.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:40.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: Reconfiguring mon.smithi017 (unknown last config time)... 2024-09-20T18:28:40.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T18:28:40.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T18:28:40.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:40.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:40 smithi172 ceph-mon[35456]: Reconfiguring daemon mon.smithi017 on smithi017 2024-09-20T18:28:40.718 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3587936221' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:40.718 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:40.718 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:40.718 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:40.718 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:28:40.718 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-20T18:28:40.718 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-20T18:28:40.718 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: Updating smithi172:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:28:40.719 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: Updating smithi017:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:28:40.719 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:40.719 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:40.719 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:40.719 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:40.719 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:40.719 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: Reconfiguring mon.smithi017 (unknown last config time)... 2024-09-20T18:28:40.719 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T18:28:40.719 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T18:28:40.719 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:40.719 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:40 smithi017 ceph-mon[28058]: Reconfiguring daemon mon.smithi017 on smithi017 2024-09-20T18:28:40.720 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-20T18:28:40.720 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-20T18:28:40.762 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-20T18:28:40.762 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-20T18:28:40.805 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-20T18:28:40.805 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-20T18:28:40.848 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-20T18:28:40.848 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-20T18:28:40.892 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-20T18:28:40.892 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-20T18:28:40.935 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-20T18:28:40.935 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-20T18:28:40.979 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-20T18:28:40.979 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-20T18:28:41.028 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-20T18:28:41.028 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-20T18:28:41.071 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-20T18:28:41.071 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-20T18:28:41.114 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-20T18:28:41.114 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-20T18:28:41.158 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-20T18:28:41.158 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-20T18:28:41.201 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-20T18:28:41.201 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-20T18:28:41.244 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-20T18:28:41.244 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-20T18:28:41.290 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-20T18:28:41.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-20T18:28:41.334 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-20T18:28:41.334 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-20T18:28:41.377 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-20T18:28:41.377 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-20T18:28:41.420 DEBUG:tasks.cephadm:set 18 configs 2024-09-20T18:28:41.420 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi017') 2024-09-20T18:28:41.564 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:41 smithi017 ceph-mon[28058]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:41.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:41 smithi172 ceph-mon[35456]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:42.018 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:42.374 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:42.392 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:43.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:43 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:43.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:43 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:43.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:43 smithi017 ceph-mon[28058]: Reconfiguring mgr.smithi017.xusjwd (unknown last config time)... 2024-09-20T18:28:43.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:43 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi017.xusjwd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:28:43.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:43 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T18:28:43.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:43 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:43.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:43 smithi017 ceph-mon[28058]: Reconfiguring daemon mgr.smithi017.xusjwd on smithi017 2024-09-20T18:28:43.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:43 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:43.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:43 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/146594687' entity='client.admin' 2024-09-20T18:28:43.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:43 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:43.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:43 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:43.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:43 smithi172 ceph-mon[35456]: Reconfiguring mgr.smithi017.xusjwd (unknown last config time)... 2024-09-20T18:28:43.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:43 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi017.xusjwd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:28:43.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:43 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T18:28:43.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:43 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:43.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:43 smithi172 ceph-mon[35456]: Reconfiguring daemon mgr.smithi017.xusjwd on smithi017 2024-09-20T18:28:43.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:43 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:43.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:43 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/146594687' entity='client.admin' 2024-09-20T18:28:44.193 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:44.317 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:44 smithi017 ceph-mon[28058]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:44.317 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:44 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2364211323' entity='client.admin' 2024-09-20T18:28:44.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:44 smithi172 ceph-mon[35456]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:44.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:44 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/2364211323' entity='client.admin' 2024-09-20T18:28:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:45.023+0000 7fd470dc5640 1 -- 172.21.15.17:0/3016877317 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd45806e240 msgr2=0x7fd458070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:45.023+0000 7fd470dc5640 1 --2- 172.21.15.17:0/3016877317 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd45806e240 0x7fd458070700 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd454004de0 tx=0x7fd454000bc0 comp rx=0 tx=0).stop 2024-09-20T18:28:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:45.023+0000 7fd470dc5640 1 -- 172.21.15.17:0/3016877317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd46c1023f0 msgr2=0x7fd46c197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:45.023+0000 7fd470dc5640 1 --2- 172.21.15.17:0/3016877317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd46c1023f0 0x7fd46c197280 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00d8d0 tx=0x7fd45c00dd90 comp rx=0 tx=0).stop 2024-09-20T18:28:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:45.023+0000 7fd470dc5640 1 -- 172.21.15.17:0/3016877317 shutdown_connections 2024-09-20T18:28:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:45.023+0000 7fd470dc5640 1 --2- 172.21.15.17:0/3016877317 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd45806e240 0x7fd458070700 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:45.023+0000 7fd470dc5640 1 --2- 172.21.15.17:0/3016877317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd46c104d20 0x7fd46c1977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:45.023+0000 7fd470dc5640 1 --2- 172.21.15.17:0/3016877317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd46c1023f0 0x7fd46c197280 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:45.023+0000 7fd470dc5640 1 -- 172.21.15.17:0/3016877317 >> 172.21.15.17:0/3016877317 conn(0x7fd46c0fc010 msgr2=0x7fd46c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:45.023+0000 7fd470dc5640 1 -- 172.21.15.17:0/3016877317 shutdown_connections 2024-09-20T18:28:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:45.023+0000 7fd470dc5640 1 -- 172.21.15.17:0/3016877317 wait complete. 2024-09-20T18:28:46.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:45 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2314537291' entity='client.admin' 2024-09-20T18:28:46.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:45 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3016877317' entity='client.admin' 2024-09-20T18:28:46.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:45 smithi017 ceph-mon[28058]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:46.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:45 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/2314537291' entity='client.admin' 2024-09-20T18:28:46.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:45 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3016877317' entity='client.admin' 2024-09-20T18:28:46.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:45 smithi172 ceph-mon[35456]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:46.573 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:46.574 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:46.578 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:46.578 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:46.583 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:46.587 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:46.827 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:47.131 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:47.598 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:47 smithi017 ceph-mon[28058]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:47.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:47 smithi172 ceph-mon[35456]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:47.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.935+0000 7fe366b24640 1 -- 172.21.15.17:0/3738636048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe360101a60 msgr2=0x7fe360101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:47.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.935+0000 7fe366b24640 1 --2- 172.21.15.17:0/3738636048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe360101a60 0x7fe360101ee0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe350009c20 tx=0x7fe35002a970 comp rx=0 tx=0).stop 2024-09-20T18:28:47.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.935+0000 7fe366b24640 1 -- 172.21.15.17:0/3738636048 shutdown_connections 2024-09-20T18:28:47.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.935+0000 7fe366b24640 1 --2- 172.21.15.17:0/3738636048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe360101a60 0x7fe360101ee0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:47.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.935+0000 7fe366b24640 1 --2- 172.21.15.17:0/3738636048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe360100860 0x7fe360100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:47.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.935+0000 7fe366b24640 1 -- 172.21.15.17:0/3738636048 >> 172.21.15.17:0/3738636048 conn(0x7fe3600fc010 msgr2=0x7fe3600fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:47.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.935+0000 7fe366b24640 1 -- 172.21.15.17:0/3738636048 shutdown_connections 2024-09-20T18:28:47.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.935+0000 7fe366b24640 1 -- 172.21.15.17:0/3738636048 wait complete. 2024-09-20T18:28:47.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.935+0000 7fe366b24640 1 Processor -- start 2024-09-20T18:28:47.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.936+0000 7fe366b24640 1 -- start start 2024-09-20T18:28:47.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.936+0000 7fe366b24640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe360100860 0x7fe360196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:47.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.936+0000 7fe366b24640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe360101a60 0x7fe3601967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:47.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.936+0000 7fe366b24640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe3601094a0 con 0x7fe360101a60 2024-09-20T18:28:47.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.936+0000 7fe366b24640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe360109320 con 0x7fe360100860 2024-09-20T18:28:47.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.936+0000 7fe35ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe360101a60 0x7fe3601967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:47.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.936+0000 7fe35ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe360101a60 0x7fe3601967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58526/0 (socket says 172.21.15.17:58526) 2024-09-20T18:28:47.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.936+0000 7fe35ffff640 1 -- 172.21.15.17:0/2807506661 learned_addr learned my addr 172.21.15.17:0/2807506661 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:28:47.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.936+0000 7fe3648c0640 1 --2- 172.21.15.17:0/2807506661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe360100860 0x7fe360196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:47.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.936+0000 7fe35ffff640 1 -- 172.21.15.17:0/2807506661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe360100860 msgr2=0x7fe360196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:47.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.936+0000 7fe35ffff640 1 --2- 172.21.15.17:0/2807506661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe360100860 0x7fe360196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:47.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.936+0000 7fe35ffff640 1 -- 172.21.15.17:0/2807506661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe360196e50 con 0x7fe360101a60 2024-09-20T18:28:47.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.936+0000 7fe35ffff640 1 --2- 172.21.15.17:0/2807506661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe360101a60 0x7fe3601967d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe350006010 tx=0x7fe350003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:47.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.936+0000 7fe35dffb640 1 -- 172.21.15.17:0/2807506661 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe350047070 con 0x7fe360101a60 2024-09-20T18:28:47.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.937+0000 7fe35dffb640 1 -- 172.21.15.17:0/2807506661 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1047+0+0 (secure 0 0 0) 0x7fe35002fe60 con 0x7fe360101a60 2024-09-20T18:28:47.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.937+0000 7fe366b24640 1 -- 172.21.15.17:0/2807506661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe36019b830 con 0x7fe360101a60 2024-09-20T18:28:47.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.937+0000 7fe35dffb640 1 -- 172.21.15.17:0/2807506661 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe350034070 con 0x7fe360101a60 2024-09-20T18:28:47.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.937+0000 7fe366b24640 1 -- 172.21.15.17:0/2807506661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe36019be40 con 0x7fe360101a60 2024-09-20T18:28:47.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.938+0000 7fe366b24640 1 -- 172.21.15.17:0/2807506661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe360109c80 con 0x7fe360101a60 2024-09-20T18:28:47.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.938+0000 7fe35dffb640 1 -- 172.21.15.17:0/2807506661 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fe35004a070 con 0x7fe360101a60 2024-09-20T18:28:47.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.939+0000 7fe35dffb640 1 --2- 172.21.15.17:0/2807506661 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe34c06e280 0x7fe34c070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:47.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.939+0000 7fe35dffb640 1 -- 172.21.15.17:0/2807506661 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe3500ae0e0 con 0x7fe360101a60 2024-09-20T18:28:47.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.939+0000 7fe3648c0640 1 --2- 172.21.15.17:0/2807506661 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe34c06e280 0x7fe34c070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:47.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.939+0000 7fe3648c0640 1 --2- 172.21.15.17:0/2807506661 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe34c06e280 0x7fe34c070740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe3601018c0 tx=0x7fe348008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:47.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.943+0000 7fe35dffb640 1 -- 172.21.15.17:0/2807506661 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe35003f070 con 0x7fe360101a60 2024-09-20T18:28:48.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.423+0000 7f2c6aa7f640 1 -- 172.21.15.17:0/4101109238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c64101960 msgr2=0x7f2c64101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:48.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.423+0000 7f2c6aa7f640 1 --2- 172.21.15.17:0/4101109238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c64101960 0x7f2c64101d60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2c58009880 tx=0x7f2c5802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:28:48.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.423+0000 7f2c6aa7f640 1 -- 172.21.15.17:0/4101109238 shutdown_connections 2024-09-20T18:28:48.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.423+0000 7f2c6aa7f640 1 --2- 172.21.15.17:0/4101109238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c64102b60 0x7f2c64102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:48.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.423+0000 7f2c6aa7f640 1 --2- 172.21.15.17:0/4101109238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c64101960 0x7f2c64101d60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:48.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.423+0000 7f2c6aa7f640 1 -- 172.21.15.17:0/4101109238 >> 172.21.15.17:0/4101109238 conn(0x7f2c640fd0f0 msgr2=0x7f2c640ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:48.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.423+0000 7f2c6aa7f640 1 -- 172.21.15.17:0/4101109238 shutdown_connections 2024-09-20T18:28:48.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.423+0000 7f2c6aa7f640 1 -- 172.21.15.17:0/4101109238 wait complete. 2024-09-20T18:28:48.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.423+0000 7f2c6aa7f640 1 Processor -- start 2024-09-20T18:28:48.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.423+0000 7f2c6aa7f640 1 -- start start 2024-09-20T18:28:48.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.423+0000 7f2c6aa7f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c64101960 0x7f2c64197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:48.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.423+0000 7f2c6aa7f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c64102b60 0x7f2c64197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:48.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.423+0000 7f2c6aa7f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6410a500 con 0x7f2c64101960 2024-09-20T18:28:48.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.423+0000 7f2c6aa7f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6410a380 con 0x7f2c64102b60 2024-09-20T18:28:48.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.424+0000 7f2c6881b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c64101960 0x7f2c64197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:48.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.424+0000 7f2c6881b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c64101960 0x7f2c64197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58498/0 (socket says 172.21.15.17:58498) 2024-09-20T18:28:48.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.424+0000 7f2c6881b640 1 -- 172.21.15.17:0/99497330 learned_addr learned my addr 172.21.15.17:0/99497330 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:28:48.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.424+0000 7f2c63fff640 1 --2- 172.21.15.17:0/99497330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c64102b60 0x7f2c64197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:48.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.424+0000 7f2c6881b640 1 -- 172.21.15.17:0/99497330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c64102b60 msgr2=0x7f2c64197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:48.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.424+0000 7f2c6881b640 1 --2- 172.21.15.17:0/99497330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c64102b60 0x7f2c64197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:48.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.424+0000 7f2c6881b640 1 -- 172.21.15.17:0/99497330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c64197ec0 con 0x7f2c64101960 2024-09-20T18:28:48.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.424+0000 7f2c6881b640 1 --2- 172.21.15.17:0/99497330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c64101960 0x7f2c64197300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2c5802a9c0 tx=0x7f2c580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:48.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.424+0000 7f2c61ffb640 1 -- 172.21.15.17:0/99497330 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c5803f070 con 0x7f2c64101960 2024-09-20T18:28:48.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.424+0000 7f2c61ffb640 1 -- 172.21.15.17:0/99497330 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1047+0+0 (secure 0 0 0) 0x7f2c58004b30 con 0x7f2c64101960 2024-09-20T18:28:48.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.424+0000 7f2c61ffb640 1 -- 172.21.15.17:0/99497330 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c58035030 con 0x7f2c64101960 2024-09-20T18:28:48.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.424+0000 7f2c6aa7f640 1 -- 172.21.15.17:0/99497330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6419c8a0 con 0x7f2c64101960 2024-09-20T18:28:48.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.425+0000 7f2c6aa7f640 1 -- 172.21.15.17:0/99497330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c6419ceb0 con 0x7f2c64101960 2024-09-20T18:28:48.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.425+0000 7f2c6aa7f640 1 -- 172.21.15.17:0/99497330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c6410ace0 con 0x7f2c64101960 2024-09-20T18:28:48.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.426+0000 7f2c61ffb640 1 -- 172.21.15.17:0/99497330 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f2c58042070 con 0x7f2c64101960 2024-09-20T18:28:48.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.426+0000 7f2c61ffb640 1 --2- 172.21.15.17:0/99497330 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f2c5406e280 0x7f2c54070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:48.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.427+0000 7f2c61ffb640 1 -- 172.21.15.17:0/99497330 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2c580adb10 con 0x7f2c64101960 2024-09-20T18:28:48.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.427+0000 7f2c63fff640 1 --2- 172.21.15.17:0/99497330 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f2c5406e280 0x7f2c54070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:48.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.427+0000 7f2c63fff640 1 --2- 172.21.15.17:0/99497330 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f2c5406e280 0x7f2c54070740 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2c641987b0 tx=0x7f2c5000a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:48.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.431+0000 7f2c61ffb640 1 -- 172.21.15.17:0/99497330 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2c58080280 con 0x7f2c64101960 2024-09-20T18:28:48.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.613+0000 7f2c6aa7f640 1 -- 172.21.15.17:0/99497330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f2c64191310 con 0x7f2c64101960 2024-09-20T18:28:48.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.617+0000 7f2c61ffb640 1 -- 172.21.15.17:0/99497330 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7f2c58084ab0 con 0x7f2c64101960 2024-09-20T18:28:48.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.619+0000 7f2c6aa7f640 1 -- 172.21.15.17:0/99497330 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f2c5406e280 msgr2=0x7f2c54070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:48.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.619+0000 7f2c6aa7f640 1 --2- 172.21.15.17:0/99497330 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f2c5406e280 0x7f2c54070740 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2c641987b0 tx=0x7f2c5000a2d0 comp rx=0 tx=0).stop 2024-09-20T18:28:48.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.619+0000 7f2c6aa7f640 1 -- 172.21.15.17:0/99497330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c64101960 msgr2=0x7f2c64197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:48.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.619+0000 7f2c6aa7f640 1 --2- 172.21.15.17:0/99497330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c64101960 0x7f2c64197300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2c5802a9c0 tx=0x7f2c580046c0 comp rx=0 tx=0).stop 2024-09-20T18:28:48.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.619+0000 7f2c6aa7f640 1 -- 172.21.15.17:0/99497330 shutdown_connections 2024-09-20T18:28:48.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.619+0000 7f2c6aa7f640 1 --2- 172.21.15.17:0/99497330 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f2c5406e280 0x7f2c54070740 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:48.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.619+0000 7f2c6aa7f640 1 --2- 172.21.15.17:0/99497330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c64102b60 0x7f2c64197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:48.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.619+0000 7f2c6aa7f640 1 --2- 172.21.15.17:0/99497330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c64101960 0x7f2c64197300 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:48.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.619+0000 7f2c6aa7f640 1 -- 172.21.15.17:0/99497330 >> 172.21.15.17:0/99497330 conn(0x7f2c640fd0f0 msgr2=0x7f2c64106110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:48.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.619+0000 7f2c6aa7f640 1 -- 172.21.15.17:0/99497330 shutdown_connections 2024-09-20T18:28:48.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:47.619+0000 7f2c6aa7f640 1 -- 172.21.15.17:0/99497330 wait complete. 2024-09-20T18:28:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:48.119+0000 7fe366b24640 1 -- 172.21.15.17:0/2807506661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fe36002daa0 con 0x7fe360101a60 2024-09-20T18:28:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:48.122+0000 7fe35dffb640 1 -- 172.21.15.17:0/2807506661 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7fe35007ccc0 con 0x7fe360101a60 2024-09-20T18:28:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:48.124+0000 7fe366b24640 1 -- 172.21.15.17:0/2807506661 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe34c06e280 msgr2=0x7fe34c070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:48.124+0000 7fe366b24640 1 --2- 172.21.15.17:0/2807506661 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe34c06e280 0x7fe34c070740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe3601018c0 tx=0x7fe348008040 comp rx=0 tx=0).stop 2024-09-20T18:28:48.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:48.124+0000 7fe366b24640 1 -- 172.21.15.17:0/2807506661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe360101a60 msgr2=0x7fe3601967d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:48.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:48.124+0000 7fe366b24640 1 --2- 172.21.15.17:0/2807506661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe360101a60 0x7fe3601967d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe350006010 tx=0x7fe350003ba0 comp rx=0 tx=0).stop 2024-09-20T18:28:48.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:48.124+0000 7fe366b24640 1 -- 172.21.15.17:0/2807506661 shutdown_connections 2024-09-20T18:28:48.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:48.125+0000 7fe366b24640 1 --2- 172.21.15.17:0/2807506661 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe34c06e280 0x7fe34c070740 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:48.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:48.125+0000 7fe366b24640 1 --2- 172.21.15.17:0/2807506661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe360101a60 0x7fe3601967d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:48.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:48.125+0000 7fe366b24640 1 --2- 172.21.15.17:0/2807506661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe360100860 0x7fe360196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:48.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:48.125+0000 7fe366b24640 1 -- 172.21.15.17:0/2807506661 >> 172.21.15.17:0/2807506661 conn(0x7fe3600fc010 msgr2=0x7fe360105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:48.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:48.125+0000 7fe366b24640 1 -- 172.21.15.17:0/2807506661 shutdown_connections 2024-09-20T18:28:48.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:48.125+0000 7fe366b24640 1 -- 172.21.15.17:0/2807506661 wait complete. 2024-09-20T18:28:48.811 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:48 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/99497330' entity='client.admin' 2024-09-20T18:28:48.811 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:48 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2807506661' entity='client.admin' 2024-09-20T18:28:48.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:48 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/99497330' entity='client.admin' 2024-09-20T18:28:48.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:48 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/2807506661' entity='client.admin' 2024-09-20T18:28:49.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.010+0000 7f7e5cf39640 1 -- 172.21.15.17:0/2609162771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e58101960 msgr2=0x7f7e58101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:49.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.010+0000 7f7e5cf39640 1 --2- 172.21.15.17:0/2609162771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e58101960 0x7f7e58101d60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009880 tx=0x7f7e4802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.010+0000 7f7e5cf39640 1 -- 172.21.15.17:0/2609162771 shutdown_connections 2024-09-20T18:28:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.010+0000 7f7e5cf39640 1 --2- 172.21.15.17:0/2609162771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e58102b60 0x7f7e58102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.010+0000 7f7e5cf39640 1 --2- 172.21.15.17:0/2609162771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e58101960 0x7f7e58101d60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.010+0000 7f7e5cf39640 1 -- 172.21.15.17:0/2609162771 >> 172.21.15.17:0/2609162771 conn(0x7f7e580fd0d0 msgr2=0x7f7e580ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.010+0000 7f7e5cf39640 1 -- 172.21.15.17:0/2609162771 shutdown_connections 2024-09-20T18:28:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.010+0000 7f7e5cf39640 1 -- 172.21.15.17:0/2609162771 wait complete. 2024-09-20T18:28:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.010+0000 7f7e5cf39640 1 Processor -- start 2024-09-20T18:28:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.011+0000 7f7e5cf39640 1 -- start start 2024-09-20T18:28:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.011+0000 7f7e5cf39640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e58101960 0x7f7e58075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.011+0000 7f7e5cf39640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e58102b60 0x7f7e580745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.011+0000 7f7e5cf39640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5810a520 con 0x7f7e58101960 2024-09-20T18:28:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.011+0000 7f7e5cf39640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5810a3a0 con 0x7f7e58102b60 2024-09-20T18:28:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.011+0000 7f7e5659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e58101960 0x7f7e58075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.011+0000 7f7e5659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e58101960 0x7f7e58075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58546/0 (socket says 172.21.15.17:58546) 2024-09-20T18:28:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.011+0000 7f7e5659c640 1 -- 172.21.15.17:0/1518504517 learned_addr learned my addr 172.21.15.17:0/1518504517 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:28:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.011+0000 7f7e55d9b640 1 --2- 172.21.15.17:0/1518504517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e58102b60 0x7f7e580745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:49.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.011+0000 7f7e5659c640 1 -- 172.21.15.17:0/1518504517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e58102b60 msgr2=0x7f7e580745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:49.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.011+0000 7f7e5659c640 1 --2- 172.21.15.17:0/1518504517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e58102b60 0x7f7e580745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.011+0000 7f7e5659c640 1 -- 172.21.15.17:0/1518504517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e58074b20 con 0x7f7e58101960 2024-09-20T18:28:49.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.011+0000 7f7e5659c640 1 --2- 172.21.15.17:0/1518504517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e58101960 0x7f7e58075f20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009230 tx=0x7f7e480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:49.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.012+0000 7f7e477fe640 1 -- 172.21.15.17:0/1518504517 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7e4803f070 con 0x7f7e58101960 2024-09-20T18:28:49.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.012+0000 7f7e477fe640 1 -- 172.21.15.17:0/1518504517 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) ==== 1047+0+0 (secure 0 0 0) 0x7f7e480049d0 con 0x7f7e58101960 2024-09-20T18:28:49.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.012+0000 7f7e5cf39640 1 -- 172.21.15.17:0/1518504517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e58074db0 con 0x7f7e58101960 2024-09-20T18:28:49.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.012+0000 7f7e477fe640 1 -- 172.21.15.17:0/1518504517 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7e48035030 con 0x7f7e58101960 2024-09-20T18:28:49.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.012+0000 7f7e5cf39640 1 -- 172.21.15.17:0/1518504517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e58075360 con 0x7f7e58101960 2024-09-20T18:28:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.013+0000 7f7e5cf39640 1 -- 172.21.15.17:0/1518504517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e5810ad00 con 0x7f7e58101960 2024-09-20T18:28:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.013+0000 7f7e477fe640 1 -- 172.21.15.17:0/1518504517 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f7e48042070 con 0x7f7e58101960 2024-09-20T18:28:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.014+0000 7f7e477fe640 1 --2- 172.21.15.17:0/1518504517 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f7e4006e280 0x7f7e40070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.014+0000 7f7e55d9b640 1 --2- 172.21.15.17:0/1518504517 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f7e4006e280 0x7f7e40070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.014+0000 7f7e477fe640 1 -- 172.21.15.17:0/1518504517 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7e480ad9a0 con 0x7f7e58101960 2024-09-20T18:28:49.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.014+0000 7f7e55d9b640 1 --2- 172.21.15.17:0/1518504517 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f7e4006e280 0x7f7e40070740 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7e58075ca0 tx=0x7f7e4c00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:49.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.018+0000 7f7e477fe640 1 -- 172.21.15.17:0/1518504517 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7e48080110 con 0x7f7e58101960 2024-09-20T18:28:49.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.199+0000 7f7e5cf39640 1 -- 172.21.15.17:0/1518504517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f7e5802d9c0 con 0x7f7e58101960 2024-09-20T18:28:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.202+0000 7f7e477fe640 1 -- 172.21.15.17:0/1518504517 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v17)=0 v17) ==== 123+0+0 (secure 0 0 0) 0x7f7e48084940 con 0x7f7e58101960 2024-09-20T18:28:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.204+0000 7f7e477fe640 1 -- 172.21.15.17:0/1518504517 <== mon.0 v2:172.21.15.17:3300/0 8 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f7e480b3080 con 0x7f7e58101960 2024-09-20T18:28:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.206+0000 7f7e5cf39640 1 -- 172.21.15.17:0/1518504517 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f7e4006e280 msgr2=0x7f7e40070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.206+0000 7f7e5cf39640 1 --2- 172.21.15.17:0/1518504517 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f7e4006e280 0x7f7e40070740 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7e58075ca0 tx=0x7f7e4c00b390 comp rx=0 tx=0).stop 2024-09-20T18:28:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.206+0000 7f7e5cf39640 1 -- 172.21.15.17:0/1518504517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e58101960 msgr2=0x7f7e58075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.206+0000 7f7e5cf39640 1 --2- 172.21.15.17:0/1518504517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e58101960 0x7f7e58075f20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009230 tx=0x7f7e480045e0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.206+0000 7f7e5cf39640 1 -- 172.21.15.17:0/1518504517 shutdown_connections 2024-09-20T18:28:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.206+0000 7f7e5cf39640 1 --2- 172.21.15.17:0/1518504517 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f7e4006e280 0x7f7e40070740 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.206+0000 7f7e5cf39640 1 --2- 172.21.15.17:0/1518504517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e58102b60 0x7f7e580745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.206+0000 7f7e5cf39640 1 --2- 172.21.15.17:0/1518504517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e58101960 0x7f7e58075f20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.206+0000 7f7e5cf39640 1 -- 172.21.15.17:0/1518504517 >> 172.21.15.17:0/1518504517 conn(0x7f7e580fd0d0 msgr2=0x7f7e58106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.206+0000 7f7e5cf39640 1 -- 172.21.15.17:0/1518504517 shutdown_connections 2024-09-20T18:28:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.206+0000 7f7e5cf39640 1 -- 172.21.15.17:0/1518504517 wait complete. 2024-09-20T18:28:49.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.574+0000 7f53e8e78640 1 -- 172.21.15.17:0/157657801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4100860 msgr2=0x7f53e4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:49.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.574+0000 7f53e8e78640 1 --2- 172.21.15.17:0/157657801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4100860 0x7f53e4100c60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009880 tx=0x7f53d402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.574+0000 7f53e8e78640 1 -- 172.21.15.17:0/157657801 shutdown_connections 2024-09-20T18:28:49.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.574+0000 7f53e8e78640 1 --2- 172.21.15.17:0/157657801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53e4101a60 0x7f53e4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.574+0000 7f53e8e78640 1 --2- 172.21.15.17:0/157657801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4100860 0x7f53e4100c60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.574+0000 7f53e8e78640 1 -- 172.21.15.17:0/157657801 >> 172.21.15.17:0/157657801 conn(0x7f53e40fc010 msgr2=0x7f53e40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:49.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.574+0000 7f53e8e78640 1 -- 172.21.15.17:0/157657801 shutdown_connections 2024-09-20T18:28:49.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.574+0000 7f53e8e78640 1 -- 172.21.15.17:0/157657801 wait complete. 2024-09-20T18:28:49.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.575+0000 7f53e8e78640 1 Processor -- start 2024-09-20T18:28:49.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.575+0000 7f53e8e78640 1 -- start start 2024-09-20T18:28:49.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.575+0000 7f53e8e78640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4100860 0x7f53e4104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:49.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.575+0000 7f53e8e78640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53e4101a60 0x7f53e4102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:49.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.575+0000 7f53e8e78640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f53e4109540 con 0x7f53e4100860 2024-09-20T18:28:49.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.575+0000 7f53e8e78640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53e41093c0 con 0x7f53e4101a60 2024-09-20T18:28:49.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.575+0000 7f53e259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4100860 0x7f53e4104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:49.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.575+0000 7f53e259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4100860 0x7f53e4104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58574/0 (socket says 172.21.15.17:58574) 2024-09-20T18:28:49.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.575+0000 7f53e259c640 1 -- 172.21.15.17:0/2510995609 learned_addr learned my addr 172.21.15.17:0/2510995609 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:28:49.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.575+0000 7f53dbfff640 1 --2- 172.21.15.17:0/2510995609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53e4101a60 0x7f53e4102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:49.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.575+0000 7f53e259c640 1 -- 172.21.15.17:0/2510995609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53e4101a60 msgr2=0x7f53e4102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:49.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.575+0000 7f53e259c640 1 --2- 172.21.15.17:0/2510995609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53e4101a60 0x7f53e4102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.575+0000 7f53e259c640 1 -- 172.21.15.17:0/2510995609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e4103380 con 0x7f53e4100860 2024-09-20T18:28:49.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.575+0000 7f53e259c640 1 --2- 172.21.15.17:0/2510995609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4100860 0x7f53e4104780 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009230 tx=0x7f53d40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:49.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.576+0000 7f53db7fe640 1 -- 172.21.15.17:0/2510995609 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53d403f070 con 0x7f53e4100860 2024-09-20T18:28:49.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.576+0000 7f53db7fe640 1 -- 172.21.15.17:0/2510995609 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f53d4003a90 con 0x7f53e4100860 2024-09-20T18:28:49.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.576+0000 7f53e8e78640 1 -- 172.21.15.17:0/2510995609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e4103610 con 0x7f53e4100860 2024-09-20T18:28:49.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.576+0000 7f53db7fe640 1 -- 172.21.15.17:0/2510995609 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53d4035030 con 0x7f53e4100860 2024-09-20T18:28:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.576+0000 7f53e8e78640 1 -- 172.21.15.17:0/2510995609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e4103bc0 con 0x7f53e4100860 2024-09-20T18:28:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.577+0000 7f53e8e78640 1 -- 172.21.15.17:0/2510995609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53e4109d20 con 0x7f53e4100860 2024-09-20T18:28:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.577+0000 7f53db7fe640 1 -- 172.21.15.17:0/2510995609 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f53d4042070 con 0x7f53e4100860 2024-09-20T18:28:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.578+0000 7f53db7fe640 1 --2- 172.21.15.17:0/2510995609 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f53d006e230 0x7f53d00706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.578+0000 7f53dbfff640 1 --2- 172.21.15.17:0/2510995609 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f53d006e230 0x7f53d00706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.578+0000 7f53db7fe640 1 -- 172.21.15.17:0/2510995609 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f53d40ada80 con 0x7f53e4100860 2024-09-20T18:28:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.578+0000 7f53dbfff640 1 --2- 172.21.15.17:0/2510995609 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f53d006e230 0x7f53d00706f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f53e4104500 tx=0x7f53cc00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:49.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.582+0000 7f53db7fe640 1 -- 172.21.15.17:0/2510995609 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f53d4080170 con 0x7f53e4100860 2024-09-20T18:28:49.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.761+0000 7f53e8e78640 1 -- 172.21.15.17:0/2510995609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f53e419f440 con 0x7f53e4100860 2024-09-20T18:28:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.764+0000 7f53db7fe640 1 -- 172.21.15.17:0/2510995609 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f53d40849a0 con 0x7f53e4100860 2024-09-20T18:28:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.767+0000 7f53e8e78640 1 -- 172.21.15.17:0/2510995609 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f53d006e230 msgr2=0x7f53d00706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.767+0000 7f53e8e78640 1 --2- 172.21.15.17:0/2510995609 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f53d006e230 0x7f53d00706f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f53e4104500 tx=0x7f53cc00b390 comp rx=0 tx=0).stop 2024-09-20T18:28:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.767+0000 7f53e8e78640 1 -- 172.21.15.17:0/2510995609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4100860 msgr2=0x7f53e4104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.767+0000 7f53e8e78640 1 --2- 172.21.15.17:0/2510995609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4100860 0x7f53e4104780 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009230 tx=0x7f53d40048f0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.767+0000 7f53e8e78640 1 -- 172.21.15.17:0/2510995609 shutdown_connections 2024-09-20T18:28:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.767+0000 7f53e8e78640 1 --2- 172.21.15.17:0/2510995609 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f53d006e230 0x7f53d00706f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.767+0000 7f53e8e78640 1 --2- 172.21.15.17:0/2510995609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53e4101a60 0x7f53e4102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.767+0000 7f53e8e78640 1 --2- 172.21.15.17:0/2510995609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4100860 0x7f53e4104780 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.767+0000 7f53e8e78640 1 -- 172.21.15.17:0/2510995609 >> 172.21.15.17:0/2510995609 conn(0x7f53e40fc010 msgr2=0x7f53e406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.767+0000 7f53e8e78640 1 -- 172.21.15.17:0/2510995609 shutdown_connections 2024-09-20T18:28:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.767+0000 7f53e8e78640 1 -- 172.21.15.17:0/2510995609 wait complete. 2024-09-20T18:28:49.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.799+0000 7fd6e4a02640 1 -- 172.21.15.17:0/1709321871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e0101880 msgr2=0x7fd6e0101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:49.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.799+0000 7fd6e4a02640 1 --2- 172.21.15.17:0/1709321871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e0101880 0x7fd6e0101d00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009880 tx=0x7fd6c802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.799+0000 7fd6e4a02640 1 -- 172.21.15.17:0/1709321871 shutdown_connections 2024-09-20T18:28:49.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.799+0000 7fd6e4a02640 1 --2- 172.21.15.17:0/1709321871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e0101880 0x7fd6e0101d00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.799+0000 7fd6e4a02640 1 --2- 172.21.15.17:0/1709321871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0100680 0x7fd6e0100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.799+0000 7fd6e4a02640 1 -- 172.21.15.17:0/1709321871 >> 172.21.15.17:0/1709321871 conn(0x7fd6e00fbe30 msgr2=0x7fd6e00fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:49.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.799+0000 7fd6e4a02640 1 -- 172.21.15.17:0/1709321871 shutdown_connections 2024-09-20T18:28:49.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.799+0000 7fd6e4a02640 1 -- 172.21.15.17:0/1709321871 wait complete. 2024-09-20T18:28:49.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.800+0000 7fd6e4a02640 1 Processor -- start 2024-09-20T18:28:49.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.800+0000 7fd6e4a02640 1 -- start start 2024-09-20T18:28:49.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.800+0000 7fd6e4a02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e0100680 0x7fd6e0197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:49.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.800+0000 7fd6e4a02640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0101880 0x7fd6e0197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:49.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.800+0000 7fd6e4a02640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e0109380 con 0x7fd6e0100680 2024-09-20T18:28:49.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.801+0000 7fd6e4a02640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e0109200 con 0x7fd6e0101880 2024-09-20T18:28:49.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.801+0000 7fd6ded9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e0100680 0x7fd6e0197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:49.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.801+0000 7fd6d659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0101880 0x7fd6e0197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:49.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.801+0000 7fd6d659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0101880 0x7fd6e0197760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:54974/0 (socket says 172.21.15.17:54974) 2024-09-20T18:28:49.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.801+0000 7fd6d659c640 1 -- 172.21.15.17:0/1632760776 learned_addr learned my addr 172.21.15.17:0/1632760776 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:28:49.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.801+0000 7fd6d659c640 1 -- 172.21.15.17:0/1632760776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e0100680 msgr2=0x7fd6e0197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:49.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.801+0000 7fd6d659c640 1 --2- 172.21.15.17:0/1632760776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e0100680 0x7fd6e0197220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:49.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.801+0000 7fd6d659c640 1 -- 172.21.15.17:0/1632760776 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e0197de0 con 0x7fd6e0101880 2024-09-20T18:28:49.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.801+0000 7fd6d659c640 1 --2- 172.21.15.17:0/1632760776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0101880 0x7fd6e0197760 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8005d90 tx=0x7fd6c80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:49.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.802+0000 7fd6dcd99640 1 -- 172.21.15.17:0/1632760776 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd6c803f070 con 0x7fd6e0101880 2024-09-20T18:28:49.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.802+0000 7fd6dcd99640 1 -- 172.21.15.17:0/1632760776 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7fd6c8004b00 con 0x7fd6e0101880 2024-09-20T18:28:49.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.802+0000 7fd6e4a02640 1 -- 172.21.15.17:0/1632760776 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e0102aa0 con 0x7fd6e0101880 2024-09-20T18:28:49.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.802+0000 7fd6dcd99640 1 -- 172.21.15.17:0/1632760776 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd6c8035030 con 0x7fd6e0101880 2024-09-20T18:28:49.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.802+0000 7fd6e4a02640 1 -- 172.21.15.17:0/1632760776 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e01030b0 con 0x7fd6e0101880 2024-09-20T18:28:49.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.803+0000 7fd6e4a02640 1 -- 172.21.15.17:0/1632760776 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e0109b60 con 0x7fd6e0101880 2024-09-20T18:28:49.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.803+0000 7fd6dcd99640 1 -- 172.21.15.17:0/1632760776 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fd6c8042070 con 0x7fd6e0101880 2024-09-20T18:28:49.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.804+0000 7fd6dcd99640 1 --2- 172.21.15.17:0/1632760776 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd6cc06e280 0x7fd6cc070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:49.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.804+0000 7fd6dcd99640 1 -- 172.21.15.17:0/1632760776 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd6c80adaa0 con 0x7fd6e0101880 2024-09-20T18:28:49.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.804+0000 7fd6ded9d640 1 --2- 172.21.15.17:0/1632760776 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd6cc06e280 0x7fd6cc070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:49.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.804+0000 7fd6ded9d640 1 --2- 172.21.15.17:0/1632760776 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd6cc06e280 0x7fd6cc070740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd6e01016e0 tx=0x7fd6d0005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:49.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.809+0000 7fd6dcd99640 1 -- 172.21.15.17:0/1632760776 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd6c80801b0 con 0x7fd6e0101880 2024-09-20T18:28:49.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.983+0000 7fd6e4a02640 1 -- 172.21.15.17:0/1632760776 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fd6e0103880 con 0x7fd6e0101880 2024-09-20T18:28:50.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.987+0000 7fd6dcd99640 1 -- 172.21.15.17:0/1632760776 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7fd6c80849e0 con 0x7fd6e0101880 2024-09-20T18:28:50.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.990+0000 7fd6e4a02640 1 -- 172.21.15.17:0/1632760776 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd6cc06e280 msgr2=0x7fd6cc070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:50.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.990+0000 7fd6e4a02640 1 --2- 172.21.15.17:0/1632760776 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd6cc06e280 0x7fd6cc070740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd6e01016e0 tx=0x7fd6d0005f90 comp rx=0 tx=0).stop 2024-09-20T18:28:50.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.990+0000 7fd6e4a02640 1 -- 172.21.15.17:0/1632760776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0101880 msgr2=0x7fd6e0197760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:50.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.990+0000 7fd6e4a02640 1 --2- 172.21.15.17:0/1632760776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0101880 0x7fd6e0197760 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8005d90 tx=0x7fd6c80046c0 comp rx=0 tx=0).stop 2024-09-20T18:28:50.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.990+0000 7fd6e4a02640 1 -- 172.21.15.17:0/1632760776 shutdown_connections 2024-09-20T18:28:50.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.990+0000 7fd6e4a02640 1 --2- 172.21.15.17:0/1632760776 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd6cc06e280 0x7fd6cc070740 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:50.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.990+0000 7fd6e4a02640 1 --2- 172.21.15.17:0/1632760776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0101880 0x7fd6e0197760 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:50.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.990+0000 7fd6e4a02640 1 --2- 172.21.15.17:0/1632760776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e0100680 0x7fd6e0197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:50.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.990+0000 7fd6e4a02640 1 -- 172.21.15.17:0/1632760776 >> 172.21.15.17:0/1632760776 conn(0x7fd6e00fbe30 msgr2=0x7fd6e0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:50.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.990+0000 7fd6e4a02640 1 -- 172.21.15.17:0/1632760776 shutdown_connections 2024-09-20T18:28:50.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:49.990+0000 7fd6e4a02640 1 -- 172.21.15.17:0/1632760776 wait complete. 2024-09-20T18:28:50.330 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:50 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1518504517' entity='client.admin' 2024-09-20T18:28:50.330 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:50 smithi017 ceph-mon[28058]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:50.330 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:50 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2510995609' entity='client.admin' 2024-09-20T18:28:50.330 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:50 smithi017 ceph-mon[28058]: from='client.? ' entity='client.admin' 2024-09-20T18:28:50.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:50 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/1518504517' entity='client.admin' 2024-09-20T18:28:50.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:50 smithi172 ceph-mon[35456]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:50.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:50 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/2510995609' entity='client.admin' 2024-09-20T18:28:50.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:50 smithi172 ceph-mon[35456]: from='client.? ' entity='client.admin' 2024-09-20T18:28:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.604+0000 7fce54109640 1 -- 172.21.15.17:0/395755593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce4c100b20 msgr2=0x7fce4c100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.604+0000 7fce54109640 1 --2- 172.21.15.17:0/395755593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce4c100b20 0x7fce4c100f80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fce3c009880 tx=0x7fce3c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:28:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.604+0000 7fce54109640 1 -- 172.21.15.17:0/395755593 shutdown_connections 2024-09-20T18:28:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.604+0000 7fce54109640 1 --2- 172.21.15.17:0/395755593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce4c100b20 0x7fce4c100f80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.604+0000 7fce54109640 1 --2- 172.21.15.17:0/395755593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce4c1001e0 0x7fce4c1005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.604+0000 7fce54109640 1 -- 172.21.15.17:0/395755593 >> 172.21.15.17:0/395755593 conn(0x7fce4c0fc010 msgr2=0x7fce4c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.604+0000 7fce54109640 1 -- 172.21.15.17:0/395755593 shutdown_connections 2024-09-20T18:28:50.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.604+0000 7fce54109640 1 -- 172.21.15.17:0/395755593 wait complete. 2024-09-20T18:28:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.605+0000 7fce54109640 1 Processor -- start 2024-09-20T18:28:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.605+0000 7fce54109640 1 -- start start 2024-09-20T18:28:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.605+0000 7fce54109640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce4c1001e0 0x7fce4c1995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.605+0000 7fce54109640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce4c100b20 0x7fce4c199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.605+0000 7fce54109640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c10c850 con 0x7fce4c1001e0 2024-09-20T18:28:50.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.605+0000 7fce54109640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c10c6d0 con 0x7fce4c100b20 2024-09-20T18:28:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.605+0000 7fce51ea5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce4c1001e0 0x7fce4c1995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.605+0000 7fce51ea5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce4c1001e0 0x7fce4c1995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34458/0 (socket says 172.21.15.17:34458) 2024-09-20T18:28:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.605+0000 7fce51ea5640 1 -- 172.21.15.17:0/3395654466 learned_addr learned my addr 172.21.15.17:0/3395654466 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:28:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.605+0000 7fce516a4640 1 --2- 172.21.15.17:0/3395654466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce4c100b20 0x7fce4c199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.606+0000 7fce51ea5640 1 -- 172.21.15.17:0/3395654466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce4c100b20 msgr2=0x7fce4c199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.606+0000 7fce51ea5640 1 --2- 172.21.15.17:0/3395654466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce4c100b20 0x7fce4c199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.606+0000 7fce51ea5640 1 -- 172.21.15.17:0/3395654466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4c19a160 con 0x7fce4c1001e0 2024-09-20T18:28:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.606+0000 7fce51ea5640 1 --2- 172.21.15.17:0/3395654466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce4c1001e0 0x7fce4c1995a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fce4800d6f0 tx=0x7fce4800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.606+0000 7fce42ffd640 1 -- 172.21.15.17:0/3395654466 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce48017070 con 0x7fce4c1001e0 2024-09-20T18:28:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.606+0000 7fce54109640 1 -- 172.21.15.17:0/3395654466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce4c19eba0 con 0x7fce4c1001e0 2024-09-20T18:28:50.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.606+0000 7fce42ffd640 1 -- 172.21.15.17:0/3395654466 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7fce4800de00 con 0x7fce4c1001e0 2024-09-20T18:28:50.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.606+0000 7fce42ffd640 1 -- 172.21.15.17:0/3395654466 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce48004b00 con 0x7fce4c1001e0 2024-09-20T18:28:50.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.606+0000 7fce54109640 1 -- 172.21.15.17:0/3395654466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce4c19f100 con 0x7fce4c1001e0 2024-09-20T18:28:50.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.607+0000 7fce54109640 1 -- 172.21.15.17:0/3395654466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce4c10d030 con 0x7fce4c1001e0 2024-09-20T18:28:50.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.608+0000 7fce42ffd640 1 -- 172.21.15.17:0/3395654466 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fce48009a30 con 0x7fce4c1001e0 2024-09-20T18:28:50.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.608+0000 7fce42ffd640 1 --2- 172.21.15.17:0/3395654466 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce3806e230 0x7fce380706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:50.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.608+0000 7fce516a4640 1 --2- 172.21.15.17:0/3395654466 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce3806e230 0x7fce380706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:50.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.608+0000 7fce42ffd640 1 -- 172.21.15.17:0/3395654466 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fce4808cc20 con 0x7fce4c1001e0 2024-09-20T18:28:50.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.609+0000 7fce516a4640 1 --2- 172.21.15.17:0/3395654466 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce3806e230 0x7fce380706f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fce3c000c00 tx=0x7fce3c005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:50.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.613+0000 7fce42ffd640 1 -- 172.21.15.17:0/3395654466 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fce4805f310 con 0x7fce4c1001e0 2024-09-20T18:28:50.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.790+0000 7fce54109640 1 -- 172.21.15.17:0/3395654466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fce4c1005e0 con 0x7fce4c1001e0 2024-09-20T18:28:50.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.794+0000 7fce42ffd640 1 -- 172.21.15.17:0/3395654466 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v20)=0 v20) ==== 123+0+0 (secure 0 0 0) 0x7fce48063b40 con 0x7fce4c1001e0 2024-09-20T18:28:50.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.794+0000 7fce42ffd640 1 -- 172.21.15.17:0/3395654466 <== mon.0 v2:172.21.15.17:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce48092020 con 0x7fce4c1001e0 2024-09-20T18:28:50.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.796+0000 7fce54109640 1 -- 172.21.15.17:0/3395654466 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce3806e230 msgr2=0x7fce380706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:50.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.796+0000 7fce54109640 1 --2- 172.21.15.17:0/3395654466 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce3806e230 0x7fce380706f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fce3c000c00 tx=0x7fce3c005d50 comp rx=0 tx=0).stop 2024-09-20T18:28:50.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.796+0000 7fce54109640 1 -- 172.21.15.17:0/3395654466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce4c1001e0 msgr2=0x7fce4c1995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:50.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.796+0000 7fce54109640 1 --2- 172.21.15.17:0/3395654466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce4c1001e0 0x7fce4c1995a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fce4800d6f0 tx=0x7fce4800dbb0 comp rx=0 tx=0).stop 2024-09-20T18:28:50.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.796+0000 7fce54109640 1 -- 172.21.15.17:0/3395654466 shutdown_connections 2024-09-20T18:28:50.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.796+0000 7fce54109640 1 --2- 172.21.15.17:0/3395654466 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce3806e230 0x7fce380706f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:50.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.796+0000 7fce54109640 1 --2- 172.21.15.17:0/3395654466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce4c100b20 0x7fce4c199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:50.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.796+0000 7fce54109640 1 --2- 172.21.15.17:0/3395654466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce4c1001e0 0x7fce4c1995a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:50.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.796+0000 7fce54109640 1 -- 172.21.15.17:0/3395654466 >> 172.21.15.17:0/3395654466 conn(0x7fce4c0fc010 msgr2=0x7fce4c108a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:50.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.796+0000 7fce54109640 1 -- 172.21.15.17:0/3395654466 shutdown_connections 2024-09-20T18:28:50.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:50.796+0000 7fce54109640 1 -- 172.21.15.17:0/3395654466 wait complete. 2024-09-20T18:28:51.841 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi017') 2024-09-20T18:28:51.842 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi017') 2024-09-20T18:28:51.842 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi017') 2024-09-20T18:28:52.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:51 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3395654466' entity='client.admin' 2024-09-20T18:28:52.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:51 smithi017 ceph-mon[28058]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:52.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:51 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3395654466' entity='client.admin' 2024-09-20T18:28:52.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:51 smithi172 ceph-mon[35456]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:52.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.757+0000 7f04eeecc640 1 -- 172.21.15.17:0/1841045507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e8101a60 msgr2=0x7f04e8101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:52.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.757+0000 7f04eeecc640 1 --2- 172.21.15.17:0/1841045507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e8101a60 0x7f04e8101ee0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009880 tx=0x7f04d402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:28:52.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.757+0000 7f04eeecc640 1 -- 172.21.15.17:0/1841045507 shutdown_connections 2024-09-20T18:28:52.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.757+0000 7f04eeecc640 1 --2- 172.21.15.17:0/1841045507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e8101a60 0x7f04e8101ee0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:52.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.757+0000 7f04eeecc640 1 --2- 172.21.15.17:0/1841045507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04e8100860 0x7f04e8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:52.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.757+0000 7f04eeecc640 1 -- 172.21.15.17:0/1841045507 >> 172.21.15.17:0/1841045507 conn(0x7f04e80fc010 msgr2=0x7f04e80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.757+0000 7f04eeecc640 1 -- 172.21.15.17:0/1841045507 shutdown_connections 2024-09-20T18:28:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.757+0000 7f04eeecc640 1 -- 172.21.15.17:0/1841045507 wait complete. 2024-09-20T18:28:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.758+0000 7f04eeecc640 1 Processor -- start 2024-09-20T18:28:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.758+0000 7f04eeecc640 1 -- start start 2024-09-20T18:28:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.758+0000 7f04eeecc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e8100860 0x7f04e81974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.758+0000 7f04eeecc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04e8101a60 0x7f04e81979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.758+0000 7f04eeecc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f04e8109680 con 0x7f04e8100860 2024-09-20T18:28:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.759+0000 7f04eeecc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04e8109500 con 0x7f04e8101a60 2024-09-20T18:28:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.759+0000 7f04ecc68640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e8100860 0x7f04e81974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.759+0000 7f04ecc68640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e8100860 0x7f04e81974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34476/0 (socket says 172.21.15.17:34476) 2024-09-20T18:28:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.759+0000 7f04ecc68640 1 -- 172.21.15.17:0/4206536862 learned_addr learned my addr 172.21.15.17:0/4206536862 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:28:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.759+0000 7f04e7fff640 1 --2- 172.21.15.17:0/4206536862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04e8101a60 0x7f04e81979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.759+0000 7f04ecc68640 1 -- 172.21.15.17:0/4206536862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04e8101a60 msgr2=0x7f04e81979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.759+0000 7f04ecc68640 1 --2- 172.21.15.17:0/4206536862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04e8101a60 0x7f04e81979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.759+0000 7f04ecc68640 1 -- 172.21.15.17:0/4206536862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e8197fd0 con 0x7f04e8100860 2024-09-20T18:28:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.759+0000 7f04ecc68640 1 --2- 172.21.15.17:0/4206536862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e8100860 0x7f04e81974a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f04dc00c8f0 tx=0x7f04dc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.759+0000 7f04e5ffb640 1 -- 172.21.15.17:0/4206536862 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f04dc004020 con 0x7f04e8100860 2024-09-20T18:28:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.759+0000 7f04e5ffb640 1 -- 172.21.15.17:0/4206536862 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f04dc007e10 con 0x7f04e8100860 2024-09-20T18:28:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.759+0000 7f04eeecc640 1 -- 172.21.15.17:0/4206536862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e819ca40 con 0x7f04e8100860 2024-09-20T18:28:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.759+0000 7f04e5ffb640 1 -- 172.21.15.17:0/4206536862 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f04dc003e10 con 0x7f04e8100860 2024-09-20T18:28:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.760+0000 7f04eeecc640 1 -- 172.21.15.17:0/4206536862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e819cfa0 con 0x7f04e8100860 2024-09-20T18:28:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.761+0000 7f04e5ffb640 1 -- 172.21.15.17:0/4206536862 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f04dc007950 con 0x7f04e8100860 2024-09-20T18:28:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.761+0000 7f04eeecc640 1 -- 172.21.15.17:0/4206536862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04e8100c60 con 0x7f04e8100860 2024-09-20T18:28:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.762+0000 7f04e5ffb640 1 --2- 172.21.15.17:0/4206536862 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f04d806e230 0x7f04d80706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.762+0000 7f04e5ffb640 1 -- 172.21.15.17:0/4206536862 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f04dc08d180 con 0x7f04e8100860 2024-09-20T18:28:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.762+0000 7f04e7fff640 1 --2- 172.21.15.17:0/4206536862 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f04d806e230 0x7f04d80706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.762+0000 7f04e7fff640 1 --2- 172.21.15.17:0/4206536862 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f04d806e230 0x7f04d80706f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f04e8198950 tx=0x7f04d4005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.767+0000 7f04e5ffb640 1 -- 172.21.15.17:0/4206536862 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f04dc015330 con 0x7f04e8100860 2024-09-20T18:28:52.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.949+0000 7f04eeecc640 1 -- 172.21.15.17:0/4206536862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f04e819d420 con 0x7f04e8100860 2024-09-20T18:28:52.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.953+0000 7f04e5ffb640 1 -- 172.21.15.17:0/4206536862 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v21)=0 v21) ==== 106+0+0 (secure 0 0 0) 0x7f04dc05bc40 con 0x7f04e8100860 2024-09-20T18:28:52.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.955+0000 7f04eeecc640 1 -- 172.21.15.17:0/4206536862 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f04d806e230 msgr2=0x7f04d80706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:52.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.955+0000 7f04eeecc640 1 --2- 172.21.15.17:0/4206536862 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f04d806e230 0x7f04d80706f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f04e8198950 tx=0x7f04d4005a20 comp rx=0 tx=0).stop 2024-09-20T18:28:52.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.955+0000 7f04eeecc640 1 -- 172.21.15.17:0/4206536862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e8100860 msgr2=0x7f04e81974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:52.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.955+0000 7f04eeecc640 1 --2- 172.21.15.17:0/4206536862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e8100860 0x7f04e81974a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f04dc00c8f0 tx=0x7f04dc00cdb0 comp rx=0 tx=0).stop 2024-09-20T18:28:52.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.956+0000 7f04eeecc640 1 -- 172.21.15.17:0/4206536862 shutdown_connections 2024-09-20T18:28:52.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.956+0000 7f04eeecc640 1 --2- 172.21.15.17:0/4206536862 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f04d806e230 0x7f04d80706f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:52.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.956+0000 7f04eeecc640 1 --2- 172.21.15.17:0/4206536862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04e8101a60 0x7f04e81979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:52.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.956+0000 7f04eeecc640 1 --2- 172.21.15.17:0/4206536862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04e8100860 0x7f04e81974a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:52.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.956+0000 7f04eeecc640 1 -- 172.21.15.17:0/4206536862 >> 172.21.15.17:0/4206536862 conn(0x7f04e80fc010 msgr2=0x7f04e80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:52.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.956+0000 7f04eeecc640 1 -- 172.21.15.17:0/4206536862 shutdown_connections 2024-09-20T18:28:52.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.956+0000 7f04eeecc640 1 -- 172.21.15.17:0/4206536862 wait complete. 2024-09-20T18:28:52.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.951+0000 7fe1e60b7640 1 -- 172.21.15.17:0/3662396225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e0100860 msgr2=0x7fe1e0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:52.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.951+0000 7fe1e60b7640 1 --2- 172.21.15.17:0/3662396225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e0100860 0x7fe1e0100c60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009880 tx=0x7fe1d002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:28:52.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.951+0000 7fe1e60b7640 1 -- 172.21.15.17:0/3662396225 shutdown_connections 2024-09-20T18:28:52.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.951+0000 7fe1e60b7640 1 --2- 172.21.15.17:0/3662396225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e0101a60 0x7fe1e0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:52.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.951+0000 7fe1e60b7640 1 --2- 172.21.15.17:0/3662396225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e0100860 0x7fe1e0100c60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:52.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.951+0000 7fe1e60b7640 1 -- 172.21.15.17:0/3662396225 >> 172.21.15.17:0/3662396225 conn(0x7fe1e00fc010 msgr2=0x7fe1e00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:52.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.952+0000 7fe1e60b7640 1 -- 172.21.15.17:0/3662396225 shutdown_connections 2024-09-20T18:28:52.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.952+0000 7fe1e60b7640 1 -- 172.21.15.17:0/3662396225 wait complete. 2024-09-20T18:28:52.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.952+0000 7fe1e60b7640 1 Processor -- start 2024-09-20T18:28:52.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.952+0000 7fe1e60b7640 1 -- start start 2024-09-20T18:28:52.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.953+0000 7fe1e60b7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e0100860 0x7fe1e006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:52.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.953+0000 7fe1e60b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e0101a60 0x7fe1e019c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:52.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.953+0000 7fe1e60b7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e01096a0 con 0x7fe1e0101a60 2024-09-20T18:28:52.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.953+0000 7fe1e60b7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e0109520 con 0x7fe1e0100860 2024-09-20T18:28:52.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.953+0000 7fe1deffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e0101a60 0x7fe1e019c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:52.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.953+0000 7fe1deffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e0101a60 0x7fe1e019c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34496/0 (socket says 172.21.15.17:34496) 2024-09-20T18:28:52.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.953+0000 7fe1deffd640 1 -- 172.21.15.17:0/2712096992 learned_addr learned my addr 172.21.15.17:0/2712096992 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:28:52.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.953+0000 7fe1df7fe640 1 --2- 172.21.15.17:0/2712096992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e0100860 0x7fe1e006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:52.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.953+0000 7fe1deffd640 1 -- 172.21.15.17:0/2712096992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e0100860 msgr2=0x7fe1e006a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:52.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.953+0000 7fe1deffd640 1 --2- 172.21.15.17:0/2712096992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e0100860 0x7fe1e006a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:52.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.953+0000 7fe1deffd640 1 -- 172.21.15.17:0/2712096992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e019c7e0 con 0x7fe1e0101a60 2024-09-20T18:28:52.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.954+0000 7fe1deffd640 1 --2- 172.21.15.17:0/2712096992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e0101a60 0x7fe1e019c1f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400d6f0 tx=0x7fe1d400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:52.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.954+0000 7fe1dcff9640 1 -- 172.21.15.17:0/2712096992 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1d4017070 con 0x7fe1e0101a60 2024-09-20T18:28:52.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.954+0000 7fe1dcff9640 1 -- 172.21.15.17:0/2712096992 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe1d400de00 con 0x7fe1e0101a60 2024-09-20T18:28:52.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.954+0000 7fe1e60b7640 1 -- 172.21.15.17:0/2712096992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e019cad0 con 0x7fe1e0101a60 2024-09-20T18:28:52.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.954+0000 7fe1dcff9640 1 -- 172.21.15.17:0/2712096992 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1d4004bb0 con 0x7fe1e0101a60 2024-09-20T18:28:52.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.955+0000 7fe1e60b7640 1 -- 172.21.15.17:0/2712096992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e019cfa0 con 0x7fe1e0101a60 2024-09-20T18:28:52.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.956+0000 7fe1e60b7640 1 -- 172.21.15.17:0/2712096992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e0100c60 con 0x7fe1e0101a60 2024-09-20T18:28:52.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.956+0000 7fe1dcff9640 1 -- 172.21.15.17:0/2712096992 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fe1d4010460 con 0x7fe1e0101a60 2024-09-20T18:28:52.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.957+0000 7fe1dcff9640 1 --2- 172.21.15.17:0/2712096992 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe1c806e280 0x7fe1c8070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:52.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.957+0000 7fe1dcff9640 1 -- 172.21.15.17:0/2712096992 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe1d408cc30 con 0x7fe1e0101a60 2024-09-20T18:28:52.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.957+0000 7fe1df7fe640 1 --2- 172.21.15.17:0/2712096992 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe1c806e280 0x7fe1c8070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:52.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.958+0000 7fe1df7fe640 1 --2- 172.21.15.17:0/2712096992 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe1c806e280 0x7fe1c8070740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0000c00 tx=0x7fe1d0005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:52.977 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:52.978 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:52.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:52.965+0000 7fe1dcff9640 1 -- 172.21.15.17:0/2712096992 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe1d405b660 con 0x7fe1e0101a60 2024-09-20T18:28:52.979 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:53.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:53.154+0000 7fe1e60b7640 1 -- 172.21.15.17:0/2712096992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fe1e0062df0 con 0x7fe1e0101a60 2024-09-20T18:28:53.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:53.157+0000 7fe1dcff9640 1 -- 172.21.15.17:0/2712096992 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v22)=0 v22) ==== 115+0+0 (secure 0 0 0) 0x7fe1d405f310 con 0x7fe1e0101a60 2024-09-20T18:28:53.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:53.160+0000 7fe1e60b7640 1 -- 172.21.15.17:0/2712096992 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe1c806e280 msgr2=0x7fe1c8070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:53.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:53.160+0000 7fe1e60b7640 1 --2- 172.21.15.17:0/2712096992 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe1c806e280 0x7fe1c8070740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0000c00 tx=0x7fe1d0005a20 comp rx=0 tx=0).stop 2024-09-20T18:28:53.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:53.160+0000 7fe1e60b7640 1 -- 172.21.15.17:0/2712096992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e0101a60 msgr2=0x7fe1e019c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:53.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:53.160+0000 7fe1e60b7640 1 --2- 172.21.15.17:0/2712096992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e0101a60 0x7fe1e019c1f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400d6f0 tx=0x7fe1d400dbb0 comp rx=0 tx=0).stop 2024-09-20T18:28:53.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:53.160+0000 7fe1e60b7640 1 -- 172.21.15.17:0/2712096992 shutdown_connections 2024-09-20T18:28:53.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:53.160+0000 7fe1e60b7640 1 --2- 172.21.15.17:0/2712096992 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe1c806e280 0x7fe1c8070740 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:53.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:53.160+0000 7fe1e60b7640 1 --2- 172.21.15.17:0/2712096992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e0101a60 0x7fe1e019c1f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:53.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:53.160+0000 7fe1e60b7640 1 --2- 172.21.15.17:0/2712096992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e0100860 0x7fe1e006a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:53.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:53.160+0000 7fe1e60b7640 1 -- 172.21.15.17:0/2712096992 >> 172.21.15.17:0/2712096992 conn(0x7fe1e00fc010 msgr2=0x7fe1e0104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:53.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:53.160+0000 7fe1e60b7640 1 -- 172.21.15.17:0/2712096992 shutdown_connections 2024-09-20T18:28:53.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:53.160+0000 7fe1e60b7640 1 -- 172.21.15.17:0/2712096992 wait complete. 2024-09-20T18:28:53.812 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:53.812 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:28:53.812 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:53.812 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:53 smithi017 ceph-mon[28058]: Reconfiguring ceph-exporter.smithi017 (monmap changed)... 2024-09-20T18:28:53.812 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:28:53.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:53.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:53 smithi017 ceph-mon[28058]: Reconfiguring daemon ceph-exporter.smithi017 on smithi017 2024-09-20T18:28:53.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:53 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/4206536862' entity='client.admin' 2024-09-20T18:28:53.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:53 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2712096992' entity='client.admin' 2024-09-20T18:28:53.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:53 smithi017 ceph-mon[28058]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:53.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:53.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:28:53.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:53.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:53 smithi172 ceph-mon[35456]: Reconfiguring ceph-exporter.smithi017 (monmap changed)... 2024-09-20T18:28:53.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:28:53.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:53.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:53 smithi172 ceph-mon[35456]: Reconfiguring daemon ceph-exporter.smithi017 on smithi017 2024-09-20T18:28:53.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:53 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/4206536862' entity='client.admin' 2024-09-20T18:28:53.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:53 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/2712096992' entity='client.admin' 2024-09-20T18:28:53.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:53 smithi172 ceph-mon[35456]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:54.540 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:54.541 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:28:55.461 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi017') 2024-09-20T18:28:55.461 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi017') 2024-09-20T18:28:55.675 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:55 smithi017 ceph-mon[28058]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:55.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.922+0000 7f53eac5d640 1 -- 172.21.15.17:0/3530243719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4102b80 msgr2=0x7f53e4103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:55.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.922+0000 7f53eac5d640 1 --2- 172.21.15.17:0/3530243719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4102b80 0x7f53e4103000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009880 tx=0x7f53d402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:28:55.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.922+0000 7f53eac5d640 1 -- 172.21.15.17:0/3530243719 shutdown_connections 2024-09-20T18:28:55.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.922+0000 7f53eac5d640 1 --2- 172.21.15.17:0/3530243719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4102b80 0x7f53e4103000 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:55.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.922+0000 7f53eac5d640 1 --2- 172.21.15.17:0/3530243719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53e4101980 0x7f53e4101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:55.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.922+0000 7f53eac5d640 1 -- 172.21.15.17:0/3530243719 >> 172.21.15.17:0/3530243719 conn(0x7f53e40fd110 msgr2=0x7f53e40ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:55.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.922+0000 7f53eac5d640 1 -- 172.21.15.17:0/3530243719 shutdown_connections 2024-09-20T18:28:55.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.922+0000 7f53eac5d640 1 -- 172.21.15.17:0/3530243719 wait complete. 2024-09-20T18:28:55.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.922+0000 7f53eac5d640 1 Processor -- start 2024-09-20T18:28:55.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.922+0000 7f53eac5d640 1 -- start start 2024-09-20T18:28:55.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.923+0000 7f53eac5d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53e4101980 0x7f53e41974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.923+0000 7f53eac5d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4102b80 0x7f53e41979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.923+0000 7f53eac5d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f53e410a7c0 con 0x7f53e4102b80 2024-09-20T18:28:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.923+0000 7f53eac5d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53e410a640 con 0x7f53e4101980 2024-09-20T18:28:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.923+0000 7f53dbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4102b80 0x7f53e41979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.923+0000 7f53dbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4102b80 0x7f53e41979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34512/0 (socket says 172.21.15.17:34512) 2024-09-20T18:28:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.923+0000 7f53dbfff640 1 -- 172.21.15.17:0/404490168 learned_addr learned my addr 172.21.15.17:0/404490168 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:28:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.923+0000 7f53e89f9640 1 --2- 172.21.15.17:0/404490168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53e4101980 0x7f53e41974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.923+0000 7f53dbfff640 1 -- 172.21.15.17:0/404490168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53e4101980 msgr2=0x7f53e41974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.923+0000 7f53dbfff640 1 --2- 172.21.15.17:0/404490168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53e4101980 0x7f53e41974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.923+0000 7f53dbfff640 1 -- 172.21.15.17:0/404490168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e4198070 con 0x7f53e4102b80 2024-09-20T18:28:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.923+0000 7f53dbfff640 1 --2- 172.21.15.17:0/404490168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4102b80 0x7f53e41979f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f53d4006010 tx=0x7f53d40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.924+0000 7f53d9ffb640 1 -- 172.21.15.17:0/404490168 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53d403f070 con 0x7f53e4102b80 2024-09-20T18:28:55.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.924+0000 7f53d9ffb640 1 -- 172.21.15.17:0/404490168 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53d40044d0 con 0x7f53e4102b80 2024-09-20T18:28:55.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.924+0000 7f53eac5d640 1 -- 172.21.15.17:0/404490168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e419ca50 con 0x7f53e4102b80 2024-09-20T18:28:55.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.924+0000 7f53d9ffb640 1 -- 172.21.15.17:0/404490168 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53d4035030 con 0x7f53e4102b80 2024-09-20T18:28:55.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.924+0000 7f53eac5d640 1 -- 172.21.15.17:0/404490168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e419cfe0 con 0x7f53e4102b80 2024-09-20T18:28:55.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.925+0000 7f53eac5d640 1 -- 172.21.15.17:0/404490168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53e4101d80 con 0x7f53e4102b80 2024-09-20T18:28:55.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.925+0000 7f53d9ffb640 1 -- 172.21.15.17:0/404490168 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f53d4042070 con 0x7f53e4102b80 2024-09-20T18:28:55.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.926+0000 7f53d9ffb640 1 --2- 172.21.15.17:0/404490168 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f53cc06e280 0x7f53cc070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:55.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.926+0000 7f53d9ffb640 1 -- 172.21.15.17:0/404490168 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f53d40adc20 con 0x7f53e4102b80 2024-09-20T18:28:55.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.926+0000 7f53e89f9640 1 --2- 172.21.15.17:0/404490168 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f53cc06e280 0x7f53cc070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:55.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.926+0000 7f53e89f9640 1 --2- 172.21.15.17:0/404490168 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f53cc06e280 0x7f53cc070740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f53e00058c0 tx=0x7f53e000a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:55.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:55.932+0000 7f53d9ffb640 1 -- 172.21.15.17:0/404490168 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f53d4080390 con 0x7f53e4102b80 2024-09-20T18:28:55.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:55 smithi172 ceph-mon[35456]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.110+0000 7f53eac5d640 1 -- 172.21.15.17:0/404490168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f53e4062df0 con 0x7f53e4102b80 2024-09-20T18:28:56.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.113+0000 7f53d9ffb640 1 -- 172.21.15.17:0/404490168 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v23)=0 v23) ==== 125+0+0 (secure 0 0 0) 0x7f53d4084bc0 con 0x7f53e4102b80 2024-09-20T18:28:56.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.116+0000 7f53eac5d640 1 -- 172.21.15.17:0/404490168 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f53cc06e280 msgr2=0x7f53cc070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:56.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.116+0000 7f53eac5d640 1 --2- 172.21.15.17:0/404490168 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f53cc06e280 0x7f53cc070740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f53e00058c0 tx=0x7f53e000a2d0 comp rx=0 tx=0).stop 2024-09-20T18:28:56.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.116+0000 7f53eac5d640 1 -- 172.21.15.17:0/404490168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4102b80 msgr2=0x7f53e41979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:56.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.116+0000 7f53eac5d640 1 --2- 172.21.15.17:0/404490168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4102b80 0x7f53e41979f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f53d4006010 tx=0x7f53d40048f0 comp rx=0 tx=0).stop 2024-09-20T18:28:56.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.116+0000 7f53eac5d640 1 -- 172.21.15.17:0/404490168 shutdown_connections 2024-09-20T18:28:56.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.116+0000 7f53eac5d640 1 --2- 172.21.15.17:0/404490168 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f53cc06e280 0x7f53cc070740 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:56.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.116+0000 7f53eac5d640 1 --2- 172.21.15.17:0/404490168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53e4102b80 0x7f53e41979f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:56.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.116+0000 7f53eac5d640 1 --2- 172.21.15.17:0/404490168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53e4101980 0x7f53e41974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:56.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.116+0000 7f53eac5d640 1 -- 172.21.15.17:0/404490168 >> 172.21.15.17:0/404490168 conn(0x7f53e40fd110 msgr2=0x7f53e4106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:56.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.116+0000 7f53eac5d640 1 -- 172.21.15.17:0/404490168 shutdown_connections 2024-09-20T18:28:56.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.116+0000 7f53eac5d640 1 -- 172.21.15.17:0/404490168 wait complete. 2024-09-20T18:28:56.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.606+0000 7fbbb645f640 1 -- 172.21.15.17:0/395474007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb0101990 msgr2=0x7fbbb0101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.606+0000 7fbbb645f640 1 --2- 172.21.15.17:0/395474007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb0101990 0x7fbbb0101d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009880 tx=0x7fbba002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:28:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.606+0000 7fbbb645f640 1 -- 172.21.15.17:0/395474007 shutdown_connections 2024-09-20T18:28:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.606+0000 7fbbb645f640 1 --2- 172.21.15.17:0/395474007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0102b90 0x7fbbb0103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.606+0000 7fbbb645f640 1 --2- 172.21.15.17:0/395474007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb0101990 0x7fbbb0101d90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.606+0000 7fbbb645f640 1 -- 172.21.15.17:0/395474007 >> 172.21.15.17:0/395474007 conn(0x7fbbb00fd140 msgr2=0x7fbbb00ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.606+0000 7fbbb645f640 1 -- 172.21.15.17:0/395474007 shutdown_connections 2024-09-20T18:28:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.606+0000 7fbbb645f640 1 -- 172.21.15.17:0/395474007 wait complete. 2024-09-20T18:28:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.606+0000 7fbbb645f640 1 Processor -- start 2024-09-20T18:28:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.606+0000 7fbbb645f640 1 -- start start 2024-09-20T18:28:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.607+0000 7fbbb645f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0101990 0x7fbbb0199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.607+0000 7fbbb645f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb0102b90 0x7fbbb0199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.607+0000 7fbbb645f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb010a7b0 con 0x7fbbb0102b90 2024-09-20T18:28:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.607+0000 7fbbb645f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb010a630 con 0x7fbbb0101990 2024-09-20T18:28:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.607+0000 7fbbaf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb0102b90 0x7fbbb0199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:56.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.607+0000 7fbbaf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb0102b90 0x7fbbb0199c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34524/0 (socket says 172.21.15.17:34524) 2024-09-20T18:28:56.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.607+0000 7fbbaf7fe640 1 -- 172.21.15.17:0/2969552707 learned_addr learned my addr 172.21.15.17:0/2969552707 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:28:56.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.607+0000 7fbbaffff640 1 --2- 172.21.15.17:0/2969552707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0101990 0x7fbbb0199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:56.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.607+0000 7fbbaf7fe640 1 -- 172.21.15.17:0/2969552707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0101990 msgr2=0x7fbbb0199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:56.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.607+0000 7fbbaf7fe640 1 --2- 172.21.15.17:0/2969552707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0101990 0x7fbbb0199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:56.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.607+0000 7fbbaf7fe640 1 -- 172.21.15.17:0/2969552707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb019a230 con 0x7fbbb0102b90 2024-09-20T18:28:56.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.607+0000 7fbbaf7fe640 1 --2- 172.21.15.17:0/2969552707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb0102b90 0x7fbbb0199c40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbba400c8a0 tx=0x7fbba400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:56.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.607+0000 7fbbad7fa640 1 -- 172.21.15.17:0/2969552707 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbba40079b0 con 0x7fbbb0102b90 2024-09-20T18:28:56.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.607+0000 7fbbad7fa640 1 -- 172.21.15.17:0/2969552707 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbba4007b50 con 0x7fbbb0102b90 2024-09-20T18:28:56.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.607+0000 7fbbb645f640 1 -- 172.21.15.17:0/2969552707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb019eca0 con 0x7fbbb0102b90 2024-09-20T18:28:56.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.607+0000 7fbbad7fa640 1 -- 172.21.15.17:0/2969552707 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbba4018700 con 0x7fbbb0102b90 2024-09-20T18:28:56.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.607+0000 7fbbb645f640 1 -- 172.21.15.17:0/2969552707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb019f200 con 0x7fbbb0102b90 2024-09-20T18:28:56.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.608+0000 7fbbb645f640 1 -- 172.21.15.17:0/2969552707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb0101d90 con 0x7fbbb0102b90 2024-09-20T18:28:56.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.609+0000 7fbbad7fa640 1 -- 172.21.15.17:0/2969552707 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fbba4007d00 con 0x7fbbb0102b90 2024-09-20T18:28:56.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.609+0000 7fbbad7fa640 1 --2- 172.21.15.17:0/2969552707 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fbb9806e2d0 0x7fbb98070790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:56.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.609+0000 7fbbad7fa640 1 -- 172.21.15.17:0/2969552707 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fbba408d2f0 con 0x7fbbb0102b90 2024-09-20T18:28:56.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.609+0000 7fbbaffff640 1 --2- 172.21.15.17:0/2969552707 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fbb9806e2d0 0x7fbb98070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:56.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.610+0000 7fbbaffff640 1 --2- 172.21.15.17:0/2969552707 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fbb9806e2d0 0x7fbb98070790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbba0006010 tx=0x7fbba0000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:56.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.614+0000 7fbbad7fa640 1 -- 172.21.15.17:0/2969552707 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbba4014030 con 0x7fbbb0102b90 2024-09-20T18:28:56.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.793+0000 7fbbb645f640 1 -- 172.21.15.17:0/2969552707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fbbb0106be0 con 0x7fbbb0102b90 2024-09-20T18:28:56.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.797+0000 7fbbad7fa640 1 -- 172.21.15.17:0/2969552707 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v24)=0 v24) ==== 120+0+0 (secure 0 0 0) 0x7fbba4016300 con 0x7fbbb0102b90 2024-09-20T18:28:56.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.799+0000 7fbbb645f640 1 -- 172.21.15.17:0/2969552707 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fbb9806e2d0 msgr2=0x7fbb98070790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:56.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.799+0000 7fbbb645f640 1 --2- 172.21.15.17:0/2969552707 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fbb9806e2d0 0x7fbb98070790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbba0006010 tx=0x7fbba0000bc0 comp rx=0 tx=0).stop 2024-09-20T18:28:56.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.799+0000 7fbbb645f640 1 -- 172.21.15.17:0/2969552707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb0102b90 msgr2=0x7fbbb0199c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:56.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.799+0000 7fbbb645f640 1 --2- 172.21.15.17:0/2969552707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb0102b90 0x7fbbb0199c40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbba400c8a0 tx=0x7fbba400cd60 comp rx=0 tx=0).stop 2024-09-20T18:28:56.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.799+0000 7fbbb645f640 1 -- 172.21.15.17:0/2969552707 shutdown_connections 2024-09-20T18:28:56.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.799+0000 7fbbb645f640 1 --2- 172.21.15.17:0/2969552707 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fbb9806e2d0 0x7fbb98070790 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:56.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.799+0000 7fbbb645f640 1 --2- 172.21.15.17:0/2969552707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb0102b90 0x7fbbb0199c40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:56.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.799+0000 7fbbb645f640 1 --2- 172.21.15.17:0/2969552707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0101990 0x7fbbb0199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:56.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.799+0000 7fbbb645f640 1 -- 172.21.15.17:0/2969552707 >> 172.21.15.17:0/2969552707 conn(0x7fbbb00fd140 msgr2=0x7fbbb0103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:56.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.799+0000 7fbbb645f640 1 -- 172.21.15.17:0/2969552707 shutdown_connections 2024-09-20T18:28:56.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:56.800+0000 7fbbb645f640 1 -- 172.21.15.17:0/2969552707 wait complete. 2024-09-20T18:28:57.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:57 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/404490168' entity='client.admin' 2024-09-20T18:28:57.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:57 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2969552707' entity='client.admin' 2024-09-20T18:28:57.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:57 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/404490168' entity='client.admin' 2024-09-20T18:28:57.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:57 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/2969552707' entity='client.admin' 2024-09-20T18:28:57.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.459+0000 7f58cf544640 1 -- 172.21.15.17:0/1608904261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58c8100b20 msgr2=0x7f58c8100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:57.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.459+0000 7f58cf544640 1 --2- 172.21.15.17:0/1608904261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58c8100b20 0x7f58c8100f80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009880 tx=0x7f58bc02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:28:57.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.459+0000 7f58cf544640 1 -- 172.21.15.17:0/1608904261 shutdown_connections 2024-09-20T18:28:57.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.459+0000 7f58cf544640 1 --2- 172.21.15.17:0/1608904261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58c8100b20 0x7f58c8100f80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:57.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.459+0000 7f58cf544640 1 --2- 172.21.15.17:0/1608904261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58c81001e0 0x7f58c81005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:57.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.459+0000 7f58cf544640 1 -- 172.21.15.17:0/1608904261 >> 172.21.15.17:0/1608904261 conn(0x7f58c80fc010 msgr2=0x7f58c80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:57.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.459+0000 7f58cf544640 1 -- 172.21.15.17:0/1608904261 shutdown_connections 2024-09-20T18:28:57.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.459+0000 7f58cf544640 1 -- 172.21.15.17:0/1608904261 wait complete. 2024-09-20T18:28:57.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.459+0000 7f58cf544640 1 Processor -- start 2024-09-20T18:28:57.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.459+0000 7f58cf544640 1 -- start start 2024-09-20T18:28:57.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.460+0000 7f58cf544640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58c81001e0 0x7f58c8199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:57.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.460+0000 7f58cf544640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58c8100b20 0x7f58c8199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:57.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.460+0000 7f58cf544640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f58c810c970 con 0x7f58c8100b20 2024-09-20T18:28:57.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.460+0000 7f58cf544640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f58c810c7f0 con 0x7f58c81001e0 2024-09-20T18:28:57.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.460+0000 7f58ccadf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58c8100b20 0x7f58c8199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:57.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.460+0000 7f58ccadf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58c8100b20 0x7f58c8199bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34536/0 (socket says 172.21.15.17:34536) 2024-09-20T18:28:57.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.460+0000 7f58ccadf640 1 -- 172.21.15.17:0/2056889078 learned_addr learned my addr 172.21.15.17:0/2056889078 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:28:57.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.460+0000 7f58cd2e0640 1 --2- 172.21.15.17:0/2056889078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58c81001e0 0x7f58c8199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:57.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.460+0000 7f58ccadf640 1 -- 172.21.15.17:0/2056889078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58c81001e0 msgr2=0x7f58c8199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:57.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.460+0000 7f58ccadf640 1 --2- 172.21.15.17:0/2056889078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58c81001e0 0x7f58c8199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:57.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.460+0000 7f58ccadf640 1 -- 172.21.15.17:0/2056889078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c819a1b0 con 0x7f58c8100b20 2024-09-20T18:28:57.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.460+0000 7f58ccadf640 1 --2- 172.21.15.17:0/2056889078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58c8100b20 0x7f58c8199bc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f58bc006010 tx=0x7f58bc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:57.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.460+0000 7f58c67fc640 1 -- 172.21.15.17:0/2056889078 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58bc03f070 con 0x7f58c8100b20 2024-09-20T18:28:57.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.460+0000 7f58c67fc640 1 -- 172.21.15.17:0/2056889078 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f58bc0044d0 con 0x7f58c8100b20 2024-09-20T18:28:57.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.460+0000 7f58cf544640 1 -- 172.21.15.17:0/2056889078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c819ebc0 con 0x7f58c8100b20 2024-09-20T18:28:57.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.460+0000 7f58c67fc640 1 -- 172.21.15.17:0/2056889078 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58bc035030 con 0x7f58c8100b20 2024-09-20T18:28:57.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.461+0000 7f58cf544640 1 -- 172.21.15.17:0/2056889078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c819f0c0 con 0x7f58c8100b20 2024-09-20T18:28:57.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.462+0000 7f58cf544640 1 -- 172.21.15.17:0/2056889078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c81005e0 con 0x7f58c8100b20 2024-09-20T18:28:57.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.462+0000 7f58c67fc640 1 -- 172.21.15.17:0/2056889078 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f58bc042070 con 0x7f58c8100b20 2024-09-20T18:28:57.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.463+0000 7f58c67fc640 1 --2- 172.21.15.17:0/2056889078 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f58b006e2d0 0x7f58b0070790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:57.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.463+0000 7f58c67fc640 1 -- 172.21.15.17:0/2056889078 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f58bc0adcd0 con 0x7f58c8100b20 2024-09-20T18:28:57.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.463+0000 7f58cd2e0640 1 --2- 172.21.15.17:0/2056889078 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f58b006e2d0 0x7f58b0070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:57.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.463+0000 7f58cd2e0640 1 --2- 172.21.15.17:0/2056889078 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f58b006e2d0 0x7f58b0070790 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f58c000abe0 tx=0x7f58c000a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:57.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.467+0000 7f58c67fc640 1 -- 172.21.15.17:0/2056889078 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f58bc07c6f0 con 0x7f58c8100b20 2024-09-20T18:28:57.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.648+0000 7f58cf544640 1 -- 172.21.15.17:0/2056889078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f58c8193780 con 0x7f58c8100b20 2024-09-20T18:28:57.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.652+0000 7f58c67fc640 1 -- 172.21.15.17:0/2056889078 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v25)=0 v25) ==== 108+0+0 (secure 0 0 0) 0x7f58bc0803a0 con 0x7f58c8100b20 2024-09-20T18:28:57.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.654+0000 7f58cf544640 1 -- 172.21.15.17:0/2056889078 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f58b006e2d0 msgr2=0x7f58b0070790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:57.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.654+0000 7f58cf544640 1 --2- 172.21.15.17:0/2056889078 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f58b006e2d0 0x7f58b0070790 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f58c000abe0 tx=0x7f58c000a2d0 comp rx=0 tx=0).stop 2024-09-20T18:28:57.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.654+0000 7f58cf544640 1 -- 172.21.15.17:0/2056889078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58c8100b20 msgr2=0x7f58c8199bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:57.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.654+0000 7f58cf544640 1 --2- 172.21.15.17:0/2056889078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58c8100b20 0x7f58c8199bc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f58bc006010 tx=0x7f58bc0048f0 comp rx=0 tx=0).stop 2024-09-20T18:28:57.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.654+0000 7f58cf544640 1 -- 172.21.15.17:0/2056889078 shutdown_connections 2024-09-20T18:28:57.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.654+0000 7f58cf544640 1 --2- 172.21.15.17:0/2056889078 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f58b006e2d0 0x7f58b0070790 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:57.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.654+0000 7f58cf544640 1 --2- 172.21.15.17:0/2056889078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58c8100b20 0x7f58c8199bc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:57.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.654+0000 7f58cf544640 1 --2- 172.21.15.17:0/2056889078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58c81001e0 0x7f58c8199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:57.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.654+0000 7f58cf544640 1 -- 172.21.15.17:0/2056889078 >> 172.21.15.17:0/2056889078 conn(0x7f58c80fc010 msgr2=0x7f58c8108a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:57.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.654+0000 7f58cf544640 1 -- 172.21.15.17:0/2056889078 shutdown_connections 2024-09-20T18:28:57.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:57.654+0000 7f58cf544640 1 -- 172.21.15.17:0/2056889078 wait complete. 2024-09-20T18:28:58.372 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:58 smithi017 ceph-mon[28058]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:58.373 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:58 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2056889078' entity='client.admin' 2024-09-20T18:28:58.373 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:58 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:58.373 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:58 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:58.373 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:58 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi017", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-20T18:28:58.373 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:58 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:58.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:58 smithi172 ceph-mon[35456]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:28:58.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:58 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/2056889078' entity='client.admin' 2024-09-20T18:28:58.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:58 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:58.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:58 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:28:58.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:58 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi017", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-20T18:28:58.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:58 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:28:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.142+0000 7f80d9a04640 1 -- 172.21.15.17:0/486851235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80d41006a0 msgr2=0x7f80d4100aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.142+0000 7f80d9a04640 1 --2- 172.21.15.17:0/486851235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80d41006a0 0x7f80d4100aa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009880 tx=0x7f80c402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:28:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.143+0000 7f80d9a04640 1 -- 172.21.15.17:0/486851235 shutdown_connections 2024-09-20T18:28:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.143+0000 7f80d9a04640 1 --2- 172.21.15.17:0/486851235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80d41018a0 0x7f80d4101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.143+0000 7f80d9a04640 1 --2- 172.21.15.17:0/486851235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80d41006a0 0x7f80d4100aa0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.143+0000 7f80d9a04640 1 -- 172.21.15.17:0/486851235 >> 172.21.15.17:0/486851235 conn(0x7f80d40fbe50 msgr2=0x7f80d40fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.143+0000 7f80d9a04640 1 -- 172.21.15.17:0/486851235 shutdown_connections 2024-09-20T18:28:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.143+0000 7f80d9a04640 1 -- 172.21.15.17:0/486851235 wait complete. 2024-09-20T18:28:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.143+0000 7f80d9a04640 1 Processor -- start 2024-09-20T18:28:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.143+0000 7f80d9a04640 1 -- start start 2024-09-20T18:28:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.144+0000 7f80d9a04640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80d41006a0 0x7f80d41045c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.144+0000 7f80d9a04640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80d41018a0 0x7f80d4102c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.144+0000 7f80d9a04640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f80d41094c0 con 0x7f80d41006a0 2024-09-20T18:28:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.144+0000 7f80d9a04640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f80d4109340 con 0x7f80d41018a0 2024-09-20T18:28:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.144+0000 7f80d2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80d41006a0 0x7f80d41045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.144+0000 7f80d2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80d41006a0 0x7f80d41045c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34542/0 (socket says 172.21.15.17:34542) 2024-09-20T18:28:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.144+0000 7f80d2ffd640 1 -- 172.21.15.17:0/4228149532 learned_addr learned my addr 172.21.15.17:0/4228149532 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:28:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.144+0000 7f80ca7fc640 1 --2- 172.21.15.17:0/4228149532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80d41018a0 0x7f80d4102c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.144+0000 7f80d2ffd640 1 -- 172.21.15.17:0/4228149532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80d41018a0 msgr2=0x7f80d4102c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.144+0000 7f80d2ffd640 1 --2- 172.21.15.17:0/4228149532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80d41018a0 0x7f80d4102c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.144+0000 7f80d2ffd640 1 -- 172.21.15.17:0/4228149532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d41031c0 con 0x7f80d41006a0 2024-09-20T18:28:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.144+0000 7f80d2ffd640 1 --2- 172.21.15.17:0/4228149532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80d41006a0 0x7f80d41045c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f80c4006010 tx=0x7f80c40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.145+0000 7f80d8a02640 1 -- 172.21.15.17:0/4228149532 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80c403f070 con 0x7f80d41006a0 2024-09-20T18:28:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.145+0000 7f80d8a02640 1 -- 172.21.15.17:0/4228149532 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f80c4004a50 con 0x7f80d41006a0 2024-09-20T18:28:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.145+0000 7f80d8a02640 1 -- 172.21.15.17:0/4228149532 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80c4035030 con 0x7f80d41006a0 2024-09-20T18:28:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.145+0000 7f80d9a04640 1 -- 172.21.15.17:0/4228149532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80d4103450 con 0x7f80d41006a0 2024-09-20T18:28:59.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.145+0000 7f80d9a04640 1 -- 172.21.15.17:0/4228149532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80d4103980 con 0x7f80d41006a0 2024-09-20T18:28:59.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.146+0000 7f80d9a04640 1 -- 172.21.15.17:0/4228149532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80d4100aa0 con 0x7f80d41006a0 2024-09-20T18:28:59.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.147+0000 7f80d8a02640 1 -- 172.21.15.17:0/4228149532 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f80c4042070 con 0x7f80d41006a0 2024-09-20T18:28:59.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.147+0000 7f80d8a02640 1 --2- 172.21.15.17:0/4228149532 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f80c006e230 0x7f80c00706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:59.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.148+0000 7f80d8a02640 1 -- 172.21.15.17:0/4228149532 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f80c40adb50 con 0x7f80d41006a0 2024-09-20T18:28:59.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.148+0000 7f80ca7fc640 1 --2- 172.21.15.17:0/4228149532 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f80c006e230 0x7f80c00706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:59.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.148+0000 7f80ca7fc640 1 --2- 172.21.15.17:0/4228149532 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f80c006e230 0x7f80c00706f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f80d4104340 tx=0x7f80bc00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:59.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.152+0000 7f80d8a02640 1 -- 172.21.15.17:0/4228149532 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f80c4004c00 con 0x7f80d41006a0 2024-09-20T18:28:59.289 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:59 smithi017 ceph-mon[28058]: Reconfiguring crash.smithi017 (monmap changed)... 2024-09-20T18:28:59.289 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:28:59 smithi017 ceph-mon[28058]: Reconfiguring daemon crash.smithi017 on smithi017 2024-09-20T18:28:59.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.349+0000 7f80d9a04640 1 -- 172.21.15.17:0/4228149532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f80d419f360 con 0x7f80d41006a0 2024-09-20T18:28:59.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.352+0000 7f80d8a02640 1 -- 172.21.15.17:0/4228149532 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v26)=0 v26) ==== 121+0+0 (secure 0 0 0) 0x7f80c4080240 con 0x7f80d41006a0 2024-09-20T18:28:59.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.355+0000 7f80d9a04640 1 -- 172.21.15.17:0/4228149532 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f80c006e230 msgr2=0x7f80c00706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:59.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.355+0000 7f80d9a04640 1 --2- 172.21.15.17:0/4228149532 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f80c006e230 0x7f80c00706f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f80d4104340 tx=0x7f80bc00b390 comp rx=0 tx=0).stop 2024-09-20T18:28:59.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.355+0000 7f80d9a04640 1 -- 172.21.15.17:0/4228149532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80d41006a0 msgr2=0x7f80d41045c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:59.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.355+0000 7f80d9a04640 1 --2- 172.21.15.17:0/4228149532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80d41006a0 0x7f80d41045c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f80c4006010 tx=0x7f80c40045e0 comp rx=0 tx=0).stop 2024-09-20T18:28:59.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.355+0000 7f80d9a04640 1 -- 172.21.15.17:0/4228149532 shutdown_connections 2024-09-20T18:28:59.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.355+0000 7f80d9a04640 1 --2- 172.21.15.17:0/4228149532 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f80c006e230 0x7f80c00706f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:59.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.355+0000 7f80d9a04640 1 --2- 172.21.15.17:0/4228149532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80d41018a0 0x7f80d4102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:59.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.355+0000 7f80d9a04640 1 --2- 172.21.15.17:0/4228149532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80d41006a0 0x7f80d41045c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:59.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.355+0000 7f80d9a04640 1 -- 172.21.15.17:0/4228149532 >> 172.21.15.17:0/4228149532 conn(0x7f80d40fbe50 msgr2=0x7f80d4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:59.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.355+0000 7f80d9a04640 1 -- 172.21.15.17:0/4228149532 shutdown_connections 2024-09-20T18:28:59.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.355+0000 7f80d9a04640 1 -- 172.21.15.17:0/4228149532 wait complete. 2024-09-20T18:28:59.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:59 smithi172 ceph-mon[35456]: Reconfiguring crash.smithi017 (monmap changed)... 2024-09-20T18:28:59.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:28:59 smithi172 ceph-mon[35456]: Reconfiguring daemon crash.smithi017 on smithi017 2024-09-20T18:28:59.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.515+0000 7f152aacd640 1 -- 172.21.15.17:0/3930025901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1524101a60 msgr2=0x7f1524101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:59.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.515+0000 7f152aacd640 1 --2- 172.21.15.17:0/3930025901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1524101a60 0x7f1524101ee0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1510009880 tx=0x7f151002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:28:59.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.515+0000 7f152aacd640 1 -- 172.21.15.17:0/3930025901 shutdown_connections 2024-09-20T18:28:59.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.515+0000 7f152aacd640 1 --2- 172.21.15.17:0/3930025901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1524101a60 0x7f1524101ee0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:59.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.515+0000 7f152aacd640 1 --2- 172.21.15.17:0/3930025901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1524100860 0x7f1524100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:59.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.515+0000 7f152aacd640 1 -- 172.21.15.17:0/3930025901 >> 172.21.15.17:0/3930025901 conn(0x7f15240fc010 msgr2=0x7f15240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:59.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.515+0000 7f152aacd640 1 -- 172.21.15.17:0/3930025901 shutdown_connections 2024-09-20T18:28:59.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.515+0000 7f152aacd640 1 -- 172.21.15.17:0/3930025901 wait complete. 2024-09-20T18:28:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.516+0000 7f152aacd640 1 Processor -- start 2024-09-20T18:28:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.516+0000 7f152aacd640 1 -- start start 2024-09-20T18:28:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.516+0000 7f152aacd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1524100860 0x7f152406aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.516+0000 7f152aacd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1524101a60 0x7f152419c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.516+0000 7f152aacd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1524109680 con 0x7f1524100860 2024-09-20T18:28:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.516+0000 7f152aacd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1524109500 con 0x7f1524101a60 2024-09-20T18:28:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.516+0000 7f1528869640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1524100860 0x7f152406aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.516+0000 7f1528869640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1524100860 0x7f152406aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34550/0 (socket says 172.21.15.17:34550) 2024-09-20T18:28:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.516+0000 7f1528869640 1 -- 172.21.15.17:0/221131339 learned_addr learned my addr 172.21.15.17:0/221131339 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:28:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.517+0000 7f1523fff640 1 --2- 172.21.15.17:0/221131339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1524101a60 0x7f152419c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.517+0000 7f1528869640 1 -- 172.21.15.17:0/221131339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1524101a60 msgr2=0x7f152419c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.517+0000 7f1528869640 1 --2- 172.21.15.17:0/221131339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1524101a60 0x7f152419c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.517+0000 7f1528869640 1 -- 172.21.15.17:0/221131339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152419c740 con 0x7f1524100860 2024-09-20T18:28:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.517+0000 7f1528869640 1 --2- 172.21.15.17:0/221131339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1524100860 0x7f152406aca0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f151800c920 tx=0x7f151800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.517+0000 7f1521ffb640 1 -- 172.21.15.17:0/221131339 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1518007a10 con 0x7f1524100860 2024-09-20T18:28:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.517+0000 7f1521ffb640 1 -- 172.21.15.17:0/221131339 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1518007bb0 con 0x7f1524100860 2024-09-20T18:28:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.517+0000 7f152aacd640 1 -- 172.21.15.17:0/221131339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f152419ca30 con 0x7f1524100860 2024-09-20T18:28:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.517+0000 7f1521ffb640 1 -- 172.21.15.17:0/221131339 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f151800f450 con 0x7f1524100860 2024-09-20T18:28:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.517+0000 7f152aacd640 1 -- 172.21.15.17:0/221131339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f152419cfc0 con 0x7f1524100860 2024-09-20T18:28:59.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.518+0000 7f152aacd640 1 -- 172.21.15.17:0/221131339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1524100c60 con 0x7f1524100860 2024-09-20T18:28:59.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.519+0000 7f1521ffb640 1 -- 172.21.15.17:0/221131339 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f1518003ea0 con 0x7f1524100860 2024-09-20T18:28:59.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.519+0000 7f1521ffb640 1 --2- 172.21.15.17:0/221131339 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f151406e280 0x7f1514070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:28:59.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.519+0000 7f1521ffb640 1 -- 172.21.15.17:0/221131339 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f151808d080 con 0x7f1524100860 2024-09-20T18:28:59.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.519+0000 7f1523fff640 1 --2- 172.21.15.17:0/221131339 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f151406e280 0x7f1514070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:28:59.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.520+0000 7f1523fff640 1 --2- 172.21.15.17:0/221131339 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f151406e280 0x7f1514070740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f152406aa20 tx=0x7f1510005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:28:59.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.523+0000 7f1521ffb640 1 -- 172.21.15.17:0/221131339 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f151805bb40 con 0x7f1524100860 2024-09-20T18:28:59.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.701+0000 7f152aacd640 1 -- 172.21.15.17:0/221131339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f1524190490 con 0x7f1524100860 2024-09-20T18:28:59.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.705+0000 7f1521ffb640 1 -- 172.21.15.17:0/221131339 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v27)=0 v27) ==== 117+0+0 (secure 0 0 0) 0x7f151805f7f0 con 0x7f1524100860 2024-09-20T18:28:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.707+0000 7f152aacd640 1 -- 172.21.15.17:0/221131339 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f151406e280 msgr2=0x7f1514070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.707+0000 7f152aacd640 1 --2- 172.21.15.17:0/221131339 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f151406e280 0x7f1514070740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f152406aa20 tx=0x7f1510005a20 comp rx=0 tx=0).stop 2024-09-20T18:28:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.707+0000 7f152aacd640 1 -- 172.21.15.17:0/221131339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1524100860 msgr2=0x7f152406aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:28:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.707+0000 7f152aacd640 1 --2- 172.21.15.17:0/221131339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1524100860 0x7f152406aca0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f151800c920 tx=0x7f151800cde0 comp rx=0 tx=0).stop 2024-09-20T18:28:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.707+0000 7f152aacd640 1 -- 172.21.15.17:0/221131339 shutdown_connections 2024-09-20T18:28:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.707+0000 7f152aacd640 1 --2- 172.21.15.17:0/221131339 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f151406e280 0x7f1514070740 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.707+0000 7f152aacd640 1 --2- 172.21.15.17:0/221131339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1524101a60 0x7f152419c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.707+0000 7f152aacd640 1 --2- 172.21.15.17:0/221131339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1524100860 0x7f152406aca0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:28:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.707+0000 7f152aacd640 1 -- 172.21.15.17:0/221131339 >> 172.21.15.17:0/221131339 conn(0x7f15240fc010 msgr2=0x7f1524104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:28:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.707+0000 7f152aacd640 1 -- 172.21.15.17:0/221131339 shutdown_connections 2024-09-20T18:28:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:28:59.707+0000 7f152aacd640 1 -- 172.21.15.17:0/221131339 wait complete. 2024-09-20T18:28:59.925 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi017') 2024-09-20T18:29:00.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:00 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/4228149532' entity='client.admin' 2024-09-20T18:29:00.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:00 smithi172 ceph-mon[35456]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:00.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:00 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/221131339' entity='client.admin' 2024-09-20T18:29:00.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.599+0000 7f8be6e22640 1 -- 172.21.15.17:0/2139337815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8be0101960 msgr2=0x7f8be0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:29:00.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.599+0000 7f8be6e22640 1 --2- 172.21.15.17:0/2139337815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8be0101960 0x7f8be0101d60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009880 tx=0x7f8bc802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:29:00.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.600+0000 7f8be6e22640 1 -- 172.21.15.17:0/2139337815 shutdown_connections 2024-09-20T18:29:00.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.600+0000 7f8be6e22640 1 --2- 172.21.15.17:0/2139337815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be0102b60 0x7f8be0102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:29:00.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.600+0000 7f8be6e22640 1 --2- 172.21.15.17:0/2139337815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8be0101960 0x7f8be0101d60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:29:00.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.600+0000 7f8be6e22640 1 -- 172.21.15.17:0/2139337815 >> 172.21.15.17:0/2139337815 conn(0x7f8be00fd0d0 msgr2=0x7f8be00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:29:00.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.600+0000 7f8be6e22640 1 -- 172.21.15.17:0/2139337815 shutdown_connections 2024-09-20T18:29:00.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.600+0000 7f8be6e22640 1 -- 172.21.15.17:0/2139337815 wait complete. 2024-09-20T18:29:00.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.600+0000 7f8be6e22640 1 Processor -- start 2024-09-20T18:29:00.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.600+0000 7f8be6e22640 1 -- start start 2024-09-20T18:29:00.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.601+0000 7f8be6e22640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be0101960 0x7f8be0197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:29:00.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.601+0000 7f8be6e22640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8be0102b60 0x7f8be0197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:29:00.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.601+0000 7f8be6e22640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8be010a800 con 0x7f8be0102b60 2024-09-20T18:29:00.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.601+0000 7f8be6e22640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8be010a680 con 0x7f8be0101960 2024-09-20T18:29:00.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.601+0000 7f8bdffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8be0102b60 0x7f8be0197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:29:00.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.601+0000 7f8bdffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8be0102b60 0x7f8be0197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48928/0 (socket says 172.21.15.17:48928) 2024-09-20T18:29:00.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.601+0000 7f8bdffff640 1 -- 172.21.15.17:0/1498634643 learned_addr learned my addr 172.21.15.17:0/1498634643 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:29:00.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.601+0000 7f8be4bbe640 1 --2- 172.21.15.17:0/1498634643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be0101960 0x7f8be0197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:29:00.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.601+0000 7f8bdffff640 1 -- 172.21.15.17:0/1498634643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be0101960 msgr2=0x7f8be0197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:29:00.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.601+0000 7f8bdffff640 1 --2- 172.21.15.17:0/1498634643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be0101960 0x7f8be0197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:29:00.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.601+0000 7f8bdffff640 1 -- 172.21.15.17:0/1498634643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be01980d0 con 0x7f8be0102b60 2024-09-20T18:29:00.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.601+0000 7f8be4bbe640 1 --2- 172.21.15.17:0/1498634643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be0101960 0x7f8be0197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:29:00.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.601+0000 7f8bdffff640 1 --2- 172.21.15.17:0/1498634643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8be0102b60 0x7f8be0197a50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000b420 tx=0x7f8bd000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:29:00.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.601+0000 7f8bddffb640 1 -- 172.21.15.17:0/1498634643 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8bd0011630 con 0x7f8be0102b60 2024-09-20T18:29:00.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.601+0000 7f8bddffb640 1 -- 172.21.15.17:0/1498634643 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8bd0016070 con 0x7f8be0102b60 2024-09-20T18:29:00.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.601+0000 7f8bddffb640 1 -- 172.21.15.17:0/1498634643 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8bd0010d40 con 0x7f8be0102b60 2024-09-20T18:29:00.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.601+0000 7f8be6e22640 1 -- 172.21.15.17:0/1498634643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be019cb10 con 0x7f8be0102b60 2024-09-20T18:29:00.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.602+0000 7f8be6e22640 1 -- 172.21.15.17:0/1498634643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be019d120 con 0x7f8be0102b60 2024-09-20T18:29:00.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.603+0000 7f8be6e22640 1 -- 172.21.15.17:0/1498634643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be0101d60 con 0x7f8be0102b60 2024-09-20T18:29:00.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.603+0000 7f8bddffb640 1 -- 172.21.15.17:0/1498634643 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f8bd001b460 con 0x7f8be0102b60 2024-09-20T18:29:00.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.604+0000 7f8bddffb640 1 --2- 172.21.15.17:0/1498634643 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8bcc06e280 0x7f8bcc070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:29:00.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.604+0000 7f8bddffb640 1 -- 172.21.15.17:0/1498634643 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8bd008c880 con 0x7f8be0102b60 2024-09-20T18:29:00.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.604+0000 7f8be4bbe640 1 --2- 172.21.15.17:0/1498634643 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8bcc06e280 0x7f8bcc070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:29:00.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.604+0000 7f8be4bbe640 1 --2- 172.21.15.17:0/1498634643 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8bcc06e280 0x7f8bcc070740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8000c00 tx=0x7f8bc8005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:29:00.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.608+0000 7f8bddffb640 1 -- 172.21.15.17:0/1498634643 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8bd005b340 con 0x7f8be0102b60 2024-09-20T18:29:00.622 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:00 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/4228149532' entity='client.admin' 2024-09-20T18:29:00.622 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:00 smithi017 ceph-mon[28058]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:00.622 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:00 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/221131339' entity='client.admin' 2024-09-20T18:29:00.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.786+0000 7f8be6e22640 1 -- 172.21.15.17:0/1498634643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f8be0062df0 con 0x7f8be0102b60 2024-09-20T18:29:00.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.790+0000 7f8bddffb640 1 -- 172.21.15.17:0/1498634643 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v28)=0 v28) ==== 119+0+0 (secure 0 0 0) 0x7f8bd005eff0 con 0x7f8be0102b60 2024-09-20T18:29:00.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.792+0000 7f8be6e22640 1 -- 172.21.15.17:0/1498634643 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8bcc06e280 msgr2=0x7f8bcc070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:29:00.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.792+0000 7f8be6e22640 1 --2- 172.21.15.17:0/1498634643 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8bcc06e280 0x7f8bcc070740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8000c00 tx=0x7f8bc8005a20 comp rx=0 tx=0).stop 2024-09-20T18:29:00.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.792+0000 7f8be6e22640 1 -- 172.21.15.17:0/1498634643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8be0102b60 msgr2=0x7f8be0197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:29:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.792+0000 7f8be6e22640 1 --2- 172.21.15.17:0/1498634643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8be0102b60 0x7f8be0197a50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000b420 tx=0x7f8bd000b8e0 comp rx=0 tx=0).stop 2024-09-20T18:29:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.792+0000 7f8be6e22640 1 -- 172.21.15.17:0/1498634643 shutdown_connections 2024-09-20T18:29:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.792+0000 7f8be6e22640 1 --2- 172.21.15.17:0/1498634643 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8bcc06e280 0x7f8bcc070740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:29:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.792+0000 7f8be6e22640 1 --2- 172.21.15.17:0/1498634643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8be0102b60 0x7f8be0197a50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:29:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.792+0000 7f8be6e22640 1 --2- 172.21.15.17:0/1498634643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be0101960 0x7f8be0197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:29:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.792+0000 7f8be6e22640 1 -- 172.21.15.17:0/1498634643 >> 172.21.15.17:0/1498634643 conn(0x7f8be00fd0d0 msgr2=0x7f8be0105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:29:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.792+0000 7f8be6e22640 1 -- 172.21.15.17:0/1498634643 shutdown_connections 2024-09-20T18:29:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:00.792+0000 7f8be6e22640 1 -- 172.21.15.17:0/1498634643 wait complete. 2024-09-20T18:29:01.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:01 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1498634643' entity='client.admin' 2024-09-20T18:29:01.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:01 smithi017 ceph-mon[28058]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:02.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:01 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/1498634643' entity='client.admin' 2024-09-20T18:29:02.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:01 smithi172 ceph-mon[35456]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:03.703 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi017') 2024-09-20T18:29:03.703 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi017') 2024-09-20T18:29:03.703 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi017') 2024-09-20T18:29:03.704 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi017') 2024-09-20T18:29:03.704 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi017') 2024-09-20T18:29:03.704 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi017') 2024-09-20T18:29:03.704 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi017') 2024-09-20T18:29:03.704 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi017') 2024-09-20T18:29:03.704 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi017') 2024-09-20T18:29:03.705 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi017') 2024-09-20T18:29:03.705 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7a27d282-777d-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi017') 2024-09-20T18:29:03.705 INFO:tasks.cephadm:Deploying OSDs... 2024-09-20T18:29:03.705 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T18:29:03.705 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2024-09-20T18:29:03.723 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-20T18:29:03.723 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2024-09-20T18:29:03.780 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-20T18:29:03.780 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T18:29:03.780 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-20T18:29:03.780 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:29:03.780 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T18:29:03.780 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-20 18:28:00.812013351 +0000 2024-09-20T18:29:03.781 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-20 18:21:06.444657081 +0000 2024-09-20T18:29:03.781 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-20 18:21:06.444657081 +0000 2024-09-20T18:29:03.781 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-20 18:21:06.444657081 +0000 2024-09-20T18:29:03.781 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-20T18:29:03.846 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-20T18:29:03.846 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-20T18:29:03.846 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 9.7568e-05 s, 5.2 MB/s 2024-09-20T18:29:03.847 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-20T18:29:03.905 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2024-09-20T18:29:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-20T18:29:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T18:29:03.961 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-20T18:29:03.961 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:29:03.961 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T18:29:03.961 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-20 18:28:00.813013340 +0000 2024-09-20T18:29:03.961 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-20 18:21:06.765653741 +0000 2024-09-20T18:29:03.961 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-20 18:21:06.765653741 +0000 2024-09-20T18:29:03.961 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-20 18:21:06.765653741 +0000 2024-09-20T18:29:03.962 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-20T18:29:04.025 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-20T18:29:04.026 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-20T18:29:04.026 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000105384 s, 4.9 MB/s 2024-09-20T18:29:04.027 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-20T18:29:04.084 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2024-09-20T18:29:04.140 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-20T18:29:04.140 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T18:29:04.140 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-20T18:29:04.140 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:29:04.140 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T18:29:04.140 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-20 18:28:00.813013340 +0000 2024-09-20T18:29:04.140 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-20 18:21:07.083650432 +0000 2024-09-20T18:29:04.141 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-20 18:21:07.083650432 +0000 2024-09-20T18:29:04.141 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-20 18:21:07.083650432 +0000 2024-09-20T18:29:04.141 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-20T18:29:04.207 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-20T18:29:04.207 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-20T18:29:04.208 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000106111 s, 4.8 MB/s 2024-09-20T18:29:04.209 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-20T18:29:04.266 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2024-09-20T18:29:04.322 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-20T18:29:04.322 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T18:29:04.323 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-20T18:29:04.323 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:29:04.323 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T18:29:04.323 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-20 18:28:00.813013340 +0000 2024-09-20T18:29:04.323 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-20 18:21:07.408647050 +0000 2024-09-20T18:29:04.323 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-20 18:21:07.408647050 +0000 2024-09-20T18:29:04.323 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-20 18:21:07.408647050 +0000 2024-09-20T18:29:04.323 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-20T18:29:04.324 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:04 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:04.324 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:04 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:04.324 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:04 smithi017 ceph-mon[28058]: Reconfiguring alertmanager.smithi017 (dependencies changed)... 2024-09-20T18:29:04.324 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:04 smithi017 ceph-mon[28058]: Reconfiguring daemon alertmanager.smithi017 on smithi017 2024-09-20T18:29:04.324 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:04 smithi017 ceph-mon[28058]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-20T18:29:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-20T18:29:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.00010645 s, 4.8 MB/s 2024-09-20T18:29:04.389 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-20T18:29:04.446 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-20T18:29:04.446 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-09-20T18:29:04.469 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-20T18:29:04.469 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-09-20T18:29:04.528 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-20T18:29:04.528 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T18:29:04.528 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-20T18:29:04.529 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:29:04.529 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T18:29:04.529 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-20 18:28:31.093018296 +0000 2024-09-20T18:29:04.529 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-20 18:21:06.447698560 +0000 2024-09-20T18:29:04.529 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-20 18:21:06.447698560 +0000 2024-09-20T18:29:04.529 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-20 18:21:06.447698560 +0000 2024-09-20T18:29:04.529 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-20T18:29:04.594 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:04 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:04.594 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:04 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:04.594 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:04 smithi172 ceph-mon[35456]: Reconfiguring alertmanager.smithi017 (dependencies changed)... 2024-09-20T18:29:04.595 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:04 smithi172 ceph-mon[35456]: Reconfiguring daemon alertmanager.smithi017 on smithi017 2024-09-20T18:29:04.595 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:04 smithi172 ceph-mon[35456]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:04.597 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-20T18:29:04.598 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-20T18:29:04.598 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000233242 s, 2.2 MB/s 2024-09-20T18:29:04.599 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-20T18:29:04.658 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-09-20T18:29:04.715 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-20T18:29:04.715 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T18:29:04.715 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-20T18:29:04.715 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:29:04.716 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T18:29:04.716 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-20 18:28:31.093018296 +0000 2024-09-20T18:29:04.716 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-20 18:21:06.798689968 +0000 2024-09-20T18:29:04.716 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-20 18:21:06.798689968 +0000 2024-09-20T18:29:04.716 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-20 18:21:06.798689968 +0000 2024-09-20T18:29:04.716 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-20T18:29:04.781 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-20T18:29:04.781 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-20T18:29:04.781 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000261115 s, 2.0 MB/s 2024-09-20T18:29:04.783 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-20T18:29:04.842 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-09-20T18:29:04.899 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-20T18:29:04.899 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T18:29:04.899 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-20T18:29:04.899 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:29:04.899 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T18:29:04.899 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-20 18:28:31.093018296 +0000 2024-09-20T18:29:04.900 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-20 18:21:07.130681840 +0000 2024-09-20T18:29:04.900 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-20 18:21:07.130681840 +0000 2024-09-20T18:29:04.900 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-20 18:21:07.130681840 +0000 2024-09-20T18:29:04.900 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-20T18:29:04.964 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-20T18:29:04.964 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-20T18:29:04.964 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000230916 s, 2.2 MB/s 2024-09-20T18:29:04.966 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-20T18:29:05.024 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-09-20T18:29:05.080 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-20T18:29:05.080 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-20T18:29:05.080 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-20T18:29:05.081 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:29:05.081 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-20T18:29:05.081 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-20 18:28:31.094018272 +0000 2024-09-20T18:29:05.081 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-20 18:21:07.451673981 +0000 2024-09-20T18:29:05.081 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-20 18:21:07.451673981 +0000 2024-09-20T18:29:05.081 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-20 18:21:07.451673981 +0000 2024-09-20T18:29:05.081 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-20T18:29:05.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-20T18:29:05.145 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-20T18:29:05.145 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.00026694 s, 1.9 MB/s 2024-09-20T18:29:05.146 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-20T18:29:05.203 INFO:tasks.cephadm:Deploying osd.0 on smithi017 with /dev/vg_nvme/lv_4... 2024-09-20T18:29:05.203 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-20T18:29:05.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:05 smithi017 ceph-mon[28058]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:05.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:05 smithi172 ceph-mon[35456]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:06.310 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:29:07.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:07 smithi017 ceph-mon[28058]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:07.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:07 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:29:07.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:07 smithi172 ceph-mon[35456]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:07.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:07 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:29:10.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:10 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:10.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:10 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:10.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:10 smithi172 ceph-mon[35456]: Reconfiguring grafana.smithi017 (dependencies changed)... 2024-09-20T18:29:10.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:10 smithi172 ceph-mon[35456]: Reconfiguring daemon grafana.smithi017 on smithi017 2024-09-20T18:29:10.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:10 smithi172 ceph-mon[35456]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:10.563 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:10 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:10.563 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:10 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:10.563 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:10 smithi017 ceph-mon[28058]: Reconfiguring grafana.smithi017 (dependencies changed)... 2024-09-20T18:29:10.563 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:10 smithi017 ceph-mon[28058]: Reconfiguring daemon grafana.smithi017 on smithi017 2024-09-20T18:29:10.563 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:10 smithi017 ceph-mon[28058]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:10.567 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:29:10.593 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi017:vg_nvme/lv_4 2024-09-20T18:29:11.829 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:11 smithi017 ceph-mon[28058]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:11.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:11 smithi172 ceph-mon[35456]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:12.399 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:29:13.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.150+0000 7f67677b9640 1 -- 172.21.15.17:0/3153269513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6760101960 msgr2=0x7f6760101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:29:13.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.150+0000 7f67677b9640 1 --2- 172.21.15.17:0/3153269513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6760101960 0x7f6760101d60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f675c009880 tx=0x7f675c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:29:13.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.151+0000 7f67677b9640 1 -- 172.21.15.17:0/3153269513 shutdown_connections 2024-09-20T18:29:13.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.151+0000 7f67677b9640 1 --2- 172.21.15.17:0/3153269513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6760102b60 0x7f6760102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:29:13.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.151+0000 7f67677b9640 1 --2- 172.21.15.17:0/3153269513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6760101960 0x7f6760101d60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:29:13.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.151+0000 7f67677b9640 1 -- 172.21.15.17:0/3153269513 >> 172.21.15.17:0/3153269513 conn(0x7f67600fd0f0 msgr2=0x7f67600ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:29:13.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.151+0000 7f67677b9640 1 -- 172.21.15.17:0/3153269513 shutdown_connections 2024-09-20T18:29:13.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.151+0000 7f67677b9640 1 -- 172.21.15.17:0/3153269513 wait complete. 2024-09-20T18:29:13.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.152+0000 7f67677b9640 1 Processor -- start 2024-09-20T18:29:13.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.152+0000 7f67677b9640 1 -- start start 2024-09-20T18:29:13.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.152+0000 7f67677b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6760101960 0x7f6760197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:29:13.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.152+0000 7f67677b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6760102b60 0x7f6760197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:29:13.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.152+0000 7f67677b9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f676010a800 con 0x7f6760101960 2024-09-20T18:29:13.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.152+0000 7f67677b9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f676010a680 con 0x7f6760102b60 2024-09-20T18:29:13.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.152+0000 7f6765555640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6760101960 0x7f6760197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:29:13.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.152+0000 7f6765555640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6760101960 0x7f6760197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50726/0 (socket says 172.21.15.17:50726) 2024-09-20T18:29:13.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.152+0000 7f6765555640 1 -- 172.21.15.17:0/3923302034 learned_addr learned my addr 172.21.15.17:0/3923302034 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:29:13.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.153+0000 7f6764d54640 1 --2- 172.21.15.17:0/3923302034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6760102b60 0x7f6760197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:29:13.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.153+0000 7f6765555640 1 -- 172.21.15.17:0/3923302034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6760102b60 msgr2=0x7f6760197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:29:13.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.153+0000 7f6765555640 1 --2- 172.21.15.17:0/3923302034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6760102b60 0x7f6760197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:29:13.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.153+0000 7f6765555640 1 -- 172.21.15.17:0/3923302034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67601980d0 con 0x7f6760101960 2024-09-20T18:29:13.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.153+0000 7f6764d54640 1 --2- 172.21.15.17:0/3923302034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6760102b60 0x7f6760197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:29:13.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.153+0000 7f6765555640 1 --2- 172.21.15.17:0/3923302034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6760101960 0x7f6760197510 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f675c006010 tx=0x7f675c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:29:13.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.153+0000 7f67567fc640 1 -- 172.21.15.17:0/3923302034 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f675c03f070 con 0x7f6760101960 2024-09-20T18:29:13.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.153+0000 7f67567fc640 1 -- 172.21.15.17:0/3923302034 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f675c0044d0 con 0x7f6760101960 2024-09-20T18:29:13.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.153+0000 7f67677b9640 1 -- 172.21.15.17:0/3923302034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676019cab0 con 0x7f6760101960 2024-09-20T18:29:13.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.153+0000 7f67567fc640 1 -- 172.21.15.17:0/3923302034 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f675c035030 con 0x7f6760101960 2024-09-20T18:29:13.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.153+0000 7f67677b9640 1 -- 172.21.15.17:0/3923302034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f676019d040 con 0x7f6760101960 2024-09-20T18:29:13.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.154+0000 7f67677b9640 1 -- 172.21.15.17:0/3923302034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6760101d60 con 0x7f6760101960 2024-09-20T18:29:13.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.155+0000 7f67567fc640 1 -- 172.21.15.17:0/3923302034 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f675c042070 con 0x7f6760101960 2024-09-20T18:29:13.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.156+0000 7f67567fc640 1 --2- 172.21.15.17:0/3923302034 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f674c06e280 0x7f674c070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:29:13.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.156+0000 7f6764d54640 1 --2- 172.21.15.17:0/3923302034 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f674c06e280 0x7f674c070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:29:13.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.156+0000 7f67567fc640 1 -- 172.21.15.17:0/3923302034 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f675c0adcd0 con 0x7f6760101960 2024-09-20T18:29:13.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.156+0000 7f6764d54640 1 --2- 172.21.15.17:0/3923302034 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f674c06e280 0x7f674c070740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f67601989c0 tx=0x7f6750008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:29:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.160+0000 7f67567fc640 1 -- 172.21.15.17:0/3923302034 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f675c07c6f0 con 0x7f6760101960 2024-09-20T18:29:13.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:13.360+0000 7f67677b9640 1 -- 172.21.15.17:0/3923302034 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f6760062630 con 0x7f674c06e280 2024-09-20T18:29:13.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:13 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T18:29:13.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:13 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T18:29:13.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:13 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:13.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:13 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T18:29:13.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:13 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T18:29:13.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:13 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:14.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:14 smithi017 ceph-mon[28058]: from='client.14330 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:29:14.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:14 smithi017 ceph-mon[28058]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:14.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:14 smithi172 ceph-mon[35456]: from='client.14330 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:29:14.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:14 smithi172 ceph-mon[35456]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:15.740 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:15 smithi017 ceph-mon[28058]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:15.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:15 smithi172 ceph-mon[35456]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:17.041 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:16 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:17.042 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:16 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:17.042 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:16 smithi017 ceph-mon[28058]: Reconfiguring prometheus.smithi017 (dependencies changed)... 2024-09-20T18:29:17.042 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:16 smithi017 ceph-mon[28058]: Reconfiguring daemon prometheus.smithi017 on smithi017 2024-09-20T18:29:17.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:16 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:17.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:16 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:17.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:16 smithi172 ceph-mon[35456]: Reconfiguring prometheus.smithi017 (dependencies changed)... 2024-09-20T18:29:17.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:16 smithi172 ceph-mon[35456]: Reconfiguring daemon prometheus.smithi017 on smithi017 2024-09-20T18:29:17.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:17 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/2170241286' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b3046c2d-32a3-4007-bf81-f0df8bc45e8e"}]: dispatch 2024-09-20T18:29:17.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:17 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/2170241286' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b3046c2d-32a3-4007-bf81-f0df8bc45e8e"}]': finished 2024-09-20T18:29:17.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:17 smithi172 ceph-mon[35456]: osdmap e6: 1 total, 0 up, 1 in 2024-09-20T18:29:17.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:17 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:29:17.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:17 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/1505566514' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T18:29:17.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:17 smithi172 ceph-mon[35456]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:18.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:17 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2170241286' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b3046c2d-32a3-4007-bf81-f0df8bc45e8e"}]: dispatch 2024-09-20T18:29:18.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:17 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2170241286' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b3046c2d-32a3-4007-bf81-f0df8bc45e8e"}]': finished 2024-09-20T18:29:18.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:17 smithi017 ceph-mon[28058]: osdmap e6: 1 total, 0 up, 1 in 2024-09-20T18:29:18.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:17 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:29:18.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:17 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1505566514' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T18:29:18.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:17 smithi017 ceph-mon[28058]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:19.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:19 smithi017 ceph-mon[28058]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:19.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:19 smithi172 ceph-mon[35456]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:21.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:21 smithi017 ceph-mon[28058]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:21.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:21 smithi172 ceph-mon[35456]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:22.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:22 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:29:22.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:22 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:29:23.708 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:23 smithi017 ceph-mon[28058]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:23.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:23 smithi172 ceph-mon[35456]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:25.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:25 smithi017 ceph-mon[28058]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:25.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:25 smithi172 ceph-mon[35456]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:27.824 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:27 smithi017 ceph-mon[28058]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:27.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:27 smithi172 ceph-mon[35456]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:29.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:28 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:29.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:28 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:29.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:28 smithi017 ceph-mon[28058]: Reconfiguring ceph-exporter.smithi172 (monmap changed)... 2024-09-20T18:29:29.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:28 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:29:29.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:28 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:29.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:28 smithi017 ceph-mon[28058]: Reconfiguring daemon ceph-exporter.smithi172 on smithi172 2024-09-20T18:29:29.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:28 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:29.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:28 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:29.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:28 smithi172 ceph-mon[35456]: Reconfiguring ceph-exporter.smithi172 (monmap changed)... 2024-09-20T18:29:29.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:28 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:29:29.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:28 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:29.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:28 smithi172 ceph-mon[35456]: Reconfiguring daemon ceph-exporter.smithi172 on smithi172 2024-09-20T18:29:29.974 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:29 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T18:29:29.974 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:29 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:29.974 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:29 smithi017 ceph-mon[28058]: Deploying daemon osd.0 on smithi017 2024-09-20T18:29:29.974 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:29 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:29.974 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:29 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:29.974 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:29 smithi017 ceph-mon[28058]: Reconfiguring crash.smithi172 (monmap changed)... 2024-09-20T18:29:29.974 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:29 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-20T18:29:29.974 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:29 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:29.974 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:29 smithi017 ceph-mon[28058]: Reconfiguring daemon crash.smithi172 on smithi172 2024-09-20T18:29:29.974 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:29 smithi017 ceph-mon[28058]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:30.018 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:29 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-20T18:29:30.018 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:29 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:30.018 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:29 smithi172 ceph-mon[35456]: Deploying daemon osd.0 on smithi017 2024-09-20T18:29:30.018 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:29 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:30.018 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:29 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:30.018 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:29 smithi172 ceph-mon[35456]: Reconfiguring crash.smithi172 (monmap changed)... 2024-09-20T18:29:30.018 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:29 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-20T18:29:30.018 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:29 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:30.018 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:29 smithi172 ceph-mon[35456]: Reconfiguring daemon crash.smithi172 on smithi172 2024-09-20T18:29:30.019 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:29 smithi172 ceph-mon[35456]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:31.846 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:31 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:31.847 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:31 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:31.847 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:31 smithi017 ceph-mon[28058]: Reconfiguring mgr.smithi172.jczphg (monmap changed)... 2024-09-20T18:29:31.847 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:31 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.jczphg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:29:31.847 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:31 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T18:29:31.847 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:31 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:31.847 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:31 smithi017 ceph-mon[28058]: Reconfiguring daemon mgr.smithi172.jczphg on smithi172 2024-09-20T18:29:31.847 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:31 smithi017 ceph-mon[28058]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:31.918 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:31 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:31.918 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:31 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:31.918 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:31 smithi172 ceph-mon[35456]: Reconfiguring mgr.smithi172.jczphg (monmap changed)... 2024-09-20T18:29:31.918 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:31 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.jczphg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:29:31.918 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:31 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T18:29:31.919 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:31 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:31.919 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:31 smithi172 ceph-mon[35456]: Reconfiguring daemon mgr.smithi172.jczphg on smithi172 2024-09-20T18:29:31.919 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:31 smithi172 ceph-mon[35456]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:33.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:32 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:33.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:32 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:33.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:32 smithi017 ceph-mon[28058]: Reconfiguring mon.smithi172 (monmap changed)... 2024-09-20T18:29:33.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:32 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T18:29:33.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:32 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T18:29:33.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:32 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:33.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:32 smithi017 ceph-mon[28058]: Reconfiguring daemon mon.smithi172 on smithi172 2024-09-20T18:29:33.266 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:33.267 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:33.267 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:32 smithi172 ceph-mon[35456]: Reconfiguring mon.smithi172 (monmap changed)... 2024-09-20T18:29:33.267 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T18:29:33.267 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T18:29:33.267 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:33.267 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:32 smithi172 ceph-mon[35456]: Reconfiguring daemon mon.smithi172 on smithi172 2024-09-20T18:29:34.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:34.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:34.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T18:29:34.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T18:29:34.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi017.front.sepia.ceph.com:9093"}]: dispatch 2024-09-20T18:29:34.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi017.front.sepia.ceph.com:9093"}]: dispatch 2024-09-20T18:29:34.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:34.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T18:29:34.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T18:29:34.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi017.front.sepia.ceph.com:3000"}]: dispatch 2024-09-20T18:29:34.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi017.front.sepia.ceph.com:3000"}]: dispatch 2024-09-20T18:29:34.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:34.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:29:34.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:29:34.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi017.front.sepia.ceph.com:9095"}]: dispatch 2024-09-20T18:29:34.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi017.front.sepia.ceph.com:9095"}]: dispatch 2024-09-20T18:29:34.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:34.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:29:34.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:34 smithi017 ceph-mon[28058]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:34.687 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:34.688 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:34.688 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T18:29:34.688 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T18:29:34.688 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi017.front.sepia.ceph.com:9093"}]: dispatch 2024-09-20T18:29:34.688 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi017.front.sepia.ceph.com:9093"}]: dispatch 2024-09-20T18:29:34.688 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:34.688 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T18:29:34.688 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T18:29:34.688 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi017.front.sepia.ceph.com:3000"}]: dispatch 2024-09-20T18:29:34.688 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi017.front.sepia.ceph.com:3000"}]: dispatch 2024-09-20T18:29:34.688 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:34.688 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:29:34.688 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:29:34.689 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi017.front.sepia.ceph.com:9095"}]: dispatch 2024-09-20T18:29:34.689 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi017.front.sepia.ceph.com:9095"}]: dispatch 2024-09-20T18:29:34.689 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:34.689 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:29:34.689 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:34 smithi172 ceph-mon[35456]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:36.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:36 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:36.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:36 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:36.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:36 smithi172 ceph-mon[35456]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:36.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:36 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:36.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:36 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:36.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:36 smithi017 ceph-mon[28058]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:37.724 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:37 smithi017 ceph-mon[28058]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:37.724 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:37 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:29:37.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:37 smithi172 ceph-mon[35456]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:37.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:37 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:29:39.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:39 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:39.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:39 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:39.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:39 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:39.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:39 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:39.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:39 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:39.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:39 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:29:39.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:39 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:39.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:39 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:29:39.700 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:39 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:39.700 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:39 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:39.700 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:39 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:39.700 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:39 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:39.700 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:39 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:39.700 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:39 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:29:39.700 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:39 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:39.700 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:39 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:29:40.262 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:40 smithi017 ceph-mon[28058]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:40.560 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:40 smithi172 ceph-mon[35456]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:42.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:41 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:42.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:41 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:42.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:41 smithi017 ceph-mon[28058]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:42.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:41 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:42.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:41 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:42.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:41 smithi172 ceph-mon[35456]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:42.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:42.214+0000 7f67567fc640 1 -- 172.21.15.17:0/3923302034 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6760062630 con 0x7f674c06e280 2024-09-20T18:29:42.229 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 0 on host 'smithi017' 2024-09-20T18:29:42.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:42.216+0000 7f67677b9640 1 -- 172.21.15.17:0/3923302034 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f674c06e280 msgr2=0x7f674c070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:29:42.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:42.216+0000 7f67677b9640 1 --2- 172.21.15.17:0/3923302034 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f674c06e280 0x7f674c070740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f67601989c0 tx=0x7f6750008040 comp rx=0 tx=0).stop 2024-09-20T18:29:42.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:42.216+0000 7f67677b9640 1 -- 172.21.15.17:0/3923302034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6760101960 msgr2=0x7f6760197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:29:42.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:42.216+0000 7f67677b9640 1 --2- 172.21.15.17:0/3923302034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6760101960 0x7f6760197510 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f675c006010 tx=0x7f675c0048f0 comp rx=0 tx=0).stop 2024-09-20T18:29:42.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:42.216+0000 7f67677b9640 1 -- 172.21.15.17:0/3923302034 shutdown_connections 2024-09-20T18:29:42.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:42.216+0000 7f67677b9640 1 --2- 172.21.15.17:0/3923302034 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f674c06e280 0x7f674c070740 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:29:42.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:42.216+0000 7f67677b9640 1 --2- 172.21.15.17:0/3923302034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6760102b60 0x7f6760197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:29:42.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:42.216+0000 7f67677b9640 1 --2- 172.21.15.17:0/3923302034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6760101960 0x7f6760197510 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:29:42.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:42.216+0000 7f67677b9640 1 -- 172.21.15.17:0/3923302034 >> 172.21.15.17:0/3923302034 conn(0x7f67600fd0f0 msgr2=0x7f6760105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:29:42.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:42.216+0000 7f67677b9640 1 -- 172.21.15.17:0/3923302034 shutdown_connections 2024-09-20T18:29:42.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:42.216+0000 7f67677b9640 1 -- 172.21.15.17:0/3923302034 wait complete. 2024-09-20T18:29:43.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:43 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:43.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:43 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:43.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:43 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:43.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:43 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:43.760 DEBUG:teuthology.orchestra.run.smithi017:osd.0> sudo journalctl -f -n 0 -u ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.0.service 2024-09-20T18:29:43.762 INFO:tasks.cephadm:Deploying osd.1 on smithi017 with /dev/vg_nvme/lv_3... 2024-09-20T18:29:43.763 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-20T18:29:44.473 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:29:44.824 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:29:44 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0[49249]: 2024-09-20T18:29:44.491+0000 7f06c572e640 -1 osd.0 0 log_to_monitors true 2024-09-20T18:29:45.493 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:45 smithi017 ceph-mon[28058]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:45.493 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:45 smithi017 ceph-mon[28058]: from='osd.0 [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T18:29:45.494 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:45 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:45.494 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:45 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:45.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:45 smithi172 ceph-mon[35456]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:45.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:45 smithi172 ceph-mon[35456]: from='osd.0 [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-20T18:29:45.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:45 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:45.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:45 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:46.577 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:46 smithi017 ceph-mon[28058]: from='osd.0 [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T18:29:46.577 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:46 smithi017 ceph-mon[28058]: osdmap e7: 1 total, 0 up, 1 in 2024-09-20T18:29:46.578 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:46 smithi017 ceph-mon[28058]: from='osd.0 [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-20T18:29:46.578 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:46 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:29:46.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:46 smithi172 ceph-mon[35456]: from='osd.0 [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T18:29:46.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:46 smithi172 ceph-mon[35456]: osdmap e7: 1 total, 0 up, 1 in 2024-09-20T18:29:46.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:46 smithi172 ceph-mon[35456]: from='osd.0 [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-20T18:29:46.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:46 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:29:47.149 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:29:47 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0[49249]: 2024-09-20T18:29:47.021+0000 7f06c0e8e640 -1 osd.0 0 waiting for initial osdmap 2024-09-20T18:29:47.149 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:29:47 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0[49249]: 2024-09-20T18:29:47.026+0000 7f06b94c0640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T18:29:47.506 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:47 smithi017 ceph-mon[28058]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:47.507 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:47 smithi017 ceph-mon[28058]: from='osd.0 [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-20T18:29:47.507 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:47 smithi017 ceph-mon[28058]: osdmap e8: 1 total, 0 up, 1 in 2024-09-20T18:29:47.507 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:47 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:29:47.507 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:47 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:29:47.507 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:47 smithi017 ceph-mon[28058]: from='osd.0 [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871]' entity='osd.0' 2024-09-20T18:29:47.607 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:47 smithi172 ceph-mon[35456]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:47.607 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:47 smithi172 ceph-mon[35456]: from='osd.0 [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-20T18:29:47.607 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:47 smithi172 ceph-mon[35456]: osdmap e8: 1 total, 0 up, 1 in 2024-09-20T18:29:47.607 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:47 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:29:47.607 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:47 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:29:47.607 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:47 smithi172 ceph-mon[35456]: from='osd.0 [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871]' entity='osd.0' 2024-09-20T18:29:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:29:48.084 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi017:vg_nvme/lv_3 2024-09-20T18:29:48.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:48 smithi017 ceph-mon[28058]: purged_snaps scrub starts 2024-09-20T18:29:48.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:48 smithi017 ceph-mon[28058]: purged_snaps scrub ok 2024-09-20T18:29:48.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:48 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:29:48.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:48 smithi017 ceph-mon[28058]: osd.0 [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871] boot 2024-09-20T18:29:48.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:48 smithi017 ceph-mon[28058]: osdmap e9: 1 total, 1 up, 1 in 2024-09-20T18:29:48.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:48 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:29:48.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:48 smithi172 ceph-mon[35456]: purged_snaps scrub starts 2024-09-20T18:29:48.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:48 smithi172 ceph-mon[35456]: purged_snaps scrub ok 2024-09-20T18:29:48.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:48 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:29:48.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:48 smithi172 ceph-mon[35456]: osd.0 [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871] boot 2024-09-20T18:29:48.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:48 smithi172 ceph-mon[35456]: osdmap e9: 1 total, 1 up, 1 in 2024-09-20T18:29:48.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:48 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:29:49.145 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:29:49.568 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:49 smithi017 ceph-mon[28058]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:49.610 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:49 smithi172 ceph-mon[35456]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-20T18:29:49.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.645+0000 7f3c1749e640 1 -- 172.21.15.17:0/579974723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c10102b70 msgr2=0x7f3c10102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:29:49.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.645+0000 7f3c1749e640 1 --2- 172.21.15.17:0/579974723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c10102b70 0x7f3c10102ff0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009880 tx=0x7f3c0002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:29:49.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.645+0000 7f3c1749e640 1 -- 172.21.15.17:0/579974723 shutdown_connections 2024-09-20T18:29:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.645+0000 7f3c1749e640 1 --2- 172.21.15.17:0/579974723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c10102b70 0x7f3c10102ff0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:29:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.645+0000 7f3c1749e640 1 --2- 172.21.15.17:0/579974723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c10101970 0x7f3c10101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:29:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.645+0000 7f3c1749e640 1 -- 172.21.15.17:0/579974723 >> 172.21.15.17:0/579974723 conn(0x7f3c100fd140 msgr2=0x7f3c100ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:29:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.645+0000 7f3c1749e640 1 -- 172.21.15.17:0/579974723 shutdown_connections 2024-09-20T18:29:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.645+0000 7f3c1749e640 1 -- 172.21.15.17:0/579974723 wait complete. 2024-09-20T18:29:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.646+0000 7f3c1749e640 1 Processor -- start 2024-09-20T18:29:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.646+0000 7f3c1749e640 1 -- start start 2024-09-20T18:29:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.646+0000 7f3c1749e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c10101970 0x7f3c10075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:29:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.646+0000 7f3c1749e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c10102b70 0x7f3c100745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:29:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.646+0000 7f3c1749e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1010a790 con 0x7f3c10101970 2024-09-20T18:29:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.646+0000 7f3c1749e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1010a610 con 0x7f3c10102b70 2024-09-20T18:29:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.646+0000 7f3c1523a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c10101970 0x7f3c10075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:29:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.646+0000 7f3c1523a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c10101970 0x7f3c10075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56442/0 (socket says 172.21.15.17:56442) 2024-09-20T18:29:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.646+0000 7f3c1523a640 1 -- 172.21.15.17:0/4088289645 learned_addr learned my addr 172.21.15.17:0/4088289645 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:29:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.646+0000 7f3c14a39640 1 --2- 172.21.15.17:0/4088289645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c10102b70 0x7f3c100745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:29:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.646+0000 7f3c1523a640 1 -- 172.21.15.17:0/4088289645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c10102b70 msgr2=0x7f3c100745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:29:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.646+0000 7f3c1523a640 1 --2- 172.21.15.17:0/4088289645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c10102b70 0x7f3c100745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:29:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.646+0000 7f3c1523a640 1 -- 172.21.15.17:0/4088289645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c10074b20 con 0x7f3c10101970 2024-09-20T18:29:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.647+0000 7f3c1523a640 1 --2- 172.21.15.17:0/4088289645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c10101970 0x7f3c10075f20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00d6f0 tx=0x7f3c0c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:29:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.647+0000 7f3c067fc640 1 -- 172.21.15.17:0/4088289645 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c0c017070 con 0x7f3c10101970 2024-09-20T18:29:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.647+0000 7f3c067fc640 1 -- 172.21.15.17:0/4088289645 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c0c00de00 con 0x7f3c10101970 2024-09-20T18:29:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.647+0000 7f3c067fc640 1 -- 172.21.15.17:0/4088289645 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c0c003bc0 con 0x7f3c10101970 2024-09-20T18:29:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.647+0000 7f3c1749e640 1 -- 172.21.15.17:0/4088289645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c10074e10 con 0x7f3c10101970 2024-09-20T18:29:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.647+0000 7f3c1749e640 1 -- 172.21.15.17:0/4088289645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c10075370 con 0x7f3c10101970 2024-09-20T18:29:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.648+0000 7f3c1749e640 1 -- 172.21.15.17:0/4088289645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c10101d70 con 0x7f3c10101970 2024-09-20T18:29:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.648+0000 7f3c067fc640 1 -- 172.21.15.17:0/4088289645 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f3c0c009a30 con 0x7f3c10101970 2024-09-20T18:29:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.649+0000 7f3c067fc640 1 --2- 172.21.15.17:0/4088289645 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3bfc06e280 0x7f3bfc070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:29:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.649+0000 7f3c067fc640 1 -- 172.21.15.17:0/4088289645 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1982+0+0 (secure 0 0 0) 0x7f3c0c08cd10 con 0x7f3c10101970 2024-09-20T18:29:49.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.649+0000 7f3c14a39640 1 --2- 172.21.15.17:0/4088289645 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3bfc06e280 0x7f3bfc070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:29:49.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.650+0000 7f3c14a39640 1 --2- 172.21.15.17:0/4088289645 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3bfc06e280 0x7f3bfc070740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3c00000c00 tx=0x7f3c000058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:29:49.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.653+0000 7f3c067fc640 1 -- 172.21.15.17:0/4088289645 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3c0c05f220 con 0x7f3c10101970 2024-09-20T18:29:49.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:29:49.845+0000 7f3c1749e640 1 -- 172.21.15.17:0/4088289645 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3c10062630 con 0x7f3bfc06e280 2024-09-20T18:29:50.514 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:50 smithi017 ceph-mon[28058]: osdmap e10: 1 total, 1 up, 1 in 2024-09-20T18:29:50.514 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:50 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T18:29:50.514 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:50 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T18:29:50.514 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:50 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:50.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:50 smithi172 ceph-mon[35456]: osdmap e10: 1 total, 1 up, 1 in 2024-09-20T18:29:50.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:50 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T18:29:50.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:50 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T18:29:50.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:50 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:51.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:51 smithi017 ceph-mon[28058]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:29:51.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:51 smithi017 ceph-mon[28058]: from='client.14348 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:29:51.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:51 smithi017 ceph-mon[28058]: Detected new or changed devices on smithi017 2024-09-20T18:29:51.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:51 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:51.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:51 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:51.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:51 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:29:51.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:51 smithi017 ceph-mon[28058]: Adjusting osd_memory_target on smithi017 to 11844M 2024-09-20T18:29:51.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:51 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:51.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:51 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:51.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:51 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:29:51.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:51 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:51.438 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:51 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:29:51.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:51 smithi172 ceph-mon[35456]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:29:51.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:51 smithi172 ceph-mon[35456]: from='client.14348 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:29:51.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:51 smithi172 ceph-mon[35456]: Detected new or changed devices on smithi017 2024-09-20T18:29:51.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:51 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:51.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:51 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:51.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:51 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:29:51.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:51 smithi172 ceph-mon[35456]: Adjusting osd_memory_target on smithi017 to 11844M 2024-09-20T18:29:51.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:51 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:51.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:51 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:51.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:51 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:29:51.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:51 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:51.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:51 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:29:53.504 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:53 smithi017 ceph-mon[28058]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:29:53.504 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:53.504 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:53.504 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:53 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3360063607' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb694b7d-d1c1-4aa6-90f4-837c7bd79c1d"}]: dispatch 2024-09-20T18:29:53.505 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:53 smithi017 ceph-mon[28058]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb694b7d-d1c1-4aa6-90f4-837c7bd79c1d"}]: dispatch 2024-09-20T18:29:53.505 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:53 smithi017 ceph-mon[28058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb694b7d-d1c1-4aa6-90f4-837c7bd79c1d"}]': finished 2024-09-20T18:29:53.505 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:53 smithi017 ceph-mon[28058]: osdmap e11: 2 total, 1 up, 2 in 2024-09-20T18:29:53.505 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T18:29:53.505 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:29:53.505 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:53 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1263138068' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T18:29:53.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:53 smithi172 ceph-mon[35456]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:29:53.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:53.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:53.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:53 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3360063607' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb694b7d-d1c1-4aa6-90f4-837c7bd79c1d"}]: dispatch 2024-09-20T18:29:53.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:53 smithi172 ceph-mon[35456]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb694b7d-d1c1-4aa6-90f4-837c7bd79c1d"}]: dispatch 2024-09-20T18:29:53.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:53 smithi172 ceph-mon[35456]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb694b7d-d1c1-4aa6-90f4-837c7bd79c1d"}]': finished 2024-09-20T18:29:53.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:53 smithi172 ceph-mon[35456]: osdmap e11: 2 total, 1 up, 2 in 2024-09-20T18:29:53.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T18:29:53.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:29:53.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:53 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/1263138068' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T18:29:55.612 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:55 smithi017 ceph-mon[28058]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:29:55.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:55 smithi172 ceph-mon[35456]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:29:57.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:56 smithi017 ceph-mon[28058]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:29:57.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:56 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:57.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:56 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:57.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:56 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:57.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:56 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:29:57.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:56 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:57.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:56 smithi172 ceph-mon[35456]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:29:57.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:56 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:57.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:56 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:57.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:56 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:29:57.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:56 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:29:57.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:56 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:29:59.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:29:58 smithi017 ceph-mon[28058]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:29:59.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:29:58 smithi172 ceph-mon[35456]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:01.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:00 smithi172 ceph-mon[35456]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:01.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:00 smithi172 ceph-mon[35456]: overall HEALTH_OK 2024-09-20T18:30:01.294 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:00 smithi017 ceph-mon[28058]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:01.294 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:00 smithi017 ceph-mon[28058]: overall HEALTH_OK 2024-09-20T18:30:02.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:01 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T18:30:02.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:01 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:02.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:01 smithi017 ceph-mon[28058]: Deploying daemon osd.1 on smithi017 2024-09-20T18:30:02.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:01 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-20T18:30:02.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:01 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:02.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:01 smithi172 ceph-mon[35456]: Deploying daemon osd.1 on smithi017 2024-09-20T18:30:03.266 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:02 smithi017 ceph-mon[28058]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:03.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:02 smithi172 ceph-mon[35456]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:05.077 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:05 smithi017 ceph-mon[28058]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:05.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:05 smithi172 ceph-mon[35456]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:07.336 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:07 smithi017 ceph-mon[28058]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:07.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:07 smithi172 ceph-mon[35456]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:08.332 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:08 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:30:08.332 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:08 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:30:08.332 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:08 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:08.332 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:08 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:08.346 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:08 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:30:08.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:08 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:30:08.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:08 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:08.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:08 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:09.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:09 smithi172 ceph-mon[35456]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:09.340 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:09 smithi017 ceph-mon[28058]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:10.588 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:10 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:10.589 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:10 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:10.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:10 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:10.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:10 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:11.667 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:11 smithi017 ceph-mon[28058]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:11.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:11 smithi172 ceph-mon[35456]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:11.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:11.693+0000 7f3c067fc640 1 -- 172.21.15.17:0/4088289645 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3c10062630 con 0x7f3bfc06e280 2024-09-20T18:30:11.708 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 1 on host 'smithi017' 2024-09-20T18:30:11.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:11.695+0000 7f3c1749e640 1 -- 172.21.15.17:0/4088289645 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3bfc06e280 msgr2=0x7f3bfc070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:30:11.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:11.695+0000 7f3c1749e640 1 --2- 172.21.15.17:0/4088289645 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3bfc06e280 0x7f3bfc070740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3c00000c00 tx=0x7f3c000058d0 comp rx=0 tx=0).stop 2024-09-20T18:30:11.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:11.695+0000 7f3c1749e640 1 -- 172.21.15.17:0/4088289645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c10101970 msgr2=0x7f3c10075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:30:11.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:11.695+0000 7f3c1749e640 1 --2- 172.21.15.17:0/4088289645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c10101970 0x7f3c10075f20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00d6f0 tx=0x7f3c0c00dbb0 comp rx=0 tx=0).stop 2024-09-20T18:30:11.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:11.695+0000 7f3c1749e640 1 -- 172.21.15.17:0/4088289645 shutdown_connections 2024-09-20T18:30:11.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:11.695+0000 7f3c1749e640 1 --2- 172.21.15.17:0/4088289645 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3bfc06e280 0x7f3bfc070740 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:30:11.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:11.695+0000 7f3c1749e640 1 --2- 172.21.15.17:0/4088289645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c10102b70 0x7f3c100745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:30:11.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:11.695+0000 7f3c1749e640 1 --2- 172.21.15.17:0/4088289645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c10101970 0x7f3c10075f20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:30:11.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:11.695+0000 7f3c1749e640 1 -- 172.21.15.17:0/4088289645 >> 172.21.15.17:0/4088289645 conn(0x7f3c100fd140 msgr2=0x7f3c10106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:30:11.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:11.696+0000 7f3c1749e640 1 -- 172.21.15.17:0/4088289645 shutdown_connections 2024-09-20T18:30:11.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:11.696+0000 7f3c1749e640 1 -- 172.21.15.17:0/4088289645 wait complete. 2024-09-20T18:30:12.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:12 smithi017 ceph-mon[28058]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:12.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:12.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:12.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:12 smithi172 ceph-mon[35456]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:12.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:12 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:12.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:12 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:13.045 DEBUG:teuthology.orchestra.run.smithi017:osd.1> sudo journalctl -f -n 0 -u ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.1.service 2024-09-20T18:30:13.047 INFO:tasks.cephadm:Deploying osd.2 on smithi017 with /dev/vg_nvme/lv_2... 2024-09-20T18:30:13.048 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-20T18:30:13.696 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:30:13.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:13 smithi017 ceph-mon[28058]: from='osd.1 [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T18:30:13.936 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:30:13 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1[57063]: 2024-09-20T18:30:13.667+0000 7fed4da5c640 -1 osd.1 0 log_to_monitors true 2024-09-20T18:30:13.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:13 smithi172 ceph-mon[35456]: from='osd.1 [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-20T18:30:14.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:14 smithi017 ceph-mon[28058]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:14.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:14 smithi017 ceph-mon[28058]: from='osd.1 [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T18:30:14.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:14 smithi017 ceph-mon[28058]: osdmap e12: 2 total, 1 up, 2 in 2024-09-20T18:30:14.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:14 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T18:30:14.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:14 smithi017 ceph-mon[28058]: from='osd.1 [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-20T18:30:15.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:14 smithi172 ceph-mon[35456]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:15.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:14 smithi172 ceph-mon[35456]: from='osd.1 [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T18:30:15.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:14 smithi172 ceph-mon[35456]: osdmap e12: 2 total, 1 up, 2 in 2024-09-20T18:30:15.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:14 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T18:30:15.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:14 smithi172 ceph-mon[35456]: from='osd.1 [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-20T18:30:15.800 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:15 smithi017 ceph-mon[28058]: from='osd.1 [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-20T18:30:15.800 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:15 smithi017 ceph-mon[28058]: osdmap e13: 2 total, 1 up, 2 in 2024-09-20T18:30:15.800 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:15 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T18:30:15.800 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:15 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T18:30:15.800 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:15 smithi017 ceph-mon[28058]: from='osd.1 [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513]' entity='osd.1' 2024-09-20T18:30:15.801 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:30:15 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1[57063]: 2024-09-20T18:30:15.470+0000 7fed491bc640 -1 osd.1 0 waiting for initial osdmap 2024-09-20T18:30:15.801 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:30:15 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1[57063]: 2024-09-20T18:30:15.474+0000 7fed417ee640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T18:30:16.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:15 smithi172 ceph-mon[35456]: from='osd.1 [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-20T18:30:16.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:15 smithi172 ceph-mon[35456]: osdmap e13: 2 total, 1 up, 2 in 2024-09-20T18:30:16.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:15 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T18:30:16.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:15 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T18:30:16.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:15 smithi172 ceph-mon[35456]: from='osd.1 [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513]' entity='osd.1' 2024-09-20T18:30:16.812 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:16 smithi017 ceph-mon[28058]: purged_snaps scrub starts 2024-09-20T18:30:16.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:16 smithi017 ceph-mon[28058]: purged_snaps scrub ok 2024-09-20T18:30:16.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:16 smithi017 ceph-mon[28058]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:16.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:16 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T18:30:16.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:16 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:16.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:16 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:16.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:16 smithi017 ceph-mon[28058]: osd.1 [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513] boot 2024-09-20T18:30:16.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:16 smithi017 ceph-mon[28058]: osdmap e14: 2 total, 2 up, 2 in 2024-09-20T18:30:16.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:16 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T18:30:16.815 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:30:16.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi017:vg_nvme/lv_2 2024-09-20T18:30:17.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:16 smithi172 ceph-mon[35456]: purged_snaps scrub starts 2024-09-20T18:30:17.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:16 smithi172 ceph-mon[35456]: purged_snaps scrub ok 2024-09-20T18:30:17.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:16 smithi172 ceph-mon[35456]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-20T18:30:17.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:16 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T18:30:17.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:16 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:17.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:16 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:17.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:16 smithi172 ceph-mon[35456]: osd.1 [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513] boot 2024-09-20T18:30:17.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:16 smithi172 ceph-mon[35456]: osdmap e14: 2 total, 2 up, 2 in 2024-09-20T18:30:17.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:16 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T18:30:18.047 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:30:18.553 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:18 smithi017 ceph-mon[28058]: osdmap e15: 2 total, 2 up, 2 in 2024-09-20T18:30:18.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.804+0000 7f6faa917640 1 -- 172.21.15.17:0/2602298388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa4101970 msgr2=0x7f6fa4101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:30:18.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.804+0000 7f6faa917640 1 --2- 172.21.15.17:0/2602298388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa4101970 0x7f6fa4101d70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009880 tx=0x7f6f9402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:30:18.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.804+0000 7f6faa917640 1 -- 172.21.15.17:0/2602298388 shutdown_connections 2024-09-20T18:30:18.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.804+0000 7f6faa917640 1 --2- 172.21.15.17:0/2602298388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa4102b70 0x7f6fa4102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:30:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.804+0000 7f6faa917640 1 --2- 172.21.15.17:0/2602298388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa4101970 0x7f6fa4101d70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:30:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.804+0000 7f6faa917640 1 -- 172.21.15.17:0/2602298388 >> 172.21.15.17:0/2602298388 conn(0x7f6fa40fd140 msgr2=0x7f6fa40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:30:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.804+0000 7f6faa917640 1 -- 172.21.15.17:0/2602298388 shutdown_connections 2024-09-20T18:30:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.804+0000 7f6faa917640 1 -- 172.21.15.17:0/2602298388 wait complete. 2024-09-20T18:30:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.805+0000 7f6faa917640 1 Processor -- start 2024-09-20T18:30:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.805+0000 7f6faa917640 1 -- start start 2024-09-20T18:30:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.805+0000 7f6faa917640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa4101970 0x7f6fa4197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:30:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.805+0000 7f6faa917640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa4102b70 0x7f6fa41979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:30:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.805+0000 7f6faa917640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa410a790 con 0x7f6fa4101970 2024-09-20T18:30:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.805+0000 7f6faa917640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa410a610 con 0x7f6fa4102b70 2024-09-20T18:30:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.805+0000 7f6fa3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa4101970 0x7f6fa4197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:30:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.805+0000 7f6fa3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa4101970 0x7f6fa4197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49376/0 (socket says 172.21.15.17:49376) 2024-09-20T18:30:18.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.805+0000 7f6fa3fff640 1 -- 172.21.15.17:0/1241837743 learned_addr learned my addr 172.21.15.17:0/1241837743 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:30:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.806+0000 7f6fa37fe640 1 --2- 172.21.15.17:0/1241837743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa4102b70 0x7f6fa41979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:30:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.806+0000 7f6fa3fff640 1 -- 172.21.15.17:0/1241837743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa4102b70 msgr2=0x7f6fa41979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:30:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.806+0000 7f6fa3fff640 1 --2- 172.21.15.17:0/1241837743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa4102b70 0x7f6fa41979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:30:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.806+0000 7f6fa3fff640 1 -- 172.21.15.17:0/1241837743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa4197fc0 con 0x7f6fa4101970 2024-09-20T18:30:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.806+0000 7f6fa37fe640 1 --2- 172.21.15.17:0/1241837743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa4102b70 0x7f6fa41979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:30:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.806+0000 7f6fa3fff640 1 --2- 172.21.15.17:0/1241837743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa4101970 0x7f6fa4197490 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6f94006010 tx=0x7f6f940048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:30:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.806+0000 7f6fa17fa640 1 -- 172.21.15.17:0/1241837743 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f9403f070 con 0x7f6fa4101970 2024-09-20T18:30:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.806+0000 7f6faa917640 1 -- 172.21.15.17:0/1241837743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa419c9d0 con 0x7f6fa4101970 2024-09-20T18:30:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.806+0000 7f6fa17fa640 1 -- 172.21.15.17:0/1241837743 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f940044d0 con 0x7f6fa4101970 2024-09-20T18:30:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.806+0000 7f6fa17fa640 1 -- 172.21.15.17:0/1241837743 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f94035030 con 0x7f6fa4101970 2024-09-20T18:30:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.806+0000 7f6faa917640 1 -- 172.21.15.17:0/1241837743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa419ced0 con 0x7f6fa4101970 2024-09-20T18:30:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.808+0000 7f6faa917640 1 -- 172.21.15.17:0/1241837743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa4101d70 con 0x7f6fa4101970 2024-09-20T18:30:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.808+0000 7f6fa17fa640 1 -- 172.21.15.17:0/1241837743 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f6f94042070 con 0x7f6fa4101970 2024-09-20T18:30:18.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.809+0000 7f6fa17fa640 1 --2- 172.21.15.17:0/1241837743 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f6f8c06e230 0x7f6f8c0706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:30:18.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.809+0000 7f6fa17fa640 1 -- 172.21.15.17:0/1241837743 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2414+0+0 (secure 0 0 0) 0x7f6f940ae0e0 con 0x7f6fa4101970 2024-09-20T18:30:18.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.809+0000 7f6fa37fe640 1 --2- 172.21.15.17:0/1241837743 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f6f8c06e230 0x7f6f8c0706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:30:18.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.809+0000 7f6fa37fe640 1 --2- 172.21.15.17:0/1241837743 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f6f8c06e230 0x7f6f8c0706f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4198940 tx=0x7f6f9800a5c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:30:18.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:18.813+0000 7f6fa17fa640 1 -- 172.21.15.17:0/1241837743 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6f9407c710 con 0x7f6fa4101970 2024-09-20T18:30:18.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:18 smithi172 ceph-mon[35456]: osdmap e15: 2 total, 2 up, 2 in 2024-09-20T18:30:19.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:19.001+0000 7f6faa917640 1 -- 172.21.15.17:0/1241837743 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f6fa4107110 con 0x7f6f8c06e230 2024-09-20T18:30:19.826 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:19 smithi017 ceph-mon[28058]: pgmap v68: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:19.826 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:19 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T18:30:19.826 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:19 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T18:30:19.826 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:19 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:19.859 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:19 smithi172 ceph-mon[35456]: pgmap v68: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:19.859 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:19 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T18:30:19.859 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:19 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T18:30:19.859 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:19 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:20.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:20 smithi017 ceph-mon[28058]: from='client.14366 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:30:20.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:20 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:20.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:20 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:20.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:20 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:30:20.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:20 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:30:20.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:20 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:20.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:20 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:20.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:20 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:30:20.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:20 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:20.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:20 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:30:20.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:20 smithi172 ceph-mon[35456]: from='client.14366 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:30:20.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:20 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:20.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:20 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:20.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:20 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:30:20.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:20 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:30:20.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:20 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:20.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:20 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:20.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:20 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:30:20.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:20 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:20.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:20 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:30:21.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:21 smithi017 ceph-mon[28058]: pgmap v69: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:21.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:21 smithi017 ceph-mon[28058]: Detected new or changed devices on smithi017 2024-09-20T18:30:21.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:21 smithi017 ceph-mon[28058]: Adjusting osd_memory_target on smithi017 to 5922M 2024-09-20T18:30:21.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:21 smithi172 ceph-mon[35456]: pgmap v69: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:21.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:21 smithi172 ceph-mon[35456]: Detected new or changed devices on smithi017 2024-09-20T18:30:21.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:21 smithi172 ceph-mon[35456]: Adjusting osd_memory_target on smithi017 to 5922M 2024-09-20T18:30:22.544 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:22 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3710623516' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86d6d42c-0a7a-400f-9e2b-087bab36d8d5"}]: dispatch 2024-09-20T18:30:22.545 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:22 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3710623516' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86d6d42c-0a7a-400f-9e2b-087bab36d8d5"}]': finished 2024-09-20T18:30:22.545 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:22 smithi017 ceph-mon[28058]: osdmap e16: 3 total, 2 up, 3 in 2024-09-20T18:30:22.545 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:22 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T18:30:22.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:22 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3710623516' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86d6d42c-0a7a-400f-9e2b-087bab36d8d5"}]: dispatch 2024-09-20T18:30:22.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:22 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3710623516' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86d6d42c-0a7a-400f-9e2b-087bab36d8d5"}]': finished 2024-09-20T18:30:22.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:22 smithi172 ceph-mon[35456]: osdmap e16: 3 total, 2 up, 3 in 2024-09-20T18:30:22.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:22 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T18:30:23.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:23 smithi017 ceph-mon[28058]: pgmap v70: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:23.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:23 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:30:23.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:23 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2916299561' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T18:30:23.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:23 smithi172 ceph-mon[35456]: pgmap v70: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:23.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:23 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:30:23.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:23 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/2916299561' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T18:30:25.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:25 smithi017 ceph-mon[28058]: pgmap v72: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:25.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:25 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:25.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:25 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:25.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:25 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:25.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:25 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:30:25.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:25 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:25.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:25 smithi172 ceph-mon[35456]: pgmap v72: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:25.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:25 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:25.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:25 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:25.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:25 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:25.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:25 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:30:25.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:25 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:27.627 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:27 smithi017 ceph-mon[28058]: pgmap v73: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:27.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:27 smithi172 ceph-mon[35456]: pgmap v73: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:29.562 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:29 smithi017 ceph-mon[28058]: pgmap v74: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:29.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:29 smithi172 ceph-mon[35456]: pgmap v74: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:31.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:31 smithi017 ceph-mon[28058]: pgmap v75: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:31.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:31 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T18:30:31.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:31 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:31.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:31 smithi172 ceph-mon[35456]: pgmap v75: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:31.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:31 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-20T18:30:31.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:31 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:32.614 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:32 smithi017 ceph-mon[28058]: Deploying daemon osd.2 on smithi017 2024-09-20T18:30:32.614 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:32 smithi017 ceph-mon[28058]: pgmap v76: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:32.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:32 smithi172 ceph-mon[35456]: Deploying daemon osd.2 on smithi017 2024-09-20T18:30:32.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:32 smithi172 ceph-mon[35456]: pgmap v76: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:34.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:34 smithi017 ceph-mon[28058]: pgmap v77: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:34.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:34 smithi172 ceph-mon[35456]: pgmap v77: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:36.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:36 smithi017 ceph-mon[28058]: pgmap v78: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:36.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:36 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:30:36.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:36 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:36.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:36 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:36.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:36 smithi172 ceph-mon[35456]: pgmap v78: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:36.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:36 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:30:36.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:36 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:36.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:36 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:38.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:38 smithi017 ceph-mon[28058]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:38.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:38 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:30:38.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:38 smithi172 ceph-mon[35456]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:38.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:38 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:30:40.435 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 2 on host 'smithi017' 2024-09-20T18:30:40.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:40.421+0000 7f6fa17fa640 1 -- 172.21.15.17:0/1241837743 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6fa4107110 con 0x7f6f8c06e230 2024-09-20T18:30:40.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:40.423+0000 7f6faa917640 1 -- 172.21.15.17:0/1241837743 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f6f8c06e230 msgr2=0x7f6f8c0706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:30:40.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:40.423+0000 7f6faa917640 1 --2- 172.21.15.17:0/1241837743 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f6f8c06e230 0x7f6f8c0706f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4198940 tx=0x7f6f9800a5c0 comp rx=0 tx=0).stop 2024-09-20T18:30:40.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:40.423+0000 7f6faa917640 1 -- 172.21.15.17:0/1241837743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa4101970 msgr2=0x7f6fa4197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:30:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:40.423+0000 7f6faa917640 1 --2- 172.21.15.17:0/1241837743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa4101970 0x7f6fa4197490 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6f94006010 tx=0x7f6f940048f0 comp rx=0 tx=0).stop 2024-09-20T18:30:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:40.424+0000 7f6faa917640 1 -- 172.21.15.17:0/1241837743 shutdown_connections 2024-09-20T18:30:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:40.424+0000 7f6faa917640 1 --2- 172.21.15.17:0/1241837743 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f6f8c06e230 0x7f6f8c0706f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:30:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:40.424+0000 7f6faa917640 1 --2- 172.21.15.17:0/1241837743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa4102b70 0x7f6fa41979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:30:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:40.424+0000 7f6faa917640 1 --2- 172.21.15.17:0/1241837743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa4101970 0x7f6fa4197490 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:30:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:40.424+0000 7f6faa917640 1 -- 172.21.15.17:0/1241837743 >> 172.21.15.17:0/1241837743 conn(0x7f6fa40fd140 msgr2=0x7f6fa40ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:30:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:40.424+0000 7f6faa917640 1 -- 172.21.15.17:0/1241837743 shutdown_connections 2024-09-20T18:30:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:30:40.424+0000 7f6faa917640 1 -- 172.21.15.17:0/1241837743 wait complete. 2024-09-20T18:30:41.085 DEBUG:teuthology.orchestra.run.smithi017:osd.2> sudo journalctl -f -n 0 -u ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.2.service 2024-09-20T18:30:41.087 INFO:tasks.cephadm:Deploying osd.3 on smithi172 with /dev/vg_nvme/lv_4... 2024-09-20T18:30:41.087 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-20T18:30:41.342 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T18:30:41.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:41 smithi017 ceph-mon[28058]: pgmap v80: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:41.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:41 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:41.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:41 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:41.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:41 smithi172 ceph-mon[35456]: pgmap v80: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:41.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:41 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:41.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:41 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:43.118 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:30:42 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2[64378]: 2024-09-20T18:30:42.803+0000 7fbbc73b8640 -1 osd.2 0 log_to_monitors true 2024-09-20T18:30:43.684 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:43 smithi172 ceph-mon[35456]: pgmap v81: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:43.684 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:43 smithi172 ceph-mon[35456]: from='osd.2 [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T18:30:43.684 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:43 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:43.684 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:43 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:43.687 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:30:43.713 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi172:vg_nvme/lv_4 2024-09-20T18:30:43.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:43 smithi017 ceph-mon[28058]: pgmap v81: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:43.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:43 smithi017 ceph-mon[28058]: from='osd.2 [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-20T18:30:43.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:43 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:43.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:43 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:43.961 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T18:30:44.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.376+0000 7fb8e9496640 1 -- 172.21.15.172:0/719686580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e4104de0 msgr2=0x7fb8e41071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:30:44.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.376+0000 7fb8e9496640 1 --2- 172.21.15.172:0/719686580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e4104de0 0x7fb8e41071d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8009880 tx=0x7fb8d802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:30:44.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.376+0000 7fb8e9496640 1 -- 172.21.15.172:0/719686580 shutdown_connections 2024-09-20T18:30:44.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.376+0000 7fb8e9496640 1 --2- 172.21.15.172:0/719686580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e4104de0 0x7fb8e41071d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:30:44.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.376+0000 7fb8e9496640 1 --2- 172.21.15.172:0/719686580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8e41024b0 0x7fb8e41048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:30:44.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.376+0000 7fb8e9496640 1 -- 172.21.15.172:0/719686580 >> 172.21.15.172:0/719686580 conn(0x7fb8e40fc010 msgr2=0x7fb8e40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:30:44.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.376+0000 7fb8e9496640 1 -- 172.21.15.172:0/719686580 shutdown_connections 2024-09-20T18:30:44.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.376+0000 7fb8e9496640 1 -- 172.21.15.172:0/719686580 wait complete. 2024-09-20T18:30:44.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.377+0000 7fb8e9496640 1 Processor -- start 2024-09-20T18:30:44.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.377+0000 7fb8e9496640 1 -- start start 2024-09-20T18:30:44.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.377+0000 7fb8e9496640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8e41024b0 0x7fb8e41974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:30:44.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.377+0000 7fb8e9496640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e4104de0 0x7fb8e4197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:30:44.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.377+0000 7fb8e9496640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e410a7a0 con 0x7fb8e41024b0 2024-09-20T18:30:44.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.377+0000 7fb8e9496640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e410a620 con 0x7fb8e4104de0 2024-09-20T18:30:44.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.378+0000 7fb8e27fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e4104de0 0x7fb8e4197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:30:44.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.378+0000 7fb8e27fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e4104de0 0x7fb8e4197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53064/0 (socket says 172.21.15.172:53064) 2024-09-20T18:30:44.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.378+0000 7fb8e27fc640 1 -- 172.21.15.172:0/3935497213 learned_addr learned my addr 172.21.15.172:0/3935497213 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-20T18:30:44.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.378+0000 7fb8e2ffd640 1 --2- 172.21.15.172:0/3935497213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8e41024b0 0x7fb8e41974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:30:44.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.378+0000 7fb8e27fc640 1 -- 172.21.15.172:0/3935497213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8e41024b0 msgr2=0x7fb8e41974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:30:44.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.378+0000 7fb8e27fc640 1 --2- 172.21.15.172:0/3935497213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8e41024b0 0x7fb8e41974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:30:44.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.378+0000 7fb8e27fc640 1 -- 172.21.15.172:0/3935497213 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e41980b0 con 0x7fb8e4104de0 2024-09-20T18:30:44.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.378+0000 7fb8e2ffd640 1 --2- 172.21.15.172:0/3935497213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8e41024b0 0x7fb8e41974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:30:44.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.378+0000 7fb8e27fc640 1 --2- 172.21.15.172:0/3935497213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e4104de0 0x7fb8e4197a30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8006010 tx=0x7fb8d80048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:30:44.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.378+0000 7fb8cbfff640 1 -- 172.21.15.172:0/3935497213 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb8d803f070 con 0x7fb8e4104de0 2024-09-20T18:30:44.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.378+0000 7fb8e9496640 1 -- 172.21.15.172:0/3935497213 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e419ca90 con 0x7fb8e4104de0 2024-09-20T18:30:44.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.378+0000 7fb8cbfff640 1 -- 172.21.15.172:0/3935497213 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb8d80044d0 con 0x7fb8e4104de0 2024-09-20T18:30:44.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.378+0000 7fb8cbfff640 1 -- 172.21.15.172:0/3935497213 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb8d8035030 con 0x7fb8e4104de0 2024-09-20T18:30:44.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.378+0000 7fb8e9496640 1 -- 172.21.15.172:0/3935497213 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e419d020 con 0x7fb8e4104de0 2024-09-20T18:30:44.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.379+0000 7fb8e9496640 1 -- 172.21.15.172:0/3935497213 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e4102890 con 0x7fb8e4104de0 2024-09-20T18:30:44.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.380+0000 7fb8cbfff640 1 -- 172.21.15.172:0/3935497213 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fb8d8042070 con 0x7fb8e4104de0 2024-09-20T18:30:44.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.380+0000 7fb8cbfff640 1 --2- 172.21.15.172:0/3935497213 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fb8cc06e230 0x7fb8cc0706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:30:44.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.380+0000 7fb8cbfff640 1 -- 172.21.15.172:0/3935497213 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2550+0+0 (secure 0 0 0) 0x7fb8d80ae170 con 0x7fb8e4104de0 2024-09-20T18:30:44.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.380+0000 7fb8e2ffd640 1 --2- 172.21.15.172:0/3935497213 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fb8cc06e230 0x7fb8cc0706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:30:44.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.381+0000 7fb8e2ffd640 1 --2- 172.21.15.172:0/3935497213 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fb8cc06e230 0x7fb8cc0706f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40058c0 tx=0x7fb8d4005d30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:30:44.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.385+0000 7fb8cbfff640 1 -- 172.21.15.172:0/3935497213 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb8d807c710 con 0x7fb8e4104de0 2024-09-20T18:30:44.497 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:44 smithi017 ceph-mon[28058]: from='osd.2 [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T18:30:44.497 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:44 smithi017 ceph-mon[28058]: osdmap e17: 3 total, 2 up, 3 in 2024-09-20T18:30:44.498 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:44 smithi017 ceph-mon[28058]: from='osd.2 [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-20T18:30:44.498 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:44 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T18:30:44.498 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:44 smithi017 ceph-mon[28058]: from='osd.2 [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-20T18:30:44.578 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:44.564+0000 7fb8e9496640 1 -- 172.21.15.172:0/3935497213 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb8e4105840 con 0x7fb8cc06e230 2024-09-20T18:30:44.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:44 smithi172 ceph-mon[35456]: from='osd.2 [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T18:30:44.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:44 smithi172 ceph-mon[35456]: osdmap e17: 3 total, 2 up, 3 in 2024-09-20T18:30:44.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:44 smithi172 ceph-mon[35456]: from='osd.2 [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-09-20T18:30:44.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:44 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T18:30:44.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:44 smithi172 ceph-mon[35456]: from='osd.2 [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-09-20T18:30:45.393 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:30:45 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2[64378]: 2024-09-20T18:30:45.129+0000 7fbbc2b18640 -1 osd.2 0 waiting for initial osdmap 2024-09-20T18:30:45.394 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:30:45 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2[64378]: 2024-09-20T18:30:45.134+0000 7fbbbb14a640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T18:30:45.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:45 smithi017 ceph-mon[28058]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:45.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:45 smithi017 ceph-mon[28058]: osdmap e18: 3 total, 2 up, 3 in 2024-09-20T18:30:45.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:45 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T18:30:45.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:45 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T18:30:45.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:45 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T18:30:45.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:45 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T18:30:45.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:45 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:45.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:45 smithi017 ceph-mon[28058]: from='osd.2 [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491]' entity='osd.2' 2024-09-20T18:30:45.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:45 smithi172 ceph-mon[35456]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:45.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:45 smithi172 ceph-mon[35456]: osdmap e18: 3 total, 2 up, 3 in 2024-09-20T18:30:45.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:45 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T18:30:45.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:45 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T18:30:45.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:45 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T18:30:45.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:45 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T18:30:45.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:45 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:45.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:45 smithi172 ceph-mon[35456]: from='osd.2 [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491]' entity='osd.2' 2024-09-20T18:30:46.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:46 smithi172 ceph-mon[35456]: purged_snaps scrub starts 2024-09-20T18:30:46.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:46 smithi172 ceph-mon[35456]: purged_snaps scrub ok 2024-09-20T18:30:46.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:46 smithi172 ceph-mon[35456]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:30:46.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:46 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T18:30:46.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:46 smithi172 ceph-mon[35456]: osd.2 [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491] boot 2024-09-20T18:30:46.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:46 smithi172 ceph-mon[35456]: osdmap e19: 3 total, 3 up, 3 in 2024-09-20T18:30:46.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:46 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T18:30:46.861 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:46 smithi017 ceph-mon[28058]: purged_snaps scrub starts 2024-09-20T18:30:46.861 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:46 smithi017 ceph-mon[28058]: purged_snaps scrub ok 2024-09-20T18:30:46.861 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:46 smithi017 ceph-mon[28058]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:30:46.861 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:46 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T18:30:46.861 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:46 smithi017 ceph-mon[28058]: osd.2 [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491] boot 2024-09-20T18:30:46.861 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:46 smithi017 ceph-mon[28058]: osdmap e19: 3 total, 3 up, 3 in 2024-09-20T18:30:46.861 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:46 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T18:30:47.612 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: pgmap v85: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:47.612 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/3672314705' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ca08e10-5b3b-497f-9db4-bc544c622f93"}]: dispatch 2024-09-20T18:30:47.613 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ca08e10-5b3b-497f-9db4-bc544c622f93"}]: dispatch 2024-09-20T18:30:47.613 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ca08e10-5b3b-497f-9db4-bc544c622f93"}]': finished 2024-09-20T18:30:47.613 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: osdmap e20: 4 total, 3 up, 4 in 2024-09-20T18:30:47.613 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:30:47.613 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:47.613 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:47.613 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:30:47.613 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:30:47.613 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:30:47.614 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:47.614 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:47.614 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:30:47.614 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:47.614 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:30:47.614 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:47.614 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:30:47.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:47.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:47 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/2984353015' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T18:30:47.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: pgmap v85: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-20T18:30:47.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/3672314705' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ca08e10-5b3b-497f-9db4-bc544c622f93"}]: dispatch 2024-09-20T18:30:47.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ca08e10-5b3b-497f-9db4-bc544c622f93"}]: dispatch 2024-09-20T18:30:47.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ca08e10-5b3b-497f-9db4-bc544c622f93"}]': finished 2024-09-20T18:30:47.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: osdmap e20: 4 total, 3 up, 4 in 2024-09-20T18:30:47.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:30:47.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:47.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:47.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:30:47.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:30:47.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:30:47.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:47.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:47.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:30:47.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:47.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:30:47.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:47.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:30:47.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:47.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:47 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/2984353015' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T18:30:48.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:48 smithi172 ceph-mon[35456]: Detected new or changed devices on smithi017 2024-09-20T18:30:48.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:48 smithi172 ceph-mon[35456]: Adjusting osd_memory_target on smithi017 to 3948M 2024-09-20T18:30:48.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:48 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-20T18:30:48.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:48 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-20T18:30:48.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:48 smithi172 ceph-mon[35456]: osdmap e21: 4 total, 3 up, 4 in 2024-09-20T18:30:48.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:48 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:30:48.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:48 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-20T18:30:48.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:48 smithi017 ceph-mon[28058]: Detected new or changed devices on smithi017 2024-09-20T18:30:48.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:48 smithi017 ceph-mon[28058]: Adjusting osd_memory_target on smithi017 to 3948M 2024-09-20T18:30:48.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:48 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-20T18:30:48.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:48 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-20T18:30:48.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:48 smithi017 ceph-mon[28058]: osdmap e21: 4 total, 3 up, 4 in 2024-09-20T18:30:48.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:48 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:30:48.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:48 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-20T18:30:49.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:49 smithi172 ceph-mon[35456]: pgmap v88: 0 pgs: ; 0 B data, 108 MiB used, 268 GiB / 268 GiB avail 2024-09-20T18:30:49.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:49 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-20T18:30:49.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:49 smithi172 ceph-mon[35456]: osdmap e22: 4 total, 3 up, 4 in 2024-09-20T18:30:49.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:49 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:30:49.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:49 smithi017 ceph-mon[28058]: pgmap v88: 0 pgs: ; 0 B data, 108 MiB used, 268 GiB / 268 GiB avail 2024-09-20T18:30:49.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:49 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-20T18:30:49.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:49 smithi017 ceph-mon[28058]: osdmap e22: 4 total, 3 up, 4 in 2024-09-20T18:30:49.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:49 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:30:50.399 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:30:50 smithi017 sudo[69023]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-20T18:30:50.399 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:30:50 smithi017 sudo[69023]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T18:30:50.399 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:30:50 smithi017 sudo[69023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T18:30:50.399 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:30:50 smithi017 sudo[69023]: pam_unix(sudo:session): session closed for user root 2024-09-20T18:30:50.883 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:30:50 smithi017 sudo[69026]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-20T18:30:50.883 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:30:50 smithi017 sudo[69026]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T18:30:50.884 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:30:50 smithi017 sudo[69026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T18:30:50.884 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:30:50 smithi017 sudo[69026]: pam_unix(sudo:session): session closed for user root 2024-09-20T18:30:51.149 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:30:50 smithi017 sudo[69029]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-20T18:30:51.149 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:30:50 smithi017 sudo[69029]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T18:30:51.149 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:30:50 smithi017 sudo[69029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T18:30:51.149 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:30:50 smithi017 sudo[69029]: pam_unix(sudo:session): session closed for user root 2024-09-20T18:30:51.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:51 smithi172 ceph-mon[35456]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 108 MiB used, 268 GiB / 268 GiB avail 2024-09-20T18:30:51.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:51 smithi172 ceph-mon[35456]: osdmap e23: 4 total, 3 up, 4 in 2024-09-20T18:30:51.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:51 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:30:51.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:51 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:51.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:51 smithi017 ceph-mon[28058]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 108 MiB used, 268 GiB / 268 GiB avail 2024-09-20T18:30:51.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:51 smithi017 ceph-mon[28058]: osdmap e23: 4 total, 3 up, 4 in 2024-09-20T18:30:51.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:51 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:30:51.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:51 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:51.769 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:30:51 smithi017 sudo[69032]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-20T18:30:51.770 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:30:51 smithi017 sudo[69032]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T18:30:51.770 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:30:51 smithi017 sudo[69032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T18:30:51.770 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:30:51 smithi017 sudo[69032]: pam_unix(sudo:session): session closed for user root 2024-09-20T18:30:52.149 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:30:51 smithi017 sudo[69035]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-20T18:30:52.149 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:30:51 smithi017 sudo[69035]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T18:30:52.149 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:30:51 smithi017 sudo[69035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T18:30:52.149 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:30:51 smithi017 sudo[69035]: pam_unix(sudo:session): session closed for user root 2024-09-20T18:30:52.649 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:30:52 smithi017 sudo[69038]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-20T18:30:52.649 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:30:52 smithi017 sudo[69038]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T18:30:52.649 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:30:52 smithi017 sudo[69038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T18:30:52.649 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:30:52 smithi017 sudo[69038]: pam_unix(sudo:session): session closed for user root 2024-09-20T18:30:53.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:52 smithi017 sudo[69041]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-20T18:30:53.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:52 smithi017 sudo[69041]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T18:30:53.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:52 smithi017 sudo[69041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T18:30:53.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:52 smithi017 sudo[69041]: pam_unix(sudo:session): session closed for user root 2024-09-20T18:30:53.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:30:53.223+0000 7fb8cbfff640 1 -- 172.21.15.172:0/3935497213 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fb8d8078680 con 0x7fb8e4104de0 2024-09-20T18:30:53.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:53 smithi017 sudo[69044]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-20T18:30:53.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:53 smithi017 sudo[69044]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T18:30:53.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:53 smithi017 sudo[69044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T18:30:53.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:53 smithi017 sudo[69044]: pam_unix(sudo:session): session closed for user root 2024-09-20T18:30:53.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:53 smithi172 sudo[40777]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-20T18:30:53.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:53 smithi172 sudo[40777]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T18:30:53.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:53 smithi172 sudo[40777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T18:30:53.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:53 smithi172 sudo[40777]: pam_unix(sudo:session): session closed for user root 2024-09-20T18:30:54.067 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:53 smithi172 sudo[40781]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-20T18:30:54.067 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:53 smithi172 sudo[40781]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-20T18:30:54.068 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:53 smithi172 sudo[40781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-20T18:30:54.068 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:53 smithi172 sudo[40781]: pam_unix(sudo:session): session closed for user root 2024-09-20T18:30:54.068 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:53 smithi172 ceph-mon[35456]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 109 MiB used, 268 GiB / 268 GiB avail 2024-09-20T18:30:54.068 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:53 smithi172 ceph-mon[35456]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T18:30:54.068 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:53 smithi172 ceph-mon[35456]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T18:30:54.068 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-09-20T18:30:54.068 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:30:54.068 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:30:54.068 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:53 smithi172 ceph-mon[35456]: mgrmap e19: smithi017.xusjwd(active, since 2m), standbys: smithi172.jczphg 2024-09-20T18:30:54.068 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-09-20T18:30:54.069 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:30:54.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:53 smithi017 ceph-mon[28058]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 109 MiB used, 268 GiB / 268 GiB avail 2024-09-20T18:30:54.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:53 smithi017 ceph-mon[28058]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T18:30:54.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:53 smithi017 ceph-mon[28058]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T18:30:54.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-09-20T18:30:54.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:30:54.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:30:54.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:53 smithi017 ceph-mon[28058]: mgrmap e19: smithi017.xusjwd(active, since 2m), standbys: smithi172.jczphg 2024-09-20T18:30:54.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-09-20T18:30:54.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:30:54.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:54 smithi172 ceph-mon[35456]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T18:30:54.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:54 smithi172 ceph-mon[35456]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 268 GiB / 268 GiB avail 2024-09-20T18:30:54.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:54 smithi172 ceph-mon[35456]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T18:30:54.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:54 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:55.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:54 smithi017 ceph-mon[28058]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-20T18:30:55.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:54 smithi017 ceph-mon[28058]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 268 GiB / 268 GiB avail 2024-09-20T18:30:55.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:54 smithi017 ceph-mon[28058]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-20T18:30:55.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:54 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:30:55.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:55 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-20T18:30:55.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:55 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:55.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:55 smithi172 ceph-mon[35456]: Deploying daemon osd.3 on smithi172 2024-09-20T18:30:56.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:55 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-20T18:30:56.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:55 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:30:56.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:55 smithi017 ceph-mon[28058]: Deploying daemon osd.3 on smithi172 2024-09-20T18:30:56.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:56 smithi172 ceph-mon[35456]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 268 GiB / 268 GiB avail 2024-09-20T18:30:57.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:56 smithi017 ceph-mon[28058]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 268 GiB / 268 GiB avail 2024-09-20T18:30:58.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:30:58 smithi172 ceph-mon[35456]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 110 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-20T18:30:59.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:30:58 smithi017 ceph-mon[28058]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 110 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-20T18:31:01.105 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:00 smithi172 ceph-mon[35456]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 110 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-20T18:31:01.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:00 smithi017 ceph-mon[28058]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 110 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-20T18:31:01.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:01 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:31:01.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:01 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:01.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:01 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:02.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:01 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:31:02.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:01 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:02.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:01 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:03.090 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:02 smithi172 ceph-mon[35456]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 110 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-20T18:31:03.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:02 smithi017 ceph-mon[28058]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 110 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-20T18:31:04.935 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:04 smithi172 ceph-mon[35456]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 110 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-20T18:31:05.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:04 smithi017 ceph-mon[28058]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 110 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-20T18:31:05.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:05.219+0000 7fb8cbfff640 1 -- 172.21.15.172:0/3935497213 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb8e4105840 con 0x7fb8cc06e230 2024-09-20T18:31:05.233 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 3 on host 'smithi172' 2024-09-20T18:31:05.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:05.222+0000 7fb8e9496640 1 -- 172.21.15.172:0/3935497213 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fb8cc06e230 msgr2=0x7fb8cc0706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:31:05.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:05.222+0000 7fb8e9496640 1 --2- 172.21.15.172:0/3935497213 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fb8cc06e230 0x7fb8cc0706f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40058c0 tx=0x7fb8d4005d30 comp rx=0 tx=0).stop 2024-09-20T18:31:05.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:05.222+0000 7fb8e9496640 1 -- 172.21.15.172:0/3935497213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e4104de0 msgr2=0x7fb8e4197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:31:05.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:05.222+0000 7fb8e9496640 1 --2- 172.21.15.172:0/3935497213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e4104de0 0x7fb8e4197a30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8006010 tx=0x7fb8d80048f0 comp rx=0 tx=0).stop 2024-09-20T18:31:05.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:05.222+0000 7fb8e9496640 1 -- 172.21.15.172:0/3935497213 shutdown_connections 2024-09-20T18:31:05.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:05.222+0000 7fb8e9496640 1 --2- 172.21.15.172:0/3935497213 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fb8cc06e230 0x7fb8cc0706f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:31:05.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:05.222+0000 7fb8e9496640 1 --2- 172.21.15.172:0/3935497213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8e4104de0 0x7fb8e4197a30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:31:05.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:05.222+0000 7fb8e9496640 1 --2- 172.21.15.172:0/3935497213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8e41024b0 0x7fb8e41974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:31:05.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:05.222+0000 7fb8e9496640 1 -- 172.21.15.172:0/3935497213 >> 172.21.15.172:0/3935497213 conn(0x7fb8e40fc010 msgr2=0x7fb8e40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:31:05.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:05.222+0000 7fb8e9496640 1 -- 172.21.15.172:0/3935497213 shutdown_connections 2024-09-20T18:31:05.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:05.222+0000 7fb8e9496640 1 -- 172.21.15.172:0/3935497213 wait complete. 2024-09-20T18:31:06.277 DEBUG:teuthology.orchestra.run.smithi172:osd.3> sudo journalctl -f -n 0 -u ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.3.service 2024-09-20T18:31:06.279 INFO:tasks.cephadm:Deploying osd.4 on smithi172 with /dev/vg_nvme/lv_3... 2024-09-20T18:31:06.279 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-20T18:31:06.577 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T18:31:06.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:06 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:06.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:06 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:06.702 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:06 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:06.702 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:06 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:07.591 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:07 smithi172 ceph-mon[35456]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 110 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-20T18:31:07.591 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:07 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:07.592 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:07 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:07.592 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:31:07 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3[41389]: 2024-09-20T18:31:07.484+0000 7f1e192a6640 -1 osd.3 0 log_to_monitors true 2024-09-20T18:31:07.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:07 smithi017 ceph-mon[28058]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 110 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-20T18:31:07.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:07 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:07.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:07 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:08.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:08 smithi172 ceph-mon[35456]: from='osd.3 [v2:172.21.15.172:6800/3866485293,v1:172.21.15.172:6801/3866485293]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-20T18:31:08.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:08 smithi172 ceph-mon[35456]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-20T18:31:08.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:08 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:31:08.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:08 smithi017 ceph-mon[28058]: from='osd.3 [v2:172.21.15.172:6800/3866485293,v1:172.21.15.172:6801/3866485293]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-20T18:31:08.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:08 smithi017 ceph-mon[28058]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-20T18:31:08.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:08 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:31:09.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:09 smithi017 ceph-mon[28058]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 110 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-20T18:31:09.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:09 smithi017 ceph-mon[28058]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-20T18:31:09.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:09 smithi017 ceph-mon[28058]: from='osd.3 [v2:172.21.15.172:6800/3866485293,v1:172.21.15.172:6801/3866485293]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-20T18:31:09.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:09 smithi017 ceph-mon[28058]: osdmap e24: 4 total, 3 up, 4 in 2024-09-20T18:31:09.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:09 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:31:09.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:09 smithi017 ceph-mon[28058]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-20T18:31:09.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:09 smithi172 ceph-mon[35456]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 110 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-20T18:31:09.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:09 smithi172 ceph-mon[35456]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-20T18:31:09.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:09 smithi172 ceph-mon[35456]: from='osd.3 [v2:172.21.15.172:6800/3866485293,v1:172.21.15.172:6801/3866485293]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-20T18:31:09.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:09 smithi172 ceph-mon[35456]: osdmap e24: 4 total, 3 up, 4 in 2024-09-20T18:31:09.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:09 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:31:09.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:09 smithi172 ceph-mon[35456]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-20T18:31:09.797 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:31:09.828 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi172:vg_nvme/lv_3 2024-09-20T18:31:10.312 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T18:31:10.358 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:31:10 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3[41389]: 2024-09-20T18:31:10.158+0000 7f1e14a06640 -1 osd.3 0 waiting for initial osdmap 2024-09-20T18:31:10.358 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:31:10 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3[41389]: 2024-09-20T18:31:10.164+0000 7f1e0d038640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T18:31:10.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:10 smithi172 ceph-mon[35456]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-20T18:31:10.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:10 smithi172 ceph-mon[35456]: osdmap e25: 4 total, 3 up, 4 in 2024-09-20T18:31:10.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:10 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:31:10.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:10 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:31:10.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:10 smithi172 ceph-mon[35456]: from='osd.3 ' entity='osd.3' 2024-09-20T18:31:10.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:10 smithi017 ceph-mon[28058]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-20T18:31:10.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:10 smithi017 ceph-mon[28058]: osdmap e25: 4 total, 3 up, 4 in 2024-09-20T18:31:10.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:10 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:31:10.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:10 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:31:10.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:10 smithi017 ceph-mon[28058]: from='osd.3 ' entity='osd.3' 2024-09-20T18:31:10.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.818+0000 7f486e86a640 1 -- 172.21.15.172:0/176178504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4868100b80 msgr2=0x7f4868100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:31:10.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.818+0000 7f486e86a640 1 --2- 172.21.15.172:0/176178504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4868100b80 0x7f4868100fe0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f485c009880 tx=0x7f485c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:31:10.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.818+0000 7f486e86a640 1 -- 172.21.15.172:0/176178504 shutdown_connections 2024-09-20T18:31:10.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.818+0000 7f486e86a640 1 --2- 172.21.15.172:0/176178504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4868100b80 0x7f4868100fe0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:31:10.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.818+0000 7f486e86a640 1 --2- 172.21.15.172:0/176178504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4868100240 0x7f4868100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:31:10.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.818+0000 7f486e86a640 1 -- 172.21.15.172:0/176178504 >> 172.21.15.172:0/176178504 conn(0x7f48680fc010 msgr2=0x7f48680fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:31:10.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.818+0000 7f486e86a640 1 -- 172.21.15.172:0/176178504 shutdown_connections 2024-09-20T18:31:10.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.818+0000 7f486e86a640 1 -- 172.21.15.172:0/176178504 wait complete. 2024-09-20T18:31:10.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.819+0000 7f486e86a640 1 Processor -- start 2024-09-20T18:31:10.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.819+0000 7f486e86a640 1 -- start start 2024-09-20T18:31:10.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.819+0000 7f486e86a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4868100240 0x7f48681996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:31:10.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.819+0000 7f486e86a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4868100b80 0x7f4868199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:31:10.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.819+0000 7f486e86a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f486810c9f0 con 0x7f4868100b80 2024-09-20T18:31:10.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.819+0000 7f486e86a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f486810c870 con 0x7f4868100240 2024-09-20T18:31:10.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.819+0000 7f4867fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4868100240 0x7f48681996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:31:10.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.819+0000 7f4867fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4868100240 0x7f48681996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41474/0 (socket says 172.21.15.172:41474) 2024-09-20T18:31:10.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.819+0000 7f4867fff640 1 -- 172.21.15.172:0/1440715393 learned_addr learned my addr 172.21.15.172:0/1440715393 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-20T18:31:10.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.820+0000 7f4867fff640 1 -- 172.21.15.172:0/1440715393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4868100b80 msgr2=0x7f4868199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:31:10.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.819+0000 7f48677fe640 1 --2- 172.21.15.172:0/1440715393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4868100b80 0x7f4868199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:31:10.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.820+0000 7f4867fff640 1 --2- 172.21.15.172:0/1440715393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4868100b80 0x7f4868199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:31:10.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.820+0000 7f4867fff640 1 -- 172.21.15.172:0/1440715393 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486819a2b0 con 0x7f4868100240 2024-09-20T18:31:10.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.820+0000 7f48677fe640 1 --2- 172.21.15.172:0/1440715393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4868100b80 0x7f4868199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:31:10.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.820+0000 7f4867fff640 1 --2- 172.21.15.172:0/1440715393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4868100240 0x7f48681996f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f485800b420 tx=0x7f485800b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:31:10.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.820+0000 7f48657fa640 1 -- 172.21.15.172:0/1440715393 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4858011630 con 0x7f4868100240 2024-09-20T18:31:10.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.820+0000 7f48657fa640 1 -- 172.21.15.172:0/1440715393 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4858016070 con 0x7f4868100240 2024-09-20T18:31:10.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.820+0000 7f486e86a640 1 -- 172.21.15.172:0/1440715393 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486819ecf0 con 0x7f4868100240 2024-09-20T18:31:10.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.820+0000 7f48657fa640 1 -- 172.21.15.172:0/1440715393 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4858010d40 con 0x7f4868100240 2024-09-20T18:31:10.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.820+0000 7f486e86a640 1 -- 172.21.15.172:0/1440715393 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f486819f240 con 0x7f4868100240 2024-09-20T18:31:10.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.821+0000 7f486e86a640 1 -- 172.21.15.172:0/1440715393 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4868100640 con 0x7f4868100240 2024-09-20T18:31:10.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.822+0000 7f48657fa640 1 -- 172.21.15.172:0/1440715393 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f485801b460 con 0x7f4868100240 2024-09-20T18:31:10.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.822+0000 7f48657fa640 1 --2- 172.21.15.172:0/1440715393 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f485006e300 0x7f48500707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:31:10.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.822+0000 7f48657fa640 1 -- 172.21.15.172:0/1440715393 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3807+0+0 (secure 0 0 0) 0x7f485808d330 con 0x7f4868100240 2024-09-20T18:31:10.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.823+0000 7f48677fe640 1 --2- 172.21.15.172:0/1440715393 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f485006e300 0x7f48500707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:31:10.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.823+0000 7f48677fe640 1 --2- 172.21.15.172:0/1440715393 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f485006e300 0x7f48500707c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f485c006010 tx=0x7f485c000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:31:10.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:10.831+0000 7f48657fa640 1 -- 172.21.15.172:0/1440715393 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f485805b390 con 0x7f4868100240 2024-09-20T18:31:11.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:11.013+0000 7f486e86a640 1 -- 172.21.15.172:0/1440715393 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4868109bf0 con 0x7f485006e300 2024-09-20T18:31:11.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:11 smithi172 ceph-mon[35456]: purged_snaps scrub starts 2024-09-20T18:31:11.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:11 smithi172 ceph-mon[35456]: purged_snaps scrub ok 2024-09-20T18:31:11.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:11 smithi172 ceph-mon[35456]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 110 MiB used, 268 GiB / 268 GiB avail 2024-09-20T18:31:11.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:11 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:31:11.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:11 smithi172 ceph-mon[35456]: osd.3 [v2:172.21.15.172:6800/3866485293,v1:172.21.15.172:6801/3866485293] boot 2024-09-20T18:31:11.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:11 smithi172 ceph-mon[35456]: osdmap e26: 4 total, 4 up, 4 in 2024-09-20T18:31:11.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:11 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:31:11.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:11 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T18:31:11.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:11 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T18:31:11.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:11 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:31:11.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:11 smithi017 ceph-mon[28058]: purged_snaps scrub starts 2024-09-20T18:31:11.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:11 smithi017 ceph-mon[28058]: purged_snaps scrub ok 2024-09-20T18:31:11.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:11 smithi017 ceph-mon[28058]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 110 MiB used, 268 GiB / 268 GiB avail 2024-09-20T18:31:11.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:11 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:31:11.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:11 smithi017 ceph-mon[28058]: osd.3 [v2:172.21.15.172:6800/3866485293,v1:172.21.15.172:6801/3866485293] boot 2024-09-20T18:31:11.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:11 smithi017 ceph-mon[28058]: osdmap e26: 4 total, 4 up, 4 in 2024-09-20T18:31:11.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:11 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:31:11.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:11 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T18:31:11.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:11 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T18:31:11.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:11 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:31:12.614 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:12 smithi172 ceph-mon[35456]: from='client.24207 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:31:12.614 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:12 smithi172 ceph-mon[35456]: osdmap e27: 4 total, 4 up, 4 in 2024-09-20T18:31:12.614 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:12 smithi172 ceph-mon[35456]: Detected new or changed devices on smithi172 2024-09-20T18:31:12.614 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:12 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:12.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:12 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:12.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:12 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:31:12.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:12 smithi172 ceph-mon[35456]: Adjusting osd_memory_target on smithi172 to 14912M 2024-09-20T18:31:12.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:12 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:12.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:12 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:31:12.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:12 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:31:12.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:12 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:12.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:12 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:31:12.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:12 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:31:12.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:12 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:31:12.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:12 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:12.615 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:12 smithi172 ceph-mon[35456]: osdmap e28: 4 total, 4 up, 4 in 2024-09-20T18:31:12.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:12 smithi017 ceph-mon[28058]: from='client.24207 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:31:12.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:12 smithi017 ceph-mon[28058]: osdmap e27: 4 total, 4 up, 4 in 2024-09-20T18:31:12.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:12 smithi017 ceph-mon[28058]: Detected new or changed devices on smithi172 2024-09-20T18:31:12.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:12.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:12.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:31:12.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:12 smithi017 ceph-mon[28058]: Adjusting osd_memory_target on smithi172 to 14912M 2024-09-20T18:31:12.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:12.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:31:12.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:31:12.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:12.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:31:12.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:31:12.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:31:12.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:12 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:12.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:12 smithi017 ceph-mon[28058]: osdmap e28: 4 total, 4 up, 4 in 2024-09-20T18:31:13.884 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:13 smithi172 ceph-mon[35456]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-20T18:31:13.885 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:13 smithi172 ceph-mon[35456]: osdmap e29: 4 total, 4 up, 4 in 2024-09-20T18:31:13.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:13 smithi017 ceph-mon[28058]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-20T18:31:13.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:13 smithi017 ceph-mon[28058]: osdmap e29: 4 total, 4 up, 4 in 2024-09-20T18:31:14.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:14 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/3330092997' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e5440d7-28d3-4726-81a0-7b73e8490c90"}]: dispatch 2024-09-20T18:31:14.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:14 smithi017 ceph-mon[28058]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e5440d7-28d3-4726-81a0-7b73e8490c90"}]: dispatch 2024-09-20T18:31:14.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:14 smithi017 ceph-mon[28058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e5440d7-28d3-4726-81a0-7b73e8490c90"}]': finished 2024-09-20T18:31:14.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:14 smithi017 ceph-mon[28058]: osdmap e30: 5 total, 4 up, 5 in 2024-09-20T18:31:14.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:14 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T18:31:14.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:14 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/2218688341' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T18:31:14.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:14 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/3330092997' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e5440d7-28d3-4726-81a0-7b73e8490c90"}]: dispatch 2024-09-20T18:31:14.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:14 smithi172 ceph-mon[35456]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1e5440d7-28d3-4726-81a0-7b73e8490c90"}]: dispatch 2024-09-20T18:31:14.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:14 smithi172 ceph-mon[35456]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1e5440d7-28d3-4726-81a0-7b73e8490c90"}]': finished 2024-09-20T18:31:14.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:14 smithi172 ceph-mon[35456]: osdmap e30: 5 total, 4 up, 5 in 2024-09-20T18:31:14.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:14 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T18:31:14.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:14 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/2218688341' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T18:31:15.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:15 smithi017 ceph-mon[28058]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-20T18:31:15.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:15 smithi172 ceph-mon[35456]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-20T18:31:17.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:17 smithi017 ceph-mon[28058]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-20T18:31:17.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:17 smithi172 ceph-mon[35456]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-20T18:31:19.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:19 smithi017 ceph-mon[28058]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-20T18:31:19.952 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:19 smithi172 ceph-mon[35456]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-20T18:31:21.767 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:21 smithi172 ceph-mon[35456]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-20T18:31:21.768 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:21 smithi017 ceph-mon[28058]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-20T18:31:22.828 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:22 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-20T18:31:22.829 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:22 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:31:22.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:22 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-20T18:31:22.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:22 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:31:23.759 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:23 smithi172 ceph-mon[35456]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-20T18:31:23.759 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:23 smithi172 ceph-mon[35456]: Deploying daemon osd.4 on smithi172 2024-09-20T18:31:23.759 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:23 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:31:23.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:23 smithi017 ceph-mon[28058]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-20T18:31:23.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:23 smithi017 ceph-mon[28058]: Deploying daemon osd.4 on smithi172 2024-09-20T18:31:23.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:23 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:31:25.775 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:25 smithi172 ceph-mon[35456]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-20T18:31:25.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:25 smithi017 ceph-mon[28058]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-20T18:31:27.698 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:27 smithi172 ceph-mon[35456]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-20T18:31:27.779 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:27 smithi017 ceph-mon[28058]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-20T18:31:28.838 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:28 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:31:28.838 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:28 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:28.838 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:28 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:28.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:28 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:31:28.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:28 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:28.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:28 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:29.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:29 smithi017 ceph-mon[28058]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-20T18:31:29.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:29 smithi172 ceph-mon[35456]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-20T18:31:31.768 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:31 smithi017 ceph-mon[28058]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-20T18:31:31.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:31 smithi172 ceph-mon[35456]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-20T18:31:32.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:32.181+0000 7f48657fa640 1 -- 172.21.15.172:0/1440715393 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4868109bf0 con 0x7f485006e300 2024-09-20T18:31:32.195 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 4 on host 'smithi172' 2024-09-20T18:31:32.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:32.183+0000 7f486e86a640 1 -- 172.21.15.172:0/1440715393 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f485006e300 msgr2=0x7f48500707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:31:32.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:32.183+0000 7f486e86a640 1 --2- 172.21.15.172:0/1440715393 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f485006e300 0x7f48500707c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f485c006010 tx=0x7f485c000bc0 comp rx=0 tx=0).stop 2024-09-20T18:31:32.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:32.183+0000 7f486e86a640 1 -- 172.21.15.172:0/1440715393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4868100240 msgr2=0x7f48681996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:31:32.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:32.183+0000 7f486e86a640 1 --2- 172.21.15.172:0/1440715393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4868100240 0x7f48681996f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f485800b420 tx=0x7f485800b8e0 comp rx=0 tx=0).stop 2024-09-20T18:31:32.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:32.183+0000 7f486e86a640 1 -- 172.21.15.172:0/1440715393 shutdown_connections 2024-09-20T18:31:32.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:32.183+0000 7f486e86a640 1 --2- 172.21.15.172:0/1440715393 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f485006e300 0x7f48500707c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:31:32.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:32.183+0000 7f486e86a640 1 --2- 172.21.15.172:0/1440715393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4868100b80 0x7f4868199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:31:32.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:32.183+0000 7f486e86a640 1 --2- 172.21.15.172:0/1440715393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4868100240 0x7f48681996f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:31:32.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:32.183+0000 7f486e86a640 1 -- 172.21.15.172:0/1440715393 >> 172.21.15.172:0/1440715393 conn(0x7f48680fc010 msgr2=0x7f48680fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:31:32.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:32.183+0000 7f486e86a640 1 -- 172.21.15.172:0/1440715393 shutdown_connections 2024-09-20T18:31:32.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:32.183+0000 7f486e86a640 1 -- 172.21.15.172:0/1440715393 wait complete. 2024-09-20T18:31:32.800 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:32 smithi172 ceph-mon[35456]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-20T18:31:32.800 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:32.800 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:32.800 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:31:32.800 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:31:32.800 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:32.800 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:31:32.800 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:32.800 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:32 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:32.826 DEBUG:teuthology.orchestra.run.smithi172:osd.4> sudo journalctl -f -n 0 -u ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.4.service 2024-09-20T18:31:32.828 INFO:tasks.cephadm:Deploying osd.5 on smithi172 with /dev/vg_nvme/lv_2... 2024-09-20T18:31:32.828 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-20T18:31:32.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:32 smithi017 ceph-mon[28058]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-20T18:31:32.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:32 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:32.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:32 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:32.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:32 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:31:32.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:32 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:31:32.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:32 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:32.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:32 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:31:32.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:32 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:32.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:32 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:34.449 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T18:31:34.571 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:31:34 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[48111]: 2024-09-20T18:31:34.327+0000 7f13db6c7640 -1 osd.4 0 log_to_monitors true 2024-09-20T18:31:34.822 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:34 smithi172 ceph-mon[35456]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-20T18:31:34.822 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:34 smithi172 ceph-mon[35456]: from='osd.4 [v2:172.21.15.172:6808/503301696,v1:172.21.15.172:6809/503301696]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T18:31:34.822 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:34 smithi172 ceph-mon[35456]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T18:31:34.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:34 smithi017 ceph-mon[28058]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-20T18:31:34.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:34 smithi017 ceph-mon[28058]: from='osd.4 [v2:172.21.15.172:6808/503301696,v1:172.21.15.172:6809/503301696]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T18:31:34.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:34 smithi017 ceph-mon[28058]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-20T18:31:35.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:35 smithi172 ceph-mon[35456]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-20T18:31:35.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:35 smithi172 ceph-mon[35456]: osdmap e31: 5 total, 4 up, 5 in 2024-09-20T18:31:35.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:35 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T18:31:35.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:35 smithi172 ceph-mon[35456]: from='osd.4 [v2:172.21.15.172:6808/503301696,v1:172.21.15.172:6809/503301696]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-20T18:31:35.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:35 smithi172 ceph-mon[35456]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-20T18:31:35.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:35 smithi017 ceph-mon[28058]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-20T18:31:35.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:35 smithi017 ceph-mon[28058]: osdmap e31: 5 total, 4 up, 5 in 2024-09-20T18:31:35.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:35 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T18:31:35.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:35 smithi017 ceph-mon[28058]: from='osd.4 [v2:172.21.15.172:6808/503301696,v1:172.21.15.172:6809/503301696]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-20T18:31:35.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:35 smithi017 ceph-mon[28058]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-20T18:31:36.708 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[48111]: 2024-09-20T18:31:36.393+0000 7f13d6e27640 -1 osd.4 0 waiting for initial osdmap 2024-09-20T18:31:36.709 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[48111]: 2024-09-20T18:31:36.400+0000 7f13cf459640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T18:31:36.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-20T18:31:36.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-20T18:31:36.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: osdmap e32: 5 total, 4 up, 5 in 2024-09-20T18:31:36.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T18:31:36.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T18:31:36.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: Detected new or changed devices on smithi172 2024-09-20T18:31:36.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:36.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:36.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:31:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:31:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: Adjusting osd_memory_target on smithi172 to 7456M 2024-09-20T18:31:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:31:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:31:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: from='osd.4 ' entity='osd.4' 2024-09-20T18:31:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: osd.4 [v2:172.21.15.172:6808/503301696,v1:172.21.15.172:6809/503301696] boot 2024-09-20T18:31:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: osdmap e33: 5 total, 5 up, 5 in 2024-09-20T18:31:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:36 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T18:31:36.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 357 GiB / 358 GiB avail 2024-09-20T18:31:36.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-20T18:31:36.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: osdmap e32: 5 total, 4 up, 5 in 2024-09-20T18:31:36.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T18:31:36.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T18:31:36.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: Detected new or changed devices on smithi172 2024-09-20T18:31:36.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:36.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:36.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:31:36.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:31:36.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: Adjusting osd_memory_target on smithi172 to 7456M 2024-09-20T18:31:36.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:36.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:31:36.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:31:36.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:36.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: from='osd.4 ' entity='osd.4' 2024-09-20T18:31:36.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: osd.4 [v2:172.21.15.172:6808/503301696,v1:172.21.15.172:6809/503301696] boot 2024-09-20T18:31:36.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: osdmap e33: 5 total, 5 up, 5 in 2024-09-20T18:31:36.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:36 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T18:31:37.448 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-20T18:31:37.474 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi172:vg_nvme/lv_2 2024-09-20T18:31:37.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:37 smithi172 ceph-mon[35456]: purged_snaps scrub starts 2024-09-20T18:31:37.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:37 smithi172 ceph-mon[35456]: purged_snaps scrub ok 2024-09-20T18:31:37.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:37 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:31:37.720 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T18:31:37.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:37 smithi017 ceph-mon[28058]: purged_snaps scrub starts 2024-09-20T18:31:37.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:37 smithi017 ceph-mon[28058]: purged_snaps scrub ok 2024-09-20T18:31:37.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:37 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:31:38.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.143+0000 7f83dcae5640 1 -- 172.21.15.172:0/4285257076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d8102490 msgr2=0x7f83d8104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:31:38.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.143+0000 7f83dcae5640 1 --2- 172.21.15.172:0/4285257076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d8102490 0x7f83d8104880 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009880 tx=0x7f83c802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:31:38.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.143+0000 7f83dcae5640 1 -- 172.21.15.172:0/4285257076 shutdown_connections 2024-09-20T18:31:38.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.143+0000 7f83dcae5640 1 --2- 172.21.15.172:0/4285257076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83d8104dc0 0x7f83d81071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:31:38.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.143+0000 7f83dcae5640 1 --2- 172.21.15.172:0/4285257076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d8102490 0x7f83d8104880 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:31:38.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.143+0000 7f83dcae5640 1 -- 172.21.15.172:0/4285257076 >> 172.21.15.172:0/4285257076 conn(0x7f83d80fc010 msgr2=0x7f83d80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:31:38.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.143+0000 7f83dcae5640 1 -- 172.21.15.172:0/4285257076 shutdown_connections 2024-09-20T18:31:38.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.143+0000 7f83dcae5640 1 -- 172.21.15.172:0/4285257076 wait complete. 2024-09-20T18:31:38.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.144+0000 7f83dcae5640 1 Processor -- start 2024-09-20T18:31:38.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.144+0000 7f83dcae5640 1 -- start start 2024-09-20T18:31:38.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.144+0000 7f83dcae5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d8102490 0x7f83d8101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:31:38.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.144+0000 7f83dcae5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83d8104dc0 0x7f83d8100440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:31:38.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.144+0000 7f83dcae5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f83d810a820 con 0x7f83d8104dc0 2024-09-20T18:31:38.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.144+0000 7f83dcae5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83d810a6a0 con 0x7f83d8102490 2024-09-20T18:31:38.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.144+0000 7f83d659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d8102490 0x7f83d8101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:31:38.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.144+0000 7f83d659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d8102490 0x7f83d8101d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33478/0 (socket says 172.21.15.172:33478) 2024-09-20T18:31:38.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.144+0000 7f83d659c640 1 -- 172.21.15.172:0/1191173557 learned_addr learned my addr 172.21.15.172:0/1191173557 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-20T18:31:38.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.145+0000 7f83d659c640 1 -- 172.21.15.172:0/1191173557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83d8104dc0 msgr2=0x7f83d8100440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:31:38.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.145+0000 7f83d659c640 1 --2- 172.21.15.172:0/1191173557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83d8104dc0 0x7f83d8100440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:31:38.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.145+0000 7f83d659c640 1 -- 172.21.15.172:0/1191173557 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d8100980 con 0x7f83d8102490 2024-09-20T18:31:38.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.145+0000 7f83d659c640 1 --2- 172.21.15.172:0/1191173557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d8102490 0x7f83d8101d80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f83c8006010 tx=0x7f83c80048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:31:38.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.145+0000 7f83cf7fe640 1 -- 172.21.15.172:0/1191173557 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83c803f070 con 0x7f83d8102490 2024-09-20T18:31:38.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.145+0000 7f83dcae5640 1 -- 172.21.15.172:0/1191173557 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d8100c10 con 0x7f83d8102490 2024-09-20T18:31:38.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.145+0000 7f83cf7fe640 1 -- 172.21.15.172:0/1191173557 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f83c80044d0 con 0x7f83d8102490 2024-09-20T18:31:38.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.145+0000 7f83cf7fe640 1 -- 172.21.15.172:0/1191173557 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83c8035030 con 0x7f83d8102490 2024-09-20T18:31:38.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.145+0000 7f83dcae5640 1 -- 172.21.15.172:0/1191173557 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d81011c0 con 0x7f83d8102490 2024-09-20T18:31:38.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.146+0000 7f83dcae5640 1 -- 172.21.15.172:0/1191173557 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d8102870 con 0x7f83d8102490 2024-09-20T18:31:38.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.146+0000 7f83cf7fe640 1 -- 172.21.15.172:0/1191173557 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f83c8042070 con 0x7f83d8102490 2024-09-20T18:31:38.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.147+0000 7f83cf7fe640 1 --2- 172.21.15.172:0/1191173557 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f83c406e2b0 0x7f83c4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:31:38.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.147+0000 7f83cf7fe640 1 -- 172.21.15.172:0/1191173557 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4206+0+0 (secure 0 0 0) 0x7f83c80aea20 con 0x7f83d8102490 2024-09-20T18:31:38.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.147+0000 7f83cffff640 1 --2- 172.21.15.172:0/1191173557 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f83c406e2b0 0x7f83c4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:31:38.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.148+0000 7f83cffff640 1 --2- 172.21.15.172:0/1191173557 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f83c406e2b0 0x7f83c4070770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f83d8101b00 tx=0x7f83c0006c90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:31:38.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.151+0000 7f83cf7fe640 1 -- 172.21.15.172:0/1191173557 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f83c807c870 con 0x7f83d8102490 2024-09-20T18:31:38.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:38.326+0000 7f83dcae5640 1 -- 172.21.15.172:0/1191173557 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f83d8105740 con 0x7f83c406e2b0 2024-09-20T18:31:38.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:38 smithi172 ceph-mon[35456]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 572 MiB used, 446 GiB / 447 GiB avail 2024-09-20T18:31:38.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:38 smithi172 ceph-mon[35456]: osdmap e34: 5 total, 5 up, 5 in 2024-09-20T18:31:38.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:38 smithi172 ceph-mon[35456]: from='client.24225 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:31:38.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:38 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T18:31:38.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:38 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T18:31:38.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:38 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:31:38.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:38 smithi017 ceph-mon[28058]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 572 MiB used, 446 GiB / 447 GiB avail 2024-09-20T18:31:38.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:38 smithi017 ceph-mon[28058]: osdmap e34: 5 total, 5 up, 5 in 2024-09-20T18:31:38.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:38 smithi017 ceph-mon[28058]: from='client.24225 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:31:38.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:38 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-20T18:31:38.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:38 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-20T18:31:38.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:38 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:31:40.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:40 smithi017 ceph-mon[28058]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 577 MiB used, 446 GiB / 447 GiB avail 2024-09-20T18:31:40.905 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:40 smithi172 ceph-mon[35456]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 577 MiB used, 446 GiB / 447 GiB avail 2024-09-20T18:31:41.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:41 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/691595476' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56758921-ec3d-4dbd-8aa2-c23cebba688c"}]: dispatch 2024-09-20T18:31:41.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:41 smithi017 ceph-mon[28058]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56758921-ec3d-4dbd-8aa2-c23cebba688c"}]: dispatch 2024-09-20T18:31:41.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:41 smithi017 ceph-mon[28058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56758921-ec3d-4dbd-8aa2-c23cebba688c"}]': finished 2024-09-20T18:31:41.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:41 smithi017 ceph-mon[28058]: osdmap e35: 6 total, 5 up, 6 in 2024-09-20T18:31:41.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:41 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T18:31:41.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:41 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/4113333912' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T18:31:41.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:41 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/691595476' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56758921-ec3d-4dbd-8aa2-c23cebba688c"}]: dispatch 2024-09-20T18:31:41.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:41 smithi172 ceph-mon[35456]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56758921-ec3d-4dbd-8aa2-c23cebba688c"}]: dispatch 2024-09-20T18:31:41.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:41 smithi172 ceph-mon[35456]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56758921-ec3d-4dbd-8aa2-c23cebba688c"}]': finished 2024-09-20T18:31:41.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:41 smithi172 ceph-mon[35456]: osdmap e35: 6 total, 5 up, 6 in 2024-09-20T18:31:41.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:41 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T18:31:41.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:41 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/4113333912' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-20T18:31:42.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:42 smithi172 ceph-mon[35456]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 577 MiB used, 446 GiB / 447 GiB avail 2024-09-20T18:31:42.992 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:42 smithi017 ceph-mon[28058]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 577 MiB used, 446 GiB / 447 GiB avail 2024-09-20T18:31:44.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:44 smithi172 ceph-mon[35456]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:31:45.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:44 smithi017 ceph-mon[28058]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:31:46.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:46 smithi172 ceph-mon[35456]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:31:47.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:46 smithi017 ceph-mon[28058]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:31:48.951 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:48 smithi172 ceph-mon[35456]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:31:49.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:48 smithi017 ceph-mon[28058]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:31:49.804 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:49 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-20T18:31:49.804 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:49 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:31:49.804 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:49 smithi172 ceph-mon[35456]: Deploying daemon osd.5 on smithi172 2024-09-20T18:31:50.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:49 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-20T18:31:50.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:49 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:31:50.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:49 smithi017 ceph-mon[28058]: Deploying daemon osd.5 on smithi172 2024-09-20T18:31:50.860 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:50 smithi172 ceph-mon[35456]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:31:51.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:50 smithi017 ceph-mon[28058]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:31:52.741 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:52 smithi172 ceph-mon[35456]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:31:52.741 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:52 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:31:53.133 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:52 smithi017 ceph-mon[28058]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:31:53.133 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:52 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:31:55.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:54 smithi017 ceph-mon[28058]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:31:55.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:54 smithi172 ceph-mon[35456]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:31:55.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:55 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:31:55.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:55 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:56.084 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:55 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:56.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:55 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:31:56.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:55 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:56.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:55 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:57.266 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:56 smithi172 ceph-mon[35456]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:31:57.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:56 smithi017 ceph-mon[28058]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:31:58.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:58.847+0000 7f83cf7fe640 1 -- 172.21.15.172:0/1191173557 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f83d8105740 con 0x7f83c406e2b0 2024-09-20T18:31:58.861 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 5 on host 'smithi172' 2024-09-20T18:31:58.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:58.849+0000 7f83dcae5640 1 -- 172.21.15.172:0/1191173557 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f83c406e2b0 msgr2=0x7f83c4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:31:58.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:58.849+0000 7f83dcae5640 1 --2- 172.21.15.172:0/1191173557 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f83c406e2b0 0x7f83c4070770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f83d8101b00 tx=0x7f83c0006c90 comp rx=0 tx=0).stop 2024-09-20T18:31:58.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:58.849+0000 7f83dcae5640 1 -- 172.21.15.172:0/1191173557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d8102490 msgr2=0x7f83d8101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:31:58.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:58.849+0000 7f83dcae5640 1 --2- 172.21.15.172:0/1191173557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d8102490 0x7f83d8101d80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f83c8006010 tx=0x7f83c80048f0 comp rx=0 tx=0).stop 2024-09-20T18:31:58.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:58.850+0000 7f83dcae5640 1 -- 172.21.15.172:0/1191173557 shutdown_connections 2024-09-20T18:31:58.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:58.850+0000 7f83dcae5640 1 --2- 172.21.15.172:0/1191173557 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f83c406e2b0 0x7f83c4070770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:31:58.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:58.850+0000 7f83dcae5640 1 --2- 172.21.15.172:0/1191173557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83d8104dc0 0x7f83d8100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:31:58.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:58.850+0000 7f83dcae5640 1 --2- 172.21.15.172:0/1191173557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d8102490 0x7f83d8101d80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:31:58.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:58.850+0000 7f83dcae5640 1 -- 172.21.15.172:0/1191173557 >> 172.21.15.172:0/1191173557 conn(0x7f83d80fc010 msgr2=0x7f83d80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:31:58.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:58.850+0000 7f83dcae5640 1 -- 172.21.15.172:0/1191173557 shutdown_connections 2024-09-20T18:31:58.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:31:58.850+0000 7f83dcae5640 1 -- 172.21.15.172:0/1191173557 wait complete. 2024-09-20T18:31:59.184 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:58 smithi172 ceph-mon[35456]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:31:59.184 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:58 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:59.184 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:31:58 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:59.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:58 smithi017 ceph-mon[28058]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:31:59.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:58 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:59.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:31:58 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:31:59.518 DEBUG:teuthology.orchestra.run.smithi172:osd.5> sudo journalctl -f -n 0 -u ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.5.service 2024-09-20T18:31:59.521 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-20T18:31:59.521 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-20T18:31:59.794 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:00.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.198+0000 7f0d34177640 1 -- 172.21.15.17:0/2772316194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d2c101a60 msgr2=0x7f0d2c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:00.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.199+0000 7f0d34177640 1 --2- 172.21.15.17:0/2772316194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d2c101a60 0x7f0d2c101ee0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009880 tx=0x7f0d1c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:00.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.199+0000 7f0d34177640 1 -- 172.21.15.17:0/2772316194 shutdown_connections 2024-09-20T18:32:00.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.199+0000 7f0d34177640 1 --2- 172.21.15.17:0/2772316194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d2c101a60 0x7f0d2c101ee0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:00.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.199+0000 7f0d34177640 1 --2- 172.21.15.17:0/2772316194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d2c100860 0x7f0d2c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:00.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.199+0000 7f0d34177640 1 -- 172.21.15.17:0/2772316194 >> 172.21.15.17:0/2772316194 conn(0x7f0d2c0fc010 msgr2=0x7f0d2c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:00.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.199+0000 7f0d34177640 1 -- 172.21.15.17:0/2772316194 shutdown_connections 2024-09-20T18:32:00.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.199+0000 7f0d34177640 1 -- 172.21.15.17:0/2772316194 wait complete. 2024-09-20T18:32:00.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.199+0000 7f0d34177640 1 Processor -- start 2024-09-20T18:32:00.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.199+0000 7f0d34177640 1 -- start start 2024-09-20T18:32:00.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.200+0000 7f0d34177640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d2c100860 0x7f0d2c1996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:00.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.200+0000 7f0d34177640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d2c101a60 0x7f0d2c199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:00.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.200+0000 7f0d34177640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c1096a0 con 0x7f0d2c100860 2024-09-20T18:32:00.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.200+0000 7f0d34177640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c109520 con 0x7f0d2c101a60 2024-09-20T18:32:00.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.200+0000 7f0d31f13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d2c100860 0x7f0d2c1996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:00.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.200+0000 7f0d31f13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d2c100860 0x7f0d2c1996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42044/0 (socket says 172.21.15.17:42044) 2024-09-20T18:32:00.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.200+0000 7f0d31f13640 1 -- 172.21.15.17:0/1416906308 learned_addr learned my addr 172.21.15.17:0/1416906308 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:00.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.200+0000 7f0d31712640 1 --2- 172.21.15.17:0/1416906308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d2c101a60 0x7f0d2c199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:00.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.200+0000 7f0d31f13640 1 -- 172.21.15.17:0/1416906308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d2c101a60 msgr2=0x7f0d2c199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:00.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.200+0000 7f0d31f13640 1 --2- 172.21.15.17:0/1416906308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d2c101a60 0x7f0d2c199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:00.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.200+0000 7f0d31f13640 1 -- 172.21.15.17:0/1416906308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2c19a2b0 con 0x7f0d2c100860 2024-09-20T18:32:00.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.200+0000 7f0d31712640 1 --2- 172.21.15.17:0/1416906308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d2c101a60 0x7f0d2c199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:32:00.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.200+0000 7f0d31f13640 1 --2- 172.21.15.17:0/1416906308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d2c100860 0x7f0d2c1996f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800e940 tx=0x7f0d2800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:00.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.200+0000 7f0d22ffd640 1 -- 172.21.15.17:0/1416906308 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d2800cac0 con 0x7f0d2c100860 2024-09-20T18:32:00.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.200+0000 7f0d22ffd640 1 -- 172.21.15.17:0/1416906308 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d2800cc60 con 0x7f0d2c100860 2024-09-20T18:32:00.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.200+0000 7f0d22ffd640 1 -- 172.21.15.17:0/1416906308 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d28003e30 con 0x7f0d2c100860 2024-09-20T18:32:00.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.200+0000 7f0d34177640 1 -- 172.21.15.17:0/1416906308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d2c19ecf0 con 0x7f0d2c100860 2024-09-20T18:32:00.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.201+0000 7f0d34177640 1 -- 172.21.15.17:0/1416906308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d2c19f1c0 con 0x7f0d2c100860 2024-09-20T18:32:00.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.202+0000 7f0d34177640 1 -- 172.21.15.17:0/1416906308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d2c100c60 con 0x7f0d2c100860 2024-09-20T18:32:00.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.202+0000 7f0d22ffd640 1 -- 172.21.15.17:0/1416906308 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0d28004000 con 0x7f0d2c100860 2024-09-20T18:32:00.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.202+0000 7f0d22ffd640 1 --2- 172.21.15.17:0/1416906308 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f0d1806e2b0 0x7f0d18070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:00.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.203+0000 7f0d22ffd640 1 -- 172.21.15.17:0/1416906308 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4321+0+0 (secure 0 0 0) 0x7f0d2808e330 con 0x7f0d2c100860 2024-09-20T18:32:00.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.203+0000 7f0d31712640 1 --2- 172.21.15.17:0/1416906308 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f0d1806e2b0 0x7f0d18070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:00.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.203+0000 7f0d31712640 1 --2- 172.21.15.17:0/1416906308 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f0d1806e2b0 0x7f0d18070770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c006010 tx=0x7f0d1c000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:00.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.208+0000 7f0d22ffd640 1 -- 172.21.15.17:0/1416906308 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0d2805c100 con 0x7f0d2c100860 2024-09-20T18:32:00.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.384+0000 7f0d34177640 1 -- 172.21.15.17:0/1416906308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f0d2c19f6f0 con 0x7f0d2c100860 2024-09-20T18:32:00.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.385+0000 7f0d22ffd640 1 -- 172.21.15.17:0/1416906308 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v35) ==== 74+0+130 (secure 0 0 0) 0x7f0d2805fdb0 con 0x7f0d2c100860 2024-09-20T18:32:00.399 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:32:00.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.387+0000 7f0d34177640 1 -- 172.21.15.17:0/1416906308 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f0d1806e2b0 msgr2=0x7f0d18070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:00.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.387+0000 7f0d34177640 1 --2- 172.21.15.17:0/1416906308 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f0d1806e2b0 0x7f0d18070770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c006010 tx=0x7f0d1c000bc0 comp rx=0 tx=0).stop 2024-09-20T18:32:00.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.387+0000 7f0d34177640 1 -- 172.21.15.17:0/1416906308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d2c100860 msgr2=0x7f0d2c1996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:00.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.387+0000 7f0d34177640 1 --2- 172.21.15.17:0/1416906308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d2c100860 0x7f0d2c1996f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800e940 tx=0x7f0d2800ee00 comp rx=0 tx=0).stop 2024-09-20T18:32:00.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.387+0000 7f0d34177640 1 -- 172.21.15.17:0/1416906308 shutdown_connections 2024-09-20T18:32:00.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.387+0000 7f0d34177640 1 --2- 172.21.15.17:0/1416906308 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f0d1806e2b0 0x7f0d18070770 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.387+0000 7f0d34177640 1 --2- 172.21.15.17:0/1416906308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d2c101a60 0x7f0d2c199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.387+0000 7f0d34177640 1 --2- 172.21.15.17:0/1416906308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d2c100860 0x7f0d2c1996f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.387+0000 7f0d34177640 1 -- 172.21.15.17:0/1416906308 >> 172.21.15.17:0/1416906308 conn(0x7f0d2c0fc010 msgr2=0x7f0d2c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.387+0000 7f0d34177640 1 -- 172.21.15.17:0/1416906308 shutdown_connections 2024-09-20T18:32:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:00.387+0000 7f0d34177640 1 -- 172.21.15.17:0/1416906308 wait complete. 2024-09-20T18:32:00.678 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:00 smithi172 ceph-mon[35456]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:32:00.678 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:00 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:00.678 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:00 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:00.679 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:00 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/1416906308' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T18:32:00.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:00 smithi017 ceph-mon[28058]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:32:00.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:00 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:00.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:00 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:00.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:00 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1416906308' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T18:32:01.068 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"num_osds":6,"num_up_osds":5,"osd_up_since":1726857096,"num_in_osds":6,"osd_in_since":1726857100,"num_remapped_pgs":0} 2024-09-20T18:32:01.332 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:32:00 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[54854]: 2024-09-20T18:32:00.986+0000 7fe125a2f640 -1 osd.5 0 log_to_monitors true 2024-09-20T18:32:01.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:01 smithi017 ceph-mon[28058]: from='osd.5 [v2:172.21.15.172:6816/3232179537,v1:172.21.15.172:6817/3232179537]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T18:32:01.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:01 smithi017 ceph-mon[28058]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T18:32:01.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:01 smithi172 ceph-mon[35456]: from='osd.5 [v2:172.21.15.172:6816/3232179537,v1:172.21.15.172:6817/3232179537]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T18:32:01.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:01 smithi172 ceph-mon[35456]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-20T18:32:02.068 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-20T18:32:02.331 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:02.729 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:02 smithi017 ceph-mon[28058]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:32:02.729 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:02 smithi017 ceph-mon[28058]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-20T18:32:02.729 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:02 smithi017 ceph-mon[28058]: osdmap e36: 6 total, 5 up, 6 in 2024-09-20T18:32:02.729 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:02 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T18:32:02.730 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:02 smithi017 ceph-mon[28058]: from='osd.5 [v2:172.21.15.172:6816/3232179537,v1:172.21.15.172:6817/3232179537]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-20T18:32:02.730 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:02 smithi017 ceph-mon[28058]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-20T18:32:02.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.799+0000 7f43e3536640 1 -- 172.21.15.17:0/3594267268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43dc076220 msgr2=0x7f43dc074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:02.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.799+0000 7f43e3536640 1 --2- 172.21.15.17:0/3594267268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43dc076220 0x7f43dc074680 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f43d8009880 tx=0x7f43d802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:02.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.799+0000 7f43e3536640 1 -- 172.21.15.17:0/3594267268 shutdown_connections 2024-09-20T18:32:02.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.799+0000 7f43e3536640 1 --2- 172.21.15.17:0/3594267268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43dc074c50 0x7f43dc0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:02.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.799+0000 7f43e3536640 1 --2- 172.21.15.17:0/3594267268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43dc076220 0x7f43dc074680 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:02.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.799+0000 7f43e3536640 1 -- 172.21.15.17:0/3594267268 >> 172.21.15.17:0/3594267268 conn(0x7f43dc0fd0f0 msgr2=0x7f43dc0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:02.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.799+0000 7f43e3536640 1 -- 172.21.15.17:0/3594267268 shutdown_connections 2024-09-20T18:32:02.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.799+0000 7f43e3536640 1 -- 172.21.15.17:0/3594267268 wait complete. 2024-09-20T18:32:02.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.799+0000 7f43e3536640 1 Processor -- start 2024-09-20T18:32:02.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.800+0000 7f43e3536640 1 -- start start 2024-09-20T18:32:02.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.800+0000 7f43e3536640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43dc074c50 0x7f43dc19db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:02.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.800+0000 7f43e3536640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43dc076220 0x7f43dc19e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:02.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.800+0000 7f43e3536640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc110e00 con 0x7f43dc074c50 2024-09-20T18:32:02.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.800+0000 7f43e3536640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc110c80 con 0x7f43dc076220 2024-09-20T18:32:02.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.800+0000 7f43e12d2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43dc074c50 0x7f43dc19db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:02.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.800+0000 7f43e12d2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43dc074c50 0x7f43dc19db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47022/0 (socket says 172.21.15.17:47022) 2024-09-20T18:32:02.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.800+0000 7f43e12d2640 1 -- 172.21.15.17:0/1676203974 learned_addr learned my addr 172.21.15.17:0/1676203974 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:02.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.800+0000 7f43e0ad1640 1 --2- 172.21.15.17:0/1676203974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43dc076220 0x7f43dc19e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:02.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.800+0000 7f43e12d2640 1 -- 172.21.15.17:0/1676203974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43dc076220 msgr2=0x7f43dc19e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:02.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.800+0000 7f43e12d2640 1 --2- 172.21.15.17:0/1676203974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43dc076220 0x7f43dc19e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:02.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.800+0000 7f43e12d2640 1 -- 172.21.15.17:0/1676203974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43dc19e6c0 con 0x7f43dc074c50 2024-09-20T18:32:02.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.800+0000 7f43e12d2640 1 --2- 172.21.15.17:0/1676203974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43dc074c50 0x7f43dc19db00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f43d8006010 tx=0x7f43d80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:02.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.801+0000 7f43d27fc640 1 -- 172.21.15.17:0/1676203974 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f43d803f070 con 0x7f43dc074c50 2024-09-20T18:32:02.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.801+0000 7f43e3536640 1 -- 172.21.15.17:0/1676203974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43dc1a30a0 con 0x7f43dc074c50 2024-09-20T18:32:02.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.801+0000 7f43d27fc640 1 -- 172.21.15.17:0/1676203974 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f43d80044d0 con 0x7f43dc074c50 2024-09-20T18:32:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.801+0000 7f43d27fc640 1 -- 172.21.15.17:0/1676203974 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f43d8035030 con 0x7f43dc074c50 2024-09-20T18:32:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.801+0000 7f43e3536640 1 -- 172.21.15.17:0/1676203974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43dc1a36b0 con 0x7f43dc074c50 2024-09-20T18:32:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.802+0000 7f43e3536640 1 -- 172.21.15.17:0/1676203974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43dc0750b0 con 0x7f43dc074c50 2024-09-20T18:32:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.802+0000 7f43d27fc640 1 -- 172.21.15.17:0/1676203974 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f43d8042070 con 0x7f43dc074c50 2024-09-20T18:32:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.803+0000 7f43d27fc640 1 --2- 172.21.15.17:0/1676203974 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f43c806e2b0 0x7f43c8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.803+0000 7f43d27fc640 1 -- 172.21.15.17:0/1676203974 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4358+0+0 (secure 0 0 0) 0x7f43d80ae8c0 con 0x7f43dc074c50 2024-09-20T18:32:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.803+0000 7f43e0ad1640 1 --2- 172.21.15.17:0/1676203974 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f43c806e2b0 0x7f43c8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.803+0000 7f43e0ad1640 1 --2- 172.21.15.17:0/1676203974 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f43c806e2b0 0x7f43c8070770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f43dc19efb0 tx=0x7f43cc009110 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:02.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.807+0000 7f43d27fc640 1 -- 172.21.15.17:0/1676203974 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f43d807c670 con 0x7f43dc074c50 2024-09-20T18:32:02.947 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:32:02 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[54854]: 2024-09-20T18:32:02.589+0000 7fe12118f640 -1 osd.5 0 waiting for initial osdmap 2024-09-20T18:32:02.948 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:32:02 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[54854]: 2024-09-20T18:32:02.595+0000 7fe11d7c9640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T18:32:02.948 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:02 smithi172 ceph-mon[35456]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:32:02.948 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:02 smithi172 ceph-mon[35456]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-20T18:32:02.948 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:02 smithi172 ceph-mon[35456]: osdmap e36: 6 total, 5 up, 6 in 2024-09-20T18:32:02.948 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:02 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T18:32:02.948 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:02 smithi172 ceph-mon[35456]: from='osd.5 [v2:172.21.15.172:6816/3232179537,v1:172.21.15.172:6817/3232179537]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-20T18:32:02.948 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:02 smithi172 ceph-mon[35456]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-20T18:32:02.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.985+0000 7f43e3536640 1 -- 172.21.15.17:0/1676203974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f43dc197c10 con 0x7f43dc074c50 2024-09-20T18:32:02.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.986+0000 7f43d27fc640 1 -- 172.21.15.17:0/1676203974 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) ==== 74+0+130 (secure 0 0 0) 0x7f43d8080320 con 0x7f43dc074c50 2024-09-20T18:32:03.000 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:32:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.989+0000 7f43e3536640 1 -- 172.21.15.17:0/1676203974 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f43c806e2b0 msgr2=0x7f43c8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.989+0000 7f43e3536640 1 --2- 172.21.15.17:0/1676203974 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f43c806e2b0 0x7f43c8070770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f43dc19efb0 tx=0x7f43cc009110 comp rx=0 tx=0).stop 2024-09-20T18:32:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.989+0000 7f43e3536640 1 -- 172.21.15.17:0/1676203974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43dc074c50 msgr2=0x7f43dc19db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.989+0000 7f43e3536640 1 --2- 172.21.15.17:0/1676203974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43dc074c50 0x7f43dc19db00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f43d8006010 tx=0x7f43d80048f0 comp rx=0 tx=0).stop 2024-09-20T18:32:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.989+0000 7f43e3536640 1 -- 172.21.15.17:0/1676203974 shutdown_connections 2024-09-20T18:32:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.989+0000 7f43e3536640 1 --2- 172.21.15.17:0/1676203974 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f43c806e2b0 0x7f43c8070770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.989+0000 7f43e3536640 1 --2- 172.21.15.17:0/1676203974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43dc076220 0x7f43dc19e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.989+0000 7f43e3536640 1 --2- 172.21.15.17:0/1676203974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43dc074c50 0x7f43dc19db00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.989+0000 7f43e3536640 1 -- 172.21.15.17:0/1676203974 >> 172.21.15.17:0/1676203974 conn(0x7f43dc0fd0f0 msgr2=0x7f43dc1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.989+0000 7f43e3536640 1 -- 172.21.15.17:0/1676203974 shutdown_connections 2024-09-20T18:32:03.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:02.989+0000 7f43e3536640 1 -- 172.21.15.17:0/1676203974 wait complete. 2024-09-20T18:32:03.797 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":37,"num_osds":6,"num_up_osds":5,"osd_up_since":1726857096,"num_in_osds":6,"osd_in_since":1726857100,"num_remapped_pgs":0} 2024-09-20T18:32:03.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-20T18:32:03.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: osdmap e37: 6 total, 5 up, 6 in 2024-09-20T18:32:03.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T18:32:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T18:32:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: Detected new or changed devices on smithi172 2024-09-20T18:32:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:32:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:32:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:32:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: Adjusting osd_memory_target on smithi172 to 4970M 2024-09-20T18:32:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:32:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:32:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1676203974' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T18:32:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:32:03.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:32:03.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:32:03.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:03.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-20T18:32:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: osdmap e37: 6 total, 5 up, 6 in 2024-09-20T18:32:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T18:32:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T18:32:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: Detected new or changed devices on smithi172 2024-09-20T18:32:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:32:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:32:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:32:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: Adjusting osd_memory_target on smithi172 to 4970M 2024-09-20T18:32:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:32:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:32:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:03.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/1676203974' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T18:32:03.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:32:03.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:32:03.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:32:03.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:04.797 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-20T18:32:04.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:04 smithi017 ceph-mon[28058]: purged_snaps scrub starts 2024-09-20T18:32:04.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:04 smithi017 ceph-mon[28058]: purged_snaps scrub ok 2024-09-20T18:32:04.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:04 smithi017 ceph-mon[28058]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:32:04.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:04 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T18:32:04.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:04 smithi017 ceph-mon[28058]: osd.5 [v2:172.21.15.172:6816/3232179537,v1:172.21.15.172:6817/3232179537] boot 2024-09-20T18:32:04.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:04 smithi017 ceph-mon[28058]: osdmap e38: 6 total, 6 up, 6 in 2024-09-20T18:32:04.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:04 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T18:32:04.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:04 smithi172 ceph-mon[35456]: purged_snaps scrub starts 2024-09-20T18:32:04.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:04 smithi172 ceph-mon[35456]: purged_snaps scrub ok 2024-09-20T18:32:04.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:04 smithi172 ceph-mon[35456]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 176 MiB used, 447 GiB / 447 GiB avail 2024-09-20T18:32:04.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:04 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T18:32:04.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:04 smithi172 ceph-mon[35456]: osd.5 [v2:172.21.15.172:6816/3232179537,v1:172.21.15.172:6817/3232179537] boot 2024-09-20T18:32:04.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:04 smithi172 ceph-mon[35456]: osdmap e38: 6 total, 6 up, 6 in 2024-09-20T18:32:04.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:04 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T18:32:05.068 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.473+0000 7f56b23ae640 1 -- 172.21.15.17:0/922356477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac102b60 msgr2=0x7f56ac102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.473+0000 7f56b23ae640 1 --2- 172.21.15.17:0/922356477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac102b60 0x7f56ac102fe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5694009880 tx=0x7f569402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.473+0000 7f56b23ae640 1 -- 172.21.15.17:0/922356477 shutdown_connections 2024-09-20T18:32:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.473+0000 7f56b23ae640 1 --2- 172.21.15.17:0/922356477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac102b60 0x7f56ac102fe0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:05.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.473+0000 7f56b23ae640 1 --2- 172.21.15.17:0/922356477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56ac101960 0x7f56ac101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:05.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.473+0000 7f56b23ae640 1 -- 172.21.15.17:0/922356477 >> 172.21.15.17:0/922356477 conn(0x7f56ac0fd0f0 msgr2=0x7f56ac0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:05.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.473+0000 7f56b23ae640 1 -- 172.21.15.17:0/922356477 shutdown_connections 2024-09-20T18:32:05.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.473+0000 7f56b23ae640 1 -- 172.21.15.17:0/922356477 wait complete. 2024-09-20T18:32:05.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.474+0000 7f56b23ae640 1 Processor -- start 2024-09-20T18:32:05.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.474+0000 7f56b23ae640 1 -- start start 2024-09-20T18:32:05.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.474+0000 7f56b23ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac101960 0x7f56ac197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:05.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.474+0000 7f56b23ae640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56ac102b60 0x7f56ac197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:05.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.474+0000 7f56b23ae640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac10a820 con 0x7f56ac101960 2024-09-20T18:32:05.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.474+0000 7f56b23ae640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac10a6a0 con 0x7f56ac102b60 2024-09-20T18:32:05.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.474+0000 7f56abfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac101960 0x7f56ac197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:05.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.474+0000 7f56abfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac101960 0x7f56ac197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47048/0 (socket says 172.21.15.17:47048) 2024-09-20T18:32:05.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.474+0000 7f56abfff640 1 -- 172.21.15.17:0/3683889640 learned_addr learned my addr 172.21.15.17:0/3683889640 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:05.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.474+0000 7f56a3fff640 1 --2- 172.21.15.17:0/3683889640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56ac102b60 0x7f56ac197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:05.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.475+0000 7f56abfff640 1 -- 172.21.15.17:0/3683889640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56ac102b60 msgr2=0x7f56ac197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:05.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.475+0000 7f56abfff640 1 --2- 172.21.15.17:0/3683889640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56ac102b60 0x7f56ac197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:05.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.475+0000 7f56abfff640 1 -- 172.21.15.17:0/3683889640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac1980d0 con 0x7f56ac101960 2024-09-20T18:32:05.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.475+0000 7f56a3fff640 1 --2- 172.21.15.17:0/3683889640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56ac102b60 0x7f56ac197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:32:05.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.475+0000 7f56abfff640 1 --2- 172.21.15.17:0/3683889640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac101960 0x7f56ac197510 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f569c00b3d0 tx=0x7f569c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:05.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.475+0000 7f56a9ffb640 1 -- 172.21.15.17:0/3683889640 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f569c015020 con 0x7f56ac101960 2024-09-20T18:32:05.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.475+0000 7f56a9ffb640 1 -- 172.21.15.17:0/3683889640 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f569c011af0 con 0x7f56ac101960 2024-09-20T18:32:05.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.475+0000 7f56b23ae640 1 -- 172.21.15.17:0/3683889640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ac19cb10 con 0x7f56ac101960 2024-09-20T18:32:05.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.475+0000 7f56a9ffb640 1 -- 172.21.15.17:0/3683889640 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f569c010da0 con 0x7f56ac101960 2024-09-20T18:32:05.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.475+0000 7f56b23ae640 1 -- 172.21.15.17:0/3683889640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ac19d0a0 con 0x7f56ac101960 2024-09-20T18:32:05.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.476+0000 7f56b23ae640 1 -- 172.21.15.17:0/3683889640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ac101d60 con 0x7f56ac101960 2024-09-20T18:32:05.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.477+0000 7f56a9ffb640 1 -- 172.21.15.17:0/3683889640 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f569c018020 con 0x7f56ac101960 2024-09-20T18:32:05.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.477+0000 7f56a9ffb640 1 --2- 172.21.15.17:0/3683889640 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f569806e2b0 0x7f5698070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:05.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.478+0000 7f56a3fff640 1 --2- 172.21.15.17:0/3683889640 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f569806e2b0 0x7f5698070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:05.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.478+0000 7f56a9ffb640 1 -- 172.21.15.17:0/3683889640 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f569c08daf0 con 0x7f56ac101960 2024-09-20T18:32:05.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.478+0000 7f56a3fff640 1 --2- 172.21.15.17:0/3683889640 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f569806e2b0 0x7f5698070770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f56ac1989c0 tx=0x7f5694005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:05.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.482+0000 7f56a9ffb640 1 -- 172.21.15.17:0/3683889640 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f569c01f020 con 0x7f56ac101960 2024-09-20T18:32:05.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.662+0000 7f56b23ae640 1 -- 172.21.15.17:0/3683889640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f56ac191630 con 0x7f56ac101960 2024-09-20T18:32:05.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.662+0000 7f56a9ffb640 1 -- 172.21.15.17:0/3683889640 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) ==== 74+0+130 (secure 0 0 0) 0x7f569c05b6f0 con 0x7f56ac101960 2024-09-20T18:32:05.676 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:32:05.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.665+0000 7f56b23ae640 1 -- 172.21.15.17:0/3683889640 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f569806e2b0 msgr2=0x7f5698070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:05.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.665+0000 7f56b23ae640 1 --2- 172.21.15.17:0/3683889640 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f569806e2b0 0x7f5698070770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f56ac1989c0 tx=0x7f5694005a20 comp rx=0 tx=0).stop 2024-09-20T18:32:05.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.665+0000 7f56b23ae640 1 -- 172.21.15.17:0/3683889640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac101960 msgr2=0x7f56ac197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:05.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.665+0000 7f56b23ae640 1 --2- 172.21.15.17:0/3683889640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac101960 0x7f56ac197510 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f569c00b3d0 tx=0x7f569c00b890 comp rx=0 tx=0).stop 2024-09-20T18:32:05.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.665+0000 7f56b23ae640 1 -- 172.21.15.17:0/3683889640 shutdown_connections 2024-09-20T18:32:05.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.665+0000 7f56b23ae640 1 --2- 172.21.15.17:0/3683889640 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f569806e2b0 0x7f5698070770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:05.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.665+0000 7f56b23ae640 1 --2- 172.21.15.17:0/3683889640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56ac102b60 0x7f56ac197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:05.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.665+0000 7f56b23ae640 1 --2- 172.21.15.17:0/3683889640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56ac101960 0x7f56ac197510 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:05.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.665+0000 7f56b23ae640 1 -- 172.21.15.17:0/3683889640 >> 172.21.15.17:0/3683889640 conn(0x7f56ac0fd0f0 msgr2=0x7f56ac106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:05.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.665+0000 7f56b23ae640 1 -- 172.21.15.17:0/3683889640 shutdown_connections 2024-09-20T18:32:05.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:05.665+0000 7f56b23ae640 1 -- 172.21.15.17:0/3683889640 wait complete. 2024-09-20T18:32:05.680 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:05 smithi017 ceph-mon[28058]: osdmap e39: 6 total, 6 up, 6 in 2024-09-20T18:32:05.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:05 smithi172 ceph-mon[35456]: osdmap e39: 6 total, 6 up, 6 in 2024-09-20T18:32:06.355 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":39,"num_osds":6,"num_up_osds":6,"osd_up_since":1726857123,"num_in_osds":6,"osd_in_since":1726857100,"num_remapped_pgs":0} 2024-09-20T18:32:06.356 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-20T18:32:06.614 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:06.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:06 smithi017 ceph-mon[28058]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:06.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:06 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3683889640' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T18:32:06.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:06 smithi172 ceph-mon[35456]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:06.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:06 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3683889640' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-20T18:32:07.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.064+0000 7f6b530b7640 1 -- 172.21.15.17:0/4137518829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c100800 msgr2=0x7f6b4c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:07.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.064+0000 7f6b530b7640 1 --2- 172.21.15.17:0/4137518829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c100800 0x7f6b4c100c60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009c20 tx=0x7f6b4002a970 comp rx=0 tx=0).stop 2024-09-20T18:32:07.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.064+0000 7f6b530b7640 1 -- 172.21.15.17:0/4137518829 shutdown_connections 2024-09-20T18:32:07.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.064+0000 7f6b530b7640 1 --2- 172.21.15.17:0/4137518829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c100800 0x7f6b4c100c60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:07.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.064+0000 7f6b530b7640 1 --2- 172.21.15.17:0/4137518829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b4c106800 0x7f6b4c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:07.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.064+0000 7f6b530b7640 1 -- 172.21.15.17:0/4137518829 >> 172.21.15.17:0/4137518829 conn(0x7f6b4c0fc520 msgr2=0x7f6b4c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:07.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.064+0000 7f6b530b7640 1 -- 172.21.15.17:0/4137518829 shutdown_connections 2024-09-20T18:32:07.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.064+0000 7f6b530b7640 1 -- 172.21.15.17:0/4137518829 wait complete. 2024-09-20T18:32:07.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.065+0000 7f6b530b7640 1 Processor -- start 2024-09-20T18:32:07.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.065+0000 7f6b530b7640 1 -- start start 2024-09-20T18:32:07.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.065+0000 7f6b530b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c100800 0x7f6b4c198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:07.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.065+0000 7f6b530b7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b4c106800 0x7f6b4c198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:07.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.065+0000 7f6b530b7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c10dd30 con 0x7f6b4c100800 2024-09-20T18:32:07.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.065+0000 7f6b530b7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c10dbb0 con 0x7f6b4c106800 2024-09-20T18:32:07.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.065+0000 7f6b50e53640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c100800 0x7f6b4c198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:07.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.065+0000 7f6b50e53640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c100800 0x7f6b4c198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47070/0 (socket says 172.21.15.17:47070) 2024-09-20T18:32:07.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.065+0000 7f6b50e53640 1 -- 172.21.15.17:0/3356308743 learned_addr learned my addr 172.21.15.17:0/3356308743 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:07.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.066+0000 7f6b4bfff640 1 --2- 172.21.15.17:0/3356308743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b4c106800 0x7f6b4c198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:07.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.066+0000 7f6b50e53640 1 -- 172.21.15.17:0/3356308743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b4c106800 msgr2=0x7f6b4c198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:07.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.066+0000 7f6b50e53640 1 --2- 172.21.15.17:0/3356308743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b4c106800 0x7f6b4c198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:07.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.066+0000 7f6b50e53640 1 -- 172.21.15.17:0/3356308743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c199440 con 0x7f6b4c100800 2024-09-20T18:32:07.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.066+0000 7f6b50e53640 1 --2- 172.21.15.17:0/3356308743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c100800 0x7f6b4c198900 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00b420 tx=0x7f6b3c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:07.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.066+0000 7f6b49ffb640 1 -- 172.21.15.17:0/3356308743 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b3c011630 con 0x7f6b4c100800 2024-09-20T18:32:07.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.066+0000 7f6b49ffb640 1 -- 172.21.15.17:0/3356308743 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b3c016070 con 0x7f6b4c100800 2024-09-20T18:32:07.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.066+0000 7f6b530b7640 1 -- 172.21.15.17:0/3356308743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4c199730 con 0x7f6b4c100800 2024-09-20T18:32:07.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.066+0000 7f6b49ffb640 1 -- 172.21.15.17:0/3356308743 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b3c010d40 con 0x7f6b4c100800 2024-09-20T18:32:07.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.066+0000 7f6b530b7640 1 -- 172.21.15.17:0/3356308743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4c1a1d30 con 0x7f6b4c100800 2024-09-20T18:32:07.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.067+0000 7f6b530b7640 1 -- 172.21.15.17:0/3356308743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b4c101f40 con 0x7f6b4c100800 2024-09-20T18:32:07.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.068+0000 7f6b49ffb640 1 -- 172.21.15.17:0/3356308743 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6b3c01b460 con 0x7f6b4c100800 2024-09-20T18:32:07.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.068+0000 7f6b49ffb640 1 --2- 172.21.15.17:0/3356308743 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f6b3406e2b0 0x7f6b34070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:07.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.068+0000 7f6b49ffb640 1 -- 172.21.15.17:0/3356308743 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f6b3c08d680 con 0x7f6b4c100800 2024-09-20T18:32:07.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.068+0000 7f6b4bfff640 1 --2- 172.21.15.17:0/3356308743 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f6b3406e2b0 0x7f6b34070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:07.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.069+0000 7f6b4bfff640 1 --2- 172.21.15.17:0/3356308743 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f6b3406e2b0 0x7f6b34070770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6b40006010 tx=0x7f6b40009380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:07.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.073+0000 7f6b49ffb640 1 -- 172.21.15.17:0/3356308743 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6b4c199730 con 0x7f6b4c100800 2024-09-20T18:32:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.251+0000 7f6b530b7640 1 -- 172.21.15.17:0/3356308743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b4c108d90 con 0x7f6b4c100800 2024-09-20T18:32:07.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.252+0000 7f6b49ffb640 1 -- 172.21.15.17:0/3356308743 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11365 (secure 0 0 0) 0x7f6b3c05b320 con 0x7f6b4c100800 2024-09-20T18:32:07.267 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:32:07.267 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":39,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","created":"2024-09-20T18:26:16.474373+0000","modified":"2024-09-20T18:32:04.594620+0000","last_up_change":"2024-09-20T18:32:03.588885+0000","last_in_change":"2024-09-20T18:31:40.653300+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T18:30:47.993676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3046c2d-32a3-4007-bf81-f0df8bc45e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":159236871},{"type":"v1","addr":"172.21.15.17:6803","nonce":159236871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":159236871},{"type":"v1","addr":"172.21.15.17:6805","nonce":159236871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":159236871},{"type":"v1","addr":"172.21.15.17:6809","nonce":159236871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":159236871},{"type":"v1","addr":"172.21.15.17:6807","nonce":159236871}]},"public_addr":"172.21.15.17:6803/159236871","cluster_addr":"172.21.15.17:6805/159236871","heartbeat_back_addr":"172.21.15.17:6809/159236871","heartbeat_front_addr":"172.21.15.17:6807/159236871","state":["exists","up"]},{"osd":1,"uuid":"bb694b7d-d1c1-4aa6-90f4-837c7bd79c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":227764513},{"type":"v1","addr":"172.21.15.17:6811","nonce":227764513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":227764513},{"type":"v1","addr":"172.21.15.17:6813","nonce":227764513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":227764513},{"type":"v1","addr":"172.21.15.17:6817","nonce":227764513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":227764513},{"type":"v1","addr":"172.21.15.17:6815","nonce":227764513}]},"public_addr":"172.21.15.17:6811/227764513","cluster_addr":"172.21.15.17:6813/227764513","heartbeat_back_addr":"172.21.15.17:6817/227764513","heartbeat_front_addr":"172.21.15.17:6815/227764513","state":["exists","up"]},{"osd":2,"uuid":"86d6d42c-0a7a-400f-9e2b-087bab36d8d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2070903491},{"type":"v1","addr":"172.21.15.17:6819","nonce":2070903491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2070903491},{"type":"v1","addr":"172.21.15.17:6821","nonce":2070903491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2070903491},{"type":"v1","addr":"172.21.15.17:6825","nonce":2070903491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2070903491},{"type":"v1","addr":"172.21.15.17:6823","nonce":2070903491}]},"public_addr":"172.21.15.17:6819/2070903491","cluster_addr":"172.21.15.17:6821/2070903491","heartbeat_back_addr":"172.21.15.17:6825/2070903491","heartbeat_front_addr":"172.21.15.17:6823/2070903491","state":["exists","up"]},{"osd":3,"uuid":"8ca08e10-5b3b-497f-9db4-bc544c622f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3866485293},{"type":"v1","addr":"172.21.15.172:6801","nonce":3866485293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3866485293},{"type":"v1","addr":"172.21.15.172:6803","nonce":3866485293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3866485293},{"type":"v1","addr":"172.21.15.172:6807","nonce":3866485293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3866485293},{"type":"v1","addr":"172.21.15.172:6805","nonce":3866485293}]},"public_addr":"172.21.15.172:6801/3866485293","cluster_addr":"172.21.15.172:6803/3866485293","heartbeat_back_addr":"172.21.15.172:6807/3866485293","heartbeat_front_addr":"172.21.15.172:6805/3866485293","state":["exists","up"]},{"osd":4,"uuid":"1e5440d7-28d3-4726-81a0-7b73e8490c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":503301696},{"type":"v1","addr":"172.21.15.172:6809","nonce":503301696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":503301696},{"type":"v1","addr":"172.21.15.172:6811","nonce":503301696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":503301696},{"type":"v1","addr":"172.21.15.172:6815","nonce":503301696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":503301696},{"type":"v1","addr":"172.21.15.172:6813","nonce":503301696}]},"public_addr":"172.21.15.172:6809/503301696","cluster_addr":"172.21.15.172:6811/503301696","heartbeat_back_addr":"172.21.15.172:6815/503301696","heartbeat_front_addr":"172.21.15.172:6813/503301696","state":["exists","up"]},{"osd":5,"uuid":"56758921-ec3d-4dbd-8aa2-c23cebba688c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3232179537},{"type":"v1","addr":"172.21.15.172:6817","nonce":3232179537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3232179537},{"type":"v1","addr":"172.21.15.172:6819","nonce":3232179537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3232179537},{"type":"v1","addr":"172.21.15.172:6823","nonce":3232179537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3232179537},{"type":"v1","addr":"172.21.15.172:6821","nonce":3232179537}]},"public_addr":"172.21.15.172:6817/3232179537","cluster_addr":"172.21.15.172:6819/3232179537","heartbeat_back_addr":"172.21.15.172:6823/3232179537","heartbeat_front_addr":"172.21.15.172:6821/3232179537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:29:45.463575+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:30:14.630783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:30:43.783562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:31:08.457494+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:31:35.337334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:32:02.034197+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2443650242":"2024-09-21T18:28:07.480593+0000","172.21.15.17:0/352736886":"2024-09-21T18:28:07.480593+0000","172.21.15.17:6801/513066305":"2024-09-21T18:26:38.662388+0000","172.21.15.17:6801/29863517":"2024-09-21T18:28:07.480593+0000","172.21.15.17:6800/513066305":"2024-09-21T18:26:38.662388+0000","172.21.15.17:0/3393805637":"2024-09-21T18:26:38.662388+0000","172.21.15.17:0/652312164":"2024-09-21T18:26:38.662388+0000","172.21.15.17:0/3207433207":"2024-09-21T18:27:10.529430+0000","172.21.15.17:0/2934627597":"2024-09-21T18:27:10.529430+0000","172.21.15.17:6800/3940118846":"2024-09-21T18:27:10.529430+0000","172.21.15.17:0/3160589064":"2024-09-21T18:26:38.662388+0000","172.21.15.17:6801/3940118846":"2024-09-21T18:27:10.529430+0000","172.21.15.17:0/4095439401":"2024-09-21T18:28:07.480593+0000","172.21.15.17:0/2816923133":"2024-09-21T18:27:10.529430+0000","172.21.15.17:6800/29863517":"2024-09-21T18:28:07.480593+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T18:32:07.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.254+0000 7f6b530b7640 1 -- 172.21.15.17:0/3356308743 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f6b3406e2b0 msgr2=0x7f6b34070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:07.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.254+0000 7f6b530b7640 1 --2- 172.21.15.17:0/3356308743 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f6b3406e2b0 0x7f6b34070770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6b40006010 tx=0x7f6b40009380 comp rx=0 tx=0).stop 2024-09-20T18:32:07.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.254+0000 7f6b530b7640 1 -- 172.21.15.17:0/3356308743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c100800 msgr2=0x7f6b4c198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:07.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.254+0000 7f6b530b7640 1 --2- 172.21.15.17:0/3356308743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c100800 0x7f6b4c198900 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00b420 tx=0x7f6b3c00b8e0 comp rx=0 tx=0).stop 2024-09-20T18:32:07.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.254+0000 7f6b530b7640 1 -- 172.21.15.17:0/3356308743 shutdown_connections 2024-09-20T18:32:07.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.254+0000 7f6b530b7640 1 --2- 172.21.15.17:0/3356308743 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f6b3406e2b0 0x7f6b34070770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:07.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.254+0000 7f6b530b7640 1 --2- 172.21.15.17:0/3356308743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b4c106800 0x7f6b4c198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:07.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.254+0000 7f6b530b7640 1 --2- 172.21.15.17:0/3356308743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c100800 0x7f6b4c198900 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:07.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.254+0000 7f6b530b7640 1 -- 172.21.15.17:0/3356308743 >> 172.21.15.17:0/3356308743 conn(0x7f6b4c0fc520 msgr2=0x7f6b4c0fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:07.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.254+0000 7f6b530b7640 1 -- 172.21.15.17:0/3356308743 shutdown_connections 2024-09-20T18:32:07.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:07.254+0000 7f6b530b7640 1 -- 172.21.15.17:0/3356308743 wait complete. 2024-09-20T18:32:07.795 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-20T18:30:47.993676+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-20T18:32:07.795 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-20T18:32:07.819 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:07 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3356308743' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T18:32:07.819 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:07 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:32:07.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:07 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3356308743' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T18:32:07.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:07 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:32:08.053 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:08.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.516+0000 7fd2baa81640 1 -- 172.21.15.17:0/1414899661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b4102760 msgr2=0x7fd2b4102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:08.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.516+0000 7fd2baa81640 1 --2- 172.21.15.17:0/1414899661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b4102760 0x7fd2b4102b40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009880 tx=0x7fd2a402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:08.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.516+0000 7fd2baa81640 1 -- 172.21.15.17:0/1414899661 shutdown_connections 2024-09-20T18:32:08.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.516+0000 7fd2baa81640 1 --2- 172.21.15.17:0/1414899661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2b4100160 0x7fd2b41005a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:08.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.516+0000 7fd2baa81640 1 --2- 172.21.15.17:0/1414899661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b4102760 0x7fd2b4102b40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:08.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.516+0000 7fd2baa81640 1 -- 172.21.15.17:0/1414899661 >> 172.21.15.17:0/1414899661 conn(0x7fd2b4077150 msgr2=0x7fd2b4077560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:08.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.516+0000 7fd2baa81640 1 -- 172.21.15.17:0/1414899661 shutdown_connections 2024-09-20T18:32:08.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.516+0000 7fd2baa81640 1 -- 172.21.15.17:0/1414899661 wait complete. 2024-09-20T18:32:08.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.517+0000 7fd2baa81640 1 Processor -- start 2024-09-20T18:32:08.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.517+0000 7fd2baa81640 1 -- start start 2024-09-20T18:32:08.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.517+0000 7fd2baa81640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b4100160 0x7fd2b419f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:08.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.517+0000 7fd2baa81640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2b4102760 0x7fd2b419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:08.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.517+0000 7fd2baa81640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b4111010 con 0x7fd2b4100160 2024-09-20T18:32:08.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.517+0000 7fd2baa81640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b4110e90 con 0x7fd2b4102760 2024-09-20T18:32:08.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.517+0000 7fd2b881d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b4100160 0x7fd2b419f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.517+0000 7fd2b881d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b4100160 0x7fd2b419f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47092/0 (socket says 172.21.15.17:47092) 2024-09-20T18:32:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.517+0000 7fd2b881d640 1 -- 172.21.15.17:0/3677217097 learned_addr learned my addr 172.21.15.17:0/3677217097 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.517+0000 7fd2b3fff640 1 --2- 172.21.15.17:0/3677217097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2b4102760 0x7fd2b419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.517+0000 7fd2b881d640 1 -- 172.21.15.17:0/3677217097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2b4102760 msgr2=0x7fd2b419fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.517+0000 7fd2b881d640 1 --2- 172.21.15.17:0/3677217097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2b4102760 0x7fd2b419fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.518+0000 7fd2b881d640 1 -- 172.21.15.17:0/3677217097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b4199a00 con 0x7fd2b4100160 2024-09-20T18:32:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.518+0000 7fd2b3fff640 1 --2- 172.21.15.17:0/3677217097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2b4102760 0x7fd2b419fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:32:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.518+0000 7fd2b881d640 1 --2- 172.21.15.17:0/3677217097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b4100160 0x7fd2b419f840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4031460 tx=0x7fd2a40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.518+0000 7fd2b1ffb640 1 -- 172.21.15.17:0/3677217097 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2a403f070 con 0x7fd2b4100160 2024-09-20T18:32:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.518+0000 7fd2b1ffb640 1 -- 172.21.15.17:0/3677217097 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd2a4004cf0 con 0x7fd2b4100160 2024-09-20T18:32:08.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.518+0000 7fd2baa81640 1 -- 172.21.15.17:0/3677217097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b4199c90 con 0x7fd2b4100160 2024-09-20T18:32:08.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.518+0000 7fd2b1ffb640 1 -- 172.21.15.17:0/3677217097 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2a4035030 con 0x7fd2b4100160 2024-09-20T18:32:08.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.518+0000 7fd2baa81640 1 -- 172.21.15.17:0/3677217097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b419a1c0 con 0x7fd2b4100160 2024-09-20T18:32:08.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.519+0000 7fd2baa81640 1 -- 172.21.15.17:0/3677217097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b4069e70 con 0x7fd2b4100160 2024-09-20T18:32:08.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.520+0000 7fd2b1ffb640 1 -- 172.21.15.17:0/3677217097 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fd2a4042070 con 0x7fd2b4100160 2024-09-20T18:32:08.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.520+0000 7fd2b1ffb640 1 --2- 172.21.15.17:0/3677217097 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd2a006e2b0 0x7fd2a0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:08.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.520+0000 7fd2b1ffb640 1 -- 172.21.15.17:0/3677217097 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fd2a40ae910 con 0x7fd2b4100160 2024-09-20T18:32:08.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.521+0000 7fd2b3fff640 1 --2- 172.21.15.17:0/3677217097 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd2a006e2b0 0x7fd2a0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:08.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.521+0000 7fd2b3fff640 1 --2- 172.21.15.17:0/3677217097 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd2a006e2b0 0x7fd2a0070770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd29c006fd0 tx=0x7fd29c008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:08.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.525+0000 7fd2b1ffb640 1 -- 172.21.15.17:0/3677217097 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd2a407c5b0 con 0x7fd2b4100160 2024-09-20T18:32:08.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.699+0000 7fd2baa81640 1 -- 172.21.15.17:0/3677217097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd2b419af30 con 0x7fd2b4100160 2024-09-20T18:32:08.713 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:08 smithi017 ceph-mon[28058]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:08.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.699+0000 7fd2b1ffb640 1 -- 172.21.15.17:0/3677217097 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7fd2a4080260 con 0x7fd2b4100160 2024-09-20T18:32:08.714 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-20T18:32:08.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.701+0000 7fd2baa81640 1 -- 172.21.15.17:0/3677217097 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd2a006e2b0 msgr2=0x7fd2a0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:08.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.701+0000 7fd2baa81640 1 --2- 172.21.15.17:0/3677217097 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd2a006e2b0 0x7fd2a0070770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd29c006fd0 tx=0x7fd29c008040 comp rx=0 tx=0).stop 2024-09-20T18:32:08.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.701+0000 7fd2baa81640 1 -- 172.21.15.17:0/3677217097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b4100160 msgr2=0x7fd2b419f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:08.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.701+0000 7fd2baa81640 1 --2- 172.21.15.17:0/3677217097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b4100160 0x7fd2b419f840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4031460 tx=0x7fd2a40048f0 comp rx=0 tx=0).stop 2024-09-20T18:32:08.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.701+0000 7fd2baa81640 1 -- 172.21.15.17:0/3677217097 shutdown_connections 2024-09-20T18:32:08.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.701+0000 7fd2baa81640 1 --2- 172.21.15.17:0/3677217097 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd2a006e2b0 0x7fd2a0070770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:08.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.701+0000 7fd2baa81640 1 --2- 172.21.15.17:0/3677217097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2b4102760 0x7fd2b419fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:08.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.701+0000 7fd2baa81640 1 --2- 172.21.15.17:0/3677217097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2b4100160 0x7fd2b419f840 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:08.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.701+0000 7fd2baa81640 1 -- 172.21.15.17:0/3677217097 >> 172.21.15.17:0/3677217097 conn(0x7fd2b4077150 msgr2=0x7fd2b40fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:08.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.701+0000 7fd2baa81640 1 -- 172.21.15.17:0/3677217097 shutdown_connections 2024-09-20T18:32:08.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:08.701+0000 7fd2baa81640 1 -- 172.21.15.17:0/3677217097 wait complete. 2024-09-20T18:32:08.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:08 smithi172 ceph-mon[35456]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:09.322 INFO:tasks.cephadm:Setting up client nodes... 2024-09-20T18:32:09.322 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-20T18:32:09.623 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:09.887 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:09 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3677217097' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-20T18:32:09.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:09 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3677217097' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-20T18:32:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.030+0000 7faa90ee2640 1 -- 172.21.15.17:0/2379532359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa8c100860 msgr2=0x7faa8c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.030+0000 7faa90ee2640 1 --2- 172.21.15.17:0/2379532359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa8c100860 0x7faa8c100c60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009880 tx=0x7faa7c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.030+0000 7faa90ee2640 1 -- 172.21.15.17:0/2379532359 shutdown_connections 2024-09-20T18:32:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.030+0000 7faa90ee2640 1 --2- 172.21.15.17:0/2379532359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa8c101a60 0x7faa8c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.030+0000 7faa90ee2640 1 --2- 172.21.15.17:0/2379532359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa8c100860 0x7faa8c100c60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.030+0000 7faa90ee2640 1 -- 172.21.15.17:0/2379532359 >> 172.21.15.17:0/2379532359 conn(0x7faa8c0fc010 msgr2=0x7faa8c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.030+0000 7faa90ee2640 1 -- 172.21.15.17:0/2379532359 shutdown_connections 2024-09-20T18:32:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.030+0000 7faa90ee2640 1 -- 172.21.15.17:0/2379532359 wait complete. 2024-09-20T18:32:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.031+0000 7faa90ee2640 1 Processor -- start 2024-09-20T18:32:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.031+0000 7faa90ee2640 1 -- start start 2024-09-20T18:32:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.031+0000 7faa90ee2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa8c100860 0x7faa8c197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.031+0000 7faa90ee2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa8c101a60 0x7faa8c197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.031+0000 7faa90ee2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c109700 con 0x7faa8c101a60 2024-09-20T18:32:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.031+0000 7faa90ee2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c109580 con 0x7faa8c100860 2024-09-20T18:32:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.031+0000 7faa83fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa8c101a60 0x7faa8c197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.032+0000 7faa83fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa8c101a60 0x7faa8c197ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47108/0 (socket says 172.21.15.17:47108) 2024-09-20T18:32:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.032+0000 7faa83fff640 1 -- 172.21.15.17:0/3283258774 learned_addr learned my addr 172.21.15.17:0/3283258774 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.032+0000 7faa8a59c640 1 --2- 172.21.15.17:0/3283258774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa8c100860 0x7faa8c197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.032+0000 7faa83fff640 1 -- 172.21.15.17:0/3283258774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa8c100860 msgr2=0x7faa8c197580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.032+0000 7faa83fff640 1 --2- 172.21.15.17:0/3283258774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa8c100860 0x7faa8c197580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.032+0000 7faa83fff640 1 -- 172.21.15.17:0/3283258774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8c198140 con 0x7faa8c101a60 2024-09-20T18:32:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.032+0000 7faa83fff640 1 --2- 172.21.15.17:0/3283258774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa8c101a60 0x7faa8c197ac0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faa7400b420 tx=0x7faa7400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.032+0000 7faa837fe640 1 -- 172.21.15.17:0/3283258774 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa74011630 con 0x7faa8c101a60 2024-09-20T18:32:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.032+0000 7faa837fe640 1 -- 172.21.15.17:0/3283258774 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa74016070 con 0x7faa8c101a60 2024-09-20T18:32:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.032+0000 7faa90ee2640 1 -- 172.21.15.17:0/3283258774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa8c19cb80 con 0x7faa8c101a60 2024-09-20T18:32:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.032+0000 7faa837fe640 1 -- 172.21.15.17:0/3283258774 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa74010d40 con 0x7faa8c101a60 2024-09-20T18:32:10.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.032+0000 7faa90ee2640 1 -- 172.21.15.17:0/3283258774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa8c19d190 con 0x7faa8c101a60 2024-09-20T18:32:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.034+0000 7faa90ee2640 1 -- 172.21.15.17:0/3283258774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa8c100c60 con 0x7faa8c101a60 2024-09-20T18:32:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.034+0000 7faa837fe640 1 -- 172.21.15.17:0/3283258774 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7faa7401b460 con 0x7faa8c101a60 2024-09-20T18:32:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.034+0000 7faa837fe640 1 --2- 172.21.15.17:0/3283258774 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7faa7806e310 0x7faa780707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.035+0000 7faa837fe640 1 -- 172.21.15.17:0/3283258774 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7faa7408d5b0 con 0x7faa8c101a60 2024-09-20T18:32:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.035+0000 7faa8a59c640 1 --2- 172.21.15.17:0/3283258774 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7faa7806e310 0x7faa780707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:10.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.035+0000 7faa8a59c640 1 --2- 172.21.15.17:0/3283258774 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7faa7806e310 0x7faa780707d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009230 tx=0x7faa7c0058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.039+0000 7faa837fe640 1 -- 172.21.15.17:0/3283258774 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faa7405b2d0 con 0x7faa8c101a60 2024-09-20T18:32:10.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.280+0000 7faa90ee2640 1 -- 172.21.15.17:0/3283258774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7faa8c19d9d0 con 0x7faa8c101a60 2024-09-20T18:32:10.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.282+0000 7faa837fe640 1 -- 172.21.15.17:0/3283258774 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7faa7408d3d0 con 0x7faa8c101a60 2024-09-20T18:32:10.296 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-20T18:32:10.296 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCqv+1mA7rFEBAAB16/EWGO+c9wn/9BwAQNQQ== 2024-09-20T18:32:10.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.284+0000 7faa90ee2640 1 -- 172.21.15.17:0/3283258774 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7faa7806e310 msgr2=0x7faa780707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:10.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.284+0000 7faa90ee2640 1 --2- 172.21.15.17:0/3283258774 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7faa7806e310 0x7faa780707d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009230 tx=0x7faa7c0058d0 comp rx=0 tx=0).stop 2024-09-20T18:32:10.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.284+0000 7faa90ee2640 1 -- 172.21.15.17:0/3283258774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa8c101a60 msgr2=0x7faa8c197ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:10.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.284+0000 7faa90ee2640 1 --2- 172.21.15.17:0/3283258774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa8c101a60 0x7faa8c197ac0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faa7400b420 tx=0x7faa7400b8e0 comp rx=0 tx=0).stop 2024-09-20T18:32:10.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.284+0000 7faa90ee2640 1 -- 172.21.15.17:0/3283258774 shutdown_connections 2024-09-20T18:32:10.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.284+0000 7faa90ee2640 1 --2- 172.21.15.17:0/3283258774 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7faa7806e310 0x7faa780707d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:10.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.284+0000 7faa90ee2640 1 --2- 172.21.15.17:0/3283258774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa8c101a60 0x7faa8c197ac0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:10.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.284+0000 7faa90ee2640 1 --2- 172.21.15.17:0/3283258774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa8c100860 0x7faa8c197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:10.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.284+0000 7faa90ee2640 1 -- 172.21.15.17:0/3283258774 >> 172.21.15.17:0/3283258774 conn(0x7faa8c0fc010 msgr2=0x7faa8c06a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:10.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.284+0000 7faa90ee2640 1 -- 172.21.15.17:0/3283258774 shutdown_connections 2024-09-20T18:32:10.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:10.284+0000 7faa90ee2640 1 -- 172.21.15.17:0/3283258774 wait complete. 2024-09-20T18:32:10.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:10 smithi017 ceph-mon[28058]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:10.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:10 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3283258774' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T18:32:10.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:10 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3283258774' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-20T18:32:10.936 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T18:32:10.936 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-20T18:32:10.936 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-20T18:32:10.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:10 smithi172 ceph-mon[35456]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:10.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:10 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3283258774' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T18:32:10.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:10 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3283258774' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-20T18:32:10.975 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-20T18:32:11.236 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T18:32:11.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.634+0000 7f5f245a1640 1 -- 172.21.15.172:0/4242111516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f1c102b60 msgr2=0x7f5f1c102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:11.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.634+0000 7f5f245a1640 1 --2- 172.21.15.172:0/4242111516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f1c102b60 0x7f5f1c102fe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009880 tx=0x7f5f0c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:11.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.634+0000 7f5f245a1640 1 -- 172.21.15.172:0/4242111516 shutdown_connections 2024-09-20T18:32:11.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.634+0000 7f5f245a1640 1 --2- 172.21.15.172:0/4242111516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f1c102b60 0x7f5f1c102fe0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:11.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.634+0000 7f5f245a1640 1 --2- 172.21.15.172:0/4242111516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f1c101960 0x7f5f1c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:11.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.634+0000 7f5f245a1640 1 -- 172.21.15.172:0/4242111516 >> 172.21.15.172:0/4242111516 conn(0x7f5f1c0fd0f0 msgr2=0x7f5f1c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:11.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.634+0000 7f5f245a1640 1 -- 172.21.15.172:0/4242111516 shutdown_connections 2024-09-20T18:32:11.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.634+0000 7f5f245a1640 1 -- 172.21.15.172:0/4242111516 wait complete. 2024-09-20T18:32:11.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.634+0000 7f5f245a1640 1 Processor -- start 2024-09-20T18:32:11.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.634+0000 7f5f245a1640 1 -- start start 2024-09-20T18:32:11.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.635+0000 7f5f245a1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f1c101960 0x7f5f1c1974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:11.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.635+0000 7f5f245a1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f1c102b60 0x7f5f1c197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:11.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.635+0000 7f5f245a1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1c10a780 con 0x7f5f1c101960 2024-09-20T18:32:11.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.635+0000 7f5f245a1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1c10a600 con 0x7f5f1c102b60 2024-09-20T18:32:11.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.635+0000 7f5f21b3c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f1c102b60 0x7f5f1c197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:11.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.635+0000 7f5f21b3c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f1c102b60 0x7f5f1c197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37484/0 (socket says 172.21.15.172:37484) 2024-09-20T18:32:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.635+0000 7f5f21b3c640 1 -- 172.21.15.172:0/1122666462 learned_addr learned my addr 172.21.15.172:0/1122666462 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-20T18:32:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.635+0000 7f5f2233d640 1 --2- 172.21.15.172:0/1122666462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f1c101960 0x7f5f1c1974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.635+0000 7f5f21b3c640 1 -- 172.21.15.172:0/1122666462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f1c101960 msgr2=0x7f5f1c1974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.635+0000 7f5f21b3c640 1 --2- 172.21.15.172:0/1122666462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f1c101960 0x7f5f1c1974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.635+0000 7f5f21b3c640 1 -- 172.21.15.172:0/1122666462 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1c1980a0 con 0x7f5f1c102b60 2024-09-20T18:32:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.635+0000 7f5f21b3c640 1 --2- 172.21.15.172:0/1122666462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f1c102b60 0x7f5f1c197a20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c006010 tx=0x7f5f0c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.635+0000 7f5f137fe640 1 -- 172.21.15.172:0/1122666462 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f0c03f070 con 0x7f5f1c102b60 2024-09-20T18:32:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.635+0000 7f5f137fe640 1 -- 172.21.15.172:0/1122666462 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5f0c004ac0 con 0x7f5f1c102b60 2024-09-20T18:32:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.635+0000 7f5f245a1640 1 -- 172.21.15.172:0/1122666462 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f1c19ca80 con 0x7f5f1c102b60 2024-09-20T18:32:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.635+0000 7f5f137fe640 1 -- 172.21.15.172:0/1122666462 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f0c035030 con 0x7f5f1c102b60 2024-09-20T18:32:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.636+0000 7f5f245a1640 1 -- 172.21.15.172:0/1122666462 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f1c19d010 con 0x7f5f1c102b60 2024-09-20T18:32:11.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.636+0000 7f5f245a1640 1 -- 172.21.15.172:0/1122666462 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f1c101d60 con 0x7f5f1c102b60 2024-09-20T18:32:11.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.637+0000 7f5f137fe640 1 -- 172.21.15.172:0/1122666462 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5f0c042070 con 0x7f5f1c102b60 2024-09-20T18:32:11.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.637+0000 7f5f137fe640 1 --2- 172.21.15.172:0/1122666462 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5f0806e2b0 0x7f5f08070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:11.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.638+0000 7f5f137fe640 1 -- 172.21.15.172:0/1122666462 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f5f0c0ae970 con 0x7f5f1c102b60 2024-09-20T18:32:11.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.638+0000 7f5f2233d640 1 --2- 172.21.15.172:0/1122666462 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5f0806e2b0 0x7f5f08070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:11.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.638+0000 7f5f2233d640 1 --2- 172.21.15.172:0/1122666462 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5f0806e2b0 0x7f5f08070770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f18005fd0 tx=0x7f5f1800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:11.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.643+0000 7f5f137fe640 1 -- 172.21.15.172:0/1122666462 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5f0c0b0e20 con 0x7f5f1c102b60 2024-09-20T18:32:11.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.868+0000 7f5f245a1640 1 -- 172.21.15.172:0/1122666462 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f5f1c191590 con 0x7f5f1c102b60 2024-09-20T18:32:11.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.873+0000 7f5f137fe640 1 -- 172.21.15.172:0/1122666462 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7f5f0c0802c0 con 0x7f5f1c102b60 2024-09-20T18:32:11.888 INFO:teuthology.orchestra.run.smithi172.stdout:[client.1] 2024-09-20T18:32:11.888 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQCrv+1mS+TvMxAAJ+smSf7At06ym2cpSyKweQ== 2024-09-20T18:32:11.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.875+0000 7f5f245a1640 1 -- 172.21.15.172:0/1122666462 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5f0806e2b0 msgr2=0x7f5f08070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:11.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.875+0000 7f5f245a1640 1 --2- 172.21.15.172:0/1122666462 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5f0806e2b0 0x7f5f08070770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f18005fd0 tx=0x7f5f1800b410 comp rx=0 tx=0).stop 2024-09-20T18:32:11.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.876+0000 7f5f245a1640 1 -- 172.21.15.172:0/1122666462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f1c102b60 msgr2=0x7f5f1c197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:11.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.876+0000 7f5f245a1640 1 --2- 172.21.15.172:0/1122666462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f1c102b60 0x7f5f1c197a20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c006010 tx=0x7f5f0c0046c0 comp rx=0 tx=0).stop 2024-09-20T18:32:11.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.876+0000 7f5f245a1640 1 -- 172.21.15.172:0/1122666462 shutdown_connections 2024-09-20T18:32:11.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.876+0000 7f5f245a1640 1 --2- 172.21.15.172:0/1122666462 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5f0806e2b0 0x7f5f08070770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:11.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.876+0000 7f5f245a1640 1 --2- 172.21.15.172:0/1122666462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f1c102b60 0x7f5f1c197a20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:11.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.876+0000 7f5f245a1640 1 --2- 172.21.15.172:0/1122666462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f1c101960 0x7f5f1c1974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:11.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.876+0000 7f5f245a1640 1 -- 172.21.15.172:0/1122666462 >> 172.21.15.172:0/1122666462 conn(0x7f5f1c0fd0f0 msgr2=0x7f5f1c106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:11.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.876+0000 7f5f245a1640 1 -- 172.21.15.172:0/1122666462 shutdown_connections 2024-09-20T18:32:11.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:32:11.876+0000 7f5f245a1640 1 -- 172.21.15.172:0/1122666462 wait complete. 2024-09-20T18:32:12.522 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-20T18:32:12.522 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-20T18:32:12.522 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-20T18:32:12.558 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-20T18:32:12.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:12 smithi017 ceph-mon[28058]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:12.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:12 smithi017 ceph-mon[28058]: from='client.? 172.21.15.172:0/1122666462' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T18:32:12.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:12 smithi017 ceph-mon[28058]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T18:32:12.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:12 smithi017 ceph-mon[28058]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-20T18:32:12.955 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:12.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:12 smithi172 ceph-mon[35456]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:12.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:12 smithi172 ceph-mon[35456]: from='client.? 172.21.15.172:0/1122666462' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T18:32:12.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:12 smithi172 ceph-mon[35456]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-20T18:32:12.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:12 smithi172 ceph-mon[35456]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-20T18:32:13.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.397+0000 7f30835b2640 1 -- 172.21.15.17:0/2828074253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f307c106800 msgr2=0x7f307c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:13.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.397+0000 7f30835b2640 1 --2- 172.21.15.17:0/2828074253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f307c106800 0x7f307c106be0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3078009880 tx=0x7f307802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:13.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.397+0000 7f30835b2640 1 -- 172.21.15.17:0/2828074253 shutdown_connections 2024-09-20T18:32:13.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.397+0000 7f30835b2640 1 --2- 172.21.15.17:0/2828074253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f307c100800 0x7f307c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:13.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.397+0000 7f30835b2640 1 --2- 172.21.15.17:0/2828074253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f307c106800 0x7f307c106be0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:13.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.397+0000 7f30835b2640 1 -- 172.21.15.17:0/2828074253 >> 172.21.15.17:0/2828074253 conn(0x7f307c0fc520 msgr2=0x7f307c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:13.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.397+0000 7f30835b2640 1 -- 172.21.15.17:0/2828074253 shutdown_connections 2024-09-20T18:32:13.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.397+0000 7f30835b2640 1 -- 172.21.15.17:0/2828074253 wait complete. 2024-09-20T18:32:13.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.398+0000 7f30835b2640 1 Processor -- start 2024-09-20T18:32:13.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.398+0000 7f30835b2640 1 -- start start 2024-09-20T18:32:13.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.398+0000 7f30835b2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f307c100800 0x7f307c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:13.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.398+0000 7f30835b2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f307c106800 0x7f307c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:13.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.398+0000 7f30835b2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f307c10dcb0 con 0x7f307c106800 2024-09-20T18:32:13.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.398+0000 7f30835b2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f307c10db30 con 0x7f307c100800 2024-09-20T18:32:13.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.398+0000 7f3080b4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f307c106800 0x7f307c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:13.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.398+0000 7f3080b4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f307c106800 0x7f307c19dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34814/0 (socket says 172.21.15.17:34814) 2024-09-20T18:32:13.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.398+0000 7f3080b4d640 1 -- 172.21.15.17:0/1708243961 learned_addr learned my addr 172.21.15.17:0/1708243961 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:13.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.398+0000 7f308134e640 1 --2- 172.21.15.17:0/1708243961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f307c100800 0x7f307c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:13.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.399+0000 7f3080b4d640 1 -- 172.21.15.17:0/1708243961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f307c100800 msgr2=0x7f307c19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:13.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.399+0000 7f3080b4d640 1 --2- 172.21.15.17:0/1708243961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f307c100800 0x7f307c19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:13.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.399+0000 7f3080b4d640 1 -- 172.21.15.17:0/1708243961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c197820 con 0x7f307c106800 2024-09-20T18:32:13.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.399+0000 7f308134e640 1 --2- 172.21.15.17:0/1708243961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f307c100800 0x7f307c19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:32:13.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.399+0000 7f3080b4d640 1 --2- 172.21.15.17:0/1708243961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f307c106800 0x7f307c19dbe0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f306c00c8a0 tx=0x7f306c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.399+0000 7f30727fc640 1 -- 172.21.15.17:0/1708243961 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f306c0079b0 con 0x7f307c106800 2024-09-20T18:32:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.399+0000 7f30835b2640 1 -- 172.21.15.17:0/1708243961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307c197b10 con 0x7f307c106800 2024-09-20T18:32:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.399+0000 7f30727fc640 1 -- 172.21.15.17:0/1708243961 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f306c007b50 con 0x7f307c106800 2024-09-20T18:32:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.399+0000 7f30727fc640 1 -- 172.21.15.17:0/1708243961 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f306c018700 con 0x7f307c106800 2024-09-20T18:32:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.399+0000 7f30835b2640 1 -- 172.21.15.17:0/1708243961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f307c1980a0 con 0x7f307c106800 2024-09-20T18:32:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.400+0000 7f30835b2640 1 -- 172.21.15.17:0/1708243961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f307c101f40 con 0x7f307c106800 2024-09-20T18:32:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.401+0000 7f30727fc640 1 -- 172.21.15.17:0/1708243961 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f306c007d00 con 0x7f307c106800 2024-09-20T18:32:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.401+0000 7f30727fc640 1 --2- 172.21.15.17:0/1708243961 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f306806e2b0 0x7f3068070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.401+0000 7f30727fc640 1 -- 172.21.15.17:0/1708243961 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f306c08e220 con 0x7f307c106800 2024-09-20T18:32:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.401+0000 7f308134e640 1 --2- 172.21.15.17:0/1708243961 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f306806e2b0 0x7f3068070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.402+0000 7f308134e640 1 --2- 172.21.15.17:0/1708243961 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f306806e2b0 0x7f3068070770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3078031460 tx=0x7f3078009560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:13.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.405+0000 7f30727fc640 1 -- 172.21.15.17:0/1708243961 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f306c014030 con 0x7f307c106800 2024-09-20T18:32:13.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.586+0000 7f30835b2640 1 -- 172.21.15.17:0/1708243961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f307c198d50 con 0x7f307c106800 2024-09-20T18:32:13.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.587+0000 7f30727fc640 1 -- 172.21.15.17:0/1708243961 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v42) ==== 86+0+187 (secure 0 0 0) 0x7f306c01f300 con 0x7f307c106800 2024-09-20T18:32:13.600 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:32:13.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.589+0000 7f30835b2640 1 -- 172.21.15.17:0/1708243961 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f306806e2b0 msgr2=0x7f3068070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:13.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.589+0000 7f30835b2640 1 --2- 172.21.15.17:0/1708243961 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f306806e2b0 0x7f3068070770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3078031460 tx=0x7f3078009560 comp rx=0 tx=0).stop 2024-09-20T18:32:13.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.589+0000 7f30835b2640 1 -- 172.21.15.17:0/1708243961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f307c106800 msgr2=0x7f307c19dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:13.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.589+0000 7f30835b2640 1 --2- 172.21.15.17:0/1708243961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f307c106800 0x7f307c19dbe0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f306c00c8a0 tx=0x7f306c00cd60 comp rx=0 tx=0).stop 2024-09-20T18:32:13.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.589+0000 7f30835b2640 1 -- 172.21.15.17:0/1708243961 shutdown_connections 2024-09-20T18:32:13.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.589+0000 7f30835b2640 1 --2- 172.21.15.17:0/1708243961 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f306806e2b0 0x7f3068070770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:13.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.589+0000 7f30835b2640 1 --2- 172.21.15.17:0/1708243961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f307c106800 0x7f307c19dbe0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:13.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.589+0000 7f30835b2640 1 --2- 172.21.15.17:0/1708243961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f307c100800 0x7f307c19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:13.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.589+0000 7f30835b2640 1 -- 172.21.15.17:0/1708243961 >> 172.21.15.17:0/1708243961 conn(0x7f307c0fc520 msgr2=0x7f307c06a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:13.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.589+0000 7f30835b2640 1 -- 172.21.15.17:0/1708243961 shutdown_connections 2024-09-20T18:32:13.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:13.589+0000 7f30835b2640 1 -- 172.21.15.17:0/1708243961 wait complete. 2024-09-20T18:32:13.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:13 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1708243961' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-20T18:32:13.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:13 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/1708243961' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-20T18:32:14.302 INFO:teuthology.orchestra.run.smithi017.stdout:[{"version":42,"timestamp":"2024-09-20T18:32:02.972743+0000","name":"","changes":[{"name":"osd/host:smithi172/osd_memory_target","previous_value":"7818245939","new_value":"5212163959"}]}] 2024-09-20T18:32:14.303 INFO:tasks.ceph_manager:config epoch is 42 2024-09-20T18:32:14.303 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-20T18:32:14.303 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-20T18:32:14.303 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-20T18:32:14.561 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:14.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:14 smithi017 ceph-mon[28058]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:14.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:14 smithi172 ceph-mon[35456]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.971+0000 7f0238c3b640 1 -- 172.21.15.17:0/1875345738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0234100800 msgr2=0x7f0234100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.971+0000 7f0238c3b640 1 --2- 172.21.15.17:0/1875345738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0234100800 0x7f0234100c60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0228009880 tx=0x7f022802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.971+0000 7f0238c3b640 1 -- 172.21.15.17:0/1875345738 shutdown_connections 2024-09-20T18:32:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.971+0000 7f0238c3b640 1 --2- 172.21.15.17:0/1875345738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0234100800 0x7f0234100c60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.971+0000 7f0238c3b640 1 --2- 172.21.15.17:0/1875345738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0234106800 0x7f0234106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.971+0000 7f0238c3b640 1 -- 172.21.15.17:0/1875345738 >> 172.21.15.17:0/1875345738 conn(0x7f02340fc520 msgr2=0x7f02340fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.971+0000 7f0238c3b640 1 -- 172.21.15.17:0/1875345738 shutdown_connections 2024-09-20T18:32:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.971+0000 7f0238c3b640 1 -- 172.21.15.17:0/1875345738 wait complete. 2024-09-20T18:32:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.972+0000 7f0238c3b640 1 Processor -- start 2024-09-20T18:32:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.972+0000 7f0238c3b640 1 -- start start 2024-09-20T18:32:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.972+0000 7f0238c3b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0234100800 0x7f0234196610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.972+0000 7f0238c3b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0234106800 0x7f0234196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.972+0000 7f0238c3b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f023410dcd0 con 0x7f0234100800 2024-09-20T18:32:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.972+0000 7f0238c3b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f023410db50 con 0x7f0234106800 2024-09-20T18:32:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.972+0000 7f023259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0234100800 0x7f0234196610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.972+0000 7f023259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0234100800 0x7f0234196610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34830/0 (socket says 172.21.15.17:34830) 2024-09-20T18:32:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.972+0000 7f023259c640 1 -- 172.21.15.17:0/546518566 learned_addr learned my addr 172.21.15.17:0/546518566 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.972+0000 7f023259c640 1 -- 172.21.15.17:0/546518566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0234106800 msgr2=0x7f0234196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.972+0000 7f023259c640 1 --2- 172.21.15.17:0/546518566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0234106800 0x7f0234196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.972+0000 7f023259c640 1 -- 172.21.15.17:0/546518566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0234197090 con 0x7f0234100800 2024-09-20T18:32:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.973+0000 7f023259c640 1 --2- 172.21.15.17:0/546518566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0234100800 0x7f0234196610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f022400d6f0 tx=0x7f022400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.973+0000 7f02237fe640 1 -- 172.21.15.17:0/546518566 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0224017070 con 0x7f0234100800 2024-09-20T18:32:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.973+0000 7f02237fe640 1 -- 172.21.15.17:0/546518566 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f022400de00 con 0x7f0234100800 2024-09-20T18:32:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.973+0000 7f0238c3b640 1 -- 172.21.15.17:0/546518566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0234197380 con 0x7f0234100800 2024-09-20T18:32:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.973+0000 7f02237fe640 1 -- 172.21.15.17:0/546518566 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0224004bb0 con 0x7f0234100800 2024-09-20T18:32:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.973+0000 7f0238c3b640 1 -- 172.21.15.17:0/546518566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02341a3e50 con 0x7f0234100800 2024-09-20T18:32:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.974+0000 7f0238c3b640 1 -- 172.21.15.17:0/546518566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0234101f40 con 0x7f0234100800 2024-09-20T18:32:14.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.975+0000 7f02237fe640 1 -- 172.21.15.17:0/546518566 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0224009a30 con 0x7f0234100800 2024-09-20T18:32:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.975+0000 7f02237fe640 1 --2- 172.21.15.17:0/546518566 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f021c06e350 0x7f021c070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.975+0000 7f02237fe640 1 -- 172.21.15.17:0/546518566 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f022408da60 con 0x7f0234100800 2024-09-20T18:32:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.975+0000 7f0231d9b640 1 --2- 172.21.15.17:0/546518566 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f021c06e350 0x7f021c070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.976+0000 7f0231d9b640 1 --2- 172.21.15.17:0/546518566 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f021c06e350 0x7f021c070810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f02280096c0 tx=0x7f0228000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:14.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:14.980+0000 7f02237fe640 1 -- 172.21.15.17:0/546518566 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f022405b6e0 con 0x7f0234100800 2024-09-20T18:32:15.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:15.205+0000 7f0238c3b640 1 -- 172.21.15.17:0/546518566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0234100c60 con 0x7f0234100800 2024-09-20T18:32:15.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:15.208+0000 7f02237fe640 1 -- 172.21.15.17:0/546518566 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+176565 (secure 0 0 0) 0x7f022405f390 con 0x7f0234100800 2024-09-20T18:32:15.224 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:32:15.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:15.211+0000 7f0238c3b640 1 -- 172.21.15.17:0/546518566 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f021c06e350 msgr2=0x7f021c070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:15.211+0000 7f0238c3b640 1 --2- 172.21.15.17:0/546518566 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f021c06e350 0x7f021c070810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f02280096c0 tx=0x7f0228000bc0 comp rx=0 tx=0).stop 2024-09-20T18:32:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:15.211+0000 7f0238c3b640 1 -- 172.21.15.17:0/546518566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0234100800 msgr2=0x7f0234196610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:15.211+0000 7f0238c3b640 1 --2- 172.21.15.17:0/546518566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0234100800 0x7f0234196610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f022400d6f0 tx=0x7f022400dbb0 comp rx=0 tx=0).stop 2024-09-20T18:32:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:15.212+0000 7f0238c3b640 1 -- 172.21.15.17:0/546518566 shutdown_connections 2024-09-20T18:32:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:15.212+0000 7f0238c3b640 1 --2- 172.21.15.17:0/546518566 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f021c06e350 0x7f021c070810 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:15.212+0000 7f0238c3b640 1 --2- 172.21.15.17:0/546518566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0234106800 0x7f0234196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:15.212+0000 7f0238c3b640 1 --2- 172.21.15.17:0/546518566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0234100800 0x7f0234196610 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:15.212+0000 7f0238c3b640 1 -- 172.21.15.17:0/546518566 >> 172.21.15.17:0/546518566 conn(0x7f02340fc520 msgr2=0x7f02340fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:15.212+0000 7f0238c3b640 1 -- 172.21.15.17:0/546518566 shutdown_connections 2024-09-20T18:32:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:15.212+0000 7f0238c3b640 1 -- 172.21.15.17:0/546518566 wait complete. 2024-09-20T18:32:15.858 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:15 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/546518566' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-20T18:32:15.887 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"flags":0,"active_gid":14217,"active_name":"smithi017.xusjwd","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":2021461456},{"type":"v1","addr":"172.21.15.17:6801","nonce":2021461456}]},"active_addr":"172.21.15.17:6801/2021461456","active_change":"2024-09-20T18:28:07.480727+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14244,"name":"smithi172.jczphg","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.17:8443/","prometheus":"http://172.21.15.17:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":384622812}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":3027447183}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":1352836007}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":2241274877}]}]} 2024-09-20T18:32:15.893 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-20T18:32:15.893 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-20T18:32:15.893 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-20T18:32:15.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:15 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/546518566' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-20T18:32:16.148 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:16.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.563+0000 7f2bc6d54640 1 -- 172.21.15.17:0/987465379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bc0107900 msgr2=0x7f2bc0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:16.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.563+0000 7f2bc6d54640 1 --2- 172.21.15.17:0/987465379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bc0107900 0x7f2bc0107ce0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009880 tx=0x7f2bb402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:16.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.563+0000 7f2bc6d54640 1 -- 172.21.15.17:0/987465379 shutdown_connections 2024-09-20T18:32:16.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.563+0000 7f2bc6d54640 1 --2- 172.21.15.17:0/987465379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bc0101900 0x7f2bc0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:16.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.563+0000 7f2bc6d54640 1 --2- 172.21.15.17:0/987465379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bc0107900 0x7f2bc0107ce0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:16.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.563+0000 7f2bc6d54640 1 -- 172.21.15.17:0/987465379 >> 172.21.15.17:0/987465379 conn(0x7f2bc00fd600 msgr2=0x7f2bc00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:16.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.563+0000 7f2bc6d54640 1 -- 172.21.15.17:0/987465379 shutdown_connections 2024-09-20T18:32:16.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.563+0000 7f2bc6d54640 1 -- 172.21.15.17:0/987465379 wait complete. 2024-09-20T18:32:16.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.564+0000 7f2bc6d54640 1 Processor -- start 2024-09-20T18:32:16.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.564+0000 7f2bc6d54640 1 -- start start 2024-09-20T18:32:16.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.564+0000 7f2bc6d54640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bc0101900 0x7f2bc00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:16.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.564+0000 7f2bc6d54640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bc0107900 0x7f2bc0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:16.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.564+0000 7f2bc6d54640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc010ee30 con 0x7f2bc0107900 2024-09-20T18:32:16.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.564+0000 7f2bc6d54640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc010ecb0 con 0x7f2bc0101900 2024-09-20T18:32:16.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.564+0000 7f2bbffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bc0107900 0x7f2bc0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:16.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.564+0000 7f2bbffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bc0107900 0x7f2bc0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34846/0 (socket says 172.21.15.17:34846) 2024-09-20T18:32:16.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.564+0000 7f2bbffff640 1 -- 172.21.15.17:0/215028142 learned_addr learned my addr 172.21.15.17:0/215028142 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:16.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.565+0000 7f2bc4af0640 1 --2- 172.21.15.17:0/215028142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bc0101900 0x7f2bc00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:16.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.565+0000 7f2bbffff640 1 -- 172.21.15.17:0/215028142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bc0101900 msgr2=0x7f2bc00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:16.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.565+0000 7f2bbffff640 1 --2- 172.21.15.17:0/215028142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bc0101900 0x7f2bc00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:16.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.565+0000 7f2bbffff640 1 -- 172.21.15.17:0/215028142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc0074f70 con 0x7f2bc0107900 2024-09-20T18:32:16.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.565+0000 7f2bbffff640 1 --2- 172.21.15.17:0/215028142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bc0107900 0x7f2bc0074a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00b420 tx=0x7f2bac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:16.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.565+0000 7f2bbdffb640 1 -- 172.21.15.17:0/215028142 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2bac011630 con 0x7f2bc0107900 2024-09-20T18:32:16.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.565+0000 7f2bbdffb640 1 -- 172.21.15.17:0/215028142 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2bac016070 con 0x7f2bc0107900 2024-09-20T18:32:16.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.565+0000 7f2bbdffb640 1 -- 172.21.15.17:0/215028142 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2bac010d40 con 0x7f2bc0107900 2024-09-20T18:32:16.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.565+0000 7f2bc6d54640 1 -- 172.21.15.17:0/215028142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc0075260 con 0x7f2bc0107900 2024-09-20T18:32:16.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.566+0000 7f2bc6d54640 1 -- 172.21.15.17:0/215028142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc01a3ee0 con 0x7f2bc0107900 2024-09-20T18:32:16.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.567+0000 7f2bc6d54640 1 -- 172.21.15.17:0/215028142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bc0103040 con 0x7f2bc0107900 2024-09-20T18:32:16.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.567+0000 7f2bbdffb640 1 -- 172.21.15.17:0/215028142 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2bac01b460 con 0x7f2bc0107900 2024-09-20T18:32:16.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.568+0000 7f2bbdffb640 1 --2- 172.21.15.17:0/215028142 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f2bb006e310 0x7f2bb00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:16.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.568+0000 7f2bbdffb640 1 -- 172.21.15.17:0/215028142 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f2bac08d580 con 0x7f2bc0107900 2024-09-20T18:32:16.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.568+0000 7f2bc4af0640 1 --2- 172.21.15.17:0/215028142 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f2bb006e310 0x7f2bb00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:16.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.568+0000 7f2bc4af0640 1 --2- 172.21.15.17:0/215028142 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f2bb006e310 0x7f2bb00707d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40096c0 tx=0x7f2bb4031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.572+0000 7f2bbdffb640 1 -- 172.21.15.17:0/215028142 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2bac05b2a0 con 0x7f2bc0107900 2024-09-20T18:32:16.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.750+0000 7f2bc6d54640 1 -- 172.21.15.17:0/215028142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2bc0109e70 con 0x7f2bc0107900 2024-09-20T18:32:16.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.751+0000 7f2bbdffb640 1 -- 172.21.15.17:0/215028142 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11365 (secure 0 0 0) 0x7f2bac08d3a0 con 0x7f2bc0107900 2024-09-20T18:32:16.765 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:32:16.765 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":39,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","created":"2024-09-20T18:26:16.474373+0000","modified":"2024-09-20T18:32:04.594620+0000","last_up_change":"2024-09-20T18:32:03.588885+0000","last_in_change":"2024-09-20T18:31:40.653300+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T18:30:47.993676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3046c2d-32a3-4007-bf81-f0df8bc45e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":159236871},{"type":"v1","addr":"172.21.15.17:6803","nonce":159236871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":159236871},{"type":"v1","addr":"172.21.15.17:6805","nonce":159236871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":159236871},{"type":"v1","addr":"172.21.15.17:6809","nonce":159236871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":159236871},{"type":"v1","addr":"172.21.15.17:6807","nonce":159236871}]},"public_addr":"172.21.15.17:6803/159236871","cluster_addr":"172.21.15.17:6805/159236871","heartbeat_back_addr":"172.21.15.17:6809/159236871","heartbeat_front_addr":"172.21.15.17:6807/159236871","state":["exists","up"]},{"osd":1,"uuid":"bb694b7d-d1c1-4aa6-90f4-837c7bd79c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":227764513},{"type":"v1","addr":"172.21.15.17:6811","nonce":227764513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":227764513},{"type":"v1","addr":"172.21.15.17:6813","nonce":227764513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":227764513},{"type":"v1","addr":"172.21.15.17:6817","nonce":227764513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":227764513},{"type":"v1","addr":"172.21.15.17:6815","nonce":227764513}]},"public_addr":"172.21.15.17:6811/227764513","cluster_addr":"172.21.15.17:6813/227764513","heartbeat_back_addr":"172.21.15.17:6817/227764513","heartbeat_front_addr":"172.21.15.17:6815/227764513","state":["exists","up"]},{"osd":2,"uuid":"86d6d42c-0a7a-400f-9e2b-087bab36d8d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2070903491},{"type":"v1","addr":"172.21.15.17:6819","nonce":2070903491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2070903491},{"type":"v1","addr":"172.21.15.17:6821","nonce":2070903491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2070903491},{"type":"v1","addr":"172.21.15.17:6825","nonce":2070903491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2070903491},{"type":"v1","addr":"172.21.15.17:6823","nonce":2070903491}]},"public_addr":"172.21.15.17:6819/2070903491","cluster_addr":"172.21.15.17:6821/2070903491","heartbeat_back_addr":"172.21.15.17:6825/2070903491","heartbeat_front_addr":"172.21.15.17:6823/2070903491","state":["exists","up"]},{"osd":3,"uuid":"8ca08e10-5b3b-497f-9db4-bc544c622f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3866485293},{"type":"v1","addr":"172.21.15.172:6801","nonce":3866485293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3866485293},{"type":"v1","addr":"172.21.15.172:6803","nonce":3866485293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3866485293},{"type":"v1","addr":"172.21.15.172:6807","nonce":3866485293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3866485293},{"type":"v1","addr":"172.21.15.172:6805","nonce":3866485293}]},"public_addr":"172.21.15.172:6801/3866485293","cluster_addr":"172.21.15.172:6803/3866485293","heartbeat_back_addr":"172.21.15.172:6807/3866485293","heartbeat_front_addr":"172.21.15.172:6805/3866485293","state":["exists","up"]},{"osd":4,"uuid":"1e5440d7-28d3-4726-81a0-7b73e8490c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":503301696},{"type":"v1","addr":"172.21.15.172:6809","nonce":503301696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":503301696},{"type":"v1","addr":"172.21.15.172:6811","nonce":503301696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":503301696},{"type":"v1","addr":"172.21.15.172:6815","nonce":503301696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":503301696},{"type":"v1","addr":"172.21.15.172:6813","nonce":503301696}]},"public_addr":"172.21.15.172:6809/503301696","cluster_addr":"172.21.15.172:6811/503301696","heartbeat_back_addr":"172.21.15.172:6815/503301696","heartbeat_front_addr":"172.21.15.172:6813/503301696","state":["exists","up"]},{"osd":5,"uuid":"56758921-ec3d-4dbd-8aa2-c23cebba688c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3232179537},{"type":"v1","addr":"172.21.15.172:6817","nonce":3232179537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3232179537},{"type":"v1","addr":"172.21.15.172:6819","nonce":3232179537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3232179537},{"type":"v1","addr":"172.21.15.172:6823","nonce":3232179537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3232179537},{"type":"v1","addr":"172.21.15.172:6821","nonce":3232179537}]},"public_addr":"172.21.15.172:6817/3232179537","cluster_addr":"172.21.15.172:6819/3232179537","heartbeat_back_addr":"172.21.15.172:6823/3232179537","heartbeat_front_addr":"172.21.15.172:6821/3232179537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:29:45.463575+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:30:14.630783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:30:43.783562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:31:08.457494+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:31:35.337334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:32:02.034197+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2443650242":"2024-09-21T18:28:07.480593+0000","172.21.15.17:0/352736886":"2024-09-21T18:28:07.480593+0000","172.21.15.17:6801/513066305":"2024-09-21T18:26:38.662388+0000","172.21.15.17:6801/29863517":"2024-09-21T18:28:07.480593+0000","172.21.15.17:6800/513066305":"2024-09-21T18:26:38.662388+0000","172.21.15.17:0/3393805637":"2024-09-21T18:26:38.662388+0000","172.21.15.17:0/652312164":"2024-09-21T18:26:38.662388+0000","172.21.15.17:0/3207433207":"2024-09-21T18:27:10.529430+0000","172.21.15.17:0/2934627597":"2024-09-21T18:27:10.529430+0000","172.21.15.17:6800/3940118846":"2024-09-21T18:27:10.529430+0000","172.21.15.17:0/3160589064":"2024-09-21T18:26:38.662388+0000","172.21.15.17:6801/3940118846":"2024-09-21T18:27:10.529430+0000","172.21.15.17:0/4095439401":"2024-09-21T18:28:07.480593+0000","172.21.15.17:0/2816923133":"2024-09-21T18:27:10.529430+0000","172.21.15.17:6800/29863517":"2024-09-21T18:28:07.480593+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T18:32:16.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.753+0000 7f2bc6d54640 1 -- 172.21.15.17:0/215028142 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f2bb006e310 msgr2=0x7f2bb00707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:16.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.753+0000 7f2bc6d54640 1 --2- 172.21.15.17:0/215028142 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f2bb006e310 0x7f2bb00707d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40096c0 tx=0x7f2bb4031400 comp rx=0 tx=0).stop 2024-09-20T18:32:16.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.753+0000 7f2bc6d54640 1 -- 172.21.15.17:0/215028142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bc0107900 msgr2=0x7f2bc0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:16.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.753+0000 7f2bc6d54640 1 --2- 172.21.15.17:0/215028142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bc0107900 0x7f2bc0074a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00b420 tx=0x7f2bac00b8e0 comp rx=0 tx=0).stop 2024-09-20T18:32:16.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.753+0000 7f2bc6d54640 1 -- 172.21.15.17:0/215028142 shutdown_connections 2024-09-20T18:32:16.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.753+0000 7f2bc6d54640 1 --2- 172.21.15.17:0/215028142 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f2bb006e310 0x7f2bb00707d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:16.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.753+0000 7f2bc6d54640 1 --2- 172.21.15.17:0/215028142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bc0107900 0x7f2bc0074a30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:16.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.753+0000 7f2bc6d54640 1 --2- 172.21.15.17:0/215028142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bc0101900 0x7f2bc00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:16.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.753+0000 7f2bc6d54640 1 -- 172.21.15.17:0/215028142 >> 172.21.15.17:0/215028142 conn(0x7f2bc00fd600 msgr2=0x7f2bc00fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:16.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.753+0000 7f2bc6d54640 1 -- 172.21.15.17:0/215028142 shutdown_connections 2024-09-20T18:32:16.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:16.753+0000 7f2bc6d54640 1 -- 172.21.15.17:0/215028142 wait complete. 2024-09-20T18:32:16.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:16 smithi017 ceph-mon[28058]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:16.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:16 smithi172 ceph-mon[35456]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:17.553 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-20T18:32:17.553 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-20T18:32:17.810 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:17.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:17 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/215028142' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T18:32:17.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:17 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/215028142' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T18:32:18.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.213+0000 7f29f656c640 1 -- 172.21.15.17:0/2823475744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f01034a0 msgr2=0x7f29f010b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:18.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.213+0000 7f29f656c640 1 --2- 172.21.15.17:0/2823475744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f01034a0 0x7f29f010b990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f29e40098b0 tx=0x7f29e402a560 comp rx=0 tx=0).stop 2024-09-20T18:32:18.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.214+0000 7f29f656c640 1 -- 172.21.15.17:0/2823475744 shutdown_connections 2024-09-20T18:32:18.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.214+0000 7f29f656c640 1 --2- 172.21.15.17:0/2823475744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f01034a0 0x7f29f010b990 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:18.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.214+0000 7f29f656c640 1 --2- 172.21.15.17:0/2823475744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f0102b80 0x7f29f0102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:18.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.214+0000 7f29f656c640 1 -- 172.21.15.17:0/2823475744 >> 172.21.15.17:0/2823475744 conn(0x7f29f00fc580 msgr2=0x7f29f00fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:18.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.214+0000 7f29f656c640 1 -- 172.21.15.17:0/2823475744 shutdown_connections 2024-09-20T18:32:18.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.214+0000 7f29f656c640 1 -- 172.21.15.17:0/2823475744 wait complete. 2024-09-20T18:32:18.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.214+0000 7f29f656c640 1 Processor -- start 2024-09-20T18:32:18.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.214+0000 7f29f656c640 1 -- start start 2024-09-20T18:32:18.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.215+0000 7f29f656c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f0102b80 0x7f29f019d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:18.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.215+0000 7f29f656c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f01034a0 0x7f29f019dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:18.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.215+0000 7f29f656c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f29f010eeb0 con 0x7f29f01034a0 2024-09-20T18:32:18.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.215+0000 7f29f656c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29f010ed30 con 0x7f29f0102b80 2024-09-20T18:32:18.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.215+0000 7f29ef7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f01034a0 0x7f29f019dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:18.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.215+0000 7f29ef7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f01034a0 0x7f29f019dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34870/0 (socket says 172.21.15.17:34870) 2024-09-20T18:32:18.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.215+0000 7f29ef7fe640 1 -- 172.21.15.17:0/31518237 learned_addr learned my addr 172.21.15.17:0/31518237 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:18.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.215+0000 7f29effff640 1 --2- 172.21.15.17:0/31518237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f0102b80 0x7f29f019d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:18.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.215+0000 7f29ef7fe640 1 -- 172.21.15.17:0/31518237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f0102b80 msgr2=0x7f29f019d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:18.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.215+0000 7f29ef7fe640 1 --2- 172.21.15.17:0/31518237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f0102b80 0x7f29f019d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:18.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.215+0000 7f29ef7fe640 1 -- 172.21.15.17:0/31518237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f0197a20 con 0x7f29f01034a0 2024-09-20T18:32:18.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.215+0000 7f29effff640 1 --2- 172.21.15.17:0/31518237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f0102b80 0x7f29f019d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:32:18.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.215+0000 7f29ef7fe640 1 --2- 172.21.15.17:0/31518237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f01034a0 0x7f29f019dda0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f29e4031460 tx=0x7f29e40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:18.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.215+0000 7f29ed7fa640 1 -- 172.21.15.17:0/31518237 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f29e403f070 con 0x7f29f01034a0 2024-09-20T18:32:18.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.216+0000 7f29f656c640 1 -- 172.21.15.17:0/31518237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f0197cb0 con 0x7f29f01034a0 2024-09-20T18:32:18.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.216+0000 7f29ed7fa640 1 -- 172.21.15.17:0/31518237 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f29e40044d0 con 0x7f29f01034a0 2024-09-20T18:32:18.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.216+0000 7f29ed7fa640 1 -- 172.21.15.17:0/31518237 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f29e4035030 con 0x7f29f01034a0 2024-09-20T18:32:18.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.216+0000 7f29f656c640 1 -- 172.21.15.17:0/31518237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f01981e0 con 0x7f29f01034a0 2024-09-20T18:32:18.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.217+0000 7f29f656c640 1 -- 172.21.15.17:0/31518237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f006ad40 con 0x7f29f01034a0 2024-09-20T18:32:18.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.217+0000 7f29ed7fa640 1 -- 172.21.15.17:0/31518237 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f29e4042070 con 0x7f29f01034a0 2024-09-20T18:32:18.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.218+0000 7f29ed7fa640 1 --2- 172.21.15.17:0/31518237 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f29d806e2b0 0x7f29d8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:18.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.218+0000 7f29ed7fa640 1 -- 172.21.15.17:0/31518237 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f29e40ae930 con 0x7f29f01034a0 2024-09-20T18:32:18.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.218+0000 7f29effff640 1 --2- 172.21.15.17:0/31518237 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f29d806e2b0 0x7f29d8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:18.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.218+0000 7f29effff640 1 --2- 172.21.15.17:0/31518237 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f29d806e2b0 0x7f29d8070770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f29f0198b60 tx=0x7f29e0008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:18.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.222+0000 7f29ed7fa640 1 -- 172.21.15.17:0/31518237 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f29e407c530 con 0x7f29f01034a0 2024-09-20T18:32:18.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.398+0000 7f29f656c640 1 -- 172.21.15.17:0/31518237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29f0198f50 con 0x7f29f01034a0 2024-09-20T18:32:18.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.399+0000 7f29ed7fa640 1 -- 172.21.15.17:0/31518237 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11365 (secure 0 0 0) 0x7f29e4004cf0 con 0x7f29f01034a0 2024-09-20T18:32:18.413 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:32:18.414 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":39,"fsid":"7a27d282-777d-11ef-baf5-efdc52797490","created":"2024-09-20T18:26:16.474373+0000","modified":"2024-09-20T18:32:04.594620+0000","last_up_change":"2024-09-20T18:32:03.588885+0000","last_in_change":"2024-09-20T18:31:40.653300+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-20T18:30:47.993676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3046c2d-32a3-4007-bf81-f0df8bc45e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":159236871},{"type":"v1","addr":"172.21.15.17:6803","nonce":159236871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":159236871},{"type":"v1","addr":"172.21.15.17:6805","nonce":159236871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":159236871},{"type":"v1","addr":"172.21.15.17:6809","nonce":159236871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":159236871},{"type":"v1","addr":"172.21.15.17:6807","nonce":159236871}]},"public_addr":"172.21.15.17:6803/159236871","cluster_addr":"172.21.15.17:6805/159236871","heartbeat_back_addr":"172.21.15.17:6809/159236871","heartbeat_front_addr":"172.21.15.17:6807/159236871","state":["exists","up"]},{"osd":1,"uuid":"bb694b7d-d1c1-4aa6-90f4-837c7bd79c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":227764513},{"type":"v1","addr":"172.21.15.17:6811","nonce":227764513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":227764513},{"type":"v1","addr":"172.21.15.17:6813","nonce":227764513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":227764513},{"type":"v1","addr":"172.21.15.17:6817","nonce":227764513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":227764513},{"type":"v1","addr":"172.21.15.17:6815","nonce":227764513}]},"public_addr":"172.21.15.17:6811/227764513","cluster_addr":"172.21.15.17:6813/227764513","heartbeat_back_addr":"172.21.15.17:6817/227764513","heartbeat_front_addr":"172.21.15.17:6815/227764513","state":["exists","up"]},{"osd":2,"uuid":"86d6d42c-0a7a-400f-9e2b-087bab36d8d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2070903491},{"type":"v1","addr":"172.21.15.17:6819","nonce":2070903491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2070903491},{"type":"v1","addr":"172.21.15.17:6821","nonce":2070903491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2070903491},{"type":"v1","addr":"172.21.15.17:6825","nonce":2070903491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2070903491},{"type":"v1","addr":"172.21.15.17:6823","nonce":2070903491}]},"public_addr":"172.21.15.17:6819/2070903491","cluster_addr":"172.21.15.17:6821/2070903491","heartbeat_back_addr":"172.21.15.17:6825/2070903491","heartbeat_front_addr":"172.21.15.17:6823/2070903491","state":["exists","up"]},{"osd":3,"uuid":"8ca08e10-5b3b-497f-9db4-bc544c622f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3866485293},{"type":"v1","addr":"172.21.15.172:6801","nonce":3866485293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3866485293},{"type":"v1","addr":"172.21.15.172:6803","nonce":3866485293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3866485293},{"type":"v1","addr":"172.21.15.172:6807","nonce":3866485293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3866485293},{"type":"v1","addr":"172.21.15.172:6805","nonce":3866485293}]},"public_addr":"172.21.15.172:6801/3866485293","cluster_addr":"172.21.15.172:6803/3866485293","heartbeat_back_addr":"172.21.15.172:6807/3866485293","heartbeat_front_addr":"172.21.15.172:6805/3866485293","state":["exists","up"]},{"osd":4,"uuid":"1e5440d7-28d3-4726-81a0-7b73e8490c90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":503301696},{"type":"v1","addr":"172.21.15.172:6809","nonce":503301696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":503301696},{"type":"v1","addr":"172.21.15.172:6811","nonce":503301696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":503301696},{"type":"v1","addr":"172.21.15.172:6815","nonce":503301696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":503301696},{"type":"v1","addr":"172.21.15.172:6813","nonce":503301696}]},"public_addr":"172.21.15.172:6809/503301696","cluster_addr":"172.21.15.172:6811/503301696","heartbeat_back_addr":"172.21.15.172:6815/503301696","heartbeat_front_addr":"172.21.15.172:6813/503301696","state":["exists","up"]},{"osd":5,"uuid":"56758921-ec3d-4dbd-8aa2-c23cebba688c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3232179537},{"type":"v1","addr":"172.21.15.172:6817","nonce":3232179537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3232179537},{"type":"v1","addr":"172.21.15.172:6819","nonce":3232179537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3232179537},{"type":"v1","addr":"172.21.15.172:6823","nonce":3232179537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3232179537},{"type":"v1","addr":"172.21.15.172:6821","nonce":3232179537}]},"public_addr":"172.21.15.172:6817/3232179537","cluster_addr":"172.21.15.172:6819/3232179537","heartbeat_back_addr":"172.21.15.172:6823/3232179537","heartbeat_front_addr":"172.21.15.172:6821/3232179537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:29:45.463575+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:30:14.630783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:30:43.783562+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:31:08.457494+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:31:35.337334+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-20T18:32:02.034197+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2443650242":"2024-09-21T18:28:07.480593+0000","172.21.15.17:0/352736886":"2024-09-21T18:28:07.480593+0000","172.21.15.17:6801/513066305":"2024-09-21T18:26:38.662388+0000","172.21.15.17:6801/29863517":"2024-09-21T18:28:07.480593+0000","172.21.15.17:6800/513066305":"2024-09-21T18:26:38.662388+0000","172.21.15.17:0/3393805637":"2024-09-21T18:26:38.662388+0000","172.21.15.17:0/652312164":"2024-09-21T18:26:38.662388+0000","172.21.15.17:0/3207433207":"2024-09-21T18:27:10.529430+0000","172.21.15.17:0/2934627597":"2024-09-21T18:27:10.529430+0000","172.21.15.17:6800/3940118846":"2024-09-21T18:27:10.529430+0000","172.21.15.17:0/3160589064":"2024-09-21T18:26:38.662388+0000","172.21.15.17:6801/3940118846":"2024-09-21T18:27:10.529430+0000","172.21.15.17:0/4095439401":"2024-09-21T18:28:07.480593+0000","172.21.15.17:0/2816923133":"2024-09-21T18:27:10.529430+0000","172.21.15.17:6800/29863517":"2024-09-21T18:28:07.480593+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-20T18:32:18.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.401+0000 7f29f656c640 1 -- 172.21.15.17:0/31518237 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f29d806e2b0 msgr2=0x7f29d8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:18.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.401+0000 7f29f656c640 1 --2- 172.21.15.17:0/31518237 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f29d806e2b0 0x7f29d8070770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f29f0198b60 tx=0x7f29e0008040 comp rx=0 tx=0).stop 2024-09-20T18:32:18.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.401+0000 7f29f656c640 1 -- 172.21.15.17:0/31518237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f01034a0 msgr2=0x7f29f019dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:18.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.401+0000 7f29f656c640 1 --2- 172.21.15.17:0/31518237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f01034a0 0x7f29f019dda0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f29e4031460 tx=0x7f29e40048f0 comp rx=0 tx=0).stop 2024-09-20T18:32:18.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.401+0000 7f29f656c640 1 -- 172.21.15.17:0/31518237 shutdown_connections 2024-09-20T18:32:18.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.401+0000 7f29f656c640 1 --2- 172.21.15.17:0/31518237 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f29d806e2b0 0x7f29d8070770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:18.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.401+0000 7f29f656c640 1 --2- 172.21.15.17:0/31518237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f01034a0 0x7f29f019dda0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:18.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.401+0000 7f29f656c640 1 --2- 172.21.15.17:0/31518237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f0102b80 0x7f29f019d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:18.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.401+0000 7f29f656c640 1 -- 172.21.15.17:0/31518237 >> 172.21.15.17:0/31518237 conn(0x7f29f00fc580 msgr2=0x7f29f0103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:18.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.401+0000 7f29f656c640 1 -- 172.21.15.17:0/31518237 shutdown_connections 2024-09-20T18:32:18.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:18.401+0000 7f29f656c640 1 -- 172.21.15.17:0/31518237 wait complete. 2024-09-20T18:32:18.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:18 smithi017 ceph-mon[28058]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:18.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:18 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/31518237' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T18:32:18.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:18 smithi172 ceph-mon[35456]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:18.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:18 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/31518237' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-20T18:32:19.068 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-20T18:32:19.069 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-20T18:32:19.069 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-20T18:32:19.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-20T18:32:19.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-20T18:32:19.071 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-20T18:32:19.361 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:19.362 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:19.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.879+0000 7f0068a38640 1 -- 172.21.15.17:0/641484050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0064100800 msgr2=0x7f0064100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.879+0000 7f0068a38640 1 --2- 172.21.15.17:0/641484050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0064100800 0x7f0064100c60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0058009880 tx=0x7f005802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.879+0000 7f0068a38640 1 -- 172.21.15.17:0/641484050 shutdown_connections 2024-09-20T18:32:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.879+0000 7f0068a38640 1 --2- 172.21.15.17:0/641484050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0064100800 0x7f0064100c60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.879+0000 7f0068a38640 1 --2- 172.21.15.17:0/641484050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0064106800 0x7f0064106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.879+0000 7f0068a38640 1 -- 172.21.15.17:0/641484050 >> 172.21.15.17:0/641484050 conn(0x7f00640fc520 msgr2=0x7f00640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.879+0000 7f0068a38640 1 -- 172.21.15.17:0/641484050 shutdown_connections 2024-09-20T18:32:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.879+0000 7f0068a38640 1 -- 172.21.15.17:0/641484050 wait complete. 2024-09-20T18:32:19.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.880+0000 7f0068a38640 1 Processor -- start 2024-09-20T18:32:19.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.880+0000 7f0068a38640 1 -- start start 2024-09-20T18:32:19.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.880+0000 7f0068a38640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0064100800 0x7f006419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:19.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.880+0000 7f0068a38640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0064106800 0x7f006419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:19.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.880+0000 7f0068a38640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f006410ee40 con 0x7f0064106800 2024-09-20T18:32:19.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.880+0000 7f0068a38640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f006410ecc0 con 0x7f0064100800 2024-09-20T18:32:19.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.881+0000 7f0061d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0064106800 0x7f006419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:19.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.881+0000 7f0061d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0064106800 0x7f006419dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34886/0 (socket says 172.21.15.17:34886) 2024-09-20T18:32:19.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.881+0000 7f0061d9b640 1 -- 172.21.15.17:0/1609738435 learned_addr learned my addr 172.21.15.17:0/1609738435 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:19.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.881+0000 7f006259c640 1 --2- 172.21.15.17:0/1609738435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0064100800 0x7f006419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:19.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.881+0000 7f0061d9b640 1 -- 172.21.15.17:0/1609738435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0064100800 msgr2=0x7f006419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:19.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.881+0000 7f0061d9b640 1 --2- 172.21.15.17:0/1609738435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0064100800 0x7f006419d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:19.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.881+0000 7f0061d9b640 1 -- 172.21.15.17:0/1609738435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0064197830 con 0x7f0064106800 2024-09-20T18:32:19.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.881+0000 7f0061d9b640 1 --2- 172.21.15.17:0/1609738435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0064106800 0x7f006419dbf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0058031460 tx=0x7f00580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:19.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.881+0000 7f00537fe640 1 -- 172.21.15.17:0/1609738435 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f005803f070 con 0x7f0064106800 2024-09-20T18:32:19.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.881+0000 7f00537fe640 1 -- 172.21.15.17:0/1609738435 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0058004cf0 con 0x7f0064106800 2024-09-20T18:32:19.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.881+0000 7f0068a38640 1 -- 172.21.15.17:0/1609738435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0064197ac0 con 0x7f0064106800 2024-09-20T18:32:19.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.881+0000 7f00537fe640 1 -- 172.21.15.17:0/1609738435 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0058035030 con 0x7f0064106800 2024-09-20T18:32:19.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.881+0000 7f0068a38640 1 -- 172.21.15.17:0/1609738435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0064197ff0 con 0x7f0064106800 2024-09-20T18:32:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.882+0000 7f0068a38640 1 -- 172.21.15.17:0/1609738435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00641985b0 con 0x7f0064106800 2024-09-20T18:32:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.883+0000 7f00537fe640 1 -- 172.21.15.17:0/1609738435 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0058042070 con 0x7f0064106800 2024-09-20T18:32:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.883+0000 7f00537fe640 1 --2- 172.21.15.17:0/1609738435 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f004c06e2b0 0x7f004c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.883+0000 7f00537fe640 1 -- 172.21.15.17:0/1609738435 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f00580ae840 con 0x7f0064106800 2024-09-20T18:32:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.884+0000 7f006259c640 1 --2- 172.21.15.17:0/1609738435 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f004c06e2b0 0x7f004c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.884+0000 7f00537fe640 1 --2- 172.21.15.17:0/1609738435 >> [v2:172.21.15.172:6800/3866485293,v1:172.21.15.172:6801/3866485293] conn(0x7f004c0740a0 0x7f004c0764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.884+0000 7f00537fe640 1 -- 172.21.15.17:0/1609738435 --> [v2:172.21.15.172:6800/3866485293,v1:172.21.15.172:6801/3866485293] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f004c076b70 con 0x7f004c0740a0 2024-09-20T18:32:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.884+0000 7f00537fe640 1 -- 172.21.15.17:0/1609738435 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f00580b32a0 con 0x7f0064106800 2024-09-20T18:32:19.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.884+0000 7f0062d9d640 1 --2- 172.21.15.17:0/1609738435 >> [v2:172.21.15.172:6800/3866485293,v1:172.21.15.172:6801/3866485293] conn(0x7f004c0740a0 0x7f004c0764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:19.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.884+0000 7f006259c640 1 --2- 172.21.15.17:0/1609738435 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f004c06e2b0 0x7f004c070770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0054009990 tx=0x7f0054009110 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:19.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.884+0000 7f0062d9d640 1 --2- 172.21.15.17:0/1609738435 >> [v2:172.21.15.172:6800/3866485293,v1:172.21.15.172:6801/3866485293] conn(0x7f004c0740a0 0x7f004c0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:19.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.885+0000 7f00537fe640 1 -- 172.21.15.17:0/1609738435 <== osd.3 v2:172.21.15.172:6800/3866485293 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f004c076b70 con 0x7f004c0740a0 2024-09-20T18:32:19.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.899+0000 7f0068a38640 1 -- 172.21.15.17:0/1609738435 --> [v2:172.21.15.172:6800/3866485293,v1:172.21.15.172:6801/3866485293] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0064062900 con 0x7f004c0740a0 2024-09-20T18:32:19.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.899+0000 7f00537fe640 1 -- 172.21.15.17:0/1609738435 <== osd.3 v2:172.21.15.172:6800/3866485293 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0064062900 con 0x7f004c0740a0 2024-09-20T18:32:19.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.900+0000 7f0068a38640 1 -- 172.21.15.17:0/1609738435 >> [v2:172.21.15.172:6800/3866485293,v1:172.21.15.172:6801/3866485293] conn(0x7f004c0740a0 msgr2=0x7f004c0764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:19.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.900+0000 7f0068a38640 1 --2- 172.21.15.17:0/1609738435 >> [v2:172.21.15.172:6800/3866485293,v1:172.21.15.172:6801/3866485293] conn(0x7f004c0740a0 0x7f004c0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:19.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.900+0000 7f0068a38640 1 -- 172.21.15.17:0/1609738435 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f004c06e2b0 msgr2=0x7f004c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:19.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.900+0000 7f0068a38640 1 --2- 172.21.15.17:0/1609738435 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f004c06e2b0 0x7f004c070770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0054009990 tx=0x7f0054009110 comp rx=0 tx=0).stop 2024-09-20T18:32:19.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.900+0000 7f0068a38640 1 -- 172.21.15.17:0/1609738435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0064106800 msgr2=0x7f006419dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:19.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.900+0000 7f0068a38640 1 --2- 172.21.15.17:0/1609738435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0064106800 0x7f006419dbf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0058031460 tx=0x7f00580048f0 comp rx=0 tx=0).stop 2024-09-20T18:32:19.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.900+0000 7f0068a38640 1 -- 172.21.15.17:0/1609738435 shutdown_connections 2024-09-20T18:32:19.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.900+0000 7f0068a38640 1 --2- 172.21.15.17:0/1609738435 >> [v2:172.21.15.172:6800/3866485293,v1:172.21.15.172:6801/3866485293] conn(0x7f004c0740a0 0x7f004c0764c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:19.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.900+0000 7f0068a38640 1 --2- 172.21.15.17:0/1609738435 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f004c06e2b0 0x7f004c070770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:19.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.900+0000 7f0068a38640 1 --2- 172.21.15.17:0/1609738435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0064106800 0x7f006419dbf0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:19.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.900+0000 7f0068a38640 1 --2- 172.21.15.17:0/1609738435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0064100800 0x7f006419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:19.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.900+0000 7f0068a38640 1 -- 172.21.15.17:0/1609738435 >> 172.21.15.17:0/1609738435 conn(0x7f00640fc520 msgr2=0x7f00640fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:19.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.900+0000 7f0068a38640 1 -- 172.21.15.17:0/1609738435 shutdown_connections 2024-09-20T18:32:19.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:19.900+0000 7f0068a38640 1 -- 172.21.15.17:0/1609738435 wait complete. 2024-09-20T18:32:20.727 INFO:teuthology.orchestra.run.smithi017.stdout:111669149713 2024-09-20T18:32:20.727 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-20T18:32:20.940 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:20 smithi017 ceph-mon[28058]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:20.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.929+0000 7f2481408640 1 -- 172.21.15.17:0/707251070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f247c107900 msgr2=0x7f247c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:20.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.929+0000 7f2481408640 1 --2- 172.21.15.17:0/707251070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f247c107900 0x7f247c107ce0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f246c009880 tx=0x7f246c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:20.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.929+0000 7f2481408640 1 -- 172.21.15.17:0/707251070 shutdown_connections 2024-09-20T18:32:20.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.929+0000 7f2481408640 1 --2- 172.21.15.17:0/707251070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f247c101900 0x7f247c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:20.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.929+0000 7f2481408640 1 --2- 172.21.15.17:0/707251070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f247c107900 0x7f247c107ce0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:20.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.929+0000 7f2481408640 1 -- 172.21.15.17:0/707251070 >> 172.21.15.17:0/707251070 conn(0x7f247c0fd600 msgr2=0x7f247c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.929+0000 7f2481408640 1 -- 172.21.15.17:0/707251070 shutdown_connections 2024-09-20T18:32:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.929+0000 7f2481408640 1 -- 172.21.15.17:0/707251070 wait complete. 2024-09-20T18:32:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.930+0000 7f2481408640 1 Processor -- start 2024-09-20T18:32:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.930+0000 7f2481408640 1 -- start start 2024-09-20T18:32:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.931+0000 7f2481408640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f247c101900 0x7f247c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.931+0000 7f2481408640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f247c107900 0x7f247c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.931+0000 7f2481408640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f247c10edd0 con 0x7f247c101900 2024-09-20T18:32:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.931+0000 7f2481408640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f247c10ec50 con 0x7f247c107900 2024-09-20T18:32:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.931+0000 7f247a7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f247c107900 0x7f247c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.931+0000 7f247a7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f247c107900 0x7f247c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:43402/0 (socket says 172.21.15.17:43402) 2024-09-20T18:32:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.931+0000 7f247affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f247c101900 0x7f247c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.931+0000 7f247a7fc640 1 -- 172.21.15.17:0/2236942424 learned_addr learned my addr 172.21.15.17:0/2236942424 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.931+0000 7f247a7fc640 1 -- 172.21.15.17:0/2236942424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f247c101900 msgr2=0x7f247c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.931+0000 7f247a7fc640 1 --2- 172.21.15.17:0/2236942424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f247c101900 0x7f247c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.931+0000 7f247a7fc640 1 -- 172.21.15.17:0/2236942424 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247c197800 con 0x7f247c107900 2024-09-20T18:32:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.932+0000 7f247a7fc640 1 --2- 172.21.15.17:0/2236942424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f247c107900 0x7f247c19dbc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f246400e970 tx=0x7f246400ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.932+0000 7f2473fff640 1 -- 172.21.15.17:0/2236942424 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f246400cac0 con 0x7f247c107900 2024-09-20T18:32:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.932+0000 7f2481408640 1 -- 172.21.15.17:0/2236942424 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247c197af0 con 0x7f247c107900 2024-09-20T18:32:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.932+0000 7f2473fff640 1 -- 172.21.15.17:0/2236942424 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f24640054e0 con 0x7f247c107900 2024-09-20T18:32:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.932+0000 7f2473fff640 1 -- 172.21.15.17:0/2236942424 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2464010430 con 0x7f247c107900 2024-09-20T18:32:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.932+0000 7f2481408640 1 -- 172.21.15.17:0/2236942424 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f247c198080 con 0x7f247c107900 2024-09-20T18:32:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.933+0000 7f2481408640 1 -- 172.21.15.17:0/2236942424 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f247c1986b0 con 0x7f247c107900 2024-09-20T18:32:20.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.935+0000 7f2473fff640 1 -- 172.21.15.17:0/2236942424 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2464004f00 con 0x7f247c107900 2024-09-20T18:32:20.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.935+0000 7f2473fff640 1 --2- 172.21.15.17:0/2236942424 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f246806e310 0x7f24680707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:20.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.935+0000 7f2473fff640 1 -- 172.21.15.17:0/2236942424 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f246408e390 con 0x7f247c107900 2024-09-20T18:32:20.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.935+0000 7f2473fff640 1 --2- 172.21.15.17:0/2236942424 >> [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871] conn(0x7f2468074100 0x7f2468076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:20.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.935+0000 7f2473fff640 1 -- 172.21.15.17:0/2236942424 --> [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2468076bd0 con 0x7f2468074100 2024-09-20T18:32:20.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.935+0000 7f247affd640 1 --2- 172.21.15.17:0/2236942424 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f246806e310 0x7f24680707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:20.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.935+0000 7f2473fff640 1 -- 172.21.15.17:0/2236942424 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f2464095050 con 0x7f247c107900 2024-09-20T18:32:20.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.936+0000 7f247b7fe640 1 --2- 172.21.15.17:0/2236942424 >> [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871] conn(0x7f2468074100 0x7f2468076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:20.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.936+0000 7f247affd640 1 --2- 172.21.15.17:0/2236942424 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f246806e310 0x7f24680707d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f246c0096c0 tx=0x7f246c031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:20.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.936+0000 7f247b7fe640 1 --2- 172.21.15.17:0/2236942424 >> [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871] conn(0x7f2468074100 0x7f2468076520 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:20.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.937+0000 7f2473fff640 1 -- 172.21.15.17:0/2236942424 <== osd.0 v2:172.21.15.17:6802/159236871 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2468076bd0 con 0x7f2468074100 2024-09-20T18:32:20.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:20 smithi172 ceph-mon[35456]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:20.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.965+0000 7f2481408640 1 -- 172.21.15.17:0/2236942424 --> [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f247c062900 con 0x7f2468074100 2024-09-20T18:32:20.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.966+0000 7f2473fff640 1 -- 172.21.15.17:0/2236942424 <== osd.0 v2:172.21.15.17:6802/159236871 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f247c062900 con 0x7f2468074100 2024-09-20T18:32:20.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.966+0000 7f2481408640 1 -- 172.21.15.17:0/2236942424 >> [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871] conn(0x7f2468074100 msgr2=0x7f2468076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:20.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.966+0000 7f2481408640 1 --2- 172.21.15.17:0/2236942424 >> [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871] conn(0x7f2468074100 0x7f2468076520 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:20.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.966+0000 7f2481408640 1 -- 172.21.15.17:0/2236942424 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f246806e310 msgr2=0x7f24680707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:20.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.966+0000 7f2481408640 1 --2- 172.21.15.17:0/2236942424 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f246806e310 0x7f24680707d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f246c0096c0 tx=0x7f246c031400 comp rx=0 tx=0).stop 2024-09-20T18:32:20.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.966+0000 7f2481408640 1 -- 172.21.15.17:0/2236942424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f247c107900 msgr2=0x7f247c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:20.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.966+0000 7f2481408640 1 --2- 172.21.15.17:0/2236942424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f247c107900 0x7f247c19dbc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f246400e970 tx=0x7f246400ed70 comp rx=0 tx=0).stop 2024-09-20T18:32:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.967+0000 7f2481408640 1 -- 172.21.15.17:0/2236942424 shutdown_connections 2024-09-20T18:32:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.967+0000 7f2481408640 1 --2- 172.21.15.17:0/2236942424 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f246806e310 0x7f24680707d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.967+0000 7f2481408640 1 --2- 172.21.15.17:0/2236942424 >> [v2:172.21.15.17:6802/159236871,v1:172.21.15.17:6803/159236871] conn(0x7f2468074100 0x7f2468076520 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.967+0000 7f2481408640 1 --2- 172.21.15.17:0/2236942424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f247c107900 0x7f247c19dbc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.967+0000 7f2481408640 1 --2- 172.21.15.17:0/2236942424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f247c101900 0x7f247c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.967+0000 7f2481408640 1 -- 172.21.15.17:0/2236942424 >> 172.21.15.17:0/2236942424 conn(0x7f247c0fd600 msgr2=0x7f247c0fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.967+0000 7f2481408640 1 -- 172.21.15.17:0/2236942424 shutdown_connections 2024-09-20T18:32:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:20.967+0000 7f2481408640 1 -- 172.21.15.17:0/2236942424 wait complete. 2024-09-20T18:32:20.990 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:20.991 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:21.957 INFO:teuthology.orchestra.run.smithi017.stdout:38654705698 2024-09-20T18:32:21.957 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-20T18:32:22.372 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:22.373 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:22.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.375+0000 7ff1c6495640 1 -- 172.21.15.17:0/53072622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c01033d0 msgr2=0x7ff1c010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:22.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.375+0000 7ff1c6495640 1 --2- 172.21.15.17:0/53072622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c01033d0 0x7ff1c010b8c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009880 tx=0x7ff1b402a540 comp rx=0 tx=0).stop 2024-09-20T18:32:22.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.375+0000 7ff1c6495640 1 -- 172.21.15.17:0/53072622 shutdown_connections 2024-09-20T18:32:22.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.375+0000 7ff1c6495640 1 --2- 172.21.15.17:0/53072622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c01033d0 0x7ff1c010b8c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:22.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.375+0000 7ff1c6495640 1 --2- 172.21.15.17:0/53072622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1c0102ab0 0x7ff1c0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:22.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.375+0000 7ff1c6495640 1 -- 172.21.15.17:0/53072622 >> 172.21.15.17:0/53072622 conn(0x7ff1c00fc550 msgr2=0x7ff1c00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:22.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.375+0000 7ff1c6495640 1 -- 172.21.15.17:0/53072622 shutdown_connections 2024-09-20T18:32:22.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.375+0000 7ff1c6495640 1 -- 172.21.15.17:0/53072622 wait complete. 2024-09-20T18:32:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.376+0000 7ff1c6495640 1 Processor -- start 2024-09-20T18:32:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.376+0000 7ff1c6495640 1 -- start start 2024-09-20T18:32:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.376+0000 7ff1c6495640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c0102ab0 0x7ff1c0100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.376+0000 7ff1c6495640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1c01033d0 0x7ff1c0100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.376+0000 7ff1c6495640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c010edc0 con 0x7ff1c0102ab0 2024-09-20T18:32:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.376+0000 7ff1c6495640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c010ec40 con 0x7ff1c01033d0 2024-09-20T18:32:22.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.376+0000 7ff1bffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c0102ab0 0x7ff1c0100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:22.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.376+0000 7ff1bffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c0102ab0 0x7ff1c0100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60922/0 (socket says 172.21.15.17:60922) 2024-09-20T18:32:22.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.376+0000 7ff1bffff640 1 -- 172.21.15.17:0/1815906400 learned_addr learned my addr 172.21.15.17:0/1815906400 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:22.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.376+0000 7ff1bf7fe640 1 --2- 172.21.15.17:0/1815906400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1c01033d0 0x7ff1c0100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:22.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.377+0000 7ff1bffff640 1 -- 172.21.15.17:0/1815906400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1c01033d0 msgr2=0x7ff1c0100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:22.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.377+0000 7ff1bffff640 1 --2- 172.21.15.17:0/1815906400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1c01033d0 0x7ff1c0100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:22.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.377+0000 7ff1bffff640 1 -- 172.21.15.17:0/1815906400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c0101190 con 0x7ff1c0102ab0 2024-09-20T18:32:22.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.377+0000 7ff1bffff640 1 --2- 172.21.15.17:0/1815906400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c0102ab0 0x7ff1c0100710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000c8a0 tx=0x7ff1b000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.377+0000 7ff1bd7fa640 1 -- 172.21.15.17:0/1815906400 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff1b00079b0 con 0x7ff1c0102ab0 2024-09-20T18:32:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.377+0000 7ff1c6495640 1 -- 172.21.15.17:0/1815906400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c0101480 con 0x7ff1c0102ab0 2024-09-20T18:32:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.377+0000 7ff1c6495640 1 -- 172.21.15.17:0/1815906400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c01a3db0 con 0x7ff1c0102ab0 2024-09-20T18:32:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.378+0000 7ff1bd7fa640 1 -- 172.21.15.17:0/1815906400 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff1b0007b50 con 0x7ff1c0102ab0 2024-09-20T18:32:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.378+0000 7ff1bd7fa640 1 -- 172.21.15.17:0/1815906400 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff1b0018700 con 0x7ff1c0102ab0 2024-09-20T18:32:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.378+0000 7ff1c6495640 1 -- 172.21.15.17:0/1815906400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1ac001030 con 0x7ff1c0102ab0 2024-09-20T18:32:22.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.379+0000 7ff1bd7fa640 1 -- 172.21.15.17:0/1815906400 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff1b00188a0 con 0x7ff1c0102ab0 2024-09-20T18:32:22.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.380+0000 7ff1bd7fa640 1 --2- 172.21.15.17:0/1815906400 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff1a806e310 0x7ff1a80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:22.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.380+0000 7ff1bd7fa640 1 -- 172.21.15.17:0/1815906400 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7ff1b008df30 con 0x7ff1c0102ab0 2024-09-20T18:32:22.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.380+0000 7ff1bd7fa640 1 --2- 172.21.15.17:0/1815906400 >> [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513] conn(0x7ff1a8074100 0x7ff1a8076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:22.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.380+0000 7ff1bd7fa640 1 -- 172.21.15.17:0/1815906400 --> [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1b0005640 con 0x7ff1a8074100 2024-09-20T18:32:22.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.380+0000 7ff1bd7fa640 1 -- 172.21.15.17:0/1815906400 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7ff1b00905f0 con 0x7ff1c0102ab0 2024-09-20T18:32:22.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.380+0000 7ff1c4a32640 1 --2- 172.21.15.17:0/1815906400 >> [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513] conn(0x7ff1a8074100 0x7ff1a8076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:22.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.380+0000 7ff1bf7fe640 1 --2- 172.21.15.17:0/1815906400 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff1a806e310 0x7ff1a80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:22.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.381+0000 7ff1c4a32640 1 --2- 172.21.15.17:0/1815906400 >> [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513] conn(0x7ff1a8074100 0x7ff1a8076520 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:22.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.382+0000 7ff1bf7fe640 1 --2- 172.21.15.17:0/1815906400 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff1a806e310 0x7ff1a80707d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff1c01021a0 tx=0x7ff1b4031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:22.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.382+0000 7ff1bd7fa640 1 -- 172.21.15.17:0/1815906400 <== osd.1 v2:172.21.15.17:6810/227764513 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff1b0005640 con 0x7ff1a8074100 2024-09-20T18:32:22.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.396+0000 7ff1c6495640 1 -- 172.21.15.17:0/1815906400 --> [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff1ac002dd0 con 0x7ff1a8074100 2024-09-20T18:32:22.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.396+0000 7ff1bd7fa640 1 -- 172.21.15.17:0/1815906400 <== osd.1 v2:172.21.15.17:6810/227764513 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff1ac002dd0 con 0x7ff1a8074100 2024-09-20T18:32:22.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.396+0000 7ff1c6495640 1 -- 172.21.15.17:0/1815906400 >> [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513] conn(0x7ff1a8074100 msgr2=0x7ff1a8076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:22.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.396+0000 7ff1c6495640 1 --2- 172.21.15.17:0/1815906400 >> [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513] conn(0x7ff1a8074100 0x7ff1a8076520 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:22.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.397+0000 7ff1c6495640 1 -- 172.21.15.17:0/1815906400 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff1a806e310 msgr2=0x7ff1a80707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:22.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.397+0000 7ff1c6495640 1 --2- 172.21.15.17:0/1815906400 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff1a806e310 0x7ff1a80707d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff1c01021a0 tx=0x7ff1b4031400 comp rx=0 tx=0).stop 2024-09-20T18:32:22.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.397+0000 7ff1c6495640 1 -- 172.21.15.17:0/1815906400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c0102ab0 msgr2=0x7ff1c0100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:22.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.397+0000 7ff1c6495640 1 --2- 172.21.15.17:0/1815906400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c0102ab0 0x7ff1c0100710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000c8a0 tx=0x7ff1b000cd60 comp rx=0 tx=0).stop 2024-09-20T18:32:22.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.397+0000 7ff1c6495640 1 -- 172.21.15.17:0/1815906400 shutdown_connections 2024-09-20T18:32:22.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.397+0000 7ff1c6495640 1 --2- 172.21.15.17:0/1815906400 >> [v2:172.21.15.17:6810/227764513,v1:172.21.15.17:6811/227764513] conn(0x7ff1a8074100 0x7ff1a8076520 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:22.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.397+0000 7ff1c6495640 1 --2- 172.21.15.17:0/1815906400 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff1a806e310 0x7ff1a80707d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:22.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.397+0000 7ff1c6495640 1 --2- 172.21.15.17:0/1815906400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1c01033d0 0x7ff1c0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:22.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.397+0000 7ff1c6495640 1 --2- 172.21.15.17:0/1815906400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c0102ab0 0x7ff1c0100710 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:22.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.397+0000 7ff1c6495640 1 -- 172.21.15.17:0/1815906400 >> 172.21.15.17:0/1815906400 conn(0x7ff1c00fc550 msgr2=0x7ff1c010aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:22.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.397+0000 7ff1c6495640 1 -- 172.21.15.17:0/1815906400 shutdown_connections 2024-09-20T18:32:22.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.397+0000 7ff1c6495640 1 -- 172.21.15.17:0/1815906400 wait complete. 2024-09-20T18:32:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.553+0000 7f3b9efd2640 1 -- 172.21.15.17:0/4172501652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b98100810 msgr2=0x7f3b98100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.553+0000 7f3b9efd2640 1 --2- 172.21.15.17:0/4172501652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b98100810 0x7f3b98100c70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009880 tx=0x7f3b8c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.553+0000 7f3b9efd2640 1 -- 172.21.15.17:0/4172501652 shutdown_connections 2024-09-20T18:32:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.553+0000 7f3b9efd2640 1 --2- 172.21.15.17:0/4172501652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b98100810 0x7f3b98100c70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.553+0000 7f3b9efd2640 1 --2- 172.21.15.17:0/4172501652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b98106810 0x7f3b98106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.553+0000 7f3b9efd2640 1 -- 172.21.15.17:0/4172501652 >> 172.21.15.17:0/4172501652 conn(0x7f3b980fc510 msgr2=0x7f3b980fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.553+0000 7f3b9efd2640 1 -- 172.21.15.17:0/4172501652 shutdown_connections 2024-09-20T18:32:22.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.553+0000 7f3b9efd2640 1 -- 172.21.15.17:0/4172501652 wait complete. 2024-09-20T18:32:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.553+0000 7f3b9efd2640 1 Processor -- start 2024-09-20T18:32:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.553+0000 7f3b9efd2640 1 -- start start 2024-09-20T18:32:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.554+0000 7f3b9efd2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b98100810 0x7f3b9819f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.554+0000 7f3b9efd2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b98106810 0x7f3b9819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.554+0000 7f3b9efd2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9810dce0 con 0x7f3b98106810 2024-09-20T18:32:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.554+0000 7f3b9efd2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9810db60 con 0x7f3b98100810 2024-09-20T18:32:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.554+0000 7f3b97fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b98106810 0x7f3b9819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.554+0000 7f3b97fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b98106810 0x7f3b9819fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60940/0 (socket says 172.21.15.17:60940) 2024-09-20T18:32:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.554+0000 7f3b97fff640 1 -- 172.21.15.17:0/62455816 learned_addr learned my addr 172.21.15.17:0/62455816 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:22.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.554+0000 7f3b9cd6e640 1 --2- 172.21.15.17:0/62455816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b98100810 0x7f3b9819f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.554+0000 7f3b97fff640 1 -- 172.21.15.17:0/62455816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b98100810 msgr2=0x7f3b9819f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.554+0000 7f3b97fff640 1 --2- 172.21.15.17:0/62455816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b98100810 0x7f3b9819f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.554+0000 7f3b97fff640 1 -- 172.21.15.17:0/62455816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b98199a00 con 0x7f3b98106810 2024-09-20T18:32:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.554+0000 7f3b97fff640 1 --2- 172.21.15.17:0/62455816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b98106810 0x7f3b9819fd80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c031460 tx=0x7f3b8c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.554+0000 7f3b95ffb640 1 -- 172.21.15.17:0/62455816 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b8c03f070 con 0x7f3b98106810 2024-09-20T18:32:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.554+0000 7f3b95ffb640 1 -- 172.21.15.17:0/62455816 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3b8c0035f0 con 0x7f3b98106810 2024-09-20T18:32:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.554+0000 7f3b95ffb640 1 -- 172.21.15.17:0/62455816 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b8c035030 con 0x7f3b98106810 2024-09-20T18:32:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.554+0000 7f3b9efd2640 1 -- 172.21.15.17:0/62455816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b98199c90 con 0x7f3b98106810 2024-09-20T18:32:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.555+0000 7f3b9efd2640 1 -- 172.21.15.17:0/62455816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b9819a1c0 con 0x7f3b98106810 2024-09-20T18:32:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.555+0000 7f3b9efd2640 1 -- 172.21.15.17:0/62455816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b9819a800 con 0x7f3b98106810 2024-09-20T18:32:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.556+0000 7f3b95ffb640 1 -- 172.21.15.17:0/62455816 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f3b8c042070 con 0x7f3b98106810 2024-09-20T18:32:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.556+0000 7f3b95ffb640 1 --2- 172.21.15.17:0/62455816 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3b8006e2b0 0x7f3b80070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.557+0000 7f3b9cd6e640 1 --2- 172.21.15.17:0/62455816 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3b8006e2b0 0x7f3b80070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:22.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.557+0000 7f3b95ffb640 1 -- 172.21.15.17:0/62455816 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f3b8c0ae7c0 con 0x7f3b98106810 2024-09-20T18:32:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.557+0000 7f3b95ffb640 1 --2- 172.21.15.17:0/62455816 >> [v2:172.21.15.172:6808/503301696,v1:172.21.15.172:6809/503301696] conn(0x7f3b800740a0 0x7f3b800764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.557+0000 7f3b95ffb640 1 -- 172.21.15.17:0/62455816 --> [v2:172.21.15.172:6808/503301696,v1:172.21.15.172:6809/503301696] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b8c0054e0 con 0x7f3b800740a0 2024-09-20T18:32:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.557+0000 7f3b95ffb640 1 -- 172.21.15.17:0/62455816 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f3b8c0b5050 con 0x7f3b98106810 2024-09-20T18:32:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.557+0000 7f3b9cd6e640 1 --2- 172.21.15.17:0/62455816 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3b8006e2b0 0x7f3b80070770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3b9819ab40 tx=0x7f3b88005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.557+0000 7f3b9d56f640 1 --2- 172.21.15.17:0/62455816 >> [v2:172.21.15.172:6808/503301696,v1:172.21.15.172:6809/503301696] conn(0x7f3b800740a0 0x7f3b800764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.558+0000 7f3b9d56f640 1 --2- 172.21.15.17:0/62455816 >> [v2:172.21.15.172:6808/503301696,v1:172.21.15.172:6809/503301696] conn(0x7f3b800740a0 0x7f3b800764c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.558+0000 7f3b95ffb640 1 -- 172.21.15.17:0/62455816 <== osd.4 v2:172.21.15.172:6808/503301696 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b8c0054e0 con 0x7f3b800740a0 2024-09-20T18:32:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.572+0000 7f3b9efd2640 1 -- 172.21.15.17:0/62455816 --> [v2:172.21.15.172:6808/503301696,v1:172.21.15.172:6809/503301696] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b980fdce0 con 0x7f3b800740a0 2024-09-20T18:32:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.573+0000 7f3b95ffb640 1 -- 172.21.15.17:0/62455816 <== osd.4 v2:172.21.15.172:6808/503301696 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3b980fdce0 con 0x7f3b800740a0 2024-09-20T18:32:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.573+0000 7f3b9efd2640 1 -- 172.21.15.17:0/62455816 >> [v2:172.21.15.172:6808/503301696,v1:172.21.15.172:6809/503301696] conn(0x7f3b800740a0 msgr2=0x7f3b800764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.573+0000 7f3b9efd2640 1 --2- 172.21.15.17:0/62455816 >> [v2:172.21.15.172:6808/503301696,v1:172.21.15.172:6809/503301696] conn(0x7f3b800740a0 0x7f3b800764c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.573+0000 7f3b9efd2640 1 -- 172.21.15.17:0/62455816 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3b8006e2b0 msgr2=0x7f3b80070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.573+0000 7f3b9efd2640 1 --2- 172.21.15.17:0/62455816 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3b8006e2b0 0x7f3b80070770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3b9819ab40 tx=0x7f3b88005f90 comp rx=0 tx=0).stop 2024-09-20T18:32:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.573+0000 7f3b9efd2640 1 -- 172.21.15.17:0/62455816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b98106810 msgr2=0x7f3b9819fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.573+0000 7f3b9efd2640 1 --2- 172.21.15.17:0/62455816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b98106810 0x7f3b9819fd80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c031460 tx=0x7f3b8c004530 comp rx=0 tx=0).stop 2024-09-20T18:32:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.573+0000 7f3b9efd2640 1 -- 172.21.15.17:0/62455816 shutdown_connections 2024-09-20T18:32:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.573+0000 7f3b9efd2640 1 --2- 172.21.15.17:0/62455816 >> [v2:172.21.15.172:6808/503301696,v1:172.21.15.172:6809/503301696] conn(0x7f3b800740a0 0x7f3b800764c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.573+0000 7f3b9efd2640 1 --2- 172.21.15.17:0/62455816 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3b8006e2b0 0x7f3b80070770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.573+0000 7f3b9efd2640 1 --2- 172.21.15.17:0/62455816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b98106810 0x7f3b9819fd80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.573+0000 7f3b9efd2640 1 --2- 172.21.15.17:0/62455816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b98100810 0x7f3b9819f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.573+0000 7f3b9efd2640 1 -- 172.21.15.17:0/62455816 >> 172.21.15.17:0/62455816 conn(0x7f3b980fc510 msgr2=0x7f3b980fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.573+0000 7f3b9efd2640 1 -- 172.21.15.17:0/62455816 shutdown_connections 2024-09-20T18:32:22.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:22.573+0000 7f3b9efd2640 1 -- 172.21.15.17:0/62455816 wait complete. 2024-09-20T18:32:22.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:22 smithi017 ceph-mon[28058]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:22.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:22 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:32:22.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:22 smithi172 ceph-mon[35456]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:22.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:22 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:32:23.368 INFO:teuthology.orchestra.run.smithi017.stdout:141733920780 2024-09-20T18:32:23.368 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-20T18:32:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:23.964 INFO:teuthology.orchestra.run.smithi017.stdout:60129542172 2024-09-20T18:32:23.964 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-20T18:32:24.195 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.574+0000 7fce7162d640 1 -- 172.21.15.17:0/52851122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce6c100250 msgr2=0x7fce6c100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.574+0000 7fce7162d640 1 --2- 172.21.15.17:0/52851122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce6c100250 0x7fce6c100630 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fce5c009c20 tx=0x7fce5c02a970 comp rx=0 tx=0).stop 2024-09-20T18:32:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.574+0000 7fce7162d640 1 -- 172.21.15.17:0/52851122 shutdown_connections 2024-09-20T18:32:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.574+0000 7fce7162d640 1 --2- 172.21.15.17:0/52851122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce6c100c00 0x7fce6c104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.574+0000 7fce7162d640 1 --2- 172.21.15.17:0/52851122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce6c100250 0x7fce6c100630 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.574+0000 7fce7162d640 1 -- 172.21.15.17:0/52851122 >> 172.21.15.17:0/52851122 conn(0x7fce6c0fbc90 msgr2=0x7fce6c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.575+0000 7fce7162d640 1 -- 172.21.15.17:0/52851122 shutdown_connections 2024-09-20T18:32:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.575+0000 7fce7162d640 1 -- 172.21.15.17:0/52851122 wait complete. 2024-09-20T18:32:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.575+0000 7fce7162d640 1 Processor -- start 2024-09-20T18:32:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.575+0000 7fce7162d640 1 -- start start 2024-09-20T18:32:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.575+0000 7fce7162d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce6c100250 0x7fce6c19f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.576+0000 7fce7162d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce6c100c00 0x7fce6c19fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.576+0000 7fce7162d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c10ddb0 con 0x7fce6c100c00 2024-09-20T18:32:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.576+0000 7fce7162d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c10dc30 con 0x7fce6c100250 2024-09-20T18:32:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.576+0000 7fce6a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce6c100c00 0x7fce6c19fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.576+0000 7fce6a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce6c100c00 0x7fce6c19fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60950/0 (socket says 172.21.15.17:60950) 2024-09-20T18:32:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.576+0000 7fce6a7fc640 1 -- 172.21.15.17:0/524651355 learned_addr learned my addr 172.21.15.17:0/524651355 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.576+0000 7fce6affd640 1 --2- 172.21.15.17:0/524651355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce6c100250 0x7fce6c19f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.576+0000 7fce6a7fc640 1 -- 172.21.15.17:0/524651355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce6c100250 msgr2=0x7fce6c19f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.576+0000 7fce6a7fc640 1 --2- 172.21.15.17:0/524651355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce6c100250 0x7fce6c19f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.576+0000 7fce6a7fc640 1 -- 172.21.15.17:0/524651355 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6c199ab0 con 0x7fce6c100c00 2024-09-20T18:32:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.576+0000 7fce6a7fc640 1 --2- 172.21.15.17:0/524651355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce6c100c00 0x7fce6c19fe30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fce6000b420 tx=0x7fce6000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.576+0000 7fce53fff640 1 -- 172.21.15.17:0/524651355 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce60011630 con 0x7fce6c100c00 2024-09-20T18:32:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.576+0000 7fce7162d640 1 -- 172.21.15.17:0/524651355 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6c199da0 con 0x7fce6c100c00 2024-09-20T18:32:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.576+0000 7fce53fff640 1 -- 172.21.15.17:0/524651355 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce60016070 con 0x7fce6c100c00 2024-09-20T18:32:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.576+0000 7fce53fff640 1 -- 172.21.15.17:0/524651355 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce60010d40 con 0x7fce6c100c00 2024-09-20T18:32:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.576+0000 7fce7162d640 1 -- 172.21.15.17:0/524651355 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce6c19a330 con 0x7fce6c100c00 2024-09-20T18:32:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.577+0000 7fce7162d640 1 -- 172.21.15.17:0/524651355 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fce6c101730 con 0x7fce6c100c00 2024-09-20T18:32:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.578+0000 7fce53fff640 1 -- 172.21.15.17:0/524651355 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fce600243d0 con 0x7fce6c100c00 2024-09-20T18:32:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.578+0000 7fce53fff640 1 --2- 172.21.15.17:0/524651355 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce5406e2b0 0x7fce54070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.578+0000 7fce53fff640 1 -- 172.21.15.17:0/524651355 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fce6008e1b0 con 0x7fce6c100c00 2024-09-20T18:32:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.579+0000 7fce6affd640 1 --2- 172.21.15.17:0/524651355 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce5406e2b0 0x7fce54070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.579+0000 7fce53fff640 1 --2- 172.21.15.17:0/524651355 >> [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491] conn(0x7fce54074030 0x7fce54076450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.579+0000 7fce53fff640 1 -- 172.21.15.17:0/524651355 --> [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce60014e50 con 0x7fce54074030 2024-09-20T18:32:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.579+0000 7fce53fff640 1 -- 172.21.15.17:0/524651355 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fce6008e5b0 con 0x7fce6c100c00 2024-09-20T18:32:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.579+0000 7fce6b7fe640 1 --2- 172.21.15.17:0/524651355 >> [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491] conn(0x7fce54074030 0x7fce54076450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.579+0000 7fce6affd640 1 --2- 172.21.15.17:0/524651355 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce5406e2b0 0x7fce54070770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fce5c000f80 tx=0x7fce5c02f9d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.579+0000 7fce6b7fe640 1 --2- 172.21.15.17:0/524651355 >> [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491] conn(0x7fce54074030 0x7fce54076450 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.580+0000 7fce53fff640 1 -- 172.21.15.17:0/524651355 <== osd.2 v2:172.21.15.17:6818/2070903491 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fce60014e50 con 0x7fce54074030 2024-09-20T18:32:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.593+0000 7fce7162d640 1 -- 172.21.15.17:0/524651355 --> [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fce6c103ec0 con 0x7fce54074030 2024-09-20T18:32:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.594+0000 7fce53fff640 1 -- 172.21.15.17:0/524651355 <== osd.2 v2:172.21.15.17:6818/2070903491 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fce6c103ec0 con 0x7fce54074030 2024-09-20T18:32:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.594+0000 7fce7162d640 1 -- 172.21.15.17:0/524651355 >> [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491] conn(0x7fce54074030 msgr2=0x7fce54076450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.594+0000 7fce7162d640 1 --2- 172.21.15.17:0/524651355 >> [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491] conn(0x7fce54074030 0x7fce54076450 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.594+0000 7fce7162d640 1 -- 172.21.15.17:0/524651355 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce5406e2b0 msgr2=0x7fce54070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.594+0000 7fce7162d640 1 --2- 172.21.15.17:0/524651355 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce5406e2b0 0x7fce54070770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fce5c000f80 tx=0x7fce5c02f9d0 comp rx=0 tx=0).stop 2024-09-20T18:32:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.594+0000 7fce7162d640 1 -- 172.21.15.17:0/524651355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce6c100c00 msgr2=0x7fce6c19fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.594+0000 7fce7162d640 1 --2- 172.21.15.17:0/524651355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce6c100c00 0x7fce6c19fe30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fce6000b420 tx=0x7fce6000b8e0 comp rx=0 tx=0).stop 2024-09-20T18:32:24.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.594+0000 7fce7162d640 1 -- 172.21.15.17:0/524651355 shutdown_connections 2024-09-20T18:32:24.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.594+0000 7fce7162d640 1 --2- 172.21.15.17:0/524651355 >> [v2:172.21.15.17:6818/2070903491,v1:172.21.15.17:6819/2070903491] conn(0x7fce54074030 0x7fce54076450 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:24.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.594+0000 7fce7162d640 1 --2- 172.21.15.17:0/524651355 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce5406e2b0 0x7fce54070770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:24.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.594+0000 7fce7162d640 1 --2- 172.21.15.17:0/524651355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce6c100c00 0x7fce6c19fe30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:24.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.594+0000 7fce7162d640 1 --2- 172.21.15.17:0/524651355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce6c100250 0x7fce6c19f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:24.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.594+0000 7fce7162d640 1 -- 172.21.15.17:0/524651355 >> 172.21.15.17:0/524651355 conn(0x7fce6c0fbc90 msgr2=0x7fce6c0fc070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:24.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.594+0000 7fce7162d640 1 -- 172.21.15.17:0/524651355 shutdown_connections 2024-09-20T18:32:24.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:24.594+0000 7fce7162d640 1 -- 172.21.15.17:0/524651355 wait complete. 2024-09-20T18:32:24.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:24 smithi017 ceph-mon[28058]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:24.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:24 smithi172 ceph-mon[35456]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:25.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.421+0000 7fce95f77640 1 -- 172.21.15.17:0/1633329465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce901033e0 msgr2=0x7fce9010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:25.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.421+0000 7fce95f77640 1 --2- 172.21.15.17:0/1633329465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce901033e0 0x7fce9010b8d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fce84009880 tx=0x7fce8402a530 comp rx=0 tx=0).stop 2024-09-20T18:32:25.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.421+0000 7fce95f77640 1 -- 172.21.15.17:0/1633329465 shutdown_connections 2024-09-20T18:32:25.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.421+0000 7fce95f77640 1 --2- 172.21.15.17:0/1633329465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce901033e0 0x7fce9010b8d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:25.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.421+0000 7fce95f77640 1 --2- 172.21.15.17:0/1633329465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce90102ac0 0x7fce90102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:25.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.421+0000 7fce95f77640 1 -- 172.21.15.17:0/1633329465 >> 172.21.15.17:0/1633329465 conn(0x7fce900fc520 msgr2=0x7fce900fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:25.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.421+0000 7fce95f77640 1 -- 172.21.15.17:0/1633329465 shutdown_connections 2024-09-20T18:32:25.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.422+0000 7fce95f77640 1 -- 172.21.15.17:0/1633329465 wait complete. 2024-09-20T18:32:25.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.422+0000 7fce95f77640 1 Processor -- start 2024-09-20T18:32:25.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.422+0000 7fce95f77640 1 -- start start 2024-09-20T18:32:25.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.422+0000 7fce95f77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce90102ac0 0x7fce9019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:25.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.422+0000 7fce95f77640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce901033e0 0x7fce9019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:25.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.422+0000 7fce95f77640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fce9010edf0 con 0x7fce90102ac0 2024-09-20T18:32:25.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.422+0000 7fce95f77640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fce9010ec70 con 0x7fce901033e0 2024-09-20T18:32:25.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.423+0000 7fce8f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce90102ac0 0x7fce9019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:25.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.423+0000 7fce8f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce90102ac0 0x7fce9019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60956/0 (socket says 172.21.15.17:60956) 2024-09-20T18:32:25.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.423+0000 7fce8f7fe640 1 -- 172.21.15.17:0/2353455306 learned_addr learned my addr 172.21.15.17:0/2353455306 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:25.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.423+0000 7fce8effd640 1 --2- 172.21.15.17:0/2353455306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce901033e0 0x7fce9019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:25.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.423+0000 7fce8f7fe640 1 -- 172.21.15.17:0/2353455306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce901033e0 msgr2=0x7fce9019dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:25.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.423+0000 7fce8f7fe640 1 --2- 172.21.15.17:0/2353455306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce901033e0 0x7fce9019dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:25.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.423+0000 7fce8f7fe640 1 -- 172.21.15.17:0/2353455306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce90197820 con 0x7fce90102ac0 2024-09-20T18:32:25.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.423+0000 7fce8f7fe640 1 --2- 172.21.15.17:0/2353455306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce90102ac0 0x7fce9019d6a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fce8000e970 tx=0x7fce8000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:25.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.423+0000 7fce8cff9640 1 -- 172.21.15.17:0/2353455306 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce8000cac0 con 0x7fce90102ac0 2024-09-20T18:32:25.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.423+0000 7fce8cff9640 1 -- 172.21.15.17:0/2353455306 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce800054e0 con 0x7fce90102ac0 2024-09-20T18:32:25.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.423+0000 7fce95f77640 1 -- 172.21.15.17:0/2353455306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce90197b10 con 0x7fce90102ac0 2024-09-20T18:32:25.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.423+0000 7fce8cff9640 1 -- 172.21.15.17:0/2353455306 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce80010430 con 0x7fce90102ac0 2024-09-20T18:32:25.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.423+0000 7fce95f77640 1 -- 172.21.15.17:0/2353455306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce90198070 con 0x7fce90102ac0 2024-09-20T18:32:25.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.424+0000 7fce95f77640 1 -- 172.21.15.17:0/2353455306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9006aa90 con 0x7fce90102ac0 2024-09-20T18:32:25.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.425+0000 7fce8cff9640 1 -- 172.21.15.17:0/2353455306 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fce80004f00 con 0x7fce90102ac0 2024-09-20T18:32:25.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.426+0000 7fce8cff9640 1 --2- 172.21.15.17:0/2353455306 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce7806e310 0x7fce780707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:25.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.426+0000 7fce8cff9640 1 -- 172.21.15.17:0/2353455306 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fce8008e370 con 0x7fce90102ac0 2024-09-20T18:32:25.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.426+0000 7fce8effd640 1 --2- 172.21.15.17:0/2353455306 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce7806e310 0x7fce780707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:25.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.426+0000 7fce8effd640 1 --2- 172.21.15.17:0/2353455306 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce7806e310 0x7fce780707d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce90198b70 tx=0x7fce84031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:25.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.430+0000 7fce8cff9640 1 -- 172.21.15.17:0/2353455306 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fce8005c090 con 0x7fce90102ac0 2024-09-20T18:32:25.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.610+0000 7fce95f77640 1 -- 172.21.15.17:0/2353455306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fce90105f60 con 0x7fce90102ac0 2024-09-20T18:32:25.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.610+0000 7fce8cff9640 1 -- 172.21.15.17:0/2353455306 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fce8005fd40 con 0x7fce90102ac0 2024-09-20T18:32:25.624 INFO:teuthology.orchestra.run.smithi017.stdout:38654705699 2024-09-20T18:32:25.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.612+0000 7fce95f77640 1 -- 172.21.15.17:0/2353455306 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce7806e310 msgr2=0x7fce780707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.612+0000 7fce95f77640 1 --2- 172.21.15.17:0/2353455306 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce7806e310 0x7fce780707d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce90198b70 tx=0x7fce84031400 comp rx=0 tx=0).stop 2024-09-20T18:32:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.612+0000 7fce95f77640 1 -- 172.21.15.17:0/2353455306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce90102ac0 msgr2=0x7fce9019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.612+0000 7fce95f77640 1 --2- 172.21.15.17:0/2353455306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce90102ac0 0x7fce9019d6a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fce8000e970 tx=0x7fce8000ed70 comp rx=0 tx=0).stop 2024-09-20T18:32:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.612+0000 7fce95f77640 1 -- 172.21.15.17:0/2353455306 shutdown_connections 2024-09-20T18:32:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.612+0000 7fce95f77640 1 --2- 172.21.15.17:0/2353455306 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fce7806e310 0x7fce780707d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.612+0000 7fce95f77640 1 --2- 172.21.15.17:0/2353455306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce901033e0 0x7fce9019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.612+0000 7fce95f77640 1 --2- 172.21.15.17:0/2353455306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce90102ac0 0x7fce9019d6a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.612+0000 7fce95f77640 1 -- 172.21.15.17:0/2353455306 >> 172.21.15.17:0/2353455306 conn(0x7fce900fc520 msgr2=0x7fce90108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.612+0000 7fce95f77640 1 -- 172.21.15.17:0/2353455306 shutdown_connections 2024-09-20T18:32:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.612+0000 7fce95f77640 1 -- 172.21.15.17:0/2353455306 wait complete. 2024-09-20T18:32:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.589+0000 7f5154dda640 1 -- 172.21.15.17:0/3679766248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5150103470 msgr2=0x7f515010b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.589+0000 7f5154dda640 1 --2- 172.21.15.17:0/3679766248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5150103470 0x7f515010b960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5144009880 tx=0x7f514402a530 comp rx=0 tx=0).stop 2024-09-20T18:32:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.589+0000 7f5154dda640 1 -- 172.21.15.17:0/3679766248 shutdown_connections 2024-09-20T18:32:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.589+0000 7f5154dda640 1 --2- 172.21.15.17:0/3679766248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5150103470 0x7f515010b960 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.589+0000 7f5154dda640 1 --2- 172.21.15.17:0/3679766248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5150102b50 0x7f5150102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.589+0000 7f5154dda640 1 -- 172.21.15.17:0/3679766248 >> 172.21.15.17:0/3679766248 conn(0x7f51500fc550 msgr2=0x7f51500fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.589+0000 7f5154dda640 1 -- 172.21.15.17:0/3679766248 shutdown_connections 2024-09-20T18:32:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.589+0000 7f5154dda640 1 -- 172.21.15.17:0/3679766248 wait complete. 2024-09-20T18:32:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.590+0000 7f5154dda640 1 Processor -- start 2024-09-20T18:32:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.590+0000 7f5154dda640 1 -- start start 2024-09-20T18:32:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.590+0000 7f5154dda640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5150102b50 0x7f51501007b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.590+0000 7f5154dda640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5150103470 0x7f5150100cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.590+0000 7f5154dda640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f515010edc0 con 0x7f5150103470 2024-09-20T18:32:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.590+0000 7f5154dda640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f515010ec40 con 0x7f5150102b50 2024-09-20T18:32:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.590+0000 7f514dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5150103470 0x7f5150100cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.591+0000 7f514dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5150103470 0x7f5150100cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60972/0 (socket says 172.21.15.17:60972) 2024-09-20T18:32:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.591+0000 7f514dd9b640 1 -- 172.21.15.17:0/2433552718 learned_addr learned my addr 172.21.15.17:0/2433552718 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.591+0000 7f514e59c640 1 --2- 172.21.15.17:0/2433552718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5150102b50 0x7f51501007b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.591+0000 7f514dd9b640 1 -- 172.21.15.17:0/2433552718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5150102b50 msgr2=0x7f51501007b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.591+0000 7f514dd9b640 1 --2- 172.21.15.17:0/2433552718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5150102b50 0x7f51501007b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.591+0000 7f514dd9b640 1 -- 172.21.15.17:0/2433552718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5150101230 con 0x7f5150103470 2024-09-20T18:32:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.591+0000 7f514e59c640 1 --2- 172.21.15.17:0/2433552718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5150102b50 0x7f51501007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:32:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.591+0000 7f514dd9b640 1 --2- 172.21.15.17:0/2433552718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5150103470 0x7f5150100cf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5144004f90 tx=0x7f51440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.591+0000 7f513f7fe640 1 -- 172.21.15.17:0/2433552718 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f514403f070 con 0x7f5150103470 2024-09-20T18:32:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.591+0000 7f513f7fe640 1 -- 172.21.15.17:0/2433552718 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5144004c70 con 0x7f5150103470 2024-09-20T18:32:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.591+0000 7f5154dda640 1 -- 172.21.15.17:0/2433552718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51501014c0 con 0x7f5150103470 2024-09-20T18:32:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.591+0000 7f513f7fe640 1 -- 172.21.15.17:0/2433552718 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5144035030 con 0x7f5150103470 2024-09-20T18:32:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.591+0000 7f5154dda640 1 -- 172.21.15.17:0/2433552718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51501a3d50 con 0x7f5150103470 2024-09-20T18:32:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.592+0000 7f5154dda640 1 -- 172.21.15.17:0/2433552718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f515006a4e0 con 0x7f5150103470 2024-09-20T18:32:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.593+0000 7f513f7fe640 1 -- 172.21.15.17:0/2433552718 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5144042070 con 0x7f5150103470 2024-09-20T18:32:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.593+0000 7f513f7fe640 1 --2- 172.21.15.17:0/2433552718 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f513806e2b0 0x7f5138070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.594+0000 7f514e59c640 1 --2- 172.21.15.17:0/2433552718 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f513806e2b0 0x7f5138070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.594+0000 7f513f7fe640 1 -- 172.21.15.17:0/2433552718 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f51440ae8c0 con 0x7f5150103470 2024-09-20T18:32:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.594+0000 7f514e59c640 1 --2- 172.21.15.17:0/2433552718 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f513806e2b0 0x7f5138070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f51400058c0 tx=0x7f5140005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.598+0000 7f513f7fe640 1 -- 172.21.15.17:0/2433552718 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f514407c4c0 con 0x7f5150103470 2024-09-20T18:32:25.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.780+0000 7f5154dda640 1 -- 172.21.15.17:0/2433552718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5150105f70 con 0x7f5150103470 2024-09-20T18:32:25.794 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:25 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2353455306' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-20T18:32:25.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.780+0000 7f513f7fe640 1 -- 172.21.15.17:0/2433552718 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5144080170 con 0x7f5150103470 2024-09-20T18:32:25.795 INFO:teuthology.orchestra.run.smithi017.stdout:111669149714 2024-09-20T18:32:25.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.782+0000 7f5154dda640 1 -- 172.21.15.17:0/2433552718 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f513806e2b0 msgr2=0x7f5138070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:25.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.782+0000 7f5154dda640 1 --2- 172.21.15.17:0/2433552718 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f513806e2b0 0x7f5138070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f51400058c0 tx=0x7f5140005850 comp rx=0 tx=0).stop 2024-09-20T18:32:25.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.782+0000 7f5154dda640 1 -- 172.21.15.17:0/2433552718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5150103470 msgr2=0x7f5150100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:25.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.782+0000 7f5154dda640 1 --2- 172.21.15.17:0/2433552718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5150103470 0x7f5150100cf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5144004f90 tx=0x7f51440048f0 comp rx=0 tx=0).stop 2024-09-20T18:32:25.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.783+0000 7f5154dda640 1 -- 172.21.15.17:0/2433552718 shutdown_connections 2024-09-20T18:32:25.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.783+0000 7f5154dda640 1 --2- 172.21.15.17:0/2433552718 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f513806e2b0 0x7f5138070770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:25.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.783+0000 7f5154dda640 1 --2- 172.21.15.17:0/2433552718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5150103470 0x7f5150100cf0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:25.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.783+0000 7f5154dda640 1 --2- 172.21.15.17:0/2433552718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5150102b50 0x7f51501007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:25.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.783+0000 7f5154dda640 1 -- 172.21.15.17:0/2433552718 >> 172.21.15.17:0/2433552718 conn(0x7f51500fc550 msgr2=0x7f5150108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:25.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.783+0000 7f5154dda640 1 -- 172.21.15.17:0/2433552718 shutdown_connections 2024-09-20T18:32:25.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:25.783+0000 7f5154dda640 1 -- 172.21.15.17:0/2433552718 wait complete. 2024-09-20T18:32:25.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:25 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/2353455306' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-20T18:32:26.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.067+0000 7f3c87d26640 1 -- 172.21.15.17:0/2381408519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c80100650 msgr2=0x7f3c80100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:26.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.067+0000 7f3c87d26640 1 --2- 172.21.15.17:0/2381408519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c80100650 0x7f3c80100a30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009880 tx=0x7f3c7c02a490 comp rx=0 tx=0).stop 2024-09-20T18:32:26.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.067+0000 7f3c87d26640 1 -- 172.21.15.17:0/2381408519 shutdown_connections 2024-09-20T18:32:26.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.067+0000 7f3c87d26640 1 --2- 172.21.15.17:0/2381408519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c80101000 0x7f3c8010dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:26.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.067+0000 7f3c87d26640 1 --2- 172.21.15.17:0/2381408519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c80100650 0x7f3c80100a30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:26.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.067+0000 7f3c87d26640 1 -- 172.21.15.17:0/2381408519 >> 172.21.15.17:0/2381408519 conn(0x7f3c800fc520 msgr2=0x7f3c800fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:26.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.067+0000 7f3c87d26640 1 -- 172.21.15.17:0/2381408519 shutdown_connections 2024-09-20T18:32:26.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.067+0000 7f3c87d26640 1 -- 172.21.15.17:0/2381408519 wait complete. 2024-09-20T18:32:26.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.068+0000 7f3c87d26640 1 Processor -- start 2024-09-20T18:32:26.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.068+0000 7f3c87d26640 1 -- start start 2024-09-20T18:32:26.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.068+0000 7f3c87d26640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c80100650 0x7f3c8019f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:26.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.068+0000 7f3c87d26640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c80101000 0x7f3c8019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:26.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.068+0000 7f3c87d26640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3c80110fb0 con 0x7f3c80100650 2024-09-20T18:32:26.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.068+0000 7f3c87d26640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c80110e30 con 0x7f3c80101000 2024-09-20T18:32:26.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.068+0000 7f3c85ac2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c80100650 0x7f3c8019f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:26.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.068+0000 7f3c85ac2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c80100650 0x7f3c8019f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60986/0 (socket says 172.21.15.17:60986) 2024-09-20T18:32:26.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.068+0000 7f3c85ac2640 1 -- 172.21.15.17:0/2169336326 learned_addr learned my addr 172.21.15.17:0/2169336326 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:26.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.068+0000 7f3c852c1640 1 --2- 172.21.15.17:0/2169336326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c80101000 0x7f3c8019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:26.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.068+0000 7f3c85ac2640 1 -- 172.21.15.17:0/2169336326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c80101000 msgr2=0x7f3c8019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:26.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.069+0000 7f3c85ac2640 1 --2- 172.21.15.17:0/2169336326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c80101000 0x7f3c8019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.069+0000 7f3c85ac2640 1 -- 172.21.15.17:0/2169336326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c801999a0 con 0x7f3c80100650 2024-09-20T18:32:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.069+0000 7f3c852c1640 1 --2- 172.21.15.17:0/2169336326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c80101000 0x7f3c8019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:32:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.069+0000 7f3c85ac2640 1 --2- 172.21.15.17:0/2169336326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c80100650 0x7f3c8019f7e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c031460 tx=0x7f3c7c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.069+0000 7f3c76ffd640 1 -- 172.21.15.17:0/2169336326 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c7c03f070 con 0x7f3c80100650 2024-09-20T18:32:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.069+0000 7f3c76ffd640 1 -- 172.21.15.17:0/2169336326 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c7c0044d0 con 0x7f3c80100650 2024-09-20T18:32:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.069+0000 7f3c87d26640 1 -- 172.21.15.17:0/2169336326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c80199c30 con 0x7f3c80100650 2024-09-20T18:32:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.069+0000 7f3c76ffd640 1 -- 172.21.15.17:0/2169336326 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c7c035030 con 0x7f3c80100650 2024-09-20T18:32:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.069+0000 7f3c87d26640 1 -- 172.21.15.17:0/2169336326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c8019a1c0 con 0x7f3c80100650 2024-09-20T18:32:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.070+0000 7f3c87d26640 1 -- 172.21.15.17:0/2169336326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c8019a780 con 0x7f3c80100650 2024-09-20T18:32:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.071+0000 7f3c76ffd640 1 -- 172.21.15.17:0/2169336326 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f3c7c042070 con 0x7f3c80100650 2024-09-20T18:32:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.071+0000 7f3c76ffd640 1 --2- 172.21.15.17:0/2169336326 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3c6c06e2b0 0x7f3c6c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.071+0000 7f3c76ffd640 1 -- 172.21.15.17:0/2169336326 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f3c7c0ae930 con 0x7f3c80100650 2024-09-20T18:32:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.071+0000 7f3c852c1640 1 --2- 172.21.15.17:0/2169336326 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3c6c06e2b0 0x7f3c6c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.071+0000 7f3c76ffd640 1 --2- 172.21.15.17:0/2169336326 >> [v2:172.21.15.172:6816/3232179537,v1:172.21.15.172:6817/3232179537] conn(0x7f3c6c0740a0 0x7f3c6c0764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:26.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.071+0000 7f3c76ffd640 1 -- 172.21.15.17:0/2169336326 --> [v2:172.21.15.172:6816/3232179537,v1:172.21.15.172:6817/3232179537] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c7c04ce50 con 0x7f3c6c0740a0 2024-09-20T18:32:26.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.071+0000 7f3c76ffd640 1 -- 172.21.15.17:0/2169336326 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f3c7c0b32a0 con 0x7f3c80100650 2024-09-20T18:32:26.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.072+0000 7f3c852c1640 1 --2- 172.21.15.17:0/2169336326 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3c6c06e2b0 0x7f3c6c070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3c80102520 tx=0x7f3c70005d30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:26.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.072+0000 7f3c862c3640 1 --2- 172.21.15.17:0/2169336326 >> [v2:172.21.15.172:6816/3232179537,v1:172.21.15.172:6817/3232179537] conn(0x7f3c6c0740a0 0x7f3c6c0764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:26.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.072+0000 7f3c862c3640 1 --2- 172.21.15.17:0/2169336326 >> [v2:172.21.15.172:6816/3232179537,v1:172.21.15.172:6817/3232179537] conn(0x7f3c6c0740a0 0x7f3c6c0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:26.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.073+0000 7f3c76ffd640 1 -- 172.21.15.17:0/2169336326 <== osd.5 v2:172.21.15.172:6816/3232179537 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3c7c04ce50 con 0x7f3c6c0740a0 2024-09-20T18:32:26.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.087+0000 7f3c87d26640 1 -- 172.21.15.17:0/2169336326 --> [v2:172.21.15.172:6816/3232179537,v1:172.21.15.172:6817/3232179537] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3c800628f0 con 0x7f3c6c0740a0 2024-09-20T18:32:26.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.087+0000 7f3c76ffd640 1 -- 172.21.15.17:0/2169336326 <== osd.5 v2:172.21.15.172:6816/3232179537 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3c800628f0 con 0x7f3c6c0740a0 2024-09-20T18:32:26.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.088+0000 7f3c87d26640 1 -- 172.21.15.17:0/2169336326 >> [v2:172.21.15.172:6816/3232179537,v1:172.21.15.172:6817/3232179537] conn(0x7f3c6c0740a0 msgr2=0x7f3c6c0764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:26.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.088+0000 7f3c87d26640 1 --2- 172.21.15.17:0/2169336326 >> [v2:172.21.15.172:6816/3232179537,v1:172.21.15.172:6817/3232179537] conn(0x7f3c6c0740a0 0x7f3c6c0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.088+0000 7f3c87d26640 1 -- 172.21.15.17:0/2169336326 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3c6c06e2b0 msgr2=0x7f3c6c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.088+0000 7f3c87d26640 1 --2- 172.21.15.17:0/2169336326 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3c6c06e2b0 0x7f3c6c070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3c80102520 tx=0x7f3c70005d30 comp rx=0 tx=0).stop 2024-09-20T18:32:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.088+0000 7f3c87d26640 1 -- 172.21.15.17:0/2169336326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c80100650 msgr2=0x7f3c8019f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.088+0000 7f3c87d26640 1 --2- 172.21.15.17:0/2169336326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c80100650 0x7f3c8019f7e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c031460 tx=0x7f3c7c0048f0 comp rx=0 tx=0).stop 2024-09-20T18:32:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.088+0000 7f3c87d26640 1 -- 172.21.15.17:0/2169336326 shutdown_connections 2024-09-20T18:32:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.088+0000 7f3c87d26640 1 --2- 172.21.15.17:0/2169336326 >> [v2:172.21.15.172:6816/3232179537,v1:172.21.15.172:6817/3232179537] conn(0x7f3c6c0740a0 0x7f3c6c0764c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.088+0000 7f3c87d26640 1 --2- 172.21.15.17:0/2169336326 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3c6c06e2b0 0x7f3c6c070770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.088+0000 7f3c87d26640 1 --2- 172.21.15.17:0/2169336326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c80101000 0x7f3c8019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.088+0000 7f3c87d26640 1 --2- 172.21.15.17:0/2169336326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c80100650 0x7f3c8019f7e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.088+0000 7f3c87d26640 1 -- 172.21.15.17:0/2169336326 >> 172.21.15.17:0/2169336326 conn(0x7f3c800fc520 msgr2=0x7f3c800fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.088+0000 7f3c87d26640 1 -- 172.21.15.17:0/2169336326 shutdown_connections 2024-09-20T18:32:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:26.088+0000 7f3c87d26640 1 -- 172.21.15.17:0/2169336326 wait complete. 2024-09-20T18:32:26.105 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:26.529 INFO:teuthology.orchestra.run.smithi017.stdout:81604378647 2024-09-20T18:32:26.529 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-20T18:32:26.752 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:26 smithi017 ceph-mon[28058]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:26.752 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:26 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2433552718' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-20T18:32:26.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:26 smithi172 ceph-mon[35456]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:26.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:26 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/2433552718' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-20T18:32:27.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.127+0000 7f5c272e9640 1 -- 172.21.15.17:0/1427718363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20100640 msgr2=0x7f5c20100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:27.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.127+0000 7f5c272e9640 1 --2- 172.21.15.17:0/1427718363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20100640 0x7f5c20100a20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5c18009880 tx=0x7f5c1802a490 comp rx=0 tx=0).stop 2024-09-20T18:32:27.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.127+0000 7f5c272e9640 1 -- 172.21.15.17:0/1427718363 shutdown_connections 2024-09-20T18:32:27.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.127+0000 7f5c272e9640 1 --2- 172.21.15.17:0/1427718363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c20100ff0 0x7f5c2010dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:27.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.127+0000 7f5c272e9640 1 --2- 172.21.15.17:0/1427718363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20100640 0x7f5c20100a20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:27.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.127+0000 7f5c272e9640 1 -- 172.21.15.17:0/1427718363 >> 172.21.15.17:0/1427718363 conn(0x7f5c200fc550 msgr2=0x7f5c200fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:27.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.127+0000 7f5c272e9640 1 -- 172.21.15.17:0/1427718363 shutdown_connections 2024-09-20T18:32:27.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.127+0000 7f5c272e9640 1 -- 172.21.15.17:0/1427718363 wait complete. 2024-09-20T18:32:27.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.127+0000 7f5c272e9640 1 Processor -- start 2024-09-20T18:32:27.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.127+0000 7f5c272e9640 1 -- start start 2024-09-20T18:32:27.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.128+0000 7f5c272e9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20100640 0x7f5c2019f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:27.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.128+0000 7f5c272e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c20100ff0 0x7f5c2019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:27.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.128+0000 7f5c272e9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5c20110f60 con 0x7f5c20100640 2024-09-20T18:32:27.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.128+0000 7f5c272e9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5c20110de0 con 0x7f5c20100ff0 2024-09-20T18:32:27.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.128+0000 7f5c25085640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20100640 0x7f5c2019f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:27.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.128+0000 7f5c25085640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20100640 0x7f5c2019f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60996/0 (socket says 172.21.15.17:60996) 2024-09-20T18:32:27.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.128+0000 7f5c25085640 1 -- 172.21.15.17:0/262695628 learned_addr learned my addr 172.21.15.17:0/262695628 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:27.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.128+0000 7f5c24884640 1 --2- 172.21.15.17:0/262695628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c20100ff0 0x7f5c2019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:27.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.128+0000 7f5c25085640 1 -- 172.21.15.17:0/262695628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c20100ff0 msgr2=0x7f5c2019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:27.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.128+0000 7f5c25085640 1 --2- 172.21.15.17:0/262695628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c20100ff0 0x7f5c2019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:27.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.128+0000 7f5c25085640 1 -- 172.21.15.17:0/262695628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c201a0380 con 0x7f5c20100640 2024-09-20T18:32:27.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.128+0000 7f5c25085640 1 --2- 172.21.15.17:0/262695628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20100640 0x7f5c2019f790 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5c18031460 tx=0x7f5c180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:27.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.128+0000 7f5c1e7fc640 1 -- 172.21.15.17:0/262695628 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c1803f070 con 0x7f5c20100640 2024-09-20T18:32:27.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.129+0000 7f5c1e7fc640 1 -- 172.21.15.17:0/262695628 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c18004cf0 con 0x7f5c20100640 2024-09-20T18:32:27.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.129+0000 7f5c1e7fc640 1 -- 172.21.15.17:0/262695628 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c18035030 con 0x7f5c20100640 2024-09-20T18:32:27.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.129+0000 7f5c272e9640 1 -- 172.21.15.17:0/262695628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c20199a10 con 0x7f5c20100640 2024-09-20T18:32:27.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.129+0000 7f5c272e9640 1 -- 172.21.15.17:0/262695628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c20199f70 con 0x7f5c20100640 2024-09-20T18:32:27.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.129+0000 7f5c272e9640 1 -- 172.21.15.17:0/262695628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c2006a580 con 0x7f5c20100640 2024-09-20T18:32:27.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.130+0000 7f5c1e7fc640 1 -- 172.21.15.17:0/262695628 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5c18042070 con 0x7f5c20100640 2024-09-20T18:32:27.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.130+0000 7f5c1e7fc640 1 --2- 172.21.15.17:0/262695628 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5c0806e2b0 0x7f5c08070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:27.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.131+0000 7f5c1e7fc640 1 -- 172.21.15.17:0/262695628 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f5c180ae790 con 0x7f5c20100640 2024-09-20T18:32:27.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.131+0000 7f5c24884640 1 --2- 172.21.15.17:0/262695628 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5c0806e2b0 0x7f5c08070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:27.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.131+0000 7f5c24884640 1 --2- 172.21.15.17:0/262695628 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5c0806e2b0 0x7f5c08070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5c200fefe0 tx=0x7f5c1400a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:27.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.135+0000 7f5c1e7fc640 1 -- 172.21.15.17:0/262695628 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5c1807c430 con 0x7f5c20100640 2024-09-20T18:32:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.315+0000 7f5c272e9640 1 -- 172.21.15.17:0/262695628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f5c2019ae80 con 0x7f5c20100640 2024-09-20T18:32:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.315+0000 7f5c1e7fc640 1 -- 172.21.15.17:0/262695628 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5c180800e0 con 0x7f5c20100640 2024-09-20T18:32:27.329 INFO:teuthology.orchestra.run.smithi017.stdout:141733920780 2024-09-20T18:32:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.317+0000 7f5c272e9640 1 -- 172.21.15.17:0/262695628 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5c0806e2b0 msgr2=0x7f5c08070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.317+0000 7f5c272e9640 1 --2- 172.21.15.17:0/262695628 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5c0806e2b0 0x7f5c08070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5c200fefe0 tx=0x7f5c1400a2d0 comp rx=0 tx=0).stop 2024-09-20T18:32:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.317+0000 7f5c272e9640 1 -- 172.21.15.17:0/262695628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20100640 msgr2=0x7f5c2019f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.317+0000 7f5c272e9640 1 --2- 172.21.15.17:0/262695628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20100640 0x7f5c2019f790 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5c18031460 tx=0x7f5c180048f0 comp rx=0 tx=0).stop 2024-09-20T18:32:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.317+0000 7f5c272e9640 1 -- 172.21.15.17:0/262695628 shutdown_connections 2024-09-20T18:32:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.317+0000 7f5c272e9640 1 --2- 172.21.15.17:0/262695628 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5c0806e2b0 0x7f5c08070770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.317+0000 7f5c272e9640 1 --2- 172.21.15.17:0/262695628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c20100ff0 0x7f5c2019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.317+0000 7f5c272e9640 1 --2- 172.21.15.17:0/262695628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c20100640 0x7f5c2019f790 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.317+0000 7f5c272e9640 1 -- 172.21.15.17:0/262695628 >> 172.21.15.17:0/262695628 conn(0x7f5c200fc550 msgr2=0x7f5c200fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.317+0000 7f5c272e9640 1 -- 172.21.15.17:0/262695628 shutdown_connections 2024-09-20T18:32:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:27.317+0000 7f5c272e9640 1 -- 172.21.15.17:0/262695628 wait complete. 2024-09-20T18:32:27.893 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:27 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/262695628' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-20T18:32:27.894 INFO:teuthology.orchestra.run.smithi017.stdout:163208757256 2024-09-20T18:32:27.895 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-20T18:32:27.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:27 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/262695628' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-20T18:32:28.472 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149713 got 111669149714 for osd.3 2024-09-20T18:32:28.472 DEBUG:teuthology.parallel:result is None 2024-09-20T18:32:28.848 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:28 smithi017 ceph-mon[28058]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:28.875 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920780 got 141733920780 for osd.4 2024-09-20T18:32:28.875 DEBUG:teuthology.parallel:result is None 2024-09-20T18:32:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:28.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:28 smithi172 ceph-mon[35456]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:29.361 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705698 got 38654705699 for osd.0 2024-09-20T18:32:29.362 DEBUG:teuthology.parallel:result is None 2024-09-20T18:32:29.365 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:29.777 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:29.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.775+0000 7f53b78d8640 1 -- 172.21.15.17:0/3170111906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b01007f0 msgr2=0x7f53b0100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:29.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.775+0000 7f53b78d8640 1 --2- 172.21.15.17:0/3170111906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b01007f0 0x7f53b0100c50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f53a0009880 tx=0x7f53a002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:29.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.775+0000 7f53b78d8640 1 -- 172.21.15.17:0/3170111906 shutdown_connections 2024-09-20T18:32:29.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.775+0000 7f53b78d8640 1 --2- 172.21.15.17:0/3170111906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b01007f0 0x7f53b0100c50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:29.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.775+0000 7f53b78d8640 1 --2- 172.21.15.17:0/3170111906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53b01067f0 0x7f53b0106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:29.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.775+0000 7f53b78d8640 1 -- 172.21.15.17:0/3170111906 >> 172.21.15.17:0/3170111906 conn(0x7f53b00fc550 msgr2=0x7f53b00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:29.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.775+0000 7f53b78d8640 1 -- 172.21.15.17:0/3170111906 shutdown_connections 2024-09-20T18:32:29.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.775+0000 7f53b78d8640 1 -- 172.21.15.17:0/3170111906 wait complete. 2024-09-20T18:32:29.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.775+0000 7f53b78d8640 1 Processor -- start 2024-09-20T18:32:29.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.775+0000 7f53b78d8640 1 -- start start 2024-09-20T18:32:29.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.776+0000 7f53b78d8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b01007f0 0x7f53b019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:29.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.776+0000 7f53b78d8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53b01067f0 0x7f53b019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:29.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.776+0000 7f53b78d8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f53b010dcc0 con 0x7f53b01007f0 2024-09-20T18:32:29.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.776+0000 7f53b78d8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53b010db40 con 0x7f53b01067f0 2024-09-20T18:32:29.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.776+0000 7f53b5674640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b01007f0 0x7f53b019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:29.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.776+0000 7f53b5674640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b01007f0 0x7f53b019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32788/0 (socket says 172.21.15.17:32788) 2024-09-20T18:32:29.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.776+0000 7f53b5674640 1 -- 172.21.15.17:0/3800774870 learned_addr learned my addr 172.21.15.17:0/3800774870 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:29.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.776+0000 7f53b4e73640 1 --2- 172.21.15.17:0/3800774870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53b01067f0 0x7f53b019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:29.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.776+0000 7f53b5674640 1 -- 172.21.15.17:0/3800774870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53b01067f0 msgr2=0x7f53b019dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:29.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.776+0000 7f53b5674640 1 --2- 172.21.15.17:0/3800774870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53b01067f0 0x7f53b019dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:29.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.776+0000 7f53b5674640 1 -- 172.21.15.17:0/3800774870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b01977e0 con 0x7f53b01007f0 2024-09-20T18:32:29.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.776+0000 7f53b4e73640 1 --2- 172.21.15.17:0/3800774870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53b01067f0 0x7f53b019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:32:29.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.776+0000 7f53b5674640 1 --2- 172.21.15.17:0/3800774870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b01007f0 0x7f53b019d660 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f53ac00c8f0 tx=0x7f53ac00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:29.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.777+0000 7f53a67fc640 1 -- 172.21.15.17:0/3800774870 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53ac0079b0 con 0x7f53b01007f0 2024-09-20T18:32:29.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.777+0000 7f53a67fc640 1 -- 172.21.15.17:0/3800774870 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53ac0054e0 con 0x7f53b01007f0 2024-09-20T18:32:29.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.777+0000 7f53b78d8640 1 -- 172.21.15.17:0/3800774870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b0197ad0 con 0x7f53b01007f0 2024-09-20T18:32:29.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.777+0000 7f53a67fc640 1 -- 172.21.15.17:0/3800774870 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53ac004dd0 con 0x7f53b01007f0 2024-09-20T18:32:29.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.777+0000 7f53b78d8640 1 -- 172.21.15.17:0/3800774870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b0198060 con 0x7f53b01007f0 2024-09-20T18:32:29.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.778+0000 7f53b78d8640 1 -- 172.21.15.17:0/3800774870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53b0101f30 con 0x7f53b01007f0 2024-09-20T18:32:29.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.778+0000 7f53a67fc640 1 -- 172.21.15.17:0/3800774870 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f53ac005020 con 0x7f53b01007f0 2024-09-20T18:32:29.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.779+0000 7f53a67fc640 1 --2- 172.21.15.17:0/3800774870 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f539c06e2b0 0x7f539c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:29.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.779+0000 7f53a67fc640 1 -- 172.21.15.17:0/3800774870 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f53ac08dcc0 con 0x7f53b01007f0 2024-09-20T18:32:29.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.779+0000 7f53b4e73640 1 --2- 172.21.15.17:0/3800774870 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f539c06e2b0 0x7f539c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:29.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.780+0000 7f53b4e73640 1 --2- 172.21.15.17:0/3800774870 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f539c06e2b0 0x7f539c070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f53a0031460 tx=0x7f53a00095f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:29.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.784+0000 7f53a67fc640 1 -- 172.21.15.17:0/3800774870 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f53ac014030 con 0x7f53b01007f0 2024-09-20T18:32:29.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.961+0000 7f53b78d8640 1 -- 172.21.15.17:0/3800774870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f53b0109d70 con 0x7f53b01007f0 2024-09-20T18:32:29.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.961+0000 7f53a67fc640 1 -- 172.21.15.17:0/3800774870 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f53ac05b9e0 con 0x7f53b01007f0 2024-09-20T18:32:29.975 INFO:teuthology.orchestra.run.smithi017.stdout:163208757256 2024-09-20T18:32:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.963+0000 7f53b78d8640 1 -- 172.21.15.17:0/3800774870 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f539c06e2b0 msgr2=0x7f539c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.963+0000 7f53b78d8640 1 --2- 172.21.15.17:0/3800774870 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f539c06e2b0 0x7f539c070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f53a0031460 tx=0x7f53a00095f0 comp rx=0 tx=0).stop 2024-09-20T18:32:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.963+0000 7f53b78d8640 1 -- 172.21.15.17:0/3800774870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b01007f0 msgr2=0x7f53b019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.963+0000 7f53b78d8640 1 --2- 172.21.15.17:0/3800774870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b01007f0 0x7f53b019d660 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f53ac00c8f0 tx=0x7f53ac00cdb0 comp rx=0 tx=0).stop 2024-09-20T18:32:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.963+0000 7f53b78d8640 1 -- 172.21.15.17:0/3800774870 shutdown_connections 2024-09-20T18:32:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.963+0000 7f53b78d8640 1 --2- 172.21.15.17:0/3800774870 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f539c06e2b0 0x7f539c070770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.963+0000 7f53b78d8640 1 --2- 172.21.15.17:0/3800774870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53b01067f0 0x7f53b019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.963+0000 7f53b78d8640 1 --2- 172.21.15.17:0/3800774870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53b01007f0 0x7f53b019d660 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.963+0000 7f53b78d8640 1 -- 172.21.15.17:0/3800774870 >> 172.21.15.17:0/3800774870 conn(0x7f53b00fc550 msgr2=0x7f53b0069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.963+0000 7f53b78d8640 1 -- 172.21.15.17:0/3800774870 shutdown_connections 2024-09-20T18:32:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:29.963+0000 7f53b78d8640 1 -- 172.21.15.17:0/3800774870 wait complete. 2024-09-20T18:32:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.359+0000 7f3c72d05640 1 -- 172.21.15.17:0/3726961766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c1007f0 msgr2=0x7f3c6c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.359+0000 7f3c72d05640 1 --2- 172.21.15.17:0/3726961766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c1007f0 0x7f3c6c100c50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009880 tx=0x7f3c5c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.359+0000 7f3c72d05640 1 -- 172.21.15.17:0/3726961766 shutdown_connections 2024-09-20T18:32:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.359+0000 7f3c72d05640 1 --2- 172.21.15.17:0/3726961766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c1007f0 0x7f3c6c100c50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.359+0000 7f3c72d05640 1 --2- 172.21.15.17:0/3726961766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c6c1067f0 0x7f3c6c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.359+0000 7f3c72d05640 1 -- 172.21.15.17:0/3726961766 >> 172.21.15.17:0/3726961766 conn(0x7f3c6c0fc550 msgr2=0x7f3c6c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.359+0000 7f3c72d05640 1 -- 172.21.15.17:0/3726961766 shutdown_connections 2024-09-20T18:32:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.359+0000 7f3c72d05640 1 -- 172.21.15.17:0/3726961766 wait complete. 2024-09-20T18:32:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.359+0000 7f3c72d05640 1 Processor -- start 2024-09-20T18:32:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.359+0000 7f3c72d05640 1 -- start start 2024-09-20T18:32:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.360+0000 7f3c72d05640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c6c1007f0 0x7f3c6c0fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.360+0000 7f3c72d05640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c1067f0 0x7f3c6c0fd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.360+0000 7f3c72d05640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c10dd20 con 0x7f3c6c1067f0 2024-09-20T18:32:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.360+0000 7f3c72d05640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c10dba0 con 0x7f3c6c1007f0 2024-09-20T18:32:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.360+0000 7f3c63fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c1067f0 0x7f3c6c0fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.360+0000 7f3c63fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c1067f0 0x7f3c6c0fd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32796/0 (socket says 172.21.15.17:32796) 2024-09-20T18:32:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.360+0000 7f3c63fff640 1 -- 172.21.15.17:0/1048667100 learned_addr learned my addr 172.21.15.17:0/1048667100 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.360+0000 7f3c70aa1640 1 --2- 172.21.15.17:0/1048667100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c6c1007f0 0x7f3c6c0fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.360+0000 7f3c63fff640 1 -- 172.21.15.17:0/1048667100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c6c1007f0 msgr2=0x7f3c6c0fcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.360+0000 7f3c63fff640 1 --2- 172.21.15.17:0/1048667100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c6c1007f0 0x7f3c6c0fcd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.360+0000 7f3c63fff640 1 -- 172.21.15.17:0/1048667100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6c0fd790 con 0x7f3c6c1067f0 2024-09-20T18:32:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.360+0000 7f3c63fff640 1 --2- 172.21.15.17:0/1048667100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c1067f0 0x7f3c6c0fd250 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c031460 tx=0x7f3c5c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.360+0000 7f3c61ffb640 1 -- 172.21.15.17:0/1048667100 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c5c03f070 con 0x7f3c6c1067f0 2024-09-20T18:32:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.360+0000 7f3c61ffb640 1 -- 172.21.15.17:0/1048667100 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c5c004cf0 con 0x7f3c6c1067f0 2024-09-20T18:32:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.360+0000 7f3c72d05640 1 -- 172.21.15.17:0/1048667100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c6c0fda20 con 0x7f3c6c1067f0 2024-09-20T18:32:30.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.360+0000 7f3c61ffb640 1 -- 172.21.15.17:0/1048667100 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c5c035030 con 0x7f3c6c1067f0 2024-09-20T18:32:30.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.361+0000 7f3c72d05640 1 -- 172.21.15.17:0/1048667100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c6c1a3df0 con 0x7f3c6c1067f0 2024-09-20T18:32:30.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.362+0000 7f3c72d05640 1 -- 172.21.15.17:0/1048667100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c6c101f30 con 0x7f3c6c1067f0 2024-09-20T18:32:30.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.362+0000 7f3c61ffb640 1 -- 172.21.15.17:0/1048667100 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f3c5c042070 con 0x7f3c6c1067f0 2024-09-20T18:32:30.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.362+0000 7f3c61ffb640 1 --2- 172.21.15.17:0/1048667100 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3c5406e310 0x7f3c540707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:30.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.363+0000 7f3c61ffb640 1 -- 172.21.15.17:0/1048667100 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f3c5c0ae920 con 0x7f3c6c1067f0 2024-09-20T18:32:30.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.363+0000 7f3c70aa1640 1 --2- 172.21.15.17:0/1048667100 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3c5406e310 0x7f3c540707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:30.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.363+0000 7f3c70aa1640 1 --2- 172.21.15.17:0/1048667100 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3c5406e310 0x7f3c540707d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800a810 tx=0x7f3c68008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:30.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.367+0000 7f3c61ffb640 1 -- 172.21.15.17:0/1048667100 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3c5c07c5a0 con 0x7f3c6c1067f0 2024-09-20T18:32:30.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.547+0000 7f3c72d05640 1 -- 172.21.15.17:0/1048667100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3c6c0fe240 con 0x7f3c6c1067f0 2024-09-20T18:32:30.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.547+0000 7f3c61ffb640 1 -- 172.21.15.17:0/1048667100 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3c5c080250 con 0x7f3c6c1067f0 2024-09-20T18:32:30.561 INFO:teuthology.orchestra.run.smithi017.stdout:60129542173 2024-09-20T18:32:30.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.549+0000 7f3c72d05640 1 -- 172.21.15.17:0/1048667100 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3c5406e310 msgr2=0x7f3c540707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:30.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.549+0000 7f3c72d05640 1 --2- 172.21.15.17:0/1048667100 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3c5406e310 0x7f3c540707d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800a810 tx=0x7f3c68008040 comp rx=0 tx=0).stop 2024-09-20T18:32:30.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.549+0000 7f3c72d05640 1 -- 172.21.15.17:0/1048667100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c1067f0 msgr2=0x7f3c6c0fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:30.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.549+0000 7f3c72d05640 1 --2- 172.21.15.17:0/1048667100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c1067f0 0x7f3c6c0fd250 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c031460 tx=0x7f3c5c0048f0 comp rx=0 tx=0).stop 2024-09-20T18:32:30.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.549+0000 7f3c72d05640 1 -- 172.21.15.17:0/1048667100 shutdown_connections 2024-09-20T18:32:30.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.549+0000 7f3c72d05640 1 --2- 172.21.15.17:0/1048667100 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3c5406e310 0x7f3c540707d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:30.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.549+0000 7f3c72d05640 1 --2- 172.21.15.17:0/1048667100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c6c1067f0 0x7f3c6c0fd250 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:30.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.549+0000 7f3c72d05640 1 --2- 172.21.15.17:0/1048667100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c6c1007f0 0x7f3c6c0fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:30.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.549+0000 7f3c72d05640 1 -- 172.21.15.17:0/1048667100 >> 172.21.15.17:0/1048667100 conn(0x7f3c6c0fc550 msgr2=0x7f3c6c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:30.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.549+0000 7f3c72d05640 1 -- 172.21.15.17:0/1048667100 shutdown_connections 2024-09-20T18:32:30.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:30.549+0000 7f3c72d05640 1 -- 172.21.15.17:0/1048667100 wait complete. 2024-09-20T18:32:30.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:30 smithi017 ceph-mon[28058]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:30.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:30 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3800774870' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-20T18:32:30.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:30 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1048667100' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-20T18:32:30.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:30 smithi172 ceph-mon[35456]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:30.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:30 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3800774870' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-20T18:32:30.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:30 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/1048667100' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-20T18:32:31.370 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542172 got 60129542173 for osd.1 2024-09-20T18:32:31.371 DEBUG:teuthology.parallel:result is None 2024-09-20T18:32:31.836 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757256 got 163208757256 for osd.5 2024-09-20T18:32:31.836 DEBUG:teuthology.parallel:result is None 2024-09-20T18:32:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.996+0000 7f58e811c640 1 -- 172.21.15.17:0/4053437376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e01067f0 msgr2=0x7f58e0106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.996+0000 7f58e811c640 1 --2- 172.21.15.17:0/4053437376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e01067f0 0x7f58e0106bd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009880 tx=0x7f58dc02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.996+0000 7f58e811c640 1 -- 172.21.15.17:0/4053437376 shutdown_connections 2024-09-20T18:32:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.996+0000 7f58e811c640 1 --2- 172.21.15.17:0/4053437376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58e01007f0 0x7f58e0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.996+0000 7f58e811c640 1 --2- 172.21.15.17:0/4053437376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e01067f0 0x7f58e0106bd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.996+0000 7f58e811c640 1 -- 172.21.15.17:0/4053437376 >> 172.21.15.17:0/4053437376 conn(0x7f58e00fc550 msgr2=0x7f58e00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.996+0000 7f58e811c640 1 -- 172.21.15.17:0/4053437376 shutdown_connections 2024-09-20T18:32:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.996+0000 7f58e811c640 1 -- 172.21.15.17:0/4053437376 wait complete. 2024-09-20T18:32:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.997+0000 7f58e811c640 1 Processor -- start 2024-09-20T18:32:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.997+0000 7f58e811c640 1 -- start start 2024-09-20T18:32:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.998+0000 7f58e811c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e01007f0 0x7f58e01988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.998+0000 7f58e811c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58e01067f0 0x7f58e0198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.998+0000 7f58e811c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f58e010dca0 con 0x7f58e01007f0 2024-09-20T18:32:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.998+0000 7f58e811c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f58e010db20 con 0x7f58e01067f0 2024-09-20T18:32:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.998+0000 7f58e5eb8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e01007f0 0x7f58e01988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.998+0000 7f58e5eb8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e01007f0 0x7f58e01988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33496/0 (socket says 172.21.15.17:33496) 2024-09-20T18:32:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.998+0000 7f58e5eb8640 1 -- 172.21.15.17:0/702263167 learned_addr learned my addr 172.21.15.17:0/702263167 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.998+0000 7f58e56b7640 1 --2- 172.21.15.17:0/702263167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58e01067f0 0x7f58e0198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.998+0000 7f58e5eb8640 1 -- 172.21.15.17:0/702263167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58e01067f0 msgr2=0x7f58e0198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.998+0000 7f58e5eb8640 1 --2- 172.21.15.17:0/702263167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58e01067f0 0x7f58e0198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.998+0000 7f58e5eb8640 1 -- 172.21.15.17:0/702263167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e0199410 con 0x7f58e01007f0 2024-09-20T18:32:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.998+0000 7f58e5eb8640 1 --2- 172.21.15.17:0/702263167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e01007f0 0x7f58e01988d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f58dc031460 tx=0x7f58dc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.998+0000 7f58d6ffd640 1 -- 172.21.15.17:0/702263167 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58dc03f070 con 0x7f58e01007f0 2024-09-20T18:32:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.998+0000 7f58d6ffd640 1 -- 172.21.15.17:0/702263167 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f58dc004cf0 con 0x7f58e01007f0 2024-09-20T18:32:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.998+0000 7f58e811c640 1 -- 172.21.15.17:0/702263167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e01996a0 con 0x7f58e01007f0 2024-09-20T18:32:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.999+0000 7f58d6ffd640 1 -- 172.21.15.17:0/702263167 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58dc035030 con 0x7f58e01007f0 2024-09-20T18:32:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:31.999+0000 7f58e811c640 1 -- 172.21.15.17:0/702263167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e01a1b90 con 0x7f58e01007f0 2024-09-20T18:32:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.000+0000 7f58e811c640 1 -- 172.21.15.17:0/702263167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e0101f30 con 0x7f58e01007f0 2024-09-20T18:32:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.000+0000 7f58d6ffd640 1 -- 172.21.15.17:0/702263167 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f58dc042070 con 0x7f58e01007f0 2024-09-20T18:32:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.001+0000 7f58d6ffd640 1 --2- 172.21.15.17:0/702263167 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f58cc06e310 0x7f58cc0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.001+0000 7f58e56b7640 1 --2- 172.21.15.17:0/702263167 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f58cc06e310 0x7f58cc0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.001+0000 7f58d6ffd640 1 -- 172.21.15.17:0/702263167 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f58dc0ae730 con 0x7f58e01007f0 2024-09-20T18:32:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.001+0000 7f58e56b7640 1 --2- 172.21.15.17:0/702263167 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f58cc06e310 0x7f58cc0707d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f58e006a7f0 tx=0x7f58d000a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.005+0000 7f58d6ffd640 1 -- 172.21.15.17:0/702263167 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f58dc080100 con 0x7f58e01007f0 2024-09-20T18:32:32.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.183+0000 7f58e811c640 1 -- 172.21.15.17:0/702263167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f58e006a2c0 con 0x7f58e01007f0 2024-09-20T18:32:32.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.183+0000 7f58d6ffd640 1 -- 172.21.15.17:0/702263167 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f58e006a2c0 con 0x7f58e01007f0 2024-09-20T18:32:32.198 INFO:teuthology.orchestra.run.smithi017.stdout:81604378649 2024-09-20T18:32:32.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.186+0000 7f58e811c640 1 -- 172.21.15.17:0/702263167 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f58cc06e310 msgr2=0x7f58cc0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:32.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.186+0000 7f58e811c640 1 --2- 172.21.15.17:0/702263167 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f58cc06e310 0x7f58cc0707d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f58e006a7f0 tx=0x7f58d000a2d0 comp rx=0 tx=0).stop 2024-09-20T18:32:32.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.186+0000 7f58e811c640 1 -- 172.21.15.17:0/702263167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e01007f0 msgr2=0x7f58e01988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:32.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.186+0000 7f58e811c640 1 --2- 172.21.15.17:0/702263167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e01007f0 0x7f58e01988d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f58dc031460 tx=0x7f58dc0048f0 comp rx=0 tx=0).stop 2024-09-20T18:32:32.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.186+0000 7f58e811c640 1 -- 172.21.15.17:0/702263167 shutdown_connections 2024-09-20T18:32:32.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.186+0000 7f58e811c640 1 --2- 172.21.15.17:0/702263167 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f58cc06e310 0x7f58cc0707d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:32.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.186+0000 7f58e811c640 1 --2- 172.21.15.17:0/702263167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58e01067f0 0x7f58e0198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:32.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.186+0000 7f58e811c640 1 --2- 172.21.15.17:0/702263167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e01007f0 0x7f58e01988d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:32.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.186+0000 7f58e811c640 1 -- 172.21.15.17:0/702263167 >> 172.21.15.17:0/702263167 conn(0x7f58e00fc550 msgr2=0x7f58e00fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:32.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.186+0000 7f58e811c640 1 -- 172.21.15.17:0/702263167 shutdown_connections 2024-09-20T18:32:32.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:32.186+0000 7f58e811c640 1 -- 172.21.15.17:0/702263167 wait complete. 2024-09-20T18:32:32.820 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:32 smithi017 ceph-mon[28058]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:32.821 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:32 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/702263167' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-20T18:32:32.847 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378647 got 81604378649 for osd.2 2024-09-20T18:32:32.847 DEBUG:teuthology.parallel:result is None 2024-09-20T18:32:32.847 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-20T18:32:32.847 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-20T18:32:32.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:32 smithi172 ceph-mon[35456]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:32.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:32 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/702263167' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-20T18:32:33.106 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:33.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.501+0000 7f45095d3640 1 -- 172.21.15.17:0/243030755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45041033d0 msgr2=0x7f450410b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:33.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.501+0000 7f45095d3640 1 --2- 172.21.15.17:0/243030755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45041033d0 0x7f450410b8c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f44f8009880 tx=0x7f44f802a530 comp rx=0 tx=0).stop 2024-09-20T18:32:33.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.501+0000 7f45095d3640 1 -- 172.21.15.17:0/243030755 shutdown_connections 2024-09-20T18:32:33.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.501+0000 7f45095d3640 1 --2- 172.21.15.17:0/243030755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45041033d0 0x7f450410b8c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:33.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.501+0000 7f45095d3640 1 --2- 172.21.15.17:0/243030755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4504102ab0 0x7f4504102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:33.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.501+0000 7f45095d3640 1 -- 172.21.15.17:0/243030755 >> 172.21.15.17:0/243030755 conn(0x7f45040fc550 msgr2=0x7f45040fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:33.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.501+0000 7f45095d3640 1 -- 172.21.15.17:0/243030755 shutdown_connections 2024-09-20T18:32:33.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.501+0000 7f45095d3640 1 -- 172.21.15.17:0/243030755 wait complete. 2024-09-20T18:32:33.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.501+0000 7f45095d3640 1 Processor -- start 2024-09-20T18:32:33.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.502+0000 7f45095d3640 1 -- start start 2024-09-20T18:32:33.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.502+0000 7f45095d3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4504102ab0 0x7f4504100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:33.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.502+0000 7f45095d3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45041033d0 0x7f4504100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:33.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.502+0000 7f45095d3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f450410ede0 con 0x7f4504102ab0 2024-09-20T18:32:33.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.502+0000 7f45095d3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f450410ec60 con 0x7f45041033d0 2024-09-20T18:32:33.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.502+0000 7f4502ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4504102ab0 0x7f4504100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:33.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.502+0000 7f4502ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4504102ab0 0x7f4504100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33518/0 (socket says 172.21.15.17:33518) 2024-09-20T18:32:33.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.502+0000 7f4502ffd640 1 -- 172.21.15.17:0/813947767 learned_addr learned my addr 172.21.15.17:0/813947767 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:33.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.502+0000 7f45027fc640 1 --2- 172.21.15.17:0/813947767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45041033d0 0x7f4504100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:33.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.502+0000 7f4502ffd640 1 -- 172.21.15.17:0/813947767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45041033d0 msgr2=0x7f4504100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:33.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.502+0000 7f4502ffd640 1 --2- 172.21.15.17:0/813947767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45041033d0 0x7f4504100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:33.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.502+0000 7f4502ffd640 1 -- 172.21.15.17:0/813947767 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4504101190 con 0x7f4504102ab0 2024-09-20T18:32:33.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.502+0000 7f4502ffd640 1 --2- 172.21.15.17:0/813947767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4504102ab0 0x7f4504100710 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f44f400cc60 tx=0x7f44f400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:33.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.503+0000 7f44ebfff640 1 -- 172.21.15.17:0/813947767 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f44f400ad30 con 0x7f4504102ab0 2024-09-20T18:32:33.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.503+0000 7f45095d3640 1 -- 172.21.15.17:0/813947767 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4504101480 con 0x7f4504102ab0 2024-09-20T18:32:33.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.503+0000 7f44ebfff640 1 -- 172.21.15.17:0/813947767 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f44f4005020 con 0x7f4504102ab0 2024-09-20T18:32:33.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.503+0000 7f44ebfff640 1 -- 172.21.15.17:0/813947767 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f44f400f640 con 0x7f4504102ab0 2024-09-20T18:32:33.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.503+0000 7f45095d3640 1 -- 172.21.15.17:0/813947767 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45041a3e90 con 0x7f4504102ab0 2024-09-20T18:32:33.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.504+0000 7f45095d3640 1 -- 172.21.15.17:0/813947767 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f450406a580 con 0x7f4504102ab0 2024-09-20T18:32:33.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.504+0000 7f44ebfff640 1 -- 172.21.15.17:0/813947767 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f44f400f940 con 0x7f4504102ab0 2024-09-20T18:32:33.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.505+0000 7f44ebfff640 1 --2- 172.21.15.17:0/813947767 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f44ec06e2b0 0x7f44ec070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:33.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.505+0000 7f44ebfff640 1 -- 172.21.15.17:0/813947767 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f44f408e0d0 con 0x7f4504102ab0 2024-09-20T18:32:33.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.505+0000 7f45027fc640 1 --2- 172.21.15.17:0/813947767 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f44ec06e2b0 0x7f44ec070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:33.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.505+0000 7f45027fc640 1 --2- 172.21.15.17:0/813947767 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f44ec06e2b0 0x7f44ec070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f45041021a0 tx=0x7f44f8031420 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:33.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.509+0000 7f44ebfff640 1 -- 172.21.15.17:0/813947767 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f44f4014030 con 0x7f4504102ab0 2024-09-20T18:32:33.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.682+0000 7f45095d3640 1 -- 172.21.15.17:0/813947767 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4504062630 con 0x7f44ec06e2b0 2024-09-20T18:32:33.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.682+0000 7f44ebfff640 1 -- 172.21.15.17:0/813947767 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f4504062630 con 0x7f44ec06e2b0 2024-09-20T18:32:33.696 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:32:33.697 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-20T18:32:33.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.685+0000 7f45095d3640 1 -- 172.21.15.17:0/813947767 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f44ec06e2b0 msgr2=0x7f44ec070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:33.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.685+0000 7f45095d3640 1 --2- 172.21.15.17:0/813947767 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f44ec06e2b0 0x7f44ec070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f45041021a0 tx=0x7f44f8031420 comp rx=0 tx=0).stop 2024-09-20T18:32:33.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.685+0000 7f45095d3640 1 -- 172.21.15.17:0/813947767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4504102ab0 msgr2=0x7f4504100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:33.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.685+0000 7f45095d3640 1 --2- 172.21.15.17:0/813947767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4504102ab0 0x7f4504100710 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f44f400cc60 tx=0x7f44f400a620 comp rx=0 tx=0).stop 2024-09-20T18:32:33.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.685+0000 7f45095d3640 1 -- 172.21.15.17:0/813947767 shutdown_connections 2024-09-20T18:32:33.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.685+0000 7f45095d3640 1 --2- 172.21.15.17:0/813947767 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f44ec06e2b0 0x7f44ec070770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:33.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.685+0000 7f45095d3640 1 --2- 172.21.15.17:0/813947767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45041033d0 0x7f4504100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:33.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.685+0000 7f45095d3640 1 --2- 172.21.15.17:0/813947767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4504102ab0 0x7f4504100710 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:33.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.685+0000 7f45095d3640 1 -- 172.21.15.17:0/813947767 >> 172.21.15.17:0/813947767 conn(0x7f45040fc550 msgr2=0x7f4504108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:33.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.685+0000 7f45095d3640 1 -- 172.21.15.17:0/813947767 shutdown_connections 2024-09-20T18:32:33.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:33.685+0000 7f45095d3640 1 -- 172.21.15.17:0/813947767 wait complete. 2024-09-20T18:32:34.255 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-09-20T18:32:33.525677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":207608,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":203638,"kb_avail":562263304,"statfs":{"total":575970213888,"available":575757623296,"internally_reserved":0,"allocated":3919872,"data_stored":2585772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":208525984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002048"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":192,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-20T18:32:04.598373+0000","last_change":"2024-09-20T18:31:36.604986+0000","last_active":"2024-09-20T18:32:04.598373+0000","last_peered":"2024-09-20T18:32:04.598373+0000","last_clean":"2024-09-20T18:32:04.598373+0000","last_became_active":"2024-09-20T18:31:36.604521+0000","last_became_peered":"2024-09-20T18:31:36.604521+0000","last_unstale":"2024-09-20T18:32:04.598373+0000","last_undegraded":"2024-09-20T18:32:04.598373+0000","last_fullsized":"2024-09-20T18:32:04.598373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T18:30:47.993760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T18:30:47.993760+0000","last_clean_scrub_stamp":"2024-09-20T18:30:47.993760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:58.395831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920782,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713616,"statfs":{"total":95995035648,"available":95962742784,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149716,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":35700,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709452,"statfs":{"total":95995035648,"available":95958478848,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40440,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704712,"statfs":{"total":95995035648,"available":95953625088,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40436,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704716,"statfs":{"total":95995035648,"available":95953629184,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T18:32:34.256 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-20T18:32:34.514 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:34.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:34 smithi017 ceph-mon[28058]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:34.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:34 smithi017 ceph-mon[28058]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T18:32:34.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:34 smithi172 ceph-mon[35456]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:34.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:34 smithi172 ceph-mon[35456]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T18:32:34.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.956+0000 7f71720e9640 1 -- 172.21.15.17:0/3462233740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f716c101900 msgr2=0x7f716c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:34.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.956+0000 7f71720e9640 1 --2- 172.21.15.17:0/3462233740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f716c101900 0x7f716c101d60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f715c009880 tx=0x7f715c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:34.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.956+0000 7f71720e9640 1 -- 172.21.15.17:0/3462233740 shutdown_connections 2024-09-20T18:32:34.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.956+0000 7f71720e9640 1 --2- 172.21.15.17:0/3462233740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f716c101900 0x7f716c101d60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:34.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.956+0000 7f71720e9640 1 --2- 172.21.15.17:0/3462233740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f716c107900 0x7f716c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:34.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.956+0000 7f71720e9640 1 -- 172.21.15.17:0/3462233740 >> 172.21.15.17:0/3462233740 conn(0x7f716c0fd600 msgr2=0x7f716c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:34.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.956+0000 7f71720e9640 1 -- 172.21.15.17:0/3462233740 shutdown_connections 2024-09-20T18:32:34.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.956+0000 7f71720e9640 1 -- 172.21.15.17:0/3462233740 wait complete. 2024-09-20T18:32:34.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.956+0000 7f71720e9640 1 Processor -- start 2024-09-20T18:32:34.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.957+0000 7f71720e9640 1 -- start start 2024-09-20T18:32:34.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.957+0000 7f71720e9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f716c101900 0x7f716c19f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:34.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.957+0000 7f71720e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f716c107900 0x7f716c19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:34.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.957+0000 7f71720e9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f716c10ee30 con 0x7f716c101900 2024-09-20T18:32:34.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.957+0000 7f71720e9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f716c10ecb0 con 0x7f716c107900 2024-09-20T18:32:34.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.957+0000 7f716b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f716c101900 0x7f716c19f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:34.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.957+0000 7f716b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f716c101900 0x7f716c19f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33546/0 (socket says 172.21.15.17:33546) 2024-09-20T18:32:34.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.957+0000 7f716b7fe640 1 -- 172.21.15.17:0/677652126 learned_addr learned my addr 172.21.15.17:0/677652126 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:34.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.957+0000 7f716affd640 1 --2- 172.21.15.17:0/677652126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f716c107900 0x7f716c19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:34.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.957+0000 7f716b7fe640 1 -- 172.21.15.17:0/677652126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f716c107900 msgr2=0x7f716c19fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:34.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.957+0000 7f716b7fe640 1 --2- 172.21.15.17:0/677652126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f716c107900 0x7f716c19fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:34.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.957+0000 7f716b7fe640 1 -- 172.21.15.17:0/677652126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716c199a30 con 0x7f716c101900 2024-09-20T18:32:34.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.957+0000 7f716b7fe640 1 --2- 172.21.15.17:0/677652126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f716c101900 0x7f716c19f870 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f715400b420 tx=0x7f715400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.958+0000 7f7168ff9640 1 -- 172.21.15.17:0/677652126 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7154011630 con 0x7f716c101900 2024-09-20T18:32:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.958+0000 7f71720e9640 1 -- 172.21.15.17:0/677652126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f716c199d20 con 0x7f716c101900 2024-09-20T18:32:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.958+0000 7f7168ff9640 1 -- 172.21.15.17:0/677652126 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7154016070 con 0x7f716c101900 2024-09-20T18:32:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.958+0000 7f7168ff9640 1 -- 172.21.15.17:0/677652126 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7154010d40 con 0x7f716c101900 2024-09-20T18:32:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.958+0000 7f71720e9640 1 -- 172.21.15.17:0/677652126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f716c19a280 con 0x7f716c101900 2024-09-20T18:32:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.959+0000 7f71720e9640 1 -- 172.21.15.17:0/677652126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f716c103040 con 0x7f716c101900 2024-09-20T18:32:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.959+0000 7f7168ff9640 1 -- 172.21.15.17:0/677652126 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f715401b460 con 0x7f716c101900 2024-09-20T18:32:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.960+0000 7f7168ff9640 1 --2- 172.21.15.17:0/677652126 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f715806e2b0 0x7f7158070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.960+0000 7f7168ff9640 1 -- 172.21.15.17:0/677652126 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f715408d680 con 0x7f716c101900 2024-09-20T18:32:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.960+0000 7f716affd640 1 --2- 172.21.15.17:0/677652126 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f715806e2b0 0x7f7158070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.960+0000 7f716affd640 1 --2- 172.21.15.17:0/677652126 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f715806e2b0 0x7f7158070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f716c19b220 tx=0x7f715c031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:34.964+0000 7f7168ff9640 1 -- 172.21.15.17:0/677652126 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f715405b320 con 0x7f716c101900 2024-09-20T18:32:35.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:35.136+0000 7f71720e9640 1 -- 172.21.15.17:0/677652126 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f716c19a590 con 0x7f715806e2b0 2024-09-20T18:32:35.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:35.137+0000 7f7168ff9640 1 -- 172.21.15.17:0/677652126 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f716c19a590 con 0x7f715806e2b0 2024-09-20T18:32:35.151 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:32:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-20T18:32:35.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:35.140+0000 7f71720e9640 1 -- 172.21.15.17:0/677652126 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f715806e2b0 msgr2=0x7f7158070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:35.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:35.140+0000 7f71720e9640 1 --2- 172.21.15.17:0/677652126 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f715806e2b0 0x7f7158070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f716c19b220 tx=0x7f715c031400 comp rx=0 tx=0).stop 2024-09-20T18:32:35.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:35.140+0000 7f71720e9640 1 -- 172.21.15.17:0/677652126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f716c101900 msgr2=0x7f716c19f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:35.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:35.140+0000 7f71720e9640 1 --2- 172.21.15.17:0/677652126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f716c101900 0x7f716c19f870 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f715400b420 tx=0x7f715400b8e0 comp rx=0 tx=0).stop 2024-09-20T18:32:35.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:35.140+0000 7f71720e9640 1 -- 172.21.15.17:0/677652126 shutdown_connections 2024-09-20T18:32:35.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:35.140+0000 7f71720e9640 1 --2- 172.21.15.17:0/677652126 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f715806e2b0 0x7f7158070770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:35.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:35.140+0000 7f71720e9640 1 --2- 172.21.15.17:0/677652126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f716c107900 0x7f716c19fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:35.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:35.140+0000 7f71720e9640 1 --2- 172.21.15.17:0/677652126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f716c101900 0x7f716c19f870 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:35.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:35.140+0000 7f71720e9640 1 -- 172.21.15.17:0/677652126 >> 172.21.15.17:0/677652126 conn(0x7f716c0fd600 msgr2=0x7f716c074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:35.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:35.140+0000 7f71720e9640 1 -- 172.21.15.17:0/677652126 shutdown_connections 2024-09-20T18:32:35.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:35.140+0000 7f71720e9640 1 -- 172.21.15.17:0/677652126 wait complete. 2024-09-20T18:32:35.700 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:35 smithi017 ceph-mon[28058]: from='client.14512 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T18:32:35.731 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-09-20T18:32:33.525677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":207608,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":203638,"kb_avail":562263304,"statfs":{"total":575970213888,"available":575757623296,"internally_reserved":0,"allocated":3919872,"data_stored":2585772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":208525984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002048"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":192,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-20T18:32:04.598373+0000","last_change":"2024-09-20T18:31:36.604986+0000","last_active":"2024-09-20T18:32:04.598373+0000","last_peered":"2024-09-20T18:32:04.598373+0000","last_clean":"2024-09-20T18:32:04.598373+0000","last_became_active":"2024-09-20T18:31:36.604521+0000","last_became_peered":"2024-09-20T18:31:36.604521+0000","last_unstale":"2024-09-20T18:32:04.598373+0000","last_undegraded":"2024-09-20T18:32:04.598373+0000","last_fullsized":"2024-09-20T18:32:04.598373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-20T18:30:47.993760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-20T18:30:47.993760+0000","last_clean_scrub_stamp":"2024-09-20T18:30:47.993760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:58.395831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920782,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713616,"statfs":{"total":95995035648,"available":95962742784,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149716,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":35700,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709452,"statfs":{"total":95995035648,"available":95958478848,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40440,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704712,"statfs":{"total":95995035648,"available":95953625088,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40436,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704716,"statfs":{"total":95995035648,"available":95953629184,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-20T18:32:35.732 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-20T18:32:35.732 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-20T18:32:35.732 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-20T18:32:35.732 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-20T18:32:35.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:35 smithi172 ceph-mon[35456]: from='client.14512 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-20T18:32:35.991 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:36.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.478+0000 7f4f9add7640 1 -- 172.21.15.17:0/3137788434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f94101900 msgr2=0x7f4f94101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:36.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.478+0000 7f4f9add7640 1 --2- 172.21.15.17:0/3137788434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f94101900 0x7f4f94101d60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4f84009880 tx=0x7f4f8402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:36.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.478+0000 7f4f9add7640 1 -- 172.21.15.17:0/3137788434 shutdown_connections 2024-09-20T18:32:36.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.478+0000 7f4f9add7640 1 --2- 172.21.15.17:0/3137788434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f94101900 0x7f4f94101d60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:36.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.478+0000 7f4f9add7640 1 --2- 172.21.15.17:0/3137788434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f94107900 0x7f4f94107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:36.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.478+0000 7f4f9add7640 1 -- 172.21.15.17:0/3137788434 >> 172.21.15.17:0/3137788434 conn(0x7f4f940fd600 msgr2=0x7f4f940ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:36.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.478+0000 7f4f9add7640 1 -- 172.21.15.17:0/3137788434 shutdown_connections 2024-09-20T18:32:36.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.478+0000 7f4f9add7640 1 -- 172.21.15.17:0/3137788434 wait complete. 2024-09-20T18:32:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.478+0000 7f4f9add7640 1 Processor -- start 2024-09-20T18:32:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.478+0000 7f4f9add7640 1 -- start start 2024-09-20T18:32:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.479+0000 7f4f9add7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f94101900 0x7f4f9419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.479+0000 7f4f9add7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f94107900 0x7f4f9419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.479+0000 7f4f9add7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9410edd0 con 0x7f4f94101900 2024-09-20T18:32:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.479+0000 7f4f9add7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9410ec50 con 0x7f4f94107900 2024-09-20T18:32:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.479+0000 7f4f98b73640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f94101900 0x7f4f9419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.479+0000 7f4f98b73640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f94101900 0x7f4f9419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33564/0 (socket says 172.21.15.17:33564) 2024-09-20T18:32:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.479+0000 7f4f98b73640 1 -- 172.21.15.17:0/303242109 learned_addr learned my addr 172.21.15.17:0/303242109 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.479+0000 7f4f8bfff640 1 --2- 172.21.15.17:0/303242109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f94107900 0x7f4f9419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.479+0000 7f4f98b73640 1 -- 172.21.15.17:0/303242109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f94107900 msgr2=0x7f4f9419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.479+0000 7f4f98b73640 1 --2- 172.21.15.17:0/303242109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f94107900 0x7f4f9419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.479+0000 7f4f98b73640 1 -- 172.21.15.17:0/303242109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f94197800 con 0x7f4f94101900 2024-09-20T18:32:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.479+0000 7f4f8bfff640 1 --2- 172.21.15.17:0/303242109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f94107900 0x7f4f9419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:32:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.479+0000 7f4f98b73640 1 --2- 172.21.15.17:0/303242109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f94101900 0x7f4f9419d680 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000d6f0 tx=0x7f4f9000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.479+0000 7f4f89ffb640 1 -- 172.21.15.17:0/303242109 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f90017070 con 0x7f4f94101900 2024-09-20T18:32:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.479+0000 7f4f9add7640 1 -- 172.21.15.17:0/303242109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f94197af0 con 0x7f4f94101900 2024-09-20T18:32:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.479+0000 7f4f89ffb640 1 -- 172.21.15.17:0/303242109 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f9000de00 con 0x7f4f94101900 2024-09-20T18:32:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.479+0000 7f4f89ffb640 1 -- 172.21.15.17:0/303242109 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f90004bb0 con 0x7f4f94101900 2024-09-20T18:32:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.480+0000 7f4f9add7640 1 -- 172.21.15.17:0/303242109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f94198050 con 0x7f4f94101900 2024-09-20T18:32:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.481+0000 7f4f9add7640 1 -- 172.21.15.17:0/303242109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f94103040 con 0x7f4f94101900 2024-09-20T18:32:36.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.481+0000 7f4f89ffb640 1 -- 172.21.15.17:0/303242109 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f4f90004e60 con 0x7f4f94101900 2024-09-20T18:32:36.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.482+0000 7f4f89ffb640 1 --2- 172.21.15.17:0/303242109 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f4f7c06e2b0 0x7f4f7c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:36.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.482+0000 7f4f89ffb640 1 -- 172.21.15.17:0/303242109 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f4f9008da20 con 0x7f4f94101900 2024-09-20T18:32:36.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.482+0000 7f4f8bfff640 1 --2- 172.21.15.17:0/303242109 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f4f7c06e2b0 0x7f4f7c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:36.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.482+0000 7f4f8bfff640 1 --2- 172.21.15.17:0/303242109 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f4f7c06e2b0 0x7f4f7c070770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4f94198b50 tx=0x7f4f84031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:36.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.486+0000 7f4f89ffb640 1 -- 172.21.15.17:0/303242109 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f9005b6c0 con 0x7f4f94101900 2024-09-20T18:32:36.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.699+0000 7f4f9add7640 1 -- 172.21.15.17:0/303242109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4f94109e70 con 0x7f4f94101900 2024-09-20T18:32:36.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.700+0000 7f4f89ffb640 1 -- 172.21.15.17:0/303242109 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f4f9005f370 con 0x7f4f94101900 2024-09-20T18:32:36.714 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:32:36.714 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-20T18:32:36.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.702+0000 7f4f9add7640 1 -- 172.21.15.17:0/303242109 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f4f7c06e2b0 msgr2=0x7f4f7c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:36.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.702+0000 7f4f9add7640 1 --2- 172.21.15.17:0/303242109 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f4f7c06e2b0 0x7f4f7c070770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4f94198b50 tx=0x7f4f84031400 comp rx=0 tx=0).stop 2024-09-20T18:32:36.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.702+0000 7f4f9add7640 1 -- 172.21.15.17:0/303242109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f94101900 msgr2=0x7f4f9419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:36.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.702+0000 7f4f9add7640 1 --2- 172.21.15.17:0/303242109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f94101900 0x7f4f9419d680 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000d6f0 tx=0x7f4f9000dbb0 comp rx=0 tx=0).stop 2024-09-20T18:32:36.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.702+0000 7f4f9add7640 1 -- 172.21.15.17:0/303242109 shutdown_connections 2024-09-20T18:32:36.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.702+0000 7f4f9add7640 1 --2- 172.21.15.17:0/303242109 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f4f7c06e2b0 0x7f4f7c070770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:36.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.702+0000 7f4f9add7640 1 --2- 172.21.15.17:0/303242109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f94107900 0x7f4f9419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:36.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.702+0000 7f4f9add7640 1 --2- 172.21.15.17:0/303242109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f94101900 0x7f4f9419d680 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:36.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.702+0000 7f4f9add7640 1 -- 172.21.15.17:0/303242109 >> 172.21.15.17:0/303242109 conn(0x7f4f940fd600 msgr2=0x7f4f940fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:36.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.702+0000 7f4f9add7640 1 -- 172.21.15.17:0/303242109 shutdown_connections 2024-09-20T18:32:36.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:36.702+0000 7f4f9add7640 1 -- 172.21.15.17:0/303242109 wait complete. 2024-09-20T18:32:36.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:36 smithi172 ceph-mon[35456]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:36.990 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:36 smithi017 ceph-mon[28058]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:37.349 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-20T18:32:37.349 INFO:tasks.cephadm:Setup complete, yielding 2024-09-20T18:32:37.349 INFO:teuthology.run_tasks:Running task print... 2024-09-20T18:32:37.360 INFO:teuthology.task.print:**** done end installing squid cephadm ... 2024-09-20T18:32:37.360 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T18:32:37.413 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-20T18:32:37.414 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-20T18:32:37.690 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:37.909 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:37 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/303242109' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-20T18:32:37.909 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:37 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:32:37.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:37 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/303242109' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-20T18:32:37.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:37 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:32:38.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.091+0000 7f8e1c964640 1 -- 172.21.15.17:0/4215150471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e18102b60 msgr2=0x7f8e18102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:38.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.091+0000 7f8e1c964640 1 --2- 172.21.15.17:0/4215150471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e18102b60 0x7f8e18102fe0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c009880 tx=0x7f8e0c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:38.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.091+0000 7f8e1c964640 1 -- 172.21.15.17:0/4215150471 shutdown_connections 2024-09-20T18:32:38.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.091+0000 7f8e1c964640 1 --2- 172.21.15.17:0/4215150471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e18102b60 0x7f8e18102fe0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:38.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.091+0000 7f8e1c964640 1 --2- 172.21.15.17:0/4215150471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e18101960 0x7f8e18101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:38.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.091+0000 7f8e1c964640 1 -- 172.21.15.17:0/4215150471 >> 172.21.15.17:0/4215150471 conn(0x7f8e180fd0f0 msgr2=0x7f8e180ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:38.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.091+0000 7f8e1c964640 1 -- 172.21.15.17:0/4215150471 shutdown_connections 2024-09-20T18:32:38.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.091+0000 7f8e1c964640 1 -- 172.21.15.17:0/4215150471 wait complete. 2024-09-20T18:32:38.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.092+0000 7f8e1c964640 1 Processor -- start 2024-09-20T18:32:38.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.092+0000 7f8e1c964640 1 -- start start 2024-09-20T18:32:38.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.092+0000 7f8e1c964640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e18101960 0x7f8e18197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:38.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.092+0000 7f8e1c964640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e18102b60 0x7f8e18197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:38.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.092+0000 7f8e1c964640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1810a820 con 0x7f8e18101960 2024-09-20T18:32:38.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.092+0000 7f8e1c964640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1810a6a0 con 0x7f8e18102b60 2024-09-20T18:32:38.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.092+0000 7f8e1659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e18101960 0x7f8e18197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:38.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.092+0000 7f8e1659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e18101960 0x7f8e18197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33586/0 (socket says 172.21.15.17:33586) 2024-09-20T18:32:38.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.092+0000 7f8e1659c640 1 -- 172.21.15.17:0/872782955 learned_addr learned my addr 172.21.15.17:0/872782955 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:38.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.092+0000 7f8e15d9b640 1 --2- 172.21.15.17:0/872782955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e18102b60 0x7f8e18197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:38.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.093+0000 7f8e1659c640 1 -- 172.21.15.17:0/872782955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e18102b60 msgr2=0x7f8e18197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:38.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.093+0000 7f8e1659c640 1 --2- 172.21.15.17:0/872782955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e18102b60 0x7f8e18197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:38.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.093+0000 7f8e1659c640 1 -- 172.21.15.17:0/872782955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e181980d0 con 0x7f8e18101960 2024-09-20T18:32:38.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.093+0000 7f8e1659c640 1 --2- 172.21.15.17:0/872782955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e18101960 0x7f8e18197510 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800b3d0 tx=0x7f8e0800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:38.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.093+0000 7f8e077fe640 1 -- 172.21.15.17:0/872782955 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e08015020 con 0x7f8e18101960 2024-09-20T18:32:38.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.093+0000 7f8e1c964640 1 -- 172.21.15.17:0/872782955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e1819cb10 con 0x7f8e18101960 2024-09-20T18:32:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.093+0000 7f8e077fe640 1 -- 172.21.15.17:0/872782955 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e08011af0 con 0x7f8e18101960 2024-09-20T18:32:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.093+0000 7f8e1c964640 1 -- 172.21.15.17:0/872782955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e1819d070 con 0x7f8e18101960 2024-09-20T18:32:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.093+0000 7f8e077fe640 1 -- 172.21.15.17:0/872782955 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e08010da0 con 0x7f8e18101960 2024-09-20T18:32:38.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.094+0000 7f8e1c964640 1 -- 172.21.15.17:0/872782955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e18101d60 con 0x7f8e18101960 2024-09-20T18:32:38.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.094+0000 7f8e077fe640 1 -- 172.21.15.17:0/872782955 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8e08018020 con 0x7f8e18101960 2024-09-20T18:32:38.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.095+0000 7f8e077fe640 1 --2- 172.21.15.17:0/872782955 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8e0006e2b0 0x7f8e00070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:38.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.095+0000 7f8e077fe640 1 -- 172.21.15.17:0/872782955 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f8e0808d920 con 0x7f8e18101960 2024-09-20T18:32:38.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.095+0000 7f8e15d9b640 1 --2- 172.21.15.17:0/872782955 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8e0006e2b0 0x7f8e00070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:38.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.095+0000 7f8e15d9b640 1 --2- 172.21.15.17:0/872782955 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8e0006e2b0 0x7f8e00070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c000c00 tx=0x7f8e0c0058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:38.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.099+0000 7f8e077fe640 1 -- 172.21.15.17:0/872782955 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8e0801f020 con 0x7f8e18101960 2024-09-20T18:32:38.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.278+0000 7f8e1c964640 1 -- 172.21.15.17:0/872782955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) -- 0x7f8e18191630 con 0x7f8e18101960 2024-09-20T18:32:38.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.281+0000 7f8e077fe640 1 -- 172.21.15.17:0/872782955 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v43)=0 v43) ==== 143+0+0 (secure 0 0 0) 0x7f8e0805b5c0 con 0x7f8e18101960 2024-09-20T18:32:38.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.284+0000 7f8e1c964640 1 -- 172.21.15.17:0/872782955 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8e0006e2b0 msgr2=0x7f8e00070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:38.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.284+0000 7f8e1c964640 1 --2- 172.21.15.17:0/872782955 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8e0006e2b0 0x7f8e00070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c000c00 tx=0x7f8e0c0058d0 comp rx=0 tx=0).stop 2024-09-20T18:32:38.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.284+0000 7f8e1c964640 1 -- 172.21.15.17:0/872782955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e18101960 msgr2=0x7f8e18197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:38.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.284+0000 7f8e1c964640 1 --2- 172.21.15.17:0/872782955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e18101960 0x7f8e18197510 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800b3d0 tx=0x7f8e0800b890 comp rx=0 tx=0).stop 2024-09-20T18:32:38.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.284+0000 7f8e1c964640 1 -- 172.21.15.17:0/872782955 shutdown_connections 2024-09-20T18:32:38.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.284+0000 7f8e1c964640 1 --2- 172.21.15.17:0/872782955 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8e0006e2b0 0x7f8e00070770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:38.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.284+0000 7f8e1c964640 1 --2- 172.21.15.17:0/872782955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e18102b60 0x7f8e18197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:38.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.284+0000 7f8e1c964640 1 --2- 172.21.15.17:0/872782955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e18101960 0x7f8e18197510 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:38.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.284+0000 7f8e1c964640 1 -- 172.21.15.17:0/872782955 >> 172.21.15.17:0/872782955 conn(0x7f8e180fd0f0 msgr2=0x7f8e18106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:38.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.284+0000 7f8e1c964640 1 -- 172.21.15.17:0/872782955 shutdown_connections 2024-09-20T18:32:38.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:38.284+0000 7f8e1c964640 1 -- 172.21.15.17:0/872782955 wait complete. 2024-09-20T18:32:38.959 INFO:teuthology.run_tasks:Running task print... 2024-09-20T18:32:38.968 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-20T18:32:38.968 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T18:32:38.976 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-20T18:32:38.976 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-20T18:32:39.234 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:39.625 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:39 smithi017 ceph-mon[28058]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:39.625 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:39 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/872782955' entity='client.admin' 2024-09-20T18:32:39.625 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:39 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:32:39.625 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:39 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:32:39.626 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:39 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:32:39.626 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:39 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:39.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.694+0000 7f696bf36640 1 -- 172.21.15.17:0/2241054856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69641024b0 msgr2=0x7f69641048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:39.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.694+0000 7f696bf36640 1 --2- 172.21.15.17:0/2241054856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69641024b0 0x7f69641048a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6960009880 tx=0x7f696002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:39.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.694+0000 7f696bf36640 1 -- 172.21.15.17:0/2241054856 shutdown_connections 2024-09-20T18:32:39.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.694+0000 7f696bf36640 1 --2- 172.21.15.17:0/2241054856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6964104de0 0x7f69641071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:39.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.694+0000 7f696bf36640 1 --2- 172.21.15.17:0/2241054856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69641024b0 0x7f69641048a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:39.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.694+0000 7f696bf36640 1 -- 172.21.15.17:0/2241054856 >> 172.21.15.17:0/2241054856 conn(0x7f69640fc010 msgr2=0x7f69640fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:39.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.695+0000 7f696bf36640 1 -- 172.21.15.17:0/2241054856 shutdown_connections 2024-09-20T18:32:39.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.695+0000 7f696bf36640 1 -- 172.21.15.17:0/2241054856 wait complete. 2024-09-20T18:32:39.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:39 smithi172 ceph-mon[35456]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:39.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:39 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/872782955' entity='client.admin' 2024-09-20T18:32:39.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:39 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:32:39.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:39 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:32:39.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:39 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:32:39.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:39 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:39.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.695+0000 7f696bf36640 1 Processor -- start 2024-09-20T18:32:39.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.695+0000 7f696bf36640 1 -- start start 2024-09-20T18:32:39.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.696+0000 7f696bf36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69641024b0 0x7f6964197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:39.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.696+0000 7f696bf36640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6964104de0 0x7f6964197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:39.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.696+0000 7f696bf36640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f696410a7d0 con 0x7f69641024b0 2024-09-20T18:32:39.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.696+0000 7f696bf36640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f696410a650 con 0x7f6964104de0 2024-09-20T18:32:39.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.696+0000 7f6969cd2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69641024b0 0x7f6964197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:39.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.696+0000 7f6969cd2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69641024b0 0x7f6964197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33610/0 (socket says 172.21.15.17:33610) 2024-09-20T18:32:39.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.696+0000 7f6969cd2640 1 -- 172.21.15.17:0/1698393372 learned_addr learned my addr 172.21.15.17:0/1698393372 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:39.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.696+0000 7f69694d1640 1 --2- 172.21.15.17:0/1698393372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6964104de0 0x7f6964197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:39.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.696+0000 7f6969cd2640 1 -- 172.21.15.17:0/1698393372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6964104de0 msgr2=0x7f6964197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:39.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.696+0000 7f6969cd2640 1 --2- 172.21.15.17:0/1698393372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6964104de0 0x7f6964197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:39.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.696+0000 7f6969cd2640 1 -- 172.21.15.17:0/1698393372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69641980e0 con 0x7f69641024b0 2024-09-20T18:32:39.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.696+0000 7f6969cd2640 1 --2- 172.21.15.17:0/1698393372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69641024b0 0x7f6964197520 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6960009230 tx=0x7f69600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:39.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.696+0000 7f695affd640 1 -- 172.21.15.17:0/1698393372 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f696003f070 con 0x7f69641024b0 2024-09-20T18:32:39.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.697+0000 7f696bf36640 1 -- 172.21.15.17:0/1698393372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f696419cac0 con 0x7f69641024b0 2024-09-20T18:32:39.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.697+0000 7f695affd640 1 -- 172.21.15.17:0/1698393372 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6960004b80 con 0x7f69641024b0 2024-09-20T18:32:39.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.697+0000 7f695affd640 1 -- 172.21.15.17:0/1698393372 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6960035030 con 0x7f69641024b0 2024-09-20T18:32:39.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.697+0000 7f696bf36640 1 -- 172.21.15.17:0/1698393372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f696419d050 con 0x7f69641024b0 2024-09-20T18:32:39.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.697+0000 7f696bf36640 1 -- 172.21.15.17:0/1698393372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6964102890 con 0x7f69641024b0 2024-09-20T18:32:39.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.698+0000 7f695affd640 1 -- 172.21.15.17:0/1698393372 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6960042070 con 0x7f69641024b0 2024-09-20T18:32:39.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.698+0000 7f695affd640 1 --2- 172.21.15.17:0/1698393372 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f695006e300 0x7f69500707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:39.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.699+0000 7f695affd640 1 -- 172.21.15.17:0/1698393372 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f69600ae920 con 0x7f69641024b0 2024-09-20T18:32:39.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.699+0000 7f69694d1640 1 --2- 172.21.15.17:0/1698393372 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f695006e300 0x7f69500707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:39.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.699+0000 7f69694d1640 1 --2- 172.21.15.17:0/1698393372 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f695006e300 0x7f69500707c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f69641989d0 tx=0x7f695400b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:39.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.703+0000 7f695affd640 1 -- 172.21.15.17:0/1698393372 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f69600802f0 con 0x7f69641024b0 2024-09-20T18:32:39.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.897+0000 7f696bf36640 1 -- 172.21.15.17:0/1698393372 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f69641058c0 con 0x7f695006e300 2024-09-20T18:32:39.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.898+0000 7f695affd640 1 -- 172.21.15.17:0/1698393372 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f69641058c0 con 0x7f695006e300 2024-09-20T18:32:39.913 INFO:teuthology.orchestra.run.smithi017.stdout:Backend: cephadm 2024-09-20T18:32:39.913 INFO:teuthology.orchestra.run.smithi017.stdout:Available: Yes 2024-09-20T18:32:39.913 INFO:teuthology.orchestra.run.smithi017.stdout:Paused: No 2024-09-20T18:32:39.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.901+0000 7f696bf36640 1 -- 172.21.15.17:0/1698393372 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f695006e300 msgr2=0x7f69500707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:39.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.901+0000 7f696bf36640 1 --2- 172.21.15.17:0/1698393372 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f695006e300 0x7f69500707c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f69641989d0 tx=0x7f695400b390 comp rx=0 tx=0).stop 2024-09-20T18:32:39.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.901+0000 7f696bf36640 1 -- 172.21.15.17:0/1698393372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69641024b0 msgr2=0x7f6964197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:39.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.901+0000 7f696bf36640 1 --2- 172.21.15.17:0/1698393372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69641024b0 0x7f6964197520 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6960009230 tx=0x7f69600046c0 comp rx=0 tx=0).stop 2024-09-20T18:32:39.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.901+0000 7f696bf36640 1 -- 172.21.15.17:0/1698393372 shutdown_connections 2024-09-20T18:32:39.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.901+0000 7f696bf36640 1 --2- 172.21.15.17:0/1698393372 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f695006e300 0x7f69500707c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:39.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.901+0000 7f696bf36640 1 --2- 172.21.15.17:0/1698393372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6964104de0 0x7f6964197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:39.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.901+0000 7f696bf36640 1 --2- 172.21.15.17:0/1698393372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69641024b0 0x7f6964197520 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:39.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.901+0000 7f696bf36640 1 -- 172.21.15.17:0/1698393372 >> 172.21.15.17:0/1698393372 conn(0x7f69640fc010 msgr2=0x7f69640fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:39.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.901+0000 7f696bf36640 1 -- 172.21.15.17:0/1698393372 shutdown_connections 2024-09-20T18:32:39.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:39.901+0000 7f696bf36640 1 -- 172.21.15.17:0/1698393372 wait complete. 2024-09-20T18:32:40.668 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-20T18:32:40.925 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:41.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.361+0000 7f200c7a9640 1 -- 172.21.15.17:0/2412783196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2004100860 msgr2=0x7f2004100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:41.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.361+0000 7f200c7a9640 1 --2- 172.21.15.17:0/2412783196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2004100860 0x7f2004100c60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2000009880 tx=0x7f200002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:41.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.362+0000 7f200c7a9640 1 -- 172.21.15.17:0/2412783196 shutdown_connections 2024-09-20T18:32:41.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.362+0000 7f200c7a9640 1 --2- 172.21.15.17:0/2412783196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2004101a60 0x7f2004101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:41.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.362+0000 7f200c7a9640 1 --2- 172.21.15.17:0/2412783196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2004100860 0x7f2004100c60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:41.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.362+0000 7f200c7a9640 1 -- 172.21.15.17:0/2412783196 >> 172.21.15.17:0/2412783196 conn(0x7f20040fc010 msgr2=0x7f20040fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:41.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.362+0000 7f200c7a9640 1 -- 172.21.15.17:0/2412783196 shutdown_connections 2024-09-20T18:32:41.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.362+0000 7f200c7a9640 1 -- 172.21.15.17:0/2412783196 wait complete. 2024-09-20T18:32:41.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.362+0000 7f200c7a9640 1 Processor -- start 2024-09-20T18:32:41.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.362+0000 7f200c7a9640 1 -- start start 2024-09-20T18:32:41.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.362+0000 7f200c7a9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2004100860 0x7f2004197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:41.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.362+0000 7f200c7a9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2004101a60 0x7f2004197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:41.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.362+0000 7f200c7a9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2004109700 con 0x7f2004101a60 2024-09-20T18:32:41.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.362+0000 7f200c7a9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2004109580 con 0x7f2004100860 2024-09-20T18:32:41.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.362+0000 7f2009d44640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2004101a60 0x7f2004197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:41.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.362+0000 7f2009d44640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2004101a60 0x7f2004197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59138/0 (socket says 172.21.15.17:59138) 2024-09-20T18:32:41.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.362+0000 7f2009d44640 1 -- 172.21.15.17:0/4055916858 learned_addr learned my addr 172.21.15.17:0/4055916858 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:41.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.363+0000 7f200a545640 1 --2- 172.21.15.17:0/4055916858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2004100860 0x7f2004197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:41.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.363+0000 7f2009d44640 1 -- 172.21.15.17:0/4055916858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2004100860 msgr2=0x7f2004197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:41.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.363+0000 7f2009d44640 1 --2- 172.21.15.17:0/4055916858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2004100860 0x7f2004197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:41.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.363+0000 7f2009d44640 1 -- 172.21.15.17:0/4055916858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2004198130 con 0x7f2004101a60 2024-09-20T18:32:41.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.363+0000 7f2009d44640 1 --2- 172.21.15.17:0/4055916858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2004101a60 0x7f2004197ab0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400b420 tx=0x7f1ff400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:41.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.363+0000 7f1ffb7fe640 1 -- 172.21.15.17:0/4055916858 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ff4011630 con 0x7f2004101a60 2024-09-20T18:32:41.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.363+0000 7f200c7a9640 1 -- 172.21.15.17:0/4055916858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200419cb70 con 0x7f2004101a60 2024-09-20T18:32:41.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.363+0000 7f1ffb7fe640 1 -- 172.21.15.17:0/4055916858 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1ff4016070 con 0x7f2004101a60 2024-09-20T18:32:41.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.363+0000 7f1ffb7fe640 1 -- 172.21.15.17:0/4055916858 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ff4010d40 con 0x7f2004101a60 2024-09-20T18:32:41.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.363+0000 7f200c7a9640 1 -- 172.21.15.17:0/4055916858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f200419d180 con 0x7f2004101a60 2024-09-20T18:32:41.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.364+0000 7f200c7a9640 1 -- 172.21.15.17:0/4055916858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2004100c60 con 0x7f2004101a60 2024-09-20T18:32:41.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.365+0000 7f1ffb7fe640 1 -- 172.21.15.17:0/4055916858 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f1ff401b460 con 0x7f2004101a60 2024-09-20T18:32:41.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.365+0000 7f1ffb7fe640 1 --2- 172.21.15.17:0/4055916858 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f1ff006e2b0 0x7f1ff0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:41.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.365+0000 7f1ffb7fe640 1 -- 172.21.15.17:0/4055916858 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f1ff408d730 con 0x7f2004101a60 2024-09-20T18:32:41.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.365+0000 7f200a545640 1 --2- 172.21.15.17:0/4055916858 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f1ff006e2b0 0x7f1ff0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:41.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.366+0000 7f200a545640 1 --2- 172.21.15.17:0/4055916858 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f1ff006e2b0 0x7f1ff0070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2000000c00 tx=0x7f2000005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:41.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.369+0000 7f1ffb7fe640 1 -- 172.21.15.17:0/4055916858 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1ff405b3d0 con 0x7f2004101a60 2024-09-20T18:32:41.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.553+0000 7f200c7a9640 1 -- 172.21.15.17:0/4055916858 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f200406a970 con 0x7f1ff006e2b0 2024-09-20T18:32:41.567 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:41 smithi017 ceph-mon[28058]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:41.567 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:41 smithi017 ceph-mon[28058]: from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:32:41.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.561+0000 7f1ffb7fe640 1 -- 172.21.15.17:0/4055916858 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3100 (secure 0 0 0) 0x7f200406a970 con 0x7f1ff006e2b0 2024-09-20T18:32:41.575 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:32:41.575 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (3m) 118s ago 5m 26.4M - 0.25.0 c8568f914cd2 8954ab699be3 2024-09-20T18:32:41.575 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (5m) 118s ago 5m 9789k - 19.1.1-369-ged8ee0f2 6acb0a031eab 404e79f7d9bb 2024-09-20T18:32:41.575 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (4m) 41s ago 4m 5272k - 19.1.1-369-ged8ee0f2 6acb0a031eab 747d22f4b582 2024-09-20T18:32:41.576 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (5m) 118s ago 5m 6895k - 19.1.1-369-ged8ee0f2 6acb0a031eab 725c8bcc6ec8 2024-09-20T18:32:41.576 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (4m) 41s ago 4m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab e10dd613dbe2 2024-09-20T18:32:41.576 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (3m) 118s ago 4m 75.7M - 9.4.12 2bacad6d85d8 d8c886b98eae 2024-09-20T18:32:41.576 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:9283,8765,8443 running (6m) 118s ago 6m 489M - 19.1.1-369-ged8ee0f2 6acb0a031eab 28eeab491beb 2024-09-20T18:32:41.576 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (4m) 41s ago 4m 443M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4b1c7bce31f2 2024-09-20T18:32:41.576 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (6m) 118s ago 6m 44.2M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab ab1f988c4cb2 2024-09-20T18:32:41.576 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (4m) 41s ago 4m 41.2M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 9eea40352787 2024-09-20T18:32:41.576 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (5m) 118s ago 5m 14.1M - 1.5.0 0da6a335fe13 1584915999b1 2024-09-20T18:32:41.576 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (4m) 41s ago 4m 15.2M - 1.5.0 0da6a335fe13 880d938148e8 2024-09-20T18:32:41.576 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (3m) 118s ago 3m 45.1M 3948M 19.1.1-369-ged8ee0f2 6acb0a031eab c1207e514216 2024-09-20T18:32:41.576 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (2m) 118s ago 2m 44.6M 3948M 19.1.1-369-ged8ee0f2 6acb0a031eab 73f2fd77590f 2024-09-20T18:32:41.576 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (2m) 118s ago 2m 12.0M 3948M 19.1.1-369-ged8ee0f2 6acb0a031eab 6f0b9405dc18 2024-09-20T18:32:41.576 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (100s) 41s ago 99s 47.8M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:32:41.576 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (73s) 41s ago 73s 43.5M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:32:41.576 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (47s) 41s ago 46s 11.8M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:32:41.577 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (3m) 118s ago 4m 40.5M - 2.43.0 a07b618ecd1d ebc76047e24f 2024-09-20T18:32:41.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.563+0000 7f200c7a9640 1 -- 172.21.15.17:0/4055916858 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f1ff006e2b0 msgr2=0x7f1ff0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:41.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.563+0000 7f200c7a9640 1 --2- 172.21.15.17:0/4055916858 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f1ff006e2b0 0x7f1ff0070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2000000c00 tx=0x7f2000005a20 comp rx=0 tx=0).stop 2024-09-20T18:32:41.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.563+0000 7f200c7a9640 1 -- 172.21.15.17:0/4055916858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2004101a60 msgr2=0x7f2004197ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:41.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.563+0000 7f200c7a9640 1 --2- 172.21.15.17:0/4055916858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2004101a60 0x7f2004197ab0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400b420 tx=0x7f1ff400b8e0 comp rx=0 tx=0).stop 2024-09-20T18:32:41.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.563+0000 7f200c7a9640 1 -- 172.21.15.17:0/4055916858 shutdown_connections 2024-09-20T18:32:41.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.563+0000 7f200c7a9640 1 --2- 172.21.15.17:0/4055916858 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f1ff006e2b0 0x7f1ff0070770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:41.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.563+0000 7f200c7a9640 1 --2- 172.21.15.17:0/4055916858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2004101a60 0x7f2004197ab0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:41.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.563+0000 7f200c7a9640 1 --2- 172.21.15.17:0/4055916858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2004100860 0x7f2004197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:41.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.563+0000 7f200c7a9640 1 -- 172.21.15.17:0/4055916858 >> 172.21.15.17:0/4055916858 conn(0x7f20040fc010 msgr2=0x7f200406a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:41.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.563+0000 7f200c7a9640 1 -- 172.21.15.17:0/4055916858 shutdown_connections 2024-09-20T18:32:41.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:41.563+0000 7f200c7a9640 1 -- 172.21.15.17:0/4055916858 wait complete. 2024-09-20T18:32:41.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:41 smithi172 ceph-mon[35456]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:41.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:41 smithi172 ceph-mon[35456]: from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:32:42.125 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-20T18:32:42.382 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:42.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.794+0000 7f8f3776e640 1 -- 172.21.15.17:0/4168315849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f30102b60 msgr2=0x7f8f30102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:42.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.794+0000 7f8f3776e640 1 --2- 172.21.15.17:0/4168315849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f30102b60 0x7f8f30102fe0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009880 tx=0x7f8f2002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:42.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.794+0000 7f8f3776e640 1 -- 172.21.15.17:0/4168315849 shutdown_connections 2024-09-20T18:32:42.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.794+0000 7f8f3776e640 1 --2- 172.21.15.17:0/4168315849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f30102b60 0x7f8f30102fe0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:42.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.794+0000 7f8f3776e640 1 --2- 172.21.15.17:0/4168315849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f30101960 0x7f8f30101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:42.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.794+0000 7f8f3776e640 1 -- 172.21.15.17:0/4168315849 >> 172.21.15.17:0/4168315849 conn(0x7f8f300fd0f0 msgr2=0x7f8f300ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:42.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.794+0000 7f8f3776e640 1 -- 172.21.15.17:0/4168315849 shutdown_connections 2024-09-20T18:32:42.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.794+0000 7f8f3776e640 1 -- 172.21.15.17:0/4168315849 wait complete. 2024-09-20T18:32:42.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.794+0000 7f8f3776e640 1 Processor -- start 2024-09-20T18:32:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.794+0000 7f8f3776e640 1 -- start start 2024-09-20T18:32:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.795+0000 7f8f3776e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f30101960 0x7f8f301996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.795+0000 7f8f3776e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f30102b60 0x7f8f30199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.795+0000 7f8f3776e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3010a7a0 con 0x7f8f30102b60 2024-09-20T18:32:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.795+0000 7f8f3776e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3010a620 con 0x7f8f30101960 2024-09-20T18:32:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.795+0000 7f8f34d09640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f30102b60 0x7f8f30199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.795+0000 7f8f34d09640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f30102b60 0x7f8f30199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59162/0 (socket says 172.21.15.17:59162) 2024-09-20T18:32:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.795+0000 7f8f34d09640 1 -- 172.21.15.17:0/1777026633 learned_addr learned my addr 172.21.15.17:0/1777026633 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.795+0000 7f8f3550a640 1 --2- 172.21.15.17:0/1777026633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f30101960 0x7f8f301996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.795+0000 7f8f34d09640 1 -- 172.21.15.17:0/1777026633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f30101960 msgr2=0x7f8f301996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.795+0000 7f8f34d09640 1 --2- 172.21.15.17:0/1777026633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f30101960 0x7f8f301996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.795+0000 7f8f34d09640 1 -- 172.21.15.17:0/1777026633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3019a280 con 0x7f8f30102b60 2024-09-20T18:32:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.795+0000 7f8f34d09640 1 --2- 172.21.15.17:0/1777026633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f30102b60 0x7f8f30199c00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8f20006010 tx=0x7f8f200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:42.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.795+0000 7f8f267fc640 1 -- 172.21.15.17:0/1777026633 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f2003f070 con 0x7f8f30102b60 2024-09-20T18:32:42.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.796+0000 7f8f267fc640 1 -- 172.21.15.17:0/1777026633 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f20004ac0 con 0x7f8f30102b60 2024-09-20T18:32:42.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.796+0000 7f8f3776e640 1 -- 172.21.15.17:0/1777026633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f3019ec60 con 0x7f8f30102b60 2024-09-20T18:32:42.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.796+0000 7f8f267fc640 1 -- 172.21.15.17:0/1777026633 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f20035030 con 0x7f8f30102b60 2024-09-20T18:32:42.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.796+0000 7f8f3776e640 1 -- 172.21.15.17:0/1777026633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f3019f1a0 con 0x7f8f30102b60 2024-09-20T18:32:42.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.797+0000 7f8f3776e640 1 -- 172.21.15.17:0/1777026633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f30101d60 con 0x7f8f30102b60 2024-09-20T18:32:42.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.797+0000 7f8f267fc640 1 -- 172.21.15.17:0/1777026633 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8f20042070 con 0x7f8f30102b60 2024-09-20T18:32:42.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.798+0000 7f8f267fc640 1 --2- 172.21.15.17:0/1777026633 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8f1c06e310 0x7f8f1c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:42.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.798+0000 7f8f3550a640 1 --2- 172.21.15.17:0/1777026633 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8f1c06e310 0x7f8f1c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:42.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.798+0000 7f8f267fc640 1 -- 172.21.15.17:0/1777026633 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f8f200ae940 con 0x7f8f30102b60 2024-09-20T18:32:42.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.798+0000 7f8f3550a640 1 --2- 172.21.15.17:0/1777026633 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8f1c06e310 0x7f8f1c0707d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c005fd0 tx=0x7f8f2c00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:42.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.802+0000 7f8f267fc640 1 -- 172.21.15.17:0/1777026633 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8f20080310 con 0x7f8f30102b60 2024-09-20T18:32:43.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.988+0000 7f8f3776e640 1 -- 172.21.15.17:0/1777026633 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f8f30062630 con 0x7f8f1c06e310 2024-09-20T18:32:43.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.993+0000 7f8f267fc640 1 -- 172.21.15.17:0/1777026633 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1300 (secure 0 0 0) 0x7f8f30062630 con 0x7f8f1c06e310 2024-09-20T18:32:43.007 INFO:teuthology.orchestra.run.smithi017.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-20T18:32:43.007 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager ?:9093,9094 1/1 119s ago 5m count:1 2024-09-20T18:32:43.007 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter 2/2 119s ago 5m * 2024-09-20T18:32:43.007 INFO:teuthology.orchestra.run.smithi017.stdout:crash 2/2 119s ago 5m * 2024-09-20T18:32:43.007 INFO:teuthology.orchestra.run.smithi017.stdout:grafana ?:3000 1/1 119s ago 5m count:1 2024-09-20T18:32:43.007 INFO:teuthology.orchestra.run.smithi017.stdout:mgr 2/2 119s ago 5m count:2 2024-09-20T18:32:43.007 INFO:teuthology.orchestra.run.smithi017.stdout:mon 2/2 119s ago 5m smithi017:172.21.15.17=smithi017;smithi172:172.21.15.172=smithi172;count:2 2024-09-20T18:32:43.007 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter ?:9100 2/2 119s ago 5m * 2024-09-20T18:32:43.007 INFO:teuthology.orchestra.run.smithi017.stdout:osd 6 119s ago - 2024-09-20T18:32:43.007 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus ?:9095 1/1 119s ago 5m count:1 2024-09-20T18:32:43.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.995+0000 7f8f3776e640 1 -- 172.21.15.17:0/1777026633 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8f1c06e310 msgr2=0x7f8f1c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:43.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.995+0000 7f8f3776e640 1 --2- 172.21.15.17:0/1777026633 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8f1c06e310 0x7f8f1c0707d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c005fd0 tx=0x7f8f2c00b390 comp rx=0 tx=0).stop 2024-09-20T18:32:43.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.995+0000 7f8f3776e640 1 -- 172.21.15.17:0/1777026633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f30102b60 msgr2=0x7f8f30199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:43.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.995+0000 7f8f3776e640 1 --2- 172.21.15.17:0/1777026633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f30102b60 0x7f8f30199c00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8f20006010 tx=0x7f8f200046c0 comp rx=0 tx=0).stop 2024-09-20T18:32:43.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.995+0000 7f8f3776e640 1 -- 172.21.15.17:0/1777026633 shutdown_connections 2024-09-20T18:32:43.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.995+0000 7f8f3776e640 1 --2- 172.21.15.17:0/1777026633 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8f1c06e310 0x7f8f1c0707d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:43.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.995+0000 7f8f3776e640 1 --2- 172.21.15.17:0/1777026633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f30102b60 0x7f8f30199c00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:43.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.995+0000 7f8f3776e640 1 --2- 172.21.15.17:0/1777026633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f30101960 0x7f8f301996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:43.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.995+0000 7f8f3776e640 1 -- 172.21.15.17:0/1777026633 >> 172.21.15.17:0/1777026633 conn(0x7f8f300fd0f0 msgr2=0x7f8f30103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:43.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.995+0000 7f8f3776e640 1 -- 172.21.15.17:0/1777026633 shutdown_connections 2024-09-20T18:32:43.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:42.995+0000 7f8f3776e640 1 -- 172.21.15.17:0/1777026633 wait complete. 2024-09-20T18:32:43.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:43 smithi017 ceph-mon[28058]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:43.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:43 smithi017 ceph-mon[28058]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:32:43.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:43 smithi172 ceph-mon[35456]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:43.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:43 smithi172 ceph-mon[35456]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:32:43.717 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-20T18:32:43.990 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:44.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:44 smithi017 ceph-mon[28058]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:32:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.427+0000 7fe653f0d640 1 -- 172.21.15.17:0/3862361689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe64c1001e0 msgr2=0x7fe64c1005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.427+0000 7fe653f0d640 1 --2- 172.21.15.17:0/3862361689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe64c1001e0 0x7fe64c1005e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe644009880 tx=0x7fe64402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.427+0000 7fe653f0d640 1 -- 172.21.15.17:0/3862361689 shutdown_connections 2024-09-20T18:32:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.427+0000 7fe653f0d640 1 --2- 172.21.15.17:0/3862361689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe64c100b20 0x7fe64c100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.427+0000 7fe653f0d640 1 --2- 172.21.15.17:0/3862361689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe64c1001e0 0x7fe64c1005e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.427+0000 7fe653f0d640 1 -- 172.21.15.17:0/3862361689 >> 172.21.15.17:0/3862361689 conn(0x7fe64c0fc010 msgr2=0x7fe64c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.427+0000 7fe653f0d640 1 -- 172.21.15.17:0/3862361689 shutdown_connections 2024-09-20T18:32:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.427+0000 7fe653f0d640 1 -- 172.21.15.17:0/3862361689 wait complete. 2024-09-20T18:32:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.427+0000 7fe653f0d640 1 Processor -- start 2024-09-20T18:32:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.427+0000 7fe653f0d640 1 -- start start 2024-09-20T18:32:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.427+0000 7fe653f0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe64c1001e0 0x7fe64c199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.427+0000 7fe653f0d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe64c100b20 0x7fe64c199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.428+0000 7fe653f0d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c10c970 con 0x7fe64c1001e0 2024-09-20T18:32:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.428+0000 7fe653f0d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c10c7f0 con 0x7fe64c100b20 2024-09-20T18:32:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.428+0000 7fe651ca9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe64c1001e0 0x7fe64c199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.428+0000 7fe651ca9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe64c1001e0 0x7fe64c199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59178/0 (socket says 172.21.15.17:59178) 2024-09-20T18:32:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.428+0000 7fe651ca9640 1 -- 172.21.15.17:0/2922537499 learned_addr learned my addr 172.21.15.17:0/2922537499 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:44.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.428+0000 7fe6514a8640 1 --2- 172.21.15.17:0/2922537499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe64c100b20 0x7fe64c199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.428+0000 7fe651ca9640 1 -- 172.21.15.17:0/2922537499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe64c100b20 msgr2=0x7fe64c199ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.428+0000 7fe651ca9640 1 --2- 172.21.15.17:0/2922537499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe64c100b20 0x7fe64c199ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.428+0000 7fe651ca9640 1 -- 172.21.15.17:0/2922537499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64c19a190 con 0x7fe64c1001e0 2024-09-20T18:32:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.428+0000 7fe6514a8640 1 --2- 172.21.15.17:0/2922537499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe64c100b20 0x7fe64c199ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:32:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.428+0000 7fe651ca9640 1 --2- 172.21.15.17:0/2922537499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe64c1001e0 0x7fe64c199660 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe644006010 tx=0x7fe6440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.428+0000 7fe64affd640 1 -- 172.21.15.17:0/2922537499 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe64403f070 con 0x7fe64c1001e0 2024-09-20T18:32:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.428+0000 7fe64affd640 1 -- 172.21.15.17:0/2922537499 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe6440044d0 con 0x7fe64c1001e0 2024-09-20T18:32:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.428+0000 7fe653f0d640 1 -- 172.21.15.17:0/2922537499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64c19eba0 con 0x7fe64c1001e0 2024-09-20T18:32:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.428+0000 7fe64affd640 1 -- 172.21.15.17:0/2922537499 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe644035030 con 0x7fe64c1001e0 2024-09-20T18:32:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.428+0000 7fe653f0d640 1 -- 172.21.15.17:0/2922537499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe64c19f0a0 con 0x7fe64c1001e0 2024-09-20T18:32:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.429+0000 7fe653f0d640 1 -- 172.21.15.17:0/2922537499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe64c1005e0 con 0x7fe64c1001e0 2024-09-20T18:32:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.430+0000 7fe64affd640 1 -- 172.21.15.17:0/2922537499 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe644042070 con 0x7fe64c1001e0 2024-09-20T18:32:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.430+0000 7fe64affd640 1 --2- 172.21.15.17:0/2922537499 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe63406e310 0x7fe6340707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:44.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.430+0000 7fe64affd640 1 -- 172.21.15.17:0/2922537499 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fe6440aeab0 con 0x7fe64c1001e0 2024-09-20T18:32:44.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.430+0000 7fe6514a8640 1 --2- 172.21.15.17:0/2922537499 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe63406e310 0x7fe6340707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:44.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.431+0000 7fe6514a8640 1 --2- 172.21.15.17:0/2922537499 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe63406e310 0x7fe6340707d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe64c19ab10 tx=0x7fe64000a5c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:44.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.435+0000 7fe64affd640 1 -- 172.21.15.17:0/2922537499 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe64407c7d0 con 0x7fe64c1001e0 2024-09-20T18:32:44.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.616+0000 7fe653f0d640 1 -- 172.21.15.17:0/2922537499 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fe64c062630 con 0x7fe63406e310 2024-09-20T18:32:44.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.617+0000 7fe64affd640 1 -- 172.21.15.17:0/2922537499 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+148 (secure 0 0 0) 0x7fe64c062630 con 0x7fe63406e310 2024-09-20T18:32:44.631 INFO:teuthology.orchestra.run.smithi017.stdout:HOST ADDR LABELS STATUS 2024-09-20T18:32:44.631 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 172.21.15.17 2024-09-20T18:32:44.631 INFO:teuthology.orchestra.run.smithi017.stdout:smithi172 172.21.15.172 2024-09-20T18:32:44.631 INFO:teuthology.orchestra.run.smithi017.stdout:2 hosts in cluster 2024-09-20T18:32:44.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.619+0000 7fe653f0d640 1 -- 172.21.15.17:0/2922537499 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe63406e310 msgr2=0x7fe6340707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:44.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.619+0000 7fe653f0d640 1 --2- 172.21.15.17:0/2922537499 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe63406e310 0x7fe6340707d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe64c19ab10 tx=0x7fe64000a5c0 comp rx=0 tx=0).stop 2024-09-20T18:32:44.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.619+0000 7fe653f0d640 1 -- 172.21.15.17:0/2922537499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe64c1001e0 msgr2=0x7fe64c199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:44.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.619+0000 7fe653f0d640 1 --2- 172.21.15.17:0/2922537499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe64c1001e0 0x7fe64c199660 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe644006010 tx=0x7fe6440048f0 comp rx=0 tx=0).stop 2024-09-20T18:32:44.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.619+0000 7fe653f0d640 1 -- 172.21.15.17:0/2922537499 shutdown_connections 2024-09-20T18:32:44.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.619+0000 7fe653f0d640 1 --2- 172.21.15.17:0/2922537499 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe63406e310 0x7fe6340707d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:44.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.619+0000 7fe653f0d640 1 --2- 172.21.15.17:0/2922537499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe64c100b20 0x7fe64c199ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:44.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.619+0000 7fe653f0d640 1 --2- 172.21.15.17:0/2922537499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe64c1001e0 0x7fe64c199660 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:44.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.619+0000 7fe653f0d640 1 -- 172.21.15.17:0/2922537499 >> 172.21.15.17:0/2922537499 conn(0x7fe64c0fc010 msgr2=0x7fe64c108a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:44.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.620+0000 7fe653f0d640 1 -- 172.21.15.17:0/2922537499 shutdown_connections 2024-09-20T18:32:44.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:44.620+0000 7fe653f0d640 1 -- 172.21.15.17:0/2922537499 wait complete. 2024-09-20T18:32:44.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:44 smithi172 ceph-mon[35456]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:32:45.297 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-20T18:32:45.555 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:45.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:45 smithi017 ceph-mon[28058]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:45.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:45 smithi172 ceph-mon[35456]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:45.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.981+0000 7f3ec54bb640 1 -- 172.21.15.17:0/153322107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec00fffe0 msgr2=0x7f3ec01003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:45.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.981+0000 7f3ec54bb640 1 --2- 172.21.15.17:0/153322107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec00fffe0 0x7f3ec01003e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009880 tx=0x7f3eb002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:45.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.981+0000 7f3ec54bb640 1 -- 172.21.15.17:0/153322107 shutdown_connections 2024-09-20T18:32:45.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.981+0000 7f3ec54bb640 1 --2- 172.21.15.17:0/153322107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec01011e0 0x7f3ec0101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:45.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.981+0000 7f3ec54bb640 1 --2- 172.21.15.17:0/153322107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec00fffe0 0x7f3ec01003e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:45.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.981+0000 7f3ec54bb640 1 -- 172.21.15.17:0/153322107 >> 172.21.15.17:0/153322107 conn(0x7f3ec00fb770 msgr2=0x7f3ec00fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:45.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.981+0000 7f3ec54bb640 1 -- 172.21.15.17:0/153322107 shutdown_connections 2024-09-20T18:32:45.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.982+0000 7f3ec54bb640 1 -- 172.21.15.17:0/153322107 wait complete. 2024-09-20T18:32:45.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.982+0000 7f3ec54bb640 1 Processor -- start 2024-09-20T18:32:45.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.982+0000 7f3ec54bb640 1 -- start start 2024-09-20T18:32:45.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.982+0000 7f3ec54bb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec00fffe0 0x7f3ec0103f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.982+0000 7f3ec54bb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec01011e0 0x7f3ec01025c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.982+0000 7f3ec54bb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec01096a0 con 0x7f3ec00fffe0 2024-09-20T18:32:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.982+0000 7f3ec54bb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec0109520 con 0x7f3ec01011e0 2024-09-20T18:32:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.982+0000 7f3ebeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec00fffe0 0x7f3ec0103f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.982+0000 7f3ebeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec00fffe0 0x7f3ec0103f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59202/0 (socket says 172.21.15.17:59202) 2024-09-20T18:32:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.982+0000 7f3ebeffd640 1 -- 172.21.15.17:0/3405260261 learned_addr learned my addr 172.21.15.17:0/3405260261 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.983+0000 7f3eb7fff640 1 --2- 172.21.15.17:0/3405260261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec01011e0 0x7f3ec01025c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.983+0000 7f3ebeffd640 1 -- 172.21.15.17:0/3405260261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec01011e0 msgr2=0x7f3ec01025c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.983+0000 7f3ebeffd640 1 --2- 172.21.15.17:0/3405260261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec01011e0 0x7f3ec01025c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.983+0000 7f3ebeffd640 1 -- 172.21.15.17:0/3405260261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec0102b00 con 0x7f3ec00fffe0 2024-09-20T18:32:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.983+0000 7f3eb7fff640 1 --2- 172.21.15.17:0/3405260261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec01011e0 0x7f3ec01025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:32:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.983+0000 7f3ebeffd640 1 --2- 172.21.15.17:0/3405260261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec00fffe0 0x7f3ec0103f00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0006010 tx=0x7f3eb00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:45.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.983+0000 7f3ebcff9640 1 -- 172.21.15.17:0/3405260261 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3eb003f070 con 0x7f3ec00fffe0 2024-09-20T18:32:45.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.983+0000 7f3ebcff9640 1 -- 172.21.15.17:0/3405260261 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3eb0004a50 con 0x7f3ec00fffe0 2024-09-20T18:32:45.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.983+0000 7f3ec54bb640 1 -- 172.21.15.17:0/3405260261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec0102d90 con 0x7f3ec00fffe0 2024-09-20T18:32:45.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.983+0000 7f3ebcff9640 1 -- 172.21.15.17:0/3405260261 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3eb0035030 con 0x7f3ec00fffe0 2024-09-20T18:32:45.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.983+0000 7f3ec54bb640 1 -- 172.21.15.17:0/3405260261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec01032c0 con 0x7f3ec00fffe0 2024-09-20T18:32:46.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.984+0000 7f3ec54bb640 1 -- 172.21.15.17:0/3405260261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec01003e0 con 0x7f3ec00fffe0 2024-09-20T18:32:46.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.985+0000 7f3ebcff9640 1 -- 172.21.15.17:0/3405260261 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f3eb0042070 con 0x7f3ec00fffe0 2024-09-20T18:32:46.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.985+0000 7f3ebcff9640 1 --2- 172.21.15.17:0/3405260261 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3eac06e310 0x7f3eac0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:46.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.985+0000 7f3ebcff9640 1 -- 172.21.15.17:0/3405260261 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f3eb00ae920 con 0x7f3ec00fffe0 2024-09-20T18:32:46.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.985+0000 7f3eb7fff640 1 --2- 172.21.15.17:0/3405260261 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3eac06e310 0x7f3eac0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:46.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.986+0000 7f3eb7fff640 1 --2- 172.21.15.17:0/3405260261 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3eac06e310 0x7f3eac0707d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80058c0 tx=0x7f3ea8005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:46.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:45.990+0000 7f3ebcff9640 1 -- 172.21.15.17:0/3405260261 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3eb0004c00 con 0x7f3ec00fffe0 2024-09-20T18:32:46.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:46.170+0000 7f3ec54bb640 1 -- 172.21.15.17:0/3405260261 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f3ec0062630 con 0x7f3eac06e310 2024-09-20T18:32:46.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:46.171+0000 7f3ebcff9640 1 -- 172.21.15.17:0/3405260261 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+399 (secure 0 0 0) 0x7f3ec0062630 con 0x7f3eac06e310 2024-09-20T18:32:46.185 INFO:teuthology.orchestra.run.smithi017.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-20T18:32:46.185 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7473003Q480DGN 447G No 119s ago Has a FileSystem, LVM detected 2024-09-20T18:32:46.185 INFO:teuthology.orchestra.run.smithi017.stdout:smithi172 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005M400BGN 372G No 43s ago Has a FileSystem, LVM detected 2024-09-20T18:32:46.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:46.174+0000 7f3ec54bb640 1 -- 172.21.15.17:0/3405260261 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3eac06e310 msgr2=0x7f3eac0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:46.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:46.174+0000 7f3ec54bb640 1 --2- 172.21.15.17:0/3405260261 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3eac06e310 0x7f3eac0707d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80058c0 tx=0x7f3ea8005850 comp rx=0 tx=0).stop 2024-09-20T18:32:46.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:46.174+0000 7f3ec54bb640 1 -- 172.21.15.17:0/3405260261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec00fffe0 msgr2=0x7f3ec0103f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:46.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:46.174+0000 7f3ec54bb640 1 --2- 172.21.15.17:0/3405260261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec00fffe0 0x7f3ec0103f00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0006010 tx=0x7f3eb00045e0 comp rx=0 tx=0).stop 2024-09-20T18:32:46.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:46.174+0000 7f3ec54bb640 1 -- 172.21.15.17:0/3405260261 shutdown_connections 2024-09-20T18:32:46.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:46.174+0000 7f3ec54bb640 1 --2- 172.21.15.17:0/3405260261 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f3eac06e310 0x7f3eac0707d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:46.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:46.174+0000 7f3ec54bb640 1 --2- 172.21.15.17:0/3405260261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec01011e0 0x7f3ec01025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:46.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:46.174+0000 7f3ec54bb640 1 --2- 172.21.15.17:0/3405260261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec00fffe0 0x7f3ec0103f00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:46.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:46.174+0000 7f3ec54bb640 1 -- 172.21.15.17:0/3405260261 >> 172.21.15.17:0/3405260261 conn(0x7f3ec00fb770 msgr2=0x7f3ec01068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:46.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:46.174+0000 7f3ec54bb640 1 -- 172.21.15.17:0/3405260261 shutdown_connections 2024-09-20T18:32:46.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:46.174+0000 7f3ec54bb640 1 -- 172.21.15.17:0/3405260261 wait complete. 2024-09-20T18:32:46.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:46 smithi017 ceph-mon[28058]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:32:46.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:46 smithi172 ceph-mon[35456]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:32:46.828 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T18:32:46.837 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-20T18:32:46.837 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-20T18:32:47.094 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:47.529 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:47 smithi017 ceph-mon[28058]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:47.529 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:47 smithi017 ceph-mon[28058]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:32:47.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:47 smithi172 ceph-mon[35456]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:47.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:47 smithi172 ceph-mon[35456]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:32:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.602+0000 7f4a2bf45640 1 -- 172.21.15.17:0/1178873592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24100860 msgr2=0x7f4a24100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.602+0000 7f4a2bf45640 1 --2- 172.21.15.17:0/1178873592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24100860 0x7f4a24100c60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009880 tx=0x7f4a2002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.603+0000 7f4a2bf45640 1 -- 172.21.15.17:0/1178873592 shutdown_connections 2024-09-20T18:32:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.603+0000 7f4a2bf45640 1 --2- 172.21.15.17:0/1178873592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a24101a60 0x7f4a24101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.603+0000 7f4a2bf45640 1 --2- 172.21.15.17:0/1178873592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24100860 0x7f4a24100c60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.603+0000 7f4a2bf45640 1 -- 172.21.15.17:0/1178873592 >> 172.21.15.17:0/1178873592 conn(0x7f4a240fc010 msgr2=0x7f4a240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.603+0000 7f4a2bf45640 1 -- 172.21.15.17:0/1178873592 shutdown_connections 2024-09-20T18:32:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.603+0000 7f4a2bf45640 1 -- 172.21.15.17:0/1178873592 wait complete. 2024-09-20T18:32:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.603+0000 7f4a2bf45640 1 Processor -- start 2024-09-20T18:32:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.603+0000 7f4a2bf45640 1 -- start start 2024-09-20T18:32:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.603+0000 7f4a2bf45640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a24100860 0x7f4a241974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.603+0000 7f4a2bf45640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24101a60 0x7f4a24197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.603+0000 7f4a2bf45640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4a241096a0 con 0x7f4a24101a60 2024-09-20T18:32:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.603+0000 7f4a2bf45640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4a24109520 con 0x7f4a24100860 2024-09-20T18:32:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.604+0000 7f4a294e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24101a60 0x7f4a24197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.604+0000 7f4a294e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24101a60 0x7f4a24197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59218/0 (socket says 172.21.15.17:59218) 2024-09-20T18:32:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.604+0000 7f4a294e0640 1 -- 172.21.15.17:0/3307829935 learned_addr learned my addr 172.21.15.17:0/3307829935 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.604+0000 7f4a29ce1640 1 --2- 172.21.15.17:0/3307829935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a24100860 0x7f4a241974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.604+0000 7f4a294e0640 1 -- 172.21.15.17:0/3307829935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a24100860 msgr2=0x7f4a241974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.604+0000 7f4a294e0640 1 --2- 172.21.15.17:0/3307829935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a24100860 0x7f4a241974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.604+0000 7f4a294e0640 1 -- 172.21.15.17:0/3307829935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a241980a0 con 0x7f4a24101a60 2024-09-20T18:32:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.604+0000 7f4a294e0640 1 --2- 172.21.15.17:0/3307829935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24101a60 0x7f4a24197a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400d6f0 tx=0x7f4a1400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.604+0000 7f4a1affd640 1 -- 172.21.15.17:0/3307829935 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a14017070 con 0x7f4a24101a60 2024-09-20T18:32:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.604+0000 7f4a1affd640 1 -- 172.21.15.17:0/3307829935 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4a1400de00 con 0x7f4a24101a60 2024-09-20T18:32:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.604+0000 7f4a2bf45640 1 -- 172.21.15.17:0/3307829935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a2419cae0 con 0x7f4a24101a60 2024-09-20T18:32:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.604+0000 7f4a1affd640 1 -- 172.21.15.17:0/3307829935 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a14004bb0 con 0x7f4a24101a60 2024-09-20T18:32:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.604+0000 7f4a2bf45640 1 -- 172.21.15.17:0/3307829935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a2419d070 con 0x7f4a24101a60 2024-09-20T18:32:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.605+0000 7f4a2bf45640 1 -- 172.21.15.17:0/3307829935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a24100c60 con 0x7f4a24101a60 2024-09-20T18:32:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.606+0000 7f4a1affd640 1 -- 172.21.15.17:0/3307829935 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f4a14009a30 con 0x7f4a24101a60 2024-09-20T18:32:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.606+0000 7f4a1affd640 1 --2- 172.21.15.17:0/3307829935 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f4a1006e310 0x7f4a100707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.606+0000 7f4a1affd640 1 -- 172.21.15.17:0/3307829935 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f4a1408d8d0 con 0x7f4a24101a60 2024-09-20T18:32:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.606+0000 7f4a29ce1640 1 --2- 172.21.15.17:0/3307829935 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f4a1006e310 0x7f4a100707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.607+0000 7f4a29ce1640 1 --2- 172.21.15.17:0/3307829935 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f4a1006e310 0x7f4a100707d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009230 tx=0x7f4a200058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.611+0000 7f4a1affd640 1 -- 172.21.15.17:0/3307829935 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4a1405f2a0 con 0x7f4a24101a60 2024-09-20T18:32:47.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:47.810+0000 7f4a2bf45640 1 -- 172.21.15.17:0/3307829935 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) -- 0x7f4a2406a3e0 con 0x7f4a1006e310 2024-09-20T18:32:48.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:48 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-20T18:32:48.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:48 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-20T18:32:49.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:49.329+0000 7f4a1affd640 1 -- 172.21.15.17:0/3307829935 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4a2406a3e0 con 0x7f4a1006e310 2024-09-20T18:32:49.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:49.332+0000 7f4a2bf45640 1 -- 172.21.15.17:0/3307829935 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f4a1006e310 msgr2=0x7f4a100707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:49.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:49.332+0000 7f4a2bf45640 1 --2- 172.21.15.17:0/3307829935 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f4a1006e310 0x7f4a100707d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009230 tx=0x7f4a200058d0 comp rx=0 tx=0).stop 2024-09-20T18:32:49.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:49.332+0000 7f4a2bf45640 1 -- 172.21.15.17:0/3307829935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24101a60 msgr2=0x7f4a24197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:49.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:49.332+0000 7f4a2bf45640 1 --2- 172.21.15.17:0/3307829935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24101a60 0x7f4a24197a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400d6f0 tx=0x7f4a1400dbb0 comp rx=0 tx=0).stop 2024-09-20T18:32:49.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:49.332+0000 7f4a2bf45640 1 -- 172.21.15.17:0/3307829935 shutdown_connections 2024-09-20T18:32:49.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:49.332+0000 7f4a2bf45640 1 --2- 172.21.15.17:0/3307829935 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f4a1006e310 0x7f4a100707d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:49.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:49.332+0000 7f4a2bf45640 1 --2- 172.21.15.17:0/3307829935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24101a60 0x7f4a24197a20 secure :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400d6f0 tx=0x7f4a1400dbb0 comp rx=0 tx=0).stop 2024-09-20T18:32:49.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:49.332+0000 7f4a2bf45640 1 --2- 172.21.15.17:0/3307829935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a24100860 0x7f4a241974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:49.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:49.332+0000 7f4a2bf45640 1 -- 172.21.15.17:0/3307829935 >> 172.21.15.17:0/3307829935 conn(0x7f4a240fc010 msgr2=0x7f4a24069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:49.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:49.333+0000 7f4a2bf45640 1 -- 172.21.15.17:0/3307829935 shutdown_connections 2024-09-20T18:32:49.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:49.333+0000 7f4a2bf45640 1 -- 172.21.15.17:0/3307829935 wait complete. 2024-09-20T18:32:49.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:49 smithi017 ceph-mon[28058]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:49.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:49 smithi017 ceph-mon[28058]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:32:49.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:49 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-20T18:32:49.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:49 smithi017 ceph-mon[28058]: osdmap e40: 6 total, 6 up, 6 in 2024-09-20T18:32:49.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:49 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-20T18:32:49.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:49 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[28054]: 2024-09-20T18:32:49.312+0000 7ffbcf6e7640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-20T18:32:49.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:49 smithi172 ceph-mon[35456]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:49.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:49 smithi172 ceph-mon[35456]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:32:49.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:49 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-20T18:32:49.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:49 smithi172 ceph-mon[35456]: osdmap e40: 6 total, 6 up, 6 in 2024-09-20T18:32:49.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:49 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-20T18:32:50.024 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-20T18:32:50.610 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-20T18:32:50.610 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: osdmap e41: 6 total, 6 up, 6 in 2024-09-20T18:32:50.610 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-20T18:32:50.610 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-20T18:32:50.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-20T18:32:50.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-20T18:32:50.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: osdmap e42: 6 total, 6 up, 6 in 2024-09-20T18:32:50.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: fsmap cephfs:0 2024-09-20T18:32:50.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: Saving service mds.cephfs spec with placement count:4 2024-09-20T18:32:50.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:50.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:32:50.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:32:50.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:32:50.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:50.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.puqizo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-20T18:32:50.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.puqizo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-20T18:32:50.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:32:50.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:50 smithi172 ceph-mon[35456]: Deploying daemon mds.cephfs.smithi017.puqizo on smithi017 2024-09-20T18:32:50.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-20T18:32:50.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: osdmap e41: 6 total, 6 up, 6 in 2024-09-20T18:32:50.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-20T18:32:50.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-20T18:32:50.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-20T18:32:50.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-20T18:32:50.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: osdmap e42: 6 total, 6 up, 6 in 2024-09-20T18:32:50.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: fsmap cephfs:0 2024-09-20T18:32:50.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: Saving service mds.cephfs spec with placement count:4 2024-09-20T18:32:50.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:50.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:32:50.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:32:50.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:32:50.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:50.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.puqizo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-20T18:32:50.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.puqizo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-20T18:32:50.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:32:50.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:50 smithi017 ceph-mon[28058]: Deploying daemon mds.cephfs.smithi017.puqizo on smithi017 2024-09-20T18:32:50.772 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:51.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:51 smithi017 ceph-mon[28058]: pgmap v171: 65 pgs: 64 unknown, 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:51.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:51 smithi017 ceph-mon[28058]: osdmap e43: 6 total, 6 up, 6 in 2024-09-20T18:32:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.612+0000 7f5c57ac7640 1 -- 172.21.15.17:0/621642741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c501023f0 msgr2=0x7f5c501047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.612+0000 7f5c57ac7640 1 --2- 172.21.15.17:0/621642741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c501023f0 0x7f5c501047e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0098b0 tx=0x7f5c4c02a4d0 comp rx=0 tx=0).stop 2024-09-20T18:32:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.613+0000 7f5c57ac7640 1 -- 172.21.15.17:0/621642741 shutdown_connections 2024-09-20T18:32:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.613+0000 7f5c57ac7640 1 --2- 172.21.15.17:0/621642741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c50104d20 0x7f5c50107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.613+0000 7f5c57ac7640 1 --2- 172.21.15.17:0/621642741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c501023f0 0x7f5c501047e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.613+0000 7f5c57ac7640 1 -- 172.21.15.17:0/621642741 >> 172.21.15.17:0/621642741 conn(0x7f5c500fc010 msgr2=0x7f5c500fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.613+0000 7f5c57ac7640 1 -- 172.21.15.17:0/621642741 shutdown_connections 2024-09-20T18:32:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.613+0000 7f5c57ac7640 1 -- 172.21.15.17:0/621642741 wait complete. 2024-09-20T18:32:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.613+0000 7f5c57ac7640 1 Processor -- start 2024-09-20T18:32:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.613+0000 7f5c57ac7640 1 -- start start 2024-09-20T18:32:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.613+0000 7f5c57ac7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c501023f0 0x7f5c50199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.613+0000 7f5c57ac7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c50104d20 0x7f5c50199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.613+0000 7f5c57ac7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5010a830 con 0x7f5c50104d20 2024-09-20T18:32:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.613+0000 7f5c57ac7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5010a6b0 con 0x7f5c501023f0 2024-09-20T18:32:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.614+0000 7f5c55062640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c50104d20 0x7f5c50199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.614+0000 7f5c55062640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c50104d20 0x7f5c50199c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39148/0 (socket says 172.21.15.17:39148) 2024-09-20T18:32:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.614+0000 7f5c55062640 1 -- 172.21.15.17:0/2822376211 learned_addr learned my addr 172.21.15.17:0/2822376211 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.614+0000 7f5c55863640 1 --2- 172.21.15.17:0/2822376211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c501023f0 0x7f5c50199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.614+0000 7f5c55062640 1 -- 172.21.15.17:0/2822376211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c501023f0 msgr2=0x7f5c50199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.614+0000 7f5c55062640 1 --2- 172.21.15.17:0/2822376211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c501023f0 0x7f5c50199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.614+0000 7f5c55062640 1 -- 172.21.15.17:0/2822376211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5019a310 con 0x7f5c50104d20 2024-09-20T18:32:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.614+0000 7f5c55863640 1 --2- 172.21.15.17:0/2822376211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c501023f0 0x7f5c50199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:32:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.614+0000 7f5c55062640 1 --2- 172.21.15.17:0/2822376211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c50104d20 0x7f5c50199c90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000b3d0 tx=0x7f5c4000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.614+0000 7f5c46ffd640 1 -- 172.21.15.17:0/2822376211 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c40015020 con 0x7f5c50104d20 2024-09-20T18:32:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.614+0000 7f5c57ac7640 1 -- 172.21.15.17:0/2822376211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c5019ed50 con 0x7f5c50104d20 2024-09-20T18:32:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.614+0000 7f5c46ffd640 1 -- 172.21.15.17:0/2822376211 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c40011af0 con 0x7f5c50104d20 2024-09-20T18:32:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.614+0000 7f5c46ffd640 1 -- 172.21.15.17:0/2822376211 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c40010d30 con 0x7f5c50104d20 2024-09-20T18:32:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.614+0000 7f5c57ac7640 1 -- 172.21.15.17:0/2822376211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c5019f330 con 0x7f5c50104d20 2024-09-20T18:32:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.615+0000 7f5c57ac7640 1 -- 172.21.15.17:0/2822376211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c501027d0 con 0x7f5c50104d20 2024-09-20T18:32:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.616+0000 7f5c46ffd640 1 -- 172.21.15.17:0/2822376211 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5c40018020 con 0x7f5c50104d20 2024-09-20T18:32:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.616+0000 7f5c46ffd640 1 --2- 172.21.15.17:0/2822376211 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5c3c06e2b0 0x7f5c3c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.616+0000 7f5c46ffd640 1 -- 172.21.15.17:0/2822376211 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f5c4008dc70 con 0x7f5c50104d20 2024-09-20T18:32:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.616+0000 7f5c55863640 1 --2- 172.21.15.17:0/2822376211 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5c3c06e2b0 0x7f5c3c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.617+0000 7f5c55863640 1 --2- 172.21.15.17:0/2822376211 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5c3c06e2b0 0x7f5c3c070770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c000c00 tx=0x7f5c4c005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.621+0000 7f5c46ffd640 1 -- 172.21.15.17:0/2822376211 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5c4001f020 con 0x7f5c50104d20 2024-09-20T18:32:51.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:51 smithi172 ceph-mon[35456]: pgmap v171: 65 pgs: 64 unknown, 1 active+clean; 577 KiB data, 203 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:51.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:51 smithi172 ceph-mon[35456]: osdmap e43: 6 total, 6 up, 6 in 2024-09-20T18:32:51.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.846+0000 7f5c57ac7640 1 -- 172.21.15.17:0/2822376211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5c50062df0 con 0x7f5c50104d20 2024-09-20T18:32:51.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.846+0000 7f5c46ffd640 1 -- 172.21.15.17:0/2822376211 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) ==== 75+0+1272 (secure 0 0 0) 0x7f5c4005b5d0 con 0x7f5c50104d20 2024-09-20T18:32:51.860 INFO:teuthology.orchestra.run.smithi017.stdout:e2 2024-09-20T18:32:51.860 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:32:49:312900+0000 2024-09-20T18:32:51.861 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:32:51.861 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:32:51.861 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:32:51.861 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:32:51.861 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:32:51.861 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:32:51.861 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 2 2024-09-20T18:32:51.861 INFO:teuthology.orchestra.run.smithi017.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-20T18:32:51.861 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:32:51.861 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:32:49.312742+0000 2024-09-20T18:32:51.861 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:32:51.861 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:32:51.861 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:32:51.861 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:32:51.861 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:32:51.862 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:32:51.862 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:32:51.862 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:32:51.862 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2024-09-20T18:32:51.862 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:32:51.862 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 1 2024-09-20T18:32:51.862 INFO:teuthology.orchestra.run.smithi017.stdout:in 2024-09-20T18:32:51.862 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:32:51.862 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-09-20T18:32:51.862 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:32:51.862 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:32:51.862 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:32:51.862 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:32:51.862 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data disabled 2024-09-20T18:32:51.862 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:32:51.862 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:32:51.863 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 0 2024-09-20T18:32:51.863 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:32:51.863 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:32:51.863 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:32:51.863 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 2 2024-09-20T18:32:51.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.849+0000 7f5c57ac7640 1 -- 172.21.15.17:0/2822376211 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5c3c06e2b0 msgr2=0x7f5c3c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:51.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.849+0000 7f5c57ac7640 1 --2- 172.21.15.17:0/2822376211 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5c3c06e2b0 0x7f5c3c070770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c000c00 tx=0x7f5c4c005a20 comp rx=0 tx=0).stop 2024-09-20T18:32:51.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.849+0000 7f5c57ac7640 1 -- 172.21.15.17:0/2822376211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c50104d20 msgr2=0x7f5c50199c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:51.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.849+0000 7f5c57ac7640 1 --2- 172.21.15.17:0/2822376211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c50104d20 0x7f5c50199c90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000b3d0 tx=0x7f5c4000b890 comp rx=0 tx=0).stop 2024-09-20T18:32:51.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.849+0000 7f5c57ac7640 1 -- 172.21.15.17:0/2822376211 shutdown_connections 2024-09-20T18:32:51.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.849+0000 7f5c57ac7640 1 --2- 172.21.15.17:0/2822376211 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5c3c06e2b0 0x7f5c3c070770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:51.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.849+0000 7f5c57ac7640 1 --2- 172.21.15.17:0/2822376211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c50104d20 0x7f5c50199c90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:51.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.849+0000 7f5c57ac7640 1 --2- 172.21.15.17:0/2822376211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c501023f0 0x7f5c50199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:51.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.849+0000 7f5c57ac7640 1 -- 172.21.15.17:0/2822376211 >> 172.21.15.17:0/2822376211 conn(0x7f5c500fc010 msgr2=0x7f5c50101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:51.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.850+0000 7f5c57ac7640 1 -- 172.21.15.17:0/2822376211 shutdown_connections 2024-09-20T18:32:51.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:51.850+0000 7f5c57ac7640 1 -- 172.21.15.17:0/2822376211 wait complete. 2024-09-20T18:32:52.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:52 smithi017 ceph-mon[28058]: osdmap e44: 6 total, 6 up, 6 in 2024-09-20T18:32:52.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:52 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2822376211' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-20T18:32:52.477 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T18:32:52.486 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-20T18:32:52.487 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-20T18:32:52.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:52 smithi172 ceph-mon[35456]: osdmap e44: 6 total, 6 up, 6 in 2024-09-20T18:32:52.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:52 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/2822376211' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-20T18:32:53.033 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:53.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.463+0000 7fd801a6b640 1 -- 172.21.15.17:0/737460018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7fc101960 msgr2=0x7fd7fc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:53.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.463+0000 7fd801a6b640 1 --2- 172.21.15.17:0/737460018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7fc101960 0x7fd7fc101d60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009880 tx=0x7fd7ec02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:53.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.463+0000 7fd801a6b640 1 -- 172.21.15.17:0/737460018 shutdown_connections 2024-09-20T18:32:53.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.463+0000 7fd801a6b640 1 --2- 172.21.15.17:0/737460018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7fc102b60 0x7fd7fc102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:53.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.463+0000 7fd801a6b640 1 --2- 172.21.15.17:0/737460018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7fc101960 0x7fd7fc101d60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:53.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.463+0000 7fd801a6b640 1 -- 172.21.15.17:0/737460018 >> 172.21.15.17:0/737460018 conn(0x7fd7fc0fd0f0 msgr2=0x7fd7fc0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:53.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.463+0000 7fd801a6b640 1 -- 172.21.15.17:0/737460018 shutdown_connections 2024-09-20T18:32:53.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.463+0000 7fd801a6b640 1 -- 172.21.15.17:0/737460018 wait complete. 2024-09-20T18:32:53.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.464+0000 7fd801a6b640 1 Processor -- start 2024-09-20T18:32:53.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.464+0000 7fd801a6b640 1 -- start start 2024-09-20T18:32:53.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.464+0000 7fd801a6b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7fc101960 0x7fd7fc1974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:53.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.464+0000 7fd801a6b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7fc102b60 0x7fd7fc197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:53.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.464+0000 7fd801a6b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc10a7a0 con 0x7fd7fc101960 2024-09-20T18:32:53.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.464+0000 7fd801a6b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc10a620 con 0x7fd7fc102b60 2024-09-20T18:32:53.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.464+0000 7fd7fb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7fc101960 0x7fd7fc1974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:53.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.464+0000 7fd7fb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7fc101960 0x7fd7fc1974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39180/0 (socket says 172.21.15.17:39180) 2024-09-20T18:32:53.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.464+0000 7fd7fb7fe640 1 -- 172.21.15.17:0/4141144110 learned_addr learned my addr 172.21.15.17:0/4141144110 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:53.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.464+0000 7fd7faffd640 1 --2- 172.21.15.17:0/4141144110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7fc102b60 0x7fd7fc197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:53.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.465+0000 7fd7fb7fe640 1 -- 172.21.15.17:0/4141144110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7fc102b60 msgr2=0x7fd7fc197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:53.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.465+0000 7fd7fb7fe640 1 --2- 172.21.15.17:0/4141144110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7fc102b60 0x7fd7fc197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:53.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.465+0000 7fd7fb7fe640 1 -- 172.21.15.17:0/4141144110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7fc198090 con 0x7fd7fc101960 2024-09-20T18:32:53.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.465+0000 7fd7fb7fe640 1 --2- 172.21.15.17:0/4141144110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7fc101960 0x7fd7fc1974d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec006010 tx=0x7fd7ec0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:53.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.465+0000 7fd7f8ff9640 1 -- 172.21.15.17:0/4141144110 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7ec03f070 con 0x7fd7fc101960 2024-09-20T18:32:53.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.465+0000 7fd7f8ff9640 1 -- 172.21.15.17:0/4141144110 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd7ec0049d0 con 0x7fd7fc101960 2024-09-20T18:32:53.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.465+0000 7fd801a6b640 1 -- 172.21.15.17:0/4141144110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7fc19ca70 con 0x7fd7fc101960 2024-09-20T18:32:53.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.465+0000 7fd7f8ff9640 1 -- 172.21.15.17:0/4141144110 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7ec035030 con 0x7fd7fc101960 2024-09-20T18:32:53.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.465+0000 7fd801a6b640 1 -- 172.21.15.17:0/4141144110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7fc19d000 con 0x7fd7fc101960 2024-09-20T18:32:53.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.466+0000 7fd801a6b640 1 -- 172.21.15.17:0/4141144110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7fc101d60 con 0x7fd7fc101960 2024-09-20T18:32:53.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.467+0000 7fd7f8ff9640 1 -- 172.21.15.17:0/4141144110 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fd7ec042070 con 0x7fd7fc101960 2024-09-20T18:32:53.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.467+0000 7fd7f8ff9640 1 --2- 172.21.15.17:0/4141144110 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd7e406e2b0 0x7fd7e4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:53.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.467+0000 7fd7f8ff9640 1 -- 172.21.15.17:0/4141144110 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fd7ec0aec10 con 0x7fd7fc101960 2024-09-20T18:32:53.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.467+0000 7fd7faffd640 1 --2- 172.21.15.17:0/4141144110 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd7e406e2b0 0x7fd7e4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:53.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.468+0000 7fd7faffd640 1 --2- 172.21.15.17:0/4141144110 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd7e406e2b0 0x7fd7e4070770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc198980 tx=0x7fd7f0005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:53.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.472+0000 7fd7f8ff9640 1 -- 172.21.15.17:0/4141144110 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd7ec080220 con 0x7fd7fc101960 2024-09-20T18:32:53.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:53 smithi172 ceph-mon[35456]: pgmap v174: 65 pgs: 8 creating+peering, 27 unknown, 30 active+clean; 577 KiB data, 207 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:53.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:53.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:32:53.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:53.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:53.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:53.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.mugtlk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-20T18:32:53.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.mugtlk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-20T18:32:53.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:32:53.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:53 smithi017 ceph-mon[28058]: pgmap v174: 65 pgs: 8 creating+peering, 27 unknown, 30 active+clean; 577 KiB data, 207 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:53.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:53.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:32:53.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:53.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:53.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:53.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.mugtlk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-20T18:32:53.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.mugtlk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-20T18:32:53.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:32:53.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:53.694+0000 7fd801a6b640 1 -- 172.21.15.17:0/4141144110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) -- 0x7fd7fc062df0 con 0x7fd7fc101960 2024-09-20T18:32:54.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:54.538+0000 7fd7f8ff9640 1 -- 172.21.15.17:0/4141144110 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v5) ==== 105+0+0 (secure 0 0 0) 0x7fd7ec084a50 con 0x7fd7fc101960 2024-09-20T18:32:54.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:54.540+0000 7fd801a6b640 1 -- 172.21.15.17:0/4141144110 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd7e406e2b0 msgr2=0x7fd7e4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:54.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:54.540+0000 7fd801a6b640 1 --2- 172.21.15.17:0/4141144110 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd7e406e2b0 0x7fd7e4070770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc198980 tx=0x7fd7f0005f90 comp rx=0 tx=0).stop 2024-09-20T18:32:54.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:54.540+0000 7fd801a6b640 1 -- 172.21.15.17:0/4141144110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7fc101960 msgr2=0x7fd7fc1974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:54.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:54.540+0000 7fd801a6b640 1 --2- 172.21.15.17:0/4141144110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7fc101960 0x7fd7fc1974d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec006010 tx=0x7fd7ec0045e0 comp rx=0 tx=0).stop 2024-09-20T18:32:54.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:54.540+0000 7fd801a6b640 1 -- 172.21.15.17:0/4141144110 shutdown_connections 2024-09-20T18:32:54.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:54.540+0000 7fd801a6b640 1 --2- 172.21.15.17:0/4141144110 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fd7e406e2b0 0x7fd7e4070770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:54.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:54.540+0000 7fd801a6b640 1 --2- 172.21.15.17:0/4141144110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7fc102b60 0x7fd7fc197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:54.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:54.540+0000 7fd801a6b640 1 --2- 172.21.15.17:0/4141144110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7fc101960 0x7fd7fc1974d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:54.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:54.540+0000 7fd801a6b640 1 -- 172.21.15.17:0/4141144110 >> 172.21.15.17:0/4141144110 conn(0x7fd7fc0fd0f0 msgr2=0x7fd7fc106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:54.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:54.540+0000 7fd801a6b640 1 -- 172.21.15.17:0/4141144110 shutdown_connections 2024-09-20T18:32:54.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:54.540+0000 7fd801a6b640 1 -- 172.21.15.17:0/4141144110 wait complete. 2024-09-20T18:32:54.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:54 smithi017 ceph-mon[28058]: Deploying daemon mds.cephfs.smithi172.mugtlk on smithi172 2024-09-20T18:32:54.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:54 smithi017 ceph-mon[28058]: mds.? [v2:172.21.15.17:6826/3360305779,v1:172.21.15.17:6827/3360305779] up:boot 2024-09-20T18:32:54.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:54 smithi017 ceph-mon[28058]: daemon mds.cephfs.smithi017.puqizo assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-20T18:32:54.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:54 smithi017 ceph-mon[28058]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-20T18:32:54.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:54 smithi017 ceph-mon[28058]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-20T18:32:54.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:54 smithi017 ceph-mon[28058]: Cluster is now healthy 2024-09-20T18:32:54.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:54 smithi017 ceph-mon[28058]: fsmap cephfs:0 1 up:standby 2024-09-20T18:32:54.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:54 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.puqizo"}]: dispatch 2024-09-20T18:32:54.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:54 smithi017 ceph-mon[28058]: fsmap cephfs:1 {0=cephfs.smithi017.puqizo=up:creating} 2024-09-20T18:32:54.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:54 smithi017 ceph-mon[28058]: daemon mds.cephfs.smithi017.puqizo is now active in filesystem cephfs as rank 0 2024-09-20T18:32:54.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:54 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/4141144110' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-20T18:32:54.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:54 smithi172 ceph-mon[35456]: Deploying daemon mds.cephfs.smithi172.mugtlk on smithi172 2024-09-20T18:32:54.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:54 smithi172 ceph-mon[35456]: mds.? [v2:172.21.15.17:6826/3360305779,v1:172.21.15.17:6827/3360305779] up:boot 2024-09-20T18:32:54.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:54 smithi172 ceph-mon[35456]: daemon mds.cephfs.smithi017.puqizo assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-20T18:32:54.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:54 smithi172 ceph-mon[35456]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-20T18:32:54.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:54 smithi172 ceph-mon[35456]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-20T18:32:54.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:54 smithi172 ceph-mon[35456]: Cluster is now healthy 2024-09-20T18:32:54.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:54 smithi172 ceph-mon[35456]: fsmap cephfs:0 1 up:standby 2024-09-20T18:32:54.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:54 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.puqizo"}]: dispatch 2024-09-20T18:32:54.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:54 smithi172 ceph-mon[35456]: fsmap cephfs:1 {0=cephfs.smithi017.puqizo=up:creating} 2024-09-20T18:32:54.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:54 smithi172 ceph-mon[35456]: daemon mds.cephfs.smithi017.puqizo is now active in filesystem cephfs as rank 0 2024-09-20T18:32:54.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:54 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/4141144110' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-20T18:32:55.211 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T18:32:55.225 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-20T18:32:55.226 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-20T18:32:55.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:55 smithi172 ceph-mon[35456]: pgmap v175: 65 pgs: 8 creating+peering, 57 active+clean; 577 KiB data, 207 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:55.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:55 smithi172 ceph-mon[35456]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-20T18:32:55.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:55 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/4141144110' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-20T18:32:55.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:55 smithi172 ceph-mon[35456]: mds.? [v2:172.21.15.17:6826/3360305779,v1:172.21.15.17:6827/3360305779] up:active 2024-09-20T18:32:55.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:55 smithi172 ceph-mon[35456]: fsmap cephfs:1 {0=cephfs.smithi017.puqizo=up:active} 2024-09-20T18:32:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:55.618 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:55 smithi017 ceph-mon[28058]: pgmap v175: 65 pgs: 8 creating+peering, 57 active+clean; 577 KiB data, 207 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:55.618 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:55 smithi017 ceph-mon[28058]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-20T18:32:55.618 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:55 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/4141144110' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-20T18:32:55.618 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:55 smithi017 ceph-mon[28058]: mds.? [v2:172.21.15.17:6826/3360305779,v1:172.21.15.17:6827/3360305779] up:active 2024-09-20T18:32:55.618 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:55 smithi017 ceph-mon[28058]: fsmap cephfs:1 {0=cephfs.smithi017.puqizo=up:active} 2024-09-20T18:32:56.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.961+0000 7f366169e640 1 -- 172.21.15.17:0/1247373010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f365c102c00 msgr2=0x7f365c103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:56.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.961+0000 7f366169e640 1 --2- 172.21.15.17:0/1247373010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f365c102c00 0x7f365c103080 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3650009880 tx=0x7f365002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:32:56.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.961+0000 7f366169e640 1 -- 172.21.15.17:0/1247373010 shutdown_connections 2024-09-20T18:32:56.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.961+0000 7f366169e640 1 --2- 172.21.15.17:0/1247373010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f365c102c00 0x7f365c103080 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:56.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.961+0000 7f366169e640 1 --2- 172.21.15.17:0/1247373010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f365c0ffc20 0x7f365c100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:56.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.961+0000 7f366169e640 1 -- 172.21.15.17:0/1247373010 >> 172.21.15.17:0/1247373010 conn(0x7f365c0fb770 msgr2=0x7f365c0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:56.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.961+0000 7f366169e640 1 -- 172.21.15.17:0/1247373010 shutdown_connections 2024-09-20T18:32:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.961+0000 7f366169e640 1 -- 172.21.15.17:0/1247373010 wait complete. 2024-09-20T18:32:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.962+0000 7f366169e640 1 Processor -- start 2024-09-20T18:32:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.962+0000 7f366169e640 1 -- start start 2024-09-20T18:32:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.962+0000 7f366169e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f365c0ffc20 0x7f365c1974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.962+0000 7f366169e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f365c102c00 0x7f365c1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.962+0000 7f366169e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f365c10a780 con 0x7f365c0ffc20 2024-09-20T18:32:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.962+0000 7f366169e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f365c10a600 con 0x7f365c102c00 2024-09-20T18:32:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.962+0000 7f365affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f365c0ffc20 0x7f365c1974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.962+0000 7f365affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f365c0ffc20 0x7f365c1974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39198/0 (socket says 172.21.15.17:39198) 2024-09-20T18:32:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.962+0000 7f365affd640 1 -- 172.21.15.17:0/154626747 learned_addr learned my addr 172.21.15.17:0/154626747 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.963+0000 7f365a7fc640 1 --2- 172.21.15.17:0/154626747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f365c102c00 0x7f365c1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.963+0000 7f365affd640 1 -- 172.21.15.17:0/154626747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f365c102c00 msgr2=0x7f365c1979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.963+0000 7f365affd640 1 --2- 172.21.15.17:0/154626747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f365c102c00 0x7f365c1979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.963+0000 7f365affd640 1 -- 172.21.15.17:0/154626747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c198060 con 0x7f365c0ffc20 2024-09-20T18:32:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.963+0000 7f365affd640 1 --2- 172.21.15.17:0/154626747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f365c0ffc20 0x7f365c1974a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f364c00d6f0 tx=0x7f364c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.963+0000 7f3643fff640 1 -- 172.21.15.17:0/154626747 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f364c017070 con 0x7f365c0ffc20 2024-09-20T18:32:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.963+0000 7f366169e640 1 -- 172.21.15.17:0/154626747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f365c19caa0 con 0x7f365c0ffc20 2024-09-20T18:32:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.963+0000 7f3643fff640 1 -- 172.21.15.17:0/154626747 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f364c00de00 con 0x7f365c0ffc20 2024-09-20T18:32:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.963+0000 7f3643fff640 1 -- 172.21.15.17:0/154626747 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f364c003bc0 con 0x7f365c0ffc20 2024-09-20T18:32:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.963+0000 7f366169e640 1 -- 172.21.15.17:0/154626747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f365c19d030 con 0x7f365c0ffc20 2024-09-20T18:32:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.964+0000 7f366169e640 1 -- 172.21.15.17:0/154626747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f365c100020 con 0x7f365c0ffc20 2024-09-20T18:32:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.965+0000 7f3643fff640 1 -- 172.21.15.17:0/154626747 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f364c003e70 con 0x7f365c0ffc20 2024-09-20T18:32:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.965+0000 7f3643fff640 1 --2- 172.21.15.17:0/154626747 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f364406e2b0 0x7f3644070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.965+0000 7f3643fff640 1 -- 172.21.15.17:0/154626747 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f364c08dd60 con 0x7f365c0ffc20 2024-09-20T18:32:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.965+0000 7f365a7fc640 1 --2- 172.21.15.17:0/154626747 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f364406e2b0 0x7f3644070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:56.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.966+0000 7f365a7fc640 1 --2- 172.21.15.17:0/154626747 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f364406e2b0 0x7f3644070770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f365c198950 tx=0x7f3650005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:56.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:55.970+0000 7f3643fff640 1 -- 172.21.15.17:0/154626747 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f364c05b6c0 con 0x7f365c0ffc20 2024-09-20T18:32:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:56.196+0000 7f366169e640 1 -- 172.21.15.17:0/154626747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f365c19d8f0 con 0x7f365c0ffc20 2024-09-20T18:32:56.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:56.335+0000 7f3643fff640 1 -- 172.21.15.17:0/154626747 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v6) ==== 121+0+0 (secure 0 0 0) 0x7f364c05f370 con 0x7f365c0ffc20 2024-09-20T18:32:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:56.338+0000 7f366169e640 1 -- 172.21.15.17:0/154626747 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f364406e2b0 msgr2=0x7f3644070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:56.338+0000 7f366169e640 1 --2- 172.21.15.17:0/154626747 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f364406e2b0 0x7f3644070770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f365c198950 tx=0x7f3650005a20 comp rx=0 tx=0).stop 2024-09-20T18:32:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:56.338+0000 7f366169e640 1 -- 172.21.15.17:0/154626747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f365c0ffc20 msgr2=0x7f365c1974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:56.338+0000 7f366169e640 1 --2- 172.21.15.17:0/154626747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f365c0ffc20 0x7f365c1974a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f364c00d6f0 tx=0x7f364c00dbb0 comp rx=0 tx=0).stop 2024-09-20T18:32:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:56.338+0000 7f366169e640 1 -- 172.21.15.17:0/154626747 shutdown_connections 2024-09-20T18:32:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:56.338+0000 7f366169e640 1 --2- 172.21.15.17:0/154626747 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f364406e2b0 0x7f3644070770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:56.338+0000 7f366169e640 1 --2- 172.21.15.17:0/154626747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f365c102c00 0x7f365c1979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:56.338+0000 7f366169e640 1 --2- 172.21.15.17:0/154626747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f365c0ffc20 0x7f365c1974a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:56.338+0000 7f366169e640 1 -- 172.21.15.17:0/154626747 >> 172.21.15.17:0/154626747 conn(0x7f365c0fb770 msgr2=0x7f365c0fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:56.338+0000 7f366169e640 1 -- 172.21.15.17:0/154626747 shutdown_connections 2024-09-20T18:32:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:56.338+0000 7f366169e640 1 -- 172.21.15.17:0/154626747 wait complete. 2024-09-20T18:32:56.750 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:56 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:56.750 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:56 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:56.750 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:56 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:56.750 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:56 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.xhlvpy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-20T18:32:56.751 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:56 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.xhlvpy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-20T18:32:56.751 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:56 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:32:56.751 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:56 smithi172 ceph-mon[35456]: Deploying daemon mds.cephfs.smithi017.xhlvpy on smithi017 2024-09-20T18:32:56.751 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:56 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/154626747' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-20T18:32:56.751 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:56 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/154626747' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-20T18:32:56.751 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:56 smithi172 ceph-mon[35456]: mds.? [v2:172.21.15.172:6824/1043027893,v1:172.21.15.172:6825/1043027893] up:boot 2024-09-20T18:32:56.751 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:56 smithi172 ceph-mon[35456]: daemon mds.cephfs.smithi172.mugtlk assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-20T18:32:56.751 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:56 smithi172 ceph-mon[35456]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-20T18:32:56.751 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:56 smithi172 ceph-mon[35456]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-20T18:32:56.751 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:56 smithi172 ceph-mon[35456]: fsmap cephfs:1 {0=cephfs.smithi017.puqizo=up:active} 1 up:standby 2024-09-20T18:32:56.751 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:56 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.mugtlk"}]: dispatch 2024-09-20T18:32:56.751 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:56 smithi172 ceph-mon[35456]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:creating} 2024-09-20T18:32:56.752 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:56 smithi172 ceph-mon[35456]: daemon mds.cephfs.smithi172.mugtlk is now active in filesystem cephfs as rank 1 2024-09-20T18:32:56.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:56 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:56.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:56 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:56.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:56 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:56.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:56 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.xhlvpy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-20T18:32:56.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:56 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.xhlvpy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-20T18:32:56.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:56 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:32:56.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:56 smithi017 ceph-mon[28058]: Deploying daemon mds.cephfs.smithi017.xhlvpy on smithi017 2024-09-20T18:32:56.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:56 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/154626747' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-20T18:32:56.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:56 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/154626747' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-20T18:32:56.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:56 smithi017 ceph-mon[28058]: mds.? [v2:172.21.15.172:6824/1043027893,v1:172.21.15.172:6825/1043027893] up:boot 2024-09-20T18:32:56.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:56 smithi017 ceph-mon[28058]: daemon mds.cephfs.smithi172.mugtlk assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-20T18:32:56.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:56 smithi017 ceph-mon[28058]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-20T18:32:56.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:56 smithi017 ceph-mon[28058]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-20T18:32:56.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:56 smithi017 ceph-mon[28058]: fsmap cephfs:1 {0=cephfs.smithi017.puqizo=up:active} 1 up:standby 2024-09-20T18:32:56.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:56 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.mugtlk"}]: dispatch 2024-09-20T18:32:56.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:56 smithi017 ceph-mon[28058]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:creating} 2024-09-20T18:32:56.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:56 smithi017 ceph-mon[28058]: daemon mds.cephfs.smithi172.mugtlk is now active in filesystem cephfs as rank 1 2024-09-20T18:32:57.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:57 smithi017 ceph-mon[28058]: pgmap v176: 65 pgs: 65 active+clean; 577 KiB data, 207 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:57.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:57 smithi017 ceph-mon[28058]: mds.? [v2:172.21.15.172:6824/1043027893,v1:172.21.15.172:6825/1043027893] up:active 2024-09-20T18:32:57.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:57 smithi017 ceph-mon[28058]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 2024-09-20T18:32:57.949 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T18:32:57.959 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-20T18:32:57.959 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-20T18:32:57.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:57 smithi172 ceph-mon[35456]: pgmap v176: 65 pgs: 65 active+clean; 577 KiB data, 207 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:32:57.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:57 smithi172 ceph-mon[35456]: mds.? [v2:172.21.15.172:6824/1043027893,v1:172.21.15.172:6825/1043027893] up:active 2024-09-20T18:32:57.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:57 smithi172 ceph-mon[35456]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 2024-09-20T18:32:58.677 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:32:59.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.145+0000 7fe29a00f640 1 -- 172.21.15.17:0/2486349346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2941023f0 msgr2=0x7fe2941047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:59.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.145+0000 7fe29a00f640 1 --2- 172.21.15.17:0/2486349346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2941023f0 0x7fe2941047e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe284009c50 tx=0x7fe28402a9a0 comp rx=0 tx=0).stop 2024-09-20T18:32:59.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.145+0000 7fe29a00f640 1 -- 172.21.15.17:0/2486349346 shutdown_connections 2024-09-20T18:32:59.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.145+0000 7fe29a00f640 1 --2- 172.21.15.17:0/2486349346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe294104d20 0x7fe294107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:59.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.145+0000 7fe29a00f640 1 --2- 172.21.15.17:0/2486349346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2941023f0 0x7fe2941047e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:59.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.145+0000 7fe29a00f640 1 -- 172.21.15.17:0/2486349346 >> 172.21.15.17:0/2486349346 conn(0x7fe2940fc010 msgr2=0x7fe2940fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:59.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.145+0000 7fe29a00f640 1 -- 172.21.15.17:0/2486349346 shutdown_connections 2024-09-20T18:32:59.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.145+0000 7fe29a00f640 1 -- 172.21.15.17:0/2486349346 wait complete. 2024-09-20T18:32:59.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.145+0000 7fe29a00f640 1 Processor -- start 2024-09-20T18:32:59.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.146+0000 7fe29a00f640 1 -- start start 2024-09-20T18:32:59.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.146+0000 7fe29a00f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2941023f0 0x7fe294199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:59.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.146+0000 7fe29a00f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe294104d20 0x7fe294199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:59.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.146+0000 7fe29a00f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe29410a7c0 con 0x7fe2941023f0 2024-09-20T18:32:59.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.146+0000 7fe29a00f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe29410a640 con 0x7fe294104d20 2024-09-20T18:32:59.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.146+0000 7fe2937fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2941023f0 0x7fe294199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:59.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.146+0000 7fe2937fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2941023f0 0x7fe294199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39214/0 (socket says 172.21.15.17:39214) 2024-09-20T18:32:59.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.146+0000 7fe2937fe640 1 -- 172.21.15.17:0/300880107 learned_addr learned my addr 172.21.15.17:0/300880107 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:32:59.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.146+0000 7fe292ffd640 1 --2- 172.21.15.17:0/300880107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe294104d20 0x7fe294199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:59.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.146+0000 7fe2937fe640 1 -- 172.21.15.17:0/300880107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe294104d20 msgr2=0x7fe294199c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:59.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.146+0000 7fe2937fe640 1 --2- 172.21.15.17:0/300880107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe294104d20 0x7fe294199c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:59.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.146+0000 7fe2937fe640 1 -- 172.21.15.17:0/300880107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29419a250 con 0x7fe2941023f0 2024-09-20T18:32:59.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.147+0000 7fe2937fe640 1 --2- 172.21.15.17:0/300880107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2941023f0 0x7fe294199720 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe284009d70 tx=0x7fe28402fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:59.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.147+0000 7fe290ff9640 1 -- 172.21.15.17:0/300880107 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe284034030 con 0x7fe2941023f0 2024-09-20T18:32:59.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.147+0000 7fe29a00f640 1 -- 172.21.15.17:0/300880107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe29419ec60 con 0x7fe2941023f0 2024-09-20T18:32:59.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.147+0000 7fe290ff9640 1 -- 172.21.15.17:0/300880107 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe284030b20 con 0x7fe2941023f0 2024-09-20T18:32:59.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.147+0000 7fe290ff9640 1 -- 172.21.15.17:0/300880107 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2840046d0 con 0x7fe2941023f0 2024-09-20T18:32:59.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.147+0000 7fe29a00f640 1 -- 172.21.15.17:0/300880107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe29419f160 con 0x7fe2941023f0 2024-09-20T18:32:59.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.148+0000 7fe29a00f640 1 -- 172.21.15.17:0/300880107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2941027d0 con 0x7fe2941023f0 2024-09-20T18:32:59.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.149+0000 7fe290ff9640 1 -- 172.21.15.17:0/300880107 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe284037020 con 0x7fe2941023f0 2024-09-20T18:32:59.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.149+0000 7fe290ff9640 1 --2- 172.21.15.17:0/300880107 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe28006e2b0 0x7fe280070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:32:59.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.150+0000 7fe292ffd640 1 --2- 172.21.15.17:0/300880107 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe28006e2b0 0x7fe280070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:32:59.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.150+0000 7fe290ff9640 1 -- 172.21.15.17:0/300880107 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fe2840af1d0 con 0x7fe2941023f0 2024-09-20T18:32:59.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.150+0000 7fe292ffd640 1 --2- 172.21.15.17:0/300880107 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe28006e2b0 0x7fe280070770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe29419abd0 tx=0x7fe27c00a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:32:59.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.153+0000 7fe290ff9640 1 -- 172.21.15.17:0/300880107 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe28407cb30 con 0x7fe2941023f0 2024-09-20T18:32:59.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.368+0000 7fe29a00f640 1 -- 172.21.15.17:0/300880107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe2940fdb00 con 0x7fe2941023f0 2024-09-20T18:32:59.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.500+0000 7fe290ff9640 1 -- 172.21.15.17:0/300880107 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v9) ==== 168+0+0 (secure 0 0 0) 0x7fe2840807e0 con 0x7fe2941023f0 2024-09-20T18:32:59.515 INFO:teuthology.orchestra.run.smithi017.stderr:inline data enabled 2024-09-20T18:32:59.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.503+0000 7fe29a00f640 1 -- 172.21.15.17:0/300880107 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe28006e2b0 msgr2=0x7fe280070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:59.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.503+0000 7fe29a00f640 1 --2- 172.21.15.17:0/300880107 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe28006e2b0 0x7fe280070770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe29419abd0 tx=0x7fe27c00a2d0 comp rx=0 tx=0).stop 2024-09-20T18:32:59.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.503+0000 7fe29a00f640 1 -- 172.21.15.17:0/300880107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2941023f0 msgr2=0x7fe294199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:32:59.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.503+0000 7fe29a00f640 1 --2- 172.21.15.17:0/300880107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2941023f0 0x7fe294199720 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe284009d70 tx=0x7fe28402fb90 comp rx=0 tx=0).stop 2024-09-20T18:32:59.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.503+0000 7fe29a00f640 1 -- 172.21.15.17:0/300880107 shutdown_connections 2024-09-20T18:32:59.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.503+0000 7fe29a00f640 1 --2- 172.21.15.17:0/300880107 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe28006e2b0 0x7fe280070770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:59.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.503+0000 7fe29a00f640 1 --2- 172.21.15.17:0/300880107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe294104d20 0x7fe294199c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:59.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.503+0000 7fe29a00f640 1 --2- 172.21.15.17:0/300880107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2941023f0 0x7fe294199720 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:32:59.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.503+0000 7fe29a00f640 1 -- 172.21.15.17:0/300880107 >> 172.21.15.17:0/300880107 conn(0x7fe2940fc010 msgr2=0x7fe294101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:32:59.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.504+0000 7fe29a00f640 1 -- 172.21.15.17:0/300880107 shutdown_connections 2024-09-20T18:32:59.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:32:59.504+0000 7fe29a00f640 1 -- 172.21.15.17:0/300880107 wait complete. 2024-09-20T18:32:59.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:59 smithi017 ceph-mon[28058]: pgmap v177: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 6 op/s 2024-09-20T18:32:59.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:59 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:59.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:59 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:59.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:59 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:59.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:59 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.liatxm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-20T18:32:59.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:59 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.liatxm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-20T18:32:59.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:59 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:32:59.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:32:59 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/300880107' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-20T18:32:59.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:59 smithi172 ceph-mon[35456]: pgmap v177: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 6 op/s 2024-09-20T18:32:59.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:59 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:59.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:59 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:59.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:59 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:32:59.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:59 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.liatxm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-20T18:32:59.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:59 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.liatxm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-20T18:32:59.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:59 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:32:59.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:32:59 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/300880107' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-20T18:33:00.278 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T18:33:00.289 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-20T18:33:00.289 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-20T18:33:00.554 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:33:00.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:00 smithi172 ceph-mon[35456]: Deploying daemon mds.cephfs.smithi172.liatxm on smithi172 2024-09-20T18:33:00.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:00 smithi172 ceph-mon[35456]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-20T18:33:00.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:00 smithi172 ceph-mon[35456]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-20T18:33:00.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:00 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/300880107' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-20T18:33:00.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:00 smithi172 ceph-mon[35456]: mds.? [v2:172.21.15.17:6828/53113052,v1:172.21.15.17:6829/53113052] up:boot 2024-09-20T18:33:00.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:00 smithi172 ceph-mon[35456]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 1 up:standby 2024-09-20T18:33:00.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:00 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.xhlvpy"}]: dispatch 2024-09-20T18:33:00.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:00 smithi172 ceph-mon[35456]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 1 up:standby-replay 2024-09-20T18:33:00.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:00 smithi017 ceph-mon[28058]: Deploying daemon mds.cephfs.smithi172.liatxm on smithi172 2024-09-20T18:33:00.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:00 smithi017 ceph-mon[28058]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-20T18:33:00.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:00 smithi017 ceph-mon[28058]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-20T18:33:00.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:00 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/300880107' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-20T18:33:00.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:00 smithi017 ceph-mon[28058]: mds.? [v2:172.21.15.17:6828/53113052,v1:172.21.15.17:6829/53113052] up:boot 2024-09-20T18:33:00.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:00 smithi017 ceph-mon[28058]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 1 up:standby 2024-09-20T18:33:00.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:00 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.xhlvpy"}]: dispatch 2024-09-20T18:33:00.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:00 smithi017 ceph-mon[28058]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 1 up:standby-replay 2024-09-20T18:33:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.933+0000 7f10201a3640 1 -- 172.21.15.17:0/1301540069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10181023f0 msgr2=0x7f10181047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.933+0000 7f10201a3640 1 --2- 172.21.15.17:0/1301540069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10181023f0 0x7f10181047e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f10140098b0 tx=0x7f101402a4d0 comp rx=0 tx=0).stop 2024-09-20T18:33:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.933+0000 7f10201a3640 1 -- 172.21.15.17:0/1301540069 shutdown_connections 2024-09-20T18:33:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.933+0000 7f10201a3640 1 --2- 172.21.15.17:0/1301540069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1018104d20 0x7f1018107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.933+0000 7f10201a3640 1 --2- 172.21.15.17:0/1301540069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10181023f0 0x7f10181047e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.933+0000 7f10201a3640 1 -- 172.21.15.17:0/1301540069 >> 172.21.15.17:0/1301540069 conn(0x7f10180fc010 msgr2=0x7f10180fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.933+0000 7f10201a3640 1 -- 172.21.15.17:0/1301540069 shutdown_connections 2024-09-20T18:33:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.933+0000 7f10201a3640 1 -- 172.21.15.17:0/1301540069 wait complete. 2024-09-20T18:33:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.933+0000 7f10201a3640 1 Processor -- start 2024-09-20T18:33:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.933+0000 7f10201a3640 1 -- start start 2024-09-20T18:33:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.934+0000 7f10201a3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10181023f0 0x7f10181975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.934+0000 7f10201a3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1018104d20 0x7f1018197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.934+0000 7f10201a3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f101810a830 con 0x7f1018104d20 2024-09-20T18:33:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.934+0000 7f10201a3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f101810a6b0 con 0x7f10181023f0 2024-09-20T18:33:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.934+0000 7f101d73e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1018104d20 0x7f1018197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.934+0000 7f101d73e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1018104d20 0x7f1018197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55556/0 (socket says 172.21.15.17:55556) 2024-09-20T18:33:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.934+0000 7f101d73e640 1 -- 172.21.15.17:0/1926837281 learned_addr learned my addr 172.21.15.17:0/1926837281 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:33:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.934+0000 7f101d73e640 1 -- 172.21.15.17:0/1926837281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10181023f0 msgr2=0x7f10181975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.934+0000 7f101d73e640 1 --2- 172.21.15.17:0/1926837281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10181023f0 0x7f10181975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.934+0000 7f101d73e640 1 -- 172.21.15.17:0/1926837281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1018198180 con 0x7f1018104d20 2024-09-20T18:33:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.934+0000 7f101d73e640 1 --2- 172.21.15.17:0/1926837281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1018104d20 0x7f1018197b00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f100c00b3d0 tx=0x7f100c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.934+0000 7f100affd640 1 -- 172.21.15.17:0/1926837281 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f100c015020 con 0x7f1018104d20 2024-09-20T18:33:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.934+0000 7f10201a3640 1 -- 172.21.15.17:0/1926837281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101819cbc0 con 0x7f1018104d20 2024-09-20T18:33:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.935+0000 7f100affd640 1 -- 172.21.15.17:0/1926837281 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f100c011af0 con 0x7f1018104d20 2024-09-20T18:33:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.935+0000 7f100affd640 1 -- 172.21.15.17:0/1926837281 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f100c010d30 con 0x7f1018104d20 2024-09-20T18:33:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.935+0000 7f10201a3640 1 -- 172.21.15.17:0/1926837281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f101819d1d0 con 0x7f1018104d20 2024-09-20T18:33:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.936+0000 7f10201a3640 1 -- 172.21.15.17:0/1926837281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10181027d0 con 0x7f1018104d20 2024-09-20T18:33:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.936+0000 7f100affd640 1 -- 172.21.15.17:0/1926837281 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f100c018020 con 0x7f1018104d20 2024-09-20T18:33:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.937+0000 7f100affd640 1 --2- 172.21.15.17:0/1926837281 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f100406e2b0 0x7f1004070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.937+0000 7f101df3f640 1 --2- 172.21.15.17:0/1926837281 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f100406e2b0 0x7f1004070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.937+0000 7f100affd640 1 -- 172.21.15.17:0/1926837281 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f100c08dc70 con 0x7f1018104d20 2024-09-20T18:33:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.937+0000 7f101df3f640 1 --2- 172.21.15.17:0/1926837281 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f100406e2b0 0x7f1004070770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f10140096c0 tx=0x7f1014000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:00.941+0000 7f100affd640 1 -- 172.21.15.17:0/1926837281 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f100c01f020 con 0x7f1018104d20 2024-09-20T18:33:01.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:01.155+0000 7f10201a3640 1 -- 172.21.15.17:0/1926837281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f101819dae0 con 0x7f1018104d20 2024-09-20T18:33:01.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:01.155+0000 7f100affd640 1 -- 172.21.15.17:0/1926837281 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 10 v10) ==== 76+0+1819 (secure 0 0 0) 0x7f100c05b5d0 con 0x7f1018104d20 2024-09-20T18:33:01.170 INFO:teuthology.orchestra.run.smithi017.stdout:e10 2024-09-20T18:33:01.170 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:32:59:505360+0000 2024-09-20T18:33:01.171 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:33:01.171 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:33:01.171 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:33:01.171 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:33:01.171 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:33:01.171 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:33:01.171 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 10 2024-09-20T18:33:01.171 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T18:33:01.171 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:33:01.171 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:32:59.505344+0000 2024-09-20T18:33:01.171 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:33:01.171 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:33:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:33:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:33:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:33:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:33:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:33:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:33:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2024-09-20T18:33:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:33:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:33:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:33:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14552,1=24325} 2024-09-20T18:33:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-09-20T18:33:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:33:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:33:01.173 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:33:01.173 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:33:01.173 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:33:01.173 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:33:01.173 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:33:01.173 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:33:01.173 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 14552 members: 14552,24325 2024-09-20T18:33:01.173 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{0:14552} state up:active seq 2 addr [v2:172.21.15.17:6826/3360305779,v1:172.21.15.17:6827/3360305779] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:33:01.173 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{0:14568} state up:standby-replay seq 1 addr [v2:172.21.15.17:6828/53113052,v1:172.21.15.17:6829/53113052] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:33:01.173 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{1:24325} state up:active seq 2 addr [v2:172.21.15.172:6824/1043027893,v1:172.21.15.172:6825/1043027893] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:33:01.173 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:33:01.173 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:33:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 10 2024-09-20T18:33:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:01.157+0000 7f10201a3640 1 -- 172.21.15.17:0/1926837281 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f100406e2b0 msgr2=0x7f1004070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:01.157+0000 7f10201a3640 1 --2- 172.21.15.17:0/1926837281 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f100406e2b0 0x7f1004070770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f10140096c0 tx=0x7f1014000bc0 comp rx=0 tx=0).stop 2024-09-20T18:33:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:01.157+0000 7f10201a3640 1 -- 172.21.15.17:0/1926837281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1018104d20 msgr2=0x7f1018197b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:01.157+0000 7f10201a3640 1 --2- 172.21.15.17:0/1926837281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1018104d20 0x7f1018197b00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f100c00b3d0 tx=0x7f100c00b890 comp rx=0 tx=0).stop 2024-09-20T18:33:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:01.158+0000 7f10201a3640 1 -- 172.21.15.17:0/1926837281 shutdown_connections 2024-09-20T18:33:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:01.158+0000 7f10201a3640 1 --2- 172.21.15.17:0/1926837281 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f100406e2b0 0x7f1004070770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:01.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:01.158+0000 7f10201a3640 1 --2- 172.21.15.17:0/1926837281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1018104d20 0x7f1018197b00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:01.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:01.158+0000 7f10201a3640 1 --2- 172.21.15.17:0/1926837281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10181023f0 0x7f10181975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:01.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:01.158+0000 7f10201a3640 1 -- 172.21.15.17:0/1926837281 >> 172.21.15.17:0/1926837281 conn(0x7f10180fc010 msgr2=0x7f10180fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:01.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:01.158+0000 7f10201a3640 1 -- 172.21.15.17:0/1926837281 shutdown_connections 2024-09-20T18:33:01.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:01.158+0000 7f10201a3640 1 -- 172.21.15.17:0/1926837281 wait complete. 2024-09-20T18:33:01.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:01 smithi017 ceph-mon[28058]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-20T18:33:01.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:01 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1926837281' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-20T18:33:01.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:01 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:01.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:01 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:01.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:01 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:01.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:01 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:01.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:01 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:01.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:01 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:33:01.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:01 smithi172 ceph-mon[35456]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-20T18:33:01.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:01 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/1926837281' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-20T18:33:01.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:01 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:01.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:01 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:01.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:01 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:01.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:01 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:01.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:01 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:01.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:01 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:33:01.892 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-20T18:33:02.397 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:33:02.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:02 smithi017 ceph-mon[28058]: mds.? [v2:172.21.15.172:6826/2975309540,v1:172.21.15.172:6827/2975309540] up:boot 2024-09-20T18:33:02.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:02 smithi017 ceph-mon[28058]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 1 up:standby-replay 1 up:standby 2024-09-20T18:33:02.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:02 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.liatxm"}]: dispatch 2024-09-20T18:33:02.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:02 smithi017 ceph-mon[28058]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 2 up:standby-replay 2024-09-20T18:33:02.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:02 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:02.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:02 smithi172 ceph-mon[35456]: mds.? [v2:172.21.15.172:6826/2975309540,v1:172.21.15.172:6827/2975309540] up:boot 2024-09-20T18:33:02.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:02 smithi172 ceph-mon[35456]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 1 up:standby-replay 1 up:standby 2024-09-20T18:33:02.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:02 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.liatxm"}]: dispatch 2024-09-20T18:33:02.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:02 smithi172 ceph-mon[35456]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 2 up:standby-replay 2024-09-20T18:33:02.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:02 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:03.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.197+0000 7fe053318640 1 -- 172.21.15.17:0/3420504499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe04c100860 msgr2=0x7fe04c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:03.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.197+0000 7fe053318640 1 --2- 172.21.15.17:0/3420504499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe04c100860 0x7fe04c100c60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe048009880 tx=0x7fe04802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:33:03.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.197+0000 7fe053318640 1 -- 172.21.15.17:0/3420504499 shutdown_connections 2024-09-20T18:33:03.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.197+0000 7fe053318640 1 --2- 172.21.15.17:0/3420504499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe04c101a60 0x7fe04c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:03.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.197+0000 7fe053318640 1 --2- 172.21.15.17:0/3420504499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe04c100860 0x7fe04c100c60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:03.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.197+0000 7fe053318640 1 -- 172.21.15.17:0/3420504499 >> 172.21.15.17:0/3420504499 conn(0x7fe04c0fc010 msgr2=0x7fe04c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:03.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.197+0000 7fe053318640 1 -- 172.21.15.17:0/3420504499 shutdown_connections 2024-09-20T18:33:03.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.197+0000 7fe053318640 1 -- 172.21.15.17:0/3420504499 wait complete. 2024-09-20T18:33:03.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.198+0000 7fe053318640 1 Processor -- start 2024-09-20T18:33:03.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.198+0000 7fe053318640 1 -- start start 2024-09-20T18:33:03.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.198+0000 7fe053318640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe04c100860 0x7fe04c1963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:03.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.198+0000 7fe053318640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe04c101a60 0x7fe04c196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:03.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.198+0000 7fe053318640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c109680 con 0x7fe04c100860 2024-09-20T18:33:03.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.198+0000 7fe053318640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c109500 con 0x7fe04c101a60 2024-09-20T18:33:03.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.198+0000 7fe0510b4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe04c100860 0x7fe04c1963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:03.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.198+0000 7fe0510b4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe04c100860 0x7fe04c1963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55566/0 (socket says 172.21.15.17:55566) 2024-09-20T18:33:03.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.198+0000 7fe0510b4640 1 -- 172.21.15.17:0/1508340717 learned_addr learned my addr 172.21.15.17:0/1508340717 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:33:03.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.198+0000 7fe0508b3640 1 --2- 172.21.15.17:0/1508340717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe04c101a60 0x7fe04c196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:03.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.198+0000 7fe0510b4640 1 -- 172.21.15.17:0/1508340717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe04c101a60 msgr2=0x7fe04c196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:03.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.198+0000 7fe0510b4640 1 --2- 172.21.15.17:0/1508340717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe04c101a60 0x7fe04c196900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:03.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.198+0000 7fe0510b4640 1 -- 172.21.15.17:0/1508340717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04c196f80 con 0x7fe04c100860 2024-09-20T18:33:03.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.198+0000 7fe0510b4640 1 --2- 172.21.15.17:0/1508340717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe04c100860 0x7fe04c1963c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe048006010 tx=0x7fe0480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:03.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.199+0000 7fe0427fc640 1 -- 172.21.15.17:0/1508340717 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe04803f070 con 0x7fe04c100860 2024-09-20T18:33:03.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.199+0000 7fe0427fc640 1 -- 172.21.15.17:0/1508340717 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe048004a50 con 0x7fe04c100860 2024-09-20T18:33:03.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.199+0000 7fe053318640 1 -- 172.21.15.17:0/1508340717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe04c19b960 con 0x7fe04c100860 2024-09-20T18:33:03.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.199+0000 7fe0427fc640 1 -- 172.21.15.17:0/1508340717 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe048035030 con 0x7fe04c100860 2024-09-20T18:33:03.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.199+0000 7fe053318640 1 -- 172.21.15.17:0/1508340717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe04c19bef0 con 0x7fe04c100860 2024-09-20T18:33:03.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.200+0000 7fe053318640 1 -- 172.21.15.17:0/1508340717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe04c100c60 con 0x7fe04c100860 2024-09-20T18:33:03.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.200+0000 7fe0427fc640 1 -- 172.21.15.17:0/1508340717 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe048042070 con 0x7fe04c100860 2024-09-20T18:33:03.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.201+0000 7fe0427fc640 1 --2- 172.21.15.17:0/1508340717 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe03806e310 0x7fe0380707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:03.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.201+0000 7fe0427fc640 1 -- 172.21.15.17:0/1508340717 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fe0480aeb30 con 0x7fe04c100860 2024-09-20T18:33:03.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.201+0000 7fe0508b3640 1 --2- 172.21.15.17:0/1508340717 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe03806e310 0x7fe0380707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:03.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.201+0000 7fe0508b3640 1 --2- 172.21.15.17:0/1508340717 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe03806e310 0x7fe0380707d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe04c197870 tx=0x7fe03c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:03.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.205+0000 7fe0427fc640 1 -- 172.21.15.17:0/1508340717 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe0480801c0 con 0x7fe04c100860 2024-09-20T18:33:03.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.437+0000 7fe053318640 1 -- 172.21.15.17:0/1508340717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe04c190490 con 0x7fe04c100860 2024-09-20T18:33:03.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.438+0000 7fe0427fc640 1 -- 172.21.15.17:0/1508340717 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5353 (secure 0 0 0) 0x7fe0480849f0 con 0x7fe04c100860 2024-09-20T18:33:03.453 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 13 2024-09-20T18:33:03.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.440+0000 7fe053318640 1 -- 172.21.15.17:0/1508340717 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe03806e310 msgr2=0x7fe0380707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:03.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.440+0000 7fe053318640 1 --2- 172.21.15.17:0/1508340717 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe03806e310 0x7fe0380707d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe04c197870 tx=0x7fe03c00b410 comp rx=0 tx=0).stop 2024-09-20T18:33:03.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.440+0000 7fe053318640 1 -- 172.21.15.17:0/1508340717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe04c100860 msgr2=0x7fe04c1963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:03.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.440+0000 7fe053318640 1 --2- 172.21.15.17:0/1508340717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe04c100860 0x7fe04c1963c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe048006010 tx=0x7fe0480045e0 comp rx=0 tx=0).stop 2024-09-20T18:33:03.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.440+0000 7fe053318640 1 -- 172.21.15.17:0/1508340717 shutdown_connections 2024-09-20T18:33:03.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.440+0000 7fe053318640 1 --2- 172.21.15.17:0/1508340717 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe03806e310 0x7fe0380707d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:03.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.440+0000 7fe053318640 1 --2- 172.21.15.17:0/1508340717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe04c101a60 0x7fe04c196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:03.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.440+0000 7fe053318640 1 --2- 172.21.15.17:0/1508340717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe04c100860 0x7fe04c1963c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:03.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.440+0000 7fe053318640 1 -- 172.21.15.17:0/1508340717 >> 172.21.15.17:0/1508340717 conn(0x7fe04c0fc010 msgr2=0x7fe04c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:03.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.441+0000 7fe053318640 1 -- 172.21.15.17:0/1508340717 shutdown_connections 2024-09-20T18:33:03.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:03.441+0000 7fe053318640 1 -- 172.21.15.17:0/1508340717 wait complete. 2024-09-20T18:33:03.464 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:33:03.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:03 smithi017 ceph-mon[28058]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 601 B/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-20T18:33:03.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:03 smithi017 ceph-mon[28058]: mds.? [v2:172.21.15.17:6826/3360305779,v1:172.21.15.17:6827/3360305779] up:active 2024-09-20T18:33:03.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:03 smithi017 ceph-mon[28058]: mds.? [v2:172.21.15.17:6828/53113052,v1:172.21.15.17:6829/53113052] up:standby-replay 2024-09-20T18:33:03.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:03 smithi017 ceph-mon[28058]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 2 up:standby-replay 2024-09-20T18:33:03.762 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:03.762 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:03.762 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:03 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1508340717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-20T18:33:03.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:03 smithi172 ceph-mon[35456]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 601 B/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-20T18:33:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:03 smithi172 ceph-mon[35456]: mds.? [v2:172.21.15.17:6826/3360305779,v1:172.21.15.17:6827/3360305779] up:active 2024-09-20T18:33:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:03 smithi172 ceph-mon[35456]: mds.? [v2:172.21.15.17:6828/53113052,v1:172.21.15.17:6829/53113052] up:standby-replay 2024-09-20T18:33:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:03 smithi172 ceph-mon[35456]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 2 up:standby-replay 2024-09-20T18:33:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:03 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/1508340717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-20T18:33:05.203 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-20T18:33:05.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:05 smithi017 ceph-mon[28058]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-20T18:33:05.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:05 smithi017 ceph-mon[28058]: mds.? [v2:172.21.15.172:6824/1043027893,v1:172.21.15.172:6825/1043027893] up:active 2024-09-20T18:33:05.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:05 smithi017 ceph-mon[28058]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 2 up:standby-replay 2024-09-20T18:33:05.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:05 smithi172 ceph-mon[35456]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-20T18:33:05.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:05 smithi172 ceph-mon[35456]: mds.? [v2:172.21.15.172:6824/1043027893,v1:172.21.15.172:6825/1043027893] up:active 2024-09-20T18:33:05.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:05 smithi172 ceph-mon[35456]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 2 up:standby-replay 2024-09-20T18:33:06.691 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:33:06.818 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:06 smithi017 ceph-mon[28058]: mds.? [v2:172.21.15.172:6826/2975309540,v1:172.21.15.172:6827/2975309540] up:standby-replay 2024-09-20T18:33:06.818 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:06 smithi017 ceph-mon[28058]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 2 up:standby-replay 2024-09-20T18:33:06.818 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:06 smithi017 ceph-mon[28058]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-20T18:33:06.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:06 smithi172 ceph-mon[35456]: mds.? [v2:172.21.15.172:6826/2975309540,v1:172.21.15.172:6827/2975309540] up:standby-replay 2024-09-20T18:33:06.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:06 smithi172 ceph-mon[35456]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 2 up:standby-replay 2024-09-20T18:33:06.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:06 smithi172 ceph-mon[35456]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-20T18:33:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.237+0000 7ff04a594640 1 -- 172.21.15.17:0/2136328675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff044102b60 msgr2=0x7ff044102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.237+0000 7ff04a594640 1 --2- 172.21.15.17:0/2136328675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff044102b60 0x7ff044102fe0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff038009880 tx=0x7ff03802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:33:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.237+0000 7ff04a594640 1 -- 172.21.15.17:0/2136328675 shutdown_connections 2024-09-20T18:33:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.237+0000 7ff04a594640 1 --2- 172.21.15.17:0/2136328675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff044102b60 0x7ff044102fe0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.237+0000 7ff04a594640 1 --2- 172.21.15.17:0/2136328675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff044101960 0x7ff044101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.237+0000 7ff04a594640 1 -- 172.21.15.17:0/2136328675 >> 172.21.15.17:0/2136328675 conn(0x7ff0440fd0f0 msgr2=0x7ff0440ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.237+0000 7ff04a594640 1 -- 172.21.15.17:0/2136328675 shutdown_connections 2024-09-20T18:33:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.237+0000 7ff04a594640 1 -- 172.21.15.17:0/2136328675 wait complete. 2024-09-20T18:33:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.238+0000 7ff04a594640 1 Processor -- start 2024-09-20T18:33:07.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.238+0000 7ff04a594640 1 -- start start 2024-09-20T18:33:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.238+0000 7ff04a594640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff044101960 0x7ff044075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.238+0000 7ff04a594640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff044102b60 0x7ff0440745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.238+0000 7ff04a594640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff04410a820 con 0x7ff044102b60 2024-09-20T18:33:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.238+0000 7ff04a594640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff04410a6a0 con 0x7ff044101960 2024-09-20T18:33:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.238+0000 7ff0437fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff044102b60 0x7ff0440745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.238+0000 7ff0437fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff044102b60 0x7ff0440745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55592/0 (socket says 172.21.15.17:55592) 2024-09-20T18:33:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.238+0000 7ff0437fe640 1 -- 172.21.15.17:0/974492850 learned_addr learned my addr 172.21.15.17:0/974492850 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:33:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.238+0000 7ff043fff640 1 --2- 172.21.15.17:0/974492850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff044101960 0x7ff044075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.238+0000 7ff0437fe640 1 -- 172.21.15.17:0/974492850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff044101960 msgr2=0x7ff044075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.238+0000 7ff0437fe640 1 --2- 172.21.15.17:0/974492850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff044101960 0x7ff044075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.239+0000 7ff0437fe640 1 -- 172.21.15.17:0/974492850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff044074b20 con 0x7ff044102b60 2024-09-20T18:33:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.239+0000 7ff043fff640 1 --2- 172.21.15.17:0/974492850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff044101960 0x7ff044075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:33:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.239+0000 7ff0437fe640 1 --2- 172.21.15.17:0/974492850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff044102b60 0x7ff0440745e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff038006010 tx=0x7ff0380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:07.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.239+0000 7ff0417fa640 1 -- 172.21.15.17:0/974492850 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff03803f070 con 0x7ff044102b60 2024-09-20T18:33:07.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.239+0000 7ff04a594640 1 -- 172.21.15.17:0/974492850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff044074db0 con 0x7ff044102b60 2024-09-20T18:33:07.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.239+0000 7ff0417fa640 1 -- 172.21.15.17:0/974492850 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff0380044d0 con 0x7ff044102b60 2024-09-20T18:33:07.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.239+0000 7ff0417fa640 1 -- 172.21.15.17:0/974492850 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff038035030 con 0x7ff044102b60 2024-09-20T18:33:07.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.239+0000 7ff04a594640 1 -- 172.21.15.17:0/974492850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff044075360 con 0x7ff044102b60 2024-09-20T18:33:07.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.240+0000 7ff04a594640 1 -- 172.21.15.17:0/974492850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff044101d40 con 0x7ff044102b60 2024-09-20T18:33:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.241+0000 7ff0417fa640 1 -- 172.21.15.17:0/974492850 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff038042070 con 0x7ff044102b60 2024-09-20T18:33:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.241+0000 7ff0417fa640 1 --2- 172.21.15.17:0/974492850 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff02c06e2b0 0x7ff02c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.241+0000 7ff0417fa640 1 -- 172.21.15.17:0/974492850 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7ff0380aeec0 con 0x7ff044102b60 2024-09-20T18:33:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.241+0000 7ff043fff640 1 --2- 172.21.15.17:0/974492850 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff02c06e2b0 0x7ff02c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.242+0000 7ff043fff640 1 --2- 172.21.15.17:0/974492850 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff02c06e2b0 0x7ff02c070770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff034006fd0 tx=0x7ff034008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.246+0000 7ff0417fa640 1 -- 172.21.15.17:0/974492850 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff03807c820 con 0x7ff044102b60 2024-09-20T18:33:07.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.523+0000 7ff04a594640 1 -- 172.21.15.17:0/974492850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) -- 0x7ff04402d7c0 con 0x7ff044102b60 2024-09-20T18:33:07.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.524+0000 7ff0417fa640 1 -- 172.21.15.17:0/974492850 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v15) ==== 78+0+98 (secure 0 0 0) 0x7ff0380804d0 con 0x7ff044102b60 2024-09-20T18:33:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.527+0000 7ff04a594640 1 -- 172.21.15.17:0/974492850 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff02c06e2b0 msgr2=0x7ff02c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.527+0000 7ff04a594640 1 --2- 172.21.15.17:0/974492850 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff02c06e2b0 0x7ff02c070770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff034006fd0 tx=0x7ff034008040 comp rx=0 tx=0).stop 2024-09-20T18:33:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.527+0000 7ff04a594640 1 -- 172.21.15.17:0/974492850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff044102b60 msgr2=0x7ff0440745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.527+0000 7ff04a594640 1 --2- 172.21.15.17:0/974492850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff044102b60 0x7ff0440745e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff038006010 tx=0x7ff0380048f0 comp rx=0 tx=0).stop 2024-09-20T18:33:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.527+0000 7ff04a594640 1 -- 172.21.15.17:0/974492850 shutdown_connections 2024-09-20T18:33:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.527+0000 7ff04a594640 1 --2- 172.21.15.17:0/974492850 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff02c06e2b0 0x7ff02c070770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.527+0000 7ff04a594640 1 --2- 172.21.15.17:0/974492850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff044102b60 0x7ff0440745e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.527+0000 7ff04a594640 1 --2- 172.21.15.17:0/974492850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff044101960 0x7ff044075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.527+0000 7ff04a594640 1 -- 172.21.15.17:0/974492850 >> 172.21.15.17:0/974492850 conn(0x7ff0440fd0f0 msgr2=0x7ff044106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.527+0000 7ff04a594640 1 -- 172.21.15.17:0/974492850 shutdown_connections 2024-09-20T18:33:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:07.527+0000 7ff04a594640 1 -- 172.21.15.17:0/974492850 wait complete. 2024-09-20T18:33:07.556 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:33:08.169 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-20T18:33:08.181 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-20T18:33:08.449 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:33:08.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:08 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:08.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:08 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:08.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:08 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/974492850' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-20T18:33:08.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:08 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:08.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:08 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:33:08.704 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:08 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:33:08.704 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:08 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:33:08.704 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:08 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:08.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:08 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:08.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:08 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:08.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:08 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/974492850' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-20T18:33:08.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:08 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:08.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:08 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:33:08.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:08 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:33:08.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:08 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:33:08.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:08 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:08.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.905+0000 7f31fdf08640 1 -- 172.21.15.17:0/2764108464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31f80ffdc0 msgr2=0x7f31f8100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:08.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.905+0000 7f31fdf08640 1 --2- 172.21.15.17:0/2764108464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31f80ffdc0 0x7f31f8100220 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009880 tx=0x7f31e002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:33:08.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.905+0000 7f31fdf08640 1 -- 172.21.15.17:0/2764108464 shutdown_connections 2024-09-20T18:33:08.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.905+0000 7f31fdf08640 1 --2- 172.21.15.17:0/2764108464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31f80ffdc0 0x7f31f8100220 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:08.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.905+0000 7f31fdf08640 1 --2- 172.21.15.17:0/2764108464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f81069a0 0x7f31f8106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:08.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.905+0000 7f31fdf08640 1 -- 172.21.15.17:0/2764108464 >> 172.21.15.17:0/2764108464 conn(0x7f31f80fbc90 msgr2=0x7f31f80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:08.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.905+0000 7f31fdf08640 1 -- 172.21.15.17:0/2764108464 shutdown_connections 2024-09-20T18:33:08.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.905+0000 7f31fdf08640 1 -- 172.21.15.17:0/2764108464 wait complete. 2024-09-20T18:33:08.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.905+0000 7f31fdf08640 1 Processor -- start 2024-09-20T18:33:08.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.906+0000 7f31fdf08640 1 -- start start 2024-09-20T18:33:08.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.906+0000 7f31fdf08640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31f80ffdc0 0x7f31f8100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:08.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.906+0000 7f31fdf08640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f81069a0 0x7f31f81014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:08.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.906+0000 7f31fdf08640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f31f810ef40 con 0x7f31f80ffdc0 2024-09-20T18:33:08.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.906+0000 7f31fdf08640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f31f810edc0 con 0x7f31f81069a0 2024-09-20T18:33:08.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.906+0000 7f31f77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31f80ffdc0 0x7f31f8100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:08.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.906+0000 7f31f77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31f80ffdc0 0x7f31f8100fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55600/0 (socket says 172.21.15.17:55600) 2024-09-20T18:33:08.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.906+0000 7f31f77fe640 1 -- 172.21.15.17:0/304524894 learned_addr learned my addr 172.21.15.17:0/304524894 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:33:08.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.906+0000 7f31eeffd640 1 --2- 172.21.15.17:0/304524894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f81069a0 0x7f31f81014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:08.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.906+0000 7f31f77fe640 1 -- 172.21.15.17:0/304524894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f81069a0 msgr2=0x7f31f81014e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:08.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.906+0000 7f31f77fe640 1 --2- 172.21.15.17:0/304524894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f81069a0 0x7f31f81014e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:08.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.906+0000 7f31f77fe640 1 -- 172.21.15.17:0/304524894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f8101a20 con 0x7f31f80ffdc0 2024-09-20T18:33:08.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.906+0000 7f31f77fe640 1 --2- 172.21.15.17:0/304524894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31f80ffdc0 0x7f31f8100fa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f31e800d6f0 tx=0x7f31e800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:08.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.907+0000 7f31f57fa640 1 -- 172.21.15.17:0/304524894 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f31e8017070 con 0x7f31f80ffdc0 2024-09-20T18:33:08.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.907+0000 7f31fdf08640 1 -- 172.21.15.17:0/304524894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f8101d10 con 0x7f31f80ffdc0 2024-09-20T18:33:08.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.907+0000 7f31f57fa640 1 -- 172.21.15.17:0/304524894 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31e800de00 con 0x7f31f80ffdc0 2024-09-20T18:33:08.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.907+0000 7f31f57fa640 1 -- 172.21.15.17:0/304524894 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f31e8004bb0 con 0x7f31f80ffdc0 2024-09-20T18:33:08.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.907+0000 7f31fdf08640 1 -- 172.21.15.17:0/304524894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f81a3f70 con 0x7f31f80ffdc0 2024-09-20T18:33:08.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.908+0000 7f31fdf08640 1 -- 172.21.15.17:0/304524894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31f81030e0 con 0x7f31f80ffdc0 2024-09-20T18:33:08.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.908+0000 7f31f57fa640 1 -- 172.21.15.17:0/304524894 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f31e8004e60 con 0x7f31f80ffdc0 2024-09-20T18:33:08.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.909+0000 7f31f57fa640 1 --2- 172.21.15.17:0/304524894 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f31e406e2b0 0x7f31e4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:08.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.909+0000 7f31f57fa640 1 -- 172.21.15.17:0/304524894 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f31e808dd20 con 0x7f31f80ffdc0 2024-09-20T18:33:08.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.909+0000 7f31eeffd640 1 --2- 172.21.15.17:0/304524894 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f31e406e2b0 0x7f31e4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:08.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.909+0000 7f31eeffd640 1 --2- 172.21.15.17:0/304524894 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f31e406e2b0 0x7f31e4070770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f31f8102a30 tx=0x7f31e0031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:08.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:08.913+0000 7f31f57fa640 1 -- 172.21.15.17:0/304524894 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f31e805f330 con 0x7f31f80ffdc0 2024-09-20T18:33:09.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:09.164+0000 7f31fdf08640 1 -- 172.21.15.17:0/304524894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31f8100220 con 0x7f31f80ffdc0 2024-09-20T18:33:09.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:09.164+0000 7f31f57fa640 1 -- 172.21.15.17:0/304524894 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5351 (secure 0 0 0) 0x7f31e8063b60 con 0x7f31f80ffdc0 2024-09-20T18:33:09.179 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:33:09.180 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":15,"btime":"2024-09-20T18:33:05:524203+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":15,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T18:33:05.065474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14552,"mds_1":24325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14552":{"gid":14552,"name":"cephfs.smithi017.puqizo","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6827/3360305779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":3360305779},{"type":"v1","addr":"172.21.15.17:6827","nonce":3360305779}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14568":{"gid":14568,"name":"cephfs.smithi017.xhlvpy","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.17:6829/53113052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":53113052},{"type":"v1","addr":"172.21.15.17:6829","nonce":53113052}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24325":{"gid":24325,"name":"cephfs.smithi172.mugtlk","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6825/1043027893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1043027893},{"type":"v1","addr":"172.21.15.172:6825","nonce":1043027893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24339":{"gid":24339,"name":"cephfs.smithi172.liatxm","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.172:6827/2975309540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2975309540},{"type":"v1","addr":"172.21.15.172:6827","nonce":2975309540}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14552,"qdb_cluster":[24325,14552]},"id":1}]} 2024-09-20T18:33:09.180 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 15 2024-09-20T18:33:09.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:09.166+0000 7f31fdf08640 1 -- 172.21.15.17:0/304524894 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f31e406e2b0 msgr2=0x7f31e4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:09.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:09.166+0000 7f31fdf08640 1 --2- 172.21.15.17:0/304524894 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f31e406e2b0 0x7f31e4070770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f31f8102a30 tx=0x7f31e0031400 comp rx=0 tx=0).stop 2024-09-20T18:33:09.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:09.166+0000 7f31fdf08640 1 -- 172.21.15.17:0/304524894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31f80ffdc0 msgr2=0x7f31f8100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:09.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:09.166+0000 7f31fdf08640 1 --2- 172.21.15.17:0/304524894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31f80ffdc0 0x7f31f8100fa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f31e800d6f0 tx=0x7f31e800dbb0 comp rx=0 tx=0).stop 2024-09-20T18:33:09.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:09.166+0000 7f31fdf08640 1 -- 172.21.15.17:0/304524894 shutdown_connections 2024-09-20T18:33:09.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:09.166+0000 7f31fdf08640 1 --2- 172.21.15.17:0/304524894 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f31e406e2b0 0x7f31e4070770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:09.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:09.166+0000 7f31fdf08640 1 --2- 172.21.15.17:0/304524894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f81069a0 0x7f31f81014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:09.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:09.166+0000 7f31fdf08640 1 --2- 172.21.15.17:0/304524894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31f80ffdc0 0x7f31f8100fa0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:09.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:09.166+0000 7f31fdf08640 1 -- 172.21.15.17:0/304524894 >> 172.21.15.17:0/304524894 conn(0x7f31f80fbc90 msgr2=0x7f31f80fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:09.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:09.166+0000 7f31fdf08640 1 -- 172.21.15.17:0/304524894 shutdown_connections 2024-09-20T18:33:09.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:09.166+0000 7f31fdf08640 1 -- 172.21.15.17:0/304524894 wait complete. 2024-09-20T18:33:09.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:09 smithi172 ceph-mon[35456]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-20T18:33:09.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:09 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:33:09.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:09 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/304524894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-20T18:33:09.748 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:09 smithi017 ceph-mon[28058]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-20T18:33:09.748 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:09 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:33:09.748 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:09 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/304524894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-20T18:33:10.036 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 2, 'flags': 50} 2024-09-20T18:33:10.037 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-20T18:33:10.067 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-20T18:33:10.067 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-20T18:33:10.067 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-20T18:33:10.068 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-20T18:33:10.068 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-20T18:33:10.068 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-20T18:33:10.068 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-20T18:33:10.068 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-20T18:33:10.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:10.068 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-09-20T18:33:10.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:10.085 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2024-09-20T18:33:10.153 INFO:teuthology.orchestra.run.smithi172.stderr:Cannot find device "ceph-brx" 2024-09-20T18:33:10.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T18:33:10.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:10.155 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-20T18:33:10.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:10.173 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-09-20T18:33:10.243 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2024-09-20T18:33:10.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T18:33:10.245 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-20T18:33:10.245 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-20T18:33:10.245 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-20T18:33:10.569 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:33:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.989+0000 7ff1d4f59640 1 -- 172.21.15.17:0/1042011950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1d0106800 msgr2=0x7ff1d0106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.989+0000 7ff1d4f59640 1 --2- 172.21.15.17:0/1042011950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1d0106800 0x7ff1d0106be0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009880 tx=0x7ff1c002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:33:11.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.989+0000 7ff1d4f59640 1 -- 172.21.15.17:0/1042011950 shutdown_connections 2024-09-20T18:33:11.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.989+0000 7ff1d4f59640 1 --2- 172.21.15.17:0/1042011950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1d0100800 0x7ff1d0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:11.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.989+0000 7ff1d4f59640 1 --2- 172.21.15.17:0/1042011950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1d0106800 0x7ff1d0106be0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:11.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.989+0000 7ff1d4f59640 1 -- 172.21.15.17:0/1042011950 >> 172.21.15.17:0/1042011950 conn(0x7ff1d00fc520 msgr2=0x7ff1d00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:11.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.989+0000 7ff1d4f59640 1 -- 172.21.15.17:0/1042011950 shutdown_connections 2024-09-20T18:33:11.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.989+0000 7ff1d4f59640 1 -- 172.21.15.17:0/1042011950 wait complete. 2024-09-20T18:33:11.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.990+0000 7ff1d4f59640 1 Processor -- start 2024-09-20T18:33:11.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.990+0000 7ff1d4f59640 1 -- start start 2024-09-20T18:33:11.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.990+0000 7ff1d4f59640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1d0100800 0x7ff1d00fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:11.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.990+0000 7ff1d4f59640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1d0106800 0x7ff1d00fd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:11.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.990+0000 7ff1d4f59640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d010dd30 con 0x7ff1d0106800 2024-09-20T18:33:11.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.990+0000 7ff1d4f59640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d010dbb0 con 0x7ff1d0100800 2024-09-20T18:33:11.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.990+0000 7ff1cdd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1d0106800 0x7ff1d00fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:11.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.990+0000 7ff1cdd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1d0106800 0x7ff1d00fd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36048/0 (socket says 172.21.15.17:36048) 2024-09-20T18:33:11.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.990+0000 7ff1cdd9b640 1 -- 172.21.15.17:0/1059194949 learned_addr learned my addr 172.21.15.17:0/1059194949 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:33:11.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.990+0000 7ff1ce59c640 1 --2- 172.21.15.17:0/1059194949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1d0100800 0x7ff1d00fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:11.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.991+0000 7ff1cdd9b640 1 -- 172.21.15.17:0/1059194949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1d0100800 msgr2=0x7ff1d00fcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:11.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.991+0000 7ff1cdd9b640 1 --2- 172.21.15.17:0/1059194949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1d0100800 0x7ff1d00fcc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:11.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.991+0000 7ff1cdd9b640 1 -- 172.21.15.17:0/1059194949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d00fd710 con 0x7ff1d0106800 2024-09-20T18:33:11.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.991+0000 7ff1cdd9b640 1 --2- 172.21.15.17:0/1059194949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1d0106800 0x7ff1d00fd1d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400b420 tx=0x7ff1c400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:11.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.991+0000 7ff1bf7fe640 1 -- 172.21.15.17:0/1059194949 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff1c4011630 con 0x7ff1d0106800 2024-09-20T18:33:11.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.991+0000 7ff1d4f59640 1 -- 172.21.15.17:0/1059194949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d00fda00 con 0x7ff1d0106800 2024-09-20T18:33:11.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.991+0000 7ff1bf7fe640 1 -- 172.21.15.17:0/1059194949 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff1c4016070 con 0x7ff1d0106800 2024-09-20T18:33:11.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.991+0000 7ff1bf7fe640 1 -- 172.21.15.17:0/1059194949 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff1c4010d40 con 0x7ff1d0106800 2024-09-20T18:33:11.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.991+0000 7ff1d4f59640 1 -- 172.21.15.17:0/1059194949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d01a3f00 con 0x7ff1d0106800 2024-09-20T18:33:11.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.992+0000 7ff1d4f59640 1 -- 172.21.15.17:0/1059194949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d0101f40 con 0x7ff1d0106800 2024-09-20T18:33:11.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.993+0000 7ff1bf7fe640 1 -- 172.21.15.17:0/1059194949 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff1c401b460 con 0x7ff1d0106800 2024-09-20T18:33:11.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.993+0000 7ff1bf7fe640 1 --2- 172.21.15.17:0/1059194949 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff1b806e2b0 0x7ff1b8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:11.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.993+0000 7ff1bf7fe640 1 -- 172.21.15.17:0/1059194949 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7ff1c408da00 con 0x7ff1d0106800 2024-09-20T18:33:11.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.993+0000 7ff1ce59c640 1 --2- 172.21.15.17:0/1059194949 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff1b806e2b0 0x7ff1b8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:11.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.994+0000 7ff1ce59c640 1 --2- 172.21.15.17:0/1059194949 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff1b806e2b0 0x7ff1b8070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0031460 tx=0x7ff1c00095c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:11.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:10.998+0000 7ff1bf7fe640 1 -- 172.21.15.17:0/1059194949 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff1c405b360 con 0x7ff1d0106800 2024-09-20T18:33:11.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:11.212+0000 7ff1d4f59640 1 -- 172.21.15.17:0/1059194949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff1d00fe1c0 con 0x7ff1d0106800 2024-09-20T18:33:11.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:11.213+0000 7ff1bf7fe640 1 -- 172.21.15.17:0/1059194949 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+83 (secure 0 0 0) 0x7ff1c405f010 con 0x7ff1d0106800 2024-09-20T18:33:11.228 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-20T18:33:11.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:11.215+0000 7ff1d4f59640 1 -- 172.21.15.17:0/1059194949 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff1b806e2b0 msgr2=0x7ff1b8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:11.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:11.215+0000 7ff1d4f59640 1 --2- 172.21.15.17:0/1059194949 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff1b806e2b0 0x7ff1b8070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0031460 tx=0x7ff1c00095c0 comp rx=0 tx=0).stop 2024-09-20T18:33:11.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:11.215+0000 7ff1d4f59640 1 -- 172.21.15.17:0/1059194949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1d0106800 msgr2=0x7ff1d00fd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:11.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:11.215+0000 7ff1d4f59640 1 --2- 172.21.15.17:0/1059194949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1d0106800 0x7ff1d00fd1d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400b420 tx=0x7ff1c400b8e0 comp rx=0 tx=0).stop 2024-09-20T18:33:11.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:11.215+0000 7ff1d4f59640 1 -- 172.21.15.17:0/1059194949 shutdown_connections 2024-09-20T18:33:11.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:11.215+0000 7ff1d4f59640 1 --2- 172.21.15.17:0/1059194949 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff1b806e2b0 0x7ff1b8070770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:11.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:11.215+0000 7ff1d4f59640 1 --2- 172.21.15.17:0/1059194949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1d0106800 0x7ff1d00fd1d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:11.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:11.215+0000 7ff1d4f59640 1 --2- 172.21.15.17:0/1059194949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1d0100800 0x7ff1d00fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:11.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:11.215+0000 7ff1d4f59640 1 -- 172.21.15.17:0/1059194949 >> 172.21.15.17:0/1059194949 conn(0x7ff1d00fc520 msgr2=0x7ff1d006a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:11.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:11.215+0000 7ff1d4f59640 1 -- 172.21.15.17:0/1059194949 shutdown_connections 2024-09-20T18:33:11.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:11.215+0000 7ff1d4f59640 1 -- 172.21.15.17:0/1059194949 wait complete. 2024-09-20T18:33:11.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:11 smithi017 ceph-mon[28058]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-20T18:33:11.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:11 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:11.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:11 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:11.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:11 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1059194949' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-20T18:33:11.905 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-20T18:33:11.905 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-20T18:33:11.905 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-20T18:33:11.905 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-20T18:33:11.906 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-20T18:33:11.906 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-20T18:33:11.906 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-20T18:33:11.906 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-20T18:33:11.906 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-20T18:33:11.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:11.906 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-20T18:33:11.924 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-20T18:33:11.924 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-20T18:33:11.924 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-20T18:33:11.924 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-20T18:33:11.924 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-20T18:33:11.924 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-20T18:33:11.924 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-20T18:33:11.924 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-20T18:33:11.924 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-20T18:33:11.925 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-20T18:33:11.925 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-20T18:33:11.925 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-20T18:33:11.925 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-20T18:33:11.925 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-20T18:33:11.925 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-20T18:33:11.925 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-20T18:33:11.925 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42228sec preferred_lft 42228sec 2024-09-20T18:33:11.925 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-20T18:33:11.925 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-20T18:33:11.925 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-20T18:33:11.925 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-20T18:33:11.925 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-20T18:33:11.926 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-20T18:33:11.926 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T18:33:11.926 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-20T18:33:11.926 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2024-09-20T18:33:11.926 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2024-09-20T18:33:11.926 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2024-09-20T18:33:11.926 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-20T18:33:11.926 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-20T18:33:11.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:11 smithi172 ceph-mon[35456]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-20T18:33:11.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:11 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:11.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:11 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:11.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:11 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/1059194949' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-20T18:33:12.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T18:33:12.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T18:33:12.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:12.299 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-20T18:33:12.325 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-20T18:33:12.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:12.326 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-20T18:33:12.426 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-20T18:33:12.426 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-20T18:33:12.426 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-20T18:33:12.426 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-20T18:33:12.426 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-20T18:33:12.426 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T18:33:12.426 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-20T18:33:12.426 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-20T18:33:12.427 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-20T18:33:12.427 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-20T18:33:12.427 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-20T18:33:12.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T18:33:12.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T18:33:12.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:12.839 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-20T18:33:12.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:12.856 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2024-09-20T18:33:12.912 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T18:33:12.912 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-20T18:33:12.912 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T18:33:12.912 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-20T18:33:12.912 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-20T18:33:13.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T18:33:13.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T18:33:13.033 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-20T18:33:13.033 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T18:33:13.033 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-20T18:33:13.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-20T18:33:13.034 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-20T18:33:13.034 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-20T18:33:13.034 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-20T18:33:13.034 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-20T18:33:13.034 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-20T18:33:13.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T18:33:13.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T18:33:13.191 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T18:33:13.191 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-20T18:33:13.191 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-20T18:33:13.191 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2024-09-20T18:33:13.191 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-20T18:33:13.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T18:33:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T18:33:13.272 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-20T18:33:13.272 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-20T18:33:13.272 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-20T18:33:13.289 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-20T18:33:13.289 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-20T18:33:13.290 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-20T18:33:13.349 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-20T18:33:13.416 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-20T18:33:13.473 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-20T18:33:13.473 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-20T18:33:13.473 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-20T18:33:13.473 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-20T18:33:13.473 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-20T18:33:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-20T18:33:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-20T18:33:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-20T18:33:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-20T18:33:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-20T18:33:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-20T18:33:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-20T18:33:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T18:33:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-20T18:33:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-20T18:33:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-20T18:33:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-20T18:33:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-20T18:33:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-20T18:33:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-20T18:33:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-20T18:33:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-20T18:33:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-20T18:33:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-20T18:33:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-20T18:33:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay 2024-09-20T18:33:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/11835e5dd0da6c5e753ec80eff31cef501be61136ecbf1c7e9ea65d833686927/merged 2024-09-20T18:33:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/569033d8e692b9dcd535212a9e2cd81c13cc36071f024e824a49cc158396e9b5/merged 2024-09-20T18:33:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/0 2024-09-20T18:33:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T18:33:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/cb9fa9e2293e4df723d9fb2126c6565afcf13889ec352cd31397b64b83b786a3/merged 2024-09-20T18:33:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/f3dd4357ec4ca259d28694f1e3253ea869c0e900b76cf1fcb9e4bb755870aeb7/merged 2024-09-20T18:33:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/eb8dcc8d407eb70f66f7fe95d5e694da8b300f4b54aca319a2ebe2ef6157b842/merged 2024-09-20T18:33:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/39a7143565bbb96ca654f72d8af00664b16545b16d7f9d7fdf281b215932ca45/merged 2024-09-20T18:33:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/083f29c80f51fa4059f515b357e240b8fdf3d518a07c2a5c918b1f15b4089c97/merged 2024-09-20T18:33:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/70aa742bc11b9f498372622d5ac2de6dba282bf9bd060e3d449b2f1e72a7905b/merged 2024-09-20T18:33:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/c5025004036827f97cf021dc69fa3ec2a1197ead8cbddd6dcd505111e7bdce67/merged 2024-09-20T18:33:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/1fa548c411394439b465514034dac8e8f34258dd6b9c91c9c82c986a35686ad4/merged 2024-09-20T18:33:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/d23002f1bb7f27e40196ad26af26b01974067cb758996b19fcb2fa9e449650b7/merged 2024-09-20T18:33:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/e08be794f0fc17d164f2467fddc4caf7ed581e932d8d50db570eb0e740887a9a/merged 2024-09-20T18:33:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/cae911d290ac257a60e08c3c2a3ac1daf442ff8d98b366b85f334339eae3407d/merged 2024-09-20T18:33:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-20T18:33:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T18:33:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T18:33:13.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:13.477 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-20T18:33:13.533 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-20T18:33:13.534 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-20T18:33:13.577 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-20T18:33:13.605 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-20T18:33:13.664 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-20T18:33:13.664 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-20T18:33:13.664 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-20T18:33:13.664 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-20T18:33:13.664 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-20T18:33:13.664 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-20T18:33:13.664 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-20T18:33:13.664 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-20T18:33:13.664 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-20T18:33:13.664 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-20T18:33:13.664 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-20T18:33:13.664 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-20T18:33:13.665 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T18:33:13.665 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-20T18:33:13.665 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-20T18:33:13.665 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-20T18:33:13.665 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-20T18:33:13.665 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-20T18:33:13.665 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-20T18:33:13.665 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-20T18:33:13.665 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-20T18:33:13.665 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-20T18:33:13.665 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-20T18:33:13.665 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-20T18:33:13.665 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-20T18:33:13.666 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay 2024-09-20T18:33:13.666 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/11835e5dd0da6c5e753ec80eff31cef501be61136ecbf1c7e9ea65d833686927/merged 2024-09-20T18:33:13.666 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/569033d8e692b9dcd535212a9e2cd81c13cc36071f024e824a49cc158396e9b5/merged 2024-09-20T18:33:13.666 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/0 2024-09-20T18:33:13.666 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T18:33:13.666 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/cb9fa9e2293e4df723d9fb2126c6565afcf13889ec352cd31397b64b83b786a3/merged 2024-09-20T18:33:13.666 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/f3dd4357ec4ca259d28694f1e3253ea869c0e900b76cf1fcb9e4bb755870aeb7/merged 2024-09-20T18:33:13.666 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/eb8dcc8d407eb70f66f7fe95d5e694da8b300f4b54aca319a2ebe2ef6157b842/merged 2024-09-20T18:33:13.666 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/39a7143565bbb96ca654f72d8af00664b16545b16d7f9d7fdf281b215932ca45/merged 2024-09-20T18:33:13.666 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/083f29c80f51fa4059f515b357e240b8fdf3d518a07c2a5c918b1f15b4089c97/merged 2024-09-20T18:33:13.666 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/70aa742bc11b9f498372622d5ac2de6dba282bf9bd060e3d449b2f1e72a7905b/merged 2024-09-20T18:33:13.666 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/c5025004036827f97cf021dc69fa3ec2a1197ead8cbddd6dcd505111e7bdce67/merged 2024-09-20T18:33:13.667 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/1fa548c411394439b465514034dac8e8f34258dd6b9c91c9c82c986a35686ad4/merged 2024-09-20T18:33:13.667 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/d23002f1bb7f27e40196ad26af26b01974067cb758996b19fcb2fa9e449650b7/merged 2024-09-20T18:33:13.667 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/e08be794f0fc17d164f2467fddc4caf7ed581e932d8d50db570eb0e740887a9a/merged 2024-09-20T18:33:13.667 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/cae911d290ac257a60e08c3c2a3ac1daf442ff8d98b366b85f334339eae3407d/merged 2024-09-20T18:33:13.667 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-20T18:33:13.667 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T18:33:13.667 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T18:33:13.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:13.667 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-20T18:33:13.735 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-20T18:33:13.720+0000 7f2472101480 -1 init, newargv = 0x55673dbff310 newargc=15 2024-09-20T18:33:13.735 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[76345]: starting ceph client 2024-09-20T18:33:13.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[76345]: starting fuse 2024-09-20T18:33:13.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:13 smithi017 ceph-mon[28058]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-20T18:33:13.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:13 smithi172 ceph-mon[35456]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-20T18:33:14.822 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-20T18:33:14.852 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-20T18:33:14.909 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-20T18:33:14.909 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-20T18:33:14.909 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-20T18:33:14.909 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-20T18:33:14.909 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-20T18:33:14.909 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-20T18:33:14.909 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-20T18:33:14.909 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-20T18:33:14.910 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-20T18:33:14.910 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-20T18:33:14.910 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-20T18:33:14.910 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-09-20T18:33:14.910 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T18:33:14.910 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-20T18:33:14.910 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-20T18:33:14.910 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-20T18:33:14.910 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-20T18:33:14.910 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-20T18:33:14.910 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-20T18:33:14.910 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-09-20T18:33:14.910 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-20T18:33:14.910 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-20T18:33:14.910 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-09-20T18:33:14.911 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-20T18:33:14.911 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-20T18:33:14.911 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay 2024-09-20T18:33:14.911 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/11835e5dd0da6c5e753ec80eff31cef501be61136ecbf1c7e9ea65d833686927/merged 2024-09-20T18:33:14.911 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/569033d8e692b9dcd535212a9e2cd81c13cc36071f024e824a49cc158396e9b5/merged 2024-09-20T18:33:14.911 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/0 2024-09-20T18:33:14.911 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T18:33:14.911 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/cb9fa9e2293e4df723d9fb2126c6565afcf13889ec352cd31397b64b83b786a3/merged 2024-09-20T18:33:14.911 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/f3dd4357ec4ca259d28694f1e3253ea869c0e900b76cf1fcb9e4bb755870aeb7/merged 2024-09-20T18:33:14.911 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/eb8dcc8d407eb70f66f7fe95d5e694da8b300f4b54aca319a2ebe2ef6157b842/merged 2024-09-20T18:33:14.911 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/39a7143565bbb96ca654f72d8af00664b16545b16d7f9d7fdf281b215932ca45/merged 2024-09-20T18:33:14.911 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/083f29c80f51fa4059f515b357e240b8fdf3d518a07c2a5c918b1f15b4089c97/merged 2024-09-20T18:33:14.911 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/70aa742bc11b9f498372622d5ac2de6dba282bf9bd060e3d449b2f1e72a7905b/merged 2024-09-20T18:33:14.911 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/c5025004036827f97cf021dc69fa3ec2a1197ead8cbddd6dcd505111e7bdce67/merged 2024-09-20T18:33:14.911 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/1fa548c411394439b465514034dac8e8f34258dd6b9c91c9c82c986a35686ad4/merged 2024-09-20T18:33:14.912 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/d23002f1bb7f27e40196ad26af26b01974067cb758996b19fcb2fa9e449650b7/merged 2024-09-20T18:33:14.912 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/e08be794f0fc17d164f2467fddc4caf7ed581e932d8d50db570eb0e740887a9a/merged 2024-09-20T18:33:14.912 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/cae911d290ac257a60e08c3c2a3ac1daf442ff8d98b366b85f334339eae3407d/merged 2024-09-20T18:33:14.912 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-20T18:33:14.912 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T18:33:14.912 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-20T18:33:14.912 INFO:teuthology.orchestra.run.smithi017.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-20T18:33:14.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:14.912 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-20T18:33:14.965 INFO:teuthology.orchestra.run.smithi017.stdout:165 2024-09-20T18:33:14.965 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [165] 2024-09-20T18:33:14.965 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-20T18:33:14.965 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-20T18:33:14.965 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-20T18:33:14.966 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-20T18:33:14.966 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-20T18:33:14.966 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-20T18:33:14.966 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-20T18:33:14.966 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-20T18:33:14.966 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-20T18:33:14.966 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-20T18:33:14.966 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-20T18:33:14.966 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-20T18:33:14.966 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-20T18:33:14.966 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-20T18:33:14.966 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-20T18:33:14.966 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-20T18:33:14.966 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-20T18:33:14.966 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-20T18:33:14.966 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-20T18:33:14.966 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-20T18:33:14.967 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-20T18:33:14.967 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-20T18:33:14.967 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-20T18:33:14.967 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-20T18:33:14.967 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-20T18:33:14.967 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-20T18:33:14.967 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-20T18:33:15.086 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.76345.asok 2024-09-20T18:33:15.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T18:33:15.097 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.76345.asok 2024-09-20T18:33:15.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:15.097 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.76345.asok status 2024-09-20T18:33:15.235 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:33:15.235 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-20T18:33:15.235 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "ed8ee0f26ef720e6504cefa8be1a2d0872192de7", 2024-09-20T18:33:15.235 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)", 2024-09-20T18:33:15.235 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-20T18:33:15.235 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-20T18:33:15.235 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-20T18:33:15.235 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "76345", 2024-09-20T18:33:15.235 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-20T18:33:15.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:33:15.235 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-20T18:33:15.236 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-20T18:33:15.236 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 14600, 2024-09-20T18:33:15.236 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-20T18:33:15.236 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-20T18:33:15.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-20T18:33:15.236 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 14600 2024-09-20T18:33:15.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:33:15.236 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-20T18:33:15.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-20T18:33:15.236 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-20T18:33:15.236 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 4159009387 2024-09-20T18:33:15.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:33:15.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:33:15.236 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-20T18:33:15.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-20T18:33:15.237 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-20T18:33:15.237 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 4159009387 2024-09-20T18:33:15.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:33:15.237 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.14600 192.168.0.1:0/4159009387", 2024-09-20T18:33:15.237 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/4159009387", 2024-09-20T18:33:15.237 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-20T18:33:15.237 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 15, 2024-09-20T18:33:15.237 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 44, 2024-09-20T18:33:15.237 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-20T18:33:15.237 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-20T18:33:15.237 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-20T18:33:15.237 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:33:15.243 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-20T18:33:15.244 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-20T18:33:15.496 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:33:15.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:15 smithi017 ceph-mon[28058]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-20T18:33:15.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:15 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:15.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:15 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:15.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:15 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:33:15.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:15 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:33:15.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:15 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:15.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:15 smithi172 ceph-mon[35456]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-20T18:33:15.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:15 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:15.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:15 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:15.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:15 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:33:15.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:15 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:33:15.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:15 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:33:15.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.979+0000 7fc8cb942640 1 -- 172.21.15.17:0/322526730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8c4107900 msgr2=0x7fc8c4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:15.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.979+0000 7fc8cb942640 1 --2- 172.21.15.17:0/322526730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8c4107900 0x7fc8c4107ce0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009880 tx=0x7fc8c002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:33:15.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.979+0000 7fc8cb942640 1 -- 172.21.15.17:0/322526730 shutdown_connections 2024-09-20T18:33:15.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.979+0000 7fc8cb942640 1 --2- 172.21.15.17:0/322526730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8c4101900 0x7fc8c4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:15.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.979+0000 7fc8cb942640 1 --2- 172.21.15.17:0/322526730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8c4107900 0x7fc8c4107ce0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:15.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.979+0000 7fc8cb942640 1 -- 172.21.15.17:0/322526730 >> 172.21.15.17:0/322526730 conn(0x7fc8c40fd600 msgr2=0x7fc8c40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:15.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.979+0000 7fc8cb942640 1 -- 172.21.15.17:0/322526730 shutdown_connections 2024-09-20T18:33:15.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.979+0000 7fc8cb942640 1 -- 172.21.15.17:0/322526730 wait complete. 2024-09-20T18:33:15.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.980+0000 7fc8cb942640 1 Processor -- start 2024-09-20T18:33:15.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.980+0000 7fc8cb942640 1 -- start start 2024-09-20T18:33:15.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.980+0000 7fc8cb942640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8c4101900 0x7fc8c419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:15.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.980+0000 7fc8cb942640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8c4107900 0x7fc8c419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:15.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.980+0000 7fc8cb942640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c410edb0 con 0x7fc8c4107900 2024-09-20T18:33:15.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.980+0000 7fc8cb942640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c410ec30 con 0x7fc8c4101900 2024-09-20T18:33:15.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.980+0000 7fc8c8edd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8c4107900 0x7fc8c419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:15.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.980+0000 7fc8c8edd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8c4107900 0x7fc8c419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36064/0 (socket says 172.21.15.17:36064) 2024-09-20T18:33:15.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.980+0000 7fc8c8edd640 1 -- 172.21.15.17:0/4209355452 learned_addr learned my addr 172.21.15.17:0/4209355452 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:33:15.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.981+0000 7fc8c96de640 1 --2- 172.21.15.17:0/4209355452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8c4101900 0x7fc8c419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:15.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.981+0000 7fc8c8edd640 1 -- 172.21.15.17:0/4209355452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8c4101900 msgr2=0x7fc8c419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:15.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.981+0000 7fc8c8edd640 1 --2- 172.21.15.17:0/4209355452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8c4101900 0x7fc8c419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:15.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.981+0000 7fc8c8edd640 1 -- 172.21.15.17:0/4209355452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c41977c0 con 0x7fc8c4107900 2024-09-20T18:33:15.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.981+0000 7fc8c8edd640 1 --2- 172.21.15.17:0/4209355452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8c4107900 0x7fc8c419db80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400c8a0 tx=0x7fc8b400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:15.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.981+0000 7fc8ba7fc640 1 -- 172.21.15.17:0/4209355452 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc8b40079b0 con 0x7fc8c4107900 2024-09-20T18:33:15.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.981+0000 7fc8ba7fc640 1 -- 172.21.15.17:0/4209355452 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc8b4007b50 con 0x7fc8c4107900 2024-09-20T18:33:15.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.981+0000 7fc8cb942640 1 -- 172.21.15.17:0/4209355452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c4197ab0 con 0x7fc8c4107900 2024-09-20T18:33:15.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.981+0000 7fc8ba7fc640 1 -- 172.21.15.17:0/4209355452 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc8b4018700 con 0x7fc8c4107900 2024-09-20T18:33:15.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.981+0000 7fc8cb942640 1 -- 172.21.15.17:0/4209355452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c4198040 con 0x7fc8c4107900 2024-09-20T18:33:15.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.982+0000 7fc8cb942640 1 -- 172.21.15.17:0/4209355452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8c4103040 con 0x7fc8c4107900 2024-09-20T18:33:15.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.983+0000 7fc8ba7fc640 1 -- 172.21.15.17:0/4209355452 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc8b4007d00 con 0x7fc8c4107900 2024-09-20T18:33:15.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.983+0000 7fc8ba7fc640 1 --2- 172.21.15.17:0/4209355452 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc8b006e2b0 0x7fc8b0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:15.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.983+0000 7fc8ba7fc640 1 -- 172.21.15.17:0/4209355452 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fc8b408e3e0 con 0x7fc8c4107900 2024-09-20T18:33:15.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.983+0000 7fc8c96de640 1 --2- 172.21.15.17:0/4209355452 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc8b006e2b0 0x7fc8b0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:15.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.984+0000 7fc8c96de640 1 --2- 172.21.15.17:0/4209355452 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc8b006e2b0 0x7fc8b0070770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0031460 tx=0x7fc8c0009560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:16.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:15.988+0000 7fc8ba7fc640 1 -- 172.21.15.17:0/4209355452 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc8b4014030 con 0x7fc8c4107900 2024-09-20T18:33:16.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:16.200+0000 7fc8cb942640 1 -- 172.21.15.17:0/4209355452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc8c4104b10 con 0x7fc8c4107900 2024-09-20T18:33:16.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:16.201+0000 7fc8ba7fc640 1 -- 172.21.15.17:0/4209355452 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+83 (secure 0 0 0) 0x7fc8b408ce20 con 0x7fc8c4107900 2024-09-20T18:33:16.216 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-20T18:33:16.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:16.203+0000 7fc8cb942640 1 -- 172.21.15.17:0/4209355452 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc8b006e2b0 msgr2=0x7fc8b0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:16.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:16.203+0000 7fc8cb942640 1 --2- 172.21.15.17:0/4209355452 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc8b006e2b0 0x7fc8b0070770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0031460 tx=0x7fc8c0009560 comp rx=0 tx=0).stop 2024-09-20T18:33:16.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:16.203+0000 7fc8cb942640 1 -- 172.21.15.17:0/4209355452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8c4107900 msgr2=0x7fc8c419db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:16.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:16.203+0000 7fc8cb942640 1 --2- 172.21.15.17:0/4209355452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8c4107900 0x7fc8c419db80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400c8a0 tx=0x7fc8b400cd60 comp rx=0 tx=0).stop 2024-09-20T18:33:16.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:16.203+0000 7fc8cb942640 1 -- 172.21.15.17:0/4209355452 shutdown_connections 2024-09-20T18:33:16.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:16.203+0000 7fc8cb942640 1 --2- 172.21.15.17:0/4209355452 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc8b006e2b0 0x7fc8b0070770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:16.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:16.203+0000 7fc8cb942640 1 --2- 172.21.15.17:0/4209355452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8c4107900 0x7fc8c419db80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:16.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:16.203+0000 7fc8cb942640 1 --2- 172.21.15.17:0/4209355452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8c4101900 0x7fc8c419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:16.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:16.203+0000 7fc8cb942640 1 -- 172.21.15.17:0/4209355452 >> 172.21.15.17:0/4209355452 conn(0x7fc8c40fd600 msgr2=0x7fc8c40ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:16.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:16.203+0000 7fc8cb942640 1 -- 172.21.15.17:0/4209355452 shutdown_connections 2024-09-20T18:33:16.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:16.203+0000 7fc8cb942640 1 -- 172.21.15.17:0/4209355452 wait complete. 2024-09-20T18:33:16.830 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:16 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/4209355452' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-20T18:33:16.862 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-20T18:33:16.862 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-20T18:33:16.862 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-09-20T18:33:16.862 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-20T18:33:16.862 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-20T18:33:16.862 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-20T18:33:16.862 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-20T18:33:16.862 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-20T18:33:16.862 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-20T18:33:16.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:16.863 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-09-20T18:33:16.882 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-20T18:33:16.883 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-20T18:33:16.883 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-09-20T18:33:16.883 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-09-20T18:33:16.883 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-09-20T18:33:16.883 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-09-20T18:33:16.883 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-20T18:33:16.883 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-09-20T18:33:16.883 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-09-20T18:33:16.883 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-20T18:33:16.883 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-09-20T18:33:16.883 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-09-20T18:33:16.883 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-20T18:33:16.884 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-09-20T18:33:16.884 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-20T18:33:16.884 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-09-20T18:33:16.884 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-20T18:33:16.884 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42230sec preferred_lft 42230sec 2024-09-20T18:33:16.884 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::ec4:7aff:fe88:7f91/64 scope link noprefixroute 2024-09-20T18:33:16.884 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-09-20T18:33:16.884 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-20T18:33:16.884 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T18:33:16.884 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-09-20T18:33:16.884 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add name ceph-brx type bridge 2024-09-20T18:33:16.885 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr flush dev ceph-brx 2024-09-20T18:33:16.885 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set ceph-brx up 2024-09-20T18:33:16.885 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-20T18:33:16.885 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-09-20T18:33:16.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:16 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/4209355452' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-20T18:33:16.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:33:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T18:33:17.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T18:33:17.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:17.106 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-20T18:33:17.171 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-09-20T18:33:17.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:17.173 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-09-20T18:33:17.241 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-09-20T18:33:17.241 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-20T18:33:17.242 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-20T18:33:17.242 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-20T18:33:17.242 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-20T18:33:17.242 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T18:33:17.242 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-09-20T18:33:17.242 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-20T18:33:17.242 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-20T18:33:17.242 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-20T18:33:17.242 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-09-20T18:33:17.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:33:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T18:33:17.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T18:33:17.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:17.530 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-09-20T18:33:17.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:17.547 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list-id 2024-09-20T18:33:17.603 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T18:33:17.604 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-09-20T18:33:17.604 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-20T18:33:17.604 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-20T18:33:17.604 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-09-20T18:33:17.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:17 smithi172 ceph-mon[35456]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-20T18:33:17.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:33:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T18:33:17.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T18:33:17.701 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-20T18:33:17.701 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T18:33:17.701 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-09-20T18:33:17.701 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-20T18:33:17.701 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-20T18:33:17.701 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-20T18:33:17.701 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-20T18:33:17.702 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-20T18:33:17.702 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-09-20T18:33:17.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:33:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T18:33:17.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T18:33:17.829 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-20T18:33:17.829 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-09-20T18:33:17.829 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2024-09-20T18:33:17.829 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set dev brx.0 master ceph-brx 2024-09-20T18:33:17.830 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-09-20T18:33:17.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:33:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-20T18:33:17.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:17 smithi017 ceph-mon[28058]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-20T18:33:17.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T18:33:17.912 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-20T18:33:17.912 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-20T18:33:17.912 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-20T18:33:17.927 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-20T18:33:17.928 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-20T18:33:17.928 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-20T18:33:17.983 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2024-09-20T18:33:18.049 DEBUG:teuthology.orchestra.run.smithi172:> cat /proc/self/mounts | awk '{print $2}' 2024-09-20T18:33:18.106 INFO:teuthology.orchestra.run.smithi172.stdout:/proc 2024-09-20T18:33:18.106 INFO:teuthology.orchestra.run.smithi172.stdout:/sys 2024-09-20T18:33:18.107 INFO:teuthology.orchestra.run.smithi172.stdout:/dev 2024-09-20T18:33:18.107 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/security 2024-09-20T18:33:18.107 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/shm 2024-09-20T18:33:18.107 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/pts 2024-09-20T18:33:18.107 INFO:teuthology.orchestra.run.smithi172.stdout:/run 2024-09-20T18:33:18.107 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/cgroup 2024-09-20T18:33:18.107 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/pstore 2024-09-20T18:33:18.107 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/bpf 2024-09-20T18:33:18.107 INFO:teuthology.orchestra.run.smithi172.stdout:/ 2024-09-20T18:33:18.107 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/selinux 2024-09-20T18:33:18.108 INFO:teuthology.orchestra.run.smithi172.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T18:33:18.108 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/mqueue 2024-09-20T18:33:18.108 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/hugepages 2024-09-20T18:33:18.108 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/debug 2024-09-20T18:33:18.108 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/tracing 2024-09-20T18:33:18.108 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/fuse/connections 2024-09-20T18:33:18.108 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/config 2024-09-20T18:33:18.108 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-sysctl.service 2024-09-20T18:33:18.108 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-20T18:33:18.108 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-20T18:33:18.108 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/nfs/rpc_pipefs 2024-09-20T18:33:18.109 INFO:teuthology.orchestra.run.smithi172.stdout:/run/user/1000 2024-09-20T18:33:18.109 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/ceph 2024-09-20T18:33:18.109 INFO:teuthology.orchestra.run.smithi172.stdout:/run/user/0 2024-09-20T18:33:18.109 INFO:teuthology.orchestra.run.smithi172.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T18:33:18.109 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay 2024-09-20T18:33:18.109 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/3657bd26b0ad11cf35aac9811f63dcf44ee2727b5a4de48b686bfc532a9d3419/merged 2024-09-20T18:33:18.109 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/cf67b338b301442b58e17e195dd459fca3ad030b4d6e87a0ee204a7c4d9f5b74/merged 2024-09-20T18:33:18.109 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/53848a5a2e402cb738746c96f3e0cb38085235ad38355358072f39b6aeaf6319/merged 2024-09-20T18:33:18.109 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/767b85ae09b652fd3674ab73bddde11208244bb1bf0bd97189ca1ee285f56058/merged 2024-09-20T18:33:18.109 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/8d2268f1ce0d0158cd6f783a276f43ee042c201c9eff6bdcec1f6d90edb5bed4/merged 2024-09-20T18:33:18.109 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/29081cefdaf0780a9d1dbb49be15c3c976b41b318f15e01b16b500cbff877828/merged 2024-09-20T18:33:18.110 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/0d6aa018e2ca7ac39789c65a671bf57037e059529e9c5c314a18e7af4927b922/merged 2024-09-20T18:33:18.110 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/74b025d865c98bd727b42274a182c217ec23c079af93655fe90355cceb162bac/merged 2024-09-20T18:33:18.110 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/136107dfc271dcacd9f1a881ae44c8e8369dce96f17dbc82d603609111d54cf4/merged 2024-09-20T18:33:18.110 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/3c6ed8e9f0e7b769d1b12122ae69470ed3516afc97d293752adbf38bca6606bd/merged 2024-09-20T18:33:18.110 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns 2024-09-20T18:33:18.110 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-20T18:33:18.110 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-20T18:33:18.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:18.110 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2024-09-20T18:33:18.162 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-20T18:33:18.162 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-20T18:33:18.205 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2024-09-20T18:33:18.229 DEBUG:teuthology.orchestra.run.smithi172:> cat /proc/self/mounts | awk '{print $2}' 2024-09-20T18:33:18.286 INFO:teuthology.orchestra.run.smithi172.stdout:/proc 2024-09-20T18:33:18.286 INFO:teuthology.orchestra.run.smithi172.stdout:/sys 2024-09-20T18:33:18.286 INFO:teuthology.orchestra.run.smithi172.stdout:/dev 2024-09-20T18:33:18.286 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/security 2024-09-20T18:33:18.286 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/shm 2024-09-20T18:33:18.286 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/pts 2024-09-20T18:33:18.286 INFO:teuthology.orchestra.run.smithi172.stdout:/run 2024-09-20T18:33:18.286 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/cgroup 2024-09-20T18:33:18.286 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/pstore 2024-09-20T18:33:18.287 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/bpf 2024-09-20T18:33:18.287 INFO:teuthology.orchestra.run.smithi172.stdout:/ 2024-09-20T18:33:18.287 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/selinux 2024-09-20T18:33:18.287 INFO:teuthology.orchestra.run.smithi172.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T18:33:18.287 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/mqueue 2024-09-20T18:33:18.287 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/hugepages 2024-09-20T18:33:18.287 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/debug 2024-09-20T18:33:18.287 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/tracing 2024-09-20T18:33:18.287 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/fuse/connections 2024-09-20T18:33:18.287 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/config 2024-09-20T18:33:18.287 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-sysctl.service 2024-09-20T18:33:18.287 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-20T18:33:18.288 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-20T18:33:18.288 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/nfs/rpc_pipefs 2024-09-20T18:33:18.288 INFO:teuthology.orchestra.run.smithi172.stdout:/run/user/1000 2024-09-20T18:33:18.288 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/ceph 2024-09-20T18:33:18.288 INFO:teuthology.orchestra.run.smithi172.stdout:/run/user/0 2024-09-20T18:33:18.288 INFO:teuthology.orchestra.run.smithi172.stdout:/proc/sys/fs/binfmt_misc 2024-09-20T18:33:18.288 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay 2024-09-20T18:33:18.288 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/3657bd26b0ad11cf35aac9811f63dcf44ee2727b5a4de48b686bfc532a9d3419/merged 2024-09-20T18:33:18.288 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/cf67b338b301442b58e17e195dd459fca3ad030b4d6e87a0ee204a7c4d9f5b74/merged 2024-09-20T18:33:18.288 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/53848a5a2e402cb738746c96f3e0cb38085235ad38355358072f39b6aeaf6319/merged 2024-09-20T18:33:18.288 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/767b85ae09b652fd3674ab73bddde11208244bb1bf0bd97189ca1ee285f56058/merged 2024-09-20T18:33:18.288 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/8d2268f1ce0d0158cd6f783a276f43ee042c201c9eff6bdcec1f6d90edb5bed4/merged 2024-09-20T18:33:18.289 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/29081cefdaf0780a9d1dbb49be15c3c976b41b318f15e01b16b500cbff877828/merged 2024-09-20T18:33:18.289 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/0d6aa018e2ca7ac39789c65a671bf57037e059529e9c5c314a18e7af4927b922/merged 2024-09-20T18:33:18.289 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/74b025d865c98bd727b42274a182c217ec23c079af93655fe90355cceb162bac/merged 2024-09-20T18:33:18.289 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/136107dfc271dcacd9f1a881ae44c8e8369dce96f17dbc82d603609111d54cf4/merged 2024-09-20T18:33:18.289 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/containers/storage/overlay/3c6ed8e9f0e7b769d1b12122ae69470ed3516afc97d293752adbf38bca6606bd/merged 2024-09-20T18:33:18.289 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns 2024-09-20T18:33:18.289 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-20T18:33:18.289 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-20T18:33:18.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:18.289 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2024-09-20T18:33:18.322 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:2024-09-20T18:33:18.308+0000 7fd39040b480 -1 init, newargv = 0x55cc69964f80 newargc=15 2024-09-20T18:33:18.322 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[61510]: starting ceph client 2024-09-20T18:33:18.330 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi172.stderr:ceph-fuse[61510]: starting fuse 2024-09-20T18:33:18.339 INFO:teuthology.orchestra.run.smithi172.stdout:129 2024-09-20T18:33:18.339 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [129] 2024-09-20T18:33:18.339 DEBUG:teuthology.orchestra.run.smithi172:> sudo stdin-killer -- python3 -c ' 2024-09-20T18:33:18.339 DEBUG:teuthology.orchestra.run.smithi172:> import glob 2024-09-20T18:33:18.340 DEBUG:teuthology.orchestra.run.smithi172:> import re 2024-09-20T18:33:18.340 DEBUG:teuthology.orchestra.run.smithi172:> import os 2024-09-20T18:33:18.340 DEBUG:teuthology.orchestra.run.smithi172:> import subprocess 2024-09-20T18:33:18.340 DEBUG:teuthology.orchestra.run.smithi172:> 2024-09-20T18:33:18.340 DEBUG:teuthology.orchestra.run.smithi172:> def _find_admin_socket(client_name): 2024-09-20T18:33:18.340 DEBUG:teuthology.orchestra.run.smithi172:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-20T18:33:18.340 DEBUG:teuthology.orchestra.run.smithi172:> files = glob.glob(asok_path) 2024-09-20T18:33:18.340 DEBUG:teuthology.orchestra.run.smithi172:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-20T18:33:18.340 DEBUG:teuthology.orchestra.run.smithi172:> 2024-09-20T18:33:18.340 DEBUG:teuthology.orchestra.run.smithi172:> # Given a non-glob path, it better be there 2024-09-20T18:33:18.340 DEBUG:teuthology.orchestra.run.smithi172:> if "*" not in asok_path: 2024-09-20T18:33:18.340 DEBUG:teuthology.orchestra.run.smithi172:> assert(len(files) == 1) 2024-09-20T18:33:18.340 DEBUG:teuthology.orchestra.run.smithi172:> return files[0] 2024-09-20T18:33:18.341 DEBUG:teuthology.orchestra.run.smithi172:> 2024-09-20T18:33:18.341 DEBUG:teuthology.orchestra.run.smithi172:> for f in files: 2024-09-20T18:33:18.341 DEBUG:teuthology.orchestra.run.smithi172:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-20T18:33:18.341 DEBUG:teuthology.orchestra.run.smithi172:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-20T18:33:18.341 DEBUG:teuthology.orchestra.run.smithi172:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-20T18:33:18.341 DEBUG:teuthology.orchestra.run.smithi172:> contents = proc_f.read() 2024-09-20T18:33:18.341 DEBUG:teuthology.orchestra.run.smithi172:> if mountpoint in contents: 2024-09-20T18:33:18.341 DEBUG:teuthology.orchestra.run.smithi172:> return f 2024-09-20T18:33:18.341 DEBUG:teuthology.orchestra.run.smithi172:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-20T18:33:18.341 DEBUG:teuthology.orchestra.run.smithi172:> 2024-09-20T18:33:18.341 DEBUG:teuthology.orchestra.run.smithi172:> print(_find_admin_socket("client.1")) 2024-09-20T18:33:18.341 DEBUG:teuthology.orchestra.run.smithi172:> ' 2024-09-20T18:33:18.458 INFO:teuthology.orchestra.run.smithi172.stdout:/var/run/ceph/ceph-client.1.61510.asok 2024-09-20T18:33:18.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-20T18:33:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-20T18:33:18.469 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.61510.asok 2024-09-20T18:33:18.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:18.469 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.61510.asok status 2024-09-20T18:33:18.603 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-20T18:33:18.603 INFO:teuthology.orchestra.run.smithi172.stdout: "metadata": { 2024-09-20T18:33:18.603 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_sha1": "ed8ee0f26ef720e6504cefa8be1a2d0872192de7", 2024-09-20T18:33:18.603 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)", 2024-09-20T18:33:18.603 INFO:teuthology.orchestra.run.smithi172.stdout: "entity_id": "1", 2024-09-20T18:33:18.603 INFO:teuthology.orchestra.run.smithi172.stdout: "hostname": "smithi172", 2024-09-20T18:33:18.603 INFO:teuthology.orchestra.run.smithi172.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-20T18:33:18.604 INFO:teuthology.orchestra.run.smithi172.stdout: "pid": "61510", 2024-09-20T18:33:18.604 INFO:teuthology.orchestra.run.smithi172.stdout: "root": "/" 2024-09-20T18:33:18.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-20T18:33:18.604 INFO:teuthology.orchestra.run.smithi172.stdout: "dentry_count": 0, 2024-09-20T18:33:18.604 INFO:teuthology.orchestra.run.smithi172.stdout: "dentry_pinned_count": 0, 2024-09-20T18:33:18.604 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 24355, 2024-09-20T18:33:18.604 INFO:teuthology.orchestra.run.smithi172.stdout: "inst": { 2024-09-20T18:33:18.604 INFO:teuthology.orchestra.run.smithi172.stdout: "name": { 2024-09-20T18:33:18.604 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "client", 2024-09-20T18:33:18.604 INFO:teuthology.orchestra.run.smithi172.stdout: "num": 24355 2024-09-20T18:33:18.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-20T18:33:18.604 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": { 2024-09-20T18:33:18.605 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "v1", 2024-09-20T18:33:18.605 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": "192.168.0.1:0", 2024-09-20T18:33:18.605 INFO:teuthology.orchestra.run.smithi172.stdout: "nonce": 2617768171 2024-09-20T18:33:18.605 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-20T18:33:18.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-20T18:33:18.605 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": { 2024-09-20T18:33:18.605 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "v1", 2024-09-20T18:33:18.605 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": "192.168.0.1:0", 2024-09-20T18:33:18.605 INFO:teuthology.orchestra.run.smithi172.stdout: "nonce": 2617768171 2024-09-20T18:33:18.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-20T18:33:18.605 INFO:teuthology.orchestra.run.smithi172.stdout: "inst_str": "client.24355 192.168.0.1:0/2617768171", 2024-09-20T18:33:18.605 INFO:teuthology.orchestra.run.smithi172.stdout: "addr_str": "192.168.0.1:0/2617768171", 2024-09-20T18:33:18.605 INFO:teuthology.orchestra.run.smithi172.stdout: "inode_count": 1, 2024-09-20T18:33:18.605 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_epoch": 15, 2024-09-20T18:33:18.606 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_epoch": 44, 2024-09-20T18:33:18.606 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_epoch_barrier": 0, 2024-09-20T18:33:18.606 INFO:teuthology.orchestra.run.smithi172.stdout: "blocklisted": false, 2024-09-20T18:33:18.606 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs" 2024-09-20T18:33:18.606 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-20T18:33:18.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:18.612 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-20T18:33:18.612 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-20T18:33:18.633 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-20T18:33:18.634 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-20T18:33:18.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:18.634 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-20T18:33:18.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:18.922 DEBUG:teuthology.orchestra.run.smithi172:> stat --file-system '--printf=%T 2024-09-20T18:33:18.922 DEBUG:teuthology.orchestra.run.smithi172:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-20T18:33:18.938 INFO:teuthology.orchestra.run.smithi172.stdout:fuseblk 2024-09-20T18:33:18.938 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-20T18:33:18.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T18:33:18.939 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-20T18:33:19.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:19 smithi017 ceph-mon[28058]: pgmap v187: 65 pgs: 65 active+clean; 581 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-20T18:33:19.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:19 smithi172 ceph-mon[35456]: pgmap v187: 65 pgs: 65 active+clean; 581 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-20T18:33:21.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:21 smithi017 ceph-mon[28058]: pgmap v188: 65 pgs: 65 active+clean; 581 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-09-20T18:33:21.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:21 smithi172 ceph-mon[35456]: pgmap v188: 65 pgs: 65 active+clean; 581 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-09-20T18:33:22.953 INFO:teuthology.run_tasks:Running task print... 2024-09-20T18:33:22.965 INFO:teuthology.task.print:**** done client 2024-09-20T18:33:22.965 INFO:teuthology.run_tasks:Running task parallel... 2024-09-20T18:33:22.988 INFO:teuthology.task.parallel:starting parallel... 2024-09-20T18:33:22.988 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-20T18:33:22.988 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-20T18:33:22.989 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-20T18:33:22.989 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-20T18:33:22.989 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-20T18:33:22.989 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-20T18:33:22.993 INFO:tasks.workunit:Pulling workunits from ref 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:33:22.994 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-20T18:33:22.994 INFO:tasks.workunit:timeout=3h 2024-09-20T18:33:22.994 INFO:tasks.workunit:cleanup=True 2024-09-20T18:33:22.994 DEBUG:teuthology.orchestra.run.smithi017:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-20T18:33:23.016 INFO:teuthology.orchestra.run.smithi017.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-20T18:33:23.016 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-20T18:33:23.016 INFO:teuthology.orchestra.run.smithi017.stdout:Device: a5h/165d Inode: 1 Links: 2 2024-09-20T18:33:23.016 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:33:23.016 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-20T18:33:23.016 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-20T18:33:23.016 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-20 18:32:53.541148107 +0000 2024-09-20T18:33:23.016 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-20 18:33:18.692603222 +0000 2024-09-20T18:33:23.016 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2024-09-20T18:33:23.016 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-20T18:33:23.016 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-20T18:33:23.090 DEBUG:teuthology.orchestra.run.smithi172:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-20T18:33:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-20T18:33:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-20T18:33:23.108 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-20T18:33:23.108 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-20T18:33:23.108 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-20T18:33:23.108 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-20T18:33:23.108 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-20 18:33:23.070948048 +0000 2024-09-20T18:33:23.108 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-20 18:33:23.070948048 +0000 2024-09-20T18:33:23.108 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2024-09-20T18:33:23.108 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-20T18:33:23.108 DEBUG:teuthology.orchestra.run.smithi172:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-20T18:33:23.180 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:33:23.180 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:33:23.197 INFO:tasks.workunit.client.0.smithi017.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-20T18:33:23.235 INFO:tasks.workunit.client.1.smithi172.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-20T18:33:23.277 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:33:23.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:23 smithi017 ceph-mon[28058]: pgmap v189: 65 pgs: 65 active+clean; 582 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-20T18:33:23.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:23 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:33:23.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.749+0000 7feb4f638640 1 -- 172.21.15.17:0/2052425354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48100860 msgr2=0x7feb48100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:23.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.749+0000 7feb4f638640 1 --2- 172.21.15.17:0/2052425354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48100860 0x7feb48100c60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7feb44009880 tx=0x7feb4402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:33:23.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.749+0000 7feb4f638640 1 -- 172.21.15.17:0/2052425354 shutdown_connections 2024-09-20T18:33:23.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.749+0000 7feb4f638640 1 --2- 172.21.15.17:0/2052425354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb48101a60 0x7feb48101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:23.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.749+0000 7feb4f638640 1 --2- 172.21.15.17:0/2052425354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48100860 0x7feb48100c60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:23.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.749+0000 7feb4f638640 1 -- 172.21.15.17:0/2052425354 >> 172.21.15.17:0/2052425354 conn(0x7feb480fc010 msgr2=0x7feb480fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:23.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.749+0000 7feb4f638640 1 -- 172.21.15.17:0/2052425354 shutdown_connections 2024-09-20T18:33:23.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.749+0000 7feb4f638640 1 -- 172.21.15.17:0/2052425354 wait complete. 2024-09-20T18:33:23.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.750+0000 7feb4f638640 1 Processor -- start 2024-09-20T18:33:23.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.750+0000 7feb4f638640 1 -- start start 2024-09-20T18:33:23.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.750+0000 7feb4f638640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48100860 0x7feb48197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:23.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.750+0000 7feb4f638640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb48101a60 0x7feb48197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:23.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.750+0000 7feb4f638640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7feb481096a0 con 0x7feb48100860 2024-09-20T18:33:23.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.750+0000 7feb4f638640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feb48109520 con 0x7feb48101a60 2024-09-20T18:33:23.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.750+0000 7feb4d3d4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48100860 0x7feb48197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:23.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.750+0000 7feb4d3d4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48100860 0x7feb48197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42714/0 (socket says 172.21.15.17:42714) 2024-09-20T18:33:23.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.750+0000 7feb4d3d4640 1 -- 172.21.15.17:0/1291041136 learned_addr learned my addr 172.21.15.17:0/1291041136 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:33:23.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.751+0000 7feb4cbd3640 1 --2- 172.21.15.17:0/1291041136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb48101a60 0x7feb48197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:23.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.751+0000 7feb4d3d4640 1 -- 172.21.15.17:0/1291041136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb48101a60 msgr2=0x7feb48197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:23.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.751+0000 7feb4d3d4640 1 --2- 172.21.15.17:0/1291041136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb48101a60 0x7feb48197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:23.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.751+0000 7feb4d3d4640 1 -- 172.21.15.17:0/1291041136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb48198150 con 0x7feb48100860 2024-09-20T18:33:23.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.751+0000 7feb4d3d4640 1 --2- 172.21.15.17:0/1291041136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48100860 0x7feb48197590 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7feb44006010 tx=0x7feb440045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:23.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.751+0000 7feb3e7fc640 1 -- 172.21.15.17:0/1291041136 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb4403f070 con 0x7feb48100860 2024-09-20T18:33:23.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.751+0000 7feb3e7fc640 1 -- 172.21.15.17:0/1291041136 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feb440049d0 con 0x7feb48100860 2024-09-20T18:33:23.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.751+0000 7feb3e7fc640 1 -- 172.21.15.17:0/1291041136 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb44035030 con 0x7feb48100860 2024-09-20T18:33:23.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.751+0000 7feb4f638640 1 -- 172.21.15.17:0/1291041136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb4819cae0 con 0x7feb48100860 2024-09-20T18:33:23.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.751+0000 7feb4f638640 1 -- 172.21.15.17:0/1291041136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb4819d070 con 0x7feb48100860 2024-09-20T18:33:23.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.752+0000 7feb4f638640 1 -- 172.21.15.17:0/1291041136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb48100c60 con 0x7feb48100860 2024-09-20T18:33:23.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.753+0000 7feb3e7fc640 1 -- 172.21.15.17:0/1291041136 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7feb44042070 con 0x7feb48100860 2024-09-20T18:33:23.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.753+0000 7feb3e7fc640 1 --2- 172.21.15.17:0/1291041136 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7feb3406e310 0x7feb340707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:23.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.753+0000 7feb3e7fc640 1 -- 172.21.15.17:0/1291041136 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7feb440aeb70 con 0x7feb48100860 2024-09-20T18:33:23.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.753+0000 7feb4cbd3640 1 --2- 172.21.15.17:0/1291041136 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7feb3406e310 0x7feb340707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:23.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.754+0000 7feb4cbd3640 1 --2- 172.21.15.17:0/1291041136 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7feb3406e310 0x7feb340707d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feb481989f0 tx=0x7feb38005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:23.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.758+0000 7feb3e7fc640 1 -- 172.21.15.17:0/1291041136 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feb44080200 con 0x7feb48100860 2024-09-20T18:33:23.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.933+0000 7feb4f638640 1 -- 172.21.15.17:0/1291041136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7feb4819d860 con 0x7feb48100860 2024-09-20T18:33:23.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.933+0000 7feb3e7fc640 1 -- 172.21.15.17:0/1291041136 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v44)=0 v44) ==== 155+0+0 (secure 0 0 0) 0x7feb44084a30 con 0x7feb48100860 2024-09-20T18:33:23.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.936+0000 7feb4f638640 1 -- 172.21.15.17:0/1291041136 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7feb3406e310 msgr2=0x7feb340707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:23.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.936+0000 7feb4f638640 1 --2- 172.21.15.17:0/1291041136 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7feb3406e310 0x7feb340707d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feb481989f0 tx=0x7feb38005f90 comp rx=0 tx=0).stop 2024-09-20T18:33:23.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.936+0000 7feb4f638640 1 -- 172.21.15.17:0/1291041136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48100860 msgr2=0x7feb48197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:23.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.936+0000 7feb4f638640 1 --2- 172.21.15.17:0/1291041136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48100860 0x7feb48197590 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7feb44006010 tx=0x7feb440045e0 comp rx=0 tx=0).stop 2024-09-20T18:33:23.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.936+0000 7feb4f638640 1 -- 172.21.15.17:0/1291041136 shutdown_connections 2024-09-20T18:33:23.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.936+0000 7feb4f638640 1 --2- 172.21.15.17:0/1291041136 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7feb3406e310 0x7feb340707d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:23.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.936+0000 7feb4f638640 1 --2- 172.21.15.17:0/1291041136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb48101a60 0x7feb48197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:23.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.936+0000 7feb4f638640 1 --2- 172.21.15.17:0/1291041136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48100860 0x7feb48197590 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:23.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.936+0000 7feb4f638640 1 -- 172.21.15.17:0/1291041136 >> 172.21.15.17:0/1291041136 conn(0x7feb480fc010 msgr2=0x7feb4806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:23.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.936+0000 7feb4f638640 1 -- 172.21.15.17:0/1291041136 shutdown_connections 2024-09-20T18:33:23.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:23.936+0000 7feb4f638640 1 -- 172.21.15.17:0/1291041136 wait complete. 2024-09-20T18:33:23.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:23 smithi172 ceph-mon[35456]: pgmap v189: 65 pgs: 65 active+clean; 582 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-20T18:33:23.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:23 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:33:24.643 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-20T18:33:24.942 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:33:25.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.363+0000 7fe709c90640 1 -- 172.21.15.17:0/31773654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe704101a60 msgr2=0x7fe704101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:25.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.363+0000 7fe709c90640 1 --2- 172.21.15.17:0/31773654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe704101a60 0x7fe704101ee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009880 tx=0x7fe6f802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:33:25.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.363+0000 7fe709c90640 1 -- 172.21.15.17:0/31773654 shutdown_connections 2024-09-20T18:33:25.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.363+0000 7fe709c90640 1 --2- 172.21.15.17:0/31773654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe704101a60 0x7fe704101ee0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:25.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.363+0000 7fe709c90640 1 --2- 172.21.15.17:0/31773654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe704100860 0x7fe704100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:25.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.363+0000 7fe709c90640 1 -- 172.21.15.17:0/31773654 >> 172.21.15.17:0/31773654 conn(0x7fe7040fc010 msgr2=0x7fe7040fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:25.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.363+0000 7fe709c90640 1 -- 172.21.15.17:0/31773654 shutdown_connections 2024-09-20T18:33:25.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.363+0000 7fe709c90640 1 -- 172.21.15.17:0/31773654 wait complete. 2024-09-20T18:33:25.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.364+0000 7fe709c90640 1 Processor -- start 2024-09-20T18:33:25.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.364+0000 7fe709c90640 1 -- start start 2024-09-20T18:33:25.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.364+0000 7fe709c90640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe704100860 0x7fe7041974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:25.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.364+0000 7fe709c90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe704101a60 0x7fe704197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:25.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.364+0000 7fe709c90640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe704109680 con 0x7fe704100860 2024-09-20T18:33:25.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.364+0000 7fe709c90640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe704109500 con 0x7fe704101a60 2024-09-20T18:33:25.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.364+0000 7fe7037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe704100860 0x7fe7041974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:25.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.364+0000 7fe7037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe704100860 0x7fe7041974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42728/0 (socket says 172.21.15.17:42728) 2024-09-20T18:33:25.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.365+0000 7fe7037fe640 1 -- 172.21.15.17:0/1147511272 learned_addr learned my addr 172.21.15.17:0/1147511272 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:33:25.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.365+0000 7fe702ffd640 1 --2- 172.21.15.17:0/1147511272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe704101a60 0x7fe704197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:25.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.365+0000 7fe7037fe640 1 -- 172.21.15.17:0/1147511272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe704101a60 msgr2=0x7fe704197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:25.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.365+0000 7fe7037fe640 1 --2- 172.21.15.17:0/1147511272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe704101a60 0x7fe704197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:25.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.365+0000 7fe7037fe640 1 -- 172.21.15.17:0/1147511272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe704198090 con 0x7fe704100860 2024-09-20T18:33:25.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.365+0000 7fe7037fe640 1 --2- 172.21.15.17:0/1147511272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe704100860 0x7fe7041974d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400c8f0 tx=0x7fe6f400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:25.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.365+0000 7fe700ff9640 1 -- 172.21.15.17:0/1147511272 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe6f40079b0 con 0x7fe704100860 2024-09-20T18:33:25.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.365+0000 7fe700ff9640 1 -- 172.21.15.17:0/1147511272 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe6f4007b50 con 0x7fe704100860 2024-09-20T18:33:25.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.365+0000 7fe709c90640 1 -- 172.21.15.17:0/1147511272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe70419cad0 con 0x7fe704100860 2024-09-20T18:33:25.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.365+0000 7fe700ff9640 1 -- 172.21.15.17:0/1147511272 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe6f4018610 con 0x7fe704100860 2024-09-20T18:33:25.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.365+0000 7fe709c90640 1 -- 172.21.15.17:0/1147511272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe70419d060 con 0x7fe704100860 2024-09-20T18:33:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.366+0000 7fe709c90640 1 -- 172.21.15.17:0/1147511272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe704100c60 con 0x7fe704100860 2024-09-20T18:33:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.367+0000 7fe700ff9640 1 -- 172.21.15.17:0/1147511272 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe6f4007d00 con 0x7fe704100860 2024-09-20T18:33:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.367+0000 7fe700ff9640 1 --2- 172.21.15.17:0/1147511272 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe6ec06e2b0 0x7fe6ec070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.367+0000 7fe700ff9640 1 -- 172.21.15.17:0/1147511272 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fe6f408e3a0 con 0x7fe704100860 2024-09-20T18:33:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.367+0000 7fe702ffd640 1 --2- 172.21.15.17:0/1147511272 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe6ec06e2b0 0x7fe6ec070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.368+0000 7fe702ffd640 1 --2- 172.21.15.17:0/1147511272 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe6ec06e2b0 0x7fe6ec070770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe704198980 tx=0x7fe6f8005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:25.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.372+0000 7fe700ff9640 1 -- 172.21.15.17:0/1147511272 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe6f4014030 con 0x7fe704100860 2024-09-20T18:33:25.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.547+0000 7fe709c90640 1 -- 172.21.15.17:0/1147511272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7fe70419d380 con 0x7fe704100860 2024-09-20T18:33:25.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.547+0000 7fe700ff9640 1 -- 172.21.15.17:0/1147511272 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v44)=0 v44) ==== 163+0+0 (secure 0 0 0) 0x7fe6f401f2f0 con 0x7fe704100860 2024-09-20T18:33:25.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.549+0000 7fe709c90640 1 -- 172.21.15.17:0/1147511272 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe6ec06e2b0 msgr2=0x7fe6ec070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:25.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.549+0000 7fe709c90640 1 --2- 172.21.15.17:0/1147511272 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe6ec06e2b0 0x7fe6ec070770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe704198980 tx=0x7fe6f8005a20 comp rx=0 tx=0).stop 2024-09-20T18:33:25.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.549+0000 7fe709c90640 1 -- 172.21.15.17:0/1147511272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe704100860 msgr2=0x7fe7041974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:25.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.549+0000 7fe709c90640 1 --2- 172.21.15.17:0/1147511272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe704100860 0x7fe7041974d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400c8f0 tx=0x7fe6f400cdb0 comp rx=0 tx=0).stop 2024-09-20T18:33:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.549+0000 7fe709c90640 1 -- 172.21.15.17:0/1147511272 shutdown_connections 2024-09-20T18:33:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.549+0000 7fe709c90640 1 --2- 172.21.15.17:0/1147511272 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fe6ec06e2b0 0x7fe6ec070770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.549+0000 7fe709c90640 1 --2- 172.21.15.17:0/1147511272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe704101a60 0x7fe704197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.549+0000 7fe709c90640 1 --2- 172.21.15.17:0/1147511272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe704100860 0x7fe7041974d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.549+0000 7fe709c90640 1 -- 172.21.15.17:0/1147511272 >> 172.21.15.17:0/1147511272 conn(0x7fe7040fc010 msgr2=0x7fe70406a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.549+0000 7fe709c90640 1 -- 172.21.15.17:0/1147511272 shutdown_connections 2024-09-20T18:33:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:25.549+0000 7fe709c90640 1 -- 172.21.15.17:0/1147511272 wait complete. 2024-09-20T18:33:25.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:25 smithi017 ceph-mon[28058]: pgmap v190: 65 pgs: 65 active+clean; 582 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-20T18:33:25.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:25 smithi172 ceph-mon[35456]: pgmap v190: 65 pgs: 65 active+clean; 582 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-20T18:33:26.218 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-20T18:33:26.477 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:33:26.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.896+0000 7f19aaa0b640 1 -- 172.21.15.17:0/3253267242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a4101960 msgr2=0x7f19a4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:26.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.896+0000 7f19aaa0b640 1 --2- 172.21.15.17:0/3253267242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a4101960 0x7f19a4101d60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1994009880 tx=0x7f199402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:33:26.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.896+0000 7f19aaa0b640 1 -- 172.21.15.17:0/3253267242 shutdown_connections 2024-09-20T18:33:26.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.896+0000 7f19aaa0b640 1 --2- 172.21.15.17:0/3253267242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19a4102b60 0x7f19a4102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.896+0000 7f19aaa0b640 1 --2- 172.21.15.17:0/3253267242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a4101960 0x7f19a4101d60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.896+0000 7f19aaa0b640 1 -- 172.21.15.17:0/3253267242 >> 172.21.15.17:0/3253267242 conn(0x7f19a40fd0f0 msgr2=0x7f19a40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.896+0000 7f19aaa0b640 1 -- 172.21.15.17:0/3253267242 shutdown_connections 2024-09-20T18:33:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.896+0000 7f19aaa0b640 1 -- 172.21.15.17:0/3253267242 wait complete. 2024-09-20T18:33:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.896+0000 7f19aaa0b640 1 Processor -- start 2024-09-20T18:33:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.896+0000 7f19aaa0b640 1 -- start start 2024-09-20T18:33:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.897+0000 7f19aaa0b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19a4101960 0x7f19a4197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.897+0000 7f19aaa0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a4102b60 0x7f19a4197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.897+0000 7f19aaa0b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f19a410a800 con 0x7f19a4102b60 2024-09-20T18:33:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.897+0000 7f19aaa0b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f19a410a680 con 0x7f19a4101960 2024-09-20T18:33:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.897+0000 7f19a37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a4102b60 0x7f19a4197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.897+0000 7f19a37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a4102b60 0x7f19a4197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42746/0 (socket says 172.21.15.17:42746) 2024-09-20T18:33:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.897+0000 7f19a37fe640 1 -- 172.21.15.17:0/2186809461 learned_addr learned my addr 172.21.15.17:0/2186809461 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:33:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.897+0000 7f19a3fff640 1 --2- 172.21.15.17:0/2186809461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19a4101960 0x7f19a4197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.897+0000 7f19a37fe640 1 -- 172.21.15.17:0/2186809461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19a4101960 msgr2=0x7f19a4197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.897+0000 7f19a37fe640 1 --2- 172.21.15.17:0/2186809461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19a4101960 0x7f19a4197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.897+0000 7f19a37fe640 1 -- 172.21.15.17:0/2186809461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a41980f0 con 0x7f19a4102b60 2024-09-20T18:33:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.897+0000 7f19a37fe640 1 --2- 172.21.15.17:0/2186809461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a4102b60 0x7f19a4197a70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f199800b420 tx=0x7f199800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.898+0000 7f19a17fa640 1 -- 172.21.15.17:0/2186809461 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1998011630 con 0x7f19a4102b60 2024-09-20T18:33:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.898+0000 7f19a17fa640 1 -- 172.21.15.17:0/2186809461 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1998016070 con 0x7f19a4102b60 2024-09-20T18:33:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.898+0000 7f19aaa0b640 1 -- 172.21.15.17:0/2186809461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a419cb30 con 0x7f19a4102b60 2024-09-20T18:33:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.898+0000 7f19a17fa640 1 -- 172.21.15.17:0/2186809461 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1998010d40 con 0x7f19a4102b60 2024-09-20T18:33:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.898+0000 7f19aaa0b640 1 -- 172.21.15.17:0/2186809461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a419d140 con 0x7f19a4102b60 2024-09-20T18:33:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.899+0000 7f19aaa0b640 1 -- 172.21.15.17:0/2186809461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19a4101d60 con 0x7f19a4102b60 2024-09-20T18:33:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.899+0000 7f19a17fa640 1 -- 172.21.15.17:0/2186809461 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f199801b460 con 0x7f19a4102b60 2024-09-20T18:33:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.900+0000 7f19a17fa640 1 --2- 172.21.15.17:0/2186809461 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f198c06e310 0x7f198c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.900+0000 7f19a3fff640 1 --2- 172.21.15.17:0/2186809461 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f198c06e310 0x7f198c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.900+0000 7f19a17fa640 1 -- 172.21.15.17:0/2186809461 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f199808d9a0 con 0x7f19a4102b60 2024-09-20T18:33:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.900+0000 7f19a3fff640 1 --2- 172.21.15.17:0/2186809461 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f198c06e310 0x7f198c0707d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1994000c00 tx=0x7f1994005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:26.904+0000 7f19a17fa640 1 -- 172.21.15.17:0/2186809461 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f199805b380 con 0x7f19a4102b60 2024-09-20T18:33:27.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:27.085+0000 7f19aaa0b640 1 -- 172.21.15.17:0/2186809461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7f19a4062df0 con 0x7f19a4102b60 2024-09-20T18:33:27.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:27.086+0000 7f19a17fa640 1 -- 172.21.15.17:0/2186809461 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v44)=0 v44) ==== 135+0+0 (secure 0 0 0) 0x7f199805f030 con 0x7f19a4102b60 2024-09-20T18:33:27.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:27.088+0000 7f19aaa0b640 1 -- 172.21.15.17:0/2186809461 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f198c06e310 msgr2=0x7f198c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:27.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:27.088+0000 7f19aaa0b640 1 --2- 172.21.15.17:0/2186809461 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f198c06e310 0x7f198c0707d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1994000c00 tx=0x7f1994005a20 comp rx=0 tx=0).stop 2024-09-20T18:33:27.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:27.088+0000 7f19aaa0b640 1 -- 172.21.15.17:0/2186809461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a4102b60 msgr2=0x7f19a4197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:27.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:27.088+0000 7f19aaa0b640 1 --2- 172.21.15.17:0/2186809461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a4102b60 0x7f19a4197a70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f199800b420 tx=0x7f199800b8e0 comp rx=0 tx=0).stop 2024-09-20T18:33:27.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:27.088+0000 7f19aaa0b640 1 -- 172.21.15.17:0/2186809461 shutdown_connections 2024-09-20T18:33:27.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:27.088+0000 7f19aaa0b640 1 --2- 172.21.15.17:0/2186809461 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f198c06e310 0x7f198c0707d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:27.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:27.088+0000 7f19aaa0b640 1 --2- 172.21.15.17:0/2186809461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a4102b60 0x7f19a4197a70 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:27.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:27.088+0000 7f19aaa0b640 1 --2- 172.21.15.17:0/2186809461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19a4101960 0x7f19a4197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:27.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:27.088+0000 7f19aaa0b640 1 -- 172.21.15.17:0/2186809461 >> 172.21.15.17:0/2186809461 conn(0x7f19a40fd0f0 msgr2=0x7f19a4106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:27.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:27.088+0000 7f19aaa0b640 1 -- 172.21.15.17:0/2186809461 shutdown_connections 2024-09-20T18:33:27.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:27.088+0000 7f19aaa0b640 1 -- 172.21.15.17:0/2186809461 wait complete. 2024-09-20T18:33:27.730 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-20T18:33:27.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:27 smithi017 ceph-mon[28058]: pgmap v191: 65 pgs: 65 active+clean; 582 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-20T18:33:27.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:27 smithi172 ceph-mon[35456]: pgmap v191: 65 pgs: 65 active+clean; 582 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-20T18:33:27.988 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:33:28.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.420+0000 7efdee91f640 1 -- 172.21.15.17:0/4158565009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efde81023f0 msgr2=0x7efde81047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:28.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.420+0000 7efdee91f640 1 --2- 172.21.15.17:0/4158565009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efde81023f0 0x7efde81047e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efdd80098b0 tx=0x7efdd802a4d0 comp rx=0 tx=0).stop 2024-09-20T18:33:28.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.420+0000 7efdee91f640 1 -- 172.21.15.17:0/4158565009 shutdown_connections 2024-09-20T18:33:28.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.420+0000 7efdee91f640 1 --2- 172.21.15.17:0/4158565009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde8104d20 0x7efde8107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:28.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.420+0000 7efdee91f640 1 --2- 172.21.15.17:0/4158565009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efde81023f0 0x7efde81047e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:28.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.420+0000 7efdee91f640 1 -- 172.21.15.17:0/4158565009 >> 172.21.15.17:0/4158565009 conn(0x7efde80fc010 msgr2=0x7efde80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:33:28.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.420+0000 7efdee91f640 1 -- 172.21.15.17:0/4158565009 shutdown_connections 2024-09-20T18:33:28.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.420+0000 7efdee91f640 1 -- 172.21.15.17:0/4158565009 wait complete. 2024-09-20T18:33:28.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.421+0000 7efdee91f640 1 Processor -- start 2024-09-20T18:33:28.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.421+0000 7efdee91f640 1 -- start start 2024-09-20T18:33:28.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.421+0000 7efdee91f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efde81023f0 0x7efde81975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:28.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.421+0000 7efdee91f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde8104d20 0x7efde8197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:28.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.421+0000 7efdee91f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efde810a830 con 0x7efde81023f0 2024-09-20T18:33:28.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.421+0000 7efdee91f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efde810a6b0 con 0x7efde8104d20 2024-09-20T18:33:28.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.421+0000 7efde7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efde81023f0 0x7efde81975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:28.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.421+0000 7efde7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efde81023f0 0x7efde81975b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42760/0 (socket says 172.21.15.17:42760) 2024-09-20T18:33:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.421+0000 7efde7fff640 1 -- 172.21.15.17:0/2636294502 learned_addr learned my addr 172.21.15.17:0/2636294502 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:33:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.422+0000 7efde77fe640 1 --2- 172.21.15.17:0/2636294502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde8104d20 0x7efde8197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.422+0000 7efde7fff640 1 -- 172.21.15.17:0/2636294502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde8104d20 msgr2=0x7efde8197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:33:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.422+0000 7efde7fff640 1 --2- 172.21.15.17:0/2636294502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde8104d20 0x7efde8197af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:33:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.422+0000 7efde7fff640 1 -- 172.21.15.17:0/2636294502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde8198170 con 0x7efde81023f0 2024-09-20T18:33:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.422+0000 7efde77fe640 1 --2- 172.21.15.17:0/2636294502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde8104d20 0x7efde8197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:33:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.422+0000 7efde7fff640 1 --2- 172.21.15.17:0/2636294502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efde81023f0 0x7efde81975b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efdd80099d0 tx=0x7efdd80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.422+0000 7efde57fa640 1 -- 172.21.15.17:0/2636294502 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efdd803f070 con 0x7efde81023f0 2024-09-20T18:33:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.422+0000 7efdee91f640 1 -- 172.21.15.17:0/2636294502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde819cb50 con 0x7efde81023f0 2024-09-20T18:33:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.422+0000 7efde57fa640 1 -- 172.21.15.17:0/2636294502 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efdd8004c70 con 0x7efde81023f0 2024-09-20T18:33:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.422+0000 7efde57fa640 1 -- 172.21.15.17:0/2636294502 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efdd8035030 con 0x7efde81023f0 2024-09-20T18:33:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.422+0000 7efdee91f640 1 -- 172.21.15.17:0/2636294502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde819d0e0 con 0x7efde81023f0 2024-09-20T18:33:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.423+0000 7efdee91f640 1 -- 172.21.15.17:0/2636294502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde81027d0 con 0x7efde81023f0 2024-09-20T18:33:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.424+0000 7efde57fa640 1 -- 172.21.15.17:0/2636294502 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7efdd8042070 con 0x7efde81023f0 2024-09-20T18:33:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.424+0000 7efde57fa640 1 --2- 172.21.15.17:0/2636294502 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7efdd006e2b0 0x7efdd0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:33:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.424+0000 7efde57fa640 1 -- 172.21.15.17:0/2636294502 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7efdd80aee30 con 0x7efde81023f0 2024-09-20T18:33:28.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.424+0000 7efde77fe640 1 --2- 172.21.15.17:0/2636294502 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7efdd006e2b0 0x7efdd0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:33:28.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.425+0000 7efde77fe640 1 --2- 172.21.15.17:0/2636294502 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7efdd006e2b0 0x7efdd0070770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efde8198a60 tx=0x7efddc008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:33:28.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.429+0000 7efde57fa640 1 -- 172.21.15.17:0/2636294502 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efdd807c790 con 0x7efde81023f0 2024-09-20T18:33:28.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:33:28.623+0000 7efdee91f640 1 -- 172.21.15.17:0/2636294502 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) -- 0x7efde8105780 con 0x7efdd006e2b0 2024-09-20T18:33:29.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:29 smithi017 ceph-mon[28058]: pgmap v192: 65 pgs: 65 active+clean; 587 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-20T18:33:29.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:29 smithi172 ceph-mon[35456]: pgmap v192: 65 pgs: 65 active+clean; 587 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-20T18:33:30.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:30 smithi017 ceph-mon[28058]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:33:30.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:30 smithi172 ceph-mon[35456]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:33:31.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:31 smithi017 ceph-mon[28058]: pgmap v193: 65 pgs: 65 active+clean; 587 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-20T18:33:31.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:31 smithi172 ceph-mon[35456]: pgmap v193: 65 pgs: 65 active+clean; 587 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-20T18:33:33.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:33 smithi017 ceph-mon[28058]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-20T18:33:33.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:33 smithi172 ceph-mon[35456]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-20T18:33:34.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:34 smithi017 ceph-mon[28058]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-20T18:33:34.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:34 smithi172 ceph-mon[35456]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-20T18:33:36.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:36 smithi017 ceph-mon[28058]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-20T18:33:36.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:36 smithi172 ceph-mon[35456]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 682 B/s wr, 4 op/s 2024-09-20T18:33:37.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:37 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:33:37.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:37 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:33:38.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:38 smithi017 ceph-mon[28058]: pgmap v197: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-20T18:33:38.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:38 smithi172 ceph-mon[35456]: pgmap v197: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-20T18:33:40.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:40 smithi017 ceph-mon[28058]: pgmap v198: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-20T18:33:40.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:40 smithi172 ceph-mon[35456]: pgmap v198: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-20T18:33:42.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:42 smithi017 ceph-mon[28058]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-20T18:33:42.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:42 smithi172 ceph-mon[35456]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-20T18:33:44.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:44 smithi017 ceph-mon[28058]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-20T18:33:44.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:44 smithi172 ceph-mon[35456]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-20T18:33:46.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:46 smithi017 ceph-mon[28058]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-20T18:33:46.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:46 smithi172 ceph-mon[35456]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-20T18:33:48.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:48 smithi017 ceph-mon[28058]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-20T18:33:48.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:48 smithi172 ceph-mon[35456]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-20T18:33:50.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:50 smithi017 ceph-mon[28058]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:33:50.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:50 smithi172 ceph-mon[35456]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:33:52.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:52 smithi017 ceph-mon[28058]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:33:52.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:52 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:33:52.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:52 smithi172 ceph-mon[35456]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:33:52.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:52 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:33:54.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:54 smithi017 ceph-mon[28058]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:33:54.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:54 smithi172 ceph-mon[35456]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:33:56.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:56 smithi017 ceph-mon[28058]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T18:33:56.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:56 smithi172 ceph-mon[35456]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T18:33:58.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:33:58 smithi017 ceph-mon[28058]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T18:33:58.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:33:58 smithi172 ceph-mon[35456]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T18:34:00.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:00 smithi017 ceph-mon[28058]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:34:00.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:00 smithi172 ceph-mon[35456]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:34:02.269 INFO:teuthology.orchestra.run.smithi017.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:34:02.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:02.254+0000 7efde57fa640 1 -- 172.21.15.17:0/2636294502 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7efde8105780 con 0x7efdd006e2b0 2024-09-20T18:34:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:02.257+0000 7efdee91f640 1 -- 172.21.15.17:0/2636294502 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7efdd006e2b0 msgr2=0x7efdd0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:02.257+0000 7efdee91f640 1 --2- 172.21.15.17:0/2636294502 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7efdd006e2b0 0x7efdd0070770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efde8198a60 tx=0x7efddc008040 comp rx=0 tx=0).stop 2024-09-20T18:34:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:02.257+0000 7efdee91f640 1 -- 172.21.15.17:0/2636294502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efde81023f0 msgr2=0x7efde81975b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:02.257+0000 7efdee91f640 1 --2- 172.21.15.17:0/2636294502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efde81023f0 0x7efde81975b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efdd80099d0 tx=0x7efdd80048f0 comp rx=0 tx=0).stop 2024-09-20T18:34:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:02.257+0000 7efdee91f640 1 -- 172.21.15.17:0/2636294502 shutdown_connections 2024-09-20T18:34:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:02.257+0000 7efdee91f640 1 --2- 172.21.15.17:0/2636294502 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7efdd006e2b0 0x7efdd0070770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:02.257+0000 7efdee91f640 1 --2- 172.21.15.17:0/2636294502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde8104d20 0x7efde8197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:02.257+0000 7efdee91f640 1 --2- 172.21.15.17:0/2636294502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efde81023f0 0x7efde81975b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:02.257+0000 7efdee91f640 1 -- 172.21.15.17:0/2636294502 >> 172.21.15.17:0/2636294502 conn(0x7efde80fc010 msgr2=0x7efde80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:02.257+0000 7efdee91f640 1 -- 172.21.15.17:0/2636294502 shutdown_connections 2024-09-20T18:34:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:02.258+0000 7efdee91f640 1 -- 172.21.15.17:0/2636294502 wait complete. 2024-09-20T18:34:03.073 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-20T18:34:03.388 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:34:03.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:03 smithi017 ceph-mon[28058]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:34:03.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:03 smithi017 ceph-mon[28058]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:34:03.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:03.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:34:03.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:34:03.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:34:03.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:03 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:03.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:03 smithi017 ceph-mon[28058]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:34:03.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:03 smithi172 ceph-mon[35456]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:34:03.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:03 smithi172 ceph-mon[35456]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:34:03.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:03.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:34:03.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:34:03.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:34:03.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:03 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:03.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:03 smithi172 ceph-mon[35456]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:34:04.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.063+0000 7ff277cc5640 1 -- 172.21.15.17:0/2982517621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff270100b80 msgr2=0x7ff270100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:04.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.063+0000 7ff277cc5640 1 --2- 172.21.15.17:0/2982517621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff270100b80 0x7ff270100fe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff260009880 tx=0x7ff26002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.063+0000 7ff277cc5640 1 -- 172.21.15.17:0/2982517621 shutdown_connections 2024-09-20T18:34:04.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.064+0000 7ff277cc5640 1 --2- 172.21.15.17:0/2982517621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff270100b80 0x7ff270100fe0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.064+0000 7ff277cc5640 1 --2- 172.21.15.17:0/2982517621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff270100240 0x7ff270100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.064+0000 7ff277cc5640 1 -- 172.21.15.17:0/2982517621 >> 172.21.15.17:0/2982517621 conn(0x7ff2700fc010 msgr2=0x7ff2700fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:04.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.064+0000 7ff277cc5640 1 -- 172.21.15.17:0/2982517621 shutdown_connections 2024-09-20T18:34:04.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.064+0000 7ff277cc5640 1 -- 172.21.15.17:0/2982517621 wait complete. 2024-09-20T18:34:04.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.065+0000 7ff277cc5640 1 Processor -- start 2024-09-20T18:34:04.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.065+0000 7ff277cc5640 1 -- start start 2024-09-20T18:34:04.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.066+0000 7ff277cc5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff270100240 0x7ff270199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:04.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.066+0000 7ff277cc5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff270100b80 0x7ff270199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:04.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.066+0000 7ff277cc5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff27010c970 con 0x7ff270100240 2024-09-20T18:34:04.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.066+0000 7ff277cc5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff27010c7f0 con 0x7ff270100b80 2024-09-20T18:34:04.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.066+0000 7ff275260640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff270100b80 0x7ff270199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:04.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.066+0000 7ff275260640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff270100b80 0x7ff270199bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:50758/0 (socket says 172.21.15.17:50758) 2024-09-20T18:34:04.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.066+0000 7ff275260640 1 -- 172.21.15.17:0/981095851 learned_addr learned my addr 172.21.15.17:0/981095851 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:34:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.066+0000 7ff275a61640 1 --2- 172.21.15.17:0/981095851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff270100240 0x7ff270199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.066+0000 7ff275260640 1 -- 172.21.15.17:0/981095851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff270100240 msgr2=0x7ff270199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.066+0000 7ff275260640 1 --2- 172.21.15.17:0/981095851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff270100240 0x7ff270199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.066+0000 7ff275260640 1 -- 172.21.15.17:0/981095851 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27019a230 con 0x7ff270100b80 2024-09-20T18:34:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.067+0000 7ff275260640 1 --2- 172.21.15.17:0/981095851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff270100b80 0x7ff270199bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff260006010 tx=0x7ff2600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:04.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.067+0000 7ff266ffd640 1 -- 172.21.15.17:0/981095851 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff26003f070 con 0x7ff270100b80 2024-09-20T18:34:04.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.067+0000 7ff266ffd640 1 -- 172.21.15.17:0/981095851 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff260004ac0 con 0x7ff270100b80 2024-09-20T18:34:04.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.067+0000 7ff277cc5640 1 -- 172.21.15.17:0/981095851 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27019ec10 con 0x7ff270100b80 2024-09-20T18:34:04.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.067+0000 7ff277cc5640 1 -- 172.21.15.17:0/981095851 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff27019f0e0 con 0x7ff270100b80 2024-09-20T18:34:04.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.068+0000 7ff266ffd640 1 -- 172.21.15.17:0/981095851 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff260035030 con 0x7ff270100b80 2024-09-20T18:34:04.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.069+0000 7ff277cc5640 1 -- 172.21.15.17:0/981095851 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2540052c0 con 0x7ff270100b80 2024-09-20T18:34:04.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.069+0000 7ff266ffd640 1 -- 172.21.15.17:0/981095851 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff260042070 con 0x7ff270100b80 2024-09-20T18:34:04.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.070+0000 7ff266ffd640 1 --2- 172.21.15.17:0/981095851 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff25c06e360 0x7ff25c070820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:04.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.070+0000 7ff266ffd640 1 -- 172.21.15.17:0/981095851 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7ff2600aec20 con 0x7ff270100b80 2024-09-20T18:34:04.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.070+0000 7ff275a61640 1 --2- 172.21.15.17:0/981095851 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff25c06e360 0x7ff25c070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:04.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.070+0000 7ff275a61640 1 --2- 172.21.15.17:0/981095851 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff25c06e360 0x7ff25c070820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff26c005d00 tx=0x7ff26c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:04.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.078+0000 7ff266ffd640 1 -- 172.21.15.17:0/981095851 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff260080210 con 0x7ff270100b80 2024-09-20T18:34:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.276+0000 7ff277cc5640 1 -- 172.21.15.17:0/981095851 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff254000bf0 con 0x7ff25c06e360 2024-09-20T18:34:04.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.277+0000 7ff266ffd640 1 -- 172.21.15.17:0/981095851 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7ff254000bf0 con 0x7ff25c06e360 2024-09-20T18:34:04.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.279+0000 7ff277cc5640 1 -- 172.21.15.17:0/981095851 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff25c06e360 msgr2=0x7ff25c070820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:04.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.279+0000 7ff277cc5640 1 --2- 172.21.15.17:0/981095851 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff25c06e360 0x7ff25c070820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff26c005d00 tx=0x7ff26c00b410 comp rx=0 tx=0).stop 2024-09-20T18:34:04.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.279+0000 7ff277cc5640 1 -- 172.21.15.17:0/981095851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff270100b80 msgr2=0x7ff270199bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:04.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.279+0000 7ff277cc5640 1 --2- 172.21.15.17:0/981095851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff270100b80 0x7ff270199bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff260006010 tx=0x7ff2600046c0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.279+0000 7ff277cc5640 1 -- 172.21.15.17:0/981095851 shutdown_connections 2024-09-20T18:34:04.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.279+0000 7ff277cc5640 1 --2- 172.21.15.17:0/981095851 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7ff25c06e360 0x7ff25c070820 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.279+0000 7ff277cc5640 1 --2- 172.21.15.17:0/981095851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff270100b80 0x7ff270199bb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.279+0000 7ff277cc5640 1 --2- 172.21.15.17:0/981095851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff270100240 0x7ff270199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.279+0000 7ff277cc5640 1 -- 172.21.15.17:0/981095851 >> 172.21.15.17:0/981095851 conn(0x7ff2700fc010 msgr2=0x7ff270108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:04.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.280+0000 7ff277cc5640 1 -- 172.21.15.17:0/981095851 shutdown_connections 2024-09-20T18:34:04.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.280+0000 7ff277cc5640 1 -- 172.21.15.17:0/981095851 wait complete. 2024-09-20T18:34:04.305 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:34:04.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.378+0000 7f8219193640 1 -- 172.21.15.17:0/135092951 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8204033740 con 0x7f8214101a80 2024-09-20T18:34:04.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.378+0000 7f821c3f9640 1 -- 172.21.15.17:0/135092951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8214101a80 msgr2=0x7f8214101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:04.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.378+0000 7f821c3f9640 1 --2- 172.21.15.17:0/135092951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8214101a80 0x7f8214101f00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8204009880 tx=0x7f820402c6b0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.378+0000 7f821c3f9640 1 -- 172.21.15.17:0/135092951 shutdown_connections 2024-09-20T18:34:04.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.378+0000 7f821c3f9640 1 --2- 172.21.15.17:0/135092951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8214101a80 0x7f8214101f00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.378+0000 7f821c3f9640 1 --2- 172.21.15.17:0/135092951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8214100880 0x7f8214100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.378+0000 7f821c3f9640 1 -- 172.21.15.17:0/135092951 >> 172.21.15.17:0/135092951 conn(0x7f82140fc010 msgr2=0x7f82140fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:04.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.379+0000 7f821c3f9640 1 -- 172.21.15.17:0/135092951 shutdown_connections 2024-09-20T18:34:04.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.379+0000 7f821c3f9640 1 -- 172.21.15.17:0/135092951 wait complete. 2024-09-20T18:34:04.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.379+0000 7f821c3f9640 1 Processor -- start 2024-09-20T18:34:04.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.379+0000 7f821c3f9640 1 -- start start 2024-09-20T18:34:04.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.379+0000 7f821c3f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8214100880 0x7f8214073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:04.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.379+0000 7f821c3f9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8214101a80 0x7f8214073760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:04.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.379+0000 7f821c3f9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f82141085b0 con 0x7f8214101a80 2024-09-20T18:34:04.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.379+0000 7f821c3f9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8214108430 con 0x7f8214100880 2024-09-20T18:34:04.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.380+0000 7f821a195640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8214100880 0x7f8214073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:04.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.380+0000 7f821a195640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8214100880 0x7f8214073220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:50768/0 (socket says 172.21.15.17:50768) 2024-09-20T18:34:04.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.380+0000 7f821a195640 1 -- 172.21.15.17:0/2123015709 learned_addr learned my addr 172.21.15.17:0/2123015709 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:34:04.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.380+0000 7f821a195640 1 -- 172.21.15.17:0/2123015709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8214101a80 msgr2=0x7f8214073760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:04.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.380+0000 7f821a195640 1 --2- 172.21.15.17:0/2123015709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8214101a80 0x7f8214073760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.380+0000 7f821a195640 1 -- 172.21.15.17:0/2123015709 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8214073e10 con 0x7f8214100880 2024-09-20T18:34:04.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.380+0000 7f821a195640 1 --2- 172.21.15.17:0/2123015709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8214100880 0x7f8214073220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8210009f00 tx=0x7f821000ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:04.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.380+0000 7f820b7fe640 1 -- 172.21.15.17:0/2123015709 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8210017de0 con 0x7f8214100880 2024-09-20T18:34:04.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.380+0000 7f821c3f9640 1 -- 172.21.15.17:0/2123015709 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82141a3030 con 0x7f8214100880 2024-09-20T18:34:04.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.381+0000 7f821c3f9640 1 -- 172.21.15.17:0/2123015709 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82141a35c0 con 0x7f8214100880 2024-09-20T18:34:04.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.381+0000 7f820b7fe640 1 -- 172.21.15.17:0/2123015709 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f821000c8b0 con 0x7f8214100880 2024-09-20T18:34:04.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.381+0000 7f820b7fe640 1 -- 172.21.15.17:0/2123015709 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8210003a00 con 0x7f8214100880 2024-09-20T18:34:04.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.382+0000 7f821c3f9640 1 -- 172.21.15.17:0/2123015709 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8214100c80 con 0x7f8214100880 2024-09-20T18:34:04.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.383+0000 7f820b7fe640 1 -- 172.21.15.17:0/2123015709 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f821000ca60 con 0x7f8214100880 2024-09-20T18:34:04.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.384+0000 7f820b7fe640 1 --2- 172.21.15.17:0/2123015709 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f820006e4b0 0x7f8200070970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:04.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.384+0000 7f820b7fe640 1 -- 172.21.15.17:0/2123015709 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f8210096c80 con 0x7f8214100880 2024-09-20T18:34:04.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.385+0000 7f8219994640 1 --2- 172.21.15.17:0/2123015709 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f820006e4b0 0x7f8200070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:04.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.386+0000 7f8219994640 1 --2- 172.21.15.17:0/2123015709 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f820006e4b0 0x7f8200070970 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f820400e4b0 tx=0x7f8204000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:04.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.391+0000 7f820b7fe640 1 -- 172.21.15.17:0/2123015709 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f82100645c0 con 0x7f8214100880 2024-09-20T18:34:04.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.623+0000 7f821c3f9640 1 -- 172.21.15.17:0/2123015709 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8214062630 con 0x7f820006e4b0 2024-09-20T18:34:04.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.625+0000 7f820b7fe640 1 -- 172.21.15.17:0/2123015709 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f8214062630 con 0x7f820006e4b0 2024-09-20T18:34:04.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.627+0000 7f821c3f9640 1 -- 172.21.15.17:0/2123015709 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f820006e4b0 msgr2=0x7f8200070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:04.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.627+0000 7f821c3f9640 1 --2- 172.21.15.17:0/2123015709 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f820006e4b0 0x7f8200070970 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f820400e4b0 tx=0x7f8204000bc0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.627+0000 7f821c3f9640 1 -- 172.21.15.17:0/2123015709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8214100880 msgr2=0x7f8214073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:04.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.627+0000 7f821c3f9640 1 --2- 172.21.15.17:0/2123015709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8214100880 0x7f8214073220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8210009f00 tx=0x7f821000ed10 comp rx=0 tx=0).stop 2024-09-20T18:34:04.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.627+0000 7f821c3f9640 1 -- 172.21.15.17:0/2123015709 shutdown_connections 2024-09-20T18:34:04.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.627+0000 7f821c3f9640 1 --2- 172.21.15.17:0/2123015709 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f820006e4b0 0x7f8200070970 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.627+0000 7f821c3f9640 1 --2- 172.21.15.17:0/2123015709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8214101a80 0x7f8214073760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.627+0000 7f821c3f9640 1 --2- 172.21.15.17:0/2123015709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8214100880 0x7f8214073220 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8210009f00 tx=0x7f821000ed10 comp rx=0 tx=0).stop 2024-09-20T18:34:04.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.627+0000 7f821c3f9640 1 -- 172.21.15.17:0/2123015709 >> 172.21.15.17:0/2123015709 conn(0x7f82140fc010 msgr2=0x7f8214104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:04.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.627+0000 7f821c3f9640 1 -- 172.21.15.17:0/2123015709 shutdown_connections 2024-09-20T18:34:04.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.627+0000 7f821c3f9640 1 -- 172.21.15.17:0/2123015709 wait complete. 2024-09-20T18:34:04.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.720+0000 7f8a6ea60640 1 -- 172.21.15.17:0/3762178571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a680761c0 msgr2=0x7f8a68074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:04.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.720+0000 7f8a6ea60640 1 --2- 172.21.15.17:0/3762178571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a680761c0 0x7f8a68074620 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009880 tx=0x7f8a5802a530 comp rx=0 tx=0).stop 2024-09-20T18:34:04.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.720+0000 7f8a6ea60640 1 -- 172.21.15.17:0/3762178571 shutdown_connections 2024-09-20T18:34:04.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.720+0000 7f8a6ea60640 1 --2- 172.21.15.17:0/3762178571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a68074bf0 0x7f8a68075050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.720+0000 7f8a6ea60640 1 --2- 172.21.15.17:0/3762178571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a680761c0 0x7f8a68074620 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.720+0000 7f8a6ea60640 1 -- 172.21.15.17:0/3762178571 >> 172.21.15.17:0/3762178571 conn(0x7f8a680fd100 msgr2=0x7f8a680ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:04.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.720+0000 7f8a6ea60640 1 -- 172.21.15.17:0/3762178571 shutdown_connections 2024-09-20T18:34:04.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.720+0000 7f8a6ea60640 1 -- 172.21.15.17:0/3762178571 wait complete. 2024-09-20T18:34:04.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.722+0000 7f8a6ea60640 1 Processor -- start 2024-09-20T18:34:04.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.722+0000 7f8a6ea60640 1 -- start start 2024-09-20T18:34:04.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.722+0000 7f8a6ea60640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a68074bf0 0x7f8a681996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:04.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.723+0000 7f8a6ea60640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a680761c0 0x7f8a68199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:04.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.723+0000 7f8a677fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a680761c0 0x7f8a68199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:04.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.723+0000 7f8a677fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a680761c0 0x7f8a68199c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47532/0 (socket says 172.21.15.17:47532) 2024-09-20T18:34:04.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.723+0000 7f8a67fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a68074bf0 0x7f8a681996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:04.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.723+0000 7f8a67fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a68074bf0 0x7f8a681996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:50784/0 (socket says 172.21.15.17:50784) 2024-09-20T18:34:04.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.723+0000 7f8a677fe640 1 -- 172.21.15.17:0/2113223021 learned_addr learned my addr 172.21.15.17:0/2113223021 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:34:04.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.723+0000 7f8a6ea60640 1 -- 172.21.15.17:0/2113223021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6810c9b0 con 0x7f8a680761c0 2024-09-20T18:34:04.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.723+0000 7f8a6ea60640 1 -- 172.21.15.17:0/2113223021 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6810c830 con 0x7f8a68074bf0 2024-09-20T18:34:04.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.724+0000 7f8a677fe640 1 -- 172.21.15.17:0/2113223021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a68074bf0 msgr2=0x7f8a681996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:04.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.724+0000 7f8a677fe640 1 --2- 172.21.15.17:0/2113223021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a68074bf0 0x7f8a681996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:04.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.724+0000 7f8a677fe640 1 -- 172.21.15.17:0/2113223021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6819a2b0 con 0x7f8a680761c0 2024-09-20T18:34:04.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.724+0000 7f8a67fff640 1 --2- 172.21.15.17:0/2113223021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a68074bf0 0x7f8a681996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:34:04.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.724+0000 7f8a677fe640 1 --2- 172.21.15.17:0/2113223021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a680761c0 0x7f8a68199c30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c00ece0 tx=0x7f8a5c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:04.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.725+0000 7f8a657fa640 1 -- 172.21.15.17:0/2113223021 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a5c00edd0 con 0x7f8a680761c0 2024-09-20T18:34:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.725+0000 7f8a657fa640 1 -- 172.21.15.17:0/2113223021 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a5c00cdb0 con 0x7f8a680761c0 2024-09-20T18:34:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.725+0000 7f8a657fa640 1 -- 172.21.15.17:0/2113223021 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a5c010430 con 0x7f8a680761c0 2024-09-20T18:34:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.725+0000 7f8a6ea60640 1 -- 172.21.15.17:0/2113223021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a6819ecf0 con 0x7f8a680761c0 2024-09-20T18:34:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.725+0000 7f8a6ea60640 1 -- 172.21.15.17:0/2113223021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a6819f220 con 0x7f8a680761c0 2024-09-20T18:34:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.726+0000 7f8a6ea60640 1 -- 172.21.15.17:0/2113223021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a68075050 con 0x7f8a680761c0 2024-09-20T18:34:04.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.728+0000 7f8a657fa640 1 -- 172.21.15.17:0/2113223021 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8a5c004f20 con 0x7f8a680761c0 2024-09-20T18:34:04.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.728+0000 7f8a657fa640 1 --2- 172.21.15.17:0/2113223021 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8a5006e420 0x7f8a500708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:04.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.729+0000 7f8a657fa640 1 -- 172.21.15.17:0/2113223021 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f8a5c08e7b0 con 0x7f8a680761c0 2024-09-20T18:34:04.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.729+0000 7f8a67fff640 1 --2- 172.21.15.17:0/2113223021 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8a5006e420 0x7f8a500708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:04.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.730+0000 7f8a67fff640 1 --2- 172.21.15.17:0/2113223021 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8a5006e420 0x7f8a500708e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8a58006010 tx=0x7f8a58000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:04.737+0000 7f8a657fa640 1 -- 172.21.15.17:0/2113223021 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8a5c05c170 con 0x7f8a680761c0 2024-09-20T18:34:05.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.107+0000 7f8a6ea60640 1 -- 172.21.15.17:0/2113223021 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8a68062630 con 0x7f8a5006e420 2024-09-20T18:34:05.133 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:34:05.133 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (4m) 50s ago 6m 25.8M - 0.25.0 c8568f914cd2 8954ab699be3 2024-09-20T18:34:05.133 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (6m) 50s ago 6m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 404e79f7d9bb 2024-09-20T18:34:05.133 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (5m) 54s ago 5m 5272k - 19.1.1-369-ged8ee0f2 6acb0a031eab 747d22f4b582 2024-09-20T18:34:05.134 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (6m) 50s ago 6m 6895k - 19.1.1-369-ged8ee0f2 6acb0a031eab 725c8bcc6ec8 2024-09-20T18:34:05.134 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (5m) 54s ago 5m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab e10dd613dbe2 2024-09-20T18:34:05.134 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (4m) 50s ago 6m 81.4M - 9.4.12 2bacad6d85d8 d8c886b98eae 2024-09-20T18:34:05.134 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (72s) 50s ago 72s 18.7M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:34:05.134 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (67s) 50s ago 66s 17.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:34:05.134 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (64s) 54s ago 63s 14.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:34:05.134 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (70s) 54s ago 69s 14.6M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:34:05.134 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:9283,8765,8443 running (7m) 50s ago 7m 499M - 19.1.1-369-ged8ee0f2 6acb0a031eab 28eeab491beb 2024-09-20T18:34:05.134 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (5m) 54s ago 5m 443M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4b1c7bce31f2 2024-09-20T18:34:05.134 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (7m) 50s ago 7m 46.4M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab ab1f988c4cb2 2024-09-20T18:34:05.134 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (5m) 54s ago 5m 35.4M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 9eea40352787 2024-09-20T18:34:05.134 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (6m) 50s ago 6m 14.2M - 1.5.0 0da6a335fe13 1584915999b1 2024-09-20T18:34:05.134 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (5m) 54s ago 5m 15.4M - 1.5.0 0da6a335fe13 880d938148e8 2024-09-20T18:34:05.134 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (4m) 50s ago 4m 54.2M 3948M 19.1.1-369-ged8ee0f2 6acb0a031eab c1207e514216 2024-09-20T18:34:05.135 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (3m) 50s ago 3m 54.1M 3948M 19.1.1-369-ged8ee0f2 6acb0a031eab 73f2fd77590f 2024-09-20T18:34:05.135 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (3m) 50s ago 3m 53.4M 3948M 19.1.1-369-ged8ee0f2 6acb0a031eab 6f0b9405dc18 2024-09-20T18:34:05.135 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (3m) 54s ago 3m 51.8M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:34:05.135 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (2m) 54s ago 2m 48.7M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:34:05.135 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (2m) 54s ago 2m 42.7M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:34:05.135 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (4m) 50s ago 6m 58.1M - 2.43.0 a07b618ecd1d ebc76047e24f 2024-09-20T18:34:05.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.119+0000 7f8a657fa640 1 -- 172.21.15.17:0/2113223021 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3792 (secure 0 0 0) 0x7f8a68062630 con 0x7f8a5006e420 2024-09-20T18:34:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.122+0000 7f8a6ea60640 1 -- 172.21.15.17:0/2113223021 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8a5006e420 msgr2=0x7f8a500708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.122+0000 7f8a6ea60640 1 --2- 172.21.15.17:0/2113223021 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8a5006e420 0x7f8a500708e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8a58006010 tx=0x7f8a58000bc0 comp rx=0 tx=0).stop 2024-09-20T18:34:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.122+0000 7f8a6ea60640 1 -- 172.21.15.17:0/2113223021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a680761c0 msgr2=0x7f8a68199c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.122+0000 7f8a6ea60640 1 --2- 172.21.15.17:0/2113223021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a680761c0 0x7f8a68199c30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c00ece0 tx=0x7f8a5c00c6a0 comp rx=0 tx=0).stop 2024-09-20T18:34:05.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.122+0000 7f8a6ea60640 1 -- 172.21.15.17:0/2113223021 shutdown_connections 2024-09-20T18:34:05.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.122+0000 7f8a6ea60640 1 --2- 172.21.15.17:0/2113223021 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f8a5006e420 0x7f8a500708e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:05.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.122+0000 7f8a6ea60640 1 --2- 172.21.15.17:0/2113223021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a680761c0 0x7f8a68199c30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:05.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.122+0000 7f8a6ea60640 1 --2- 172.21.15.17:0/2113223021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a68074bf0 0x7f8a681996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:05.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.122+0000 7f8a6ea60640 1 -- 172.21.15.17:0/2113223021 >> 172.21.15.17:0/2113223021 conn(0x7f8a680fd100 msgr2=0x7f8a68107a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:05.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.123+0000 7f8a6ea60640 1 -- 172.21.15.17:0/2113223021 shutdown_connections 2024-09-20T18:34:05.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.123+0000 7f8a6ea60640 1 -- 172.21.15.17:0/2113223021 wait complete. 2024-09-20T18:34:05.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.253+0000 7f83ee66c640 1 -- 172.21.15.17:0/2755224736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e8100860 msgr2=0x7f83e8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:05.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.253+0000 7f83ee66c640 1 --2- 172.21.15.17:0/2755224736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e8100860 0x7f83e8100c60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009c20 tx=0x7f83e002a980 comp rx=0 tx=0).stop 2024-09-20T18:34:05.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.253+0000 7f83ee66c640 1 -- 172.21.15.17:0/2755224736 shutdown_connections 2024-09-20T18:34:05.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.253+0000 7f83ee66c640 1 --2- 172.21.15.17:0/2755224736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83e8101a60 0x7f83e8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:05.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.253+0000 7f83ee66c640 1 --2- 172.21.15.17:0/2755224736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e8100860 0x7f83e8100c60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:05.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.253+0000 7f83ee66c640 1 -- 172.21.15.17:0/2755224736 >> 172.21.15.17:0/2755224736 conn(0x7f83e80fc010 msgr2=0x7f83e80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:05.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.254+0000 7f83ee66c640 1 -- 172.21.15.17:0/2755224736 shutdown_connections 2024-09-20T18:34:05.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.254+0000 7f83ee66c640 1 -- 172.21.15.17:0/2755224736 wait complete. 2024-09-20T18:34:05.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.255+0000 7f83ee66c640 1 Processor -- start 2024-09-20T18:34:05.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.255+0000 7f83ee66c640 1 -- start start 2024-09-20T18:34:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.255+0000 7f83ee66c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e8100860 0x7f83e819da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.255+0000 7f83ee66c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83e8101a60 0x7f83e819dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.255+0000 7f83ee66c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f83e8108570 con 0x7f83e8100860 2024-09-20T18:34:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.255+0000 7f83ee66c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83e81083f0 con 0x7f83e8101a60 2024-09-20T18:34:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.256+0000 7f83e7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e8100860 0x7f83e819da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.256+0000 7f83e77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83e8101a60 0x7f83e819dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.256+0000 7f83e7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e8100860 0x7f83e819da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47552/0 (socket says 172.21.15.17:47552) 2024-09-20T18:34:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.256+0000 7f83e7fff640 1 -- 172.21.15.17:0/3932844508 learned_addr learned my addr 172.21.15.17:0/3932844508 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:34:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.256+0000 7f83e7fff640 1 -- 172.21.15.17:0/3932844508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83e8101a60 msgr2=0x7f83e819dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.256+0000 7f83e7fff640 1 --2- 172.21.15.17:0/3932844508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83e8101a60 0x7f83e819dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.256+0000 7f83e7fff640 1 -- 172.21.15.17:0/3932844508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e819e650 con 0x7f83e8100860 2024-09-20T18:34:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.256+0000 7f83e7fff640 1 --2- 172.21.15.17:0/3932844508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e8100860 0x7f83e819da90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f83e0004af0 tx=0x7f83e002f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:05.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.259+0000 7f83e57fa640 1 -- 172.21.15.17:0/3932844508 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83e0034040 con 0x7f83e8100860 2024-09-20T18:34:05.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.260+0000 7f83ee66c640 1 -- 172.21.15.17:0/3932844508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e81a3030 con 0x7f83e8100860 2024-09-20T18:34:05.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.260+0000 7f83ee66c640 1 -- 172.21.15.17:0/3932844508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e81a3640 con 0x7f83e8100860 2024-09-20T18:34:05.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.260+0000 7f83e57fa640 1 -- 172.21.15.17:0/3932844508 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f83e0003e30 con 0x7f83e8100860 2024-09-20T18:34:05.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.261+0000 7f83e57fa640 1 -- 172.21.15.17:0/3932844508 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83e0045480 con 0x7f83e8100860 2024-09-20T18:34:05.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.262+0000 7f83ee66c640 1 -- 172.21.15.17:0/3932844508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d40052c0 con 0x7f83e8100860 2024-09-20T18:34:05.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.263+0000 7f83e57fa640 1 -- 172.21.15.17:0/3932844508 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f83e0037020 con 0x7f83e8100860 2024-09-20T18:34:05.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.263+0000 7f83e57fa640 1 --2- 172.21.15.17:0/3932844508 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f83d006e310 0x7f83d00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:05.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.264+0000 7f83e77fe640 1 --2- 172.21.15.17:0/3932844508 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f83d006e310 0x7f83d00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:05.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.264+0000 7f83e57fa640 1 -- 172.21.15.17:0/3932844508 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f83e00af8d0 con 0x7f83e8100860 2024-09-20T18:34:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.265+0000 7f83e77fe640 1 --2- 172.21.15.17:0/3932844508 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f83d006e310 0x7f83d00707d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f83dc005fd0 tx=0x7f83dc005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:05.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.272+0000 7f83e57fa640 1 -- 172.21.15.17:0/3932844508 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f83e004a060 con 0x7f83e8100860 2024-09-20T18:34:05.552 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:05 smithi017 ceph-mon[28058]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:34:05.552 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:05 smithi017 ceph-mon[28058]: from='client.24369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:34:05.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:05 smithi172 ceph-mon[35456]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:34:05.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:05 smithi172 ceph-mon[35456]: from='client.24369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:34:05.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.775+0000 7f83ee66c640 1 -- 172.21.15.17:0/3932844508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f83d4005dc0 con 0x7f83e8100860 2024-09-20T18:34:05.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.777+0000 7f83e57fa640 1 -- 172.21.15.17:0/3932844508 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7f83e00443e0 con 0x7f83e8100860 2024-09-20T18:34:05.792 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:34:05.792 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:34:05.792 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T18:34:05.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:34:05.792 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:34:05.792 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T18:34:05.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:34:05.793 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:34:05.793 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T18:34:05.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:34:05.793 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:34:05.793 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:34:05.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:34:05.793 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:34:05.793 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 14 2024-09-20T18:34:05.793 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:34:05.793 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:34:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.780+0000 7f83ee66c640 1 -- 172.21.15.17:0/3932844508 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f83d006e310 msgr2=0x7f83d00707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.780+0000 7f83ee66c640 1 --2- 172.21.15.17:0/3932844508 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f83d006e310 0x7f83d00707d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f83dc005fd0 tx=0x7f83dc005850 comp rx=0 tx=0).stop 2024-09-20T18:34:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.781+0000 7f83ee66c640 1 -- 172.21.15.17:0/3932844508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e8100860 msgr2=0x7f83e819da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.781+0000 7f83ee66c640 1 --2- 172.21.15.17:0/3932844508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e8100860 0x7f83e819da90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f83e0004af0 tx=0x7f83e002f670 comp rx=0 tx=0).stop 2024-09-20T18:34:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.781+0000 7f83ee66c640 1 -- 172.21.15.17:0/3932844508 shutdown_connections 2024-09-20T18:34:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.781+0000 7f83ee66c640 1 --2- 172.21.15.17:0/3932844508 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f83d006e310 0x7f83d00707d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.782+0000 7f83ee66c640 1 --2- 172.21.15.17:0/3932844508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83e8101a60 0x7f83e819dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.782+0000 7f83ee66c640 1 --2- 172.21.15.17:0/3932844508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e8100860 0x7f83e819da90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.782+0000 7f83ee66c640 1 -- 172.21.15.17:0/3932844508 >> 172.21.15.17:0/3932844508 conn(0x7f83e80fc010 msgr2=0x7f83e8104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.783+0000 7f83ee66c640 1 -- 172.21.15.17:0/3932844508 shutdown_connections 2024-09-20T18:34:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.783+0000 7f83ee66c640 1 -- 172.21.15.17:0/3932844508 wait complete. 2024-09-20T18:34:05.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.918+0000 7fc0a4c44640 1 -- 172.21.15.17:0/2437480720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0a0100860 msgr2=0x7fc0a0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:05.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.918+0000 7fc0a4c44640 1 --2- 172.21.15.17:0/2437480720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0a0100860 0x7fc0a0100c60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc090009880 tx=0x7fc09002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:34:05.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.919+0000 7fc0a4c44640 1 -- 172.21.15.17:0/2437480720 shutdown_connections 2024-09-20T18:34:05.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.919+0000 7fc0a4c44640 1 --2- 172.21.15.17:0/2437480720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0a0101a60 0x7fc0a0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:05.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.919+0000 7fc0a4c44640 1 --2- 172.21.15.17:0/2437480720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0a0100860 0x7fc0a0100c60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:05.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.919+0000 7fc0a4c44640 1 -- 172.21.15.17:0/2437480720 >> 172.21.15.17:0/2437480720 conn(0x7fc0a00fc010 msgr2=0x7fc0a00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:05.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.920+0000 7fc0a4c44640 1 -- 172.21.15.17:0/2437480720 shutdown_connections 2024-09-20T18:34:05.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.920+0000 7fc0a4c44640 1 -- 172.21.15.17:0/2437480720 wait complete. 2024-09-20T18:34:05.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.921+0000 7fc0a4c44640 1 Processor -- start 2024-09-20T18:34:05.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.921+0000 7fc0a4c44640 1 -- start start 2024-09-20T18:34:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.921+0000 7fc0a4c44640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0a0100860 0x7fc0a01087a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.921+0000 7fc0a4c44640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0a0101a60 0x7fc0a0106e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.921+0000 7fc09e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0a0100860 0x7fc0a01087a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.921+0000 7fc09e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0a0100860 0x7fc0a01087a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:50824/0 (socket says 172.21.15.17:50824) 2024-09-20T18:34:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.921+0000 7fc09e59c640 1 -- 172.21.15.17:0/2627936625 learned_addr learned my addr 172.21.15.17:0/2627936625 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:34:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.921+0000 7fc0a4c44640 1 -- 172.21.15.17:0/2627936625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a010a800 con 0x7fc0a0101a60 2024-09-20T18:34:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.921+0000 7fc0a4c44640 1 -- 172.21.15.17:0/2627936625 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a010a680 con 0x7fc0a0100860 2024-09-20T18:34:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.922+0000 7fc09dd9b640 1 --2- 172.21.15.17:0/2627936625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0a0101a60 0x7fc0a0106e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.922+0000 7fc09e59c640 1 -- 172.21.15.17:0/2627936625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0a0101a60 msgr2=0x7fc0a0106e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.922+0000 7fc09e59c640 1 --2- 172.21.15.17:0/2627936625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0a0101a60 0x7fc0a0106e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.922+0000 7fc09e59c640 1 -- 172.21.15.17:0/2627936625 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a019afb0 con 0x7fc0a0100860 2024-09-20T18:34:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.922+0000 7fc09e59c640 1 --2- 172.21.15.17:0/2627936625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0a0100860 0x7fc0a01087a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc09002aa90 tx=0x7fc090004a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.923+0000 7fc08f7fe640 1 -- 172.21.15.17:0/2627936625 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc09003f070 con 0x7fc0a0100860 2024-09-20T18:34:05.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.923+0000 7fc0a4c44640 1 -- 172.21.15.17:0/2627936625 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a01073a0 con 0x7fc0a0100860 2024-09-20T18:34:05.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.923+0000 7fc0a4c44640 1 -- 172.21.15.17:0/2627936625 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a0107950 con 0x7fc0a0100860 2024-09-20T18:34:05.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.924+0000 7fc08f7fe640 1 -- 172.21.15.17:0/2627936625 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc090003ab0 con 0x7fc0a0100860 2024-09-20T18:34:05.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.924+0000 7fc0a4c44640 1 -- 172.21.15.17:0/2627936625 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a019b180 con 0x7fc0a0100860 2024-09-20T18:34:05.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.926+0000 7fc08f7fe640 1 -- 172.21.15.17:0/2627936625 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc090035030 con 0x7fc0a0100860 2024-09-20T18:34:05.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.927+0000 7fc08f7fe640 1 -- 172.21.15.17:0/2627936625 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc090042070 con 0x7fc0a0100860 2024-09-20T18:34:05.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.927+0000 7fc08f7fe640 1 --2- 172.21.15.17:0/2627936625 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc08806e3a0 0x7fc088070860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:05.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.928+0000 7fc09dd9b640 1 --2- 172.21.15.17:0/2627936625 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc08806e3a0 0x7fc088070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:05.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.929+0000 7fc08f7fe640 1 -- 172.21.15.17:0/2627936625 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fc0900aedb0 con 0x7fc0a0100860 2024-09-20T18:34:05.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.929+0000 7fc09dd9b640 1 --2- 172.21.15.17:0/2627936625 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc08806e3a0 0x7fc088070860 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0108520 tx=0x7fc094009110 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:05.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:05.936+0000 7fc08f7fe640 1 -- 172.21.15.17:0/2627936625 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc090049020 con 0x7fc0a0100860 2024-09-20T18:34:06.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:06.328+0000 7fc0a4c44640 1 -- 172.21.15.17:0/2627936625 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc0a0105e50 con 0x7fc08806e3a0 2024-09-20T18:34:06.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:06.329+0000 7fc08f7fe640 1 -- 172.21.15.17:0/2627936625 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7fc0a0105e50 con 0x7fc08806e3a0 2024-09-20T18:34:06.343 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:34:06.343 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:34:06.343 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:34:06.343 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T18:34:06.343 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [], 2024-09-20T18:34:06.343 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "0/2 daemons upgraded", 2024-09-20T18:34:06.343 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 image on host smithi172", 2024-09-20T18:34:06.344 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:34:06.344 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:34:06.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:06.331+0000 7fc0a4c44640 1 -- 172.21.15.17:0/2627936625 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc08806e3a0 msgr2=0x7fc088070860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:06.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:06.331+0000 7fc0a4c44640 1 --2- 172.21.15.17:0/2627936625 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc08806e3a0 0x7fc088070860 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0108520 tx=0x7fc094009110 comp rx=0 tx=0).stop 2024-09-20T18:34:06.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:06.332+0000 7fc0a4c44640 1 -- 172.21.15.17:0/2627936625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0a0100860 msgr2=0x7fc0a01087a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:06.332+0000 7fc0a4c44640 1 --2- 172.21.15.17:0/2627936625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0a0100860 0x7fc0a01087a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc09002aa90 tx=0x7fc090004a30 comp rx=0 tx=0).stop 2024-09-20T18:34:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:06.332+0000 7fc0a4c44640 1 -- 172.21.15.17:0/2627936625 shutdown_connections 2024-09-20T18:34:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:06.332+0000 7fc0a4c44640 1 --2- 172.21.15.17:0/2627936625 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc08806e3a0 0x7fc088070860 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:06.332+0000 7fc0a4c44640 1 --2- 172.21.15.17:0/2627936625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0a0101a60 0x7fc0a0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:06.332+0000 7fc0a4c44640 1 --2- 172.21.15.17:0/2627936625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0a0100860 0x7fc0a01087a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:06.332+0000 7fc0a4c44640 1 -- 172.21.15.17:0/2627936625 >> 172.21.15.17:0/2627936625 conn(0x7fc0a00fc010 msgr2=0x7fc0a00fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:06.332+0000 7fc0a4c44640 1 -- 172.21.15.17:0/2627936625 shutdown_connections 2024-09-20T18:34:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:06.332+0000 7fc0a4c44640 1 -- 172.21.15.17:0/2627936625 wait complete. 2024-09-20T18:34:06.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:06 smithi017 ceph-mon[28058]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:34:06.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:06 smithi017 ceph-mon[28058]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:34:06.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:06 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:06.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:06 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:34:06.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:06 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3932844508' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:34:06.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:06 smithi172 ceph-mon[35456]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:34:06.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:06 smithi172 ceph-mon[35456]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:34:06.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:06 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:06.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:06 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:34:06.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:06 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3932844508' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:34:07.553 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:07 smithi017 ceph-mon[28058]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:34:07.553 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:07 smithi017 ceph-mon[28058]: Upgrade: Target is version 19.3.0-5099-g88deadb8 (squid) 2024-09-20T18:34:07.553 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:07 smithi017 ceph-mon[28058]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2'] 2024-09-20T18:34:07.553 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:07 smithi017 ceph-mon[28058]: Upgrade: Need to upgrade myself (mgr.smithi017.xusjwd) 2024-09-20T18:34:07.553 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:07 smithi017 ceph-mon[28058]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 on smithi172 2024-09-20T18:34:07.553 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:07 smithi017 ceph-mon[28058]: from='client.24381 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:34:07.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:07 smithi172 ceph-mon[35456]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:34:07.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:07 smithi172 ceph-mon[35456]: Upgrade: Target is version 19.3.0-5099-g88deadb8 (squid) 2024-09-20T18:34:07.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:07 smithi172 ceph-mon[35456]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2'] 2024-09-20T18:34:07.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:07 smithi172 ceph-mon[35456]: Upgrade: Need to upgrade myself (mgr.smithi017.xusjwd) 2024-09-20T18:34:07.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:07 smithi172 ceph-mon[35456]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 on smithi172 2024-09-20T18:34:07.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:07 smithi172 ceph-mon[35456]: from='client.24381 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:34:08.566 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:08 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:34:08.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:08 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:34:09.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:09 smithi017 ceph-mon[28058]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-20T18:34:09.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:09 smithi172 ceph-mon[35456]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-20T18:34:11.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:11 smithi017 ceph-mon[28058]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-20T18:34:11.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:11 smithi172 ceph-mon[35456]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-20T18:34:13.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:13 smithi017 ceph-mon[28058]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-20T18:34:13.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:13 smithi172 ceph-mon[35456]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-20T18:34:15.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:15 smithi017 ceph-mon[28058]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-20T18:34:15.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:15 smithi172 ceph-mon[35456]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-20T18:34:17.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:17 smithi172 ceph-mon[35456]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:34:17.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:17 smithi017 ceph-mon[28058]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:34:19.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:19 smithi017 ceph-mon[28058]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T18:34:19.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:19 smithi172 ceph-mon[35456]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T18:34:21.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:21 smithi017 ceph-mon[28058]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:34:21.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:21 smithi172 ceph-mon[35456]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:34:23.297 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:23 smithi172 ceph-mon[35456]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:34:23.298 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:23 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:34:23.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:23 smithi017 ceph-mon[28058]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:34:23.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:23 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:34:25.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:25 smithi017 ceph-mon[28058]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:34:25.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:25 smithi172 ceph-mon[35456]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:34:27.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:27 smithi172 ceph-mon[35456]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T18:34:27.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:27 smithi017 ceph-mon[28058]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T18:34:29.352 INFO:tasks.workunit.client.0.smithi017.stderr:Updating files: 90% (11535/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-20T18:34:29.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:29 smithi017 ceph-mon[28058]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T18:34:29.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:29 smithi172 ceph-mon[35456]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T18:34:30.067 INFO:tasks.workunit.client.0.smithi017.stderr:Note: switching to '88deadb8082f4a33832e228ccefc59cedba158a5'. 2024-09-20T18:34:30.067 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-20T18:34:30.067 INFO:tasks.workunit.client.0.smithi017.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-20T18:34:30.067 INFO:tasks.workunit.client.0.smithi017.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-20T18:34:30.067 INFO:tasks.workunit.client.0.smithi017.stderr:state without impacting any branches by switching back to a branch. 2024-09-20T18:34:30.067 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-20T18:34:30.067 INFO:tasks.workunit.client.0.smithi017.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-20T18:34:30.067 INFO:tasks.workunit.client.0.smithi017.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-20T18:34:30.067 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-20T18:34:30.067 INFO:tasks.workunit.client.0.smithi017.stderr: git switch -c 2024-09-20T18:34:30.068 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-20T18:34:30.068 INFO:tasks.workunit.client.0.smithi017.stderr:Or undo this operation with: 2024-09-20T18:34:30.068 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-20T18:34:30.068 INFO:tasks.workunit.client.0.smithi017.stderr: git switch - 2024-09-20T18:34:30.068 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-20T18:34:30.068 INFO:tasks.workunit.client.0.smithi017.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-20T18:34:30.068 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-20T18:34:30.068 INFO:tasks.workunit.client.0.smithi017.stderr:HEAD is now at 88deadb8082 ceph-volume: fix OSD lvm/tpm2 activation 2024-09-20T18:34:30.073 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-20T18:34:30.215 INFO:tasks.workunit.client.0.smithi017.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-20T18:34:30.217 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-20T18:34:30.217 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-20T18:34:31.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:31 smithi017 ceph-mon[28058]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:34:31.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:31 smithi172 ceph-mon[35456]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:34:32.175 INFO:tasks.workunit.client.1.smithi172.stderr:Updating files: 12% (1542/12697) Updating files: 13% (1651/12697) Updating files: 14% (1778/12697) Updating files: 15% (1905/12697) Updating files: 16% (2032/12697) Updating files: 17% (2159/12697) Updating files: 18% (2286/12697) Updating files: 19% (2413/12697) Updating files: 20% (2540/12697) Updating files: 21% (2667/12697) Updating files: 22% (2794/12697) Updating files: 23% (2921/12697) Updating files: 24% (3048/12697) Updating files: 25% (3175/12697) Updating files: 26% (3302/12697) Updating files: 27% (3429/12697) Updating files: 28% (3556/12697) Updating files: 29% (3683/12697) Updating files: 30% (3810/12697) Updating files: 31% (3937/12697) Updating files: 32% (4064/12697) Updating files: 33% (4191/12697) Updating files: 34% (4317/12697) Updating files: 35% (4444/12697) Updating files: 36% (4571/12697) Updating files: 37% (4698/12697) Updating files: 38% (4825/12697) Updating files: 39% (4952/12697) Updating files: 40% (5079/12697) Updating files: 41% (5206/12697) Updating files: 42% (5333/12697) Updating files: 43% (5460/12697) Updating files: 44% (5587/12697) Updating files: 45% (5714/12697) Updating files: 46% (5841/12697) Updating files: 47% (5968/12697) Updating files: 48% (6095/12697) Updating files: 49% (6222/12697) Updating files: 50% (6349/12697) Updating files: 51% (6476/12697) Updating files: 52% (6603/12697) Updating files: 53% (6730/12697) Updating files: 54% (6857/12697) Updating files: 55% (6984/12697) Updating files: 56% (7111/12697) Updating files: 57% (7238/12697) Updating files: 58% (7365/12697) Updating files: 59% (7492/12697) Updating files: 59% (7513/12697) Updating files: 60% (7619/12697) Updating files: 61% (7746/12697) Updating files: 62% (7873/12697) Updating files: 63% (8000/12697) Updating files: 64% (8127/12697) Updating files: 65% (8254/12697) Updating files: 66% (8381/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-20T18:34:32.648 INFO:tasks.workunit.client.1.smithi172.stderr:Note: switching to '88deadb8082f4a33832e228ccefc59cedba158a5'. 2024-09-20T18:34:32.649 INFO:tasks.workunit.client.1.smithi172.stderr: 2024-09-20T18:34:32.649 INFO:tasks.workunit.client.1.smithi172.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-20T18:34:32.649 INFO:tasks.workunit.client.1.smithi172.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-20T18:34:32.649 INFO:tasks.workunit.client.1.smithi172.stderr:state without impacting any branches by switching back to a branch. 2024-09-20T18:34:32.649 INFO:tasks.workunit.client.1.smithi172.stderr: 2024-09-20T18:34:32.649 INFO:tasks.workunit.client.1.smithi172.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-20T18:34:32.649 INFO:tasks.workunit.client.1.smithi172.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-20T18:34:32.649 INFO:tasks.workunit.client.1.smithi172.stderr: 2024-09-20T18:34:32.649 INFO:tasks.workunit.client.1.smithi172.stderr: git switch -c 2024-09-20T18:34:32.649 INFO:tasks.workunit.client.1.smithi172.stderr: 2024-09-20T18:34:32.649 INFO:tasks.workunit.client.1.smithi172.stderr:Or undo this operation with: 2024-09-20T18:34:32.649 INFO:tasks.workunit.client.1.smithi172.stderr: 2024-09-20T18:34:32.649 INFO:tasks.workunit.client.1.smithi172.stderr: git switch - 2024-09-20T18:34:32.650 INFO:tasks.workunit.client.1.smithi172.stderr: 2024-09-20T18:34:32.650 INFO:tasks.workunit.client.1.smithi172.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-20T18:34:32.650 INFO:tasks.workunit.client.1.smithi172.stderr: 2024-09-20T18:34:32.650 INFO:tasks.workunit.client.1.smithi172.stderr:HEAD is now at 88deadb8082 ceph-volume: fix OSD lvm/tpm2 activation 2024-09-20T18:34:32.654 DEBUG:teuthology.orchestra.run.smithi172:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-20T18:34:32.719 INFO:tasks.workunit.client.1.smithi172.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-20T18:34:32.721 INFO:tasks.workunit.client.1.smithi172.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-20T18:34:32.721 INFO:tasks.workunit.client.1.smithi172.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-20T18:34:33.426 INFO:tasks.workunit.client.1.smithi172.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-20T18:34:33.523 INFO:tasks.workunit.client.1.smithi172.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-20T18:34:33.572 INFO:tasks.workunit.client.1.smithi172.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-20T18:34:33.573 INFO:tasks.workunit.client.1.smithi172.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-20T18:34:33.574 INFO:tasks.workunit.client.1.smithi172.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-20T18:34:33.625 INFO:tasks.workunit.client.1.smithi172.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-20T18:34:33.628 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-20T18:34:33.628 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-20T18:34:33.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:33 smithi017 ceph-mon[28058]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:34:33.687 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-20T18:34:33.688 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-20T18:34:33.688 DEBUG:teuthology.orchestra.run.smithi172:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88deadb8082f4a33832e228ccefc59cedba158a5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-20T18:34:33.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:33 smithi172 ceph-mon[35456]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:34:33.739 INFO:tasks.workunit.client.1.smithi172.stderr:+ mkdir -p fsstress 2024-09-20T18:34:33.742 INFO:tasks.workunit.client.1.smithi172.stderr:+ pushd fsstress 2024-09-20T18:34:33.743 INFO:tasks.workunit.client.1.smithi172.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-20T18:34:33.743 INFO:tasks.workunit.client.1.smithi172.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-20T18:34:34.651 INFO:tasks.workunit.client.1.smithi172.stderr:+ tar xzf ltp-full.tgz 2024-09-20T18:34:35.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:35 smithi017 ceph-mon[28058]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:34:35.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:35 smithi172 ceph-mon[35456]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:34:36.236 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-20T18:34:36.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.421+0000 7efdcbc97640 1 -- 172.21.15.17:0/3836044014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4100b20 msgr2=0x7efdc4100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:36.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.421+0000 7efdcbc97640 1 --2- 172.21.15.17:0/3836044014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4100b20 0x7efdc4100f80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009880 tx=0x7efdb402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:34:36.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.421+0000 7efdcbc97640 1 -- 172.21.15.17:0/3836044014 shutdown_connections 2024-09-20T18:34:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.421+0000 7efdcbc97640 1 --2- 172.21.15.17:0/3836044014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4100b20 0x7efdc4100f80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.421+0000 7efdcbc97640 1 --2- 172.21.15.17:0/3836044014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc41001e0 0x7efdc41005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.421+0000 7efdcbc97640 1 -- 172.21.15.17:0/3836044014 >> 172.21.15.17:0/3836044014 conn(0x7efdc40fc010 msgr2=0x7efdc40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.421+0000 7efdcbc97640 1 -- 172.21.15.17:0/3836044014 shutdown_connections 2024-09-20T18:34:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.421+0000 7efdcbc97640 1 -- 172.21.15.17:0/3836044014 wait complete. 2024-09-20T18:34:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.421+0000 7efdcbc97640 1 Processor -- start 2024-09-20T18:34:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.422+0000 7efdcbc97640 1 -- start start 2024-09-20T18:34:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.422+0000 7efdcbc97640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc41001e0 0x7efdc4199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.422+0000 7efdcbc97640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4100b20 0x7efdc4199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.422+0000 7efdcbc97640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efdc410c970 con 0x7efdc4100b20 2024-09-20T18:34:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.422+0000 7efdcbc97640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efdc410c7f0 con 0x7efdc41001e0 2024-09-20T18:34:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.422+0000 7efdc9232640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4100b20 0x7efdc4199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.422+0000 7efdc9232640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4100b20 0x7efdc4199bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55344/0 (socket says 172.21.15.17:55344) 2024-09-20T18:34:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.422+0000 7efdc9232640 1 -- 172.21.15.17:0/183684352 learned_addr learned my addr 172.21.15.17:0/183684352 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:34:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.422+0000 7efdc9a33640 1 --2- 172.21.15.17:0/183684352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc41001e0 0x7efdc4199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.422+0000 7efdc9232640 1 -- 172.21.15.17:0/183684352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc41001e0 msgr2=0x7efdc4199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.422+0000 7efdc9232640 1 --2- 172.21.15.17:0/183684352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc41001e0 0x7efdc4199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.422+0000 7efdc9232640 1 -- 172.21.15.17:0/183684352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc419a240 con 0x7efdc4100b20 2024-09-20T18:34:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.423+0000 7efdc9232640 1 --2- 172.21.15.17:0/183684352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4100b20 0x7efdc4199bc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efdb4006010 tx=0x7efdb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.423+0000 7efdbaffd640 1 -- 172.21.15.17:0/183684352 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efdb403f070 con 0x7efdc4100b20 2024-09-20T18:34:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.423+0000 7efdcbc97640 1 -- 172.21.15.17:0/183684352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc419ec20 con 0x7efdc4100b20 2024-09-20T18:34:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.423+0000 7efdbaffd640 1 -- 172.21.15.17:0/183684352 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efdb4004ac0 con 0x7efdc4100b20 2024-09-20T18:34:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.423+0000 7efdbaffd640 1 -- 172.21.15.17:0/183684352 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efdb4035030 con 0x7efdc4100b20 2024-09-20T18:34:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.423+0000 7efdcbc97640 1 -- 172.21.15.17:0/183684352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc419f1b0 con 0x7efdc4100b20 2024-09-20T18:34:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.424+0000 7efdcbc97640 1 -- 172.21.15.17:0/183684352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc41005e0 con 0x7efdc4100b20 2024-09-20T18:34:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.425+0000 7efdbaffd640 1 -- 172.21.15.17:0/183684352 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7efdb4042070 con 0x7efdc4100b20 2024-09-20T18:34:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.425+0000 7efdbaffd640 1 --2- 172.21.15.17:0/183684352 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7efdb006e2b0 0x7efdb0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.426+0000 7efdbaffd640 1 -- 172.21.15.17:0/183684352 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7efdb40aed20 con 0x7efdc4100b20 2024-09-20T18:34:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.426+0000 7efdc9a33640 1 --2- 172.21.15.17:0/183684352 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7efdb006e2b0 0x7efdb0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.426+0000 7efdc9a33640 1 --2- 172.21.15.17:0/183684352 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7efdb006e2b0 0x7efdb0070770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efdc000bbe0 tx=0x7efdc000b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.431+0000 7efdbaffd640 1 -- 172.21.15.17:0/183684352 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efdb4080330 con 0x7efdc4100b20 2024-09-20T18:34:36.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.694+0000 7efdcbc97640 1 -- 172.21.15.17:0/183684352 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efdc4062630 con 0x7efdb006e2b0 2024-09-20T18:34:36.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.696+0000 7efdbaffd640 1 -- 172.21.15.17:0/183684352 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7efdc4062630 con 0x7efdb006e2b0 2024-09-20T18:34:36.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.699+0000 7efdcbc97640 1 -- 172.21.15.17:0/183684352 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7efdb006e2b0 msgr2=0x7efdb0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:36.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.699+0000 7efdcbc97640 1 --2- 172.21.15.17:0/183684352 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7efdb006e2b0 0x7efdb0070770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efdc000bbe0 tx=0x7efdc000b390 comp rx=0 tx=0).stop 2024-09-20T18:34:36.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.699+0000 7efdcbc97640 1 -- 172.21.15.17:0/183684352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4100b20 msgr2=0x7efdc4199bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:36.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.699+0000 7efdcbc97640 1 --2- 172.21.15.17:0/183684352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4100b20 0x7efdc4199bc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efdb4006010 tx=0x7efdb40046c0 comp rx=0 tx=0).stop 2024-09-20T18:34:36.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.699+0000 7efdcbc97640 1 -- 172.21.15.17:0/183684352 shutdown_connections 2024-09-20T18:34:36.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.699+0000 7efdcbc97640 1 --2- 172.21.15.17:0/183684352 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7efdb006e2b0 0x7efdb0070770 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:36.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.699+0000 7efdcbc97640 1 --2- 172.21.15.17:0/183684352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4100b20 0x7efdc4199bc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:36.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.699+0000 7efdcbc97640 1 --2- 172.21.15.17:0/183684352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdc41001e0 0x7efdc4199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:36.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.699+0000 7efdcbc97640 1 -- 172.21.15.17:0/183684352 >> 172.21.15.17:0/183684352 conn(0x7efdc40fc010 msgr2=0x7efdc4108a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:36.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.699+0000 7efdcbc97640 1 -- 172.21.15.17:0/183684352 shutdown_connections 2024-09-20T18:34:36.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.699+0000 7efdcbc97640 1 -- 172.21.15.17:0/183684352 wait complete. 2024-09-20T18:34:36.723 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-20T18:34:36.725 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:34:36.776 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-20T18:34:36.778 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-20T18:34:36.778 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-20T18:34:36.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.805+0000 7f5fdbcf5640 1 -- 172.21.15.17:0/1499523676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fd4100860 msgr2=0x7f5fd4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:36.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.805+0000 7f5fdbcf5640 1 --2- 172.21.15.17:0/1499523676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fd4100860 0x7f5fd4100c60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009880 tx=0x7f5fd002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:34:36.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.805+0000 7f5fdbcf5640 1 -- 172.21.15.17:0/1499523676 shutdown_connections 2024-09-20T18:34:36.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.805+0000 7f5fdbcf5640 1 --2- 172.21.15.17:0/1499523676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fd4101a60 0x7f5fd4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:36.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.805+0000 7f5fdbcf5640 1 --2- 172.21.15.17:0/1499523676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fd4100860 0x7f5fd4100c60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:36.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.806+0000 7f5fdbcf5640 1 -- 172.21.15.17:0/1499523676 >> 172.21.15.17:0/1499523676 conn(0x7f5fd40fc010 msgr2=0x7f5fd40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:36.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.806+0000 7f5fdbcf5640 1 -- 172.21.15.17:0/1499523676 shutdown_connections 2024-09-20T18:34:36.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.806+0000 7f5fdbcf5640 1 -- 172.21.15.17:0/1499523676 wait complete. 2024-09-20T18:34:36.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.806+0000 7f5fdbcf5640 1 Processor -- start 2024-09-20T18:34:36.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.806+0000 7f5fdbcf5640 1 -- start start 2024-09-20T18:34:36.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.807+0000 7f5fdbcf5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fd4100860 0x7f5fd4197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:36.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.807+0000 7f5fdbcf5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fd4101a60 0x7f5fd4197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:36.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.807+0000 7f5fdbcf5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd41096a0 con 0x7f5fd4100860 2024-09-20T18:34:36.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.807+0000 7f5fdbcf5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd4109520 con 0x7f5fd4101a60 2024-09-20T18:34:36.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.807+0000 7f5fd9a91640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fd4100860 0x7f5fd4197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:36.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.807+0000 7f5fd9a91640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fd4100860 0x7f5fd4197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55356/0 (socket says 172.21.15.17:55356) 2024-09-20T18:34:36.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.807+0000 7f5fd9a91640 1 -- 172.21.15.17:0/3885718505 learned_addr learned my addr 172.21.15.17:0/3885718505 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:34:36.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.807+0000 7f5fd9290640 1 --2- 172.21.15.17:0/3885718505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fd4101a60 0x7f5fd4197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:36.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.807+0000 7f5fd9a91640 1 -- 172.21.15.17:0/3885718505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fd4101a60 msgr2=0x7f5fd4197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:36.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.807+0000 7f5fd9a91640 1 --2- 172.21.15.17:0/3885718505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fd4101a60 0x7f5fd4197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:36.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.807+0000 7f5fd9a91640 1 -- 172.21.15.17:0/3885718505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd41980e0 con 0x7f5fd4100860 2024-09-20T18:34:36.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.807+0000 7f5fd9a91640 1 --2- 172.21.15.17:0/3885718505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fd4100860 0x7f5fd4197520 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0006010 tx=0x7f5fd00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:36.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.808+0000 7f5fcaffd640 1 -- 172.21.15.17:0/3885718505 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fd003f070 con 0x7f5fd4100860 2024-09-20T18:34:36.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.808+0000 7f5fdbcf5640 1 -- 172.21.15.17:0/3885718505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd419cac0 con 0x7f5fd4100860 2024-09-20T18:34:36.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.808+0000 7f5fcaffd640 1 -- 172.21.15.17:0/3885718505 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5fd00049d0 con 0x7f5fd4100860 2024-09-20T18:34:36.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.808+0000 7f5fcaffd640 1 -- 172.21.15.17:0/3885718505 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fd0035030 con 0x7f5fd4100860 2024-09-20T18:34:36.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.808+0000 7f5fdbcf5640 1 -- 172.21.15.17:0/3885718505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd419d050 con 0x7f5fd4100860 2024-09-20T18:34:36.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.809+0000 7f5fdbcf5640 1 -- 172.21.15.17:0/3885718505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd4100c60 con 0x7f5fd4100860 2024-09-20T18:34:36.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.810+0000 7f5fcaffd640 1 -- 172.21.15.17:0/3885718505 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5fd0042070 con 0x7f5fd4100860 2024-09-20T18:34:36.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.810+0000 7f5fcaffd640 1 --2- 172.21.15.17:0/3885718505 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5fc00726c0 0x7f5fc0074b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:36.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.810+0000 7f5fcaffd640 1 -- 172.21.15.17:0/3885718505 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f5fd00aec10 con 0x7f5fd4100860 2024-09-20T18:34:36.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.810+0000 7f5fd9290640 1 --2- 172.21.15.17:0/3885718505 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5fc00726c0 0x7f5fc0074b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:36.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.811+0000 7f5fd9290640 1 --2- 172.21.15.17:0/3885718505 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5fc00726c0 0x7f5fc0074b80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5fd41989d0 tx=0x7f5fc4005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:36.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:36.815+0000 7f5fcaffd640 1 -- 172.21.15.17:0/3885718505 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5fd0080220 con 0x7f5fd4100860 2024-09-20T18:34:36.880 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-20T18:34:36.884 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T18:34:36.885 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-20T18:34:36.903 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-20T18:34:36.904 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-20T18:34:36.904 DEBUG:teuthology.orchestra.run.smithi017:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=88deadb8082f4a33832e228ccefc59cedba158a5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-20T18:34:36.970 INFO:tasks.workunit.client.0.smithi017.stderr:+ mkdir -p fsstress 2024-09-20T18:34:36.973 INFO:tasks.workunit.client.0.smithi017.stderr:+ pushd fsstress 2024-09-20T18:34:36.974 INFO:tasks.workunit.client.0.smithi017.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-20T18:34:36.974 INFO:tasks.workunit.client.0.smithi017.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-20T18:34:37.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.054+0000 7f5fdbcf5640 1 -- 172.21.15.17:0/3885718505 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5fd406a460 con 0x7f5fc00726c0 2024-09-20T18:34:37.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.055+0000 7f5fcaffd640 1 -- 172.21.15.17:0/3885718505 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f5fd406a460 con 0x7f5fc00726c0 2024-09-20T18:34:37.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.058+0000 7f5fdbcf5640 1 -- 172.21.15.17:0/3885718505 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5fc00726c0 msgr2=0x7f5fc0074b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:37.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.058+0000 7f5fdbcf5640 1 --2- 172.21.15.17:0/3885718505 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5fc00726c0 0x7f5fc0074b80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5fd41989d0 tx=0x7f5fc4005f90 comp rx=0 tx=0).stop 2024-09-20T18:34:37.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.058+0000 7f5fdbcf5640 1 -- 172.21.15.17:0/3885718505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fd4100860 msgr2=0x7f5fd4197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:37.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.058+0000 7f5fdbcf5640 1 --2- 172.21.15.17:0/3885718505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fd4100860 0x7f5fd4197520 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0006010 tx=0x7f5fd00045e0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.058+0000 7f5fdbcf5640 1 -- 172.21.15.17:0/3885718505 shutdown_connections 2024-09-20T18:34:37.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.058+0000 7f5fdbcf5640 1 --2- 172.21.15.17:0/3885718505 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7f5fc00726c0 0x7f5fc0074b80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.058+0000 7f5fdbcf5640 1 --2- 172.21.15.17:0/3885718505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fd4101a60 0x7f5fd4197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.058+0000 7f5fdbcf5640 1 --2- 172.21.15.17:0/3885718505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fd4100860 0x7f5fd4197520 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.058+0000 7f5fdbcf5640 1 -- 172.21.15.17:0/3885718505 >> 172.21.15.17:0/3885718505 conn(0x7f5fd40fc010 msgr2=0x7f5fd4069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:37.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.058+0000 7f5fdbcf5640 1 -- 172.21.15.17:0/3885718505 shutdown_connections 2024-09-20T18:34:37.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.058+0000 7f5fdbcf5640 1 -- 172.21.15.17:0/3885718505 wait complete. 2024-09-20T18:34:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.147+0000 7fc772f98640 1 -- 172.21.15.17:0/2817942101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc76c102bf0 msgr2=0x7fc76c103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.147+0000 7fc772f98640 1 --2- 172.21.15.17:0/2817942101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc76c102bf0 0x7fc76c103070 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc758009880 tx=0x7fc75802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.147+0000 7fc772f98640 1 -- 172.21.15.17:0/2817942101 shutdown_connections 2024-09-20T18:34:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.147+0000 7fc772f98640 1 --2- 172.21.15.17:0/2817942101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc76c102bf0 0x7fc76c103070 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.147+0000 7fc772f98640 1 --2- 172.21.15.17:0/2817942101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc76c0ffc10 0x7fc76c100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.147+0000 7fc772f98640 1 -- 172.21.15.17:0/2817942101 >> 172.21.15.17:0/2817942101 conn(0x7fc76c0fb760 msgr2=0x7fc76c0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:37.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.147+0000 7fc772f98640 1 -- 172.21.15.17:0/2817942101 shutdown_connections 2024-09-20T18:34:37.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.147+0000 7fc772f98640 1 -- 172.21.15.17:0/2817942101 wait complete. 2024-09-20T18:34:37.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.148+0000 7fc772f98640 1 Processor -- start 2024-09-20T18:34:37.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.148+0000 7fc772f98640 1 -- start start 2024-09-20T18:34:37.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.148+0000 7fc772f98640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc76c0ffc10 0x7fc76c197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:37.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.148+0000 7fc772f98640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc76c102bf0 0x7fc76c197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:37.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.148+0000 7fc772f98640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc76c10a770 con 0x7fc76c0ffc10 2024-09-20T18:34:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.148+0000 7fc772f98640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc76c10a5f0 con 0x7fc76c102bf0 2024-09-20T18:34:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.148+0000 7fc770d34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc76c0ffc10 0x7fc76c197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.148+0000 7fc770d34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc76c0ffc10 0x7fc76c197450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55372/0 (socket says 172.21.15.17:55372) 2024-09-20T18:34:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.148+0000 7fc770d34640 1 -- 172.21.15.17:0/2379865625 learned_addr learned my addr 172.21.15.17:0/2379865625 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:34:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.148+0000 7fc76bfff640 1 --2- 172.21.15.17:0/2379865625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc76c102bf0 0x7fc76c197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.148+0000 7fc770d34640 1 -- 172.21.15.17:0/2379865625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc76c102bf0 msgr2=0x7fc76c197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.148+0000 7fc770d34640 1 --2- 172.21.15.17:0/2379865625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc76c102bf0 0x7fc76c197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.148+0000 7fc770d34640 1 -- 172.21.15.17:0/2379865625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc76c198010 con 0x7fc76c0ffc10 2024-09-20T18:34:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.149+0000 7fc770d34640 1 --2- 172.21.15.17:0/2379865625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc76c0ffc10 0x7fc76c197450 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc76000e940 tx=0x7fc76000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.149+0000 7fc769ffb640 1 -- 172.21.15.17:0/2379865625 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc76000cac0 con 0x7fc76c0ffc10 2024-09-20T18:34:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.149+0000 7fc772f98640 1 -- 172.21.15.17:0/2379865625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc76c19ca50 con 0x7fc76c0ffc10 2024-09-20T18:34:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.149+0000 7fc769ffb640 1 -- 172.21.15.17:0/2379865625 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc76000cc60 con 0x7fc76c0ffc10 2024-09-20T18:34:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.149+0000 7fc769ffb640 1 -- 172.21.15.17:0/2379865625 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc760003de0 con 0x7fc76c0ffc10 2024-09-20T18:34:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.149+0000 7fc772f98640 1 -- 172.21.15.17:0/2379865625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc76c19cfb0 con 0x7fc76c0ffc10 2024-09-20T18:34:37.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.150+0000 7fc772f98640 1 -- 172.21.15.17:0/2379865625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc76c10af50 con 0x7fc76c0ffc10 2024-09-20T18:34:37.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.151+0000 7fc769ffb640 1 -- 172.21.15.17:0/2379865625 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc760003f80 con 0x7fc76c0ffc10 2024-09-20T18:34:37.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.151+0000 7fc769ffb640 1 --2- 172.21.15.17:0/2379865625 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc75c06e310 0x7fc75c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:37.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.151+0000 7fc769ffb640 1 -- 172.21.15.17:0/2379865625 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fc76008e800 con 0x7fc76c0ffc10 2024-09-20T18:34:37.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.151+0000 7fc76bfff640 1 --2- 172.21.15.17:0/2379865625 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc75c06e310 0x7fc75c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:37.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.152+0000 7fc76bfff640 1 --2- 172.21.15.17:0/2379865625 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc75c06e310 0x7fc75c0707d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc758000c00 tx=0x7fc7580058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:37.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.157+0000 7fc769ffb640 1 -- 172.21.15.17:0/2379865625 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc76005c140 con 0x7fc76c0ffc10 2024-09-20T18:34:37.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.372+0000 7fc772f98640 1 -- 172.21.15.17:0/2379865625 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc76c02dba0 con 0x7fc75c06e310 2024-09-20T18:34:37.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:37 smithi017 ceph-mon[28058]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T18:34:37.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.388+0000 7fc769ffb640 1 -- 172.21.15.17:0/2379865625 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fc76c02dba0 con 0x7fc75c06e310 2024-09-20T18:34:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:34:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (5m) 82s ago 6m 25.8M - 0.25.0 c8568f914cd2 8954ab699be3 2024-09-20T18:34:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (7m) 82s ago 7m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 404e79f7d9bb 2024-09-20T18:34:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (6m) 86s ago 6m 5272k - 19.1.1-369-ged8ee0f2 6acb0a031eab 747d22f4b582 2024-09-20T18:34:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (7m) 82s ago 7m 6895k - 19.1.1-369-ged8ee0f2 6acb0a031eab 725c8bcc6ec8 2024-09-20T18:34:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (6m) 86s ago 6m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab e10dd613dbe2 2024-09-20T18:34:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (5m) 82s ago 6m 81.4M - 9.4.12 2bacad6d85d8 d8c886b98eae 2024-09-20T18:34:37.404 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (104s) 82s ago 104s 18.7M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:34:37.405 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (99s) 82s ago 98s 17.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:34:37.405 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (96s) 86s ago 96s 14.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:34:37.405 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (102s) 86s ago 101s 14.6M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:34:37.405 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:9283,8765,8443 running (8m) 82s ago 8m 499M - 19.1.1-369-ged8ee0f2 6acb0a031eab 28eeab491beb 2024-09-20T18:34:37.405 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (6m) 86s ago 6m 443M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4b1c7bce31f2 2024-09-20T18:34:37.405 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (8m) 82s ago 8m 46.4M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab ab1f988c4cb2 2024-09-20T18:34:37.405 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (6m) 86s ago 6m 35.4M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 9eea40352787 2024-09-20T18:34:37.405 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (7m) 82s ago 7m 14.2M - 1.5.0 0da6a335fe13 1584915999b1 2024-09-20T18:34:37.405 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (6m) 86s ago 6m 15.4M - 1.5.0 0da6a335fe13 880d938148e8 2024-09-20T18:34:37.405 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (5m) 82s ago 4m 54.2M 3948M 19.1.1-369-ged8ee0f2 6acb0a031eab c1207e514216 2024-09-20T18:34:37.405 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (4m) 82s ago 4m 54.1M 3948M 19.1.1-369-ged8ee0f2 6acb0a031eab 73f2fd77590f 2024-09-20T18:34:37.405 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (4m) 82s ago 4m 53.4M 3948M 19.1.1-369-ged8ee0f2 6acb0a031eab 6f0b9405dc18 2024-09-20T18:34:37.405 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (3m) 86s ago 3m 51.8M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:34:37.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (3m) 86s ago 3m 48.7M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:34:37.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (2m) 86s ago 2m 42.7M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:34:37.406 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (5m) 82s ago 6m 58.1M - 2.43.0 a07b618ecd1d ebc76047e24f 2024-09-20T18:34:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.391+0000 7fc772f98640 1 -- 172.21.15.17:0/2379865625 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc75c06e310 msgr2=0x7fc75c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.391+0000 7fc772f98640 1 --2- 172.21.15.17:0/2379865625 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc75c06e310 0x7fc75c0707d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc758000c00 tx=0x7fc7580058d0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.391+0000 7fc772f98640 1 -- 172.21.15.17:0/2379865625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc76c0ffc10 msgr2=0x7fc76c197450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.391+0000 7fc772f98640 1 --2- 172.21.15.17:0/2379865625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc76c0ffc10 0x7fc76c197450 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc76000e940 tx=0x7fc76000ee00 comp rx=0 tx=0).stop 2024-09-20T18:34:37.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.391+0000 7fc772f98640 1 -- 172.21.15.17:0/2379865625 shutdown_connections 2024-09-20T18:34:37.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.391+0000 7fc772f98640 1 --2- 172.21.15.17:0/2379865625 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fc75c06e310 0x7fc75c0707d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.391+0000 7fc772f98640 1 --2- 172.21.15.17:0/2379865625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc76c102bf0 0x7fc76c197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.391+0000 7fc772f98640 1 --2- 172.21.15.17:0/2379865625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc76c0ffc10 0x7fc76c197450 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.391+0000 7fc772f98640 1 -- 172.21.15.17:0/2379865625 >> 172.21.15.17:0/2379865625 conn(0x7fc76c0fb760 msgr2=0x7fc76c1060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:37.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.391+0000 7fc772f98640 1 -- 172.21.15.17:0/2379865625 shutdown_connections 2024-09-20T18:34:37.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.391+0000 7fc772f98640 1 -- 172.21.15.17:0/2379865625 wait complete. 2024-09-20T18:34:37.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.497+0000 7fb582113640 1 -- 172.21.15.17:0/2951606846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c100860 msgr2=0x7fb57c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:37.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.497+0000 7fb582113640 1 --2- 172.21.15.17:0/2951606846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c100860 0x7fb57c100c60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009880 tx=0x7fb56c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.497+0000 7fb582113640 1 -- 172.21.15.17:0/2951606846 shutdown_connections 2024-09-20T18:34:37.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.497+0000 7fb582113640 1 --2- 172.21.15.17:0/2951606846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb57c101a60 0x7fb57c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.497+0000 7fb582113640 1 --2- 172.21.15.17:0/2951606846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c100860 0x7fb57c100c60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.497+0000 7fb582113640 1 -- 172.21.15.17:0/2951606846 >> 172.21.15.17:0/2951606846 conn(0x7fb57c0fc010 msgr2=0x7fb57c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:37.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.497+0000 7fb582113640 1 -- 172.21.15.17:0/2951606846 shutdown_connections 2024-09-20T18:34:37.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.497+0000 7fb582113640 1 -- 172.21.15.17:0/2951606846 wait complete. 2024-09-20T18:34:37.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.498+0000 7fb582113640 1 Processor -- start 2024-09-20T18:34:37.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.498+0000 7fb582113640 1 -- start start 2024-09-20T18:34:37.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.498+0000 7fb582113640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c100860 0x7fb57c1963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:37.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.498+0000 7fb582113640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb57c101a60 0x7fb57c196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:37.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.498+0000 7fb582113640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb57c1096a0 con 0x7fb57c100860 2024-09-20T18:34:37.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.498+0000 7fb582113640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb57c109520 con 0x7fb57c101a60 2024-09-20T18:34:37.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.499+0000 7fb57b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c100860 0x7fb57c1963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:37.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.499+0000 7fb57b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c100860 0x7fb57c1963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55388/0 (socket says 172.21.15.17:55388) 2024-09-20T18:34:37.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.499+0000 7fb57b7fe640 1 -- 172.21.15.17:0/3383701010 learned_addr learned my addr 172.21.15.17:0/3383701010 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:34:37.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.499+0000 7fb57affd640 1 --2- 172.21.15.17:0/3383701010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb57c101a60 0x7fb57c196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:37.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.499+0000 7fb57b7fe640 1 -- 172.21.15.17:0/3383701010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb57c101a60 msgr2=0x7fb57c196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:37.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.499+0000 7fb57b7fe640 1 --2- 172.21.15.17:0/3383701010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb57c101a60 0x7fb57c196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.499+0000 7fb57b7fe640 1 -- 172.21.15.17:0/3383701010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb57c196f90 con 0x7fb57c100860 2024-09-20T18:34:37.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.499+0000 7fb57affd640 1 --2- 172.21.15.17:0/3383701010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb57c101a60 0x7fb57c196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T18:34:37.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.499+0000 7fb57b7fe640 1 --2- 172.21.15.17:0/3383701010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c100860 0x7fb57c1963d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009230 tx=0x7fb56c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:37.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.499+0000 7fb578ff9640 1 -- 172.21.15.17:0/3383701010 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb56c03f070 con 0x7fb57c100860 2024-09-20T18:34:37.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.499+0000 7fb578ff9640 1 -- 172.21.15.17:0/3383701010 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb56c0049d0 con 0x7fb57c100860 2024-09-20T18:34:37.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.499+0000 7fb582113640 1 -- 172.21.15.17:0/3383701010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb57c19b970 con 0x7fb57c100860 2024-09-20T18:34:37.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.499+0000 7fb578ff9640 1 -- 172.21.15.17:0/3383701010 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb56c035030 con 0x7fb57c100860 2024-09-20T18:34:37.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.500+0000 7fb582113640 1 -- 172.21.15.17:0/3383701010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb57c19bf00 con 0x7fb57c100860 2024-09-20T18:34:37.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.501+0000 7fb582113640 1 -- 172.21.15.17:0/3383701010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb57c100c60 con 0x7fb57c100860 2024-09-20T18:34:37.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.501+0000 7fb578ff9640 1 -- 172.21.15.17:0/3383701010 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fb56c042070 con 0x7fb57c100860 2024-09-20T18:34:37.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.502+0000 7fb578ff9640 1 --2- 172.21.15.17:0/3383701010 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fb56406e300 0x7fb5640707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:37.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.502+0000 7fb578ff9640 1 -- 172.21.15.17:0/3383701010 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fb56c0aeb20 con 0x7fb57c100860 2024-09-20T18:34:37.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.502+0000 7fb57affd640 1 --2- 172.21.15.17:0/3383701010 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fb56406e300 0x7fb5640707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:37.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.503+0000 7fb57affd640 1 --2- 172.21.15.17:0/3383701010 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fb56406e300 0x7fb5640707c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb57c197880 tx=0x7fb570005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:37.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.508+0000 7fb578ff9640 1 -- 172.21.15.17:0/3383701010 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb56c0801b0 con 0x7fb57c100860 2024-09-20T18:34:37.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:37 smithi172 ceph-mon[35456]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 207 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T18:34:37.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.836+0000 7fb582113640 1 -- 172.21.15.17:0/3383701010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb57c062df0 con 0x7fb57c100860 2024-09-20T18:34:37.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.837+0000 7fb578ff9640 1 -- 172.21.15.17:0/3383701010 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7fb56c0849e0 con 0x7fb57c100860 2024-09-20T18:34:37.852 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:34:37.852 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:34:37.852 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T18:34:37.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:34:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:34:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T18:34:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:34:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:34:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T18:34:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:34:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:34:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:34:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:34:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:34:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 14 2024-09-20T18:34:37.853 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:34:37.853 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:34:37.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.839+0000 7fb582113640 1 -- 172.21.15.17:0/3383701010 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fb56406e300 msgr2=0x7fb5640707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:37.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.839+0000 7fb582113640 1 --2- 172.21.15.17:0/3383701010 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fb56406e300 0x7fb5640707c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb57c197880 tx=0x7fb570005f90 comp rx=0 tx=0).stop 2024-09-20T18:34:37.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.840+0000 7fb582113640 1 -- 172.21.15.17:0/3383701010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c100860 msgr2=0x7fb57c1963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:37.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.840+0000 7fb582113640 1 --2- 172.21.15.17:0/3383701010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c100860 0x7fb57c1963d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009230 tx=0x7fb56c0045e0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.840+0000 7fb582113640 1 -- 172.21.15.17:0/3383701010 shutdown_connections 2024-09-20T18:34:37.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.840+0000 7fb582113640 1 --2- 172.21.15.17:0/3383701010 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fb56406e300 0x7fb5640707c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.840+0000 7fb582113640 1 --2- 172.21.15.17:0/3383701010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb57c101a60 0x7fb57c196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.840+0000 7fb582113640 1 --2- 172.21.15.17:0/3383701010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c100860 0x7fb57c1963d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.840+0000 7fb582113640 1 -- 172.21.15.17:0/3383701010 >> 172.21.15.17:0/3383701010 conn(0x7fb57c0fc010 msgr2=0x7fb57c104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:37.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.840+0000 7fb582113640 1 -- 172.21.15.17:0/3383701010 shutdown_connections 2024-09-20T18:34:37.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.840+0000 7fb582113640 1 -- 172.21.15.17:0/3383701010 wait complete. 2024-09-20T18:34:37.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.945+0000 7fcdee1a7640 1 -- 172.21.15.17:0/2209594413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcde8101e20 msgr2=0x7fcde8102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:37.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.945+0000 7fcdee1a7640 1 --2- 172.21.15.17:0/2209594413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcde8101e20 0x7fcde8102220 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009880 tx=0x7fcdd802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.945+0000 7fcdee1a7640 1 -- 172.21.15.17:0/2209594413 shutdown_connections 2024-09-20T18:34:37.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.945+0000 7fcdee1a7640 1 --2- 172.21.15.17:0/2209594413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcde8100a80 0x7fcde8100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.945+0000 7fcdee1a7640 1 --2- 172.21.15.17:0/2209594413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcde8101e20 0x7fcde8102220 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.945+0000 7fcdee1a7640 1 -- 172.21.15.17:0/2209594413 >> 172.21.15.17:0/2209594413 conn(0x7fcde80fb760 msgr2=0x7fcde80fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:37.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.945+0000 7fcdee1a7640 1 -- 172.21.15.17:0/2209594413 shutdown_connections 2024-09-20T18:34:37.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.945+0000 7fcdee1a7640 1 -- 172.21.15.17:0/2209594413 wait complete. 2024-09-20T18:34:37.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.946+0000 7fcdee1a7640 1 Processor -- start 2024-09-20T18:34:37.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.946+0000 7fcdee1a7640 1 -- start start 2024-09-20T18:34:37.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.946+0000 7fcdee1a7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcde8100a80 0x7fcde8199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:37.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.946+0000 7fcdee1a7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcde8101e20 0x7fcde8199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:37.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.946+0000 7fcdee1a7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcde81096a0 con 0x7fcde8100a80 2024-09-20T18:34:37.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.946+0000 7fcdee1a7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcde8109520 con 0x7fcde8101e20 2024-09-20T18:34:37.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.946+0000 7fcde77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcde8100a80 0x7fcde8199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:37.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.947+0000 7fcde6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcde8101e20 0x7fcde8199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:37.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.947+0000 7fcde6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcde8101e20 0x7fcde8199c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:49510/0 (socket says 172.21.15.17:49510) 2024-09-20T18:34:37.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.947+0000 7fcde77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcde8100a80 0x7fcde8199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55404/0 (socket says 172.21.15.17:55404) 2024-09-20T18:34:37.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.947+0000 7fcde6ffd640 1 -- 172.21.15.17:0/141676068 learned_addr learned my addr 172.21.15.17:0/141676068 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:34:37.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.947+0000 7fcde77fe640 1 -- 172.21.15.17:0/141676068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcde8101e20 msgr2=0x7fcde8199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:37.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.947+0000 7fcde77fe640 1 --2- 172.21.15.17:0/141676068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcde8101e20 0x7fcde8199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:37.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.947+0000 7fcde77fe640 1 -- 172.21.15.17:0/141676068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde819a2d0 con 0x7fcde8100a80 2024-09-20T18:34:37.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.947+0000 7fcde6ffd640 1 --2- 172.21.15.17:0/141676068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcde8101e20 0x7fcde8199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T18:34:37.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.947+0000 7fcde77fe640 1 --2- 172.21.15.17:0/141676068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcde8100a80 0x7fcde8199710 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8006010 tx=0x7fcdd80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:37.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.947+0000 7fcde4ff9640 1 -- 172.21.15.17:0/141676068 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcdd803f070 con 0x7fcde8100a80 2024-09-20T18:34:37.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.947+0000 7fcde4ff9640 1 -- 172.21.15.17:0/141676068 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcdd80049d0 con 0x7fcde8100a80 2024-09-20T18:34:37.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.947+0000 7fcdee1a7640 1 -- 172.21.15.17:0/141676068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde819ecb0 con 0x7fcde8100a80 2024-09-20T18:34:37.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.948+0000 7fcde4ff9640 1 -- 172.21.15.17:0/141676068 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcdd8035030 con 0x7fcde8100a80 2024-09-20T18:34:37.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.948+0000 7fcdee1a7640 1 -- 172.21.15.17:0/141676068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde819f190 con 0x7fcde8100a80 2024-09-20T18:34:37.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.949+0000 7fcdee1a7640 1 -- 172.21.15.17:0/141676068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde8100f00 con 0x7fcde8100a80 2024-09-20T18:34:37.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.949+0000 7fcde4ff9640 1 -- 172.21.15.17:0/141676068 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fcdd8042070 con 0x7fcde8100a80 2024-09-20T18:34:37.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.950+0000 7fcde4ff9640 1 --2- 172.21.15.17:0/141676068 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fcdd006e310 0x7fcdd00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:34:37.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.950+0000 7fcde4ff9640 1 -- 172.21.15.17:0/141676068 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fcdd80aea30 con 0x7fcde8100a80 2024-09-20T18:34:37.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.950+0000 7fcde6ffd640 1 --2- 172.21.15.17:0/141676068 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fcdd006e310 0x7fcdd00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:34:37.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.951+0000 7fcde6ffd640 1 --2- 172.21.15.17:0/141676068 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fcdd006e310 0x7fcdd00707d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcde819abc0 tx=0x7fcddc005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:34:37.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:37.957+0000 7fcde4ff9640 1 -- 172.21.15.17:0/141676068 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcdd80800c0 con 0x7fcde8100a80 2024-09-20T18:34:38.031 INFO:tasks.workunit.client.0.smithi017.stderr:+ tar xzf ltp-full.tgz 2024-09-20T18:34:38.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:38.209+0000 7fcdee1a7640 1 -- 172.21.15.17:0/141676068 --> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcde81000f0 con 0x7fcdd006e310 2024-09-20T18:34:38.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:38.210+0000 7fcde4ff9640 1 -- 172.21.15.17:0/141676068 <== mgr.14217 v2:172.21.15.17:6800/2021461456 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7fcde81000f0 con 0x7fcdd006e310 2024-09-20T18:34:38.226 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:34:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:34:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:34:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T18:34:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [], 2024-09-20T18:34:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "0/2 daemons upgraded", 2024-09-20T18:34:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mgr daemons", 2024-09-20T18:34:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:34:38.226 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:34:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:38.213+0000 7fcdee1a7640 1 -- 172.21.15.17:0/141676068 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fcdd006e310 msgr2=0x7fcdd00707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:38.213+0000 7fcdee1a7640 1 --2- 172.21.15.17:0/141676068 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fcdd006e310 0x7fcdd00707d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcde819abc0 tx=0x7fcddc005f90 comp rx=0 tx=0).stop 2024-09-20T18:34:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:38.213+0000 7fcdee1a7640 1 -- 172.21.15.17:0/141676068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcde8100a80 msgr2=0x7fcde8199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:34:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:38.213+0000 7fcdee1a7640 1 --2- 172.21.15.17:0/141676068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcde8100a80 0x7fcde8199710 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8006010 tx=0x7fcdd80045e0 comp rx=0 tx=0).stop 2024-09-20T18:34:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:38.213+0000 7fcdee1a7640 1 -- 172.21.15.17:0/141676068 shutdown_connections 2024-09-20T18:34:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:38.213+0000 7fcdee1a7640 1 --2- 172.21.15.17:0/141676068 >> [v2:172.21.15.17:6800/2021461456,v1:172.21.15.17:6801/2021461456] conn(0x7fcdd006e310 0x7fcdd00707d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:38.213+0000 7fcdee1a7640 1 --2- 172.21.15.17:0/141676068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcde8101e20 0x7fcde8199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:38.213+0000 7fcdee1a7640 1 --2- 172.21.15.17:0/141676068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcde8100a80 0x7fcde8199710 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:34:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:38.213+0000 7fcdee1a7640 1 -- 172.21.15.17:0/141676068 >> 172.21.15.17:0/141676068 conn(0x7fcde80fb760 msgr2=0x7fcde80ff9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:34:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:38.214+0000 7fcdee1a7640 1 -- 172.21.15.17:0/141676068 shutdown_connections 2024-09-20T18:34:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:34:38.214+0000 7fcdee1a7640 1 -- 172.21.15.17:0/141676068 wait complete. 2024-09-20T18:34:38.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:38 smithi172 ceph-mon[35456]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:34:38.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:38 smithi172 ceph-mon[35456]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:34:38.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:38 smithi172 ceph-mon[35456]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:34:38.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:38 smithi172 ceph-mon[35456]: Upgrade: Updating mgr.smithi172.jczphg 2024-09-20T18:34:38.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:38 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:38.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:38 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.jczphg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:34:38.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:38 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T18:34:38.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:38 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:34:38.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:38 smithi172 ceph-mon[35456]: Deploying daemon mgr.smithi172.jczphg on smithi172 2024-09-20T18:34:38.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:38 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:34:38.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:38 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3383701010' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:34:38.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:38 smithi017 ceph-mon[28058]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:34:38.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:38 smithi017 ceph-mon[28058]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:34:38.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:38 smithi017 ceph-mon[28058]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:34:38.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:38 smithi017 ceph-mon[28058]: Upgrade: Updating mgr.smithi172.jczphg 2024-09-20T18:34:38.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:38 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:38.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:38 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.jczphg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:34:38.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:38 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T18:34:38.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:38 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:34:38.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:38 smithi017 ceph-mon[28058]: Deploying daemon mgr.smithi172.jczphg on smithi172 2024-09-20T18:34:38.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:38 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:34:38.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:38 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3383701010' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:34:39.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:39 smithi172 ceph-mon[35456]: pgmap v227: 65 pgs: 65 active+clean; 8.8 MiB data, 231 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 713 KiB/s wr, 17 op/s 2024-09-20T18:34:39.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:39 smithi172 ceph-mon[35456]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:34:39.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:39 smithi017 ceph-mon[28058]: pgmap v227: 65 pgs: 65 active+clean; 8.8 MiB data, 231 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 713 KiB/s wr, 17 op/s 2024-09-20T18:34:39.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:39 smithi017 ceph-mon[28058]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:34:41.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:41 smithi172 ceph-mon[35456]: pgmap v228: 65 pgs: 65 active+clean; 13 MiB data, 236 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 1.1 MiB/s wr, 23 op/s 2024-09-20T18:34:41.770 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:41 smithi017 ceph-mon[28058]: pgmap v228: 65 pgs: 65 active+clean; 13 MiB data, 236 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 1.1 MiB/s wr, 23 op/s 2024-09-20T18:34:42.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:42 smithi017 ceph-mon[28058]: pgmap v229: 65 pgs: 65 active+clean; 29 MiB data, 277 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 2.4 MiB/s wr, 67 op/s 2024-09-20T18:34:42.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:42 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:42.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:42 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:42.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:42 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:34:42.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:42 smithi172 ceph-mon[35456]: pgmap v229: 65 pgs: 65 active+clean; 29 MiB data, 277 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 2.4 MiB/s wr, 67 op/s 2024-09-20T18:34:42.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:42 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:42.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:42 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:42.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:42 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:34:44.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:44 smithi017 ceph-mon[28058]: pgmap v230: 65 pgs: 65 active+clean; 35 MiB data, 316 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 2.9 MiB/s wr, 104 op/s 2024-09-20T18:34:44.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:44 smithi172 ceph-mon[35456]: pgmap v230: 65 pgs: 65 active+clean; 35 MiB data, 316 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 2.9 MiB/s wr, 104 op/s 2024-09-20T18:34:45.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:45 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:45.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:45 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:45.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:45 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:45.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:45 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:46.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:45 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:46.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:45 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:46.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:45 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:46.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:45 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:47.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:47 smithi172 ceph-mon[35456]: pgmap v231: 65 pgs: 65 active+clean; 37 MiB data, 326 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 3.1 MiB/s wr, 119 op/s 2024-09-20T18:34:47.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:47 smithi017 ceph-mon[28058]: pgmap v231: 65 pgs: 65 active+clean; 37 MiB data, 326 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 3.1 MiB/s wr, 119 op/s 2024-09-20T18:34:48.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:48 smithi017 ceph-mon[28058]: Standby manager daemon smithi172.jczphg restarted 2024-09-20T18:34:48.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:48 smithi017 ceph-mon[28058]: Standby manager daemon smithi172.jczphg started 2024-09-20T18:34:48.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:48 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.jczphg/crt"}]: dispatch 2024-09-20T18:34:48.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:48 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T18:34:48.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:48 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.jczphg/key"}]: dispatch 2024-09-20T18:34:48.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:48 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T18:34:48.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:48 smithi172 ceph-mon[35456]: Standby manager daemon smithi172.jczphg restarted 2024-09-20T18:34:48.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:48 smithi172 ceph-mon[35456]: Standby manager daemon smithi172.jczphg started 2024-09-20T18:34:48.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:48 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.jczphg/crt"}]: dispatch 2024-09-20T18:34:48.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:48 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T18:34:48.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:48 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.jczphg/key"}]: dispatch 2024-09-20T18:34:48.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:48 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T18:34:49.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:49 smithi172 ceph-mon[35456]: pgmap v232: 65 pgs: 65 active+clean; 42 MiB data, 351 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.6 MiB/s wr, 142 op/s 2024-09-20T18:34:49.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:49 smithi172 ceph-mon[35456]: mgrmap e20: smithi017.xusjwd(active, since 6m), standbys: smithi172.jczphg 2024-09-20T18:34:49.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:49 smithi017 ceph-mon[28058]: pgmap v232: 65 pgs: 65 active+clean; 42 MiB data, 351 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.6 MiB/s wr, 142 op/s 2024-09-20T18:34:49.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:49 smithi017 ceph-mon[28058]: mgrmap e20: smithi017.xusjwd(active, since 6m), standbys: smithi172.jczphg 2024-09-20T18:34:51.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:51 smithi172 ceph-mon[35456]: pgmap v233: 65 pgs: 65 active+clean; 49 MiB data, 359 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 142 op/s 2024-09-20T18:34:51.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:51 smithi017 ceph-mon[28058]: pgmap v233: 65 pgs: 65 active+clean; 49 MiB data, 359 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 142 op/s 2024-09-20T18:34:53.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:53 smithi172 ceph-mon[35456]: pgmap v234: 65 pgs: 65 active+clean; 67 MiB data, 406 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 189 op/s 2024-09-20T18:34:53.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:53 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:34:53.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:53 smithi017 ceph-mon[28058]: pgmap v234: 65 pgs: 65 active+clean; 67 MiB data, 406 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 189 op/s 2024-09-20T18:34:53.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:53 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:34:55.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:55 smithi172 ceph-mon[35456]: pgmap v235: 65 pgs: 65 active+clean; 71 MiB data, 440 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 178 op/s 2024-09-20T18:34:55.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:55 smithi017 ceph-mon[28058]: pgmap v235: 65 pgs: 65 active+clean; 71 MiB data, 440 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 178 op/s 2024-09-20T18:34:57.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: pgmap v236: 65 pgs: 65 active+clean; 74 MiB data, 451 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 156 op/s 2024-09-20T18:34:57.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:57.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:57.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:34:57.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:34:57.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:57.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:34:57.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr fail", "who": "smithi017.xusjwd"}]: dispatch 2024-09-20T18:34:57.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: Activating manager daemon smithi172.jczphg 2024-09-20T18:34:57.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "mgr fail", "who": "smithi017.xusjwd"}]': finished 2024-09-20T18:34:57.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-09-20T18:34:57.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: osdmap e45: 6 total, 6 up, 6 in 2024-09-20T18:34:57.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:34:57.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: mgrmap e21: smithi172.jczphg(active, starting, since 0.00870451s) 2024-09-20T18:34:57.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.puqizo"}]: dispatch 2024-09-20T18:34:57.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.xhlvpy"}]: dispatch 2024-09-20T18:34:57.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.mugtlk"}]: dispatch 2024-09-20T18:34:57.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.liatxm"}]: dispatch 2024-09-20T18:34:57.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mgr metadata", "who": "smithi172.jczphg", "id": "smithi172.jczphg"}]: dispatch 2024-09-20T18:34:57.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:34:57.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T18:34:57.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T18:34:57.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:34:57.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T18:34:57.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T18:34:57.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T18:34:57.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T18:34:57.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T18:34:57.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:57 smithi017 ceph-mon[28058]: Manager daemon smithi172.jczphg is now available 2024-09-20T18:34:57.816 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: pgmap v236: 65 pgs: 65 active+clean; 74 MiB data, 451 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 156 op/s 2024-09-20T18:34:57.816 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:57.816 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:57.816 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:34:57.817 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:34:57.817 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' 2024-09-20T18:34:57.817 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:34:57.817 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr fail", "who": "smithi017.xusjwd"}]: dispatch 2024-09-20T18:34:57.817 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: Activating manager daemon smithi172.jczphg 2024-09-20T18:34:57.817 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.14217 172.21.15.17:0/36633502' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "mgr fail", "who": "smithi017.xusjwd"}]': finished 2024-09-20T18:34:57.817 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-09-20T18:34:57.817 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: osdmap e45: 6 total, 6 up, 6 in 2024-09-20T18:34:57.817 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:34:57.817 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: mgrmap e21: smithi172.jczphg(active, starting, since 0.00870451s) 2024-09-20T18:34:57.817 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.puqizo"}]: dispatch 2024-09-20T18:34:57.817 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.xhlvpy"}]: dispatch 2024-09-20T18:34:57.817 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.mugtlk"}]: dispatch 2024-09-20T18:34:57.817 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.liatxm"}]: dispatch 2024-09-20T18:34:57.817 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mgr metadata", "who": "smithi172.jczphg", "id": "smithi172.jczphg"}]: dispatch 2024-09-20T18:34:57.817 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:34:57.818 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T18:34:57.818 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T18:34:57.818 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:34:57.818 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T18:34:57.818 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T18:34:57.818 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T18:34:57.818 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T18:34:57.818 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T18:34:57.818 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:57 smithi172 ceph-mon[35456]: Manager daemon smithi172.jczphg is now available 2024-09-20T18:34:58.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:58 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:34:58.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:58 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:34:58.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:58 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:34:58.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:58 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:34:58.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:58 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T18:34:58.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:58 smithi017 ceph-mon[28058]: mgrmap e22: smithi172.jczphg(active, since 1.05421s) 2024-09-20T18:34:58.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:58 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.jczphg/mirror_snapshot_schedule"}]: dispatch 2024-09-20T18:34:58.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:58 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.jczphg/mirror_snapshot_schedule"}]: dispatch 2024-09-20T18:34:58.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:58 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.jczphg/trash_purge_schedule"}]: dispatch 2024-09-20T18:34:58.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:58 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.jczphg/trash_purge_schedule"}]: dispatch 2024-09-20T18:34:58.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:58 smithi017 ceph-mon[28058]: Deploying cephadm binary to smithi172 2024-09-20T18:34:58.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:58 smithi017 ceph-mon[28058]: Deploying cephadm binary to smithi017 2024-09-20T18:34:58.951 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:58 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:34:58.952 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:58 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:34:58.952 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:58 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:34:58.952 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:58 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:34:58.952 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:58 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T18:34:58.952 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:58 smithi172 ceph-mon[35456]: mgrmap e22: smithi172.jczphg(active, since 1.05421s) 2024-09-20T18:34:58.952 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:58 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.jczphg/mirror_snapshot_schedule"}]: dispatch 2024-09-20T18:34:58.952 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:58 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.jczphg/mirror_snapshot_schedule"}]: dispatch 2024-09-20T18:34:58.952 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:58 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.jczphg/trash_purge_schedule"}]: dispatch 2024-09-20T18:34:58.952 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:58 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.jczphg/trash_purge_schedule"}]: dispatch 2024-09-20T18:34:58.952 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:58 smithi172 ceph-mon[35456]: Deploying cephadm binary to smithi172 2024-09-20T18:34:58.952 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:58 smithi172 ceph-mon[35456]: Deploying cephadm binary to smithi017 2024-09-20T18:34:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:59 smithi172 ceph-mon[35456]: pgmap v4: 65 pgs: 65 active+clean; 99 MiB data, 501 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:34:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:59 smithi172 ceph-mon[35456]: [20/Sep/2024:18:34:58] ENGINE Bus STARTING 2024-09-20T18:34:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:59 smithi172 ceph-mon[35456]: [20/Sep/2024:18:34:58] ENGINE Serving on http://172.21.15.172:8765 2024-09-20T18:34:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:59 smithi172 ceph-mon[35456]: [20/Sep/2024:18:34:58] ENGINE Serving on https://172.21.15.172:7150 2024-09-20T18:34:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:59 smithi172 ceph-mon[35456]: [20/Sep/2024:18:34:58] ENGINE Bus STARTED 2024-09-20T18:34:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:34:59 smithi172 ceph-mon[35456]: [20/Sep/2024:18:34:58] ENGINE Error in HTTPServer.serve 2024-09-20T18:34:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Traceback (most recent call last): 2024-09-20T18:34:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T18:34:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: self._connections.run(self.expiration_interval) 2024-09-20T18:34:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T18:34:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: self._run(expiration_interval) 2024-09-20T18:34:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T18:34:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T18:34:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T18:34:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T18:34:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T18:34:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: s = self.context.wrap_socket( 2024-09-20T18:34:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T18:34:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: return self.sslsocket_class._create( 2024-09-20T18:34:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T18:34:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: self.do_handshake() 2024-09-20T18:34:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T18:34:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: self._sslobj.do_handshake() 2024-09-20T18:34:59.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T18:35:00.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:59 smithi017 ceph-mon[28058]: pgmap v4: 65 pgs: 65 active+clean; 99 MiB data, 501 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:35:00.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:59 smithi017 ceph-mon[28058]: [20/Sep/2024:18:34:58] ENGINE Bus STARTING 2024-09-20T18:35:00.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:59 smithi017 ceph-mon[28058]: [20/Sep/2024:18:34:58] ENGINE Serving on http://172.21.15.172:8765 2024-09-20T18:35:00.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:59 smithi017 ceph-mon[28058]: [20/Sep/2024:18:34:58] ENGINE Serving on https://172.21.15.172:7150 2024-09-20T18:35:00.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:59 smithi017 ceph-mon[28058]: [20/Sep/2024:18:34:58] ENGINE Bus STARTED 2024-09-20T18:35:00.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:34:59 smithi017 ceph-mon[28058]: [20/Sep/2024:18:34:58] ENGINE Error in HTTPServer.serve 2024-09-20T18:35:00.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Traceback (most recent call last): 2024-09-20T18:35:00.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T18:35:00.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-09-20T18:35:00.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T18:35:00.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._run(expiration_interval) 2024-09-20T18:35:00.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T18:35:00.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T18:35:00.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T18:35:00.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T18:35:00.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T18:35:00.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s = self.context.wrap_socket( 2024-09-20T18:35:00.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T18:35:00.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: return self.sslsocket_class._create( 2024-09-20T18:35:00.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T18:35:00.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self.do_handshake() 2024-09-20T18:35:00.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T18:35:00.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._sslobj.do_handshake() 2024-09-20T18:35:00.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T18:35:00.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:00 smithi172 ceph-mon[35456]: mgrmap e23: smithi172.jczphg(active, since 3s) 2024-09-20T18:35:00.965 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:00 smithi017 ceph-mon[28058]: mgrmap e23: smithi172.jczphg(active, since 3s) 2024-09-20T18:35:01.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:01 smithi017 ceph-mon[28058]: pgmap v5: 65 pgs: 65 active+clean; 99 MiB data, 501 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:35:01.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:01 smithi172 ceph-mon[35456]: pgmap v5: 65 pgs: 65 active+clean; 99 MiB data, 501 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:35:02.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:02 smithi172 ceph-mon[35456]: mgrmap e24: smithi172.jczphg(active, since 5s) 2024-09-20T18:35:03.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:02 smithi017 ceph-mon[28058]: mgrmap e24: smithi172.jczphg(active, since 5s) 2024-09-20T18:35:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:03 smithi017 ceph-mon[28058]: pgmap v6: 65 pgs: 65 active+clean; 99 MiB data, 501 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:35:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:03 smithi017 ceph-mon[28058]: Standby manager daemon smithi017.xusjwd started 2024-09-20T18:35:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:03 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.17:0/1590538312' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi017.xusjwd/crt"}]: dispatch 2024-09-20T18:35:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:03 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.17:0/1590538312' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T18:35:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:03 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.17:0/1590538312' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi017.xusjwd/key"}]: dispatch 2024-09-20T18:35:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:03 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.17:0/1590538312' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T18:35:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:03 smithi172 ceph-mon[35456]: pgmap v6: 65 pgs: 65 active+clean; 99 MiB data, 501 MiB used, 536 GiB / 536 GiB avail 2024-09-20T18:35:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:03 smithi172 ceph-mon[35456]: Standby manager daemon smithi017.xusjwd started 2024-09-20T18:35:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:03 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.17:0/1590538312' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi017.xusjwd/crt"}]: dispatch 2024-09-20T18:35:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:03 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.17:0/1590538312' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T18:35:03.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:03 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.17:0/1590538312' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi017.xusjwd/key"}]: dispatch 2024-09-20T18:35:03.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:03 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.17:0/1590538312' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T18:35:05.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:04 smithi017 ceph-mon[28058]: mgrmap e25: smithi172.jczphg(active, since 7s), standbys: smithi017.xusjwd 2024-09-20T18:35:05.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:04 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mgr metadata", "who": "smithi017.xusjwd", "id": "smithi017.xusjwd"}]: dispatch 2024-09-20T18:35:05.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:04 smithi172 ceph-mon[35456]: mgrmap e25: smithi172.jczphg(active, since 7s), standbys: smithi017.xusjwd 2024-09-20T18:35:05.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:04 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mgr metadata", "who": "smithi017.xusjwd", "id": "smithi017.xusjwd"}]: dispatch 2024-09-20T18:35:05.809 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:05 smithi172 ceph-mon[35456]: pgmap v7: 65 pgs: 65 active+clean; 112 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 92 op/s 2024-09-20T18:35:06.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:05 smithi017 ceph-mon[28058]: pgmap v7: 65 pgs: 65 active+clean; 112 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 92 op/s 2024-09-20T18:35:08.269 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:07 smithi172 ceph-mon[35456]: pgmap v8: 65 pgs: 65 active+clean; 112 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 938 KiB/s rd, 1.5 MiB/s wr, 71 op/s 2024-09-20T18:35:08.269 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:07 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:08.269 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:07 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:08.269 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:07 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:08.269 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:07 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:08.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.313+0000 7f021a0b9640 1 -- 172.21.15.17:0/3402694169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0214101960 msgr2=0x7f0214101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:08.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.313+0000 7f021a0b9640 1 --2- 172.21.15.17:0/3402694169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0214101960 0x7f0214101d60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0204009880 tx=0x7f020402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:35:08.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.314+0000 7f021a0b9640 1 -- 172.21.15.17:0/3402694169 shutdown_connections 2024-09-20T18:35:08.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.314+0000 7f021a0b9640 1 --2- 172.21.15.17:0/3402694169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0214102b60 0x7f0214102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:08.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.314+0000 7f021a0b9640 1 --2- 172.21.15.17:0/3402694169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0214101960 0x7f0214101d60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:08.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.314+0000 7f021a0b9640 1 -- 172.21.15.17:0/3402694169 >> 172.21.15.17:0/3402694169 conn(0x7f02140fd0f0 msgr2=0x7f02140ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:08.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.314+0000 7f021a0b9640 1 -- 172.21.15.17:0/3402694169 shutdown_connections 2024-09-20T18:35:08.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.314+0000 7f021a0b9640 1 -- 172.21.15.17:0/3402694169 wait complete. 2024-09-20T18:35:08.329 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:07 smithi017 ceph-mon[28058]: pgmap v8: 65 pgs: 65 active+clean; 112 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 938 KiB/s rd, 1.5 MiB/s wr, 71 op/s 2024-09-20T18:35:08.329 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:07 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:08.329 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:07 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:08.329 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:07 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:08.330 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:07 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:08.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.314+0000 7f021a0b9640 1 Processor -- start 2024-09-20T18:35:08.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.315+0000 7f021a0b9640 1 -- start start 2024-09-20T18:35:08.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.317+0000 7f021a0b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0214101960 0x7f0214075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:08.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.317+0000 7f021a0b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0214102b60 0x7f02140745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:08.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.317+0000 7f021a0b9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f021410a780 con 0x7f0214102b60 2024-09-20T18:35:08.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.317+0000 7f021a0b9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f021410a600 con 0x7f0214101960 2024-09-20T18:35:08.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.318+0000 7f02137fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0214101960 0x7f0214075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:08.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.318+0000 7f02137fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0214101960 0x7f0214075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:56530/0 (socket says 172.21.15.17:56530) 2024-09-20T18:35:08.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.318+0000 7f02137fe640 1 -- 172.21.15.17:0/1736714455 learned_addr learned my addr 172.21.15.17:0/1736714455 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:35:08.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.318+0000 7f02137fe640 1 -- 172.21.15.17:0/1736714455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0214102b60 msgr2=0x7f02140745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:08.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.318+0000 7f02137fe640 1 --2- 172.21.15.17:0/1736714455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0214102b60 0x7f02140745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:08.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.318+0000 7f02137fe640 1 -- 172.21.15.17:0/1736714455 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f021419b0e0 con 0x7f0214101960 2024-09-20T18:35:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.318+0000 7f02137fe640 1 --2- 172.21.15.17:0/1736714455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0214101960 0x7f0214075f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0204006010 tx=0x7f02040048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.319+0000 7f0210ff9640 1 -- 172.21.15.17:0/1736714455 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f020403f070 con 0x7f0214101960 2024-09-20T18:35:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.319+0000 7f0210ff9640 1 -- 172.21.15.17:0/1736714455 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f02040044d0 con 0x7f0214101960 2024-09-20T18:35:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.319+0000 7f0210ff9640 1 -- 172.21.15.17:0/1736714455 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0204035030 con 0x7f0214101960 2024-09-20T18:35:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.319+0000 7f021a0b9640 1 -- 172.21.15.17:0/1736714455 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0214074b20 con 0x7f0214101960 2024-09-20T18:35:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.319+0000 7f021a0b9640 1 -- 172.21.15.17:0/1736714455 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0214075050 con 0x7f0214101960 2024-09-20T18:35:08.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.321+0000 7f021a0b9640 1 -- 172.21.15.17:0/1736714455 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02000052c0 con 0x7f0214101960 2024-09-20T18:35:08.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.321+0000 7f0210ff9640 1 -- 172.21.15.17:0/1736714455 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f0204042070 con 0x7f0214101960 2024-09-20T18:35:08.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.322+0000 7f0210ff9640 1 --2- 172.21.15.17:0/1736714455 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f01fc074a80 0x7f01fc076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:08.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.322+0000 7f0210ff9640 1 -- 172.21.15.17:0/1736714455 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7f02040b6f10 con 0x7f0214101960 2024-09-20T18:35:08.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.322+0000 7f0212ffd640 1 --2- 172.21.15.17:0/1736714455 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f01fc074a80 0x7f01fc076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:08.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.323+0000 7f0212ffd640 1 --2- 172.21.15.17:0/1736714455 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f01fc074a80 0x7f01fc076f40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0214075ca0 tx=0x7f0208005c70 comp rx=0 tx=0).ready entity=mgr.24405 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:08.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.327+0000 7f0210ff9640 1 -- 172.21.15.17:0/1736714455 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f02040824c0 con 0x7f0214101960 2024-09-20T18:35:08.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.622+0000 7f021a0b9640 1 -- 172.21.15.17:0/1736714455 --> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0200000bf0 con 0x7f01fc074a80 2024-09-20T18:35:08.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.623+0000 7f0210ff9640 1 -- 172.21.15.17:0/1736714455 <== mgr.24405 v2:172.21.15.172:6828/3016443347 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f0200000bf0 con 0x7f01fc074a80 2024-09-20T18:35:08.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.627+0000 7f021a0b9640 1 -- 172.21.15.17:0/1736714455 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f01fc074a80 msgr2=0x7f01fc076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:08.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.627+0000 7f021a0b9640 1 --2- 172.21.15.17:0/1736714455 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f01fc074a80 0x7f01fc076f40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0214075ca0 tx=0x7f0208005c70 comp rx=0 tx=0).stop 2024-09-20T18:35:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.627+0000 7f021a0b9640 1 -- 172.21.15.17:0/1736714455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0214101960 msgr2=0x7f0214075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.627+0000 7f021a0b9640 1 --2- 172.21.15.17:0/1736714455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0214101960 0x7f0214075f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0204006010 tx=0x7f02040048f0 comp rx=0 tx=0).stop 2024-09-20T18:35:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.627+0000 7f021a0b9640 1 -- 172.21.15.17:0/1736714455 shutdown_connections 2024-09-20T18:35:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.627+0000 7f021a0b9640 1 --2- 172.21.15.17:0/1736714455 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f01fc074a80 0x7f01fc076f40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.627+0000 7f021a0b9640 1 --2- 172.21.15.17:0/1736714455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0214102b60 0x7f02140745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.627+0000 7f021a0b9640 1 --2- 172.21.15.17:0/1736714455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0214101960 0x7f0214075f20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.627+0000 7f021a0b9640 1 -- 172.21.15.17:0/1736714455 >> 172.21.15.17:0/1736714455 conn(0x7f02140fd0f0 msgr2=0x7f0214105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.627+0000 7f021a0b9640 1 -- 172.21.15.17:0/1736714455 shutdown_connections 2024-09-20T18:35:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.627+0000 7f021a0b9640 1 -- 172.21.15.17:0/1736714455 wait complete. 2024-09-20T18:35:08.654 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:35:08.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.734+0000 7ff95c9fc640 1 -- 172.21.15.17:0/1924299242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff958100860 msgr2=0x7ff958100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:08.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.734+0000 7ff95c9fc640 1 --2- 172.21.15.17:0/1924299242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff958100860 0x7ff958100c60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff948009880 tx=0x7ff94802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:35:08.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.735+0000 7ff95c9fc640 1 -- 172.21.15.17:0/1924299242 shutdown_connections 2024-09-20T18:35:08.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.735+0000 7ff95c9fc640 1 --2- 172.21.15.17:0/1924299242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff958101a60 0x7ff958101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:08.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.735+0000 7ff95c9fc640 1 --2- 172.21.15.17:0/1924299242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff958100860 0x7ff958100c60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:08.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.735+0000 7ff95c9fc640 1 -- 172.21.15.17:0/1924299242 >> 172.21.15.17:0/1924299242 conn(0x7ff9580fc010 msgr2=0x7ff9580fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:08.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.735+0000 7ff95c9fc640 1 -- 172.21.15.17:0/1924299242 shutdown_connections 2024-09-20T18:35:08.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.735+0000 7ff95c9fc640 1 -- 172.21.15.17:0/1924299242 wait complete. 2024-09-20T18:35:08.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.736+0000 7ff95c9fc640 1 Processor -- start 2024-09-20T18:35:08.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.736+0000 7ff95c9fc640 1 -- start start 2024-09-20T18:35:08.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.736+0000 7ff95c9fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff958100860 0x7ff95806a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:08.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.736+0000 7ff95c9fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff958101a60 0x7ff95819e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:08.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.736+0000 7ff95c9fc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff9581096a0 con 0x7ff958100860 2024-09-20T18:35:08.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.736+0000 7ff95c9fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff958109520 con 0x7ff958101a60 2024-09-20T18:35:08.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.736+0000 7ff95659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff958100860 0x7ff95806a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:08.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.736+0000 7ff95659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff958100860 0x7ff95806a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35372/0 (socket says 172.21.15.17:35372) 2024-09-20T18:35:08.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.736+0000 7ff95659c640 1 -- 172.21.15.17:0/2566275167 learned_addr learned my addr 172.21.15.17:0/2566275167 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:35:08.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.736+0000 7ff955d9b640 1 --2- 172.21.15.17:0/2566275167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff958101a60 0x7ff95819e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:08.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.737+0000 7ff955d9b640 1 -- 172.21.15.17:0/2566275167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff958100860 msgr2=0x7ff95806a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:08.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.737+0000 7ff955d9b640 1 --2- 172.21.15.17:0/2566275167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff958100860 0x7ff95806a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:08.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.737+0000 7ff955d9b640 1 -- 172.21.15.17:0/2566275167 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95819eb70 con 0x7ff958101a60 2024-09-20T18:35:08.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.737+0000 7ff95659c640 1 --2- 172.21.15.17:0/2566275167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff958100860 0x7ff95806a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T18:35:08.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.737+0000 7ff955d9b640 1 --2- 172.21.15.17:0/2566275167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff958101a60 0x7ff95819e630 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00e9a0 tx=0x7ff94c00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:08.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.738+0000 7ff9477fe640 1 -- 172.21.15.17:0/2566275167 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff94c00cac0 con 0x7ff958101a60 2024-09-20T18:35:08.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.738+0000 7ff9477fe640 1 -- 172.21.15.17:0/2566275167 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff94c00cc60 con 0x7ff958101a60 2024-09-20T18:35:08.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.738+0000 7ff9477fe640 1 -- 172.21.15.17:0/2566275167 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff94c0049d0 con 0x7ff958101a60 2024-09-20T18:35:08.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.738+0000 7ff95c9fc640 1 -- 172.21.15.17:0/2566275167 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff95819ed40 con 0x7ff958101a60 2024-09-20T18:35:08.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.738+0000 7ff95c9fc640 1 -- 172.21.15.17:0/2566275167 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff95819f270 con 0x7ff958101a60 2024-09-20T18:35:08.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.739+0000 7ff95c9fc640 1 -- 172.21.15.17:0/2566275167 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff958100c60 con 0x7ff958101a60 2024-09-20T18:35:08.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.740+0000 7ff9477fe640 1 -- 172.21.15.17:0/2566275167 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7ff94c004b70 con 0x7ff958101a60 2024-09-20T18:35:08.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.740+0000 7ff9477fe640 1 --2- 172.21.15.17:0/2566275167 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7ff940074a80 0x7ff940076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:08.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.741+0000 7ff9477fe640 1 -- 172.21.15.17:0/2566275167 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7ff94c0965a0 con 0x7ff958101a60 2024-09-20T18:35:08.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.741+0000 7ff95659c640 1 --2- 172.21.15.17:0/2566275167 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7ff940074a80 0x7ff940076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:08.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.741+0000 7ff95659c640 1 --2- 172.21.15.17:0/2566275167 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7ff940074a80 0x7ff940076f40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff9480096c0 tx=0x7ff948005a20 comp rx=0 tx=0).ready entity=mgr.24405 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:08.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:08.745+0000 7ff9477fe640 1 -- 172.21.15.17:0/2566275167 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ff94c00ce10 con 0x7ff958101a60 2024-09-20T18:35:09.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.015+0000 7ff95c9fc640 1 -- 172.21.15.17:0/2566275167 --> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff958062630 con 0x7ff940074a80 2024-09-20T18:35:09.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.017+0000 7ff9477fe640 1 -- 172.21.15.17:0/2566275167 <== mgr.24405 v2:172.21.15.172:6828/3016443347 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7ff958062630 con 0x7ff940074a80 2024-09-20T18:35:09.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.019+0000 7ff95c9fc640 1 -- 172.21.15.17:0/2566275167 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7ff940074a80 msgr2=0x7ff940076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:09.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.019+0000 7ff95c9fc640 1 --2- 172.21.15.17:0/2566275167 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7ff940074a80 0x7ff940076f40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff9480096c0 tx=0x7ff948005a20 comp rx=0 tx=0).stop 2024-09-20T18:35:09.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.019+0000 7ff95c9fc640 1 -- 172.21.15.17:0/2566275167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff958101a60 msgr2=0x7ff95819e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:09.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.019+0000 7ff95c9fc640 1 --2- 172.21.15.17:0/2566275167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff958101a60 0x7ff95819e630 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00e9a0 tx=0x7ff94c00ee60 comp rx=0 tx=0).stop 2024-09-20T18:35:09.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.019+0000 7ff95c9fc640 1 -- 172.21.15.17:0/2566275167 shutdown_connections 2024-09-20T18:35:09.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.019+0000 7ff95c9fc640 1 --2- 172.21.15.17:0/2566275167 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7ff940074a80 0x7ff940076f40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.019+0000 7ff95c9fc640 1 --2- 172.21.15.17:0/2566275167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff958101a60 0x7ff95819e630 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.019+0000 7ff95c9fc640 1 --2- 172.21.15.17:0/2566275167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff958100860 0x7ff95806a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.019+0000 7ff95c9fc640 1 -- 172.21.15.17:0/2566275167 >> 172.21.15.17:0/2566275167 conn(0x7ff9580fc010 msgr2=0x7ff958104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:09.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.019+0000 7ff95c9fc640 1 -- 172.21.15.17:0/2566275167 shutdown_connections 2024-09-20T18:35:09.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.019+0000 7ff95c9fc640 1 -- 172.21.15.17:0/2566275167 wait complete. 2024-09-20T18:35:09.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.130+0000 7f19a1959640 1 -- 172.21.15.17:0/957090610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f199c1024b0 msgr2=0x7f199c1048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:09.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.130+0000 7f19a1959640 1 --2- 172.21.15.17:0/957090610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f199c1024b0 0x7f199c1048a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f198c009880 tx=0x7f198c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.130+0000 7f19a1959640 1 -- 172.21.15.17:0/957090610 shutdown_connections 2024-09-20T18:35:09.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.130+0000 7f19a1959640 1 --2- 172.21.15.17:0/957090610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f199c104de0 0x7f199c1071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.130+0000 7f19a1959640 1 --2- 172.21.15.17:0/957090610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f199c1024b0 0x7f199c1048a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.130+0000 7f19a1959640 1 -- 172.21.15.17:0/957090610 >> 172.21.15.17:0/957090610 conn(0x7f199c0fc010 msgr2=0x7f199c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:09.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.130+0000 7f19a1959640 1 -- 172.21.15.17:0/957090610 shutdown_connections 2024-09-20T18:35:09.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.130+0000 7f19a1959640 1 -- 172.21.15.17:0/957090610 wait complete. 2024-09-20T18:35:09.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.131+0000 7f19a1959640 1 Processor -- start 2024-09-20T18:35:09.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.131+0000 7f19a1959640 1 -- start start 2024-09-20T18:35:09.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.131+0000 7f19a1959640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f199c1024b0 0x7f199c197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:09.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.131+0000 7f19a1959640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f199c104de0 0x7f199c197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:09.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.131+0000 7f19a1959640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f199c10a7d0 con 0x7f199c1024b0 2024-09-20T18:35:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.131+0000 7f19a1959640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f199c10a650 con 0x7f199c104de0 2024-09-20T18:35:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.131+0000 7f199affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f199c1024b0 0x7f199c197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.131+0000 7f199affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f199c1024b0 0x7f199c197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35402/0 (socket says 172.21.15.17:35402) 2024-09-20T18:35:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.131+0000 7f199affd640 1 -- 172.21.15.17:0/2588273908 learned_addr learned my addr 172.21.15.17:0/2588273908 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:35:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.132+0000 7f199a7fc640 1 --2- 172.21.15.17:0/2588273908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f199c104de0 0x7f199c197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.132+0000 7f199affd640 1 -- 172.21.15.17:0/2588273908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f199c104de0 msgr2=0x7f199c197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.132+0000 7f199affd640 1 --2- 172.21.15.17:0/2588273908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f199c104de0 0x7f199c197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.132+0000 7f199affd640 1 -- 172.21.15.17:0/2588273908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199c1980e0 con 0x7f199c1024b0 2024-09-20T18:35:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.132+0000 7f199affd640 1 --2- 172.21.15.17:0/2588273908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f199c1024b0 0x7f199c197520 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f198c006010 tx=0x7f198c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.132+0000 7f19a0957640 1 -- 172.21.15.17:0/2588273908 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f198c03f070 con 0x7f199c1024b0 2024-09-20T18:35:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.133+0000 7f19a1959640 1 -- 172.21.15.17:0/2588273908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f199c19cac0 con 0x7f199c1024b0 2024-09-20T18:35:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.133+0000 7f19a1959640 1 -- 172.21.15.17:0/2588273908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f199c19d050 con 0x7f199c1024b0 2024-09-20T18:35:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.133+0000 7f19a0957640 1 -- 172.21.15.17:0/2588273908 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f198c0049d0 con 0x7f199c1024b0 2024-09-20T18:35:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.133+0000 7f19a0957640 1 -- 172.21.15.17:0/2588273908 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f198c035030 con 0x7f199c1024b0 2024-09-20T18:35:09.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.134+0000 7f19a1959640 1 -- 172.21.15.17:0/2588273908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19880052c0 con 0x7f199c1024b0 2024-09-20T18:35:09.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.135+0000 7f19a0957640 1 -- 172.21.15.17:0/2588273908 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f198c042070 con 0x7f199c1024b0 2024-09-20T18:35:09.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.135+0000 7f19a0957640 1 --2- 172.21.15.17:0/2588273908 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f1984074a80 0x7f1984076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:09.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.135+0000 7f19a0957640 1 -- 172.21.15.17:0/2588273908 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7f198c0b6d70 con 0x7f199c1024b0 2024-09-20T18:35:09.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.135+0000 7f199a7fc640 1 --2- 172.21.15.17:0/2588273908 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f1984074a80 0x7f1984076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:09.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.136+0000 7f199a7fc640 1 --2- 172.21.15.17:0/2588273908 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f1984074a80 0x7f1984076f40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f199c1989d0 tx=0x7f1990005f90 comp rx=0 tx=0).ready entity=mgr.24405 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:09.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.144+0000 7f19a0957640 1 -- 172.21.15.17:0/2588273908 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f198c082380 con 0x7f199c1024b0 2024-09-20T18:35:09.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.371+0000 7f19a1959640 1 -- 172.21.15.17:0/2588273908 --> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1988000bf0 con 0x7f1984074a80 2024-09-20T18:35:09.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.383+0000 7f19a0957640 1 -- 172.21.15.17:0/2588273908 <== mgr.24405 v2:172.21.15.172:6828/3016443347 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f1988000bf0 con 0x7f1984074a80 2024-09-20T18:35:09.398 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:35:09.398 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (6m) 114s ago 7m 25.8M - 0.25.0 c8568f914cd2 8954ab699be3 2024-09-20T18:35:09.398 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (7m) 114s ago 7m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 404e79f7d9bb 2024-09-20T18:35:09.398 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (6m) 2s ago 6m 5272k - 19.1.1-369-ged8ee0f2 6acb0a031eab 747d22f4b582 2024-09-20T18:35:09.398 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (7m) 114s ago 7m 6895k - 19.1.1-369-ged8ee0f2 6acb0a031eab 725c8bcc6ec8 2024-09-20T18:35:09.399 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (6m) 2s ago 6m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab e10dd613dbe2 2024-09-20T18:35:09.399 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (5m) 114s ago 7m 81.4M - 9.4.12 2bacad6d85d8 d8c886b98eae 2024-09-20T18:35:09.399 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (2m) 114s ago 2m 18.7M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:35:09.399 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (2m) 114s ago 2m 17.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:35:09.399 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (2m) 2s ago 2m 19.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:35:09.399 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (2m) 2s ago 2m 19.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:35:09.399 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:9283,8765,8443 running (8m) 114s ago 8m 499M - 19.1.1-369-ged8ee0f2 6acb0a031eab 28eeab491beb 2024-09-20T18:35:09.399 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (28s) 2s ago 6m 497M - 19.3.0-5099-g88deadb8 441f9a3fe515 84c6ec0abc34 2024-09-20T18:35:09.399 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (8m) 114s ago 8m 46.4M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab ab1f988c4cb2 2024-09-20T18:35:09.399 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (6m) 2s ago 6m 39.4M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 9eea40352787 2024-09-20T18:35:09.399 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (7m) 114s ago 7m 14.2M - 1.5.0 0da6a335fe13 1584915999b1 2024-09-20T18:35:09.399 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (6m) 2s ago 6m 15.4M - 1.5.0 0da6a335fe13 880d938148e8 2024-09-20T18:35:09.400 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (5m) 114s ago 5m 54.2M 3948M 19.1.1-369-ged8ee0f2 6acb0a031eab c1207e514216 2024-09-20T18:35:09.400 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (5m) 114s ago 5m 54.1M 3948M 19.1.1-369-ged8ee0f2 6acb0a031eab 73f2fd77590f 2024-09-20T18:35:09.400 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (4m) 114s ago 4m 53.4M 3948M 19.1.1-369-ged8ee0f2 6acb0a031eab 6f0b9405dc18 2024-09-20T18:35:09.400 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (4m) 2s ago 4m 85.8M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:35:09.400 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (3m) 2s ago 3m 75.5M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:35:09.400 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (3m) 2s ago 3m 65.4M 4970M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:35:09.400 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (5m) 114s ago 7m 58.1M - 2.43.0 a07b618ecd1d ebc76047e24f 2024-09-20T18:35:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.386+0000 7f19a1959640 1 -- 172.21.15.17:0/2588273908 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f1984074a80 msgr2=0x7f1984076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.386+0000 7f19a1959640 1 --2- 172.21.15.17:0/2588273908 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f1984074a80 0x7f1984076f40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f199c1989d0 tx=0x7f1990005f90 comp rx=0 tx=0).stop 2024-09-20T18:35:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.386+0000 7f19a1959640 1 -- 172.21.15.17:0/2588273908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f199c1024b0 msgr2=0x7f199c197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.386+0000 7f19a1959640 1 --2- 172.21.15.17:0/2588273908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f199c1024b0 0x7f199c197520 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f198c006010 tx=0x7f198c004570 comp rx=0 tx=0).stop 2024-09-20T18:35:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.386+0000 7f19a1959640 1 -- 172.21.15.17:0/2588273908 shutdown_connections 2024-09-20T18:35:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.386+0000 7f19a1959640 1 --2- 172.21.15.17:0/2588273908 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f1984074a80 0x7f1984076f40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.386+0000 7f19a1959640 1 --2- 172.21.15.17:0/2588273908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f199c104de0 0x7f199c197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.386+0000 7f19a1959640 1 --2- 172.21.15.17:0/2588273908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f199c1024b0 0x7f199c197520 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.386+0000 7f19a1959640 1 -- 172.21.15.17:0/2588273908 >> 172.21.15.17:0/2588273908 conn(0x7f199c0fc010 msgr2=0x7f199c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.386+0000 7f19a1959640 1 -- 172.21.15.17:0/2588273908 shutdown_connections 2024-09-20T18:35:09.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.386+0000 7f19a1959640 1 -- 172.21.15.17:0/2588273908 wait complete. 2024-09-20T18:35:09.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.507+0000 7f5759f84640 1 -- 172.21.15.17:0/2054284144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57541023f0 msgr2=0x7f57541047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:09.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.507+0000 7f5759f84640 1 --2- 172.21.15.17:0/2054284144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57541023f0 0x7f57541047e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f57440098b0 tx=0x7f574402a4d0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.507+0000 7f5759f84640 1 -- 172.21.15.17:0/2054284144 shutdown_connections 2024-09-20T18:35:09.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.507+0000 7f5759f84640 1 --2- 172.21.15.17:0/2054284144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5754104d20 0x7f5754107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.507+0000 7f5759f84640 1 --2- 172.21.15.17:0/2054284144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57541023f0 0x7f57541047e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.507+0000 7f5759f84640 1 -- 172.21.15.17:0/2054284144 >> 172.21.15.17:0/2054284144 conn(0x7f57540fc010 msgr2=0x7f57540fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:09.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.507+0000 7f5759f84640 1 -- 172.21.15.17:0/2054284144 shutdown_connections 2024-09-20T18:35:09.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.508+0000 7f5759f84640 1 -- 172.21.15.17:0/2054284144 wait complete. 2024-09-20T18:35:09.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.508+0000 7f5759f84640 1 Processor -- start 2024-09-20T18:35:09.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.508+0000 7f5759f84640 1 -- start start 2024-09-20T18:35:09.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.509+0000 7f5759f84640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57541023f0 0x7f5754199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:09.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.509+0000 7f5759f84640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5754104d20 0x7f5754199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:09.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.509+0000 7f5759f84640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f575410a7c0 con 0x7f5754104d20 2024-09-20T18:35:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.509+0000 7f5759f84640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f575410a640 con 0x7f57541023f0 2024-09-20T18:35:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.509+0000 7f57537fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57541023f0 0x7f5754199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.509+0000 7f5752ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5754104d20 0x7f5754199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.509+0000 7f57537fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57541023f0 0x7f5754199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:56578/0 (socket says 172.21.15.17:56578) 2024-09-20T18:35:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.509+0000 7f57537fe640 1 -- 172.21.15.17:0/420068187 learned_addr learned my addr 172.21.15.17:0/420068187 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:35:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.509+0000 7f57537fe640 1 -- 172.21.15.17:0/420068187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5754104d20 msgr2=0x7f5754199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.509+0000 7f57537fe640 1 --2- 172.21.15.17:0/420068187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5754104d20 0x7f5754199c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.509+0000 7f57537fe640 1 -- 172.21.15.17:0/420068187 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575419a300 con 0x7f57541023f0 2024-09-20T18:35:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.510+0000 7f57537fe640 1 --2- 172.21.15.17:0/420068187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57541023f0 0x7f5754199740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5744009880 tx=0x7f57440045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.510+0000 7f5750ff9640 1 -- 172.21.15.17:0/420068187 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f574403f070 con 0x7f57541023f0 2024-09-20T18:35:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.510+0000 7f5759f84640 1 -- 172.21.15.17:0/420068187 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575419ece0 con 0x7f57541023f0 2024-09-20T18:35:09.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.510+0000 7f5750ff9640 1 -- 172.21.15.17:0/420068187 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f57440049d0 con 0x7f57541023f0 2024-09-20T18:35:09.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.510+0000 7f5750ff9640 1 -- 172.21.15.17:0/420068187 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5744035030 con 0x7f57541023f0 2024-09-20T18:35:09.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.510+0000 7f5759f84640 1 -- 172.21.15.17:0/420068187 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f575419f1b0 con 0x7f57541023f0 2024-09-20T18:35:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.511+0000 7f5759f84640 1 -- 172.21.15.17:0/420068187 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57541027d0 con 0x7f57541023f0 2024-09-20T18:35:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.512+0000 7f5750ff9640 1 -- 172.21.15.17:0/420068187 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f5744042070 con 0x7f57541023f0 2024-09-20T18:35:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.513+0000 7f5750ff9640 1 --2- 172.21.15.17:0/420068187 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f573c074a80 0x7f573c076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.513+0000 7f5750ff9640 1 -- 172.21.15.17:0/420068187 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7f57440b6cb0 con 0x7f57541023f0 2024-09-20T18:35:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.513+0000 7f5752ffd640 1 --2- 172.21.15.17:0/420068187 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f573c074a80 0x7f573c076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.513+0000 7f5752ffd640 1 --2- 172.21.15.17:0/420068187 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f573c074a80 0x7f573c076f40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f575419abf0 tx=0x7f5748005f90 comp rx=0 tx=0).ready entity=mgr.24405 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:09.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.518+0000 7f5750ff9640 1 -- 172.21.15.17:0/420068187 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f57440822c0 con 0x7f57541023f0 2024-09-20T18:35:09.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.951+0000 7f5759f84640 1 -- 172.21.15.17:0/420068187 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5754062df0 con 0x7f57541023f0 2024-09-20T18:35:09.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.952+0000 7f5750ff9640 1 -- 172.21.15.17:0/420068187 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f5744087170 con 0x7f57541023f0 2024-09-20T18:35:09.966 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:35:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:35:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T18:35:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:35:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:35:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:35:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 1 2024-09-20T18:35:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:35:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:35:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T18:35:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:35:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:35:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:35:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:35:09.967 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:35:09.968 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 13, 2024-09-20T18:35:09.968 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 1 2024-09-20T18:35:09.968 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:35:09.968 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:35:09.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.955+0000 7f5759f84640 1 -- 172.21.15.17:0/420068187 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f573c074a80 msgr2=0x7f573c076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:09.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.955+0000 7f5759f84640 1 --2- 172.21.15.17:0/420068187 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f573c074a80 0x7f573c076f40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f575419abf0 tx=0x7f5748005f90 comp rx=0 tx=0).stop 2024-09-20T18:35:09.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.955+0000 7f5759f84640 1 -- 172.21.15.17:0/420068187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57541023f0 msgr2=0x7f5754199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:09.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.955+0000 7f5759f84640 1 --2- 172.21.15.17:0/420068187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57541023f0 0x7f5754199740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5744009880 tx=0x7f57440045e0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.955+0000 7f5759f84640 1 -- 172.21.15.17:0/420068187 shutdown_connections 2024-09-20T18:35:09.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.955+0000 7f5759f84640 1 --2- 172.21.15.17:0/420068187 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f573c074a80 0x7f573c076f40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.955+0000 7f5759f84640 1 --2- 172.21.15.17:0/420068187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5754104d20 0x7f5754199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.955+0000 7f5759f84640 1 --2- 172.21.15.17:0/420068187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57541023f0 0x7f5754199740 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:09.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.955+0000 7f5759f84640 1 -- 172.21.15.17:0/420068187 >> 172.21.15.17:0/420068187 conn(0x7f57540fc010 msgr2=0x7f5754101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:09.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.955+0000 7f5759f84640 1 -- 172.21.15.17:0/420068187 shutdown_connections 2024-09-20T18:35:09.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:09.955+0000 7f5759f84640 1 -- 172.21.15.17:0/420068187 wait complete. 2024-09-20T18:35:10.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.069+0000 7f6ffc3b0640 1 -- 172.21.15.17:0/2643221952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff4101960 msgr2=0x7f6ff4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:10.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.069+0000 7f6ffc3b0640 1 --2- 172.21.15.17:0/2643221952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff4101960 0x7f6ff4101d60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009880 tx=0x7f6ff002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:35:10.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.069+0000 7f6ffc3b0640 1 -- 172.21.15.17:0/2643221952 shutdown_connections 2024-09-20T18:35:10.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.069+0000 7f6ffc3b0640 1 --2- 172.21.15.17:0/2643221952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff4102b60 0x7f6ff4102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:10.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.069+0000 7f6ffc3b0640 1 --2- 172.21.15.17:0/2643221952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff4101960 0x7f6ff4101d60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:10.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.069+0000 7f6ffc3b0640 1 -- 172.21.15.17:0/2643221952 >> 172.21.15.17:0/2643221952 conn(0x7f6ff40fd110 msgr2=0x7f6ff40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:10.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.069+0000 7f6ffc3b0640 1 -- 172.21.15.17:0/2643221952 shutdown_connections 2024-09-20T18:35:10.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.069+0000 7f6ffc3b0640 1 -- 172.21.15.17:0/2643221952 wait complete. 2024-09-20T18:35:10.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.070+0000 7f6ffc3b0640 1 Processor -- start 2024-09-20T18:35:10.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.070+0000 7f6ffc3b0640 1 -- start start 2024-09-20T18:35:10.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.070+0000 7f6ffc3b0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff4101960 0x7f6ff4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:10.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.070+0000 7f6ffc3b0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff4102b60 0x7f6ff40745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:10.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.070+0000 7f6ffc3b0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff410a780 con 0x7f6ff4102b60 2024-09-20T18:35:10.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.070+0000 7f6ffc3b0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff410a600 con 0x7f6ff4101960 2024-09-20T18:35:10.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.070+0000 7f6ff994b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff4102b60 0x7f6ff40745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:10.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.070+0000 7f6ff994b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff4102b60 0x7f6ff40745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35426/0 (socket says 172.21.15.17:35426) 2024-09-20T18:35:10.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.070+0000 7f6ff994b640 1 -- 172.21.15.17:0/3402171364 learned_addr learned my addr 172.21.15.17:0/3402171364 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:35:10.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.070+0000 7f6ffa14c640 1 --2- 172.21.15.17:0/3402171364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff4101960 0x7f6ff4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:10.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.070+0000 7f6ff994b640 1 -- 172.21.15.17:0/3402171364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff4101960 msgr2=0x7f6ff4075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:10.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.070+0000 7f6ff994b640 1 --2- 172.21.15.17:0/3402171364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff4101960 0x7f6ff4075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:10.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.070+0000 7f6ff994b640 1 -- 172.21.15.17:0/3402171364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff4074b20 con 0x7f6ff4102b60 2024-09-20T18:35:10.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.071+0000 7f6ff994b640 1 --2- 172.21.15.17:0/3402171364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff4102b60 0x7f6ff40745e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400e970 tx=0x7f6fe400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:10.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.071+0000 7f6feb7fe640 1 -- 172.21.15.17:0/3402171364 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6fe400cac0 con 0x7f6ff4102b60 2024-09-20T18:35:10.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.071+0000 7f6feb7fe640 1 -- 172.21.15.17:0/3402171364 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6fe400cc60 con 0x7f6ff4102b60 2024-09-20T18:35:10.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.071+0000 7f6ffc3b0640 1 -- 172.21.15.17:0/3402171364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff4074e10 con 0x7f6ff4102b60 2024-09-20T18:35:10.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.071+0000 7f6feb7fe640 1 -- 172.21.15.17:0/3402171364 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6fe4018720 con 0x7f6ff4102b60 2024-09-20T18:35:10.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.071+0000 7f6ffc3b0640 1 -- 172.21.15.17:0/3402171364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff40753a0 con 0x7f6ff4102b60 2024-09-20T18:35:10.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.072+0000 7f6ffc3b0640 1 -- 172.21.15.17:0/3402171364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff4101d60 con 0x7f6ff4102b60 2024-09-20T18:35:10.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.073+0000 7f6feb7fe640 1 -- 172.21.15.17:0/3402171364 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f6fe4010430 con 0x7f6ff4102b60 2024-09-20T18:35:10.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.073+0000 7f6feb7fe640 1 --2- 172.21.15.17:0/3402171364 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6fe0074a30 0x7f6fe0076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:10.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.073+0000 7f6feb7fe640 1 -- 172.21.15.17:0/3402171364 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7f6fe4096880 con 0x7f6ff4102b60 2024-09-20T18:35:10.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.073+0000 7f6ffa14c640 1 --2- 172.21.15.17:0/3402171364 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6fe0074a30 0x7f6fe0076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:10.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.074+0000 7f6ffa14c640 1 --2- 172.21.15.17:0/3402171364 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6fe0074a30 0x7f6fe0076ef0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009230 tx=0x7f6ff00058d0 comp rx=0 tx=0).ready entity=mgr.24405 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:10.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.078+0000 7f6feb7fe640 1 -- 172.21.15.17:0/3402171364 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f6fe4061e10 con 0x7f6ff4102b60 2024-09-20T18:35:10.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.334+0000 7f6ffc3b0640 1 -- 172.21.15.17:0/3402171364 --> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6ff4062630 con 0x7f6fe0074a30 2024-09-20T18:35:10.348 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:09 smithi017 ceph-mon[28058]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:35:10.349 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:09 smithi017 ceph-mon[28058]: pgmap v9: 65 pgs: 65 active+clean; 122 MiB data, 591 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 123 op/s 2024-09-20T18:35:10.349 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:09 smithi017 ceph-mon[28058]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:35:10.349 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:09 smithi017 ceph-mon[28058]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:35:10.349 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:09 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/420068187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:35:10.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.335+0000 7f6feb7fe640 1 -- 172.21.15.17:0/3402171364 <== mgr.24405 v2:172.21.15.172:6828/3016443347 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f6ff4062630 con 0x7f6fe0074a30 2024-09-20T18:35:10.350 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:35:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:35:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:35:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T18:35:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [], 2024-09-20T18:35:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "1/2 daemons upgraded", 2024-09-20T18:35:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-20T18:35:10.350 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:35:10.350 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:35:10.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.339+0000 7f6ffc3b0640 1 -- 172.21.15.17:0/3402171364 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6fe0074a30 msgr2=0x7f6fe0076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:10.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.339+0000 7f6ffc3b0640 1 --2- 172.21.15.17:0/3402171364 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6fe0074a30 0x7f6fe0076ef0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009230 tx=0x7f6ff00058d0 comp rx=0 tx=0).stop 2024-09-20T18:35:10.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.339+0000 7f6ffc3b0640 1 -- 172.21.15.17:0/3402171364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff4102b60 msgr2=0x7f6ff40745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:10.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.339+0000 7f6ffc3b0640 1 --2- 172.21.15.17:0/3402171364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff4102b60 0x7f6ff40745e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400e970 tx=0x7f6fe400ee30 comp rx=0 tx=0).stop 2024-09-20T18:35:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.339+0000 7f6ffc3b0640 1 -- 172.21.15.17:0/3402171364 shutdown_connections 2024-09-20T18:35:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.339+0000 7f6ffc3b0640 1 --2- 172.21.15.17:0/3402171364 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6fe0074a30 0x7f6fe0076ef0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.339+0000 7f6ffc3b0640 1 --2- 172.21.15.17:0/3402171364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff4102b60 0x7f6ff40745e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.339+0000 7f6ffc3b0640 1 --2- 172.21.15.17:0/3402171364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff4101960 0x7f6ff4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.339+0000 7f6ffc3b0640 1 -- 172.21.15.17:0/3402171364 >> 172.21.15.17:0/3402171364 conn(0x7f6ff40fd110 msgr2=0x7f6ff4106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.339+0000 7f6ffc3b0640 1 -- 172.21.15.17:0/3402171364 shutdown_connections 2024-09-20T18:35:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:10.339+0000 7f6ffc3b0640 1 -- 172.21.15.17:0/3402171364 wait complete. 2024-09-20T18:35:10.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:09 smithi172 ceph-mon[35456]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:35:10.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:09 smithi172 ceph-mon[35456]: pgmap v9: 65 pgs: 65 active+clean; 122 MiB data, 591 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 123 op/s 2024-09-20T18:35:10.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:09 smithi172 ceph-mon[35456]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:35:10.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:09 smithi172 ceph-mon[35456]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:35:10.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:09 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/420068187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:35:11.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:10 smithi172 ceph-mon[35456]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:35:11.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:10 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:11.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:10 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:11.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:10 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:11.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:10 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:11.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:10 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:11.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:10 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:11.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:10 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:11.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:10 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:11.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:10 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:11.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:10 smithi017 ceph-mon[28058]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:35:11.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:10 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:11.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:10 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:11.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:10 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:11.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:10 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:11.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:10 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:11.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:10 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:11.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:10 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:11.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:10 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:11.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:10 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:12.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:12 smithi017 ceph-mon[28058]: pgmap v10: 65 pgs: 65 active+clean; 122 MiB data, 591 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 112 op/s 2024-09-20T18:35:12.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:12 smithi017 ceph-mon[28058]: Adjusting osd_memory_target on smithi172 to 2240M 2024-09-20T18:35:12.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:12 smithi172 ceph-mon[35456]: pgmap v10: 65 pgs: 65 active+clean; 122 MiB data, 591 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 112 op/s 2024-09-20T18:35:12.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:12 smithi172 ceph-mon[35456]: Adjusting osd_memory_target on smithi172 to 2240M 2024-09-20T18:35:13.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:13 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:35:13.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:13 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:35:14.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:14 smithi017 ceph-mon[28058]: pgmap v11: 65 pgs: 65 active+clean; 122 MiB data, 591 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 112 op/s 2024-09-20T18:35:14.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:14 smithi172 ceph-mon[35456]: pgmap v11: 65 pgs: 65 active+clean; 122 MiB data, 591 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 112 op/s 2024-09-20T18:35:16.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:16 smithi017 ceph-mon[28058]: pgmap v12: 65 pgs: 65 active+clean; 139 MiB data, 618 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 215 op/s 2024-09-20T18:35:16.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:16 smithi172 ceph-mon[35456]: pgmap v12: 65 pgs: 65 active+clean; 139 MiB data, 618 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 215 op/s 2024-09-20T18:35:18.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:18 smithi017 ceph-mon[28058]: pgmap v13: 65 pgs: 65 active+clean; 139 MiB data, 618 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 162 op/s 2024-09-20T18:35:18.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:18 smithi172 ceph-mon[35456]: pgmap v13: 65 pgs: 65 active+clean; 139 MiB data, 618 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 162 op/s 2024-09-20T18:35:20.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:20 smithi017 ceph-mon[28058]: pgmap v14: 65 pgs: 65 active+clean; 159 MiB data, 688 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.1 MiB/s wr, 276 op/s 2024-09-20T18:35:20.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:20 smithi172 ceph-mon[35456]: pgmap v14: 65 pgs: 65 active+clean; 159 MiB data, 688 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.1 MiB/s wr, 276 op/s 2024-09-20T18:35:21.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:21 smithi172 ceph-mon[35456]: pgmap v15: 65 pgs: 65 active+clean; 159 MiB data, 688 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 217 op/s 2024-09-20T18:35:21.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:21 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:21.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:21 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:21.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:21 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:21.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:21 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:21.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:21 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:21.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:21 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:21 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:21 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:21 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:21 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:21 smithi172 ceph-mon[35456]: Adjusting osd_memory_target on smithi017 to 1217M 2024-09-20T18:35:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:21 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:21 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:35:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:21 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:35:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:21 smithi172 ceph-mon[35456]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-20T18:35:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:21 smithi172 ceph-mon[35456]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-20T18:35:22.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:21 smithi017 ceph-mon[28058]: pgmap v15: 65 pgs: 65 active+clean; 159 MiB data, 688 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 217 op/s 2024-09-20T18:35:22.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:21 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:22.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:21 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:22.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:21 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:22.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:21 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:22.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:21 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:22.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:21 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:22.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:21 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:22.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:21 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:22.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:21 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:22.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:21 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-20T18:35:22.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:21 smithi017 ceph-mon[28058]: Adjusting osd_memory_target on smithi017 to 1217M 2024-09-20T18:35:22.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:21 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:22.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:21 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:35:22.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:21 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:35:22.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:21 smithi017 ceph-mon[28058]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-20T18:35:22.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:21 smithi017 ceph-mon[28058]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-20T18:35:23.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:22 smithi017 ceph-mon[28058]: Updating smithi172:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:35:23.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:22 smithi017 ceph-mon[28058]: Updating smithi017:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:35:23.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:22 smithi017 ceph-mon[28058]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:35:23.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:22 smithi017 ceph-mon[28058]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:35:23.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:22 smithi017 ceph-mon[28058]: Updating smithi172:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T18:35:23.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:22 smithi017 ceph-mon[28058]: Updating smithi017:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T18:35:23.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:22 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:23.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:22 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:23.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:22 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:23.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:22 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:23.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:22 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:23.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:22 smithi017 ceph-mon[28058]: Reconfiguring ceph-exporter.smithi017 (dependencies changed)... 2024-09-20T18:35:23.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:22 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:35:23.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:22 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:35:23.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:22 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:35:23.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:22 smithi017 ceph-mon[28058]: Deploying daemon ceph-exporter.smithi017 on smithi017 2024-09-20T18:35:23.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:22 smithi172 ceph-mon[35456]: Updating smithi172:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:35:23.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:22 smithi172 ceph-mon[35456]: Updating smithi017:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:35:23.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:22 smithi172 ceph-mon[35456]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:35:23.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:22 smithi172 ceph-mon[35456]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:35:23.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:22 smithi172 ceph-mon[35456]: Updating smithi172:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T18:35:23.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:22 smithi172 ceph-mon[35456]: Updating smithi017:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T18:35:23.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:22 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:23.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:22 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:23.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:22 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:23.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:22 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:23.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:22 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:23.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:22 smithi172 ceph-mon[35456]: Reconfiguring ceph-exporter.smithi017 (dependencies changed)... 2024-09-20T18:35:23.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:22 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:35:23.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:22 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:35:23.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:22 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:35:23.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:22 smithi172 ceph-mon[35456]: Deploying daemon ceph-exporter.smithi017 on smithi017 2024-09-20T18:35:24.155 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:24 smithi172 ceph-mon[35456]: pgmap v16: 65 pgs: 65 active+clean; 159 MiB data, 688 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 217 op/s 2024-09-20T18:35:24.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:24 smithi017 ceph-mon[28058]: pgmap v16: 65 pgs: 65 active+clean; 159 MiB data, 688 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 217 op/s 2024-09-20T18:35:26.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:26 smithi017 ceph-mon[28058]: pgmap v17: 65 pgs: 65 active+clean; 174 MiB data, 763 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 375 op/s 2024-09-20T18:35:26.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:26 smithi172 ceph-mon[35456]: pgmap v17: 65 pgs: 65 active+clean; 174 MiB data, 763 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 375 op/s 2024-09-20T18:35:28.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:28 smithi017 ceph-mon[28058]: pgmap v18: 65 pgs: 65 active+clean; 174 MiB data, 763 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 271 op/s 2024-09-20T18:35:28.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:28 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:35:28.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:28 smithi172 ceph-mon[35456]: pgmap v18: 65 pgs: 65 active+clean; 174 MiB data, 763 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 271 op/s 2024-09-20T18:35:28.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:28 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:35:29.741 INFO:tasks.workunit.client.1.smithi172.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-20T18:35:29.746 INFO:tasks.workunit.client.1.smithi172.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-20T18:35:29.746 INFO:tasks.workunit.client.1.smithi172.stderr:+ make 2024-09-20T18:35:30.016 INFO:tasks.workunit.client.1.smithi172.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-20T18:35:30.385 INFO:tasks.workunit.client.1.smithi172.stderr:++ readlink -f fsstress 2024-09-20T18:35:30.387 INFO:tasks.workunit.client.1.smithi172.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-20T18:35:30.387 INFO:tasks.workunit.client.1.smithi172.stderr:+ popd 2024-09-20T18:35:30.388 INFO:tasks.workunit.client.1.smithi172.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-20T18:35:30.388 INFO:tasks.workunit.client.1.smithi172.stderr:+ popd 2024-09-20T18:35:30.389 INFO:tasks.workunit.client.1.smithi172.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-20T18:35:30.389 INFO:tasks.workunit.client.1.smithi172.stderr:++ mktemp -d -p . 2024-09-20T18:35:30.391 INFO:tasks.workunit.client.1.smithi172.stderr:+ T=./tmp.Q6xDQenbc7 2024-09-20T18:35:30.391 INFO:tasks.workunit.client.1.smithi172.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.Q6xDQenbc7 -l 1 -n 1000 -p 10 -v 2024-09-20T18:35:30.394 INFO:tasks.workunit.client.1.smithi172.stdout:seed = 1726484989 2024-09-20T18:35:30.399 INFO:tasks.workunit.client.1.smithi172.stdout:0/0: dread - no filename 2024-09-20T18:35:30.399 INFO:tasks.workunit.client.1.smithi172.stdout:0/1: unlink - no file 2024-09-20T18:35:30.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:30 smithi017 ceph-mon[28058]: pgmap v19: 65 pgs: 65 active+clean; 192 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 412 op/s 2024-09-20T18:35:30.402 INFO:tasks.workunit.client.1.smithi172.stdout:0/2: mknod c0 0 2024-09-20T18:35:30.402 INFO:tasks.workunit.client.1.smithi172.stdout:0/3: rmdir - no directory 2024-09-20T18:35:30.403 INFO:tasks.workunit.client.1.smithi172.stdout:2/0: write - no filename 2024-09-20T18:35:30.403 INFO:tasks.workunit.client.1.smithi172.stdout:2/1: truncate - no filename 2024-09-20T18:35:30.403 INFO:tasks.workunit.client.1.smithi172.stdout:0/4: mknod c1 0 2024-09-20T18:35:30.403 INFO:tasks.workunit.client.1.smithi172.stdout:0/5: truncate - no filename 2024-09-20T18:35:30.403 INFO:tasks.workunit.client.1.smithi172.stdout:0/6: readlink - no filename 2024-09-20T18:35:30.403 INFO:tasks.workunit.client.1.smithi172.stdout:0/7: dwrite - no filename 2024-09-20T18:35:30.403 INFO:tasks.workunit.client.1.smithi172.stdout:0/8: dwrite - no filename 2024-09-20T18:35:30.403 INFO:tasks.workunit.client.1.smithi172.stdout:0/9: dwrite - no filename 2024-09-20T18:35:30.404 INFO:tasks.workunit.client.1.smithi172.stdout:3/0: fdatasync - no filename 2024-09-20T18:35:30.405 INFO:tasks.workunit.client.1.smithi172.stdout:3/1: rename - no filename 2024-09-20T18:35:30.405 INFO:tasks.workunit.client.1.smithi172.stdout:3/2: truncate - no filename 2024-09-20T18:35:30.405 INFO:tasks.workunit.client.1.smithi172.stdout:3/3: dread - no filename 2024-09-20T18:35:30.405 INFO:tasks.workunit.client.1.smithi172.stdout:3/4: truncate - no filename 2024-09-20T18:35:30.405 INFO:tasks.workunit.client.1.smithi172.stdout:0/10: rename c0 to c2 0 2024-09-20T18:35:30.406 INFO:tasks.workunit.client.1.smithi172.stdout:2/2: mkdir d0 0 2024-09-20T18:35:30.408 INFO:tasks.workunit.client.1.smithi172.stdout:4/0: dread - no filename 2024-09-20T18:35:30.410 INFO:tasks.workunit.client.1.smithi172.stdout:3/5: mkdir d0 0 2024-09-20T18:35:30.410 INFO:tasks.workunit.client.1.smithi172.stdout:3/6: fdatasync - no filename 2024-09-20T18:35:30.411 INFO:tasks.workunit.client.1.smithi172.stdout:5/0: chown . 42 1 2024-09-20T18:35:30.411 INFO:tasks.workunit.client.1.smithi172.stdout:5/1: link - no file 2024-09-20T18:35:30.411 INFO:tasks.workunit.client.1.smithi172.stdout:5/2: rename - no filename 2024-09-20T18:35:30.411 INFO:tasks.workunit.client.1.smithi172.stdout:5/3: link - no file 2024-09-20T18:35:30.411 INFO:tasks.workunit.client.1.smithi172.stdout:5/4: truncate - no filename 2024-09-20T18:35:30.411 INFO:tasks.workunit.client.1.smithi172.stdout:2/3: symlink d0/l1 0 2024-09-20T18:35:30.411 INFO:tasks.workunit.client.1.smithi172.stdout:2/4: write - no filename 2024-09-20T18:35:30.413 INFO:tasks.workunit.client.1.smithi172.stdout:6/0: dread - no filename 2024-09-20T18:35:30.413 INFO:tasks.workunit.client.1.smithi172.stdout:6/1: write - no filename 2024-09-20T18:35:30.413 INFO:tasks.workunit.client.1.smithi172.stdout:6/2: truncate - no filename 2024-09-20T18:35:30.413 INFO:tasks.workunit.client.1.smithi172.stdout:6/3: write - no filename 2024-09-20T18:35:30.413 INFO:tasks.workunit.client.1.smithi172.stdout:6/4: rename - no filename 2024-09-20T18:35:30.413 INFO:tasks.workunit.client.1.smithi172.stdout:6/5: truncate - no filename 2024-09-20T18:35:30.414 INFO:tasks.workunit.client.1.smithi172.stdout:6/6: rename - no filename 2024-09-20T18:35:30.414 INFO:tasks.workunit.client.1.smithi172.stdout:6/7: dwrite - no filename 2024-09-20T18:35:30.414 INFO:tasks.workunit.client.1.smithi172.stdout:3/7: creat d0/f1 x:0 0 0 2024-09-20T18:35:30.416 INFO:tasks.workunit.client.1.smithi172.stdout:5/5: symlink l0 0 2024-09-20T18:35:30.416 INFO:tasks.workunit.client.1.smithi172.stdout:5/6: dwrite - no filename 2024-09-20T18:35:30.422 INFO:tasks.workunit.client.1.smithi172.stdout:3/8: mknod d0/c2 0 2024-09-20T18:35:30.423 INFO:tasks.workunit.client.1.smithi172.stdout:3/9: write d0/f1 [656443,94303] 0 2024-09-20T18:35:30.424 INFO:tasks.workunit.client.1.smithi172.stdout:5/7: rename l0 to l1 0 2024-09-20T18:35:30.424 INFO:tasks.workunit.client.1.smithi172.stdout:5/8: dwrite - no filename 2024-09-20T18:35:30.429 INFO:tasks.workunit.client.1.smithi172.stdout:6/8: mkdir d0 0 2024-09-20T18:35:30.430 INFO:tasks.workunit.client.1.smithi172.stdout:3/10: rename d0/c2 to d0/c3 0 2024-09-20T18:35:30.430 INFO:tasks.workunit.client.1.smithi172.stdout:3/11: chown d0/f1 6907 1 2024-09-20T18:35:30.431 INFO:tasks.workunit.client.1.smithi172.stdout:5/9: symlink l2 0 2024-09-20T18:35:30.431 INFO:tasks.workunit.client.1.smithi172.stdout:5/10: truncate - no filename 2024-09-20T18:35:30.431 INFO:tasks.workunit.client.1.smithi172.stdout:5/11: write - no filename 2024-09-20T18:35:30.431 INFO:tasks.workunit.client.1.smithi172.stdout:5/12: dread - no filename 2024-09-20T18:35:30.433 INFO:tasks.workunit.client.1.smithi172.stdout:3/12: dread d0/f1 [0,4194304] 0 2024-09-20T18:35:30.435 INFO:tasks.workunit.client.1.smithi172.stdout:7/0: creat f0 x:0 0 0 2024-09-20T18:35:30.435 INFO:tasks.workunit.client.1.smithi172.stdout:7/1: readlink - no filename 2024-09-20T18:35:30.435 INFO:tasks.workunit.client.1.smithi172.stdout:7/2: readlink - no filename 2024-09-20T18:35:30.435 INFO:tasks.workunit.client.1.smithi172.stdout:7/3: chown f0 478604124 1 2024-09-20T18:35:30.443 INFO:tasks.workunit.client.1.smithi172.stdout:5/13: unlink l2 0 2024-09-20T18:35:30.445 INFO:tasks.workunit.client.1.smithi172.stdout:3/13: creat d0/f4 x:0 0 0 2024-09-20T18:35:30.448 INFO:tasks.workunit.client.1.smithi172.stdout:8/0: creat f0 x:0 0 0 2024-09-20T18:35:30.449 INFO:tasks.workunit.client.1.smithi172.stdout:7/4: mknod c1 0 2024-09-20T18:35:30.450 INFO:tasks.workunit.client.1.smithi172.stdout:7/5: write f0 [407960,47612] 0 2024-09-20T18:35:30.451 INFO:tasks.workunit.client.1.smithi172.stdout:6/9: mknod d0/c1 0 2024-09-20T18:35:30.452 INFO:tasks.workunit.client.1.smithi172.stdout:6/10: chown d0/c1 156 1 2024-09-20T18:35:30.452 INFO:tasks.workunit.client.1.smithi172.stdout:6/11: dwrite - no filename 2024-09-20T18:35:30.452 INFO:tasks.workunit.client.1.smithi172.stdout:6/12: fsync - no filename 2024-09-20T18:35:30.452 INFO:tasks.workunit.client.1.smithi172.stdout:6/13: dread - no filename 2024-09-20T18:35:30.453 INFO:tasks.workunit.client.1.smithi172.stdout:6/14: chown d0/c1 372 1 2024-09-20T18:35:30.453 INFO:tasks.workunit.client.1.smithi172.stdout:6/15: readlink - no filename 2024-09-20T18:35:30.453 INFO:tasks.workunit.client.1.smithi172.stdout:6/16: write - no filename 2024-09-20T18:35:30.457 INFO:tasks.workunit.client.1.smithi172.stdout:3/14: symlink d0/l5 0 2024-09-20T18:35:30.457 INFO:tasks.workunit.client.1.smithi172.stdout:7/6: dwrite f0 [0,4194304] 0 2024-09-20T18:35:30.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:30 smithi172 ceph-mon[35456]: pgmap v19: 65 pgs: 65 active+clean; 192 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.6 MiB/s wr, 412 op/s 2024-09-20T18:35:30.459 INFO:tasks.workunit.client.1.smithi172.stdout:9/0: symlink l0 0 2024-09-20T18:35:30.462 INFO:tasks.workunit.client.1.smithi172.stdout:8/1: creat f1 x:0 0 0 2024-09-20T18:35:30.466 INFO:tasks.workunit.client.1.smithi172.stdout:6/17: creat d0/f2 x:0 0 0 2024-09-20T18:35:30.466 INFO:tasks.workunit.client.1.smithi172.stdout:3/15: dwrite d0/f4 [0,4194304] 0 2024-09-20T18:35:30.470 INFO:tasks.workunit.client.1.smithi172.stdout:7/7: mkdir d2 0 2024-09-20T18:35:30.472 INFO:tasks.workunit.client.1.smithi172.stdout:8/2: mknod c2 0 2024-09-20T18:35:30.472 INFO:tasks.workunit.client.1.smithi172.stdout:8/3: write f0 [330089,68328] 0 2024-09-20T18:35:30.475 INFO:tasks.workunit.client.1.smithi172.stdout:6/18: rmdir d0 39 2024-09-20T18:35:30.477 INFO:tasks.workunit.client.1.smithi172.stdout:3/16: rmdir d0 39 2024-09-20T18:35:30.487 INFO:tasks.workunit.client.1.smithi172.stdout:7/8: mkdir d2/d3 0 2024-09-20T18:35:30.702 INFO:tasks.workunit.client.1.smithi172.stdout:0/11: chown c2 96 1 2024-09-20T18:35:30.702 INFO:tasks.workunit.client.1.smithi172.stdout:0/12: stat c1 0 2024-09-20T18:35:30.704 INFO:tasks.workunit.client.1.smithi172.stdout:0/13: creat f3 x:0 0 0 2024-09-20T18:35:30.704 INFO:tasks.workunit.client.1.smithi172.stdout:0/14: dread - f3 zero size 2024-09-20T18:35:30.705 INFO:tasks.workunit.client.1.smithi172.stdout:0/15: write f3 [339065,101566] 0 2024-09-20T18:35:30.709 INFO:tasks.workunit.client.1.smithi172.stdout:0/16: mkdir d4 0 2024-09-20T18:35:30.712 INFO:tasks.workunit.client.1.smithi172.stdout:0/17: mkdir d4/d5 0 2024-09-20T18:35:30.714 INFO:tasks.workunit.client.1.smithi172.stdout:0/18: creat d4/f6 x:0 0 0 2024-09-20T18:35:30.715 INFO:tasks.workunit.client.1.smithi172.stdout:0/19: fdatasync f3 0 2024-09-20T18:35:30.720 INFO:tasks.workunit.client.1.smithi172.stdout:6/19: mkdir d0/d3 0 2024-09-20T18:35:30.722 INFO:tasks.workunit.client.1.smithi172.stdout:0/20: link c2 d4/c7 0 2024-09-20T18:35:30.724 INFO:tasks.workunit.client.1.smithi172.stdout:7/9: fsync f0 0 2024-09-20T18:35:30.726 INFO:tasks.workunit.client.1.smithi172.stdout:0/21: symlink d4/d5/l8 0 2024-09-20T18:35:30.727 INFO:tasks.workunit.client.1.smithi172.stdout:0/22: truncate f3 512322 0 2024-09-20T18:35:30.728 INFO:tasks.workunit.client.1.smithi172.stdout:0/23: write f3 [1546308,106783] 0 2024-09-20T18:35:30.728 INFO:tasks.workunit.client.1.smithi172.stdout:7/10: creat d2/f4 x:0 0 0 2024-09-20T18:35:30.729 INFO:tasks.workunit.client.1.smithi172.stdout:5/14: getdents . 0 2024-09-20T18:35:30.729 INFO:tasks.workunit.client.1.smithi172.stdout:7/11: dread - d2/f4 zero size 2024-09-20T18:35:30.729 INFO:tasks.workunit.client.1.smithi172.stdout:0/24: write f3 [719056,95641] 0 2024-09-20T18:35:30.734 INFO:tasks.workunit.client.1.smithi172.stdout:3/17: fsync d0/f4 0 2024-09-20T18:35:30.734 INFO:tasks.workunit.client.1.smithi172.stdout:5/15: creat f3 x:0 0 0 2024-09-20T18:35:30.735 INFO:tasks.workunit.client.1.smithi172.stdout:7/12: creat d2/f5 x:0 0 0 2024-09-20T18:35:30.735 INFO:tasks.workunit.client.1.smithi172.stdout:7/13: stat d2/f5 0 2024-09-20T18:35:30.736 INFO:tasks.workunit.client.1.smithi172.stdout:0/25: mknod d4/d5/c9 0 2024-09-20T18:35:30.739 INFO:tasks.workunit.client.1.smithi172.stdout:7/14: mknod d2/d3/c6 0 2024-09-20T18:35:30.740 INFO:tasks.workunit.client.1.smithi172.stdout:3/18: dread d0/f1 [0,4194304] 0 2024-09-20T18:35:30.742 INFO:tasks.workunit.client.1.smithi172.stdout:7/15: rmdir d2/d3 39 2024-09-20T18:35:30.744 INFO:tasks.workunit.client.1.smithi172.stdout:5/16: dwrite f3 [0,4194304] 0 2024-09-20T18:35:30.745 INFO:tasks.workunit.client.1.smithi172.stdout:3/19: unlink d0/l5 0 2024-09-20T18:35:30.748 INFO:tasks.workunit.client.1.smithi172.stdout:5/17: mkdir d4 0 2024-09-20T18:35:30.748 INFO:tasks.workunit.client.1.smithi172.stdout:0/26: dwrite f3 [0,4194304] 0 2024-09-20T18:35:30.750 INFO:tasks.workunit.client.1.smithi172.stdout:3/20: mknod d0/c6 0 2024-09-20T18:35:30.751 INFO:tasks.workunit.client.1.smithi172.stdout:0/27: mknod d4/d5/ca 0 2024-09-20T18:35:30.755 INFO:tasks.workunit.client.1.smithi172.stdout:5/18: link f3 d4/f5 0 2024-09-20T18:35:30.758 INFO:tasks.workunit.client.1.smithi172.stdout:3/21: dwrite d0/f4 [0,4194304] 0 2024-09-20T18:35:30.760 INFO:tasks.workunit.client.1.smithi172.stdout:0/28: link d4/f6 d4/d5/fb 0 2024-09-20T18:35:30.762 INFO:tasks.workunit.client.1.smithi172.stdout:5/19: mknod d4/c6 0 2024-09-20T18:35:30.764 INFO:tasks.workunit.client.1.smithi172.stdout:3/22: rmdir d0 39 2024-09-20T18:35:30.765 INFO:tasks.workunit.client.1.smithi172.stdout:5/20: dread f3 [0,4194304] 0 2024-09-20T18:35:30.766 INFO:tasks.workunit.client.1.smithi172.stdout:0/29: creat d4/d5/fc x:0 0 0 2024-09-20T18:35:30.770 INFO:tasks.workunit.client.1.smithi172.stdout:8/4: truncate f0 221059 0 2024-09-20T18:35:30.771 INFO:tasks.workunit.client.1.smithi172.stdout:5/21: symlink d4/l7 0 2024-09-20T18:35:30.772 INFO:tasks.workunit.client.1.smithi172.stdout:0/30: fdatasync d4/d5/fb 0 2024-09-20T18:35:30.773 INFO:tasks.workunit.client.1.smithi172.stdout:7/16: rmdir d2/d3 39 2024-09-20T18:35:30.773 INFO:tasks.workunit.client.1.smithi172.stdout:7/17: dread - d2/f4 zero size 2024-09-20T18:35:30.774 INFO:tasks.workunit.client.1.smithi172.stdout:7/18: chown c1 164 1 2024-09-20T18:35:30.776 INFO:tasks.workunit.client.1.smithi172.stdout:3/23: creat d0/f7 x:0 0 0 2024-09-20T18:35:30.777 INFO:tasks.workunit.client.1.smithi172.stdout:5/22: symlink d4/l8 0 2024-09-20T18:35:30.779 INFO:tasks.workunit.client.1.smithi172.stdout:3/24: dread d0/f4 [0,4194304] 0 2024-09-20T18:35:30.779 INFO:tasks.workunit.client.1.smithi172.stdout:0/31: symlink d4/ld 0 2024-09-20T18:35:30.779 INFO:tasks.workunit.client.1.smithi172.stdout:0/32: stat d4/f6 0 2024-09-20T18:35:30.780 INFO:tasks.workunit.client.1.smithi172.stdout:0/33: write d4/d5/fb [1031524,29642] 0 2024-09-20T18:35:30.781 INFO:tasks.workunit.client.1.smithi172.stdout:0/34: readlink d4/d5/l8 0 2024-09-20T18:35:30.784 INFO:tasks.workunit.client.1.smithi172.stdout:5/23: write d4/f5 [4090648,607] 0 2024-09-20T18:35:30.787 INFO:tasks.workunit.client.1.smithi172.stdout:7/19: creat d2/d3/f7 x:0 0 0 2024-09-20T18:35:30.789 INFO:tasks.workunit.client.1.smithi172.stdout:0/35: mkdir d4/d5/de 0 2024-09-20T18:35:30.791 INFO:tasks.workunit.client.1.smithi172.stdout:5/24: creat d4/f9 x:0 0 0 2024-09-20T18:35:30.791 INFO:tasks.workunit.client.1.smithi172.stdout:0/36: dread f3 [0,4194304] 0 2024-09-20T18:35:30.792 INFO:tasks.workunit.client.1.smithi172.stdout:3/25: rename d0/f4 to d0/f8 0 2024-09-20T18:35:30.796 INFO:tasks.workunit.client.1.smithi172.stdout:5/25: unlink l1 0 2024-09-20T18:35:30.797 INFO:tasks.workunit.client.1.smithi172.stdout:5/26: write d4/f5 [3878233,81025] 0 2024-09-20T18:35:30.797 INFO:tasks.workunit.client.1.smithi172.stdout:0/37: unlink d4/ld 0 2024-09-20T18:35:30.799 INFO:tasks.workunit.client.1.smithi172.stdout:3/26: truncate d0/f1 1349785 0 2024-09-20T18:35:30.800 INFO:tasks.workunit.client.1.smithi172.stdout:3/27: write d0/f7 [439815,570] 0 2024-09-20T18:35:30.800 INFO:tasks.workunit.client.1.smithi172.stdout:3/28: stat d0 0 2024-09-20T18:35:30.803 INFO:tasks.workunit.client.1.smithi172.stdout:5/27: mknod d4/ca 0 2024-09-20T18:35:30.805 INFO:tasks.workunit.client.1.smithi172.stdout:0/38: rename f3 to d4/d5/ff 0 2024-09-20T18:35:30.811 INFO:tasks.workunit.client.1.smithi172.stdout:0/39: creat d4/d5/f10 x:0 0 0 2024-09-20T18:35:30.813 INFO:tasks.workunit.client.1.smithi172.stdout:0/40: write d4/d5/ff [3898409,34648] 0 2024-09-20T18:35:30.819 INFO:tasks.workunit.client.1.smithi172.stdout:0/41: dwrite d4/d5/fb [0,4194304] 0 2024-09-20T18:35:30.823 INFO:tasks.workunit.client.1.smithi172.stdout:0/42: creat d4/f11 x:0 0 0 2024-09-20T18:35:30.826 INFO:tasks.workunit.client.1.smithi172.stdout:0/43: mkdir d4/d12 0 2024-09-20T18:35:30.828 INFO:tasks.workunit.client.1.smithi172.stdout:0/44: mkdir d4/d13 0 2024-09-20T18:35:30.829 INFO:tasks.workunit.client.1.smithi172.stdout:0/45: dread - d4/d5/f10 zero size 2024-09-20T18:35:30.907 INFO:tasks.workunit.client.1.smithi172.stdout:5/28: fsync d4/f5 0 2024-09-20T18:35:30.908 INFO:tasks.workunit.client.1.smithi172.stdout:0/46: fsync d4/d5/fb 0 2024-09-20T18:35:30.908 INFO:tasks.workunit.client.1.smithi172.stdout:0/47: truncate d4/f11 302543 0 2024-09-20T18:35:30.909 INFO:tasks.workunit.client.1.smithi172.stdout:5/29: rename d4/ca to d4/cb 0 2024-09-20T18:35:30.910 INFO:tasks.workunit.client.1.smithi172.stdout:0/48: symlink d4/d5/l14 0 2024-09-20T18:35:30.911 INFO:tasks.workunit.client.1.smithi172.stdout:0/49: write d4/d5/f10 [534051,83302] 0 2024-09-20T18:35:30.912 INFO:tasks.workunit.client.1.smithi172.stdout:5/30: creat d4/fc x:0 0 0 2024-09-20T18:35:30.913 INFO:tasks.workunit.client.1.smithi172.stdout:5/31: dread - d4/f9 zero size 2024-09-20T18:35:30.915 INFO:tasks.workunit.client.1.smithi172.stdout:5/32: dread f3 [0,4194304] 0 2024-09-20T18:35:30.916 INFO:tasks.workunit.client.1.smithi172.stdout:8/5: fsync f0 0 2024-09-20T18:35:30.916 INFO:tasks.workunit.client.1.smithi172.stdout:5/33: fdatasync d4/f5 0 2024-09-20T18:35:30.917 INFO:tasks.workunit.client.1.smithi172.stdout:5/34: truncate d4/fc 633071 0 2024-09-20T18:35:30.918 INFO:tasks.workunit.client.1.smithi172.stdout:5/35: stat d4/l7 0 2024-09-20T18:35:30.918 INFO:tasks.workunit.client.1.smithi172.stdout:5/36: chown d4/l7 20694855 1 2024-09-20T18:35:30.920 INFO:tasks.workunit.client.1.smithi172.stdout:3/29: fsync d0/f7 0 2024-09-20T18:35:30.923 INFO:tasks.workunit.client.1.smithi172.stdout:5/37: dwrite f3 [0,4194304] 0 2024-09-20T18:35:30.924 INFO:tasks.workunit.client.1.smithi172.stdout:3/30: fdatasync d0/f1 0 2024-09-20T18:35:30.927 INFO:tasks.workunit.client.1.smithi172.stdout:7/20: getdents d2/d3 0 2024-09-20T18:35:30.928 INFO:tasks.workunit.client.1.smithi172.stdout:5/38: creat d4/fd x:0 0 0 2024-09-20T18:35:30.935 INFO:tasks.workunit.client.1.smithi172.stdout:7/21: mknod d2/c8 0 2024-09-20T18:35:30.941 INFO:tasks.workunit.client.1.smithi172.stdout:7/22: dwrite d2/f5 [0,4194304] 0 2024-09-20T18:35:30.941 INFO:tasks.workunit.client.1.smithi172.stdout:3/31: unlink d0/f1 0 2024-09-20T18:35:30.942 INFO:tasks.workunit.client.1.smithi172.stdout:7/23: write d2/f4 [363343,3591] 0 2024-09-20T18:35:30.944 INFO:tasks.workunit.client.1.smithi172.stdout:3/32: rmdir d0 39 2024-09-20T18:35:30.946 INFO:tasks.workunit.client.1.smithi172.stdout:0/50: unlink d4/d5/ff 0 2024-09-20T18:35:30.950 INFO:tasks.workunit.client.1.smithi172.stdout:0/51: dread d4/d5/fb [0,4194304] 0 2024-09-20T18:35:30.950 INFO:tasks.workunit.client.1.smithi172.stdout:0/52: dread - d4/d5/fc zero size 2024-09-20T18:35:30.953 INFO:tasks.workunit.client.1.smithi172.stdout:7/24: creat d2/f9 x:0 0 0 2024-09-20T18:35:30.954 INFO:tasks.workunit.client.1.smithi172.stdout:3/33: link d0/f7 d0/f9 0 2024-09-20T18:35:30.954 INFO:tasks.workunit.client.1.smithi172.stdout:3/34: chown d0 165371 1 2024-09-20T18:35:30.954 INFO:tasks.workunit.client.1.smithi172.stdout:0/53: dread d4/f6 [0,4194304] 0 2024-09-20T18:35:30.955 INFO:tasks.workunit.client.1.smithi172.stdout:0/54: readlink d4/d5/l14 0 2024-09-20T18:35:30.956 INFO:tasks.workunit.client.1.smithi172.stdout:7/25: creat d2/d3/fa x:0 0 0 2024-09-20T18:35:30.956 INFO:tasks.workunit.client.1.smithi172.stdout:0/55: chown d4/d5/ca 60571983 1 2024-09-20T18:35:30.960 INFO:tasks.workunit.client.1.smithi172.stdout:7/26: creat d2/d3/fb x:0 0 0 2024-09-20T18:35:30.961 INFO:tasks.workunit.client.1.smithi172.stdout:0/56: rename d4/d12 to d4/d5/de/d15 0 2024-09-20T18:35:30.963 INFO:tasks.workunit.client.1.smithi172.stdout:7/27: dread f0 [0,4194304] 0 2024-09-20T18:35:30.963 INFO:tasks.workunit.client.1.smithi172.stdout:7/28: dread - d2/d3/f7 zero size 2024-09-20T18:35:30.964 INFO:tasks.workunit.client.1.smithi172.stdout:7/29: write d2/f4 [1302656,44007] 0 2024-09-20T18:35:30.964 INFO:tasks.workunit.client.1.smithi172.stdout:7/30: chown f0 2 1 2024-09-20T18:35:30.966 INFO:tasks.workunit.client.1.smithi172.stdout:7/31: truncate d2/d3/f7 113758 0 2024-09-20T18:35:30.966 INFO:tasks.workunit.client.1.smithi172.stdout:0/57: creat d4/f16 x:0 0 0 2024-09-20T18:35:30.971 INFO:tasks.workunit.client.1.smithi172.stdout:7/32: rmdir d2/d3 39 2024-09-20T18:35:30.972 INFO:tasks.workunit.client.1.smithi172.stdout:0/58: dwrite d4/f11 [0,4194304] 0 2024-09-20T18:35:30.972 INFO:tasks.workunit.client.1.smithi172.stdout:0/59: chown d4/d5/l8 21 1 2024-09-20T18:35:30.976 INFO:tasks.workunit.client.1.smithi172.stdout:0/60: rename d4/d5/f10 to d4/d5/de/f17 0 2024-09-20T18:35:30.986 INFO:tasks.workunit.client.1.smithi172.stdout:0/61: stat d4/d5/de 0 2024-09-20T18:35:30.994 INFO:tasks.workunit.client.1.smithi172.stdout:0/62: dwrite d4/f16 [0,4194304] 0 2024-09-20T18:35:30.995 INFO:tasks.workunit.client.1.smithi172.stdout:5/39: getdents d4 0 2024-09-20T18:35:30.997 INFO:tasks.workunit.client.1.smithi172.stdout:5/40: fdatasync d4/f5 0 2024-09-20T18:35:30.997 INFO:tasks.workunit.client.1.smithi172.stdout:8/6: dwrite f0 [0,4194304] 0 2024-09-20T18:35:30.998 INFO:tasks.workunit.client.1.smithi172.stdout:8/7: dread - f1 zero size 2024-09-20T18:35:30.998 INFO:tasks.workunit.client.1.smithi172.stdout:8/8: write f1 [663273,76927] 0 2024-09-20T18:35:30.999 INFO:tasks.workunit.client.1.smithi172.stdout:8/9: read f1 [665442,52249] 0 2024-09-20T18:35:31.004 INFO:tasks.workunit.client.1.smithi172.stdout:0/63: dread d4/d5/de/f17 [0,4194304] 0 2024-09-20T18:35:31.009 INFO:tasks.workunit.client.1.smithi172.stdout:3/35: getdents d0 0 2024-09-20T18:35:31.012 INFO:tasks.workunit.client.1.smithi172.stdout:3/36: dread d0/f7 [0,4194304] 0 2024-09-20T18:35:31.121 INFO:tasks.workunit.client.1.smithi172.stdout:5/41: creat d4/fe x:0 0 0 2024-09-20T18:35:31.124 INFO:tasks.workunit.client.1.smithi172.stdout:0/64: chown d4/c7 5166284 1 2024-09-20T18:35:31.127 INFO:tasks.workunit.client.1.smithi172.stdout:5/42: dwrite d4/f9 [0,4194304] 0 2024-09-20T18:35:31.130 INFO:tasks.workunit.client.1.smithi172.stdout:0/65: creat d4/f18 x:0 0 0 2024-09-20T18:35:31.132 INFO:tasks.workunit.client.1.smithi172.stdout:5/43: mkdir d4/df 0 2024-09-20T18:35:31.134 INFO:tasks.workunit.client.1.smithi172.stdout:0/66: rename d4/d5/l14 to d4/l19 0 2024-09-20T18:35:31.138 INFO:tasks.workunit.client.1.smithi172.stdout:0/67: mkdir d4/d1a 0 2024-09-20T18:35:31.142 INFO:tasks.workunit.client.1.smithi172.stdout:5/44: dwrite d4/f9 [0,4194304] 0 2024-09-20T18:35:31.142 INFO:tasks.workunit.client.1.smithi172.stdout:0/68: creat d4/d5/de/d15/f1b x:0 0 0 2024-09-20T18:35:31.142 INFO:tasks.workunit.client.1.smithi172.stdout:5/45: mknod d4/c10 0 2024-09-20T18:35:31.143 INFO:tasks.workunit.client.1.smithi172.stdout:0/69: write d4/f16 [390033,85975] 0 2024-09-20T18:35:31.143 INFO:tasks.workunit.client.1.smithi172.stdout:5/46: dread - d4/fd zero size 2024-09-20T18:35:31.144 INFO:tasks.workunit.client.1.smithi172.stdout:5/47: fsync f3 0 2024-09-20T18:35:31.144 INFO:tasks.workunit.client.1.smithi172.stdout:0/70: rename d4 to d4/d5/de/d1c 22 2024-09-20T18:35:31.144 INFO:tasks.workunit.client.1.smithi172.stdout:0/71: chown c2 265 1 2024-09-20T18:35:31.145 INFO:tasks.workunit.client.1.smithi172.stdout:5/48: fsync f3 0 2024-09-20T18:35:31.145 INFO:tasks.workunit.client.1.smithi172.stdout:0/72: readlink d4/d5/l8 0 2024-09-20T18:35:31.150 INFO:tasks.workunit.client.1.smithi172.stdout:5/49: link d4/c10 d4/df/c11 0 2024-09-20T18:35:31.152 INFO:tasks.workunit.client.1.smithi172.stdout:0/73: dwrite d4/f6 [0,4194304] 0 2024-09-20T18:35:31.153 INFO:tasks.workunit.client.1.smithi172.stdout:5/50: mknod d4/c12 0 2024-09-20T18:35:31.154 INFO:tasks.workunit.client.1.smithi172.stdout:5/51: chown d4/c12 4898 1 2024-09-20T18:35:31.239 INFO:tasks.workunit.client.1.smithi172.stdout:5/52: truncate d4/f5 4037563 0 2024-09-20T18:35:31.242 INFO:tasks.workunit.client.1.smithi172.stdout:5/53: symlink d4/l13 0 2024-09-20T18:35:31.246 INFO:tasks.workunit.client.1.smithi172.stdout:8/10: truncate f0 4037391 0 2024-09-20T18:35:31.248 INFO:tasks.workunit.client.1.smithi172.stdout:8/11: symlink l3 0 2024-09-20T18:35:31.253 INFO:tasks.workunit.client.1.smithi172.stdout:8/12: link c2 c4 0 2024-09-20T18:35:31.258 INFO:tasks.workunit.client.1.smithi172.stdout:8/13: dread f1 [0,4194304] 0 2024-09-20T18:35:31.261 INFO:tasks.workunit.client.1.smithi172.stdout:8/14: creat f5 x:0 0 0 2024-09-20T18:35:31.264 INFO:tasks.workunit.client.1.smithi172.stdout:8/15: mknod c6 0 2024-09-20T18:35:31.267 INFO:tasks.workunit.client.1.smithi172.stdout:8/16: mknod c7 0 2024-09-20T18:35:31.306 INFO:tasks.workunit.client.1.smithi172.stdout:5/54: dwrite f3 [4194304,4194304] 0 2024-09-20T18:35:31.321 INFO:tasks.workunit.client.1.smithi172.stdout:5/55: truncate d4/fc 91116 0 2024-09-20T18:35:31.321 INFO:tasks.workunit.client.1.smithi172.stdout:5/56: readlink d4/l13 0 2024-09-20T18:35:31.323 INFO:tasks.workunit.client.1.smithi172.stdout:5/57: creat d4/f14 x:0 0 0 2024-09-20T18:35:31.324 INFO:tasks.workunit.client.1.smithi172.stdout:5/58: write d4/fe [907921,124768] 0 2024-09-20T18:35:31.327 INFO:tasks.workunit.client.1.smithi172.stdout:5/59: creat d4/df/f15 x:0 0 0 2024-09-20T18:35:31.329 INFO:tasks.workunit.client.1.smithi172.stdout:5/60: symlink d4/df/l16 0 2024-09-20T18:35:31.330 INFO:tasks.workunit.client.1.smithi172.stdout:5/61: chown d4/c10 681466 1 2024-09-20T18:35:31.331 INFO:tasks.workunit.client.1.smithi172.stdout:5/62: readlink d4/l13 0 2024-09-20T18:35:31.331 INFO:tasks.workunit.client.1.smithi172.stdout:5/63: truncate d4/fe 1263810 0 2024-09-20T18:35:31.331 INFO:tasks.workunit.client.1.smithi172.stdout:5/64: write d4/fe [1208714,45298] 0 2024-09-20T18:35:31.334 INFO:tasks.workunit.client.1.smithi172.stdout:5/65: rmdir d4/df 39 2024-09-20T18:35:31.337 INFO:tasks.workunit.client.1.smithi172.stdout:5/66: creat d4/f17 x:0 0 0 2024-09-20T18:35:31.343 INFO:tasks.workunit.client.1.smithi172.stdout:5/67: dwrite d4/fd [0,4194304] 0 2024-09-20T18:35:31.343 INFO:tasks.workunit.client.1.smithi172.stdout:5/68: dread - d4/f17 zero size 2024-09-20T18:35:31.349 INFO:tasks.workunit.client.1.smithi172.stdout:5/69: dwrite d4/f9 [0,4194304] 0 2024-09-20T18:35:31.349 INFO:tasks.workunit.client.1.smithi172.stdout:5/70: truncate d4/fe 1771401 0 2024-09-20T18:35:31.355 INFO:tasks.workunit.client.1.smithi172.stdout:5/71: symlink d4/l18 0 2024-09-20T18:35:31.359 INFO:tasks.workunit.client.1.smithi172.stdout:5/72: symlink d4/df/l19 0 2024-09-20T18:35:31.359 INFO:tasks.workunit.client.1.smithi172.stdout:5/73: stat d4/l18 0 2024-09-20T18:35:31.362 INFO:tasks.workunit.client.1.smithi172.stdout:5/74: dread d4/f9 [0,4194304] 0 2024-09-20T18:35:31.363 INFO:tasks.workunit.client.1.smithi172.stdout:5/75: write d4/fd [1861490,57770] 0 2024-09-20T18:35:31.365 INFO:tasks.workunit.client.1.smithi172.stdout:5/76: mknod d4/df/c1a 0 2024-09-20T18:35:31.366 INFO:tasks.workunit.client.1.smithi172.stdout:5/77: mknod d4/df/c1b 0 2024-09-20T18:35:31.367 INFO:tasks.workunit.client.1.smithi172.stdout:5/78: write d4/df/f15 [331059,71328] 0 2024-09-20T18:35:31.371 INFO:tasks.workunit.client.1.smithi172.stdout:5/79: dread d4/fd [0,4194304] 0 2024-09-20T18:35:31.371 INFO:tasks.workunit.client.1.smithi172.stdout:5/80: fdatasync d4/fe 0 2024-09-20T18:35:31.379 INFO:tasks.workunit.client.1.smithi172.stdout:5/81: getdents d4/df 0 2024-09-20T18:35:31.379 INFO:tasks.workunit.client.1.smithi172.stdout:5/82: dread - d4/f17 zero size 2024-09-20T18:35:31.381 INFO:tasks.workunit.client.1.smithi172.stdout:5/83: unlink d4/l7 0 2024-09-20T18:35:31.383 INFO:tasks.workunit.client.1.smithi172.stdout:5/84: unlink d4/l13 0 2024-09-20T18:35:31.385 INFO:tasks.workunit.client.1.smithi172.stdout:5/85: creat d4/df/f1c x:0 0 0 2024-09-20T18:35:31.391 INFO:tasks.workunit.client.1.smithi172.stdout:5/86: dwrite d4/fe [0,4194304] 0 2024-09-20T18:35:31.400 INFO:tasks.workunit.client.1.smithi172.stdout:5/87: dwrite d4/f14 [0,4194304] 0 2024-09-20T18:35:31.416 INFO:tasks.workunit.client.1.smithi172.stdout:5/88: truncate d4/f14 959982 0 2024-09-20T18:35:31.418 INFO:tasks.workunit.client.1.smithi172.stdout:5/89: fsync d4/fd 0 2024-09-20T18:35:31.420 INFO:tasks.workunit.client.1.smithi172.stdout:5/90: mkdir d4/d1d 0 2024-09-20T18:35:31.421 INFO:tasks.workunit.client.1.smithi172.stdout:5/91: creat d4/d1d/f1e x:0 0 0 2024-09-20T18:35:31.424 INFO:tasks.workunit.client.1.smithi172.stdout:5/92: mkdir d4/d1f 0 2024-09-20T18:35:32.170 INFO:tasks.workunit.client.1.smithi172.stdout:1/0: sync 2024-09-20T18:35:32.170 INFO:tasks.workunit.client.1.smithi172.stdout:1/1: chown . 307 1 2024-09-20T18:35:32.170 INFO:tasks.workunit.client.1.smithi172.stdout:1/2: dwrite - no filename 2024-09-20T18:35:32.170 INFO:tasks.workunit.client.1.smithi172.stdout:1/3: readlink - no filename 2024-09-20T18:35:32.170 INFO:tasks.workunit.client.1.smithi172.stdout:1/4: dwrite - no filename 2024-09-20T18:35:32.170 INFO:tasks.workunit.client.1.smithi172.stdout:1/5: rmdir - no directory 2024-09-20T18:35:32.170 INFO:tasks.workunit.client.1.smithi172.stdout:1/6: read - no filename 2024-09-20T18:35:32.170 INFO:tasks.workunit.client.1.smithi172.stdout:1/7: chown . 24 1 2024-09-20T18:35:32.170 INFO:tasks.workunit.client.1.smithi172.stdout:1/8: chown . 1164791033 1 2024-09-20T18:35:32.171 INFO:tasks.workunit.client.1.smithi172.stdout:1/9: mkdir d0 0 2024-09-20T18:35:32.175 INFO:tasks.workunit.client.1.smithi172.stdout:1/10: creat d0/f1 x:0 0 0 2024-09-20T18:35:32.175 INFO:tasks.workunit.client.1.smithi172.stdout:1/11: dread - d0/f1 zero size 2024-09-20T18:35:32.176 INFO:tasks.workunit.client.1.smithi172.stdout:1/12: rename d0 to d0/d2 22 2024-09-20T18:35:32.215 INFO:tasks.workunit.client.1.smithi172.stdout:4/1: sync 2024-09-20T18:35:32.215 INFO:tasks.workunit.client.1.smithi172.stdout:5/93: sync 2024-09-20T18:35:32.215 INFO:tasks.workunit.client.1.smithi172.stdout:2/5: sync 2024-09-20T18:35:32.215 INFO:tasks.workunit.client.1.smithi172.stdout:2/6: write - no filename 2024-09-20T18:35:32.216 INFO:tasks.workunit.client.1.smithi172.stdout:6/20: sync 2024-09-20T18:35:32.216 INFO:tasks.workunit.client.1.smithi172.stdout:0/74: sync 2024-09-20T18:35:32.216 INFO:tasks.workunit.client.1.smithi172.stdout:9/1: sync 2024-09-20T18:35:32.216 INFO:tasks.workunit.client.1.smithi172.stdout:3/37: sync 2024-09-20T18:35:32.216 INFO:tasks.workunit.client.1.smithi172.stdout:7/33: sync 2024-09-20T18:35:32.216 INFO:tasks.workunit.client.1.smithi172.stdout:8/17: sync 2024-09-20T18:35:32.218 INFO:tasks.workunit.client.1.smithi172.stdout:9/2: unlink l0 0 2024-09-20T18:35:32.219 INFO:tasks.workunit.client.1.smithi172.stdout:9/3: dread - no filename 2024-09-20T18:35:32.219 INFO:tasks.workunit.client.1.smithi172.stdout:9/4: dread - no filename 2024-09-20T18:35:32.219 INFO:tasks.workunit.client.1.smithi172.stdout:9/5: write - no filename 2024-09-20T18:35:32.220 INFO:tasks.workunit.client.1.smithi172.stdout:8/18: creat f8 x:0 0 0 2024-09-20T18:35:32.223 INFO:tasks.workunit.client.1.smithi172.stdout:2/7: creat d0/f2 x:0 0 0 2024-09-20T18:35:32.223 INFO:tasks.workunit.client.1.smithi172.stdout:3/38: dread d0/f8 [0,4194304] 0 2024-09-20T18:35:32.224 INFO:tasks.workunit.client.1.smithi172.stdout:3/39: read d0/f7 [246026,112274] 0 2024-09-20T18:35:32.225 INFO:tasks.workunit.client.1.smithi172.stdout:6/21: dwrite d0/f2 [0,4194304] 0 2024-09-20T18:35:32.229 INFO:tasks.workunit.client.1.smithi172.stdout:4/2: mkdir d0 0 2024-09-20T18:35:32.229 INFO:tasks.workunit.client.1.smithi172.stdout:4/3: chown d0 31 1 2024-09-20T18:35:32.230 INFO:tasks.workunit.client.1.smithi172.stdout:5/94: creat d4/d1d/f20 x:0 0 0 2024-09-20T18:35:32.234 INFO:tasks.workunit.client.1.smithi172.stdout:0/75: rename d4/d5/de to d4/d1d 0 2024-09-20T18:35:32.234 INFO:tasks.workunit.client.1.smithi172.stdout:7/34: rename d2/d3 to d2/d3/dc 22 2024-09-20T18:35:32.236 INFO:tasks.workunit.client.1.smithi172.stdout:9/6: creat f1 x:0 0 0 2024-09-20T18:35:32.241 INFO:tasks.workunit.client.1.smithi172.stdout:8/19: truncate f1 268050 0 2024-09-20T18:35:32.242 INFO:tasks.workunit.client.1.smithi172.stdout:0/76: dwrite d4/f6 [0,4194304] 0 2024-09-20T18:35:32.244 INFO:tasks.workunit.client.1.smithi172.stdout:2/8: rename d0/f2 to d0/f3 0 2024-09-20T18:35:32.255 INFO:tasks.workunit.client.1.smithi172.stdout:6/22: rename d0/c1 to d0/d3/c4 0 2024-09-20T18:35:32.255 INFO:tasks.workunit.client.1.smithi172.stdout:6/23: write d0/f2 [903203,126115] 0 2024-09-20T18:35:32.257 INFO:tasks.workunit.client.1.smithi172.stdout:7/35: mkdir d2/d3/dd 0 2024-09-20T18:35:32.260 INFO:tasks.workunit.client.1.smithi172.stdout:9/7: unlink f1 0 2024-09-20T18:35:32.260 INFO:tasks.workunit.client.1.smithi172.stdout:9/8: dwrite - no filename 2024-09-20T18:35:32.260 INFO:tasks.workunit.client.1.smithi172.stdout:9/9: dwrite - no filename 2024-09-20T18:35:32.260 INFO:tasks.workunit.client.1.smithi172.stdout:9/10: dwrite - no filename 2024-09-20T18:35:32.262 INFO:tasks.workunit.client.1.smithi172.stdout:8/20: creat f9 x:0 0 0 2024-09-20T18:35:32.266 INFO:tasks.workunit.client.1.smithi172.stdout:4/4: mknod d0/c1 0 2024-09-20T18:35:32.272 INFO:tasks.workunit.client.1.smithi172.stdout:2/9: dwrite d0/f3 [0,4194304] 0 2024-09-20T18:35:32.272 INFO:tasks.workunit.client.1.smithi172.stdout:2/10: stat d0/l1 0 2024-09-20T18:35:32.281 INFO:tasks.workunit.client.1.smithi172.stdout:9/11: symlink l2 0 2024-09-20T18:35:32.281 INFO:tasks.workunit.client.1.smithi172.stdout:9/12: write - no filename 2024-09-20T18:35:32.282 INFO:tasks.workunit.client.1.smithi172.stdout:0/77: creat d4/d1a/f1e x:0 0 0 2024-09-20T18:35:32.284 INFO:tasks.workunit.client.1.smithi172.stdout:4/5: mknod d0/c2 0 2024-09-20T18:35:32.288 INFO:tasks.workunit.client.1.smithi172.stdout:2/11: mkdir d0/d4 0 2024-09-20T18:35:32.289 INFO:tasks.workunit.client.1.smithi172.stdout:6/24: link d0/f2 d0/f5 0 2024-09-20T18:35:32.291 INFO:tasks.workunit.client.1.smithi172.stdout:7/36: creat d2/d3/dd/fe x:0 0 0 2024-09-20T18:35:32.292 INFO:tasks.workunit.client.1.smithi172.stdout:7/37: chown d2/f4 237556637 1 2024-09-20T18:35:32.292 INFO:tasks.workunit.client.1.smithi172.stdout:7/38: dread - d2/d3/fa zero size 2024-09-20T18:35:32.293 INFO:tasks.workunit.client.1.smithi172.stdout:0/78: symlink d4/d5/l1f 0 2024-09-20T18:35:32.296 INFO:tasks.workunit.client.1.smithi172.stdout:4/6: creat d0/f3 x:0 0 0 2024-09-20T18:35:32.297 INFO:tasks.workunit.client.1.smithi172.stdout:2/12: symlink d0/l5 0 2024-09-20T18:35:32.298 INFO:tasks.workunit.client.1.smithi172.stdout:6/25: mknod d0/d3/c6 0 2024-09-20T18:35:32.301 INFO:tasks.workunit.client.1.smithi172.stdout:7/39: dwrite d2/d3/f7 [0,4194304] 0 2024-09-20T18:35:32.302 INFO:tasks.workunit.client.1.smithi172.stdout:0/79: dwrite d4/f16 [4194304,4194304] 0 2024-09-20T18:35:32.303 INFO:tasks.workunit.client.1.smithi172.stdout:0/80: write d4/f16 [5849348,111295] 0 2024-09-20T18:35:32.308 INFO:tasks.workunit.client.1.smithi172.stdout:9/13: link l2 l3 0 2024-09-20T18:35:32.309 INFO:tasks.workunit.client.1.smithi172.stdout:9/14: dread - no filename 2024-09-20T18:35:32.311 INFO:tasks.workunit.client.1.smithi172.stdout:6/26: creat d0/d3/f7 x:0 0 0 2024-09-20T18:35:32.317 INFO:tasks.workunit.client.1.smithi172.stdout:0/81: unlink d4/c7 0 2024-09-20T18:35:32.322 INFO:tasks.workunit.client.1.smithi172.stdout:6/27: symlink d0/d3/l8 0 2024-09-20T18:35:32.327 INFO:tasks.workunit.client.1.smithi172.stdout:0/82: rename d4/d13 to d4/d20 0 2024-09-20T18:35:32.328 INFO:tasks.workunit.client.1.smithi172.stdout:4/7: link d0/c2 d0/c4 0 2024-09-20T18:35:32.333 INFO:tasks.workunit.client.1.smithi172.stdout:6/28: mknod d0/d3/c9 0 2024-09-20T18:35:32.333 INFO:tasks.workunit.client.1.smithi172.stdout:4/8: dwrite d0/f3 [0,4194304] 0 2024-09-20T18:35:32.335 INFO:tasks.workunit.client.1.smithi172.stdout:4/9: write d0/f3 [3431813,14321] 0 2024-09-20T18:35:32.335 INFO:tasks.workunit.client.1.smithi172.stdout:0/83: symlink d4/d5/l21 0 2024-09-20T18:35:32.338 INFO:tasks.workunit.client.1.smithi172.stdout:9/15: link l2 l4 0 2024-09-20T18:35:32.338 INFO:tasks.workunit.client.1.smithi172.stdout:9/16: dwrite - no filename 2024-09-20T18:35:32.339 INFO:tasks.workunit.client.1.smithi172.stdout:8/21: sync 2024-09-20T18:35:32.343 INFO:tasks.workunit.client.1.smithi172.stdout:4/10: dwrite d0/f3 [0,4194304] 0 2024-09-20T18:35:32.344 INFO:tasks.workunit.client.1.smithi172.stdout:4/11: chown d0/c1 39821186 1 2024-09-20T18:35:32.351 INFO:tasks.workunit.client.1.smithi172.stdout:4/12: mkdir d0/d5 0 2024-09-20T18:35:32.359 INFO:tasks.workunit.client.1.smithi172.stdout:9/17: rename l4 to l5 0 2024-09-20T18:35:32.359 INFO:tasks.workunit.client.1.smithi172.stdout:9/18: dwrite - no filename 2024-09-20T18:35:32.359 INFO:tasks.workunit.client.1.smithi172.stdout:9/19: read - no filename 2024-09-20T18:35:32.359 INFO:tasks.workunit.client.1.smithi172.stdout:9/20: dwrite - no filename 2024-09-20T18:35:32.366 INFO:tasks.workunit.client.1.smithi172.stdout:4/13: symlink d0/d5/l6 0 2024-09-20T18:35:32.370 INFO:tasks.workunit.client.1.smithi172.stdout:9/21: chown l3 36 1 2024-09-20T18:35:32.370 INFO:tasks.workunit.client.1.smithi172.stdout:9/22: truncate - no filename 2024-09-20T18:35:32.370 INFO:tasks.workunit.client.1.smithi172.stdout:9/23: fsync - no filename 2024-09-20T18:35:32.370 INFO:tasks.workunit.client.1.smithi172.stdout:9/24: truncate - no filename 2024-09-20T18:35:32.370 INFO:tasks.workunit.client.1.smithi172.stdout:9/25: dwrite - no filename 2024-09-20T18:35:32.371 INFO:tasks.workunit.client.1.smithi172.stdout:4/14: dwrite d0/f3 [0,4194304] 0 2024-09-20T18:35:32.371 INFO:tasks.workunit.client.1.smithi172.stdout:4/15: chown d0/d5/l6 414646 1 2024-09-20T18:35:32.378 INFO:tasks.workunit.client.1.smithi172.stdout:9/26: stat l3 0 2024-09-20T18:35:32.382 INFO:tasks.workunit.client.1.smithi172.stdout:9/27: stat l2 0 2024-09-20T18:35:32.382 INFO:tasks.workunit.client.1.smithi172.stdout:9/28: fdatasync - no filename 2024-09-20T18:35:32.385 INFO:tasks.workunit.client.1.smithi172.stdout:9/29: creat f6 x:0 0 0 2024-09-20T18:35:32.386 INFO:tasks.workunit.client.1.smithi172.stdout:9/30: write f6 [564395,70300] 0 2024-09-20T18:35:32.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:32 smithi017 ceph-mon[28058]: pgmap v20: 65 pgs: 65 active+clean; 192 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 298 op/s 2024-09-20T18:35:32.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:32 smithi172 ceph-mon[35456]: pgmap v20: 65 pgs: 65 active+clean; 192 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 298 op/s 2024-09-20T18:35:32.471 INFO:tasks.workunit.client.1.smithi172.stdout:8/22: sync 2024-09-20T18:35:32.471 INFO:tasks.workunit.client.1.smithi172.stdout:8/23: rmdir - no directory 2024-09-20T18:35:32.474 INFO:tasks.workunit.client.1.smithi172.stdout:8/24: chown c2 3 1 2024-09-20T18:35:32.479 INFO:tasks.workunit.client.1.smithi172.stdout:8/25: truncate f0 16429 0 2024-09-20T18:35:32.506 INFO:tasks.workunit.client.1.smithi172.stdout:4/16: sync 2024-09-20T18:35:32.510 INFO:tasks.workunit.client.1.smithi172.stdout:4/17: unlink d0/f3 0 2024-09-20T18:35:32.513 INFO:tasks.workunit.client.1.smithi172.stdout:4/18: mkdir d0/d7 0 2024-09-20T18:35:32.513 INFO:tasks.workunit.client.1.smithi172.stdout:4/19: dread - no filename 2024-09-20T18:35:32.557 INFO:tasks.workunit.client.1.smithi172.stdout:1/13: getdents d0 0 2024-09-20T18:35:32.557 INFO:tasks.workunit.client.1.smithi172.stdout:1/14: readlink - no filename 2024-09-20T18:35:32.560 INFO:tasks.workunit.client.1.smithi172.stdout:1/15: mknod d0/c3 0 2024-09-20T18:35:32.560 INFO:tasks.workunit.client.1.smithi172.stdout:1/16: write d0/f1 [517836,94277] 0 2024-09-20T18:35:32.564 INFO:tasks.workunit.client.1.smithi172.stdout:1/17: dread d0/f1 [0,4194304] 0 2024-09-20T18:35:32.568 INFO:tasks.workunit.client.1.smithi172.stdout:1/18: creat d0/f4 x:0 0 0 2024-09-20T18:35:32.571 INFO:tasks.workunit.client.1.smithi172.stdout:1/19: mkdir d0/d5 0 2024-09-20T18:35:32.571 INFO:tasks.workunit.client.1.smithi172.stdout:1/20: dread - d0/f4 zero size 2024-09-20T18:35:32.572 INFO:tasks.workunit.client.1.smithi172.stdout:1/21: dread d0/f1 [0,4194304] 0 2024-09-20T18:35:32.573 INFO:tasks.workunit.client.1.smithi172.stdout:1/22: truncate d0/f4 258934 0 2024-09-20T18:35:32.573 INFO:tasks.workunit.client.1.smithi172.stdout:1/23: rename d0 to d0/d5/d6 22 2024-09-20T18:35:32.575 INFO:tasks.workunit.client.1.smithi172.stdout:1/24: write d0/f1 [1429164,17978] 0 2024-09-20T18:35:32.576 INFO:tasks.workunit.client.1.smithi172.stdout:1/25: write d0/f4 [1115664,50772] 0 2024-09-20T18:35:32.582 INFO:tasks.workunit.client.1.smithi172.stdout:1/26: mknod d0/c7 0 2024-09-20T18:35:32.582 INFO:tasks.workunit.client.1.smithi172.stdout:1/27: truncate d0/f4 1587317 0 2024-09-20T18:35:32.582 INFO:tasks.workunit.client.1.smithi172.stdout:1/28: fdatasync d0/f1 0 2024-09-20T18:35:32.583 INFO:tasks.workunit.client.1.smithi172.stdout:1/29: fdatasync d0/f4 0 2024-09-20T18:35:32.584 INFO:tasks.workunit.client.1.smithi172.stdout:1/30: write d0/f4 [1462106,45928] 0 2024-09-20T18:35:32.586 INFO:tasks.workunit.client.1.smithi172.stdout:2/13: fsync d0/f3 0 2024-09-20T18:35:32.593 INFO:tasks.workunit.client.1.smithi172.stdout:1/31: rename d0/d5 to d0/d8 0 2024-09-20T18:35:32.593 INFO:tasks.workunit.client.1.smithi172.stdout:3/40: dwrite d0/f9 [0,4194304] 0 2024-09-20T18:35:32.599 INFO:tasks.workunit.client.1.smithi172.stdout:1/32: dwrite d0/f4 [0,4194304] 0 2024-09-20T18:35:32.600 INFO:tasks.workunit.client.1.smithi172.stdout:1/33: rename d0 to d0/d9 22 2024-09-20T18:35:32.601 INFO:tasks.workunit.client.1.smithi172.stdout:6/29: unlink d0/d3/c4 0 2024-09-20T18:35:32.601 INFO:tasks.workunit.client.1.smithi172.stdout:5/95: write d4/fc [233716,56127] 0 2024-09-20T18:35:32.602 INFO:tasks.workunit.client.1.smithi172.stdout:6/30: read d0/f5 [1164792,84721] 0 2024-09-20T18:35:32.607 INFO:tasks.workunit.client.1.smithi172.stdout:3/41: mknod d0/ca 0 2024-09-20T18:35:32.613 INFO:tasks.workunit.client.1.smithi172.stdout:1/34: mknod d0/d8/ca 0 2024-09-20T18:35:32.613 INFO:tasks.workunit.client.1.smithi172.stdout:1/35: write d0/f4 [1626780,66334] 0 2024-09-20T18:35:32.618 INFO:tasks.workunit.client.1.smithi172.stdout:5/96: creat d4/d1d/f21 x:0 0 0 2024-09-20T18:35:32.619 INFO:tasks.workunit.client.1.smithi172.stdout:5/97: fsync f3 0 2024-09-20T18:35:32.621 INFO:tasks.workunit.client.1.smithi172.stdout:3/42: mkdir d0/db 0 2024-09-20T18:35:32.624 INFO:tasks.workunit.client.1.smithi172.stdout:4/20: sync 2024-09-20T18:35:32.624 INFO:tasks.workunit.client.1.smithi172.stdout:4/21: dwrite - no filename 2024-09-20T18:35:32.624 INFO:tasks.workunit.client.1.smithi172.stdout:1/36: mkdir d0/d8/db 0 2024-09-20T18:35:32.625 INFO:tasks.workunit.client.1.smithi172.stdout:2/14: truncate d0/f3 951381 0 2024-09-20T18:35:32.631 INFO:tasks.workunit.client.1.smithi172.stdout:7/40: truncate d2/f4 1046385 0 2024-09-20T18:35:32.632 INFO:tasks.workunit.client.1.smithi172.stdout:7/41: chown d2/d3/c6 8643229 1 2024-09-20T18:35:32.633 INFO:tasks.workunit.client.1.smithi172.stdout:4/22: mknod d0/c8 0 2024-09-20T18:35:32.635 INFO:tasks.workunit.client.1.smithi172.stdout:1/37: creat d0/d8/fc x:0 0 0 2024-09-20T18:35:32.635 INFO:tasks.workunit.client.1.smithi172.stdout:1/38: chown d0/d8 16447424 1 2024-09-20T18:35:32.636 INFO:tasks.workunit.client.1.smithi172.stdout:1/39: truncate d0/d8/fc 911243 0 2024-09-20T18:35:32.637 INFO:tasks.workunit.client.1.smithi172.stdout:0/84: getdents d4/d5 0 2024-09-20T18:35:32.638 INFO:tasks.workunit.client.1.smithi172.stdout:1/40: write d0/f1 [1387970,11104] 0 2024-09-20T18:35:32.641 INFO:tasks.workunit.client.1.smithi172.stdout:4/23: mknod d0/d5/c9 0 2024-09-20T18:35:32.643 INFO:tasks.workunit.client.1.smithi172.stdout:0/85: creat d4/d1d/f22 x:0 0 0 2024-09-20T18:35:32.644 INFO:tasks.workunit.client.1.smithi172.stdout:0/86: chown d4/d5/c9 275474 1 2024-09-20T18:35:32.644 INFO:tasks.workunit.client.1.smithi172.stdout:0/87: rename d4 to d4/d1d/d23 22 2024-09-20T18:35:32.644 INFO:tasks.workunit.client.1.smithi172.stdout:0/88: stat c1 0 2024-09-20T18:35:32.645 INFO:tasks.workunit.client.1.smithi172.stdout:1/41: symlink d0/d8/ld 0 2024-09-20T18:35:32.647 INFO:tasks.workunit.client.1.smithi172.stdout:7/42: mknod d2/cf 0 2024-09-20T18:35:32.648 INFO:tasks.workunit.client.1.smithi172.stdout:4/24: creat d0/fa x:0 0 0 2024-09-20T18:35:32.649 INFO:tasks.workunit.client.1.smithi172.stdout:0/89: rename d4/d1d/f22 to d4/d1a/f24 0 2024-09-20T18:35:32.652 INFO:tasks.workunit.client.1.smithi172.stdout:9/31: truncate f6 629641 0 2024-09-20T18:35:32.654 INFO:tasks.workunit.client.1.smithi172.stdout:7/43: mkdir d2/d3/d10 0 2024-09-20T18:35:32.656 INFO:tasks.workunit.client.1.smithi172.stdout:4/25: symlink d0/d5/lb 0 2024-09-20T18:35:32.658 INFO:tasks.workunit.client.1.smithi172.stdout:0/90: rmdir d4/d1a 39 2024-09-20T18:35:32.663 INFO:tasks.workunit.client.1.smithi172.stdout:9/32: creat f7 x:0 0 0 2024-09-20T18:35:32.665 INFO:tasks.workunit.client.1.smithi172.stdout:4/26: mkdir d0/d5/dc 0 2024-09-20T18:35:32.669 INFO:tasks.workunit.client.1.smithi172.stdout:9/33: chown l2 18112 1 2024-09-20T18:35:32.669 INFO:tasks.workunit.client.1.smithi172.stdout:9/34: chown l5 0 1 2024-09-20T18:35:32.669 INFO:tasks.workunit.client.1.smithi172.stdout:9/35: dread - f7 zero size 2024-09-20T18:35:32.670 INFO:tasks.workunit.client.1.smithi172.stdout:9/36: readlink l2 0 2024-09-20T18:35:32.670 INFO:tasks.workunit.client.1.smithi172.stdout:7/44: symlink d2/l11 0 2024-09-20T18:35:32.670 INFO:tasks.workunit.client.1.smithi172.stdout:9/37: chown l2 250484171 1 2024-09-20T18:35:32.672 INFO:tasks.workunit.client.1.smithi172.stdout:0/91: rename d4/l19 to d4/d20/l25 0 2024-09-20T18:35:32.674 INFO:tasks.workunit.client.1.smithi172.stdout:7/45: symlink d2/d3/dd/l12 0 2024-09-20T18:35:32.677 INFO:tasks.workunit.client.1.smithi172.stdout:0/92: creat d4/d1d/d15/f26 x:0 0 0 2024-09-20T18:35:32.678 INFO:tasks.workunit.client.1.smithi172.stdout:7/46: mknod d2/d3/c13 0 2024-09-20T18:35:32.681 INFO:tasks.workunit.client.1.smithi172.stdout:0/93: mknod d4/d5/c27 0 2024-09-20T18:35:32.683 INFO:tasks.workunit.client.1.smithi172.stdout:0/94: dread - d4/d1a/f24 zero size 2024-09-20T18:35:32.685 INFO:tasks.workunit.client.1.smithi172.stdout:0/95: mkdir d4/d1a/d28 0 2024-09-20T18:35:32.685 INFO:tasks.workunit.client.1.smithi172.stdout:0/96: stat d4/d5/fc 0 2024-09-20T18:35:32.689 INFO:tasks.workunit.client.1.smithi172.stdout:0/97: dread d4/d5/fb [0,4194304] 0 2024-09-20T18:35:32.694 INFO:tasks.workunit.client.1.smithi172.stdout:0/98: creat d4/f29 x:0 0 0 2024-09-20T18:35:32.696 INFO:tasks.workunit.client.1.smithi172.stdout:0/99: write d4/d1d/f17 [589579,127012] 0 2024-09-20T18:35:32.699 INFO:tasks.workunit.client.1.smithi172.stdout:0/100: mknod d4/d1d/c2a 0 2024-09-20T18:35:32.740 INFO:tasks.workunit.client.1.smithi172.stdout:8/26: dwrite f1 [0,4194304] 0 2024-09-20T18:35:32.742 INFO:tasks.workunit.client.1.smithi172.stdout:8/27: creat fa x:0 0 0 2024-09-20T18:35:32.742 INFO:tasks.workunit.client.1.smithi172.stdout:8/28: rmdir - no directory 2024-09-20T18:35:32.745 INFO:tasks.workunit.client.1.smithi172.stdout:8/29: rename f5 to fb 0 2024-09-20T18:35:32.747 INFO:tasks.workunit.client.1.smithi172.stdout:3/43: dwrite d0/f9 [4194304,4194304] 0 2024-09-20T18:35:32.758 INFO:tasks.workunit.client.1.smithi172.stdout:6/31: dwrite d0/f5 [0,4194304] 0 2024-09-20T18:35:32.759 INFO:tasks.workunit.client.1.smithi172.stdout:6/32: dread - d0/d3/f7 zero size 2024-09-20T18:35:32.762 INFO:tasks.workunit.client.1.smithi172.stdout:6/33: creat d0/d3/fa x:0 0 0 2024-09-20T18:35:32.765 INFO:tasks.workunit.client.1.smithi172.stdout:6/34: mknod d0/cb 0 2024-09-20T18:35:32.765 INFO:tasks.workunit.client.1.smithi172.stdout:6/35: fsync d0/d3/f7 0 2024-09-20T18:35:32.768 INFO:tasks.workunit.client.1.smithi172.stdout:4/27: sync 2024-09-20T18:35:32.769 INFO:tasks.workunit.client.1.smithi172.stdout:3/44: fdatasync d0/f9 0 2024-09-20T18:35:32.771 INFO:tasks.workunit.client.1.smithi172.stdout:6/36: rename d0/d3/fa to d0/fc 0 2024-09-20T18:35:32.773 INFO:tasks.workunit.client.1.smithi172.stdout:3/45: mkdir d0/dc 0 2024-09-20T18:35:32.773 INFO:tasks.workunit.client.1.smithi172.stdout:6/37: mknod d0/cd 0 2024-09-20T18:35:32.774 INFO:tasks.workunit.client.1.smithi172.stdout:3/46: chown d0/f8 1247450 1 2024-09-20T18:35:32.775 INFO:tasks.workunit.client.1.smithi172.stdout:5/98: truncate d4/f14 297225 0 2024-09-20T18:35:32.777 INFO:tasks.workunit.client.1.smithi172.stdout:4/28: dwrite d0/fa [0,4194304] 0 2024-09-20T18:35:32.777 INFO:tasks.workunit.client.1.smithi172.stdout:5/99: fdatasync d4/df/f1c 0 2024-09-20T18:35:32.780 INFO:tasks.workunit.client.1.smithi172.stdout:6/38: dread d0/f5 [0,4194304] 0 2024-09-20T18:35:32.781 INFO:tasks.workunit.client.1.smithi172.stdout:6/39: dread - d0/d3/f7 zero size 2024-09-20T18:35:32.782 INFO:tasks.workunit.client.1.smithi172.stdout:5/100: creat d4/df/f22 x:0 0 0 2024-09-20T18:35:32.787 INFO:tasks.workunit.client.1.smithi172.stdout:9/38: write f6 [515668,19773] 0 2024-09-20T18:35:32.789 INFO:tasks.workunit.client.1.smithi172.stdout:5/101: rmdir d4/df 39 2024-09-20T18:35:32.789 INFO:tasks.workunit.client.1.smithi172.stdout:5/102: chown d4/d1d/f21 43 1 2024-09-20T18:35:32.789 INFO:tasks.workunit.client.1.smithi172.stdout:5/103: dread - d4/d1d/f21 zero size 2024-09-20T18:35:32.789 INFO:tasks.workunit.client.1.smithi172.stdout:5/104: truncate d4/d1d/f21 358393 0 2024-09-20T18:35:32.792 INFO:tasks.workunit.client.1.smithi172.stdout:5/105: readlink d4/l8 0 2024-09-20T18:35:32.792 INFO:tasks.workunit.client.1.smithi172.stdout:4/29: fdatasync d0/fa 0 2024-09-20T18:35:32.792 INFO:tasks.workunit.client.1.smithi172.stdout:9/39: fdatasync f6 0 2024-09-20T18:35:32.794 INFO:tasks.workunit.client.1.smithi172.stdout:5/106: dread - d4/df/f22 zero size 2024-09-20T18:35:32.794 INFO:tasks.workunit.client.1.smithi172.stdout:1/42: truncate d0/f1 1185050 0 2024-09-20T18:35:32.794 INFO:tasks.workunit.client.1.smithi172.stdout:9/40: dread f6 [0,4194304] 0 2024-09-20T18:35:32.795 INFO:tasks.workunit.client.1.smithi172.stdout:1/43: readlink d0/d8/ld 0 2024-09-20T18:35:32.795 INFO:tasks.workunit.client.1.smithi172.stdout:9/41: truncate f6 891259 0 2024-09-20T18:35:32.795 INFO:tasks.workunit.client.1.smithi172.stdout:4/30: mkdir d0/d7/dd 0 2024-09-20T18:35:32.796 INFO:tasks.workunit.client.1.smithi172.stdout:1/44: write d0/f4 [496853,24067] 0 2024-09-20T18:35:32.796 INFO:tasks.workunit.client.1.smithi172.stdout:9/42: write f6 [656168,76369] 0 2024-09-20T18:35:32.796 INFO:tasks.workunit.client.1.smithi172.stdout:5/107: rmdir d4/df 39 2024-09-20T18:35:32.797 INFO:tasks.workunit.client.1.smithi172.stdout:9/43: truncate f7 732729 0 2024-09-20T18:35:32.798 INFO:tasks.workunit.client.1.smithi172.stdout:5/108: write d4/fc [498646,29478] 0 2024-09-20T18:35:32.802 INFO:tasks.workunit.client.1.smithi172.stdout:4/31: rename d0/d5 to d0/de 0 2024-09-20T18:35:32.806 INFO:tasks.workunit.client.1.smithi172.stdout:5/109: dread f3 [4194304,4194304] 0 2024-09-20T18:35:32.806 INFO:tasks.workunit.client.1.smithi172.stdout:7/47: sync 2024-09-20T18:35:32.806 INFO:tasks.workunit.client.1.smithi172.stdout:9/44: dwrite f6 [0,4194304] 0 2024-09-20T18:35:32.807 INFO:tasks.workunit.client.1.smithi172.stdout:4/32: truncate d0/fa 4325708 0 2024-09-20T18:35:32.812 INFO:tasks.workunit.client.1.smithi172.stdout:9/45: creat f8 x:0 0 0 2024-09-20T18:35:32.815 INFO:tasks.workunit.client.1.smithi172.stdout:7/48: unlink d2/f5 0 2024-09-20T18:35:32.818 INFO:tasks.workunit.client.1.smithi172.stdout:4/33: mkdir d0/d7/df 0 2024-09-20T18:35:32.819 INFO:tasks.workunit.client.1.smithi172.stdout:9/46: dwrite f8 [0,4194304] 0 2024-09-20T18:35:32.820 INFO:tasks.workunit.client.1.smithi172.stdout:0/101: truncate d4/f6 3485654 0 2024-09-20T18:35:32.821 INFO:tasks.workunit.client.1.smithi172.stdout:0/102: fdatasync d4/d1d/d15/f26 0 2024-09-20T18:35:32.822 INFO:tasks.workunit.client.1.smithi172.stdout:0/103: write d4/d1d/d15/f1b [500587,126392] 0 2024-09-20T18:35:32.823 INFO:tasks.workunit.client.1.smithi172.stdout:0/104: chown d4/f16 90060 1 2024-09-20T18:35:32.825 INFO:tasks.workunit.client.1.smithi172.stdout:4/34: dread d0/fa [0,4194304] 0 2024-09-20T18:35:32.830 INFO:tasks.workunit.client.1.smithi172.stdout:9/47: rename l2 to l9 0 2024-09-20T18:35:32.833 INFO:tasks.workunit.client.1.smithi172.stdout:7/49: creat d2/d3/d10/f14 x:0 0 0 2024-09-20T18:35:32.834 INFO:tasks.workunit.client.1.smithi172.stdout:9/48: dread f8 [0,4194304] 0 2024-09-20T18:35:32.836 INFO:tasks.workunit.client.1.smithi172.stdout:5/110: link d4/df/f1c d4/f23 0 2024-09-20T18:35:32.837 INFO:tasks.workunit.client.1.smithi172.stdout:9/49: dread f6 [0,4194304] 0 2024-09-20T18:35:32.839 INFO:tasks.workunit.client.1.smithi172.stdout:0/105: symlink d4/d1a/d28/l2b 0 2024-09-20T18:35:32.840 INFO:tasks.workunit.client.1.smithi172.stdout:4/35: mknod d0/de/dc/c10 0 2024-09-20T18:35:32.844 INFO:tasks.workunit.client.1.smithi172.stdout:9/50: dwrite f7 [0,4194304] 0 2024-09-20T18:35:32.845 INFO:tasks.workunit.client.1.smithi172.stdout:5/111: creat d4/d1d/f24 x:0 0 0 2024-09-20T18:35:32.847 INFO:tasks.workunit.client.1.smithi172.stdout:0/106: symlink d4/d5/l2c 0 2024-09-20T18:35:32.856 INFO:tasks.workunit.client.1.smithi172.stdout:9/51: fsync f6 0 2024-09-20T18:35:32.858 INFO:tasks.workunit.client.1.smithi172.stdout:5/112: creat d4/d1d/f25 x:0 0 0 2024-09-20T18:35:32.859 INFO:tasks.workunit.client.1.smithi172.stdout:0/107: mkdir d4/d1a/d28/d2d 0 2024-09-20T18:35:32.860 INFO:tasks.workunit.client.1.smithi172.stdout:0/108: dread - d4/d5/fc zero size 2024-09-20T18:35:32.862 INFO:tasks.workunit.client.1.smithi172.stdout:4/36: creat d0/d7/df/f11 x:0 0 0 2024-09-20T18:35:32.864 INFO:tasks.workunit.client.1.smithi172.stdout:9/52: dread f6 [0,4194304] 0 2024-09-20T18:35:32.864 INFO:tasks.workunit.client.1.smithi172.stdout:6/40: truncate d0/f5 1661196 0 2024-09-20T18:35:32.865 INFO:tasks.workunit.client.1.smithi172.stdout:3/47: dwrite d0/f8 [0,4194304] 0 2024-09-20T18:35:32.866 INFO:tasks.workunit.client.1.smithi172.stdout:9/53: write f7 [3889677,40181] 0 2024-09-20T18:35:32.867 INFO:tasks.workunit.client.1.smithi172.stdout:9/54: chown f6 5 1 2024-09-20T18:35:32.867 INFO:tasks.workunit.client.1.smithi172.stdout:5/113: mkdir d4/d1f/d26 0 2024-09-20T18:35:32.871 INFO:tasks.workunit.client.1.smithi172.stdout:3/48: dread d0/f8 [0,4194304] 0 2024-09-20T18:35:32.872 INFO:tasks.workunit.client.1.smithi172.stdout:9/55: dread f7 [0,4194304] 0 2024-09-20T18:35:32.873 INFO:tasks.workunit.client.1.smithi172.stdout:6/41: creat d0/fe x:0 0 0 2024-09-20T18:35:32.878 INFO:tasks.workunit.client.1.smithi172.stdout:3/49: dwrite d0/f7 [0,4194304] 0 2024-09-20T18:35:32.879 INFO:tasks.workunit.client.1.smithi172.stdout:3/50: stat d0/f7 0 2024-09-20T18:35:32.879 INFO:tasks.workunit.client.1.smithi172.stdout:5/114: creat d4/d1f/f27 x:0 0 0 2024-09-20T18:35:32.880 INFO:tasks.workunit.client.1.smithi172.stdout:5/115: chown d4/df/c1a 108423409 1 2024-09-20T18:35:32.883 INFO:tasks.workunit.client.1.smithi172.stdout:6/42: unlink d0/d3/l8 0 2024-09-20T18:35:32.883 INFO:tasks.workunit.client.1.smithi172.stdout:6/43: readlink - no filename 2024-09-20T18:35:32.883 INFO:tasks.workunit.client.1.smithi172.stdout:2/15: truncate d0/f3 43969 0 2024-09-20T18:35:32.884 INFO:tasks.workunit.client.1.smithi172.stdout:5/116: dread d4/f5 [4194304,4194304] 0 2024-09-20T18:35:32.895 INFO:tasks.workunit.client.1.smithi172.stdout:3/51: fdatasync d0/f9 0 2024-09-20T18:35:32.895 INFO:tasks.workunit.client.1.smithi172.stdout:0/109: fsync d4/d5/fb 0 2024-09-20T18:35:32.897 INFO:tasks.workunit.client.1.smithi172.stdout:5/117: creat d4/d1f/f28 x:0 0 0 2024-09-20T18:35:32.899 INFO:tasks.workunit.client.1.smithi172.stdout:9/56: write f8 [4639475,29003] 0 2024-09-20T18:35:32.900 INFO:tasks.workunit.client.1.smithi172.stdout:3/52: dread d0/f9 [4194304,4194304] 0 2024-09-20T18:35:32.900 INFO:tasks.workunit.client.1.smithi172.stdout:2/16: mknod d0/d4/c6 0 2024-09-20T18:35:32.903 INFO:tasks.workunit.client.1.smithi172.stdout:0/110: fsync d4/d5/fb 0 2024-09-20T18:35:32.904 INFO:tasks.workunit.client.1.smithi172.stdout:0/111: dread - d4/f29 zero size 2024-09-20T18:35:32.904 INFO:tasks.workunit.client.1.smithi172.stdout:6/44: link d0/cd d0/cf 0 2024-09-20T18:35:32.905 INFO:tasks.workunit.client.1.smithi172.stdout:6/45: read - d0/fc zero size 2024-09-20T18:35:32.906 INFO:tasks.workunit.client.1.smithi172.stdout:4/37: truncate d0/fa 4893583 0 2024-09-20T18:35:32.908 INFO:tasks.workunit.client.1.smithi172.stdout:9/57: dread f7 [0,4194304] 0 2024-09-20T18:35:32.912 INFO:tasks.workunit.client.1.smithi172.stdout:0/112: mkdir d4/d5/d2e 0 2024-09-20T18:35:32.914 INFO:tasks.workunit.client.1.smithi172.stdout:6/46: rename d0/cb to d0/d3/c10 0 2024-09-20T18:35:32.915 INFO:tasks.workunit.client.1.smithi172.stdout:4/38: creat d0/d7/f12 x:0 0 0 2024-09-20T18:35:32.916 INFO:tasks.workunit.client.1.smithi172.stdout:4/39: fdatasync d0/d7/df/f11 0 2024-09-20T18:35:32.922 INFO:tasks.workunit.client.1.smithi172.stdout:0/113: creat d4/d5/f2f x:0 0 0 2024-09-20T18:35:32.924 INFO:tasks.workunit.client.1.smithi172.stdout:4/40: rmdir d0/de 39 2024-09-20T18:35:32.926 INFO:tasks.workunit.client.1.smithi172.stdout:9/58: dwrite f7 [4194304,4194304] 0 2024-09-20T18:35:32.926 INFO:tasks.workunit.client.1.smithi172.stdout:4/41: write d0/d7/df/f11 [149443,89975] 0 2024-09-20T18:35:32.928 INFO:tasks.workunit.client.1.smithi172.stdout:6/47: fdatasync d0/f2 0 2024-09-20T18:35:32.931 INFO:tasks.workunit.client.1.smithi172.stdout:7/50: chown d2/f4 4 1 2024-09-20T18:35:32.933 INFO:tasks.workunit.client.1.smithi172.stdout:9/59: chown l3 3849 1 2024-09-20T18:35:32.934 INFO:tasks.workunit.client.1.smithi172.stdout:0/114: dwrite d4/d5/fc [0,4194304] 0 2024-09-20T18:35:32.936 INFO:tasks.workunit.client.1.smithi172.stdout:4/42: rename d0/c8 to d0/d7/c13 0 2024-09-20T18:35:32.938 INFO:tasks.workunit.client.1.smithi172.stdout:9/60: creat fa x:0 0 0 2024-09-20T18:35:32.940 INFO:tasks.workunit.client.1.smithi172.stdout:7/51: creat d2/d3/d10/f15 x:0 0 0 2024-09-20T18:35:32.942 INFO:tasks.workunit.client.1.smithi172.stdout:4/43: readlink d0/de/l6 0 2024-09-20T18:35:32.943 INFO:tasks.workunit.client.1.smithi172.stdout:7/52: write d2/d3/d10/f15 [910107,99287] 0 2024-09-20T18:35:32.944 INFO:tasks.workunit.client.1.smithi172.stdout:2/17: truncate d0/f3 759291 0 2024-09-20T18:35:32.946 INFO:tasks.workunit.client.1.smithi172.stdout:6/48: dwrite d0/fc [0,4194304] 0 2024-09-20T18:35:32.949 INFO:tasks.workunit.client.1.smithi172.stdout:3/53: truncate d0/f9 372204 0 2024-09-20T18:35:32.952 INFO:tasks.workunit.client.1.smithi172.stdout:0/115: rmdir d4/d1a/d28/d2d 0 2024-09-20T18:35:32.954 INFO:tasks.workunit.client.1.smithi172.stdout:2/18: creat d0/f7 x:0 0 0 2024-09-20T18:35:32.954 INFO:tasks.workunit.client.1.smithi172.stdout:8/30: dwrite f0 [0,4194304] 0 2024-09-20T18:35:32.955 INFO:tasks.workunit.client.1.smithi172.stdout:2/19: stat d0/d4/c6 0 2024-09-20T18:35:32.955 INFO:tasks.workunit.client.1.smithi172.stdout:6/49: mknod d0/d3/c11 0 2024-09-20T18:35:32.956 INFO:tasks.workunit.client.1.smithi172.stdout:6/50: chown d0/d3/c6 200 1 2024-09-20T18:35:32.960 INFO:tasks.workunit.client.1.smithi172.stdout:0/116: dread d4/d5/fb [0,4194304] 0 2024-09-20T18:35:32.962 INFO:tasks.workunit.client.1.smithi172.stdout:0/117: write d4/f16 [5816016,10406] 0 2024-09-20T18:35:32.967 INFO:tasks.workunit.client.1.smithi172.stdout:2/20: dwrite d0/f7 [0,4194304] 0 2024-09-20T18:35:32.969 INFO:tasks.workunit.client.1.smithi172.stdout:9/61: link l9 lb 0 2024-09-20T18:35:32.973 INFO:tasks.workunit.client.1.smithi172.stdout:1/45: sync 2024-09-20T18:35:32.996 INFO:tasks.workunit.client.1.smithi172.stdout:7/53: mknod d2/c16 0 2024-09-20T18:35:32.997 INFO:tasks.workunit.client.1.smithi172.stdout:4/44: dread d0/fa [0,4194304] 0 2024-09-20T18:35:32.997 INFO:tasks.workunit.client.1.smithi172.stdout:6/51: symlink d0/l12 0 2024-09-20T18:35:32.997 INFO:tasks.workunit.client.1.smithi172.stdout:4/45: chown d0/fa 901107892 1 2024-09-20T18:35:32.997 INFO:tasks.workunit.client.1.smithi172.stdout:0/118: symlink d4/d1a/l30 0 2024-09-20T18:35:32.997 INFO:tasks.workunit.client.1.smithi172.stdout:6/52: dwrite d0/fe [0,4194304] 0 2024-09-20T18:35:32.997 INFO:tasks.workunit.client.1.smithi172.stdout:3/54: symlink d0/db/ld 0 2024-09-20T18:35:32.997 INFO:tasks.workunit.client.1.smithi172.stdout:6/53: dread d0/f5 [0,4194304] 0 2024-09-20T18:35:32.997 INFO:tasks.workunit.client.1.smithi172.stdout:8/31: link f0 fc 0 2024-09-20T18:35:32.997 INFO:tasks.workunit.client.1.smithi172.stdout:7/54: rename d2/d3/dd/l12 to d2/d3/l17 0 2024-09-20T18:35:32.997 INFO:tasks.workunit.client.1.smithi172.stdout:7/55: stat c1 0 2024-09-20T18:35:33.016 INFO:tasks.workunit.client.1.smithi172.stdout:9/62: rename l5 to lc 0 2024-09-20T18:35:33.017 INFO:tasks.workunit.client.1.smithi172.stdout:8/32: mkdir dd 0 2024-09-20T18:35:33.019 INFO:tasks.workunit.client.1.smithi172.stdout:8/33: chown c2 15669 1 2024-09-20T18:35:33.020 INFO:tasks.workunit.client.1.smithi172.stdout:2/21: dread d0/f3 [0,4194304] 0 2024-09-20T18:35:33.021 INFO:tasks.workunit.client.1.smithi172.stdout:7/56: dwrite d2/d3/d10/f14 [0,4194304] 0 2024-09-20T18:35:33.021 INFO:tasks.workunit.client.1.smithi172.stdout:2/22: read d0/f7 [479000,46098] 0 2024-09-20T18:35:33.027 INFO:tasks.workunit.client.1.smithi172.stdout:7/57: dread d2/f4 [0,4194304] 0 2024-09-20T18:35:33.063 INFO:tasks.workunit.client.1.smithi172.stdout:0/119: write d4/d5/fb [1485479,116996] 0 2024-09-20T18:35:33.068 INFO:tasks.workunit.client.1.smithi172.stdout:0/120: dwrite d4/f18 [0,4194304] 0 2024-09-20T18:35:33.069 INFO:tasks.workunit.client.1.smithi172.stdout:0/121: fdatasync d4/d5/f2f 0 2024-09-20T18:35:33.090 INFO:tasks.workunit.client.1.smithi172.stdout:5/118: sync 2024-09-20T18:35:33.091 INFO:tasks.workunit.client.1.smithi172.stdout:5/119: dread - d4/d1d/f25 zero size 2024-09-20T18:35:33.149 INFO:tasks.workunit.client.1.smithi172.stdout:3/55: sync 2024-09-20T18:35:33.152 INFO:tasks.workunit.client.1.smithi172.stdout:3/56: dread d0/f8 [0,4194304] 0 2024-09-20T18:35:33.220 INFO:tasks.workunit.client.1.smithi172.stdout:4/46: creat d0/d7/dd/f14 x:0 0 0 2024-09-20T18:35:33.220 INFO:tasks.workunit.client.1.smithi172.stdout:4/47: dread - d0/d7/dd/f14 zero size 2024-09-20T18:35:33.220 INFO:tasks.workunit.client.1.smithi172.stdout:9/63: creat fd x:0 0 0 2024-09-20T18:35:33.221 INFO:tasks.workunit.client.1.smithi172.stdout:9/64: dread - fd zero size 2024-09-20T18:35:33.222 INFO:tasks.workunit.client.1.smithi172.stdout:9/65: write f8 [3649062,43016] 0 2024-09-20T18:35:33.222 INFO:tasks.workunit.client.1.smithi172.stdout:9/66: rmdir - no directory 2024-09-20T18:35:33.223 INFO:tasks.workunit.client.1.smithi172.stdout:6/54: unlink d0/f2 0 2024-09-20T18:35:33.232 INFO:tasks.workunit.client.1.smithi172.stdout:0/122: rename d4/d1a/f24 to d4/d1a/f31 0 2024-09-20T18:35:33.232 INFO:tasks.workunit.client.1.smithi172.stdout:0/123: truncate d4/d1a/f31 448471 0 2024-09-20T18:35:33.233 INFO:tasks.workunit.client.1.smithi172.stdout:0/124: chown c1 1168568 1 2024-09-20T18:35:33.238 INFO:tasks.workunit.client.1.smithi172.stdout:9/67: rename f7 to fe 0 2024-09-20T18:35:33.238 INFO:tasks.workunit.client.1.smithi172.stdout:9/68: write f6 [166123,91819] 0 2024-09-20T18:35:33.240 INFO:tasks.workunit.client.1.smithi172.stdout:8/34: symlink dd/le 0 2024-09-20T18:35:33.245 INFO:tasks.workunit.client.1.smithi172.stdout:5/120: symlink d4/l29 0 2024-09-20T18:35:33.246 INFO:tasks.workunit.client.1.smithi172.stdout:5/121: write d4/f5 [1547910,31849] 0 2024-09-20T18:35:33.249 INFO:tasks.workunit.client.1.smithi172.stdout:0/125: mknod d4/d5/c32 0 2024-09-20T18:35:33.253 INFO:tasks.workunit.client.1.smithi172.stdout:6/55: link d0/fc d0/f13 0 2024-09-20T18:35:33.254 INFO:tasks.workunit.client.1.smithi172.stdout:8/35: rename dd/le to dd/lf 0 2024-09-20T18:35:33.260 INFO:tasks.workunit.client.1.smithi172.stdout:6/56: unlink d0/d3/c9 0 2024-09-20T18:35:33.260 INFO:tasks.workunit.client.1.smithi172.stdout:8/36: rmdir dd 39 2024-09-20T18:35:33.262 INFO:tasks.workunit.client.1.smithi172.stdout:7/58: getdents d2/d3/dd 0 2024-09-20T18:35:33.262 INFO:tasks.workunit.client.1.smithi172.stdout:6/57: dread d0/fe [0,4194304] 0 2024-09-20T18:35:33.264 INFO:tasks.workunit.client.1.smithi172.stdout:6/58: truncate d0/d3/f7 10392 0 2024-09-20T18:35:33.264 INFO:tasks.workunit.client.1.smithi172.stdout:6/59: readlink d0/l12 0 2024-09-20T18:35:33.265 INFO:tasks.workunit.client.1.smithi172.stdout:3/57: getdents d0 0 2024-09-20T18:35:33.266 INFO:tasks.workunit.client.1.smithi172.stdout:0/126: mkdir d4/d5/d2e/d33 0 2024-09-20T18:35:33.270 INFO:tasks.workunit.client.1.smithi172.stdout:7/59: creat d2/d3/d10/f18 x:0 0 0 2024-09-20T18:35:33.271 INFO:tasks.workunit.client.1.smithi172.stdout:6/60: mknod d0/c14 0 2024-09-20T18:35:33.274 INFO:tasks.workunit.client.1.smithi172.stdout:3/58: dread d0/f9 [0,4194304] 0 2024-09-20T18:35:33.274 INFO:tasks.workunit.client.1.smithi172.stdout:0/127: mkdir d4/d1a/d28/d34 0 2024-09-20T18:35:33.274 INFO:tasks.workunit.client.1.smithi172.stdout:9/69: link l9 lf 0 2024-09-20T18:35:33.275 INFO:tasks.workunit.client.1.smithi172.stdout:0/128: write d4/d5/fc [808662,81172] 0 2024-09-20T18:35:33.275 INFO:tasks.workunit.client.1.smithi172.stdout:9/70: truncate fd 39123 0 2024-09-20T18:35:33.276 INFO:tasks.workunit.client.1.smithi172.stdout:0/129: write d4/f16 [9044575,32301] 0 2024-09-20T18:35:33.276 INFO:tasks.workunit.client.1.smithi172.stdout:0/130: stat d4/f11 0 2024-09-20T18:35:33.278 INFO:tasks.workunit.client.1.smithi172.stdout:8/37: mknod dd/c10 0 2024-09-20T18:35:33.279 INFO:tasks.workunit.client.1.smithi172.stdout:6/61: symlink d0/l15 0 2024-09-20T18:35:33.282 INFO:tasks.workunit.client.1.smithi172.stdout:9/71: symlink l10 0 2024-09-20T18:35:33.282 INFO:tasks.workunit.client.1.smithi172.stdout:9/72: write fa [1047682,88858] 0 2024-09-20T18:35:33.283 INFO:tasks.workunit.client.1.smithi172.stdout:8/38: fsync fc 0 2024-09-20T18:35:33.288 INFO:tasks.workunit.client.1.smithi172.stdout:9/73: symlink l11 0 2024-09-20T18:35:33.295 INFO:tasks.workunit.client.1.smithi172.stdout:8/39: dwrite f9 [0,4194304] 0 2024-09-20T18:35:33.296 INFO:tasks.workunit.client.1.smithi172.stdout:8/40: dread - fa zero size 2024-09-20T18:35:33.298 INFO:tasks.workunit.client.1.smithi172.stdout:9/74: dread f8 [0,4194304] 0 2024-09-20T18:35:33.298 INFO:tasks.workunit.client.1.smithi172.stdout:9/75: rmdir - no directory 2024-09-20T18:35:33.299 INFO:tasks.workunit.client.1.smithi172.stdout:6/62: dwrite d0/fe [4194304,4194304] 0 2024-09-20T18:35:33.299 INFO:tasks.workunit.client.1.smithi172.stdout:9/76: fdatasync fe 0 2024-09-20T18:35:33.307 INFO:tasks.workunit.client.1.smithi172.stdout:6/63: rename d0/cf to d0/c16 0 2024-09-20T18:35:33.308 INFO:tasks.workunit.client.1.smithi172.stdout:9/77: dread fa [0,4194304] 0 2024-09-20T18:35:33.308 INFO:tasks.workunit.client.1.smithi172.stdout:6/64: dread d0/d3/f7 [0,4194304] 0 2024-09-20T18:35:33.311 INFO:tasks.workunit.client.1.smithi172.stdout:6/65: rmdir d0 39 2024-09-20T18:35:33.319 INFO:tasks.workunit.client.1.smithi172.stdout:6/66: mknod d0/d3/c17 0 2024-09-20T18:35:33.320 INFO:tasks.workunit.client.1.smithi172.stdout:6/67: mkdir d0/d18 0 2024-09-20T18:35:33.376 INFO:tasks.workunit.client.1.smithi172.stdout:4/48: rename d0/d7/dd to d0/d7/df/d15 0 2024-09-20T18:35:33.379 INFO:tasks.workunit.client.1.smithi172.stdout:8/41: rename c2 to dd/c11 0 2024-09-20T18:35:33.379 INFO:tasks.workunit.client.1.smithi172.stdout:8/42: truncate f1 4898594 0 2024-09-20T18:35:33.380 INFO:tasks.workunit.client.1.smithi172.stdout:8/43: dread - fb zero size 2024-09-20T18:35:33.384 INFO:tasks.workunit.client.1.smithi172.stdout:1/46: dwrite d0/f1 [0,4194304] 0 2024-09-20T18:35:33.396 INFO:tasks.workunit.client.1.smithi172.stdout:1/47: creat d0/d8/db/fe x:0 0 0 2024-09-20T18:35:33.396 INFO:tasks.workunit.client.1.smithi172.stdout:2/23: truncate d0/f3 521906 0 2024-09-20T18:35:33.402 INFO:tasks.workunit.client.1.smithi172.stdout:1/48: dwrite d0/f1 [0,4194304] 0 2024-09-20T18:35:33.405 INFO:tasks.workunit.client.1.smithi172.stdout:2/24: link d0/f7 d0/f8 0 2024-09-20T18:35:33.413 INFO:tasks.workunit.client.1.smithi172.stdout:5/122: truncate f3 781273 0 2024-09-20T18:35:33.416 INFO:tasks.workunit.client.1.smithi172.stdout:5/123: creat d4/d1f/d26/f2a x:0 0 0 2024-09-20T18:35:33.417 INFO:tasks.workunit.client.1.smithi172.stdout:5/124: write d4/d1d/f25 [928140,110170] 0 2024-09-20T18:35:33.417 INFO:tasks.workunit.client.1.smithi172.stdout:5/125: chown d4/d1d/f1e 822 1 2024-09-20T18:35:33.418 INFO:tasks.workunit.client.1.smithi172.stdout:7/60: getdents d2/d3/d10 0 2024-09-20T18:35:33.419 INFO:tasks.workunit.client.1.smithi172.stdout:7/61: dread - d2/f9 zero size 2024-09-20T18:35:33.420 INFO:tasks.workunit.client.1.smithi172.stdout:7/62: fdatasync d2/d3/fa 0 2024-09-20T18:35:33.420 INFO:tasks.workunit.client.1.smithi172.stdout:7/63: chown d2/l11 295 1 2024-09-20T18:35:33.426 INFO:tasks.workunit.client.1.smithi172.stdout:7/64: link d2/f4 d2/d3/dd/f19 0 2024-09-20T18:35:33.427 INFO:tasks.workunit.client.1.smithi172.stdout:7/65: write d2/d3/d10/f18 [206672,23239] 0 2024-09-20T18:35:33.429 INFO:tasks.workunit.client.1.smithi172.stdout:9/78: getdents . 0 2024-09-20T18:35:33.431 INFO:tasks.workunit.client.1.smithi172.stdout:9/79: write fe [5257125,97603] 0 2024-09-20T18:35:33.431 INFO:tasks.workunit.client.1.smithi172.stdout:7/66: symlink d2/d3/l1a 0 2024-09-20T18:35:33.437 INFO:tasks.workunit.client.1.smithi172.stdout:7/67: rename d2/f4 to d2/d3/d10/f1b 0 2024-09-20T18:35:33.438 INFO:tasks.workunit.client.1.smithi172.stdout:7/68: fdatasync d2/d3/d10/f18 0 2024-09-20T18:35:33.438 INFO:tasks.workunit.client.1.smithi172.stdout:9/80: dwrite f8 [0,4194304] 0 2024-09-20T18:35:33.442 INFO:tasks.workunit.client.1.smithi172.stdout:0/131: sync 2024-09-20T18:35:33.442 INFO:tasks.workunit.client.1.smithi172.stdout:3/59: sync 2024-09-20T18:35:33.443 INFO:tasks.workunit.client.1.smithi172.stdout:9/81: getdents . 0 2024-09-20T18:35:33.444 INFO:tasks.workunit.client.1.smithi172.stdout:9/82: read fe [8155411,93981] 0 2024-09-20T18:35:33.444 INFO:tasks.workunit.client.1.smithi172.stdout:7/69: dwrite d2/d3/fa [0,4194304] 0 2024-09-20T18:35:33.446 INFO:tasks.workunit.client.1.smithi172.stdout:7/70: truncate d2/f9 1034232 0 2024-09-20T18:35:33.452 INFO:tasks.workunit.client.1.smithi172.stdout:9/83: creat f12 x:0 0 0 2024-09-20T18:35:33.462 INFO:tasks.workunit.client.1.smithi172.stdout:3/60: symlink d0/dc/le 0 2024-09-20T18:35:33.487 INFO:tasks.workunit.client.1.smithi172.stdout:8/44: dwrite f0 [0,4194304] 0 2024-09-20T18:35:33.493 INFO:tasks.workunit.client.1.smithi172.stdout:6/68: dwrite d0/f5 [0,4194304] 0 2024-09-20T18:35:33.495 INFO:tasks.workunit.client.1.smithi172.stdout:2/25: dread d0/f3 [0,4194304] 0 2024-09-20T18:35:33.505 INFO:tasks.workunit.client.1.smithi172.stdout:8/45: link l3 dd/l12 0 2024-09-20T18:35:33.506 INFO:tasks.workunit.client.1.smithi172.stdout:1/49: truncate d0/f1 2882809 0 2024-09-20T18:35:33.509 INFO:tasks.workunit.client.1.smithi172.stdout:5/126: dread d4/f5 [0,4194304] 0 2024-09-20T18:35:33.510 INFO:tasks.workunit.client.1.smithi172.stdout:5/127: write d4/f17 [98970,80654] 0 2024-09-20T18:35:33.513 INFO:tasks.workunit.client.1.smithi172.stdout:2/26: mkdir d0/d4/d9 0 2024-09-20T18:35:33.516 INFO:tasks.workunit.client.1.smithi172.stdout:1/50: symlink d0/lf 0 2024-09-20T18:35:33.525 INFO:tasks.workunit.client.1.smithi172.stdout:9/84: getdents . 0 2024-09-20T18:35:33.528 INFO:tasks.workunit.client.1.smithi172.stdout:2/27: creat d0/d4/d9/fa x:0 0 0 2024-09-20T18:35:33.529 INFO:tasks.workunit.client.1.smithi172.stdout:7/71: truncate d2/d3/d10/f15 43173 0 2024-09-20T18:35:33.530 INFO:tasks.workunit.client.1.smithi172.stdout:7/72: readlink d2/l11 0 2024-09-20T18:35:33.530 INFO:tasks.workunit.client.1.smithi172.stdout:8/46: link dd/l12 dd/l13 0 2024-09-20T18:35:33.531 INFO:tasks.workunit.client.1.smithi172.stdout:3/61: write d0/f9 [1107997,18621] 0 2024-09-20T18:35:33.535 INFO:tasks.workunit.client.1.smithi172.stdout:3/62: dread d0/f7 [0,4194304] 0 2024-09-20T18:35:33.536 INFO:tasks.workunit.client.1.smithi172.stdout:3/63: write d0/f7 [1552543,104005] 0 2024-09-20T18:35:33.538 INFO:tasks.workunit.client.1.smithi172.stdout:8/47: symlink dd/l14 0 2024-09-20T18:35:33.539 INFO:tasks.workunit.client.1.smithi172.stdout:2/28: dread d0/f8 [0,4194304] 0 2024-09-20T18:35:33.539 INFO:tasks.workunit.client.1.smithi172.stdout:8/48: write f8 [445560,20165] 0 2024-09-20T18:35:33.539 INFO:tasks.workunit.client.1.smithi172.stdout:2/29: readlink d0/l1 0 2024-09-20T18:35:33.541 INFO:tasks.workunit.client.1.smithi172.stdout:4/49: sync 2024-09-20T18:35:33.541 INFO:tasks.workunit.client.1.smithi172.stdout:9/85: unlink l9 0 2024-09-20T18:35:33.543 INFO:tasks.workunit.client.1.smithi172.stdout:8/49: dread f1 [0,4194304] 0 2024-09-20T18:35:33.543 INFO:tasks.workunit.client.1.smithi172.stdout:9/86: write f12 [842795,116283] 0 2024-09-20T18:35:33.543 INFO:tasks.workunit.client.1.smithi172.stdout:6/69: dread d0/d3/f7 [0,4194304] 0 2024-09-20T18:35:33.544 INFO:tasks.workunit.client.1.smithi172.stdout:3/64: mkdir d0/df 0 2024-09-20T18:35:33.544 INFO:tasks.workunit.client.1.smithi172.stdout:6/70: chown d0/d3/c6 53818 1 2024-09-20T18:35:33.546 INFO:tasks.workunit.client.1.smithi172.stdout:7/73: mkdir d2/d1c 0 2024-09-20T18:35:33.546 INFO:tasks.workunit.client.1.smithi172.stdout:8/50: dread f0 [0,4194304] 0 2024-09-20T18:35:33.549 INFO:tasks.workunit.client.1.smithi172.stdout:1/51: truncate d0/f1 3147449 0 2024-09-20T18:35:33.551 INFO:tasks.workunit.client.1.smithi172.stdout:5/128: write f3 [302856,88199] 0 2024-09-20T18:35:33.553 INFO:tasks.workunit.client.1.smithi172.stdout:4/50: mknod d0/d7/df/c16 0 2024-09-20T18:35:33.554 INFO:tasks.workunit.client.1.smithi172.stdout:4/51: chown d0/de/l6 33013678 1 2024-09-20T18:35:33.557 INFO:tasks.workunit.client.1.smithi172.stdout:5/129: dwrite d4/df/f15 [0,4194304] 0 2024-09-20T18:35:33.559 INFO:tasks.workunit.client.1.smithi172.stdout:7/74: creat d2/d3/dd/f1d x:0 0 0 2024-09-20T18:35:33.560 INFO:tasks.workunit.client.1.smithi172.stdout:7/75: truncate d2/d3/dd/fe 131035 0 2024-09-20T18:35:33.560 INFO:tasks.workunit.client.1.smithi172.stdout:7/76: readlink d2/l11 0 2024-09-20T18:35:33.561 INFO:tasks.workunit.client.1.smithi172.stdout:8/51: mknod dd/c15 0 2024-09-20T18:35:33.572 INFO:tasks.workunit.client.1.smithi172.stdout:4/52: mknod d0/d7/c17 0 2024-09-20T18:35:33.572 INFO:tasks.workunit.client.1.smithi172.stdout:4/53: readlink d0/de/lb 0 2024-09-20T18:35:33.573 INFO:tasks.workunit.client.1.smithi172.stdout:4/54: chown d0/de/lb 7 1 2024-09-20T18:35:33.575 INFO:tasks.workunit.client.1.smithi172.stdout:5/130: creat d4/d1d/f2b x:0 0 0 2024-09-20T18:35:33.576 INFO:tasks.workunit.client.1.smithi172.stdout:5/131: fsync d4/d1f/f27 0 2024-09-20T18:35:33.577 INFO:tasks.workunit.client.1.smithi172.stdout:7/77: symlink d2/d3/d10/l1e 0 2024-09-20T18:35:33.578 INFO:tasks.workunit.client.1.smithi172.stdout:7/78: dread d2/f9 [0,4194304] 0 2024-09-20T18:35:33.579 INFO:tasks.workunit.client.1.smithi172.stdout:7/79: truncate d2/d3/dd/fe 612406 0 2024-09-20T18:35:33.584 INFO:tasks.workunit.client.1.smithi172.stdout:4/55: mkdir d0/d7/df/d18 0 2024-09-20T18:35:33.585 INFO:tasks.workunit.client.1.smithi172.stdout:6/71: getdents d0/d18 0 2024-09-20T18:35:33.585 INFO:tasks.workunit.client.1.smithi172.stdout:2/30: write d0/f3 [506221,43360] 0 2024-09-20T18:35:33.587 INFO:tasks.workunit.client.1.smithi172.stdout:5/132: mkdir d4/d1d/d2c 0 2024-09-20T18:35:33.599 INFO:tasks.workunit.client.1.smithi172.stdout:2/31: fdatasync d0/f8 0 2024-09-20T18:35:33.605 INFO:tasks.workunit.client.1.smithi172.stdout:5/133: dwrite d4/f9 [0,4194304] 0 2024-09-20T18:35:33.607 INFO:tasks.workunit.client.1.smithi172.stdout:8/52: truncate f0 3791102 0 2024-09-20T18:35:33.607 INFO:tasks.workunit.client.1.smithi172.stdout:4/56: mknod d0/d7/df/d18/c19 0 2024-09-20T18:35:33.609 INFO:tasks.workunit.client.1.smithi172.stdout:2/32: rmdir d0/d4/d9 39 2024-09-20T18:35:33.610 INFO:tasks.workunit.client.1.smithi172.stdout:4/57: write d0/d7/f12 [80037,54442] 0 2024-09-20T18:35:33.615 INFO:tasks.workunit.client.1.smithi172.stdout:8/53: creat dd/f16 x:0 0 0 2024-09-20T18:35:33.615 INFO:tasks.workunit.client.1.smithi172.stdout:5/134: dwrite d4/f5 [0,4194304] 0 2024-09-20T18:35:33.619 INFO:tasks.workunit.client.1.smithi172.stdout:4/58: mkdir d0/d7/df/d18/d1a 0 2024-09-20T18:35:33.620 INFO:tasks.workunit.client.1.smithi172.stdout:2/33: dwrite d0/f3 [0,4194304] 0 2024-09-20T18:35:33.620 INFO:tasks.workunit.client.1.smithi172.stdout:4/59: chown d0 233 1 2024-09-20T18:35:33.621 INFO:tasks.workunit.client.1.smithi172.stdout:8/54: symlink dd/l17 0 2024-09-20T18:35:33.626 INFO:tasks.workunit.client.1.smithi172.stdout:5/135: dwrite d4/f17 [0,4194304] 0 2024-09-20T18:35:33.626 INFO:tasks.workunit.client.1.smithi172.stdout:4/60: rmdir d0/d7/df 39 2024-09-20T18:35:33.627 INFO:tasks.workunit.client.1.smithi172.stdout:5/136: chown d4/l18 155 1 2024-09-20T18:35:33.628 INFO:tasks.workunit.client.1.smithi172.stdout:2/34: dread d0/f7 [0,4194304] 0 2024-09-20T18:35:33.629 INFO:tasks.workunit.client.1.smithi172.stdout:9/87: getdents . 0 2024-09-20T18:35:33.629 INFO:tasks.workunit.client.1.smithi172.stdout:9/88: rmdir - no directory 2024-09-20T18:35:33.632 INFO:tasks.workunit.client.1.smithi172.stdout:0/132: sync 2024-09-20T18:35:33.633 INFO:tasks.workunit.client.1.smithi172.stdout:8/55: rename dd/c10 to dd/c18 0 2024-09-20T18:35:33.633 INFO:tasks.workunit.client.1.smithi172.stdout:1/52: truncate d0/f1 2162146 0 2024-09-20T18:35:33.639 INFO:tasks.workunit.client.1.smithi172.stdout:9/89: symlink l13 0 2024-09-20T18:35:33.639 INFO:tasks.workunit.client.1.smithi172.stdout:2/35: dwrite d0/f3 [0,4194304] 0 2024-09-20T18:35:33.641 INFO:tasks.workunit.client.1.smithi172.stdout:8/56: creat dd/f19 x:0 0 0 2024-09-20T18:35:33.643 INFO:tasks.workunit.client.1.smithi172.stdout:1/53: dread d0/f4 [0,4194304] 0 2024-09-20T18:35:33.644 INFO:tasks.workunit.client.1.smithi172.stdout:0/133: dwrite d4/d5/fc [0,4194304] 0 2024-09-20T18:35:33.645 INFO:tasks.workunit.client.1.smithi172.stdout:2/36: write d0/f8 [2344108,21200] 0 2024-09-20T18:35:33.648 INFO:tasks.workunit.client.1.smithi172.stdout:8/57: mknod dd/c1a 0 2024-09-20T18:35:33.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:33 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:33.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:33 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:33.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:33 smithi017 ceph-mon[28058]: Reconfiguring prometheus.smithi017 (dependencies changed)... 2024-09-20T18:35:33.654 INFO:tasks.workunit.client.1.smithi172.stdout:9/90: dwrite fd [0,4194304] 0 2024-09-20T18:35:33.654 INFO:tasks.workunit.client.1.smithi172.stdout:8/58: mkdir dd/d1b 0 2024-09-20T18:35:33.660 INFO:tasks.workunit.client.1.smithi172.stdout:2/37: symlink d0/d4/lb 0 2024-09-20T18:35:33.664 INFO:tasks.workunit.client.1.smithi172.stdout:8/59: creat dd/f1c x:0 0 0 2024-09-20T18:35:33.665 INFO:tasks.workunit.client.1.smithi172.stdout:8/60: readlink dd/l17 0 2024-09-20T18:35:33.665 INFO:tasks.workunit.client.1.smithi172.stdout:8/61: chown dd/l14 820611 1 2024-09-20T18:35:33.666 INFO:tasks.workunit.client.1.smithi172.stdout:1/54: link d0/d8/db/fe d0/f10 0 2024-09-20T18:35:33.676 INFO:tasks.workunit.client.1.smithi172.stdout:1/55: write d0/f10 [808665,125367] 0 2024-09-20T18:35:33.677 INFO:tasks.workunit.client.1.smithi172.stdout:0/134: link d4/d20/l25 d4/d5/d2e/l35 0 2024-09-20T18:35:33.677 INFO:tasks.workunit.client.1.smithi172.stdout:4/61: dwrite d0/fa [4194304,4194304] 0 2024-09-20T18:35:33.678 INFO:tasks.workunit.client.1.smithi172.stdout:0/135: chown d4/d1a/d28 79608440 1 2024-09-20T18:35:33.678 INFO:tasks.workunit.client.1.smithi172.stdout:4/62: stat d0/de/dc/c10 0 2024-09-20T18:35:33.679 INFO:tasks.workunit.client.1.smithi172.stdout:2/38: creat d0/d4/d9/fc x:0 0 0 2024-09-20T18:35:33.681 INFO:tasks.workunit.client.1.smithi172.stdout:2/39: write d0/d4/d9/fa [623560,83418] 0 2024-09-20T18:35:33.681 INFO:tasks.workunit.client.1.smithi172.stdout:4/63: dread d0/d7/f12 [0,4194304] 0 2024-09-20T18:35:33.683 INFO:tasks.workunit.client.1.smithi172.stdout:2/40: write d0/d4/d9/fc [974912,64293] 0 2024-09-20T18:35:33.683 INFO:tasks.workunit.client.1.smithi172.stdout:2/41: readlink d0/l1 0 2024-09-20T18:35:33.684 INFO:tasks.workunit.client.1.smithi172.stdout:2/42: write d0/f3 [1263111,42251] 0 2024-09-20T18:35:33.685 INFO:tasks.workunit.client.1.smithi172.stdout:1/56: mknod d0/d8/c11 0 2024-09-20T18:35:33.685 INFO:tasks.workunit.client.1.smithi172.stdout:1/57: chown d0/d8/ld 7346110 1 2024-09-20T18:35:33.687 INFO:tasks.workunit.client.1.smithi172.stdout:0/136: symlink d4/d20/l36 0 2024-09-20T18:35:33.691 INFO:tasks.workunit.client.1.smithi172.stdout:9/91: getdents . 0 2024-09-20T18:35:33.692 INFO:tasks.workunit.client.1.smithi172.stdout:2/43: fdatasync d0/d4/d9/fc 0 2024-09-20T18:35:33.692 INFO:tasks.workunit.client.1.smithi172.stdout:2/44: chown d0/f3 1394 1 2024-09-20T18:35:33.695 INFO:tasks.workunit.client.1.smithi172.stdout:9/92: dread fe [4194304,4194304] 0 2024-09-20T18:35:33.698 INFO:tasks.workunit.client.1.smithi172.stdout:0/137: rmdir d4/d1a 39 2024-09-20T18:35:33.698 INFO:tasks.workunit.client.1.smithi172.stdout:2/45: dwrite d0/f3 [0,4194304] 0 2024-09-20T18:35:33.700 INFO:tasks.workunit.client.1.smithi172.stdout:9/93: dread fe [0,4194304] 0 2024-09-20T18:35:33.702 INFO:tasks.workunit.client.1.smithi172.stdout:9/94: write f8 [4856968,56381] 0 2024-09-20T18:35:33.705 INFO:tasks.workunit.client.1.smithi172.stdout:2/46: dread d0/f7 [0,4194304] 0 2024-09-20T18:35:33.706 INFO:tasks.workunit.client.1.smithi172.stdout:8/62: link dd/l12 dd/l1d 0 2024-09-20T18:35:33.706 INFO:tasks.workunit.client.1.smithi172.stdout:0/138: dwrite d4/d5/fc [0,4194304] 0 2024-09-20T18:35:33.707 INFO:tasks.workunit.client.1.smithi172.stdout:2/47: readlink d0/l1 0 2024-09-20T18:35:33.707 INFO:tasks.workunit.client.1.smithi172.stdout:8/63: chown dd/d1b 38 1 2024-09-20T18:35:33.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:33 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:33.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:33 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:33.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:33 smithi172 ceph-mon[35456]: Reconfiguring prometheus.smithi017 (dependencies changed)... 2024-09-20T18:35:33.709 INFO:tasks.workunit.client.1.smithi172.stdout:3/65: sync 2024-09-20T18:35:33.718 INFO:tasks.workunit.client.1.smithi172.stdout:4/64: mknod d0/d7/df/d18/d1a/c1b 0 2024-09-20T18:35:33.721 INFO:tasks.workunit.client.1.smithi172.stdout:9/95: creat f14 x:0 0 0 2024-09-20T18:35:33.722 INFO:tasks.workunit.client.1.smithi172.stdout:2/48: rmdir d0/d4/d9 39 2024-09-20T18:35:33.725 INFO:tasks.workunit.client.1.smithi172.stdout:0/139: creat d4/d1d/f37 x:0 0 0 2024-09-20T18:35:33.725 INFO:tasks.workunit.client.1.smithi172.stdout:4/65: dwrite d0/d7/df/f11 [0,4194304] 0 2024-09-20T18:35:33.729 INFO:tasks.workunit.client.1.smithi172.stdout:3/66: creat d0/f10 x:0 0 0 2024-09-20T18:35:33.736 INFO:tasks.workunit.client.1.smithi172.stdout:8/64: unlink dd/c11 0 2024-09-20T18:35:33.738 INFO:tasks.workunit.client.1.smithi172.stdout:4/66: dread d0/d7/f12 [0,4194304] 0 2024-09-20T18:35:33.738 INFO:tasks.workunit.client.1.smithi172.stdout:0/140: mkdir d4/d5/d2e/d38 0 2024-09-20T18:35:33.739 INFO:tasks.workunit.client.1.smithi172.stdout:4/67: dread d0/d7/f12 [0,4194304] 0 2024-09-20T18:35:33.740 INFO:tasks.workunit.client.1.smithi172.stdout:1/58: getdents d0 0 2024-09-20T18:35:33.742 INFO:tasks.workunit.client.1.smithi172.stdout:8/65: symlink dd/l1e 0 2024-09-20T18:35:33.743 INFO:tasks.workunit.client.1.smithi172.stdout:8/66: truncate dd/f1c 220805 0 2024-09-20T18:35:33.744 INFO:tasks.workunit.client.1.smithi172.stdout:3/67: dwrite d0/f8 [0,4194304] 0 2024-09-20T18:35:33.754 INFO:tasks.workunit.client.1.smithi172.stdout:0/141: mknod d4/d1a/d28/c39 0 2024-09-20T18:35:33.755 INFO:tasks.workunit.client.1.smithi172.stdout:0/142: write d4/f18 [1532687,21351] 0 2024-09-20T18:35:33.756 INFO:tasks.workunit.client.1.smithi172.stdout:3/68: fdatasync d0/f7 0 2024-09-20T18:35:33.759 INFO:tasks.workunit.client.1.smithi172.stdout:9/96: mkdir d15 0 2024-09-20T18:35:33.759 INFO:tasks.workunit.client.1.smithi172.stdout:0/143: dread d4/f11 [0,4194304] 0 2024-09-20T18:35:33.761 INFO:tasks.workunit.client.1.smithi172.stdout:8/67: creat dd/d1b/f1f x:0 0 0 2024-09-20T18:35:33.762 INFO:tasks.workunit.client.1.smithi172.stdout:0/144: dread d4/f18 [0,4194304] 0 2024-09-20T18:35:33.763 INFO:tasks.workunit.client.1.smithi172.stdout:0/145: read d4/d1a/f31 [32497,97477] 0 2024-09-20T18:35:33.764 INFO:tasks.workunit.client.1.smithi172.stdout:0/146: chown c1 589744648 1 2024-09-20T18:35:33.764 INFO:tasks.workunit.client.1.smithi172.stdout:1/59: chown d0/f1 56 1 2024-09-20T18:35:33.768 INFO:tasks.workunit.client.1.smithi172.stdout:4/68: link d0/c1 d0/d7/df/c1c 0 2024-09-20T18:35:33.769 INFO:tasks.workunit.client.1.smithi172.stdout:4/69: fdatasync d0/d7/df/d15/f14 0 2024-09-20T18:35:33.797 INFO:tasks.workunit.client.1.smithi172.stdout:7/80: sync 2024-09-20T18:35:33.801 INFO:tasks.workunit.client.1.smithi172.stdout:1/60: mkdir d0/d8/d12 0 2024-09-20T18:35:33.801 INFO:tasks.workunit.client.1.smithi172.stdout:3/69: write d0/f7 [632427,24548] 0 2024-09-20T18:35:33.803 INFO:tasks.workunit.client.1.smithi172.stdout:3/70: chown d0/c3 62695583 1 2024-09-20T18:35:33.805 INFO:tasks.workunit.client.1.smithi172.stdout:0/147: creat d4/d1a/d28/d34/f3a x:0 0 0 2024-09-20T18:35:33.806 INFO:tasks.workunit.client.1.smithi172.stdout:7/81: creat d2/d3/f1f x:0 0 0 2024-09-20T18:35:33.807 INFO:tasks.workunit.client.1.smithi172.stdout:1/61: fdatasync d0/f4 0 2024-09-20T18:35:33.807 INFO:tasks.workunit.client.1.smithi172.stdout:3/71: dread d0/f7 [0,4194304] 0 2024-09-20T18:35:33.808 INFO:tasks.workunit.client.1.smithi172.stdout:8/68: link c7 dd/c20 0 2024-09-20T18:35:33.809 INFO:tasks.workunit.client.1.smithi172.stdout:4/70: dwrite d0/d7/df/d15/f14 [0,4194304] 0 2024-09-20T18:35:33.809 INFO:tasks.workunit.client.1.smithi172.stdout:1/62: chown d0/f1 918599 1 2024-09-20T18:35:33.809 INFO:tasks.workunit.client.1.smithi172.stdout:3/72: readlink d0/dc/le 0 2024-09-20T18:35:33.810 INFO:tasks.workunit.client.1.smithi172.stdout:3/73: chown d0/c3 3077 1 2024-09-20T18:35:33.810 INFO:tasks.workunit.client.1.smithi172.stdout:4/71: chown d0/d7/df/d18/d1a 0 1 2024-09-20T18:35:33.817 INFO:tasks.workunit.client.1.smithi172.stdout:1/63: rename d0/c3 to d0/d8/d12/c13 0 2024-09-20T18:35:33.818 INFO:tasks.workunit.client.1.smithi172.stdout:0/148: link d4/d1d/f17 d4/d1d/d15/f3b 0 2024-09-20T18:35:33.819 INFO:tasks.workunit.client.1.smithi172.stdout:0/149: chown d4/f11 11 1 2024-09-20T18:35:33.819 INFO:tasks.workunit.client.1.smithi172.stdout:8/69: rmdir dd/d1b 39 2024-09-20T18:35:33.819 INFO:tasks.workunit.client.1.smithi172.stdout:0/150: write d4/d1d/d15/f26 [380094,16552] 0 2024-09-20T18:35:33.820 INFO:tasks.workunit.client.1.smithi172.stdout:0/151: truncate d4/d5/f2f 669933 0 2024-09-20T18:35:33.823 INFO:tasks.workunit.client.1.smithi172.stdout:7/82: link d2/d3/fb d2/d3/d10/f20 0 2024-09-20T18:35:33.826 INFO:tasks.workunit.client.1.smithi172.stdout:1/64: creat d0/d8/f14 x:0 0 0 2024-09-20T18:35:33.828 INFO:tasks.workunit.client.1.smithi172.stdout:0/152: mknod d4/d1a/d28/d34/c3c 0 2024-09-20T18:35:33.831 INFO:tasks.workunit.client.1.smithi172.stdout:1/65: rmdir d0/d8/db 39 2024-09-20T18:35:33.833 INFO:tasks.workunit.client.1.smithi172.stdout:8/70: dwrite f8 [0,4194304] 0 2024-09-20T18:35:33.833 INFO:tasks.workunit.client.1.smithi172.stdout:0/153: mknod d4/d1a/d28/c3d 0 2024-09-20T18:35:33.836 INFO:tasks.workunit.client.1.smithi172.stdout:7/83: truncate d2/d3/d10/f15 1019690 0 2024-09-20T18:35:33.845 INFO:tasks.workunit.client.1.smithi172.stdout:7/84: mknod d2/c21 0 2024-09-20T18:35:33.845 INFO:tasks.workunit.client.1.smithi172.stdout:8/71: dwrite dd/d1b/f1f [0,4194304] 0 2024-09-20T18:35:33.847 INFO:tasks.workunit.client.1.smithi172.stdout:8/72: write f8 [3214567,63784] 0 2024-09-20T18:35:33.850 INFO:tasks.workunit.client.1.smithi172.stdout:7/85: symlink d2/d3/d10/l22 0 2024-09-20T18:35:33.852 INFO:tasks.workunit.client.1.smithi172.stdout:0/154: dwrite d4/f18 [0,4194304] 0 2024-09-20T18:35:33.853 INFO:tasks.workunit.client.1.smithi172.stdout:7/86: truncate d2/d3/d10/f20 81296 0 2024-09-20T18:35:33.853 INFO:tasks.workunit.client.1.smithi172.stdout:0/155: write d4/f18 [1306562,110941] 0 2024-09-20T18:35:33.857 INFO:tasks.workunit.client.1.smithi172.stdout:8/73: truncate f0 1418955 0 2024-09-20T18:35:33.859 INFO:tasks.workunit.client.1.smithi172.stdout:8/74: write dd/f1c [273084,101896] 0 2024-09-20T18:35:33.868 INFO:tasks.workunit.client.1.smithi172.stdout:8/75: rename f8 to dd/d1b/f21 0 2024-09-20T18:35:33.869 INFO:tasks.workunit.client.1.smithi172.stdout:8/76: chown dd/d1b/f1f 11163162 1 2024-09-20T18:35:33.875 INFO:tasks.workunit.client.1.smithi172.stdout:8/77: dread f1 [0,4194304] 0 2024-09-20T18:35:33.876 INFO:tasks.workunit.client.1.smithi172.stdout:8/78: truncate f1 95641 0 2024-09-20T18:35:33.880 INFO:tasks.workunit.client.1.smithi172.stdout:8/79: mknod dd/c22 0 2024-09-20T18:35:33.882 INFO:tasks.workunit.client.1.smithi172.stdout:0/156: truncate d4/d1a/f31 269778 0 2024-09-20T18:35:33.882 INFO:tasks.workunit.client.1.smithi172.stdout:7/87: dwrite d2/d3/fb [0,4194304] 0 2024-09-20T18:35:33.889 INFO:tasks.workunit.client.1.smithi172.stdout:5/137: sync 2024-09-20T18:35:33.889 INFO:tasks.workunit.client.1.smithi172.stdout:6/72: sync 2024-09-20T18:35:33.889 INFO:tasks.workunit.client.1.smithi172.stdout:0/157: unlink d4/d5/l2c 0 2024-09-20T18:35:33.890 INFO:tasks.workunit.client.1.smithi172.stdout:0/158: fdatasync d4/d5/f2f 0 2024-09-20T18:35:33.897 INFO:tasks.workunit.client.1.smithi172.stdout:7/88: mkdir d2/d23 0 2024-09-20T18:35:33.899 INFO:tasks.workunit.client.1.smithi172.stdout:5/138: mkdir d4/d1f/d26/d2d 0 2024-09-20T18:35:33.903 INFO:tasks.workunit.client.1.smithi172.stdout:7/89: dread f0 [0,4194304] 0 2024-09-20T18:35:33.908 INFO:tasks.workunit.client.1.smithi172.stdout:5/139: unlink d4/l8 0 2024-09-20T18:35:33.908 INFO:tasks.workunit.client.1.smithi172.stdout:5/140: readlink d4/df/l19 0 2024-09-20T18:35:33.914 INFO:tasks.workunit.client.1.smithi172.stdout:5/141: dwrite d4/d1d/f21 [0,4194304] 0 2024-09-20T18:35:33.914 INFO:tasks.workunit.client.1.smithi172.stdout:7/90: creat d2/d23/f24 x:0 0 0 2024-09-20T18:35:33.915 INFO:tasks.workunit.client.1.smithi172.stdout:7/91: chown d2 531 1 2024-09-20T18:35:33.918 INFO:tasks.workunit.client.1.smithi172.stdout:0/159: write d4/d1a/f31 [519435,42644] 0 2024-09-20T18:35:33.918 INFO:tasks.workunit.client.1.smithi172.stdout:0/160: dread - d4/d1a/f1e zero size 2024-09-20T18:35:33.924 INFO:tasks.workunit.client.1.smithi172.stdout:8/80: truncate fc 2224399 0 2024-09-20T18:35:33.926 INFO:tasks.workunit.client.1.smithi172.stdout:7/92: creat d2/f25 x:0 0 0 2024-09-20T18:35:33.928 INFO:tasks.workunit.client.1.smithi172.stdout:7/93: write d2/d3/d10/f18 [277058,129057] 0 2024-09-20T18:35:33.931 INFO:tasks.workunit.client.1.smithi172.stdout:7/94: write d2/d3/f1f [418487,30265] 0 2024-09-20T18:35:33.931 INFO:tasks.workunit.client.1.smithi172.stdout:6/73: dwrite d0/f13 [4194304,4194304] 0 2024-09-20T18:35:33.931 INFO:tasks.workunit.client.1.smithi172.stdout:8/81: creat dd/d1b/f23 x:0 0 0 2024-09-20T18:35:33.935 INFO:tasks.workunit.client.1.smithi172.stdout:5/142: write d4/df/f1c [1008570,115312] 0 2024-09-20T18:35:33.936 INFO:tasks.workunit.client.1.smithi172.stdout:5/143: write d4/d1f/f27 [733375,77783] 0 2024-09-20T18:35:33.939 INFO:tasks.workunit.client.1.smithi172.stdout:8/82: creat dd/d1b/f24 x:0 0 0 2024-09-20T18:35:33.939 INFO:tasks.workunit.client.1.smithi172.stdout:6/74: dread d0/fc [0,4194304] 0 2024-09-20T18:35:33.943 INFO:tasks.workunit.client.1.smithi172.stdout:0/161: truncate d4/d5/fb 1848634 0 2024-09-20T18:35:33.945 INFO:tasks.workunit.client.1.smithi172.stdout:5/144: mknod d4/d1d/c2e 0 2024-09-20T18:35:33.946 INFO:tasks.workunit.client.1.smithi172.stdout:7/95: write d2/f9 [1462083,37046] 0 2024-09-20T18:35:33.946 INFO:tasks.workunit.client.1.smithi172.stdout:5/145: chown d4/d1d/f1e 22333 1 2024-09-20T18:35:33.948 INFO:tasks.workunit.client.1.smithi172.stdout:8/83: mknod dd/c25 0 2024-09-20T18:35:33.949 INFO:tasks.workunit.client.1.smithi172.stdout:0/162: mknod d4/d5/d2e/d38/c3e 0 2024-09-20T18:35:33.951 INFO:tasks.workunit.client.1.smithi172.stdout:7/96: mknod d2/d3/d10/c26 0 2024-09-20T18:35:33.951 INFO:tasks.workunit.client.1.smithi172.stdout:0/163: write d4/d1d/d15/f26 [724473,116341] 0 2024-09-20T18:35:33.951 INFO:tasks.workunit.client.1.smithi172.stdout:8/84: mknod dd/d1b/c26 0 2024-09-20T18:35:33.952 INFO:tasks.workunit.client.1.smithi172.stdout:0/164: chown d4/d1d/f37 407 1 2024-09-20T18:35:33.952 INFO:tasks.workunit.client.1.smithi172.stdout:5/146: mknod d4/d1d/d2c/c2f 0 2024-09-20T18:35:33.954 INFO:tasks.workunit.client.1.smithi172.stdout:6/75: truncate d0/f13 4594834 0 2024-09-20T18:35:33.955 INFO:tasks.workunit.client.1.smithi172.stdout:6/76: chown d0 1714615 1 2024-09-20T18:35:33.959 INFO:tasks.workunit.client.1.smithi172.stdout:5/147: dwrite d4/d1d/f21 [0,4194304] 0 2024-09-20T18:35:33.961 INFO:tasks.workunit.client.1.smithi172.stdout:6/77: mknod d0/d3/c19 0 2024-09-20T18:35:33.962 INFO:tasks.workunit.client.1.smithi172.stdout:6/78: chown d0 8 1 2024-09-20T18:35:33.963 INFO:tasks.workunit.client.1.smithi172.stdout:8/85: dwrite dd/d1b/f21 [4194304,4194304] 0 2024-09-20T18:35:33.967 INFO:tasks.workunit.client.1.smithi172.stdout:5/148: creat d4/d1d/d2c/f30 x:0 0 0 2024-09-20T18:35:33.968 INFO:tasks.workunit.client.1.smithi172.stdout:5/149: chown d4/f23 766 1 2024-09-20T18:35:33.970 INFO:tasks.workunit.client.1.smithi172.stdout:6/79: rename d0 to d0/d1a 22 2024-09-20T18:35:33.971 INFO:tasks.workunit.client.1.smithi172.stdout:5/150: read d4/d1d/f25 [343862,47384] 0 2024-09-20T18:35:33.976 INFO:tasks.workunit.client.1.smithi172.stdout:7/97: truncate d2/d3/f1f 360408 0 2024-09-20T18:35:33.977 INFO:tasks.workunit.client.1.smithi172.stdout:8/86: dwrite f9 [0,4194304] 0 2024-09-20T18:35:33.981 INFO:tasks.workunit.client.1.smithi172.stdout:2/49: sync 2024-09-20T18:35:33.981 INFO:tasks.workunit.client.1.smithi172.stdout:9/97: sync 2024-09-20T18:35:33.981 INFO:tasks.workunit.client.1.smithi172.stdout:0/165: getdents d4/d1a/d28/d34 0 2024-09-20T18:35:33.981 INFO:tasks.workunit.client.1.smithi172.stdout:2/50: chown d0/d4 104 1 2024-09-20T18:35:33.987 INFO:tasks.workunit.client.1.smithi172.stdout:7/98: creat d2/d1c/f27 x:0 0 0 2024-09-20T18:35:33.987 INFO:tasks.workunit.client.1.smithi172.stdout:7/99: fdatasync d2/d3/f7 0 2024-09-20T18:35:33.987 INFO:tasks.workunit.client.1.smithi172.stdout:0/166: mknod d4/d20/c3f 0 2024-09-20T18:35:33.990 INFO:tasks.workunit.client.1.smithi172.stdout:6/80: creat d0/f1b x:0 0 0 2024-09-20T18:35:33.994 INFO:tasks.workunit.client.1.smithi172.stdout:9/98: mknod d15/c16 0 2024-09-20T18:35:33.996 INFO:tasks.workunit.client.1.smithi172.stdout:7/100: rename d2/d3/d10/l22 to d2/d1c/l28 0 2024-09-20T18:35:34.001 INFO:tasks.workunit.client.1.smithi172.stdout:0/167: rename d4/d1a/f31 to d4/d1a/d28/d34/f40 0 2024-09-20T18:35:34.002 INFO:tasks.workunit.client.1.smithi172.stdout:0/168: chown d4/d1d/f17 118545 1 2024-09-20T18:35:34.002 INFO:tasks.workunit.client.1.smithi172.stdout:7/101: symlink d2/d23/l29 0 2024-09-20T18:35:34.003 INFO:tasks.workunit.client.1.smithi172.stdout:0/169: chown d4/d5/ca 100948164 1 2024-09-20T18:35:34.004 INFO:tasks.workunit.client.1.smithi172.stdout:2/51: creat d0/d4/fd x:0 0 0 2024-09-20T18:35:34.007 INFO:tasks.workunit.client.1.smithi172.stdout:6/81: mkdir d0/d18/d1c 0 2024-09-20T18:35:34.008 INFO:tasks.workunit.client.1.smithi172.stdout:7/102: rmdir d2 39 2024-09-20T18:35:34.009 INFO:tasks.workunit.client.1.smithi172.stdout:0/170: rmdir d4/d20 39 2024-09-20T18:35:34.023 INFO:tasks.workunit.client.1.smithi172.stdout:2/52: symlink d0/d4/le 0 2024-09-20T18:35:34.023 INFO:tasks.workunit.client.1.smithi172.stdout:7/103: creat d2/d1c/f2a x:0 0 0 2024-09-20T18:35:34.023 INFO:tasks.workunit.client.1.smithi172.stdout:0/171: write d4/d1a/d28/d34/f40 [173118,29621] 0 2024-09-20T18:35:34.025 INFO:tasks.workunit.client.1.smithi172.stdout:0/172: truncate d4/f29 241401 0 2024-09-20T18:35:34.028 INFO:tasks.workunit.client.1.smithi172.stdout:6/82: dwrite d0/fc [4194304,4194304] 0 2024-09-20T18:35:34.084 INFO:tasks.workunit.client.1.smithi172.stdout:9/99: truncate fd 313450 0 2024-09-20T18:35:34.107 INFO:tasks.workunit.client.1.smithi172.stdout:4/72: sync 2024-09-20T18:35:34.107 INFO:tasks.workunit.client.1.smithi172.stdout:3/74: sync 2024-09-20T18:35:34.107 INFO:tasks.workunit.client.1.smithi172.stdout:1/66: sync 2024-09-20T18:35:34.108 INFO:tasks.workunit.client.1.smithi172.stdout:3/75: chown d0/ca 930447 1 2024-09-20T18:35:34.108 INFO:tasks.workunit.client.1.smithi172.stdout:1/67: chown d0/d8/ca 91918 1 2024-09-20T18:35:34.108 INFO:tasks.workunit.client.1.smithi172.stdout:1/68: chown d0/d8/fc 16052 1 2024-09-20T18:35:34.137 INFO:tasks.workunit.client.1.smithi172.stdout:5/151: sync 2024-09-20T18:35:34.169 INFO:tasks.workunit.client.1.smithi172.stdout:4/73: creat d0/d7/df/d15/f1d x:0 0 0 2024-09-20T18:35:34.170 INFO:tasks.workunit.client.1.smithi172.stdout:3/76: mknod d0/db/c11 0 2024-09-20T18:35:34.170 INFO:tasks.workunit.client.1.smithi172.stdout:1/69: symlink d0/l15 0 2024-09-20T18:35:34.171 INFO:tasks.workunit.client.1.smithi172.stdout:5/152: symlink d4/df/l31 0 2024-09-20T18:35:34.171 INFO:tasks.workunit.client.1.smithi172.stdout:5/153: chown d4/d1f/d26 1 1 2024-09-20T18:35:34.172 INFO:tasks.workunit.client.1.smithi172.stdout:2/53: unlink d0/d4/d9/fa 0 2024-09-20T18:35:34.172 INFO:tasks.workunit.client.1.smithi172.stdout:2/54: chown d0/f7 54849312 1 2024-09-20T18:35:34.173 INFO:tasks.workunit.client.1.smithi172.stdout:6/83: symlink d0/l1d 0 2024-09-20T18:35:34.174 INFO:tasks.workunit.client.1.smithi172.stdout:6/84: write d0/fc [7559788,105283] 0 2024-09-20T18:35:34.174 INFO:tasks.workunit.client.1.smithi172.stdout:3/77: unlink d0/c6 0 2024-09-20T18:35:34.178 INFO:tasks.workunit.client.1.smithi172.stdout:7/104: rename d2/d1c/f2a to d2/f2b 0 2024-09-20T18:35:34.178 INFO:tasks.workunit.client.1.smithi172.stdout:2/55: truncate d0/f7 4887940 0 2024-09-20T18:35:34.180 INFO:tasks.workunit.client.1.smithi172.stdout:6/85: chown d0/cd 57485 1 2024-09-20T18:35:34.181 INFO:tasks.workunit.client.1.smithi172.stdout:3/78: mknod d0/db/c12 0 2024-09-20T18:35:34.181 INFO:tasks.workunit.client.1.smithi172.stdout:3/79: write d0/f8 [3193449,6550] 0 2024-09-20T18:35:34.182 INFO:tasks.workunit.client.1.smithi172.stdout:3/80: truncate d0/f8 4434880 0 2024-09-20T18:35:34.184 INFO:tasks.workunit.client.1.smithi172.stdout:8/87: sync 2024-09-20T18:35:34.186 INFO:tasks.workunit.client.1.smithi172.stdout:0/173: getdents d4/d1d 0 2024-09-20T18:35:34.187 INFO:tasks.workunit.client.1.smithi172.stdout:9/100: getdents d15 0 2024-09-20T18:35:34.188 INFO:tasks.workunit.client.1.smithi172.stdout:0/174: chown d4/d5/c27 9 1 2024-09-20T18:35:34.188 INFO:tasks.workunit.client.1.smithi172.stdout:1/70: creat d0/d8/f16 x:0 0 0 2024-09-20T18:35:34.192 INFO:tasks.workunit.client.1.smithi172.stdout:7/105: dwrite d2/f2b [0,4194304] 0 2024-09-20T18:35:34.192 INFO:tasks.workunit.client.1.smithi172.stdout:8/88: dread f1 [0,4194304] 0 2024-09-20T18:35:34.194 INFO:tasks.workunit.client.1.smithi172.stdout:6/86: dread d0/f13 [0,4194304] 0 2024-09-20T18:35:34.197 INFO:tasks.workunit.client.1.smithi172.stdout:0/175: mkdir d4/d5/d2e/d38/d41 0 2024-09-20T18:35:34.199 INFO:tasks.workunit.client.1.smithi172.stdout:0/176: dread - d4/d1a/f1e zero size 2024-09-20T18:35:34.202 INFO:tasks.workunit.client.1.smithi172.stdout:0/177: chown d4/d1a/d28/d34/f3a 333 1 2024-09-20T18:35:34.203 INFO:tasks.workunit.client.1.smithi172.stdout:8/89: dwrite dd/d1b/f23 [0,4194304] 0 2024-09-20T18:35:34.204 INFO:tasks.workunit.client.1.smithi172.stdout:0/178: fsync d4/d1a/d28/d34/f3a 0 2024-09-20T18:35:34.206 INFO:tasks.workunit.client.1.smithi172.stdout:4/74: rename d0/d7/df/c1c to d0/d7/c1e 0 2024-09-20T18:35:34.211 INFO:tasks.workunit.client.1.smithi172.stdout:1/71: creat d0/d8/f17 x:0 0 0 2024-09-20T18:35:34.213 INFO:tasks.workunit.client.1.smithi172.stdout:7/106: rename d2/d1c/f27 to d2/d3/d10/f2c 0 2024-09-20T18:35:34.214 INFO:tasks.workunit.client.1.smithi172.stdout:1/72: readlink d0/d8/ld 0 2024-09-20T18:35:34.214 INFO:tasks.workunit.client.1.smithi172.stdout:6/87: dwrite d0/fc [0,4194304] 0 2024-09-20T18:35:34.215 INFO:tasks.workunit.client.1.smithi172.stdout:4/75: mknod d0/d7/df/d15/c1f 0 2024-09-20T18:35:34.218 INFO:tasks.workunit.client.1.smithi172.stdout:0/179: rename d4/d5/d2e/d38/d41 to d4/d1a/d28/d42 0 2024-09-20T18:35:34.221 INFO:tasks.workunit.client.1.smithi172.stdout:8/90: dwrite fa [0,4194304] 0 2024-09-20T18:35:34.223 INFO:tasks.workunit.client.1.smithi172.stdout:1/73: read d0/d8/db/fe [483734,37530] 0 2024-09-20T18:35:34.224 INFO:tasks.workunit.client.1.smithi172.stdout:6/88: dread d0/fe [4194304,4194304] 0 2024-09-20T18:35:34.232 INFO:tasks.workunit.client.1.smithi172.stdout:6/89: dwrite d0/f1b [0,4194304] 0 2024-09-20T18:35:34.235 INFO:tasks.workunit.client.1.smithi172.stdout:1/74: creat d0/d8/db/f18 x:0 0 0 2024-09-20T18:35:34.236 INFO:tasks.workunit.client.1.smithi172.stdout:1/75: chown d0/d8/fc 65762971 1 2024-09-20T18:35:34.237 INFO:tasks.workunit.client.1.smithi172.stdout:1/76: write d0/f4 [871631,126178] 0 2024-09-20T18:35:34.237 INFO:tasks.workunit.client.1.smithi172.stdout:1/77: chown d0/f10 12320759 1 2024-09-20T18:35:34.238 INFO:tasks.workunit.client.1.smithi172.stdout:1/78: chown d0/d8/f14 403652657 1 2024-09-20T18:35:34.239 INFO:tasks.workunit.client.1.smithi172.stdout:0/180: readlink d4/d20/l25 0 2024-09-20T18:35:34.246 INFO:tasks.workunit.client.1.smithi172.stdout:1/79: mknod d0/c19 0 2024-09-20T18:35:34.247 INFO:tasks.workunit.client.1.smithi172.stdout:0/181: creat d4/d1a/d28/d34/f43 x:0 0 0 2024-09-20T18:35:34.250 INFO:tasks.workunit.client.1.smithi172.stdout:4/76: rename d0/d7/df/d15/c1f to d0/d7/c20 0 2024-09-20T18:35:34.251 INFO:tasks.workunit.client.1.smithi172.stdout:8/91: creat dd/f27 x:0 0 0 2024-09-20T18:35:34.252 INFO:tasks.workunit.client.1.smithi172.stdout:4/77: write d0/d7/df/d15/f1d [490997,561] 0 2024-09-20T18:35:34.253 INFO:tasks.workunit.client.1.smithi172.stdout:0/182: chown c2 1405771 1 2024-09-20T18:35:34.253 INFO:tasks.workunit.client.1.smithi172.stdout:3/81: sync 2024-09-20T18:35:34.255 INFO:tasks.workunit.client.1.smithi172.stdout:6/90: rename d0/f1b to d0/d18/f1e 0 2024-09-20T18:35:34.257 INFO:tasks.workunit.client.1.smithi172.stdout:4/78: mkdir d0/de/d21 0 2024-09-20T18:35:34.258 INFO:tasks.workunit.client.1.smithi172.stdout:4/79: chown d0/d7/c17 323 1 2024-09-20T18:35:34.261 INFO:tasks.workunit.client.1.smithi172.stdout:0/183: unlink d4/d1a/d28/d34/f40 0 2024-09-20T18:35:34.262 INFO:tasks.workunit.client.1.smithi172.stdout:3/82: mkdir d0/d13 0 2024-09-20T18:35:34.263 INFO:tasks.workunit.client.1.smithi172.stdout:3/83: write d0/f8 [5456065,26274] 0 2024-09-20T18:35:34.264 INFO:tasks.workunit.client.1.smithi172.stdout:6/91: readlink d0/l12 0 2024-09-20T18:35:34.267 INFO:tasks.workunit.client.1.smithi172.stdout:4/80: dwrite d0/fa [0,4194304] 0 2024-09-20T18:35:34.272 INFO:tasks.workunit.client.1.smithi172.stdout:3/84: unlink d0/db/ld 0 2024-09-20T18:35:34.273 INFO:tasks.workunit.client.1.smithi172.stdout:3/85: read d0/f8 [3787279,51125] 0 2024-09-20T18:35:34.275 INFO:tasks.workunit.client.1.smithi172.stdout:0/184: mkdir d4/d44 0 2024-09-20T18:35:34.277 INFO:tasks.workunit.client.1.smithi172.stdout:4/81: creat d0/de/dc/f22 x:0 0 0 2024-09-20T18:35:34.282 INFO:tasks.workunit.client.1.smithi172.stdout:0/185: dwrite d4/d1a/d28/d34/f43 [0,4194304] 0 2024-09-20T18:35:34.287 INFO:tasks.workunit.client.1.smithi172.stdout:0/186: rmdir d4 39 2024-09-20T18:35:34.291 INFO:tasks.workunit.client.1.smithi172.stdout:0/187: mkdir d4/d1a/d28/d42/d45 0 2024-09-20T18:35:34.291 INFO:tasks.workunit.client.1.smithi172.stdout:0/188: write d4/d1a/d28/d34/f43 [2258663,125866] 0 2024-09-20T18:35:34.296 INFO:tasks.workunit.client.1.smithi172.stdout:0/189: getdents d4/d1a/d28/d42/d45 0 2024-09-20T18:35:34.299 INFO:tasks.workunit.client.1.smithi172.stdout:0/190: mkdir d4/d46 0 2024-09-20T18:35:34.302 INFO:tasks.workunit.client.1.smithi172.stdout:0/191: mknod d4/d1a/d28/d34/c47 0 2024-09-20T18:35:34.303 INFO:tasks.workunit.client.1.smithi172.stdout:0/192: mknod d4/d1d/c48 0 2024-09-20T18:35:34.305 INFO:tasks.workunit.client.1.smithi172.stdout:9/101: read fd [198794,8893] 0 2024-09-20T18:35:34.306 INFO:tasks.workunit.client.1.smithi172.stdout:0/193: creat d4/d5/d2e/f49 x:0 0 0 2024-09-20T18:35:34.311 INFO:tasks.workunit.client.1.smithi172.stdout:9/102: getdents d15 0 2024-09-20T18:35:34.313 INFO:tasks.workunit.client.1.smithi172.stdout:0/194: dwrite d4/f18 [4194304,4194304] 0 2024-09-20T18:35:34.315 INFO:tasks.workunit.client.1.smithi172.stdout:9/103: dread f6 [0,4194304] 0 2024-09-20T18:35:34.317 INFO:tasks.workunit.client.1.smithi172.stdout:0/195: symlink d4/d1a/d28/d42/d45/l4a 0 2024-09-20T18:35:34.323 INFO:tasks.workunit.client.1.smithi172.stdout:0/196: dwrite d4/d5/f2f [0,4194304] 0 2024-09-20T18:35:34.333 INFO:tasks.workunit.client.1.smithi172.stdout:9/104: link lb d15/l17 0 2024-09-20T18:35:34.340 INFO:tasks.workunit.client.1.smithi172.stdout:9/105: dwrite f14 [0,4194304] 0 2024-09-20T18:35:34.347 INFO:tasks.workunit.client.1.smithi172.stdout:9/106: dwrite f6 [0,4194304] 0 2024-09-20T18:35:34.362 INFO:tasks.workunit.client.1.smithi172.stdout:9/107: fdatasync f14 0 2024-09-20T18:35:34.363 INFO:tasks.workunit.client.1.smithi172.stdout:9/108: creat d15/f18 x:0 0 0 2024-09-20T18:35:34.401 INFO:tasks.workunit.client.1.smithi172.stdout:2/56: truncate d0/f8 158926 0 2024-09-20T18:35:34.404 INFO:tasks.workunit.client.1.smithi172.stdout:5/154: truncate d4/d1d/f21 47281 0 2024-09-20T18:35:34.405 INFO:tasks.workunit.client.1.smithi172.stdout:5/155: write d4/d1d/d2c/f30 [387219,48378] 0 2024-09-20T18:35:34.406 INFO:tasks.workunit.client.1.smithi172.stdout:2/57: getdents d0/d4/d9 0 2024-09-20T18:35:34.409 INFO:tasks.workunit.client.1.smithi172.stdout:5/156: dread f3 [0,4194304] 0 2024-09-20T18:35:34.410 INFO:tasks.workunit.client.1.smithi172.stdout:5/157: fsync d4/d1f/d26/f2a 0 2024-09-20T18:35:34.411 INFO:tasks.workunit.client.1.smithi172.stdout:5/158: dread - d4/d1d/f24 zero size 2024-09-20T18:35:34.411 INFO:tasks.workunit.client.1.smithi172.stdout:2/58: chown d0/f8 18743 1 2024-09-20T18:35:34.412 INFO:tasks.workunit.client.1.smithi172.stdout:2/59: write d0/d4/d9/fc [2004754,12321] 0 2024-09-20T18:35:34.413 INFO:tasks.workunit.client.1.smithi172.stdout:5/159: creat d4/d1f/d26/f32 x:0 0 0 2024-09-20T18:35:34.416 INFO:tasks.workunit.client.1.smithi172.stdout:5/160: dread f3 [0,4194304] 0 2024-09-20T18:35:34.416 INFO:tasks.workunit.client.1.smithi172.stdout:2/60: mknod d0/d4/d9/cf 0 2024-09-20T18:35:34.420 INFO:tasks.workunit.client.1.smithi172.stdout:2/61: mkdir d0/d4/d9/d10 0 2024-09-20T18:35:34.420 INFO:tasks.workunit.client.1.smithi172.stdout:2/62: chown d0/d4/lb 251197107 1 2024-09-20T18:35:34.429 INFO:tasks.workunit.client.1.smithi172.stdout:5/161: getdents d4/d1d 0 2024-09-20T18:35:34.429 INFO:tasks.workunit.client.1.smithi172.stdout:5/162: dread - d4/df/f22 zero size 2024-09-20T18:35:34.430 INFO:tasks.workunit.client.1.smithi172.stdout:5/163: write d4/d1d/f2b [20278,27109] 0 2024-09-20T18:35:34.430 INFO:tasks.workunit.client.1.smithi172.stdout:7/107: write d2/d3/dd/f19 [1282694,78972] 0 2024-09-20T18:35:34.431 INFO:tasks.workunit.client.1.smithi172.stdout:7/108: dread - d2/f25 zero size 2024-09-20T18:35:34.432 INFO:tasks.workunit.client.1.smithi172.stdout:5/164: creat d4/d1d/f33 x:0 0 0 2024-09-20T18:35:34.434 INFO:tasks.workunit.client.1.smithi172.stdout:7/109: creat d2/d3/d10/f2d x:0 0 0 2024-09-20T18:35:34.435 INFO:tasks.workunit.client.1.smithi172.stdout:6/92: truncate d0/fe 3042150 0 2024-09-20T18:35:34.435 INFO:tasks.workunit.client.1.smithi172.stdout:6/93: chown d0/cd 108 1 2024-09-20T18:35:34.436 INFO:tasks.workunit.client.1.smithi172.stdout:7/110: truncate d2/d3/d10/f2d 451960 0 2024-09-20T18:35:34.436 INFO:tasks.workunit.client.1.smithi172.stdout:6/94: readlink d0/l1d 0 2024-09-20T18:35:34.438 INFO:tasks.workunit.client.1.smithi172.stdout:6/95: read d0/d3/f7 [7507,35969] 0 2024-09-20T18:35:34.439 INFO:tasks.workunit.client.1.smithi172.stdout:1/80: getdents d0 0 2024-09-20T18:35:34.440 INFO:tasks.workunit.client.1.smithi172.stdout:1/81: dread - d0/d8/db/f18 zero size 2024-09-20T18:35:34.440 INFO:tasks.workunit.client.1.smithi172.stdout:6/96: unlink d0/d3/c19 0 2024-09-20T18:35:34.441 INFO:tasks.workunit.client.1.smithi172.stdout:7/111: dwrite f0 [0,4194304] 0 2024-09-20T18:35:34.442 INFO:tasks.workunit.client.1.smithi172.stdout:6/97: write d0/f13 [8846163,82496] 0 2024-09-20T18:35:34.442 INFO:tasks.workunit.client.1.smithi172.stdout:1/82: truncate d0/d8/f17 150614 0 2024-09-20T18:35:34.445 INFO:tasks.workunit.client.1.smithi172.stdout:7/112: creat d2/d3/dd/f2e x:0 0 0 2024-09-20T18:35:34.446 INFO:tasks.workunit.client.1.smithi172.stdout:1/83: fsync d0/f1 0 2024-09-20T18:35:34.447 INFO:tasks.workunit.client.1.smithi172.stdout:1/84: chown d0/d8/d12 1 1 2024-09-20T18:35:34.447 INFO:tasks.workunit.client.1.smithi172.stdout:1/85: stat d0/d8/f16 0 2024-09-20T18:35:34.452 INFO:tasks.workunit.client.1.smithi172.stdout:7/113: creat d2/d3/dd/f2f x:0 0 0 2024-09-20T18:35:34.453 INFO:tasks.workunit.client.1.smithi172.stdout:7/114: stat d2/d3/dd/f19 0 2024-09-20T18:35:34.455 INFO:tasks.workunit.client.1.smithi172.stdout:1/86: unlink d0/c19 0 2024-09-20T18:35:34.457 INFO:tasks.workunit.client.1.smithi172.stdout:6/98: creat d0/d18/d1c/f1f x:0 0 0 2024-09-20T18:35:34.457 INFO:tasks.workunit.client.1.smithi172.stdout:4/82: link d0/d7/c20 d0/d7/df/d15/c23 0 2024-09-20T18:35:34.458 INFO:tasks.workunit.client.1.smithi172.stdout:4/83: read d0/d7/df/f11 [3550557,30316] 0 2024-09-20T18:35:34.459 INFO:tasks.workunit.client.1.smithi172.stdout:8/92: write f0 [3066496,358] 0 2024-09-20T18:35:34.460 INFO:tasks.workunit.client.1.smithi172.stdout:8/93: stat dd/l17 0 2024-09-20T18:35:34.461 INFO:tasks.workunit.client.1.smithi172.stdout:1/87: creat d0/d8/d12/f1a x:0 0 0 2024-09-20T18:35:34.464 INFO:tasks.workunit.client.1.smithi172.stdout:4/84: dwrite d0/fa [4194304,4194304] 0 2024-09-20T18:35:34.468 INFO:tasks.workunit.client.1.smithi172.stdout:7/115: rename d2/d3/f1f to d2/d23/f30 0 2024-09-20T18:35:34.469 INFO:tasks.workunit.client.1.smithi172.stdout:7/116: stat d2/d3/fb 0 2024-09-20T18:35:34.473 INFO:tasks.workunit.client.1.smithi172.stdout:1/88: creat d0/d8/db/f1b x:0 0 0 2024-09-20T18:35:34.473 INFO:tasks.workunit.client.1.smithi172.stdout:3/86: write d0/f7 [403389,25972] 0 2024-09-20T18:35:34.474 INFO:tasks.workunit.client.1.smithi172.stdout:1/89: truncate d0/d8/f14 186828 0 2024-09-20T18:35:34.475 INFO:tasks.workunit.client.1.smithi172.stdout:4/85: stat d0/c4 0 2024-09-20T18:35:34.476 INFO:tasks.workunit.client.1.smithi172.stdout:8/94: mknod dd/c28 0 2024-09-20T18:35:34.478 INFO:tasks.workunit.client.1.smithi172.stdout:1/90: symlink d0/l1c 0 2024-09-20T18:35:34.479 INFO:tasks.workunit.client.1.smithi172.stdout:1/91: chown d0/f4 16355811 1 2024-09-20T18:35:34.482 INFO:tasks.workunit.client.1.smithi172.stdout:8/95: symlink dd/d1b/l29 0 2024-09-20T18:35:34.485 INFO:tasks.workunit.client.1.smithi172.stdout:3/87: symlink d0/d13/l14 0 2024-09-20T18:35:34.485 INFO:tasks.workunit.client.1.smithi172.stdout:3/88: chown d0 9 1 2024-09-20T18:35:34.487 INFO:tasks.workunit.client.1.smithi172.stdout:4/86: mkdir d0/de/d21/d24 0 2024-09-20T18:35:34.489 INFO:tasks.workunit.client.1.smithi172.stdout:1/92: read d0/f10 [143489,37937] 0 2024-09-20T18:35:34.489 INFO:tasks.workunit.client.1.smithi172.stdout:1/93: dread - d0/d8/db/f18 zero size 2024-09-20T18:35:34.490 INFO:tasks.workunit.client.1.smithi172.stdout:8/96: mknod dd/d1b/c2a 0 2024-09-20T18:35:34.491 INFO:tasks.workunit.client.1.smithi172.stdout:8/97: chown dd/c28 465209 1 2024-09-20T18:35:34.492 INFO:tasks.workunit.client.1.smithi172.stdout:3/89: mknod d0/c15 0 2024-09-20T18:35:34.494 INFO:tasks.workunit.client.1.smithi172.stdout:3/90: fsync d0/f10 0 2024-09-20T18:35:34.497 INFO:tasks.workunit.client.1.smithi172.stdout:8/98: dwrite fc [0,4194304] 0 2024-09-20T18:35:34.502 INFO:tasks.workunit.client.1.smithi172.stdout:0/197: write d4/d5/fb [950553,77907] 0 2024-09-20T18:35:34.517 INFO:tasks.workunit.client.1.smithi172.stdout:9/109: dwrite fd [0,4194304] 0 2024-09-20T18:35:34.520 INFO:tasks.workunit.client.1.smithi172.stdout:9/110: dread f14 [0,4194304] 0 2024-09-20T18:35:34.520 INFO:tasks.workunit.client.1.smithi172.stdout:8/99: mkdir dd/d2b 0 2024-09-20T18:35:34.521 INFO:tasks.workunit.client.1.smithi172.stdout:9/111: write d15/f18 [526646,43685] 0 2024-09-20T18:35:34.522 INFO:tasks.workunit.client.1.smithi172.stdout:4/87: link d0/d7/f12 d0/d7/f25 0 2024-09-20T18:35:34.526 INFO:tasks.workunit.client.1.smithi172.stdout:4/88: dread d0/d7/df/d15/f1d [0,4194304] 0 2024-09-20T18:35:34.527 INFO:tasks.workunit.client.1.smithi172.stdout:8/100: dwrite dd/f16 [0,4194304] 0 2024-09-20T18:35:34.530 INFO:tasks.workunit.client.1.smithi172.stdout:3/91: rmdir d0/df 0 2024-09-20T18:35:34.533 INFO:tasks.workunit.client.1.smithi172.stdout:3/92: dread d0/f7 [0,4194304] 0 2024-09-20T18:35:34.534 INFO:tasks.workunit.client.1.smithi172.stdout:9/112: mknod d15/c19 0 2024-09-20T18:35:34.538 INFO:tasks.workunit.client.1.smithi172.stdout:3/93: dread d0/f9 [0,4194304] 0 2024-09-20T18:35:34.539 INFO:tasks.workunit.client.1.smithi172.stdout:2/63: dwrite d0/f7 [0,4194304] 0 2024-09-20T18:35:34.541 INFO:tasks.workunit.client.1.smithi172.stdout:9/113: dread f14 [0,4194304] 0 2024-09-20T18:35:34.541 INFO:tasks.workunit.client.1.smithi172.stdout:4/89: symlink d0/d7/df/d15/l26 0 2024-09-20T18:35:34.544 INFO:tasks.workunit.client.1.smithi172.stdout:8/101: creat dd/d1b/f2c x:0 0 0 2024-09-20T18:35:34.544 INFO:tasks.workunit.client.1.smithi172.stdout:8/102: fdatasync dd/f19 0 2024-09-20T18:35:34.549 INFO:tasks.workunit.client.1.smithi172.stdout:3/94: creat d0/f16 x:0 0 0 2024-09-20T18:35:34.550 INFO:tasks.workunit.client.1.smithi172.stdout:3/95: chown d0/d13 471149549 1 2024-09-20T18:35:34.551 INFO:tasks.workunit.client.1.smithi172.stdout:2/64: unlink d0/d4/c6 0 2024-09-20T18:35:34.553 INFO:tasks.workunit.client.1.smithi172.stdout:2/65: write d0/d4/d9/fc [150616,24809] 0 2024-09-20T18:35:34.553 INFO:tasks.workunit.client.1.smithi172.stdout:9/114: mkdir d15/d1a 0 2024-09-20T18:35:34.555 INFO:tasks.workunit.client.1.smithi172.stdout:4/90: fsync d0/d7/df/f11 0 2024-09-20T18:35:34.558 INFO:tasks.workunit.client.1.smithi172.stdout:8/103: truncate fb 445783 0 2024-09-20T18:35:34.563 INFO:tasks.workunit.client.1.smithi172.stdout:5/165: sync 2024-09-20T18:35:34.564 INFO:tasks.workunit.client.1.smithi172.stdout:6/99: dread d0/fe [0,4194304] 0 2024-09-20T18:35:34.565 INFO:tasks.workunit.client.1.smithi172.stdout:3/96: dread d0/f8 [4194304,4194304] 0 2024-09-20T18:35:34.566 INFO:tasks.workunit.client.1.smithi172.stdout:6/100: write d0/d18/d1c/f1f [821362,100871] 0 2024-09-20T18:35:34.572 INFO:tasks.workunit.client.1.smithi172.stdout:5/166: symlink d4/d1d/l34 0 2024-09-20T18:35:34.572 INFO:tasks.workunit.client.1.smithi172.stdout:5/167: chown d4/f17 292351 1 2024-09-20T18:35:34.573 INFO:tasks.workunit.client.1.smithi172.stdout:5/168: chown d4/f17 55409 1 2024-09-20T18:35:34.573 INFO:tasks.workunit.client.1.smithi172.stdout:5/169: chown f3 2061927 1 2024-09-20T18:35:34.576 INFO:tasks.workunit.client.1.smithi172.stdout:3/97: symlink d0/l17 0 2024-09-20T18:35:34.577 INFO:tasks.workunit.client.1.smithi172.stdout:3/98: chown d0/f16 825 1 2024-09-20T18:35:34.579 INFO:tasks.workunit.client.1.smithi172.stdout:9/115: rename fa to d15/f1b 0 2024-09-20T18:35:34.587 INFO:tasks.workunit.client.1.smithi172.stdout:4/91: dread d0/d7/f12 [0,4194304] 0 2024-09-20T18:35:34.588 INFO:tasks.workunit.client.1.smithi172.stdout:4/92: chown d0/d7/df/f11 366472879 1 2024-09-20T18:35:34.589 INFO:tasks.workunit.client.1.smithi172.stdout:8/104: unlink c7 0 2024-09-20T18:35:34.593 INFO:tasks.workunit.client.1.smithi172.stdout:9/116: chown f12 700 1 2024-09-20T18:35:34.594 INFO:tasks.workunit.client.1.smithi172.stdout:9/117: chown d15/f1b 92911 1 2024-09-20T18:35:34.595 INFO:tasks.workunit.client.1.smithi172.stdout:7/117: truncate d2/f2b 3461093 0 2024-09-20T18:35:34.599 INFO:tasks.workunit.client.1.smithi172.stdout:4/93: symlink d0/d7/df/d18/d1a/l27 0 2024-09-20T18:35:34.599 INFO:tasks.workunit.client.1.smithi172.stdout:4/94: chown d0/d7/df/d18/d1a/c1b 372 1 2024-09-20T18:35:34.603 INFO:tasks.workunit.client.1.smithi172.stdout:7/118: mknod d2/d1c/c31 0 2024-09-20T18:35:34.604 INFO:tasks.workunit.client.1.smithi172.stdout:2/66: getdents d0 0 2024-09-20T18:35:34.606 INFO:tasks.workunit.client.1.smithi172.stdout:8/105: symlink dd/d2b/l2d 0 2024-09-20T18:35:34.606 INFO:tasks.workunit.client.1.smithi172.stdout:7/119: dread d2/d3/d10/f20 [0,4194304] 0 2024-09-20T18:35:34.607 INFO:tasks.workunit.client.1.smithi172.stdout:4/95: dread d0/d7/df/d15/f1d [0,4194304] 0 2024-09-20T18:35:34.608 INFO:tasks.workunit.client.1.smithi172.stdout:9/118: mkdir d15/d1a/d1c 0 2024-09-20T18:35:34.609 INFO:tasks.workunit.client.1.smithi172.stdout:4/96: readlink d0/d7/df/d18/d1a/l27 0 2024-09-20T18:35:34.609 INFO:tasks.workunit.client.1.smithi172.stdout:2/67: mknod d0/d4/d9/c11 0 2024-09-20T18:35:34.610 INFO:tasks.workunit.client.1.smithi172.stdout:8/106: chown c6 12953227 1 2024-09-20T18:35:34.612 INFO:tasks.workunit.client.1.smithi172.stdout:1/94: truncate d0/d8/f17 19873 0 2024-09-20T18:35:34.612 INFO:tasks.workunit.client.1.smithi172.stdout:1/95: readlink d0/lf 0 2024-09-20T18:35:34.613 INFO:tasks.workunit.client.1.smithi172.stdout:9/119: creat d15/f1d x:0 0 0 2024-09-20T18:35:34.613 INFO:tasks.workunit.client.1.smithi172.stdout:1/96: write d0/d8/d12/f1a [479667,67496] 0 2024-09-20T18:35:34.618 INFO:tasks.workunit.client.1.smithi172.stdout:2/68: mkdir d0/d4/d9/d12 0 2024-09-20T18:35:34.621 INFO:tasks.workunit.client.1.smithi172.stdout:2/69: dread d0/f3 [0,4194304] 0 2024-09-20T18:35:34.622 INFO:tasks.workunit.client.1.smithi172.stdout:8/107: creat dd/d2b/f2e x:0 0 0 2024-09-20T18:35:34.627 INFO:tasks.workunit.client.1.smithi172.stdout:2/70: rmdir d0/d4 39 2024-09-20T18:35:34.629 INFO:tasks.workunit.client.1.smithi172.stdout:0/198: truncate d4/f18 6925489 0 2024-09-20T18:35:34.630 INFO:tasks.workunit.client.1.smithi172.stdout:8/108: stat dd/lf 0 2024-09-20T18:35:34.631 INFO:tasks.workunit.client.1.smithi172.stdout:0/199: dread - d4/d1a/d28/d34/f3a zero size 2024-09-20T18:35:34.632 INFO:tasks.workunit.client.1.smithi172.stdout:1/97: mknod d0/d8/c1d 0 2024-09-20T18:35:34.633 INFO:tasks.workunit.client.1.smithi172.stdout:0/200: readlink d4/d1a/d28/d42/d45/l4a 0 2024-09-20T18:35:34.633 INFO:tasks.workunit.client.1.smithi172.stdout:1/98: read - d0/d8/db/f1b zero size 2024-09-20T18:35:34.633 INFO:tasks.workunit.client.1.smithi172.stdout:2/71: dwrite d0/f7 [0,4194304] 0 2024-09-20T18:35:34.635 INFO:tasks.workunit.client.1.smithi172.stdout:1/99: write d0/d8/f16 [681657,7088] 0 2024-09-20T18:35:34.637 INFO:tasks.workunit.client.1.smithi172.stdout:8/109: unlink dd/f16 0 2024-09-20T18:35:34.646 INFO:tasks.workunit.client.1.smithi172.stdout:2/72: dwrite d0/d4/fd [0,4194304] 0 2024-09-20T18:35:34.654 INFO:tasks.workunit.client.1.smithi172.stdout:1/100: symlink d0/d8/l1e 0 2024-09-20T18:35:34.657 INFO:tasks.workunit.client.1.smithi172.stdout:6/101: write d0/fe [1438320,12900] 0 2024-09-20T18:35:34.660 INFO:tasks.workunit.client.1.smithi172.stdout:1/101: creat d0/d8/d12/f1f x:0 0 0 2024-09-20T18:35:34.666 INFO:tasks.workunit.client.1.smithi172.stdout:1/102: getdents d0/d8/db 0 2024-09-20T18:35:34.685 INFO:tasks.workunit.client.1.smithi172.stdout:3/99: dwrite d0/f8 [0,4194304] 0 2024-09-20T18:35:34.686 INFO:tasks.workunit.client.1.smithi172.stdout:3/100: write d0/f10 [273700,62050] 0 2024-09-20T18:35:34.687 INFO:tasks.workunit.client.1.smithi172.stdout:3/101: dread - d0/f16 zero size 2024-09-20T18:35:34.706 INFO:tasks.workunit.client.1.smithi172.stdout:4/97: write d0/d7/f12 [367270,72138] 0 2024-09-20T18:35:34.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:34 smithi172 ceph-mon[35456]: Reconfiguring daemon prometheus.smithi017 on smithi017 2024-09-20T18:35:34.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:34 smithi172 ceph-mon[35456]: pgmap v21: 65 pgs: 65 active+clean; 192 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 298 op/s 2024-09-20T18:35:34.710 INFO:tasks.workunit.client.1.smithi172.stdout:9/120: write fe [4009421,69234] 0 2024-09-20T18:35:34.713 INFO:tasks.workunit.client.1.smithi172.stdout:4/98: dwrite d0/d7/df/f11 [0,4194304] 0 2024-09-20T18:35:34.716 INFO:tasks.workunit.client.1.smithi172.stdout:9/121: write d15/f1b [1508877,66343] 0 2024-09-20T18:35:34.718 INFO:tasks.workunit.client.1.smithi172.stdout:4/99: symlink d0/d7/df/l28 0 2024-09-20T18:35:34.719 INFO:tasks.workunit.client.1.smithi172.stdout:9/122: mkdir d15/d1a/d1e 0 2024-09-20T18:35:34.723 INFO:tasks.workunit.client.1.smithi172.stdout:4/100: symlink d0/de/dc/l29 0 2024-09-20T18:35:34.724 INFO:tasks.workunit.client.1.smithi172.stdout:4/101: write d0/d7/f12 [37751,89780] 0 2024-09-20T18:35:34.727 INFO:tasks.workunit.client.1.smithi172.stdout:9/123: mkdir d15/d1f 0 2024-09-20T18:35:34.728 INFO:tasks.workunit.client.1.smithi172.stdout:0/201: truncate d4/d5/fc 3350667 0 2024-09-20T18:35:34.730 INFO:tasks.workunit.client.1.smithi172.stdout:4/102: rmdir d0/d7/df 39 2024-09-20T18:35:34.731 INFO:tasks.workunit.client.1.smithi172.stdout:9/124: mkdir d15/d20 0 2024-09-20T18:35:34.732 INFO:tasks.workunit.client.1.smithi172.stdout:0/202: dread d4/d1a/d28/d34/f43 [0,4194304] 0 2024-09-20T18:35:34.732 INFO:tasks.workunit.client.1.smithi172.stdout:4/103: truncate d0/de/dc/f22 103226 0 2024-09-20T18:35:34.732 INFO:tasks.workunit.client.1.smithi172.stdout:8/110: truncate f9 420978 0 2024-09-20T18:35:34.735 INFO:tasks.workunit.client.1.smithi172.stdout:9/125: dread f6 [0,4194304] 0 2024-09-20T18:35:34.738 INFO:tasks.workunit.client.1.smithi172.stdout:0/203: unlink d4/d1d/d15/f26 0 2024-09-20T18:35:34.741 INFO:tasks.workunit.client.1.smithi172.stdout:3/102: write d0/f9 [1407806,56569] 0 2024-09-20T18:35:34.742 INFO:tasks.workunit.client.1.smithi172.stdout:7/120: dwrite d2/f2b [0,4194304] 0 2024-09-20T18:35:34.747 INFO:tasks.workunit.client.1.smithi172.stdout:0/204: creat d4/d5/d2e/d38/f4b x:0 0 0 2024-09-20T18:35:34.747 INFO:tasks.workunit.client.1.smithi172.stdout:1/103: write d0/d8/f17 [328435,130238] 0 2024-09-20T18:35:34.750 INFO:tasks.workunit.client.1.smithi172.stdout:1/104: write d0/f4 [484468,24668] 0 2024-09-20T18:35:34.751 INFO:tasks.workunit.client.1.smithi172.stdout:7/121: dwrite d2/d3/d10/f18 [0,4194304] 0 2024-09-20T18:35:34.754 INFO:tasks.workunit.client.1.smithi172.stdout:9/126: creat d15/d20/f21 x:0 0 0 2024-09-20T18:35:34.755 INFO:tasks.workunit.client.1.smithi172.stdout:3/103: unlink d0/db/c11 0 2024-09-20T18:35:34.756 INFO:tasks.workunit.client.1.smithi172.stdout:3/104: write d0/f7 [1720024,52446] 0 2024-09-20T18:35:34.761 INFO:tasks.workunit.client.1.smithi172.stdout:5/170: write d4/d1d/f21 [119480,71624] 0 2024-09-20T18:35:34.761 INFO:tasks.workunit.client.1.smithi172.stdout:5/171: fsync d4/df/f22 0 2024-09-20T18:35:34.768 INFO:tasks.workunit.client.1.smithi172.stdout:0/205: creat d4/d1a/d28/d42/f4c x:0 0 0 2024-09-20T18:35:34.770 INFO:tasks.workunit.client.1.smithi172.stdout:0/206: dread - d4/d1a/d28/d34/f3a zero size 2024-09-20T18:35:34.770 INFO:tasks.workunit.client.1.smithi172.stdout:5/172: dwrite d4/d1f/d26/f32 [0,4194304] 0 2024-09-20T18:35:34.770 INFO:tasks.workunit.client.1.smithi172.stdout:1/105: symlink d0/l20 0 2024-09-20T18:35:34.773 INFO:tasks.workunit.client.1.smithi172.stdout:1/106: read d0/d8/db/fe [364797,126766] 0 2024-09-20T18:35:34.773 INFO:tasks.workunit.client.1.smithi172.stdout:5/173: truncate d4/df/f22 262723 0 2024-09-20T18:35:34.776 INFO:tasks.workunit.client.1.smithi172.stdout:5/174: write d4/d1f/f27 [771480,30345] 0 2024-09-20T18:35:34.778 INFO:tasks.workunit.client.1.smithi172.stdout:1/107: write d0/d8/d12/f1a [1467103,19791] 0 2024-09-20T18:35:34.778 INFO:tasks.workunit.client.1.smithi172.stdout:3/105: creat d0/f18 x:0 0 0 2024-09-20T18:35:34.780 INFO:tasks.workunit.client.1.smithi172.stdout:1/108: chown d0/d8/c11 291336 1 2024-09-20T18:35:34.782 INFO:tasks.workunit.client.1.smithi172.stdout:8/111: write f1 [1115847,33482] 0 2024-09-20T18:35:34.783 INFO:tasks.workunit.client.1.smithi172.stdout:9/127: symlink d15/d1f/l22 0 2024-09-20T18:35:34.786 INFO:tasks.workunit.client.1.smithi172.stdout:0/207: dwrite d4/d5/d2e/d38/f4b [0,4194304] 0 2024-09-20T18:35:34.787 INFO:tasks.workunit.client.1.smithi172.stdout:5/175: creat d4/d1d/d2c/f35 x:0 0 0 2024-09-20T18:35:34.788 INFO:tasks.workunit.client.1.smithi172.stdout:0/208: readlink d4/d1a/l30 0 2024-09-20T18:35:34.789 INFO:tasks.workunit.client.1.smithi172.stdout:7/122: link d2/cf d2/d23/c32 0 2024-09-20T18:35:34.790 INFO:tasks.workunit.client.1.smithi172.stdout:5/176: write d4/d1f/d26/f32 [1655600,124999] 0 2024-09-20T18:35:34.791 INFO:tasks.workunit.client.1.smithi172.stdout:4/104: truncate d0/d7/f12 381657 0 2024-09-20T18:35:34.795 INFO:tasks.workunit.client.1.smithi172.stdout:7/123: dread d2/d3/d10/f2d [0,4194304] 0 2024-09-20T18:35:34.795 INFO:tasks.workunit.client.1.smithi172.stdout:9/128: rmdir d15/d20 39 2024-09-20T18:35:34.796 INFO:tasks.workunit.client.1.smithi172.stdout:3/106: dwrite d0/f18 [0,4194304] 0 2024-09-20T18:35:34.798 INFO:tasks.workunit.client.1.smithi172.stdout:7/124: chown d2/d3/dd/f2e 509543732 1 2024-09-20T18:35:34.802 INFO:tasks.workunit.client.1.smithi172.stdout:0/209: mknod d4/d1a/d28/d42/d45/c4d 0 2024-09-20T18:35:34.802 INFO:tasks.workunit.client.1.smithi172.stdout:8/112: dread - dd/f19 zero size 2024-09-20T18:35:34.802 INFO:tasks.workunit.client.1.smithi172.stdout:9/129: truncate d15/f1d 712695 0 2024-09-20T18:35:34.805 INFO:tasks.workunit.client.1.smithi172.stdout:9/130: fdatasync d15/f1d 0 2024-09-20T18:35:34.807 INFO:tasks.workunit.client.1.smithi172.stdout:3/107: mknod d0/dc/c19 0 2024-09-20T18:35:34.810 INFO:tasks.workunit.client.1.smithi172.stdout:7/125: mknod d2/d23/c33 0 2024-09-20T18:35:34.812 INFO:tasks.workunit.client.1.smithi172.stdout:0/210: rename d4/d1d/f17 to d4/d5/d2e/d33/f4e 0 2024-09-20T18:35:34.816 INFO:tasks.workunit.client.1.smithi172.stdout:3/108: symlink d0/l1a 0 2024-09-20T18:35:34.819 INFO:tasks.workunit.client.1.smithi172.stdout:0/211: dwrite d4/f16 [0,4194304] 0 2024-09-20T18:35:34.823 INFO:tasks.workunit.client.1.smithi172.stdout:7/126: dread d2/d3/d10/f15 [0,4194304] 0 2024-09-20T18:35:34.826 INFO:tasks.workunit.client.1.smithi172.stdout:3/109: dwrite d0/f10 [0,4194304] 0 2024-09-20T18:35:34.834 INFO:tasks.workunit.client.1.smithi172.stdout:3/110: dwrite d0/f7 [0,4194304] 0 2024-09-20T18:35:34.847 INFO:tasks.workunit.client.1.smithi172.stdout:2/73: sync 2024-09-20T18:35:34.847 INFO:tasks.workunit.client.1.smithi172.stdout:6/102: sync 2024-09-20T18:35:34.894 INFO:tasks.workunit.client.1.smithi172.stdout:1/109: dwrite d0/d8/db/fe [0,4194304] 0 2024-09-20T18:35:34.896 INFO:tasks.workunit.client.1.smithi172.stdout:5/177: creat d4/f36 x:0 0 0 2024-09-20T18:35:34.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:34 smithi017 ceph-mon[28058]: Reconfiguring daemon prometheus.smithi017 on smithi017 2024-09-20T18:35:34.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:34 smithi017 ceph-mon[28058]: pgmap v21: 65 pgs: 65 active+clean; 192 MiB data, 816 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 298 op/s 2024-09-20T18:35:34.900 INFO:tasks.workunit.client.1.smithi172.stdout:4/105: dread d0/d7/f25 [0,4194304] 0 2024-09-20T18:35:34.901 INFO:tasks.workunit.client.1.smithi172.stdout:1/110: dread d0/d8/f16 [0,4194304] 0 2024-09-20T18:35:34.906 INFO:tasks.workunit.client.1.smithi172.stdout:7/127: symlink d2/d3/d10/l34 0 2024-09-20T18:35:34.908 INFO:tasks.workunit.client.1.smithi172.stdout:3/111: symlink d0/l1b 0 2024-09-20T18:35:34.913 INFO:tasks.workunit.client.1.smithi172.stdout:2/74: rename d0/f7 to d0/d4/d9/f13 0 2024-09-20T18:35:34.914 INFO:tasks.workunit.client.1.smithi172.stdout:3/112: dwrite d0/f7 [0,4194304] 0 2024-09-20T18:35:34.916 INFO:tasks.workunit.client.1.smithi172.stdout:6/103: dread d0/f5 [0,4194304] 0 2024-09-20T18:35:34.923 INFO:tasks.workunit.client.1.smithi172.stdout:3/113: dwrite d0/f8 [0,4194304] 0 2024-09-20T18:35:34.923 INFO:tasks.workunit.client.1.smithi172.stdout:2/75: dwrite d0/d4/fd [4194304,4194304] 0 2024-09-20T18:35:34.924 INFO:tasks.workunit.client.1.smithi172.stdout:0/212: link d4/d5/d2e/d38/f4b d4/d1a/d28/d34/f4f 0 2024-09-20T18:35:34.925 INFO:tasks.workunit.client.1.smithi172.stdout:9/131: truncate fe 8250933 0 2024-09-20T18:35:34.927 INFO:tasks.workunit.client.1.smithi172.stdout:7/128: creat d2/d3/f35 x:0 0 0 2024-09-20T18:35:34.928 INFO:tasks.workunit.client.1.smithi172.stdout:7/129: truncate d2/d3/f35 590938 0 2024-09-20T18:35:34.932 INFO:tasks.workunit.client.1.smithi172.stdout:8/113: read f9 [195015,53191] 0 2024-09-20T18:35:34.939 INFO:tasks.workunit.client.1.smithi172.stdout:6/104: unlink d0/cd 0 2024-09-20T18:35:34.944 INFO:tasks.workunit.client.1.smithi172.stdout:1/111: mknod d0/d8/c21 0 2024-09-20T18:35:34.946 INFO:tasks.workunit.client.1.smithi172.stdout:2/76: rename d0 to d0/d14 22 2024-09-20T18:35:34.946 INFO:tasks.workunit.client.1.smithi172.stdout:2/77: chown d0/l1 0 1 2024-09-20T18:35:34.947 INFO:tasks.workunit.client.1.smithi172.stdout:2/78: chown d0/d4/d9/d12 112 1 2024-09-20T18:35:34.949 INFO:tasks.workunit.client.1.smithi172.stdout:9/132: symlink d15/d1a/l23 0 2024-09-20T18:35:34.953 INFO:tasks.workunit.client.1.smithi172.stdout:2/79: dwrite d0/d4/d9/fc [0,4194304] 0 2024-09-20T18:35:34.955 INFO:tasks.workunit.client.1.smithi172.stdout:2/80: chown d0/d4/d9/c11 6107 1 2024-09-20T18:35:34.956 INFO:tasks.workunit.client.1.smithi172.stdout:9/133: dwrite f12 [0,4194304] 0 2024-09-20T18:35:34.957 INFO:tasks.workunit.client.1.smithi172.stdout:4/106: creat d0/f2a x:0 0 0 2024-09-20T18:35:34.959 INFO:tasks.workunit.client.1.smithi172.stdout:1/112: mkdir d0/d22 0 2024-09-20T18:35:34.963 INFO:tasks.workunit.client.1.smithi172.stdout:0/213: rename d4/f16 to d4/d1d/d15/f50 0 2024-09-20T18:35:34.964 INFO:tasks.workunit.client.1.smithi172.stdout:5/178: truncate d4/f9 1975063 0 2024-09-20T18:35:34.968 INFO:tasks.workunit.client.1.smithi172.stdout:1/113: dwrite d0/d8/db/f1b [0,4194304] 0 2024-09-20T18:35:34.969 INFO:tasks.workunit.client.1.smithi172.stdout:8/114: creat dd/d1b/f2f x:0 0 0 2024-09-20T18:35:34.970 INFO:tasks.workunit.client.1.smithi172.stdout:2/81: read d0/f3 [2961723,37795] 0 2024-09-20T18:35:34.971 INFO:tasks.workunit.client.1.smithi172.stdout:8/115: dread - dd/d1b/f2f zero size 2024-09-20T18:35:34.972 INFO:tasks.workunit.client.1.smithi172.stdout:4/107: readlink d0/d7/df/l28 0 2024-09-20T18:35:34.972 INFO:tasks.workunit.client.1.smithi172.stdout:9/134: dread - d15/d20/f21 zero size 2024-09-20T18:35:34.976 INFO:tasks.workunit.client.1.smithi172.stdout:1/114: dread d0/d8/f17 [0,4194304] 0 2024-09-20T18:35:34.977 INFO:tasks.workunit.client.1.smithi172.stdout:5/179: creat d4/d1f/d26/f37 x:0 0 0 2024-09-20T18:35:34.977 INFO:tasks.workunit.client.1.smithi172.stdout:1/115: readlink d0/l1c 0 2024-09-20T18:35:34.981 INFO:tasks.workunit.client.1.smithi172.stdout:5/180: dread d4/d1d/f25 [0,4194304] 0 2024-09-20T18:35:34.981 INFO:tasks.workunit.client.1.smithi172.stdout:5/181: chown d4/l18 15 1 2024-09-20T18:35:34.982 INFO:tasks.workunit.client.1.smithi172.stdout:4/108: fsync d0/d7/f25 0 2024-09-20T18:35:34.986 INFO:tasks.workunit.client.1.smithi172.stdout:7/130: getdents d2/d23 0 2024-09-20T18:35:34.989 INFO:tasks.workunit.client.1.smithi172.stdout:4/109: dwrite d0/d7/df/d15/f14 [0,4194304] 0 2024-09-20T18:35:34.990 INFO:tasks.workunit.client.1.smithi172.stdout:3/114: truncate d0/f8 182873 0 2024-09-20T18:35:34.992 INFO:tasks.workunit.client.1.smithi172.stdout:6/105: getdents d0/d3 0 2024-09-20T18:35:34.993 INFO:tasks.workunit.client.1.smithi172.stdout:2/82: symlink d0/d4/l15 0 2024-09-20T18:35:34.997 INFO:tasks.workunit.client.1.smithi172.stdout:5/182: creat d4/d1d/d2c/f38 x:0 0 0 2024-09-20T18:35:34.998 INFO:tasks.workunit.client.1.smithi172.stdout:9/135: mkdir d15/d1a/d1e/d24 0 2024-09-20T18:35:35.000 INFO:tasks.workunit.client.1.smithi172.stdout:9/136: read - d15/d20/f21 zero size 2024-09-20T18:35:35.002 INFO:tasks.workunit.client.1.smithi172.stdout:0/214: dwrite d4/f11 [0,4194304] 0 2024-09-20T18:35:35.003 INFO:tasks.workunit.client.1.smithi172.stdout:1/116: creat d0/d22/f23 x:0 0 0 2024-09-20T18:35:35.003 INFO:tasks.workunit.client.1.smithi172.stdout:7/131: truncate d2/d3/d10/f2d 1090208 0 2024-09-20T18:35:35.005 INFO:tasks.workunit.client.1.smithi172.stdout:1/117: read - d0/d22/f23 zero size 2024-09-20T18:35:35.006 INFO:tasks.workunit.client.1.smithi172.stdout:4/110: creat d0/de/d21/f2b x:0 0 0 2024-09-20T18:35:35.008 INFO:tasks.workunit.client.1.smithi172.stdout:9/137: dwrite d15/d20/f21 [0,4194304] 0 2024-09-20T18:35:35.014 INFO:tasks.workunit.client.1.smithi172.stdout:2/83: unlink d0/d4/lb 0 2024-09-20T18:35:35.083 INFO:tasks.workunit.client.1.smithi172.stdout:8/116: creat dd/f30 x:0 0 0 2024-09-20T18:35:35.083 INFO:tasks.workunit.client.1.smithi172.stdout:0/215: mkdir d4/d1a/d28/d42/d45/d51 0 2024-09-20T18:35:35.084 INFO:tasks.workunit.client.1.smithi172.stdout:3/115: link d0/f9 d0/d13/f1c 0 2024-09-20T18:35:35.084 INFO:tasks.workunit.client.1.smithi172.stdout:8/117: chown dd/d1b/f2f 253748 1 2024-09-20T18:35:35.085 INFO:tasks.workunit.client.1.smithi172.stdout:1/118: symlink d0/d8/d12/l24 0 2024-09-20T18:35:35.085 INFO:tasks.workunit.client.1.smithi172.stdout:9/138: rmdir d15/d1f 39 2024-09-20T18:35:35.086 INFO:tasks.workunit.client.1.smithi172.stdout:1/119: readlink d0/l15 0 2024-09-20T18:35:35.088 INFO:tasks.workunit.client.1.smithi172.stdout:6/106: write d0/f13 [993311,122306] 0 2024-09-20T18:35:35.089 INFO:tasks.workunit.client.1.smithi172.stdout:5/183: write d4/d1d/f25 [133929,36857] 0 2024-09-20T18:35:35.091 INFO:tasks.workunit.client.1.smithi172.stdout:2/84: dread d0/d4/fd [4194304,4194304] 0 2024-09-20T18:35:35.094 INFO:tasks.workunit.client.1.smithi172.stdout:3/116: dwrite d0/f16 [0,4194304] 0 2024-09-20T18:35:35.096 INFO:tasks.workunit.client.1.smithi172.stdout:3/117: truncate d0/f18 4927483 0 2024-09-20T18:35:35.098 INFO:tasks.workunit.client.1.smithi172.stdout:5/184: dwrite d4/d1d/f25 [0,4194304] 0 2024-09-20T18:35:35.107 INFO:tasks.workunit.client.1.smithi172.stdout:5/185: dwrite d4/d1d/f20 [0,4194304] 0 2024-09-20T18:35:35.179 INFO:tasks.workunit.client.1.smithi172.stdout:8/118: chown dd/c25 30 1 2024-09-20T18:35:35.180 INFO:tasks.workunit.client.1.smithi172.stdout:0/216: creat d4/d1a/d28/d42/d45/f52 x:0 0 0 2024-09-20T18:35:35.182 INFO:tasks.workunit.client.1.smithi172.stdout:1/120: mkdir d0/d8/db/d25 0 2024-09-20T18:35:35.182 INFO:tasks.workunit.client.1.smithi172.stdout:1/121: readlink d0/d8/d12/l24 0 2024-09-20T18:35:35.185 INFO:tasks.workunit.client.1.smithi172.stdout:3/118: symlink d0/d13/l1d 0 2024-09-20T18:35:35.187 INFO:tasks.workunit.client.1.smithi172.stdout:4/111: link d0/d7/df/c16 d0/d7/df/c2c 0 2024-09-20T18:35:35.188 INFO:tasks.workunit.client.1.smithi172.stdout:8/119: rename dd/d1b/f24 to dd/d1b/f31 0 2024-09-20T18:35:35.188 INFO:tasks.workunit.client.1.smithi172.stdout:1/122: dwrite d0/d8/db/f1b [0,4194304] 0 2024-09-20T18:35:35.189 INFO:tasks.workunit.client.1.smithi172.stdout:0/217: symlink d4/d5/l53 0 2024-09-20T18:35:35.189 INFO:tasks.workunit.client.1.smithi172.stdout:4/112: dread d0/de/dc/f22 [0,4194304] 0 2024-09-20T18:35:35.193 INFO:tasks.workunit.client.1.smithi172.stdout:6/107: creat d0/d3/f20 x:0 0 0 2024-09-20T18:35:35.197 INFO:tasks.workunit.client.1.smithi172.stdout:2/85: symlink d0/d4/d9/d10/l16 0 2024-09-20T18:35:35.197 INFO:tasks.workunit.client.1.smithi172.stdout:4/113: dwrite d0/de/dc/f22 [0,4194304] 0 2024-09-20T18:35:35.203 INFO:tasks.workunit.client.1.smithi172.stdout:8/120: unlink fc 0 2024-09-20T18:35:35.204 INFO:tasks.workunit.client.1.smithi172.stdout:7/132: sync 2024-09-20T18:35:35.205 INFO:tasks.workunit.client.1.smithi172.stdout:0/218: mkdir d4/d1a/d28/d42/d45/d54 0 2024-09-20T18:35:35.206 INFO:tasks.workunit.client.1.smithi172.stdout:1/123: dread d0/d8/f16 [0,4194304] 0 2024-09-20T18:35:35.211 INFO:tasks.workunit.client.1.smithi172.stdout:4/114: unlink d0/de/dc/c10 0 2024-09-20T18:35:35.211 INFO:tasks.workunit.client.1.smithi172.stdout:8/121: dwrite dd/d1b/f23 [0,4194304] 0 2024-09-20T18:35:35.211 INFO:tasks.workunit.client.1.smithi172.stdout:6/108: dread d0/fe [0,4194304] 0 2024-09-20T18:35:35.217 INFO:tasks.workunit.client.1.smithi172.stdout:7/133: unlink d2/d3/d10/l34 0 2024-09-20T18:35:35.218 INFO:tasks.workunit.client.1.smithi172.stdout:7/134: write d2/f2b [5094781,119280] 0 2024-09-20T18:35:35.222 INFO:tasks.workunit.client.1.smithi172.stdout:1/124: creat d0/d8/db/f26 x:0 0 0 2024-09-20T18:35:35.223 INFO:tasks.workunit.client.1.smithi172.stdout:0/219: creat d4/d1a/d28/d42/f55 x:0 0 0 2024-09-20T18:35:35.224 INFO:tasks.workunit.client.1.smithi172.stdout:0/220: truncate d4/f6 2634911 0 2024-09-20T18:35:35.225 INFO:tasks.workunit.client.1.smithi172.stdout:2/86: mkdir d0/d4/d17 0 2024-09-20T18:35:35.228 INFO:tasks.workunit.client.1.smithi172.stdout:8/122: mknod dd/d1b/c32 0 2024-09-20T18:35:35.229 INFO:tasks.workunit.client.1.smithi172.stdout:8/123: write dd/d1b/f2f [26048,66166] 0 2024-09-20T18:35:35.232 INFO:tasks.workunit.client.1.smithi172.stdout:7/135: mknod d2/d3/dd/c36 0 2024-09-20T18:35:35.236 INFO:tasks.workunit.client.1.smithi172.stdout:2/87: rename d0/d4/d9/d12 to d0/d4/d17/d18 0 2024-09-20T18:35:35.237 INFO:tasks.workunit.client.1.smithi172.stdout:6/109: mkdir d0/d18/d1c/d21 0 2024-09-20T18:35:35.239 INFO:tasks.workunit.client.1.smithi172.stdout:4/115: creat d0/de/d21/d24/f2d x:0 0 0 2024-09-20T18:35:35.240 INFO:tasks.workunit.client.1.smithi172.stdout:8/124: creat dd/d1b/f33 x:0 0 0 2024-09-20T18:35:35.241 INFO:tasks.workunit.client.1.smithi172.stdout:7/136: mknod d2/d3/c37 0 2024-09-20T18:35:35.243 INFO:tasks.workunit.client.1.smithi172.stdout:0/221: creat d4/d46/f56 x:0 0 0 2024-09-20T18:35:35.248 INFO:tasks.workunit.client.1.smithi172.stdout:4/116: mknod d0/de/d21/c2e 0 2024-09-20T18:35:35.251 INFO:tasks.workunit.client.1.smithi172.stdout:7/137: mknod d2/d23/c38 0 2024-09-20T18:35:35.252 INFO:tasks.workunit.client.1.smithi172.stdout:0/222: rmdir d4/d1d/d15 39 2024-09-20T18:35:35.252 INFO:tasks.workunit.client.1.smithi172.stdout:0/223: chown d4 3982 1 2024-09-20T18:35:35.254 INFO:tasks.workunit.client.1.smithi172.stdout:6/110: fsync d0/f5 0 2024-09-20T18:35:35.256 INFO:tasks.workunit.client.1.smithi172.stdout:8/125: dwrite dd/f27 [0,4194304] 0 2024-09-20T18:35:35.259 INFO:tasks.workunit.client.1.smithi172.stdout:7/138: dread d2/d3/d10/f1b [0,4194304] 0 2024-09-20T18:35:35.261 INFO:tasks.workunit.client.1.smithi172.stdout:4/117: symlink d0/l2f 0 2024-09-20T18:35:35.262 INFO:tasks.workunit.client.1.smithi172.stdout:0/224: mknod d4/d1a/c57 0 2024-09-20T18:35:35.263 INFO:tasks.workunit.client.1.smithi172.stdout:6/111: write d0/fc [3485190,60382] 0 2024-09-20T18:35:35.270 INFO:tasks.workunit.client.1.smithi172.stdout:4/118: write d0/de/dc/f22 [2912514,57179] 0 2024-09-20T18:35:35.273 INFO:tasks.workunit.client.1.smithi172.stdout:4/119: dread d0/fa [4194304,4194304] 0 2024-09-20T18:35:35.275 INFO:tasks.workunit.client.1.smithi172.stdout:6/112: mkdir d0/d18/d1c/d22 0 2024-09-20T18:35:35.276 INFO:tasks.workunit.client.1.smithi172.stdout:8/126: mkdir dd/d2b/d34 0 2024-09-20T18:35:35.280 INFO:tasks.workunit.client.1.smithi172.stdout:6/113: dwrite d0/fc [8388608,4194304] 0 2024-09-20T18:35:35.281 INFO:tasks.workunit.client.1.smithi172.stdout:4/120: creat d0/de/f30 x:0 0 0 2024-09-20T18:35:35.282 INFO:tasks.workunit.client.1.smithi172.stdout:4/121: dread - d0/de/d21/d24/f2d zero size 2024-09-20T18:35:35.285 INFO:tasks.workunit.client.1.smithi172.stdout:8/127: creat dd/d2b/f35 x:0 0 0 2024-09-20T18:35:35.285 INFO:tasks.workunit.client.1.smithi172.stdout:8/128: dread - dd/d1b/f31 zero size 2024-09-20T18:35:35.287 INFO:tasks.workunit.client.1.smithi172.stdout:7/139: creat d2/f39 x:0 0 0 2024-09-20T18:35:35.293 INFO:tasks.workunit.client.1.smithi172.stdout:4/122: mknod d0/d7/df/d18/d1a/c31 0 2024-09-20T18:35:35.296 INFO:tasks.workunit.client.1.smithi172.stdout:0/225: getdents d4/d20 0 2024-09-20T18:35:35.302 INFO:tasks.workunit.client.1.smithi172.stdout:0/226: creat d4/d5/f58 x:0 0 0 2024-09-20T18:35:35.304 INFO:tasks.workunit.client.1.smithi172.stdout:6/114: getdents d0 0 2024-09-20T18:35:35.304 INFO:tasks.workunit.client.1.smithi172.stdout:5/186: sync 2024-09-20T18:35:35.306 INFO:tasks.workunit.client.1.smithi172.stdout:4/123: creat d0/f32 x:0 0 0 2024-09-20T18:35:35.306 INFO:tasks.workunit.client.1.smithi172.stdout:5/187: truncate d4/d1d/d2c/f35 810113 0 2024-09-20T18:35:35.314 INFO:tasks.workunit.client.1.smithi172.stdout:6/115: link d0/fe d0/d18/f23 0 2024-09-20T18:35:35.317 INFO:tasks.workunit.client.1.smithi172.stdout:5/188: symlink d4/d1f/d26/d2d/l39 0 2024-09-20T18:35:35.318 INFO:tasks.workunit.client.1.smithi172.stdout:0/227: creat d4/d1d/f59 x:0 0 0 2024-09-20T18:35:35.319 INFO:tasks.workunit.client.1.smithi172.stdout:0/228: write d4/d1a/f1e [586743,125156] 0 2024-09-20T18:35:35.319 INFO:tasks.workunit.client.1.smithi172.stdout:6/116: fdatasync d0/fe 0 2024-09-20T18:35:35.319 INFO:tasks.workunit.client.1.smithi172.stdout:6/117: readlink d0/l12 0 2024-09-20T18:35:35.320 INFO:tasks.workunit.client.1.smithi172.stdout:6/118: chown d0/f13 3649481 1 2024-09-20T18:35:35.321 INFO:tasks.workunit.client.1.smithi172.stdout:4/124: link d0/d7/df/c16 d0/de/d21/c33 0 2024-09-20T18:35:35.321 INFO:tasks.workunit.client.1.smithi172.stdout:6/119: dread d0/d3/f7 [0,4194304] 0 2024-09-20T18:35:35.322 INFO:tasks.workunit.client.1.smithi172.stdout:5/189: mknod d4/d1f/d26/d2d/c3a 0 2024-09-20T18:35:35.322 INFO:tasks.workunit.client.1.smithi172.stdout:6/120: write d0/d3/f20 [1039329,112056] 0 2024-09-20T18:35:35.323 INFO:tasks.workunit.client.1.smithi172.stdout:0/229: creat d4/d5/d2e/d33/f5a x:0 0 0 2024-09-20T18:35:35.324 INFO:tasks.workunit.client.1.smithi172.stdout:6/121: write d0/fc [2150575,4054] 0 2024-09-20T18:35:35.324 INFO:tasks.workunit.client.1.smithi172.stdout:0/230: stat d4/f6 0 2024-09-20T18:35:35.326 INFO:tasks.workunit.client.1.smithi172.stdout:4/125: stat d0/d7/c1e 0 2024-09-20T18:35:35.328 INFO:tasks.workunit.client.1.smithi172.stdout:5/190: symlink d4/d1f/d26/d2d/l3b 0 2024-09-20T18:35:35.329 INFO:tasks.workunit.client.1.smithi172.stdout:6/122: creat d0/d18/f24 x:0 0 0 2024-09-20T18:35:35.331 INFO:tasks.workunit.client.1.smithi172.stdout:5/191: mknod d4/d1f/c3c 0 2024-09-20T18:35:35.333 INFO:tasks.workunit.client.1.smithi172.stdout:6/123: rmdir d0 39 2024-09-20T18:35:35.334 INFO:tasks.workunit.client.1.smithi172.stdout:1/125: sync 2024-09-20T18:35:35.335 INFO:tasks.workunit.client.1.smithi172.stdout:5/192: rename d4/df/f15 to d4/d1d/f3d 0 2024-09-20T18:35:35.340 INFO:tasks.workunit.client.1.smithi172.stdout:5/193: creat d4/d1d/f3e x:0 0 0 2024-09-20T18:35:35.341 INFO:tasks.workunit.client.1.smithi172.stdout:1/126: symlink d0/d8/db/d25/l27 0 2024-09-20T18:35:35.341 INFO:tasks.workunit.client.1.smithi172.stdout:5/194: read - d4/d1d/f33 zero size 2024-09-20T18:35:35.344 INFO:tasks.workunit.client.1.smithi172.stdout:5/195: dread d4/d1f/d26/f32 [0,4194304] 0 2024-09-20T18:35:35.346 INFO:tasks.workunit.client.1.smithi172.stdout:5/196: mkdir d4/df/d3f 0 2024-09-20T18:35:35.349 INFO:tasks.workunit.client.1.smithi172.stdout:5/197: rename d4/df/l16 to d4/df/d3f/l40 0 2024-09-20T18:35:35.351 INFO:tasks.workunit.client.1.smithi172.stdout:5/198: mkdir d4/d1f/d26/d41 0 2024-09-20T18:35:35.353 INFO:tasks.workunit.client.1.smithi172.stdout:5/199: mknod d4/d1f/d26/d2d/c42 0 2024-09-20T18:35:35.356 INFO:tasks.workunit.client.1.smithi172.stdout:5/200: rename d4/d1f/f28 to d4/df/d3f/f43 0 2024-09-20T18:35:35.357 INFO:tasks.workunit.client.1.smithi172.stdout:5/201: write d4/df/f1c [670580,5711] 0 2024-09-20T18:35:35.357 INFO:tasks.workunit.client.1.smithi172.stdout:5/202: stat d4/d1f/d26/d41 0 2024-09-20T18:35:35.364 INFO:tasks.workunit.client.1.smithi172.stdout:5/203: dwrite d4/df/d3f/f43 [0,4194304] 0 2024-09-20T18:35:35.368 INFO:tasks.workunit.client.1.smithi172.stdout:5/204: creat d4/d1f/f44 x:0 0 0 2024-09-20T18:35:35.370 INFO:tasks.workunit.client.1.smithi172.stdout:5/205: unlink d4/f5 0 2024-09-20T18:35:35.378 INFO:tasks.workunit.client.1.smithi172.stdout:5/206: dwrite f3 [0,4194304] 0 2024-09-20T18:35:35.380 INFO:tasks.workunit.client.1.smithi172.stdout:5/207: truncate d4/f23 1167018 0 2024-09-20T18:35:35.392 INFO:tasks.workunit.client.1.smithi172.stdout:5/208: symlink d4/d1f/d26/d41/l45 0 2024-09-20T18:35:35.405 INFO:tasks.workunit.client.1.smithi172.stdout:5/209: dread d4/fd [0,4194304] 0 2024-09-20T18:35:35.406 INFO:tasks.workunit.client.1.smithi172.stdout:5/210: read - d4/d1f/d26/f2a zero size 2024-09-20T18:35:35.409 INFO:tasks.workunit.client.1.smithi172.stdout:5/211: rename d4/d1f/d26/d2d/l39 to d4/df/d3f/l46 0 2024-09-20T18:35:35.409 INFO:tasks.workunit.client.1.smithi172.stdout:5/212: chown d4/d1d/d2c 1 1 2024-09-20T18:35:35.412 INFO:tasks.workunit.client.1.smithi172.stdout:9/139: truncate d15/f1b 865877 0 2024-09-20T18:35:35.414 INFO:tasks.workunit.client.1.smithi172.stdout:9/140: readlink lc 0 2024-09-20T18:35:35.415 INFO:tasks.workunit.client.1.smithi172.stdout:2/88: getdents d0/d4/d9/d10 0 2024-09-20T18:35:35.416 INFO:tasks.workunit.client.1.smithi172.stdout:9/141: creat d15/d1a/f25 x:0 0 0 2024-09-20T18:35:35.417 INFO:tasks.workunit.client.1.smithi172.stdout:9/142: truncate d15/d1a/f25 839607 0 2024-09-20T18:35:35.417 INFO:tasks.workunit.client.1.smithi172.stdout:2/89: dread d0/f3 [0,4194304] 0 2024-09-20T18:35:35.422 INFO:tasks.workunit.client.1.smithi172.stdout:3/119: truncate d0/f16 4128243 0 2024-09-20T18:35:35.423 INFO:tasks.workunit.client.1.smithi172.stdout:3/120: truncate d0/f7 4658318 0 2024-09-20T18:35:35.423 INFO:tasks.workunit.client.1.smithi172.stdout:3/121: write d0/f18 [381639,5919] 0 2024-09-20T18:35:35.424 INFO:tasks.workunit.client.1.smithi172.stdout:3/122: chown d0/c15 5 1 2024-09-20T18:35:35.425 INFO:tasks.workunit.client.1.smithi172.stdout:3/123: stat d0/ca 0 2024-09-20T18:35:35.426 INFO:tasks.workunit.client.1.smithi172.stdout:3/124: read d0/f9 [2804448,94869] 0 2024-09-20T18:35:35.431 INFO:tasks.workunit.client.1.smithi172.stdout:9/143: dread f8 [0,4194304] 0 2024-09-20T18:35:35.434 INFO:tasks.workunit.client.1.smithi172.stdout:9/144: creat d15/d1a/f26 x:0 0 0 2024-09-20T18:35:35.438 INFO:tasks.workunit.client.1.smithi172.stdout:9/145: fdatasync d15/f1b 0 2024-09-20T18:35:35.442 INFO:tasks.workunit.client.1.smithi172.stdout:9/146: creat d15/d1a/d1e/f27 x:0 0 0 2024-09-20T18:35:35.445 INFO:tasks.workunit.client.1.smithi172.stdout:9/147: creat d15/d1a/f28 x:0 0 0 2024-09-20T18:35:35.463 INFO:tasks.workunit.client.1.smithi172.stdout:7/140: write d2/d3/d10/f20 [1342368,69667] 0 2024-09-20T18:35:35.464 INFO:tasks.workunit.client.1.smithi172.stdout:8/129: truncate dd/d1b/f23 3011467 0 2024-09-20T18:35:35.464 INFO:tasks.workunit.client.1.smithi172.stdout:7/141: write d2/d23/f24 [774509,92411] 0 2024-09-20T18:35:35.465 INFO:tasks.workunit.client.1.smithi172.stdout:7/142: chown d2/d3/d10/f14 182 1 2024-09-20T18:35:35.466 INFO:tasks.workunit.client.1.smithi172.stdout:4/126: getdents d0 0 2024-09-20T18:35:35.470 INFO:tasks.workunit.client.1.smithi172.stdout:4/127: dread d0/d7/df/d15/f14 [0,4194304] 0 2024-09-20T18:35:35.492 INFO:tasks.workunit.client.1.smithi172.stdout:0/231: sync 2024-09-20T18:35:35.493 INFO:tasks.workunit.client.1.smithi172.stdout:5/213: fsync d4/d1d/f3e 0 2024-09-20T18:35:35.494 INFO:tasks.workunit.client.1.smithi172.stdout:4/128: dwrite d0/de/dc/f22 [0,4194304] 0 2024-09-20T18:35:35.494 INFO:tasks.workunit.client.1.smithi172.stdout:1/127: write d0/d8/f16 [715343,104568] 0 2024-09-20T18:35:35.496 INFO:tasks.workunit.client.1.smithi172.stdout:4/129: write d0/de/dc/f22 [1136456,37712] 0 2024-09-20T18:35:35.502 INFO:tasks.workunit.client.1.smithi172.stdout:1/128: unlink d0/d8/f17 0 2024-09-20T18:35:35.510 INFO:tasks.workunit.client.1.smithi172.stdout:4/130: mkdir d0/de/d21/d24/d34 0 2024-09-20T18:35:35.512 INFO:tasks.workunit.client.1.smithi172.stdout:4/131: truncate d0/de/d21/d24/f2d 792891 0 2024-09-20T18:35:35.514 INFO:tasks.workunit.client.1.smithi172.stdout:1/129: creat d0/d22/f28 x:0 0 0 2024-09-20T18:35:35.521 INFO:tasks.workunit.client.1.smithi172.stdout:4/132: mknod d0/d7/df/d18/d1a/c35 0 2024-09-20T18:35:35.522 INFO:tasks.workunit.client.1.smithi172.stdout:1/130: creat d0/d8/d12/f29 x:0 0 0 2024-09-20T18:35:35.523 INFO:tasks.workunit.client.1.smithi172.stdout:1/131: stat d0/d8/d12 0 2024-09-20T18:35:35.523 INFO:tasks.workunit.client.1.smithi172.stdout:4/133: rmdir d0/de/d21 39 2024-09-20T18:35:35.525 INFO:tasks.workunit.client.1.smithi172.stdout:3/125: dwrite d0/f8 [0,4194304] 0 2024-09-20T18:35:35.525 INFO:tasks.workunit.client.1.smithi172.stdout:4/134: truncate d0/d7/f12 1021491 0 2024-09-20T18:35:35.529 INFO:tasks.workunit.client.1.smithi172.stdout:9/148: write fe [9069360,118518] 0 2024-09-20T18:35:35.533 INFO:tasks.workunit.client.1.smithi172.stdout:4/135: symlink d0/l36 0 2024-09-20T18:35:35.538 INFO:tasks.workunit.client.1.smithi172.stdout:9/149: unlink f8 0 2024-09-20T18:35:35.544 INFO:tasks.workunit.client.1.smithi172.stdout:1/132: creat d0/d8/f2a x:0 0 0 2024-09-20T18:35:35.544 INFO:tasks.workunit.client.1.smithi172.stdout:1/133: fdatasync d0/d8/db/f26 0 2024-09-20T18:35:35.545 INFO:tasks.workunit.client.1.smithi172.stdout:9/150: symlink d15/d1a/d1e/l29 0 2024-09-20T18:35:35.547 INFO:tasks.workunit.client.1.smithi172.stdout:4/136: creat d0/d7/df/d15/f37 x:0 0 0 2024-09-20T18:35:35.549 INFO:tasks.workunit.client.1.smithi172.stdout:9/151: creat d15/d1a/d1e/f2a x:0 0 0 2024-09-20T18:35:35.553 INFO:tasks.workunit.client.1.smithi172.stdout:1/134: dread d0/f1 [0,4194304] 0 2024-09-20T18:35:35.554 INFO:tasks.workunit.client.1.smithi172.stdout:4/137: rename d0/l2f to d0/d7/df/d18/l38 0 2024-09-20T18:35:35.554 INFO:tasks.workunit.client.1.smithi172.stdout:1/135: write d0/f4 [1637877,60659] 0 2024-09-20T18:35:35.557 INFO:tasks.workunit.client.1.smithi172.stdout:0/232: dwrite d4/d1a/d28/d34/f43 [0,4194304] 0 2024-09-20T18:35:35.560 INFO:tasks.workunit.client.1.smithi172.stdout:4/138: chown d0/c4 95 1 2024-09-20T18:35:35.561 INFO:tasks.workunit.client.1.smithi172.stdout:1/136: mkdir d0/d8/db/d25/d2b 0 2024-09-20T18:35:35.563 INFO:tasks.workunit.client.1.smithi172.stdout:5/214: truncate d4/f23 787258 0 2024-09-20T18:35:35.563 INFO:tasks.workunit.client.1.smithi172.stdout:0/233: creat d4/d1a/d28/f5b x:0 0 0 2024-09-20T18:35:35.569 INFO:tasks.workunit.client.1.smithi172.stdout:4/139: dwrite d0/de/dc/f22 [0,4194304] 0 2024-09-20T18:35:35.573 INFO:tasks.workunit.client.1.smithi172.stdout:0/234: creat d4/d44/f5c x:0 0 0 2024-09-20T18:35:35.592 INFO:tasks.workunit.client.1.smithi172.stdout:6/124: sync 2024-09-20T18:35:35.592 INFO:tasks.workunit.client.1.smithi172.stdout:2/90: sync 2024-09-20T18:35:35.603 INFO:tasks.workunit.client.1.smithi172.stdout:4/140: mkdir d0/de/d39 0 2024-09-20T18:35:35.604 INFO:tasks.workunit.client.1.smithi172.stdout:9/152: truncate f12 4138747 0 2024-09-20T18:35:35.607 INFO:tasks.workunit.client.1.smithi172.stdout:0/235: dwrite d4/d1d/d15/f1b [0,4194304] 0 2024-09-20T18:35:35.610 INFO:tasks.workunit.client.1.smithi172.stdout:2/91: write d0/f8 [3645815,69177] 0 2024-09-20T18:35:35.611 INFO:tasks.workunit.client.1.smithi172.stdout:2/92: write d0/f8 [4912840,100821] 0 2024-09-20T18:35:35.613 INFO:tasks.workunit.client.1.smithi172.stdout:9/153: rename d15/l17 to d15/d20/l2b 0 2024-09-20T18:35:35.614 INFO:tasks.workunit.client.1.smithi172.stdout:9/154: truncate d15/d1a/f26 295969 0 2024-09-20T18:35:35.614 INFO:tasks.workunit.client.1.smithi172.stdout:6/125: rmdir d0/d18/d1c 39 2024-09-20T18:35:35.615 INFO:tasks.workunit.client.1.smithi172.stdout:6/126: chown d0/fc 6946699 1 2024-09-20T18:35:35.624 INFO:tasks.workunit.client.1.smithi172.stdout:9/155: mkdir d15/d1f/d2c 0 2024-09-20T18:35:35.625 INFO:tasks.workunit.client.1.smithi172.stdout:6/127: rmdir d0/d18/d1c 39 2024-09-20T18:35:35.626 INFO:tasks.workunit.client.1.smithi172.stdout:9/156: symlink d15/d1f/l2d 0 2024-09-20T18:35:35.627 INFO:tasks.workunit.client.1.smithi172.stdout:9/157: stat d15/d20 0 2024-09-20T18:35:35.629 INFO:tasks.workunit.client.1.smithi172.stdout:6/128: mkdir d0/d3/d25 0 2024-09-20T18:35:35.629 INFO:tasks.workunit.client.1.smithi172.stdout:6/129: fdatasync d0/d3/f20 0 2024-09-20T18:35:35.630 INFO:tasks.workunit.client.1.smithi172.stdout:6/130: write d0/d18/f24 [829619,81859] 0 2024-09-20T18:35:35.633 INFO:tasks.workunit.client.1.smithi172.stdout:9/158: creat d15/d1a/d1e/d24/f2e x:0 0 0 2024-09-20T18:35:35.634 INFO:tasks.workunit.client.1.smithi172.stdout:9/159: write d15/d1a/d1e/f2a [511038,101395] 0 2024-09-20T18:35:35.645 INFO:tasks.workunit.client.1.smithi172.stdout:3/126: dwrite d0/f16 [0,4194304] 0 2024-09-20T18:35:35.650 INFO:tasks.workunit.client.1.smithi172.stdout:9/160: dread fe [0,4194304] 0 2024-09-20T18:35:35.651 INFO:tasks.workunit.client.1.smithi172.stdout:2/93: write d0/f3 [4435401,125378] 0 2024-09-20T18:35:35.659 INFO:tasks.workunit.client.1.smithi172.stdout:2/94: creat d0/d4/d17/d18/f19 x:0 0 0 2024-09-20T18:35:35.660 INFO:tasks.workunit.client.1.smithi172.stdout:3/127: getdents d0/db 0 2024-09-20T18:35:35.662 INFO:tasks.workunit.client.1.smithi172.stdout:2/95: dread d0/d4/fd [4194304,4194304] 0 2024-09-20T18:35:35.663 INFO:tasks.workunit.client.1.smithi172.stdout:2/96: read d0/f8 [3732897,15687] 0 2024-09-20T18:35:35.666 INFO:tasks.workunit.client.1.smithi172.stdout:3/128: dwrite d0/f8 [0,4194304] 0 2024-09-20T18:35:35.673 INFO:tasks.workunit.client.1.smithi172.stdout:6/131: dwrite d0/d3/f7 [0,4194304] 0 2024-09-20T18:35:35.677 INFO:tasks.workunit.client.1.smithi172.stdout:3/129: mkdir d0/d13/d1e 0 2024-09-20T18:35:35.677 INFO:tasks.workunit.client.1.smithi172.stdout:9/161: getdents d15/d20 0 2024-09-20T18:35:35.680 INFO:tasks.workunit.client.1.smithi172.stdout:3/130: dread d0/f10 [0,4194304] 0 2024-09-20T18:35:35.681 INFO:tasks.workunit.client.1.smithi172.stdout:2/97: mkdir d0/d1a 0 2024-09-20T18:35:35.684 INFO:tasks.workunit.client.1.smithi172.stdout:3/131: dread d0/f8 [0,4194304] 0 2024-09-20T18:35:35.693 INFO:tasks.workunit.client.1.smithi172.stdout:3/132: fsync d0/f7 0 2024-09-20T18:35:35.695 INFO:tasks.workunit.client.1.smithi172.stdout:9/162: unlink d15/d20/l2b 0 2024-09-20T18:35:35.728 INFO:tasks.workunit.client.1.smithi172.stdout:7/143: sync 2024-09-20T18:35:35.728 INFO:tasks.workunit.client.1.smithi172.stdout:8/130: sync 2024-09-20T18:35:35.728 INFO:tasks.workunit.client.1.smithi172.stdout:2/98: unlink d0/d4/d17/d18/f19 0 2024-09-20T18:35:35.728 INFO:tasks.workunit.client.1.smithi172.stdout:8/131: fdatasync f1 0 2024-09-20T18:35:35.729 INFO:tasks.workunit.client.1.smithi172.stdout:6/132: mkdir d0/d18/d1c/d21/d26 0 2024-09-20T18:35:35.729 INFO:tasks.workunit.client.1.smithi172.stdout:3/133: creat d0/dc/f1f x:0 0 0 2024-09-20T18:35:35.730 INFO:tasks.workunit.client.1.smithi172.stdout:7/144: mkdir d2/d23/d3a 0 2024-09-20T18:35:35.734 INFO:tasks.workunit.client.1.smithi172.stdout:7/145: chown d2/d3/d10/f2c 53 1 2024-09-20T18:35:35.734 INFO:tasks.workunit.client.1.smithi172.stdout:3/134: creat d0/f20 x:0 0 0 2024-09-20T18:35:35.735 INFO:tasks.workunit.client.1.smithi172.stdout:9/163: dwrite d15/f18 [0,4194304] 0 2024-09-20T18:35:35.736 INFO:tasks.workunit.client.1.smithi172.stdout:3/135: stat d0/d13/l1d 0 2024-09-20T18:35:35.737 INFO:tasks.workunit.client.1.smithi172.stdout:7/146: chown d2/f25 28769046 1 2024-09-20T18:35:35.738 INFO:tasks.workunit.client.1.smithi172.stdout:6/133: dread d0/fe [0,4194304] 0 2024-09-20T18:35:35.739 INFO:tasks.workunit.client.1.smithi172.stdout:2/99: dwrite d0/d4/d9/fc [0,4194304] 0 2024-09-20T18:35:35.740 INFO:tasks.workunit.client.1.smithi172.stdout:2/100: chown d0/l5 121 1 2024-09-20T18:35:35.740 INFO:tasks.workunit.client.1.smithi172.stdout:3/136: symlink d0/d13/l21 0 2024-09-20T18:35:35.742 INFO:tasks.workunit.client.1.smithi172.stdout:3/137: write d0/dc/f1f [618266,24851] 0 2024-09-20T18:35:35.744 INFO:tasks.workunit.client.1.smithi172.stdout:9/164: creat d15/d1a/d1e/d24/f2f x:0 0 0 2024-09-20T18:35:35.748 INFO:tasks.workunit.client.1.smithi172.stdout:7/147: truncate d2/d23/f30 1067546 0 2024-09-20T18:35:35.749 INFO:tasks.workunit.client.1.smithi172.stdout:2/101: symlink d0/d4/d17/l1b 0 2024-09-20T18:35:35.753 INFO:tasks.workunit.client.1.smithi172.stdout:9/165: rename d15/d1a/d1e/l29 to d15/d1a/l30 0 2024-09-20T18:35:35.754 INFO:tasks.workunit.client.1.smithi172.stdout:6/134: mkdir d0/d18/d1c/d22/d27 0 2024-09-20T18:35:35.756 INFO:tasks.workunit.client.1.smithi172.stdout:7/148: chown d2/d23/c32 71896585 1 2024-09-20T18:35:35.757 INFO:tasks.workunit.client.1.smithi172.stdout:7/149: write d2/d3/f7 [2677993,112693] 0 2024-09-20T18:35:35.757 INFO:tasks.workunit.client.1.smithi172.stdout:6/135: dread d0/d18/f23 [0,4194304] 0 2024-09-20T18:35:35.760 INFO:tasks.workunit.client.1.smithi172.stdout:3/138: unlink d0/dc/f1f 0 2024-09-20T18:35:35.762 INFO:tasks.workunit.client.1.smithi172.stdout:9/166: creat d15/d1a/f31 x:0 0 0 2024-09-20T18:35:35.763 INFO:tasks.workunit.client.1.smithi172.stdout:2/102: mknod d0/d1a/c1c 0 2024-09-20T18:35:35.763 INFO:tasks.workunit.client.1.smithi172.stdout:2/103: read d0/d4/d9/fc [36284,125800] 0 2024-09-20T18:35:35.764 INFO:tasks.workunit.client.1.smithi172.stdout:7/150: creat d2/d3/f3b x:0 0 0 2024-09-20T18:35:35.765 INFO:tasks.workunit.client.1.smithi172.stdout:7/151: read - d2/d3/dd/f2e zero size 2024-09-20T18:35:35.766 INFO:tasks.workunit.client.1.smithi172.stdout:7/152: truncate d2/f9 2527311 0 2024-09-20T18:35:35.767 INFO:tasks.workunit.client.1.smithi172.stdout:3/139: mkdir d0/db/d22 0 2024-09-20T18:35:35.768 INFO:tasks.workunit.client.1.smithi172.stdout:9/167: mknod d15/d20/c32 0 2024-09-20T18:35:35.774 INFO:tasks.workunit.client.1.smithi172.stdout:7/153: mkdir d2/d23/d3c 0 2024-09-20T18:35:35.775 INFO:tasks.workunit.client.1.smithi172.stdout:1/137: sync 2024-09-20T18:35:35.776 INFO:tasks.workunit.client.1.smithi172.stdout:1/138: fsync d0/f10 0 2024-09-20T18:35:35.776 INFO:tasks.workunit.client.1.smithi172.stdout:3/140: fsync d0/d13/f1c 0 2024-09-20T18:35:35.777 INFO:tasks.workunit.client.1.smithi172.stdout:3/141: readlink d0/d13/l14 0 2024-09-20T18:35:35.778 INFO:tasks.workunit.client.1.smithi172.stdout:1/139: fdatasync d0/d8/fc 0 2024-09-20T18:35:35.779 INFO:tasks.workunit.client.1.smithi172.stdout:1/140: dread d0/d8/f14 [0,4194304] 0 2024-09-20T18:35:35.780 INFO:tasks.workunit.client.1.smithi172.stdout:1/141: chown d0/d8/db/d25/l27 79065 1 2024-09-20T18:35:35.780 INFO:tasks.workunit.client.1.smithi172.stdout:7/154: dwrite d2/d3/fb [0,4194304] 0 2024-09-20T18:35:35.781 INFO:tasks.workunit.client.1.smithi172.stdout:1/142: chown d0/d8/db/f18 59 1 2024-09-20T18:35:35.781 INFO:tasks.workunit.client.1.smithi172.stdout:7/155: chown d2/d3/dd/f1d 71 1 2024-09-20T18:35:35.782 INFO:tasks.workunit.client.1.smithi172.stdout:7/156: read d2/d3/f35 [524770,109489] 0 2024-09-20T18:35:35.788 INFO:tasks.workunit.client.1.smithi172.stdout:3/142: rmdir d0/d13 39 2024-09-20T18:35:35.791 INFO:tasks.workunit.client.1.smithi172.stdout:2/104: creat d0/f1d x:0 0 0 2024-09-20T18:35:35.792 INFO:tasks.workunit.client.1.smithi172.stdout:2/105: chown d0/d4/d9/fc 1998102 1 2024-09-20T18:35:35.796 INFO:tasks.workunit.client.1.smithi172.stdout:3/143: unlink d0/c15 0 2024-09-20T18:35:35.796 INFO:tasks.workunit.client.1.smithi172.stdout:2/106: dwrite d0/f3 [0,4194304] 0 2024-09-20T18:35:35.797 INFO:tasks.workunit.client.1.smithi172.stdout:2/107: readlink d0/l1 0 2024-09-20T18:35:35.798 INFO:tasks.workunit.client.1.smithi172.stdout:2/108: write d0/f1d [382393,120061] 0 2024-09-20T18:35:35.809 INFO:tasks.workunit.client.1.smithi172.stdout:1/143: creat d0/d8/f2c x:0 0 0 2024-09-20T18:35:35.815 INFO:tasks.workunit.client.1.smithi172.stdout:3/144: link d0/f10 d0/db/f23 0 2024-09-20T18:35:35.815 INFO:tasks.workunit.client.1.smithi172.stdout:3/145: readlink d0/l1a 0 2024-09-20T18:35:35.816 INFO:tasks.workunit.client.1.smithi172.stdout:1/144: creat d0/d8/db/d25/d2b/f2d x:0 0 0 2024-09-20T18:35:35.818 INFO:tasks.workunit.client.1.smithi172.stdout:3/146: dread d0/f8 [0,4194304] 0 2024-09-20T18:35:35.818 INFO:tasks.workunit.client.1.smithi172.stdout:2/109: creat d0/d4/f1e x:0 0 0 2024-09-20T18:35:35.819 INFO:tasks.workunit.client.1.smithi172.stdout:1/145: symlink d0/d8/db/d25/d2b/l2e 0 2024-09-20T18:35:35.822 INFO:tasks.workunit.client.1.smithi172.stdout:0/236: sync 2024-09-20T18:35:35.822 INFO:tasks.workunit.client.1.smithi172.stdout:4/141: sync 2024-09-20T18:35:35.822 INFO:tasks.workunit.client.1.smithi172.stdout:5/215: sync 2024-09-20T18:35:35.823 INFO:tasks.workunit.client.1.smithi172.stdout:2/110: creat d0/d4/d9/d10/f1f x:0 0 0 2024-09-20T18:35:35.824 INFO:tasks.workunit.client.1.smithi172.stdout:5/216: stat d4/d1d/f2b 0 2024-09-20T18:35:35.824 INFO:tasks.workunit.client.1.smithi172.stdout:0/237: fsync d4/d46/f56 0 2024-09-20T18:35:35.825 INFO:tasks.workunit.client.1.smithi172.stdout:5/217: chown d4/l18 2139 1 2024-09-20T18:35:35.826 INFO:tasks.workunit.client.1.smithi172.stdout:1/146: dwrite d0/d8/db/d25/d2b/f2d [0,4194304] 0 2024-09-20T18:35:35.829 INFO:tasks.workunit.client.1.smithi172.stdout:4/142: dread d0/de/d21/d24/f2d [0,4194304] 0 2024-09-20T18:35:35.830 INFO:tasks.workunit.client.1.smithi172.stdout:2/111: creat d0/d1a/f20 x:0 0 0 2024-09-20T18:35:35.834 INFO:tasks.workunit.client.1.smithi172.stdout:6/136: truncate d0/d18/d1c/f1f 785406 0 2024-09-20T18:35:35.834 INFO:tasks.workunit.client.1.smithi172.stdout:5/218: creat d4/d1f/d26/f47 x:0 0 0 2024-09-20T18:35:35.837 INFO:tasks.workunit.client.1.smithi172.stdout:1/147: dwrite d0/d8/f2a [0,4194304] 0 2024-09-20T18:35:35.837 INFO:tasks.workunit.client.1.smithi172.stdout:5/219: write d4/d1d/f33 [878454,75784] 0 2024-09-20T18:35:35.838 INFO:tasks.workunit.client.1.smithi172.stdout:3/147: truncate d0/f10 4846180 0 2024-09-20T18:35:35.840 INFO:tasks.workunit.client.1.smithi172.stdout:2/112: creat d0/d4/d9/d10/f21 x:0 0 0 2024-09-20T18:35:35.842 INFO:tasks.workunit.client.1.smithi172.stdout:4/143: dwrite d0/de/d21/d24/f2d [0,4194304] 0 2024-09-20T18:35:35.844 INFO:tasks.workunit.client.1.smithi172.stdout:1/148: symlink d0/l2f 0 2024-09-20T18:35:35.849 INFO:tasks.workunit.client.1.smithi172.stdout:4/144: creat d0/d7/df/d18/f3a x:0 0 0 2024-09-20T18:35:35.850 INFO:tasks.workunit.client.1.smithi172.stdout:2/113: dwrite d0/d4/d9/d10/f1f [0,4194304] 0 2024-09-20T18:35:35.851 INFO:tasks.workunit.client.1.smithi172.stdout:4/145: chown d0/d7/df 418705282 1 2024-09-20T18:35:35.852 INFO:tasks.workunit.client.1.smithi172.stdout:4/146: stat d0/d7 0 2024-09-20T18:35:35.852 INFO:tasks.workunit.client.1.smithi172.stdout:2/114: chown d0/f1d 7760803 1 2024-09-20T18:35:35.853 INFO:tasks.workunit.client.1.smithi172.stdout:9/168: truncate d15/d20/f21 1127603 0 2024-09-20T18:35:35.854 INFO:tasks.workunit.client.1.smithi172.stdout:3/148: creat d0/d13/d1e/f24 x:0 0 0 2024-09-20T18:35:35.857 INFO:tasks.workunit.client.1.smithi172.stdout:1/149: dwrite d0/d8/fc [0,4194304] 0 2024-09-20T18:35:35.860 INFO:tasks.workunit.client.1.smithi172.stdout:5/220: link d4/d1d/f3d d4/f48 0 2024-09-20T18:35:35.865 INFO:tasks.workunit.client.1.smithi172.stdout:1/150: mkdir d0/d8/db/d25/d30 0 2024-09-20T18:35:35.865 INFO:tasks.workunit.client.1.smithi172.stdout:4/147: link d0/d7/f12 d0/d7/df/f3b 0 2024-09-20T18:35:35.867 INFO:tasks.workunit.client.1.smithi172.stdout:3/149: symlink d0/l25 0 2024-09-20T18:35:35.867 INFO:tasks.workunit.client.1.smithi172.stdout:9/169: dwrite d15/f1d [0,4194304] 0 2024-09-20T18:35:35.869 INFO:tasks.workunit.client.1.smithi172.stdout:9/170: dread d15/d1a/f25 [0,4194304] 0 2024-09-20T18:35:35.870 INFO:tasks.workunit.client.1.smithi172.stdout:5/221: creat d4/df/d3f/f49 x:0 0 0 2024-09-20T18:35:35.871 INFO:tasks.workunit.client.1.smithi172.stdout:9/171: dread - d15/d1a/f28 zero size 2024-09-20T18:35:35.872 INFO:tasks.workunit.client.1.smithi172.stdout:4/148: chown d0/d7/df/c16 107589 1 2024-09-20T18:35:35.873 INFO:tasks.workunit.client.1.smithi172.stdout:9/172: truncate d15/d1a/d1e/f27 213561 0 2024-09-20T18:35:35.874 INFO:tasks.workunit.client.1.smithi172.stdout:1/151: symlink d0/d8/l31 0 2024-09-20T18:35:35.875 INFO:tasks.workunit.client.1.smithi172.stdout:1/152: stat d0/d8/db 0 2024-09-20T18:35:35.886 INFO:tasks.workunit.client.1.smithi172.stdout:4/149: dwrite d0/de/d21/d24/f2d [0,4194304] 0 2024-09-20T18:35:35.886 INFO:tasks.workunit.client.1.smithi172.stdout:9/173: dwrite d15/f1d [0,4194304] 0 2024-09-20T18:35:35.886 INFO:tasks.workunit.client.1.smithi172.stdout:7/157: dwrite d2/d3/d10/f2d [0,4194304] 0 2024-09-20T18:35:35.886 INFO:tasks.workunit.client.1.smithi172.stdout:1/153: creat d0/d8/f32 x:0 0 0 2024-09-20T18:35:35.890 INFO:tasks.workunit.client.1.smithi172.stdout:1/154: truncate d0/d8/db/f26 56857 0 2024-09-20T18:35:35.894 INFO:tasks.workunit.client.1.smithi172.stdout:4/150: mkdir d0/de/dc/d3c 0 2024-09-20T18:35:35.894 INFO:tasks.workunit.client.1.smithi172.stdout:1/155: write d0/d8/f2a [989713,92771] 0 2024-09-20T18:35:35.898 INFO:tasks.workunit.client.1.smithi172.stdout:7/158: write d2/d3/dd/f19 [254232,111438] 0 2024-09-20T18:35:35.901 INFO:tasks.workunit.client.1.smithi172.stdout:4/151: mknod d0/d7/df/d18/c3d 0 2024-09-20T18:35:35.902 INFO:tasks.workunit.client.1.smithi172.stdout:7/159: mkdir d2/d3/d3d 0 2024-09-20T18:35:35.905 INFO:tasks.workunit.client.1.smithi172.stdout:0/238: dwrite d4/d1a/d28/d34/f4f [4194304,4194304] 0 2024-09-20T18:35:35.921 INFO:tasks.workunit.client.1.smithi172.stdout:1/156: dread d0/f4 [0,4194304] 0 2024-09-20T18:35:35.940 INFO:tasks.workunit.client.1.smithi172.stdout:6/137: sync 2024-09-20T18:35:35.978 INFO:tasks.workunit.client.1.smithi172.stdout:8/132: dread dd/d1b/f21 [0,4194304] 0 2024-09-20T18:35:35.985 INFO:tasks.workunit.client.1.smithi172.stdout:4/152: readlink d0/d7/df/d18/l38 0 2024-09-20T18:35:35.986 INFO:tasks.workunit.client.1.smithi172.stdout:2/115: rename d0/d4/d9 to d0/d4/d17/d22 0 2024-09-20T18:35:35.991 INFO:tasks.workunit.client.1.smithi172.stdout:1/157: creat d0/d8/db/f33 x:0 0 0 2024-09-20T18:35:35.992 INFO:tasks.workunit.client.1.smithi172.stdout:1/158: readlink d0/l2f 0 2024-09-20T18:35:35.992 INFO:tasks.workunit.client.1.smithi172.stdout:1/159: write d0/d8/f16 [1354917,118842] 0 2024-09-20T18:35:35.995 INFO:tasks.workunit.client.1.smithi172.stdout:9/174: dread d15/d20/f21 [0,4194304] 0 2024-09-20T18:35:35.995 INFO:tasks.workunit.client.1.smithi172.stdout:9/175: chown d15/f18 0 1 2024-09-20T18:35:35.998 INFO:tasks.workunit.client.1.smithi172.stdout:4/153: creat d0/d7/df/d18/d1a/f3e x:0 0 0 2024-09-20T18:35:35.999 INFO:tasks.workunit.client.1.smithi172.stdout:4/154: dread - d0/d7/df/d18/f3a zero size 2024-09-20T18:35:35.999 INFO:tasks.workunit.client.1.smithi172.stdout:4/155: stat d0/d7/f12 0 2024-09-20T18:35:35.999 INFO:tasks.workunit.client.1.smithi172.stdout:4/156: stat d0/l36 0 2024-09-20T18:35:36.001 INFO:tasks.workunit.client.1.smithi172.stdout:3/150: rename d0/d13/l14 to d0/db/l26 0 2024-09-20T18:35:36.003 INFO:tasks.workunit.client.1.smithi172.stdout:2/116: symlink d0/d4/d17/d22/d10/l23 0 2024-09-20T18:35:36.003 INFO:tasks.workunit.client.1.smithi172.stdout:2/117: chown d0 26444174 1 2024-09-20T18:35:36.005 INFO:tasks.workunit.client.1.smithi172.stdout:4/157: dwrite d0/de/d21/d24/f2d [0,4194304] 0 2024-09-20T18:35:36.006 INFO:tasks.workunit.client.1.smithi172.stdout:6/138: mknod d0/d18/c28 0 2024-09-20T18:35:36.008 INFO:tasks.workunit.client.1.smithi172.stdout:1/160: unlink d0/d8/f2a 0 2024-09-20T18:35:36.009 INFO:tasks.workunit.client.1.smithi172.stdout:1/161: read d0/d8/db/f26 [12061,16624] 0 2024-09-20T18:35:36.013 INFO:tasks.workunit.client.1.smithi172.stdout:9/176: symlink d15/d1a/d1e/d24/l33 0 2024-09-20T18:35:36.016 INFO:tasks.workunit.client.1.smithi172.stdout:7/160: creat d2/f3e x:0 0 0 2024-09-20T18:35:36.017 INFO:tasks.workunit.client.1.smithi172.stdout:5/222: rename d4/d1d/f21 to d4/d1f/f4a 0 2024-09-20T18:35:36.018 INFO:tasks.workunit.client.1.smithi172.stdout:7/161: rename d2/d1c to d2/d1c/d3f 22 2024-09-20T18:35:36.018 INFO:tasks.workunit.client.1.smithi172.stdout:5/223: dread - d4/d1d/f24 zero size 2024-09-20T18:35:36.019 INFO:tasks.workunit.client.1.smithi172.stdout:3/151: symlink d0/d13/d1e/l27 0 2024-09-20T18:35:36.019 INFO:tasks.workunit.client.1.smithi172.stdout:7/162: write d2/d3/dd/fe [107465,36789] 0 2024-09-20T18:35:36.022 INFO:tasks.workunit.client.1.smithi172.stdout:4/158: rmdir d0/d7/df/d15 39 2024-09-20T18:35:36.027 INFO:tasks.workunit.client.1.smithi172.stdout:1/162: symlink d0/l34 0 2024-09-20T18:35:36.027 INFO:tasks.workunit.client.1.smithi172.stdout:2/118: dwrite d0/d4/fd [0,4194304] 0 2024-09-20T18:35:36.028 INFO:tasks.workunit.client.1.smithi172.stdout:1/163: fsync d0/d22/f28 0 2024-09-20T18:35:36.031 INFO:tasks.workunit.client.1.smithi172.stdout:9/177: rmdir d15/d1a/d1e 39 2024-09-20T18:35:36.031 INFO:tasks.workunit.client.1.smithi172.stdout:1/164: chown d0/d8/l31 77 1 2024-09-20T18:35:36.032 INFO:tasks.workunit.client.1.smithi172.stdout:4/159: dwrite d0/de/f30 [0,4194304] 0 2024-09-20T18:35:36.035 INFO:tasks.workunit.client.1.smithi172.stdout:4/160: dread - d0/d7/df/d18/d1a/f3e zero size 2024-09-20T18:35:36.036 INFO:tasks.workunit.client.1.smithi172.stdout:3/152: creat d0/dc/f28 x:0 0 0 2024-09-20T18:35:36.037 INFO:tasks.workunit.client.1.smithi172.stdout:4/161: stat d0/de/d21/d24/f2d 0 2024-09-20T18:35:36.038 INFO:tasks.workunit.client.1.smithi172.stdout:2/119: dwrite d0/f3 [4194304,4194304] 0 2024-09-20T18:35:36.046 INFO:tasks.workunit.client.1.smithi172.stdout:8/133: link f0 dd/d2b/d34/f36 0 2024-09-20T18:35:36.048 INFO:tasks.workunit.client.1.smithi172.stdout:0/239: dwrite d4/d1d/d15/f3b [0,4194304] 0 2024-09-20T18:35:36.048 INFO:tasks.workunit.client.1.smithi172.stdout:8/134: truncate dd/d1b/f2f 707090 0 2024-09-20T18:35:36.050 INFO:tasks.workunit.client.1.smithi172.stdout:9/178: truncate d15/d1a/d1e/f27 1113390 0 2024-09-20T18:35:36.050 INFO:tasks.workunit.client.1.smithi172.stdout:5/224: unlink d4/df/f1c 0 2024-09-20T18:35:36.053 INFO:tasks.workunit.client.1.smithi172.stdout:6/139: creat d0/d18/f29 x:0 0 0 2024-09-20T18:35:36.054 INFO:tasks.workunit.client.1.smithi172.stdout:5/225: write d4/d1d/d2c/f35 [54714,50490] 0 2024-09-20T18:35:36.056 INFO:tasks.workunit.client.1.smithi172.stdout:4/162: truncate d0/f32 827744 0 2024-09-20T18:35:36.057 INFO:tasks.workunit.client.1.smithi172.stdout:8/135: dwrite f1 [0,4194304] 0 2024-09-20T18:35:36.061 INFO:tasks.workunit.client.1.smithi172.stdout:2/120: rename d0/d4/f1e to d0/d4/d17/d22/d10/f24 0 2024-09-20T18:35:36.062 INFO:tasks.workunit.client.1.smithi172.stdout:2/121: fdatasync d0/d4/d17/d22/d10/f21 0 2024-09-20T18:35:36.066 INFO:tasks.workunit.client.1.smithi172.stdout:1/165: truncate d0/d8/db/fe 1761322 0 2024-09-20T18:35:36.067 INFO:tasks.workunit.client.1.smithi172.stdout:6/140: chown d0/c16 62453816 1 2024-09-20T18:35:36.068 INFO:tasks.workunit.client.1.smithi172.stdout:3/153: creat d0/db/d22/f29 x:0 0 0 2024-09-20T18:35:36.069 INFO:tasks.workunit.client.1.smithi172.stdout:5/226: mkdir d4/d1f/d4b 0 2024-09-20T18:35:36.071 INFO:tasks.workunit.client.1.smithi172.stdout:8/136: chown dd/c18 45968700 1 2024-09-20T18:35:36.072 INFO:tasks.workunit.client.1.smithi172.stdout:6/141: dread d0/d3/f7 [0,4194304] 0 2024-09-20T18:35:36.073 INFO:tasks.workunit.client.1.smithi172.stdout:6/142: chown d0/d18/f29 0 1 2024-09-20T18:35:36.074 INFO:tasks.workunit.client.1.smithi172.stdout:0/240: rename d4/f29 to d4/d1a/d28/d42/d45/d54/f5d 0 2024-09-20T18:35:36.075 INFO:tasks.workunit.client.1.smithi172.stdout:0/241: stat d4/d1d/d15/f50 0 2024-09-20T18:35:36.078 INFO:tasks.workunit.client.1.smithi172.stdout:5/227: mknod d4/d1f/d26/d41/c4c 0 2024-09-20T18:35:36.078 INFO:tasks.workunit.client.1.smithi172.stdout:4/163: symlink d0/de/d21/d24/d34/l3f 0 2024-09-20T18:35:36.081 INFO:tasks.workunit.client.1.smithi172.stdout:0/242: dwrite d4/d1d/f37 [0,4194304] 0 2024-09-20T18:35:36.087 INFO:tasks.workunit.client.1.smithi172.stdout:9/179: rename d15/d1a/d1c to d15/d1a/d1e/d34 0 2024-09-20T18:35:36.090 INFO:tasks.workunit.client.1.smithi172.stdout:7/163: sync 2024-09-20T18:35:36.094 INFO:tasks.workunit.client.1.smithi172.stdout:5/228: mknod d4/d1f/d26/d2d/c4d 0 2024-09-20T18:35:36.094 INFO:tasks.workunit.client.1.smithi172.stdout:9/180: dwrite d15/d1a/f31 [0,4194304] 0 2024-09-20T18:35:36.095 INFO:tasks.workunit.client.1.smithi172.stdout:8/137: symlink dd/l37 0 2024-09-20T18:35:36.099 INFO:tasks.workunit.client.1.smithi172.stdout:7/164: dwrite d2/d3/d10/f18 [0,4194304] 0 2024-09-20T18:35:36.099 INFO:tasks.workunit.client.1.smithi172.stdout:1/166: rmdir d0/d8/db/d25/d30 0 2024-09-20T18:35:36.100 INFO:tasks.workunit.client.1.smithi172.stdout:7/165: chown d2/d3/dd/c36 574371 1 2024-09-20T18:35:36.101 INFO:tasks.workunit.client.1.smithi172.stdout:0/243: creat d4/d1a/d28/f5e x:0 0 0 2024-09-20T18:35:36.102 INFO:tasks.workunit.client.1.smithi172.stdout:7/166: truncate d2/d3/dd/f19 1598152 0 2024-09-20T18:35:36.104 INFO:tasks.workunit.client.1.smithi172.stdout:2/122: rename d0/d4/d17/d22/d10/f24 to d0/d1a/f25 0 2024-09-20T18:35:36.105 INFO:tasks.workunit.client.1.smithi172.stdout:2/123: write d0/d4/fd [8747702,25922] 0 2024-09-20T18:35:36.114 INFO:tasks.workunit.client.1.smithi172.stdout:6/143: dwrite d0/f5 [0,4194304] 0 2024-09-20T18:35:36.115 INFO:tasks.workunit.client.1.smithi172.stdout:8/138: rmdir dd/d1b 39 2024-09-20T18:35:36.116 INFO:tasks.workunit.client.1.smithi172.stdout:1/167: chown d0/d8/d12/c13 31756 1 2024-09-20T18:35:36.122 INFO:tasks.workunit.client.1.smithi172.stdout:7/167: mkdir d2/d3/d10/d40 0 2024-09-20T18:35:36.122 INFO:tasks.workunit.client.1.smithi172.stdout:7/168: dread - d2/d3/d10/f2c zero size 2024-09-20T18:35:36.124 INFO:tasks.workunit.client.1.smithi172.stdout:7/169: write d2/d3/d10/f1b [870295,127128] 0 2024-09-20T18:35:36.129 INFO:tasks.workunit.client.1.smithi172.stdout:9/181: mknod d15/c35 0 2024-09-20T18:35:36.130 INFO:tasks.workunit.client.1.smithi172.stdout:8/139: readlink dd/l14 0 2024-09-20T18:35:36.133 INFO:tasks.workunit.client.1.smithi172.stdout:1/168: symlink d0/d8/db/d25/l35 0 2024-09-20T18:35:36.134 INFO:tasks.workunit.client.1.smithi172.stdout:6/144: dread d0/d18/f1e [0,4194304] 0 2024-09-20T18:35:36.136 INFO:tasks.workunit.client.1.smithi172.stdout:3/154: rename d0/f10 to d0/dc/f2a 0 2024-09-20T18:35:36.137 INFO:tasks.workunit.client.1.smithi172.stdout:5/229: fdatasync d4/f36 0 2024-09-20T18:35:36.138 INFO:tasks.workunit.client.1.smithi172.stdout:9/182: symlink d15/d1a/d1e/d34/l36 0 2024-09-20T18:35:36.138 INFO:tasks.workunit.client.1.smithi172.stdout:9/183: stat d15/d1f 0 2024-09-20T18:35:36.139 INFO:tasks.workunit.client.1.smithi172.stdout:9/184: truncate d15/d1a/d1e/f27 1663053 0 2024-09-20T18:35:36.139 INFO:tasks.workunit.client.1.smithi172.stdout:8/140: creat dd/d2b/f38 x:0 0 0 2024-09-20T18:35:36.140 INFO:tasks.workunit.client.1.smithi172.stdout:0/244: rmdir d4/d1a/d28/d42/d45/d51 0 2024-09-20T18:35:36.141 INFO:tasks.workunit.client.1.smithi172.stdout:0/245: fdatasync d4/d1d/f37 0 2024-09-20T18:35:36.141 INFO:tasks.workunit.client.1.smithi172.stdout:1/169: symlink d0/d8/db/d25/d2b/l36 0 2024-09-20T18:35:36.144 INFO:tasks.workunit.client.1.smithi172.stdout:2/124: link d0/d4/d17/d22/d10/f21 d0/d4/f26 0 2024-09-20T18:35:36.144 INFO:tasks.workunit.client.1.smithi172.stdout:1/170: dread d0/d8/f16 [0,4194304] 0 2024-09-20T18:35:36.145 INFO:tasks.workunit.client.1.smithi172.stdout:2/125: read - d0/d4/f26 zero size 2024-09-20T18:35:36.146 INFO:tasks.workunit.client.1.smithi172.stdout:8/141: rmdir dd/d2b/d34 39 2024-09-20T18:35:36.146 INFO:tasks.workunit.client.1.smithi172.stdout:1/171: dread - d0/d8/f2c zero size 2024-09-20T18:35:36.151 INFO:tasks.workunit.client.1.smithi172.stdout:3/155: link d0/f8 d0/dc/f2b 0 2024-09-20T18:35:36.152 INFO:tasks.workunit.client.1.smithi172.stdout:0/246: dwrite d4/d5/d2e/d33/f5a [0,4194304] 0 2024-09-20T18:35:36.155 INFO:tasks.workunit.client.1.smithi172.stdout:9/185: mkdir d15/d1f/d2c/d37 0 2024-09-20T18:35:36.158 INFO:tasks.workunit.client.1.smithi172.stdout:2/126: mknod d0/d1a/c27 0 2024-09-20T18:35:36.159 INFO:tasks.workunit.client.1.smithi172.stdout:5/230: dwrite d4/d1d/f25 [0,4194304] 0 2024-09-20T18:35:36.160 INFO:tasks.workunit.client.1.smithi172.stdout:8/142: dwrite f1 [0,4194304] 0 2024-09-20T18:35:36.161 INFO:tasks.workunit.client.1.smithi172.stdout:4/164: rename d0/d7/df/d15/f1d to d0/d7/df/f40 0 2024-09-20T18:35:36.164 INFO:tasks.workunit.client.1.smithi172.stdout:1/172: creat d0/d8/db/d25/d2b/f37 x:0 0 0 2024-09-20T18:35:36.167 INFO:tasks.workunit.client.1.smithi172.stdout:3/156: dwrite d0/f16 [4194304,4194304] 0 2024-09-20T18:35:36.170 INFO:tasks.workunit.client.1.smithi172.stdout:6/145: getdents d0/d18 0 2024-09-20T18:35:36.171 INFO:tasks.workunit.client.1.smithi172.stdout:4/165: chown d0/f2a 6 1 2024-09-20T18:35:36.174 INFO:tasks.workunit.client.1.smithi172.stdout:7/170: rename d2/d3/f7 to d2/d3/dd/f41 0 2024-09-20T18:35:36.177 INFO:tasks.workunit.client.1.smithi172.stdout:7/171: read - d2/d3/dd/f1d zero size 2024-09-20T18:35:36.177 INFO:tasks.workunit.client.1.smithi172.stdout:8/143: mkdir dd/d2b/d34/d39 0 2024-09-20T18:35:36.180 INFO:tasks.workunit.client.1.smithi172.stdout:6/146: dwrite d0/d18/f29 [0,4194304] 0 2024-09-20T18:35:36.181 INFO:tasks.workunit.client.1.smithi172.stdout:3/157: creat d0/d13/f2c x:0 0 0 2024-09-20T18:35:36.182 INFO:tasks.workunit.client.1.smithi172.stdout:9/186: truncate f12 2387197 0 2024-09-20T18:35:36.187 INFO:tasks.workunit.client.1.smithi172.stdout:4/166: fdatasync d0/d7/f12 0 2024-09-20T18:35:36.188 INFO:tasks.workunit.client.1.smithi172.stdout:3/158: dwrite d0/d13/d1e/f24 [0,4194304] 0 2024-09-20T18:35:36.189 INFO:tasks.workunit.client.1.smithi172.stdout:4/167: dread - d0/d7/df/d18/d1a/f3e zero size 2024-09-20T18:35:36.195 INFO:tasks.workunit.client.1.smithi172.stdout:1/173: rename d0/l20 to d0/d8/db/d25/d2b/l38 0 2024-09-20T18:35:36.195 INFO:tasks.workunit.client.1.smithi172.stdout:9/187: rename d15/d1a to d15/d1a/d1e/d34/d38 22 2024-09-20T18:35:36.195 INFO:tasks.workunit.client.1.smithi172.stdout:9/188: chown d15/d1a/d1e/d34 6 1 2024-09-20T18:35:36.195 INFO:tasks.workunit.client.1.smithi172.stdout:1/174: dread - d0/d22/f28 zero size 2024-09-20T18:35:36.196 INFO:tasks.workunit.client.1.smithi172.stdout:3/159: dread d0/f8 [0,4194304] 0 2024-09-20T18:35:36.197 INFO:tasks.workunit.client.1.smithi172.stdout:9/189: chown d15/d1f/l2d 661364 1 2024-09-20T18:35:36.197 INFO:tasks.workunit.client.1.smithi172.stdout:7/172: creat d2/d3/dd/f42 x:0 0 0 2024-09-20T18:35:36.201 INFO:tasks.workunit.client.1.smithi172.stdout:5/231: creat d4/f4e x:0 0 0 2024-09-20T18:35:36.203 INFO:tasks.workunit.client.1.smithi172.stdout:8/144: mknod dd/d1b/c3a 0 2024-09-20T18:35:36.203 INFO:tasks.workunit.client.1.smithi172.stdout:2/127: link d0/d4/d17/d22/c11 d0/d4/d17/d22/c28 0 2024-09-20T18:35:36.203 INFO:tasks.workunit.client.1.smithi172.stdout:8/145: dread - dd/d1b/f31 zero size 2024-09-20T18:35:36.204 INFO:tasks.workunit.client.1.smithi172.stdout:1/175: mkdir d0/d8/db/d39 0 2024-09-20T18:35:36.205 INFO:tasks.workunit.client.1.smithi172.stdout:3/160: creat d0/d13/d1e/f2d x:0 0 0 2024-09-20T18:35:36.206 INFO:tasks.workunit.client.1.smithi172.stdout:3/161: readlink d0/l17 0 2024-09-20T18:35:36.206 INFO:tasks.workunit.client.1.smithi172.stdout:0/247: getdents d4/d1a/d28/d42 0 2024-09-20T18:35:36.207 INFO:tasks.workunit.client.1.smithi172.stdout:7/173: mknod d2/d1c/c43 0 2024-09-20T18:35:36.207 INFO:tasks.workunit.client.1.smithi172.stdout:0/248: chown d4/d1a/d28/d42/d45 5010 1 2024-09-20T18:35:36.210 INFO:tasks.workunit.client.1.smithi172.stdout:5/232: truncate d4/df/f22 1217723 0 2024-09-20T18:35:36.211 INFO:tasks.workunit.client.1.smithi172.stdout:2/128: unlink d0/f1d 0 2024-09-20T18:35:36.213 INFO:tasks.workunit.client.1.smithi172.stdout:8/146: mkdir dd/d1b/d3b 0 2024-09-20T18:35:36.218 INFO:tasks.workunit.client.1.smithi172.stdout:3/162: creat d0/dc/f2e x:0 0 0 2024-09-20T18:35:36.218 INFO:tasks.workunit.client.1.smithi172.stdout:3/163: stat d0/dc/c19 0 2024-09-20T18:35:36.218 INFO:tasks.workunit.client.1.smithi172.stdout:3/164: chown d0/dc/f2e 353648207 1 2024-09-20T18:35:36.221 INFO:tasks.workunit.client.1.smithi172.stdout:0/249: dread d4/d1d/d15/f50 [0,4194304] 0 2024-09-20T18:35:36.226 INFO:tasks.workunit.client.1.smithi172.stdout:2/129: mkdir d0/d4/d17/d18/d29 0 2024-09-20T18:35:36.227 INFO:tasks.workunit.client.1.smithi172.stdout:4/168: truncate d0/d7/df/f3b 96563 0 2024-09-20T18:35:36.230 INFO:tasks.workunit.client.1.smithi172.stdout:3/165: symlink d0/db/l2f 0 2024-09-20T18:35:36.231 INFO:tasks.workunit.client.1.smithi172.stdout:7/174: creat d2/d23/d3c/f44 x:0 0 0 2024-09-20T18:35:36.232 INFO:tasks.workunit.client.1.smithi172.stdout:3/166: write d0/dc/f2e [1023428,42710] 0 2024-09-20T18:35:36.233 INFO:tasks.workunit.client.1.smithi172.stdout:4/169: dwrite d0/de/dc/f22 [0,4194304] 0 2024-09-20T18:35:36.235 INFO:tasks.workunit.client.1.smithi172.stdout:0/250: rmdir d4/d20 39 2024-09-20T18:35:36.235 INFO:tasks.workunit.client.1.smithi172.stdout:6/147: write d0/d18/d1c/f1f [1064366,54881] 0 2024-09-20T18:35:36.237 INFO:tasks.workunit.client.1.smithi172.stdout:8/147: creat dd/d1b/d3b/f3c x:0 0 0 2024-09-20T18:35:36.239 INFO:tasks.workunit.client.1.smithi172.stdout:1/176: link d0/l34 d0/d8/db/l3a 0 2024-09-20T18:35:36.240 INFO:tasks.workunit.client.1.smithi172.stdout:9/190: write d15/f1b [1461535,89176] 0 2024-09-20T18:35:36.241 INFO:tasks.workunit.client.1.smithi172.stdout:3/167: fdatasync d0/f7 0 2024-09-20T18:35:36.242 INFO:tasks.workunit.client.1.smithi172.stdout:4/170: creat d0/d7/df/d15/f41 x:0 0 0 2024-09-20T18:35:36.243 INFO:tasks.workunit.client.1.smithi172.stdout:7/175: dwrite d2/f25 [0,4194304] 0 2024-09-20T18:35:36.243 INFO:tasks.workunit.client.1.smithi172.stdout:3/168: chown d0/dc/f2e 4 1 2024-09-20T18:35:36.244 INFO:tasks.workunit.client.1.smithi172.stdout:4/171: fdatasync d0/de/d21/f2b 0 2024-09-20T18:35:36.245 INFO:tasks.workunit.client.1.smithi172.stdout:4/172: chown d0/de 456 1 2024-09-20T18:35:36.245 INFO:tasks.workunit.client.1.smithi172.stdout:7/176: chown d2/d3/fa 1534174 1 2024-09-20T18:35:36.247 INFO:tasks.workunit.client.1.smithi172.stdout:4/173: truncate d0/d7/df/d15/f37 990060 0 2024-09-20T18:35:36.254 INFO:tasks.workunit.client.1.smithi172.stdout:0/251: unlink d4/d1a/d28/d42/d45/l4a 0 2024-09-20T18:35:36.254 INFO:tasks.workunit.client.1.smithi172.stdout:0/252: chown d4/d1a/d28/d34/f4f 99 1 2024-09-20T18:35:36.255 INFO:tasks.workunit.client.1.smithi172.stdout:0/253: chown d4/d1a/d28/d42 1953 1 2024-09-20T18:35:36.258 INFO:tasks.workunit.client.1.smithi172.stdout:1/177: unlink d0/d8/db/d25/d2b/l2e 0 2024-09-20T18:35:36.260 INFO:tasks.workunit.client.1.smithi172.stdout:5/233: link d4/df/l31 d4/d1f/d26/d41/l4f 0 2024-09-20T18:35:36.261 INFO:tasks.workunit.client.1.smithi172.stdout:7/177: creat d2/d3/f45 x:0 0 0 2024-09-20T18:35:36.262 INFO:tasks.workunit.client.1.smithi172.stdout:7/178: dread - d2/d3/f45 zero size 2024-09-20T18:35:36.267 INFO:tasks.workunit.client.1.smithi172.stdout:0/254: mknod d4/d44/c5f 0 2024-09-20T18:35:36.269 INFO:tasks.workunit.client.1.smithi172.stdout:1/178: chown d0/d8/db/l3a 2082 1 2024-09-20T18:35:36.270 INFO:tasks.workunit.client.1.smithi172.stdout:3/169: symlink d0/l30 0 2024-09-20T18:35:36.271 INFO:tasks.workunit.client.1.smithi172.stdout:2/130: getdents d0/d4 0 2024-09-20T18:35:36.272 INFO:tasks.workunit.client.1.smithi172.stdout:4/174: mkdir d0/d7/df/d42 0 2024-09-20T18:35:36.273 INFO:tasks.workunit.client.1.smithi172.stdout:6/148: rmdir d0/d3/d25 0 2024-09-20T18:35:36.274 INFO:tasks.workunit.client.1.smithi172.stdout:0/255: rmdir d4/d46 39 2024-09-20T18:35:36.275 INFO:tasks.workunit.client.1.smithi172.stdout:9/191: creat d15/f39 x:0 0 0 2024-09-20T18:35:36.278 INFO:tasks.workunit.client.1.smithi172.stdout:7/179: mkdir d2/d3/d10/d40/d46 0 2024-09-20T18:35:36.279 INFO:tasks.workunit.client.1.smithi172.stdout:3/170: creat d0/dc/f31 x:0 0 0 2024-09-20T18:35:36.279 INFO:tasks.workunit.client.1.smithi172.stdout:3/171: dread - d0/dc/f28 zero size 2024-09-20T18:35:36.281 INFO:tasks.workunit.client.1.smithi172.stdout:4/175: mknod d0/d7/df/d18/c43 0 2024-09-20T18:35:36.283 INFO:tasks.workunit.client.1.smithi172.stdout:6/149: rename d0/d18/f24 to d0/d3/f2a 0 2024-09-20T18:35:36.283 INFO:tasks.workunit.client.1.smithi172.stdout:6/150: stat d0/f5 0 2024-09-20T18:35:36.284 INFO:tasks.workunit.client.1.smithi172.stdout:0/256: mkdir d4/d1a/d28/d34/d60 0 2024-09-20T18:35:36.285 INFO:tasks.workunit.client.1.smithi172.stdout:9/192: creat d15/d20/f3a x:0 0 0 2024-09-20T18:35:36.285 INFO:tasks.workunit.client.1.smithi172.stdout:9/193: chown d15/d20/c32 2021 1 2024-09-20T18:35:36.286 INFO:tasks.workunit.client.1.smithi172.stdout:5/234: rmdir d4/d1f/d4b 0 2024-09-20T18:35:36.288 INFO:tasks.workunit.client.1.smithi172.stdout:3/172: mkdir d0/d13/d32 0 2024-09-20T18:35:36.291 INFO:tasks.workunit.client.1.smithi172.stdout:0/257: creat d4/d44/f61 x:0 0 0 2024-09-20T18:35:36.293 INFO:tasks.workunit.client.1.smithi172.stdout:1/179: link d0/lf d0/d8/db/d39/l3b 0 2024-09-20T18:35:36.294 INFO:tasks.workunit.client.1.smithi172.stdout:2/131: link d0/d4/d17/d22/d10/f21 d0/d4/f2a 0 2024-09-20T18:35:36.295 INFO:tasks.workunit.client.1.smithi172.stdout:4/176: symlink d0/de/l44 0 2024-09-20T18:35:36.298 INFO:tasks.workunit.client.1.smithi172.stdout:0/258: dwrite d4/f6 [0,4194304] 0 2024-09-20T18:35:36.301 INFO:tasks.workunit.client.1.smithi172.stdout:3/173: dread d0/dc/f2a [0,4194304] 0 2024-09-20T18:35:36.302 INFO:tasks.workunit.client.1.smithi172.stdout:5/235: rename d4/d1d to d4/d1f/d26/d2d/d50 0 2024-09-20T18:35:36.302 INFO:tasks.workunit.client.1.smithi172.stdout:9/194: dread f14 [0,4194304] 0 2024-09-20T18:35:36.303 INFO:tasks.workunit.client.1.smithi172.stdout:0/259: symlink d4/d1a/d28/d42/l62 0 2024-09-20T18:35:36.305 INFO:tasks.workunit.client.1.smithi172.stdout:3/174: mkdir d0/d13/d1e/d33 0 2024-09-20T18:35:36.305 INFO:tasks.workunit.client.1.smithi172.stdout:0/260: write d4/d5/d2e/d38/f4b [17608,113258] 0 2024-09-20T18:35:36.306 INFO:tasks.workunit.client.1.smithi172.stdout:3/175: fsync d0/dc/f2e 0 2024-09-20T18:35:36.307 INFO:tasks.workunit.client.1.smithi172.stdout:7/180: getdents d2/d3 0 2024-09-20T18:35:36.307 INFO:tasks.workunit.client.1.smithi172.stdout:4/177: mknod d0/d7/df/d42/c45 0 2024-09-20T18:35:36.308 INFO:tasks.workunit.client.1.smithi172.stdout:7/181: readlink d2/l11 0 2024-09-20T18:35:36.312 INFO:tasks.workunit.client.1.smithi172.stdout:0/261: symlink d4/d1a/l63 0 2024-09-20T18:35:36.315 INFO:tasks.workunit.client.1.smithi172.stdout:3/176: truncate d0/dc/f2b 33575 0 2024-09-20T18:35:36.317 INFO:tasks.workunit.client.1.smithi172.stdout:9/195: truncate f14 3018435 0 2024-09-20T18:35:36.318 INFO:tasks.workunit.client.1.smithi172.stdout:4/178: creat d0/de/d39/f46 x:0 0 0 2024-09-20T18:35:36.320 INFO:tasks.workunit.client.1.smithi172.stdout:0/262: creat d4/d1a/d28/d42/d45/d54/f64 x:0 0 0 2024-09-20T18:35:36.320 INFO:tasks.workunit.client.1.smithi172.stdout:4/179: write d0/de/d39/f46 [425632,30627] 0 2024-09-20T18:35:36.321 INFO:tasks.workunit.client.1.smithi172.stdout:5/236: dread d4/d1f/d26/f32 [0,4194304] 0 2024-09-20T18:35:36.322 INFO:tasks.workunit.client.1.smithi172.stdout:3/177: dwrite d0/d13/d1e/f24 [0,4194304] 0 2024-09-20T18:35:36.324 INFO:tasks.workunit.client.1.smithi172.stdout:9/196: creat d15/d1a/d1e/d34/f3b x:0 0 0 2024-09-20T18:35:36.324 INFO:tasks.workunit.client.1.smithi172.stdout:8/148: sync 2024-09-20T18:35:36.327 INFO:tasks.workunit.client.1.smithi172.stdout:7/182: rename d2/d3/dd/f41 to d2/f47 0 2024-09-20T18:35:36.328 INFO:tasks.workunit.client.1.smithi172.stdout:5/237: chown d4/fe 34431405 1 2024-09-20T18:35:36.331 INFO:tasks.workunit.client.1.smithi172.stdout:3/178: creat d0/db/d22/f34 x:0 0 0 2024-09-20T18:35:36.333 INFO:tasks.workunit.client.1.smithi172.stdout:0/263: truncate d4/d5/fc 3092841 0 2024-09-20T18:35:36.335 INFO:tasks.workunit.client.1.smithi172.stdout:7/183: mknod d2/d3/c48 0 2024-09-20T18:35:36.337 INFO:tasks.workunit.client.1.smithi172.stdout:5/238: creat d4/d1f/f51 x:0 0 0 2024-09-20T18:35:36.339 INFO:tasks.workunit.client.1.smithi172.stdout:6/151: truncate d0/fc 10224125 0 2024-09-20T18:35:36.341 INFO:tasks.workunit.client.1.smithi172.stdout:0/264: dwrite d4/d1d/d15/f1b [0,4194304] 0 2024-09-20T18:35:36.341 INFO:tasks.workunit.client.1.smithi172.stdout:2/132: chown d0/d4/d17/d22/cf 1 1 2024-09-20T18:35:36.343 INFO:tasks.workunit.client.1.smithi172.stdout:1/180: write d0/d8/f14 [745515,81001] 0 2024-09-20T18:35:36.344 INFO:tasks.workunit.client.1.smithi172.stdout:7/184: creat d2/d3/dd/f49 x:0 0 0 2024-09-20T18:35:36.345 INFO:tasks.workunit.client.1.smithi172.stdout:1/181: read d0/f4 [2947357,97468] 0 2024-09-20T18:35:36.345 INFO:tasks.workunit.client.1.smithi172.stdout:7/185: chown d2/d3/d10/f2c 242523538 1 2024-09-20T18:35:36.346 INFO:tasks.workunit.client.1.smithi172.stdout:8/149: creat dd/f3d x:0 0 0 2024-09-20T18:35:36.346 INFO:tasks.workunit.client.1.smithi172.stdout:1/182: stat d0/d8/f32 0 2024-09-20T18:35:36.347 INFO:tasks.workunit.client.1.smithi172.stdout:8/150: write dd/d2b/f38 [611100,10129] 0 2024-09-20T18:35:36.351 INFO:tasks.workunit.client.1.smithi172.stdout:0/265: truncate d4/d46/f56 208308 0 2024-09-20T18:35:36.353 INFO:tasks.workunit.client.1.smithi172.stdout:2/133: rename d0/d4/d17/d22/d10/l23 to d0/d4/d17/d22/d10/l2b 0 2024-09-20T18:35:36.353 INFO:tasks.workunit.client.1.smithi172.stdout:8/151: dwrite dd/f27 [0,4194304] 0 2024-09-20T18:35:36.357 INFO:tasks.workunit.client.1.smithi172.stdout:1/183: creat d0/d8/db/f3c x:0 0 0 2024-09-20T18:35:36.358 INFO:tasks.workunit.client.1.smithi172.stdout:1/184: dread - d0/d8/d12/f1f zero size 2024-09-20T18:35:36.362 INFO:tasks.workunit.client.1.smithi172.stdout:0/266: mknod d4/d5/d2e/c65 0 2024-09-20T18:35:36.366 INFO:tasks.workunit.client.1.smithi172.stdout:3/179: write d0/f7 [1850888,42588] 0 2024-09-20T18:35:36.369 INFO:tasks.workunit.client.1.smithi172.stdout:4/180: rename d0/d7/c20 to d0/c47 0 2024-09-20T18:35:36.370 INFO:tasks.workunit.client.1.smithi172.stdout:1/185: dread d0/d8/db/f26 [0,4194304] 0 2024-09-20T18:35:36.372 INFO:tasks.workunit.client.1.smithi172.stdout:0/267: creat d4/d1a/f66 x:0 0 0 2024-09-20T18:35:36.372 INFO:tasks.workunit.client.1.smithi172.stdout:0/268: chown d4/f6 21 1 2024-09-20T18:35:36.379 INFO:tasks.workunit.client.1.smithi172.stdout:9/197: rename d15/f39 to d15/d1f/d2c/d37/f3c 0 2024-09-20T18:35:36.380 INFO:tasks.workunit.client.1.smithi172.stdout:6/152: creat d0/d18/f2b x:0 0 0 2024-09-20T18:35:36.384 INFO:tasks.workunit.client.1.smithi172.stdout:0/269: mkdir d4/d5/d2e/d67 0 2024-09-20T18:35:36.384 INFO:tasks.workunit.client.1.smithi172.stdout:6/153: dread d0/d3/f2a [0,4194304] 0 2024-09-20T18:35:36.387 INFO:tasks.workunit.client.1.smithi172.stdout:3/180: mknod d0/d13/d32/c35 0 2024-09-20T18:35:36.391 INFO:tasks.workunit.client.1.smithi172.stdout:4/181: mkdir d0/d48 0 2024-09-20T18:35:36.394 INFO:tasks.workunit.client.1.smithi172.stdout:8/152: write f0 [4149754,84543] 0 2024-09-20T18:35:36.396 INFO:tasks.workunit.client.1.smithi172.stdout:5/239: rename d4/d1f/d26/d2d/c4d to d4/df/c52 0 2024-09-20T18:35:36.398 INFO:tasks.workunit.client.1.smithi172.stdout:5/240: write d4/df/d3f/f43 [4731313,27015] 0 2024-09-20T18:35:36.401 INFO:tasks.workunit.client.1.smithi172.stdout:8/153: dread dd/d1b/f21 [4194304,4194304] 0 2024-09-20T18:35:36.401 INFO:tasks.workunit.client.1.smithi172.stdout:3/181: mknod d0/d13/d32/c36 0 2024-09-20T18:35:36.402 INFO:tasks.workunit.client.1.smithi172.stdout:5/241: chown d4/d1f/d26/d2d/d50/f20 37014259 1 2024-09-20T18:35:36.403 INFO:tasks.workunit.client.1.smithi172.stdout:2/134: dwrite d0/d4/d17/d22/d10/f21 [0,4194304] 0 2024-09-20T18:35:36.404 INFO:tasks.workunit.client.1.smithi172.stdout:9/198: fsync f12 0 2024-09-20T18:35:36.407 INFO:tasks.workunit.client.1.smithi172.stdout:9/199: truncate d15/f1b 1663382 0 2024-09-20T18:35:36.407 INFO:tasks.workunit.client.1.smithi172.stdout:8/154: chown dd/f1c 4840 1 2024-09-20T18:35:36.407 INFO:tasks.workunit.client.1.smithi172.stdout:4/182: mknod d0/d7/df/c49 0 2024-09-20T18:35:36.408 INFO:tasks.workunit.client.1.smithi172.stdout:3/182: mkdir d0/d13/d32/d37 0 2024-09-20T18:35:36.409 INFO:tasks.workunit.client.1.smithi172.stdout:4/183: dread - d0/d7/df/d15/f41 zero size 2024-09-20T18:35:36.414 INFO:tasks.workunit.client.1.smithi172.stdout:1/186: getdents d0/d8/db 0 2024-09-20T18:35:36.414 INFO:tasks.workunit.client.1.smithi172.stdout:5/242: dwrite d4/d1f/d26/f32 [0,4194304] 0 2024-09-20T18:35:36.415 INFO:tasks.workunit.client.1.smithi172.stdout:1/187: truncate d0/d8/f2c 503266 0 2024-09-20T18:35:36.416 INFO:tasks.workunit.client.1.smithi172.stdout:1/188: fsync d0/d8/db/f3c 0 2024-09-20T18:35:36.417 INFO:tasks.workunit.client.1.smithi172.stdout:1/189: dread - d0/d8/db/f18 zero size 2024-09-20T18:35:36.418 INFO:tasks.workunit.client.1.smithi172.stdout:4/184: chown d0/fa 30879437 1 2024-09-20T18:35:36.422 INFO:tasks.workunit.client.1.smithi172.stdout:2/135: mkdir d0/d2c 0 2024-09-20T18:35:36.424 INFO:tasks.workunit.client.1.smithi172.stdout:7/186: rename f0 to d2/f4a 0 2024-09-20T18:35:36.426 INFO:tasks.workunit.client.1.smithi172.stdout:5/243: creat d4/df/f53 x:0 0 0 2024-09-20T18:35:36.428 INFO:tasks.workunit.client.1.smithi172.stdout:8/155: symlink dd/l3e 0 2024-09-20T18:35:36.430 INFO:tasks.workunit.client.1.smithi172.stdout:1/190: truncate d0/d8/f16 1807896 0 2024-09-20T18:35:36.430 INFO:tasks.workunit.client.1.smithi172.stdout:1/191: dread - d0/d22/f28 zero size 2024-09-20T18:35:36.433 INFO:tasks.workunit.client.1.smithi172.stdout:2/136: mkdir d0/d4/d17/d18/d2d 0 2024-09-20T18:35:36.434 INFO:tasks.workunit.client.1.smithi172.stdout:0/270: rename d4/d1a/d28/d34/c47 to d4/d46/c68 0 2024-09-20T18:35:36.437 INFO:tasks.workunit.client.1.smithi172.stdout:5/244: chown d4/f36 1332 1 2024-09-20T18:35:36.438 INFO:tasks.workunit.client.1.smithi172.stdout:5/245: dread - d4/d1f/d26/d2d/d50/d2c/f38 zero size 2024-09-20T18:35:36.438 INFO:tasks.workunit.client.1.smithi172.stdout:8/156: mknod dd/d1b/d3b/c3f 0 2024-09-20T18:35:36.441 INFO:tasks.workunit.client.1.smithi172.stdout:1/192: mkdir d0/d8/db/d25/d2b/d3d 0 2024-09-20T18:35:36.444 INFO:tasks.workunit.client.1.smithi172.stdout:9/200: dwrite f14 [0,4194304] 0 2024-09-20T18:35:36.444 INFO:tasks.workunit.client.1.smithi172.stdout:3/183: rename d0/dc/c19 to d0/d13/d1e/c38 0 2024-09-20T18:35:36.446 INFO:tasks.workunit.client.1.smithi172.stdout:9/201: write d15/f1b [1808693,58633] 0 2024-09-20T18:35:36.446 INFO:tasks.workunit.client.1.smithi172.stdout:0/271: fsync d4/d1d/d15/f50 0 2024-09-20T18:35:36.446 INFO:tasks.workunit.client.1.smithi172.stdout:3/184: chown d0/dc/f2a 2131519 1 2024-09-20T18:35:36.448 INFO:tasks.workunit.client.1.smithi172.stdout:6/154: link d0/f13 d0/d18/d1c/d22/f2c 0 2024-09-20T18:35:36.453 INFO:tasks.workunit.client.1.smithi172.stdout:7/187: dwrite d2/d3/d10/f15 [0,4194304] 0 2024-09-20T18:35:36.455 INFO:tasks.workunit.client.1.smithi172.stdout:4/185: rename d0/d7/df/d18/d1a/c31 to d0/d7/df/d18/c4a 0 2024-09-20T18:35:36.456 INFO:tasks.workunit.client.1.smithi172.stdout:0/272: creat d4/d1d/d15/f69 x:0 0 0 2024-09-20T18:35:36.458 INFO:tasks.workunit.client.1.smithi172.stdout:0/273: write d4/f6 [628618,59510] 0 2024-09-20T18:35:36.458 INFO:tasks.workunit.client.1.smithi172.stdout:3/185: symlink d0/d13/d32/l39 0 2024-09-20T18:35:36.460 INFO:tasks.workunit.client.1.smithi172.stdout:2/137: rmdir d0/d4/d17/d18/d2d 0 2024-09-20T18:35:36.460 INFO:tasks.workunit.client.1.smithi172.stdout:0/274: truncate d4/d1d/d15/f69 712235 0 2024-09-20T18:35:36.461 INFO:tasks.workunit.client.1.smithi172.stdout:1/193: creat d0/d8/db/d25/d2b/d3d/f3e x:0 0 0 2024-09-20T18:35:36.478 INFO:tasks.workunit.client.1.smithi172.stdout:3/186: mkdir d0/db/d3a 0 2024-09-20T18:35:36.478 INFO:tasks.workunit.client.1.smithi172.stdout:1/194: write d0/d22/f28 [860954,123527] 0 2024-09-20T18:35:36.479 INFO:tasks.workunit.client.1.smithi172.stdout:6/155: mknod d0/d18/d1c/d22/d27/c2d 0 2024-09-20T18:35:36.479 INFO:tasks.workunit.client.1.smithi172.stdout:0/275: creat d4/d5/f6a x:0 0 0 2024-09-20T18:35:36.481 INFO:tasks.workunit.client.1.smithi172.stdout:9/202: link d15/d1f/l2d d15/d1a/d1e/d24/l3d 0 2024-09-20T18:35:36.486 INFO:tasks.workunit.client.1.smithi172.stdout:1/195: chown d0/f10 242633 1 2024-09-20T18:35:36.489 INFO:tasks.workunit.client.1.smithi172.stdout:2/138: dwrite d0/d4/d17/d22/d10/f1f [0,4194304] 0 2024-09-20T18:35:36.489 INFO:tasks.workunit.client.1.smithi172.stdout:1/196: fsync d0/d8/db/f1b 0 2024-09-20T18:35:36.489 INFO:tasks.workunit.client.1.smithi172.stdout:8/157: rename dd/lf to dd/d2b/l40 0 2024-09-20T18:35:36.491 INFO:tasks.workunit.client.1.smithi172.stdout:8/158: dread - dd/d1b/d3b/f3c zero size 2024-09-20T18:35:36.493 INFO:tasks.workunit.client.1.smithi172.stdout:1/197: write d0/d8/d12/f29 [738408,35134] 0 2024-09-20T18:35:36.493 INFO:tasks.workunit.client.1.smithi172.stdout:8/159: read - dd/d1b/f2c zero size 2024-09-20T18:35:36.494 INFO:tasks.workunit.client.1.smithi172.stdout:5/246: dwrite d4/f17 [4194304,4194304] 0 2024-09-20T18:35:36.496 INFO:tasks.workunit.client.1.smithi172.stdout:9/203: creat d15/d1a/d1e/d24/f3e x:0 0 0 2024-09-20T18:35:36.497 INFO:tasks.workunit.client.1.smithi172.stdout:6/156: getdents d0/d18/d1c/d21/d26 0 2024-09-20T18:35:36.568 INFO:tasks.workunit.client.1.smithi172.stdout:1/198: truncate d0/d8/f2c 1468957 0 2024-09-20T18:35:36.569 INFO:tasks.workunit.client.1.smithi172.stdout:3/187: truncate d0/f18 3409405 0 2024-09-20T18:35:36.569 INFO:tasks.workunit.client.1.smithi172.stdout:6/157: chown d0/d3/c11 31642261 1 2024-09-20T18:35:36.570 INFO:tasks.workunit.client.1.smithi172.stdout:0/276: truncate d4/d1d/d15/f3b 45947 0 2024-09-20T18:35:36.570 INFO:tasks.workunit.client.1.smithi172.stdout:5/247: creat d4/d1f/d26/d41/f54 x:0 0 0 2024-09-20T18:35:36.571 INFO:tasks.workunit.client.1.smithi172.stdout:3/188: dread - d0/d13/d1e/f2d zero size 2024-09-20T18:35:36.571 INFO:tasks.workunit.client.1.smithi172.stdout:4/186: rename d0/d7/df/d18/d1a/c1b to d0/de/c4b 0 2024-09-20T18:35:36.573 INFO:tasks.workunit.client.1.smithi172.stdout:1/199: creat d0/d8/db/d25/d2b/f3f x:0 0 0 2024-09-20T18:35:36.573 INFO:tasks.workunit.client.1.smithi172.stdout:0/277: dread - d4/d1a/d28/d42/d45/f52 zero size 2024-09-20T18:35:36.574 INFO:tasks.workunit.client.1.smithi172.stdout:8/160: dwrite dd/f27 [0,4194304] 0 2024-09-20T18:35:36.575 INFO:tasks.workunit.client.1.smithi172.stdout:0/278: dread - d4/d44/f5c zero size 2024-09-20T18:35:36.577 INFO:tasks.workunit.client.1.smithi172.stdout:6/158: creat d0/d18/d1c/d22/f2e x:0 0 0 2024-09-20T18:35:36.577 INFO:tasks.workunit.client.1.smithi172.stdout:0/279: write d4/d1d/d15/f1b [844767,110463] 0 2024-09-20T18:35:36.578 INFO:tasks.workunit.client.1.smithi172.stdout:5/248: readlink d4/df/d3f/l46 0 2024-09-20T18:35:36.582 INFO:tasks.workunit.client.1.smithi172.stdout:6/159: dread - d0/d18/d1c/d22/f2e zero size 2024-09-20T18:35:36.583 INFO:tasks.workunit.client.1.smithi172.stdout:0/280: chown d4/d1a/l63 80150881 1 2024-09-20T18:35:36.585 INFO:tasks.workunit.client.1.smithi172.stdout:1/200: dwrite d0/d8/db/f33 [0,4194304] 0 2024-09-20T18:35:36.586 INFO:tasks.workunit.client.1.smithi172.stdout:0/281: write d4/d5/d2e/d33/f5a [2461651,57777] 0 2024-09-20T18:35:36.587 INFO:tasks.workunit.client.1.smithi172.stdout:0/282: chown d4/d1a/l63 5 1 2024-09-20T18:35:36.588 INFO:tasks.workunit.client.1.smithi172.stdout:0/283: fsync d4/d1a/d28/f5e 0 2024-09-20T18:35:36.592 INFO:tasks.workunit.client.1.smithi172.stdout:5/249: rename d4/d1f/f44 to d4/d1f/d26/d2d/f55 0 2024-09-20T18:35:36.594 INFO:tasks.workunit.client.1.smithi172.stdout:1/201: dwrite d0/d22/f28 [0,4194304] 0 2024-09-20T18:35:36.595 INFO:tasks.workunit.client.1.smithi172.stdout:4/187: creat d0/de/f4c x:0 0 0 2024-09-20T18:35:36.597 INFO:tasks.workunit.client.1.smithi172.stdout:6/160: creat d0/d18/d1c/d22/d27/f2f x:0 0 0 2024-09-20T18:35:36.603 INFO:tasks.workunit.client.1.smithi172.stdout:3/189: rmdir d0/d13/d32/d37 0 2024-09-20T18:35:36.604 INFO:tasks.workunit.client.1.smithi172.stdout:3/190: chown d0/d13/f2c 1 1 2024-09-20T18:35:36.606 INFO:tasks.workunit.client.1.smithi172.stdout:0/284: creat d4/d5/d2e/d33/f6b x:0 0 0 2024-09-20T18:35:36.609 INFO:tasks.workunit.client.1.smithi172.stdout:3/191: dwrite d0/db/d22/f34 [0,4194304] 0 2024-09-20T18:35:36.613 INFO:tasks.workunit.client.1.smithi172.stdout:1/202: mknod d0/c40 0 2024-09-20T18:35:36.614 INFO:tasks.workunit.client.1.smithi172.stdout:1/203: fsync d0/d22/f23 0 2024-09-20T18:35:36.616 INFO:tasks.workunit.client.1.smithi172.stdout:4/188: unlink d0/d7/df/d15/f41 0 2024-09-20T18:35:36.617 INFO:tasks.workunit.client.1.smithi172.stdout:7/188: sync 2024-09-20T18:35:36.617 INFO:tasks.workunit.client.1.smithi172.stdout:9/204: truncate fe 8919019 0 2024-09-20T18:35:36.618 INFO:tasks.workunit.client.1.smithi172.stdout:9/205: write d15/d1a/d1e/d24/f3e [259186,1192] 0 2024-09-20T18:35:36.618 INFO:tasks.workunit.client.1.smithi172.stdout:6/161: unlink d0/d3/c6 0 2024-09-20T18:35:36.621 INFO:tasks.workunit.client.1.smithi172.stdout:0/285: mknod d4/d44/c6c 0 2024-09-20T18:35:36.623 INFO:tasks.workunit.client.1.smithi172.stdout:8/161: getdents dd/d1b/d3b 0 2024-09-20T18:35:36.632 INFO:tasks.workunit.client.1.smithi172.stdout:7/189: symlink d2/d3/d10/l4b 0 2024-09-20T18:35:36.632 INFO:tasks.workunit.client.1.smithi172.stdout:9/206: dread f12 [0,4194304] 0 2024-09-20T18:35:36.633 INFO:tasks.workunit.client.1.smithi172.stdout:1/204: dwrite d0/f4 [4194304,4194304] 0 2024-09-20T18:35:36.633 INFO:tasks.workunit.client.1.smithi172.stdout:9/207: write d15/d1a/f26 [900761,33217] 0 2024-09-20T18:35:36.634 INFO:tasks.workunit.client.1.smithi172.stdout:6/162: symlink d0/d18/d1c/l30 0 2024-09-20T18:35:36.639 INFO:tasks.workunit.client.1.smithi172.stdout:3/192: unlink d0/f18 0 2024-09-20T18:35:36.640 INFO:tasks.workunit.client.1.smithi172.stdout:3/193: chown d0/d13/d1e/d33 51 1 2024-09-20T18:35:36.640 INFO:tasks.workunit.client.1.smithi172.stdout:7/190: dwrite d2/d3/dd/f2e [0,4194304] 0 2024-09-20T18:35:36.642 INFO:tasks.workunit.client.1.smithi172.stdout:3/194: fdatasync d0/dc/f2e 0 2024-09-20T18:35:36.644 INFO:tasks.workunit.client.1.smithi172.stdout:4/189: fdatasync d0/d7/df/f3b 0 2024-09-20T18:35:36.652 INFO:tasks.workunit.client.1.smithi172.stdout:1/205: symlink d0/d8/db/l41 0 2024-09-20T18:35:36.652 INFO:tasks.workunit.client.1.smithi172.stdout:1/206: chown d0/d8/db/f1b 100704 1 2024-09-20T18:35:36.653 INFO:tasks.workunit.client.1.smithi172.stdout:2/139: sync 2024-09-20T18:35:36.653 INFO:tasks.workunit.client.1.smithi172.stdout:6/163: mknod d0/c31 0 2024-09-20T18:35:36.653 INFO:tasks.workunit.client.1.smithi172.stdout:2/140: chown d0/d1a/c27 0 1 2024-09-20T18:35:36.655 INFO:tasks.workunit.client.1.smithi172.stdout:0/286: symlink d4/d20/l6d 0 2024-09-20T18:35:36.655 INFO:tasks.workunit.client.1.smithi172.stdout:2/141: write d0/d4/d17/d22/d10/f1f [2446740,88461] 0 2024-09-20T18:35:36.659 INFO:tasks.workunit.client.1.smithi172.stdout:2/142: dread d0/d4/d17/d22/d10/f1f [0,4194304] 0 2024-09-20T18:35:36.659 INFO:tasks.workunit.client.1.smithi172.stdout:7/191: unlink d2/d3/c37 0 2024-09-20T18:35:36.660 INFO:tasks.workunit.client.1.smithi172.stdout:2/143: stat d0/d4/d17/d22/cf 0 2024-09-20T18:35:36.660 INFO:tasks.workunit.client.1.smithi172.stdout:5/250: link d4/f9 d4/d1f/d26/d2d/d50/f56 0 2024-09-20T18:35:36.665 INFO:tasks.workunit.client.1.smithi172.stdout:5/251: dwrite f3 [0,4194304] 0 2024-09-20T18:35:36.667 INFO:tasks.workunit.client.1.smithi172.stdout:1/207: rmdir d0/d8/db/d25/d2b 39 2024-09-20T18:35:36.669 INFO:tasks.workunit.client.1.smithi172.stdout:6/164: symlink d0/d3/l32 0 2024-09-20T18:35:36.676 INFO:tasks.workunit.client.1.smithi172.stdout:0/287: rename d4/d5/f58 to d4/d44/f6e 0 2024-09-20T18:35:36.678 INFO:tasks.workunit.client.1.smithi172.stdout:5/252: dread d4/df/d3f/f43 [0,4194304] 0 2024-09-20T18:35:36.681 INFO:tasks.workunit.client.1.smithi172.stdout:7/192: creat d2/d3/dd/f4c x:0 0 0 2024-09-20T18:35:36.682 INFO:tasks.workunit.client.1.smithi172.stdout:7/193: write d2/d3/dd/f42 [805738,71662] 0 2024-09-20T18:35:36.682 INFO:tasks.workunit.client.1.smithi172.stdout:2/144: fsync d0/d4/f26 0 2024-09-20T18:35:36.688 INFO:tasks.workunit.client.1.smithi172.stdout:4/190: mknod d0/de/dc/d3c/c4d 0 2024-09-20T18:35:36.697 INFO:tasks.workunit.client.1.smithi172.stdout:1/208: dwrite d0/d8/db/d25/d2b/f3f [0,4194304] 0 2024-09-20T18:35:36.698 INFO:tasks.workunit.client.1.smithi172.stdout:1/209: readlink d0/d8/db/d25/l27 0 2024-09-20T18:35:36.698 INFO:tasks.workunit.client.1.smithi172.stdout:0/288: mknod d4/d1a/c6f 0 2024-09-20T18:35:36.699 INFO:tasks.workunit.client.1.smithi172.stdout:0/289: stat d4/d5/f6a 0 2024-09-20T18:35:36.701 INFO:tasks.workunit.client.1.smithi172.stdout:5/253: creat d4/d1f/f57 x:0 0 0 2024-09-20T18:35:36.702 INFO:tasks.workunit.client.1.smithi172.stdout:5/254: truncate d4/f36 975327 0 2024-09-20T18:35:36.703 INFO:tasks.workunit.client.1.smithi172.stdout:9/208: truncate d15/d1a/d1e/f27 354378 0 2024-09-20T18:35:36.704 INFO:tasks.workunit.client.1.smithi172.stdout:9/209: chown d15/d20 12716250 1 2024-09-20T18:35:36.705 INFO:tasks.workunit.client.1.smithi172.stdout:1/210: dwrite d0/d8/db/d25/d2b/f2d [0,4194304] 0 2024-09-20T18:35:36.709 INFO:tasks.workunit.client.1.smithi172.stdout:9/210: dread d15/d1a/f31 [0,4194304] 0 2024-09-20T18:35:36.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:36 smithi172 ceph-mon[35456]: pgmap v22: 65 pgs: 65 active+clean; 297 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 15 MiB/s wr, 419 op/s 2024-09-20T18:35:36.711 INFO:tasks.workunit.client.1.smithi172.stdout:4/191: rename d0/d7/df/d42 to d0/d48/d4e 0 2024-09-20T18:35:36.715 INFO:tasks.workunit.client.1.smithi172.stdout:3/195: truncate d0/d13/f1c 674204 0 2024-09-20T18:35:36.720 INFO:tasks.workunit.client.1.smithi172.stdout:7/194: mknod d2/d3/d10/d40/d46/c4d 0 2024-09-20T18:35:36.721 INFO:tasks.workunit.client.1.smithi172.stdout:3/196: dwrite d0/dc/f28 [0,4194304] 0 2024-09-20T18:35:36.722 INFO:tasks.workunit.client.1.smithi172.stdout:7/195: fdatasync d2/d3/dd/f49 0 2024-09-20T18:35:36.723 INFO:tasks.workunit.client.1.smithi172.stdout:7/196: write d2/d3/f45 [227783,120611] 0 2024-09-20T18:35:36.723 INFO:tasks.workunit.client.1.smithi172.stdout:1/211: rename d0/f1 to d0/d8/db/d39/f42 0 2024-09-20T18:35:36.725 INFO:tasks.workunit.client.1.smithi172.stdout:7/197: readlink d2/d3/d10/l1e 0 2024-09-20T18:35:36.729 INFO:tasks.workunit.client.1.smithi172.stdout:6/165: truncate d0/d18/f23 631429 0 2024-09-20T18:35:36.732 INFO:tasks.workunit.client.1.smithi172.stdout:4/192: dread d0/d7/df/f40 [0,4194304] 0 2024-09-20T18:35:36.732 INFO:tasks.workunit.client.1.smithi172.stdout:6/166: dread d0/f5 [0,4194304] 0 2024-09-20T18:35:36.733 INFO:tasks.workunit.client.1.smithi172.stdout:4/193: dread - d0/de/f4c zero size 2024-09-20T18:35:36.740 INFO:tasks.workunit.client.1.smithi172.stdout:9/211: unlink lf 0 2024-09-20T18:35:36.741 INFO:tasks.workunit.client.1.smithi172.stdout:3/197: readlink d0/db/l26 0 2024-09-20T18:35:36.741 INFO:tasks.workunit.client.1.smithi172.stdout:3/198: dread - d0/dc/f31 zero size 2024-09-20T18:35:36.742 INFO:tasks.workunit.client.1.smithi172.stdout:3/199: truncate d0/f20 395989 0 2024-09-20T18:35:36.748 INFO:tasks.workunit.client.1.smithi172.stdout:3/200: dwrite d0/f20 [0,4194304] 0 2024-09-20T18:35:36.755 INFO:tasks.workunit.client.1.smithi172.stdout:6/167: unlink d0/d18/d1c/f1f 0 2024-09-20T18:35:36.758 INFO:tasks.workunit.client.1.smithi172.stdout:4/194: truncate d0/fa 6854623 0 2024-09-20T18:35:36.758 INFO:tasks.workunit.client.1.smithi172.stdout:4/195: fsync d0/f2a 0 2024-09-20T18:35:36.761 INFO:tasks.workunit.client.1.smithi172.stdout:5/255: rename d4/f17 to d4/f58 0 2024-09-20T18:35:36.763 INFO:tasks.workunit.client.1.smithi172.stdout:5/256: write d4/d1f/d26/f2a [70142,58005] 0 2024-09-20T18:35:36.764 INFO:tasks.workunit.client.1.smithi172.stdout:9/212: creat d15/d1f/f3f x:0 0 0 2024-09-20T18:35:36.764 INFO:tasks.workunit.client.1.smithi172.stdout:4/196: dwrite d0/d7/df/d15/f37 [0,4194304] 0 2024-09-20T18:35:36.769 INFO:tasks.workunit.client.1.smithi172.stdout:7/198: mkdir d2/d3/d3d/d4e 0 2024-09-20T18:35:36.774 INFO:tasks.workunit.client.1.smithi172.stdout:0/290: dwrite d4/d1d/d15/f3b [0,4194304] 0 2024-09-20T18:35:36.804 INFO:tasks.workunit.client.1.smithi172.stdout:0/291: mknod d4/d1d/d15/c70 0 2024-09-20T18:35:36.804 INFO:tasks.workunit.client.1.smithi172.stdout:0/292: stat d4/d5/d2e/l35 0 2024-09-20T18:35:36.806 INFO:tasks.workunit.client.1.smithi172.stdout:1/212: truncate d0/d8/d12/f29 277965 0 2024-09-20T18:35:36.809 INFO:tasks.workunit.client.1.smithi172.stdout:0/293: dwrite d4/d44/f61 [0,4194304] 0 2024-09-20T18:35:36.810 INFO:tasks.workunit.client.1.smithi172.stdout:6/168: unlink d0/d18/d1c/d22/f2c 0 2024-09-20T18:35:36.811 INFO:tasks.workunit.client.1.smithi172.stdout:0/294: write d4/d1a/d28/d42/f55 [781157,83163] 0 2024-09-20T18:35:36.814 INFO:tasks.workunit.client.1.smithi172.stdout:5/257: symlink d4/l59 0 2024-09-20T18:35:36.817 INFO:tasks.workunit.client.1.smithi172.stdout:3/201: dwrite d0/dc/f2a [4194304,4194304] 0 2024-09-20T18:35:36.817 INFO:tasks.workunit.client.1.smithi172.stdout:8/162: sync 2024-09-20T18:35:36.819 INFO:tasks.workunit.client.1.smithi172.stdout:8/163: stat dd/d2b/d34/f36 0 2024-09-20T18:35:36.819 INFO:tasks.workunit.client.1.smithi172.stdout:3/202: chown d0/d13/d1e 952490 1 2024-09-20T18:35:36.819 INFO:tasks.workunit.client.1.smithi172.stdout:4/197: symlink d0/d7/df/l4f 0 2024-09-20T18:35:36.819 INFO:tasks.workunit.client.1.smithi172.stdout:8/164: read - dd/f19 zero size 2024-09-20T18:35:36.820 INFO:tasks.workunit.client.1.smithi172.stdout:8/165: write dd/f1c [931514,1434] 0 2024-09-20T18:35:36.832 INFO:tasks.workunit.client.1.smithi172.stdout:0/295: symlink d4/d5/d2e/d33/l71 0 2024-09-20T18:35:36.833 INFO:tasks.workunit.client.1.smithi172.stdout:0/296: write d4/f6 [5120718,104584] 0 2024-09-20T18:35:36.835 INFO:tasks.workunit.client.1.smithi172.stdout:3/203: symlink d0/d13/d1e/l3b 0 2024-09-20T18:35:36.836 INFO:tasks.workunit.client.1.smithi172.stdout:3/204: write d0/db/f23 [739073,103482] 0 2024-09-20T18:35:36.836 INFO:tasks.workunit.client.1.smithi172.stdout:9/213: chown d15/d1a/d1e/f27 630786152 1 2024-09-20T18:35:36.847 INFO:tasks.workunit.client.1.smithi172.stdout:7/199: truncate d2/f25 726969 0 2024-09-20T18:35:36.848 INFO:tasks.workunit.client.1.smithi172.stdout:7/200: chown d2/d3/dd/f2e 1292466 1 2024-09-20T18:35:36.848 INFO:tasks.workunit.client.1.smithi172.stdout:7/201: dread - d2/d3/dd/f4c zero size 2024-09-20T18:35:36.849 INFO:tasks.workunit.client.1.smithi172.stdout:7/202: chown d2/d23/d3c/f44 409514064 1 2024-09-20T18:35:36.850 INFO:tasks.workunit.client.1.smithi172.stdout:7/203: write d2/d23/d3c/f44 [333015,16129] 0 2024-09-20T18:35:36.859 INFO:tasks.workunit.client.1.smithi172.stdout:5/258: creat d4/f5a x:0 0 0 2024-09-20T18:35:36.860 INFO:tasks.workunit.client.1.smithi172.stdout:1/213: truncate d0/d8/db/d25/d2b/f3f 442670 0 2024-09-20T18:35:36.860 INFO:tasks.workunit.client.1.smithi172.stdout:0/297: truncate d4/d5/fc 2258906 0 2024-09-20T18:35:36.861 INFO:tasks.workunit.client.1.smithi172.stdout:0/298: write d4/d1d/d15/f69 [1443772,78709] 0 2024-09-20T18:35:36.862 INFO:tasks.workunit.client.1.smithi172.stdout:7/204: mknod d2/d3/d10/d40/d46/c4f 0 2024-09-20T18:35:36.863 INFO:tasks.workunit.client.1.smithi172.stdout:7/205: dread - d2/d3/dd/f2f zero size 2024-09-20T18:35:36.866 INFO:tasks.workunit.client.1.smithi172.stdout:8/166: link dd/d1b/c3a dd/d1b/d3b/c41 0 2024-09-20T18:35:36.868 INFO:tasks.workunit.client.1.smithi172.stdout:7/206: dwrite d2/d3/d10/f20 [0,4194304] 0 2024-09-20T18:35:36.869 INFO:tasks.workunit.client.1.smithi172.stdout:7/207: dread - d2/d3/dd/f1d zero size 2024-09-20T18:35:36.870 INFO:tasks.workunit.client.1.smithi172.stdout:6/169: getdents d0/d18/d1c/d22 0 2024-09-20T18:35:36.871 INFO:tasks.workunit.client.1.smithi172.stdout:7/208: truncate d2/d3/dd/f49 399250 0 2024-09-20T18:35:36.871 INFO:tasks.workunit.client.1.smithi172.stdout:5/259: rename d4/d1f/d26/d2d/f55 to d4/d1f/d26/d2d/f5b 0 2024-09-20T18:35:36.871 INFO:tasks.workunit.client.1.smithi172.stdout:6/170: chown d0/d3/l32 3755 1 2024-09-20T18:35:36.872 INFO:tasks.workunit.client.1.smithi172.stdout:1/214: mknod d0/d8/db/d25/d2b/c43 0 2024-09-20T18:35:36.872 INFO:tasks.workunit.client.1.smithi172.stdout:9/214: write f12 [1693611,47974] 0 2024-09-20T18:35:36.872 INFO:tasks.workunit.client.1.smithi172.stdout:6/171: stat d0/d18/f2b 0 2024-09-20T18:35:36.875 INFO:tasks.workunit.client.1.smithi172.stdout:4/198: truncate d0/fa 3396036 0 2024-09-20T18:35:36.875 INFO:tasks.workunit.client.1.smithi172.stdout:9/215: dread - d15/d1a/d1e/d34/f3b zero size 2024-09-20T18:35:36.875 INFO:tasks.workunit.client.1.smithi172.stdout:6/172: dread d0/d3/f2a [0,4194304] 0 2024-09-20T18:35:36.876 INFO:tasks.workunit.client.1.smithi172.stdout:9/216: dread - d15/d1a/d1e/d24/f2f zero size 2024-09-20T18:35:36.877 INFO:tasks.workunit.client.1.smithi172.stdout:4/199: write d0/de/dc/f22 [2941280,117766] 0 2024-09-20T18:35:36.877 INFO:tasks.workunit.client.1.smithi172.stdout:0/299: creat d4/d1a/d28/d42/d45/d54/f72 x:0 0 0 2024-09-20T18:35:36.878 INFO:tasks.workunit.client.1.smithi172.stdout:4/200: chown d0/d7/df/d18/d1a/c35 32 1 2024-09-20T18:35:36.879 INFO:tasks.workunit.client.1.smithi172.stdout:4/201: truncate d0/de/d39/f46 1213237 0 2024-09-20T18:35:36.879 INFO:tasks.workunit.client.1.smithi172.stdout:4/202: readlink d0/de/l6 0 2024-09-20T18:35:36.881 INFO:tasks.workunit.client.1.smithi172.stdout:8/167: chown dd/l1e 1766 1 2024-09-20T18:35:36.881 INFO:tasks.workunit.client.1.smithi172.stdout:2/145: sync 2024-09-20T18:35:36.882 INFO:tasks.workunit.client.1.smithi172.stdout:7/209: mknod d2/d3/d10/d40/d46/c50 0 2024-09-20T18:35:36.886 INFO:tasks.workunit.client.1.smithi172.stdout:5/260: creat d4/d1f/d26/d2d/d50/d2c/f5c x:0 0 0 2024-09-20T18:35:36.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:36 smithi017 ceph-mon[28058]: pgmap v22: 65 pgs: 65 active+clean; 297 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 15 MiB/s wr, 419 op/s 2024-09-20T18:35:36.910 INFO:tasks.workunit.client.1.smithi172.stdout:3/205: link d0/f8 d0/dc/f3c 0 2024-09-20T18:35:36.910 INFO:tasks.workunit.client.1.smithi172.stdout:8/168: rmdir dd 39 2024-09-20T18:35:36.911 INFO:tasks.workunit.client.1.smithi172.stdout:7/210: dwrite d2/d3/dd/fe [0,4194304] 0 2024-09-20T18:35:36.912 INFO:tasks.workunit.client.1.smithi172.stdout:3/206: fsync d0/f20 0 2024-09-20T18:35:36.912 INFO:tasks.workunit.client.1.smithi172.stdout:2/146: mkdir d0/d4/d17/d2e 0 2024-09-20T18:35:36.917 INFO:tasks.workunit.client.1.smithi172.stdout:1/215: creat d0/d8/f44 x:0 0 0 2024-09-20T18:35:36.918 INFO:tasks.workunit.client.1.smithi172.stdout:2/147: chown d0/d4/d17/d22/f13 233 1 2024-09-20T18:35:36.918 INFO:tasks.workunit.client.1.smithi172.stdout:8/169: readlink dd/d2b/l2d 0 2024-09-20T18:35:36.918 INFO:tasks.workunit.client.1.smithi172.stdout:3/207: chown d0/db/d22/f29 71198 1 2024-09-20T18:35:36.922 INFO:tasks.workunit.client.1.smithi172.stdout:1/216: mknod d0/d22/c45 0 2024-09-20T18:35:36.922 INFO:tasks.workunit.client.1.smithi172.stdout:3/208: stat d0/d13/d1e/l27 0 2024-09-20T18:35:36.922 INFO:tasks.workunit.client.1.smithi172.stdout:8/170: dread fb [0,4194304] 0 2024-09-20T18:35:36.923 INFO:tasks.workunit.client.1.smithi172.stdout:2/148: chown d0/d4/d17/d22/f13 151 1 2024-09-20T18:35:36.923 INFO:tasks.workunit.client.1.smithi172.stdout:1/217: stat d0/l1c 0 2024-09-20T18:35:36.924 INFO:tasks.workunit.client.1.smithi172.stdout:5/261: dwrite d4/d1f/d26/f2a [0,4194304] 0 2024-09-20T18:35:36.926 INFO:tasks.workunit.client.1.smithi172.stdout:3/209: chown d0/db/d22/f34 3 1 2024-09-20T18:35:36.926 INFO:tasks.workunit.client.1.smithi172.stdout:7/211: dread d2/f2b [4194304,4194304] 0 2024-09-20T18:35:36.927 INFO:tasks.workunit.client.1.smithi172.stdout:9/217: dwrite d15/d20/f21 [0,4194304] 0 2024-09-20T18:35:36.927 INFO:tasks.workunit.client.1.smithi172.stdout:1/218: chown d0/d8/d12/c13 767 1 2024-09-20T18:35:36.928 INFO:tasks.workunit.client.1.smithi172.stdout:8/171: creat dd/d1b/d3b/f42 x:0 0 0 2024-09-20T18:35:36.931 INFO:tasks.workunit.client.1.smithi172.stdout:5/262: fsync d4/df/f53 0 2024-09-20T18:35:36.931 INFO:tasks.workunit.client.1.smithi172.stdout:1/219: stat d0/d8/l31 0 2024-09-20T18:35:36.932 INFO:tasks.workunit.client.1.smithi172.stdout:7/212: truncate d2/f39 698719 0 2024-09-20T18:35:36.933 INFO:tasks.workunit.client.1.smithi172.stdout:3/210: dread d0/f8 [0,4194304] 0 2024-09-20T18:35:36.933 INFO:tasks.workunit.client.1.smithi172.stdout:9/218: creat d15/d1f/f40 x:0 0 0 2024-09-20T18:35:36.938 INFO:tasks.workunit.client.1.smithi172.stdout:1/220: chown d0/lf 76583134 1 2024-09-20T18:35:36.938 INFO:tasks.workunit.client.1.smithi172.stdout:8/172: mknod dd/c43 0 2024-09-20T18:35:36.938 INFO:tasks.workunit.client.1.smithi172.stdout:6/173: dwrite d0/f13 [0,4194304] 0 2024-09-20T18:35:36.939 INFO:tasks.workunit.client.1.smithi172.stdout:1/221: fsync d0/d8/f44 0 2024-09-20T18:35:36.939 INFO:tasks.workunit.client.1.smithi172.stdout:5/263: readlink d4/d1f/d26/d41/l4f 0 2024-09-20T18:35:36.940 INFO:tasks.workunit.client.1.smithi172.stdout:7/213: mkdir d2/d23/d51 0 2024-09-20T18:35:36.940 INFO:tasks.workunit.client.1.smithi172.stdout:8/173: write dd/f1c [60237,106385] 0 2024-09-20T18:35:36.942 INFO:tasks.workunit.client.1.smithi172.stdout:3/211: symlink d0/dc/l3d 0 2024-09-20T18:35:36.943 INFO:tasks.workunit.client.1.smithi172.stdout:9/219: symlink d15/d1a/d1e/d24/l41 0 2024-09-20T18:35:36.943 INFO:tasks.workunit.client.1.smithi172.stdout:3/212: dread - d0/d13/f2c zero size 2024-09-20T18:35:36.944 INFO:tasks.workunit.client.1.smithi172.stdout:6/174: mknod d0/d18/d1c/c33 0 2024-09-20T18:35:36.945 INFO:tasks.workunit.client.1.smithi172.stdout:5/264: fsync d4/d1f/d26/d2d/f5b 0 2024-09-20T18:35:36.946 INFO:tasks.workunit.client.1.smithi172.stdout:7/214: symlink d2/d3/l52 0 2024-09-20T18:35:36.947 INFO:tasks.workunit.client.1.smithi172.stdout:9/220: mknod d15/d1a/d1e/c42 0 2024-09-20T18:35:36.947 INFO:tasks.workunit.client.1.smithi172.stdout:8/174: write fb [1122403,33352] 0 2024-09-20T18:35:36.948 INFO:tasks.workunit.client.1.smithi172.stdout:7/215: read d2/d3/f45 [108181,85282] 0 2024-09-20T18:35:36.949 INFO:tasks.workunit.client.1.smithi172.stdout:8/175: dread - dd/f30 zero size 2024-09-20T18:35:36.949 INFO:tasks.workunit.client.1.smithi172.stdout:5/265: creat d4/d1f/d26/d2d/d50/f5d x:0 0 0 2024-09-20T18:35:36.950 INFO:tasks.workunit.client.1.smithi172.stdout:6/175: mkdir d0/d18/d1c/d21/d26/d34 0 2024-09-20T18:35:36.950 INFO:tasks.workunit.client.1.smithi172.stdout:1/222: link d0/d8/ca d0/d8/db/c46 0 2024-09-20T18:35:36.951 INFO:tasks.workunit.client.1.smithi172.stdout:9/221: symlink d15/d1a/d1e/d34/l43 0 2024-09-20T18:35:36.953 INFO:tasks.workunit.client.1.smithi172.stdout:7/216: mknod d2/d3/d10/d40/d46/c53 0 2024-09-20T18:35:36.956 INFO:tasks.workunit.client.1.smithi172.stdout:7/217: chown d2/cf 500575 1 2024-09-20T18:35:36.956 INFO:tasks.workunit.client.1.smithi172.stdout:9/222: creat d15/d1f/d2c/d37/f44 x:0 0 0 2024-09-20T18:35:36.958 INFO:tasks.workunit.client.1.smithi172.stdout:5/266: dwrite d4/d1f/d26/f2a [0,4194304] 0 2024-09-20T18:35:36.959 INFO:tasks.workunit.client.1.smithi172.stdout:5/267: write f3 [4948580,10663] 0 2024-09-20T18:35:36.960 INFO:tasks.workunit.client.1.smithi172.stdout:9/223: rmdir d15 39 2024-09-20T18:35:36.962 INFO:tasks.workunit.client.1.smithi172.stdout:1/223: dwrite d0/d8/d12/f1a [0,4194304] 0 2024-09-20T18:35:36.962 INFO:tasks.workunit.client.1.smithi172.stdout:7/218: readlink d2/d1c/l28 0 2024-09-20T18:35:36.964 INFO:tasks.workunit.client.1.smithi172.stdout:2/149: truncate d0/f3 8174915 0 2024-09-20T18:35:36.964 INFO:tasks.workunit.client.1.smithi172.stdout:8/176: link dd/c28 dd/c44 0 2024-09-20T18:35:36.970 INFO:tasks.workunit.client.1.smithi172.stdout:1/224: dread d0/d8/db/f33 [0,4194304] 0 2024-09-20T18:35:36.971 INFO:tasks.workunit.client.1.smithi172.stdout:9/224: truncate d15/d20/f3a 249091 0 2024-09-20T18:35:36.971 INFO:tasks.workunit.client.1.smithi172.stdout:1/225: chown d0/d8/d12/f1a 0 1 2024-09-20T18:35:36.971 INFO:tasks.workunit.client.1.smithi172.stdout:8/177: mknod dd/d1b/d3b/c45 0 2024-09-20T18:35:36.973 INFO:tasks.workunit.client.1.smithi172.stdout:1/226: write d0/f4 [7304924,111809] 0 2024-09-20T18:35:36.974 INFO:tasks.workunit.client.1.smithi172.stdout:1/227: truncate d0/d8/db/f18 204021 0 2024-09-20T18:35:36.978 INFO:tasks.workunit.client.1.smithi172.stdout:8/178: symlink dd/d1b/l46 0 2024-09-20T18:35:36.979 INFO:tasks.workunit.client.1.smithi172.stdout:9/225: rename d15/d1a/f25 to d15/d1f/f45 0 2024-09-20T18:35:36.981 INFO:tasks.workunit.client.1.smithi172.stdout:6/176: write d0/d18/f23 [88964,94937] 0 2024-09-20T18:35:36.982 INFO:tasks.workunit.client.1.smithi172.stdout:7/219: creat d2/f54 x:0 0 0 2024-09-20T18:35:36.983 INFO:tasks.workunit.client.1.smithi172.stdout:7/220: write d2/d3/d10/f15 [2056863,41191] 0 2024-09-20T18:35:36.984 INFO:tasks.workunit.client.1.smithi172.stdout:6/177: mkdir d0/d18/d1c/d22/d27/d35 0 2024-09-20T18:35:36.986 INFO:tasks.workunit.client.1.smithi172.stdout:1/228: creat d0/d8/f47 x:0 0 0 2024-09-20T18:35:36.987 INFO:tasks.workunit.client.1.smithi172.stdout:7/221: mknod d2/d23/c55 0 2024-09-20T18:35:36.988 INFO:tasks.workunit.client.1.smithi172.stdout:8/179: creat dd/d2b/f47 x:0 0 0 2024-09-20T18:35:36.993 INFO:tasks.workunit.client.1.smithi172.stdout:7/222: mkdir d2/d23/d3c/d56 0 2024-09-20T18:35:36.994 INFO:tasks.workunit.client.1.smithi172.stdout:6/178: dread d0/f13 [8388608,4194304] 0 2024-09-20T18:35:36.994 INFO:tasks.workunit.client.1.smithi172.stdout:8/180: unlink dd/d1b/c32 0 2024-09-20T18:35:36.995 INFO:tasks.workunit.client.1.smithi172.stdout:6/179: write d0/d18/f23 [1649016,67398] 0 2024-09-20T18:35:36.998 INFO:tasks.workunit.client.1.smithi172.stdout:1/229: rename d0/d8/db/d25/d2b/c43 to d0/d22/c48 0 2024-09-20T18:35:36.999 INFO:tasks.workunit.client.1.smithi172.stdout:5/268: write d4/f14 [595102,86674] 0 2024-09-20T18:35:37.002 INFO:tasks.workunit.client.1.smithi172.stdout:9/226: getdents d15/d1f 0 2024-09-20T18:35:37.003 INFO:tasks.workunit.client.1.smithi172.stdout:6/180: creat d0/f36 x:0 0 0 2024-09-20T18:35:37.004 INFO:tasks.workunit.client.1.smithi172.stdout:8/181: dwrite dd/d1b/f1f [4194304,4194304] 0 2024-09-20T18:35:37.004 INFO:tasks.workunit.client.1.smithi172.stdout:2/150: dwrite d0/d4/d17/d22/fc [0,4194304] 0 2024-09-20T18:35:37.004 INFO:tasks.workunit.client.1.smithi172.stdout:9/227: fsync d15/d1f/f3f 0 2024-09-20T18:35:37.005 INFO:tasks.workunit.client.1.smithi172.stdout:7/223: symlink d2/d3/d3d/d4e/l57 0 2024-09-20T18:35:37.007 INFO:tasks.workunit.client.1.smithi172.stdout:8/182: fdatasync dd/d1b/f33 0 2024-09-20T18:35:37.008 INFO:tasks.workunit.client.1.smithi172.stdout:2/151: write d0/d1a/f20 [1027599,112391] 0 2024-09-20T18:35:37.011 INFO:tasks.workunit.client.1.smithi172.stdout:9/228: fdatasync d15/d1a/d1e/d24/f2f 0 2024-09-20T18:35:37.013 INFO:tasks.workunit.client.1.smithi172.stdout:7/224: truncate d2/d3/dd/f19 2457756 0 2024-09-20T18:35:37.014 INFO:tasks.workunit.client.1.smithi172.stdout:9/229: write f12 [1906706,60370] 0 2024-09-20T18:35:37.016 INFO:tasks.workunit.client.1.smithi172.stdout:1/230: creat d0/d8/db/d25/f49 x:0 0 0 2024-09-20T18:35:37.016 INFO:tasks.workunit.client.1.smithi172.stdout:5/269: dwrite d4/d1f/d26/d2d/d50/f2b [0,4194304] 0 2024-09-20T18:35:37.019 INFO:tasks.workunit.client.1.smithi172.stdout:6/181: dwrite d0/d18/f23 [0,4194304] 0 2024-09-20T18:35:37.020 INFO:tasks.workunit.client.1.smithi172.stdout:1/231: chown d0/d8/db/fe 2684313 1 2024-09-20T18:35:37.020 INFO:tasks.workunit.client.1.smithi172.stdout:5/270: truncate d4/f36 1564388 0 2024-09-20T18:35:37.022 INFO:tasks.workunit.client.1.smithi172.stdout:1/232: fdatasync d0/d8/db/d25/f49 0 2024-09-20T18:35:37.023 INFO:tasks.workunit.client.1.smithi172.stdout:8/183: unlink dd/l17 0 2024-09-20T18:35:37.025 INFO:tasks.workunit.client.1.smithi172.stdout:1/233: stat d0/d8/db/fe 0 2024-09-20T18:35:37.026 INFO:tasks.workunit.client.1.smithi172.stdout:7/225: creat d2/d23/d3c/f58 x:0 0 0 2024-09-20T18:35:37.027 INFO:tasks.workunit.client.1.smithi172.stdout:1/234: chown d0/d8/db/d25/d2b/d3d 17 1 2024-09-20T18:35:37.030 INFO:tasks.workunit.client.1.smithi172.stdout:6/182: dwrite d0/d18/f2b [0,4194304] 0 2024-09-20T18:35:37.030 INFO:tasks.workunit.client.1.smithi172.stdout:2/152: symlink d0/d2c/l2f 0 2024-09-20T18:35:37.035 INFO:tasks.workunit.client.1.smithi172.stdout:7/226: fdatasync d2/d3/f35 0 2024-09-20T18:35:37.037 INFO:tasks.workunit.client.1.smithi172.stdout:1/235: symlink d0/d8/db/d25/d2b/d3d/l4a 0 2024-09-20T18:35:37.041 INFO:tasks.workunit.client.1.smithi172.stdout:2/153: write d0/d1a/f25 [349520,113602] 0 2024-09-20T18:35:37.043 INFO:tasks.workunit.client.1.smithi172.stdout:9/230: dwrite d15/d1f/d2c/d37/f3c [0,4194304] 0 2024-09-20T18:35:37.045 INFO:tasks.workunit.client.1.smithi172.stdout:1/236: symlink d0/d8/d12/l4b 0 2024-09-20T18:35:37.049 INFO:tasks.workunit.client.1.smithi172.stdout:9/231: dread - d15/d1a/d1e/d34/f3b zero size 2024-09-20T18:35:37.049 INFO:tasks.workunit.client.1.smithi172.stdout:8/184: dwrite dd/d1b/f21 [4194304,4194304] 0 2024-09-20T18:35:37.051 INFO:tasks.workunit.client.1.smithi172.stdout:0/300: sync 2024-09-20T18:35:37.051 INFO:tasks.workunit.client.1.smithi172.stdout:6/183: dread d0/d18/f29 [0,4194304] 0 2024-09-20T18:35:37.051 INFO:tasks.workunit.client.1.smithi172.stdout:2/154: creat d0/d4/f30 x:0 0 0 2024-09-20T18:35:37.056 INFO:tasks.workunit.client.1.smithi172.stdout:7/227: dwrite d2/d3/dd/f1d [0,4194304] 0 2024-09-20T18:35:37.057 INFO:tasks.workunit.client.1.smithi172.stdout:6/184: truncate d0/f36 761841 0 2024-09-20T18:35:37.058 INFO:tasks.workunit.client.1.smithi172.stdout:7/228: truncate d2/d3/d10/f15 4503910 0 2024-09-20T18:35:37.059 INFO:tasks.workunit.client.1.smithi172.stdout:5/271: dread d4/d1f/d26/d2d/d50/f56 [0,4194304] 0 2024-09-20T18:35:37.060 INFO:tasks.workunit.client.1.smithi172.stdout:7/229: dread d2/d3/dd/f49 [0,4194304] 0 2024-09-20T18:35:37.066 INFO:tasks.workunit.client.1.smithi172.stdout:7/230: dwrite d2/d3/dd/f1d [0,4194304] 0 2024-09-20T18:35:37.067 INFO:tasks.workunit.client.1.smithi172.stdout:7/231: fsync d2/d3/dd/f2f 0 2024-09-20T18:35:37.080 INFO:tasks.workunit.client.1.smithi172.stdout:3/213: sync 2024-09-20T18:35:37.080 INFO:tasks.workunit.client.1.smithi172.stdout:4/203: sync 2024-09-20T18:35:37.081 INFO:tasks.workunit.client.1.smithi172.stdout:3/214: dread d0/dc/f3c [0,4194304] 0 2024-09-20T18:35:37.082 INFO:tasks.workunit.client.1.smithi172.stdout:3/215: read d0/dc/f3c [22181,116345] 0 2024-09-20T18:35:37.114 INFO:tasks.workunit.client.1.smithi172.stdout:1/237: rename d0/l34 to d0/d8/db/d25/d2b/d3d/l4c 0 2024-09-20T18:35:37.114 INFO:tasks.workunit.client.1.smithi172.stdout:1/238: chown d0/d8/c1d 6233 1 2024-09-20T18:35:37.115 INFO:tasks.workunit.client.1.smithi172.stdout:1/239: stat d0/l2f 0 2024-09-20T18:35:37.116 INFO:tasks.workunit.client.1.smithi172.stdout:0/301: mkdir d4/d1a/d28/d73 0 2024-09-20T18:35:37.117 INFO:tasks.workunit.client.1.smithi172.stdout:0/302: readlink d4/d1a/l63 0 2024-09-20T18:35:37.119 INFO:tasks.workunit.client.1.smithi172.stdout:5/272: readlink d4/df/d3f/l40 0 2024-09-20T18:35:37.124 INFO:tasks.workunit.client.1.smithi172.stdout:4/204: mknod d0/de/dc/d3c/c50 0 2024-09-20T18:35:37.125 INFO:tasks.workunit.client.1.smithi172.stdout:3/216: creat d0/db/f3e x:0 0 0 2024-09-20T18:35:37.129 INFO:tasks.workunit.client.1.smithi172.stdout:8/185: mknod dd/c48 0 2024-09-20T18:35:37.130 INFO:tasks.workunit.client.1.smithi172.stdout:3/217: dwrite d0/db/f23 [4194304,4194304] 0 2024-09-20T18:35:37.130 INFO:tasks.workunit.client.1.smithi172.stdout:9/232: mkdir d15/d46 0 2024-09-20T18:35:37.131 INFO:tasks.workunit.client.1.smithi172.stdout:3/218: dread - d0/d13/d1e/f2d zero size 2024-09-20T18:35:37.132 INFO:tasks.workunit.client.1.smithi172.stdout:3/219: write d0/f20 [2214636,20647] 0 2024-09-20T18:35:37.132 INFO:tasks.workunit.client.1.smithi172.stdout:2/155: mknod d0/d4/c31 0 2024-09-20T18:35:37.137 INFO:tasks.workunit.client.1.smithi172.stdout:5/273: mknod d4/d1f/d26/d2d/c5e 0 2024-09-20T18:35:37.138 INFO:tasks.workunit.client.1.smithi172.stdout:5/274: chown f3 847547363 1 2024-09-20T18:35:37.141 INFO:tasks.workunit.client.1.smithi172.stdout:7/232: creat d2/d23/d51/f59 x:0 0 0 2024-09-20T18:35:37.142 INFO:tasks.workunit.client.1.smithi172.stdout:4/205: mkdir d0/d7/df/d18/d51 0 2024-09-20T18:35:37.147 INFO:tasks.workunit.client.1.smithi172.stdout:6/185: truncate d0/d18/f2b 1638860 0 2024-09-20T18:35:37.149 INFO:tasks.workunit.client.1.smithi172.stdout:5/275: rmdir d4 39 2024-09-20T18:35:37.150 INFO:tasks.workunit.client.1.smithi172.stdout:4/206: mknod d0/de/dc/c52 0 2024-09-20T18:35:37.151 INFO:tasks.workunit.client.1.smithi172.stdout:9/233: mknod d15/d46/c47 0 2024-09-20T18:35:37.151 INFO:tasks.workunit.client.1.smithi172.stdout:6/186: mknod d0/d18/d1c/c37 0 2024-09-20T18:35:37.152 INFO:tasks.workunit.client.1.smithi172.stdout:6/187: chown d0/d18/d1c/d22/d27 7 1 2024-09-20T18:35:37.152 INFO:tasks.workunit.client.1.smithi172.stdout:0/303: link d4/d5/ca d4/d1a/d28/d34/d60/c74 0 2024-09-20T18:35:37.152 INFO:tasks.workunit.client.1.smithi172.stdout:6/188: chown d0/d18/d1c/c37 6848 1 2024-09-20T18:35:37.153 INFO:tasks.workunit.client.1.smithi172.stdout:2/156: truncate d0/d4/d17/d22/d10/f1f 1340042 0 2024-09-20T18:35:37.154 INFO:tasks.workunit.client.1.smithi172.stdout:7/233: mkdir d2/d5a 0 2024-09-20T18:35:37.154 INFO:tasks.workunit.client.1.smithi172.stdout:4/207: mkdir d0/d7/df/d18/d1a/d53 0 2024-09-20T18:35:37.155 INFO:tasks.workunit.client.1.smithi172.stdout:7/234: readlink d2/d3/d10/l4b 0 2024-09-20T18:35:37.157 INFO:tasks.workunit.client.1.smithi172.stdout:6/189: mknod d0/d3/c38 0 2024-09-20T18:35:37.158 INFO:tasks.workunit.client.1.smithi172.stdout:2/157: creat d0/d4/d17/d18/f32 x:0 0 0 2024-09-20T18:35:37.160 INFO:tasks.workunit.client.1.smithi172.stdout:4/208: fsync d0/d7/f25 0 2024-09-20T18:35:37.160 INFO:tasks.workunit.client.0.smithi017.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-20T18:35:37.161 INFO:tasks.workunit.client.1.smithi172.stdout:2/158: chown d0/d4/c31 19 1 2024-09-20T18:35:37.161 INFO:tasks.workunit.client.1.smithi172.stdout:0/304: dwrite d4/d1a/d28/d42/d45/d54/f72 [0,4194304] 0 2024-09-20T18:35:37.161 INFO:tasks.workunit.client.1.smithi172.stdout:7/235: symlink d2/d3/d10/d40/d46/l5b 0 2024-09-20T18:35:37.164 INFO:tasks.workunit.client.1.smithi172.stdout:6/190: write d0/f13 [6011535,112069] 0 2024-09-20T18:35:37.164 INFO:tasks.workunit.client.1.smithi172.stdout:1/240: truncate d0/d8/f2c 611266 0 2024-09-20T18:35:37.164 INFO:tasks.workunit.client.1.smithi172.stdout:8/186: write f9 [252469,93347] 0 2024-09-20T18:35:37.166 INFO:tasks.workunit.client.1.smithi172.stdout:0/305: chown d4/d5/l1f 3690 1 2024-09-20T18:35:37.166 INFO:tasks.workunit.client.1.smithi172.stdout:5/276: dwrite d4/fd [0,4194304] 0 2024-09-20T18:35:37.167 INFO:tasks.workunit.client.1.smithi172.stdout:2/159: creat d0/d1a/f33 x:0 0 0 2024-09-20T18:35:37.168 INFO:tasks.workunit.client.0.smithi017.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-20T18:35:37.168 INFO:tasks.workunit.client.0.smithi017.stderr:+ make 2024-09-20T18:35:37.169 INFO:tasks.workunit.client.1.smithi172.stdout:0/306: read - d4/d1a/d28/d34/f3a zero size 2024-09-20T18:35:37.169 INFO:tasks.workunit.client.1.smithi172.stdout:7/236: write d2/d3/d10/f2c [519011,104342] 0 2024-09-20T18:35:37.172 INFO:tasks.workunit.client.1.smithi172.stdout:7/237: write d2/d3/dd/f19 [2572663,119051] 0 2024-09-20T18:35:37.174 INFO:tasks.workunit.client.1.smithi172.stdout:8/187: rename fb to dd/d1b/f49 0 2024-09-20T18:35:37.182 INFO:tasks.workunit.client.1.smithi172.stdout:0/307: unlink d4/d1d/c48 0 2024-09-20T18:35:37.183 INFO:tasks.workunit.client.1.smithi172.stdout:0/308: chown d4/d1a/d28/d42/d45/f52 12635 1 2024-09-20T18:35:37.183 INFO:tasks.workunit.client.1.smithi172.stdout:0/309: read d4/d5/fb [3921872,63753] 0 2024-09-20T18:35:37.184 INFO:tasks.workunit.client.1.smithi172.stdout:0/310: dread d4/d46/f56 [0,4194304] 0 2024-09-20T18:35:37.190 INFO:tasks.workunit.client.1.smithi172.stdout:8/188: creat dd/d1b/d3b/f4a x:0 0 0 2024-09-20T18:35:37.190 INFO:tasks.workunit.client.1.smithi172.stdout:8/189: dread - dd/f3d zero size 2024-09-20T18:35:37.192 INFO:tasks.workunit.client.1.smithi172.stdout:2/160: mknod d0/d4/d17/d18/d29/c34 0 2024-09-20T18:35:37.195 INFO:tasks.workunit.client.1.smithi172.stdout:5/277: write d4/d1f/d26/d2d/d50/f1e [679826,40922] 0 2024-09-20T18:35:37.196 INFO:tasks.workunit.client.1.smithi172.stdout:5/278: chown d4/df/l19 341569043 1 2024-09-20T18:35:37.196 INFO:tasks.workunit.client.1.smithi172.stdout:4/209: truncate d0/de/d39/f46 1179783 0 2024-09-20T18:35:37.199 INFO:tasks.workunit.client.1.smithi172.stdout:0/311: rmdir d4/d1a/d28 39 2024-09-20T18:35:37.200 INFO:tasks.workunit.client.1.smithi172.stdout:7/238: creat d2/d23/d3a/f5c x:0 0 0 2024-09-20T18:35:37.201 INFO:tasks.workunit.client.1.smithi172.stdout:7/239: chown d2/d3/d10/d40 491474176 1 2024-09-20T18:35:37.201 INFO:tasks.workunit.client.1.smithi172.stdout:5/279: dwrite d4/d1f/f27 [0,4194304] 0 2024-09-20T18:35:37.203 INFO:tasks.workunit.client.1.smithi172.stdout:2/161: truncate d0/f8 1352954 0 2024-09-20T18:35:37.211 INFO:tasks.workunit.client.1.smithi172.stdout:0/312: truncate d4/d1a/d28/d34/f3a 413119 0 2024-09-20T18:35:37.212 INFO:tasks.workunit.client.1.smithi172.stdout:0/313: write d4/d1d/f37 [5209492,100447] 0 2024-09-20T18:35:37.214 INFO:tasks.workunit.client.1.smithi172.stdout:5/280: fdatasync d4/f9 0 2024-09-20T18:35:37.215 INFO:tasks.workunit.client.1.smithi172.stdout:7/240: creat d2/d3/d3d/d4e/f5d x:0 0 0 2024-09-20T18:35:37.215 INFO:tasks.workunit.client.1.smithi172.stdout:5/281: chown d4/df/l31 1013 1 2024-09-20T18:35:37.218 INFO:tasks.workunit.client.1.smithi172.stdout:0/314: rename d4/d1a/d28/d34 to d4/d1a/d28/d75 0 2024-09-20T18:35:37.220 INFO:tasks.workunit.client.1.smithi172.stdout:7/241: mknod d2/d23/d51/c5e 0 2024-09-20T18:35:37.222 INFO:tasks.workunit.client.1.smithi172.stdout:5/282: symlink d4/d1f/l5f 0 2024-09-20T18:35:37.223 INFO:tasks.workunit.client.1.smithi172.stdout:8/190: getdents dd/d1b/d3b 0 2024-09-20T18:35:37.224 INFO:tasks.workunit.client.1.smithi172.stdout:6/191: truncate d0/d18/f2b 524872 0 2024-09-20T18:35:37.224 INFO:tasks.workunit.client.1.smithi172.stdout:0/315: mkdir d4/d5/d2e/d76 0 2024-09-20T18:35:37.225 INFO:tasks.workunit.client.1.smithi172.stdout:4/210: write d0/d7/f25 [743862,57076] 0 2024-09-20T18:35:37.225 INFO:tasks.workunit.client.1.smithi172.stdout:5/283: fsync d4/d1f/d26/d2d/d50/f5d 0 2024-09-20T18:35:37.227 INFO:tasks.workunit.client.1.smithi172.stdout:8/191: read dd/d1b/f2f [663549,118101] 0 2024-09-20T18:35:37.228 INFO:tasks.workunit.client.1.smithi172.stdout:4/211: truncate d0/f32 890436 0 2024-09-20T18:35:37.229 INFO:tasks.workunit.client.1.smithi172.stdout:5/284: chown d4/d1f/d26/d2d/l3b 2995 1 2024-09-20T18:35:37.231 INFO:tasks.workunit.client.1.smithi172.stdout:7/242: dwrite d2/d23/d3c/f44 [0,4194304] 0 2024-09-20T18:35:37.232 INFO:tasks.workunit.client.1.smithi172.stdout:8/192: creat dd/d2b/d34/d39/f4b x:0 0 0 2024-09-20T18:35:37.232 INFO:tasks.workunit.client.1.smithi172.stdout:4/212: write d0/d7/df/f3b [633048,110167] 0 2024-09-20T18:35:37.233 INFO:tasks.workunit.client.0.smithi017.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-20T18:35:37.235 INFO:tasks.workunit.client.1.smithi172.stdout:6/192: dread d0/d18/f29 [0,4194304] 0 2024-09-20T18:35:37.235 INFO:tasks.workunit.client.1.smithi172.stdout:5/285: symlink d4/d1f/d26/d41/l60 0 2024-09-20T18:35:37.236 INFO:tasks.workunit.client.1.smithi172.stdout:7/243: read d2/f25 [59558,12329] 0 2024-09-20T18:35:37.239 INFO:tasks.workunit.client.1.smithi172.stdout:8/193: mknod dd/d2b/d34/d39/c4c 0 2024-09-20T18:35:37.239 INFO:tasks.workunit.client.1.smithi172.stdout:4/213: symlink d0/l54 0 2024-09-20T18:35:37.241 INFO:tasks.workunit.client.1.smithi172.stdout:2/162: dwrite d0/f3 [4194304,4194304] 0 2024-09-20T18:35:37.241 INFO:tasks.workunit.client.1.smithi172.stdout:0/316: dwrite d4/d1d/d15/f50 [0,4194304] 0 2024-09-20T18:35:37.243 INFO:tasks.workunit.client.1.smithi172.stdout:5/286: write d4/d1f/d26/d2d/d50/f1e [253844,76007] 0 2024-09-20T18:35:37.243 INFO:tasks.workunit.client.1.smithi172.stdout:6/193: write d0/d18/d1c/d22/f2e [38023,47583] 0 2024-09-20T18:35:37.245 INFO:tasks.workunit.client.1.smithi172.stdout:8/194: mkdir dd/d2b/d34/d39/d4d 0 2024-09-20T18:35:37.245 INFO:tasks.workunit.client.1.smithi172.stdout:4/214: chown d0/d7/df/d15/l26 1618606 1 2024-09-20T18:35:37.245 INFO:tasks.workunit.client.1.smithi172.stdout:5/287: chown d4/d1f/d26/f47 0 1 2024-09-20T18:35:37.247 INFO:tasks.workunit.client.1.smithi172.stdout:8/195: chown dd/d2b/d34/f36 255386323 1 2024-09-20T18:35:37.248 INFO:tasks.workunit.client.1.smithi172.stdout:0/317: mknod d4/d1a/c77 0 2024-09-20T18:35:37.249 INFO:tasks.workunit.client.1.smithi172.stdout:6/194: mkdir d0/d18/d1c/d21/d26/d34/d39 0 2024-09-20T18:35:37.250 INFO:tasks.workunit.client.1.smithi172.stdout:8/196: write dd/f27 [4110454,114847] 0 2024-09-20T18:35:37.251 INFO:tasks.workunit.client.1.smithi172.stdout:0/318: chown d4/d44/f61 3116846 1 2024-09-20T18:35:37.253 INFO:tasks.workunit.client.1.smithi172.stdout:1/241: sync 2024-09-20T18:35:37.253 INFO:tasks.workunit.client.1.smithi172.stdout:3/220: sync 2024-09-20T18:35:37.254 INFO:tasks.workunit.client.1.smithi172.stdout:9/234: sync 2024-09-20T18:35:37.255 INFO:tasks.workunit.client.1.smithi172.stdout:2/163: dread d0/d4/f26 [0,4194304] 0 2024-09-20T18:35:37.256 INFO:tasks.workunit.client.1.smithi172.stdout:3/221: fdatasync d0/dc/f31 0 2024-09-20T18:35:37.257 INFO:tasks.workunit.client.1.smithi172.stdout:6/195: read d0/f13 [5535767,98812] 0 2024-09-20T18:35:37.257 INFO:tasks.workunit.client.1.smithi172.stdout:4/215: dread d0/d7/f25 [0,4194304] 0 2024-09-20T18:35:37.257 INFO:tasks.workunit.client.1.smithi172.stdout:3/222: readlink d0/db/l26 0 2024-09-20T18:35:37.258 INFO:tasks.workunit.client.1.smithi172.stdout:0/319: creat d4/d44/f78 x:0 0 0 2024-09-20T18:35:37.258 INFO:tasks.workunit.client.1.smithi172.stdout:8/197: rmdir dd/d2b/d34/d39 39 2024-09-20T18:35:37.258 INFO:tasks.workunit.client.1.smithi172.stdout:1/242: truncate d0/d8/f44 321230 0 2024-09-20T18:35:37.260 INFO:tasks.workunit.client.1.smithi172.stdout:8/198: write f0 [4187740,102624] 0 2024-09-20T18:35:37.261 INFO:tasks.workunit.client.1.smithi172.stdout:5/288: dread d4/df/d3f/f43 [0,4194304] 0 2024-09-20T18:35:37.262 INFO:tasks.workunit.client.1.smithi172.stdout:6/196: write d0/fe [1584978,31796] 0 2024-09-20T18:35:37.266 INFO:tasks.workunit.client.1.smithi172.stdout:2/164: mkdir d0/d4/d17/d22/d10/d35 0 2024-09-20T18:35:37.266 INFO:tasks.workunit.client.1.smithi172.stdout:7/244: write d2/d3/f35 [894633,116488] 0 2024-09-20T18:35:37.268 INFO:tasks.workunit.client.1.smithi172.stdout:3/223: rename d0/d13/f2c to d0/db/d3a/f3f 0 2024-09-20T18:35:37.268 INFO:tasks.workunit.client.1.smithi172.stdout:5/289: chown d4/d1f/d26/d2d/d50/c2e 0 1 2024-09-20T18:35:37.270 INFO:tasks.workunit.client.1.smithi172.stdout:7/245: write d2/d3/dd/fe [1665563,113305] 0 2024-09-20T18:35:37.271 INFO:tasks.workunit.client.1.smithi172.stdout:3/224: dread d0/dc/f2b [0,4194304] 0 2024-09-20T18:35:37.272 INFO:tasks.workunit.client.1.smithi172.stdout:2/165: chown d0/d4/d17/d22/c28 4027584 1 2024-09-20T18:35:37.272 INFO:tasks.workunit.client.1.smithi172.stdout:8/199: dread dd/f27 [0,4194304] 0 2024-09-20T18:35:37.274 INFO:tasks.workunit.client.1.smithi172.stdout:6/197: mknod d0/d18/d1c/d22/d27/d35/c3a 0 2024-09-20T18:35:37.274 INFO:tasks.workunit.client.1.smithi172.stdout:7/246: write d2/d3/dd/f19 [1982045,23940] 0 2024-09-20T18:35:37.274 INFO:tasks.workunit.client.1.smithi172.stdout:8/200: read - dd/d2b/f47 zero size 2024-09-20T18:35:37.275 INFO:tasks.workunit.client.1.smithi172.stdout:2/166: chown d0/d4/d17/d22/fc 2528742 1 2024-09-20T18:35:37.275 INFO:tasks.workunit.client.1.smithi172.stdout:5/290: creat d4/df/d3f/f61 x:0 0 0 2024-09-20T18:35:37.277 INFO:tasks.workunit.client.1.smithi172.stdout:0/320: rename d4/d44/f78 to d4/d5/d2e/d76/f79 0 2024-09-20T18:35:37.278 INFO:tasks.workunit.client.1.smithi172.stdout:0/321: stat d4/d1a/c6f 0 2024-09-20T18:35:37.278 INFO:tasks.workunit.client.1.smithi172.stdout:8/201: rmdir dd/d1b/d3b 39 2024-09-20T18:35:37.280 INFO:tasks.workunit.client.1.smithi172.stdout:9/235: dread fe [4194304,4194304] 0 2024-09-20T18:35:37.280 INFO:tasks.workunit.client.1.smithi172.stdout:6/198: creat d0/d18/d1c/d21/d26/f3b x:0 0 0 2024-09-20T18:35:37.281 INFO:tasks.workunit.client.1.smithi172.stdout:3/225: symlink d0/d13/d1e/d33/l40 0 2024-09-20T18:35:37.282 INFO:tasks.workunit.client.1.smithi172.stdout:2/167: creat d0/d4/d17/d22/f36 x:0 0 0 2024-09-20T18:35:37.283 INFO:tasks.workunit.client.1.smithi172.stdout:9/236: write d15/d1f/f40 [245982,10139] 0 2024-09-20T18:35:37.284 INFO:tasks.workunit.client.1.smithi172.stdout:6/199: fsync d0/d18/d1c/d22/f2e 0 2024-09-20T18:35:37.285 INFO:tasks.workunit.client.1.smithi172.stdout:8/202: readlink l3 0 2024-09-20T18:35:37.285 INFO:tasks.workunit.client.1.smithi172.stdout:2/168: fsync d0/d4/f26 0 2024-09-20T18:35:37.286 INFO:tasks.workunit.client.1.smithi172.stdout:3/226: unlink d0/d13/d1e/l3b 0 2024-09-20T18:35:37.288 INFO:tasks.workunit.client.1.smithi172.stdout:8/203: chown dd/d1b/f1f 37 1 2024-09-20T18:35:37.289 INFO:tasks.workunit.client.1.smithi172.stdout:7/247: getdents d2/d23/d3a 0 2024-09-20T18:35:37.289 INFO:tasks.workunit.client.1.smithi172.stdout:3/227: stat d0/db/d3a 0 2024-09-20T18:35:37.289 INFO:tasks.workunit.client.1.smithi172.stdout:9/237: chown lb 1570801 1 2024-09-20T18:35:37.291 INFO:tasks.workunit.client.1.smithi172.stdout:5/291: getdents d4/df 0 2024-09-20T18:35:37.291 INFO:tasks.workunit.client.1.smithi172.stdout:0/322: dwrite d4/d1d/d15/f3b [4194304,4194304] 0 2024-09-20T18:35:37.293 INFO:tasks.workunit.client.1.smithi172.stdout:7/248: write d2/d3/fa [4069624,1366] 0 2024-09-20T18:35:37.294 INFO:tasks.workunit.client.1.smithi172.stdout:1/243: dwrite d0/d8/d12/f29 [0,4194304] 0 2024-09-20T18:35:37.295 INFO:tasks.workunit.client.1.smithi172.stdout:6/200: mknod d0/d18/d1c/d22/d27/d35/c3c 0 2024-09-20T18:35:37.297 INFO:tasks.workunit.client.1.smithi172.stdout:9/238: write d15/d1f/f3f [938714,127260] 0 2024-09-20T18:35:37.304 INFO:tasks.workunit.client.1.smithi172.stdout:3/228: fsync d0/f9 0 2024-09-20T18:35:37.305 INFO:tasks.workunit.client.1.smithi172.stdout:6/201: chown d0/c31 49700 1 2024-09-20T18:35:37.305 INFO:tasks.workunit.client.1.smithi172.stdout:1/244: rmdir d0/d8/d12 39 2024-09-20T18:35:37.305 INFO:tasks.workunit.client.1.smithi172.stdout:9/239: truncate d15/d20/f3a 998186 0 2024-09-20T18:35:37.305 INFO:tasks.workunit.client.1.smithi172.stdout:7/249: write d2/d23/d51/f59 [205281,111389] 0 2024-09-20T18:35:37.306 INFO:tasks.workunit.client.1.smithi172.stdout:8/204: creat dd/d2b/d34/d39/f4e x:0 0 0 2024-09-20T18:35:37.308 INFO:tasks.workunit.client.1.smithi172.stdout:2/169: dwrite d0/d4/d17/d22/fc [0,4194304] 0 2024-09-20T18:35:37.309 INFO:tasks.workunit.client.1.smithi172.stdout:6/202: mknod d0/d18/d1c/d22/c3d 0 2024-09-20T18:35:37.309 INFO:tasks.workunit.client.1.smithi172.stdout:5/292: creat d4/f62 x:0 0 0 2024-09-20T18:35:37.310 INFO:tasks.workunit.client.1.smithi172.stdout:9/240: mkdir d15/d1a/d1e/d48 0 2024-09-20T18:35:37.311 INFO:tasks.workunit.client.1.smithi172.stdout:3/229: unlink d0/d13/d1e/f2d 0 2024-09-20T18:35:37.312 INFO:tasks.workunit.client.1.smithi172.stdout:1/245: rename d0/d8/f14 to d0/d8/db/d25/d2b/d3d/f4d 0 2024-09-20T18:35:37.314 INFO:tasks.workunit.client.1.smithi172.stdout:8/205: mkdir dd/d1b/d4f 0 2024-09-20T18:35:37.320 INFO:tasks.workunit.client.1.smithi172.stdout:1/246: symlink d0/d22/l4e 0 2024-09-20T18:35:37.323 INFO:tasks.workunit.client.1.smithi172.stdout:0/323: truncate d4/d1d/f37 2850306 0 2024-09-20T18:35:37.325 INFO:tasks.workunit.client.1.smithi172.stdout:2/170: rename d0/d4/l15 to d0/d4/d17/d22/d10/l37 0 2024-09-20T18:35:37.326 INFO:tasks.workunit.client.1.smithi172.stdout:7/250: dwrite d2/d23/d51/f59 [0,4194304] 0 2024-09-20T18:35:37.326 INFO:tasks.workunit.client.1.smithi172.stdout:1/247: chown d0/lf 51022 1 2024-09-20T18:35:37.328 INFO:tasks.workunit.client.1.smithi172.stdout:6/203: creat d0/d18/d1c/d21/d26/d34/f3e x:0 0 0 2024-09-20T18:35:37.328 INFO:tasks.workunit.client.1.smithi172.stdout:9/241: dwrite d15/d1a/d1e/d24/f2e [0,4194304] 0 2024-09-20T18:35:37.328 INFO:tasks.workunit.client.1.smithi172.stdout:8/206: symlink dd/d1b/d4f/l50 0 2024-09-20T18:35:37.331 INFO:tasks.workunit.client.1.smithi172.stdout:0/324: chown d4/d5/c27 76021873 1 2024-09-20T18:35:37.331 INFO:tasks.workunit.client.1.smithi172.stdout:6/204: chown d0/d18/d1c/d21/d26/d34 134 1 2024-09-20T18:35:37.332 INFO:tasks.workunit.client.1.smithi172.stdout:5/293: dread d4/d1f/d26/d2d/d50/f2b [0,4194304] 0 2024-09-20T18:35:37.336 INFO:tasks.workunit.client.1.smithi172.stdout:9/242: readlink l10 0 2024-09-20T18:35:37.336 INFO:tasks.workunit.client.1.smithi172.stdout:1/248: write d0/d8/db/d25/d2b/f2d [959369,102203] 0 2024-09-20T18:35:37.336 INFO:tasks.workunit.client.1.smithi172.stdout:2/171: creat d0/d4/d17/d22/f38 x:0 0 0 2024-09-20T18:35:37.336 INFO:tasks.workunit.client.1.smithi172.stdout:7/251: mkdir d2/d3/d3d/d4e/d5f 0 2024-09-20T18:35:37.340 INFO:tasks.workunit.client.1.smithi172.stdout:0/325: mknod d4/d1a/d28/d42/d45/d54/c7a 0 2024-09-20T18:35:37.343 INFO:tasks.workunit.client.1.smithi172.stdout:3/230: dwrite d0/d13/f1c [0,4194304] 0 2024-09-20T18:35:37.345 INFO:tasks.workunit.client.1.smithi172.stdout:1/249: write d0/d8/fc [1208023,76408] 0 2024-09-20T18:35:37.345 INFO:tasks.workunit.client.1.smithi172.stdout:5/294: truncate d4/fc 782609 0 2024-09-20T18:35:37.347 INFO:tasks.workunit.client.1.smithi172.stdout:6/205: symlink d0/d18/d1c/d21/d26/d34/d39/l3f 0 2024-09-20T18:35:37.351 INFO:tasks.workunit.client.1.smithi172.stdout:8/207: dread dd/f27 [0,4194304] 0 2024-09-20T18:35:37.351 INFO:tasks.workunit.client.1.smithi172.stdout:6/206: symlink d0/l40 0 2024-09-20T18:35:37.351 INFO:tasks.workunit.client.1.smithi172.stdout:2/172: creat d0/f39 x:0 0 0 2024-09-20T18:35:37.352 INFO:tasks.workunit.client.1.smithi172.stdout:0/326: write d4/d5/d2e/d33/f5a [467287,108643] 0 2024-09-20T18:35:37.353 INFO:tasks.workunit.client.1.smithi172.stdout:5/295: mkdir d4/d1f/d26/d2d/d63 0 2024-09-20T18:35:37.356 INFO:tasks.workunit.client.1.smithi172.stdout:1/250: dread d0/d8/f2c [0,4194304] 0 2024-09-20T18:35:37.356 INFO:tasks.workunit.client.1.smithi172.stdout:8/208: truncate f1 4332018 0 2024-09-20T18:35:37.356 INFO:tasks.workunit.client.1.smithi172.stdout:6/207: rmdir d0/d18/d1c 39 2024-09-20T18:35:37.359 INFO:tasks.workunit.client.1.smithi172.stdout:0/327: write d4/d1a/d28/d42/d45/d54/f64 [482875,94090] 0 2024-09-20T18:35:37.359 INFO:tasks.workunit.client.1.smithi172.stdout:7/252: dwrite d2/d3/dd/f2f [0,4194304] 0 2024-09-20T18:35:37.359 INFO:tasks.workunit.client.1.smithi172.stdout:5/296: mkdir d4/df/d3f/d64 0 2024-09-20T18:35:37.362 INFO:tasks.workunit.client.1.smithi172.stdout:2/173: mknod d0/d4/d17/d22/d10/d35/c3a 0 2024-09-20T18:35:37.365 INFO:tasks.workunit.client.1.smithi172.stdout:8/209: rename dd/d2b to dd/d1b/d3b/d51 0 2024-09-20T18:35:37.367 INFO:tasks.workunit.client.1.smithi172.stdout:2/174: stat d0/d4/d17/d22/f13 0 2024-09-20T18:35:37.368 INFO:tasks.workunit.client.1.smithi172.stdout:6/208: fdatasync d0/d18/d1c/d22/f2e 0 2024-09-20T18:35:37.373 INFO:tasks.workunit.client.1.smithi172.stdout:8/210: rename dd to dd/d1b/d3b/d51/d52 22 2024-09-20T18:35:37.373 INFO:tasks.workunit.client.1.smithi172.stdout:2/175: chown d0/d4/d17/d22/f36 409566396 1 2024-09-20T18:35:37.374 INFO:tasks.workunit.client.1.smithi172.stdout:9/243: dread f6 [0,4194304] 0 2024-09-20T18:35:37.374 INFO:tasks.workunit.client.1.smithi172.stdout:6/209: symlink d0/d3/l41 0 2024-09-20T18:35:37.375 INFO:tasks.workunit.client.1.smithi172.stdout:0/328: dwrite d4/d1a/d28/d42/d45/d54/f64 [0,4194304] 0 2024-09-20T18:35:37.375 INFO:tasks.workunit.client.1.smithi172.stdout:1/251: getdents d0/d8/db/d25/d2b 0 2024-09-20T18:35:37.378 INFO:tasks.workunit.client.1.smithi172.stdout:2/176: chown d0/d4/f2a 33355124 1 2024-09-20T18:35:37.379 INFO:tasks.workunit.client.1.smithi172.stdout:5/297: dwrite d4/d1f/f4a [0,4194304] 0 2024-09-20T18:35:37.380 INFO:tasks.workunit.client.1.smithi172.stdout:7/253: truncate d2/d3/dd/f1d 438422 0 2024-09-20T18:35:37.381 INFO:tasks.workunit.client.1.smithi172.stdout:8/211: truncate dd/d1b/d3b/d51/f47 699525 0 2024-09-20T18:35:37.383 INFO:tasks.workunit.client.1.smithi172.stdout:5/298: write d4/f62 [408343,58653] 0 2024-09-20T18:35:37.384 INFO:tasks.workunit.client.1.smithi172.stdout:0/329: rmdir d4/d1a/d28/d75 39 2024-09-20T18:35:37.385 INFO:tasks.workunit.client.1.smithi172.stdout:5/299: dread - d4/df/d3f/f49 zero size 2024-09-20T18:35:37.385 INFO:tasks.workunit.client.1.smithi172.stdout:1/252: rename d0/l1c to d0/d8/d12/l4f 0 2024-09-20T18:35:37.386 INFO:tasks.workunit.client.1.smithi172.stdout:8/212: truncate dd/d1b/d3b/d51/f2e 736326 0 2024-09-20T18:35:37.386 INFO:tasks.workunit.client.1.smithi172.stdout:0/330: write d4/d1d/d15/f69 [605088,5141] 0 2024-09-20T18:35:37.386 INFO:tasks.workunit.client.1.smithi172.stdout:7/254: creat d2/d3/d10/d40/d46/f60 x:0 0 0 2024-09-20T18:35:37.388 INFO:tasks.workunit.client.1.smithi172.stdout:6/210: write d0/d3/f7 [2019655,38029] 0 2024-09-20T18:35:37.388 INFO:tasks.workunit.client.1.smithi172.stdout:8/213: chown dd/d1b/d3b/d51/f2e 4 1 2024-09-20T18:35:37.390 INFO:tasks.workunit.client.1.smithi172.stdout:2/177: write d0/d4/d17/d22/f13 [1055985,115892] 0 2024-09-20T18:35:37.390 INFO:tasks.workunit.client.1.smithi172.stdout:5/300: chown d4/l29 28602 1 2024-09-20T18:35:37.390 INFO:tasks.workunit.client.1.smithi172.stdout:7/255: truncate d2/d3/dd/f4c 587774 0 2024-09-20T18:35:37.392 INFO:tasks.workunit.client.1.smithi172.stdout:0/331: chown d4/d1a/d28/d75/f43 17757 1 2024-09-20T18:35:37.392 INFO:tasks.workunit.client.1.smithi172.stdout:5/301: dread - d4/df/d3f/f49 zero size 2024-09-20T18:35:37.392 INFO:tasks.workunit.client.1.smithi172.stdout:7/256: read d2/d3/d10/f20 [465173,46919] 0 2024-09-20T18:35:37.392 INFO:tasks.workunit.client.1.smithi172.stdout:2/178: write d0/d4/d17/d22/f13 [2285813,110115] 0 2024-09-20T18:35:37.393 INFO:tasks.workunit.client.1.smithi172.stdout:6/211: chown d0/d18/f1e 38962 1 2024-09-20T18:35:37.395 INFO:tasks.workunit.client.1.smithi172.stdout:6/212: write d0/d3/f20 [88277,68976] 0 2024-09-20T18:35:37.395 INFO:tasks.workunit.client.1.smithi172.stdout:8/214: mknod dd/d1b/d3b/c53 0 2024-09-20T18:35:37.397 INFO:tasks.workunit.client.1.smithi172.stdout:1/253: rename d0/d8/db/d25/d2b/l38 to d0/d8/db/d25/d2b/d3d/l50 0 2024-09-20T18:35:37.401 INFO:tasks.workunit.client.1.smithi172.stdout:2/179: mkdir d0/d4/d17/d18/d3b 0 2024-09-20T18:35:37.401 INFO:tasks.workunit.client.1.smithi172.stdout:8/215: stat dd/c1a 0 2024-09-20T18:35:37.402 INFO:tasks.workunit.client.1.smithi172.stdout:6/213: truncate d0/f5 1658119 0 2024-09-20T18:35:37.402 INFO:tasks.workunit.client.1.smithi172.stdout:8/216: chown dd/d1b/l29 261955 1 2024-09-20T18:35:37.404 INFO:tasks.workunit.client.1.smithi172.stdout:8/217: write dd/d1b/d3b/d51/f47 [600016,41545] 0 2024-09-20T18:35:37.407 INFO:tasks.workunit.client.1.smithi172.stdout:1/254: creat d0/d8/f51 x:0 0 0 2024-09-20T18:35:37.411 INFO:tasks.workunit.client.1.smithi172.stdout:1/255: mkdir d0/d52 0 2024-09-20T18:35:37.411 INFO:tasks.workunit.client.1.smithi172.stdout:7/257: dread d2/d3/d10/f2d [0,4194304] 0 2024-09-20T18:35:37.412 INFO:tasks.workunit.client.1.smithi172.stdout:0/332: write d4/f18 [2531178,74515] 0 2024-09-20T18:35:37.413 INFO:tasks.workunit.client.1.smithi172.stdout:8/218: link dd/d1b/d3b/d51/f2e dd/d1b/d3b/d51/d34/d39/d4d/f54 0 2024-09-20T18:35:37.413 INFO:tasks.workunit.client.1.smithi172.stdout:7/258: rmdir d2/d23/d3a 39 2024-09-20T18:35:37.416 INFO:tasks.workunit.client.1.smithi172.stdout:8/219: unlink dd/c18 0 2024-09-20T18:35:37.417 INFO:tasks.workunit.client.1.smithi172.stdout:8/220: write f1 [2204956,103708] 0 2024-09-20T18:35:37.417 INFO:tasks.workunit.client.1.smithi172.stdout:1/256: mknod d0/d8/db/d25/c53 0 2024-09-20T18:35:37.418 INFO:tasks.workunit.client.1.smithi172.stdout:6/214: truncate d0/d18/f29 3925111 0 2024-09-20T18:35:37.419 INFO:tasks.workunit.client.1.smithi172.stdout:0/333: fdatasync d4/d1d/f37 0 2024-09-20T18:35:37.420 INFO:tasks.workunit.client.1.smithi172.stdout:7/259: creat d2/d3/d3d/d4e/d5f/f61 x:0 0 0 2024-09-20T18:35:37.421 INFO:tasks.workunit.client.1.smithi172.stdout:7/260: chown d2/d3/d10/d40 62 1 2024-09-20T18:35:37.421 INFO:tasks.workunit.client.1.smithi172.stdout:7/261: stat d2/f39 0 2024-09-20T18:35:37.424 INFO:tasks.workunit.client.1.smithi172.stdout:0/334: creat d4/d1d/d15/f7b x:0 0 0 2024-09-20T18:35:37.424 INFO:tasks.workunit.client.1.smithi172.stdout:6/215: symlink d0/d18/l42 0 2024-09-20T18:35:37.426 INFO:tasks.workunit.client.1.smithi172.stdout:0/335: chown d4/d5/l1f 2841 1 2024-09-20T18:35:37.426 INFO:tasks.workunit.client.1.smithi172.stdout:6/216: chown d0/c31 29 1 2024-09-20T18:35:37.428 INFO:tasks.workunit.client.1.smithi172.stdout:8/221: creat dd/d1b/f55 x:0 0 0 2024-09-20T18:35:37.428 INFO:tasks.workunit.client.1.smithi172.stdout:7/262: dwrite d2/d3/dd/f4c [0,4194304] 0 2024-09-20T18:35:37.429 INFO:tasks.workunit.client.1.smithi172.stdout:6/217: chown d0/d18/d1c/d22/c3d 77 1 2024-09-20T18:35:37.430 INFO:tasks.workunit.client.1.smithi172.stdout:7/263: fsync d2/d3/f3b 0 2024-09-20T18:35:37.430 INFO:tasks.workunit.client.1.smithi172.stdout:0/336: mknod d4/d5/d2e/d76/c7c 0 2024-09-20T18:35:37.431 INFO:tasks.workunit.client.1.smithi172.stdout:1/257: truncate d0/d8/d12/f1a 3125300 0 2024-09-20T18:35:37.438 INFO:tasks.workunit.client.1.smithi172.stdout:8/222: rename dd/d1b/d3b/d51/l2d to dd/d1b/d3b/d51/l56 0 2024-09-20T18:35:37.438 INFO:tasks.workunit.client.1.smithi172.stdout:7/264: dread d2/d3/d10/f20 [0,4194304] 0 2024-09-20T18:35:37.439 INFO:tasks.workunit.client.1.smithi172.stdout:0/337: dwrite d4/d1a/d28/d75/f43 [4194304,4194304] 0 2024-09-20T18:35:37.439 INFO:tasks.workunit.client.1.smithi172.stdout:6/218: getdents d0/d18/d1c/d21/d26/d34/d39 0 2024-09-20T18:35:37.441 INFO:tasks.workunit.client.1.smithi172.stdout:7/265: dread - d2/f3e zero size 2024-09-20T18:35:37.442 INFO:tasks.workunit.client.1.smithi172.stdout:8/223: symlink dd/d1b/d4f/l57 0 2024-09-20T18:35:37.442 INFO:tasks.workunit.client.1.smithi172.stdout:6/219: dread d0/f36 [0,4194304] 0 2024-09-20T18:35:37.444 INFO:tasks.workunit.client.1.smithi172.stdout:1/258: write d0/d8/f16 [2392720,98868] 0 2024-09-20T18:35:37.445 INFO:tasks.workunit.client.1.smithi172.stdout:4/216: sync 2024-09-20T18:35:37.446 INFO:tasks.workunit.client.1.smithi172.stdout:0/338: mknod d4/c7d 0 2024-09-20T18:35:37.448 INFO:tasks.workunit.client.1.smithi172.stdout:7/266: rename d2/d3/d10/d40/d46/c4f to d2/d3/d10/d40/d46/c62 0 2024-09-20T18:35:37.449 INFO:tasks.workunit.client.1.smithi172.stdout:4/217: write d0/d7/f12 [1698179,80284] 0 2024-09-20T18:35:37.450 INFO:tasks.workunit.client.1.smithi172.stdout:7/267: chown d2/d3/d10/f2d 14131024 1 2024-09-20T18:35:37.451 INFO:tasks.workunit.client.1.smithi172.stdout:8/224: dwrite fa [0,4194304] 0 2024-09-20T18:35:37.452 INFO:tasks.workunit.client.1.smithi172.stdout:1/259: rename d0/d8/db/f18 to d0/d22/f54 0 2024-09-20T18:35:37.453 INFO:tasks.workunit.client.1.smithi172.stdout:1/260: readlink d0/d8/db/d25/l27 0 2024-09-20T18:35:37.453 INFO:tasks.workunit.client.1.smithi172.stdout:6/220: creat d0/d18/f43 x:0 0 0 2024-09-20T18:35:37.455 INFO:tasks.workunit.client.1.smithi172.stdout:8/225: symlink dd/d1b/d3b/l58 0 2024-09-20T18:35:37.456 INFO:tasks.workunit.client.1.smithi172.stdout:4/218: rename d0/d7/df/d18/d1a to d0/d7/df/d15/d55 0 2024-09-20T18:35:37.458 INFO:tasks.workunit.client.1.smithi172.stdout:1/261: creat d0/d8/db/d39/f55 x:0 0 0 2024-09-20T18:35:37.460 INFO:tasks.workunit.client.1.smithi172.stdout:0/339: creat d4/f7e x:0 0 0 2024-09-20T18:35:37.461 INFO:tasks.workunit.client.1.smithi172.stdout:7/268: symlink d2/d23/d3a/l63 0 2024-09-20T18:35:37.461 INFO:tasks.workunit.client.1.smithi172.stdout:6/221: dwrite d0/d18/d1c/d21/d26/d34/f3e [0,4194304] 0 2024-09-20T18:35:37.462 INFO:tasks.workunit.client.1.smithi172.stdout:7/269: dread - d2/d3/f3b zero size 2024-09-20T18:35:37.466 INFO:tasks.workunit.client.1.smithi172.stdout:1/262: mknod d0/d8/db/d25/d2b/c56 0 2024-09-20T18:35:37.468 INFO:tasks.workunit.client.1.smithi172.stdout:0/340: mkdir d4/d1d/d7f 0 2024-09-20T18:35:37.468 INFO:tasks.workunit.client.1.smithi172.stdout:0/341: stat d4/d5/fb 0 2024-09-20T18:35:37.469 INFO:tasks.workunit.client.1.smithi172.stdout:1/263: creat d0/f57 x:0 0 0 2024-09-20T18:35:37.471 INFO:tasks.workunit.client.1.smithi172.stdout:0/342: write d4/d1a/d28/d42/d45/d54/f72 [3939002,129757] 0 2024-09-20T18:35:37.473 INFO:tasks.workunit.client.1.smithi172.stdout:1/264: rename d0/lf to d0/d8/db/l58 0 2024-09-20T18:35:37.474 INFO:tasks.workunit.client.1.smithi172.stdout:1/265: fdatasync d0/d8/f16 0 2024-09-20T18:35:37.474 INFO:tasks.workunit.client.1.smithi172.stdout:1/266: fdatasync d0/d8/f32 0 2024-09-20T18:35:37.475 INFO:tasks.workunit.client.1.smithi172.stdout:8/226: link dd/c28 dd/d1b/d3b/d51/d34/d39/d4d/c59 0 2024-09-20T18:35:37.476 INFO:tasks.workunit.client.1.smithi172.stdout:0/343: symlink d4/d5/l80 0 2024-09-20T18:35:37.476 INFO:tasks.workunit.client.1.smithi172.stdout:1/267: chown d0/d8/db/d25/d2b/f37 507250 1 2024-09-20T18:35:37.476 INFO:tasks.workunit.client.1.smithi172.stdout:4/219: link d0/d7/df/d15/c23 d0/de/c56 0 2024-09-20T18:35:37.478 INFO:tasks.workunit.client.1.smithi172.stdout:1/268: creat d0/f59 x:0 0 0 2024-09-20T18:35:37.479 INFO:tasks.workunit.client.1.smithi172.stdout:0/344: unlink d4/d1a/d28/d75/f4f 0 2024-09-20T18:35:37.480 INFO:tasks.workunit.client.1.smithi172.stdout:1/269: readlink d0/d8/l1e 0 2024-09-20T18:35:37.481 INFO:tasks.workunit.client.1.smithi172.stdout:4/220: truncate d0/d7/df/d15/d55/f3e 125048 0 2024-09-20T18:35:37.482 INFO:tasks.workunit.client.1.smithi172.stdout:1/270: creat d0/f5a x:0 0 0 2024-09-20T18:35:37.483 INFO:tasks.workunit.client.1.smithi172.stdout:0/345: creat d4/d1a/d28/d42/f81 x:0 0 0 2024-09-20T18:35:37.483 INFO:tasks.workunit.client.1.smithi172.stdout:1/271: fsync d0/d8/fc 0 2024-09-20T18:35:37.483 INFO:tasks.workunit.client.1.smithi172.stdout:8/227: dwrite dd/d1b/d3b/d51/d34/f36 [0,4194304] 0 2024-09-20T18:35:37.485 INFO:tasks.workunit.client.1.smithi172.stdout:0/346: write d4/d44/f5c [50233,68310] 0 2024-09-20T18:35:37.487 INFO:tasks.workunit.client.1.smithi172.stdout:7/270: truncate d2/d3/dd/fe 2206491 0 2024-09-20T18:35:37.488 INFO:tasks.workunit.client.1.smithi172.stdout:4/221: rename d0/de/c56 to d0/de/d21/d24/d34/c57 0 2024-09-20T18:35:37.489 INFO:tasks.workunit.client.1.smithi172.stdout:1/272: chown d0/d8/d12/f1a 115 1 2024-09-20T18:35:37.489 INFO:tasks.workunit.client.1.smithi172.stdout:0/347: mknod d4/d1a/d28/d42/d45/d54/c82 0 2024-09-20T18:35:37.491 INFO:tasks.workunit.client.1.smithi172.stdout:7/271: truncate d2/f3e 969983 0 2024-09-20T18:35:37.491 INFO:tasks.workunit.client.1.smithi172.stdout:1/273: fsync d0/d8/db/f3c 0 2024-09-20T18:35:37.494 INFO:tasks.workunit.client.1.smithi172.stdout:0/348: unlink d4/d5/c27 0 2024-09-20T18:35:37.495 INFO:tasks.workunit.client.1.smithi172.stdout:8/228: dread fa [0,4194304] 0 2024-09-20T18:35:37.498 INFO:tasks.workunit.client.1.smithi172.stdout:6/222: dwrite d0/f5 [0,4194304] 0 2024-09-20T18:35:37.501 INFO:tasks.workunit.client.1.smithi172.stdout:0/349: unlink d4/d5/d2e/d76/c7c 0 2024-09-20T18:35:37.501 INFO:tasks.workunit.client.1.smithi172.stdout:7/272: dread d2/d23/f24 [0,4194304] 0 2024-09-20T18:35:37.501 INFO:tasks.workunit.client.1.smithi172.stdout:8/229: truncate dd/d1b/f2c 924394 0 2024-09-20T18:35:37.502 INFO:tasks.workunit.client.1.smithi172.stdout:6/223: mknod d0/d3/c44 0 2024-09-20T18:35:37.503 INFO:tasks.workunit.client.1.smithi172.stdout:4/222: dwrite d0/f2a [0,4194304] 0 2024-09-20T18:35:37.504 INFO:tasks.workunit.client.1.smithi172.stdout:1/274: link d0/d8/ca d0/c5b 0 2024-09-20T18:35:37.505 INFO:tasks.workunit.client.1.smithi172.stdout:0/350: write d4/d1a/d28/d42/f81 [186116,86477] 0 2024-09-20T18:35:37.505 INFO:tasks.workunit.client.1.smithi172.stdout:4/223: stat d0/de/l6 0 2024-09-20T18:35:37.507 INFO:tasks.workunit.client.1.smithi172.stdout:1/275: stat d0/d8/db/d25/d2b 0 2024-09-20T18:35:37.510 INFO:tasks.workunit.client.1.smithi172.stdout:1/276: chown d0/d8/d12/f1a 61297524 1 2024-09-20T18:35:37.510 INFO:tasks.workunit.client.1.smithi172.stdout:4/224: dread d0/f32 [0,4194304] 0 2024-09-20T18:35:37.511 INFO:tasks.workunit.client.1.smithi172.stdout:6/224: creat d0/d18/d1c/d21/d26/f45 x:0 0 0 2024-09-20T18:35:37.513 INFO:tasks.workunit.client.1.smithi172.stdout:1/277: dread - d0/f57 zero size 2024-09-20T18:35:37.514 INFO:tasks.workunit.client.1.smithi172.stdout:7/273: dwrite d2/f54 [0,4194304] 0 2024-09-20T18:35:37.516 INFO:tasks.workunit.client.1.smithi172.stdout:0/351: dread d4/d5/d2e/d33/f4e [0,4194304] 0 2024-09-20T18:35:37.517 INFO:tasks.workunit.client.1.smithi172.stdout:7/274: truncate d2/d3/d3d/d4e/d5f/f61 960468 0 2024-09-20T18:35:37.522 INFO:tasks.workunit.client.1.smithi172.stdout:8/230: rename dd/d1b/d3b/c41 to dd/d1b/c5a 0 2024-09-20T18:35:37.523 INFO:tasks.workunit.client.1.smithi172.stdout:0/352: dread d4/d1a/d28/d42/d45/d54/f64 [0,4194304] 0 2024-09-20T18:35:37.524 INFO:tasks.workunit.client.1.smithi172.stdout:0/353: write d4/d5/f2f [876978,39656] 0 2024-09-20T18:35:37.532 INFO:tasks.workunit.client.1.smithi172.stdout:7/275: symlink d2/d23/d3a/l64 0 2024-09-20T18:35:37.539 INFO:tasks.workunit.client.1.smithi172.stdout:0/354: write d4/d5/d2e/d33/f4e [5765896,108903] 0 2024-09-20T18:35:37.540 INFO:tasks.workunit.client.1.smithi172.stdout:0/355: dread - d4/d1d/f59 zero size 2024-09-20T18:35:37.541 INFO:tasks.workunit.client.1.smithi172.stdout:0/356: stat d4/d1a/d28/d42/d45/f52 0 2024-09-20T18:35:37.542 INFO:tasks.workunit.client.1.smithi172.stdout:6/225: fdatasync d0/d18/f29 0 2024-09-20T18:35:37.543 INFO:tasks.workunit.client.1.smithi172.stdout:6/226: write d0/fe [432449,75494] 0 2024-09-20T18:35:37.545 INFO:tasks.workunit.client.1.smithi172.stdout:7/276: dread d2/d3/d10/f14 [0,4194304] 0 2024-09-20T18:35:37.557 INFO:tasks.workunit.client.1.smithi172.stdout:6/227: dread d0/d3/f7 [0,4194304] 0 2024-09-20T18:35:37.562 INFO:tasks.workunit.client.1.smithi172.stdout:0/357: link d4/d44/f61 d4/d1a/d28/d42/f83 0 2024-09-20T18:35:37.563 INFO:tasks.workunit.client.1.smithi172.stdout:1/278: getdents d0/d8/db/d39 0 2024-09-20T18:35:37.567 INFO:tasks.workunit.client.1.smithi172.stdout:6/228: rename d0/d3 to d0/d18/d1c/d21/d26/d34/d39/d46 0 2024-09-20T18:35:37.569 INFO:tasks.workunit.client.1.smithi172.stdout:1/279: dread d0/d8/f16 [0,4194304] 0 2024-09-20T18:35:37.569 INFO:tasks.workunit.client.1.smithi172.stdout:1/280: dread - d0/f59 zero size 2024-09-20T18:35:37.570 INFO:tasks.workunit.client.1.smithi172.stdout:8/231: getdents dd/d1b/d3b/d51/d34/d39 0 2024-09-20T18:35:37.574 INFO:tasks.workunit.client.1.smithi172.stdout:7/277: creat d2/f65 x:0 0 0 2024-09-20T18:35:37.577 INFO:tasks.workunit.client.1.smithi172.stdout:0/358: mknod d4/d1a/d28/d75/d60/c84 0 2024-09-20T18:35:37.578 INFO:tasks.workunit.client.1.smithi172.stdout:0/359: write d4/d1a/d28/d42/d45/d54/f72 [1277975,35861] 0 2024-09-20T18:35:37.580 INFO:tasks.workunit.client.1.smithi172.stdout:8/232: mkdir dd/d1b/d3b/d51/d5b 0 2024-09-20T18:35:37.595 INFO:tasks.workunit.client.1.smithi172.stdout:7/278: getdents d2/d3/dd 0 2024-09-20T18:35:37.597 INFO:tasks.workunit.client.1.smithi172.stdout:0/360: creat d4/f85 x:0 0 0 2024-09-20T18:35:37.600 INFO:tasks.workunit.client.1.smithi172.stdout:8/233: creat dd/d1b/d3b/d51/d34/f5c x:0 0 0 2024-09-20T18:35:37.600 INFO:tasks.workunit.client.1.smithi172.stdout:3/231: sync 2024-09-20T18:35:37.601 INFO:tasks.workunit.client.1.smithi172.stdout:7/279: fsync d2/d3/dd/f49 0 2024-09-20T18:35:37.603 INFO:tasks.workunit.client.1.smithi172.stdout:3/232: mknod d0/d13/d1e/c41 0 2024-09-20T18:35:37.606 INFO:tasks.workunit.client.1.smithi172.stdout:7/280: dwrite d2/f54 [4194304,4194304] 0 2024-09-20T18:35:37.608 INFO:tasks.workunit.client.1.smithi172.stdout:7/281: chown d2/d3/d10/d40/d46/c50 416277530 1 2024-09-20T18:35:37.610 INFO:tasks.workunit.client.1.smithi172.stdout:1/281: truncate d0/d8/d12/f29 3358063 0 2024-09-20T18:35:37.610 INFO:tasks.workunit.client.1.smithi172.stdout:1/282: stat d0/d8/db/d39 0 2024-09-20T18:35:37.611 INFO:tasks.workunit.client.1.smithi172.stdout:0/361: creat d4/f86 x:0 0 0 2024-09-20T18:35:37.612 INFO:tasks.workunit.client.1.smithi172.stdout:0/362: truncate d4/d5/d2e/f49 329480 0 2024-09-20T18:35:37.617 INFO:tasks.workunit.client.1.smithi172.stdout:1/283: symlink d0/d22/l5c 0 2024-09-20T18:35:37.623 INFO:tasks.workunit.client.1.smithi172.stdout:1/284: creat d0/d8/d12/f5d x:0 0 0 2024-09-20T18:35:37.624 INFO:tasks.workunit.client.1.smithi172.stdout:1/285: write d0/d8/db/d25/f49 [887176,17432] 0 2024-09-20T18:35:37.625 INFO:tasks.workunit.client.1.smithi172.stdout:1/286: truncate d0/d8/f51 205358 0 2024-09-20T18:35:37.629 INFO:tasks.workunit.client.1.smithi172.stdout:0/363: getdents d4/d5 0 2024-09-20T18:35:37.630 INFO:tasks.workunit.client.1.smithi172.stdout:0/364: fsync d4/d5/d2e/f49 0 2024-09-20T18:35:37.630 INFO:tasks.workunit.client.1.smithi172.stdout:3/233: write d0/f8 [704303,29376] 0 2024-09-20T18:35:37.631 INFO:tasks.workunit.client.1.smithi172.stdout:1/287: rename d0/d8/db/l3a to d0/d8/db/l5e 0 2024-09-20T18:35:37.635 INFO:tasks.workunit.client.1.smithi172.stdout:0/365: read d4/f6 [3439361,45234] 0 2024-09-20T18:35:37.639 INFO:tasks.workunit.client.1.smithi172.stdout:7/282: truncate d2/d3/dd/f4c 3474849 0 2024-09-20T18:35:37.644 INFO:tasks.workunit.client.1.smithi172.stdout:1/288: mkdir d0/d8/d5f 0 2024-09-20T18:35:37.646 INFO:tasks.workunit.client.1.smithi172.stdout:0/366: symlink d4/d1a/l87 0 2024-09-20T18:35:37.649 INFO:tasks.workunit.client.1.smithi172.stdout:3/234: link d0/l25 d0/d13/d1e/l42 0 2024-09-20T18:35:37.652 INFO:tasks.workunit.client.1.smithi172.stdout:3/235: dread d0/db/f23 [4194304,4194304] 0 2024-09-20T18:35:37.660 INFO:tasks.workunit.client.1.smithi172.stdout:7/283: rename d2/f9 to d2/d23/f66 0 2024-09-20T18:35:37.667 INFO:tasks.workunit.client.1.smithi172.stdout:3/236: rename d0/d13/d1e/d33/l40 to d0/db/d22/l43 0 2024-09-20T18:35:37.669 INFO:tasks.workunit.client.1.smithi172.stdout:7/284: creat d2/d1c/f67 x:0 0 0 2024-09-20T18:35:37.672 INFO:tasks.workunit.client.1.smithi172.stdout:7/285: mkdir d2/d3/d3d/d68 0 2024-09-20T18:35:37.678 INFO:tasks.workunit.client.1.smithi172.stdout:3/237: creat d0/f44 x:0 0 0 2024-09-20T18:35:37.678 INFO:tasks.workunit.client.1.smithi172.stdout:7/286: dwrite d2/d23/d51/f59 [0,4194304] 0 2024-09-20T18:35:37.682 INFO:tasks.workunit.client.1.smithi172.stdout:3/238: dread d0/dc/f2b [0,4194304] 0 2024-09-20T18:35:37.682 INFO:tasks.workunit.client.1.smithi172.stdout:0/367: truncate d4/d5/d2e/d33/f4e 60538 0 2024-09-20T18:35:37.691 INFO:tasks.workunit.client.1.smithi172.stdout:3/239: symlink d0/l45 0 2024-09-20T18:35:37.692 INFO:tasks.workunit.client.1.smithi172.stdout:0/368: mkdir d4/d1a/d28/d88 0 2024-09-20T18:35:37.693 INFO:tasks.workunit.client.1.smithi172.stdout:0/369: readlink d4/d1a/l63 0 2024-09-20T18:35:37.698 INFO:tasks.workunit.client.1.smithi172.stdout:3/240: fsync d0/f44 0 2024-09-20T18:35:37.699 INFO:tasks.workunit.client.1.smithi172.stdout:0/370: dwrite d4/d1a/d28/d42/f81 [0,4194304] 0 2024-09-20T18:35:37.708 INFO:tasks.workunit.client.1.smithi172.stdout:0/371: dwrite d4/d1a/d28/d42/d45/f52 [0,4194304] 0 2024-09-20T18:35:37.711 INFO:tasks.workunit.client.1.smithi172.stdout:3/241: dwrite d0/dc/f3c [0,4194304] 0 2024-09-20T18:35:37.715 INFO:tasks.workunit.client.1.smithi172.stdout:7/287: truncate d2/d3/dd/f4c 3031891 0 2024-09-20T18:35:37.718 INFO:tasks.workunit.client.1.smithi172.stdout:3/242: creat d0/d13/d1e/f46 x:0 0 0 2024-09-20T18:35:37.722 INFO:tasks.workunit.client.1.smithi172.stdout:7/288: creat d2/d1c/f69 x:0 0 0 2024-09-20T18:35:37.722 INFO:tasks.workunit.client.1.smithi172.stdout:7/289: dread - d2/f65 zero size 2024-09-20T18:35:37.723 INFO:tasks.workunit.client.1.smithi172.stdout:7/290: chown d2/d1c/l28 170416221 1 2024-09-20T18:35:37.723 INFO:tasks.workunit.client.1.smithi172.stdout:3/243: mknod d0/db/c47 0 2024-09-20T18:35:37.724 INFO:tasks.workunit.client.1.smithi172.stdout:7/291: dread d2/d3/dd/f49 [0,4194304] 0 2024-09-20T18:35:37.725 INFO:tasks.workunit.client.1.smithi172.stdout:7/292: readlink d2/d3/d10/l4b 0 2024-09-20T18:35:37.725 INFO:tasks.workunit.client.1.smithi172.stdout:7/293: write d2/d1c/f69 [199168,113221] 0 2024-09-20T18:35:37.730 INFO:tasks.workunit.client.1.smithi172.stdout:7/294: mkdir d2/d3/d10/d40/d6a 0 2024-09-20T18:35:37.734 INFO:tasks.workunit.client.1.smithi172.stdout:7/295: symlink d2/d23/d51/l6b 0 2024-09-20T18:35:37.735 INFO:tasks.workunit.client.1.smithi172.stdout:3/244: link d0/d13/d1e/l27 d0/l48 0 2024-09-20T18:35:37.737 INFO:tasks.workunit.client.1.smithi172.stdout:7/296: creat d2/d3/d10/d40/d46/f6c x:0 0 0 2024-09-20T18:35:37.738 INFO:tasks.workunit.client.1.smithi172.stdout:7/297: readlink d2/d3/d3d/d4e/l57 0 2024-09-20T18:35:37.739 INFO:tasks.workunit.client.1.smithi172.stdout:3/245: dread d0/d13/f1c [0,4194304] 0 2024-09-20T18:35:37.744 INFO:tasks.workunit.client.1.smithi172.stdout:9/244: sync 2024-09-20T18:35:37.749 INFO:tasks.workunit.client.1.smithi172.stdout:7/298: link d2/c8 d2/d3/d3d/d4e/c6d 0 2024-09-20T18:35:37.750 INFO:tasks.workunit.client.1.smithi172.stdout:9/245: dwrite d15/d20/f21 [0,4194304] 0 2024-09-20T18:35:37.769 INFO:tasks.workunit.client.1.smithi172.stdout:3/246: truncate d0/f16 1858585 0 2024-09-20T18:35:37.772 INFO:tasks.workunit.client.1.smithi172.stdout:3/247: mknod d0/dc/c49 0 2024-09-20T18:35:37.777 INFO:tasks.workunit.client.1.smithi172.stdout:3/248: link d0/f9 d0/d13/d1e/d33/f4a 0 2024-09-20T18:35:37.779 INFO:tasks.workunit.client.1.smithi172.stdout:7/299: dwrite d2/d3/d10/f20 [0,4194304] 0 2024-09-20T18:35:37.779 INFO:tasks.workunit.client.1.smithi172.stdout:3/249: write d0/f9 [4237224,12636] 0 2024-09-20T18:35:37.784 INFO:tasks.workunit.client.1.smithi172.stdout:7/300: mkdir d2/d5a/d6e 0 2024-09-20T18:35:37.787 INFO:tasks.workunit.client.1.smithi172.stdout:7/301: creat d2/d1c/f6f x:0 0 0 2024-09-20T18:35:37.790 INFO:tasks.workunit.client.1.smithi172.stdout:7/302: mknod d2/d5a/c70 0 2024-09-20T18:35:37.796 INFO:tasks.workunit.client.1.smithi172.stdout:7/303: link d2/d3/d10/d40/d46/f60 d2/d23/d3a/f71 0 2024-09-20T18:35:37.796 INFO:tasks.workunit.client.1.smithi172.stdout:7/304: fsync d2/d3/d10/f15 0 2024-09-20T18:35:37.799 INFO:tasks.workunit.client.1.smithi172.stdout:7/305: mkdir d2/d23/d3a/d72 0 2024-09-20T18:35:37.803 INFO:tasks.workunit.client.1.smithi172.stdout:7/306: mknod d2/d23/d51/c73 0 2024-09-20T18:35:37.806 INFO:tasks.workunit.client.1.smithi172.stdout:7/307: dread d2/d3/dd/f42 [0,4194304] 0 2024-09-20T18:35:37.847 INFO:tasks.workunit.client.1.smithi172.stdout:7/308: write d2/d3/f45 [328691,120385] 0 2024-09-20T18:35:37.849 INFO:tasks.workunit.client.1.smithi172.stdout:7/309: mkdir d2/d3/d10/d40/d74 0 2024-09-20T18:35:37.851 INFO:tasks.workunit.client.1.smithi172.stdout:7/310: rename d2/d3/fa to d2/d3/dd/f75 0 2024-09-20T18:35:37.852 INFO:tasks.workunit.client.1.smithi172.stdout:7/311: readlink d2/d3/d10/l1e 0 2024-09-20T18:35:37.854 INFO:tasks.workunit.client.1.smithi172.stdout:7/312: dread d2/d3/f45 [0,4194304] 0 2024-09-20T18:35:37.857 INFO:tasks.workunit.client.1.smithi172.stdout:7/313: mkdir d2/d3/d10/d40/d6a/d76 0 2024-09-20T18:35:37.859 INFO:tasks.workunit.client.1.smithi172.stdout:7/314: mknod d2/d3/d3d/d4e/c77 0 2024-09-20T18:35:37.861 INFO:tasks.workunit.client.1.smithi172.stdout:7/315: symlink d2/d3/d10/d40/d6a/l78 0 2024-09-20T18:35:37.862 INFO:tasks.workunit.client.1.smithi172.stdout:7/316: chown d2/d23/d3a/f5c 262674069 1 2024-09-20T18:35:37.863 INFO:tasks.workunit.client.1.smithi172.stdout:7/317: chown d2/c8 122905 1 2024-09-20T18:35:37.865 INFO:tasks.workunit.client.1.smithi172.stdout:7/318: creat d2/d5a/d6e/f79 x:0 0 0 2024-09-20T18:35:37.867 INFO:tasks.workunit.client.1.smithi172.stdout:2/180: sync 2024-09-20T18:35:37.867 INFO:tasks.workunit.client.1.smithi172.stdout:5/302: sync 2024-09-20T18:35:37.869 INFO:tasks.workunit.client.1.smithi172.stdout:5/303: mkdir d4/d1f/d26/d41/d65 0 2024-09-20T18:35:37.872 INFO:tasks.workunit.client.1.smithi172.stdout:5/304: link d4/d1f/d26/d2d/d50/c2e d4/df/d3f/d64/c66 0 2024-09-20T18:35:37.873 INFO:tasks.workunit.client.1.smithi172.stdout:5/305: fdatasync d4/d1f/d26/d2d/d50/f5d 0 2024-09-20T18:35:37.877 INFO:tasks.workunit.client.1.smithi172.stdout:5/306: link d4/df/c52 d4/d1f/d26/d2d/d63/c67 0 2024-09-20T18:35:37.880 INFO:tasks.workunit.client.1.smithi172.stdout:5/307: symlink d4/d1f/d26/d2d/l68 0 2024-09-20T18:35:37.881 INFO:tasks.workunit.client.1.smithi172.stdout:2/181: dread d0/d4/fd [0,4194304] 0 2024-09-20T18:35:37.884 INFO:tasks.workunit.client.1.smithi172.stdout:2/182: dread d0/d4/d17/d22/fc [0,4194304] 0 2024-09-20T18:35:37.887 INFO:tasks.workunit.client.1.smithi172.stdout:2/183: dread d0/d1a/f25 [0,4194304] 0 2024-09-20T18:35:37.895 INFO:tasks.workunit.client.1.smithi172.stdout:2/184: dread d0/d4/d17/d22/d10/f1f [0,4194304] 0 2024-09-20T18:35:37.895 INFO:tasks.workunit.client.1.smithi172.stdout:2/185: read - d0/d4/f30 zero size 2024-09-20T18:35:37.901 INFO:tasks.workunit.client.1.smithi172.stdout:2/186: dwrite d0/d1a/f33 [0,4194304] 0 2024-09-20T18:35:37.904 INFO:tasks.workunit.client.1.smithi172.stdout:2/187: fdatasync d0/d4/d17/d22/d10/f21 0 2024-09-20T18:35:37.908 INFO:tasks.workunit.client.1.smithi172.stdout:2/188: mkdir d0/d4/d17/d22/d10/d3c 0 2024-09-20T18:35:37.912 INFO:tasks.workunit.client.1.smithi172.stdout:2/189: creat d0/d2c/f3d x:0 0 0 2024-09-20T18:35:37.913 INFO:tasks.workunit.client.1.smithi172.stdout:7/319: write d2/d23/f30 [1813153,63323] 0 2024-09-20T18:35:37.914 INFO:tasks.workunit.client.1.smithi172.stdout:2/190: creat d0/d2c/f3e x:0 0 0 2024-09-20T18:35:37.920 INFO:tasks.workunit.client.1.smithi172.stdout:2/191: rename d0/d4 to d0/d2c/d3f 0 2024-09-20T18:35:37.921 INFO:tasks.workunit.client.1.smithi172.stdout:2/192: write d0/d2c/f3e [52215,22524] 0 2024-09-20T18:35:37.921 INFO:tasks.workunit.client.1.smithi172.stdout:7/320: truncate d2/d23/f66 1785599 0 2024-09-20T18:35:37.922 INFO:tasks.workunit.client.1.smithi172.stdout:2/193: truncate d0/d1a/f33 4202667 0 2024-09-20T18:35:37.922 INFO:tasks.workunit.client.1.smithi172.stdout:7/321: rmdir d2 39 2024-09-20T18:35:37.924 INFO:tasks.workunit.client.1.smithi172.stdout:7/322: fdatasync d2/d1c/f67 0 2024-09-20T18:35:37.924 INFO:tasks.workunit.client.1.smithi172.stdout:2/194: mknod d0/c40 0 2024-09-20T18:35:37.925 INFO:tasks.workunit.client.1.smithi172.stdout:7/323: mknod d2/d3/c7a 0 2024-09-20T18:35:37.926 INFO:tasks.workunit.client.1.smithi172.stdout:2/195: creat d0/d2c/d3f/d17/d18/d29/f41 x:0 0 0 2024-09-20T18:35:37.926 INFO:tasks.workunit.client.1.smithi172.stdout:7/324: truncate d2/d5a/d6e/f79 697703 0 2024-09-20T18:35:37.928 INFO:tasks.workunit.client.1.smithi172.stdout:7/325: unlink d2/f65 0 2024-09-20T18:35:37.929 INFO:tasks.workunit.client.1.smithi172.stdout:2/196: dread d0/d2c/d3f/f26 [0,4194304] 0 2024-09-20T18:35:37.932 INFO:tasks.workunit.client.1.smithi172.stdout:2/197: truncate d0/d2c/d3f/d17/d22/d10/f1f 68691 0 2024-09-20T18:35:37.934 INFO:tasks.workunit.client.1.smithi172.stdout:7/326: dwrite d2/d3/dd/f42 [0,4194304] 0 2024-09-20T18:35:37.936 INFO:tasks.workunit.client.1.smithi172.stdout:2/198: mkdir d0/d2c/d3f/d17/d18/d29/d42 0 2024-09-20T18:35:37.938 INFO:tasks.workunit.client.1.smithi172.stdout:2/199: write d0/f8 [2629863,50644] 0 2024-09-20T18:35:37.940 INFO:tasks.workunit.client.1.smithi172.stdout:7/327: getdents d2/d5a/d6e 0 2024-09-20T18:35:37.941 INFO:tasks.workunit.client.1.smithi172.stdout:7/328: write d2/d23/f30 [1627456,71128] 0 2024-09-20T18:35:37.943 INFO:tasks.workunit.client.1.smithi172.stdout:2/200: creat d0/d2c/d3f/d17/d2e/f43 x:0 0 0 2024-09-20T18:35:37.944 INFO:tasks.workunit.client.1.smithi172.stdout:7/329: unlink d2/d3/d10/d40/d46/f6c 0 2024-09-20T18:35:37.944 INFO:tasks.workunit.client.1.smithi172.stdout:2/201: rmdir d0/d2c/d3f/d17/d18/d29 39 2024-09-20T18:35:37.945 INFO:tasks.workunit.client.1.smithi172.stdout:2/202: chown d0/d2c/d3f/d17/d22/c11 0 1 2024-09-20T18:35:37.946 INFO:tasks.workunit.client.1.smithi172.stdout:2/203: read - d0/d2c/f3d zero size 2024-09-20T18:35:37.947 INFO:tasks.workunit.client.1.smithi172.stdout:7/330: rename d2/d3/d10/d40/d46/c50 to d2/d23/c7b 0 2024-09-20T18:35:37.949 INFO:tasks.workunit.client.1.smithi172.stdout:4/225: sync 2024-09-20T18:35:37.950 INFO:tasks.workunit.client.1.smithi172.stdout:2/204: rename d0/d2c/d3f/d17/d22/f13 to d0/d2c/d3f/d17/d18/d3b/f44 0 2024-09-20T18:35:37.952 INFO:tasks.workunit.client.1.smithi172.stdout:7/331: rename d2/d3/f3b to d2/d3/d10/d40/f7c 0 2024-09-20T18:35:37.953 INFO:tasks.workunit.client.1.smithi172.stdout:2/205: mkdir d0/d2c/d3f/d17/d45 0 2024-09-20T18:35:37.954 INFO:tasks.workunit.client.1.smithi172.stdout:7/332: truncate d2/d1c/f67 513628 0 2024-09-20T18:35:37.956 INFO:tasks.workunit.client.1.smithi172.stdout:2/206: readlink d0/d2c/d3f/d17/d22/d10/l37 0 2024-09-20T18:35:37.956 INFO:tasks.workunit.client.1.smithi172.stdout:4/226: dwrite d0/de/d21/f2b [0,4194304] 0 2024-09-20T18:35:37.957 INFO:tasks.workunit.client.1.smithi172.stdout:2/207: read d0/d1a/f33 [826514,30923] 0 2024-09-20T18:35:37.957 INFO:tasks.workunit.client.1.smithi172.stdout:4/227: write d0/d7/df/d15/f37 [1512327,2127] 0 2024-09-20T18:35:37.958 INFO:tasks.workunit.client.1.smithi172.stdout:4/228: chown d0/de/dc/d3c 111110 1 2024-09-20T18:35:37.958 INFO:tasks.workunit.client.1.smithi172.stdout:2/208: read d0/d2c/d3f/d17/d22/fc [4025101,57139] 0 2024-09-20T18:35:37.996 INFO:tasks.workunit.client.1.smithi172.stdout:4/229: dwrite d0/d7/df/d15/f14 [4194304,4194304] 0 2024-09-20T18:35:38.012 INFO:tasks.workunit.client.1.smithi172.stdout:2/209: truncate d0/d2c/d3f/d17/d22/fc 2638306 0 2024-09-20T18:35:38.027 INFO:tasks.workunit.client.1.smithi172.stdout:0/372: sync 2024-09-20T18:35:38.027 INFO:tasks.workunit.client.1.smithi172.stdout:1/289: sync 2024-09-20T18:35:38.027 INFO:tasks.workunit.client.1.smithi172.stdout:3/250: sync 2024-09-20T18:35:38.027 INFO:tasks.workunit.client.1.smithi172.stdout:6/229: sync 2024-09-20T18:35:38.027 INFO:tasks.workunit.client.1.smithi172.stdout:9/246: sync 2024-09-20T18:35:38.028 INFO:tasks.workunit.client.1.smithi172.stdout:8/234: sync 2024-09-20T18:35:38.032 INFO:tasks.workunit.client.1.smithi172.stdout:4/230: truncate d0/f2a 1922383 0 2024-09-20T18:35:38.033 INFO:tasks.workunit.client.1.smithi172.stdout:6/230: mkdir d0/d18/d1c/d22/d47 0 2024-09-20T18:35:38.034 INFO:tasks.workunit.client.1.smithi172.stdout:1/290: fdatasync d0/d8/db/d25/d2b/d3d/f4d 0 2024-09-20T18:35:38.041 INFO:tasks.workunit.client.1.smithi172.stdout:8/235: dread f0 [0,4194304] 0 2024-09-20T18:35:38.045 INFO:tasks.workunit.client.1.smithi172.stdout:9/247: dwrite d15/f1b [0,4194304] 0 2024-09-20T18:35:38.045 INFO:tasks.workunit.client.1.smithi172.stdout:3/251: dwrite d0/f7 [0,4194304] 0 2024-09-20T18:35:38.052 INFO:tasks.workunit.client.1.smithi172.stdout:2/210: dwrite d0/d1a/f33 [4194304,4194304] 0 2024-09-20T18:35:38.055 INFO:tasks.workunit.client.1.smithi172.stdout:9/248: creat d15/d1a/d1e/d34/f49 x:0 0 0 2024-09-20T18:35:38.057 INFO:tasks.workunit.client.1.smithi172.stdout:3/252: unlink d0/db/d22/f29 0 2024-09-20T18:35:38.058 INFO:tasks.workunit.client.1.smithi172.stdout:6/231: dwrite d0/f36 [0,4194304] 0 2024-09-20T18:35:38.060 INFO:tasks.workunit.client.1.smithi172.stdout:9/249: readlink d15/d1f/l2d 0 2024-09-20T18:35:38.062 INFO:tasks.workunit.client.1.smithi172.stdout:2/211: truncate d0/d2c/f3d 846016 0 2024-09-20T18:35:38.064 INFO:tasks.workunit.client.1.smithi172.stdout:0/373: dread d4/d1d/d15/f50 [4194304,4194304] 0 2024-09-20T18:35:38.066 INFO:tasks.workunit.client.1.smithi172.stdout:2/212: read d0/d2c/d3f/f2a [249425,29957] 0 2024-09-20T18:35:38.067 INFO:tasks.workunit.client.1.smithi172.stdout:2/213: chown d0/d2c/d3f/d17/l1b 32995643 1 2024-09-20T18:35:38.069 INFO:tasks.workunit.client.1.smithi172.stdout:8/236: dwrite dd/d1b/d3b/d51/f2e [0,4194304] 0 2024-09-20T18:35:38.071 INFO:tasks.workunit.client.1.smithi172.stdout:6/232: mknod d0/d18/d1c/d22/d47/c48 0 2024-09-20T18:35:38.071 INFO:tasks.workunit.client.1.smithi172.stdout:8/237: mkdir dd/d1b/d3b/d5d 0 2024-09-20T18:35:38.072 INFO:tasks.workunit.client.1.smithi172.stdout:6/233: dread - d0/d18/d1c/d21/d26/f45 zero size 2024-09-20T18:35:38.074 INFO:tasks.workunit.client.1.smithi172.stdout:2/214: link d0/f39 d0/d2c/d3f/f46 0 2024-09-20T18:35:38.075 INFO:tasks.workunit.client.1.smithi172.stdout:9/250: write d15/d1a/d1e/f27 [367117,14117] 0 2024-09-20T18:35:38.078 INFO:tasks.workunit.client.1.smithi172.stdout:9/251: chown d15/d20/f3a 3970422 1 2024-09-20T18:35:38.085 INFO:tasks.workunit.client.1.smithi172.stdout:8/238: dwrite dd/d1b/d3b/d51/d34/f5c [0,4194304] 0 2024-09-20T18:35:38.086 INFO:tasks.workunit.client.1.smithi172.stdout:6/234: dread d0/f13 [8388608,4194304] 0 2024-09-20T18:35:38.087 INFO:tasks.workunit.client.1.smithi172.stdout:8/239: chown f0 255167 1 2024-09-20T18:35:38.089 INFO:tasks.workunit.client.1.smithi172.stdout:2/215: dwrite d0/f3 [0,4194304] 0 2024-09-20T18:35:38.091 INFO:tasks.workunit.client.1.smithi172.stdout:2/216: chown d0/d1a/c27 3201 1 2024-09-20T18:35:38.096 INFO:tasks.workunit.client.1.smithi172.stdout:8/240: link dd/d1b/d3b/d51/f38 dd/d1b/d3b/f5e 0 2024-09-20T18:35:38.099 INFO:tasks.workunit.client.1.smithi172.stdout:3/253: dread d0/dc/f28 [0,4194304] 0 2024-09-20T18:35:38.100 INFO:tasks.workunit.client.1.smithi172.stdout:8/241: dread dd/d1b/d3b/d51/f47 [0,4194304] 0 2024-09-20T18:35:38.103 INFO:tasks.workunit.client.1.smithi172.stdout:3/254: creat d0/db/d3a/f4b x:0 0 0 2024-09-20T18:35:38.103 INFO:tasks.workunit.client.1.smithi172.stdout:8/242: read dd/d1b/f1f [6816928,64373] 0 2024-09-20T18:35:38.105 INFO:tasks.workunit.client.1.smithi172.stdout:2/217: write d0/d2c/d3f/d17/d22/fc [947492,112940] 0 2024-09-20T18:35:38.107 INFO:tasks.workunit.client.1.smithi172.stdout:8/243: mknod dd/d1b/d3b/d51/d5b/c5f 0 2024-09-20T18:35:38.109 INFO:tasks.workunit.client.1.smithi172.stdout:2/218: symlink d0/d2c/d3f/d17/d45/l47 0 2024-09-20T18:35:38.110 INFO:tasks.workunit.client.1.smithi172.stdout:3/255: dwrite d0/db/f3e [0,4194304] 0 2024-09-20T18:35:38.111 INFO:tasks.workunit.client.1.smithi172.stdout:2/219: write d0/d2c/d3f/f26 [1084262,17461] 0 2024-09-20T18:35:38.113 INFO:tasks.workunit.client.1.smithi172.stdout:8/244: rename dd/d1b/d3b/d51/d34/d39/d4d/f54 to dd/d1b/d3b/d5d/f60 0 2024-09-20T18:35:38.119 INFO:tasks.workunit.client.1.smithi172.stdout:2/220: dwrite d0/d2c/d3f/d17/d22/d10/f21 [4194304,4194304] 0 2024-09-20T18:35:38.137 INFO:tasks.workunit.client.1.smithi172.stdout:5/308: sync 2024-09-20T18:35:38.147 INFO:tasks.workunit.client.1.smithi172.stdout:3/256: rename d0/dc/f31 to d0/dc/f4c 0 2024-09-20T18:35:38.148 INFO:tasks.workunit.client.1.smithi172.stdout:8/245: chown dd/d1b/d3b/d51/d34/d39/d4d/c59 5 1 2024-09-20T18:35:38.149 INFO:tasks.workunit.client.1.smithi172.stdout:2/221: symlink d0/d2c/d3f/d17/d22/l48 0 2024-09-20T18:35:38.150 INFO:tasks.workunit.client.1.smithi172.stdout:5/309: chown d4/f48 1345890 1 2024-09-20T18:35:38.150 INFO:tasks.workunit.client.1.smithi172.stdout:8/246: truncate dd/d1b/d3b/d51/f38 1300177 0 2024-09-20T18:35:38.151 INFO:tasks.workunit.client.1.smithi172.stdout:8/247: write dd/f30 [210447,43315] 0 2024-09-20T18:35:38.152 INFO:tasks.workunit.client.1.smithi172.stdout:5/310: mkdir d4/d1f/d26/d41/d69 0 2024-09-20T18:35:38.152 INFO:tasks.workunit.client.1.smithi172.stdout:3/257: link d0/c3 d0/c4d 0 2024-09-20T18:35:38.154 INFO:tasks.workunit.client.1.smithi172.stdout:8/248: mkdir dd/d61 0 2024-09-20T18:35:38.154 INFO:tasks.workunit.client.1.smithi172.stdout:2/222: dread d0/d1a/f20 [0,4194304] 0 2024-09-20T18:35:38.158 INFO:tasks.workunit.client.1.smithi172.stdout:5/311: dread d4/f9 [0,4194304] 0 2024-09-20T18:35:38.161 INFO:tasks.workunit.client.1.smithi172.stdout:2/223: link d0/d1a/c27 d0/d2c/d3f/d17/d18/d29/c49 0 2024-09-20T18:35:38.162 INFO:tasks.workunit.client.1.smithi172.stdout:8/249: truncate dd/d1b/f21 466715 0 2024-09-20T18:35:38.164 INFO:tasks.workunit.client.1.smithi172.stdout:8/250: symlink dd/l62 0 2024-09-20T18:35:38.166 INFO:tasks.workunit.client.1.smithi172.stdout:3/258: dwrite d0/db/f23 [8388608,4194304] 0 2024-09-20T18:35:38.169 INFO:tasks.workunit.client.1.smithi172.stdout:2/224: truncate d0/d2c/d3f/f26 7531660 0 2024-09-20T18:35:38.171 INFO:tasks.workunit.client.1.smithi172.stdout:8/251: fsync dd/d1b/f23 0 2024-09-20T18:35:38.171 INFO:tasks.workunit.client.1.smithi172.stdout:3/259: creat d0/d13/d32/f4e x:0 0 0 2024-09-20T18:35:38.173 INFO:tasks.workunit.client.1.smithi172.stdout:8/252: mknod dd/d1b/d3b/c63 0 2024-09-20T18:35:38.174 INFO:tasks.workunit.client.1.smithi172.stdout:2/225: creat d0/d2c/d3f/f4a x:0 0 0 2024-09-20T18:35:38.174 INFO:tasks.workunit.client.1.smithi172.stdout:2/226: chown d0/d2c 20 1 2024-09-20T18:35:38.175 INFO:tasks.workunit.client.1.smithi172.stdout:8/253: dread dd/d1b/f2c [0,4194304] 0 2024-09-20T18:35:38.175 INFO:tasks.workunit.client.1.smithi172.stdout:3/260: rename d0/d13/d1e/c41 to d0/dc/c4f 0 2024-09-20T18:35:38.176 INFO:tasks.workunit.client.1.smithi172.stdout:2/227: write d0/d2c/d3f/f4a [554697,116318] 0 2024-09-20T18:35:38.179 INFO:tasks.workunit.client.1.smithi172.stdout:3/261: creat d0/db/f50 x:0 0 0 2024-09-20T18:35:38.180 INFO:tasks.workunit.client.1.smithi172.stdout:8/254: creat dd/d61/f64 x:0 0 0 2024-09-20T18:35:38.180 INFO:tasks.workunit.client.1.smithi172.stdout:2/228: mkdir d0/d2c/d3f/d17/d18/d29/d42/d4b 0 2024-09-20T18:35:38.181 INFO:tasks.workunit.client.1.smithi172.stdout:3/262: symlink d0/d13/d1e/l51 0 2024-09-20T18:35:38.181 INFO:tasks.workunit.client.1.smithi172.stdout:3/263: dread - d0/d13/d1e/f46 zero size 2024-09-20T18:35:38.183 INFO:tasks.workunit.client.1.smithi172.stdout:8/255: mkdir dd/d65 0 2024-09-20T18:35:38.184 INFO:tasks.workunit.client.1.smithi172.stdout:3/264: write d0/dc/f4c [611082,70115] 0 2024-09-20T18:35:38.188 INFO:tasks.workunit.client.1.smithi172.stdout:8/256: creat dd/d1b/d3b/d51/d34/f66 x:0 0 0 2024-09-20T18:35:38.190 INFO:tasks.workunit.client.1.smithi172.stdout:3/265: link d0/dc/le d0/db/d3a/l52 0 2024-09-20T18:35:38.190 INFO:tasks.workunit.client.1.smithi172.stdout:8/257: mknod dd/d65/c67 0 2024-09-20T18:35:38.191 INFO:tasks.workunit.client.1.smithi172.stdout:2/229: write d0/d2c/d3f/f46 [928026,15424] 0 2024-09-20T18:35:38.191 INFO:tasks.workunit.client.1.smithi172.stdout:3/266: creat d0/db/f53 x:0 0 0 2024-09-20T18:35:38.192 INFO:tasks.workunit.client.1.smithi172.stdout:8/258: fsync dd/d1b/d3b/d51/d34/d39/f4e 0 2024-09-20T18:35:38.194 INFO:tasks.workunit.client.1.smithi172.stdout:8/259: write dd/d1b/f1f [1466295,128480] 0 2024-09-20T18:35:38.199 INFO:tasks.workunit.client.1.smithi172.stdout:8/260: symlink dd/d1b/d3b/d51/d34/d39/l68 0 2024-09-20T18:35:38.201 INFO:tasks.workunit.client.1.smithi172.stdout:3/267: dwrite d0/dc/f2e [0,4194304] 0 2024-09-20T18:35:38.202 INFO:tasks.workunit.client.1.smithi172.stdout:2/230: dwrite d0/d2c/d3f/d17/d18/f32 [0,4194304] 0 2024-09-20T18:35:38.203 INFO:tasks.workunit.client.1.smithi172.stdout:8/261: fsync dd/d1b/d3b/d51/d34/d39/f4b 0 2024-09-20T18:35:38.204 INFO:tasks.workunit.client.1.smithi172.stdout:3/268: mkdir d0/d13/d32/d54 0 2024-09-20T18:35:38.205 INFO:tasks.workunit.client.1.smithi172.stdout:3/269: write d0/dc/f3c [5052150,64641] 0 2024-09-20T18:35:38.209 INFO:tasks.workunit.client.1.smithi172.stdout:8/262: link dd/d1b/d3b/c63 dd/d1b/d3b/d5d/c69 0 2024-09-20T18:35:38.212 INFO:tasks.workunit.client.1.smithi172.stdout:8/263: creat dd/d1b/d3b/d51/d34/d39/f6a x:0 0 0 2024-09-20T18:35:38.213 INFO:tasks.workunit.client.1.smithi172.stdout:3/270: link d0/db/c47 d0/d13/d32/c55 0 2024-09-20T18:35:38.215 INFO:tasks.workunit.client.1.smithi172.stdout:8/264: rename dd/d61 to dd/d1b/d3b/d51/d5b/d6b 0 2024-09-20T18:35:38.215 INFO:tasks.workunit.client.1.smithi172.stdout:3/271: mknod d0/c56 0 2024-09-20T18:35:38.219 INFO:tasks.workunit.client.1.smithi172.stdout:2/231: truncate d0/d2c/d3f/d17/d18/f32 2834414 0 2024-09-20T18:35:38.221 INFO:tasks.workunit.client.1.smithi172.stdout:3/272: dwrite d0/db/d22/f34 [4194304,4194304] 0 2024-09-20T18:35:38.225 INFO:tasks.workunit.client.1.smithi172.stdout:2/232: rename d0/d2c/d3f/d17/d2e to d0/d2c/d3f/d17/d22/d4c 0 2024-09-20T18:35:38.228 INFO:tasks.workunit.client.1.smithi172.stdout:2/233: write d0/d2c/d3f/d17/d22/d4c/f43 [409437,13752] 0 2024-09-20T18:35:38.228 INFO:tasks.workunit.client.1.smithi172.stdout:2/234: fdatasync d0/d2c/f3d 0 2024-09-20T18:35:38.230 INFO:tasks.workunit.client.1.smithi172.stdout:3/273: dwrite d0/db/d22/f34 [0,4194304] 0 2024-09-20T18:35:38.230 INFO:tasks.workunit.client.1.smithi172.stdout:3/274: readlink d0/l1b 0 2024-09-20T18:35:38.232 INFO:tasks.workunit.client.1.smithi172.stdout:3/275: rmdir d0/d13/d1e 39 2024-09-20T18:35:38.233 INFO:tasks.workunit.client.1.smithi172.stdout:3/276: fsync d0/f44 0 2024-09-20T18:35:38.234 INFO:tasks.workunit.client.1.smithi172.stdout:3/277: chown d0/db/f53 49 1 2024-09-20T18:35:38.235 INFO:tasks.workunit.client.1.smithi172.stdout:3/278: chown d0/c3 320 1 2024-09-20T18:35:38.236 INFO:tasks.workunit.client.1.smithi172.stdout:3/279: fdatasync d0/db/d3a/f4b 0 2024-09-20T18:35:38.238 INFO:tasks.workunit.client.1.smithi172.stdout:2/235: getdents d0/d2c/d3f/d17 0 2024-09-20T18:35:38.240 INFO:tasks.workunit.client.1.smithi172.stdout:2/236: stat d0/d2c/d3f/le 0 2024-09-20T18:35:38.241 INFO:tasks.workunit.client.1.smithi172.stdout:2/237: creat d0/d2c/d3f/d17/d22/d4c/f4d x:0 0 0 2024-09-20T18:35:38.243 INFO:tasks.workunit.client.1.smithi172.stdout:2/238: mkdir d0/d4e 0 2024-09-20T18:35:38.244 INFO:tasks.workunit.client.1.smithi172.stdout:2/239: truncate d0/d1a/f25 712290 0 2024-09-20T18:35:38.245 INFO:tasks.workunit.client.1.smithi172.stdout:2/240: creat d0/d2c/d3f/d17/d18/d29/f4f x:0 0 0 2024-09-20T18:35:38.247 INFO:tasks.workunit.client.1.smithi172.stdout:2/241: creat d0/d4e/f50 x:0 0 0 2024-09-20T18:35:38.248 INFO:tasks.workunit.client.1.smithi172.stdout:3/280: write d0/f16 [1439775,55323] 0 2024-09-20T18:35:38.249 INFO:tasks.workunit.client.1.smithi172.stdout:2/242: write d0/d2c/d3f/d17/d18/f32 [1849501,50792] 0 2024-09-20T18:35:38.249 INFO:tasks.workunit.client.1.smithi172.stdout:3/281: chown d0/dc/f2b 1003 1 2024-09-20T18:35:38.250 INFO:tasks.workunit.client.1.smithi172.stdout:2/243: mkdir d0/d2c/d51 0 2024-09-20T18:35:38.251 INFO:tasks.workunit.client.1.smithi172.stdout:2/244: chown d0/d2c/d3f/d17/d22/d10/d35 113102 1 2024-09-20T18:35:38.251 INFO:tasks.workunit.client.1.smithi172.stdout:3/282: rename d0/c56 to d0/db/d3a/c57 0 2024-09-20T18:35:38.254 INFO:tasks.workunit.client.1.smithi172.stdout:2/245: creat d0/d2c/d3f/d17/d18/d29/d42/f52 x:0 0 0 2024-09-20T18:35:38.255 INFO:tasks.workunit.client.1.smithi172.stdout:3/283: dread d0/dc/f2e [0,4194304] 0 2024-09-20T18:35:38.258 INFO:tasks.workunit.client.1.smithi172.stdout:3/284: dread d0/dc/f28 [0,4194304] 0 2024-09-20T18:35:38.260 INFO:tasks.workunit.client.1.smithi172.stdout:3/285: getdents d0/db 0 2024-09-20T18:35:38.262 INFO:tasks.workunit.client.1.smithi172.stdout:3/286: chown d0/d13/d1e/l42 9 1 2024-09-20T18:35:38.265 INFO:tasks.workunit.client.1.smithi172.stdout:3/287: rename d0/d13/d1e/d33 to d0/d13/d58 0 2024-09-20T18:35:38.265 INFO:tasks.workunit.client.1.smithi172.stdout:3/288: readlink d0/d13/d1e/l42 0 2024-09-20T18:35:38.266 INFO:tasks.workunit.client.1.smithi172.stdout:3/289: creat d0/d13/d1e/f59 x:0 0 0 2024-09-20T18:35:38.266 INFO:tasks.workunit.client.1.smithi172.stdout:7/333: sync 2024-09-20T18:35:38.267 INFO:tasks.workunit.client.1.smithi172.stdout:3/290: truncate d0/f44 791980 0 2024-09-20T18:35:38.269 INFO:tasks.workunit.client.1.smithi172.stdout:3/291: unlink d0/f9 0 2024-09-20T18:35:38.270 INFO:tasks.workunit.client.1.smithi172.stdout:3/292: creat d0/dc/f5a x:0 0 0 2024-09-20T18:35:38.275 INFO:tasks.workunit.client.1.smithi172.stdout:3/293: dwrite d0/dc/f2b [4194304,4194304] 0 2024-09-20T18:35:38.276 INFO:tasks.workunit.client.1.smithi172.stdout:3/294: write d0/f8 [1181766,70538] 0 2024-09-20T18:35:38.279 INFO:tasks.workunit.client.1.smithi172.stdout:3/295: creat d0/db/f5b x:0 0 0 2024-09-20T18:35:38.282 INFO:tasks.workunit.client.1.smithi172.stdout:7/334: dread d2/f47 [0,4194304] 0 2024-09-20T18:35:38.282 INFO:tasks.workunit.client.1.smithi172.stdout:3/296: truncate d0/d13/d1e/f59 76881 0 2024-09-20T18:35:38.282 INFO:tasks.workunit.client.1.smithi172.stdout:3/297: stat d0/d13/d58 0 2024-09-20T18:35:38.283 INFO:tasks.workunit.client.1.smithi172.stdout:3/298: write d0/f8 [8428130,106387] 0 2024-09-20T18:35:38.284 INFO:tasks.workunit.client.1.smithi172.stdout:7/335: truncate d2/d3/d3d/d4e/d5f/f61 2004396 0 2024-09-20T18:35:38.284 INFO:tasks.workunit.client.1.smithi172.stdout:7/336: write d2/f39 [192669,40726] 0 2024-09-20T18:35:38.285 INFO:tasks.workunit.client.1.smithi172.stdout:3/299: rmdir d0 39 2024-09-20T18:35:38.287 INFO:tasks.workunit.client.1.smithi172.stdout:3/300: write d0/dc/f4c [661758,14579] 0 2024-09-20T18:35:38.288 INFO:tasks.workunit.client.1.smithi172.stdout:7/337: rename d2/d23/c7b to d2/d23/d51/c7d 0 2024-09-20T18:35:38.289 INFO:tasks.workunit.client.1.smithi172.stdout:3/301: symlink d0/d13/d58/l5c 0 2024-09-20T18:35:38.290 INFO:tasks.workunit.client.1.smithi172.stdout:3/302: fsync d0/f8 0 2024-09-20T18:35:38.291 INFO:tasks.workunit.client.1.smithi172.stdout:3/303: chown d0/dc/f2b 0 1 2024-09-20T18:35:38.292 INFO:tasks.workunit.client.1.smithi172.stdout:3/304: write d0/d13/d1e/f46 [530177,18151] 0 2024-09-20T18:35:38.292 INFO:tasks.workunit.client.1.smithi172.stdout:3/305: fsync d0/dc/f3c 0 2024-09-20T18:35:38.294 INFO:tasks.workunit.client.1.smithi172.stdout:7/338: dread d2/d23/f66 [0,4194304] 0 2024-09-20T18:35:38.295 INFO:tasks.workunit.client.1.smithi172.stdout:3/306: unlink d0/l48 0 2024-09-20T18:35:38.295 INFO:tasks.workunit.client.1.smithi172.stdout:3/307: fsync d0/dc/f4c 0 2024-09-20T18:35:38.296 INFO:tasks.workunit.client.1.smithi172.stdout:7/339: creat d2/d3/dd/f7e x:0 0 0 2024-09-20T18:35:38.299 INFO:tasks.workunit.client.1.smithi172.stdout:3/308: dread d0/f8 [4194304,4194304] 0 2024-09-20T18:35:38.301 INFO:tasks.workunit.client.1.smithi172.stdout:7/340: dwrite d2/d3/fb [0,4194304] 0 2024-09-20T18:35:38.301 INFO:tasks.workunit.client.1.smithi172.stdout:3/309: mknod d0/c5d 0 2024-09-20T18:35:38.303 INFO:tasks.workunit.client.1.smithi172.stdout:3/310: dread d0/d13/d1e/f59 [0,4194304] 0 2024-09-20T18:35:38.303 INFO:tasks.workunit.client.1.smithi172.stdout:7/341: dread d2/d5a/d6e/f79 [0,4194304] 0 2024-09-20T18:35:38.306 INFO:tasks.workunit.client.1.smithi172.stdout:7/342: creat d2/d3/d3d/f7f x:0 0 0 2024-09-20T18:35:38.308 INFO:tasks.workunit.client.1.smithi172.stdout:7/343: fsync d2/d23/f66 0 2024-09-20T18:35:38.310 INFO:tasks.workunit.client.1.smithi172.stdout:3/311: dwrite d0/db/f53 [0,4194304] 0 2024-09-20T18:35:38.312 INFO:tasks.workunit.client.1.smithi172.stdout:7/344: mknod d2/d23/c80 0 2024-09-20T18:35:38.312 INFO:tasks.workunit.client.1.smithi172.stdout:7/345: dread - d2/d1c/f6f zero size 2024-09-20T18:35:38.315 INFO:tasks.workunit.client.1.smithi172.stdout:7/346: dread d2/f47 [0,4194304] 0 2024-09-20T18:35:38.316 INFO:tasks.workunit.client.1.smithi172.stdout:7/347: write d2/d3/d10/f1b [2979227,85334] 0 2024-09-20T18:35:38.316 INFO:tasks.workunit.client.1.smithi172.stdout:3/312: rename d0/l1b to d0/l5e 0 2024-09-20T18:35:38.319 INFO:tasks.workunit.client.1.smithi172.stdout:3/313: mknod d0/dc/c5f 0 2024-09-20T18:35:38.321 INFO:tasks.workunit.client.1.smithi172.stdout:7/348: mknod d2/d3/d10/d40/c81 0 2024-09-20T18:35:38.322 INFO:tasks.workunit.client.1.smithi172.stdout:3/314: unlink d0/db/f23 0 2024-09-20T18:35:38.324 INFO:tasks.workunit.client.1.smithi172.stdout:7/349: mkdir d2/d5a/d82 0 2024-09-20T18:35:38.325 INFO:tasks.workunit.client.1.smithi172.stdout:3/315: readlink d0/dc/le 0 2024-09-20T18:35:38.326 INFO:tasks.workunit.client.1.smithi172.stdout:7/350: dread d2/d3/d3d/d4e/d5f/f61 [0,4194304] 0 2024-09-20T18:35:38.329 INFO:tasks.workunit.client.1.smithi172.stdout:7/351: rmdir d2/d5a/d82 0 2024-09-20T18:35:38.331 INFO:tasks.workunit.client.1.smithi172.stdout:7/352: fsync d2/d3/dd/f75 0 2024-09-20T18:35:38.331 INFO:tasks.workunit.client.1.smithi172.stdout:3/316: dwrite d0/db/f3e [0,4194304] 0 2024-09-20T18:35:38.334 INFO:tasks.workunit.client.1.smithi172.stdout:3/317: creat d0/db/d3a/f60 x:0 0 0 2024-09-20T18:35:38.335 INFO:tasks.workunit.client.1.smithi172.stdout:3/318: chown d0/l17 2 1 2024-09-20T18:35:38.335 INFO:tasks.workunit.client.1.smithi172.stdout:7/353: dread d2/d3/fb [0,4194304] 0 2024-09-20T18:35:38.335 INFO:tasks.workunit.client.1.smithi172.stdout:3/319: write d0/dc/f4c [348383,66697] 0 2024-09-20T18:35:38.338 INFO:tasks.workunit.client.1.smithi172.stdout:7/354: mknod d2/d23/d3c/c83 0 2024-09-20T18:35:38.340 INFO:tasks.workunit.client.1.smithi172.stdout:3/320: dread d0/dc/f4c [0,4194304] 0 2024-09-20T18:35:38.340 INFO:tasks.workunit.client.1.smithi172.stdout:7/355: rmdir d2/d3/dd 39 2024-09-20T18:35:38.341 INFO:tasks.workunit.client.1.smithi172.stdout:7/356: read d2/f39 [443146,76220] 0 2024-09-20T18:35:38.343 INFO:tasks.workunit.client.1.smithi172.stdout:7/357: truncate d2/d3/d10/f15 5375293 0 2024-09-20T18:35:38.343 INFO:tasks.workunit.client.1.smithi172.stdout:3/321: mkdir d0/dc/d61 0 2024-09-20T18:35:38.349 INFO:tasks.workunit.client.1.smithi172.stdout:7/358: dread d2/d3/d10/f2c [0,4194304] 0 2024-09-20T18:35:38.352 INFO:tasks.workunit.client.1.smithi172.stdout:7/359: mkdir d2/d3/dd/d84 0 2024-09-20T18:35:38.354 INFO:tasks.workunit.client.1.smithi172.stdout:7/360: mknod d2/d3/d3d/d68/c85 0 2024-09-20T18:35:38.355 INFO:tasks.workunit.client.1.smithi172.stdout:7/361: read - d2/d3/d3d/f7f zero size 2024-09-20T18:35:38.357 INFO:tasks.workunit.client.1.smithi172.stdout:3/322: dwrite d0/d13/d58/f4a [0,4194304] 0 2024-09-20T18:35:38.358 INFO:tasks.workunit.client.1.smithi172.stdout:3/323: chown d0/dc/f28 619448270 1 2024-09-20T18:35:38.361 INFO:tasks.workunit.client.1.smithi172.stdout:3/324: creat d0/f62 x:0 0 0 2024-09-20T18:35:38.369 INFO:tasks.workunit.client.1.smithi172.stdout:1/291: sync 2024-09-20T18:35:38.369 INFO:tasks.workunit.client.1.smithi172.stdout:4/231: sync 2024-09-20T18:35:38.369 INFO:tasks.workunit.client.1.smithi172.stdout:1/292: chown d0/l2f 114052 1 2024-09-20T18:35:38.371 INFO:tasks.workunit.client.1.smithi172.stdout:4/232: dread d0/d7/df/f40 [0,4194304] 0 2024-09-20T18:35:38.371 INFO:tasks.workunit.client.1.smithi172.stdout:1/293: mknod d0/d8/db/d25/d2b/d3d/c60 0 2024-09-20T18:35:38.372 INFO:tasks.workunit.client.1.smithi172.stdout:1/294: rmdir d0/d22 39 2024-09-20T18:35:38.372 INFO:tasks.workunit.client.1.smithi172.stdout:4/233: rmdir d0/d7/df/d15/d55 39 2024-09-20T18:35:38.374 INFO:tasks.workunit.client.1.smithi172.stdout:4/234: write d0/d7/df/d15/f37 [3881324,111856] 0 2024-09-20T18:35:38.375 INFO:tasks.workunit.client.1.smithi172.stdout:1/295: creat d0/f61 x:0 0 0 2024-09-20T18:35:38.380 INFO:tasks.workunit.client.1.smithi172.stdout:4/235: dread d0/d7/df/f3b [0,4194304] 0 2024-09-20T18:35:38.382 INFO:tasks.workunit.client.1.smithi172.stdout:4/236: getdents d0/d7/df/d15 0 2024-09-20T18:35:38.383 INFO:tasks.workunit.client.1.smithi172.stdout:4/237: chown d0/de/d21/d24/d34 2656 1 2024-09-20T18:35:38.386 INFO:tasks.workunit.client.1.smithi172.stdout:4/238: write d0/d7/f12 [1396612,109641] 0 2024-09-20T18:35:38.386 INFO:tasks.workunit.client.1.smithi172.stdout:1/296: dwrite d0/d8/f2c [0,4194304] 0 2024-09-20T18:35:38.388 INFO:tasks.workunit.client.1.smithi172.stdout:4/239: symlink d0/de/d21/d24/d34/l58 0 2024-09-20T18:35:38.389 INFO:tasks.workunit.client.1.smithi172.stdout:4/240: chown d0/d7/df/c2c 39852 1 2024-09-20T18:35:38.391 INFO:tasks.workunit.client.1.smithi172.stdout:4/241: unlink d0/d7/df/c2c 0 2024-09-20T18:35:38.490 INFO:tasks.workunit.client.1.smithi172.stdout:8/265: sync 2024-09-20T18:35:38.490 INFO:tasks.workunit.client.1.smithi172.stdout:5/312: sync 2024-09-20T18:35:38.490 INFO:tasks.workunit.client.1.smithi172.stdout:2/246: sync 2024-09-20T18:35:38.490 INFO:tasks.workunit.client.1.smithi172.stdout:6/235: sync 2024-09-20T18:35:38.490 INFO:tasks.workunit.client.1.smithi172.stdout:0/374: sync 2024-09-20T18:35:38.490 INFO:tasks.workunit.client.1.smithi172.stdout:9/252: sync 2024-09-20T18:35:38.491 INFO:tasks.workunit.client.1.smithi172.stdout:2/247: dread - d0/d2c/d3f/f30 zero size 2024-09-20T18:35:38.492 INFO:tasks.workunit.client.1.smithi172.stdout:8/266: unlink dd/c25 0 2024-09-20T18:35:38.493 INFO:tasks.workunit.client.1.smithi172.stdout:0/375: creat d4/d1a/d28/d42/d45/d54/f89 x:0 0 0 2024-09-20T18:35:38.494 INFO:tasks.workunit.client.1.smithi172.stdout:6/236: read d0/d18/d1c/d21/d26/d34/d39/d46/f7 [2942200,58907] 0 2024-09-20T18:35:38.499 INFO:tasks.workunit.client.1.smithi172.stdout:0/376: symlink d4/d5/d2e/d67/l8a 0 2024-09-20T18:35:38.504 INFO:tasks.workunit.client.1.smithi172.stdout:8/267: link dd/d1b/d3b/d51/d34/f36 dd/d1b/d3b/d51/d34/d39/f6c 0 2024-09-20T18:35:38.504 INFO:tasks.workunit.client.1.smithi172.stdout:9/253: dwrite d15/d1a/d1e/d34/f49 [0,4194304] 0 2024-09-20T18:35:38.505 INFO:tasks.workunit.client.1.smithi172.stdout:2/248: dwrite d0/d2c/f3d [0,4194304] 0 2024-09-20T18:35:38.506 INFO:tasks.workunit.client.1.smithi172.stdout:5/313: dwrite d4/df/d3f/f49 [0,4194304] 0 2024-09-20T18:35:38.506 INFO:tasks.workunit.client.1.smithi172.stdout:8/268: readlink dd/d1b/d3b/l58 0 2024-09-20T18:35:38.508 INFO:tasks.workunit.client.1.smithi172.stdout:5/314: write f3 [1115080,44466] 0 2024-09-20T18:35:38.508 INFO:tasks.workunit.client.1.smithi172.stdout:0/377: rmdir d4/d1a/d28/d75/d60 39 2024-09-20T18:35:38.513 INFO:tasks.workunit.client.1.smithi172.stdout:8/269: symlink dd/d1b/d3b/d51/d34/d39/d4d/l6d 0 2024-09-20T18:35:38.513 INFO:tasks.workunit.client.1.smithi172.stdout:6/237: dread d0/d18/d1c/d21/d26/d34/d39/d46/f2a [0,4194304] 0 2024-09-20T18:35:38.514 INFO:tasks.workunit.client.1.smithi172.stdout:0/378: symlink d4/d46/l8b 0 2024-09-20T18:35:38.515 INFO:tasks.workunit.client.1.smithi172.stdout:6/238: rmdir d0 39 2024-09-20T18:35:38.516 INFO:tasks.workunit.client.1.smithi172.stdout:0/379: fdatasync d4/d5/d2e/d33/f5a 0 2024-09-20T18:35:38.516 INFO:tasks.workunit.client.1.smithi172.stdout:9/254: rename d15/d46 to d15/d4a 0 2024-09-20T18:35:38.519 INFO:tasks.workunit.client.1.smithi172.stdout:8/270: creat dd/d1b/d3b/d51/d34/d39/f6e x:0 0 0 2024-09-20T18:35:38.520 INFO:tasks.workunit.client.1.smithi172.stdout:2/249: mkdir d0/d2c/d3f/d17/d18/d29/d42/d4b/d53 0 2024-09-20T18:35:38.522 INFO:tasks.workunit.client.1.smithi172.stdout:0/380: mkdir d4/d5/d2e/d67/d8c 0 2024-09-20T18:35:38.523 INFO:tasks.workunit.client.1.smithi172.stdout:0/381: dread - d4/d44/f6e zero size 2024-09-20T18:35:38.524 INFO:tasks.workunit.client.1.smithi172.stdout:0/382: read d4/d1a/d28/d42/d45/f52 [3941779,126139] 0 2024-09-20T18:35:38.525 INFO:tasks.workunit.client.1.smithi172.stdout:6/239: mknod d0/d18/d1c/d22/c49 0 2024-09-20T18:35:38.525 INFO:tasks.workunit.client.1.smithi172.stdout:0/383: truncate d4/f86 747262 0 2024-09-20T18:35:38.526 INFO:tasks.workunit.client.1.smithi172.stdout:8/271: symlink dd/d1b/l6f 0 2024-09-20T18:35:38.526 INFO:tasks.workunit.client.1.smithi172.stdout:6/240: readlink d0/d18/d1c/l30 0 2024-09-20T18:35:38.529 INFO:tasks.workunit.client.1.smithi172.stdout:8/272: mkdir dd/d1b/d4f/d70 0 2024-09-20T18:35:38.536 INFO:tasks.workunit.client.1.smithi172.stdout:5/315: truncate d4/d1f/f27 136474 0 2024-09-20T18:35:38.539 INFO:tasks.workunit.client.1.smithi172.stdout:0/384: creat d4/d1a/d28/d75/f8d x:0 0 0 2024-09-20T18:35:38.541 INFO:tasks.workunit.client.1.smithi172.stdout:6/241: dread d0/fc [4194304,4194304] 0 2024-09-20T18:35:38.545 INFO:tasks.workunit.client.1.smithi172.stdout:0/385: dwrite d4/d1a/f66 [0,4194304] 0 2024-09-20T18:35:38.546 INFO:tasks.workunit.client.1.smithi172.stdout:8/273: rename dd/d1b/d3b/d51/f38 to dd/f71 0 2024-09-20T18:35:38.546 INFO:tasks.workunit.client.1.smithi172.stdout:9/255: dwrite d15/d1a/f31 [0,4194304] 0 2024-09-20T18:35:38.548 INFO:tasks.workunit.client.1.smithi172.stdout:2/250: write d0/d2c/d3f/f2a [5515086,2320] 0 2024-09-20T18:35:38.554 INFO:tasks.workunit.client.1.smithi172.stdout:0/386: mkdir d4/d5/d2e/d8e 0 2024-09-20T18:35:38.555 INFO:tasks.workunit.client.1.smithi172.stdout:8/274: fsync dd/d1b/f23 0 2024-09-20T18:35:38.557 INFO:tasks.workunit.client.1.smithi172.stdout:9/256: mknod d15/d20/c4b 0 2024-09-20T18:35:38.559 INFO:tasks.workunit.client.1.smithi172.stdout:0/387: dread d4/d1a/d28/d42/d45/d54/f64 [0,4194304] 0 2024-09-20T18:35:38.565 INFO:tasks.workunit.client.1.smithi172.stdout:0/388: dwrite d4/f18 [0,4194304] 0 2024-09-20T18:35:38.565 INFO:tasks.workunit.client.1.smithi172.stdout:9/257: mknod d15/d1a/d1e/c4c 0 2024-09-20T18:35:38.566 INFO:tasks.workunit.client.1.smithi172.stdout:5/316: truncate d4/f36 661764 0 2024-09-20T18:35:38.568 INFO:tasks.workunit.client.1.smithi172.stdout:2/251: mknod d0/c54 0 2024-09-20T18:35:38.577 INFO:tasks.workunit.client.1.smithi172.stdout:0/389: mknod d4/d1a/d28/c8f 0 2024-09-20T18:35:38.577 INFO:tasks.workunit.client.1.smithi172.stdout:9/258: mknod d15/d1a/c4d 0 2024-09-20T18:35:38.577 INFO:tasks.workunit.client.1.smithi172.stdout:9/259: stat d15/c16 0 2024-09-20T18:35:38.580 INFO:tasks.workunit.client.1.smithi172.stdout:9/260: mknod d15/d4a/c4e 0 2024-09-20T18:35:38.581 INFO:tasks.workunit.client.1.smithi172.stdout:9/261: fsync d15/d1f/f40 0 2024-09-20T18:35:38.582 INFO:tasks.workunit.client.1.smithi172.stdout:0/390: symlink d4/d1a/l90 0 2024-09-20T18:35:38.582 INFO:tasks.workunit.client.1.smithi172.stdout:8/275: dwrite dd/d1b/d3b/d51/d34/d39/f6c [0,4194304] 0 2024-09-20T18:35:38.583 INFO:tasks.workunit.client.1.smithi172.stdout:5/317: getdents d4/df/d3f/d64 0 2024-09-20T18:35:38.583 INFO:tasks.workunit.client.1.smithi172.stdout:9/262: fdatasync d15/d1f/d2c/d37/f3c 0 2024-09-20T18:35:38.584 INFO:tasks.workunit.client.1.smithi172.stdout:8/276: chown dd/d1b/d3b/d51/f2e 138 1 2024-09-20T18:35:38.584 INFO:tasks.workunit.client.1.smithi172.stdout:5/318: chown d4/d1f/d26/f2a 4903 1 2024-09-20T18:35:38.584 INFO:tasks.workunit.client.1.smithi172.stdout:2/252: dread d0/d2c/d3f/d17/d18/d3b/f44 [0,4194304] 0 2024-09-20T18:35:38.585 INFO:tasks.workunit.client.1.smithi172.stdout:0/391: creat d4/d20/f91 x:0 0 0 2024-09-20T18:35:38.587 INFO:tasks.workunit.client.1.smithi172.stdout:8/277: chown dd/d1b/d3b/c3f 416557 1 2024-09-20T18:35:38.588 INFO:tasks.workunit.client.1.smithi172.stdout:2/253: mknod d0/d1a/c55 0 2024-09-20T18:35:38.588 INFO:tasks.workunit.client.1.smithi172.stdout:0/392: chown d4/d5/d2e/d33/l71 32896122 1 2024-09-20T18:35:38.590 INFO:tasks.workunit.client.1.smithi172.stdout:9/263: rename d15/d1a/f31 to d15/d1a/d1e/d48/f4f 0 2024-09-20T18:35:38.592 INFO:tasks.workunit.client.1.smithi172.stdout:9/264: write f14 [695456,110545] 0 2024-09-20T18:35:38.596 INFO:tasks.workunit.client.1.smithi172.stdout:5/319: dwrite d4/f4e [0,4194304] 0 2024-09-20T18:35:38.597 INFO:tasks.workunit.client.1.smithi172.stdout:9/265: write d15/d1a/d1e/d24/f2e [688971,100345] 0 2024-09-20T18:35:38.599 INFO:tasks.workunit.client.1.smithi172.stdout:8/278: dwrite dd/d1b/f55 [0,4194304] 0 2024-09-20T18:35:38.607 INFO:tasks.workunit.client.1.smithi172.stdout:0/393: symlink d4/d1a/d28/d73/l92 0 2024-09-20T18:35:38.607 INFO:tasks.workunit.client.1.smithi172.stdout:0/394: chown d4/d1a/d28/d42 1504988 1 2024-09-20T18:35:38.608 INFO:tasks.workunit.client.1.smithi172.stdout:0/395: write d4/d1a/d28/d75/f43 [683098,32707] 0 2024-09-20T18:35:38.609 INFO:tasks.workunit.client.1.smithi172.stdout:9/266: rmdir d15 39 2024-09-20T18:35:38.609 INFO:tasks.workunit.client.1.smithi172.stdout:0/396: readlink d4/d1a/d28/d73/l92 0 2024-09-20T18:35:38.618 INFO:tasks.workunit.client.1.smithi172.stdout:0/397: write d4/d1d/d15/f50 [6715843,20818] 0 2024-09-20T18:35:38.619 INFO:tasks.workunit.client.1.smithi172.stdout:0/398: dread - d4/d1d/f59 zero size 2024-09-20T18:35:38.620 INFO:tasks.workunit.client.1.smithi172.stdout:0/399: write d4/d1a/d28/f5e [175129,126365] 0 2024-09-20T18:35:38.620 INFO:tasks.workunit.client.1.smithi172.stdout:0/400: readlink d4/d5/l80 0 2024-09-20T18:35:38.622 INFO:tasks.workunit.client.1.smithi172.stdout:0/401: truncate d4/d5/f6a 213818 0 2024-09-20T18:35:38.622 INFO:tasks.workunit.client.1.smithi172.stdout:9/267: unlink d15/d1a/d1e/d24/f2f 0 2024-09-20T18:35:38.624 INFO:tasks.workunit.client.1.smithi172.stdout:8/279: rmdir dd/d1b/d4f/d70 0 2024-09-20T18:35:38.625 INFO:tasks.workunit.client.1.smithi172.stdout:7/362: sync 2024-09-20T18:35:38.628 INFO:tasks.workunit.client.1.smithi172.stdout:0/402: unlink d4/d1d/d15/c70 0 2024-09-20T18:35:38.628 INFO:tasks.workunit.client.1.smithi172.stdout:0/403: chown d4/d5/l21 407 1 2024-09-20T18:35:38.629 INFO:tasks.workunit.client.1.smithi172.stdout:0/404: write d4/d5/d2e/d33/f6b [149739,53522] 0 2024-09-20T18:35:38.629 INFO:tasks.workunit.client.1.smithi172.stdout:8/280: creat dd/d1b/d3b/d51/d34/d39/f72 x:0 0 0 2024-09-20T18:35:38.630 INFO:tasks.workunit.client.1.smithi172.stdout:0/405: write d4/d1a/d28/d42/f81 [501477,23946] 0 2024-09-20T18:35:38.634 INFO:tasks.workunit.client.1.smithi172.stdout:5/320: write d4/f9 [1601696,38652] 0 2024-09-20T18:35:38.637 INFO:tasks.workunit.client.1.smithi172.stdout:2/254: truncate d0/d1a/f20 768858 0 2024-09-20T18:35:38.639 INFO:tasks.workunit.client.1.smithi172.stdout:9/268: creat d15/d1a/f50 x:0 0 0 2024-09-20T18:35:38.640 INFO:tasks.workunit.client.1.smithi172.stdout:9/269: write d15/d1f/f40 [465795,5320] 0 2024-09-20T18:35:38.640 INFO:tasks.workunit.client.1.smithi172.stdout:5/321: symlink d4/d1f/d26/d41/l6a 0 2024-09-20T18:35:38.641 INFO:tasks.workunit.client.1.smithi172.stdout:5/322: fdatasync d4/df/f53 0 2024-09-20T18:35:38.642 INFO:tasks.workunit.client.1.smithi172.stdout:0/406: creat d4/d5/d2e/d8e/f93 x:0 0 0 2024-09-20T18:35:38.643 INFO:tasks.workunit.client.1.smithi172.stdout:9/270: dread d15/d1f/f40 [0,4194304] 0 2024-09-20T18:35:38.644 INFO:tasks.workunit.client.1.smithi172.stdout:7/363: rename d2/d5a to d2/d3/d86 0 2024-09-20T18:35:38.645 INFO:tasks.workunit.client.1.smithi172.stdout:5/323: dread d4/fc [0,4194304] 0 2024-09-20T18:35:38.654 INFO:tasks.workunit.client.1.smithi172.stdout:7/364: dread d2/d3/d10/f1b [0,4194304] 0 2024-09-20T18:35:38.655 INFO:tasks.workunit.client.1.smithi172.stdout:9/271: rename d15/d1a/d1e/d34/l36 to d15/d1a/d1e/l51 0 2024-09-20T18:35:38.655 INFO:tasks.workunit.client.1.smithi172.stdout:7/365: chown d2/f47 107 1 2024-09-20T18:35:38.655 INFO:tasks.workunit.client.1.smithi172.stdout:5/324: rename d4/d1f to d4/d1f/d26/d2d/d50/d2c/d6b 22 2024-09-20T18:35:38.657 INFO:tasks.workunit.client.1.smithi172.stdout:0/407: dread d4/d1a/d28/d42/d45/d54/f72 [0,4194304] 0 2024-09-20T18:35:38.658 INFO:tasks.workunit.client.1.smithi172.stdout:0/408: write d4/d1a/f1e [73443,1232] 0 2024-09-20T18:35:38.658 INFO:tasks.workunit.client.1.smithi172.stdout:2/255: link d0/d2c/d3f/d17/d18/d29/f41 d0/d2c/d3f/d17/d18/d29/f56 0 2024-09-20T18:35:38.659 INFO:tasks.workunit.client.1.smithi172.stdout:0/409: chown d4/d5/d2e/d76 25643017 1 2024-09-20T18:35:38.659 INFO:tasks.workunit.client.1.smithi172.stdout:0/410: read - d4/d5/d2e/d76/f79 zero size 2024-09-20T18:35:38.662 INFO:tasks.workunit.client.1.smithi172.stdout:9/272: rmdir d15/d1f/d2c 39 2024-09-20T18:35:38.663 INFO:tasks.workunit.client.1.smithi172.stdout:5/325: symlink d4/d1f/d26/l6c 0 2024-09-20T18:35:38.667 INFO:tasks.workunit.client.1.smithi172.stdout:2/256: creat d0/d2c/d3f/d17/d18/d29/f57 x:0 0 0 2024-09-20T18:35:38.669 INFO:tasks.workunit.client.1.smithi172.stdout:0/411: unlink d4/d5/d2e/d38/c3e 0 2024-09-20T18:35:38.670 INFO:tasks.workunit.client.1.smithi172.stdout:0/412: write d4/d1a/d28/d75/f43 [5838950,84363] 0 2024-09-20T18:35:38.673 INFO:tasks.workunit.client.1.smithi172.stdout:5/326: creat d4/d1f/d26/d2d/d50/f6d x:0 0 0 2024-09-20T18:35:38.685 INFO:tasks.workunit.client.1.smithi172.stdout:9/273: rename lc to d15/d1a/l52 0 2024-09-20T18:35:38.687 INFO:tasks.workunit.client.1.smithi172.stdout:5/327: creat d4/d1f/d26/d41/d69/f6e x:0 0 0 2024-09-20T18:35:38.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:38 smithi172 ceph-mon[35456]: pgmap v23: 65 pgs: 65 active+clean; 297 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 13 MiB/s wr, 261 op/s 2024-09-20T18:35:38.719 INFO:tasks.workunit.client.1.smithi172.stdout:5/328: link d4/f62 d4/df/d3f/f6f 0 2024-09-20T18:35:38.721 INFO:tasks.workunit.client.1.smithi172.stdout:4/242: sync 2024-09-20T18:35:38.721 INFO:tasks.workunit.client.1.smithi172.stdout:1/297: sync 2024-09-20T18:35:38.721 INFO:tasks.workunit.client.1.smithi172.stdout:3/325: sync 2024-09-20T18:35:38.721 INFO:tasks.workunit.client.1.smithi172.stdout:6/242: sync 2024-09-20T18:35:38.721 INFO:tasks.workunit.client.1.smithi172.stdout:5/329: readlink d4/l18 0 2024-09-20T18:35:38.722 INFO:tasks.workunit.client.1.smithi172.stdout:9/274: getdents d15/d1a/d1e/d34 0 2024-09-20T18:35:38.726 INFO:tasks.workunit.client.1.smithi172.stdout:4/243: creat d0/d48/f59 x:0 0 0 2024-09-20T18:35:38.727 INFO:tasks.workunit.client.1.smithi172.stdout:9/275: dread d15/d1a/d1e/f27 [0,4194304] 0 2024-09-20T18:35:38.727 INFO:tasks.workunit.client.1.smithi172.stdout:3/326: dwrite d0/db/f50 [0,4194304] 0 2024-09-20T18:35:38.728 INFO:tasks.workunit.client.1.smithi172.stdout:1/298: rename d0/d8/f51 to d0/d8/db/d25/d2b/d3d/f62 0 2024-09-20T18:35:38.728 INFO:tasks.workunit.client.1.smithi172.stdout:5/330: rename d4/d1f/d26/d2d/d63 to d4/d1f/d26/d2d/d63/d70 22 2024-09-20T18:35:38.729 INFO:tasks.workunit.client.1.smithi172.stdout:3/327: readlink d0/d13/d32/l39 0 2024-09-20T18:35:38.731 INFO:tasks.workunit.client.1.smithi172.stdout:7/366: truncate d2/d3/d10/f2d 2614004 0 2024-09-20T18:35:38.731 INFO:tasks.workunit.client.1.smithi172.stdout:7/367: stat c1 0 2024-09-20T18:35:38.734 INFO:tasks.workunit.client.1.smithi172.stdout:4/244: dwrite d0/de/d21/f2b [0,4194304] 0 2024-09-20T18:35:38.740 INFO:tasks.workunit.client.1.smithi172.stdout:0/413: write d4/d1d/d15/f3b [631783,99012] 0 2024-09-20T18:35:38.741 INFO:tasks.workunit.client.1.smithi172.stdout:0/414: stat d4/d44/f6e 0 2024-09-20T18:35:38.744 INFO:tasks.workunit.client.1.smithi172.stdout:0/415: write d4/d1d/d15/f69 [758007,124956] 0 2024-09-20T18:35:38.745 INFO:tasks.workunit.client.1.smithi172.stdout:2/257: dwrite d0/d2c/d3f/d17/d22/d10/f1f [0,4194304] 0 2024-09-20T18:35:38.747 INFO:tasks.workunit.client.1.smithi172.stdout:2/258: chown d0/d2c/d3f/d17/d18/d3b/f44 1 1 2024-09-20T18:35:38.747 INFO:tasks.workunit.client.1.smithi172.stdout:1/299: creat d0/d8/db/d25/d2b/f63 x:0 0 0 2024-09-20T18:35:38.749 INFO:tasks.workunit.client.1.smithi172.stdout:3/328: rmdir d0/db 39 2024-09-20T18:35:38.749 INFO:tasks.workunit.client.1.smithi172.stdout:2/259: chown d0/d2c/d3f/d17/d22/c11 4695 1 2024-09-20T18:35:38.752 INFO:tasks.workunit.client.1.smithi172.stdout:5/331: mknod d4/d1f/d26/d2d/c71 0 2024-09-20T18:35:38.752 INFO:tasks.workunit.client.1.smithi172.stdout:7/368: fsync d2/d3/d10/d40/f7c 0 2024-09-20T18:35:38.755 INFO:tasks.workunit.client.1.smithi172.stdout:0/416: dwrite d4/d1d/d15/f3b [0,4194304] 0 2024-09-20T18:35:38.759 INFO:tasks.workunit.client.1.smithi172.stdout:2/260: dwrite d0/d2c/f3e [0,4194304] 0 2024-09-20T18:35:38.764 INFO:tasks.workunit.client.1.smithi172.stdout:8/281: sync 2024-09-20T18:35:38.767 INFO:tasks.workunit.client.1.smithi172.stdout:1/300: creat d0/d8/db/d39/f64 x:0 0 0 2024-09-20T18:35:38.768 INFO:tasks.workunit.client.1.smithi172.stdout:6/243: dwrite d0/d18/f2b [0,4194304] 0 2024-09-20T18:35:38.773 INFO:tasks.workunit.client.1.smithi172.stdout:7/369: write d2/d3/d10/f14 [300906,78196] 0 2024-09-20T18:35:38.778 INFO:tasks.workunit.client.1.smithi172.stdout:7/370: dread d2/d3/fb [0,4194304] 0 2024-09-20T18:35:38.778 INFO:tasks.workunit.client.1.smithi172.stdout:9/276: link fd d15/d1f/f53 0 2024-09-20T18:35:38.780 INFO:tasks.workunit.client.1.smithi172.stdout:0/417: read d4/d46/f56 [152847,3383] 0 2024-09-20T18:35:38.782 INFO:tasks.workunit.client.1.smithi172.stdout:2/261: mkdir d0/d1a/d58 0 2024-09-20T18:35:38.783 INFO:tasks.workunit.client.1.smithi172.stdout:3/329: symlink d0/db/l63 0 2024-09-20T18:35:38.784 INFO:tasks.workunit.client.1.smithi172.stdout:7/371: dwrite d2/d3/d10/f14 [4194304,4194304] 0 2024-09-20T18:35:38.784 INFO:tasks.workunit.client.1.smithi172.stdout:3/330: readlink d0/d13/d1e/l51 0 2024-09-20T18:35:38.785 INFO:tasks.workunit.client.1.smithi172.stdout:3/331: fsync d0/f16 0 2024-09-20T18:35:38.788 INFO:tasks.workunit.client.1.smithi172.stdout:3/332: dread d0/dc/f4c [0,4194304] 0 2024-09-20T18:35:38.788 INFO:tasks.workunit.client.1.smithi172.stdout:8/282: rename dd/d1b/f31 to dd/d1b/d3b/d51/d34/d39/f73 0 2024-09-20T18:35:38.790 INFO:tasks.workunit.client.1.smithi172.stdout:1/301: mkdir d0/d8/db/d25/d2b/d3d/d65 0 2024-09-20T18:35:38.792 INFO:tasks.workunit.client.1.smithi172.stdout:3/333: dread d0/db/d22/f34 [4194304,4194304] 0 2024-09-20T18:35:38.797 INFO:tasks.workunit.client.1.smithi172.stdout:4/245: creat d0/de/f5a x:0 0 0 2024-09-20T18:35:38.801 INFO:tasks.workunit.client.1.smithi172.stdout:9/277: write d15/d1f/d2c/d37/f3c [679725,102091] 0 2024-09-20T18:35:38.803 INFO:tasks.workunit.client.1.smithi172.stdout:7/372: dread d2/d3/dd/fe [0,4194304] 0 2024-09-20T18:35:38.803 INFO:tasks.workunit.client.1.smithi172.stdout:0/418: dread d4/d44/f61 [0,4194304] 0 2024-09-20T18:35:38.803 INFO:tasks.workunit.client.1.smithi172.stdout:2/262: rmdir d0/d2c/d3f/d17/d18/d3b 39 2024-09-20T18:35:38.804 INFO:tasks.workunit.client.1.smithi172.stdout:0/419: chown d4/d1a/d28/d88 1091 1 2024-09-20T18:35:38.811 INFO:tasks.workunit.client.1.smithi172.stdout:5/332: getdents d4/df 0 2024-09-20T18:35:38.816 INFO:tasks.workunit.client.1.smithi172.stdout:6/244: dwrite d0/d18/d1c/d21/d26/d34/d39/d46/f7 [4194304,4194304] 0 2024-09-20T18:35:38.818 INFO:tasks.workunit.client.1.smithi172.stdout:7/373: write d2/d3/f45 [546054,33680] 0 2024-09-20T18:35:38.823 INFO:tasks.workunit.client.1.smithi172.stdout:8/283: mknod dd/c74 0 2024-09-20T18:35:38.824 INFO:tasks.workunit.client.1.smithi172.stdout:7/374: dwrite d2/f54 [0,4194304] 0 2024-09-20T18:35:38.827 INFO:tasks.workunit.client.1.smithi172.stdout:1/302: creat d0/d8/db/d25/d2b/d3d/d65/f66 x:0 0 0 2024-09-20T18:35:38.828 INFO:tasks.workunit.client.1.smithi172.stdout:1/303: fsync d0/d8/d12/f5d 0 2024-09-20T18:35:38.829 INFO:tasks.workunit.client.1.smithi172.stdout:3/334: symlink d0/l64 0 2024-09-20T18:35:38.831 INFO:tasks.workunit.client.1.smithi172.stdout:9/278: mkdir d15/d54 0 2024-09-20T18:35:38.832 INFO:tasks.workunit.client.1.smithi172.stdout:4/246: dread d0/f2a [0,4194304] 0 2024-09-20T18:35:38.834 INFO:tasks.workunit.client.1.smithi172.stdout:6/245: creat d0/f4a x:0 0 0 2024-09-20T18:35:38.836 INFO:tasks.workunit.client.1.smithi172.stdout:0/420: mkdir d4/d94 0 2024-09-20T18:35:38.836 INFO:tasks.workunit.client.1.smithi172.stdout:1/304: dwrite d0/f61 [0,4194304] 0 2024-09-20T18:35:38.837 INFO:tasks.workunit.client.1.smithi172.stdout:0/421: write d4/d5/d2e/d33/f6b [948170,105217] 0 2024-09-20T18:35:38.839 INFO:tasks.workunit.client.1.smithi172.stdout:0/422: write d4/d1a/f1e [1564830,88303] 0 2024-09-20T18:35:38.839 INFO:tasks.workunit.client.1.smithi172.stdout:9/279: write d15/d1a/d1e/d48/f4f [5184533,33542] 0 2024-09-20T18:35:38.842 INFO:tasks.workunit.client.1.smithi172.stdout:2/263: write d0/d2c/d3f/d17/d18/d29/f41 [109173,44590] 0 2024-09-20T18:35:38.843 INFO:tasks.workunit.client.1.smithi172.stdout:8/284: symlink dd/d1b/d3b/d51/l75 0 2024-09-20T18:35:38.844 INFO:tasks.workunit.client.1.smithi172.stdout:1/305: chown d0/d8/d12/f29 1 1 2024-09-20T18:35:38.845 INFO:tasks.workunit.client.1.smithi172.stdout:8/285: chown dd/d1b/d3b/d51/d34/d39/d4d 9687985 1 2024-09-20T18:35:38.846 INFO:tasks.workunit.client.1.smithi172.stdout:2/264: dread d0/d2c/d3f/d17/d18/d29/f41 [0,4194304] 0 2024-09-20T18:35:38.846 INFO:tasks.workunit.client.1.smithi172.stdout:3/335: mknod d0/c65 0 2024-09-20T18:35:38.846 INFO:tasks.workunit.client.1.smithi172.stdout:8/286: readlink dd/d1b/d3b/d51/d34/d39/l68 0 2024-09-20T18:35:38.847 INFO:tasks.workunit.client.1.smithi172.stdout:1/306: read d0/d8/db/d25/d2b/d3d/f4d [625537,32676] 0 2024-09-20T18:35:38.847 INFO:tasks.workunit.client.1.smithi172.stdout:8/287: stat dd/d1b/l46 0 2024-09-20T18:35:38.851 INFO:tasks.workunit.client.1.smithi172.stdout:9/280: rename d15/f1d to d15/d4a/f55 0 2024-09-20T18:35:38.852 INFO:tasks.workunit.client.1.smithi172.stdout:9/281: fdatasync d15/d1a/d1e/d24/f2e 0 2024-09-20T18:35:38.853 INFO:tasks.workunit.client.1.smithi172.stdout:6/246: symlink d0/d18/l4b 0 2024-09-20T18:35:38.853 INFO:tasks.workunit.client.1.smithi172.stdout:6/247: chown d0/d18/f2b 58740 1 2024-09-20T18:35:38.855 INFO:tasks.workunit.client.1.smithi172.stdout:7/375: rmdir d2/d3/d10/d40/d6a/d76 0 2024-09-20T18:35:38.855 INFO:tasks.workunit.client.1.smithi172.stdout:5/333: write d4/f48 [1711466,39483] 0 2024-09-20T18:35:38.856 INFO:tasks.workunit.client.1.smithi172.stdout:2/265: mkdir d0/d4e/d59 0 2024-09-20T18:35:38.860 INFO:tasks.workunit.client.1.smithi172.stdout:6/248: dwrite d0/d18/d1c/d21/d26/f45 [0,4194304] 0 2024-09-20T18:35:38.860 INFO:tasks.workunit.client.1.smithi172.stdout:6/249: readlink d0/d18/l42 0 2024-09-20T18:35:38.863 INFO:tasks.workunit.client.1.smithi172.stdout:0/423: rename d4/f6 to d4/d5/d2e/f95 0 2024-09-20T18:35:38.868 INFO:tasks.workunit.client.1.smithi172.stdout:3/336: link d0/d13/d58/f4a d0/dc/d61/f66 0 2024-09-20T18:35:38.869 INFO:tasks.workunit.client.1.smithi172.stdout:3/337: stat d0/dc/c5f 0 2024-09-20T18:35:38.870 INFO:tasks.workunit.client.1.smithi172.stdout:3/338: read d0/dc/f3c [6792393,21169] 0 2024-09-20T18:35:38.870 INFO:tasks.workunit.client.1.smithi172.stdout:4/247: dwrite d0/de/d39/f46 [0,4194304] 0 2024-09-20T18:35:38.871 INFO:tasks.workunit.client.1.smithi172.stdout:3/339: chown d0/d13/d32 11709130 1 2024-09-20T18:35:38.871 INFO:tasks.workunit.client.1.smithi172.stdout:4/248: stat d0/de/d39/f46 0 2024-09-20T18:35:38.872 INFO:tasks.workunit.client.1.smithi172.stdout:5/334: dread d4/fc [0,4194304] 0 2024-09-20T18:35:38.874 INFO:tasks.workunit.client.1.smithi172.stdout:6/250: mkdir d0/d18/d1c/d4c 0 2024-09-20T18:35:38.875 INFO:tasks.workunit.client.1.smithi172.stdout:9/282: getdents d15/d54 0 2024-09-20T18:35:38.876 INFO:tasks.workunit.client.1.smithi172.stdout:0/424: unlink d4/d1a/d28/d42/d45/d54/f72 0 2024-09-20T18:35:38.877 INFO:tasks.workunit.client.1.smithi172.stdout:8/288: creat dd/d1b/d3b/d51/f76 x:0 0 0 2024-09-20T18:35:38.878 INFO:tasks.workunit.client.1.smithi172.stdout:2/266: symlink d0/d2c/d51/l5a 0 2024-09-20T18:35:38.879 INFO:tasks.workunit.client.1.smithi172.stdout:4/249: dread d0/d7/f12 [0,4194304] 0 2024-09-20T18:35:38.880 INFO:tasks.workunit.client.1.smithi172.stdout:5/335: creat d4/d1f/d26/f72 x:0 0 0 2024-09-20T18:35:38.882 INFO:tasks.workunit.client.1.smithi172.stdout:7/376: creat d2/f87 x:0 0 0 2024-09-20T18:35:38.882 INFO:tasks.workunit.client.1.smithi172.stdout:3/340: dread d0/dc/f2e [0,4194304] 0 2024-09-20T18:35:38.882 INFO:tasks.workunit.client.1.smithi172.stdout:8/289: write dd/d1b/d3b/d51/d34/f5c [240116,106191] 0 2024-09-20T18:35:38.883 INFO:tasks.workunit.client.1.smithi172.stdout:9/283: mknod d15/d1a/d1e/d34/c56 0 2024-09-20T18:35:38.884 INFO:tasks.workunit.client.1.smithi172.stdout:1/307: truncate d0/f61 2108044 0 2024-09-20T18:35:38.886 INFO:tasks.workunit.client.1.smithi172.stdout:7/377: fsync d2/d23/d3c/f58 0 2024-09-20T18:35:38.887 INFO:tasks.workunit.client.1.smithi172.stdout:5/336: write d4/d1f/d26/d2d/d50/f20 [1270695,14905] 0 2024-09-20T18:35:38.889 INFO:tasks.workunit.client.1.smithi172.stdout:0/425: dread d4/d1a/d28/d42/f55 [0,4194304] 0 2024-09-20T18:35:38.890 INFO:tasks.workunit.client.1.smithi172.stdout:3/341: mknod d0/db/c67 0 2024-09-20T18:35:38.891 INFO:tasks.workunit.client.1.smithi172.stdout:9/284: mkdir d15/d1f/d2c/d57 0 2024-09-20T18:35:38.898 INFO:tasks.workunit.client.1.smithi172.stdout:6/251: dwrite d0/d18/d1c/d21/d26/d34/d39/d46/f20 [0,4194304] 0 2024-09-20T18:35:38.898 INFO:tasks.workunit.client.1.smithi172.stdout:8/290: symlink dd/d1b/d3b/d51/l77 0 2024-09-20T18:35:38.899 INFO:tasks.workunit.client.1.smithi172.stdout:0/426: read d4/d1a/d28/d42/f81 [1925656,48099] 0 2024-09-20T18:35:38.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:38 smithi017 ceph-mon[28058]: pgmap v23: 65 pgs: 65 active+clean; 297 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 13 MiB/s wr, 261 op/s 2024-09-20T18:35:38.900 INFO:tasks.workunit.client.1.smithi172.stdout:2/267: dread d0/d2c/d3f/d17/d22/d10/f21 [0,4194304] 0 2024-09-20T18:35:38.903 INFO:tasks.workunit.client.1.smithi172.stdout:4/250: dwrite d0/de/d21/d24/f2d [0,4194304] 0 2024-09-20T18:35:38.906 INFO:tasks.workunit.client.1.smithi172.stdout:9/285: mkdir d15/d1a/d1e/d58 0 2024-09-20T18:35:38.910 INFO:tasks.workunit.client.1.smithi172.stdout:1/308: dwrite d0/d8/f32 [0,4194304] 0 2024-09-20T18:35:38.910 INFO:tasks.workunit.client.1.smithi172.stdout:5/337: write d4/df/d3f/f6f [495544,122580] 0 2024-09-20T18:35:38.911 INFO:tasks.workunit.client.1.smithi172.stdout:2/268: chown d0/d2c/d3f/f46 134263793 1 2024-09-20T18:35:38.913 INFO:tasks.workunit.client.1.smithi172.stdout:0/427: mkdir d4/d5/d2e/d38/d96 0 2024-09-20T18:35:38.913 INFO:tasks.workunit.client.1.smithi172.stdout:4/251: fdatasync d0/d7/df/f11 0 2024-09-20T18:35:38.914 INFO:tasks.workunit.client.1.smithi172.stdout:6/252: mknod d0/d18/d1c/d21/d26/d34/d39/d46/c4d 0 2024-09-20T18:35:38.916 INFO:tasks.workunit.client.1.smithi172.stdout:0/428: dread - d4/d1d/d15/f7b zero size 2024-09-20T18:35:38.918 INFO:tasks.workunit.client.1.smithi172.stdout:8/291: getdents dd/d1b/d4f 0 2024-09-20T18:35:38.918 INFO:tasks.workunit.client.1.smithi172.stdout:7/378: dwrite d2/d3/dd/f7e [0,4194304] 0 2024-09-20T18:35:38.919 INFO:tasks.workunit.client.1.smithi172.stdout:5/338: rmdir d4/d1f/d26/d2d/d50 39 2024-09-20T18:35:38.920 INFO:tasks.workunit.client.1.smithi172.stdout:4/252: readlink d0/d7/df/d15/d55/l27 0 2024-09-20T18:35:38.920 INFO:tasks.workunit.client.1.smithi172.stdout:1/309: symlink d0/d52/l67 0 2024-09-20T18:35:38.921 INFO:tasks.workunit.client.1.smithi172.stdout:1/310: stat d0 0 2024-09-20T18:35:38.922 INFO:tasks.workunit.client.1.smithi172.stdout:6/253: mknod d0/d18/d1c/d22/d27/d35/c4e 0 2024-09-20T18:35:38.923 INFO:tasks.workunit.client.1.smithi172.stdout:3/342: truncate d0/db/f53 2403493 0 2024-09-20T18:35:38.924 INFO:tasks.workunit.client.1.smithi172.stdout:0/429: dread - d4/d1a/d28/d42/f4c zero size 2024-09-20T18:35:38.926 INFO:tasks.workunit.client.1.smithi172.stdout:1/311: symlink d0/d8/db/d25/d2b/l68 0 2024-09-20T18:35:38.927 INFO:tasks.workunit.client.1.smithi172.stdout:4/253: mknod d0/d7/df/c5b 0 2024-09-20T18:35:38.928 INFO:tasks.workunit.client.1.smithi172.stdout:6/254: write d0/d18/f1e [2485971,20217] 0 2024-09-20T18:35:38.928 INFO:tasks.workunit.client.1.smithi172.stdout:9/286: dread f6 [0,4194304] 0 2024-09-20T18:35:38.930 INFO:tasks.workunit.client.1.smithi172.stdout:5/339: rename d4/df/f53 to d4/d1f/d26/d2d/f73 0 2024-09-20T18:35:38.931 INFO:tasks.workunit.client.1.smithi172.stdout:5/340: dread - d4/d1f/f51 zero size 2024-09-20T18:35:38.932 INFO:tasks.workunit.client.1.smithi172.stdout:1/312: symlink d0/d8/db/l69 0 2024-09-20T18:35:38.934 INFO:tasks.workunit.client.1.smithi172.stdout:6/255: creat d0/d18/d1c/d22/d27/d35/f4f x:0 0 0 2024-09-20T18:35:38.936 INFO:tasks.workunit.client.1.smithi172.stdout:8/292: rename dd/d1b/d3b/d51/d34/f66 to dd/d65/f78 0 2024-09-20T18:35:38.936 INFO:tasks.workunit.client.1.smithi172.stdout:3/343: link d0/l45 d0/dc/d61/l68 0 2024-09-20T18:35:38.937 INFO:tasks.workunit.client.1.smithi172.stdout:3/344: readlink d0/l64 0 2024-09-20T18:35:38.938 INFO:tasks.workunit.client.1.smithi172.stdout:0/430: dwrite d4/d1a/d28/d42/d45/d54/f5d [0,4194304] 0 2024-09-20T18:35:38.938 INFO:tasks.workunit.client.1.smithi172.stdout:8/293: chown dd/d1b/f2c 1389606 1 2024-09-20T18:35:38.939 INFO:tasks.workunit.client.1.smithi172.stdout:4/254: mkdir d0/d7/df/d15/d55/d53/d5c 0 2024-09-20T18:35:38.942 INFO:tasks.workunit.client.1.smithi172.stdout:3/345: chown d0/f8 1928 1 2024-09-20T18:35:38.943 INFO:tasks.workunit.client.1.smithi172.stdout:4/255: chown d0/de/dc/d3c/c4d 2637857 1 2024-09-20T18:35:38.943 INFO:tasks.workunit.client.1.smithi172.stdout:5/341: rename d4/d1f/d26/f37 to d4/df/f74 0 2024-09-20T18:35:38.945 INFO:tasks.workunit.client.1.smithi172.stdout:8/294: write dd/d1b/d3b/d51/f35 [586727,68059] 0 2024-09-20T18:35:38.946 INFO:tasks.workunit.client.1.smithi172.stdout:0/431: mkdir d4/d1a/d28/d42/d45/d97 0 2024-09-20T18:35:38.948 INFO:tasks.workunit.client.1.smithi172.stdout:6/256: dwrite d0/d18/d1c/d21/d26/d34/d39/d46/f7 [0,4194304] 0 2024-09-20T18:35:38.950 INFO:tasks.workunit.client.1.smithi172.stdout:5/342: write d4/d1f/d26/d2d/d50/f24 [603301,124107] 0 2024-09-20T18:35:38.952 INFO:tasks.workunit.client.1.smithi172.stdout:3/346: mknod d0/d13/d32/d54/c69 0 2024-09-20T18:35:38.953 INFO:tasks.workunit.client.1.smithi172.stdout:5/343: write d4/df/d3f/f49 [1895576,116134] 0 2024-09-20T18:35:38.957 INFO:tasks.workunit.client.1.smithi172.stdout:6/257: dwrite d0/d18/d1c/d22/d27/f2f [0,4194304] 0 2024-09-20T18:35:38.962 INFO:tasks.workunit.client.1.smithi172.stdout:9/287: dwrite d15/d1f/f45 [0,4194304] 0 2024-09-20T18:35:38.964 INFO:tasks.workunit.client.1.smithi172.stdout:4/256: link d0/d7/f25 d0/d7/df/f5d 0 2024-09-20T18:35:38.967 INFO:tasks.workunit.client.1.smithi172.stdout:9/288: write d15/d1f/d2c/d37/f3c [3833239,113917] 0 2024-09-20T18:35:38.969 INFO:tasks.workunit.client.1.smithi172.stdout:8/295: truncate dd/d1b/d3b/d51/d34/d39/f6c 2375907 0 2024-09-20T18:35:38.975 INFO:tasks.workunit.client.1.smithi172.stdout:3/347: dwrite d0/dc/d61/f66 [0,4194304] 0 2024-09-20T18:35:38.975 INFO:tasks.workunit.client.1.smithi172.stdout:8/296: unlink dd/d1b/d3b/c45 0 2024-09-20T18:35:38.976 INFO:tasks.workunit.client.1.smithi172.stdout:3/348: read - d0/dc/f5a zero size 2024-09-20T18:35:38.977 INFO:tasks.workunit.client.1.smithi172.stdout:5/344: getdents d4/df 0 2024-09-20T18:35:38.977 INFO:tasks.workunit.client.1.smithi172.stdout:4/257: creat d0/de/f5e x:0 0 0 2024-09-20T18:35:38.979 INFO:tasks.workunit.client.1.smithi172.stdout:8/297: write dd/d1b/d3b/d51/f76 [5412,23336] 0 2024-09-20T18:35:38.981 INFO:tasks.workunit.client.1.smithi172.stdout:5/345: write d4/d1f/d26/d2d/f73 [965537,129317] 0 2024-09-20T18:35:38.983 INFO:tasks.workunit.client.1.smithi172.stdout:5/346: write d4/d1f/d26/d2d/d50/f24 [1605000,91843] 0 2024-09-20T18:35:38.985 INFO:tasks.workunit.client.1.smithi172.stdout:5/347: chown d4/d1f/d26/d41/d69/f6e 18217355 1 2024-09-20T18:35:38.985 INFO:tasks.workunit.client.1.smithi172.stdout:5/348: stat d4/l59 0 2024-09-20T18:35:38.987 INFO:tasks.workunit.client.1.smithi172.stdout:4/258: creat d0/de/dc/d3c/f5f x:0 0 0 2024-09-20T18:35:38.987 INFO:tasks.workunit.client.1.smithi172.stdout:3/349: truncate d0/dc/f2a 5578921 0 2024-09-20T18:35:38.987 INFO:tasks.workunit.client.1.smithi172.stdout:5/349: write d4/f4e [2357706,18853] 0 2024-09-20T18:35:38.990 INFO:tasks.workunit.client.1.smithi172.stdout:5/350: stat d4/d1f/d26/d2d/c3a 0 2024-09-20T18:35:38.990 INFO:tasks.workunit.client.1.smithi172.stdout:3/350: write d0/dc/f2e [1570748,91336] 0 2024-09-20T18:35:38.991 INFO:tasks.workunit.client.1.smithi172.stdout:9/289: dread d15/d1f/f53 [0,4194304] 0 2024-09-20T18:35:38.991 INFO:tasks.workunit.client.1.smithi172.stdout:5/351: fsync d4/d1f/d26/f2a 0 2024-09-20T18:35:38.991 INFO:tasks.workunit.client.1.smithi172.stdout:4/259: mknod d0/d48/d4e/c60 0 2024-09-20T18:35:38.993 INFO:tasks.workunit.client.1.smithi172.stdout:5/352: write d4/d1f/d26/f32 [3732700,73593] 0 2024-09-20T18:35:38.995 INFO:tasks.workunit.client.1.smithi172.stdout:3/351: rename d0/db to d0/dc/d6a 0 2024-09-20T18:35:38.995 INFO:tasks.workunit.client.1.smithi172.stdout:3/352: chown d0/d13/d1e/f24 150703940 1 2024-09-20T18:35:38.998 INFO:tasks.workunit.client.1.smithi172.stdout:9/290: rename d15/d1a/d1e/c4c to d15/d4a/c59 0 2024-09-20T18:35:39.007 INFO:tasks.workunit.client.1.smithi172.stdout:8/298: write f0 [604740,21104] 0 2024-09-20T18:35:39.009 INFO:tasks.workunit.client.1.smithi172.stdout:4/260: rename d0/de/c9 to d0/d7/df/d18/c61 0 2024-09-20T18:35:39.012 INFO:tasks.workunit.client.1.smithi172.stdout:3/353: truncate d0/dc/f3c 2467757 0 2024-09-20T18:35:39.013 INFO:tasks.workunit.client.1.smithi172.stdout:8/299: rmdir dd/d1b/d3b/d51/d5b 39 2024-09-20T18:35:39.013 INFO:tasks.workunit.client.1.smithi172.stdout:8/300: write dd/f30 [394898,57472] 0 2024-09-20T18:35:39.048 INFO:tasks.workunit.client.1.smithi172.stdout:3/354: mknod d0/d13/d1e/c6b 0 2024-09-20T18:35:39.048 INFO:tasks.workunit.client.1.smithi172.stdout:8/301: write f9 [239277,42134] 0 2024-09-20T18:35:39.049 INFO:tasks.workunit.client.1.smithi172.stdout:3/355: write d0/f62 [120741,111089] 0 2024-09-20T18:35:39.051 INFO:tasks.workunit.client.1.smithi172.stdout:4/261: creat d0/d7/f62 x:0 0 0 2024-09-20T18:35:39.052 INFO:tasks.workunit.client.1.smithi172.stdout:3/356: unlink d0/d13/d1e/l51 0 2024-09-20T18:35:39.055 INFO:tasks.workunit.client.1.smithi172.stdout:4/262: rename d0/de/dc/f22 to d0/f63 0 2024-09-20T18:35:39.055 INFO:tasks.workunit.client.1.smithi172.stdout:8/302: dwrite dd/f19 [0,4194304] 0 2024-09-20T18:35:39.055 INFO:tasks.workunit.client.1.smithi172.stdout:3/357: mknod d0/dc/d6a/c6c 0 2024-09-20T18:35:39.056 INFO:tasks.workunit.client.1.smithi172.stdout:3/358: chown d0/dc/d6a/d22 17282 1 2024-09-20T18:35:39.058 INFO:tasks.workunit.client.1.smithi172.stdout:8/303: rmdir dd/d1b 39 2024-09-20T18:35:39.061 INFO:tasks.workunit.client.1.smithi172.stdout:3/359: mkdir d0/d13/d58/d6d 0 2024-09-20T18:35:39.063 INFO:tasks.workunit.client.1.smithi172.stdout:8/304: dread - dd/d1b/d3b/f42 zero size 2024-09-20T18:35:39.063 INFO:tasks.workunit.client.1.smithi172.stdout:8/305: chown dd/d1b/d3b/d51/f47 58800 1 2024-09-20T18:35:39.067 INFO:tasks.workunit.client.1.smithi172.stdout:4/263: link d0/d7/df/d18/c3d d0/de/d21/c64 0 2024-09-20T18:35:39.068 INFO:tasks.workunit.client.1.smithi172.stdout:3/360: rename d0/d13/d32/c55 to d0/dc/d6a/d3a/c6e 0 2024-09-20T18:35:39.069 INFO:tasks.workunit.client.1.smithi172.stdout:4/264: mknod d0/d48/c65 0 2024-09-20T18:35:39.070 INFO:tasks.workunit.client.1.smithi172.stdout:8/306: creat dd/d1b/f79 x:0 0 0 2024-09-20T18:35:39.070 INFO:tasks.workunit.client.1.smithi172.stdout:3/361: chown d0/dc/f2a 175959954 1 2024-09-20T18:35:39.071 INFO:tasks.workunit.client.1.smithi172.stdout:3/362: write d0/dc/f2e [1568186,44613] 0 2024-09-20T18:35:39.074 INFO:tasks.workunit.client.1.smithi172.stdout:8/307: rename dd/f71 to dd/d1b/d3b/d51/d5b/f7a 0 2024-09-20T18:35:39.079 INFO:tasks.workunit.client.1.smithi172.stdout:4/265: truncate d0/de/d39/f46 1624429 0 2024-09-20T18:35:39.079 INFO:tasks.workunit.client.1.smithi172.stdout:8/308: dwrite fa [0,4194304] 0 2024-09-20T18:35:39.082 INFO:tasks.workunit.client.1.smithi172.stdout:8/309: creat dd/d1b/d3b/f7b x:0 0 0 2024-09-20T18:35:39.089 INFO:tasks.workunit.client.1.smithi172.stdout:8/310: rename dd/c48 to dd/d1b/d3b/d51/d34/c7c 0 2024-09-20T18:35:39.090 INFO:tasks.workunit.client.1.smithi172.stdout:8/311: chown dd/d1b/c26 692 1 2024-09-20T18:35:39.099 INFO:tasks.workunit.client.1.smithi172.stdout:8/312: dwrite dd/d1b/f1f [8388608,4194304] 0 2024-09-20T18:35:39.099 INFO:tasks.workunit.client.1.smithi172.stdout:4/266: dread d0/de/f30 [0,4194304] 0 2024-09-20T18:35:39.100 INFO:tasks.workunit.client.1.smithi172.stdout:8/313: fdatasync dd/f27 0 2024-09-20T18:35:39.101 INFO:tasks.workunit.client.1.smithi172.stdout:4/267: stat d0/d7/df/c16 0 2024-09-20T18:35:39.103 INFO:tasks.workunit.client.1.smithi172.stdout:8/314: write dd/d1b/d3b/d51/d34/d39/f4b [1018926,69181] 0 2024-09-20T18:35:39.103 INFO:tasks.workunit.client.1.smithi172.stdout:4/268: symlink d0/de/d21/l66 0 2024-09-20T18:35:39.107 INFO:tasks.workunit.client.1.smithi172.stdout:8/315: unlink dd/l13 0 2024-09-20T18:35:39.108 INFO:tasks.workunit.client.1.smithi172.stdout:4/269: truncate d0/d7/df/f3b 1572543 0 2024-09-20T18:35:39.110 INFO:tasks.workunit.client.1.smithi172.stdout:8/316: mkdir dd/d1b/d3b/d5d/d7d 0 2024-09-20T18:35:39.110 INFO:tasks.workunit.client.1.smithi172.stdout:4/270: rename d0/d7 to d0/d7/df/d67 22 2024-09-20T18:35:39.112 INFO:tasks.workunit.client.1.smithi172.stdout:4/271: symlink d0/d48/d4e/l68 0 2024-09-20T18:35:39.113 INFO:tasks.workunit.client.1.smithi172.stdout:4/272: write d0/d48/f59 [365716,7173] 0 2024-09-20T18:35:39.114 INFO:tasks.workunit.client.1.smithi172.stdout:8/317: dread dd/d1b/f21 [0,4194304] 0 2024-09-20T18:35:39.122 INFO:tasks.workunit.client.1.smithi172.stdout:4/273: write d0/f2a [272135,18527] 0 2024-09-20T18:35:39.123 INFO:tasks.workunit.client.1.smithi172.stdout:8/318: truncate dd/d1b/f55 1157080 0 2024-09-20T18:35:39.124 INFO:tasks.workunit.client.1.smithi172.stdout:4/274: creat d0/de/d21/d24/f69 x:0 0 0 2024-09-20T18:35:39.125 INFO:tasks.workunit.client.1.smithi172.stdout:4/275: readlink d0/d7/df/d15/d55/l27 0 2024-09-20T18:35:39.131 INFO:tasks.workunit.client.1.smithi172.stdout:4/276: write d0/d7/df/f40 [844066,17640] 0 2024-09-20T18:35:39.137 INFO:tasks.workunit.client.1.smithi172.stdout:8/319: dread dd/d1b/f23 [0,4194304] 0 2024-09-20T18:35:39.137 INFO:tasks.workunit.client.1.smithi172.stdout:8/320: fsync f1 0 2024-09-20T18:35:39.141 INFO:tasks.workunit.client.1.smithi172.stdout:7/379: sync 2024-09-20T18:35:39.141 INFO:tasks.workunit.client.1.smithi172.stdout:1/313: sync 2024-09-20T18:35:39.141 INFO:tasks.workunit.client.1.smithi172.stdout:2/269: sync 2024-09-20T18:35:39.142 INFO:tasks.workunit.client.1.smithi172.stdout:1/314: truncate d0/f5a 534220 0 2024-09-20T18:35:39.175 INFO:tasks.workunit.client.1.smithi172.stdout:4/277: unlink d0/d7/df/f3b 0 2024-09-20T18:35:39.176 INFO:tasks.workunit.client.1.smithi172.stdout:4/278: dread - d0/de/f5a zero size 2024-09-20T18:35:39.176 INFO:tasks.workunit.client.1.smithi172.stdout:8/321: unlink f9 0 2024-09-20T18:35:39.177 INFO:tasks.workunit.client.1.smithi172.stdout:7/380: creat d2/d23/d3a/f88 x:0 0 0 2024-09-20T18:35:39.178 INFO:tasks.workunit.client.1.smithi172.stdout:7/381: readlink d2/d23/d51/l6b 0 2024-09-20T18:35:39.180 INFO:tasks.workunit.client.1.smithi172.stdout:8/322: dread dd/d1b/d3b/d51/d34/d39/f6c [0,4194304] 0 2024-09-20T18:35:39.181 INFO:tasks.workunit.client.1.smithi172.stdout:8/323: chown dd/d1b/d3b/d51/d34/d39/f6e 2861 1 2024-09-20T18:35:39.181 INFO:tasks.workunit.client.1.smithi172.stdout:9/291: sync 2024-09-20T18:35:39.182 INFO:tasks.workunit.client.1.smithi172.stdout:3/363: sync 2024-09-20T18:35:39.182 INFO:tasks.workunit.client.1.smithi172.stdout:5/353: sync 2024-09-20T18:35:39.182 INFO:tasks.workunit.client.1.smithi172.stdout:6/258: sync 2024-09-20T18:35:39.182 INFO:tasks.workunit.client.1.smithi172.stdout:0/432: sync 2024-09-20T18:35:39.182 INFO:tasks.workunit.client.1.smithi172.stdout:8/324: dread - dd/d1b/d3b/d51/d34/d39/f72 zero size 2024-09-20T18:35:39.183 INFO:tasks.workunit.client.1.smithi172.stdout:5/354: fdatasync d4/d1f/d26/d41/f54 0 2024-09-20T18:35:39.187 INFO:tasks.workunit.client.1.smithi172.stdout:0/433: dwrite d4/d1a/f66 [0,4194304] 0 2024-09-20T18:35:39.187 INFO:tasks.workunit.client.1.smithi172.stdout:4/279: symlink d0/d7/df/d15/d55/l6a 0 2024-09-20T18:35:39.189 INFO:tasks.workunit.client.1.smithi172.stdout:1/315: truncate d0/d8/db/f1b 3322082 0 2024-09-20T18:35:39.191 INFO:tasks.workunit.client.1.smithi172.stdout:7/382: rename d2/d3/l17 to d2/d3/d10/d40/l89 0 2024-09-20T18:35:39.193 INFO:tasks.workunit.client.1.smithi172.stdout:8/325: chown dd/d1b/f55 2855601 1 2024-09-20T18:35:39.198 INFO:tasks.workunit.client.1.smithi172.stdout:5/355: creat d4/df/d3f/f75 x:0 0 0 2024-09-20T18:35:39.199 INFO:tasks.workunit.client.1.smithi172.stdout:0/434: mknod d4/d46/c98 0 2024-09-20T18:35:39.200 INFO:tasks.workunit.client.1.smithi172.stdout:0/435: write d4/d1a/d28/d42/f4c [903103,123260] 0 2024-09-20T18:35:39.200 INFO:tasks.workunit.client.1.smithi172.stdout:2/270: truncate d0/d1a/f33 933551 0 2024-09-20T18:35:39.203 INFO:tasks.workunit.client.1.smithi172.stdout:7/383: creat d2/d3/d10/d40/d6a/f8a x:0 0 0 2024-09-20T18:35:39.205 INFO:tasks.workunit.client.1.smithi172.stdout:3/364: write d0/d13/d1e/f59 [1048710,98301] 0 2024-09-20T18:35:39.207 INFO:tasks.workunit.client.1.smithi172.stdout:4/280: rename d0/d7/df/d18/c61 to d0/d7/df/d18/d51/c6b 0 2024-09-20T18:35:39.211 INFO:tasks.workunit.client.1.smithi172.stdout:7/384: mkdir d2/d3/d3d/d4e/d8b 0 2024-09-20T18:35:39.214 INFO:tasks.workunit.client.1.smithi172.stdout:3/365: readlink d0/dc/d61/l68 0 2024-09-20T18:35:39.214 INFO:tasks.workunit.client.1.smithi172.stdout:6/259: link d0/c16 d0/d18/d1c/d21/d26/d34/d39/d46/c50 0 2024-09-20T18:35:39.216 INFO:tasks.workunit.client.1.smithi172.stdout:4/281: mknod d0/d7/df/d15/c6c 0 2024-09-20T18:35:39.216 INFO:tasks.workunit.client.1.smithi172.stdout:1/316: dwrite d0/d8/db/fe [0,4194304] 0 2024-09-20T18:35:39.220 INFO:tasks.workunit.client.1.smithi172.stdout:2/271: creat d0/d2c/d3f/d17/d18/d29/d42/d4b/d53/f5b x:0 0 0 2024-09-20T18:35:39.222 INFO:tasks.workunit.client.1.smithi172.stdout:9/292: link d15/d1a/d1e/d34/l43 d15/d1f/l5a 0 2024-09-20T18:35:39.225 INFO:tasks.workunit.client.1.smithi172.stdout:5/356: dread d4/d1f/d26/f2a [0,4194304] 0 2024-09-20T18:35:39.226 INFO:tasks.workunit.client.1.smithi172.stdout:6/260: mknod d0/c51 0 2024-09-20T18:35:39.227 INFO:tasks.workunit.client.1.smithi172.stdout:8/326: getdents dd/d1b/d3b/d5d 0 2024-09-20T18:35:39.227 INFO:tasks.workunit.client.1.smithi172.stdout:4/282: rmdir d0/d7/df/d18/d51 39 2024-09-20T18:35:39.231 INFO:tasks.workunit.client.1.smithi172.stdout:8/327: fdatasync f1 0 2024-09-20T18:35:39.231 INFO:tasks.workunit.client.1.smithi172.stdout:4/283: dread - d0/de/f4c zero size 2024-09-20T18:35:39.237 INFO:tasks.workunit.client.1.smithi172.stdout:9/293: rename lb to d15/d1f/d2c/d37/l5b 0 2024-09-20T18:35:39.239 INFO:tasks.workunit.client.1.smithi172.stdout:3/366: dread d0/f20 [0,4194304] 0 2024-09-20T18:35:39.243 INFO:tasks.workunit.client.1.smithi172.stdout:5/357: link d4/d1f/d26/f2a d4/df/d3f/d64/f76 0 2024-09-20T18:35:39.245 INFO:tasks.workunit.client.1.smithi172.stdout:0/436: dwrite d4/d5/d2e/f95 [4194304,4194304] 0 2024-09-20T18:35:39.245 INFO:tasks.workunit.client.1.smithi172.stdout:2/272: dwrite d0/d2c/d3f/d17/d22/f36 [0,4194304] 0 2024-09-20T18:35:39.247 INFO:tasks.workunit.client.1.smithi172.stdout:8/328: write dd/d1b/d3b/d51/d34/d39/f73 [860884,62715] 0 2024-09-20T18:35:39.250 INFO:tasks.workunit.client.1.smithi172.stdout:8/329: dread - dd/d65/f78 zero size 2024-09-20T18:35:39.250 INFO:tasks.workunit.client.1.smithi172.stdout:9/294: write d15/d1f/f40 [315246,109054] 0 2024-09-20T18:35:39.250 INFO:tasks.workunit.client.1.smithi172.stdout:5/358: symlink d4/d1f/l77 0 2024-09-20T18:35:39.250 INFO:tasks.workunit.client.1.smithi172.stdout:1/317: dread d0/d8/db/d25/d2b/f2d [0,4194304] 0 2024-09-20T18:35:39.251 INFO:tasks.workunit.client.1.smithi172.stdout:7/385: dread d2/f4a [0,4194304] 0 2024-09-20T18:35:39.251 INFO:tasks.workunit.client.1.smithi172.stdout:3/367: rename d0/d13/d32/d54/c69 to d0/dc/d6a/c6f 0 2024-09-20T18:35:39.303 INFO:tasks.workunit.client.1.smithi172.stdout:7/386: fdatasync d2/f3e 0 2024-09-20T18:35:39.303 INFO:tasks.workunit.client.1.smithi172.stdout:0/437: mkdir d4/d1a/d28/d42/d45/d99 0 2024-09-20T18:35:39.305 INFO:tasks.workunit.client.1.smithi172.stdout:5/359: fsync d4/df/d3f/f49 0 2024-09-20T18:35:39.307 INFO:tasks.workunit.client.1.smithi172.stdout:9/295: mknod d15/d1a/d1e/d48/c5c 0 2024-09-20T18:35:39.307 INFO:tasks.workunit.client.1.smithi172.stdout:4/284: dwrite d0/d7/df/f40 [0,4194304] 0 2024-09-20T18:35:39.307 INFO:tasks.workunit.client.1.smithi172.stdout:3/368: truncate d0/d13/f1c 4729408 0 2024-09-20T18:35:39.308 INFO:tasks.workunit.client.1.smithi172.stdout:7/387: dread d2/d1c/f67 [0,4194304] 0 2024-09-20T18:35:39.310 INFO:tasks.workunit.client.1.smithi172.stdout:0/438: fsync d4/d1a/d28/d42/f55 0 2024-09-20T18:35:39.310 INFO:tasks.workunit.client.1.smithi172.stdout:5/360: write d4/d1f/d26/d2d/d50/f20 [2520322,55339] 0 2024-09-20T18:35:39.311 INFO:tasks.workunit.client.1.smithi172.stdout:8/330: symlink dd/d1b/d3b/d5d/d7d/l7e 0 2024-09-20T18:35:39.312 INFO:tasks.workunit.client.1.smithi172.stdout:8/331: readlink dd/d1b/l46 0 2024-09-20T18:35:39.312 INFO:tasks.workunit.client.1.smithi172.stdout:9/296: write d15/d1f/f53 [4050749,7924] 0 2024-09-20T18:35:39.313 INFO:tasks.workunit.client.1.smithi172.stdout:5/361: chown d4/d1f/f57 14813025 1 2024-09-20T18:35:39.313 INFO:tasks.workunit.client.1.smithi172.stdout:1/318: truncate d0/d8/db/d25/d2b/f3f 736293 0 2024-09-20T18:35:39.314 INFO:tasks.workunit.client.1.smithi172.stdout:8/332: chown dd/c1a 622211 1 2024-09-20T18:35:39.316 INFO:tasks.workunit.client.1.smithi172.stdout:7/388: symlink d2/d3/dd/l8c 0 2024-09-20T18:35:39.319 INFO:tasks.workunit.client.1.smithi172.stdout:5/362: mknod d4/df/c78 0 2024-09-20T18:35:39.319 INFO:tasks.workunit.client.1.smithi172.stdout:9/297: dread d15/d1f/f53 [0,4194304] 0 2024-09-20T18:35:39.319 INFO:tasks.workunit.client.1.smithi172.stdout:8/333: rmdir dd/d1b/d3b 39 2024-09-20T18:35:39.323 INFO:tasks.workunit.client.1.smithi172.stdout:0/439: creat d4/d1a/d28/f9a x:0 0 0 2024-09-20T18:35:39.323 INFO:tasks.workunit.client.1.smithi172.stdout:4/285: getdents d0/d7/df/d18 0 2024-09-20T18:35:39.324 INFO:tasks.workunit.client.1.smithi172.stdout:3/369: getdents d0/d13/d1e 0 2024-09-20T18:35:39.325 INFO:tasks.workunit.client.1.smithi172.stdout:9/298: symlink d15/d1a/d1e/d34/l5d 0 2024-09-20T18:35:39.325 INFO:tasks.workunit.client.1.smithi172.stdout:8/334: readlink dd/d1b/d3b/l58 0 2024-09-20T18:35:39.325 INFO:tasks.workunit.client.1.smithi172.stdout:1/319: dwrite d0/d8/d12/f1f [0,4194304] 0 2024-09-20T18:35:39.326 INFO:tasks.workunit.client.1.smithi172.stdout:7/389: dread d2/d3/f35 [0,4194304] 0 2024-09-20T18:35:39.327 INFO:tasks.workunit.client.1.smithi172.stdout:0/440: dread - d4/d20/f91 zero size 2024-09-20T18:35:39.328 INFO:tasks.workunit.client.1.smithi172.stdout:9/299: fsync d15/d1a/d1e/d48/f4f 0 2024-09-20T18:35:39.330 INFO:tasks.workunit.client.1.smithi172.stdout:3/370: rmdir d0/dc/d61 39 2024-09-20T18:35:39.331 INFO:tasks.workunit.client.1.smithi172.stdout:9/300: truncate d15/d1f/f40 630042 0 2024-09-20T18:35:39.332 INFO:tasks.workunit.client.1.smithi172.stdout:7/390: unlink d2/d23/c55 0 2024-09-20T18:35:39.334 INFO:tasks.workunit.client.1.smithi172.stdout:8/335: rename dd/d65/f78 to dd/d65/f7f 0 2024-09-20T18:35:39.334 INFO:tasks.workunit.client.1.smithi172.stdout:8/336: stat dd/d1b/d3b/d51/f47 0 2024-09-20T18:35:39.335 INFO:tasks.workunit.client.1.smithi172.stdout:4/286: creat d0/f6d x:0 0 0 2024-09-20T18:35:39.336 INFO:tasks.workunit.client.1.smithi172.stdout:1/320: creat d0/d8/db/d25/d2b/d3d/d65/f6a x:0 0 0 2024-09-20T18:35:39.336 INFO:tasks.workunit.client.1.smithi172.stdout:8/337: chown dd/d1b/d3b/d5d/f60 171 1 2024-09-20T18:35:39.336 INFO:tasks.workunit.client.1.smithi172.stdout:8/338: stat dd/d1b/l29 0 2024-09-20T18:35:39.336 INFO:tasks.workunit.client.1.smithi172.stdout:1/321: write d0/d8/fc [3712924,35396] 0 2024-09-20T18:35:39.337 INFO:tasks.workunit.client.1.smithi172.stdout:3/371: rename d0/dc/c5f to d0/d13/d1e/c70 0 2024-09-20T18:35:39.338 INFO:tasks.workunit.client.1.smithi172.stdout:0/441: creat d4/d1a/d28/d88/f9b x:0 0 0 2024-09-20T18:35:39.338 INFO:tasks.workunit.client.1.smithi172.stdout:9/301: mknod d15/d4a/c5e 0 2024-09-20T18:35:39.339 INFO:tasks.workunit.client.1.smithi172.stdout:7/391: creat d2/d3/d86/f8d x:0 0 0 2024-09-20T18:35:39.340 INFO:tasks.workunit.client.1.smithi172.stdout:3/372: write d0/dc/d6a/d3a/f4b [828456,4779] 0 2024-09-20T18:35:39.341 INFO:tasks.workunit.client.1.smithi172.stdout:6/261: sync 2024-09-20T18:35:39.341 INFO:tasks.workunit.client.1.smithi172.stdout:7/392: chown d2/d3/l52 10 1 2024-09-20T18:35:39.341 INFO:tasks.workunit.client.1.smithi172.stdout:5/363: dread d4/df/d3f/f49 [0,4194304] 0 2024-09-20T18:35:39.342 INFO:tasks.workunit.client.1.smithi172.stdout:7/393: chown c1 0 1 2024-09-20T18:35:39.343 INFO:tasks.workunit.client.1.smithi172.stdout:1/322: unlink d0/d8/l1e 0 2024-09-20T18:35:39.344 INFO:tasks.workunit.client.1.smithi172.stdout:9/302: rmdir d15/d4a 39 2024-09-20T18:35:39.347 INFO:tasks.workunit.client.1.smithi172.stdout:3/373: dwrite d0/dc/d6a/f50 [0,4194304] 0 2024-09-20T18:35:39.349 INFO:tasks.workunit.client.1.smithi172.stdout:3/374: write d0/dc/d6a/f3e [4570633,85909] 0 2024-09-20T18:35:39.350 INFO:tasks.workunit.client.1.smithi172.stdout:3/375: write d0/f16 [607398,103127] 0 2024-09-20T18:35:39.353 INFO:tasks.workunit.client.1.smithi172.stdout:7/394: rename d2/d1c to d2/d3/d10/d40/d46/d8e 0 2024-09-20T18:35:39.357 INFO:tasks.workunit.client.1.smithi172.stdout:8/339: write dd/d1b/f2c [1923009,24366] 0 2024-09-20T18:35:39.357 INFO:tasks.workunit.client.1.smithi172.stdout:6/262: symlink d0/d18/l52 0 2024-09-20T18:35:39.360 INFO:tasks.workunit.client.1.smithi172.stdout:9/303: fsync d15/d4a/f55 0 2024-09-20T18:35:39.360 INFO:tasks.workunit.client.1.smithi172.stdout:0/442: link d4/d20/c3f d4/d1d/d15/c9c 0 2024-09-20T18:35:39.361 INFO:tasks.workunit.client.1.smithi172.stdout:6/263: chown d0/d18/d1c/d21/d26/d34/d39/d46/l32 101435700 1 2024-09-20T18:35:39.361 INFO:tasks.workunit.client.1.smithi172.stdout:4/287: mknod d0/d7/df/d15/d55/d53/d5c/c6e 0 2024-09-20T18:35:39.364 INFO:tasks.workunit.client.1.smithi172.stdout:1/323: getdents d0/d22 0 2024-09-20T18:35:39.365 INFO:tasks.workunit.client.1.smithi172.stdout:0/443: write d4/d5/f6a [789103,27823] 0 2024-09-20T18:35:39.365 INFO:tasks.workunit.client.1.smithi172.stdout:7/395: getdents d2/d23/d3a 0 2024-09-20T18:35:39.366 INFO:tasks.workunit.client.1.smithi172.stdout:6/264: mknod d0/d18/c53 0 2024-09-20T18:35:39.367 INFO:tasks.workunit.client.1.smithi172.stdout:9/304: rename d15/d1a to d15/d1a/d5f 22 2024-09-20T18:35:39.367 INFO:tasks.workunit.client.1.smithi172.stdout:4/288: write d0/de/d21/f2b [2518472,84007] 0 2024-09-20T18:35:39.368 INFO:tasks.workunit.client.1.smithi172.stdout:8/340: dwrite dd/d1b/d3b/d51/d34/d39/f6a [0,4194304] 0 2024-09-20T18:35:39.368 INFO:tasks.workunit.client.1.smithi172.stdout:7/396: stat d2/d23/d3a/l64 0 2024-09-20T18:35:39.369 INFO:tasks.workunit.client.1.smithi172.stdout:1/324: chown d0/d8/db/d25/d2b/d3d 190147 1 2024-09-20T18:35:39.369 INFO:tasks.workunit.client.1.smithi172.stdout:3/376: truncate d0/dc/f2e 2472102 0 2024-09-20T18:35:39.371 INFO:tasks.workunit.client.1.smithi172.stdout:4/289: truncate d0/f6d 803097 0 2024-09-20T18:35:39.372 INFO:tasks.workunit.client.1.smithi172.stdout:7/397: chown d2/d23/c38 75466 1 2024-09-20T18:35:39.374 INFO:tasks.workunit.client.1.smithi172.stdout:9/305: rename d15/d1f/f40 to d15/d54/f60 0 2024-09-20T18:35:39.375 INFO:tasks.workunit.client.1.smithi172.stdout:6/265: creat d0/d18/f54 x:0 0 0 2024-09-20T18:35:39.376 INFO:tasks.workunit.client.1.smithi172.stdout:7/398: chown d2/d3/d10/d40/f7c 3277560 1 2024-09-20T18:35:39.377 INFO:tasks.workunit.client.1.smithi172.stdout:6/266: readlink d0/d18/l4b 0 2024-09-20T18:35:39.378 INFO:tasks.workunit.client.1.smithi172.stdout:9/306: readlink l11 0 2024-09-20T18:35:39.379 INFO:tasks.workunit.client.1.smithi172.stdout:4/290: mkdir d0/d7/d6f 0 2024-09-20T18:35:39.379 INFO:tasks.workunit.client.1.smithi172.stdout:7/399: stat d2/d3/d10/c26 0 2024-09-20T18:35:39.380 INFO:tasks.workunit.client.1.smithi172.stdout:8/341: dwrite dd/f19 [0,4194304] 0 2024-09-20T18:35:39.381 INFO:tasks.workunit.client.1.smithi172.stdout:4/291: chown d0/de/f5a 1344 1 2024-09-20T18:35:39.384 INFO:tasks.workunit.client.1.smithi172.stdout:9/307: unlink d15/d1a/f50 0 2024-09-20T18:35:39.388 INFO:tasks.workunit.client.1.smithi172.stdout:8/342: fdatasync dd/d1b/f23 0 2024-09-20T18:35:39.389 INFO:tasks.workunit.client.1.smithi172.stdout:6/267: mknod d0/d18/d1c/d21/d26/d34/d39/d46/c55 0 2024-09-20T18:35:39.390 INFO:tasks.workunit.client.1.smithi172.stdout:1/325: link d0/c40 d0/d8/db/d25/c6b 0 2024-09-20T18:35:39.391 INFO:tasks.workunit.client.1.smithi172.stdout:0/444: truncate d4/d1a/d28/d75/f43 4576100 0 2024-09-20T18:35:39.392 INFO:tasks.workunit.client.1.smithi172.stdout:3/377: write d0/dc/f2b [3278258,2183] 0 2024-09-20T18:35:39.406 INFO:tasks.workunit.client.1.smithi172.stdout:6/268: creat d0/d18/d1c/d21/f56 x:0 0 0 2024-09-20T18:35:39.407 INFO:tasks.workunit.client.1.smithi172.stdout:7/400: rmdir d2/d23/d3c/d56 0 2024-09-20T18:35:39.407 INFO:tasks.workunit.client.1.smithi172.stdout:3/378: truncate d0/dc/d6a/f5b 341743 0 2024-09-20T18:35:39.408 INFO:tasks.workunit.client.1.smithi172.stdout:8/343: link dd/d1b/d3b/d51/d34/d39/f6c dd/d1b/d4f/f80 0 2024-09-20T18:35:39.410 INFO:tasks.workunit.client.1.smithi172.stdout:9/308: getdents d15/d20 0 2024-09-20T18:35:39.413 INFO:tasks.workunit.client.1.smithi172.stdout:0/445: dwrite d4/d5/f2f [0,4194304] 0 2024-09-20T18:35:39.419 INFO:tasks.workunit.client.1.smithi172.stdout:1/326: dwrite d0/d8/db/f33 [0,4194304] 0 2024-09-20T18:35:39.419 INFO:tasks.workunit.client.1.smithi172.stdout:7/401: getdents d2/d23/d51 0 2024-09-20T18:35:39.420 INFO:tasks.workunit.client.1.smithi172.stdout:9/309: getdents d15/d1a/d1e/d58 0 2024-09-20T18:35:39.421 INFO:tasks.workunit.client.1.smithi172.stdout:6/269: dwrite d0/d18/f2b [0,4194304] 0 2024-09-20T18:35:39.422 INFO:tasks.workunit.client.1.smithi172.stdout:9/310: dread - d15/d1f/d2c/d37/f44 zero size 2024-09-20T18:35:39.422 INFO:tasks.workunit.client.1.smithi172.stdout:8/344: creat dd/d1b/d3b/d51/f81 x:0 0 0 2024-09-20T18:35:39.424 INFO:tasks.workunit.client.1.smithi172.stdout:0/446: write d4/d44/f61 [1648619,14810] 0 2024-09-20T18:35:39.425 INFO:tasks.workunit.client.1.smithi172.stdout:7/402: truncate d2/d3/d3d/f7f 454047 0 2024-09-20T18:35:39.426 INFO:tasks.workunit.client.1.smithi172.stdout:8/345: rmdir dd/d65 39 2024-09-20T18:35:39.428 INFO:tasks.workunit.client.1.smithi172.stdout:0/447: dread d4/d1a/d28/d75/f3a [0,4194304] 0 2024-09-20T18:35:39.430 INFO:tasks.workunit.client.1.smithi172.stdout:1/327: link d0/d22/l4e d0/d8/db/d39/l6c 0 2024-09-20T18:35:39.432 INFO:tasks.workunit.client.1.smithi172.stdout:0/448: truncate d4/f7e 824894 0 2024-09-20T18:35:39.433 INFO:tasks.workunit.client.1.smithi172.stdout:6/270: dread d0/d18/d1c/d22/d27/f2f [0,4194304] 0 2024-09-20T18:35:39.434 INFO:tasks.workunit.client.1.smithi172.stdout:9/311: rename l13 to d15/d1a/d1e/d48/l61 0 2024-09-20T18:35:39.435 INFO:tasks.workunit.client.1.smithi172.stdout:8/346: dread dd/d1b/d3b/d51/f35 [0,4194304] 0 2024-09-20T18:35:39.435 INFO:tasks.workunit.client.1.smithi172.stdout:9/312: chown f14 235931421 1 2024-09-20T18:35:39.436 INFO:tasks.workunit.client.1.smithi172.stdout:1/328: mkdir d0/d8/db/d25/d6d 0 2024-09-20T18:35:39.436 INFO:tasks.workunit.client.1.smithi172.stdout:1/329: readlink d0/d22/l5c 0 2024-09-20T18:35:39.436 INFO:tasks.workunit.client.1.smithi172.stdout:0/449: mkdir d4/d1a/d28/d9d 0 2024-09-20T18:35:39.440 INFO:tasks.workunit.client.1.smithi172.stdout:9/313: creat d15/d1f/f62 x:0 0 0 2024-09-20T18:35:39.440 INFO:tasks.workunit.client.1.smithi172.stdout:6/271: link d0/d18/d1c/d22/d47/c48 d0/d18/d1c/d21/d26/d34/d39/d46/c57 0 2024-09-20T18:35:39.441 INFO:tasks.workunit.client.1.smithi172.stdout:6/272: fdatasync d0/f5 0 2024-09-20T18:35:39.443 INFO:tasks.workunit.client.1.smithi172.stdout:0/450: creat d4/d5/d2e/d67/f9e x:0 0 0 2024-09-20T18:35:39.444 INFO:tasks.workunit.client.1.smithi172.stdout:8/347: dwrite dd/f27 [4194304,4194304] 0 2024-09-20T18:35:39.446 INFO:tasks.workunit.client.1.smithi172.stdout:7/403: write d2/d3/dd/f19 [1238334,122714] 0 2024-09-20T18:35:39.446 INFO:tasks.workunit.client.1.smithi172.stdout:2/273: sync 2024-09-20T18:35:39.448 INFO:tasks.workunit.client.1.smithi172.stdout:7/404: write d2/d3/dd/f42 [4403268,16754] 0 2024-09-20T18:35:39.449 INFO:tasks.workunit.client.1.smithi172.stdout:6/273: rename d0/d18/d1c/d22/d27/d35/c3c to d0/d18/d1c/c58 0 2024-09-20T18:35:39.451 INFO:tasks.workunit.client.1.smithi172.stdout:8/348: read dd/f27 [1312625,60605] 0 2024-09-20T18:35:39.454 INFO:tasks.workunit.client.1.smithi172.stdout:7/405: creat d2/d3/d10/d40/d6a/f8f x:0 0 0 2024-09-20T18:35:39.456 INFO:tasks.workunit.client.1.smithi172.stdout:7/406: chown d2/d3/l52 17217 1 2024-09-20T18:35:39.460 INFO:tasks.workunit.client.1.smithi172.stdout:2/274: link d0/d2c/d3f/f46 d0/d4e/d59/f5c 0 2024-09-20T18:35:39.460 INFO:tasks.workunit.client.1.smithi172.stdout:6/274: dwrite d0/d18/d1c/d21/d26/f45 [4194304,4194304] 0 2024-09-20T18:35:39.461 INFO:tasks.workunit.client.1.smithi172.stdout:7/407: truncate d2/d3/d10/d40/f7c 527401 0 2024-09-20T18:35:39.463 INFO:tasks.workunit.client.1.smithi172.stdout:8/349: creat dd/d1b/d3b/d51/f82 x:0 0 0 2024-09-20T18:35:39.464 INFO:tasks.workunit.client.1.smithi172.stdout:2/275: chown d0/d1a/f20 6932965 1 2024-09-20T18:35:39.465 INFO:tasks.workunit.client.1.smithi172.stdout:7/408: stat d2/d3/d10/d40 0 2024-09-20T18:35:39.466 INFO:tasks.workunit.client.1.smithi172.stdout:6/275: dread - d0/d18/d1c/d21/d26/f3b zero size 2024-09-20T18:35:39.466 INFO:tasks.workunit.client.1.smithi172.stdout:9/314: dread d15/d20/f21 [0,4194304] 0 2024-09-20T18:35:39.469 INFO:tasks.workunit.client.1.smithi172.stdout:1/330: dwrite d0/d8/db/d25/d2b/f3f [0,4194304] 0 2024-09-20T18:35:39.471 INFO:tasks.workunit.client.1.smithi172.stdout:6/276: write d0/d18/d1c/d21/d26/f3b [254143,110638] 0 2024-09-20T18:35:39.472 INFO:tasks.workunit.client.1.smithi172.stdout:8/350: truncate dd/d1b/f2f 1683430 0 2024-09-20T18:35:39.472 INFO:tasks.workunit.client.1.smithi172.stdout:2/276: mkdir d0/d2c/d3f/d17/d22/d10/d35/d5d 0 2024-09-20T18:35:39.473 INFO:tasks.workunit.client.1.smithi172.stdout:2/277: stat d0/d1a 0 2024-09-20T18:35:39.475 INFO:tasks.workunit.client.1.smithi172.stdout:6/277: write d0/d18/d1c/d21/d26/d34/f3e [5112687,106453] 0 2024-09-20T18:35:39.476 INFO:tasks.workunit.client.1.smithi172.stdout:2/278: chown d0/d2c/d3f/d17/d22 81210 1 2024-09-20T18:35:39.476 INFO:tasks.workunit.client.1.smithi172.stdout:1/331: creat d0/d8/d5f/f6e x:0 0 0 2024-09-20T18:35:39.478 INFO:tasks.workunit.client.1.smithi172.stdout:2/279: dread - d0/d2c/d3f/d17/d22/d4c/f4d zero size 2024-09-20T18:35:39.480 INFO:tasks.workunit.client.1.smithi172.stdout:9/315: truncate d15/d1a/d1e/d24/f2e 3535187 0 2024-09-20T18:35:39.480 INFO:tasks.workunit.client.1.smithi172.stdout:7/409: link d2/d23/c33 d2/d3/d3d/d4e/d5f/c90 0 2024-09-20T18:35:39.485 INFO:tasks.workunit.client.1.smithi172.stdout:8/351: rename dd/d1b/d3b/d51/d34/d39/f4e to dd/d1b/d3b/d51/d34/d39/f83 0 2024-09-20T18:35:39.485 INFO:tasks.workunit.client.1.smithi172.stdout:1/332: rmdir d0 39 2024-09-20T18:35:39.485 INFO:tasks.workunit.client.1.smithi172.stdout:6/278: rename d0/c51 to d0/d18/d1c/d22/d27/c59 0 2024-09-20T18:35:39.486 INFO:tasks.workunit.client.1.smithi172.stdout:6/279: read - d0/f4a zero size 2024-09-20T18:35:39.487 INFO:tasks.workunit.client.1.smithi172.stdout:6/280: write d0/d18/d1c/d22/d27/d35/f4f [48324,55995] 0 2024-09-20T18:35:39.487 INFO:tasks.workunit.client.1.smithi172.stdout:9/316: creat d15/d1f/d2c/d37/f63 x:0 0 0 2024-09-20T18:35:39.491 INFO:tasks.workunit.client.1.smithi172.stdout:2/280: rename d0/d2c/d3f/d17/d18/d29/d42/f52 to d0/d2c/d3f/d17/d22/d4c/f5e 0 2024-09-20T18:35:39.493 INFO:tasks.workunit.client.1.smithi172.stdout:6/281: dwrite d0/f36 [0,4194304] 0 2024-09-20T18:35:39.493 INFO:tasks.workunit.client.1.smithi172.stdout:1/333: rmdir d0/d8/db/d39 39 2024-09-20T18:35:39.495 INFO:tasks.workunit.client.1.smithi172.stdout:1/334: write d0/d8/f2c [2117513,126480] 0 2024-09-20T18:35:39.496 INFO:tasks.workunit.client.1.smithi172.stdout:9/317: mkdir d15/d1a/d64 0 2024-09-20T18:35:39.497 INFO:tasks.workunit.client.1.smithi172.stdout:8/352: creat dd/d1b/d3b/d51/d34/f84 x:0 0 0 2024-09-20T18:35:39.498 INFO:tasks.workunit.client.1.smithi172.stdout:8/353: dread - dd/d1b/d3b/d51/f81 zero size 2024-09-20T18:35:39.500 INFO:tasks.workunit.client.1.smithi172.stdout:7/410: rename d2/d3/dd/f49 to d2/f91 0 2024-09-20T18:35:39.502 INFO:tasks.workunit.client.1.smithi172.stdout:6/282: fdatasync d0/d18/d1c/d21/d26/d34/d39/d46/f2a 0 2024-09-20T18:35:39.502 INFO:tasks.workunit.client.1.smithi172.stdout:8/354: dread dd/f19 [0,4194304] 0 2024-09-20T18:35:39.504 INFO:tasks.workunit.client.1.smithi172.stdout:8/355: dread - dd/d1b/f33 zero size 2024-09-20T18:35:39.508 INFO:tasks.workunit.client.1.smithi172.stdout:7/411: write d2/d3/d10/f2c [298204,9305] 0 2024-09-20T18:35:39.510 INFO:tasks.workunit.client.1.smithi172.stdout:6/283: unlink d0/d18/l4b 0 2024-09-20T18:35:39.510 INFO:tasks.workunit.client.1.smithi172.stdout:9/318: symlink d15/d1a/l65 0 2024-09-20T18:35:39.512 INFO:tasks.workunit.client.1.smithi172.stdout:7/412: mkdir d2/d3/d3d/d4e/d92 0 2024-09-20T18:35:39.512 INFO:tasks.workunit.client.1.smithi172.stdout:2/281: dread d0/d2c/f3e [0,4194304] 0 2024-09-20T18:35:39.513 INFO:tasks.workunit.client.1.smithi172.stdout:8/356: mkdir dd/d65/d85 0 2024-09-20T18:35:39.513 INFO:tasks.workunit.client.1.smithi172.stdout:9/319: write d15/d1f/d2c/d37/f63 [32243,89426] 0 2024-09-20T18:35:39.514 INFO:tasks.workunit.client.1.smithi172.stdout:7/413: chown d2/d23/d3c 55793832 1 2024-09-20T18:35:39.514 INFO:tasks.workunit.client.1.smithi172.stdout:6/284: unlink d0/d18/d1c/d21/d26/f3b 0 2024-09-20T18:35:39.514 INFO:tasks.workunit.client.1.smithi172.stdout:2/282: stat d0/d2c/d3f/d17/d45 0 2024-09-20T18:35:39.515 INFO:tasks.workunit.client.1.smithi172.stdout:9/320: chown d15/d1a/d1e/d34/l5d 33501 1 2024-09-20T18:35:39.515 INFO:tasks.workunit.client.1.smithi172.stdout:8/357: stat dd/d1b/d3b/d51/l56 0 2024-09-20T18:35:39.516 INFO:tasks.workunit.client.1.smithi172.stdout:9/321: write d15/d1a/f26 [461273,136] 0 2024-09-20T18:35:39.517 INFO:tasks.workunit.client.1.smithi172.stdout:7/414: mknod d2/d3/d3d/d4e/d92/c93 0 2024-09-20T18:35:39.518 INFO:tasks.workunit.client.1.smithi172.stdout:9/322: truncate d15/d1a/d1e/d34/f3b 706929 0 2024-09-20T18:35:39.518 INFO:tasks.workunit.client.1.smithi172.stdout:6/285: rename d0/l40 to d0/d18/l5a 0 2024-09-20T18:35:39.519 INFO:tasks.workunit.client.1.smithi172.stdout:6/286: readlink d0/d18/l52 0 2024-09-20T18:35:39.520 INFO:tasks.workunit.client.1.smithi172.stdout:2/283: read d0/d2c/d3f/d17/d18/d29/f41 [91604,117003] 0 2024-09-20T18:35:39.521 INFO:tasks.workunit.client.1.smithi172.stdout:7/415: getdents d2/d3/d3d/d4e/d8b 0 2024-09-20T18:35:39.521 INFO:tasks.workunit.client.1.smithi172.stdout:2/284: fdatasync d0/d2c/d3f/d17/d22/d4c/f4d 0 2024-09-20T18:35:39.523 INFO:tasks.workunit.client.1.smithi172.stdout:7/416: rmdir d2/d3/d10/d40 39 2024-09-20T18:35:39.524 INFO:tasks.workunit.client.1.smithi172.stdout:8/358: getdents dd/d1b/d4f 0 2024-09-20T18:35:39.526 INFO:tasks.workunit.client.1.smithi172.stdout:8/359: mkdir dd/d1b/d4f/d86 0 2024-09-20T18:35:39.528 INFO:tasks.workunit.client.1.smithi172.stdout:2/285: getdents d0/d2c/d3f 0 2024-09-20T18:35:39.529 INFO:tasks.workunit.client.1.smithi172.stdout:6/287: dwrite d0/fc [0,4194304] 0 2024-09-20T18:35:39.530 INFO:tasks.workunit.client.1.smithi172.stdout:6/288: stat d0 0 2024-09-20T18:35:39.532 INFO:tasks.workunit.client.1.smithi172.stdout:6/289: truncate d0/f4a 212681 0 2024-09-20T18:35:39.532 INFO:tasks.workunit.client.1.smithi172.stdout:7/417: dwrite d2/d3/d10/f2c [0,4194304] 0 2024-09-20T18:35:39.537 INFO:tasks.workunit.client.1.smithi172.stdout:9/323: dread d15/d4a/f55 [0,4194304] 0 2024-09-20T18:35:39.538 INFO:tasks.workunit.client.1.smithi172.stdout:7/418: mknod d2/d23/d3a/c94 0 2024-09-20T18:35:39.540 INFO:tasks.workunit.client.1.smithi172.stdout:2/286: link d0/d2c/d3f/f26 d0/d2c/d3f/d17/d22/d10/d35/d5d/f5f 0 2024-09-20T18:35:39.544 INFO:tasks.workunit.client.1.smithi172.stdout:6/290: dwrite d0/d18/d1c/d22/f2e [0,4194304] 0 2024-09-20T18:35:39.544 INFO:tasks.workunit.client.1.smithi172.stdout:9/324: creat d15/d1a/d1e/d48/f66 x:0 0 0 2024-09-20T18:35:39.548 INFO:tasks.workunit.client.1.smithi172.stdout:9/325: chown d15/d1f/d2c/d37/f3c 3104 1 2024-09-20T18:35:39.550 INFO:tasks.workunit.client.1.smithi172.stdout:7/419: dwrite d2/d23/d3a/f88 [0,4194304] 0 2024-09-20T18:35:39.552 INFO:tasks.workunit.client.1.smithi172.stdout:5/364: sync 2024-09-20T18:35:39.556 INFO:tasks.workunit.client.1.smithi172.stdout:9/326: link d15/d1a/d1e/d24/f3e d15/d1a/d1e/f67 0 2024-09-20T18:35:39.559 INFO:tasks.workunit.client.1.smithi172.stdout:5/365: dwrite d4/df/d3f/f61 [0,4194304] 0 2024-09-20T18:35:39.560 INFO:tasks.workunit.client.1.smithi172.stdout:7/420: mknod d2/d3/d10/d40/d46/d8e/c95 0 2024-09-20T18:35:39.564 INFO:tasks.workunit.client.1.smithi172.stdout:5/366: stat d4/d1f/d26/d2d/c3a 0 2024-09-20T18:35:39.567 INFO:tasks.workunit.client.1.smithi172.stdout:9/327: dwrite d15/d1a/d1e/f2a [0,4194304] 0 2024-09-20T18:35:39.568 INFO:tasks.workunit.client.1.smithi172.stdout:7/421: creat d2/d3/d10/f96 x:0 0 0 2024-09-20T18:35:39.569 INFO:tasks.workunit.client.1.smithi172.stdout:7/422: dread - d2/d3/d10/d40/d46/d8e/f6f zero size 2024-09-20T18:35:39.572 INFO:tasks.workunit.client.1.smithi172.stdout:7/423: fsync d2/d3/dd/f7e 0 2024-09-20T18:35:39.572 INFO:tasks.workunit.client.1.smithi172.stdout:9/328: chown d15/d1a/d1e/l51 1 1 2024-09-20T18:35:39.574 INFO:tasks.workunit.client.1.smithi172.stdout:6/291: getdents d0 0 2024-09-20T18:35:39.574 INFO:tasks.workunit.client.1.smithi172.stdout:9/329: write d15/d1a/d1e/d48/f4f [1670124,45469] 0 2024-09-20T18:35:39.580 INFO:tasks.workunit.client.1.smithi172.stdout:7/424: symlink d2/d3/d86/l97 0 2024-09-20T18:35:39.581 INFO:tasks.workunit.client.1.smithi172.stdout:7/425: chown d2/d23/d51/f59 2 1 2024-09-20T18:35:39.581 INFO:tasks.workunit.client.1.smithi172.stdout:9/330: mknod d15/d4a/c68 0 2024-09-20T18:35:39.581 INFO:tasks.workunit.client.1.smithi172.stdout:6/292: dwrite d0/d18/d1c/d21/d26/d34/d39/d46/f7 [0,4194304] 0 2024-09-20T18:35:39.583 INFO:tasks.workunit.client.1.smithi172.stdout:9/331: stat d15/d1a/d1e/d24/f3e 0 2024-09-20T18:35:39.583 INFO:tasks.workunit.client.1.smithi172.stdout:7/426: write d2/d3/d10/f96 [356025,68766] 0 2024-09-20T18:35:39.584 INFO:tasks.workunit.client.1.smithi172.stdout:2/287: write d0/f39 [149451,86635] 0 2024-09-20T18:35:39.586 INFO:tasks.workunit.client.1.smithi172.stdout:6/293: mknod d0/d18/d1c/d21/d26/d34/c5b 0 2024-09-20T18:35:39.593 INFO:tasks.workunit.client.1.smithi172.stdout:7/427: rename d2/d23/d51/l6b to d2/d3/d3d/d4e/l98 0 2024-09-20T18:35:39.599 INFO:tasks.workunit.client.1.smithi172.stdout:2/288: mkdir d0/d60 0 2024-09-20T18:35:39.602 INFO:tasks.workunit.client.1.smithi172.stdout:7/428: truncate d2/f39 628447 0 2024-09-20T18:35:39.603 INFO:tasks.workunit.client.1.smithi172.stdout:7/429: readlink d2/d3/d10/d40/d46/l5b 0 2024-09-20T18:35:39.604 INFO:tasks.workunit.client.1.smithi172.stdout:2/289: dwrite d0/d2c/d3f/d17/d22/f36 [0,4194304] 0 2024-09-20T18:35:39.604 INFO:tasks.workunit.client.1.smithi172.stdout:7/430: truncate d2/d3/d3d/d4e/f5d 753549 0 2024-09-20T18:35:39.606 INFO:tasks.workunit.client.1.smithi172.stdout:9/332: creat d15/d1f/f69 x:0 0 0 2024-09-20T18:35:39.613 INFO:tasks.workunit.client.1.smithi172.stdout:2/290: mkdir d0/d2c/d51/d61 0 2024-09-20T18:35:39.614 INFO:tasks.workunit.client.1.smithi172.stdout:9/333: creat d15/d54/f6a x:0 0 0 2024-09-20T18:35:39.617 INFO:tasks.workunit.client.1.smithi172.stdout:7/431: symlink d2/d3/d10/l99 0 2024-09-20T18:35:39.619 INFO:tasks.workunit.client.1.smithi172.stdout:2/291: mknod d0/d2c/d51/c62 0 2024-09-20T18:35:39.622 INFO:tasks.workunit.client.1.smithi172.stdout:7/432: dread d2/d3/d86/d6e/f79 [0,4194304] 0 2024-09-20T18:35:39.623 INFO:tasks.workunit.client.1.smithi172.stdout:5/367: truncate d4/d1f/d26/d2d/d50/f25 1559085 0 2024-09-20T18:35:39.625 INFO:tasks.workunit.client.1.smithi172.stdout:5/368: read d4/d1f/d26/d2d/d50/f1e [605016,102684] 0 2024-09-20T18:35:39.626 INFO:tasks.workunit.client.1.smithi172.stdout:9/334: symlink d15/d1a/l6b 0 2024-09-20T18:35:39.628 INFO:tasks.workunit.client.1.smithi172.stdout:7/433: mknod d2/d3/d3d/d4e/d92/c9a 0 2024-09-20T18:35:39.630 INFO:tasks.workunit.client.1.smithi172.stdout:5/369: dwrite d4/d1f/d26/f32 [0,4194304] 0 2024-09-20T18:35:39.630 INFO:tasks.workunit.client.1.smithi172.stdout:5/370: chown d4/f62 30660 1 2024-09-20T18:35:39.633 INFO:tasks.workunit.client.1.smithi172.stdout:2/292: link d0/d2c/d3f/d17/d18/d29/f57 d0/d2c/f63 0 2024-09-20T18:35:39.644 INFO:tasks.workunit.client.1.smithi172.stdout:5/371: mknod d4/d1f/d26/d41/c79 0 2024-09-20T18:35:39.645 INFO:tasks.workunit.client.1.smithi172.stdout:6/294: write d0/d18/f29 [1428926,87404] 0 2024-09-20T18:35:39.653 INFO:tasks.workunit.client.1.smithi172.stdout:4/292: sync 2024-09-20T18:35:39.656 INFO:tasks.workunit.client.1.smithi172.stdout:2/293: creat d0/d2c/d3f/d17/d22/d10/d35/d5d/f64 x:0 0 0 2024-09-20T18:35:39.658 INFO:tasks.workunit.client.1.smithi172.stdout:6/295: symlink d0/d18/d1c/l5c 0 2024-09-20T18:35:39.660 INFO:tasks.workunit.client.1.smithi172.stdout:6/296: truncate d0/d18/f1e 4754786 0 2024-09-20T18:35:39.660 INFO:tasks.workunit.client.1.smithi172.stdout:5/372: dwrite d4/d1f/d26/d2d/d50/f1e [0,4194304] 0 2024-09-20T18:35:39.660 INFO:tasks.workunit.client.1.smithi172.stdout:6/297: fsync d0/d18/f2b 0 2024-09-20T18:35:39.662 INFO:tasks.workunit.client.1.smithi172.stdout:2/294: mknod d0/d2c/d3f/d17/d22/c65 0 2024-09-20T18:35:39.663 INFO:tasks.workunit.client.1.smithi172.stdout:2/295: write d0/d2c/d3f/f46 [986434,35946] 0 2024-09-20T18:35:39.665 INFO:tasks.workunit.client.1.smithi172.stdout:2/296: fdatasync d0/d2c/d3f/d17/d22/d4c/f4d 0 2024-09-20T18:35:39.667 INFO:tasks.workunit.client.1.smithi172.stdout:2/297: write d0/d2c/d3f/d17/d18/d29/d42/d4b/d53/f5b [673946,15519] 0 2024-09-20T18:35:39.667 INFO:tasks.workunit.client.1.smithi172.stdout:5/373: mknod d4/df/c7a 0 2024-09-20T18:35:39.668 INFO:tasks.workunit.client.1.smithi172.stdout:2/298: fdatasync d0/d2c/d3f/d17/d22/f36 0 2024-09-20T18:35:39.668 INFO:tasks.workunit.client.1.smithi172.stdout:5/374: dread - d4/d1f/f51 zero size 2024-09-20T18:35:39.669 INFO:tasks.workunit.client.1.smithi172.stdout:2/299: fdatasync d0/d4e/d59/f5c 0 2024-09-20T18:35:39.670 INFO:tasks.workunit.client.1.smithi172.stdout:6/298: mknod d0/d18/d1c/d21/c5d 0 2024-09-20T18:35:39.673 INFO:tasks.workunit.client.1.smithi172.stdout:4/293: link d0/d7/f62 d0/d7/df/f70 0 2024-09-20T18:35:39.676 INFO:tasks.workunit.client.1.smithi172.stdout:6/299: dwrite d0/d18/d1c/d22/f2e [0,4194304] 0 2024-09-20T18:35:39.676 INFO:tasks.workunit.client.1.smithi172.stdout:4/294: truncate d0/d7/df/d15/d55/f3e 586116 0 2024-09-20T18:35:39.681 INFO:tasks.workunit.client.1.smithi172.stdout:2/300: link d0/d4e/d59/f5c d0/d60/f66 0 2024-09-20T18:35:39.683 INFO:tasks.workunit.client.1.smithi172.stdout:4/295: truncate d0/fa 1637615 0 2024-09-20T18:35:39.684 INFO:tasks.workunit.client.1.smithi172.stdout:2/301: write d0/d4e/f50 [799530,19009] 0 2024-09-20T18:35:39.684 INFO:tasks.workunit.client.1.smithi172.stdout:9/335: truncate f14 3437487 0 2024-09-20T18:35:39.685 INFO:tasks.workunit.client.1.smithi172.stdout:7/434: dwrite d2/d23/f66 [0,4194304] 0 2024-09-20T18:35:39.686 INFO:tasks.workunit.client.1.smithi172.stdout:2/302: fsync d0/d2c/d3f/f4a 0 2024-09-20T18:35:39.688 INFO:tasks.workunit.client.1.smithi172.stdout:7/435: truncate d2/d3/d10/f96 792044 0 2024-09-20T18:35:39.691 INFO:tasks.workunit.client.1.smithi172.stdout:9/336: symlink d15/d1a/d1e/d24/l6c 0 2024-09-20T18:35:39.699 INFO:tasks.workunit.client.1.smithi172.stdout:4/296: creat d0/f71 x:0 0 0 2024-09-20T18:35:39.699 INFO:tasks.workunit.client.1.smithi172.stdout:4/297: stat d0/de/d21/f2b 0 2024-09-20T18:35:39.700 INFO:tasks.workunit.client.1.smithi172.stdout:7/436: mkdir d2/d23/d3a/d72/d9b 0 2024-09-20T18:35:39.700 INFO:tasks.workunit.client.1.smithi172.stdout:4/298: truncate d0/de/d21/f2b 5114987 0 2024-09-20T18:35:39.701 INFO:tasks.workunit.client.1.smithi172.stdout:2/303: truncate d0/d2c/d3f/d17/d22/d10/d35/d5d/f5f 5791658 0 2024-09-20T18:35:39.703 INFO:tasks.workunit.client.1.smithi172.stdout:2/304: truncate d0/d2c/d3f/d17/d18/d29/f57 257377 0 2024-09-20T18:35:39.706 INFO:tasks.workunit.client.1.smithi172.stdout:7/437: creat d2/d3/d3d/d4e/d5f/f9c x:0 0 0 2024-09-20T18:35:39.707 INFO:tasks.workunit.client.1.smithi172.stdout:4/299: rename d0/d7/df to d0/de/d21/d24/d34/d72 0 2024-09-20T18:35:39.708 INFO:tasks.workunit.client.1.smithi172.stdout:7/438: dread d2/d3/d10/f96 [0,4194304] 0 2024-09-20T18:35:39.709 INFO:tasks.workunit.client.1.smithi172.stdout:7/439: stat d2/d23/f30 0 2024-09-20T18:35:39.709 INFO:tasks.workunit.client.1.smithi172.stdout:4/300: write d0/de/d21/d24/d34/d72/f40 [3476437,22494] 0 2024-09-20T18:35:39.710 INFO:tasks.workunit.client.1.smithi172.stdout:7/440: chown d2/d23/d3a/l63 283841757 1 2024-09-20T18:35:39.713 INFO:tasks.workunit.client.1.smithi172.stdout:2/305: creat d0/d2c/d51/d61/f67 x:0 0 0 2024-09-20T18:35:39.718 INFO:tasks.workunit.client.1.smithi172.stdout:4/301: creat d0/de/d39/f73 x:0 0 0 2024-09-20T18:35:39.718 INFO:tasks.workunit.client.1.smithi172.stdout:4/302: readlink d0/de/lb 0 2024-09-20T18:35:39.722 INFO:tasks.workunit.client.1.smithi172.stdout:7/441: mkdir d2/d23/d9d 0 2024-09-20T18:35:39.723 INFO:tasks.workunit.client.1.smithi172.stdout:4/303: symlink d0/de/d21/d24/d34/l74 0 2024-09-20T18:35:39.725 INFO:tasks.workunit.client.1.smithi172.stdout:2/306: unlink d0/d1a/c27 0 2024-09-20T18:35:39.730 INFO:tasks.workunit.client.1.smithi172.stdout:7/442: dwrite d2/d23/d3a/f88 [4194304,4194304] 0 2024-09-20T18:35:39.734 INFO:tasks.workunit.client.1.smithi172.stdout:2/307: mkdir d0/d2c/d3f/d17/d22/d10/d3c/d68 0 2024-09-20T18:35:39.734 INFO:tasks.workunit.client.1.smithi172.stdout:4/304: dwrite d0/de/d21/d24/f69 [0,4194304] 0 2024-09-20T18:35:39.741 INFO:tasks.workunit.client.1.smithi172.stdout:4/305: write d0/de/f30 [18551,24107] 0 2024-09-20T18:35:39.742 INFO:tasks.workunit.client.1.smithi172.stdout:0/451: sync 2024-09-20T18:35:39.742 INFO:tasks.workunit.client.1.smithi172.stdout:1/335: sync 2024-09-20T18:35:39.742 INFO:tasks.workunit.client.1.smithi172.stdout:3/379: sync 2024-09-20T18:35:39.742 INFO:tasks.workunit.client.1.smithi172.stdout:8/360: sync 2024-09-20T18:35:39.744 INFO:tasks.workunit.client.1.smithi172.stdout:7/443: rename d2/d3/d10/d40/d46/d8e/f69 to d2/d3/d10/d40/d74/f9e 0 2024-09-20T18:35:39.746 INFO:tasks.workunit.client.1.smithi172.stdout:2/308: creat d0/d60/f69 x:0 0 0 2024-09-20T18:35:39.746 INFO:tasks.workunit.client.1.smithi172.stdout:9/337: truncate f14 2062477 0 2024-09-20T18:35:39.747 INFO:tasks.workunit.client.1.smithi172.stdout:2/309: fdatasync d0/d2c/d3f/f30 0 2024-09-20T18:35:39.749 INFO:tasks.workunit.client.1.smithi172.stdout:9/338: dread d15/d4a/f55 [0,4194304] 0 2024-09-20T18:35:39.750 INFO:tasks.workunit.client.1.smithi172.stdout:9/339: fsync f12 0 2024-09-20T18:35:39.756 INFO:tasks.workunit.client.1.smithi172.stdout:9/340: dwrite d15/d1a/d1e/d48/f66 [0,4194304] 0 2024-09-20T18:35:39.757 INFO:tasks.workunit.client.1.smithi172.stdout:3/380: mkdir d0/d13/d32/d54/d71 0 2024-09-20T18:35:39.757 INFO:tasks.workunit.client.1.smithi172.stdout:9/341: dread - d15/d1f/f69 zero size 2024-09-20T18:35:39.759 INFO:tasks.workunit.client.1.smithi172.stdout:7/444: mknod d2/d23/d3a/c9f 0 2024-09-20T18:35:39.764 INFO:tasks.workunit.client.1.smithi172.stdout:1/336: mkdir d0/d8/db/d25/d6f 0 2024-09-20T18:35:39.765 INFO:tasks.workunit.client.1.smithi172.stdout:2/310: dwrite d0/d1a/f25 [0,4194304] 0 2024-09-20T18:35:39.773 INFO:tasks.workunit.client.1.smithi172.stdout:9/342: creat d15/d4a/f6d x:0 0 0 2024-09-20T18:35:39.783 INFO:tasks.workunit.client.1.smithi172.stdout:1/337: unlink d0/d8/d12/l4b 0 2024-09-20T18:35:39.784 INFO:tasks.workunit.client.1.smithi172.stdout:2/311: mkdir d0/d2c/d3f/d17/d22/d10/d6a 0 2024-09-20T18:35:39.788 INFO:tasks.workunit.client.1.smithi172.stdout:9/343: mkdir d15/d1f/d2c/d6e 0 2024-09-20T18:35:39.789 INFO:tasks.workunit.client.1.smithi172.stdout:8/361: dwrite dd/d1b/f55 [0,4194304] 0 2024-09-20T18:35:39.792 INFO:tasks.workunit.client.1.smithi172.stdout:1/338: mknod d0/d22/c70 0 2024-09-20T18:35:39.793 INFO:tasks.workunit.client.1.smithi172.stdout:3/381: creat d0/d13/f72 x:0 0 0 2024-09-20T18:35:39.795 INFO:tasks.workunit.client.1.smithi172.stdout:1/339: creat d0/d8/db/d25/d2b/d3d/d65/f71 x:0 0 0 2024-09-20T18:35:39.796 INFO:tasks.workunit.client.1.smithi172.stdout:0/452: write d4/d5/d2e/d38/f4b [1027417,30775] 0 2024-09-20T18:35:39.797 INFO:tasks.workunit.client.1.smithi172.stdout:3/382: rename d0/l64 to d0/d13/d32/d54/d71/l73 0 2024-09-20T18:35:39.798 INFO:tasks.workunit.client.1.smithi172.stdout:2/312: getdents d0/d2c/d51 0 2024-09-20T18:35:39.799 INFO:tasks.workunit.client.1.smithi172.stdout:1/340: readlink d0/d8/d12/l4f 0 2024-09-20T18:35:39.802 INFO:tasks.workunit.client.1.smithi172.stdout:3/383: mkdir d0/dc/d6a/d3a/d74 0 2024-09-20T18:35:39.804 INFO:tasks.workunit.client.1.smithi172.stdout:0/453: dwrite d4/d1d/d15/f1b [4194304,4194304] 0 2024-09-20T18:35:39.806 INFO:tasks.workunit.client.1.smithi172.stdout:5/375: sync 2024-09-20T18:35:39.809 INFO:tasks.workunit.client.1.smithi172.stdout:5/376: write d4/f9 [2055633,10325] 0 2024-09-20T18:35:39.811 INFO:tasks.workunit.client.1.smithi172.stdout:7/445: dwrite d2/d3/d10/f96 [0,4194304] 0 2024-09-20T18:35:39.813 INFO:tasks.workunit.client.1.smithi172.stdout:3/384: creat d0/dc/d6a/d3a/f75 x:0 0 0 2024-09-20T18:35:39.814 INFO:tasks.workunit.client.1.smithi172.stdout:7/446: fdatasync d2/d3/fb 0 2024-09-20T18:35:39.815 INFO:tasks.workunit.client.1.smithi172.stdout:5/377: creat d4/df/d3f/d64/f7b x:0 0 0 2024-09-20T18:35:39.815 INFO:tasks.workunit.client.1.smithi172.stdout:3/385: dread - d0/dc/d6a/d3a/f60 zero size 2024-09-20T18:35:39.816 INFO:tasks.workunit.client.1.smithi172.stdout:0/454: link d4/d20/f91 d4/d5/d2e/d38/d96/f9f 0 2024-09-20T18:35:39.817 INFO:tasks.workunit.client.1.smithi172.stdout:0/455: write d4/d1a/f66 [2497317,58212] 0 2024-09-20T18:35:39.817 INFO:tasks.workunit.client.1.smithi172.stdout:3/386: chown d0/dc/d6a/d22/f34 6292495 1 2024-09-20T18:35:39.818 INFO:tasks.workunit.client.1.smithi172.stdout:5/378: write d4/d1f/d26/d2d/d50/f56 [2365881,79108] 0 2024-09-20T18:35:39.820 INFO:tasks.workunit.client.1.smithi172.stdout:3/387: mkdir d0/dc/d6a/d76 0 2024-09-20T18:35:39.846 INFO:tasks.workunit.client.0.smithi017.stderr:++ readlink -f fsstress 2024-09-20T18:35:39.848 INFO:tasks.workunit.client.0.smithi017.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-20T18:35:39.848 INFO:tasks.workunit.client.0.smithi017.stderr:+ popd 2024-09-20T18:35:39.849 INFO:tasks.workunit.client.0.smithi017.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-20T18:35:39.849 INFO:tasks.workunit.client.0.smithi017.stderr:+ popd 2024-09-20T18:35:39.849 INFO:tasks.workunit.client.0.smithi017.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-20T18:35:39.849 INFO:tasks.workunit.client.0.smithi017.stderr:++ mktemp -d -p . 2024-09-20T18:35:39.852 INFO:tasks.workunit.client.0.smithi017.stderr:+ T=./tmp.WInPXSzCyU 2024-09-20T18:35:39.852 INFO:tasks.workunit.client.0.smithi017.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.WInPXSzCyU -l 1 -n 1000 -p 10 -v 2024-09-20T18:35:39.855 INFO:tasks.workunit.client.0.smithi017.stdout:seed = 1726028041 2024-09-20T18:35:39.859 INFO:tasks.workunit.client.0.smithi017.stdout:0/0: chown . 0 1 2024-09-20T18:35:39.859 INFO:tasks.workunit.client.0.smithi017.stdout:0/1: dwrite - no filename 2024-09-20T18:35:39.859 INFO:tasks.workunit.client.0.smithi017.stdout:0/2: chown . 324995352 1 2024-09-20T18:35:39.861 INFO:tasks.workunit.client.0.smithi017.stdout:1/0: dread - no filename 2024-09-20T18:35:39.861 INFO:tasks.workunit.client.0.smithi017.stdout:1/1: truncate - no filename 2024-09-20T18:35:39.861 INFO:tasks.workunit.client.0.smithi017.stdout:1/2: link - no file 2024-09-20T18:35:39.861 INFO:tasks.workunit.client.0.smithi017.stdout:1/3: dread - no filename 2024-09-20T18:35:39.862 INFO:tasks.workunit.client.0.smithi017.stdout:0/3: mkdir d0 0 2024-09-20T18:35:39.862 INFO:tasks.workunit.client.0.smithi017.stdout:0/4: unlink - no file 2024-09-20T18:35:39.863 INFO:tasks.workunit.client.0.smithi017.stdout:2/0: rename - no filename 2024-09-20T18:35:39.863 INFO:tasks.workunit.client.0.smithi017.stdout:2/1: truncate - no filename 2024-09-20T18:35:39.863 INFO:tasks.workunit.client.0.smithi017.stdout:2/2: fdatasync - no filename 2024-09-20T18:35:39.865 INFO:tasks.workunit.client.0.smithi017.stdout:2/3: mknod c0 0 2024-09-20T18:35:39.865 INFO:tasks.workunit.client.0.smithi017.stdout:2/4: dread - no filename 2024-09-20T18:35:39.867 INFO:tasks.workunit.client.0.smithi017.stdout:0/5: rmdir d0 0 2024-09-20T18:35:39.868 INFO:tasks.workunit.client.1.smithi172.stdout:3/388: rmdir d0/dc/d61 39 2024-09-20T18:35:39.869 INFO:tasks.workunit.client.0.smithi017.stdout:2/5: mkdir d1 0 2024-09-20T18:35:39.869 INFO:tasks.workunit.client.0.smithi017.stdout:2/6: read - no filename 2024-09-20T18:35:39.869 INFO:tasks.workunit.client.1.smithi172.stdout:2/313: dwrite d0/d2c/d3f/f2a [4194304,4194304] 0 2024-09-20T18:35:39.871 INFO:tasks.workunit.client.1.smithi172.stdout:0/456: link d4/d1a/d28/l2b d4/d5/d2e/d8e/la0 0 2024-09-20T18:35:39.872 INFO:tasks.workunit.client.1.smithi172.stdout:0/457: chown d4/d1a/d28/d75/f8d 19161 1 2024-09-20T18:35:39.901 INFO:tasks.workunit.client.1.smithi172.stdout:6/300: sync 2024-09-20T18:35:39.951 INFO:tasks.workunit.client.1.smithi172.stdout:1/341: sync 2024-09-20T18:35:39.951 INFO:tasks.workunit.client.1.smithi172.stdout:4/306: sync 2024-09-20T18:35:39.951 INFO:tasks.workunit.client.1.smithi172.stdout:8/362: sync 2024-09-20T18:35:39.951 INFO:tasks.workunit.client.1.smithi172.stdout:9/344: sync 2024-09-20T18:35:39.967 INFO:tasks.workunit.client.0.smithi017.stdout:3/0: symlink l0 0 2024-09-20T18:35:39.967 INFO:tasks.workunit.client.0.smithi017.stdout:3/1: write - no filename 2024-09-20T18:35:39.967 INFO:tasks.workunit.client.0.smithi017.stdout:3/2: chown l0 19 1 2024-09-20T18:35:39.968 INFO:tasks.workunit.client.0.smithi017.stdout:3/3: chown l0 1 1 2024-09-20T18:35:39.968 INFO:tasks.workunit.client.0.smithi017.stdout:3/4: dread - no filename 2024-09-20T18:35:39.968 INFO:tasks.workunit.client.0.smithi017.stdout:3/5: truncate - no filename 2024-09-20T18:35:39.968 INFO:tasks.workunit.client.0.smithi017.stdout:3/6: dwrite - no filename 2024-09-20T18:35:39.971 INFO:tasks.workunit.client.0.smithi017.stdout:4/0: creat f0 x:0 0 0 2024-09-20T18:35:39.973 INFO:tasks.workunit.client.1.smithi172.stdout:0/458: fsync d4/d20/f91 0 2024-09-20T18:35:39.976 INFO:tasks.workunit.client.1.smithi172.stdout:6/301: dread d0/f13 [4194304,4194304] 0 2024-09-20T18:35:39.977 INFO:tasks.workunit.client.1.smithi172.stdout:4/307: creat d0/de/d21/d24/d34/d72/d15/d55/d53/d5c/f75 x:0 0 0 2024-09-20T18:35:39.978 INFO:tasks.workunit.client.0.smithi017.stdout:2/7: mkdir d1/d2 0 2024-09-20T18:35:39.978 INFO:tasks.workunit.client.0.smithi017.stdout:2/8: dread - no filename 2024-09-20T18:35:39.978 INFO:tasks.workunit.client.1.smithi172.stdout:5/379: link d4/d1f/d26/d2d/d50/f25 d4/df/d3f/f7c 0 2024-09-20T18:35:39.981 INFO:tasks.workunit.client.1.smithi172.stdout:3/389: creat d0/d13/d58/d6d/f77 x:0 0 0 2024-09-20T18:35:39.982 INFO:tasks.workunit.client.1.smithi172.stdout:3/390: truncate d0/dc/d6a/d3a/f75 836801 0 2024-09-20T18:35:39.983 INFO:tasks.workunit.client.0.smithi017.stdout:7/0: dread - no filename 2024-09-20T18:35:39.983 INFO:tasks.workunit.client.0.smithi017.stdout:7/1: dwrite - no filename 2024-09-20T18:35:39.983 INFO:tasks.workunit.client.0.smithi017.stdout:7/2: stat - no entries 2024-09-20T18:35:39.983 INFO:tasks.workunit.client.0.smithi017.stdout:7/3: truncate - no filename 2024-09-20T18:35:39.984 INFO:tasks.workunit.client.0.smithi017.stdout:4/1: mknod c1 0 2024-09-20T18:35:39.985 INFO:tasks.workunit.client.1.smithi172.stdout:8/363: truncate f0 2467046 0 2024-09-20T18:35:39.986 INFO:tasks.workunit.client.0.smithi017.stdout:5/0: mkdir d0 0 2024-09-20T18:35:39.987 INFO:tasks.workunit.client.1.smithi172.stdout:9/345: mkdir d15/d1a/d6f 0 2024-09-20T18:35:39.988 INFO:tasks.workunit.client.1.smithi172.stdout:9/346: chown d15/d4a/f6d 267571 1 2024-09-20T18:35:39.993 INFO:tasks.workunit.client.0.smithi017.stdout:8/0: dwrite - no filename 2024-09-20T18:35:39.993 INFO:tasks.workunit.client.0.smithi017.stdout:8/1: fdatasync - no filename 2024-09-20T18:35:39.993 INFO:tasks.workunit.client.0.smithi017.stdout:8/2: fdatasync - no filename 2024-09-20T18:35:39.993 INFO:tasks.workunit.client.0.smithi017.stdout:8/3: rename - no filename 2024-09-20T18:35:39.993 INFO:tasks.workunit.client.0.smithi017.stdout:8/4: rmdir - no directory 2024-09-20T18:35:39.994 INFO:tasks.workunit.client.1.smithi172.stdout:6/302: symlink d0/d18/d1c/d22/d27/d35/l5e 0 2024-09-20T18:35:39.994 INFO:tasks.workunit.client.1.smithi172.stdout:6/303: fsync d0/d18/f54 0 2024-09-20T18:35:39.995 INFO:tasks.workunit.client.1.smithi172.stdout:5/380: write d4/df/f74 [482209,5642] 0 2024-09-20T18:35:39.995 INFO:tasks.workunit.client.1.smithi172.stdout:6/304: fsync d0/f36 0 2024-09-20T18:35:39.995 INFO:tasks.workunit.client.0.smithi017.stdout:6/0: symlink l0 0 2024-09-20T18:35:39.995 INFO:tasks.workunit.client.0.smithi017.stdout:6/1: truncate - no filename 2024-09-20T18:35:39.995 INFO:tasks.workunit.client.0.smithi017.stdout:6/2: truncate - no filename 2024-09-20T18:35:39.995 INFO:tasks.workunit.client.0.smithi017.stdout:6/3: truncate - no filename 2024-09-20T18:35:39.995 INFO:tasks.workunit.client.0.smithi017.stdout:6/4: dwrite - no filename 2024-09-20T18:35:39.997 INFO:tasks.workunit.client.0.smithi017.stdout:4/2: symlink l2 0 2024-09-20T18:35:40.000 INFO:tasks.workunit.client.1.smithi172.stdout:8/364: mknod dd/d1b/d3b/d51/d34/d39/d4d/c87 0 2024-09-20T18:35:40.000 INFO:tasks.workunit.client.1.smithi172.stdout:8/365: readlink dd/d1b/d4f/l50 0 2024-09-20T18:35:40.000 INFO:tasks.workunit.client.0.smithi017.stdout:0/6: getdents . 0 2024-09-20T18:35:40.000 INFO:tasks.workunit.client.0.smithi017.stdout:0/7: write - no filename 2024-09-20T18:35:40.001 INFO:tasks.workunit.client.1.smithi172.stdout:9/347: write d15/f1b [4681715,9724] 0 2024-09-20T18:35:40.001 INFO:tasks.workunit.client.0.smithi017.stdout:3/7: link l0 l1 0 2024-09-20T18:35:40.005 INFO:tasks.workunit.client.0.smithi017.stdout:7/4: mknod c0 0 2024-09-20T18:35:40.005 INFO:tasks.workunit.client.0.smithi017.stdout:7/5: truncate - no filename 2024-09-20T18:35:40.005 INFO:tasks.workunit.client.0.smithi017.stdout:7/6: dwrite - no filename 2024-09-20T18:35:40.005 INFO:tasks.workunit.client.0.smithi017.stdout:7/7: read - no filename 2024-09-20T18:35:40.007 INFO:tasks.workunit.client.0.smithi017.stdout:6/5: mknod c1 0 2024-09-20T18:35:40.007 INFO:tasks.workunit.client.0.smithi017.stdout:6/6: dread - no filename 2024-09-20T18:35:40.007 INFO:tasks.workunit.client.0.smithi017.stdout:6/7: write - no filename 2024-09-20T18:35:40.007 INFO:tasks.workunit.client.1.smithi172.stdout:6/305: creat d0/d18/d1c/d21/d26/f5f x:0 0 0 2024-09-20T18:35:40.008 INFO:tasks.workunit.client.1.smithi172.stdout:7/447: sync 2024-09-20T18:35:40.008 INFO:tasks.workunit.client.1.smithi172.stdout:2/314: sync 2024-09-20T18:35:40.008 INFO:tasks.workunit.client.0.smithi017.stdout:4/3: creat f3 x:0 0 0 2024-09-20T18:35:40.009 INFO:tasks.workunit.client.1.smithi172.stdout:5/381: creat d4/d1f/d26/d2d/d50/d2c/f7d x:0 0 0 2024-09-20T18:35:40.009 INFO:tasks.workunit.client.0.smithi017.stdout:4/4: write f3 [451740,11690] 0 2024-09-20T18:35:40.010 INFO:tasks.workunit.client.1.smithi172.stdout:5/382: readlink d4/df/d3f/l40 0 2024-09-20T18:35:40.010 INFO:tasks.workunit.client.0.smithi017.stdout:4/5: dread - f0 zero size 2024-09-20T18:35:40.010 INFO:tasks.workunit.client.0.smithi017.stdout:5/1: creat d0/f1 x:0 0 0 2024-09-20T18:35:40.011 INFO:tasks.workunit.client.0.smithi017.stdout:4/6: fdatasync f3 0 2024-09-20T18:35:40.011 INFO:tasks.workunit.client.0.smithi017.stdout:4/7: fdatasync f3 0 2024-09-20T18:35:40.012 INFO:tasks.workunit.client.0.smithi017.stdout:3/8: mknod c2 0 2024-09-20T18:35:40.012 INFO:tasks.workunit.client.0.smithi017.stdout:3/9: truncate - no filename 2024-09-20T18:35:40.014 INFO:tasks.workunit.client.1.smithi172.stdout:0/459: creat d4/fa1 x:0 0 0 2024-09-20T18:35:40.014 INFO:tasks.workunit.client.1.smithi172.stdout:0/460: read - d4/d1a/d28/f9a zero size 2024-09-20T18:35:40.015 INFO:tasks.workunit.client.0.smithi017.stdout:8/5: mkdir d0 0 2024-09-20T18:35:40.015 INFO:tasks.workunit.client.0.smithi017.stdout:8/6: dread - no filename 2024-09-20T18:35:40.015 INFO:tasks.workunit.client.0.smithi017.stdout:8/7: dwrite - no filename 2024-09-20T18:35:40.015 INFO:tasks.workunit.client.1.smithi172.stdout:0/461: read - d4/d5/d2e/d67/f9e zero size 2024-09-20T18:35:40.015 INFO:tasks.workunit.client.1.smithi172.stdout:0/462: readlink d4/d5/l1f 0 2024-09-20T18:35:40.017 INFO:tasks.workunit.client.0.smithi017.stdout:7/8: symlink l1 0 2024-09-20T18:35:40.017 INFO:tasks.workunit.client.0.smithi017.stdout:7/9: fdatasync - no filename 2024-09-20T18:35:40.017 INFO:tasks.workunit.client.0.smithi017.stdout:7/10: fdatasync - no filename 2024-09-20T18:35:40.018 INFO:tasks.workunit.client.1.smithi172.stdout:4/308: link d0/de/dc/l29 d0/de/d21/d24/d34/d72/d15/d55/d53/l76 0 2024-09-20T18:35:40.019 INFO:tasks.workunit.client.0.smithi017.stdout:6/8: creat f2 x:0 0 0 2024-09-20T18:35:40.019 INFO:tasks.workunit.client.0.smithi017.stdout:6/9: rmdir - no directory 2024-09-20T18:35:40.021 INFO:tasks.workunit.client.1.smithi172.stdout:7/448: unlink d2/d3/dd/f2e 0 2024-09-20T18:35:40.023 INFO:tasks.workunit.client.0.smithi017.stdout:5/2: symlink d0/l2 0 2024-09-20T18:35:40.024 INFO:tasks.workunit.client.0.smithi017.stdout:5/3: dread - d0/f1 zero size 2024-09-20T18:35:40.025 INFO:tasks.workunit.client.0.smithi017.stdout:0/8: getdents . 0 2024-09-20T18:35:40.026 INFO:tasks.workunit.client.1.smithi172.stdout:5/383: creat d4/d1f/d26/d2d/d50/f7e x:0 0 0 2024-09-20T18:35:40.026 INFO:tasks.workunit.client.1.smithi172.stdout:5/384: chown d4/d1f/d26/f32 100107 1 2024-09-20T18:35:40.027 INFO:tasks.workunit.client.0.smithi017.stdout:4/8: mkdir d4 0 2024-09-20T18:35:40.029 INFO:tasks.workunit.client.1.smithi172.stdout:8/366: chown dd/d1b/d4f/f80 12303034 1 2024-09-20T18:35:40.030 INFO:tasks.workunit.client.0.smithi017.stdout:9/0: creat f0 x:0 0 0 2024-09-20T18:35:40.030 INFO:tasks.workunit.client.0.smithi017.stdout:5/4: fsync d0/f1 0 2024-09-20T18:35:40.031 INFO:tasks.workunit.client.1.smithi172.stdout:3/391: write d0/dc/d6a/f53 [664531,110821] 0 2024-09-20T18:35:40.031 INFO:tasks.workunit.client.0.smithi017.stdout:5/5: read - d0/f1 zero size 2024-09-20T18:35:40.032 INFO:tasks.workunit.client.1.smithi172.stdout:9/348: write d15/d1a/d1e/f67 [806670,88738] 0 2024-09-20T18:35:40.034 INFO:tasks.workunit.client.0.smithi017.stdout:7/11: unlink l1 0 2024-09-20T18:35:40.035 INFO:tasks.workunit.client.1.smithi172.stdout:1/342: link d0/d8/db/d39/l6c d0/d52/l72 0 2024-09-20T18:35:40.036 INFO:tasks.workunit.client.0.smithi017.stdout:6/10: symlink l3 0 2024-09-20T18:35:40.037 INFO:tasks.workunit.client.1.smithi172.stdout:0/463: creat d4/d1a/d28/d88/fa2 x:0 0 0 2024-09-20T18:35:40.038 INFO:tasks.workunit.client.0.smithi017.stdout:6/11: write f2 [25712,49023] 0 2024-09-20T18:35:40.039 INFO:tasks.workunit.client.1.smithi172.stdout:4/309: creat d0/de/d21/d24/d34/d72/d15/d55/d53/f77 x:0 0 0 2024-09-20T18:35:40.039 INFO:tasks.workunit.client.0.smithi017.stdout:0/9: symlink l1 0 2024-09-20T18:35:40.041 INFO:tasks.workunit.client.0.smithi017.stdout:5/6: dwrite d0/f1 [0,4194304] 0 2024-09-20T18:35:40.043 INFO:tasks.workunit.client.1.smithi172.stdout:7/449: mknod d2/d3/d10/d40/d74/ca0 0 2024-09-20T18:35:40.047 INFO:tasks.workunit.client.0.smithi017.stdout:5/7: dread d0/f1 [0,4194304] 0 2024-09-20T18:35:40.048 INFO:tasks.workunit.client.0.smithi017.stdout:9/1: rename f0 to f1 0 2024-09-20T18:35:40.049 INFO:tasks.workunit.client.0.smithi017.stdout:9/2: truncate f1 639652 0 2024-09-20T18:35:40.050 INFO:tasks.workunit.client.0.smithi017.stdout:8/8: creat d0/f1 x:0 0 0 2024-09-20T18:35:40.055 INFO:tasks.workunit.client.1.smithi172.stdout:5/385: creat d4/d1f/d26/d41/f7f x:0 0 0 2024-09-20T18:35:40.056 INFO:tasks.workunit.client.1.smithi172.stdout:7/450: dread d2/f2b [0,4194304] 0 2024-09-20T18:35:40.057 INFO:tasks.workunit.client.1.smithi172.stdout:5/386: truncate d4/d1f/d26/d2d/d50/f6d 753911 0 2024-09-20T18:35:40.057 INFO:tasks.workunit.client.0.smithi017.stdout:6/12: mkdir d4 0 2024-09-20T18:35:40.058 INFO:tasks.workunit.client.1.smithi172.stdout:5/387: write d4/d1f/d26/d2d/d50/d2c/f38 [40260,130794] 0 2024-09-20T18:35:40.058 INFO:tasks.workunit.client.0.smithi017.stdout:6/13: fsync f2 0 2024-09-20T18:35:40.059 INFO:tasks.workunit.client.1.smithi172.stdout:3/392: creat d0/d13/d32/d54/f78 x:0 0 0 2024-09-20T18:35:40.060 INFO:tasks.workunit.client.0.smithi017.stdout:8/9: dwrite d0/f1 [0,4194304] 0 2024-09-20T18:35:40.061 INFO:tasks.workunit.client.1.smithi172.stdout:5/388: write d4/df/d3f/d64/f7b [668093,36005] 0 2024-09-20T18:35:40.062 INFO:tasks.workunit.client.0.smithi017.stdout:0/10: creat f2 x:0 0 0 2024-09-20T18:35:40.062 INFO:tasks.workunit.client.1.smithi172.stdout:5/389: chown d4/d1f/d26/d2d/d50 0 1 2024-09-20T18:35:40.062 INFO:tasks.workunit.client.0.smithi017.stdout:0/11: dread - f2 zero size 2024-09-20T18:35:40.063 INFO:tasks.workunit.client.1.smithi172.stdout:7/451: dwrite d2/d23/d3c/f58 [0,4194304] 0 2024-09-20T18:35:40.063 INFO:tasks.workunit.client.0.smithi017.stdout:5/8: fdatasync d0/f1 0 2024-09-20T18:35:40.064 INFO:tasks.workunit.client.0.smithi017.stdout:5/9: rename d0 to d0/d3 22 2024-09-20T18:35:40.065 INFO:tasks.workunit.client.1.smithi172.stdout:9/349: rename d15/d1f/f62 to d15/d1f/d2c/f70 0 2024-09-20T18:35:40.068 INFO:tasks.workunit.client.0.smithi017.stdout:4/9: symlink d4/l5 0 2024-09-20T18:35:40.069 INFO:tasks.workunit.client.0.smithi017.stdout:4/10: fsync f0 0 2024-09-20T18:35:40.069 INFO:tasks.workunit.client.1.smithi172.stdout:5/390: dwrite d4/d1f/d26/d2d/d50/f1e [0,4194304] 0 2024-09-20T18:35:40.072 INFO:tasks.workunit.client.1.smithi172.stdout:6/306: truncate d0/d18/f1e 2972456 0 2024-09-20T18:35:40.075 INFO:tasks.workunit.client.1.smithi172.stdout:4/310: mkdir d0/de/d21/d24/d34/d72/d15/d55/d53/d78 0 2024-09-20T18:35:40.076 INFO:tasks.workunit.client.1.smithi172.stdout:8/367: sync 2024-09-20T18:35:40.076 INFO:tasks.workunit.client.1.smithi172.stdout:4/311: read d0/de/d21/d24/d34/d72/d15/d55/f3e [417536,12415] 0 2024-09-20T18:35:40.084 INFO:tasks.workunit.client.1.smithi172.stdout:8/368: dwrite dd/d1b/d3b/d51/f76 [0,4194304] 0 2024-09-20T18:35:40.086 INFO:tasks.workunit.client.1.smithi172.stdout:7/452: rmdir d2/d3/d10 39 2024-09-20T18:35:40.088 INFO:tasks.workunit.client.1.smithi172.stdout:9/350: symlink d15/d20/l71 0 2024-09-20T18:35:40.089 INFO:tasks.workunit.client.0.smithi017.stdout:5/10: creat d0/f4 x:0 0 0 2024-09-20T18:35:40.090 INFO:tasks.workunit.client.0.smithi017.stdout:5/11: write d0/f4 [633734,82728] 0 2024-09-20T18:35:40.092 INFO:tasks.workunit.client.0.smithi017.stdout:4/11: mknod d4/c6 0 2024-09-20T18:35:40.093 INFO:tasks.workunit.client.0.smithi017.stdout:3/10: getdents . 0 2024-09-20T18:35:40.094 INFO:tasks.workunit.client.1.smithi172.stdout:0/464: creat d4/d1a/d28/d75/d60/fa3 x:0 0 0 2024-09-20T18:35:40.096 INFO:tasks.workunit.client.0.smithi017.stdout:9/3: rename f1 to f2 0 2024-09-20T18:35:40.097 INFO:tasks.workunit.client.0.smithi017.stdout:6/14: creat d4/f5 x:0 0 0 2024-09-20T18:35:40.099 INFO:tasks.workunit.client.0.smithi017.stdout:8/10: link d0/f1 d0/f2 0 2024-09-20T18:35:40.101 INFO:tasks.workunit.client.0.smithi017.stdout:5/12: mkdir d0/d5 0 2024-09-20T18:35:40.104 INFO:tasks.workunit.client.0.smithi017.stdout:4/12: creat d4/f7 x:0 0 0 2024-09-20T18:35:40.104 INFO:tasks.workunit.client.0.smithi017.stdout:4/13: chown f0 115131611 1 2024-09-20T18:35:40.104 INFO:tasks.workunit.client.1.smithi172.stdout:2/315: write d0/d2c/d3f/d17/d18/d29/f41 [786400,115022] 0 2024-09-20T18:35:40.105 INFO:tasks.workunit.client.0.smithi017.stdout:3/11: symlink l3 0 2024-09-20T18:35:40.107 INFO:tasks.workunit.client.0.smithi017.stdout:9/4: creat f3 x:0 0 0 2024-09-20T18:35:40.109 INFO:tasks.workunit.client.1.smithi172.stdout:9/351: write d15/d1f/d2c/f70 [708061,32265] 0 2024-09-20T18:35:40.109 INFO:tasks.workunit.client.0.smithi017.stdout:6/15: symlink d4/l6 0 2024-09-20T18:35:40.110 INFO:tasks.workunit.client.1.smithi172.stdout:9/352: fdatasync d15/d1a/d1e/d34/f3b 0 2024-09-20T18:35:40.111 INFO:tasks.workunit.client.1.smithi172.stdout:1/343: rename d0/d52 to d0/d73 0 2024-09-20T18:35:40.111 INFO:tasks.workunit.client.1.smithi172.stdout:6/307: dread d0/d18/d1c/d21/d26/d34/f3e [0,4194304] 0 2024-09-20T18:35:40.112 INFO:tasks.workunit.client.1.smithi172.stdout:6/308: dread d0/f4a [0,4194304] 0 2024-09-20T18:35:40.113 INFO:tasks.workunit.client.1.smithi172.stdout:5/391: mkdir d4/d1f/d26/d2d/d63/d80 0 2024-09-20T18:35:40.113 INFO:tasks.workunit.client.1.smithi172.stdout:6/309: fsync d0/fe 0 2024-09-20T18:35:40.114 INFO:tasks.workunit.client.1.smithi172.stdout:7/453: dread d2/d23/d3c/f44 [0,4194304] 0 2024-09-20T18:35:40.114 INFO:tasks.workunit.client.1.smithi172.stdout:6/310: fsync d0/d18/d1c/d21/f56 0 2024-09-20T18:35:40.115 INFO:tasks.workunit.client.0.smithi017.stdout:0/12: link l1 l3 0 2024-09-20T18:35:40.117 INFO:tasks.workunit.client.0.smithi017.stdout:5/13: creat d0/f6 x:0 0 0 2024-09-20T18:35:40.117 INFO:tasks.workunit.client.0.smithi017.stdout:6/16: dwrite d4/f5 [0,4194304] 0 2024-09-20T18:35:40.118 INFO:tasks.workunit.client.0.smithi017.stdout:5/14: read - d0/f6 zero size 2024-09-20T18:35:40.119 INFO:tasks.workunit.client.0.smithi017.stdout:4/14: symlink d4/l8 0 2024-09-20T18:35:40.120 INFO:tasks.workunit.client.0.smithi017.stdout:4/15: readlink l2 0 2024-09-20T18:35:40.121 INFO:tasks.workunit.client.1.smithi172.stdout:4/312: creat d0/d7/d6f/f79 x:0 0 0 2024-09-20T18:35:40.124 INFO:tasks.workunit.client.0.smithi017.stdout:3/12: mkdir d4 0 2024-09-20T18:35:40.125 INFO:tasks.workunit.client.1.smithi172.stdout:7/454: dread d2/d3/dd/f42 [0,4194304] 0 2024-09-20T18:35:40.128 INFO:tasks.workunit.client.0.smithi017.stdout:6/17: dwrite f2 [0,4194304] 0 2024-09-20T18:35:40.130 INFO:tasks.workunit.client.0.smithi017.stdout:0/13: readlink l3 0 2024-09-20T18:35:40.130 INFO:tasks.workunit.client.0.smithi017.stdout:0/14: fdatasync f2 0 2024-09-20T18:35:40.132 INFO:tasks.workunit.client.1.smithi172.stdout:3/393: link d0/d13/f1c d0/dc/f79 0 2024-09-20T18:35:40.136 INFO:tasks.workunit.client.0.smithi017.stdout:4/16: symlink d4/l9 0 2024-09-20T18:35:40.138 INFO:tasks.workunit.client.0.smithi017.stdout:4/17: dread - d4/f7 zero size 2024-09-20T18:35:40.138 INFO:tasks.workunit.client.1.smithi172.stdout:2/316: creat d0/d2c/f6b x:0 0 0 2024-09-20T18:35:40.139 INFO:tasks.workunit.client.1.smithi172.stdout:2/317: stat d0/d2c/d3f/d17/d18/d29/f41 0 2024-09-20T18:35:40.140 INFO:tasks.workunit.client.0.smithi017.stdout:0/15: dwrite f2 [0,4194304] 0 2024-09-20T18:35:40.141 INFO:tasks.workunit.client.0.smithi017.stdout:0/16: write f2 [2707338,62046] 0 2024-09-20T18:35:40.144 INFO:tasks.workunit.client.0.smithi017.stdout:9/5: rename f2 to f4 0 2024-09-20T18:35:40.145 INFO:tasks.workunit.client.0.smithi017.stdout:9/6: write f3 [994702,53573] 0 2024-09-20T18:35:40.148 INFO:tasks.workunit.client.1.smithi172.stdout:1/344: symlink d0/d73/l74 0 2024-09-20T18:35:40.149 INFO:tasks.workunit.client.0.smithi017.stdout:6/18: mknod d4/c7 0 2024-09-20T18:35:40.149 INFO:tasks.workunit.client.0.smithi017.stdout:6/19: chown d4 2429 1 2024-09-20T18:35:40.156 INFO:tasks.workunit.client.1.smithi172.stdout:6/311: creat d0/d18/d1c/d21/d26/f60 x:0 0 0 2024-09-20T18:35:40.156 INFO:tasks.workunit.client.0.smithi017.stdout:4/18: creat d4/fa x:0 0 0 2024-09-20T18:35:40.157 INFO:tasks.workunit.client.0.smithi017.stdout:4/19: rename d4 to d4/db 22 2024-09-20T18:35:40.157 INFO:tasks.workunit.client.0.smithi017.stdout:4/20: fdatasync f3 0 2024-09-20T18:35:40.158 INFO:tasks.workunit.client.0.smithi017.stdout:4/21: chown d4/l8 122779 1 2024-09-20T18:35:40.158 INFO:tasks.workunit.client.0.smithi017.stdout:4/22: chown d4/l8 12393393 1 2024-09-20T18:35:40.160 INFO:tasks.workunit.client.0.smithi017.stdout:0/17: mkdir d4 0 2024-09-20T18:35:40.161 INFO:tasks.workunit.client.1.smithi172.stdout:7/455: rmdir d2/d3 39 2024-09-20T18:35:40.162 INFO:tasks.workunit.client.1.smithi172.stdout:7/456: chown d2/d23/d3a/f71 4 1 2024-09-20T18:35:40.162 INFO:tasks.workunit.client.1.smithi172.stdout:6/312: dwrite d0/d18/d1c/d21/d26/d34/d39/d46/f7 [4194304,4194304] 0 2024-09-20T18:35:40.164 INFO:tasks.workunit.client.0.smithi017.stdout:8/11: getdents d0 0 2024-09-20T18:35:40.164 INFO:tasks.workunit.client.0.smithi017.stdout:8/12: readlink - no filename 2024-09-20T18:35:40.165 INFO:tasks.workunit.client.1.smithi172.stdout:3/394: creat d0/dc/d6a/d22/f7a x:0 0 0 2024-09-20T18:35:40.166 INFO:tasks.workunit.client.0.smithi017.stdout:6/20: rmdir d4 39 2024-09-20T18:35:40.167 INFO:tasks.workunit.client.0.smithi017.stdout:0/18: dwrite f2 [0,4194304] 0 2024-09-20T18:35:40.168 INFO:tasks.workunit.client.0.smithi017.stdout:0/19: rename d4 to d4/d5 22 2024-09-20T18:35:40.170 INFO:tasks.workunit.client.0.smithi017.stdout:5/15: rmdir d0/d5 0 2024-09-20T18:35:40.171 INFO:tasks.workunit.client.0.smithi017.stdout:5/16: truncate d0/f6 12794 0 2024-09-20T18:35:40.172 INFO:tasks.workunit.client.1.smithi172.stdout:2/318: stat d0/d2c/d3f/d17/d18/d29/c49 0 2024-09-20T18:35:40.174 INFO:tasks.workunit.client.0.smithi017.stdout:3/13: rmdir d4 0 2024-09-20T18:35:40.175 INFO:tasks.workunit.client.1.smithi172.stdout:4/313: write d0/f32 [1779249,31075] 0 2024-09-20T18:35:40.175 INFO:tasks.workunit.client.1.smithi172.stdout:9/353: symlink d15/d1a/d6f/l72 0 2024-09-20T18:35:40.177 INFO:tasks.workunit.client.0.smithi017.stdout:4/23: mkdir d4/dc 0 2024-09-20T18:35:40.180 INFO:tasks.workunit.client.0.smithi017.stdout:4/24: write d4/f7 [876630,13326] 0 2024-09-20T18:35:40.181 INFO:tasks.workunit.client.0.smithi017.stdout:8/13: symlink d0/l3 0 2024-09-20T18:35:40.182 INFO:tasks.workunit.client.0.smithi017.stdout:4/25: fsync f0 0 2024-09-20T18:35:40.183 INFO:tasks.workunit.client.0.smithi017.stdout:5/17: dwrite d0/f6 [0,4194304] 0 2024-09-20T18:35:40.185 INFO:tasks.workunit.client.1.smithi172.stdout:0/465: creat d4/d1a/d28/fa4 x:0 0 0 2024-09-20T18:35:40.185 INFO:tasks.workunit.client.1.smithi172.stdout:3/395: dread d0/dc/f79 [0,4194304] 0 2024-09-20T18:35:40.187 INFO:tasks.workunit.client.0.smithi017.stdout:3/14: mknod c5 0 2024-09-20T18:35:40.187 INFO:tasks.workunit.client.0.smithi017.stdout:3/15: dread - no filename 2024-09-20T18:35:40.187 INFO:tasks.workunit.client.0.smithi017.stdout:3/16: fsync - no filename 2024-09-20T18:35:40.187 INFO:tasks.workunit.client.1.smithi172.stdout:3/396: write d0/dc/d6a/d3a/f60 [949682,50563] 0 2024-09-20T18:35:40.193 INFO:tasks.workunit.client.0.smithi017.stdout:6/21: dread d4/f5 [0,4194304] 0 2024-09-20T18:35:40.194 INFO:tasks.workunit.client.0.smithi017.stdout:5/18: dread d0/f1 [0,4194304] 0 2024-09-20T18:35:40.195 INFO:tasks.workunit.client.0.smithi017.stdout:4/26: dwrite f0 [0,4194304] 0 2024-09-20T18:35:40.195 INFO:tasks.workunit.client.0.smithi017.stdout:8/14: creat d0/f4 x:0 0 0 2024-09-20T18:35:40.198 INFO:tasks.workunit.client.1.smithi172.stdout:6/313: symlink d0/d18/d1c/d22/l61 0 2024-09-20T18:35:40.199 INFO:tasks.workunit.client.0.smithi017.stdout:9/7: write f4 [609083,109871] 0 2024-09-20T18:35:40.202 INFO:tasks.workunit.client.1.smithi172.stdout:8/369: getdents dd/d1b 0 2024-09-20T18:35:40.204 INFO:tasks.workunit.client.1.smithi172.stdout:5/392: truncate d4/df/d3f/f61 3395469 0 2024-09-20T18:35:40.205 INFO:tasks.workunit.client.1.smithi172.stdout:9/354: creat d15/d20/f73 x:0 0 0 2024-09-20T18:35:40.208 INFO:tasks.workunit.client.0.smithi017.stdout:4/27: dwrite f3 [0,4194304] 0 2024-09-20T18:35:40.209 INFO:tasks.workunit.client.0.smithi017.stdout:6/22: dwrite d4/f5 [0,4194304] 0 2024-09-20T18:35:40.211 INFO:tasks.workunit.client.0.smithi017.stdout:5/19: rename d0/f4 to d0/f7 0 2024-09-20T18:35:40.212 INFO:tasks.workunit.client.0.smithi017.stdout:5/20: rename d0 to d0/d8 22 2024-09-20T18:35:40.213 INFO:tasks.workunit.client.0.smithi017.stdout:5/21: fdatasync d0/f6 0 2024-09-20T18:35:40.215 INFO:tasks.workunit.client.0.smithi017.stdout:8/15: symlink d0/l5 0 2024-09-20T18:35:40.215 INFO:tasks.workunit.client.0.smithi017.stdout:5/22: read d0/f7 [600225,22439] 0 2024-09-20T18:35:40.218 INFO:tasks.workunit.client.0.smithi017.stdout:0/20: truncate f2 1996849 0 2024-09-20T18:35:40.220 INFO:tasks.workunit.client.0.smithi017.stdout:9/8: symlink l5 0 2024-09-20T18:35:40.225 INFO:tasks.workunit.client.1.smithi172.stdout:6/314: mkdir d0/d18/d1c/d22/d47/d62 0 2024-09-20T18:35:40.227 INFO:tasks.workunit.client.0.smithi017.stdout:4/28: mkdir d4/dd 0 2024-09-20T18:35:40.227 INFO:tasks.workunit.client.0.smithi017.stdout:9/9: dwrite f3 [0,4194304] 0 2024-09-20T18:35:40.228 INFO:tasks.workunit.client.1.smithi172.stdout:5/393: symlink d4/df/d3f/d64/l81 0 2024-09-20T18:35:40.229 INFO:tasks.workunit.client.1.smithi172.stdout:5/394: read f3 [4517368,6013] 0 2024-09-20T18:35:40.230 INFO:tasks.workunit.client.1.smithi172.stdout:5/395: write d4/d1f/f51 [617519,51628] 0 2024-09-20T18:35:40.230 INFO:tasks.workunit.client.0.smithi017.stdout:6/23: creat d4/f8 x:0 0 0 2024-09-20T18:35:40.232 INFO:tasks.workunit.client.0.smithi017.stdout:6/24: write d4/f8 [52044,12014] 0 2024-09-20T18:35:40.234 INFO:tasks.workunit.client.1.smithi172.stdout:5/396: read d4/fc [717334,129902] 0 2024-09-20T18:35:40.235 INFO:tasks.workunit.client.0.smithi017.stdout:8/16: mkdir d0/d6 0 2024-09-20T18:35:40.236 INFO:tasks.workunit.client.1.smithi172.stdout:1/345: link d0/d8/db/d25/d2b/d3d/f3e d0/d8/db/f75 0 2024-09-20T18:35:40.236 INFO:tasks.workunit.client.1.smithi172.stdout:9/355: dwrite d15/d20/f21 [4194304,4194304] 0 2024-09-20T18:35:40.237 INFO:tasks.workunit.client.0.smithi017.stdout:5/23: fsync d0/f1 0 2024-09-20T18:35:40.238 INFO:tasks.workunit.client.0.smithi017.stdout:5/24: stat d0/f7 0 2024-09-20T18:35:40.238 INFO:tasks.workunit.client.0.smithi017.stdout:4/29: dwrite f0 [0,4194304] 0 2024-09-20T18:35:40.239 INFO:tasks.workunit.client.1.smithi172.stdout:0/466: creat d4/d5/d2e/d67/d8c/fa5 x:0 0 0 2024-09-20T18:35:40.242 INFO:tasks.workunit.client.0.smithi017.stdout:4/30: chown d4/l5 113 1 2024-09-20T18:35:40.243 INFO:tasks.workunit.client.0.smithi017.stdout:9/10: fdatasync f3 0 2024-09-20T18:35:40.246 INFO:tasks.workunit.client.1.smithi172.stdout:7/457: symlink d2/d3/d10/d40/d6a/la1 0 2024-09-20T18:35:40.246 INFO:tasks.workunit.client.1.smithi172.stdout:7/458: stat d2/l11 0 2024-09-20T18:35:40.249 INFO:tasks.workunit.client.0.smithi017.stdout:5/25: dwrite d0/f6 [0,4194304] 0 2024-09-20T18:35:40.250 INFO:tasks.workunit.client.1.smithi172.stdout:9/356: dread d15/d1f/d2c/f70 [0,4194304] 0 2024-09-20T18:35:40.251 INFO:tasks.workunit.client.1.smithi172.stdout:6/315: creat d0/d18/d1c/d22/f63 x:0 0 0 2024-09-20T18:35:40.255 INFO:tasks.workunit.client.0.smithi017.stdout:8/17: creat d0/f7 x:0 0 0 2024-09-20T18:35:40.255 INFO:tasks.workunit.client.0.smithi017.stdout:8/18: chown d0/f4 336 1 2024-09-20T18:35:40.256 INFO:tasks.workunit.client.1.smithi172.stdout:9/357: dread d15/d1a/f26 [0,4194304] 0 2024-09-20T18:35:40.256 INFO:tasks.workunit.client.0.smithi017.stdout:0/21: getdents d4 0 2024-09-20T18:35:40.260 INFO:tasks.workunit.client.1.smithi172.stdout:6/316: dwrite d0/d18/f54 [0,4194304] 0 2024-09-20T18:35:40.261 INFO:tasks.workunit.client.1.smithi172.stdout:6/317: dread - d0/d18/f43 zero size 2024-09-20T18:35:40.263 INFO:tasks.workunit.client.1.smithi172.stdout:9/358: dwrite d15/d1a/d1e/d34/f49 [0,4194304] 0 2024-09-20T18:35:40.373 INFO:tasks.workunit.client.1.smithi172.stdout:4/314: link d0/de/dc/d3c/c50 d0/d48/d4e/c7a 0 2024-09-20T18:35:40.373 INFO:tasks.workunit.client.1.smithi172.stdout:4/315: dread - d0/f71 zero size 2024-09-20T18:35:40.375 INFO:tasks.workunit.client.0.smithi017.stdout:9/11: mkdir d6 0 2024-09-20T18:35:40.376 INFO:tasks.workunit.client.0.smithi017.stdout:3/17: getdents . 0 2024-09-20T18:35:40.378 INFO:tasks.workunit.client.0.smithi017.stdout:5/26: symlink d0/l9 0 2024-09-20T18:35:40.379 INFO:tasks.workunit.client.0.smithi017.stdout:5/27: truncate d0/f6 4472230 0 2024-09-20T18:35:40.381 INFO:tasks.workunit.client.1.smithi172.stdout:3/397: dwrite d0/dc/f2e [0,4194304] 0 2024-09-20T18:35:40.382 INFO:tasks.workunit.client.1.smithi172.stdout:1/346: creat d0/d8/db/d25/d2b/d3d/f76 x:0 0 0 2024-09-20T18:35:40.388 INFO:tasks.workunit.client.1.smithi172.stdout:7/459: unlink d2/d3/d10/d40/d46/c53 0 2024-09-20T18:35:40.388 INFO:tasks.workunit.client.1.smithi172.stdout:7/460: stat d2/d3/dd/fe 0 2024-09-20T18:35:40.393 INFO:tasks.workunit.client.0.smithi017.stdout:0/22: link f2 d4/f6 0 2024-09-20T18:35:40.395 INFO:tasks.workunit.client.1.smithi172.stdout:8/370: creat dd/d1b/d3b/d51/f88 x:0 0 0 2024-09-20T18:35:40.395 INFO:tasks.workunit.client.0.smithi017.stdout:4/31: truncate f3 1649434 0 2024-09-20T18:35:40.395 INFO:tasks.workunit.client.1.smithi172.stdout:8/371: fdatasync dd/d1b/d3b/d51/f81 0 2024-09-20T18:35:40.396 INFO:tasks.workunit.client.0.smithi017.stdout:9/12: creat d6/f7 x:0 0 0 2024-09-20T18:35:40.397 INFO:tasks.workunit.client.1.smithi172.stdout:2/319: getdents d0/d1a 0 2024-09-20T18:35:40.399 INFO:tasks.workunit.client.0.smithi017.stdout:3/18: rename l0 to l6 0 2024-09-20T18:35:40.400 INFO:tasks.workunit.client.0.smithi017.stdout:8/19: link d0/l3 d0/l8 0 2024-09-20T18:35:40.400 INFO:tasks.workunit.client.0.smithi017.stdout:9/13: dread f3 [0,4194304] 0 2024-09-20T18:35:40.403 INFO:tasks.workunit.client.1.smithi172.stdout:6/318: creat d0/d18/d1c/d21/d26/d34/d39/f64 x:0 0 0 2024-09-20T18:35:40.404 INFO:tasks.workunit.client.0.smithi017.stdout:8/20: mknod d0/c9 0 2024-09-20T18:35:40.407 INFO:tasks.workunit.client.0.smithi017.stdout:9/14: creat d6/f8 x:0 0 0 2024-09-20T18:35:40.408 INFO:tasks.workunit.client.0.smithi017.stdout:0/23: mknod d4/c7 0 2024-09-20T18:35:40.412 INFO:tasks.workunit.client.0.smithi017.stdout:8/21: dwrite d0/f4 [0,4194304] 0 2024-09-20T18:35:40.414 INFO:tasks.workunit.client.1.smithi172.stdout:5/397: rename d4/d1f/d26/d2d/d50/f25 to d4/d1f/d26/d2d/d50/d2c/f82 0 2024-09-20T18:35:40.422 INFO:tasks.workunit.client.0.smithi017.stdout:0/24: creat d4/f8 x:0 0 0 2024-09-20T18:35:40.423 INFO:tasks.workunit.client.1.smithi172.stdout:0/467: symlink d4/d5/d2e/d38/d96/la6 0 2024-09-20T18:35:40.424 INFO:tasks.workunit.client.0.smithi017.stdout:3/19: link l1 l7 0 2024-09-20T18:35:40.425 INFO:tasks.workunit.client.0.smithi017.stdout:8/22: fdatasync d0/f4 0 2024-09-20T18:35:40.426 INFO:tasks.workunit.client.1.smithi172.stdout:7/461: unlink d2/d3/dd/fe 0 2024-09-20T18:35:40.429 INFO:tasks.workunit.client.0.smithi017.stdout:8/23: dread d0/f2 [0,4194304] 0 2024-09-20T18:35:40.431 INFO:tasks.workunit.client.1.smithi172.stdout:8/372: truncate dd/f19 4501589 0 2024-09-20T18:35:40.433 INFO:tasks.workunit.client.0.smithi017.stdout:8/24: dread d0/f4 [0,4194304] 0 2024-09-20T18:35:40.436 INFO:tasks.workunit.client.0.smithi017.stdout:9/15: link l5 d6/l9 0 2024-09-20T18:35:40.437 INFO:tasks.workunit.client.0.smithi017.stdout:9/16: write d6/f8 [829514,100407] 0 2024-09-20T18:35:40.437 INFO:tasks.workunit.client.1.smithi172.stdout:9/359: truncate d15/d1a/d1e/d24/f2e 1665350 0 2024-09-20T18:35:40.439 INFO:tasks.workunit.client.1.smithi172.stdout:4/316: symlink d0/d7/l7b 0 2024-09-20T18:35:40.440 INFO:tasks.workunit.client.1.smithi172.stdout:6/319: dwrite d0/d18/d1c/d22/d27/f2f [0,4194304] 0 2024-09-20T18:35:40.441 INFO:tasks.workunit.client.0.smithi017.stdout:8/25: creat d0/fa x:0 0 0 2024-09-20T18:35:40.441 INFO:tasks.workunit.client.0.smithi017.stdout:8/26: chown d0/f7 420 1 2024-09-20T18:35:40.443 INFO:tasks.workunit.client.1.smithi172.stdout:6/320: dread d0/d18/f2b [0,4194304] 0 2024-09-20T18:35:40.444 INFO:tasks.workunit.client.0.smithi017.stdout:0/25: write f2 [1188457,13464] 0 2024-09-20T18:35:40.445 INFO:tasks.workunit.client.0.smithi017.stdout:3/20: rename l6 to l8 0 2024-09-20T18:35:40.447 INFO:tasks.workunit.client.1.smithi172.stdout:1/347: mkdir d0/d8/db/d25/d6d/d77 0 2024-09-20T18:35:40.448 INFO:tasks.workunit.client.0.smithi017.stdout:9/17: mknod d6/ca 0 2024-09-20T18:35:40.448 INFO:tasks.workunit.client.1.smithi172.stdout:0/468: mknod d4/d1a/d28/d42/d45/ca7 0 2024-09-20T18:35:40.451 INFO:tasks.workunit.client.0.smithi017.stdout:8/27: rename d0/f1 to d0/fb 0 2024-09-20T18:35:40.453 INFO:tasks.workunit.client.1.smithi172.stdout:1/348: dwrite d0/d8/f2c [0,4194304] 0 2024-09-20T18:35:40.457 INFO:tasks.workunit.client.0.smithi017.stdout:0/26: dwrite d4/f8 [0,4194304] 0 2024-09-20T18:35:40.458 INFO:tasks.workunit.client.1.smithi172.stdout:9/360: rename l10 to d15/d1a/d1e/d34/l74 0 2024-09-20T18:35:40.459 INFO:tasks.workunit.client.0.smithi017.stdout:0/27: rename d4 to d4/d9 22 2024-09-20T18:35:40.461 INFO:tasks.workunit.client.0.smithi017.stdout:9/18: dwrite f4 [0,4194304] 0 2024-09-20T18:35:40.462 INFO:tasks.workunit.client.0.smithi017.stdout:8/28: creat d0/fc x:0 0 0 2024-09-20T18:35:40.469 INFO:tasks.workunit.client.1.smithi172.stdout:5/398: symlink d4/d1f/d26/d2d/d63/d80/l83 0 2024-09-20T18:35:40.471 INFO:tasks.workunit.client.0.smithi017.stdout:0/28: dwrite d4/f6 [0,4194304] 0 2024-09-20T18:35:40.472 INFO:tasks.workunit.client.0.smithi017.stdout:8/29: creat d0/fd x:0 0 0 2024-09-20T18:35:40.474 INFO:tasks.workunit.client.0.smithi017.stdout:9/19: chown l5 4 1 2024-09-20T18:35:40.476 INFO:tasks.workunit.client.0.smithi017.stdout:3/21: rename l8 to l9 0 2024-09-20T18:35:40.480 INFO:tasks.workunit.client.0.smithi017.stdout:0/29: creat d4/fa x:0 0 0 2024-09-20T18:35:40.482 INFO:tasks.workunit.client.1.smithi172.stdout:0/469: truncate d4/d20/f91 337029 0 2024-09-20T18:35:40.483 INFO:tasks.workunit.client.1.smithi172.stdout:7/462: mknod d2/d3/dd/d84/ca2 0 2024-09-20T18:35:40.483 INFO:tasks.workunit.client.0.smithi017.stdout:9/20: dwrite d6/f8 [0,4194304] 0 2024-09-20T18:35:40.485 INFO:tasks.workunit.client.0.smithi017.stdout:3/22: mkdir da 0 2024-09-20T18:35:40.485 INFO:tasks.workunit.client.0.smithi017.stdout:3/23: dread - no filename 2024-09-20T18:35:40.485 INFO:tasks.workunit.client.1.smithi172.stdout:8/373: truncate f0 2855537 0 2024-09-20T18:35:40.486 INFO:tasks.workunit.client.0.smithi017.stdout:0/30: mkdir d4/db 0 2024-09-20T18:35:40.487 INFO:tasks.workunit.client.1.smithi172.stdout:2/320: link d0/d2c/d51/c62 d0/d2c/d3f/d17/d22/d10/c6c 0 2024-09-20T18:35:40.487 INFO:tasks.workunit.client.1.smithi172.stdout:2/321: write d0/d2c/d3f/d17/d18/f32 [2633130,106102] 0 2024-09-20T18:35:40.489 INFO:tasks.workunit.client.1.smithi172.stdout:9/361: rmdir d15/d1f/d2c/d37 39 2024-09-20T18:35:40.491 INFO:tasks.workunit.client.1.smithi172.stdout:4/317: mknod d0/c7c 0 2024-09-20T18:35:40.492 INFO:tasks.workunit.client.1.smithi172.stdout:4/318: write d0/de/d39/f73 [852632,110060] 0 2024-09-20T18:35:40.495 INFO:tasks.workunit.client.1.smithi172.stdout:3/398: getdents d0 0 2024-09-20T18:35:40.497 INFO:tasks.workunit.client.1.smithi172.stdout:6/321: mkdir d0/d18/d65 0 2024-09-20T18:35:40.499 INFO:tasks.workunit.client.1.smithi172.stdout:3/399: dread d0/dc/d6a/d3a/f60 [0,4194304] 0 2024-09-20T18:35:40.500 INFO:tasks.workunit.client.0.smithi017.stdout:3/24: creat da/fb x:0 0 0 2024-09-20T18:35:40.500 INFO:tasks.workunit.client.1.smithi172.stdout:3/400: chown d0/dc/d6a/d3a/f4b 960501 1 2024-09-20T18:35:40.501 INFO:tasks.workunit.client.1.smithi172.stdout:0/470: symlink d4/d5/d2e/d38/la8 0 2024-09-20T18:35:40.501 INFO:tasks.workunit.client.1.smithi172.stdout:0/471: chown d4/d1a/d28/d42 32425 1 2024-09-20T18:35:40.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.488+0000 7fa147211640 1 -- 172.21.15.17:0/3113102822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa140104d20 msgr2=0x7fa140107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:40.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.488+0000 7fa147211640 1 --2- 172.21.15.17:0/3113102822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa140104d20 0x7fa140107110 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa12c0098b0 tx=0x7fa12c02a4d0 comp rx=0 tx=0).stop 2024-09-20T18:35:40.502 INFO:tasks.workunit.client.0.smithi017.stdout:0/31: creat d4/db/fc x:0 0 0 2024-09-20T18:35:40.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.488+0000 7fa147211640 1 -- 172.21.15.17:0/3113102822 shutdown_connections 2024-09-20T18:35:40.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.488+0000 7fa147211640 1 --2- 172.21.15.17:0/3113102822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa140104d20 0x7fa140107110 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:40.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.488+0000 7fa147211640 1 --2- 172.21.15.17:0/3113102822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1401023f0 0x7fa1401047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:40.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.488+0000 7fa147211640 1 -- 172.21.15.17:0/3113102822 >> 172.21.15.17:0/3113102822 conn(0x7fa1400fc010 msgr2=0x7fa1400fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:40.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.488+0000 7fa147211640 1 -- 172.21.15.17:0/3113102822 shutdown_connections 2024-09-20T18:35:40.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.488+0000 7fa147211640 1 -- 172.21.15.17:0/3113102822 wait complete. 2024-09-20T18:35:40.504 INFO:tasks.workunit.client.0.smithi017.stdout:0/32: write d4/f6 [753875,85703] 0 2024-09-20T18:35:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.489+0000 7fa147211640 1 Processor -- start 2024-09-20T18:35:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.489+0000 7fa147211640 1 -- start start 2024-09-20T18:35:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.489+0000 7fa147211640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1401023f0 0x7fa140101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.489+0000 7fa147211640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa140104d20 0x7fa1401003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.490+0000 7fa147211640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa14010a790 con 0x7fa1401023f0 2024-09-20T18:35:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.490+0000 7fa144fad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1401023f0 0x7fa140101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.490+0000 7fa13ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa140104d20 0x7fa1401003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.490+0000 7fa13ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa140104d20 0x7fa1401003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:58282/0 (socket says 172.21.15.17:58282) 2024-09-20T18:35:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.490+0000 7fa13ffff640 1 -- 172.21.15.17:0/3241620866 learned_addr learned my addr 172.21.15.17:0/3241620866 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:35:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.490+0000 7fa147211640 1 -- 172.21.15.17:0/3241620866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa14010a610 con 0x7fa140104d20 2024-09-20T18:35:40.506 INFO:tasks.workunit.client.0.smithi017.stdout:8/30: getdents d0 0 2024-09-20T18:35:40.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.490+0000 7fa144fad640 1 -- 172.21.15.17:0/3241620866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa140104d20 msgr2=0x7fa1401003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:40.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.490+0000 7fa144fad640 1 --2- 172.21.15.17:0/3241620866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa140104d20 0x7fa1401003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:40.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.490+0000 7fa144fad640 1 -- 172.21.15.17:0/3241620866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1401008e0 con 0x7fa1401023f0 2024-09-20T18:35:40.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.490+0000 7fa13ffff640 1 --2- 172.21.15.17:0/3241620866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa140104d20 0x7fa1401003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T18:35:40.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.491+0000 7fa144fad640 1 --2- 172.21.15.17:0/3241620866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1401023f0 0x7fa140101ce0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa13400e970 tx=0x7fa13400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:40.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.491+0000 7fa13dffb640 1 -- 172.21.15.17:0/3241620866 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa13400cac0 con 0x7fa1401023f0 2024-09-20T18:35:40.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.491+0000 7fa13dffb640 1 -- 172.21.15.17:0/3241620866 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa13400cc60 con 0x7fa1401023f0 2024-09-20T18:35:40.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.491+0000 7fa13dffb640 1 -- 172.21.15.17:0/3241620866 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa134018720 con 0x7fa1401023f0 2024-09-20T18:35:40.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.491+0000 7fa147211640 1 -- 172.21.15.17:0/3241620866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa140100bd0 con 0x7fa1401023f0 2024-09-20T18:35:40.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.491+0000 7fa147211640 1 -- 172.21.15.17:0/3241620866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa140101160 con 0x7fa1401023f0 2024-09-20T18:35:40.508 INFO:tasks.workunit.client.0.smithi017.stdout:3/25: chown l1 1 1 2024-09-20T18:35:40.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.493+0000 7fa147211640 1 -- 172.21.15.17:0/3241620866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1401027d0 con 0x7fa1401023f0 2024-09-20T18:35:40.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.494+0000 7fa13dffb640 1 -- 172.21.15.17:0/3241620866 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fa134010430 con 0x7fa1401023f0 2024-09-20T18:35:40.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.495+0000 7fa13dffb640 1 --2- 172.21.15.17:0/3241620866 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fa130074a30 0x7fa130076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:40.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.495+0000 7fa13dffb640 1 -- 172.21.15.17:0/3241620866 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7fa1340967b0 con 0x7fa1401023f0 2024-09-20T18:35:40.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.495+0000 7fa13ffff640 1 --2- 172.21.15.17:0/3241620866 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fa130074a30 0x7fa130076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:40.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.496+0000 7fa13ffff640 1 --2- 172.21.15.17:0/3241620866 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fa130074a30 0x7fa130076ef0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa12c0096c0 tx=0x7fa12c0058d0 comp rx=0 tx=0).ready entity=mgr.24405 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:40.510 INFO:tasks.workunit.client.1.smithi172.stdout:2/322: creat d0/d2c/d3f/d17/d22/d10/d3c/f6d x:0 0 0 2024-09-20T18:35:40.512 INFO:tasks.workunit.client.0.smithi017.stdout:0/33: creat d4/db/fd x:0 0 0 2024-09-20T18:35:40.512 INFO:tasks.workunit.client.0.smithi017.stdout:9/21: truncate d6/f8 1122632 0 2024-09-20T18:35:40.513 INFO:tasks.workunit.client.0.smithi017.stdout:0/34: chown l1 0 1 2024-09-20T18:35:40.515 INFO:tasks.workunit.client.0.smithi017.stdout:0/35: write d4/fa [119406,71052] 0 2024-09-20T18:35:40.515 INFO:tasks.workunit.client.0.smithi017.stdout:8/31: write d0/fb [2971217,13515] 0 2024-09-20T18:35:40.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.502+0000 7fa13dffb640 1 -- 172.21.15.17:0/3241620866 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fa134061d40 con 0x7fa1401023f0 2024-09-20T18:35:40.517 INFO:tasks.workunit.client.0.smithi017.stdout:3/26: dwrite da/fb [0,4194304] 0 2024-09-20T18:35:40.519 INFO:tasks.workunit.client.0.smithi017.stdout:3/27: write da/fb [2605496,75241] 0 2024-09-20T18:35:40.520 INFO:tasks.workunit.client.0.smithi017.stdout:9/22: fdatasync d6/f8 0 2024-09-20T18:35:40.524 INFO:tasks.workunit.client.0.smithi017.stdout:0/36: creat d4/db/fe x:0 0 0 2024-09-20T18:35:40.528 INFO:tasks.workunit.client.0.smithi017.stdout:8/32: dwrite d0/fa [0,4194304] 0 2024-09-20T18:35:40.529 INFO:tasks.workunit.client.0.smithi017.stdout:0/37: read d4/fa [69502,36445] 0 2024-09-20T18:35:40.530 INFO:tasks.workunit.client.0.smithi017.stdout:3/28: mknod da/cc 0 2024-09-20T18:35:40.531 INFO:tasks.workunit.client.0.smithi017.stdout:3/29: chown c2 26926 1 2024-09-20T18:35:40.532 INFO:tasks.workunit.client.1.smithi172.stdout:0/472: mknod d4/d5/d2e/d76/ca9 0 2024-09-20T18:35:40.532 INFO:tasks.workunit.client.0.smithi017.stdout:3/30: fdatasync da/fb 0 2024-09-20T18:35:40.533 INFO:tasks.workunit.client.0.smithi017.stdout:3/31: fdatasync da/fb 0 2024-09-20T18:35:40.533 INFO:tasks.workunit.client.1.smithi172.stdout:0/473: readlink d4/d1a/l63 0 2024-09-20T18:35:40.534 INFO:tasks.workunit.client.1.smithi172.stdout:5/399: dwrite d4/d1f/d26/d2d/d50/d2c/f82 [0,4194304] 0 2024-09-20T18:35:40.536 INFO:tasks.workunit.client.1.smithi172.stdout:7/463: creat d2/d23/d3a/d72/d9b/fa3 x:0 0 0 2024-09-20T18:35:40.536 INFO:tasks.workunit.client.1.smithi172.stdout:0/474: dread - d4/d5/d2e/d67/d8c/fa5 zero size 2024-09-20T18:35:40.538 INFO:tasks.workunit.client.1.smithi172.stdout:1/349: creat d0/d8/db/f78 x:0 0 0 2024-09-20T18:35:40.540 INFO:tasks.workunit.client.0.smithi017.stdout:0/38: creat d4/ff x:0 0 0 2024-09-20T18:35:40.541 INFO:tasks.workunit.client.0.smithi017.stdout:0/39: dread - d4/ff zero size 2024-09-20T18:35:40.545 INFO:tasks.workunit.client.1.smithi172.stdout:3/401: dwrite d0/f7 [0,4194304] 0 2024-09-20T18:35:40.545 INFO:tasks.workunit.client.0.smithi017.stdout:9/23: link f4 d6/fb 0 2024-09-20T18:35:40.546 INFO:tasks.workunit.client.0.smithi017.stdout:9/24: write d6/f7 [17105,69252] 0 2024-09-20T18:35:40.547 INFO:tasks.workunit.client.1.smithi172.stdout:9/362: creat d15/d1a/d64/f75 x:0 0 0 2024-09-20T18:35:40.548 INFO:tasks.workunit.client.0.smithi017.stdout:3/32: creat da/fd x:0 0 0 2024-09-20T18:35:40.550 INFO:tasks.workunit.client.1.smithi172.stdout:4/319: symlink d0/de/l7d 0 2024-09-20T18:35:40.559 INFO:tasks.workunit.client.1.smithi172.stdout:6/322: truncate d0/f36 282371 0 2024-09-20T18:35:40.561 INFO:tasks.workunit.client.0.smithi017.stdout:9/25: rename f3 to d6/fc 0 2024-09-20T18:35:40.562 INFO:tasks.workunit.client.0.smithi017.stdout:0/40: write d4/fa [1188570,63640] 0 2024-09-20T18:35:40.564 INFO:tasks.workunit.client.0.smithi017.stdout:0/41: read - d4/db/fc zero size 2024-09-20T18:35:40.565 INFO:tasks.workunit.client.1.smithi172.stdout:6/323: dwrite d0/d18/d1c/d22/d27/f2f [4194304,4194304] 0 2024-09-20T18:35:40.570 INFO:tasks.workunit.client.1.smithi172.stdout:7/464: chown d2/d3/dd/f4c 13265450 1 2024-09-20T18:35:40.571 INFO:tasks.workunit.client.0.smithi017.stdout:3/33: dwrite da/fd [0,4194304] 0 2024-09-20T18:35:40.571 INFO:tasks.workunit.client.1.smithi172.stdout:7/465: write d2/d3/d10/d40/d46/d8e/f6f [493560,51139] 0 2024-09-20T18:35:40.573 INFO:tasks.workunit.client.1.smithi172.stdout:0/475: mknod d4/d1d/d15/caa 0 2024-09-20T18:35:40.574 INFO:tasks.workunit.client.1.smithi172.stdout:0/476: write d4/d1a/d28/d88/fa2 [182762,111701] 0 2024-09-20T18:35:40.575 INFO:tasks.workunit.client.1.smithi172.stdout:0/477: write d4/d5/d2e/f95 [1667893,4765] 0 2024-09-20T18:35:40.583 INFO:tasks.workunit.client.1.smithi172.stdout:3/402: chown d0/dc/d6a/d3a/c57 297026 1 2024-09-20T18:35:40.584 INFO:tasks.workunit.client.1.smithi172.stdout:5/400: write d4/d1f/d26/f2a [3347568,85100] 0 2024-09-20T18:35:40.585 INFO:tasks.workunit.client.1.smithi172.stdout:9/363: mkdir d15/d20/d76 0 2024-09-20T18:35:40.585 INFO:tasks.workunit.client.1.smithi172.stdout:5/401: write d4/df/d3f/f75 [498628,4403] 0 2024-09-20T18:35:40.586 INFO:tasks.workunit.client.1.smithi172.stdout:5/402: chown d4/d1f/d26/d2d/d50/f1e 10136 1 2024-09-20T18:35:40.587 INFO:tasks.workunit.client.1.smithi172.stdout:5/403: chown d4 0 1 2024-09-20T18:35:40.592 INFO:tasks.workunit.client.1.smithi172.stdout:0/478: mkdir d4/d44/dab 0 2024-09-20T18:35:40.593 INFO:tasks.workunit.client.1.smithi172.stdout:0/479: read d4/d5/f2f [189293,78101] 0 2024-09-20T18:35:40.593 INFO:tasks.workunit.client.1.smithi172.stdout:1/350: creat d0/d8/db/d25/d6f/f79 x:0 0 0 2024-09-20T18:35:40.596 INFO:tasks.workunit.client.1.smithi172.stdout:2/323: creat d0/d2c/d3f/d17/d18/f6e x:0 0 0 2024-09-20T18:35:40.598 INFO:tasks.workunit.client.1.smithi172.stdout:9/364: write f6 [1272018,36734] 0 2024-09-20T18:35:40.601 INFO:tasks.workunit.client.1.smithi172.stdout:6/324: unlink d0/d18/c28 0 2024-09-20T18:35:40.604 INFO:tasks.workunit.client.1.smithi172.stdout:7/466: dwrite d2/d3/d3d/d4e/d5f/f61 [0,4194304] 0 2024-09-20T18:35:40.607 INFO:tasks.workunit.client.1.smithi172.stdout:9/365: creat d15/d1a/d1e/d24/f77 x:0 0 0 2024-09-20T18:35:40.610 INFO:tasks.workunit.client.1.smithi172.stdout:8/374: sync 2024-09-20T18:35:40.612 INFO:tasks.workunit.client.1.smithi172.stdout:2/324: dwrite d0/d2c/d3f/d17/d22/d4c/f5e [0,4194304] 0 2024-09-20T18:35:40.612 INFO:tasks.workunit.client.1.smithi172.stdout:8/375: write dd/d1b/d3b/d51/d34/f5c [3696093,121636] 0 2024-09-20T18:35:40.618 INFO:tasks.workunit.client.1.smithi172.stdout:0/480: mkdir d4/d1d/dac 0 2024-09-20T18:35:40.618 INFO:tasks.workunit.client.1.smithi172.stdout:0/481: stat d4/f86 0 2024-09-20T18:35:40.620 INFO:tasks.workunit.client.1.smithi172.stdout:7/467: symlink d2/d3/d10/d40/d6a/la4 0 2024-09-20T18:35:40.624 INFO:tasks.workunit.client.1.smithi172.stdout:3/403: rename d0/dc/d6a/d3a/c57 to d0/dc/c7b 0 2024-09-20T18:35:40.625 INFO:tasks.workunit.client.1.smithi172.stdout:9/366: chown d15/d1a/l30 1 1 2024-09-20T18:35:40.626 INFO:tasks.workunit.client.1.smithi172.stdout:9/367: read f6 [525096,121712] 0 2024-09-20T18:35:40.626 INFO:tasks.workunit.client.1.smithi172.stdout:4/320: link d0/de/d21/d24/d34/d72/d15/l26 d0/de/d21/d24/d34/d72/d15/d55/d53/d78/l7e 0 2024-09-20T18:35:40.627 INFO:tasks.workunit.client.1.smithi172.stdout:4/321: write d0/de/d21/d24/d34/d72/d15/d55/d53/d5c/f75 [699317,6713] 0 2024-09-20T18:35:40.628 INFO:tasks.workunit.client.1.smithi172.stdout:4/322: dread - d0/de/d21/d24/d34/d72/f70 zero size 2024-09-20T18:35:40.629 INFO:tasks.workunit.client.1.smithi172.stdout:6/325: symlink d0/d18/d65/l66 0 2024-09-20T18:35:40.635 INFO:tasks.workunit.client.1.smithi172.stdout:0/482: creat d4/d1a/d28/d42/fad x:0 0 0 2024-09-20T18:35:40.637 INFO:tasks.workunit.client.1.smithi172.stdout:7/468: mknod d2/d3/d3d/d68/ca5 0 2024-09-20T18:35:40.637 INFO:tasks.workunit.client.1.smithi172.stdout:5/404: truncate d4/d1f/d26/d2d/d50/f6d 33635 0 2024-09-20T18:35:40.640 INFO:tasks.workunit.client.1.smithi172.stdout:1/351: rename d0/d8/db/f78 to d0/d22/f7a 0 2024-09-20T18:35:40.642 INFO:tasks.workunit.client.1.smithi172.stdout:3/404: unlink d0/dc/d6a/l26 0 2024-09-20T18:35:40.645 INFO:tasks.workunit.client.1.smithi172.stdout:7/469: dwrite d2/d3/d10/f96 [0,4194304] 0 2024-09-20T18:35:40.645 INFO:tasks.workunit.client.1.smithi172.stdout:5/405: dwrite d4/d1f/d26/f2a [0,4194304] 0 2024-09-20T18:35:40.648 INFO:tasks.workunit.client.1.smithi172.stdout:5/406: fsync d4/df/d3f/d64/f7b 0 2024-09-20T18:35:40.652 INFO:tasks.workunit.client.1.smithi172.stdout:1/352: dwrite d0/f5a [0,4194304] 0 2024-09-20T18:35:40.655 INFO:tasks.workunit.client.1.smithi172.stdout:1/353: write d0/d8/db/d25/f49 [921091,27450] 0 2024-09-20T18:35:40.659 INFO:tasks.workunit.client.1.smithi172.stdout:0/483: rmdir d4/d1a/d28/d75 39 2024-09-20T18:35:40.659 INFO:tasks.workunit.client.1.smithi172.stdout:2/325: write d0/d1a/f20 [1271067,24430] 0 2024-09-20T18:35:40.661 INFO:tasks.workunit.client.1.smithi172.stdout:0/484: dread d4/d5/d2e/f49 [0,4194304] 0 2024-09-20T18:35:40.663 INFO:tasks.workunit.client.1.smithi172.stdout:6/326: dwrite d0/d18/d1c/d21/d26/d34/d39/d46/f20 [4194304,4194304] 0 2024-09-20T18:35:40.676 INFO:tasks.workunit.client.1.smithi172.stdout:9/368: write d15/d1a/f26 [632097,66556] 0 2024-09-20T18:35:40.680 INFO:tasks.workunit.client.1.smithi172.stdout:7/470: fsync d2/d3/dd/f4c 0 2024-09-20T18:35:40.682 INFO:tasks.workunit.client.1.smithi172.stdout:7/471: read - d2/d23/d3a/d72/d9b/fa3 zero size 2024-09-20T18:35:40.684 INFO:tasks.workunit.client.1.smithi172.stdout:4/323: dwrite d0/d7/f62 [0,4194304] 0 2024-09-20T18:35:40.684 INFO:tasks.workunit.client.1.smithi172.stdout:5/407: rmdir d4/d1f/d26/d2d/d50 39 2024-09-20T18:35:40.684 INFO:tasks.workunit.client.1.smithi172.stdout:7/472: write d2/d23/d3a/f5c [884461,115558] 0 2024-09-20T18:35:40.685 INFO:tasks.workunit.client.1.smithi172.stdout:4/324: chown d0/de/d21/l66 3922023 1 2024-09-20T18:35:40.689 INFO:tasks.workunit.client.1.smithi172.stdout:1/354: symlink d0/d8/db/d25/d6d/l7b 0 2024-09-20T18:35:40.690 INFO:tasks.workunit.client.1.smithi172.stdout:1/355: write d0/d8/db/d25/d2b/d3d/f76 [363576,1118] 0 2024-09-20T18:35:40.691 INFO:tasks.workunit.client.1.smithi172.stdout:8/376: creat dd/d1b/d3b/d51/f89 x:0 0 0 2024-09-20T18:35:40.699 INFO:tasks.workunit.client.1.smithi172.stdout:0/485: mknod d4/d5/d2e/d38/cae 0 2024-09-20T18:35:40.702 INFO:tasks.workunit.client.1.smithi172.stdout:6/327: symlink d0/d18/d65/l67 0 2024-09-20T18:35:40.702 INFO:tasks.workunit.client.1.smithi172.stdout:6/328: write d0/d18/d1c/d21/d26/f45 [2831375,15153] 0 2024-09-20T18:35:40.705 INFO:tasks.workunit.client.1.smithi172.stdout:9/369: creat d15/d54/f78 x:0 0 0 2024-09-20T18:35:40.707 INFO:tasks.workunit.client.1.smithi172.stdout:9/370: write d15/d54/f78 [352408,51087] 0 2024-09-20T18:35:40.708 INFO:tasks.workunit.client.1.smithi172.stdout:9/371: read - d15/d1a/d64/f75 zero size 2024-09-20T18:35:40.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:40 smithi172 ceph-mon[35456]: pgmap v24: 65 pgs: 65 active+clean; 732 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 11 MiB/s rd, 84 MiB/s wr, 413 op/s 2024-09-20T18:35:40.709 INFO:tasks.workunit.client.1.smithi172.stdout:6/329: dwrite d0/d18/d1c/d22/d27/d35/f4f [0,4194304] 0 2024-09-20T18:35:40.712 INFO:tasks.workunit.client.1.smithi172.stdout:7/473: mknod d2/d23/d3c/ca6 0 2024-09-20T18:35:40.715 INFO:tasks.workunit.client.1.smithi172.stdout:4/325: rename d0/de/f30 to d0/de/dc/f7f 0 2024-09-20T18:35:40.721 INFO:tasks.workunit.client.1.smithi172.stdout:8/377: symlink dd/d1b/d3b/d51/d5b/d6b/l8a 0 2024-09-20T18:35:40.727 INFO:tasks.workunit.client.1.smithi172.stdout:9/372: creat d15/d1a/d1e/d48/f79 x:0 0 0 2024-09-20T18:35:40.729 INFO:tasks.workunit.client.1.smithi172.stdout:5/408: creat d4/d1f/d26/d2d/d50/f84 x:0 0 0 2024-09-20T18:35:40.733 INFO:tasks.workunit.client.1.smithi172.stdout:7/474: readlink d2/d3/d10/d40/l89 0 2024-09-20T18:35:40.734 INFO:tasks.workunit.client.1.smithi172.stdout:7/475: readlink d2/d3/d10/d40/d46/l5b 0 2024-09-20T18:35:40.735 INFO:tasks.workunit.client.1.smithi172.stdout:5/409: dwrite d4/d1f/d26/d2d/d50/f5d [0,4194304] 0 2024-09-20T18:35:40.775 INFO:tasks.workunit.client.1.smithi172.stdout:2/326: rename d0/d2c/d51/l5a to d0/d2c/d3f/d17/d18/d29/d42/l6f 0 2024-09-20T18:35:40.777 INFO:tasks.workunit.client.1.smithi172.stdout:4/326: creat d0/de/d21/f80 x:0 0 0 2024-09-20T18:35:40.785 INFO:tasks.workunit.client.1.smithi172.stdout:3/405: getdents d0/d13/d58/d6d 0 2024-09-20T18:35:40.786 INFO:tasks.workunit.client.1.smithi172.stdout:9/373: mkdir d15/d1a/d6f/d7a 0 2024-09-20T18:35:40.787 INFO:tasks.workunit.client.1.smithi172.stdout:9/374: fdatasync d15/d54/f78 0 2024-09-20T18:35:40.788 INFO:tasks.workunit.client.1.smithi172.stdout:6/330: truncate d0/f36 1203221 0 2024-09-20T18:35:40.789 INFO:tasks.workunit.client.1.smithi172.stdout:6/331: write d0/d18/d1c/d21/d26/d34/d39/d46/f2a [1852779,18174] 0 2024-09-20T18:35:40.794 INFO:tasks.workunit.client.1.smithi172.stdout:5/410: symlink d4/df/d3f/l85 0 2024-09-20T18:35:40.795 INFO:tasks.workunit.client.1.smithi172.stdout:3/406: dread d0/dc/f2b [0,4194304] 0 2024-09-20T18:35:40.796 INFO:tasks.workunit.client.1.smithi172.stdout:3/407: readlink d0/d13/l21 0 2024-09-20T18:35:40.798 INFO:tasks.workunit.client.1.smithi172.stdout:4/327: creat d0/de/dc/f81 x:0 0 0 2024-09-20T18:35:40.801 INFO:tasks.workunit.client.1.smithi172.stdout:3/408: dwrite d0/dc/d6a/f3e [4194304,4194304] 0 2024-09-20T18:35:40.801 INFO:tasks.workunit.client.1.smithi172.stdout:8/378: creat dd/d65/d85/f8b x:0 0 0 2024-09-20T18:35:40.803 INFO:tasks.workunit.client.1.smithi172.stdout:0/486: write d4/d20/f91 [640416,41094] 0 2024-09-20T18:35:40.809 INFO:tasks.workunit.client.1.smithi172.stdout:6/332: write d0/d18/f23 [4763942,60288] 0 2024-09-20T18:35:40.810 INFO:tasks.workunit.client.1.smithi172.stdout:1/356: dwrite d0/d8/db/f1b [0,4194304] 0 2024-09-20T18:35:40.813 INFO:tasks.workunit.client.1.smithi172.stdout:8/379: dwrite dd/d65/d85/f8b [0,4194304] 0 2024-09-20T18:35:40.820 INFO:tasks.workunit.client.1.smithi172.stdout:2/327: dwrite d0/d4e/d59/f5c [0,4194304] 0 2024-09-20T18:35:40.820 INFO:tasks.workunit.client.1.smithi172.stdout:0/487: creat d4/d44/faf x:0 0 0 2024-09-20T18:35:40.821 INFO:tasks.workunit.client.1.smithi172.stdout:0/488: stat d4/d1d/dac 0 2024-09-20T18:35:40.822 INFO:tasks.workunit.client.1.smithi172.stdout:8/380: dread dd/d1b/f55 [0,4194304] 0 2024-09-20T18:35:40.823 INFO:tasks.workunit.client.1.smithi172.stdout:7/476: creat d2/d3/fa7 x:0 0 0 2024-09-20T18:35:40.824 INFO:tasks.workunit.client.1.smithi172.stdout:5/411: mkdir d4/d1f/d26/d2d/d86 0 2024-09-20T18:35:40.824 INFO:tasks.workunit.client.1.smithi172.stdout:7/477: fsync d2/f54 0 2024-09-20T18:35:40.826 INFO:tasks.workunit.client.1.smithi172.stdout:6/333: unlink d0/d18/d1c/c33 0 2024-09-20T18:35:40.828 INFO:tasks.workunit.client.1.smithi172.stdout:6/334: fdatasync d0/d18/d1c/d21/d26/f5f 0 2024-09-20T18:35:40.833 INFO:tasks.workunit.client.1.smithi172.stdout:3/409: mknod d0/dc/c7c 0 2024-09-20T18:35:40.840 INFO:tasks.workunit.client.1.smithi172.stdout:8/381: dread fa [0,4194304] 0 2024-09-20T18:35:40.843 INFO:tasks.workunit.client.1.smithi172.stdout:0/489: mknod d4/d1a/d28/d42/cb0 0 2024-09-20T18:35:40.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.831+0000 7fa147211640 1 -- 172.21.15.17:0/3241620866 --> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa140105780 con 0x7fa130074a30 2024-09-20T18:35:40.846 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:40 smithi017 ceph-mon[28058]: pgmap v24: 65 pgs: 65 active+clean; 732 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 11 MiB/s rd, 84 MiB/s wr, 413 op/s 2024-09-20T18:35:40.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.833+0000 7fa13dffb640 1 -- 172.21.15.17:0/3241620866 <== mgr.24405 v2:172.21.15.172:6828/3016443347 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7fa140105780 con 0x7fa130074a30 2024-09-20T18:35:40.847 INFO:tasks.workunit.client.1.smithi172.stdout:0/490: dread d4/d1d/d15/f69 [0,4194304] 0 2024-09-20T18:35:40.848 INFO:tasks.workunit.client.1.smithi172.stdout:0/491: chown d4/d1a/d28/d42/fad 64585085 1 2024-09-20T18:35:40.848 INFO:tasks.workunit.client.1.smithi172.stdout:0/492: write d4/d1a/d28/d42/fad [966232,116976] 0 2024-09-20T18:35:40.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.836+0000 7fa147211640 1 -- 172.21.15.17:0/3241620866 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fa130074a30 msgr2=0x7fa130076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:40.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.836+0000 7fa147211640 1 --2- 172.21.15.17:0/3241620866 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fa130074a30 0x7fa130076ef0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa12c0096c0 tx=0x7fa12c0058d0 comp rx=0 tx=0).stop 2024-09-20T18:35:40.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.836+0000 7fa147211640 1 -- 172.21.15.17:0/3241620866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1401023f0 msgr2=0x7fa140101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:40.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.836+0000 7fa147211640 1 --2- 172.21.15.17:0/3241620866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1401023f0 0x7fa140101ce0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa13400e970 tx=0x7fa13400ee30 comp rx=0 tx=0).stop 2024-09-20T18:35:40.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.836+0000 7fa147211640 1 -- 172.21.15.17:0/3241620866 shutdown_connections 2024-09-20T18:35:40.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.836+0000 7fa147211640 1 --2- 172.21.15.17:0/3241620866 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fa130074a30 0x7fa130076ef0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:40.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.836+0000 7fa147211640 1 --2- 172.21.15.17:0/3241620866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa140104d20 0x7fa1401003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:40.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.836+0000 7fa147211640 1 --2- 172.21.15.17:0/3241620866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1401023f0 0x7fa140101ce0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:40.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.836+0000 7fa147211640 1 -- 172.21.15.17:0/3241620866 >> 172.21.15.17:0/3241620866 conn(0x7fa1400fc010 msgr2=0x7fa1400fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:40.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.836+0000 7fa147211640 1 -- 172.21.15.17:0/3241620866 shutdown_connections 2024-09-20T18:35:40.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.836+0000 7fa147211640 1 -- 172.21.15.17:0/3241620866 wait complete. 2024-09-20T18:35:40.855 INFO:tasks.workunit.client.1.smithi172.stdout:3/410: rename d0/dc/d6a/d3a/f4b to d0/dc/d6a/d3a/f7d 0 2024-09-20T18:35:40.858 INFO:tasks.workunit.client.1.smithi172.stdout:9/375: link d15/d1a/l23 d15/d1a/l7b 0 2024-09-20T18:35:40.861 INFO:tasks.workunit.client.1.smithi172.stdout:4/328: dwrite d0/fa [0,4194304] 0 2024-09-20T18:35:40.862 INFO:tasks.workunit.client.1.smithi172.stdout:0/493: dread d4/d5/d2e/d33/f5a [0,4194304] 0 2024-09-20T18:35:40.863 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:35:40.872 INFO:tasks.workunit.client.1.smithi172.stdout:7/478: write d2/f25 [792536,50071] 0 2024-09-20T18:35:40.875 INFO:tasks.workunit.client.1.smithi172.stdout:1/357: rename d0/d8/db/d25/d2b/d3d/d65/f71 to d0/f7c 0 2024-09-20T18:35:40.879 INFO:tasks.workunit.client.1.smithi172.stdout:3/411: symlink d0/l7e 0 2024-09-20T18:35:40.884 INFO:tasks.workunit.client.1.smithi172.stdout:8/382: write dd/d1b/f23 [640509,72048] 0 2024-09-20T18:35:40.888 INFO:tasks.workunit.client.1.smithi172.stdout:9/376: dread f6 [0,4194304] 0 2024-09-20T18:35:40.889 INFO:tasks.workunit.client.1.smithi172.stdout:4/329: mkdir d0/de/dc/d82 0 2024-09-20T18:35:40.890 INFO:tasks.workunit.client.1.smithi172.stdout:2/328: truncate d0/f3 1947913 0 2024-09-20T18:35:40.891 INFO:tasks.workunit.client.1.smithi172.stdout:2/329: write d0/d2c/d3f/d17/d18/d29/d42/d4b/d53/f5b [942856,8483] 0 2024-09-20T18:35:40.891 INFO:tasks.workunit.client.1.smithi172.stdout:2/330: fdatasync d0/d60/f69 0 2024-09-20T18:35:40.892 INFO:tasks.workunit.client.0.smithi017.stdout:9/26: symlink d6/ld 0 2024-09-20T18:35:40.894 INFO:tasks.workunit.client.1.smithi172.stdout:6/335: write d0/f36 [1300126,94257] 0 2024-09-20T18:35:40.895 INFO:tasks.workunit.client.0.smithi017.stdout:0/42: symlink d4/db/l10 0 2024-09-20T18:35:40.896 INFO:tasks.workunit.client.1.smithi172.stdout:7/479: fsync d2/d3/f35 0 2024-09-20T18:35:40.897 INFO:tasks.workunit.client.0.smithi017.stdout:3/34: mkdir da/de 0 2024-09-20T18:35:40.899 INFO:tasks.workunit.client.0.smithi017.stdout:9/27: creat d6/fe x:0 0 0 2024-09-20T18:35:40.899 INFO:tasks.workunit.client.1.smithi172.stdout:6/336: dwrite d0/fe [4194304,4194304] 0 2024-09-20T18:35:40.900 INFO:tasks.workunit.client.1.smithi172.stdout:6/337: write d0/d18/f29 [3455445,119120] 0 2024-09-20T18:35:40.901 INFO:tasks.workunit.client.1.smithi172.stdout:1/358: symlink d0/d8/db/d25/d2b/d3d/d65/l7d 0 2024-09-20T18:35:40.903 INFO:tasks.workunit.client.1.smithi172.stdout:6/338: chown d0/d18/d1c/d21/d26/d34/d39/d46/l41 1 1 2024-09-20T18:35:40.904 INFO:tasks.workunit.client.0.smithi017.stdout:3/35: mknod da/cf 0 2024-09-20T18:35:40.905 INFO:tasks.workunit.client.1.smithi172.stdout:6/339: write d0/d18/d1c/d21/d26/f45 [978949,18812] 0 2024-09-20T18:35:40.905 INFO:tasks.workunit.client.1.smithi172.stdout:8/383: rmdir dd/d1b/d3b 39 2024-09-20T18:35:40.906 INFO:tasks.workunit.client.1.smithi172.stdout:6/340: stat d0/d18/d1c/d22/d47 0 2024-09-20T18:35:40.907 INFO:tasks.workunit.client.0.smithi017.stdout:9/28: creat d6/ff x:0 0 0 2024-09-20T18:35:40.908 INFO:tasks.workunit.client.0.smithi017.stdout:9/29: write d6/ff [997099,61202] 0 2024-09-20T18:35:40.909 INFO:tasks.workunit.client.1.smithi172.stdout:6/341: dread d0/fc [4194304,4194304] 0 2024-09-20T18:35:40.909 INFO:tasks.workunit.client.1.smithi172.stdout:9/377: rename d15/d1a/d1e/l51 to d15/d1a/d1e/l7c 0 2024-09-20T18:35:40.909 INFO:tasks.workunit.client.0.smithi017.stdout:9/30: truncate d6/f8 1147897 0 2024-09-20T18:35:40.910 INFO:tasks.workunit.client.1.smithi172.stdout:6/342: stat d0/d18/d1c/d21 0 2024-09-20T18:35:40.911 INFO:tasks.workunit.client.1.smithi172.stdout:4/330: creat d0/de/d21/d24/d34/d72/d15/d55/d53/f83 x:0 0 0 2024-09-20T18:35:40.912 INFO:tasks.workunit.client.1.smithi172.stdout:4/331: readlink d0/de/lb 0 2024-09-20T18:35:40.913 INFO:tasks.workunit.client.0.smithi017.stdout:3/36: mknod da/c10 0 2024-09-20T18:35:40.917 INFO:tasks.workunit.client.0.smithi017.stdout:3/37: dread da/fb [0,4194304] 0 2024-09-20T18:35:40.918 INFO:tasks.workunit.client.1.smithi172.stdout:6/343: dwrite d0/d18/f23 [0,4194304] 0 2024-09-20T18:35:40.918 INFO:tasks.workunit.client.0.smithi017.stdout:9/31: fsync d6/fb 0 2024-09-20T18:35:40.920 INFO:tasks.workunit.client.1.smithi172.stdout:1/359: dread d0/d8/db/d25/d2b/f2d [0,4194304] 0 2024-09-20T18:35:40.921 INFO:tasks.workunit.client.1.smithi172.stdout:4/332: dwrite d0/de/f4c [0,4194304] 0 2024-09-20T18:35:40.921 INFO:tasks.workunit.client.0.smithi017.stdout:0/43: getdents d4/db 0 2024-09-20T18:35:40.922 INFO:tasks.workunit.client.1.smithi172.stdout:1/360: fdatasync d0/d8/db/d25/d2b/d3d/d65/f66 0 2024-09-20T18:35:40.922 INFO:tasks.workunit.client.0.smithi017.stdout:3/38: dread da/fb [0,4194304] 0 2024-09-20T18:35:40.923 INFO:tasks.workunit.client.0.smithi017.stdout:3/39: chown c2 0 1 2024-09-20T18:35:40.924 INFO:tasks.workunit.client.1.smithi172.stdout:2/331: rename d0/d1a/f25 to d0/d2c/f70 0 2024-09-20T18:35:40.925 INFO:tasks.workunit.client.1.smithi172.stdout:2/332: chown d0/d2c/d3f/d17/d18/d29/d42/d4b 868153 1 2024-09-20T18:35:40.927 INFO:tasks.workunit.client.1.smithi172.stdout:5/412: getdents d4/d1f/d26/d41/d69 0 2024-09-20T18:35:40.930 INFO:tasks.workunit.client.0.smithi017.stdout:3/40: dread da/fb [0,4194304] 0 2024-09-20T18:35:40.932 INFO:tasks.workunit.client.0.smithi017.stdout:9/32: unlink d6/fc 0 2024-09-20T18:35:40.934 INFO:tasks.workunit.client.0.smithi017.stdout:0/44: unlink l1 0 2024-09-20T18:35:40.937 INFO:tasks.workunit.client.1.smithi172.stdout:0/494: truncate d4/d1a/d28/d42/d45/d54/f5d 209974 0 2024-09-20T18:35:40.938 INFO:tasks.workunit.client.0.smithi017.stdout:9/33: mknod d6/c10 0 2024-09-20T18:35:40.938 INFO:tasks.workunit.client.0.smithi017.stdout:9/34: chown d6 778 1 2024-09-20T18:35:40.939 INFO:tasks.workunit.client.0.smithi017.stdout:0/45: creat d4/f11 x:0 0 0 2024-09-20T18:35:40.942 INFO:tasks.workunit.client.0.smithi017.stdout:9/35: mkdir d6/d11 0 2024-09-20T18:35:40.943 INFO:tasks.workunit.client.1.smithi172.stdout:9/378: readlink d15/d1a/d1e/l7c 0 2024-09-20T18:35:40.944 INFO:tasks.workunit.client.0.smithi017.stdout:3/41: link l1 da/l11 0 2024-09-20T18:35:40.947 INFO:tasks.workunit.client.0.smithi017.stdout:3/42: write da/fd [4179625,40925] 0 2024-09-20T18:35:40.947 INFO:tasks.workunit.client.1.smithi172.stdout:6/344: symlink d0/d18/d1c/d21/l68 0 2024-09-20T18:35:40.947 INFO:tasks.workunit.client.1.smithi172.stdout:4/333: mknod d0/de/d39/c84 0 2024-09-20T18:35:40.949 INFO:tasks.workunit.client.1.smithi172.stdout:4/334: write d0/f71 [962373,56172] 0 2024-09-20T18:35:40.949 INFO:tasks.workunit.client.0.smithi017.stdout:0/46: dwrite d4/fa [0,4194304] 0 2024-09-20T18:35:40.952 INFO:tasks.workunit.client.0.smithi017.stdout:9/36: creat d6/d11/f12 x:0 0 0 2024-09-20T18:35:40.952 INFO:tasks.workunit.client.1.smithi172.stdout:4/335: dread d0/de/d21/d24/d34/d72/f70 [0,4194304] 0 2024-09-20T18:35:40.953 INFO:tasks.workunit.client.1.smithi172.stdout:4/336: read - d0/de/d21/d24/d34/d72/d18/f3a zero size 2024-09-20T18:35:40.954 INFO:tasks.workunit.client.1.smithi172.stdout:4/337: chown d0/de/f4c 3108020 1 2024-09-20T18:35:40.954 INFO:tasks.workunit.client.0.smithi017.stdout:0/47: dread d4/f8 [0,4194304] 0 2024-09-20T18:35:40.955 INFO:tasks.workunit.client.0.smithi017.stdout:0/48: chown d4/db/l10 4436 1 2024-09-20T18:35:40.957 INFO:tasks.workunit.client.0.smithi017.stdout:0/49: truncate d4/db/fe 253672 0 2024-09-20T18:35:40.961 INFO:tasks.workunit.client.1.smithi172.stdout:5/413: creat d4/d1f/d26/d2d/d63/d80/f87 x:0 0 0 2024-09-20T18:35:40.962 INFO:tasks.workunit.client.0.smithi017.stdout:9/37: creat d6/d11/f13 x:0 0 0 2024-09-20T18:35:40.966 INFO:tasks.workunit.client.1.smithi172.stdout:5/414: dwrite d4/d1f/d26/f32 [4194304,4194304] 0 2024-09-20T18:35:40.967 INFO:tasks.workunit.client.0.smithi017.stdout:0/50: fsync d4/f11 0 2024-09-20T18:35:40.967 INFO:tasks.workunit.client.1.smithi172.stdout:5/415: fsync d4/d1f/d26/d2d/f73 0 2024-09-20T18:35:40.968 INFO:tasks.workunit.client.1.smithi172.stdout:5/416: fsync d4/d1f/d26/d2d/d50/f3d 0 2024-09-20T18:35:40.970 INFO:tasks.workunit.client.0.smithi017.stdout:3/43: creat da/de/f12 x:0 0 0 2024-09-20T18:35:40.974 INFO:tasks.workunit.client.1.smithi172.stdout:3/412: mkdir d0/d13/d58/d6d/d7f 0 2024-09-20T18:35:40.975 INFO:tasks.workunit.client.0.smithi017.stdout:9/38: rmdir d6/d11 39 2024-09-20T18:35:40.976 INFO:tasks.workunit.client.1.smithi172.stdout:8/384: dread - dd/d1b/d3b/d51/d34/d39/f6e zero size 2024-09-20T18:35:40.990 INFO:tasks.workunit.client.0.smithi017.stdout:0/51: creat d4/db/f12 x:0 0 0 2024-09-20T18:35:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.976+0000 7fc618d6b640 1 -- 172.21.15.17:0/957952730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc614102450 msgr2=0x7fc614104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.976+0000 7fc618d6b640 1 --2- 172.21.15.17:0/957952730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc614102450 0x7fc614104840 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009c20 tx=0x7fc60c02a970 comp rx=0 tx=0).stop 2024-09-20T18:35:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.976+0000 7fc618d6b640 1 -- 172.21.15.17:0/957952730 shutdown_connections 2024-09-20T18:35:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.976+0000 7fc618d6b640 1 --2- 172.21.15.17:0/957952730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc614104d80 0x7fc614107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.976+0000 7fc618d6b640 1 --2- 172.21.15.17:0/957952730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc614102450 0x7fc614104840 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.976+0000 7fc618d6b640 1 -- 172.21.15.17:0/957952730 >> 172.21.15.17:0/957952730 conn(0x7fc6140fc010 msgr2=0x7fc6140fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.977+0000 7fc618d6b640 1 -- 172.21.15.17:0/957952730 shutdown_connections 2024-09-20T18:35:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.977+0000 7fc618d6b640 1 -- 172.21.15.17:0/957952730 wait complete. 2024-09-20T18:35:40.992 INFO:tasks.workunit.client.1.smithi172.stdout:7/480: truncate d2/d3/d10/f96 2369452 0 2024-09-20T18:35:40.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.977+0000 7fc618d6b640 1 Processor -- start 2024-09-20T18:35:40.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.977+0000 7fc618d6b640 1 -- start start 2024-09-20T18:35:40.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.978+0000 7fc618d6b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc614102450 0x7fc614195280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:40.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.978+0000 7fc618d6b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc614104d80 0x7fc6141957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:40.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.978+0000 7fc618d6b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc61410a750 con 0x7fc614102450 2024-09-20T18:35:40.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.978+0000 7fc618d6b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc61410a5d0 con 0x7fc614104d80 2024-09-20T18:35:40.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.978+0000 7fc61259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc614102450 0x7fc614195280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:40.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.978+0000 7fc61259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc614102450 0x7fc614195280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60466/0 (socket says 172.21.15.17:60466) 2024-09-20T18:35:40.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.978+0000 7fc61259c640 1 -- 172.21.15.17:0/1429428982 learned_addr learned my addr 172.21.15.17:0/1429428982 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:35:40.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.978+0000 7fc611d9b640 1 --2- 172.21.15.17:0/1429428982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc614104d80 0x7fc6141957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:40.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.978+0000 7fc61259c640 1 -- 172.21.15.17:0/1429428982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc614104d80 msgr2=0x7fc6141957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:40.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.978+0000 7fc61259c640 1 --2- 172.21.15.17:0/1429428982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc614104d80 0x7fc6141957c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:40.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.978+0000 7fc61259c640 1 -- 172.21.15.17:0/1429428982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc614195e40 con 0x7fc614102450 2024-09-20T18:35:40.994 INFO:tasks.workunit.client.1.smithi172.stdout:4/338: symlink d0/de/d21/d24/d34/d72/d15/d55/d53/d5c/l85 0 2024-09-20T18:35:40.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.979+0000 7fc61259c640 1 --2- 172.21.15.17:0/1429428982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc614102450 0x7fc614195280 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc60c02f6f0 tx=0x7fc60c02f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:40.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.979+0000 7fc6037fe640 1 -- 172.21.15.17:0/1429428982 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc60c047070 con 0x7fc614102450 2024-09-20T18:35:40.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.979+0000 7fc6037fe640 1 -- 172.21.15.17:0/1429428982 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc60c003e30 con 0x7fc614102450 2024-09-20T18:35:40.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.980+0000 7fc6037fe640 1 -- 172.21.15.17:0/1429428982 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc60c034070 con 0x7fc614102450 2024-09-20T18:35:40.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.980+0000 7fc618d6b640 1 -- 172.21.15.17:0/1429428982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61419a880 con 0x7fc614102450 2024-09-20T18:35:40.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.980+0000 7fc618d6b640 1 -- 172.21.15.17:0/1429428982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc61419ae10 con 0x7fc614102450 2024-09-20T18:35:40.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.981+0000 7fc618d6b640 1 -- 172.21.15.17:0/1429428982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc614102830 con 0x7fc614102450 2024-09-20T18:35:40.996 INFO:tasks.workunit.client.0.smithi017.stdout:3/44: truncate da/fb 3860938 0 2024-09-20T18:35:40.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.982+0000 7fc6037fe640 1 -- 172.21.15.17:0/1429428982 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fc60c04a070 con 0x7fc614102450 2024-09-20T18:35:40.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.982+0000 7fc6037fe640 1 --2- 172.21.15.17:0/1429428982 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fc5fc074a60 0x7fc5fc076f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:40.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.983+0000 7fc6037fe640 1 -- 172.21.15.17:0/1429428982 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7fc60c0b7040 con 0x7fc614102450 2024-09-20T18:35:40.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.983+0000 7fc611d9b640 1 --2- 172.21.15.17:0/1429428982 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fc5fc074a60 0x7fc5fc076f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:40.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.984+0000 7fc611d9b640 1 --2- 172.21.15.17:0/1429428982 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fc5fc074a60 0x7fc5fc076f20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc614196730 tx=0x7fc60400b390 comp rx=0 tx=0).ready entity=mgr.24405 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:41.002 INFO:tasks.workunit.client.0.smithi017.stdout:3/45: mkdir da/de/d13 0 2024-09-20T18:35:41.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:40.989+0000 7fc6037fe640 1 -- 172.21.15.17:0/1429428982 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fc60c03f070 con 0x7fc614102450 2024-09-20T18:35:41.004 INFO:tasks.workunit.client.0.smithi017.stdout:9/39: creat d6/f14 x:0 0 0 2024-09-20T18:35:41.004 INFO:tasks.workunit.client.0.smithi017.stdout:9/40: fdatasync d6/fe 0 2024-09-20T18:35:41.005 INFO:tasks.workunit.client.0.smithi017.stdout:9/41: chown d6/f7 11 1 2024-09-20T18:35:41.006 INFO:tasks.workunit.client.0.smithi017.stdout:3/46: mkdir da/de/d14 0 2024-09-20T18:35:41.006 INFO:tasks.workunit.client.0.smithi017.stdout:3/47: read - da/de/f12 zero size 2024-09-20T18:35:41.008 INFO:tasks.workunit.client.0.smithi017.stdout:0/52: readlink l3 0 2024-09-20T18:35:41.008 INFO:tasks.workunit.client.0.smithi017.stdout:0/53: stat d4/db/f12 0 2024-09-20T18:35:41.011 INFO:tasks.workunit.client.1.smithi172.stdout:8/385: creat dd/d1b/d3b/d51/d5b/d6b/f8c x:0 0 0 2024-09-20T18:35:41.014 INFO:tasks.workunit.client.0.smithi017.stdout:3/48: readlink l1 0 2024-09-20T18:35:41.015 INFO:tasks.workunit.client.0.smithi017.stdout:3/49: dread - da/de/f12 zero size 2024-09-20T18:35:41.016 INFO:tasks.workunit.client.1.smithi172.stdout:6/345: dwrite d0/d18/d1c/d22/d27/d35/f4f [4194304,4194304] 0 2024-09-20T18:35:41.017 INFO:tasks.workunit.client.0.smithi017.stdout:9/42: mknod d6/d11/c15 0 2024-09-20T18:35:41.017 INFO:tasks.workunit.client.1.smithi172.stdout:6/346: fdatasync d0/d18/d1c/d21/d26/d34/d39/d46/f7 0 2024-09-20T18:35:41.018 INFO:tasks.workunit.client.0.smithi017.stdout:0/54: dwrite d4/ff [0,4194304] 0 2024-09-20T18:35:41.019 INFO:tasks.workunit.client.0.smithi017.stdout:9/43: truncate d6/f14 879915 0 2024-09-20T18:35:41.025 INFO:tasks.workunit.client.0.smithi017.stdout:3/50: creat da/f15 x:0 0 0 2024-09-20T18:35:41.028 INFO:tasks.workunit.client.0.smithi017.stdout:9/44: dwrite d6/f8 [0,4194304] 0 2024-09-20T18:35:41.030 INFO:tasks.workunit.client.1.smithi172.stdout:2/333: link d0/d2c/d3f/d17/d18/d29/c49 d0/d2c/d3f/d17/d22/d10/d6a/c71 0 2024-09-20T18:35:41.031 INFO:tasks.workunit.client.1.smithi172.stdout:2/334: chown d0/d2c/d3f/d17/l1b 5219 1 2024-09-20T18:35:41.036 INFO:tasks.workunit.client.1.smithi172.stdout:5/417: creat d4/d1f/d26/d2d/d86/f88 x:0 0 0 2024-09-20T18:35:41.038 INFO:tasks.workunit.client.0.smithi017.stdout:0/55: dwrite f2 [0,4194304] 0 2024-09-20T18:35:41.040 INFO:tasks.workunit.client.1.smithi172.stdout:3/413: creat d0/dc/d6a/d3a/f80 x:0 0 0 2024-09-20T18:35:41.043 INFO:tasks.workunit.client.1.smithi172.stdout:9/379: rename d15/d1a/d1e to d15/d1f/d2c/d7d 0 2024-09-20T18:35:41.046 INFO:tasks.workunit.client.0.smithi017.stdout:0/56: mknod d4/db/c13 0 2024-09-20T18:35:41.047 INFO:tasks.workunit.client.0.smithi017.stdout:3/51: mkdir da/de/d13/d16 0 2024-09-20T18:35:41.049 INFO:tasks.workunit.client.1.smithi172.stdout:1/361: getdents d0/d8/db/d25/d2b/d3d/d65 0 2024-09-20T18:35:41.050 INFO:tasks.workunit.client.1.smithi172.stdout:1/362: readlink d0/d8/db/d25/l35 0 2024-09-20T18:35:41.051 INFO:tasks.workunit.client.1.smithi172.stdout:7/481: dwrite d2/d3/d10/d40/d46/f60 [0,4194304] 0 2024-09-20T18:35:41.051 INFO:tasks.workunit.client.0.smithi017.stdout:3/52: mkdir da/de/d13/d17 0 2024-09-20T18:35:41.052 INFO:tasks.workunit.client.1.smithi172.stdout:7/482: truncate d2/f25 1201386 0 2024-09-20T18:35:41.053 INFO:tasks.workunit.client.1.smithi172.stdout:7/483: fsync d2/f3e 0 2024-09-20T18:35:41.056 INFO:tasks.workunit.client.0.smithi017.stdout:3/53: dread da/fd [0,4194304] 0 2024-09-20T18:35:41.056 INFO:tasks.workunit.client.1.smithi172.stdout:2/335: creat d0/d2c/d3f/d17/d22/d4c/f72 x:0 0 0 2024-09-20T18:35:41.056 INFO:tasks.workunit.client.0.smithi017.stdout:3/54: stat da/de/d13/d17 0 2024-09-20T18:35:41.057 INFO:tasks.workunit.client.1.smithi172.stdout:2/336: write d0/d2c/d3f/d17/d18/f6e [771783,103059] 0 2024-09-20T18:35:41.058 INFO:tasks.workunit.client.0.smithi017.stdout:3/55: truncate da/de/f12 46460 0 2024-09-20T18:35:41.060 INFO:tasks.workunit.client.1.smithi172.stdout:5/418: stat d4/c12 0 2024-09-20T18:35:41.064 INFO:tasks.workunit.client.0.smithi017.stdout:9/45: truncate d6/ff 18400 0 2024-09-20T18:35:41.064 INFO:tasks.workunit.client.0.smithi017.stdout:9/46: read d6/fb [1214384,74407] 0 2024-09-20T18:35:41.066 INFO:tasks.workunit.client.0.smithi017.stdout:3/56: unlink da/fd 0 2024-09-20T18:35:41.067 INFO:tasks.workunit.client.1.smithi172.stdout:4/339: write d0/d7/f25 [693535,66440] 0 2024-09-20T18:35:41.070 INFO:tasks.workunit.client.1.smithi172.stdout:1/363: creat d0/d8/db/d25/d6d/f7e x:0 0 0 2024-09-20T18:35:41.071 INFO:tasks.workunit.client.1.smithi172.stdout:1/364: stat d0/d8/db/d25/d6f 0 2024-09-20T18:35:41.072 INFO:tasks.workunit.client.1.smithi172.stdout:7/484: rename d2/d3/d86/d6e/f79 to d2/d3/d10/d40/d46/fa8 0 2024-09-20T18:35:41.073 INFO:tasks.workunit.client.0.smithi017.stdout:9/47: dwrite d6/f14 [0,4194304] 0 2024-09-20T18:35:41.073 INFO:tasks.workunit.client.1.smithi172.stdout:7/485: chown d2/d3/d3d/d68 63023514 1 2024-09-20T18:35:41.074 INFO:tasks.workunit.client.1.smithi172.stdout:3/414: symlink d0/dc/d6a/d3a/d74/l81 0 2024-09-20T18:35:41.074 INFO:tasks.workunit.client.1.smithi172.stdout:7/486: write d2/d3/f35 [1562715,22903] 0 2024-09-20T18:35:41.074 INFO:tasks.workunit.client.0.smithi017.stdout:9/48: write d6/fe [110926,120693] 0 2024-09-20T18:35:41.074 INFO:tasks.workunit.client.1.smithi172.stdout:3/415: readlink d0/d13/l21 0 2024-09-20T18:35:41.075 INFO:tasks.workunit.client.1.smithi172.stdout:8/386: creat dd/d1b/f8d x:0 0 0 2024-09-20T18:35:41.076 INFO:tasks.workunit.client.1.smithi172.stdout:3/416: write d0/dc/d6a/d3a/f80 [505772,8668] 0 2024-09-20T18:35:41.076 INFO:tasks.workunit.client.1.smithi172.stdout:9/380: mkdir d15/d1f/d7e 0 2024-09-20T18:35:41.077 INFO:tasks.workunit.client.0.smithi017.stdout:3/57: dread da/fb [0,4194304] 0 2024-09-20T18:35:41.078 INFO:tasks.workunit.client.1.smithi172.stdout:3/417: truncate d0/dc/d6a/d3a/f75 1241824 0 2024-09-20T18:35:41.079 INFO:tasks.workunit.client.1.smithi172.stdout:1/365: chown d0/d8/db/d39/l6c 50565 1 2024-09-20T18:35:41.080 INFO:tasks.workunit.client.1.smithi172.stdout:2/337: creat d0/d2c/d3f/d17/d22/d10/d3c/d68/f73 x:0 0 0 2024-09-20T18:35:41.081 INFO:tasks.workunit.client.1.smithi172.stdout:5/419: rename d4/d1f/d26/f2a to d4/df/f89 0 2024-09-20T18:35:41.081 INFO:tasks.workunit.client.0.smithi017.stdout:3/58: truncate da/fb 1350724 0 2024-09-20T18:35:41.082 INFO:tasks.workunit.client.1.smithi172.stdout:0/495: sync 2024-09-20T18:35:41.082 INFO:tasks.workunit.client.1.smithi172.stdout:7/487: mkdir d2/d23/d3c/da9 0 2024-09-20T18:35:41.084 INFO:tasks.workunit.client.0.smithi017.stdout:3/59: rename da/cf to da/de/c18 0 2024-09-20T18:35:41.084 INFO:tasks.workunit.client.1.smithi172.stdout:9/381: readlink d15/d1f/d2c/d7d/d48/l61 0 2024-09-20T18:35:41.084 INFO:tasks.workunit.client.1.smithi172.stdout:6/347: link d0/d18/d1c/d21/d26/d34/d39/d46/l41 d0/d18/l69 0 2024-09-20T18:35:41.085 INFO:tasks.workunit.client.1.smithi172.stdout:3/418: mknod d0/dc/d6a/d3a/c82 0 2024-09-20T18:35:41.088 INFO:tasks.workunit.client.1.smithi172.stdout:5/420: dwrite d4/d1f/d26/d2d/d50/d2c/f5c [0,4194304] 0 2024-09-20T18:35:41.089 INFO:tasks.workunit.client.1.smithi172.stdout:5/421: fsync d4/df/d3f/f7c 0 2024-09-20T18:35:41.161 INFO:tasks.workunit.client.1.smithi172.stdout:4/340: sync 2024-09-20T18:35:41.162 INFO:tasks.workunit.client.1.smithi172.stdout:4/341: write d0/f32 [399820,10003] 0 2024-09-20T18:35:41.166 INFO:tasks.workunit.client.1.smithi172.stdout:4/342: dwrite d0/f6d [0,4194304] 0 2024-09-20T18:35:41.199 INFO:tasks.workunit.client.1.smithi172.stdout:1/366: symlink d0/d22/l7f 0 2024-09-20T18:35:41.200 INFO:tasks.workunit.client.0.smithi017.stdout:3/60: mkdir da/de/d14/d19 0 2024-09-20T18:35:41.200 INFO:tasks.workunit.client.1.smithi172.stdout:1/367: read d0/d8/db/fe [4010216,34996] 0 2024-09-20T18:35:41.201 INFO:tasks.workunit.client.0.smithi017.stdout:3/61: dread - da/f15 zero size 2024-09-20T18:35:41.201 INFO:tasks.workunit.client.1.smithi172.stdout:1/368: truncate d0/d22/f54 724146 0 2024-09-20T18:35:41.202 INFO:tasks.workunit.client.1.smithi172.stdout:2/338: creat d0/d2c/d3f/d17/d22/d4c/f74 x:0 0 0 2024-09-20T18:35:41.205 INFO:tasks.workunit.client.1.smithi172.stdout:0/496: mknod d4/d46/cb1 0 2024-09-20T18:35:41.213 INFO:tasks.workunit.client.1.smithi172.stdout:3/419: mkdir d0/d13/d32/d54/d83 0 2024-09-20T18:35:41.219 INFO:tasks.workunit.client.1.smithi172.stdout:5/422: creat d4/df/d3f/d64/f8a x:0 0 0 2024-09-20T18:35:41.219 INFO:tasks.workunit.client.1.smithi172.stdout:5/423: stat d4/df/c78 0 2024-09-20T18:35:41.234 INFO:tasks.workunit.client.0.smithi017.stdout:3/62: getdents da/de/d14 0 2024-09-20T18:35:41.236 INFO:tasks.workunit.client.1.smithi172.stdout:4/343: creat d0/de/dc/d3c/f86 x:0 0 0 2024-09-20T18:35:41.237 INFO:tasks.workunit.client.1.smithi172.stdout:4/344: readlink d0/d48/d4e/l68 0 2024-09-20T18:35:41.238 INFO:tasks.workunit.client.0.smithi017.stdout:3/63: creat da/de/f1a x:0 0 0 2024-09-20T18:35:41.239 INFO:tasks.workunit.client.1.smithi172.stdout:4/345: truncate d0/de/d21/d24/d34/d72/d15/d55/d53/f83 30203 0 2024-09-20T18:35:41.239 INFO:tasks.workunit.client.1.smithi172.stdout:8/387: truncate dd/d1b/d3b/f5e 1165002 0 2024-09-20T18:35:41.239 INFO:tasks.workunit.client.1.smithi172.stdout:8/388: write f1 [79082,7738] 0 2024-09-20T18:35:41.243 INFO:tasks.workunit.client.1.smithi172.stdout:1/369: rename d0/d8/db/d25/l35 to d0/d8/db/d25/d2b/d3d/d65/l80 0 2024-09-20T18:35:41.243 INFO:tasks.workunit.client.0.smithi017.stdout:9/49: write d6/ff [455740,6993] 0 2024-09-20T18:35:41.245 INFO:tasks.workunit.client.0.smithi017.stdout:3/64: rename l1 to da/de/d13/d17/l1b 0 2024-09-20T18:35:41.246 INFO:tasks.workunit.client.1.smithi172.stdout:2/339: unlink d0/d2c/d3f/d17/d22/c11 0 2024-09-20T18:35:41.250 INFO:tasks.workunit.client.0.smithi017.stdout:9/50: unlink d6/d11/c15 0 2024-09-20T18:35:41.250 INFO:tasks.workunit.client.0.smithi017.stdout:9/51: chown d6/l9 38 1 2024-09-20T18:35:41.254 INFO:tasks.workunit.client.1.smithi172.stdout:3/420: rmdir d0/d13/d58 39 2024-09-20T18:35:41.255 INFO:tasks.workunit.client.0.smithi017.stdout:3/65: creat da/de/d14/d19/f1c x:0 0 0 2024-09-20T18:35:41.261 INFO:tasks.workunit.client.1.smithi172.stdout:5/424: creat d4/d1f/d26/d2d/d50/d2c/f8b x:0 0 0 2024-09-20T18:35:41.263 INFO:tasks.workunit.client.0.smithi017.stdout:9/52: rename d6/f8 to d6/f16 0 2024-09-20T18:35:41.263 INFO:tasks.workunit.client.1.smithi172.stdout:5/425: dread d4/d1f/d26/d2d/d50/d2c/f38 [0,4194304] 0 2024-09-20T18:35:41.263 INFO:tasks.workunit.client.1.smithi172.stdout:5/426: write d4/fd [4382380,72249] 0 2024-09-20T18:35:41.264 INFO:tasks.workunit.client.1.smithi172.stdout:4/346: mknod d0/de/d21/c87 0 2024-09-20T18:35:41.265 INFO:tasks.workunit.client.0.smithi017.stdout:3/66: dwrite da/de/d14/d19/f1c [0,4194304] 0 2024-09-20T18:35:41.265 INFO:tasks.workunit.client.0.smithi017.stdout:9/53: truncate d6/f7 623091 0 2024-09-20T18:35:41.267 INFO:tasks.workunit.client.0.smithi017.stdout:9/54: write d6/f7 [439138,126026] 0 2024-09-20T18:35:41.271 INFO:tasks.workunit.client.0.smithi017.stdout:9/55: write d6/f7 [583913,120660] 0 2024-09-20T18:35:41.274 INFO:tasks.workunit.client.1.smithi172.stdout:1/370: unlink d0/d22/c45 0 2024-09-20T18:35:41.277 INFO:tasks.workunit.client.0.smithi017.stdout:3/67: dwrite da/de/f12 [0,4194304] 0 2024-09-20T18:35:41.282 INFO:tasks.workunit.client.1.smithi172.stdout:0/497: link d4/d44/f5c d4/d1a/d28/d42/d45/d54/fb2 0 2024-09-20T18:35:41.285 INFO:tasks.workunit.client.0.smithi017.stdout:9/56: dwrite d6/ff [0,4194304] 0 2024-09-20T18:35:41.286 INFO:tasks.workunit.client.1.smithi172.stdout:7/488: creat d2/d3/d10/faa x:0 0 0 2024-09-20T18:35:41.288 INFO:tasks.workunit.client.1.smithi172.stdout:0/498: dwrite d4/d5/fb [4194304,4194304] 0 2024-09-20T18:35:41.288 INFO:tasks.workunit.client.1.smithi172.stdout:6/348: truncate d0/d18/d1c/d22/d27/f2f 7534231 0 2024-09-20T18:35:41.291 INFO:tasks.workunit.client.1.smithi172.stdout:9/382: creat d15/d1f/f7f x:0 0 0 2024-09-20T18:35:41.292 INFO:tasks.workunit.client.1.smithi172.stdout:6/349: read d0/fc [1309823,49602] 0 2024-09-20T18:35:41.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.279+0000 7fc618d6b640 1 -- 172.21.15.17:0/1429428982 --> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc614062630 con 0x7fc5fc074a60 2024-09-20T18:35:41.294 INFO:tasks.workunit.client.0.smithi017.stdout:3/68: write da/de/d14/d19/f1c [4285671,48144] 0 2024-09-20T18:35:41.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.281+0000 7fc6037fe640 1 -- 172.21.15.17:0/1429428982 <== mgr.24405 v2:172.21.15.172:6828/3016443347 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7fc614062630 con 0x7fc5fc074a60 2024-09-20T18:35:41.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.284+0000 7fc618d6b640 1 -- 172.21.15.17:0/1429428982 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fc5fc074a60 msgr2=0x7fc5fc076f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:41.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.284+0000 7fc618d6b640 1 --2- 172.21.15.17:0/1429428982 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fc5fc074a60 0x7fc5fc076f20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc614196730 tx=0x7fc60400b390 comp rx=0 tx=0).stop 2024-09-20T18:35:41.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.284+0000 7fc618d6b640 1 -- 172.21.15.17:0/1429428982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc614102450 msgr2=0x7fc614195280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:41.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.284+0000 7fc618d6b640 1 --2- 172.21.15.17:0/1429428982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc614102450 0x7fc614195280 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc60c02f6f0 tx=0x7fc60c02f720 comp rx=0 tx=0).stop 2024-09-20T18:35:41.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.284+0000 7fc618d6b640 1 -- 172.21.15.17:0/1429428982 shutdown_connections 2024-09-20T18:35:41.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.284+0000 7fc618d6b640 1 --2- 172.21.15.17:0/1429428982 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fc5fc074a60 0x7fc5fc076f20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:41.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.284+0000 7fc618d6b640 1 --2- 172.21.15.17:0/1429428982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc614104d80 0x7fc6141957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:41.300 INFO:tasks.workunit.client.0.smithi017.stdout:3/69: creat da/de/d14/f1d x:0 0 0 2024-09-20T18:35:41.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.284+0000 7fc618d6b640 1 --2- 172.21.15.17:0/1429428982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc614102450 0x7fc614195280 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:41.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.284+0000 7fc618d6b640 1 -- 172.21.15.17:0/1429428982 >> 172.21.15.17:0/1429428982 conn(0x7fc6140fc010 msgr2=0x7fc614101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:41.300 INFO:tasks.workunit.client.0.smithi017.stdout:3/70: stat da 0 2024-09-20T18:35:41.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.285+0000 7fc618d6b640 1 -- 172.21.15.17:0/1429428982 shutdown_connections 2024-09-20T18:35:41.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.285+0000 7fc618d6b640 1 -- 172.21.15.17:0/1429428982 wait complete. 2024-09-20T18:35:41.301 INFO:tasks.workunit.client.1.smithi172.stdout:9/383: dwrite d15/d1f/d2c/d7d/d24/f77 [0,4194304] 0 2024-09-20T18:35:41.301 INFO:tasks.workunit.client.1.smithi172.stdout:5/427: creat d4/d1f/f8c x:0 0 0 2024-09-20T18:35:41.305 INFO:tasks.workunit.client.1.smithi172.stdout:1/371: mknod d0/d8/d12/c81 0 2024-09-20T18:35:41.307 INFO:tasks.workunit.client.0.smithi017.stdout:3/71: creat da/de/d13/d16/f1e x:0 0 0 2024-09-20T18:35:41.308 INFO:tasks.workunit.client.1.smithi172.stdout:2/340: mknod d0/d1a/d58/c75 0 2024-09-20T18:35:41.311 INFO:tasks.workunit.client.0.smithi017.stdout:9/57: getdents d6 0 2024-09-20T18:35:41.313 INFO:tasks.workunit.client.0.smithi017.stdout:3/72: readlink l9 0 2024-09-20T18:35:41.314 INFO:tasks.workunit.client.0.smithi017.stdout:3/73: dread - da/de/f1a zero size 2024-09-20T18:35:41.324 INFO:tasks.workunit.client.0.smithi017.stdout:3/74: link da/de/f1a da/de/d14/d19/f1f 0 2024-09-20T18:35:41.326 INFO:tasks.workunit.client.1.smithi172.stdout:6/350: mknod d0/d18/d1c/d21/d26/d34/d39/c6a 0 2024-09-20T18:35:41.326 INFO:tasks.workunit.client.1.smithi172.stdout:7/489: write d2/d3/dd/f1d [308698,34395] 0 2024-09-20T18:35:41.329 INFO:tasks.workunit.client.0.smithi017.stdout:3/75: rename l3 to da/de/d13/d17/l20 0 2024-09-20T18:35:41.330 INFO:tasks.workunit.client.1.smithi172.stdout:6/351: dread d0/d18/f23 [0,4194304] 0 2024-09-20T18:35:41.331 INFO:tasks.workunit.client.0.smithi017.stdout:3/76: write da/f15 [737247,89034] 0 2024-09-20T18:35:41.331 INFO:tasks.workunit.client.1.smithi172.stdout:8/389: creat dd/d1b/d3b/d51/f8e x:0 0 0 2024-09-20T18:35:41.334 INFO:tasks.workunit.client.0.smithi017.stdout:9/58: dwrite d6/fb [0,4194304] 0 2024-09-20T18:35:41.336 INFO:tasks.workunit.client.0.smithi017.stdout:3/77: unlink da/de/d13/d17/l1b 0 2024-09-20T18:35:41.337 INFO:tasks.workunit.client.1.smithi172.stdout:3/421: mkdir d0/d13/d58/d6d/d7f/d84 0 2024-09-20T18:35:41.337 INFO:tasks.workunit.client.1.smithi172.stdout:3/422: fsync d0/d13/d1e/f46 0 2024-09-20T18:35:41.340 INFO:tasks.workunit.client.0.smithi017.stdout:9/59: dread d6/f16 [0,4194304] 0 2024-09-20T18:35:41.344 INFO:tasks.workunit.client.1.smithi172.stdout:6/352: mkdir d0/d18/d1c/d21/d26/d34/d6b 0 2024-09-20T18:35:41.346 INFO:tasks.workunit.client.1.smithi172.stdout:8/390: chown dd/d1b/f79 1 1 2024-09-20T18:35:41.349 INFO:tasks.workunit.client.0.smithi017.stdout:9/60: getdents d6 0 2024-09-20T18:35:41.349 INFO:tasks.workunit.client.0.smithi017.stdout:9/61: write d6/f7 [1718308,47542] 0 2024-09-20T18:35:41.350 INFO:tasks.workunit.client.1.smithi172.stdout:6/353: dwrite d0/d18/d1c/d21/d26/f60 [0,4194304] 0 2024-09-20T18:35:41.355 INFO:tasks.workunit.client.1.smithi172.stdout:5/428: link d4/df/d3f/l85 d4/d1f/d26/d2d/d50/d2c/l8d 0 2024-09-20T18:35:41.356 INFO:tasks.workunit.client.1.smithi172.stdout:5/429: truncate d4/d1f/d26/d2d/d50/d2c/f7d 348116 0 2024-09-20T18:35:41.357 INFO:tasks.workunit.client.0.smithi017.stdout:9/62: creat d6/d11/f17 x:0 0 0 2024-09-20T18:35:41.357 INFO:tasks.workunit.client.0.smithi017.stdout:9/63: fdatasync d6/d11/f17 0 2024-09-20T18:35:41.361 INFO:tasks.workunit.client.1.smithi172.stdout:4/347: rename d0/de/dc/l29 to d0/de/l88 0 2024-09-20T18:35:41.363 INFO:tasks.workunit.client.1.smithi172.stdout:1/372: creat d0/f82 x:0 0 0 2024-09-20T18:35:41.364 INFO:tasks.workunit.client.0.smithi017.stdout:3/78: truncate da/de/d14/d19/f1c 1334435 0 2024-09-20T18:35:41.364 INFO:tasks.workunit.client.0.smithi017.stdout:9/64: rmdir d6 39 2024-09-20T18:35:41.366 INFO:tasks.workunit.client.0.smithi017.stdout:3/79: mknod da/de/c21 0 2024-09-20T18:35:41.367 INFO:tasks.workunit.client.1.smithi172.stdout:2/341: mknod d0/d2c/d3f/d17/d22/d10/c76 0 2024-09-20T18:35:41.369 INFO:tasks.workunit.client.1.smithi172.stdout:6/354: symlink d0/d18/d1c/d21/d26/d34/d39/d46/l6c 0 2024-09-20T18:35:41.370 INFO:tasks.workunit.client.0.smithi017.stdout:3/80: creat da/de/d13/d16/f22 x:0 0 0 2024-09-20T18:35:41.371 INFO:tasks.workunit.client.1.smithi172.stdout:5/430: creat d4/df/f8e x:0 0 0 2024-09-20T18:35:41.371 INFO:tasks.workunit.client.0.smithi017.stdout:3/81: write da/de/d13/d16/f1e [370851,5049] 0 2024-09-20T18:35:41.372 INFO:tasks.workunit.client.1.smithi172.stdout:5/431: write d4/d1f/d26/d2d/d50/f1e [4634219,19340] 0 2024-09-20T18:35:41.373 INFO:tasks.workunit.client.0.smithi017.stdout:3/82: write da/de/f12 [1131752,126849] 0 2024-09-20T18:35:41.373 INFO:tasks.workunit.client.1.smithi172.stdout:5/432: write d4/df/f74 [1442322,95924] 0 2024-09-20T18:35:41.374 INFO:tasks.workunit.client.0.smithi017.stdout:9/65: rename d6/f16 to d6/f18 0 2024-09-20T18:35:41.375 INFO:tasks.workunit.client.0.smithi017.stdout:9/66: write d6/fe [285294,122431] 0 2024-09-20T18:35:41.376 INFO:tasks.workunit.client.0.smithi017.stdout:9/67: chown d6/f7 842 1 2024-09-20T18:35:41.382 INFO:tasks.workunit.client.1.smithi172.stdout:0/499: rename d4/d46/c98 to d4/d5/d2e/d67/cb3 0 2024-09-20T18:35:41.383 INFO:tasks.workunit.client.0.smithi017.stdout:9/68: dwrite d6/f14 [0,4194304] 0 2024-09-20T18:35:41.383 INFO:tasks.workunit.client.0.smithi017.stdout:9/69: stat d6/f18 0 2024-09-20T18:35:41.384 INFO:tasks.workunit.client.1.smithi172.stdout:1/373: mknod d0/d22/c83 0 2024-09-20T18:35:41.385 INFO:tasks.workunit.client.0.smithi017.stdout:3/83: symlink da/de/d14/d19/l23 0 2024-09-20T18:35:41.395 INFO:tasks.workunit.client.1.smithi172.stdout:7/490: getdents d2 0 2024-09-20T18:35:41.397 INFO:tasks.workunit.client.1.smithi172.stdout:9/384: rename d15/d1f/d2c/d7d/f67 to d15/d4a/f80 0 2024-09-20T18:35:41.399 INFO:tasks.workunit.client.1.smithi172.stdout:0/500: unlink d4/f86 0 2024-09-20T18:35:41.401 INFO:tasks.workunit.client.0.smithi017.stdout:9/70: getdents d6 0 2024-09-20T18:35:41.402 INFO:tasks.workunit.client.1.smithi172.stdout:5/433: mkdir d4/d1f/d26/d41/d65/d8f 0 2024-09-20T18:35:41.403 INFO:tasks.workunit.client.0.smithi017.stdout:3/84: getdents da 0 2024-09-20T18:35:41.405 INFO:tasks.workunit.client.0.smithi017.stdout:9/71: mknod d6/d11/c19 0 2024-09-20T18:35:41.405 INFO:tasks.workunit.client.0.smithi017.stdout:9/72: fdatasync d6/d11/f12 0 2024-09-20T18:35:41.406 INFO:tasks.workunit.client.0.smithi017.stdout:3/85: mknod da/de/c24 0 2024-09-20T18:35:41.407 INFO:tasks.workunit.client.1.smithi172.stdout:6/355: truncate d0/d18/d1c/d22/f2e 3147834 0 2024-09-20T18:35:41.408 INFO:tasks.workunit.client.0.smithi017.stdout:3/86: read - da/de/d14/d19/f1f zero size 2024-09-20T18:35:41.408 INFO:tasks.workunit.client.1.smithi172.stdout:6/356: readlink d0/d18/d1c/d21/d26/d34/d39/d46/l32 0 2024-09-20T18:35:41.411 INFO:tasks.workunit.client.1.smithi172.stdout:9/385: getdents d15/d20/d76 0 2024-09-20T18:35:41.412 INFO:tasks.workunit.client.0.smithi017.stdout:9/73: dwrite f4 [0,4194304] 0 2024-09-20T18:35:41.412 INFO:tasks.workunit.client.1.smithi172.stdout:5/434: dread d4/d1f/d26/d2d/d50/f1e [0,4194304] 0 2024-09-20T18:35:41.413 INFO:tasks.workunit.client.1.smithi172.stdout:9/386: write d15/d1a/d64/f75 [319579,6267] 0 2024-09-20T18:35:41.414 INFO:tasks.workunit.client.1.smithi172.stdout:6/357: read d0/f4a [65201,123044] 0 2024-09-20T18:35:41.414 INFO:tasks.workunit.client.0.smithi017.stdout:3/87: symlink da/de/d13/l25 0 2024-09-20T18:35:41.415 INFO:tasks.workunit.client.1.smithi172.stdout:9/387: chown d15/d20/f73 96784828 1 2024-09-20T18:35:41.416 INFO:tasks.workunit.client.1.smithi172.stdout:4/348: rename d0/d7/f12 to d0/de/d21/d24/d34/d72/d15/f89 0 2024-09-20T18:35:41.419 INFO:tasks.workunit.client.0.smithi017.stdout:9/74: mknod d6/d11/c1a 0 2024-09-20T18:35:41.422 INFO:tasks.workunit.client.0.smithi017.stdout:3/88: mkdir da/de/d13/d17/d26 0 2024-09-20T18:35:41.424 INFO:tasks.workunit.client.0.smithi017.stdout:3/89: write da/de/d13/d16/f22 [718042,98166] 0 2024-09-20T18:35:41.425 INFO:tasks.workunit.client.1.smithi172.stdout:6/358: creat d0/f6d x:0 0 0 2024-09-20T18:35:41.426 INFO:tasks.workunit.client.0.smithi017.stdout:9/75: fdatasync d6/fb 0 2024-09-20T18:35:41.426 INFO:tasks.workunit.client.1.smithi172.stdout:6/359: write d0/d18/d1c/d21/f56 [922012,77187] 0 2024-09-20T18:35:41.427 INFO:tasks.workunit.client.0.smithi017.stdout:9/76: write d6/d11/f12 [1028250,89973] 0 2024-09-20T18:35:41.428 INFO:tasks.workunit.client.1.smithi172.stdout:1/374: rename d0/d22/c83 to d0/d73/c84 0 2024-09-20T18:35:41.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.414+0000 7f6dbafe0640 1 -- 172.21.15.17:0/3094137886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6db41001e0 msgr2=0x7f6db41025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:41.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.414+0000 7f6dbafe0640 1 --2- 172.21.15.17:0/3094137886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6db41001e0 0x7f6db41025f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009880 tx=0x7f6da802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:35:41.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.415+0000 7f6dbafe0640 1 -- 172.21.15.17:0/3094137886 shutdown_connections 2024-09-20T18:35:41.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.415+0000 7f6dbafe0640 1 --2- 172.21.15.17:0/3094137886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6db4102b30 0x7f6db4104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:41.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.415+0000 7f6dbafe0640 1 --2- 172.21.15.17:0/3094137886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6db41001e0 0x7f6db41025f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:41.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.415+0000 7f6dbafe0640 1 -- 172.21.15.17:0/3094137886 >> 172.21.15.17:0/3094137886 conn(0x7f6db40fc010 msgr2=0x7f6db40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:41.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.415+0000 7f6dbafe0640 1 -- 172.21.15.17:0/3094137886 shutdown_connections 2024-09-20T18:35:41.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.415+0000 7f6dbafe0640 1 -- 172.21.15.17:0/3094137886 wait complete. 2024-09-20T18:35:41.430 INFO:tasks.workunit.client.0.smithi017.stdout:3/90: unlink da/c10 0 2024-09-20T18:35:41.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.416+0000 7f6dbafe0640 1 Processor -- start 2024-09-20T18:35:41.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.416+0000 7f6dbafe0640 1 -- start start 2024-09-20T18:35:41.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.416+0000 7f6dbafe0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6db41001e0 0x7f6db419da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:41.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.416+0000 7f6dbafe0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6db4102b30 0x7f6db419dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:41.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.416+0000 7f6db8d7c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6db41001e0 0x7f6db419da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:41.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.416+0000 7f6dbafe0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6db4110d70 con 0x7f6db41001e0 2024-09-20T18:35:41.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.416+0000 7f6dbafe0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6db4110bf0 con 0x7f6db4102b30 2024-09-20T18:35:41.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.416+0000 7f6db8d7c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6db41001e0 0x7f6db419da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60494/0 (socket says 172.21.15.17:60494) 2024-09-20T18:35:41.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.416+0000 7f6db8d7c640 1 -- 172.21.15.17:0/1073625771 learned_addr learned my addr 172.21.15.17:0/1073625771 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:35:41.432 INFO:tasks.workunit.client.0.smithi017.stdout:3/91: read - da/de/d14/d19/f1f zero size 2024-09-20T18:35:41.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.416+0000 7f6db3fff640 1 --2- 172.21.15.17:0/1073625771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6db4102b30 0x7f6db419dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:41.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.417+0000 7f6db8d7c640 1 -- 172.21.15.17:0/1073625771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6db4102b30 msgr2=0x7f6db419dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:41.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.417+0000 7f6db8d7c640 1 --2- 172.21.15.17:0/1073625771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6db4102b30 0x7f6db419dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:41.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.417+0000 7f6db8d7c640 1 -- 172.21.15.17:0/1073625771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db419e650 con 0x7f6db41001e0 2024-09-20T18:35:41.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.417+0000 7f6db8d7c640 1 --2- 172.21.15.17:0/1073625771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6db41001e0 0x7f6db419da90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009230 tx=0x7f6da8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:41.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.417+0000 7f6db1ffb640 1 -- 172.21.15.17:0/1073625771 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6da803f070 con 0x7f6db41001e0 2024-09-20T18:35:41.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.417+0000 7f6dbafe0640 1 -- 172.21.15.17:0/1073625771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db41a3030 con 0x7f6db41001e0 2024-09-20T18:35:41.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.418+0000 7f6dbafe0640 1 -- 172.21.15.17:0/1073625771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db41a35c0 con 0x7f6db41001e0 2024-09-20T18:35:41.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.418+0000 7f6db1ffb640 1 -- 172.21.15.17:0/1073625771 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6da8004a90 con 0x7f6db41001e0 2024-09-20T18:35:41.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.418+0000 7f6db1ffb640 1 -- 172.21.15.17:0/1073625771 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6da8049060 con 0x7f6db41001e0 2024-09-20T18:35:41.434 INFO:tasks.workunit.client.0.smithi017.stdout:3/92: truncate da/de/d13/d16/f1e 757550 0 2024-09-20T18:35:41.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.419+0000 7f6dbafe0640 1 -- 172.21.15.17:0/1073625771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d980052c0 con 0x7f6db41001e0 2024-09-20T18:35:41.434 INFO:tasks.workunit.client.0.smithi017.stdout:9/77: creat d6/d11/f1b x:0 0 0 2024-09-20T18:35:41.434 INFO:tasks.workunit.client.0.smithi017.stdout:3/93: readlink da/de/d13/l25 0 2024-09-20T18:35:41.435 INFO:tasks.workunit.client.1.smithi172.stdout:4/349: creat d0/de/d39/f8a x:0 0 0 2024-09-20T18:35:41.435 INFO:tasks.workunit.client.1.smithi172.stdout:6/360: dwrite d0/d18/f54 [0,4194304] 0 2024-09-20T18:35:41.435 INFO:tasks.workunit.client.1.smithi172.stdout:4/350: readlink d0/d7/l7b 0 2024-09-20T18:35:41.435 INFO:tasks.workunit.client.1.smithi172.stdout:3/423: sync 2024-09-20T18:35:41.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.421+0000 7f6db1ffb640 1 -- 172.21.15.17:0/1073625771 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f6da8042070 con 0x7f6db41001e0 2024-09-20T18:35:41.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.422+0000 7f6db1ffb640 1 --2- 172.21.15.17:0/1073625771 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6da4074ad0 0x7f6da4076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:41.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.422+0000 7f6db1ffb640 1 -- 172.21.15.17:0/1073625771 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7f6da80b7080 con 0x7f6db41001e0 2024-09-20T18:35:41.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.424+0000 7f6db3fff640 1 --2- 172.21.15.17:0/1073625771 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6da4074ad0 0x7f6da4076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:41.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.425+0000 7f6db3fff640 1 --2- 172.21.15.17:0/1073625771 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6da4074ad0 0x7f6da4076f90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6db419ef40 tx=0x7f6da0005f90 comp rx=0 tx=0).ready entity=mgr.24405 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:41.440 INFO:tasks.workunit.client.1.smithi172.stdout:7/491: rename d2/d3/c13 to d2/d23/d3a/d72/cab 0 2024-09-20T18:35:41.441 INFO:tasks.workunit.client.0.smithi017.stdout:9/78: mknod d6/d11/c1c 0 2024-09-20T18:35:41.444 INFO:tasks.workunit.client.1.smithi172.stdout:1/375: unlink d0/f7c 0 2024-09-20T18:35:41.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.430+0000 7f6db1ffb640 1 -- 172.21.15.17:0/1073625771 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f6da8082790 con 0x7f6db41001e0 2024-09-20T18:35:41.445 INFO:tasks.workunit.client.0.smithi017.stdout:3/94: fsync da/de/d14/d19/f1f 0 2024-09-20T18:35:41.446 INFO:tasks.workunit.client.0.smithi017.stdout:3/95: chown da/de/c24 2 1 2024-09-20T18:35:41.447 INFO:tasks.workunit.client.1.smithi172.stdout:6/361: creat d0/d18/d1c/f6e x:0 0 0 2024-09-20T18:35:41.448 INFO:tasks.workunit.client.0.smithi017.stdout:9/79: mkdir d6/d1d 0 2024-09-20T18:35:41.448 INFO:tasks.workunit.client.1.smithi172.stdout:4/351: symlink d0/de/d21/l8b 0 2024-09-20T18:35:41.450 INFO:tasks.workunit.client.0.smithi017.stdout:3/96: rename da/de/d14/f1d to da/de/d14/f27 0 2024-09-20T18:35:41.452 INFO:tasks.workunit.client.0.smithi017.stdout:9/80: creat d6/d11/f1e x:0 0 0 2024-09-20T18:35:41.453 INFO:tasks.workunit.client.0.smithi017.stdout:9/81: readlink d6/ld 0 2024-09-20T18:35:41.458 INFO:tasks.workunit.client.0.smithi017.stdout:3/97: write da/de/d14/f27 [701886,34946] 0 2024-09-20T18:35:41.459 INFO:tasks.workunit.client.0.smithi017.stdout:9/82: dwrite d6/d11/f1e [0,4194304] 0 2024-09-20T18:35:41.460 INFO:tasks.workunit.client.1.smithi172.stdout:1/376: write d0/d8/db/d25/d2b/f2d [2119423,109259] 0 2024-09-20T18:35:41.461 INFO:tasks.workunit.client.0.smithi017.stdout:3/98: write da/f15 [1723711,48304] 0 2024-09-20T18:35:41.466 INFO:tasks.workunit.client.1.smithi172.stdout:5/435: getdents d4/df/d3f 0 2024-09-20T18:35:41.467 INFO:tasks.workunit.client.0.smithi017.stdout:9/83: fsync d6/f18 0 2024-09-20T18:35:41.467 INFO:tasks.workunit.client.0.smithi017.stdout:9/84: fsync d6/ff 0 2024-09-20T18:35:41.468 INFO:tasks.workunit.client.1.smithi172.stdout:4/352: creat d0/de/d21/d24/d34/d72/d15/d55/f8c x:0 0 0 2024-09-20T18:35:41.469 INFO:tasks.workunit.client.1.smithi172.stdout:4/353: chown d0/de/d21/d24/d34/d72/d18/c43 370961 1 2024-09-20T18:35:41.470 INFO:tasks.workunit.client.0.smithi017.stdout:3/99: creat da/de/d14/f28 x:0 0 0 2024-09-20T18:35:41.471 INFO:tasks.workunit.client.1.smithi172.stdout:3/424: creat d0/d13/d32/d54/d83/f85 x:0 0 0 2024-09-20T18:35:41.474 INFO:tasks.workunit.client.1.smithi172.stdout:4/354: dwrite d0/de/dc/f81 [0,4194304] 0 2024-09-20T18:35:41.475 INFO:tasks.workunit.client.0.smithi017.stdout:9/85: mkdir d6/d1f 0 2024-09-20T18:35:41.475 INFO:tasks.workunit.client.0.smithi017.stdout:9/86: chown d6/d11/c1a 5732 1 2024-09-20T18:35:41.476 INFO:tasks.workunit.client.1.smithi172.stdout:4/355: readlink d0/de/d21/d24/d34/d72/l4f 0 2024-09-20T18:35:41.476 INFO:tasks.workunit.client.1.smithi172.stdout:7/492: creat d2/d23/d9d/fac x:0 0 0 2024-09-20T18:35:41.477 INFO:tasks.workunit.client.1.smithi172.stdout:7/493: write d2/d23/f66 [800293,96164] 0 2024-09-20T18:35:41.477 INFO:tasks.workunit.client.0.smithi017.stdout:3/100: creat da/f29 x:0 0 0 2024-09-20T18:35:41.479 INFO:tasks.workunit.client.1.smithi172.stdout:1/377: symlink d0/d8/db/d25/d2b/d3d/l85 0 2024-09-20T18:35:41.480 INFO:tasks.workunit.client.1.smithi172.stdout:6/362: symlink d0/d18/d1c/d22/d47/d62/l6f 0 2024-09-20T18:35:41.482 INFO:tasks.workunit.client.0.smithi017.stdout:3/101: symlink da/de/l2a 0 2024-09-20T18:35:41.483 INFO:tasks.workunit.client.1.smithi172.stdout:3/425: symlink d0/d13/d32/l86 0 2024-09-20T18:35:41.485 INFO:tasks.workunit.client.1.smithi172.stdout:8/391: sync 2024-09-20T18:35:41.485 INFO:tasks.workunit.client.1.smithi172.stdout:2/342: sync 2024-09-20T18:35:41.485 INFO:tasks.workunit.client.0.smithi017.stdout:9/87: link d6/f18 d6/d1f/f20 0 2024-09-20T18:35:41.487 INFO:tasks.workunit.client.0.smithi017.stdout:3/102: rename da/de/d14/d19/l23 to da/de/d14/d19/l2b 0 2024-09-20T18:35:41.488 INFO:tasks.workunit.client.0.smithi017.stdout:3/103: chown da/f15 81 1 2024-09-20T18:35:41.488 INFO:tasks.workunit.client.1.smithi172.stdout:6/363: dread d0/d18/d1c/d21/d26/d34/d39/d46/f2a [0,4194304] 0 2024-09-20T18:35:41.489 INFO:tasks.workunit.client.0.smithi017.stdout:3/104: chown da/de/l2a 139754 1 2024-09-20T18:35:41.489 INFO:tasks.workunit.client.1.smithi172.stdout:0/501: rename d4/d1a/d28/d42/fad to d4/d1d/fb4 0 2024-09-20T18:35:41.489 INFO:tasks.workunit.client.0.smithi017.stdout:9/88: unlink d6/d11/c1c 0 2024-09-20T18:35:41.489 INFO:tasks.workunit.client.1.smithi172.stdout:0/502: readlink d4/d1a/d28/d42/l62 0 2024-09-20T18:35:41.490 INFO:tasks.workunit.client.0.smithi017.stdout:9/89: read d6/f7 [1239047,2994] 0 2024-09-20T18:35:41.491 INFO:tasks.workunit.client.0.smithi017.stdout:9/90: truncate d6/d11/f17 824232 0 2024-09-20T18:35:41.578 INFO:tasks.workunit.client.0.smithi017.stdout:3/105: symlink da/de/d14/d19/l2c 0 2024-09-20T18:35:41.579 INFO:tasks.workunit.client.0.smithi017.stdout:9/91: creat d6/d11/f21 x:0 0 0 2024-09-20T18:35:41.580 INFO:tasks.workunit.client.1.smithi172.stdout:1/378: rmdir d0/d8/d5f 39 2024-09-20T18:35:41.591 INFO:tasks.workunit.client.1.smithi172.stdout:5/436: truncate d4/f23 598437 0 2024-09-20T18:35:41.591 INFO:tasks.workunit.client.0.smithi017.stdout:9/92: dwrite d6/d11/f21 [0,4194304] 0 2024-09-20T18:35:41.597 INFO:tasks.workunit.client.1.smithi172.stdout:2/343: chown d0/d2c/d3f/d17/d22/d4c/f74 6611528 1 2024-09-20T18:35:41.597 INFO:tasks.workunit.client.1.smithi172.stdout:2/344: stat d0/l5 0 2024-09-20T18:35:41.598 INFO:tasks.workunit.client.1.smithi172.stdout:2/345: chown d0/d2c/d3f/d17/d22/d4c/f43 49 1 2024-09-20T18:35:41.599 INFO:tasks.workunit.client.1.smithi172.stdout:2/346: chown d0/d2c/d3f/d17/d22/d10/f21 121323850 1 2024-09-20T18:35:41.600 INFO:tasks.workunit.client.1.smithi172.stdout:8/392: creat dd/d1b/d3b/d51/d34/d39/d4d/f8f x:0 0 0 2024-09-20T18:35:41.605 INFO:tasks.workunit.client.1.smithi172.stdout:9/388: rename fd to d15/d1f/d2c/d7d/d48/f81 0 2024-09-20T18:35:41.606 INFO:tasks.workunit.client.1.smithi172.stdout:2/347: dwrite d0/d4e/d59/f5c [0,4194304] 0 2024-09-20T18:35:41.606 INFO:tasks.workunit.client.1.smithi172.stdout:9/389: chown d15/d1f/d2c/d57 4961 1 2024-09-20T18:35:41.608 INFO:tasks.workunit.client.1.smithi172.stdout:7/494: dwrite d2/d3/dd/f42 [4194304,4194304] 0 2024-09-20T18:35:41.610 INFO:tasks.workunit.client.1.smithi172.stdout:4/356: creat d0/de/d21/d24/d34/d72/d15/d55/d53/d78/f8d x:0 0 0 2024-09-20T18:35:41.618 INFO:tasks.workunit.client.1.smithi172.stdout:6/364: write d0/f4a [1022962,114347] 0 2024-09-20T18:35:41.619 INFO:tasks.workunit.client.1.smithi172.stdout:5/437: mknod d4/d1f/d26/d2d/d50/d2c/c90 0 2024-09-20T18:35:41.621 INFO:tasks.workunit.client.1.smithi172.stdout:3/426: mkdir d0/dc/d61/d87 0 2024-09-20T18:35:41.625 INFO:tasks.workunit.client.1.smithi172.stdout:8/393: fdatasync dd/f27 0 2024-09-20T18:35:41.628 INFO:tasks.workunit.client.1.smithi172.stdout:1/379: write d0/d8/db/fe [448513,8531] 0 2024-09-20T18:35:41.630 INFO:tasks.workunit.client.1.smithi172.stdout:2/348: mkdir d0/d4e/d77 0 2024-09-20T18:35:41.630 INFO:tasks.workunit.client.1.smithi172.stdout:2/349: dread - d0/d2c/f6b zero size 2024-09-20T18:35:41.638 INFO:tasks.workunit.client.1.smithi172.stdout:4/357: creat d0/de/d21/d24/d34/d72/d18/d51/f8e x:0 0 0 2024-09-20T18:35:41.639 INFO:tasks.workunit.client.1.smithi172.stdout:3/427: dread d0/dc/f2a [0,4194304] 0 2024-09-20T18:35:41.639 INFO:tasks.workunit.client.1.smithi172.stdout:3/428: fdatasync d0/dc/d6a/f53 0 2024-09-20T18:35:41.641 INFO:tasks.workunit.client.1.smithi172.stdout:6/365: mknod d0/d18/d1c/d21/c70 0 2024-09-20T18:35:41.646 INFO:tasks.workunit.client.1.smithi172.stdout:0/503: creat d4/d1a/fb5 x:0 0 0 2024-09-20T18:35:41.648 INFO:tasks.workunit.client.1.smithi172.stdout:9/390: dwrite d15/d1a/f28 [0,4194304] 0 2024-09-20T18:35:41.650 INFO:tasks.workunit.client.1.smithi172.stdout:6/366: dwrite d0/f4a [0,4194304] 0 2024-09-20T18:35:41.652 INFO:tasks.workunit.client.1.smithi172.stdout:6/367: fsync d0/f36 0 2024-09-20T18:35:41.652 INFO:tasks.workunit.client.1.smithi172.stdout:2/350: rename d0/d2c/d3f/d17/d18/d29/f4f to d0/d1a/d58/f78 0 2024-09-20T18:35:41.653 INFO:tasks.workunit.client.1.smithi172.stdout:7/495: link d2/f91 d2/d3/d3d/d4e/fad 0 2024-09-20T18:35:41.655 INFO:tasks.workunit.client.1.smithi172.stdout:5/438: creat d4/f91 x:0 0 0 2024-09-20T18:35:41.658 INFO:tasks.workunit.client.1.smithi172.stdout:4/358: dread d0/de/dc/f7f [0,4194304] 0 2024-09-20T18:35:41.660 INFO:tasks.workunit.client.1.smithi172.stdout:4/359: chown d0/d48 257813 1 2024-09-20T18:35:41.661 INFO:tasks.workunit.client.1.smithi172.stdout:9/391: dwrite d15/f1b [0,4194304] 0 2024-09-20T18:35:41.664 INFO:tasks.workunit.client.1.smithi172.stdout:9/392: write d15/d1f/d2c/d7d/d24/f77 [2351454,18345] 0 2024-09-20T18:35:41.664 INFO:tasks.workunit.client.1.smithi172.stdout:6/368: mknod d0/d18/d1c/d21/d26/d34/c71 0 2024-09-20T18:35:41.667 INFO:tasks.workunit.client.1.smithi172.stdout:7/496: creat d2/d3/d3d/d4e/fae x:0 0 0 2024-09-20T18:35:41.670 INFO:tasks.workunit.client.1.smithi172.stdout:8/394: getdents dd/d1b/d3b/d5d/d7d 0 2024-09-20T18:35:41.670 INFO:tasks.workunit.client.1.smithi172.stdout:8/395: chown dd/d1b/d3b/d51/f82 167 1 2024-09-20T18:35:41.672 INFO:tasks.workunit.client.1.smithi172.stdout:5/439: mknod d4/d1f/d26/d41/d69/c92 0 2024-09-20T18:35:41.673 INFO:tasks.workunit.client.1.smithi172.stdout:5/440: fdatasync d4/f91 0 2024-09-20T18:35:41.680 INFO:tasks.workunit.client.1.smithi172.stdout:4/360: rename d0/de/d21/d24/d34/d72/d15/d55/d53/d5c/l85 to d0/de/d39/l8f 0 2024-09-20T18:35:41.681 INFO:tasks.workunit.client.1.smithi172.stdout:4/361: write d0/fa [803222,113911] 0 2024-09-20T18:35:41.682 INFO:tasks.workunit.client.1.smithi172.stdout:4/362: readlink d0/de/d21/d24/d34/l58 0 2024-09-20T18:35:41.683 INFO:tasks.workunit.client.1.smithi172.stdout:6/369: rmdir d0 39 2024-09-20T18:35:41.685 INFO:tasks.workunit.client.1.smithi172.stdout:7/497: creat d2/d3/d3d/faf x:0 0 0 2024-09-20T18:35:41.687 INFO:tasks.workunit.client.1.smithi172.stdout:5/441: symlink d4/d1f/d26/d2d/d63/d80/l93 0 2024-09-20T18:35:41.689 INFO:tasks.workunit.client.1.smithi172.stdout:4/363: dwrite d0/de/d21/d24/d34/d72/d18/d51/f8e [0,4194304] 0 2024-09-20T18:35:41.690 INFO:tasks.workunit.client.1.smithi172.stdout:4/364: write d0/d48/f59 [389430,102110] 0 2024-09-20T18:35:41.694 INFO:tasks.workunit.client.1.smithi172.stdout:6/370: write d0/f36 [662128,101260] 0 2024-09-20T18:35:41.695 INFO:tasks.workunit.client.1.smithi172.stdout:6/371: readlink d0/d18/d1c/d22/d27/d35/l5e 0 2024-09-20T18:35:41.697 INFO:tasks.workunit.client.1.smithi172.stdout:0/504: truncate d4/d1a/d28/d42/d45/d54/f64 1633187 0 2024-09-20T18:35:41.711 INFO:tasks.workunit.client.1.smithi172.stdout:2/351: truncate d0/d2c/d3f/d17/d18/d3b/f44 1297800 0 2024-09-20T18:35:41.712 INFO:tasks.workunit.client.1.smithi172.stdout:6/372: dread d0/d18/f29 [0,4194304] 0 2024-09-20T18:35:41.713 INFO:tasks.workunit.client.1.smithi172.stdout:9/393: rename d15/d1f/d2c/d7d/d24 to d15/d1a/d82 0 2024-09-20T18:35:41.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.699+0000 7f6dbafe0640 1 -- 172.21.15.17:0/1073625771 --> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6d98000bf0 con 0x7f6da4074ad0 2024-09-20T18:35:41.717 INFO:tasks.workunit.client.1.smithi172.stdout:0/505: mknod d4/d44/dab/cb6 0 2024-09-20T18:35:41.718 INFO:tasks.workunit.client.1.smithi172.stdout:8/396: link dd/d1b/f21 dd/d1b/d3b/d51/d34/d39/d4d/f90 0 2024-09-20T18:35:41.719 INFO:tasks.workunit.client.1.smithi172.stdout:6/373: symlink d0/l72 0 2024-09-20T18:35:41.719 INFO:tasks.workunit.client.1.smithi172.stdout:1/380: sync 2024-09-20T18:35:41.720 INFO:tasks.workunit.client.1.smithi172.stdout:1/381: dread - d0/d22/f7a zero size 2024-09-20T18:35:41.721 INFO:tasks.workunit.client.1.smithi172.stdout:7/498: dwrite d2/d3/d10/d40/d46/d8e/f67 [0,4194304] 0 2024-09-20T18:35:41.722 INFO:tasks.workunit.client.1.smithi172.stdout:5/442: rename d4/df/c11 to d4/d1f/d26/d2d/d50/c94 0 2024-09-20T18:35:41.725 INFO:tasks.workunit.client.1.smithi172.stdout:9/394: write d15/d4a/f80 [1247613,113018] 0 2024-09-20T18:35:41.728 INFO:tasks.workunit.client.1.smithi172.stdout:0/506: symlink d4/d1a/d28/d42/d45/d54/lb7 0 2024-09-20T18:35:41.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.715+0000 7f6db1ffb640 1 -- 172.21.15.17:0/1073625771 <== mgr.24405 v2:172.21.15.172:6828/3016443347 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f6d98000bf0 con 0x7f6da4074ad0 2024-09-20T18:35:41.730 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:35:41.730 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (6m) 21s ago 8m 25.0M - 0.25.0 c8568f914cd2 8954ab699be3 2024-09-20T18:35:41.730 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 starting - - - - 2024-09-20T18:35:41.730 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (7m) 34s ago 7m 5272k - 19.1.1-369-ged8ee0f2 6acb0a031eab 747d22f4b582 2024-09-20T18:35:41.730 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (8m) 21s ago 8m 6895k - 19.1.1-369-ged8ee0f2 6acb0a031eab 725c8bcc6ec8 2024-09-20T18:35:41.730 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (7m) 34s ago 7m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab e10dd613dbe2 2024-09-20T18:35:41.730 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (6m) 21s ago 7m 80.8M - 9.4.12 2bacad6d85d8 d8c886b98eae 2024-09-20T18:35:41.730 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (2m) 21s ago 2m 120M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:35:41.730 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (2m) 21s ago 2m 112M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:35:41.730 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (2m) 34s ago 2m 19.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:35:41.730 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (2m) 34s ago 2m 19.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:35:41.730 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:9283,8765,8443 running (9m) 21s ago 9m 210M - 19.1.1-369-ged8ee0f2 6acb0a031eab 28eeab491beb 2024-09-20T18:35:41.731 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (60s) 34s ago 7m 497M - 19.3.0-5099-g88deadb8 441f9a3fe515 84c6ec0abc34 2024-09-20T18:35:41.731 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (9m) 21s ago 9m 53.7M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab ab1f988c4cb2 2024-09-20T18:35:41.731 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (7m) 34s ago 7m 39.4M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 9eea40352787 2024-09-20T18:35:41.731 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (8m) 21s ago 8m 13.7M - 1.5.0 0da6a335fe13 1584915999b1 2024-09-20T18:35:41.731 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (7m) 34s ago 7m 15.4M - 1.5.0 0da6a335fe13 880d938148e8 2024-09-20T18:35:41.731 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (6m) 21s ago 6m 79.4M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab c1207e514216 2024-09-20T18:35:41.731 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (5m) 21s ago 5m 83.1M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 73f2fd77590f 2024-09-20T18:35:41.731 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (5m) 21s ago 5m 73.5M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 6f0b9405dc18 2024-09-20T18:35:41.731 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (4m) 34s ago 4m 85.8M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:35:41.731 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (4m) 34s ago 4m 75.5M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:35:41.731 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (3m) 34s ago 3m 65.4M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:35:41.731 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (6m) 21s ago 7m 62.4M - 2.43.0 a07b618ecd1d ebc76047e24f 2024-09-20T18:35:41.732 INFO:tasks.workunit.client.1.smithi172.stdout:8/397: rmdir dd/d1b/d3b/d5d/d7d 39 2024-09-20T18:35:41.732 INFO:tasks.workunit.client.1.smithi172.stdout:0/507: chown d4/d5/d2e/d67/d8c 11827 1 2024-09-20T18:35:41.732 INFO:tasks.workunit.client.1.smithi172.stdout:7/499: dwrite d2/d3/d10/f2c [0,4194304] 0 2024-09-20T18:35:41.733 INFO:tasks.workunit.client.1.smithi172.stdout:7/500: readlink d2/d3/d10/l99 0 2024-09-20T18:35:41.733 INFO:tasks.workunit.client.1.smithi172.stdout:5/443: dwrite d4/df/d3f/d64/f8a [0,4194304] 0 2024-09-20T18:35:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.719+0000 7f6dbafe0640 1 -- 172.21.15.17:0/1073625771 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6da4074ad0 msgr2=0x7f6da4076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.719+0000 7f6dbafe0640 1 --2- 172.21.15.17:0/1073625771 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6da4074ad0 0x7f6da4076f90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6db419ef40 tx=0x7f6da0005f90 comp rx=0 tx=0).stop 2024-09-20T18:35:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.719+0000 7f6dbafe0640 1 -- 172.21.15.17:0/1073625771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6db41001e0 msgr2=0x7f6db419da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.719+0000 7f6dbafe0640 1 --2- 172.21.15.17:0/1073625771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6db41001e0 0x7f6db419da90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009230 tx=0x7f6da8004570 comp rx=0 tx=0).stop 2024-09-20T18:35:41.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.719+0000 7f6dbafe0640 1 -- 172.21.15.17:0/1073625771 shutdown_connections 2024-09-20T18:35:41.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.719+0000 7f6dbafe0640 1 --2- 172.21.15.17:0/1073625771 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6da4074ad0 0x7f6da4076f90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:41.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.719+0000 7f6dbafe0640 1 --2- 172.21.15.17:0/1073625771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6db4102b30 0x7f6db419dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:41.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.719+0000 7f6dbafe0640 1 --2- 172.21.15.17:0/1073625771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6db41001e0 0x7f6db419da90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:41.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.719+0000 7f6dbafe0640 1 -- 172.21.15.17:0/1073625771 >> 172.21.15.17:0/1073625771 conn(0x7f6db40fc010 msgr2=0x7f6db40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:41.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.719+0000 7f6dbafe0640 1 -- 172.21.15.17:0/1073625771 shutdown_connections 2024-09-20T18:35:41.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.719+0000 7f6dbafe0640 1 -- 172.21.15.17:0/1073625771 wait complete. 2024-09-20T18:35:41.737 INFO:tasks.workunit.client.1.smithi172.stdout:1/382: creat d0/d8/db/d25/d6f/f86 x:0 0 0 2024-09-20T18:35:41.739 INFO:tasks.workunit.client.1.smithi172.stdout:1/383: write d0/f57 [462368,19290] 0 2024-09-20T18:35:41.740 INFO:tasks.workunit.client.1.smithi172.stdout:1/384: write d0/d8/db/fe [2096093,19353] 0 2024-09-20T18:35:41.740 INFO:tasks.workunit.client.1.smithi172.stdout:1/385: stat d0/f59 0 2024-09-20T18:35:41.742 INFO:tasks.workunit.client.1.smithi172.stdout:1/386: dread - d0/d8/db/d25/d6f/f79 zero size 2024-09-20T18:35:41.742 INFO:tasks.workunit.client.1.smithi172.stdout:4/365: rename d0/de/d21/d24/d34/d72/d15 to d0/d48/d90 0 2024-09-20T18:35:41.743 INFO:tasks.workunit.client.1.smithi172.stdout:1/387: chown d0/d73/l72 2 1 2024-09-20T18:35:41.744 INFO:tasks.workunit.client.1.smithi172.stdout:1/388: chown d0/d8/db/d39 104 1 2024-09-20T18:35:41.785 INFO:tasks.workunit.client.1.smithi172.stdout:3/429: sync 2024-09-20T18:35:41.816 INFO:tasks.workunit.client.1.smithi172.stdout:0/508: chown d4/d1a/d28/l2b 83116624 1 2024-09-20T18:35:41.817 INFO:tasks.workunit.client.1.smithi172.stdout:0/509: readlink d4/d5/d2e/d38/d96/la6 0 2024-09-20T18:35:41.819 INFO:tasks.workunit.client.1.smithi172.stdout:8/398: dread dd/d1b/f23 [0,4194304] 0 2024-09-20T18:35:41.820 INFO:tasks.workunit.client.1.smithi172.stdout:7/501: unlink d2/d23/d51/c7d 0 2024-09-20T18:35:41.822 INFO:tasks.workunit.client.1.smithi172.stdout:2/352: creat d0/d2c/d3f/d17/d22/f79 x:0 0 0 2024-09-20T18:35:41.823 INFO:tasks.workunit.client.1.smithi172.stdout:2/353: write d0/d2c/d3f/d17/d22/d10/d35/d5d/f5f [8929149,26934] 0 2024-09-20T18:35:41.824 INFO:tasks.workunit.client.1.smithi172.stdout:6/374: mknod d0/d18/d1c/d21/d26/d34/d6b/c73 0 2024-09-20T18:35:41.826 INFO:tasks.workunit.client.1.smithi172.stdout:5/444: readlink d4/d1f/d26/d2d/d50/d2c/l8d 0 2024-09-20T18:35:41.827 INFO:tasks.workunit.client.1.smithi172.stdout:5/445: read d4/df/f22 [974893,126343] 0 2024-09-20T18:35:41.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.813+0000 7ff774e66640 1 -- 172.21.15.17:0/1555644871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff770101df0 msgr2=0x7ff7701021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:41.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.813+0000 7ff774e66640 1 --2- 172.21.15.17:0/1555644871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff770101df0 0x7ff7701021f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff760009880 tx=0x7ff76002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:35:41.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.813+0000 7ff774e66640 1 -- 172.21.15.17:0/1555644871 shutdown_connections 2024-09-20T18:35:41.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.813+0000 7ff774e66640 1 --2- 172.21.15.17:0/1555644871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7701027c0 0x7ff7700ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:41.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.813+0000 7ff774e66640 1 --2- 172.21.15.17:0/1555644871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff770101df0 0x7ff7701021f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:41.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.813+0000 7ff774e66640 1 -- 172.21.15.17:0/1555644871 >> 172.21.15.17:0/1555644871 conn(0x7ff7700fb770 msgr2=0x7ff7700fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:41.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.813+0000 7ff774e66640 1 -- 172.21.15.17:0/1555644871 shutdown_connections 2024-09-20T18:35:41.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.813+0000 7ff774e66640 1 -- 172.21.15.17:0/1555644871 wait complete. 2024-09-20T18:35:41.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.814+0000 7ff774e66640 1 Processor -- start 2024-09-20T18:35:41.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.814+0000 7ff774e66640 1 -- start start 2024-09-20T18:35:41.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.814+0000 7ff774e66640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff770101df0 0x7ff7701996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:41.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.814+0000 7ff774e66640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7701027c0 0x7ff770199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:41.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.814+0000 7ff774e66640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff77010c9c0 con 0x7ff770101df0 2024-09-20T18:35:41.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.814+0000 7ff774e66640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff77010c840 con 0x7ff7701027c0 2024-09-20T18:35:41.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.814+0000 7ff76e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff770101df0 0x7ff7701996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:41.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.814+0000 7ff76dd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7701027c0 0x7ff770199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:41.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.814+0000 7ff76e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff770101df0 0x7ff7701996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60514/0 (socket says 172.21.15.17:60514) 2024-09-20T18:35:41.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.814+0000 7ff76dd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7701027c0 0x7ff770199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:58344/0 (socket says 172.21.15.17:58344) 2024-09-20T18:35:41.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.814+0000 7ff76e59c640 1 -- 172.21.15.17:0/3091032065 learned_addr learned my addr 172.21.15.17:0/3091032065 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:35:41.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.815+0000 7ff76e59c640 1 -- 172.21.15.17:0/3091032065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7701027c0 msgr2=0x7ff770199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:41.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.815+0000 7ff76e59c640 1 --2- 172.21.15.17:0/3091032065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7701027c0 0x7ff770199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:41.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.815+0000 7ff76e59c640 1 -- 172.21.15.17:0/3091032065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77019a280 con 0x7ff770101df0 2024-09-20T18:35:41.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.815+0000 7ff76e59c640 1 --2- 172.21.15.17:0/3091032065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff770101df0 0x7ff7701996c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff760006010 tx=0x7ff760004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:41.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.815+0000 7ff75f7fe640 1 -- 172.21.15.17:0/3091032065 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff76003f070 con 0x7ff770101df0 2024-09-20T18:35:41.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.815+0000 7ff774e66640 1 -- 172.21.15.17:0/3091032065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff77019ec60 con 0x7ff770101df0 2024-09-20T18:35:41.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.815+0000 7ff75f7fe640 1 -- 172.21.15.17:0/3091032065 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7600049d0 con 0x7ff770101df0 2024-09-20T18:35:41.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.815+0000 7ff75f7fe640 1 -- 172.21.15.17:0/3091032065 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff760035030 con 0x7ff770101df0 2024-09-20T18:35:41.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.815+0000 7ff774e66640 1 -- 172.21.15.17:0/3091032065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff77019f1a0 con 0x7ff770101df0 2024-09-20T18:35:41.832 INFO:tasks.workunit.client.1.smithi172.stdout:4/366: creat d0/d7/d6f/f91 x:0 0 0 2024-09-20T18:35:41.832 INFO:tasks.workunit.client.1.smithi172.stdout:4/367: write d0/de/d21/f2b [798516,42319] 0 2024-09-20T18:35:41.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.816+0000 7ff774e66640 1 -- 172.21.15.17:0/3091032065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7701021f0 con 0x7ff770101df0 2024-09-20T18:35:41.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.817+0000 7ff75f7fe640 1 -- 172.21.15.17:0/3091032065 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7ff760042070 con 0x7ff770101df0 2024-09-20T18:35:41.833 INFO:tasks.workunit.client.1.smithi172.stdout:4/368: fsync d0/d48/d90/d55/d53/f83 0 2024-09-20T18:35:41.833 INFO:tasks.workunit.client.1.smithi172.stdout:1/389: unlink d0/d8/db/d25/d2b/d3d/f76 0 2024-09-20T18:35:41.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.818+0000 7ff75f7fe640 1 --2- 172.21.15.17:0/3091032065 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7ff758074a30 0x7ff758076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:41.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.818+0000 7ff75f7fe640 1 -- 172.21.15.17:0/3091032065 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7ff7600b6f40 con 0x7ff770101df0 2024-09-20T18:35:41.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.818+0000 7ff76dd9b640 1 --2- 172.21.15.17:0/3091032065 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7ff758074a30 0x7ff758076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:41.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.819+0000 7ff76dd9b640 1 --2- 172.21.15.17:0/3091032065 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7ff758074a30 0x7ff758076ef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff77019ab70 tx=0x7ff764005f90 comp rx=0 tx=0).ready entity=mgr.24405 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:41.834 INFO:tasks.workunit.client.1.smithi172.stdout:4/369: write d0/de/f4c [1177228,52821] 0 2024-09-20T18:35:41.835 INFO:tasks.workunit.client.1.smithi172.stdout:9/395: mknod d15/d1f/d2c/d57/c83 0 2024-09-20T18:35:41.838 INFO:tasks.workunit.client.1.smithi172.stdout:0/510: mkdir d4/d1a/d28/d42/db8 0 2024-09-20T18:35:41.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:41.824+0000 7ff75f7fe640 1 -- 172.21.15.17:0/3091032065 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ff7600824d0 con 0x7ff770101df0 2024-09-20T18:35:41.838 INFO:tasks.workunit.client.1.smithi172.stdout:4/370: dread d0/de/d39/f73 [0,4194304] 0 2024-09-20T18:35:41.841 INFO:tasks.workunit.client.1.smithi172.stdout:3/430: dwrite d0/f44 [0,4194304] 0 2024-09-20T18:35:41.842 INFO:tasks.workunit.client.1.smithi172.stdout:0/511: dread d4/d20/f91 [0,4194304] 0 2024-09-20T18:35:41.843 INFO:tasks.workunit.client.1.smithi172.stdout:2/354: mkdir d0/d2c/d3f/d17/d45/d7a 0 2024-09-20T18:35:41.843 INFO:tasks.workunit.client.1.smithi172.stdout:0/512: fsync d4/d1d/d15/f7b 0 2024-09-20T18:35:41.845 INFO:tasks.workunit.client.1.smithi172.stdout:6/375: mkdir d0/d18/d1c/d21/d26/d34/d39/d74 0 2024-09-20T18:35:41.846 INFO:tasks.workunit.client.1.smithi172.stdout:6/376: fsync d0/d18/d1c/d21/d26/f60 0 2024-09-20T18:35:41.847 INFO:tasks.workunit.client.1.smithi172.stdout:2/355: truncate d0/d2c/d3f/d17/d22/d4c/f4d 355975 0 2024-09-20T18:35:41.848 INFO:tasks.workunit.client.1.smithi172.stdout:5/446: mknod d4/df/d3f/c95 0 2024-09-20T18:35:41.852 INFO:tasks.workunit.client.1.smithi172.stdout:2/356: dwrite d0/d4e/d59/f5c [0,4194304] 0 2024-09-20T18:35:41.854 INFO:tasks.workunit.client.1.smithi172.stdout:2/357: truncate d0/d2c/d3f/d17/d18/f32 2988324 0 2024-09-20T18:35:41.855 INFO:tasks.workunit.client.0.smithi017.stdout:3/106: symlink da/de/d14/l2d 0 2024-09-20T18:35:41.856 INFO:tasks.workunit.client.1.smithi172.stdout:2/358: truncate d0/d2c/f6b 265307 0 2024-09-20T18:35:41.860 INFO:tasks.workunit.client.1.smithi172.stdout:8/399: dread dd/d1b/f1f [8388608,4194304] 0 2024-09-20T18:35:41.862 INFO:tasks.workunit.client.1.smithi172.stdout:8/400: fdatasync dd/d1b/d3b/d51/f76 0 2024-09-20T18:35:41.863 INFO:tasks.workunit.client.0.smithi017.stdout:3/107: creat da/de/d13/d17/f2e x:0 0 0 2024-09-20T18:35:41.863 INFO:tasks.workunit.client.1.smithi172.stdout:2/359: dwrite d0/d2c/d3f/d17/d22/d4c/f4d [0,4194304] 0 2024-09-20T18:35:41.865 INFO:tasks.workunit.client.0.smithi017.stdout:9/93: mknod d6/d1d/c22 0 2024-09-20T18:35:41.865 INFO:tasks.workunit.client.0.smithi017.stdout:9/94: fsync f4 0 2024-09-20T18:35:41.867 INFO:tasks.workunit.client.0.smithi017.stdout:3/108: rmdir da 39 2024-09-20T18:35:41.869 INFO:tasks.workunit.client.1.smithi172.stdout:8/401: dread dd/f30 [0,4194304] 0 2024-09-20T18:35:41.871 INFO:tasks.workunit.client.1.smithi172.stdout:2/360: dwrite d0/d60/f66 [4194304,4194304] 0 2024-09-20T18:35:41.872 INFO:tasks.workunit.client.1.smithi172.stdout:7/502: creat d2/d3/d3d/d4e/d8b/fb0 x:0 0 0 2024-09-20T18:35:41.872 INFO:tasks.workunit.client.1.smithi172.stdout:7/503: fsync d2/f3e 0 2024-09-20T18:35:41.873 INFO:tasks.workunit.client.1.smithi172.stdout:7/504: chown c1 2 1 2024-09-20T18:35:41.874 INFO:tasks.workunit.client.1.smithi172.stdout:7/505: chown d2/d3/d3d/d4e/f5d 28425 1 2024-09-20T18:35:41.874 INFO:tasks.workunit.client.0.smithi017.stdout:3/109: rmdir da/de/d13/d16 39 2024-09-20T18:35:41.874 INFO:tasks.workunit.client.1.smithi172.stdout:7/506: write d2/d3/dd/f2f [203544,11715] 0 2024-09-20T18:35:41.875 INFO:tasks.workunit.client.1.smithi172.stdout:7/507: chown d2/d3/d3d/d4e/d5f 56331547 1 2024-09-20T18:35:41.878 INFO:tasks.workunit.client.0.smithi017.stdout:3/110: stat da/de/d14/d19/l2b 0 2024-09-20T18:35:41.879 INFO:tasks.workunit.client.1.smithi172.stdout:3/431: mkdir d0/d13/d32/d88 0 2024-09-20T18:35:41.896 INFO:tasks.workunit.client.1.smithi172.stdout:9/396: creat d15/d20/d76/f84 x:0 0 0 2024-09-20T18:35:41.898 INFO:tasks.workunit.client.0.smithi017.stdout:3/111: rename da/de/d13/d17 to da/de/d13/d2f 0 2024-09-20T18:35:41.899 INFO:tasks.workunit.client.1.smithi172.stdout:8/402: mkdir dd/d1b/d3b/d51/d34/d39/d91 0 2024-09-20T18:35:41.900 INFO:tasks.workunit.client.1.smithi172.stdout:8/403: chown dd/d1b/d3b/d51/f88 31324 1 2024-09-20T18:35:41.900 INFO:tasks.workunit.client.1.smithi172.stdout:2/361: mkdir d0/d2c/d3f/d17/d22/d10/d3c/d7b 0 2024-09-20T18:35:41.901 INFO:tasks.workunit.client.0.smithi017.stdout:3/112: creat da/de/d14/f30 x:0 0 0 2024-09-20T18:35:41.904 INFO:tasks.workunit.client.1.smithi172.stdout:7/508: creat d2/d3/d3d/d4e/fb1 x:0 0 0 2024-09-20T18:35:41.905 INFO:tasks.workunit.client.0.smithi017.stdout:3/113: unlink da/de/d14/f27 0 2024-09-20T18:35:41.910 INFO:tasks.workunit.client.0.smithi017.stdout:3/114: mkdir da/de/d13/d2f/d26/d31 0 2024-09-20T18:35:41.912 INFO:tasks.workunit.client.1.smithi172.stdout:0/513: symlink d4/d1a/d28/d75/d60/lb9 0 2024-09-20T18:35:41.912 INFO:tasks.workunit.client.1.smithi172.stdout:0/514: readlink d4/d5/l80 0 2024-09-20T18:35:41.913 INFO:tasks.workunit.client.1.smithi172.stdout:6/377: truncate d0/d18/d1c/d22/d27/f2f 2109888 0 2024-09-20T18:35:41.913 INFO:tasks.workunit.client.1.smithi172.stdout:0/515: chown d4/d5/d2e/d67/d8c 8248959 1 2024-09-20T18:35:41.914 INFO:tasks.workunit.client.0.smithi017.stdout:3/115: truncate da/de/f1a 913859 0 2024-09-20T18:35:41.916 INFO:tasks.workunit.client.1.smithi172.stdout:1/390: creat d0/d8/db/f87 x:0 0 0 2024-09-20T18:35:41.918 INFO:tasks.workunit.client.1.smithi172.stdout:6/378: dwrite d0/d18/d1c/d21/d26/f45 [0,4194304] 0 2024-09-20T18:35:41.919 INFO:tasks.workunit.client.1.smithi172.stdout:9/397: rename d15/d1a/d6f/l72 to d15/d1a/d6f/d7a/l85 0 2024-09-20T18:35:41.919 INFO:tasks.workunit.client.1.smithi172.stdout:6/379: readlink d0/d18/d65/l66 0 2024-09-20T18:35:41.919 INFO:tasks.workunit.client.1.smithi172.stdout:9/398: dread - d15/d54/f6a zero size 2024-09-20T18:35:41.921 INFO:tasks.workunit.client.1.smithi172.stdout:8/404: chown dd/d1b/d3b/d51/d34/f36 1688 1 2024-09-20T18:35:41.921 INFO:tasks.workunit.client.1.smithi172.stdout:9/399: write d15/d54/f78 [137715,34060] 0 2024-09-20T18:35:41.921 INFO:tasks.workunit.client.0.smithi017.stdout:3/116: dwrite da/f29 [0,4194304] 0 2024-09-20T18:35:41.922 INFO:tasks.workunit.client.1.smithi172.stdout:8/405: fsync dd/d1b/d3b/d51/f89 0 2024-09-20T18:35:41.924 INFO:tasks.workunit.client.1.smithi172.stdout:7/509: mknod d2/d3/d3d/d68/cb2 0 2024-09-20T18:35:41.924 INFO:tasks.workunit.client.1.smithi172.stdout:8/406: write dd/d1b/d3b/d51/f82 [910436,62250] 0 2024-09-20T18:35:41.925 INFO:tasks.workunit.client.1.smithi172.stdout:4/371: rmdir d0/de/dc/d82 0 2024-09-20T18:35:41.927 INFO:tasks.workunit.client.0.smithi017.stdout:3/117: creat da/de/d14/d19/f32 x:0 0 0 2024-09-20T18:35:41.928 INFO:tasks.workunit.client.0.smithi017.stdout:3/118: read - da/de/d14/f30 zero size 2024-09-20T18:35:41.929 INFO:tasks.workunit.client.1.smithi172.stdout:0/516: mkdir d4/d1a/d28/d75/d60/dba 0 2024-09-20T18:35:41.930 INFO:tasks.workunit.client.1.smithi172.stdout:0/517: fdatasync d4/fa1 0 2024-09-20T18:35:41.934 INFO:tasks.workunit.client.1.smithi172.stdout:2/362: rename d0/l1 to d0/d2c/d3f/d17/d45/d7a/l7c 0 2024-09-20T18:35:41.935 INFO:tasks.workunit.client.0.smithi017.stdout:3/119: unlink l9 0 2024-09-20T18:35:41.937 INFO:tasks.workunit.client.0.smithi017.stdout:3/120: write da/de/d13/d2f/f2e [885738,105636] 0 2024-09-20T18:35:41.937 INFO:tasks.workunit.client.1.smithi172.stdout:7/510: readlink d2/d3/d3d/d4e/l98 0 2024-09-20T18:35:41.939 INFO:tasks.workunit.client.1.smithi172.stdout:8/407: creat dd/d1b/d3b/d51/d34/d39/d4d/f92 x:0 0 0 2024-09-20T18:35:41.939 INFO:tasks.workunit.client.1.smithi172.stdout:9/400: dread d15/d1f/d2c/d7d/f27 [0,4194304] 0 2024-09-20T18:35:41.939 INFO:tasks.workunit.client.1.smithi172.stdout:8/408: readlink dd/l62 0 2024-09-20T18:35:41.940 INFO:tasks.workunit.client.1.smithi172.stdout:5/447: getdents d4/d1f/d26/d2d/d86 0 2024-09-20T18:35:41.944 INFO:tasks.workunit.client.0.smithi017.stdout:3/121: dwrite da/de/d14/f30 [0,4194304] 0 2024-09-20T18:35:41.946 INFO:tasks.workunit.client.1.smithi172.stdout:4/372: rename d0/d7/c1e to d0/d48/d90/d55/d53/d5c/c92 0 2024-09-20T18:35:41.949 INFO:tasks.workunit.client.1.smithi172.stdout:3/432: getdents d0/d13/d32/d54/d83 0 2024-09-20T18:35:41.951 INFO:tasks.workunit.client.1.smithi172.stdout:2/363: dwrite d0/d2c/d3f/fd [0,4194304] 0 2024-09-20T18:35:41.953 INFO:tasks.workunit.client.1.smithi172.stdout:5/448: symlink d4/df/l96 0 2024-09-20T18:35:41.955 INFO:tasks.workunit.client.1.smithi172.stdout:1/391: link d0/d8/c11 d0/d8/db/d25/d2b/d3d/c88 0 2024-09-20T18:35:41.956 INFO:tasks.workunit.client.1.smithi172.stdout:4/373: truncate d0/de/d39/f73 508620 0 2024-09-20T18:35:41.957 INFO:tasks.workunit.client.1.smithi172.stdout:7/511: symlink d2/d23/lb3 0 2024-09-20T18:35:41.957 INFO:tasks.workunit.client.1.smithi172.stdout:0/518: fdatasync d4/d1a/d28/d75/f43 0 2024-09-20T18:35:41.959 INFO:tasks.workunit.client.1.smithi172.stdout:9/401: mknod d15/c86 0 2024-09-20T18:35:41.959 INFO:tasks.workunit.client.1.smithi172.stdout:3/433: creat d0/dc/d6a/d22/f89 x:0 0 0 2024-09-20T18:35:41.961 INFO:tasks.workunit.client.1.smithi172.stdout:6/380: getdents d0/d18/d1c/d21 0 2024-09-20T18:35:41.963 INFO:tasks.workunit.client.1.smithi172.stdout:5/449: rename d4/df/d3f/d64 to d4/df/d3f/d64/d97 22 2024-09-20T18:35:41.964 INFO:tasks.workunit.client.1.smithi172.stdout:0/519: getdents d4/d94 0 2024-09-20T18:35:41.965 INFO:tasks.workunit.client.1.smithi172.stdout:4/374: write d0/d7/f25 [1248311,124938] 0 2024-09-20T18:35:41.967 INFO:tasks.workunit.client.1.smithi172.stdout:2/364: dwrite d0/d1a/f20 [0,4194304] 0 2024-09-20T18:35:41.967 INFO:tasks.workunit.client.1.smithi172.stdout:3/434: creat d0/d13/d32/f8a x:0 0 0 2024-09-20T18:35:41.967 INFO:tasks.workunit.client.1.smithi172.stdout:1/392: mknod d0/d8/db/d25/d6d/d77/c89 0 2024-09-20T18:35:41.970 INFO:tasks.workunit.client.1.smithi172.stdout:9/402: rename d15/d4a/c68 to d15/d1a/d82/c87 0 2024-09-20T18:35:41.973 INFO:tasks.workunit.client.1.smithi172.stdout:5/450: mkdir d4/df/d98 0 2024-09-20T18:35:41.974 INFO:tasks.workunit.client.1.smithi172.stdout:4/375: fsync d0/f63 0 2024-09-20T18:35:41.976 INFO:tasks.workunit.client.1.smithi172.stdout:1/393: chown d0/d8/db/c46 6023545 1 2024-09-20T18:35:41.977 INFO:tasks.workunit.client.1.smithi172.stdout:9/403: chown f14 205988 1 2024-09-20T18:35:41.977 INFO:tasks.workunit.client.1.smithi172.stdout:2/365: symlink d0/d2c/d3f/d17/d18/d29/d42/l7d 0 2024-09-20T18:35:41.979 INFO:tasks.workunit.client.1.smithi172.stdout:7/512: dwrite d2/d3/d86/f8d [0,4194304] 0 2024-09-20T18:35:41.979 INFO:tasks.workunit.client.1.smithi172.stdout:4/376: write d0/f32 [2335959,45533] 0 2024-09-20T18:35:41.981 INFO:tasks.workunit.client.1.smithi172.stdout:1/394: chown d0/d73/l67 125682647 1 2024-09-20T18:35:41.981 INFO:tasks.workunit.client.1.smithi172.stdout:5/451: write d4/d1f/d26/d2d/d50/f56 [1400676,17113] 0 2024-09-20T18:35:41.983 INFO:tasks.workunit.client.1.smithi172.stdout:0/520: link d4/d5/d2e/d38/f4b d4/d5/d2e/d38/d96/fbb 0 2024-09-20T18:35:41.986 INFO:tasks.workunit.client.1.smithi172.stdout:6/381: dwrite d0/d18/d1c/f6e [0,4194304] 0 2024-09-20T18:35:41.990 INFO:tasks.workunit.client.1.smithi172.stdout:5/452: mknod d4/d1f/c99 0 2024-09-20T18:35:41.991 INFO:tasks.workunit.client.1.smithi172.stdout:3/435: dwrite d0/dc/d6a/d22/f7a [0,4194304] 0 2024-09-20T18:35:41.994 INFO:tasks.workunit.client.1.smithi172.stdout:8/409: dread dd/d1b/f1f [0,4194304] 0 2024-09-20T18:35:41.998 INFO:tasks.workunit.client.1.smithi172.stdout:6/382: creat d0/d18/d1c/d22/d27/f75 x:0 0 0 2024-09-20T18:35:42.000 INFO:tasks.workunit.client.1.smithi172.stdout:1/395: dread d0/d8/db/d25/f49 [0,4194304] 0 2024-09-20T18:35:42.001 INFO:tasks.workunit.client.1.smithi172.stdout:2/366: dwrite d0/d2c/d3f/f30 [0,4194304] 0 2024-09-20T18:35:42.002 INFO:tasks.workunit.client.1.smithi172.stdout:5/453: rename d4/d1f/d26/d2d/d50/f56 to d4/df/d3f/f9a 0 2024-09-20T18:35:42.005 INFO:tasks.workunit.client.1.smithi172.stdout:6/383: mknod d0/d18/d1c/d21/d26/d34/d39/c76 0 2024-09-20T18:35:42.005 INFO:tasks.workunit.client.1.smithi172.stdout:5/454: read d4/d1f/d26/f32 [3729356,73141] 0 2024-09-20T18:35:42.009 INFO:tasks.workunit.client.1.smithi172.stdout:3/436: rename d0/d13/d32/f4e to d0/dc/d6a/d3a/d74/f8b 0 2024-09-20T18:35:42.010 INFO:tasks.workunit.client.1.smithi172.stdout:3/437: write d0/f44 [320410,74348] 0 2024-09-20T18:35:42.011 INFO:tasks.workunit.client.1.smithi172.stdout:1/396: creat d0/d8/f8a x:0 0 0 2024-09-20T18:35:42.012 INFO:tasks.workunit.client.1.smithi172.stdout:6/384: symlink d0/d18/d65/l77 0 2024-09-20T18:35:42.012 INFO:tasks.workunit.client.1.smithi172.stdout:1/397: dread - d0/d8/db/f3c zero size 2024-09-20T18:35:42.012 INFO:tasks.workunit.client.1.smithi172.stdout:5/455: dwrite d4/df/d3f/f7c [0,4194304] 0 2024-09-20T18:35:42.015 INFO:tasks.workunit.client.1.smithi172.stdout:2/367: link d0/d1a/c1c d0/d4e/c7e 0 2024-09-20T18:35:42.016 INFO:tasks.workunit.client.1.smithi172.stdout:3/438: chown d0/l30 58 1 2024-09-20T18:35:42.018 INFO:tasks.workunit.client.1.smithi172.stdout:6/385: creat d0/d18/d1c/d22/d47/f78 x:0 0 0 2024-09-20T18:35:42.019 INFO:tasks.workunit.client.1.smithi172.stdout:5/456: unlink d4/d1f/d26/l6c 0 2024-09-20T18:35:42.019 INFO:tasks.workunit.client.1.smithi172.stdout:6/386: chown d0/d18/d1c/d21/d26/d34/c71 59 1 2024-09-20T18:35:42.021 INFO:tasks.workunit.client.1.smithi172.stdout:8/410: rename dd/d1b/c3a to dd/d65/c93 0 2024-09-20T18:35:42.022 INFO:tasks.workunit.client.1.smithi172.stdout:8/411: readlink dd/d1b/d3b/d51/l77 0 2024-09-20T18:35:42.022 INFO:tasks.workunit.client.1.smithi172.stdout:1/398: symlink d0/d8/db/l8b 0 2024-09-20T18:35:42.023 INFO:tasks.workunit.client.1.smithi172.stdout:2/368: symlink d0/d2c/d3f/d17/d18/d3b/l7f 0 2024-09-20T18:35:42.025 INFO:tasks.workunit.client.1.smithi172.stdout:3/439: creat d0/dc/d6a/d22/f8c x:0 0 0 2024-09-20T18:35:42.025 INFO:tasks.workunit.client.1.smithi172.stdout:5/457: fdatasync d4/d1f/d26/d2d/d50/d2c/f38 0 2024-09-20T18:35:42.026 INFO:tasks.workunit.client.1.smithi172.stdout:5/458: write d4/d1f/f51 [372501,101505] 0 2024-09-20T18:35:42.027 INFO:tasks.workunit.client.1.smithi172.stdout:6/387: mkdir d0/d18/d1c/d21/d26/d79 0 2024-09-20T18:35:42.027 INFO:tasks.workunit.client.1.smithi172.stdout:5/459: dread - d4/d1f/d26/d41/f54 zero size 2024-09-20T18:35:42.029 INFO:tasks.workunit.client.1.smithi172.stdout:6/388: write d0/d18/d1c/d22/d27/d35/f4f [8533742,33334] 0 2024-09-20T18:35:42.030 INFO:tasks.workunit.client.1.smithi172.stdout:2/369: rmdir d0/d4e/d59 39 2024-09-20T18:35:42.031 INFO:tasks.workunit.client.1.smithi172.stdout:3/440: symlink d0/dc/d6a/d3a/l8d 0 2024-09-20T18:35:42.032 INFO:tasks.workunit.client.1.smithi172.stdout:2/370: write d0/d2c/d3f/f46 [9039872,83546] 0 2024-09-20T18:35:42.034 INFO:tasks.workunit.client.1.smithi172.stdout:5/460: dwrite d4/df/d3f/f7c [0,4194304] 0 2024-09-20T18:35:42.034 INFO:tasks.workunit.client.1.smithi172.stdout:2/371: truncate d0/d2c/d3f/d17/d22/f79 358386 0 2024-09-20T18:35:42.035 INFO:tasks.workunit.client.1.smithi172.stdout:6/389: fdatasync d0/d18/f29 0 2024-09-20T18:35:42.037 INFO:tasks.workunit.client.1.smithi172.stdout:3/441: mknod d0/d13/d32/c8e 0 2024-09-20T18:35:42.039 INFO:tasks.workunit.client.1.smithi172.stdout:3/442: dread - d0/dc/d6a/d22/f8c zero size 2024-09-20T18:35:42.039 INFO:tasks.workunit.client.1.smithi172.stdout:2/372: creat d0/d2c/d3f/d17/f80 x:0 0 0 2024-09-20T18:35:42.040 INFO:tasks.workunit.client.1.smithi172.stdout:5/461: mknod d4/d1f/d26/d2d/c9b 0 2024-09-20T18:35:42.041 INFO:tasks.workunit.client.1.smithi172.stdout:5/462: chown d4/d1f/d26/d2d/d50/f3d 29390 1 2024-09-20T18:35:42.042 INFO:tasks.workunit.client.1.smithi172.stdout:3/443: creat d0/dc/d61/d87/f8f x:0 0 0 2024-09-20T18:35:42.043 INFO:tasks.workunit.client.1.smithi172.stdout:2/373: symlink d0/d2c/d3f/d17/d22/l81 0 2024-09-20T18:35:42.045 INFO:tasks.workunit.client.1.smithi172.stdout:5/463: creat d4/df/d98/f9c x:0 0 0 2024-09-20T18:35:42.046 INFO:tasks.workunit.client.1.smithi172.stdout:3/444: mkdir d0/d13/d58/d6d/d7f/d84/d90 0 2024-09-20T18:35:42.047 INFO:tasks.workunit.client.1.smithi172.stdout:2/374: mknod d0/d2c/d3f/d17/d18/d29/c82 0 2024-09-20T18:35:42.047 INFO:tasks.workunit.client.1.smithi172.stdout:5/464: creat d4/d1f/d26/d41/d69/f9d x:0 0 0 2024-09-20T18:35:42.048 INFO:tasks.workunit.client.1.smithi172.stdout:3/445: mknod d0/d13/d1e/c91 0 2024-09-20T18:35:42.049 INFO:tasks.workunit.client.1.smithi172.stdout:2/375: mkdir d0/d2c/d3f/d17/d18/d29/d42/d83 0 2024-09-20T18:35:42.050 INFO:tasks.workunit.client.1.smithi172.stdout:2/376: fsync d0/d2c/d3f/d17/d22/f79 0 2024-09-20T18:35:42.050 INFO:tasks.workunit.client.1.smithi172.stdout:3/446: creat d0/d13/d58/d6d/d7f/d84/d90/f92 x:0 0 0 2024-09-20T18:35:42.053 INFO:tasks.workunit.client.1.smithi172.stdout:2/377: mknod d0/d2c/d3f/d17/d45/d7a/c84 0 2024-09-20T18:35:42.055 INFO:tasks.workunit.client.1.smithi172.stdout:3/447: creat d0/d13/d1e/f93 x:0 0 0 2024-09-20T18:35:42.061 INFO:tasks.workunit.client.1.smithi172.stdout:3/448: dwrite d0/dc/f5a [0,4194304] 0 2024-09-20T18:35:42.062 INFO:tasks.workunit.client.1.smithi172.stdout:3/449: truncate d0/f44 4268741 0 2024-09-20T18:35:42.063 INFO:tasks.workunit.client.1.smithi172.stdout:3/450: chown d0/d13/d58/d6d/d7f/d84 1 1 2024-09-20T18:35:42.065 INFO:tasks.workunit.client.1.smithi172.stdout:3/451: creat d0/dc/d6a/d76/f94 x:0 0 0 2024-09-20T18:35:42.066 INFO:tasks.workunit.client.1.smithi172.stdout:3/452: chown d0/dc/d6a/c47 0 1 2024-09-20T18:35:42.067 INFO:tasks.workunit.client.1.smithi172.stdout:3/453: truncate d0/d13/d32/f8a 246315 0 2024-09-20T18:35:42.069 INFO:tasks.workunit.client.1.smithi172.stdout:2/378: dread d0/d2c/d3f/f26 [0,4194304] 0 2024-09-20T18:35:42.104 INFO:tasks.workunit.client.1.smithi172.stdout:9/404: sync 2024-09-20T18:35:42.113 INFO:tasks.workunit.client.1.smithi172.stdout:2/379: creat d0/d2c/d3f/d17/d22/d10/f85 x:0 0 0 2024-09-20T18:35:42.114 INFO:tasks.workunit.client.1.smithi172.stdout:2/380: write d0/d2c/d3f/d17/d22/d4c/f5e [171718,10232] 0 2024-09-20T18:35:42.117 INFO:tasks.workunit.client.1.smithi172.stdout:3/454: dwrite d0/f7 [0,4194304] 0 2024-09-20T18:35:42.125 INFO:tasks.workunit.client.1.smithi172.stdout:9/405: mkdir d15/d1f/d88 0 2024-09-20T18:35:42.126 INFO:tasks.workunit.client.1.smithi172.stdout:9/406: write d15/d1a/f26 [1807622,101384] 0 2024-09-20T18:35:42.127 INFO:tasks.workunit.client.1.smithi172.stdout:2/381: mknod d0/d2c/d3f/d17/d18/d3b/c86 0 2024-09-20T18:35:42.128 INFO:tasks.workunit.client.1.smithi172.stdout:2/382: write d0/d2c/d3f/d17/d18/f32 [2771390,3536] 0 2024-09-20T18:35:42.139 INFO:tasks.workunit.client.1.smithi172.stdout:9/407: unlink d15/d1f/d2c/d37/f3c 0 2024-09-20T18:35:42.146 INFO:tasks.workunit.client.1.smithi172.stdout:9/408: link f12 d15/d1f/d2c/d7d/d58/f89 0 2024-09-20T18:35:42.148 INFO:tasks.workunit.client.1.smithi172.stdout:9/409: creat d15/d1a/d6f/f8a x:0 0 0 2024-09-20T18:35:42.150 INFO:tasks.workunit.client.1.smithi172.stdout:9/410: symlink d15/d1f/d2c/d7d/l8b 0 2024-09-20T18:35:42.150 INFO:tasks.workunit.client.1.smithi172.stdout:9/411: write d15/d1f/d2c/d37/f63 [929812,128496] 0 2024-09-20T18:35:42.155 INFO:tasks.workunit.client.1.smithi172.stdout:9/412: mkdir d15/d4a/d8c 0 2024-09-20T18:35:42.158 INFO:tasks.workunit.client.1.smithi172.stdout:9/413: mkdir d15/d1a/d8d 0 2024-09-20T18:35:42.163 INFO:tasks.workunit.client.1.smithi172.stdout:9/414: dwrite d15/d1f/d2c/d37/f44 [0,4194304] 0 2024-09-20T18:35:42.165 INFO:tasks.workunit.client.1.smithi172.stdout:9/415: read d15/d1a/d82/f3e [609803,7570] 0 2024-09-20T18:35:42.168 INFO:tasks.workunit.client.1.smithi172.stdout:0/521: sync 2024-09-20T18:35:42.169 INFO:tasks.workunit.client.1.smithi172.stdout:9/416: creat d15/d1a/d82/f8e x:0 0 0 2024-09-20T18:35:42.171 INFO:tasks.workunit.client.1.smithi172.stdout:0/522: mkdir d4/d1d/dac/dbc 0 2024-09-20T18:35:42.174 INFO:tasks.workunit.client.1.smithi172.stdout:0/523: unlink d4/d5/d2e/d76/f79 0 2024-09-20T18:35:42.174 INFO:tasks.workunit.client.1.smithi172.stdout:9/417: symlink d15/d1f/d2c/d7d/d58/l8f 0 2024-09-20T18:35:42.175 INFO:tasks.workunit.client.1.smithi172.stdout:0/524: symlink d4/d1d/d15/lbd 0 2024-09-20T18:35:42.178 INFO:tasks.workunit.client.1.smithi172.stdout:9/418: dread d15/d1a/d82/f77 [0,4194304] 0 2024-09-20T18:35:42.179 INFO:tasks.workunit.client.1.smithi172.stdout:0/525: creat d4/fbe x:0 0 0 2024-09-20T18:35:42.180 INFO:tasks.workunit.client.1.smithi172.stdout:4/377: truncate d0/fa 2100813 0 2024-09-20T18:35:42.181 INFO:tasks.workunit.client.1.smithi172.stdout:0/526: creat d4/d5/d2e/d38/d96/fbf x:0 0 0 2024-09-20T18:35:42.182 INFO:tasks.workunit.client.1.smithi172.stdout:7/513: truncate d2/d3/dd/f19 1840513 0 2024-09-20T18:35:42.182 INFO:tasks.workunit.client.1.smithi172.stdout:7/514: chown d2/d3/d86/f8d 6 1 2024-09-20T18:35:42.183 INFO:tasks.workunit.client.1.smithi172.stdout:4/378: rmdir d0/de/d21/d24 39 2024-09-20T18:35:42.183 INFO:tasks.workunit.client.1.smithi172.stdout:7/515: dread - d2/d23/d9d/fac zero size 2024-09-20T18:35:42.184 INFO:tasks.workunit.client.1.smithi172.stdout:0/527: mknod d4/d1a/d28/d75/d60/cc0 0 2024-09-20T18:35:42.184 INFO:tasks.workunit.client.1.smithi172.stdout:4/379: chown d0/d48/d4e/c45 2 1 2024-09-20T18:35:42.185 INFO:tasks.workunit.client.1.smithi172.stdout:7/516: chown d2/d3/d10/d40/d46/f60 6 1 2024-09-20T18:35:42.187 INFO:tasks.workunit.client.1.smithi172.stdout:4/380: truncate d0/d48/d90/d55/d53/f77 541913 0 2024-09-20T18:35:42.187 INFO:tasks.workunit.client.1.smithi172.stdout:4/381: fdatasync d0/f63 0 2024-09-20T18:35:42.189 INFO:tasks.workunit.client.1.smithi172.stdout:7/517: creat d2/d3/d10/d40/d6a/fb4 x:0 0 0 2024-09-20T18:35:42.191 INFO:tasks.workunit.client.1.smithi172.stdout:9/419: dread d15/d1f/d2c/d7d/d48/f4f [0,4194304] 0 2024-09-20T18:35:42.192 INFO:tasks.workunit.client.1.smithi172.stdout:4/382: dread d0/f6d [0,4194304] 0 2024-09-20T18:35:42.192 INFO:tasks.workunit.client.1.smithi172.stdout:7/518: creat d2/d23/d3a/d72/d9b/fb5 x:0 0 0 2024-09-20T18:35:42.193 INFO:tasks.workunit.client.1.smithi172.stdout:6/390: rename d0/d18/d1c/d22 to d0/d18/d1c/d21/d26/d34/d7a 0 2024-09-20T18:35:42.194 INFO:tasks.workunit.client.1.smithi172.stdout:7/519: chown d2/d3/c48 1109341 1 2024-09-20T18:35:42.194 INFO:tasks.workunit.client.1.smithi172.stdout:4/383: dread - d0/de/dc/d3c/f86 zero size 2024-09-20T18:35:42.194 INFO:tasks.workunit.client.1.smithi172.stdout:9/420: truncate d15/d20/f73 750708 0 2024-09-20T18:35:42.196 INFO:tasks.workunit.client.1.smithi172.stdout:7/520: symlink d2/d3/d86/d6e/lb6 0 2024-09-20T18:35:42.196 INFO:tasks.workunit.client.1.smithi172.stdout:7/521: stat d2/d23/d51/c73 0 2024-09-20T18:35:42.197 INFO:tasks.workunit.client.1.smithi172.stdout:4/384: readlink d0/d48/d90/l26 0 2024-09-20T18:35:42.198 INFO:tasks.workunit.client.1.smithi172.stdout:4/385: write d0/d7/f25 [1906220,112919] 0 2024-09-20T18:35:42.198 INFO:tasks.workunit.client.1.smithi172.stdout:6/391: unlink d0/d18/d1c/d21/d26/d34/d7a/d27/d35/c3a 0 2024-09-20T18:35:42.199 INFO:tasks.workunit.client.1.smithi172.stdout:0/528: dread d4/d1a/d28/d42/f83 [0,4194304] 0 2024-09-20T18:35:42.199 INFO:tasks.workunit.client.1.smithi172.stdout:4/386: dread - d0/d7/d6f/f91 zero size 2024-09-20T18:35:42.200 INFO:tasks.workunit.client.1.smithi172.stdout:0/529: stat d4/d1d/f59 0 2024-09-20T18:35:42.200 INFO:tasks.workunit.client.1.smithi172.stdout:7/522: unlink d2/d3/d10/d40/c81 0 2024-09-20T18:35:42.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.195+0000 7ff774e66640 1 -- 172.21.15.17:0/3091032065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff770062df0 con 0x7ff770101df0 2024-09-20T18:35:42.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.195+0000 7ff75f7fe640 1 -- 172.21.15.17:0/3091032065 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7ff760087380 con 0x7ff770101df0 2024-09-20T18:35:42.210 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:35:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:35:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T18:35:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:35:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:35:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:35:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 1 2024-09-20T18:35:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:35:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:35:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T18:35:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:35:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:35:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:35:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:35:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:35:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 13, 2024-09-20T18:35:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 1 2024-09-20T18:35:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:35:42.211 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:35:42.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.199+0000 7ff774e66640 1 -- 172.21.15.17:0/3091032065 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7ff758074a30 msgr2=0x7ff758076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:42.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.199+0000 7ff774e66640 1 --2- 172.21.15.17:0/3091032065 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7ff758074a30 0x7ff758076ef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff77019ab70 tx=0x7ff764005f90 comp rx=0 tx=0).stop 2024-09-20T18:35:42.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.199+0000 7ff774e66640 1 -- 172.21.15.17:0/3091032065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff770101df0 msgr2=0x7ff7701996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:42.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.199+0000 7ff774e66640 1 --2- 172.21.15.17:0/3091032065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff770101df0 0x7ff7701996c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff760006010 tx=0x7ff760004570 comp rx=0 tx=0).stop 2024-09-20T18:35:42.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.199+0000 7ff774e66640 1 -- 172.21.15.17:0/3091032065 shutdown_connections 2024-09-20T18:35:42.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.199+0000 7ff774e66640 1 --2- 172.21.15.17:0/3091032065 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7ff758074a30 0x7ff758076ef0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:42.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.199+0000 7ff774e66640 1 --2- 172.21.15.17:0/3091032065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7701027c0 0x7ff770199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:42.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.199+0000 7ff774e66640 1 --2- 172.21.15.17:0/3091032065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff770101df0 0x7ff7701996c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:42.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.199+0000 7ff774e66640 1 -- 172.21.15.17:0/3091032065 >> 172.21.15.17:0/3091032065 conn(0x7ff7700fb770 msgr2=0x7ff7701093d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:42.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.199+0000 7ff774e66640 1 -- 172.21.15.17:0/3091032065 shutdown_connections 2024-09-20T18:35:42.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.199+0000 7ff774e66640 1 -- 172.21.15.17:0/3091032065 wait complete. 2024-09-20T18:35:42.215 INFO:tasks.workunit.client.0.smithi017.stdout:3/122: write da/de/f1a [614434,129312] 0 2024-09-20T18:35:42.219 INFO:tasks.workunit.client.0.smithi017.stdout:3/123: symlink da/de/d13/d2f/l33 0 2024-09-20T18:35:42.222 INFO:tasks.workunit.client.0.smithi017.stdout:3/124: rename da/de/d14/d19/l2c to da/de/d13/d2f/d26/l34 0 2024-09-20T18:35:42.222 INFO:tasks.workunit.client.0.smithi017.stdout:3/125: chown da/cc 17693 1 2024-09-20T18:35:42.223 INFO:tasks.workunit.client.0.smithi017.stdout:3/126: read - da/de/d14/d19/f32 zero size 2024-09-20T18:35:42.224 INFO:tasks.workunit.client.1.smithi172.stdout:8/412: write f0 [116323,102373] 0 2024-09-20T18:35:42.224 INFO:tasks.workunit.client.1.smithi172.stdout:1/399: write d0/d8/d12/f1a [2842685,34428] 0 2024-09-20T18:35:42.226 INFO:tasks.workunit.client.1.smithi172.stdout:0/530: write d4/d1a/d28/d42/f4c [1736946,118731] 0 2024-09-20T18:35:42.227 INFO:tasks.workunit.client.1.smithi172.stdout:5/465: getdents d4/df/d98 0 2024-09-20T18:35:42.228 INFO:tasks.workunit.client.1.smithi172.stdout:8/413: fdatasync f0 0 2024-09-20T18:35:42.229 INFO:tasks.workunit.client.1.smithi172.stdout:3/455: truncate d0/d13/d1e/f24 1586472 0 2024-09-20T18:35:42.230 INFO:tasks.workunit.client.1.smithi172.stdout:2/383: write d0/d1a/f33 [1612889,17281] 0 2024-09-20T18:35:42.230 INFO:tasks.workunit.client.1.smithi172.stdout:3/456: chown d0/dc/le 66103 1 2024-09-20T18:35:42.234 INFO:tasks.workunit.client.1.smithi172.stdout:7/523: symlink d2/d23/d3a/d72/lb7 0 2024-09-20T18:35:42.235 INFO:tasks.workunit.client.1.smithi172.stdout:1/400: mknod d0/d8/db/d25/d6d/d77/c8c 0 2024-09-20T18:35:42.235 INFO:tasks.workunit.client.1.smithi172.stdout:0/531: dwrite d4/d1a/d28/d42/f4c [0,4194304] 0 2024-09-20T18:35:42.236 INFO:tasks.workunit.client.0.smithi017.stdout:3/127: getdents da/de/d14 0 2024-09-20T18:35:42.236 INFO:tasks.workunit.client.1.smithi172.stdout:0/532: readlink d4/d1a/d28/d73/l92 0 2024-09-20T18:35:42.238 INFO:tasks.workunit.client.1.smithi172.stdout:0/533: truncate d4/d1a/d28/d88/fa2 621938 0 2024-09-20T18:35:42.242 INFO:tasks.workunit.client.0.smithi017.stdout:3/128: mkdir da/de/d13/d2f/d26/d31/d35 0 2024-09-20T18:35:42.247 INFO:tasks.workunit.client.1.smithi172.stdout:3/457: rename d0/dc/d6a/d3a/d74/l81 to d0/d13/d1e/l95 0 2024-09-20T18:35:42.248 INFO:tasks.workunit.client.0.smithi017.stdout:3/129: creat da/de/d13/d2f/d26/d31/f36 x:0 0 0 2024-09-20T18:35:42.248 INFO:tasks.workunit.client.1.smithi172.stdout:3/458: write d0/dc/d6a/f5b [646498,114431] 0 2024-09-20T18:35:42.249 INFO:tasks.workunit.client.1.smithi172.stdout:7/524: mkdir d2/d3/d3d/d68/db8 0 2024-09-20T18:35:42.250 INFO:tasks.workunit.client.1.smithi172.stdout:1/401: symlink d0/d8/db/d25/d2b/d3d/l8d 0 2024-09-20T18:35:42.252 INFO:tasks.workunit.client.0.smithi017.stdout:3/130: mkdir da/d37 0 2024-09-20T18:35:42.252 INFO:tasks.workunit.client.1.smithi172.stdout:6/392: dwrite d0/d18/f23 [0,4194304] 0 2024-09-20T18:35:42.253 INFO:tasks.workunit.client.0.smithi017.stdout:3/131: chown da/de/d14/d19/l2b 13 1 2024-09-20T18:35:42.254 INFO:tasks.workunit.client.1.smithi172.stdout:8/414: mknod dd/d1b/d3b/d51/d34/d39/d91/c94 0 2024-09-20T18:35:42.255 INFO:tasks.workunit.client.0.smithi017.stdout:3/132: truncate da/de/d13/d2f/f2e 1136723 0 2024-09-20T18:35:42.255 INFO:tasks.workunit.client.0.smithi017.stdout:3/133: chown da/de/f12 12380 1 2024-09-20T18:35:42.257 INFO:tasks.workunit.client.1.smithi172.stdout:0/534: fdatasync d4/d44/f61 0 2024-09-20T18:35:42.258 INFO:tasks.workunit.client.1.smithi172.stdout:1/402: dwrite d0/d8/db/f3c [0,4194304] 0 2024-09-20T18:35:42.259 INFO:tasks.workunit.client.1.smithi172.stdout:4/387: link d0/de/d21/c2e d0/de/c93 0 2024-09-20T18:35:42.263 INFO:tasks.workunit.client.1.smithi172.stdout:1/403: dwrite d0/d8/fc [0,4194304] 0 2024-09-20T18:35:42.263 INFO:tasks.workunit.client.1.smithi172.stdout:3/459: chown d0/l5e 919204 1 2024-09-20T18:35:42.265 INFO:tasks.workunit.client.1.smithi172.stdout:3/460: write d0/d13/d58/f4a [5497099,42572] 0 2024-09-20T18:35:42.266 INFO:tasks.workunit.client.1.smithi172.stdout:7/525: symlink d2/d3/d10/d40/d46/d8e/lb9 0 2024-09-20T18:35:42.266 INFO:tasks.workunit.client.1.smithi172.stdout:1/404: chown d0/d8/db/d25/d6d/d77/c89 0 1 2024-09-20T18:35:42.269 INFO:tasks.workunit.client.1.smithi172.stdout:7/526: write d2/d23/d3a/d72/d9b/fa3 [784656,99107] 0 2024-09-20T18:35:42.270 INFO:tasks.workunit.client.1.smithi172.stdout:6/393: mkdir d0/d18/d1c/d21/d26/d34/d7a/d47/d7b 0 2024-09-20T18:35:42.272 INFO:tasks.workunit.client.1.smithi172.stdout:8/415: mknod dd/d1b/d3b/d51/d34/d39/d4d/c95 0 2024-09-20T18:35:42.275 INFO:tasks.workunit.client.1.smithi172.stdout:6/394: chown d0/d18/d1c/d21/d26/d79 223 1 2024-09-20T18:35:42.277 INFO:tasks.workunit.client.1.smithi172.stdout:5/466: dwrite d4/d1f/d26/d2d/d50/f3e [0,4194304] 0 2024-09-20T18:35:42.278 INFO:tasks.workunit.client.1.smithi172.stdout:3/461: truncate d0/f20 4396240 0 2024-09-20T18:35:42.279 INFO:tasks.workunit.client.1.smithi172.stdout:3/462: chown d0/dc/d61/f66 143381 1 2024-09-20T18:35:42.280 INFO:tasks.workunit.client.1.smithi172.stdout:2/384: getdents d0/d2c/d3f/d17/d22/d4c 0 2024-09-20T18:35:42.283 INFO:tasks.workunit.client.1.smithi172.stdout:0/535: link d4/d44/f61 d4/d5/fc1 0 2024-09-20T18:35:42.285 INFO:tasks.workunit.client.1.smithi172.stdout:4/388: creat d0/de/d21/d24/d34/f94 x:0 0 0 2024-09-20T18:35:42.286 INFO:tasks.workunit.client.0.smithi017.stdout:3/134: truncate da/de/f12 4171614 0 2024-09-20T18:35:42.286 INFO:tasks.workunit.client.1.smithi172.stdout:1/405: dread d0/d8/db/d25/d2b/f2d [0,4194304] 0 2024-09-20T18:35:42.287 INFO:tasks.workunit.client.1.smithi172.stdout:4/389: write d0/de/d21/d24/d34/d72/f40 [199369,127395] 0 2024-09-20T18:35:42.287 INFO:tasks.workunit.client.1.smithi172.stdout:1/406: read - d0/d8/db/f75 zero size 2024-09-20T18:35:42.288 INFO:tasks.workunit.client.1.smithi172.stdout:6/395: creat d0/d18/d1c/d21/f7c x:0 0 0 2024-09-20T18:35:42.289 INFO:tasks.workunit.client.1.smithi172.stdout:4/390: write d0/de/dc/d3c/f86 [624764,12017] 0 2024-09-20T18:35:42.289 INFO:tasks.workunit.client.1.smithi172.stdout:5/467: creat d4/d1f/d26/d41/f9e x:0 0 0 2024-09-20T18:35:42.290 INFO:tasks.workunit.client.1.smithi172.stdout:4/391: stat d0/de/dc/d3c 0 2024-09-20T18:35:42.290 INFO:tasks.workunit.client.1.smithi172.stdout:6/396: readlink d0/d18/d1c/d21/d26/d34/d39/d46/l32 0 2024-09-20T18:35:42.291 INFO:tasks.workunit.client.0.smithi017.stdout:3/135: creat da/de/d14/f38 x:0 0 0 2024-09-20T18:35:42.293 INFO:tasks.workunit.client.1.smithi172.stdout:9/421: sync 2024-09-20T18:35:42.294 INFO:tasks.workunit.client.1.smithi172.stdout:9/422: write d15/d1f/f3f [1989290,113511] 0 2024-09-20T18:35:42.297 INFO:tasks.workunit.client.1.smithi172.stdout:2/385: mkdir d0/d2c/d3f/d17/d18/d29/d42/d87 0 2024-09-20T18:35:42.301 INFO:tasks.workunit.client.1.smithi172.stdout:0/536: read d4/f11 [999082,102158] 0 2024-09-20T18:35:42.303 INFO:tasks.workunit.client.1.smithi172.stdout:2/386: dwrite d0/d2c/d3f/f4a [0,4194304] 0 2024-09-20T18:35:42.307 INFO:tasks.workunit.client.0.smithi017.stdout:3/136: link da/l11 da/de/d13/d2f/d26/l39 0 2024-09-20T18:35:42.311 INFO:tasks.workunit.client.1.smithi172.stdout:1/407: creat d0/d8/db/d25/d2b/d3d/f8e x:0 0 0 2024-09-20T18:35:42.314 INFO:tasks.workunit.client.1.smithi172.stdout:5/468: symlink d4/d1f/d26/l9f 0 2024-09-20T18:35:42.315 INFO:tasks.workunit.client.1.smithi172.stdout:6/397: fsync d0/fc 0 2024-09-20T18:35:42.316 INFO:tasks.workunit.client.0.smithi017.stdout:3/137: symlink da/de/d13/d16/l3a 0 2024-09-20T18:35:42.317 INFO:tasks.workunit.client.1.smithi172.stdout:1/408: dwrite d0/f57 [0,4194304] 0 2024-09-20T18:35:42.320 INFO:tasks.workunit.client.1.smithi172.stdout:9/423: fsync f6 0 2024-09-20T18:35:42.321 INFO:tasks.workunit.client.1.smithi172.stdout:6/398: dread d0/d18/d1c/d21/f56 [0,4194304] 0 2024-09-20T18:35:42.321 INFO:tasks.workunit.client.1.smithi172.stdout:9/424: fsync d15/d1a/d64/f75 0 2024-09-20T18:35:42.322 INFO:tasks.workunit.client.1.smithi172.stdout:8/416: creat dd/d1b/d3b/d51/d34/f96 x:0 0 0 2024-09-20T18:35:42.323 INFO:tasks.workunit.client.1.smithi172.stdout:7/527: dwrite d2/d3/d10/d40/d46/fa8 [0,4194304] 0 2024-09-20T18:35:42.329 INFO:tasks.workunit.client.1.smithi172.stdout:5/469: rename d4/d1f/d26/d2d/d50/l34 to d4/d1f/d26/d41/d69/la0 0 2024-09-20T18:35:42.330 INFO:tasks.workunit.client.1.smithi172.stdout:7/528: dwrite d2/d23/d3a/f5c [0,4194304] 0 2024-09-20T18:35:42.330 INFO:tasks.workunit.client.1.smithi172.stdout:5/470: write d4/df/f74 [1410336,59077] 0 2024-09-20T18:35:42.331 INFO:tasks.workunit.client.1.smithi172.stdout:4/392: link d0/de/d21/d24/d34/f94 d0/d48/d90/d55/d53/d78/f95 0 2024-09-20T18:35:42.331 INFO:tasks.workunit.client.1.smithi172.stdout:5/471: readlink d4/d1f/d26/d2d/l68 0 2024-09-20T18:35:42.333 INFO:tasks.workunit.client.1.smithi172.stdout:5/472: write d4/d1f/d26/d2d/d50/f3e [1035841,17123] 0 2024-09-20T18:35:42.335 INFO:tasks.workunit.client.1.smithi172.stdout:5/473: chown d4/d1f/d26/d2d/d50/d2c/f5c 656062 1 2024-09-20T18:35:42.342 INFO:tasks.workunit.client.1.smithi172.stdout:8/417: creat dd/d1b/d3b/d51/d34/d39/d4d/f97 x:0 0 0 2024-09-20T18:35:42.343 INFO:tasks.workunit.client.0.smithi017.stdout:3/138: dread da/de/f12 [0,4194304] 0 2024-09-20T18:35:42.343 INFO:tasks.workunit.client.1.smithi172.stdout:8/418: dread - dd/d65/f7f zero size 2024-09-20T18:35:42.344 INFO:tasks.workunit.client.0.smithi017.stdout:3/139: read - da/de/d14/f28 zero size 2024-09-20T18:35:42.347 INFO:tasks.workunit.client.1.smithi172.stdout:3/463: dwrite d0/d13/d1e/f24 [0,4194304] 0 2024-09-20T18:35:42.348 INFO:tasks.workunit.client.1.smithi172.stdout:4/393: rename d0/d48/f59 to d0/d48/d4e/f96 0 2024-09-20T18:35:42.350 INFO:tasks.workunit.client.1.smithi172.stdout:4/394: chown d0/de/d39/f8a 81 1 2024-09-20T18:35:42.352 INFO:tasks.workunit.client.1.smithi172.stdout:4/395: stat d0/de/d21/d24/d34/d72/d18/c43 0 2024-09-20T18:35:42.353 INFO:tasks.workunit.client.1.smithi172.stdout:2/387: truncate d0/f39 1986040 0 2024-09-20T18:35:42.355 INFO:tasks.workunit.client.1.smithi172.stdout:4/396: write d0/d48/d90/d55/d53/f77 [595892,82218] 0 2024-09-20T18:35:42.356 INFO:tasks.workunit.client.1.smithi172.stdout:9/425: dread d15/d1f/f53 [0,4194304] 0 2024-09-20T18:35:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.344+0000 7f64e899c640 1 -- 172.21.15.17:0/1065951144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e40ff5d0 msgr2=0x7f64e40ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.344+0000 7f64e899c640 1 --2- 172.21.15.17:0/1065951144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e40ff5d0 0x7f64e40ff9d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f64d40098b0 tx=0x7f64d402a4d0 comp rx=0 tx=0).stop 2024-09-20T18:35:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.344+0000 7f64e899c640 1 -- 172.21.15.17:0/1065951144 shutdown_connections 2024-09-20T18:35:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.344+0000 7f64e899c640 1 --2- 172.21.15.17:0/1065951144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e40fffa0 0x7f64e4107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.344+0000 7f64e899c640 1 --2- 172.21.15.17:0/1065951144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e40ff5d0 0x7f64e40ff9d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.344+0000 7f64e899c640 1 -- 172.21.15.17:0/1065951144 >> 172.21.15.17:0/1065951144 conn(0x7f64e40fb350 msgr2=0x7f64e40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.344+0000 7f64e899c640 1 -- 172.21.15.17:0/1065951144 shutdown_connections 2024-09-20T18:35:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.344+0000 7f64e899c640 1 -- 172.21.15.17:0/1065951144 wait complete. 2024-09-20T18:35:42.360 INFO:tasks.workunit.client.1.smithi172.stdout:4/397: write d0/d48/d90/d55/d53/d78/f8d [87711,126123] 0 2024-09-20T18:35:42.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.345+0000 7f64e899c640 1 Processor -- start 2024-09-20T18:35:42.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.345+0000 7f64e899c640 1 -- start start 2024-09-20T18:35:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.345+0000 7f64e899c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e40ff5d0 0x7f64e41029e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.345+0000 7f64e899c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e40fffa0 0x7f64e41010a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.345+0000 7f64e259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e40ff5d0 0x7f64e41029e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.345+0000 7f64e259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e40ff5d0 0x7f64e41029e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60522/0 (socket says 172.21.15.17:60522) 2024-09-20T18:35:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.345+0000 7f64e259c640 1 -- 172.21.15.17:0/107870334 learned_addr learned my addr 172.21.15.17:0/107870334 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:35:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.345+0000 7f64e899c640 1 -- 172.21.15.17:0/107870334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f64e410a7b0 con 0x7f64e40ff5d0 2024-09-20T18:35:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.345+0000 7f64e899c640 1 -- 172.21.15.17:0/107870334 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64e410a630 con 0x7f64e40fffa0 2024-09-20T18:35:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.345+0000 7f64e259c640 1 -- 172.21.15.17:0/107870334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e40fffa0 msgr2=0x7f64e41010a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.345+0000 7f64e259c640 1 --2- 172.21.15.17:0/107870334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e40fffa0 0x7f64e41010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.345+0000 7f64e259c640 1 -- 172.21.15.17:0/107870334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e41015e0 con 0x7f64e40ff5d0 2024-09-20T18:35:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.345+0000 7f64e259c640 1 --2- 172.21.15.17:0/107870334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e40ff5d0 0x7f64e41029e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f64d40099d0 tx=0x7f64d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.346+0000 7f64d37fe640 1 -- 172.21.15.17:0/107870334 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64d403f070 con 0x7f64e40ff5d0 2024-09-20T18:35:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.346+0000 7f64d37fe640 1 -- 172.21.15.17:0/107870334 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64d4004a40 con 0x7f64e40ff5d0 2024-09-20T18:35:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.346+0000 7f64e899c640 1 -- 172.21.15.17:0/107870334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e4101870 con 0x7f64e40ff5d0 2024-09-20T18:35:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.346+0000 7f64d37fe640 1 -- 172.21.15.17:0/107870334 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64d4035030 con 0x7f64e40ff5d0 2024-09-20T18:35:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.346+0000 7f64e899c640 1 -- 172.21.15.17:0/107870334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e4101ce0 con 0x7f64e40ff5d0 2024-09-20T18:35:42.363 INFO:tasks.workunit.client.1.smithi172.stdout:2/388: dwrite d0/d2c/d3f/d17/d22/d10/d3c/f6d [0,4194304] 0 2024-09-20T18:35:42.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.347+0000 7f64d37fe640 1 -- 172.21.15.17:0/107870334 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f64d4042070 con 0x7f64e40ff5d0 2024-09-20T18:35:42.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.347+0000 7f64e899c640 1 -- 172.21.15.17:0/107870334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e410af90 con 0x7f64e40ff5d0 2024-09-20T18:35:42.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.348+0000 7f64d37fe640 1 --2- 172.21.15.17:0/107870334 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f64cc074a80 0x7f64cc076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:35:42.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.348+0000 7f64d37fe640 1 -- 172.21.15.17:0/107870334 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7f64d40b6a00 con 0x7f64e40ff5d0 2024-09-20T18:35:42.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.348+0000 7f64e1d9b640 1 --2- 172.21.15.17:0/107870334 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f64cc074a80 0x7f64cc076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:35:42.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.349+0000 7f64e1d9b640 1 --2- 172.21.15.17:0/107870334 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f64cc074a80 0x7f64cc076f40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f64d8005fd0 tx=0x7f64d8005850 comp rx=0 tx=0).ready entity=mgr.24405 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:35:42.366 INFO:tasks.workunit.client.1.smithi172.stdout:5/474: dread d4/d1f/d26/d2d/d50/f5d [0,4194304] 0 2024-09-20T18:35:42.367 INFO:tasks.workunit.client.1.smithi172.stdout:4/398: dwrite d0/de/d39/f8a [0,4194304] 0 2024-09-20T18:35:42.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.353+0000 7f64d37fe640 1 -- 172.21.15.17:0/107870334 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f64d4082010 con 0x7f64e40ff5d0 2024-09-20T18:35:42.387 INFO:tasks.workunit.client.1.smithi172.stdout:0/537: sync 2024-09-20T18:35:42.390 INFO:tasks.workunit.client.1.smithi172.stdout:3/464: mknod d0/d13/d58/d6d/d7f/d84/d90/c96 0 2024-09-20T18:35:42.391 INFO:tasks.workunit.client.1.smithi172.stdout:7/529: link d2/d3/l1a d2/d3/d10/d40/d46/d8e/lba 0 2024-09-20T18:35:42.409 INFO:tasks.workunit.client.1.smithi172.stdout:2/389: creat d0/d2c/d3f/d17/d22/d4c/f88 x:0 0 0 2024-09-20T18:35:42.410 INFO:tasks.workunit.client.1.smithi172.stdout:5/475: mknod d4/df/d98/ca1 0 2024-09-20T18:35:42.413 INFO:tasks.workunit.client.1.smithi172.stdout:4/399: unlink d0/de/dc/d3c/c50 0 2024-09-20T18:35:42.413 INFO:tasks.workunit.client.0.smithi017.stdout:3/140: write da/de/d14/d19/f1c [2233308,56461] 0 2024-09-20T18:35:42.415 INFO:tasks.workunit.client.1.smithi172.stdout:8/419: truncate dd/d1b/d3b/d51/f76 1862743 0 2024-09-20T18:35:42.416 INFO:tasks.workunit.client.0.smithi017.stdout:3/141: mknod da/de/d14/d19/c3b 0 2024-09-20T18:35:42.420 INFO:tasks.workunit.client.0.smithi017.stdout:3/142: chown da/de/d13/d2f/l20 17 1 2024-09-20T18:35:42.421 INFO:tasks.workunit.client.0.smithi017.stdout:3/143: chown da/de/d14/f38 3291 1 2024-09-20T18:35:42.422 INFO:tasks.workunit.client.1.smithi172.stdout:0/538: creat d4/d1a/d28/d42/db8/fc2 x:0 0 0 2024-09-20T18:35:42.422 INFO:tasks.workunit.client.0.smithi017.stdout:3/144: dread - da/de/d14/f38 zero size 2024-09-20T18:35:42.424 INFO:tasks.workunit.client.1.smithi172.stdout:3/465: rename d0/ca to d0/dc/d6a/d3a/d74/c97 0 2024-09-20T18:35:42.427 INFO:tasks.workunit.client.1.smithi172.stdout:4/400: symlink d0/de/d21/l97 0 2024-09-20T18:35:42.427 INFO:tasks.workunit.client.1.smithi172.stdout:9/426: dwrite f6 [0,4194304] 0 2024-09-20T18:35:42.428 INFO:tasks.workunit.client.1.smithi172.stdout:0/539: symlink d4/d5/d2e/d33/lc3 0 2024-09-20T18:35:42.430 INFO:tasks.workunit.client.1.smithi172.stdout:7/530: rename d2/d3/l52 to d2/d3/d3d/lbb 0 2024-09-20T18:35:42.431 INFO:tasks.workunit.client.0.smithi017.stdout:3/145: dwrite da/de/d14/d19/f32 [0,4194304] 0 2024-09-20T18:35:42.431 INFO:tasks.workunit.client.1.smithi172.stdout:7/531: dread - d2/d3/d10/d40/d6a/f8a zero size 2024-09-20T18:35:42.432 INFO:tasks.workunit.client.0.smithi017.stdout:3/146: fdatasync da/de/d14/f38 0 2024-09-20T18:35:42.432 INFO:tasks.workunit.client.1.smithi172.stdout:7/532: fsync d2/d3/d10/d40/d46/d8e/f6f 0 2024-09-20T18:35:42.435 INFO:tasks.workunit.client.1.smithi172.stdout:5/476: link d4/l18 d4/d1f/d26/d2d/d86/la2 0 2024-09-20T18:35:42.436 INFO:tasks.workunit.client.1.smithi172.stdout:6/399: sync 2024-09-20T18:35:42.436 INFO:tasks.workunit.client.1.smithi172.stdout:1/409: sync 2024-09-20T18:35:42.437 INFO:tasks.workunit.client.1.smithi172.stdout:5/477: write d4/df/f74 [1013890,96357] 0 2024-09-20T18:35:42.437 INFO:tasks.workunit.client.1.smithi172.stdout:6/400: readlink d0/d18/l42 0 2024-09-20T18:35:42.443 INFO:tasks.workunit.client.1.smithi172.stdout:3/466: dwrite d0/dc/f28 [0,4194304] 0 2024-09-20T18:35:42.447 INFO:tasks.workunit.client.0.smithi017.stdout:3/147: getdents da 0 2024-09-20T18:35:42.449 INFO:tasks.workunit.client.1.smithi172.stdout:7/533: mkdir d2/d23/d9d/dbc 0 2024-09-20T18:35:42.454 INFO:tasks.workunit.client.1.smithi172.stdout:8/420: dwrite dd/d1b/f55 [0,4194304] 0 2024-09-20T18:35:42.458 INFO:tasks.workunit.client.1.smithi172.stdout:5/478: unlink d4/d1f/d26/d2d/c42 0 2024-09-20T18:35:42.458 INFO:tasks.workunit.client.0.smithi017.stdout:3/148: dwrite da/de/d14/d19/f1f [0,4194304] 0 2024-09-20T18:35:42.459 INFO:tasks.workunit.client.1.smithi172.stdout:1/410: symlink d0/d8/db/d25/d2b/d3d/d65/l8f 0 2024-09-20T18:35:42.461 INFO:tasks.workunit.client.1.smithi172.stdout:9/427: dwrite fe [0,4194304] 0 2024-09-20T18:35:42.462 INFO:tasks.workunit.client.1.smithi172.stdout:9/428: fdatasync d15/d20/f73 0 2024-09-20T18:35:42.464 INFO:tasks.workunit.client.0.smithi017.stdout:3/149: dread da/de/d14/f30 [0,4194304] 0 2024-09-20T18:35:42.465 INFO:tasks.workunit.client.1.smithi172.stdout:2/390: rename d0/d2c/d3f/d17/d22/c28 to d0/d2c/d3f/d17/d22/d10/d3c/c89 0 2024-09-20T18:35:42.467 INFO:tasks.workunit.client.1.smithi172.stdout:3/467: write d0/dc/d6a/d3a/f3f [224912,28024] 0 2024-09-20T18:35:42.468 INFO:tasks.workunit.client.1.smithi172.stdout:3/468: stat d0/dc/d6a/f50 0 2024-09-20T18:35:42.469 INFO:tasks.workunit.client.1.smithi172.stdout:7/534: mkdir d2/d3/d10/d40/d46/d8e/dbd 0 2024-09-20T18:35:42.470 INFO:tasks.workunit.client.1.smithi172.stdout:7/535: read - d2/d3/d3d/d4e/fae zero size 2024-09-20T18:35:42.471 INFO:tasks.workunit.client.1.smithi172.stdout:7/536: readlink d2/d3/d10/d40/d6a/la1 0 2024-09-20T18:35:42.472 INFO:tasks.workunit.client.1.smithi172.stdout:8/421: creat dd/d1b/d3b/d51/d5b/d6b/f98 x:0 0 0 2024-09-20T18:35:42.476 INFO:tasks.workunit.client.0.smithi017.stdout:3/150: rmdir da/de/d13/d2f/d26/d31/d35 0 2024-09-20T18:35:42.477 INFO:tasks.workunit.client.1.smithi172.stdout:9/429: unlink d15/c86 0 2024-09-20T18:35:42.480 INFO:tasks.workunit.client.1.smithi172.stdout:2/391: creat d0/d2c/d3f/f8a x:0 0 0 2024-09-20T18:35:42.480 INFO:tasks.workunit.client.0.smithi017.stdout:3/151: dread da/de/d14/d19/f1f [0,4194304] 0 2024-09-20T18:35:42.481 INFO:tasks.workunit.client.1.smithi172.stdout:2/392: chown d0/d2c/d3f/f26 44 1 2024-09-20T18:35:42.482 INFO:tasks.workunit.client.1.smithi172.stdout:2/393: fdatasync d0/d2c/d3f/d17/f80 0 2024-09-20T18:35:42.484 INFO:tasks.workunit.client.1.smithi172.stdout:7/537: unlink d2/d3/d10/d40/d6a/l78 0 2024-09-20T18:35:42.486 INFO:tasks.workunit.client.0.smithi017.stdout:3/152: symlink da/de/d13/d2f/l3c 0 2024-09-20T18:35:42.486 INFO:tasks.workunit.client.0.smithi017.stdout:3/153: stat da/de/d14/d19/f1f 0 2024-09-20T18:35:42.487 INFO:tasks.workunit.client.1.smithi172.stdout:4/401: getdents d0/d48/d90/d55/d53/d78 0 2024-09-20T18:35:42.488 INFO:tasks.workunit.client.1.smithi172.stdout:4/402: dread - d0/d7/d6f/f79 zero size 2024-09-20T18:35:42.489 INFO:tasks.workunit.client.1.smithi172.stdout:0/540: rename d4/d5/d2e/d67/cb3 to d4/d1a/d28/d75/d60/cc4 0 2024-09-20T18:35:42.489 INFO:tasks.workunit.client.1.smithi172.stdout:0/541: stat d4/d5/l8 0 2024-09-20T18:35:42.490 INFO:tasks.workunit.client.1.smithi172.stdout:5/479: write f3 [5224979,9612] 0 2024-09-20T18:35:42.491 INFO:tasks.workunit.client.1.smithi172.stdout:9/430: symlink d15/d1f/d2c/d7d/d34/l90 0 2024-09-20T18:35:42.492 INFO:tasks.workunit.client.1.smithi172.stdout:5/480: dread - d4/d1f/d26/d2d/d86/f88 zero size 2024-09-20T18:35:42.493 INFO:tasks.workunit.client.1.smithi172.stdout:5/481: dread - d4/d1f/d26/d41/f9e zero size 2024-09-20T18:35:42.493 INFO:tasks.workunit.client.0.smithi017.stdout:3/154: mknod da/d37/c3d 0 2024-09-20T18:35:42.495 INFO:tasks.workunit.client.0.smithi017.stdout:3/155: readlink l7 0 2024-09-20T18:35:42.499 INFO:tasks.workunit.client.1.smithi172.stdout:6/401: rename d0/d18/d1c/d21/d26/d34/d7a/d27 to d0/d18/d1c/d21/d26/d34/d6b/d7d 0 2024-09-20T18:35:42.504 INFO:tasks.workunit.client.1.smithi172.stdout:9/431: fdatasync d15/f18 0 2024-09-20T18:35:42.505 INFO:tasks.workunit.client.1.smithi172.stdout:8/422: mknod dd/d1b/d4f/d86/c99 0 2024-09-20T18:35:42.509 INFO:tasks.workunit.client.1.smithi172.stdout:3/469: rename d0/d13/d58/l5c to d0/d13/d32/d54/d71/l98 0 2024-09-20T18:35:42.510 INFO:tasks.workunit.client.1.smithi172.stdout:7/538: dwrite d2/f2b [0,4194304] 0 2024-09-20T18:35:42.510 INFO:tasks.workunit.client.1.smithi172.stdout:0/542: write d4/d20/f91 [45101,61231] 0 2024-09-20T18:35:42.511 INFO:tasks.workunit.client.1.smithi172.stdout:7/539: chown d2/d23/f30 25530034 1 2024-09-20T18:35:42.511 INFO:tasks.workunit.client.1.smithi172.stdout:0/543: chown d4/d44/f61 10784 1 2024-09-20T18:35:42.512 INFO:tasks.workunit.client.1.smithi172.stdout:7/540: chown d2/d3/d10/f18 10 1 2024-09-20T18:35:42.513 INFO:tasks.workunit.client.0.smithi017.stdout:3/156: dwrite da/de/d14/f30 [0,4194304] 0 2024-09-20T18:35:42.513 INFO:tasks.workunit.client.1.smithi172.stdout:2/394: truncate d0/d2c/d3f/d17/d18/f32 462763 0 2024-09-20T18:35:42.514 INFO:tasks.workunit.client.1.smithi172.stdout:8/423: mkdir dd/d1b/d4f/d9a 0 2024-09-20T18:35:42.515 INFO:tasks.workunit.client.1.smithi172.stdout:2/395: dread - d0/d2c/d3f/d17/d22/d10/f85 zero size 2024-09-20T18:35:42.515 INFO:tasks.workunit.client.0.smithi017.stdout:3/157: truncate da/de/d13/d16/f1e 1143954 0 2024-09-20T18:35:42.515 INFO:tasks.workunit.client.1.smithi172.stdout:6/402: mkdir d0/d18/d1c/d21/d26/d34/d7a/d47/d7b/d7e 0 2024-09-20T18:35:42.516 INFO:tasks.workunit.client.1.smithi172.stdout:5/482: rename d4/df/d3f/d64/l81 to d4/df/la3 0 2024-09-20T18:35:42.518 INFO:tasks.workunit.client.1.smithi172.stdout:3/470: fdatasync d0/dc/d6a/d22/f34 0 2024-09-20T18:35:42.519 INFO:tasks.workunit.client.1.smithi172.stdout:6/403: chown d0/d18/d1c/d21/d26/d34/d7a/l61 167440321 1 2024-09-20T18:35:42.519 INFO:tasks.workunit.client.0.smithi017.stdout:3/158: symlink da/de/d13/d2f/d26/l3e 0 2024-09-20T18:35:42.520 INFO:tasks.workunit.client.1.smithi172.stdout:7/541: dread d2/d23/d3a/f5c [0,4194304] 0 2024-09-20T18:35:42.520 INFO:tasks.workunit.client.0.smithi017.stdout:3/159: write da/de/d13/d16/f1e [619107,105669] 0 2024-09-20T18:35:42.522 INFO:tasks.workunit.client.0.smithi017.stdout:3/160: write da/de/d13/d2f/d26/d31/f36 [756965,31041] 0 2024-09-20T18:35:42.522 INFO:tasks.workunit.client.1.smithi172.stdout:0/544: unlink d4/d5/l21 0 2024-09-20T18:35:42.526 INFO:tasks.workunit.client.1.smithi172.stdout:3/471: dwrite d0/dc/d6a/f53 [0,4194304] 0 2024-09-20T18:35:42.528 INFO:tasks.workunit.client.1.smithi172.stdout:3/472: stat d0/d13/d32/f8a 0 2024-09-20T18:35:42.529 INFO:tasks.workunit.client.1.smithi172.stdout:5/483: creat d4/d1f/fa4 x:0 0 0 2024-09-20T18:35:42.529 INFO:tasks.workunit.client.1.smithi172.stdout:3/473: read d0/dc/d6a/d3a/f75 [1127778,28605] 0 2024-09-20T18:35:42.531 INFO:tasks.workunit.client.1.smithi172.stdout:5/484: chown d4/d1f/d26/d2d/d50/f1e 1650374 1 2024-09-20T18:35:42.532 INFO:tasks.workunit.client.1.smithi172.stdout:5/485: write d4/d1f/d26/d41/f7f [458993,15004] 0 2024-09-20T18:35:42.536 INFO:tasks.workunit.client.1.smithi172.stdout:2/396: creat d0/d2c/d3f/d17/d18/d29/d42/f8b x:0 0 0 2024-09-20T18:35:42.539 INFO:tasks.workunit.client.1.smithi172.stdout:9/432: creat d15/d1a/f91 x:0 0 0 2024-09-20T18:35:42.539 INFO:tasks.workunit.client.1.smithi172.stdout:9/433: chown d15/d54/f78 1301604 1 2024-09-20T18:35:42.540 INFO:tasks.workunit.client.1.smithi172.stdout:6/404: mknod d0/d18/d1c/d21/d26/d34/c7f 0 2024-09-20T18:35:42.542 INFO:tasks.workunit.client.1.smithi172.stdout:7/542: creat d2/d3/d3d/d68/fbe x:0 0 0 2024-09-20T18:35:42.542 INFO:tasks.workunit.client.1.smithi172.stdout:6/405: read d0/f13 [10135468,80991] 0 2024-09-20T18:35:42.542 INFO:tasks.workunit.client.1.smithi172.stdout:9/434: read d15/d20/f21 [7893084,81754] 0 2024-09-20T18:35:42.543 INFO:tasks.workunit.client.1.smithi172.stdout:9/435: truncate d15/d1a/f91 430916 0 2024-09-20T18:35:42.544 INFO:tasks.workunit.client.1.smithi172.stdout:9/436: write d15/d1a/d64/f75 [749896,81457] 0 2024-09-20T18:35:42.545 INFO:tasks.workunit.client.0.smithi017.stdout:3/161: truncate da/f15 847322 0 2024-09-20T18:35:42.547 INFO:tasks.workunit.client.1.smithi172.stdout:2/397: stat d0/d2c/d3f/d17/d22/d10/l2b 0 2024-09-20T18:35:42.554 INFO:tasks.workunit.client.1.smithi172.stdout:9/437: creat d15/d20/d76/f92 x:0 0 0 2024-09-20T18:35:42.555 INFO:tasks.workunit.client.1.smithi172.stdout:9/438: dread d15/d20/f73 [0,4194304] 0 2024-09-20T18:35:42.555 INFO:tasks.workunit.client.1.smithi172.stdout:3/474: link d0/d13/f1c d0/dc/d6a/d22/f99 0 2024-09-20T18:35:42.558 INFO:tasks.workunit.client.1.smithi172.stdout:5/486: creat d4/d1f/d26/d41/d65/d8f/fa5 x:0 0 0 2024-09-20T18:35:42.558 INFO:tasks.workunit.client.1.smithi172.stdout:2/398: fdatasync d0/d2c/f70 0 2024-09-20T18:35:42.560 INFO:tasks.workunit.client.1.smithi172.stdout:7/543: write d2/d3/dd/f4c [3627446,1031] 0 2024-09-20T18:35:42.561 INFO:tasks.workunit.client.1.smithi172.stdout:0/545: link d4/d1d/d15/caa d4/d5/d2e/d38/cc5 0 2024-09-20T18:35:42.562 INFO:tasks.workunit.client.1.smithi172.stdout:1/411: sync 2024-09-20T18:35:42.562 INFO:tasks.workunit.client.1.smithi172.stdout:6/406: mknod d0/d18/d1c/d21/d26/d34/d7a/d47/d7b/d7e/c80 0 2024-09-20T18:35:42.562 INFO:tasks.workunit.client.1.smithi172.stdout:7/544: chown d2/d3/d10/d40/d46/d8e/f6f 1 1 2024-09-20T18:35:42.563 INFO:tasks.workunit.client.0.smithi017.stdout:3/162: truncate da/de/f1a 360892 0 2024-09-20T18:35:42.564 INFO:tasks.workunit.client.1.smithi172.stdout:8/424: getdents dd/d1b/d3b/d51/d34/d39/d4d 0 2024-09-20T18:35:42.564 INFO:tasks.workunit.client.1.smithi172.stdout:7/545: chown d2/d3/d3d/d4e/d5f 473189141 1 2024-09-20T18:35:42.565 INFO:tasks.workunit.client.1.smithi172.stdout:5/487: dwrite d4/d1f/d26/f72 [0,4194304] 0 2024-09-20T18:35:42.565 INFO:tasks.workunit.client.1.smithi172.stdout:3/475: mknod d0/d13/d58/d6d/c9a 0 2024-09-20T18:35:42.566 INFO:tasks.workunit.client.1.smithi172.stdout:5/488: readlink d4/d1f/d26/d2d/d63/d80/l93 0 2024-09-20T18:35:42.567 INFO:tasks.workunit.client.1.smithi172.stdout:2/399: write d0/d2c/f3e [3025283,907] 0 2024-09-20T18:35:42.570 INFO:tasks.workunit.client.1.smithi172.stdout:0/546: symlink d4/d1d/d15/lc6 0 2024-09-20T18:35:42.570 INFO:tasks.workunit.client.1.smithi172.stdout:0/547: chown d4/d5/d2e/d33 0 1 2024-09-20T18:35:42.585 INFO:tasks.workunit.client.0.smithi017.stdout:3/163: write da/de/d14/d19/f1f [219658,43556] 0 2024-09-20T18:35:42.598 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:42 smithi017 ceph-mon[28058]: pgmap v25: 65 pgs: 65 active+clean; 732 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 9.9 MiB/s rd, 82 MiB/s wr, 273 op/s 2024-09-20T18:35:42.598 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:42 smithi017 ceph-mon[28058]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:35:42.598 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:42 smithi017 ceph-mon[28058]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:35:42.599 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:42 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3091032065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:35:42.603 INFO:tasks.workunit.client.1.smithi172.stdout:9/439: creat d15/d1f/d7e/f93 x:0 0 0 2024-09-20T18:35:42.603 INFO:tasks.workunit.client.1.smithi172.stdout:6/407: symlink d0/d18/d1c/d21/d26/d34/d39/d46/l81 0 2024-09-20T18:35:42.603 INFO:tasks.workunit.client.1.smithi172.stdout:3/476: truncate d0/dc/f3c 823251 0 2024-09-20T18:35:42.603 INFO:tasks.workunit.client.1.smithi172.stdout:5/489: creat d4/d1f/d26/d41/fa6 x:0 0 0 2024-09-20T18:35:42.604 INFO:tasks.workunit.client.1.smithi172.stdout:2/400: mknod d0/d4e/d59/c8c 0 2024-09-20T18:35:42.604 INFO:tasks.workunit.client.0.smithi017.stdout:3/164: rmdir da 39 2024-09-20T18:35:42.605 INFO:tasks.workunit.client.1.smithi172.stdout:6/408: write d0/f13 [550433,70832] 0 2024-09-20T18:35:42.605 INFO:tasks.workunit.client.1.smithi172.stdout:0/548: creat d4/d1a/d28/d42/db8/fc7 x:0 0 0 2024-09-20T18:35:42.606 INFO:tasks.workunit.client.1.smithi172.stdout:1/412: write d0/d8/db/f26 [538080,89298] 0 2024-09-20T18:35:42.608 INFO:tasks.workunit.client.1.smithi172.stdout:7/546: symlink d2/d3/d10/lbf 0 2024-09-20T18:35:42.608 INFO:tasks.workunit.client.0.smithi017.stdout:3/165: creat da/de/d13/d16/f3f x:0 0 0 2024-09-20T18:35:42.608 INFO:tasks.workunit.client.1.smithi172.stdout:3/477: creat d0/d13/d32/f9b x:0 0 0 2024-09-20T18:35:42.609 INFO:tasks.workunit.client.1.smithi172.stdout:6/409: truncate d0/d18/f43 995433 0 2024-09-20T18:35:42.609 INFO:tasks.workunit.client.1.smithi172.stdout:5/490: mkdir d4/d1f/d26/d2d/d50/da7 0 2024-09-20T18:35:42.609 INFO:tasks.workunit.client.1.smithi172.stdout:0/549: fsync d4/d46/f56 0 2024-09-20T18:35:42.612 INFO:tasks.workunit.client.1.smithi172.stdout:6/410: write d0/fe [1029241,103727] 0 2024-09-20T18:35:42.612 INFO:tasks.workunit.client.1.smithi172.stdout:0/550: chown d4/d5/f2f 6323438 1 2024-09-20T18:35:42.617 INFO:tasks.workunit.client.1.smithi172.stdout:2/401: dwrite d0/d2c/d3f/d17/d22/d10/d35/d5d/f64 [0,4194304] 0 2024-09-20T18:35:42.617 INFO:tasks.workunit.client.1.smithi172.stdout:7/547: mkdir d2/d23/dc0 0 2024-09-20T18:35:42.618 INFO:tasks.workunit.client.0.smithi017.stdout:3/166: getdents da/de/d14 0 2024-09-20T18:35:42.618 INFO:tasks.workunit.client.1.smithi172.stdout:7/548: chown d2/d23/d3a/c94 48829 1 2024-09-20T18:35:42.618 INFO:tasks.workunit.client.1.smithi172.stdout:9/440: dread d15/d4a/f55 [0,4194304] 0 2024-09-20T18:35:42.619 INFO:tasks.workunit.client.0.smithi017.stdout:3/167: stat da/de/d14/d19 0 2024-09-20T18:35:42.623 INFO:tasks.workunit.client.1.smithi172.stdout:3/478: rename d0/dc/d6a/f53 to d0/d13/d32/d54/d71/f9c 0 2024-09-20T18:35:42.623 INFO:tasks.workunit.client.1.smithi172.stdout:3/479: chown d0/d13/d1e 1585602 1 2024-09-20T18:35:42.624 INFO:tasks.workunit.client.1.smithi172.stdout:0/551: mknod d4/d1d/dac/cc8 0 2024-09-20T18:35:42.625 INFO:tasks.workunit.client.1.smithi172.stdout:0/552: chown d4/d20/f91 2051506 1 2024-09-20T18:35:42.630 INFO:tasks.workunit.client.1.smithi172.stdout:3/480: dread d0/dc/d6a/d3a/f7d [0,4194304] 0 2024-09-20T18:35:42.630 INFO:tasks.workunit.client.0.smithi017.stdout:3/168: mkdir da/de/d13/d40 0 2024-09-20T18:35:42.631 INFO:tasks.workunit.client.1.smithi172.stdout:0/553: dread d4/d1a/d28/d42/d45/d54/fb2 [0,4194304] 0 2024-09-20T18:35:42.631 INFO:tasks.workunit.client.1.smithi172.stdout:2/402: symlink d0/d2c/l8d 0 2024-09-20T18:35:42.633 INFO:tasks.workunit.client.1.smithi172.stdout:7/549: mknod d2/d23/d3a/d72/cc1 0 2024-09-20T18:35:42.633 INFO:tasks.workunit.client.1.smithi172.stdout:2/403: chown d0/d2c/d3f/d17/d22/d10/d35/d5d/f64 4394 1 2024-09-20T18:35:42.634 INFO:tasks.workunit.client.0.smithi017.stdout:3/169: mkdir da/de/d13/d2f/d26/d41 0 2024-09-20T18:35:42.635 INFO:tasks.workunit.client.1.smithi172.stdout:9/441: creat d15/d1a/d6f/f94 x:0 0 0 2024-09-20T18:35:42.637 INFO:tasks.workunit.client.0.smithi017.stdout:3/170: mknod da/c42 0 2024-09-20T18:35:42.637 INFO:tasks.workunit.client.1.smithi172.stdout:9/442: dread d15/d1a/f91 [0,4194304] 0 2024-09-20T18:35:42.637 INFO:tasks.workunit.client.1.smithi172.stdout:7/550: dread d2/d23/f30 [0,4194304] 0 2024-09-20T18:35:42.641 INFO:tasks.workunit.client.0.smithi017.stdout:3/171: fsync da/fb 0 2024-09-20T18:35:42.642 INFO:tasks.workunit.client.1.smithi172.stdout:9/443: dwrite d15/d1f/d7e/f93 [0,4194304] 0 2024-09-20T18:35:42.643 INFO:tasks.workunit.client.1.smithi172.stdout:9/444: write d15/d1a/d6f/f94 [783067,68310] 0 2024-09-20T18:35:42.643 INFO:tasks.workunit.client.1.smithi172.stdout:3/481: creat d0/dc/d61/d87/f9d x:0 0 0 2024-09-20T18:35:42.649 INFO:tasks.workunit.client.1.smithi172.stdout:4/403: sync 2024-09-20T18:35:42.654 INFO:tasks.workunit.client.1.smithi172.stdout:7/551: unlink d2/f2b 0 2024-09-20T18:35:42.657 INFO:tasks.workunit.client.1.smithi172.stdout:9/445: creat d15/d1f/d2c/d7d/d48/f95 x:0 0 0 2024-09-20T18:35:42.658 INFO:tasks.workunit.client.1.smithi172.stdout:9/446: chown d15/d20 58 1 2024-09-20T18:35:42.658 INFO:tasks.workunit.client.1.smithi172.stdout:9/447: chown d15/d1a/d6f 47023821 1 2024-09-20T18:35:42.664 INFO:tasks.workunit.client.1.smithi172.stdout:1/413: write d0/f61 [1500067,26402] 0 2024-09-20T18:35:42.666 INFO:tasks.workunit.client.1.smithi172.stdout:0/554: rmdir d4/d1a/d28/d42/d45/d97 0 2024-09-20T18:35:42.667 INFO:tasks.workunit.client.1.smithi172.stdout:5/491: write d4/d1f/d26/d2d/d50/d2c/f35 [657878,130161] 0 2024-09-20T18:35:42.672 INFO:tasks.workunit.client.1.smithi172.stdout:3/482: rename d0/d13/d58/d6d/d7f/d84/d90 to d0/d13/d9e 0 2024-09-20T18:35:42.673 INFO:tasks.workunit.client.1.smithi172.stdout:1/414: creat d0/d73/f90 x:0 0 0 2024-09-20T18:35:42.673 INFO:tasks.workunit.client.1.smithi172.stdout:6/411: write d0/d18/d1c/d21/d26/d34/d39/d46/f2a [795735,31958] 0 2024-09-20T18:35:42.673 INFO:tasks.workunit.client.1.smithi172.stdout:3/483: write d0/dc/d61/d87/f8f [244819,75947] 0 2024-09-20T18:35:42.673 INFO:tasks.workunit.client.1.smithi172.stdout:1/415: stat d0/d8 0 2024-09-20T18:35:42.673 INFO:tasks.workunit.client.1.smithi172.stdout:5/492: creat d4/d1f/d26/d2d/d63/d80/fa8 x:0 0 0 2024-09-20T18:35:42.675 INFO:tasks.workunit.client.1.smithi172.stdout:1/416: dread - d0/d8/db/d25/d2b/d3d/f3e zero size 2024-09-20T18:35:42.675 INFO:tasks.workunit.client.1.smithi172.stdout:6/412: chown d0/d18/d1c/d21/d26/d34/d6b/c73 1703658 1 2024-09-20T18:35:42.677 INFO:tasks.workunit.client.1.smithi172.stdout:0/555: truncate d4/d5/d2e/d33/f5a 2486351 0 2024-09-20T18:35:42.678 INFO:tasks.workunit.client.0.smithi017.stdout:3/172: getdents da/de/d13/d2f/d26 0 2024-09-20T18:35:42.679 INFO:tasks.workunit.client.1.smithi172.stdout:3/484: creat d0/d13/d58/d6d/d7f/f9f x:0 0 0 2024-09-20T18:35:42.680 INFO:tasks.workunit.client.1.smithi172.stdout:5/493: symlink d4/d1f/d26/d2d/d50/d2c/la9 0 2024-09-20T18:35:42.681 INFO:tasks.workunit.client.1.smithi172.stdout:5/494: chown d4/d1f/d26/d2d/d86 244675859 1 2024-09-20T18:35:42.682 INFO:tasks.workunit.client.0.smithi017.stdout:3/173: symlink da/de/d14/l43 0 2024-09-20T18:35:42.684 INFO:tasks.workunit.client.1.smithi172.stdout:0/556: rename d4/d1a/d28/d88 to d4/d1a/d28/d42/d45/d99/dc9 0 2024-09-20T18:35:42.685 INFO:tasks.workunit.client.1.smithi172.stdout:0/557: readlink d4/d5/d2e/d8e/la0 0 2024-09-20T18:35:42.686 INFO:tasks.workunit.client.1.smithi172.stdout:5/495: write d4/d1f/d26/d2d/d50/f1e [3876117,7507] 0 2024-09-20T18:35:42.687 INFO:tasks.workunit.client.0.smithi017.stdout:3/174: creat da/de/d13/d40/f44 x:0 0 0 2024-09-20T18:35:42.692 INFO:tasks.workunit.client.1.smithi172.stdout:0/558: dwrite d4/d44/faf [0,4194304] 0 2024-09-20T18:35:42.693 INFO:tasks.workunit.client.1.smithi172.stdout:1/417: creat d0/d8/db/d25/f91 x:0 0 0 2024-09-20T18:35:42.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.679+0000 7f64e899c640 1 -- 172.21.15.17:0/107870334 --> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f64e4106a20 con 0x7f64cc074a80 2024-09-20T18:35:42.694 INFO:tasks.workunit.client.1.smithi172.stdout:1/418: write d0/d8/f2c [4301026,48384] 0 2024-09-20T18:35:42.695 INFO:tasks.workunit.client.1.smithi172.stdout:4/404: truncate d0/d48/d90/d55/d53/f77 436949 0 2024-09-20T18:35:42.696 INFO:tasks.workunit.client.1.smithi172.stdout:7/552: chown d2/d3/d10/d40/d46/d8e/f6f 612 1 2024-09-20T18:35:42.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.681+0000 7f64d37fe640 1 -- 172.21.15.17:0/107870334 <== mgr.24405 v2:172.21.15.172:6828/3016443347 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f64e4106a20 con 0x7f64cc074a80 2024-09-20T18:35:42.696 INFO:tasks.workunit.client.1.smithi172.stdout:5/496: dread d4/f23 [0,4194304] 0 2024-09-20T18:35:42.698 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:35:42.698 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:35:42.698 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:35:42.698 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T18:35:42.698 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [], 2024-09-20T18:35:42.698 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "1/2 daemons upgraded", 2024-09-20T18:35:42.698 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-20T18:35:42.698 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:35:42.698 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:35:42.699 INFO:tasks.workunit.client.1.smithi172.stdout:7/553: read d2/d3/d10/f20 [2372239,69463] 0 2024-09-20T18:35:42.699 INFO:tasks.workunit.client.1.smithi172.stdout:3/485: creat d0/dc/fa0 x:0 0 0 2024-09-20T18:35:42.699 INFO:tasks.workunit.client.1.smithi172.stdout:3/486: dread - d0/d13/f72 zero size 2024-09-20T18:35:42.699 INFO:tasks.workunit.client.1.smithi172.stdout:3/487: stat d0/d13/d32 0 2024-09-20T18:35:42.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.685+0000 7f64e899c640 1 -- 172.21.15.17:0/107870334 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f64cc074a80 msgr2=0x7f64cc076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:42.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.685+0000 7f64e899c640 1 --2- 172.21.15.17:0/107870334 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f64cc074a80 0x7f64cc076f40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f64d8005fd0 tx=0x7f64d8005850 comp rx=0 tx=0).stop 2024-09-20T18:35:42.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.685+0000 7f64e899c640 1 -- 172.21.15.17:0/107870334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e40ff5d0 msgr2=0x7f64e41029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:35:42.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.685+0000 7f64e899c640 1 --2- 172.21.15.17:0/107870334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e40ff5d0 0x7f64e41029e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f64d40099d0 tx=0x7f64d40046c0 comp rx=0 tx=0).stop 2024-09-20T18:35:42.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.686+0000 7f64e899c640 1 -- 172.21.15.17:0/107870334 shutdown_connections 2024-09-20T18:35:42.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.686+0000 7f64e899c640 1 --2- 172.21.15.17:0/107870334 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f64cc074a80 0x7f64cc076f40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:42.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.686+0000 7f64e899c640 1 --2- 172.21.15.17:0/107870334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e40fffa0 0x7f64e41010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:42.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.687+0000 7f64e899c640 1 --2- 172.21.15.17:0/107870334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64e40ff5d0 0x7f64e41029e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:35:42.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.687+0000 7f64e899c640 1 -- 172.21.15.17:0/107870334 >> 172.21.15.17:0/107870334 conn(0x7f64e40fb350 msgr2=0x7f64e41052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:35:42.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.687+0000 7f64e899c640 1 -- 172.21.15.17:0/107870334 shutdown_connections 2024-09-20T18:35:42.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:35:42.688+0000 7f64e899c640 1 -- 172.21.15.17:0/107870334 wait complete. 2024-09-20T18:35:42.703 INFO:tasks.workunit.client.1.smithi172.stdout:0/559: symlink d4/d20/lca 0 2024-09-20T18:35:42.704 INFO:tasks.workunit.client.0.smithi017.stdout:3/175: getdents da/de/d13/d2f/d26 0 2024-09-20T18:35:42.706 INFO:tasks.workunit.client.1.smithi172.stdout:7/554: dwrite d2/d3/d3d/d68/fbe [0,4194304] 0 2024-09-20T18:35:42.708 INFO:tasks.workunit.client.1.smithi172.stdout:1/419: creat d0/d73/f92 x:0 0 0 2024-09-20T18:35:42.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:42 smithi172 ceph-mon[35456]: pgmap v25: 65 pgs: 65 active+clean; 732 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 9.9 MiB/s rd, 82 MiB/s wr, 273 op/s 2024-09-20T18:35:42.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:42 smithi172 ceph-mon[35456]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:35:42.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:42 smithi172 ceph-mon[35456]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:35:42.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:42 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3091032065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:35:42.712 INFO:tasks.workunit.client.0.smithi017.stdout:3/176: dwrite da/de/d14/f30 [0,4194304] 0 2024-09-20T18:35:42.712 INFO:tasks.workunit.client.1.smithi172.stdout:5/497: creat d4/d1f/d26/d2d/d86/faa x:0 0 0 2024-09-20T18:35:42.713 INFO:tasks.workunit.client.0.smithi017.stdout:3/177: chown da/de/d14/l43 11338045 1 2024-09-20T18:35:42.714 INFO:tasks.workunit.client.0.smithi017.stdout:3/178: fdatasync da/de/d14/d19/f1c 0 2024-09-20T18:35:42.717 INFO:tasks.workunit.client.1.smithi172.stdout:3/488: mknod d0/d13/d58/d6d/d7f/ca1 0 2024-09-20T18:35:42.717 INFO:tasks.workunit.client.1.smithi172.stdout:3/489: readlink d0/l7e 0 2024-09-20T18:35:42.720 INFO:tasks.workunit.client.1.smithi172.stdout:0/560: truncate d4/d1d/f37 1724682 0 2024-09-20T18:35:42.721 INFO:tasks.workunit.client.1.smithi172.stdout:0/561: truncate d4/d1a/fb5 331615 0 2024-09-20T18:35:42.723 INFO:tasks.workunit.client.0.smithi017.stdout:3/179: link da/de/d14/d19/f1c da/de/d13/d2f/d26/d31/f45 0 2024-09-20T18:35:42.724 INFO:tasks.workunit.client.1.smithi172.stdout:1/420: rmdir d0/d8/db/d25/d6d/d77 39 2024-09-20T18:35:42.724 INFO:tasks.workunit.client.0.smithi017.stdout:3/180: stat da/de/d13/d2f/d26/l3e 0 2024-09-20T18:35:42.725 INFO:tasks.workunit.client.1.smithi172.stdout:4/405: dread d0/de/dc/f7f [0,4194304] 0 2024-09-20T18:35:42.726 INFO:tasks.workunit.client.1.smithi172.stdout:5/498: mknod d4/d1f/d26/d2d/d63/cab 0 2024-09-20T18:35:42.728 INFO:tasks.workunit.client.1.smithi172.stdout:3/490: creat d0/dc/d6a/d76/fa2 x:0 0 0 2024-09-20T18:35:42.728 INFO:tasks.workunit.client.1.smithi172.stdout:4/406: write d0/d48/d90/d55/d53/d5c/f75 [62056,58774] 0 2024-09-20T18:35:42.730 INFO:tasks.workunit.client.1.smithi172.stdout:4/407: chown d0/de/d21/f2b 12987863 1 2024-09-20T18:35:42.731 INFO:tasks.workunit.client.1.smithi172.stdout:0/562: creat d4/d94/fcb x:0 0 0 2024-09-20T18:35:42.731 INFO:tasks.workunit.client.0.smithi017.stdout:3/181: dwrite da/de/d14/f28 [0,4194304] 0 2024-09-20T18:35:42.732 INFO:tasks.workunit.client.1.smithi172.stdout:0/563: fdatasync d4/d1a/f66 0 2024-09-20T18:35:42.733 INFO:tasks.workunit.client.1.smithi172.stdout:1/421: dwrite d0/d8/d12/f5d [0,4194304] 0 2024-09-20T18:35:42.734 INFO:tasks.workunit.client.1.smithi172.stdout:5/499: rename d4/d1f/d26/d2d/d50 to d4/d1f/d26/d41/d69/dac 0 2024-09-20T18:35:42.735 INFO:tasks.workunit.client.0.smithi017.stdout:3/182: symlink da/de/d14/d19/l46 0 2024-09-20T18:35:42.736 INFO:tasks.workunit.client.1.smithi172.stdout:7/555: link d2/d3/d10/d40/d6a/la4 d2/d3/dd/lc2 0 2024-09-20T18:35:42.739 INFO:tasks.workunit.client.1.smithi172.stdout:4/408: truncate d0/d48/d90/f37 4206306 0 2024-09-20T18:35:42.741 INFO:tasks.workunit.client.1.smithi172.stdout:0/564: creat d4/d44/dab/fcc x:0 0 0 2024-09-20T18:35:42.741 INFO:tasks.workunit.client.0.smithi017.stdout:3/183: dread da/f15 [0,4194304] 0 2024-09-20T18:35:42.743 INFO:tasks.workunit.client.1.smithi172.stdout:7/556: chown d2/d23/c33 56518 1 2024-09-20T18:35:42.743 INFO:tasks.workunit.client.1.smithi172.stdout:1/422: dwrite d0/f5a [0,4194304] 0 2024-09-20T18:35:42.744 INFO:tasks.workunit.client.1.smithi172.stdout:0/565: chown d4/d1a/d28/d42/d45/ca7 122804824 1 2024-09-20T18:35:42.744 INFO:tasks.workunit.client.1.smithi172.stdout:4/409: creat d0/d48/d90/d55/f98 x:0 0 0 2024-09-20T18:35:42.747 INFO:tasks.workunit.client.1.smithi172.stdout:1/423: mkdir d0/d8/db/d25/d2b/d3d/d65/d93 0 2024-09-20T18:35:42.747 INFO:tasks.workunit.client.1.smithi172.stdout:4/410: mkdir d0/de/dc/d3c/d99 0 2024-09-20T18:35:42.748 INFO:tasks.workunit.client.1.smithi172.stdout:0/566: mkdir d4/d1a/d28/d42/db8/dcd 0 2024-09-20T18:35:42.748 INFO:tasks.workunit.client.0.smithi017.stdout:3/184: dread da/de/d13/d2f/f2e [0,4194304] 0 2024-09-20T18:35:42.749 INFO:tasks.workunit.client.1.smithi172.stdout:4/411: dread - d0/d7/d6f/f79 zero size 2024-09-20T18:35:42.749 INFO:tasks.workunit.client.0.smithi017.stdout:3/185: rmdir da/de 39 2024-09-20T18:35:42.750 INFO:tasks.workunit.client.1.smithi172.stdout:1/424: symlink d0/d8/db/d25/d2b/d3d/l94 0 2024-09-20T18:35:42.751 INFO:tasks.workunit.client.1.smithi172.stdout:4/412: rmdir d0/de 39 2024-09-20T18:35:42.752 INFO:tasks.workunit.client.1.smithi172.stdout:1/425: symlink d0/d8/db/d39/l95 0 2024-09-20T18:35:42.752 INFO:tasks.workunit.client.1.smithi172.stdout:0/567: mkdir d4/d1a/d28/d42/db8/dcd/dce 0 2024-09-20T18:35:42.753 INFO:tasks.workunit.client.1.smithi172.stdout:1/426: write d0/d8/db/d39/f64 [458301,108587] 0 2024-09-20T18:35:42.753 INFO:tasks.workunit.client.0.smithi017.stdout:3/186: mknod da/de/d13/d2f/d26/d31/c47 0 2024-09-20T18:35:42.754 INFO:tasks.workunit.client.1.smithi172.stdout:0/568: stat d4/d1a/d28/d42/db8/dcd 0 2024-09-20T18:35:42.754 INFO:tasks.workunit.client.1.smithi172.stdout:4/413: stat d0/de/d21/d24/d34/l58 0 2024-09-20T18:35:42.754 INFO:tasks.workunit.client.1.smithi172.stdout:0/569: read - d4/d1d/f59 zero size 2024-09-20T18:35:42.754 INFO:tasks.workunit.client.1.smithi172.stdout:1/427: write d0/d8/f16 [3312396,57071] 0 2024-09-20T18:35:42.755 INFO:tasks.workunit.client.0.smithi017.stdout:3/187: symlink da/de/d13/d40/l48 0 2024-09-20T18:35:42.756 INFO:tasks.workunit.client.1.smithi172.stdout:1/428: readlink d0/d73/l72 0 2024-09-20T18:35:42.756 INFO:tasks.workunit.client.1.smithi172.stdout:4/414: chown d0/d48/d90/d55/d53/d78 7 1 2024-09-20T18:35:42.757 INFO:tasks.workunit.client.0.smithi017.stdout:3/188: symlink da/de/d13/d2f/d26/l49 0 2024-09-20T18:35:42.758 INFO:tasks.workunit.client.0.smithi017.stdout:3/189: read da/de/d14/d19/f32 [2683595,65735] 0 2024-09-20T18:35:42.759 INFO:tasks.workunit.client.1.smithi172.stdout:1/429: mkdir d0/d8/d12/d96 0 2024-09-20T18:35:42.759 INFO:tasks.workunit.client.1.smithi172.stdout:4/415: mkdir d0/de/d21/d24/d34/d72/d18/d51/d9a 0 2024-09-20T18:35:42.759 INFO:tasks.workunit.client.1.smithi172.stdout:8/425: sync 2024-09-20T18:35:42.761 INFO:tasks.workunit.client.0.smithi017.stdout:3/190: symlink da/de/d13/d2f/d26/d31/l4a 0 2024-09-20T18:35:42.761 INFO:tasks.workunit.client.1.smithi172.stdout:4/416: chown d0/d7/d6f/f91 7737 1 2024-09-20T18:35:42.761 INFO:tasks.workunit.client.1.smithi172.stdout:1/430: write d0/d22/f7a [462707,85257] 0 2024-09-20T18:35:42.762 INFO:tasks.workunit.client.1.smithi172.stdout:0/570: dwrite d4/d5/d2e/d67/f9e [0,4194304] 0 2024-09-20T18:35:42.763 INFO:tasks.workunit.client.1.smithi172.stdout:4/417: write d0/d48/d90/f89 [2865057,119469] 0 2024-09-20T18:35:42.764 INFO:tasks.workunit.client.1.smithi172.stdout:1/431: fdatasync d0/d8/f47 0 2024-09-20T18:35:42.765 INFO:tasks.workunit.client.1.smithi172.stdout:0/571: chown d4/d1a/d28/d75/d60/c84 502094439 1 2024-09-20T18:35:42.767 INFO:tasks.workunit.client.0.smithi017.stdout:3/191: dread da/de/d13/d16/f1e [0,4194304] 0 2024-09-20T18:35:42.767 INFO:tasks.workunit.client.1.smithi172.stdout:4/418: creat d0/de/d39/f9b x:0 0 0 2024-09-20T18:35:42.768 INFO:tasks.workunit.client.1.smithi172.stdout:0/572: creat d4/d1d/dac/fcf x:0 0 0 2024-09-20T18:35:42.768 INFO:tasks.workunit.client.0.smithi017.stdout:3/192: read da/de/d13/d2f/d26/d31/f45 [969027,44409] 0 2024-09-20T18:35:42.770 INFO:tasks.workunit.client.1.smithi172.stdout:0/573: mkdir d4/d1d/dac/dd0 0 2024-09-20T18:35:42.771 INFO:tasks.workunit.client.0.smithi017.stdout:3/193: mknod da/de/d13/d40/c4b 0 2024-09-20T18:35:42.772 INFO:tasks.workunit.client.0.smithi017.stdout:3/194: chown da/de/d14/d19/f32 0 1 2024-09-20T18:35:42.773 INFO:tasks.workunit.client.1.smithi172.stdout:0/574: mkdir d4/d1a/d28/d42/d45/dd1 0 2024-09-20T18:35:42.773 INFO:tasks.workunit.client.1.smithi172.stdout:4/419: fdatasync d0/d48/d4e/f96 0 2024-09-20T18:35:42.775 INFO:tasks.workunit.client.1.smithi172.stdout:4/420: write d0/de/dc/d3c/f5f [777347,52808] 0 2024-09-20T18:35:42.775 INFO:tasks.workunit.client.0.smithi017.stdout:3/195: creat da/de/d14/d19/f4c x:0 0 0 2024-09-20T18:35:42.777 INFO:tasks.workunit.client.1.smithi172.stdout:4/421: creat d0/d7/d6f/f9c x:0 0 0 2024-09-20T18:35:42.779 INFO:tasks.workunit.client.0.smithi017.stdout:3/196: link da/de/c18 da/c4d 0 2024-09-20T18:35:42.779 INFO:tasks.workunit.client.1.smithi172.stdout:4/422: chown d0/de/dc/c52 944789 1 2024-09-20T18:35:42.780 INFO:tasks.workunit.client.1.smithi172.stdout:0/575: dwrite d4/d5/d2e/f49 [0,4194304] 0 2024-09-20T18:35:42.781 INFO:tasks.workunit.client.0.smithi017.stdout:3/197: creat da/f4e x:0 0 0 2024-09-20T18:35:42.781 INFO:tasks.workunit.client.0.smithi017.stdout:3/198: dread - da/f4e zero size 2024-09-20T18:35:42.783 INFO:tasks.workunit.client.0.smithi017.stdout:3/199: readlink da/de/d13/d2f/l33 0 2024-09-20T18:35:42.783 INFO:tasks.workunit.client.1.smithi172.stdout:4/423: symlink d0/de/d21/d24/d34/d72/l9d 0 2024-09-20T18:35:42.783 INFO:tasks.workunit.client.1.smithi172.stdout:0/576: creat d4/d1a/d28/d42/d45/d99/dc9/fd2 x:0 0 0 2024-09-20T18:35:42.784 INFO:tasks.workunit.client.0.smithi017.stdout:3/200: write da/de/d13/d16/f3f [400672,70779] 0 2024-09-20T18:35:42.785 INFO:tasks.workunit.client.0.smithi017.stdout:3/201: dread - da/de/d13/d40/f44 zero size 2024-09-20T18:35:42.786 INFO:tasks.workunit.client.1.smithi172.stdout:0/577: mkdir d4/d5/d2e/d38/d96/dd3 0 2024-09-20T18:35:42.789 INFO:tasks.workunit.client.0.smithi017.stdout:3/202: mknod da/de/d13/c4f 0 2024-09-20T18:35:42.790 INFO:tasks.workunit.client.1.smithi172.stdout:4/424: dwrite d0/d48/d90/d55/f8c [0,4194304] 0 2024-09-20T18:35:42.791 INFO:tasks.workunit.client.1.smithi172.stdout:4/425: write d0/de/d21/d24/f2d [981926,91526] 0 2024-09-20T18:35:42.791 INFO:tasks.workunit.client.1.smithi172.stdout:4/426: readlink d0/d7/l7b 0 2024-09-20T18:35:42.792 INFO:tasks.workunit.client.1.smithi172.stdout:0/578: dread d4/d1a/d28/d42/f83 [0,4194304] 0 2024-09-20T18:35:42.792 INFO:tasks.workunit.client.0.smithi017.stdout:3/203: rename da/d37 to da/de/d13/d16/d50 0 2024-09-20T18:35:42.794 INFO:tasks.workunit.client.0.smithi017.stdout:3/204: dread da/de/d13/d16/f1e [0,4194304] 0 2024-09-20T18:35:42.795 INFO:tasks.workunit.client.1.smithi172.stdout:4/427: creat d0/d48/d90/d55/d53/f9e x:0 0 0 2024-09-20T18:35:42.795 INFO:tasks.workunit.client.1.smithi172.stdout:4/428: chown d0/de/d21/d24/f69 41520712 1 2024-09-20T18:35:42.795 INFO:tasks.workunit.client.1.smithi172.stdout:0/579: creat d4/d1d/d15/fd4 x:0 0 0 2024-09-20T18:35:42.796 INFO:tasks.workunit.client.1.smithi172.stdout:0/580: readlink d4/d5/d2e/d38/d96/la6 0 2024-09-20T18:35:42.796 INFO:tasks.workunit.client.1.smithi172.stdout:4/429: mkdir d0/de/d39/d9f 0 2024-09-20T18:35:42.797 INFO:tasks.workunit.client.1.smithi172.stdout:4/430: readlink d0/de/d21/d24/d34/l74 0 2024-09-20T18:35:42.798 INFO:tasks.workunit.client.1.smithi172.stdout:4/431: write d0/de/d21/f2b [5047490,59204] 0 2024-09-20T18:35:42.800 INFO:tasks.workunit.client.1.smithi172.stdout:4/432: creat d0/d48/d90/d55/fa0 x:0 0 0 2024-09-20T18:35:42.801 INFO:tasks.workunit.client.1.smithi172.stdout:4/433: chown d0/de/d21/d24/d34/d72/f11 61420 1 2024-09-20T18:35:42.802 INFO:tasks.workunit.client.1.smithi172.stdout:4/434: mknod d0/ca1 0 2024-09-20T18:35:42.803 INFO:tasks.workunit.client.1.smithi172.stdout:4/435: read - d0/d7/d6f/f91 zero size 2024-09-20T18:35:42.805 INFO:tasks.workunit.client.1.smithi172.stdout:4/436: mkdir d0/de/d39/d9f/da2 0 2024-09-20T18:35:42.807 INFO:tasks.workunit.client.1.smithi172.stdout:4/437: truncate d0/de/d39/f73 850658 0 2024-09-20T18:35:42.808 INFO:tasks.workunit.client.1.smithi172.stdout:0/581: dread d4/f11 [0,4194304] 0 2024-09-20T18:35:42.809 INFO:tasks.workunit.client.1.smithi172.stdout:4/438: mknod d0/de/dc/d3c/ca3 0 2024-09-20T18:35:42.810 INFO:tasks.workunit.client.1.smithi172.stdout:0/582: mkdir d4/d94/dd5 0 2024-09-20T18:35:42.812 INFO:tasks.workunit.client.1.smithi172.stdout:4/439: rename d0/de/d21/d24/d34/d72/l28 to d0/de/la4 0 2024-09-20T18:35:42.815 INFO:tasks.workunit.client.1.smithi172.stdout:0/583: dwrite d4/d44/faf [0,4194304] 0 2024-09-20T18:35:42.817 INFO:tasks.workunit.client.1.smithi172.stdout:2/404: sync 2024-09-20T18:35:42.817 INFO:tasks.workunit.client.1.smithi172.stdout:0/584: write d4/d1a/d28/f5e [636524,39567] 0 2024-09-20T18:35:42.819 INFO:tasks.workunit.client.1.smithi172.stdout:4/440: dwrite d0/de/f5a [0,4194304] 0 2024-09-20T18:35:42.819 INFO:tasks.workunit.client.1.smithi172.stdout:0/585: unlink d4/d44/c5f 0 2024-09-20T18:35:42.819 INFO:tasks.workunit.client.1.smithi172.stdout:2/405: creat d0/f8e x:0 0 0 2024-09-20T18:35:42.820 INFO:tasks.workunit.client.1.smithi172.stdout:4/441: stat d0/de/d21/d24/d34/d72 0 2024-09-20T18:35:42.820 INFO:tasks.workunit.client.1.smithi172.stdout:2/406: truncate d0/f8e 649872 0 2024-09-20T18:35:42.820 INFO:tasks.workunit.client.1.smithi172.stdout:0/586: fsync d4/d5/f2f 0 2024-09-20T18:35:42.822 INFO:tasks.workunit.client.1.smithi172.stdout:4/442: fsync d0/fa 0 2024-09-20T18:35:42.823 INFO:tasks.workunit.client.1.smithi172.stdout:4/443: write d0/f32 [3292647,66887] 0 2024-09-20T18:35:42.826 INFO:tasks.workunit.client.1.smithi172.stdout:0/587: link d4/d1a/d28/d42/d45/d54/f64 d4/d1d/fd6 0 2024-09-20T18:35:42.828 INFO:tasks.workunit.client.1.smithi172.stdout:0/588: write d4/d1a/d28/d42/d45/d54/f89 [363500,10948] 0 2024-09-20T18:35:42.828 INFO:tasks.workunit.client.1.smithi172.stdout:4/444: dwrite d0/de/d21/d24/d34/d72/d18/f3a [0,4194304] 0 2024-09-20T18:35:42.833 INFO:tasks.workunit.client.1.smithi172.stdout:4/445: mknod d0/de/d21/ca5 0 2024-09-20T18:35:42.837 INFO:tasks.workunit.client.1.smithi172.stdout:4/446: rename d0/de/dc/d3c/c4d to d0/de/dc/d3c/ca6 0 2024-09-20T18:35:42.843 INFO:tasks.workunit.client.1.smithi172.stdout:4/447: rename d0/de/d21/d24/d34/d72/d18/f3a to d0/de/d21/d24/fa7 0 2024-09-20T18:35:42.864 INFO:tasks.workunit.client.1.smithi172.stdout:3/491: dwrite d0/dc/f2a [0,4194304] 0 2024-09-20T18:35:42.869 INFO:tasks.workunit.client.1.smithi172.stdout:3/492: creat d0/d13/d1e/fa3 x:0 0 0 2024-09-20T18:35:42.871 INFO:tasks.workunit.client.1.smithi172.stdout:5/500: dwrite d4/d1f/d26/d41/d69/dac/d2c/f30 [0,4194304] 0 2024-09-20T18:35:42.873 INFO:tasks.workunit.client.1.smithi172.stdout:5/501: truncate d4/d1f/d26/d2d/f73 1959667 0 2024-09-20T18:35:42.876 INFO:tasks.workunit.client.1.smithi172.stdout:3/493: symlink d0/d13/d32/d54/d71/la4 0 2024-09-20T18:35:42.880 INFO:tasks.workunit.client.1.smithi172.stdout:6/413: sync 2024-09-20T18:35:42.880 INFO:tasks.workunit.client.1.smithi172.stdout:9/448: sync 2024-09-20T18:35:42.880 INFO:tasks.workunit.client.1.smithi172.stdout:5/502: dwrite d4/f4e [0,4194304] 0 2024-09-20T18:35:42.881 INFO:tasks.workunit.client.1.smithi172.stdout:3/494: creat d0/dc/d6a/d3a/d74/fa5 x:0 0 0 2024-09-20T18:35:42.884 INFO:tasks.workunit.client.1.smithi172.stdout:3/495: dread d0/dc/d6a/d3a/f3f [0,4194304] 0 2024-09-20T18:35:42.885 INFO:tasks.workunit.client.1.smithi172.stdout:7/557: dread d2/d3/d10/d40/d74/f9e [0,4194304] 0 2024-09-20T18:35:42.888 INFO:tasks.workunit.client.1.smithi172.stdout:3/496: creat d0/d13/d32/d54/d83/fa6 x:0 0 0 2024-09-20T18:35:42.888 INFO:tasks.workunit.client.1.smithi172.stdout:6/414: getdents d0/d18/d1c/d21/d26/d79 0 2024-09-20T18:35:42.890 INFO:tasks.workunit.client.1.smithi172.stdout:3/497: write d0/dc/d6a/f5b [1045538,110997] 0 2024-09-20T18:35:42.891 INFO:tasks.workunit.client.1.smithi172.stdout:7/558: creat d2/d23/d3c/fc3 x:0 0 0 2024-09-20T18:35:42.892 INFO:tasks.workunit.client.1.smithi172.stdout:8/426: write dd/d1b/d3b/d51/d5b/f7a [1080541,54639] 0 2024-09-20T18:35:42.894 INFO:tasks.workunit.client.1.smithi172.stdout:6/415: creat d0/d18/d1c/d21/d26/d34/f82 x:0 0 0 2024-09-20T18:35:42.896 INFO:tasks.workunit.client.1.smithi172.stdout:3/498: creat d0/d13/d32/d54/d71/fa7 x:0 0 0 2024-09-20T18:35:42.896 INFO:tasks.workunit.client.1.smithi172.stdout:7/559: unlink d2/d23/c38 0 2024-09-20T18:35:42.898 INFO:tasks.workunit.client.1.smithi172.stdout:1/432: write d0/d8/db/d25/d2b/d3d/f3e [1036570,36325] 0 2024-09-20T18:35:42.898 INFO:tasks.workunit.client.1.smithi172.stdout:8/427: chown dd/d1b/l29 192129 1 2024-09-20T18:35:42.898 INFO:tasks.workunit.client.1.smithi172.stdout:6/416: rmdir d0/d18/d1c/d21/d26/d34/d39/d46 39 2024-09-20T18:35:42.900 INFO:tasks.workunit.client.1.smithi172.stdout:8/428: chown dd/d65/d85/f8b 884 1 2024-09-20T18:35:42.901 INFO:tasks.workunit.client.1.smithi172.stdout:8/429: stat dd/d1b/d3b/d51/l56 0 2024-09-20T18:35:42.902 INFO:tasks.workunit.client.1.smithi172.stdout:7/560: creat d2/d23/d9d/fc4 x:0 0 0 2024-09-20T18:35:42.904 INFO:tasks.workunit.client.1.smithi172.stdout:6/417: unlink d0/d18/d1c/d21/d26/d34/d6b/d7d/d35/c4e 0 2024-09-20T18:35:42.906 INFO:tasks.workunit.client.1.smithi172.stdout:1/433: dwrite d0/d8/db/d25/d2b/d3d/f3e [0,4194304] 0 2024-09-20T18:35:42.907 INFO:tasks.workunit.client.1.smithi172.stdout:7/561: write d2/d3/d10/d40/d74/f9e [402205,35047] 0 2024-09-20T18:35:42.911 INFO:tasks.workunit.client.1.smithi172.stdout:1/434: creat d0/d8/db/d25/d6f/f97 x:0 0 0 2024-09-20T18:35:42.913 INFO:tasks.workunit.client.1.smithi172.stdout:6/418: dwrite d0/f36 [0,4194304] 0 2024-09-20T18:35:42.914 INFO:tasks.workunit.client.1.smithi172.stdout:1/435: truncate d0/d8/db/d25/f91 673954 0 2024-09-20T18:35:42.918 INFO:tasks.workunit.client.1.smithi172.stdout:1/436: dread d0/d8/db/f3c [0,4194304] 0 2024-09-20T18:35:42.918 INFO:tasks.workunit.client.1.smithi172.stdout:1/437: chown d0/d8/db/f75 42482005 1 2024-09-20T18:35:42.922 INFO:tasks.workunit.client.1.smithi172.stdout:1/438: rmdir d0/d8/db/d25/d6d 39 2024-09-20T18:35:42.924 INFO:tasks.workunit.client.1.smithi172.stdout:1/439: write d0/d8/db/f33 [1297351,60716] 0 2024-09-20T18:35:42.924 INFO:tasks.workunit.client.0.smithi017.stdout:3/205: dwrite da/f15 [0,4194304] 0 2024-09-20T18:35:42.926 INFO:tasks.workunit.client.0.smithi017.stdout:3/206: write da/de/d14/d19/f4c [767588,3591] 0 2024-09-20T18:35:42.927 INFO:tasks.workunit.client.1.smithi172.stdout:1/440: stat d0/d8/db/d25/d6d 0 2024-09-20T18:35:42.928 INFO:tasks.workunit.client.1.smithi172.stdout:1/441: stat d0/d8/db/l8b 0 2024-09-20T18:35:42.930 INFO:tasks.workunit.client.0.smithi017.stdout:3/207: rename da/de/d13/d2f/l20 to da/de/d13/d2f/d26/d41/l51 0 2024-09-20T18:35:42.932 INFO:tasks.workunit.client.1.smithi172.stdout:1/442: mknod d0/d8/c98 0 2024-09-20T18:35:42.935 INFO:tasks.workunit.client.0.smithi017.stdout:3/208: dread da/de/d13/d2f/d26/d31/f36 [0,4194304] 0 2024-09-20T18:35:42.937 INFO:tasks.workunit.client.0.smithi017.stdout:3/209: chown da/de/d14/d19/f1f 0 1 2024-09-20T18:35:42.937 INFO:tasks.workunit.client.1.smithi172.stdout:0/589: write d4/d1a/d28/d42/d45/d54/fb2 [695013,85462] 0 2024-09-20T18:35:42.939 INFO:tasks.workunit.client.1.smithi172.stdout:7/562: dread d2/d3/d10/f14 [4194304,4194304] 0 2024-09-20T18:35:42.940 INFO:tasks.workunit.client.1.smithi172.stdout:4/448: truncate d0/de/dc/f81 826638 0 2024-09-20T18:35:42.941 INFO:tasks.workunit.client.1.smithi172.stdout:2/407: dwrite d0/f3 [0,4194304] 0 2024-09-20T18:35:42.942 INFO:tasks.workunit.client.1.smithi172.stdout:0/590: write d4/d1d/fb4 [1298287,34932] 0 2024-09-20T18:35:42.945 INFO:tasks.workunit.client.1.smithi172.stdout:7/563: write d2/f25 [1318425,66275] 0 2024-09-20T18:35:42.945 INFO:tasks.workunit.client.1.smithi172.stdout:4/449: symlink d0/d48/la8 0 2024-09-20T18:35:42.947 INFO:tasks.workunit.client.1.smithi172.stdout:7/564: truncate d2/d3/d3d/d4e/fae 792658 0 2024-09-20T18:35:42.948 INFO:tasks.workunit.client.1.smithi172.stdout:2/408: unlink d0/d2c/d3f/d17/d22/d10/c76 0 2024-09-20T18:35:42.949 INFO:tasks.workunit.client.1.smithi172.stdout:2/409: chown d0/d2c/d3f/d17/d18/d3b 21951 1 2024-09-20T18:35:42.950 INFO:tasks.workunit.client.1.smithi172.stdout:0/591: symlink d4/d5/ld7 0 2024-09-20T18:35:42.950 INFO:tasks.workunit.client.1.smithi172.stdout:0/592: read - d4/d44/f6e zero size 2024-09-20T18:35:42.953 INFO:tasks.workunit.client.1.smithi172.stdout:7/565: mknod d2/d3/d10/d40/d74/cc5 0 2024-09-20T18:35:42.954 INFO:tasks.workunit.client.1.smithi172.stdout:2/410: write d0/d2c/d3f/d17/d18/d29/f56 [1492592,11242] 0 2024-09-20T18:35:42.955 INFO:tasks.workunit.client.1.smithi172.stdout:4/450: symlink d0/de/dc/d3c/d99/la9 0 2024-09-20T18:35:42.956 INFO:tasks.workunit.client.1.smithi172.stdout:0/593: truncate d4/d1d/d15/f69 2082005 0 2024-09-20T18:35:42.956 INFO:tasks.workunit.client.1.smithi172.stdout:4/451: write d0/de/d21/d24/f69 [1342554,37297] 0 2024-09-20T18:35:42.958 INFO:tasks.workunit.client.1.smithi172.stdout:4/452: readlink d0/de/d21/d24/d34/l58 0 2024-09-20T18:35:42.959 INFO:tasks.workunit.client.1.smithi172.stdout:4/453: read d0/f32 [1673277,55404] 0 2024-09-20T18:35:42.993 INFO:tasks.workunit.client.1.smithi172.stdout:7/566: mkdir d2/d3/d10/d40/d6a/dc6 0 2024-09-20T18:35:42.993 INFO:tasks.workunit.client.1.smithi172.stdout:7/567: chown d2/d3/d10/d40/d6a/f8a 141 1 2024-09-20T18:35:42.997 INFO:tasks.workunit.client.1.smithi172.stdout:2/411: symlink d0/d2c/d51/d61/l8f 0 2024-09-20T18:35:43.002 INFO:tasks.workunit.client.1.smithi172.stdout:3/499: dwrite d0/f7 [0,4194304] 0 2024-09-20T18:35:43.002 INFO:tasks.workunit.client.1.smithi172.stdout:3/500: dread - d0/d13/f72 zero size 2024-09-20T18:35:43.003 INFO:tasks.workunit.client.1.smithi172.stdout:0/594: rename d4/d20/l25 to d4/d1d/d7f/ld8 0 2024-09-20T18:35:43.010 INFO:tasks.workunit.client.1.smithi172.stdout:4/454: unlink d0/de/dc/d3c/f86 0 2024-09-20T18:35:43.011 INFO:tasks.workunit.client.1.smithi172.stdout:7/568: truncate d2/d23/f30 153246 0 2024-09-20T18:35:43.012 INFO:tasks.workunit.client.1.smithi172.stdout:8/430: write dd/d1b/d3b/d51/f76 [2372167,26814] 0 2024-09-20T18:35:43.019 INFO:tasks.workunit.client.1.smithi172.stdout:4/455: dwrite d0/d48/d4e/f96 [0,4194304] 0 2024-09-20T18:35:43.020 INFO:tasks.workunit.client.1.smithi172.stdout:0/595: symlink d4/d5/d2e/d38/ld9 0 2024-09-20T18:35:43.020 INFO:tasks.workunit.client.1.smithi172.stdout:6/419: truncate d0/d18/d1c/f6e 2891252 0 2024-09-20T18:35:43.025 INFO:tasks.workunit.client.1.smithi172.stdout:2/412: mkdir d0/d90 0 2024-09-20T18:35:43.028 INFO:tasks.workunit.client.1.smithi172.stdout:1/443: truncate d0/f10 2601424 0 2024-09-20T18:35:43.030 INFO:tasks.workunit.client.1.smithi172.stdout:4/456: fsync d0/d7/f62 0 2024-09-20T18:35:43.032 INFO:tasks.workunit.client.0.smithi017.stdout:3/210: write da/fb [886121,96544] 0 2024-09-20T18:35:43.032 INFO:tasks.workunit.client.1.smithi172.stdout:7/569: dread d2/d3/d10/f15 [0,4194304] 0 2024-09-20T18:35:43.034 INFO:tasks.workunit.client.1.smithi172.stdout:5/503: sync 2024-09-20T18:35:43.034 INFO:tasks.workunit.client.1.smithi172.stdout:9/449: sync 2024-09-20T18:35:43.038 INFO:tasks.workunit.client.0.smithi017.stdout:3/211: mkdir da/de/d13/d40/d52 0 2024-09-20T18:35:43.040 INFO:tasks.workunit.client.1.smithi172.stdout:6/420: dwrite d0/d18/d1c/d21/d26/d34/d39/d46/f7 [4194304,4194304] 0 2024-09-20T18:35:43.042 INFO:tasks.workunit.client.1.smithi172.stdout:9/450: dwrite d15/d1a/d64/f75 [0,4194304] 0 2024-09-20T18:35:43.050 INFO:tasks.workunit.client.1.smithi172.stdout:9/451: dwrite d15/d20/f3a [0,4194304] 0 2024-09-20T18:35:43.057 INFO:tasks.workunit.client.1.smithi172.stdout:2/413: creat d0/f91 x:0 0 0 2024-09-20T18:35:43.059 INFO:tasks.workunit.client.1.smithi172.stdout:9/452: creat d15/d4a/f96 x:0 0 0 2024-09-20T18:35:43.060 INFO:tasks.workunit.client.1.smithi172.stdout:9/453: write d15/d1f/d2c/d7d/d48/f79 [913150,7028] 0 2024-09-20T18:35:43.061 INFO:tasks.workunit.client.1.smithi172.stdout:4/457: rmdir d0/de/d39/d9f/da2 0 2024-09-20T18:35:43.064 INFO:tasks.workunit.client.1.smithi172.stdout:9/454: dread d15/d1f/d2c/d7d/d48/f81 [0,4194304] 0 2024-09-20T18:35:43.069 INFO:tasks.workunit.client.1.smithi172.stdout:2/414: getdents d0/d2c/d3f/d17/d22/d10/d35/d5d 0 2024-09-20T18:35:43.071 INFO:tasks.workunit.client.1.smithi172.stdout:9/455: creat d15/d4a/d8c/f97 x:0 0 0 2024-09-20T18:35:43.073 INFO:tasks.workunit.client.1.smithi172.stdout:2/415: creat d0/d4e/d59/f92 x:0 0 0 2024-09-20T18:35:43.085 INFO:tasks.workunit.client.1.smithi172.stdout:2/416: dread d0/d2c/d3f/f26 [0,4194304] 0 2024-09-20T18:35:43.086 INFO:tasks.workunit.client.1.smithi172.stdout:9/456: dread d15/d1f/d2c/d7d/d48/f66 [0,4194304] 0 2024-09-20T18:35:43.091 INFO:tasks.workunit.client.1.smithi172.stdout:9/457: link d15/d20/d76/f92 d15/d1f/d88/f98 0 2024-09-20T18:35:43.096 INFO:tasks.workunit.client.1.smithi172.stdout:9/458: dwrite d15/d1f/d2c/d7d/d48/f95 [0,4194304] 0 2024-09-20T18:35:43.118 INFO:tasks.workunit.client.1.smithi172.stdout:3/501: dwrite d0/dc/d6a/d3a/f75 [0,4194304] 0 2024-09-20T18:35:43.125 INFO:tasks.workunit.client.1.smithi172.stdout:3/502: dwrite d0/dc/d6a/d22/f7a [4194304,4194304] 0 2024-09-20T18:35:43.129 INFO:tasks.workunit.client.1.smithi172.stdout:3/503: mknod d0/d13/d9e/ca8 0 2024-09-20T18:35:43.131 INFO:tasks.workunit.client.1.smithi172.stdout:2/417: creat d0/d2c/d3f/d17/d22/d10/f93 x:0 0 0 2024-09-20T18:35:43.133 INFO:tasks.workunit.client.1.smithi172.stdout:3/504: creat d0/dc/d6a/d22/fa9 x:0 0 0 2024-09-20T18:35:43.134 INFO:tasks.workunit.client.0.smithi017.stdout:3/212: rename da/de/d13/d40 to da/de/d53 0 2024-09-20T18:35:43.134 INFO:tasks.workunit.client.1.smithi172.stdout:2/418: mknod d0/d2c/d3f/d17/d18/d3b/c94 0 2024-09-20T18:35:43.135 INFO:tasks.workunit.client.1.smithi172.stdout:1/444: write d0/d8/db/f75 [4839385,114036] 0 2024-09-20T18:35:43.137 INFO:tasks.workunit.client.1.smithi172.stdout:0/596: truncate d4/f7e 6509 0 2024-09-20T18:35:43.138 INFO:tasks.workunit.client.1.smithi172.stdout:3/505: symlink d0/d13/d32/d88/laa 0 2024-09-20T18:35:43.138 INFO:tasks.workunit.client.1.smithi172.stdout:0/597: chown d4/d5/d2e/c65 224 1 2024-09-20T18:35:43.139 INFO:tasks.workunit.client.1.smithi172.stdout:1/445: creat d0/d22/f99 x:0 0 0 2024-09-20T18:35:43.141 INFO:tasks.workunit.client.1.smithi172.stdout:2/419: dwrite d0/f91 [0,4194304] 0 2024-09-20T18:35:43.146 INFO:tasks.workunit.client.1.smithi172.stdout:1/446: mkdir d0/d9a 0 2024-09-20T18:35:43.147 INFO:tasks.workunit.client.1.smithi172.stdout:0/598: getdents d4/d1a/d28/d42/db8/dcd/dce 0 2024-09-20T18:35:43.149 INFO:tasks.workunit.client.1.smithi172.stdout:7/570: truncate d2/d3/d10/d40/d74/f9e 186216 0 2024-09-20T18:35:43.152 INFO:tasks.workunit.client.1.smithi172.stdout:1/447: dwrite d0/d8/db/d25/d6f/f97 [0,4194304] 0 2024-09-20T18:35:43.154 INFO:tasks.workunit.client.1.smithi172.stdout:0/599: creat d4/d1d/fda x:0 0 0 2024-09-20T18:35:43.156 INFO:tasks.workunit.client.1.smithi172.stdout:0/600: truncate d4/d1a/d28/d42/db8/fc7 185391 0 2024-09-20T18:35:43.160 INFO:tasks.workunit.client.1.smithi172.stdout:8/431: rename dd/c1a to dd/d1b/d4f/d9a/c9b 0 2024-09-20T18:35:43.162 INFO:tasks.workunit.client.1.smithi172.stdout:8/432: write dd/d1b/d3b/f42 [767372,127715] 0 2024-09-20T18:35:43.162 INFO:tasks.workunit.client.1.smithi172.stdout:1/448: getdents d0/d8/db/d25/d2b/d3d 0 2024-09-20T18:35:43.163 INFO:tasks.workunit.client.1.smithi172.stdout:0/601: creat d4/d1d/fdb x:0 0 0 2024-09-20T18:35:43.169 INFO:tasks.workunit.client.1.smithi172.stdout:8/433: getdents dd/d65 0 2024-09-20T18:35:43.170 INFO:tasks.workunit.client.1.smithi172.stdout:4/458: creat d0/de/d21/faa x:0 0 0 2024-09-20T18:35:43.170 INFO:tasks.workunit.client.1.smithi172.stdout:0/602: getdents d4/d1a/d28/d42/d45/d99 0 2024-09-20T18:35:43.172 INFO:tasks.workunit.client.1.smithi172.stdout:5/504: rename d4/d1f to d4/df/dad 0 2024-09-20T18:35:43.173 INFO:tasks.workunit.client.1.smithi172.stdout:0/603: creat d4/d44/fdc x:0 0 0 2024-09-20T18:35:43.175 INFO:tasks.workunit.client.1.smithi172.stdout:3/506: rename d0/dc/l3d to d0/d13/d9e/lab 0 2024-09-20T18:35:43.176 INFO:tasks.workunit.client.1.smithi172.stdout:8/434: dread dd/f1c [0,4194304] 0 2024-09-20T18:35:43.177 INFO:tasks.workunit.client.1.smithi172.stdout:4/459: dwrite d0/de/f5e [0,4194304] 0 2024-09-20T18:35:43.177 INFO:tasks.workunit.client.1.smithi172.stdout:5/505: unlink d4/df/d3f/l46 0 2024-09-20T18:35:43.181 INFO:tasks.workunit.client.1.smithi172.stdout:8/435: rmdir dd/d65/d85 39 2024-09-20T18:35:43.184 INFO:tasks.workunit.client.1.smithi172.stdout:0/604: link d4/d5/d2e/d38/d96/f9f d4/d1a/d28/d75/d60/fdd 0 2024-09-20T18:35:43.187 INFO:tasks.workunit.client.1.smithi172.stdout:6/421: rmdir d0/d18/d1c/d21/d26 39 2024-09-20T18:35:43.188 INFO:tasks.workunit.client.1.smithi172.stdout:3/507: dwrite d0/f16 [0,4194304] 0 2024-09-20T18:35:43.188 INFO:tasks.workunit.client.1.smithi172.stdout:9/459: truncate d15/d1f/d2c/d7d/d48/f4f 1970279 0 2024-09-20T18:35:43.189 INFO:tasks.workunit.client.1.smithi172.stdout:4/460: creat d0/de/d21/d24/d34/d72/d18/d51/d9a/fab x:0 0 0 2024-09-20T18:35:43.191 INFO:tasks.workunit.client.1.smithi172.stdout:0/605: truncate d4/d1a/d28/d75/d60/fdd 755592 0 2024-09-20T18:35:43.191 INFO:tasks.workunit.client.1.smithi172.stdout:4/461: read - d0/de/d39/f9b zero size 2024-09-20T18:35:43.192 INFO:tasks.workunit.client.1.smithi172.stdout:8/436: dwrite dd/d1b/d3b/d51/d34/d39/f72 [0,4194304] 0 2024-09-20T18:35:43.193 INFO:tasks.workunit.client.1.smithi172.stdout:6/422: symlink d0/d18/d1c/d21/l83 0 2024-09-20T18:35:43.197 INFO:tasks.workunit.client.1.smithi172.stdout:9/460: symlink d15/l99 0 2024-09-20T18:35:43.197 INFO:tasks.workunit.client.1.smithi172.stdout:0/606: read d4/d1a/d28/d42/f4c [1536194,123035] 0 2024-09-20T18:35:43.198 INFO:tasks.workunit.client.1.smithi172.stdout:8/437: rmdir dd/d65 39 2024-09-20T18:35:43.200 INFO:tasks.workunit.client.1.smithi172.stdout:3/508: dwrite d0/d13/d1e/f59 [0,4194304] 0 2024-09-20T18:35:43.203 INFO:tasks.workunit.client.1.smithi172.stdout:0/607: creat d4/d1a/d28/d42/fde x:0 0 0 2024-09-20T18:35:43.204 INFO:tasks.workunit.client.1.smithi172.stdout:4/462: creat d0/de/fac x:0 0 0 2024-09-20T18:35:43.205 INFO:tasks.workunit.client.1.smithi172.stdout:6/423: unlink d0/d18/d1c/d21/d26/d34/d6b/d7d/f75 0 2024-09-20T18:35:43.207 INFO:tasks.workunit.client.1.smithi172.stdout:8/438: creat dd/d1b/d3b/d5d/d7d/f9c x:0 0 0 2024-09-20T18:35:43.210 INFO:tasks.workunit.client.1.smithi172.stdout:8/439: read - dd/d1b/d3b/d51/d34/d39/f6e zero size 2024-09-20T18:35:43.210 INFO:tasks.workunit.client.1.smithi172.stdout:4/463: stat d0/d48/d90/d55/d53/d5c/c92 0 2024-09-20T18:35:43.211 INFO:tasks.workunit.client.1.smithi172.stdout:0/608: mkdir d4/d1a/ddf 0 2024-09-20T18:35:43.214 INFO:tasks.workunit.client.1.smithi172.stdout:4/464: creat d0/de/d21/d24/d34/fad x:0 0 0 2024-09-20T18:35:43.214 INFO:tasks.workunit.client.1.smithi172.stdout:4/465: write d0/d7/d6f/f9c [996811,47693] 0 2024-09-20T18:35:43.216 INFO:tasks.workunit.client.1.smithi172.stdout:0/609: creat d4/d20/fe0 x:0 0 0 2024-09-20T18:35:43.216 INFO:tasks.workunit.client.1.smithi172.stdout:4/466: rename d0/de/d21/d24/d34/d72/d18/d51 to d0/de/d21/d24/d34/d72/d18/d51/dae 22 2024-09-20T18:35:43.220 INFO:tasks.workunit.client.1.smithi172.stdout:8/440: creat dd/d1b/d3b/d51/f9d x:0 0 0 2024-09-20T18:35:43.224 INFO:tasks.workunit.client.0.smithi017.stdout:3/213: write da/de/f12 [4991716,55318] 0 2024-09-20T18:35:43.229 INFO:tasks.workunit.client.1.smithi172.stdout:2/420: write d0/f8 [347727,13137] 0 2024-09-20T18:35:43.230 INFO:tasks.workunit.client.1.smithi172.stdout:2/421: readlink d0/d2c/l8d 0 2024-09-20T18:35:43.231 INFO:tasks.workunit.client.1.smithi172.stdout:2/422: chown d0/d4e/d59/f92 188703 1 2024-09-20T18:35:43.233 INFO:tasks.workunit.client.1.smithi172.stdout:7/571: truncate d2/d3/d3d/d68/fbe 177322 0 2024-09-20T18:35:43.233 INFO:tasks.workunit.client.0.smithi017.stdout:3/214: dwrite da/de/f12 [4194304,4194304] 0 2024-09-20T18:35:43.234 INFO:tasks.workunit.client.1.smithi172.stdout:2/423: unlink d0/d2c/d3f/d17/d18/d29/d42/l7d 0 2024-09-20T18:35:43.234 INFO:tasks.workunit.client.0.smithi017.stdout:3/215: write da/fb [1573577,105834] 0 2024-09-20T18:35:43.237 INFO:tasks.workunit.client.1.smithi172.stdout:0/610: rename d4/d1d to d4/d5/d2e/d33/de1 0 2024-09-20T18:35:43.238 INFO:tasks.workunit.client.1.smithi172.stdout:1/449: write d0/d8/db/d25/d2b/f37 [925056,56075] 0 2024-09-20T18:35:43.247 INFO:tasks.workunit.client.0.smithi017.stdout:3/216: dwrite da/de/d13/d16/f1e [0,4194304] 0 2024-09-20T18:35:43.248 INFO:tasks.workunit.client.0.smithi017.stdout:3/217: truncate da/f4e 763794 0 2024-09-20T18:35:43.257 INFO:tasks.workunit.client.0.smithi017.stdout:3/218: dread da/de/d14/d19/f1c [0,4194304] 0 2024-09-20T18:35:43.258 INFO:tasks.workunit.client.0.smithi017.stdout:3/219: write da/de/d14/f28 [1828755,110332] 0 2024-09-20T18:35:43.259 INFO:tasks.workunit.client.0.smithi017.stdout:3/220: read da/fb [64599,85538] 0 2024-09-20T18:35:43.270 INFO:tasks.workunit.client.0.smithi017.stdout:3/221: dwrite da/de/d13/d2f/d26/d31/f36 [0,4194304] 0 2024-09-20T18:35:43.272 INFO:tasks.workunit.client.1.smithi172.stdout:2/424: creat d0/d90/f95 x:0 0 0 2024-09-20T18:35:43.273 INFO:tasks.workunit.client.1.smithi172.stdout:3/509: readlink d0/d13/d9e/lab 0 2024-09-20T18:35:43.275 INFO:tasks.workunit.client.1.smithi172.stdout:6/424: write d0/d18/d1c/d21/d26/d34/d7a/f2e [1068509,94562] 0 2024-09-20T18:35:43.275 INFO:tasks.workunit.client.0.smithi017.stdout:3/222: creat da/de/d13/f54 x:0 0 0 2024-09-20T18:35:43.276 INFO:tasks.workunit.client.1.smithi172.stdout:7/572: getdents d2/d3/d10/d40/d46 0 2024-09-20T18:35:43.277 INFO:tasks.workunit.client.1.smithi172.stdout:2/425: symlink d0/d90/l96 0 2024-09-20T18:35:43.278 INFO:tasks.workunit.client.1.smithi172.stdout:2/426: write d0/d2c/d3f/d17/d22/d10/d3c/d68/f73 [411606,14040] 0 2024-09-20T18:35:43.279 INFO:tasks.workunit.client.1.smithi172.stdout:2/427: write d0/d2c/d3f/d17/d22/d4c/f88 [675131,104444] 0 2024-09-20T18:35:43.281 INFO:tasks.workunit.client.1.smithi172.stdout:0/611: dread d4/d1a/f1e [0,4194304] 0 2024-09-20T18:35:43.281 INFO:tasks.workunit.client.1.smithi172.stdout:2/428: chown d0/d2c/d3f/d17/d18/d29/d42/d4b/d53 687985685 1 2024-09-20T18:35:43.283 INFO:tasks.workunit.client.0.smithi017.stdout:3/223: dwrite da/de/d14/f28 [0,4194304] 0 2024-09-20T18:35:43.283 INFO:tasks.workunit.client.1.smithi172.stdout:6/425: creat d0/d18/d1c/d21/d26/d34/d6b/f84 x:0 0 0 2024-09-20T18:35:43.284 INFO:tasks.workunit.client.1.smithi172.stdout:6/426: readlink d0/d18/d1c/d21/d26/d34/d7a/l61 0 2024-09-20T18:35:43.285 INFO:tasks.workunit.client.1.smithi172.stdout:6/427: fsync d0/d18/d1c/d21/d26/d34/d39/d46/f7 0 2024-09-20T18:35:43.285 INFO:tasks.workunit.client.1.smithi172.stdout:3/510: link d0/d13/f1c d0/d13/d58/d6d/d7f/fac 0 2024-09-20T18:35:43.286 INFO:tasks.workunit.client.1.smithi172.stdout:3/511: stat d0/dc/le 0 2024-09-20T18:35:43.288 INFO:tasks.workunit.client.1.smithi172.stdout:2/429: mkdir d0/d2c/d3f/d17/d22/d10/d97 0 2024-09-20T18:35:43.288 INFO:tasks.workunit.client.0.smithi017.stdout:3/224: truncate da/de/d13/d2f/f2e 1769120 0 2024-09-20T18:35:43.290 INFO:tasks.workunit.client.1.smithi172.stdout:1/450: link d0/d8/db/d25/f91 d0/d8/db/d25/d6d/d77/f9b 0 2024-09-20T18:35:43.291 INFO:tasks.workunit.client.1.smithi172.stdout:7/573: dread d2/d3/dd/f19 [0,4194304] 0 2024-09-20T18:35:43.293 INFO:tasks.workunit.client.1.smithi172.stdout:6/428: dwrite d0/d18/d1c/d21/f7c [0,4194304] 0 2024-09-20T18:35:43.295 INFO:tasks.workunit.client.1.smithi172.stdout:3/512: creat d0/d13/d32/d54/d83/fad x:0 0 0 2024-09-20T18:35:43.297 INFO:tasks.workunit.client.1.smithi172.stdout:3/513: write d0/dc/d61/d87/f9d [526971,12849] 0 2024-09-20T18:35:43.298 INFO:tasks.workunit.client.1.smithi172.stdout:3/514: chown d0/d13/d9e/lab 692 1 2024-09-20T18:35:43.298 INFO:tasks.workunit.client.1.smithi172.stdout:1/451: read d0/d22/f28 [3638315,114639] 0 2024-09-20T18:35:43.298 INFO:tasks.workunit.client.1.smithi172.stdout:7/574: unlink d2/d23/d3c/f44 0 2024-09-20T18:35:43.299 INFO:tasks.workunit.client.1.smithi172.stdout:3/515: write d0/d13/f72 [273789,42234] 0 2024-09-20T18:35:43.300 INFO:tasks.workunit.client.1.smithi172.stdout:1/452: stat d0/d8/db/d25/d2b/d3d/l85 0 2024-09-20T18:35:43.300 INFO:tasks.workunit.client.1.smithi172.stdout:1/453: readlink d0/l15 0 2024-09-20T18:35:43.301 INFO:tasks.workunit.client.1.smithi172.stdout:6/429: creat d0/d18/d1c/d21/d26/d34/f85 x:0 0 0 2024-09-20T18:35:43.301 INFO:tasks.workunit.client.1.smithi172.stdout:3/516: chown d0/dc/f2e 29 1 2024-09-20T18:35:43.302 INFO:tasks.workunit.client.1.smithi172.stdout:6/430: stat d0/d18/f2b 0 2024-09-20T18:35:43.304 INFO:tasks.workunit.client.1.smithi172.stdout:1/454: creat d0/d22/f9c x:0 0 0 2024-09-20T18:35:43.305 INFO:tasks.workunit.client.1.smithi172.stdout:2/430: getdents d0/d2c/d3f/d17/d22 0 2024-09-20T18:35:43.306 INFO:tasks.workunit.client.1.smithi172.stdout:6/431: write d0/d18/f54 [1799350,3620] 0 2024-09-20T18:35:43.309 INFO:tasks.workunit.client.0.smithi017.stdout:3/225: write da/fb [1751107,88404] 0 2024-09-20T18:35:43.312 INFO:tasks.workunit.client.0.smithi017.stdout:3/226: symlink da/de/l55 0 2024-09-20T18:35:43.312 INFO:tasks.workunit.client.1.smithi172.stdout:7/575: dwrite d2/d3/d3d/d4e/d5f/f9c [0,4194304] 0 2024-09-20T18:35:43.313 INFO:tasks.workunit.client.1.smithi172.stdout:0/612: dwrite d4/d5/d2e/d33/de1/d15/f3b [4194304,4194304] 0 2024-09-20T18:35:43.314 INFO:tasks.workunit.client.1.smithi172.stdout:6/432: write d0/d18/d1c/d21/d26/d34/d7a/f63 [639962,24930] 0 2024-09-20T18:35:43.315 INFO:tasks.workunit.client.1.smithi172.stdout:3/517: dread d0/d13/d58/f4a [0,4194304] 0 2024-09-20T18:35:43.316 INFO:tasks.workunit.client.1.smithi172.stdout:4/467: sync 2024-09-20T18:35:43.316 INFO:tasks.workunit.client.1.smithi172.stdout:9/461: sync 2024-09-20T18:35:43.317 INFO:tasks.workunit.client.1.smithi172.stdout:8/441: sync 2024-09-20T18:35:43.317 INFO:tasks.workunit.client.1.smithi172.stdout:5/506: sync 2024-09-20T18:35:43.318 INFO:tasks.workunit.client.0.smithi017.stdout:3/227: mknod da/c56 0 2024-09-20T18:35:43.318 INFO:tasks.workunit.client.0.smithi017.stdout:3/228: dread - da/de/d53/f44 zero size 2024-09-20T18:35:43.319 INFO:tasks.workunit.client.1.smithi172.stdout:9/462: write d15/d1f/d2c/d7d/d34/f3b [148808,77575] 0 2024-09-20T18:35:43.320 INFO:tasks.workunit.client.1.smithi172.stdout:2/431: rename d0/d4e to d0/d2c/d3f/d17/d22/d10/d6a/d98 0 2024-09-20T18:35:43.323 INFO:tasks.workunit.client.0.smithi017.stdout:3/229: rename da/de/d14/l2d to da/de/d13/d2f/d26/d31/l57 0 2024-09-20T18:35:43.323 INFO:tasks.workunit.client.0.smithi017.stdout:3/230: stat da/de 0 2024-09-20T18:35:43.324 INFO:tasks.workunit.client.0.smithi017.stdout:3/231: fdatasync da/de/d14/d19/f4c 0 2024-09-20T18:35:43.324 INFO:tasks.workunit.client.1.smithi172.stdout:5/507: fdatasync d4/f4e 0 2024-09-20T18:35:43.326 INFO:tasks.workunit.client.1.smithi172.stdout:2/432: fsync d0/d2c/d3f/f30 0 2024-09-20T18:35:43.326 INFO:tasks.workunit.client.1.smithi172.stdout:6/433: mknod d0/d18/d1c/d21/d26/d34/c86 0 2024-09-20T18:35:43.328 INFO:tasks.workunit.client.0.smithi017.stdout:3/232: dread da/de/d14/d19/f1c [0,4194304] 0 2024-09-20T18:35:43.329 INFO:tasks.workunit.client.1.smithi172.stdout:9/463: read d15/d1a/f91 [26419,23278] 0 2024-09-20T18:35:43.329 INFO:tasks.workunit.client.1.smithi172.stdout:2/433: readlink d0/d90/l96 0 2024-09-20T18:35:43.329 INFO:tasks.workunit.client.1.smithi172.stdout:7/576: mknod d2/d3/d10/d40/d46/d8e/dbd/cc7 0 2024-09-20T18:35:43.330 INFO:tasks.workunit.client.1.smithi172.stdout:4/468: truncate d0/de/d21/faa 741390 0 2024-09-20T18:35:43.332 INFO:tasks.workunit.client.1.smithi172.stdout:9/464: write d15/d1a/d64/f75 [1226797,119376] 0 2024-09-20T18:35:43.333 INFO:tasks.workunit.client.1.smithi172.stdout:3/518: rename d0/dc/f2a to d0/d13/d32/d88/fae 0 2024-09-20T18:35:43.334 INFO:tasks.workunit.client.0.smithi017.stdout:3/233: dwrite da/de/d14/f28 [0,4194304] 0 2024-09-20T18:35:43.335 INFO:tasks.workunit.client.1.smithi172.stdout:4/469: fdatasync d0/d48/d90/d55/d53/f9e 0 2024-09-20T18:35:43.335 INFO:tasks.workunit.client.1.smithi172.stdout:0/613: dwrite d4/d1a/d28/d75/f8d [0,4194304] 0 2024-09-20T18:35:43.335 INFO:tasks.workunit.client.0.smithi017.stdout:3/234: fdatasync da/de/d13/f54 0 2024-09-20T18:35:43.337 INFO:tasks.workunit.client.1.smithi172.stdout:1/455: dread d0/d8/db/f33 [0,4194304] 0 2024-09-20T18:35:43.341 INFO:tasks.workunit.client.1.smithi172.stdout:2/434: creat d0/d2c/d3f/d17/d22/d4c/f99 x:0 0 0 2024-09-20T18:35:43.348 INFO:tasks.workunit.client.1.smithi172.stdout:3/519: mkdir d0/d13/d32/d54/daf 0 2024-09-20T18:35:43.348 INFO:tasks.workunit.client.1.smithi172.stdout:9/465: dwrite d15/d54/f78 [0,4194304] 0 2024-09-20T18:35:43.351 INFO:tasks.workunit.client.1.smithi172.stdout:4/470: symlink d0/de/dc/laf 0 2024-09-20T18:35:43.351 INFO:tasks.workunit.client.1.smithi172.stdout:5/508: link d4/df/d3f/f7c d4/df/dad/d26/d41/fae 0 2024-09-20T18:35:43.352 INFO:tasks.workunit.client.1.smithi172.stdout:8/442: dread dd/d1b/d3b/d51/f2e [0,4194304] 0 2024-09-20T18:35:43.353 INFO:tasks.workunit.client.1.smithi172.stdout:2/435: mknod d0/d2c/d3f/d17/d45/c9a 0 2024-09-20T18:35:43.355 INFO:tasks.workunit.client.1.smithi172.stdout:6/434: truncate d0/d18/d1c/d21/d26/f60 1651819 0 2024-09-20T18:35:43.356 INFO:tasks.workunit.client.0.smithi017.stdout:3/235: write da/de/d13/d2f/f2e [1692233,83137] 0 2024-09-20T18:35:43.356 INFO:tasks.workunit.client.1.smithi172.stdout:9/466: fdatasync f12 0 2024-09-20T18:35:43.357 INFO:tasks.workunit.client.1.smithi172.stdout:3/520: creat d0/d13/d58/fb0 x:0 0 0 2024-09-20T18:35:43.357 INFO:tasks.workunit.client.0.smithi017.stdout:3/236: dread - da/de/d14/f38 zero size 2024-09-20T18:35:43.359 INFO:tasks.workunit.client.1.smithi172.stdout:2/436: truncate d0/d2c/d3f/d17/d18/d3b/f44 1664410 0 2024-09-20T18:35:43.359 INFO:tasks.workunit.client.0.smithi017.stdout:3/237: write da/de/d13/f54 [77432,71705] 0 2024-09-20T18:35:43.359 INFO:tasks.workunit.client.1.smithi172.stdout:4/471: mknod d0/de/d21/d24/cb0 0 2024-09-20T18:35:43.359 INFO:tasks.workunit.client.0.smithi017.stdout:3/238: chown da/de/d53/c4b 15 1 2024-09-20T18:35:43.361 INFO:tasks.workunit.client.0.smithi017.stdout:3/239: truncate da/de/d14/d19/f4c 1192153 0 2024-09-20T18:35:43.361 INFO:tasks.workunit.client.1.smithi172.stdout:4/472: chown d0/de/f5a 2 1 2024-09-20T18:35:43.362 INFO:tasks.workunit.client.1.smithi172.stdout:7/577: dread d2/d23/f66 [0,4194304] 0 2024-09-20T18:35:43.363 INFO:tasks.workunit.client.1.smithi172.stdout:6/435: mknod d0/d18/d1c/d21/d26/d34/d6b/c87 0 2024-09-20T18:35:43.363 INFO:tasks.workunit.client.1.smithi172.stdout:0/614: dread d4/d1a/f66 [0,4194304] 0 2024-09-20T18:35:43.365 INFO:tasks.workunit.client.1.smithi172.stdout:7/578: fdatasync d2/d3/f45 0 2024-09-20T18:35:43.365 INFO:tasks.workunit.client.1.smithi172.stdout:1/456: rename d0/d8/ld to d0/l9d 0 2024-09-20T18:35:43.366 INFO:tasks.workunit.client.1.smithi172.stdout:4/473: write d0/de/d21/d24/d34/d72/f5d [201427,21289] 0 2024-09-20T18:35:43.369 INFO:tasks.workunit.client.0.smithi017.stdout:3/240: creat da/f58 x:0 0 0 2024-09-20T18:35:43.370 INFO:tasks.workunit.client.1.smithi172.stdout:3/521: dwrite d0/dc/d6a/d3a/f80 [0,4194304] 0 2024-09-20T18:35:43.370 INFO:tasks.workunit.client.0.smithi017.stdout:3/241: fsync da/de/d14/d19/f1f 0 2024-09-20T18:35:43.372 INFO:tasks.workunit.client.1.smithi172.stdout:5/509: unlink d4/df/dad/d26/d41/d69/dac/c2e 0 2024-09-20T18:35:43.372 INFO:tasks.workunit.client.1.smithi172.stdout:2/437: dwrite d0/d2c/d3f/d17/d18/d29/f41 [0,4194304] 0 2024-09-20T18:35:43.378 INFO:tasks.workunit.client.0.smithi017.stdout:3/242: dwrite da/de/d13/d16/f1e [0,4194304] 0 2024-09-20T18:35:43.384 INFO:tasks.workunit.client.1.smithi172.stdout:7/579: mkdir d2/d3/d3d/d68/dc8 0 2024-09-20T18:35:43.386 INFO:tasks.workunit.client.1.smithi172.stdout:3/522: creat d0/d13/d58/d6d/d7f/fb1 x:0 0 0 2024-09-20T18:35:43.386 INFO:tasks.workunit.client.1.smithi172.stdout:5/510: rmdir d4/df/d3f/d64 39 2024-09-20T18:35:43.388 INFO:tasks.workunit.client.1.smithi172.stdout:2/438: mknod d0/d2c/d3f/d17/d22/d10/d35/d5d/c9b 0 2024-09-20T18:35:43.389 INFO:tasks.workunit.client.0.smithi017.stdout:3/243: dwrite da/de/d14/d19/f1f [0,4194304] 0 2024-09-20T18:35:43.390 INFO:tasks.workunit.client.1.smithi172.stdout:0/615: fsync d4/d1a/d28/d42/d45/d54/f5d 0 2024-09-20T18:35:43.391 INFO:tasks.workunit.client.0.smithi017.stdout:3/244: write da/de/d14/f28 [3086235,23902] 0 2024-09-20T18:35:43.391 INFO:tasks.workunit.client.1.smithi172.stdout:9/467: dread d15/d1f/d2c/f70 [0,4194304] 0 2024-09-20T18:35:43.392 INFO:tasks.workunit.client.1.smithi172.stdout:1/457: creat d0/d8/d12/d96/f9e x:0 0 0 2024-09-20T18:35:43.394 INFO:tasks.workunit.client.1.smithi172.stdout:3/523: dwrite d0/f44 [0,4194304] 0 2024-09-20T18:35:43.395 INFO:tasks.workunit.client.1.smithi172.stdout:9/468: read d15/d1a/d82/f77 [1001768,96543] 0 2024-09-20T18:35:43.397 INFO:tasks.workunit.client.1.smithi172.stdout:3/524: write d0/d13/d58/d6d/d7f/f9f [48872,45022] 0 2024-09-20T18:35:43.397 INFO:tasks.workunit.client.1.smithi172.stdout:4/474: unlink d0/d48/d4e/c60 0 2024-09-20T18:35:43.397 INFO:tasks.workunit.client.0.smithi017.stdout:3/245: mknod da/de/d13/d16/d50/c59 0 2024-09-20T18:35:43.398 INFO:tasks.workunit.client.0.smithi017.stdout:3/246: chown da/f15 989 1 2024-09-20T18:35:43.399 INFO:tasks.workunit.client.0.smithi017.stdout:3/247: chown da/de/d14/d19/f4c 241264424 1 2024-09-20T18:35:43.401 INFO:tasks.workunit.client.1.smithi172.stdout:4/475: chown d0/de/lb 246257145 1 2024-09-20T18:35:43.402 INFO:tasks.workunit.client.1.smithi172.stdout:0/616: dwrite d4/d44/dab/fcc [0,4194304] 0 2024-09-20T18:35:43.403 INFO:tasks.workunit.client.1.smithi172.stdout:7/580: write d2/d3/d10/f14 [5932690,128062] 0 2024-09-20T18:35:43.403 INFO:tasks.workunit.client.1.smithi172.stdout:6/436: creat d0/d18/d1c/d21/f88 x:0 0 0 2024-09-20T18:35:43.406 INFO:tasks.workunit.client.0.smithi017.stdout:3/248: mkdir da/de/d13/d2f/d26/d31/d5a 0 2024-09-20T18:35:43.406 INFO:tasks.workunit.client.0.smithi017.stdout:3/249: stat da/de/d13/d2f/d26/l49 0 2024-09-20T18:35:43.408 INFO:tasks.workunit.client.1.smithi172.stdout:2/439: chown d0/d2c/d3f/d17/d22/d10/d3c/c89 14519596 1 2024-09-20T18:35:43.409 INFO:tasks.workunit.client.1.smithi172.stdout:2/440: chown d0/d2c/f3d 0 1 2024-09-20T18:35:43.409 INFO:tasks.workunit.client.1.smithi172.stdout:2/441: chown d0/d2c/d3f/d17 7150 1 2024-09-20T18:35:43.413 INFO:tasks.workunit.client.1.smithi172.stdout:1/458: mknod d0/d73/c9f 0 2024-09-20T18:35:43.414 INFO:tasks.workunit.client.1.smithi172.stdout:1/459: truncate d0/d73/f92 310883 0 2024-09-20T18:35:43.415 INFO:tasks.workunit.client.1.smithi172.stdout:9/469: fdatasync d15/d1a/d82/f77 0 2024-09-20T18:35:43.415 INFO:tasks.workunit.client.1.smithi172.stdout:1/460: dread - d0/d22/f99 zero size 2024-09-20T18:35:43.416 INFO:tasks.workunit.client.1.smithi172.stdout:1/461: readlink d0/d73/l67 0 2024-09-20T18:35:43.417 INFO:tasks.workunit.client.1.smithi172.stdout:4/476: readlink d0/de/la4 0 2024-09-20T18:35:43.417 INFO:tasks.workunit.client.1.smithi172.stdout:1/462: dread d0/d73/f92 [0,4194304] 0 2024-09-20T18:35:43.418 INFO:tasks.workunit.client.1.smithi172.stdout:0/617: chown d4/d5/d2e/d33/de1/f37 15230847 1 2024-09-20T18:35:43.418 INFO:tasks.workunit.client.1.smithi172.stdout:1/463: chown d0/d8/c98 114628 1 2024-09-20T18:35:43.419 INFO:tasks.workunit.client.1.smithi172.stdout:6/437: creat d0/d18/d1c/d21/d26/d34/d6b/d7d/d35/f89 x:0 0 0 2024-09-20T18:35:43.428 INFO:tasks.workunit.client.0.smithi017.stdout:3/250: write da/de/d13/d2f/d26/d31/f45 [950962,127860] 0 2024-09-20T18:35:43.431 INFO:tasks.workunit.client.0.smithi017.stdout:3/251: creat da/de/f5b x:0 0 0 2024-09-20T18:35:43.431 INFO:tasks.workunit.client.0.smithi017.stdout:3/252: chown da/de/d13/f54 13727699 1 2024-09-20T18:35:43.434 INFO:tasks.workunit.client.0.smithi017.stdout:3/253: creat da/f5c x:0 0 0 2024-09-20T18:35:43.436 INFO:tasks.workunit.client.0.smithi017.stdout:3/254: write da/de/d13/d2f/d26/d31/f45 [2559202,63932] 0 2024-09-20T18:35:43.437 INFO:tasks.workunit.client.0.smithi017.stdout:3/255: write da/de/d14/d19/f1c [3063110,61840] 0 2024-09-20T18:35:43.439 INFO:tasks.workunit.client.1.smithi172.stdout:5/511: link d4/df/dad/d26/d41/d65/d8f/fa5 d4/df/dad/faf 0 2024-09-20T18:35:43.439 INFO:tasks.workunit.client.0.smithi017.stdout:3/256: readlink da/de/d13/d2f/d26/d31/l57 0 2024-09-20T18:35:43.440 INFO:tasks.workunit.client.1.smithi172.stdout:8/443: rename dd/d1b/f2c to dd/d65/f9e 0 2024-09-20T18:35:43.441 INFO:tasks.workunit.client.1.smithi172.stdout:3/525: mkdir d0/d13/db2 0 2024-09-20T18:35:43.442 INFO:tasks.workunit.client.1.smithi172.stdout:4/477: symlink d0/de/d21/d24/d34/d72/d18/d51/d9a/lb1 0 2024-09-20T18:35:43.442 INFO:tasks.workunit.client.1.smithi172.stdout:6/438: mknod d0/d18/d1c/d21/d26/d34/d7a/d47/d62/c8a 0 2024-09-20T18:35:43.444 INFO:tasks.workunit.client.1.smithi172.stdout:2/442: fsync d0/d2c/d3f/d17/d22/d10/d6a/d98/d59/f5c 0 2024-09-20T18:35:43.445 INFO:tasks.workunit.client.1.smithi172.stdout:0/618: rename c1 to d4/d5/d2e/d33/de1/dac/dd0/ce2 0 2024-09-20T18:35:43.446 INFO:tasks.workunit.client.0.smithi017.stdout:3/257: link da/de/d13/d2f/d26/d31/l57 da/de/d14/d19/l5d 0 2024-09-20T18:35:43.448 INFO:tasks.workunit.client.1.smithi172.stdout:1/464: dwrite d0/d8/db/d25/d2b/d3d/d65/f6a [0,4194304] 0 2024-09-20T18:35:43.449 INFO:tasks.workunit.client.1.smithi172.stdout:7/581: dread d2/d3/fb [0,4194304] 0 2024-09-20T18:35:43.451 INFO:tasks.workunit.client.1.smithi172.stdout:3/526: dread d0/dc/d6a/f5b [0,4194304] 0 2024-09-20T18:35:43.453 INFO:tasks.workunit.client.1.smithi172.stdout:5/512: symlink d4/df/d3f/lb0 0 2024-09-20T18:35:43.454 INFO:tasks.workunit.client.0.smithi017.stdout:3/258: symlink da/l5e 0 2024-09-20T18:35:43.454 INFO:tasks.workunit.client.1.smithi172.stdout:8/444: dwrite dd/d1b/f8d [0,4194304] 0 2024-09-20T18:35:43.458 INFO:tasks.workunit.client.1.smithi172.stdout:0/619: dwrite d4/fa1 [0,4194304] 0 2024-09-20T18:35:43.463 INFO:tasks.workunit.client.0.smithi017.stdout:3/259: getdents da/de/d53/d52 0 2024-09-20T18:35:43.472 INFO:tasks.workunit.client.0.smithi017.stdout:3/260: rename da/de/d13/c4f to da/de/d13/d2f/d26/d31/d5a/c5f 0 2024-09-20T18:35:43.473 INFO:tasks.workunit.client.1.smithi172.stdout:3/527: creat d0/dc/d6a/d3a/fb3 x:0 0 0 2024-09-20T18:35:43.476 INFO:tasks.workunit.client.1.smithi172.stdout:8/445: symlink dd/d1b/d3b/d51/d5b/l9f 0 2024-09-20T18:35:43.477 INFO:tasks.workunit.client.1.smithi172.stdout:0/620: creat d4/d1a/d28/d42/d45/d99/dc9/fe3 x:0 0 0 2024-09-20T18:35:43.478 INFO:tasks.workunit.client.1.smithi172.stdout:1/465: write d0/d8/db/d39/f55 [876594,94937] 0 2024-09-20T18:35:43.478 INFO:tasks.workunit.client.1.smithi172.stdout:0/621: chown d4/d1a/l90 98147753 1 2024-09-20T18:35:43.479 INFO:tasks.workunit.client.1.smithi172.stdout:1/466: write d0/d8/d12/f1a [1362868,20544] 0 2024-09-20T18:35:43.479 INFO:tasks.workunit.client.1.smithi172.stdout:2/443: rename d0/d1a/c1c to d0/d2c/d3f/d17/d22/d10/d97/c9c 0 2024-09-20T18:35:43.481 INFO:tasks.workunit.client.1.smithi172.stdout:3/528: creat d0/dc/d61/fb4 x:0 0 0 2024-09-20T18:35:43.481 INFO:tasks.workunit.client.1.smithi172.stdout:8/446: symlink dd/d1b/d4f/d86/la0 0 2024-09-20T18:35:43.483 INFO:tasks.workunit.client.1.smithi172.stdout:5/513: dread d4/df/dad/d26/d41/d69/dac/f33 [0,4194304] 0 2024-09-20T18:35:43.485 INFO:tasks.workunit.client.1.smithi172.stdout:4/478: rename d0/de/d21/d24/d34/d72/d18/d51/c6b to d0/d48/d90/d55/d53/cb2 0 2024-09-20T18:35:43.488 INFO:tasks.workunit.client.1.smithi172.stdout:5/514: dread - d4/df/dad/d26/d2d/d86/f88 zero size 2024-09-20T18:35:43.489 INFO:tasks.workunit.client.1.smithi172.stdout:7/582: dread d2/f4a [0,4194304] 0 2024-09-20T18:35:43.492 INFO:tasks.workunit.client.1.smithi172.stdout:4/479: symlink d0/de/d21/lb3 0 2024-09-20T18:35:43.493 INFO:tasks.workunit.client.1.smithi172.stdout:0/622: dwrite d4/d5/d2e/d33/de1/fb4 [0,4194304] 0 2024-09-20T18:35:43.499 INFO:tasks.workunit.client.1.smithi172.stdout:1/467: dwrite d0/d8/db/d25/d6f/f79 [0,4194304] 0 2024-09-20T18:35:43.500 INFO:tasks.workunit.client.1.smithi172.stdout:2/444: dwrite d0/d2c/d3f/d17/d22/d10/f93 [0,4194304] 0 2024-09-20T18:35:43.502 INFO:tasks.workunit.client.1.smithi172.stdout:7/583: creat d2/d3/d10/d40/d46/d8e/dbd/fc9 x:0 0 0 2024-09-20T18:35:43.503 INFO:tasks.workunit.client.1.smithi172.stdout:4/480: mkdir d0/d48/d90/db4 0 2024-09-20T18:35:43.504 INFO:tasks.workunit.client.1.smithi172.stdout:3/529: dwrite d0/dc/d6a/d3a/d74/f8b [0,4194304] 0 2024-09-20T18:35:43.505 INFO:tasks.workunit.client.1.smithi172.stdout:8/447: truncate dd/d1b/d3b/d51/f35 333183 0 2024-09-20T18:35:43.510 INFO:tasks.workunit.client.1.smithi172.stdout:0/623: rename d4/d1a/d28/d42/l62 to d4/d1a/d28/d42/db8/le4 0 2024-09-20T18:35:43.512 INFO:tasks.workunit.client.1.smithi172.stdout:4/481: mknod d0/d48/cb5 0 2024-09-20T18:35:43.515 INFO:tasks.workunit.client.1.smithi172.stdout:3/530: symlink d0/d13/d32/d54/d71/lb5 0 2024-09-20T18:35:43.516 INFO:tasks.workunit.client.1.smithi172.stdout:8/448: dwrite dd/d1b/d3b/d51/d34/d39/f6a [4194304,4194304] 0 2024-09-20T18:35:43.517 INFO:tasks.workunit.client.1.smithi172.stdout:1/468: mknod d0/d8/db/ca0 0 2024-09-20T18:35:43.517 INFO:tasks.workunit.client.1.smithi172.stdout:7/584: dwrite d2/d3/dd/f4c [0,4194304] 0 2024-09-20T18:35:43.519 INFO:tasks.workunit.client.1.smithi172.stdout:2/445: mkdir d0/d2c/d3f/d17/d22/d10/d3c/d7b/d9d 0 2024-09-20T18:35:43.519 INFO:tasks.workunit.client.1.smithi172.stdout:1/469: write d0/d8/d12/f1a [501693,127082] 0 2024-09-20T18:35:43.525 INFO:tasks.workunit.client.1.smithi172.stdout:4/482: mknod d0/d48/d90/d55/d53/d5c/cb6 0 2024-09-20T18:35:43.526 INFO:tasks.workunit.client.1.smithi172.stdout:4/483: readlink d0/de/la4 0 2024-09-20T18:35:43.527 INFO:tasks.workunit.client.1.smithi172.stdout:7/585: fsync d2/d23/d51/f59 0 2024-09-20T18:35:43.528 INFO:tasks.workunit.client.1.smithi172.stdout:2/446: dread d0/d2c/d3f/d17/d22/d10/d35/d5d/f5f [4194304,4194304] 0 2024-09-20T18:35:43.528 INFO:tasks.workunit.client.1.smithi172.stdout:4/484: fdatasync d0/de/f5e 0 2024-09-20T18:35:43.529 INFO:tasks.workunit.client.1.smithi172.stdout:7/586: readlink d2/d3/dd/l8c 0 2024-09-20T18:35:43.530 INFO:tasks.workunit.client.1.smithi172.stdout:4/485: chown d0/de/d21/d24/d34/f94 60 1 2024-09-20T18:35:43.531 INFO:tasks.workunit.client.1.smithi172.stdout:0/624: write d4/d1a/d28/d42/f83 [3284845,89361] 0 2024-09-20T18:35:43.532 INFO:tasks.workunit.client.1.smithi172.stdout:8/449: symlink dd/d1b/la1 0 2024-09-20T18:35:43.535 INFO:tasks.workunit.client.1.smithi172.stdout:8/450: chown dd/d1b/d3b/d5d/d7d 557738814 1 2024-09-20T18:35:43.536 INFO:tasks.workunit.client.1.smithi172.stdout:4/486: mkdir d0/d7/db7 0 2024-09-20T18:35:43.536 INFO:tasks.workunit.client.1.smithi172.stdout:1/470: getdents d0/d8/db/d25/d2b/d3d/d65 0 2024-09-20T18:35:43.538 INFO:tasks.workunit.client.1.smithi172.stdout:8/451: rmdir dd/d1b 39 2024-09-20T18:35:43.540 INFO:tasks.workunit.client.1.smithi172.stdout:2/447: dwrite d0/d2c/f70 [4194304,4194304] 0 2024-09-20T18:35:43.541 INFO:tasks.workunit.client.1.smithi172.stdout:7/587: dwrite d2/d3/d3d/d4e/f5d [0,4194304] 0 2024-09-20T18:35:43.542 INFO:tasks.workunit.client.1.smithi172.stdout:0/625: rmdir d4/d5/d2e/d38/d96/dd3 0 2024-09-20T18:35:43.548 INFO:tasks.workunit.client.1.smithi172.stdout:1/471: symlink d0/d8/db/d25/d6f/la1 0 2024-09-20T18:35:43.549 INFO:tasks.workunit.client.1.smithi172.stdout:3/531: write d0/dc/f3c [1132422,35307] 0 2024-09-20T18:35:43.549 INFO:tasks.workunit.client.1.smithi172.stdout:7/588: rmdir d2/d23/d9d 39 2024-09-20T18:35:43.551 INFO:tasks.workunit.client.1.smithi172.stdout:7/589: write d2/d3/d10/f20 [4696824,100339] 0 2024-09-20T18:35:43.552 INFO:tasks.workunit.client.1.smithi172.stdout:1/472: truncate d0/d8/db/d25/d2b/f37 1274543 0 2024-09-20T18:35:43.552 INFO:tasks.workunit.client.1.smithi172.stdout:0/626: write d4/d1a/d28/d42/f4c [1137012,39757] 0 2024-09-20T18:35:43.552 INFO:tasks.workunit.client.1.smithi172.stdout:2/448: truncate d0/d2c/d3f/d17/d22/f38 682144 0 2024-09-20T18:35:43.555 INFO:tasks.workunit.client.1.smithi172.stdout:0/627: mknod d4/d1a/d28/d42/db8/ce5 0 2024-09-20T18:35:43.557 INFO:tasks.workunit.client.1.smithi172.stdout:1/473: symlink d0/la2 0 2024-09-20T18:35:43.557 INFO:tasks.workunit.client.1.smithi172.stdout:4/487: write d0/de/d39/f73 [1554453,1557] 0 2024-09-20T18:35:43.558 INFO:tasks.workunit.client.1.smithi172.stdout:2/449: unlink d0/d2c/d3f/d17/d22/d10/l37 0 2024-09-20T18:35:43.559 INFO:tasks.workunit.client.1.smithi172.stdout:3/532: creat d0/d13/fb6 x:0 0 0 2024-09-20T18:35:43.561 INFO:tasks.workunit.client.1.smithi172.stdout:8/452: dread dd/d1b/f49 [0,4194304] 0 2024-09-20T18:35:43.561 INFO:tasks.workunit.client.1.smithi172.stdout:0/628: readlink d4/d1a/d28/d42/db8/le4 0 2024-09-20T18:35:43.561 INFO:tasks.workunit.client.1.smithi172.stdout:1/474: fdatasync d0/d8/f44 0 2024-09-20T18:35:43.562 INFO:tasks.workunit.client.1.smithi172.stdout:4/488: readlink d0/de/d21/d24/d34/d72/l4f 0 2024-09-20T18:35:43.564 INFO:tasks.workunit.client.1.smithi172.stdout:3/533: truncate d0/dc/f3c 1442655 0 2024-09-20T18:35:43.565 INFO:tasks.workunit.client.1.smithi172.stdout:2/450: creat d0/d2c/d51/d61/f9e x:0 0 0 2024-09-20T18:35:43.565 INFO:tasks.workunit.client.1.smithi172.stdout:7/590: dwrite d2/d3/d10/d40/d46/d8e/dbd/fc9 [0,4194304] 0 2024-09-20T18:35:43.566 INFO:tasks.workunit.client.1.smithi172.stdout:9/470: sync 2024-09-20T18:35:43.566 INFO:tasks.workunit.client.1.smithi172.stdout:3/534: dread - d0/d13/d1e/fa3 zero size 2024-09-20T18:35:43.568 INFO:tasks.workunit.client.1.smithi172.stdout:0/629: symlink d4/d44/dab/le6 0 2024-09-20T18:35:43.570 INFO:tasks.workunit.client.1.smithi172.stdout:1/475: truncate d0/d22/f23 748170 0 2024-09-20T18:35:43.571 INFO:tasks.workunit.client.1.smithi172.stdout:8/453: mkdir dd/d65/d85/da2 0 2024-09-20T18:35:43.571 INFO:tasks.workunit.client.1.smithi172.stdout:2/451: fdatasync d0/d1a/d58/f78 0 2024-09-20T18:35:43.572 INFO:tasks.workunit.client.1.smithi172.stdout:7/591: creat d2/d3/d10/d40/d6a/fca x:0 0 0 2024-09-20T18:35:43.573 INFO:tasks.workunit.client.1.smithi172.stdout:9/471: rmdir d15/d1f/d88 39 2024-09-20T18:35:43.573 INFO:tasks.workunit.client.1.smithi172.stdout:3/535: rename d0/d13/d32/l39 to d0/d13/d32/d54/lb7 0 2024-09-20T18:35:43.575 INFO:tasks.workunit.client.1.smithi172.stdout:1/476: mkdir d0/d8/db/d25/d2b/d3d/d65/da3 0 2024-09-20T18:35:43.576 INFO:tasks.workunit.client.1.smithi172.stdout:7/592: mkdir d2/d3/d10/d40/d74/dcb 0 2024-09-20T18:35:43.578 INFO:tasks.workunit.client.1.smithi172.stdout:9/472: rename d15/d1a/d64/f75 to d15/d1f/d2c/d6e/f9a 0 2024-09-20T18:35:43.579 INFO:tasks.workunit.client.1.smithi172.stdout:0/630: truncate d4/d5/d2e/d33/de1/d15/f69 2131775 0 2024-09-20T18:35:43.581 INFO:tasks.workunit.client.1.smithi172.stdout:8/454: getdents dd/d1b/d3b/d51/d5b 0 2024-09-20T18:35:43.583 INFO:tasks.workunit.client.1.smithi172.stdout:7/593: mkdir d2/dcc 0 2024-09-20T18:35:43.584 INFO:tasks.workunit.client.1.smithi172.stdout:4/489: dread d0/de/d39/f46 [0,4194304] 0 2024-09-20T18:35:43.586 INFO:tasks.workunit.client.1.smithi172.stdout:0/631: write d4/d1a/d28/d42/f55 [1785822,110099] 0 2024-09-20T18:35:43.586 INFO:tasks.workunit.client.1.smithi172.stdout:2/452: dwrite d0/d2c/d3f/f26 [0,4194304] 0 2024-09-20T18:35:43.588 INFO:tasks.workunit.client.1.smithi172.stdout:7/594: readlink d2/d3/d10/l1e 0 2024-09-20T18:35:43.589 INFO:tasks.workunit.client.1.smithi172.stdout:1/477: dwrite d0/d8/db/d25/d2b/f63 [0,4194304] 0 2024-09-20T18:35:43.589 INFO:tasks.workunit.client.1.smithi172.stdout:8/455: write dd/d1b/d3b/d51/d34/f96 [850772,70466] 0 2024-09-20T18:35:43.589 INFO:tasks.workunit.client.1.smithi172.stdout:3/536: truncate d0/d13/d32/d88/fae 3537935 0 2024-09-20T18:35:43.594 INFO:tasks.workunit.client.1.smithi172.stdout:9/473: dwrite d15/d1f/f45 [0,4194304] 0 2024-09-20T18:35:43.597 INFO:tasks.workunit.client.1.smithi172.stdout:4/490: write d0/d48/d90/d55/d53/f9e [434189,113794] 0 2024-09-20T18:35:43.599 INFO:tasks.workunit.client.1.smithi172.stdout:3/537: truncate d0/dc/f3c 1834420 0 2024-09-20T18:35:43.602 INFO:tasks.workunit.client.1.smithi172.stdout:7/595: creat d2/d23/d3a/d72/fcd x:0 0 0 2024-09-20T18:35:43.603 INFO:tasks.workunit.client.1.smithi172.stdout:1/478: write d0/d8/db/d25/d2b/d3d/f4d [1393277,88035] 0 2024-09-20T18:35:43.604 INFO:tasks.workunit.client.1.smithi172.stdout:3/538: stat d0/c5d 0 2024-09-20T18:35:43.607 INFO:tasks.workunit.client.1.smithi172.stdout:2/453: getdents d0/d2c/d3f/d17/d18/d29/d42/d4b/d53 0 2024-09-20T18:35:43.607 INFO:tasks.workunit.client.1.smithi172.stdout:1/479: chown d0/d8/db/d25/d2b/d3d/d65/f6a 145617 1 2024-09-20T18:35:43.608 INFO:tasks.workunit.client.1.smithi172.stdout:0/632: dwrite d4/d1a/d28/d42/d45/d54/f89 [0,4194304] 0 2024-09-20T18:35:43.608 INFO:tasks.workunit.client.1.smithi172.stdout:4/491: rename d0/de/d21/d24/d34 to d0/de/d39/db8 0 2024-09-20T18:35:43.609 INFO:tasks.workunit.client.1.smithi172.stdout:8/456: link dd/d1b/d3b/c53 dd/ca3 0 2024-09-20T18:35:43.610 INFO:tasks.workunit.client.1.smithi172.stdout:2/454: chown d0/d2c/d3f/d17/l1b 0 1 2024-09-20T18:35:43.612 INFO:tasks.workunit.client.1.smithi172.stdout:9/474: link d15/d1a/d82/f2e d15/d20/d76/f9b 0 2024-09-20T18:35:43.612 INFO:tasks.workunit.client.1.smithi172.stdout:0/633: symlink d4/d20/le7 0 2024-09-20T18:35:43.613 INFO:tasks.workunit.client.1.smithi172.stdout:4/492: write d0/d7/f62 [5221931,4778] 0 2024-09-20T18:35:43.614 INFO:tasks.workunit.client.1.smithi172.stdout:1/480: mkdir d0/d8/db/d25/d6d/da4 0 2024-09-20T18:35:43.619 INFO:tasks.workunit.client.1.smithi172.stdout:1/481: fsync d0/d8/db/d25/d6f/f97 0 2024-09-20T18:35:43.619 INFO:tasks.workunit.client.1.smithi172.stdout:3/539: dwrite d0/dc/f2e [0,4194304] 0 2024-09-20T18:35:43.619 INFO:tasks.workunit.client.1.smithi172.stdout:8/457: symlink dd/d1b/d3b/d51/la4 0 2024-09-20T18:35:43.620 INFO:tasks.workunit.client.1.smithi172.stdout:9/475: unlink d15/d1f/d2c/d7d/d34/f3b 0 2024-09-20T18:35:43.621 INFO:tasks.workunit.client.1.smithi172.stdout:3/540: readlink d0/d13/d32/d54/d71/la4 0 2024-09-20T18:35:43.622 INFO:tasks.workunit.client.1.smithi172.stdout:2/455: dread d0/d2c/d3f/d17/d18/d29/d42/d4b/d53/f5b [0,4194304] 0 2024-09-20T18:35:43.622 INFO:tasks.workunit.client.1.smithi172.stdout:8/458: fdatasync dd/d1b/d3b/d51/d34/d39/d4d/f97 0 2024-09-20T18:35:43.623 INFO:tasks.workunit.client.1.smithi172.stdout:2/456: fsync d0/d2c/d51/d61/f67 0 2024-09-20T18:35:43.626 INFO:tasks.workunit.client.1.smithi172.stdout:4/493: creat d0/d48/d90/d55/d53/fb9 x:0 0 0 2024-09-20T18:35:43.626 INFO:tasks.workunit.client.1.smithi172.stdout:4/494: chown d0/d48/d90/l26 41153 1 2024-09-20T18:35:43.627 INFO:tasks.workunit.client.1.smithi172.stdout:4/495: stat d0/de/d39/db8/d72/f70 0 2024-09-20T18:35:43.628 INFO:tasks.workunit.client.1.smithi172.stdout:3/541: symlink d0/d13/d32/d54/d71/lb8 0 2024-09-20T18:35:43.630 INFO:tasks.workunit.client.1.smithi172.stdout:8/459: creat dd/d1b/d3b/d51/d5b/fa5 x:0 0 0 2024-09-20T18:35:43.631 INFO:tasks.workunit.client.1.smithi172.stdout:0/634: getdents d4/d5/d2e/d33/de1/dac/dbc 0 2024-09-20T18:35:43.635 INFO:tasks.workunit.client.1.smithi172.stdout:9/476: mknod d15/c9c 0 2024-09-20T18:35:43.636 INFO:tasks.workunit.client.1.smithi172.stdout:9/477: chown d15/d1f/d2c/d7d/c42 13933 1 2024-09-20T18:35:43.636 INFO:tasks.workunit.client.1.smithi172.stdout:3/542: rename d0/dc/d61 to d0/d13/d58/d6d/db9 0 2024-09-20T18:35:43.636 INFO:tasks.workunit.client.1.smithi172.stdout:9/478: fdatasync d15/d1a/d82/f8e 0 2024-09-20T18:35:43.637 INFO:tasks.workunit.client.1.smithi172.stdout:0/635: symlink d4/d1a/d28/d42/d45/le8 0 2024-09-20T18:35:43.638 INFO:tasks.workunit.client.1.smithi172.stdout:1/482: creat d0/d8/db/fa5 x:0 0 0 2024-09-20T18:35:43.639 INFO:tasks.workunit.client.1.smithi172.stdout:8/460: mknod dd/d1b/d3b/d51/d34/ca6 0 2024-09-20T18:35:43.639 INFO:tasks.workunit.client.1.smithi172.stdout:9/479: mknod d15/d20/c9d 0 2024-09-20T18:35:43.640 INFO:tasks.workunit.client.1.smithi172.stdout:4/496: dread d0/d48/d90/f89 [0,4194304] 0 2024-09-20T18:35:43.641 INFO:tasks.workunit.client.1.smithi172.stdout:1/483: unlink d0/d8/d12/f1f 0 2024-09-20T18:35:43.641 INFO:tasks.workunit.client.1.smithi172.stdout:1/484: readlink d0/d8/db/d25/d2b/d3d/l50 0 2024-09-20T18:35:43.646 INFO:tasks.workunit.client.1.smithi172.stdout:4/497: dwrite d0/d7/d6f/f9c [0,4194304] 0 2024-09-20T18:35:43.647 INFO:tasks.workunit.client.1.smithi172.stdout:4/498: chown d0/de/d39/db8/d72/l9d 1 1 2024-09-20T18:35:43.648 INFO:tasks.workunit.client.1.smithi172.stdout:4/499: write d0/d48/d90/d55/d53/fb9 [737711,124123] 0 2024-09-20T18:35:43.650 INFO:tasks.workunit.client.1.smithi172.stdout:0/636: getdents d4/d5/d2e/d33/de1 0 2024-09-20T18:35:43.654 INFO:tasks.workunit.client.1.smithi172.stdout:9/480: rename d15/d20/f3a to d15/f9e 0 2024-09-20T18:35:43.659 INFO:tasks.workunit.client.1.smithi172.stdout:3/543: truncate d0/d13/f72 41449 0 2024-09-20T18:35:43.659 INFO:tasks.workunit.client.1.smithi172.stdout:9/481: symlink d15/d1f/d88/l9f 0 2024-09-20T18:35:43.662 INFO:tasks.workunit.client.1.smithi172.stdout:1/485: rename d0/c40 to d0/d8/db/d25/d2b/d3d/ca6 0 2024-09-20T18:35:43.662 INFO:tasks.workunit.client.1.smithi172.stdout:8/461: write dd/d1b/d3b/d51/d34/d39/d4d/f90 [1163637,43467] 0 2024-09-20T18:35:43.662 INFO:tasks.workunit.client.1.smithi172.stdout:4/500: creat d0/d7/fba x:0 0 0 2024-09-20T18:35:43.663 INFO:tasks.workunit.client.1.smithi172.stdout:1/486: chown d0/f82 5676789 1 2024-09-20T18:35:43.664 INFO:tasks.workunit.client.1.smithi172.stdout:9/482: creat d15/d1f/d2c/d57/fa0 x:0 0 0 2024-09-20T18:35:43.666 INFO:tasks.workunit.client.1.smithi172.stdout:3/544: mkdir d0/dba 0 2024-09-20T18:35:43.666 INFO:tasks.workunit.client.1.smithi172.stdout:0/637: getdents d4/d1a/d28/d73 0 2024-09-20T18:35:43.667 INFO:tasks.workunit.client.1.smithi172.stdout:4/501: unlink d0/de/d39/f46 0 2024-09-20T18:35:43.673 INFO:tasks.workunit.client.1.smithi172.stdout:1/487: dwrite d0/d8/db/d25/d2b/d3d/f4d [0,4194304] 0 2024-09-20T18:35:43.674 INFO:tasks.workunit.client.1.smithi172.stdout:3/545: mkdir d0/d13/d32/d54/d83/dbb 0 2024-09-20T18:35:43.676 INFO:tasks.workunit.client.1.smithi172.stdout:8/462: write dd/d1b/d3b/f3c [813580,73663] 0 2024-09-20T18:35:43.681 INFO:tasks.workunit.client.1.smithi172.stdout:0/638: dwrite d4/d1a/d28/f5e [0,4194304] 0 2024-09-20T18:35:43.682 INFO:tasks.workunit.client.1.smithi172.stdout:4/502: dwrite d0/de/f4c [0,4194304] 0 2024-09-20T18:35:43.683 INFO:tasks.workunit.client.1.smithi172.stdout:9/483: dread f6 [0,4194304] 0 2024-09-20T18:35:43.684 INFO:tasks.workunit.client.1.smithi172.stdout:8/463: mknod dd/d1b/d4f/ca7 0 2024-09-20T18:35:43.689 INFO:tasks.workunit.client.1.smithi172.stdout:1/488: dwrite d0/f61 [0,4194304] 0 2024-09-20T18:35:43.693 INFO:tasks.workunit.client.1.smithi172.stdout:1/489: truncate d0/d8/db/d39/f55 1050294 0 2024-09-20T18:35:43.695 INFO:tasks.workunit.client.1.smithi172.stdout:9/484: rename d15/d1f/f45 to d15/d20/d76/fa1 0 2024-09-20T18:35:43.696 INFO:tasks.workunit.client.1.smithi172.stdout:8/464: unlink dd/l1d 0 2024-09-20T18:35:43.698 INFO:tasks.workunit.client.1.smithi172.stdout:8/465: truncate dd/d1b/d3b/d51/d5b/fa5 906240 0 2024-09-20T18:35:43.699 INFO:tasks.workunit.client.1.smithi172.stdout:1/490: rename d0/la2 to d0/d22/la7 0 2024-09-20T18:35:43.700 INFO:tasks.workunit.client.1.smithi172.stdout:4/503: creat d0/de/d39/db8/d72/fbb x:0 0 0 2024-09-20T18:35:43.704 INFO:tasks.workunit.client.1.smithi172.stdout:1/491: symlink d0/d8/la8 0 2024-09-20T18:35:43.708 INFO:tasks.workunit.client.1.smithi172.stdout:8/466: dwrite dd/d1b/d3b/d51/d5b/fa5 [0,4194304] 0 2024-09-20T18:35:43.708 INFO:tasks.workunit.client.1.smithi172.stdout:4/504: read d0/de/d39/db8/d72/f70 [1044165,82618] 0 2024-09-20T18:35:43.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:43 smithi172 ceph-mon[35456]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:35:43.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:43 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:35:43.710 INFO:tasks.workunit.client.1.smithi172.stdout:8/467: chown dd/d1b/d3b/d51/d34/f84 14479 1 2024-09-20T18:35:43.713 INFO:tasks.workunit.client.1.smithi172.stdout:8/468: fdatasync dd/d1b/d3b/d51/d34/d39/f6e 0 2024-09-20T18:35:43.713 INFO:tasks.workunit.client.1.smithi172.stdout:9/485: truncate d15/d20/d76/fa1 1657350 0 2024-09-20T18:35:43.713 INFO:tasks.workunit.client.1.smithi172.stdout:1/492: rename d0/d8/db/d25/d2b/f3f to d0/d8/d5f/fa9 0 2024-09-20T18:35:43.717 INFO:tasks.workunit.client.1.smithi172.stdout:0/639: dread d4/d5/f2f [0,4194304] 0 2024-09-20T18:35:43.717 INFO:tasks.workunit.client.1.smithi172.stdout:9/486: dread d15/d1f/d2c/f70 [0,4194304] 0 2024-09-20T18:35:43.717 INFO:tasks.workunit.client.1.smithi172.stdout:3/546: dread d0/dc/f5a [0,4194304] 0 2024-09-20T18:35:43.718 INFO:tasks.workunit.client.1.smithi172.stdout:4/505: link d0/d48/cb5 d0/cbc 0 2024-09-20T18:35:43.719 INFO:tasks.workunit.client.1.smithi172.stdout:8/469: creat dd/d65/fa8 x:0 0 0 2024-09-20T18:35:43.722 INFO:tasks.workunit.client.1.smithi172.stdout:9/487: symlink d15/d1f/d2c/la2 0 2024-09-20T18:35:43.723 INFO:tasks.workunit.client.1.smithi172.stdout:8/470: dread - dd/d1b/d3b/d51/d34/d39/d4d/f97 zero size 2024-09-20T18:35:43.724 INFO:tasks.workunit.client.1.smithi172.stdout:3/547: mknod d0/dba/cbc 0 2024-09-20T18:35:43.725 INFO:tasks.workunit.client.1.smithi172.stdout:1/493: dwrite d0/d22/f99 [0,4194304] 0 2024-09-20T18:35:43.725 INFO:tasks.workunit.client.1.smithi172.stdout:9/488: fsync d15/d1f/f69 0 2024-09-20T18:35:43.725 INFO:tasks.workunit.client.1.smithi172.stdout:4/506: mknod d0/de/d39/db8/d72/d18/cbd 0 2024-09-20T18:35:43.726 INFO:tasks.workunit.client.1.smithi172.stdout:3/548: stat d0/dc/c7c 0 2024-09-20T18:35:43.727 INFO:tasks.workunit.client.1.smithi172.stdout:8/471: write dd/d65/d85/f8b [1475279,123148] 0 2024-09-20T18:35:43.728 INFO:tasks.workunit.client.1.smithi172.stdout:4/507: write d0/d7/d6f/f91 [838685,63282] 0 2024-09-20T18:35:43.729 INFO:tasks.workunit.client.1.smithi172.stdout:1/494: chown d0/d8/db/d25/d2b/d3d/d65/d93 2 1 2024-09-20T18:35:43.732 INFO:tasks.workunit.client.1.smithi172.stdout:4/508: fdatasync d0/d48/d90/d55/d53/f9e 0 2024-09-20T18:35:43.736 INFO:tasks.workunit.client.1.smithi172.stdout:3/549: link d0/d13/d9e/f92 d0/dc/d6a/d22/fbd 0 2024-09-20T18:35:43.741 INFO:tasks.workunit.client.1.smithi172.stdout:9/489: dwrite f6 [4194304,4194304] 0 2024-09-20T18:35:43.744 INFO:tasks.workunit.client.1.smithi172.stdout:3/550: fsync d0/d13/d32/d54/d71/fa7 0 2024-09-20T18:35:43.744 INFO:tasks.workunit.client.1.smithi172.stdout:4/509: truncate d0/d48/d90/d55/d53/d78/f95 107405 0 2024-09-20T18:35:43.746 INFO:tasks.workunit.client.1.smithi172.stdout:8/472: dwrite dd/d1b/f33 [0,4194304] 0 2024-09-20T18:35:43.749 INFO:tasks.workunit.client.1.smithi172.stdout:0/640: dread d4/d1a/d28/d42/d45/f52 [0,4194304] 0 2024-09-20T18:35:43.750 INFO:tasks.workunit.client.1.smithi172.stdout:1/495: dwrite d0/d8/db/d25/d2b/d3d/d65/f6a [4194304,4194304] 0 2024-09-20T18:35:43.750 INFO:tasks.workunit.client.1.smithi172.stdout:9/490: write d15/d1f/d2c/d37/f63 [859703,7118] 0 2024-09-20T18:35:43.752 INFO:tasks.workunit.client.1.smithi172.stdout:4/510: readlink d0/de/d39/db8/d72/d18/l38 0 2024-09-20T18:35:43.753 INFO:tasks.workunit.client.1.smithi172.stdout:8/473: readlink dd/d1b/d3b/d51/l40 0 2024-09-20T18:35:43.754 INFO:tasks.workunit.client.1.smithi172.stdout:4/511: fsync d0/de/fac 0 2024-09-20T18:35:43.754 INFO:tasks.workunit.client.1.smithi172.stdout:9/491: mkdir d15/d1f/d2c/d6e/da3 0 2024-09-20T18:35:43.754 INFO:tasks.workunit.client.1.smithi172.stdout:8/474: chown dd/c28 189133 1 2024-09-20T18:35:43.757 INFO:tasks.workunit.client.1.smithi172.stdout:0/641: mkdir d4/d1a/d28/d42/d45/d99/de9 0 2024-09-20T18:35:43.759 INFO:tasks.workunit.client.1.smithi172.stdout:5/515: sync 2024-09-20T18:35:43.759 INFO:tasks.workunit.client.1.smithi172.stdout:6/439: sync 2024-09-20T18:35:43.760 INFO:tasks.workunit.client.1.smithi172.stdout:9/492: fsync d15/d1f/d2c/d7d/d48/f66 0 2024-09-20T18:35:43.761 INFO:tasks.workunit.client.1.smithi172.stdout:4/512: creat d0/de/d39/db8/d72/d18/d51/d9a/fbe x:0 0 0 2024-09-20T18:35:43.762 INFO:tasks.workunit.client.1.smithi172.stdout:0/642: creat d4/d1a/d28/d42/d45/d54/fea x:0 0 0 2024-09-20T18:35:43.762 INFO:tasks.workunit.client.1.smithi172.stdout:3/551: link d0/dc/d6a/d3a/l8d d0/d13/d58/lbe 0 2024-09-20T18:35:43.763 INFO:tasks.workunit.client.1.smithi172.stdout:8/475: mkdir dd/da9 0 2024-09-20T18:35:43.764 INFO:tasks.workunit.client.1.smithi172.stdout:8/476: chown dd/d1b/d3b/d51/d5b/d6b/l8a 8 1 2024-09-20T18:35:43.765 INFO:tasks.workunit.client.1.smithi172.stdout:3/552: write d0/d13/d58/f4a [5941155,40364] 0 2024-09-20T18:35:43.766 INFO:tasks.workunit.client.1.smithi172.stdout:5/516: write d4/df/d3f/d64/f8a [3248489,43120] 0 2024-09-20T18:35:43.770 INFO:tasks.workunit.client.1.smithi172.stdout:0/643: link d4/d1a/d28/d75/d60/fa3 d4/d5/d2e/d8e/feb 0 2024-09-20T18:35:43.770 INFO:tasks.workunit.client.1.smithi172.stdout:4/513: rename d0/de/d39/db8/f94 to d0/d48/d90/fbf 0 2024-09-20T18:35:43.771 INFO:tasks.workunit.client.1.smithi172.stdout:0/644: readlink d4/d5/d2e/d33/l71 0 2024-09-20T18:35:43.772 INFO:tasks.workunit.client.1.smithi172.stdout:3/553: creat d0/d13/d32/fbf x:0 0 0 2024-09-20T18:35:43.774 INFO:tasks.workunit.client.1.smithi172.stdout:5/517: write d4/f9 [2704697,111593] 0 2024-09-20T18:35:43.774 INFO:tasks.workunit.client.1.smithi172.stdout:3/554: dread - d0/dc/d6a/d3a/fb3 zero size 2024-09-20T18:35:43.774 INFO:tasks.workunit.client.1.smithi172.stdout:6/440: getdents d0/d18/d1c/d21/d26/d34/d6b 0 2024-09-20T18:35:43.775 INFO:tasks.workunit.client.1.smithi172.stdout:8/477: dwrite dd/d1b/d3b/d51/d34/d39/f83 [0,4194304] 0 2024-09-20T18:35:43.776 INFO:tasks.workunit.client.1.smithi172.stdout:3/555: dread - d0/dc/d6a/d22/fa9 zero size 2024-09-20T18:35:43.777 INFO:tasks.workunit.client.1.smithi172.stdout:4/514: creat d0/d7/d6f/fc0 x:0 0 0 2024-09-20T18:35:43.779 INFO:tasks.workunit.client.1.smithi172.stdout:3/556: chown d0/dc/d6a/d3a/f80 47499141 1 2024-09-20T18:35:43.779 INFO:tasks.workunit.client.1.smithi172.stdout:6/441: chown d0/d18/d1c/d21/d26/d34/d39/d46/c44 735463590 1 2024-09-20T18:35:43.780 INFO:tasks.workunit.client.1.smithi172.stdout:9/493: write d15/d1a/d82/f3e [1101139,70308] 0 2024-09-20T18:35:43.780 INFO:tasks.workunit.client.1.smithi172.stdout:5/518: mkdir d4/df/dad/d26/d2d/d63/d80/db1 0 2024-09-20T18:35:43.782 INFO:tasks.workunit.client.1.smithi172.stdout:9/494: readlink d15/d1f/l22 0 2024-09-20T18:35:43.783 INFO:tasks.workunit.client.1.smithi172.stdout:5/519: readlink d4/df/l31 0 2024-09-20T18:35:43.783 INFO:tasks.workunit.client.1.smithi172.stdout:0/645: link d4/d44/fdc d4/d20/fec 0 2024-09-20T18:35:43.785 INFO:tasks.workunit.client.1.smithi172.stdout:3/557: readlink d0/dc/d6a/d22/l43 0 2024-09-20T18:35:43.786 INFO:tasks.workunit.client.1.smithi172.stdout:6/442: creat d0/d18/d1c/d21/d26/d34/d7a/f8b x:0 0 0 2024-09-20T18:35:43.787 INFO:tasks.workunit.client.1.smithi172.stdout:0/646: write d4/fbe [215465,88146] 0 2024-09-20T18:35:43.790 INFO:tasks.workunit.client.1.smithi172.stdout:8/478: dwrite dd/d1b/d3b/d51/d34/d39/f73 [0,4194304] 0 2024-09-20T18:35:43.791 INFO:tasks.workunit.client.1.smithi172.stdout:5/520: creat d4/df/dad/d26/d41/d69/dac/d2c/fb2 x:0 0 0 2024-09-20T18:35:43.792 INFO:tasks.workunit.client.1.smithi172.stdout:3/558: truncate d0/d13/d1e/fa3 334529 0 2024-09-20T18:35:43.793 INFO:tasks.workunit.client.1.smithi172.stdout:9/495: getdents d15/d20 0 2024-09-20T18:35:43.793 INFO:tasks.workunit.client.1.smithi172.stdout:4/515: dwrite d0/de/d21/f80 [0,4194304] 0 2024-09-20T18:35:43.794 INFO:tasks.workunit.client.1.smithi172.stdout:8/479: chown dd/d1b/d3b/d51/l40 2861 1 2024-09-20T18:35:43.794 INFO:tasks.workunit.client.1.smithi172.stdout:0/647: write d4/d5/d2e/d33/de1/dac/fcf [189912,20066] 0 2024-09-20T18:35:43.795 INFO:tasks.workunit.client.1.smithi172.stdout:6/443: creat d0/d18/d1c/d21/d26/d34/d7a/d47/f8c x:0 0 0 2024-09-20T18:35:43.797 INFO:tasks.workunit.client.1.smithi172.stdout:8/480: chown c6 1958588 1 2024-09-20T18:35:43.798 INFO:tasks.workunit.client.1.smithi172.stdout:9/496: rmdir d15/d1a/d6f 39 2024-09-20T18:35:43.799 INFO:tasks.workunit.client.1.smithi172.stdout:0/648: write d4/d1a/d28/d42/d45/d99/dc9/fd2 [599856,66338] 0 2024-09-20T18:35:43.800 INFO:tasks.workunit.client.1.smithi172.stdout:5/521: creat d4/df/dad/d26/d41/d65/fb3 x:0 0 0 2024-09-20T18:35:43.802 INFO:tasks.workunit.client.1.smithi172.stdout:4/516: dread d0/d48/d90/d55/f3e [0,4194304] 0 2024-09-20T18:35:43.802 INFO:tasks.workunit.client.1.smithi172.stdout:6/444: symlink d0/d18/d1c/d21/d26/d34/l8d 0 2024-09-20T18:35:43.802 INFO:tasks.workunit.client.1.smithi172.stdout:5/522: read - d4/df/dad/d26/d41/d65/fb3 zero size 2024-09-20T18:35:43.805 INFO:tasks.workunit.client.1.smithi172.stdout:0/649: symlink d4/d94/dd5/led 0 2024-09-20T18:35:43.805 INFO:tasks.workunit.client.1.smithi172.stdout:6/445: mknod d0/d18/d1c/d21/d26/d34/d7a/c8e 0 2024-09-20T18:35:43.806 INFO:tasks.workunit.client.1.smithi172.stdout:8/481: truncate dd/d1b/d3b/d51/f35 387342 0 2024-09-20T18:35:43.806 INFO:tasks.workunit.client.1.smithi172.stdout:5/523: mknod d4/df/dad/d26/d2d/d63/d80/cb4 0 2024-09-20T18:35:43.808 INFO:tasks.workunit.client.1.smithi172.stdout:5/524: write d4/df/d98/f9c [379720,33651] 0 2024-09-20T18:35:43.809 INFO:tasks.workunit.client.1.smithi172.stdout:0/650: read d4/d5/d2e/d33/de1/fd6 [1377545,23381] 0 2024-09-20T18:35:43.809 INFO:tasks.workunit.client.1.smithi172.stdout:6/446: fdatasync d0/d18/d1c/d21/d26/f60 0 2024-09-20T18:35:43.811 INFO:tasks.workunit.client.1.smithi172.stdout:5/525: mknod d4/df/dad/cb5 0 2024-09-20T18:35:43.811 INFO:tasks.workunit.client.1.smithi172.stdout:8/482: dread dd/f1c [0,4194304] 0 2024-09-20T18:35:43.812 INFO:tasks.workunit.client.1.smithi172.stdout:0/651: write d4/d1a/d28/d42/d45/d54/f89 [1075410,7867] 0 2024-09-20T18:35:43.813 INFO:tasks.workunit.client.1.smithi172.stdout:6/447: chown d0/d18/d1c/d21/d26/d34/d6b/d7d/d35/f89 2 1 2024-09-20T18:35:43.814 INFO:tasks.workunit.client.1.smithi172.stdout:8/483: write dd/f27 [4147694,31918] 0 2024-09-20T18:35:43.815 INFO:tasks.workunit.client.1.smithi172.stdout:3/559: truncate d0/d13/d58/f4a 3684551 0 2024-09-20T18:35:43.816 INFO:tasks.workunit.client.1.smithi172.stdout:0/652: rmdir d4/d5/d2e/d8e 39 2024-09-20T18:35:43.816 INFO:tasks.workunit.client.1.smithi172.stdout:5/526: dread d4/f23 [0,4194304] 0 2024-09-20T18:35:43.817 INFO:tasks.workunit.client.1.smithi172.stdout:9/497: truncate d15/f1b 509667 0 2024-09-20T18:35:43.817 INFO:tasks.workunit.client.1.smithi172.stdout:0/653: stat d4 0 2024-09-20T18:35:43.821 INFO:tasks.workunit.client.1.smithi172.stdout:5/527: dread d4/f23 [0,4194304] 0 2024-09-20T18:35:43.822 INFO:tasks.workunit.client.1.smithi172.stdout:6/448: creat d0/d18/d1c/d21/d26/d34/d7a/d47/d62/f8f x:0 0 0 2024-09-20T18:35:43.822 INFO:tasks.workunit.client.1.smithi172.stdout:9/498: read d15/d1f/d2c/d7d/f2a [181089,114954] 0 2024-09-20T18:35:43.823 INFO:tasks.workunit.client.1.smithi172.stdout:5/528: unlink d4/df/dad/l5f 0 2024-09-20T18:35:43.826 INFO:tasks.workunit.client.1.smithi172.stdout:8/484: dread dd/d1b/d3b/d51/d5b/fa5 [0,4194304] 0 2024-09-20T18:35:43.829 INFO:tasks.workunit.client.1.smithi172.stdout:9/499: write d15/d1a/d6f/f94 [836600,33056] 0 2024-09-20T18:35:43.830 INFO:tasks.workunit.client.1.smithi172.stdout:6/449: write d0/d18/d1c/d21/d26/d34/d7a/d47/d62/f8f [198255,4506] 0 2024-09-20T18:35:43.831 INFO:tasks.workunit.client.1.smithi172.stdout:3/560: dwrite d0/dc/fa0 [0,4194304] 0 2024-09-20T18:35:43.833 INFO:tasks.workunit.client.1.smithi172.stdout:4/517: dread d0/f6d [0,4194304] 0 2024-09-20T18:35:43.833 INFO:tasks.workunit.client.1.smithi172.stdout:5/529: creat d4/df/dad/d26/d41/fb6 x:0 0 0 2024-09-20T18:35:43.835 INFO:tasks.workunit.client.1.smithi172.stdout:9/500: mknod d15/d1a/d64/ca4 0 2024-09-20T18:35:43.836 INFO:tasks.workunit.client.1.smithi172.stdout:0/654: dwrite d4/d5/d2e/d38/d96/fbf [0,4194304] 0 2024-09-20T18:35:43.836 INFO:tasks.workunit.client.1.smithi172.stdout:4/518: readlink d0/de/d21/lb3 0 2024-09-20T18:35:43.836 INFO:tasks.workunit.client.1.smithi172.stdout:3/561: write d0/dc/f2b [2400349,22040] 0 2024-09-20T18:35:43.840 INFO:tasks.workunit.client.1.smithi172.stdout:6/450: mkdir d0/d18/d1c/d21/d26/d34/d6b/d7d/d90 0 2024-09-20T18:35:43.840 INFO:tasks.workunit.client.1.smithi172.stdout:8/485: dread dd/d1b/d3b/d51/f47 [0,4194304] 0 2024-09-20T18:35:43.841 INFO:tasks.workunit.client.1.smithi172.stdout:9/501: mkdir d15/d4a/d8c/da5 0 2024-09-20T18:35:43.841 INFO:tasks.workunit.client.1.smithi172.stdout:0/655: write d4/d1a/d28/f9a [1013817,4989] 0 2024-09-20T18:35:43.844 INFO:tasks.workunit.client.1.smithi172.stdout:8/486: chown dd/d1b/d3b/d51/d5b/f7a 18276454 1 2024-09-20T18:35:43.846 INFO:tasks.workunit.client.1.smithi172.stdout:3/562: truncate d0/d13/f72 589365 0 2024-09-20T18:35:43.847 INFO:tasks.workunit.client.1.smithi172.stdout:9/502: truncate d15/d1f/d2c/d6e/f9a 4775002 0 2024-09-20T18:35:43.848 INFO:tasks.workunit.client.1.smithi172.stdout:5/530: dwrite d4/df/dad/d26/d2d/d63/d80/fa8 [0,4194304] 0 2024-09-20T18:35:43.848 INFO:tasks.workunit.client.1.smithi172.stdout:0/656: truncate d4/f7e 855053 0 2024-09-20T18:35:43.850 INFO:tasks.workunit.client.1.smithi172.stdout:8/487: mknod dd/d1b/d3b/d5d/caa 0 2024-09-20T18:35:43.851 INFO:tasks.workunit.client.1.smithi172.stdout:5/531: creat d4/df/fb7 x:0 0 0 2024-09-20T18:35:43.852 INFO:tasks.workunit.client.1.smithi172.stdout:4/519: dread d0/f71 [0,4194304] 0 2024-09-20T18:35:43.853 INFO:tasks.workunit.client.1.smithi172.stdout:8/488: mkdir dd/d65/d85/dab 0 2024-09-20T18:35:43.873 INFO:tasks.workunit.client.1.smithi172.stdout:5/532: dread - d4/df/dad/f8c zero size 2024-09-20T18:35:43.876 INFO:tasks.workunit.client.1.smithi172.stdout:6/451: truncate d0/fc 10144360 0 2024-09-20T18:35:43.877 INFO:tasks.workunit.client.1.smithi172.stdout:5/533: rmdir d4/df/dad/d26/d41/d69/dac 39 2024-09-20T18:35:43.878 INFO:tasks.workunit.client.1.smithi172.stdout:0/657: dwrite d4/d1a/d28/d42/d45/d54/fb2 [0,4194304] 0 2024-09-20T18:35:43.878 INFO:tasks.workunit.client.1.smithi172.stdout:4/520: creat d0/d48/d90/db4/fc1 x:0 0 0 2024-09-20T18:35:43.878 INFO:tasks.workunit.client.1.smithi172.stdout:8/489: mkdir dd/d1b/d3b/d51/dac 0 2024-09-20T18:35:43.880 INFO:tasks.workunit.client.1.smithi172.stdout:4/521: rename d0/d7 to d0/d7/db7/dc2 22 2024-09-20T18:35:43.880 INFO:tasks.workunit.client.1.smithi172.stdout:8/490: stat dd/d1b/d3b/d5d/d7d/l7e 0 2024-09-20T18:35:43.882 INFO:tasks.workunit.client.1.smithi172.stdout:6/452: creat d0/d18/d1c/d21/d26/d34/d7a/d47/d62/f91 x:0 0 0 2024-09-20T18:35:43.882 INFO:tasks.workunit.client.1.smithi172.stdout:5/534: truncate d4/fe 555862 0 2024-09-20T18:35:43.884 INFO:tasks.workunit.client.1.smithi172.stdout:8/491: creat dd/d1b/d4f/fad x:0 0 0 2024-09-20T18:35:43.885 INFO:tasks.workunit.client.1.smithi172.stdout:4/522: symlink d0/d7/db7/lc3 0 2024-09-20T18:35:43.887 INFO:tasks.workunit.client.1.smithi172.stdout:4/523: stat d0/d7/db7/lc3 0 2024-09-20T18:35:43.888 INFO:tasks.workunit.client.1.smithi172.stdout:3/563: dread d0/d13/d58/d6d/db9/f66 [0,4194304] 0 2024-09-20T18:35:43.890 INFO:tasks.workunit.client.1.smithi172.stdout:5/535: mknod d4/df/dad/d26/d41/d69/dac/d2c/cb8 0 2024-09-20T18:35:43.892 INFO:tasks.workunit.client.1.smithi172.stdout:3/564: creat d0/d13/db2/fc0 x:0 0 0 2024-09-20T18:35:43.893 INFO:tasks.workunit.client.1.smithi172.stdout:0/658: dwrite d4/d5/d2e/d33/de1/d15/f3b [4194304,4194304] 0 2024-09-20T18:35:43.893 INFO:tasks.workunit.client.1.smithi172.stdout:4/524: creat d0/de/d21/fc4 x:0 0 0 2024-09-20T18:35:43.893 INFO:tasks.workunit.client.1.smithi172.stdout:6/453: dwrite d0/fe [4194304,4194304] 0 2024-09-20T18:35:43.895 INFO:tasks.workunit.client.1.smithi172.stdout:0/659: dread - d4/d5/d2e/d67/d8c/fa5 zero size 2024-09-20T18:35:43.899 INFO:tasks.workunit.client.1.smithi172.stdout:5/536: mkdir d4/df/dad/d26/d41/d69/db9 0 2024-09-20T18:35:43.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:43 smithi017 ceph-mon[28058]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:35:43.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:43 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:35:43.900 INFO:tasks.workunit.client.1.smithi172.stdout:6/454: chown d0/d18/d1c/d21/d26/d34/d6b/c73 1899 1 2024-09-20T18:35:43.901 INFO:tasks.workunit.client.1.smithi172.stdout:0/660: chown d4/d1a/f1e 16509 1 2024-09-20T18:35:43.901 INFO:tasks.workunit.client.1.smithi172.stdout:4/525: creat d0/de/d39/d9f/fc5 x:0 0 0 2024-09-20T18:35:43.902 INFO:tasks.workunit.client.0.smithi017.stdout:2/9: sync 2024-09-20T18:35:43.902 INFO:tasks.workunit.client.0.smithi017.stdout:1/4: sync 2024-09-20T18:35:43.902 INFO:tasks.workunit.client.0.smithi017.stdout:2/10: read - no filename 2024-09-20T18:35:43.902 INFO:tasks.workunit.client.0.smithi017.stdout:1/5: dwrite - no filename 2024-09-20T18:35:43.902 INFO:tasks.workunit.client.0.smithi017.stdout:2/11: dwrite - no filename 2024-09-20T18:35:43.902 INFO:tasks.workunit.client.0.smithi017.stdout:1/6: chown . 2895482 1 2024-09-20T18:35:43.902 INFO:tasks.workunit.client.0.smithi017.stdout:1/7: truncate - no filename 2024-09-20T18:35:43.902 INFO:tasks.workunit.client.0.smithi017.stdout:1/8: chown . 16760 1 2024-09-20T18:35:43.902 INFO:tasks.workunit.client.0.smithi017.stdout:1/9: dread - no filename 2024-09-20T18:35:43.904 INFO:tasks.workunit.client.0.smithi017.stdout:1/10: mknod c0 0 2024-09-20T18:35:43.905 INFO:tasks.workunit.client.1.smithi172.stdout:3/565: dwrite d0/f44 [4194304,4194304] 0 2024-09-20T18:35:43.906 INFO:tasks.workunit.client.0.smithi017.stdout:2/12: rmdir d1/d2 0 2024-09-20T18:35:43.906 INFO:tasks.workunit.client.0.smithi017.stdout:2/13: dread - no filename 2024-09-20T18:35:43.906 INFO:tasks.workunit.client.0.smithi017.stdout:2/14: dread - no filename 2024-09-20T18:35:43.906 INFO:tasks.workunit.client.0.smithi017.stdout:2/15: truncate - no filename 2024-09-20T18:35:43.906 INFO:tasks.workunit.client.0.smithi017.stdout:2/16: write - no filename 2024-09-20T18:35:43.906 INFO:tasks.workunit.client.0.smithi017.stdout:2/17: dread - no filename 2024-09-20T18:35:43.907 INFO:tasks.workunit.client.0.smithi017.stdout:2/18: rename d1 to d1/d3 22 2024-09-20T18:35:43.907 INFO:tasks.workunit.client.1.smithi172.stdout:4/526: truncate d0/de/d21/d24/f2d 4523114 0 2024-09-20T18:35:43.907 INFO:tasks.workunit.client.1.smithi172.stdout:4/527: chown d0/d7/c17 998375612 1 2024-09-20T18:35:43.907 INFO:tasks.workunit.client.1.smithi172.stdout:6/455: symlink d0/d18/d1c/d21/d26/d34/d6b/l92 0 2024-09-20T18:35:43.907 INFO:tasks.workunit.client.1.smithi172.stdout:4/528: chown d0/d48/d90/d55/d53/d78 1 1 2024-09-20T18:35:43.908 INFO:tasks.workunit.client.1.smithi172.stdout:5/537: creat d4/df/dad/d26/d41/d65/d8f/fba x:0 0 0 2024-09-20T18:35:43.910 INFO:tasks.workunit.client.1.smithi172.stdout:0/661: rename d4/d44/c6c to d4/d5/d2e/d33/de1/d7f/cee 0 2024-09-20T18:35:43.912 INFO:tasks.workunit.client.0.smithi017.stdout:2/19: unlink c0 0 2024-09-20T18:35:43.912 INFO:tasks.workunit.client.1.smithi172.stdout:3/566: fsync d0/f62 0 2024-09-20T18:35:43.913 INFO:tasks.workunit.client.1.smithi172.stdout:6/456: mknod d0/d18/d1c/d21/d26/d34/d6b/d7d/d35/c93 0 2024-09-20T18:35:43.914 INFO:tasks.workunit.client.1.smithi172.stdout:4/529: dwrite d0/d7/d6f/fc0 [0,4194304] 0 2024-09-20T18:35:43.915 INFO:tasks.workunit.client.0.smithi017.stdout:2/20: creat d1/f4 x:0 0 0 2024-09-20T18:35:43.916 INFO:tasks.workunit.client.0.smithi017.stdout:2/21: write d1/f4 [24265,127449] 0 2024-09-20T18:35:43.917 INFO:tasks.workunit.client.1.smithi172.stdout:0/662: mknod d4/d1a/d28/d73/cef 0 2024-09-20T18:35:43.917 INFO:tasks.workunit.client.1.smithi172.stdout:0/663: chown d4/f11 148 1 2024-09-20T18:35:43.918 INFO:tasks.workunit.client.1.smithi172.stdout:3/567: rmdir d0/dc/d6a/d3a 39 2024-09-20T18:35:43.920 INFO:tasks.workunit.client.1.smithi172.stdout:6/457: unlink d0/c14 0 2024-09-20T18:35:43.921 INFO:tasks.workunit.client.0.smithi017.stdout:2/22: symlink d1/l5 0 2024-09-20T18:35:43.923 INFO:tasks.workunit.client.1.smithi172.stdout:4/530: mknod d0/de/d39/db8/d72/d18/d51/cc6 0 2024-09-20T18:35:43.924 INFO:tasks.workunit.client.1.smithi172.stdout:0/664: rmdir d4/d1a/d28/d75/d60 39 2024-09-20T18:35:43.925 INFO:tasks.workunit.client.1.smithi172.stdout:0/665: stat d4/d1a/d28/d42/d45/d54/fb2 0 2024-09-20T18:35:43.925 INFO:tasks.workunit.client.1.smithi172.stdout:0/666: chown d4/c7d 3 1 2024-09-20T18:35:43.926 INFO:tasks.workunit.client.1.smithi172.stdout:7/596: sync 2024-09-20T18:35:43.926 INFO:tasks.workunit.client.1.smithi172.stdout:2/457: sync 2024-09-20T18:35:43.929 INFO:tasks.workunit.client.1.smithi172.stdout:3/568: unlink d0/d13/d58/fb0 0 2024-09-20T18:35:43.930 INFO:tasks.workunit.client.0.smithi017.stdout:2/23: dwrite d1/f4 [0,4194304] 0 2024-09-20T18:35:43.931 INFO:tasks.workunit.client.1.smithi172.stdout:6/458: creat d0/d18/d1c/d21/d26/d34/d7a/d47/d7b/f94 x:0 0 0 2024-09-20T18:35:43.932 INFO:tasks.workunit.client.1.smithi172.stdout:2/458: dwrite d0/f3 [0,4194304] 0 2024-09-20T18:35:43.933 INFO:tasks.workunit.client.1.smithi172.stdout:2/459: chown d0/d1a/f33 139399 1 2024-09-20T18:35:43.933 INFO:tasks.workunit.client.1.smithi172.stdout:6/459: chown d0/d18/d1c/d21/d26/d34/l8d 4 1 2024-09-20T18:35:43.934 INFO:tasks.workunit.client.1.smithi172.stdout:6/460: fsync d0/d18/d1c/d21/d26/d34/d7a/f2e 0 2024-09-20T18:35:43.940 INFO:tasks.workunit.client.1.smithi172.stdout:2/460: dwrite d0/f8e [0,4194304] 0 2024-09-20T18:35:43.941 INFO:tasks.workunit.client.1.smithi172.stdout:0/667: mknod d4/d1a/ddf/cf0 0 2024-09-20T18:35:43.949 INFO:tasks.workunit.client.1.smithi172.stdout:6/461: rename d0/d18/d1c/d21/d26/d34/d7a/f63 to d0/d18/d1c/d21/d26/d34/d39/d74/f95 0 2024-09-20T18:35:43.952 INFO:tasks.workunit.client.1.smithi172.stdout:2/461: mkdir d0/d2c/d3f/d17/d22/d10/d97/d9f 0 2024-09-20T18:35:43.953 INFO:tasks.workunit.client.1.smithi172.stdout:0/668: creat d4/d94/ff1 x:0 0 0 2024-09-20T18:35:43.958 INFO:tasks.workunit.client.1.smithi172.stdout:6/462: mknod d0/d18/d1c/d21/d26/d34/d6b/d7d/d35/c96 0 2024-09-20T18:35:43.958 INFO:tasks.workunit.client.1.smithi172.stdout:4/531: dread d0/f32 [0,4194304] 0 2024-09-20T18:35:43.959 INFO:tasks.workunit.client.1.smithi172.stdout:3/569: link d0/d13/d58/f4a d0/d13/d58/d6d/d7f/d84/fc1 0 2024-09-20T18:35:43.961 INFO:tasks.workunit.client.1.smithi172.stdout:2/462: dwrite d0/d2c/d3f/d17/d18/d29/f56 [0,4194304] 0 2024-09-20T18:35:43.966 INFO:tasks.workunit.client.1.smithi172.stdout:0/669: dwrite d4/d1a/d28/f9a [0,4194304] 0 2024-09-20T18:35:43.967 INFO:tasks.workunit.client.1.smithi172.stdout:1/496: sync 2024-09-20T18:35:43.967 INFO:tasks.workunit.client.1.smithi172.stdout:9/503: sync 2024-09-20T18:35:43.967 INFO:tasks.workunit.client.1.smithi172.stdout:5/538: dwrite d4/fc [0,4194304] 0 2024-09-20T18:35:43.968 INFO:tasks.workunit.client.1.smithi172.stdout:7/597: link d2/d3/d3d/d68/fbe d2/d23/fce 0 2024-09-20T18:35:43.970 INFO:tasks.workunit.client.1.smithi172.stdout:4/532: mkdir d0/de/d21/dc7 0 2024-09-20T18:35:43.971 INFO:tasks.workunit.client.1.smithi172.stdout:7/598: write d2/d3/dd/f75 [663938,97180] 0 2024-09-20T18:35:43.973 INFO:tasks.workunit.client.1.smithi172.stdout:6/463: symlink d0/d18/d1c/d21/l97 0 2024-09-20T18:35:43.973 INFO:tasks.workunit.client.1.smithi172.stdout:9/504: read d15/d1f/d2c/d7d/d48/f81 [2392463,55386] 0 2024-09-20T18:35:43.974 INFO:tasks.workunit.client.1.smithi172.stdout:4/533: read - d0/d48/d90/d55/fa0 zero size 2024-09-20T18:35:43.976 INFO:tasks.workunit.client.1.smithi172.stdout:2/463: dwrite d0/d1a/d58/f78 [0,4194304] 0 2024-09-20T18:35:43.978 INFO:tasks.workunit.client.1.smithi172.stdout:9/505: chown d15/d1f/d7e/f93 7015 1 2024-09-20T18:35:43.979 INFO:tasks.workunit.client.1.smithi172.stdout:4/534: chown d0/de/d21/f80 47 1 2024-09-20T18:35:43.980 INFO:tasks.workunit.client.1.smithi172.stdout:1/497: creat d0/d8/db/d25/d6f/faa x:0 0 0 2024-09-20T18:35:43.982 INFO:tasks.workunit.client.1.smithi172.stdout:2/464: dread d0/d2c/f6b [0,4194304] 0 2024-09-20T18:35:43.982 INFO:tasks.workunit.client.1.smithi172.stdout:5/539: dwrite d4/df/dad/d26/d41/d69/f6e [0,4194304] 0 2024-09-20T18:35:43.983 INFO:tasks.workunit.client.1.smithi172.stdout:7/599: mknod d2/d23/d3c/ccf 0 2024-09-20T18:35:43.989 INFO:tasks.workunit.client.0.smithi017.stdout:2/24: dwrite d1/f4 [4194304,4194304] 0 2024-09-20T18:35:43.990 INFO:tasks.workunit.client.1.smithi172.stdout:0/670: unlink d4/d5/d2e/d33/de1/d15/f69 0 2024-09-20T18:35:43.991 INFO:tasks.workunit.client.1.smithi172.stdout:0/671: write d4/d1a/d28/d42/d45/d54/fea [418143,33673] 0 2024-09-20T18:35:43.992 INFO:tasks.workunit.client.1.smithi172.stdout:0/672: chown d4/d5/d2e/d33/de1/d7f 467162529 1 2024-09-20T18:35:43.993 INFO:tasks.workunit.client.1.smithi172.stdout:6/464: symlink d0/d18/d1c/d21/d26/d34/d39/d46/l98 0 2024-09-20T18:35:43.993 INFO:tasks.workunit.client.1.smithi172.stdout:6/465: stat d0/d18/l52 0 2024-09-20T18:35:44.000 INFO:tasks.workunit.client.0.smithi017.stdout:2/25: symlink d1/l6 0 2024-09-20T18:35:44.003 INFO:tasks.workunit.client.1.smithi172.stdout:1/498: creat d0/d22/fab x:0 0 0 2024-09-20T18:35:44.004 INFO:tasks.workunit.client.0.smithi017.stdout:2/26: creat d1/f7 x:0 0 0 2024-09-20T18:35:44.006 INFO:tasks.workunit.client.0.smithi017.stdout:2/27: write d1/f4 [7862748,126812] 0 2024-09-20T18:35:44.006 INFO:tasks.workunit.client.0.smithi017.stdout:2/28: rename d1 to d1/d8 22 2024-09-20T18:35:44.007 INFO:tasks.workunit.client.0.smithi017.stdout:2/29: dread - d1/f7 zero size 2024-09-20T18:35:44.008 INFO:tasks.workunit.client.0.smithi017.stdout:2/30: write d1/f4 [7076748,10166] 0 2024-09-20T18:35:44.008 INFO:tasks.workunit.client.1.smithi172.stdout:7/600: symlink d2/d3/d10/d40/d46/d8e/dbd/ld0 0 2024-09-20T18:35:44.009 INFO:tasks.workunit.client.0.smithi017.stdout:2/31: stat d1/l6 0 2024-09-20T18:35:44.009 INFO:tasks.workunit.client.0.smithi017.stdout:2/32: read - d1/f7 zero size 2024-09-20T18:35:44.010 INFO:tasks.workunit.client.0.smithi017.stdout:2/33: stat d1/f4 0 2024-09-20T18:35:44.013 INFO:tasks.workunit.client.1.smithi172.stdout:6/466: mkdir d0/d18/d1c/d21/d26/d34/d7a/d99 0 2024-09-20T18:35:44.013 INFO:tasks.workunit.client.0.smithi017.stdout:2/34: symlink d1/l9 0 2024-09-20T18:35:44.014 INFO:tasks.workunit.client.1.smithi172.stdout:3/570: write d0/d13/d58/d6d/d7f/d84/fc1 [3858142,118197] 0 2024-09-20T18:35:44.014 INFO:tasks.workunit.client.1.smithi172.stdout:6/467: fsync d0/fe 0 2024-09-20T18:35:44.014 INFO:tasks.workunit.client.0.smithi017.stdout:2/35: chown d1/l9 429 1 2024-09-20T18:35:44.015 INFO:tasks.workunit.client.1.smithi172.stdout:3/571: dread - d0/d13/db2/fc0 zero size 2024-09-20T18:35:44.015 INFO:tasks.workunit.client.1.smithi172.stdout:0/673: truncate d4/d1a/d28/d42/d45/d54/f64 156274 0 2024-09-20T18:35:44.018 INFO:tasks.workunit.client.1.smithi172.stdout:9/506: mknod d15/d1f/d2c/ca6 0 2024-09-20T18:35:44.024 INFO:tasks.workunit.client.1.smithi172.stdout:4/535: link d0/de/d21/d24/f69 d0/de/d39/fc8 0 2024-09-20T18:35:44.024 INFO:tasks.workunit.client.1.smithi172.stdout:8/492: sync 2024-09-20T18:35:44.024 INFO:tasks.workunit.client.1.smithi172.stdout:6/468: dwrite d0/f5 [4194304,4194304] 0 2024-09-20T18:35:44.026 INFO:tasks.workunit.client.1.smithi172.stdout:6/469: readlink d0/l72 0 2024-09-20T18:35:44.027 INFO:tasks.workunit.client.1.smithi172.stdout:3/572: dread d0/d13/d58/d6d/db9/f66 [0,4194304] 0 2024-09-20T18:35:44.027 INFO:tasks.workunit.client.1.smithi172.stdout:2/465: rename d0/d2c/d3f/d17/d22/d10/d6a/d98/c7e to d0/d2c/d3f/d17/d45/ca0 0 2024-09-20T18:35:44.029 INFO:tasks.workunit.client.1.smithi172.stdout:0/674: dwrite d4/d5/d2e/f49 [0,4194304] 0 2024-09-20T18:35:44.032 INFO:tasks.workunit.client.1.smithi172.stdout:7/601: mkdir d2/dcc/dd1 0 2024-09-20T18:35:44.038 INFO:tasks.workunit.client.1.smithi172.stdout:5/540: getdents d4/df 0 2024-09-20T18:35:44.041 INFO:tasks.workunit.client.1.smithi172.stdout:3/573: mkdir d0/d13/d32/d88/dc2 0 2024-09-20T18:35:44.043 INFO:tasks.workunit.client.1.smithi172.stdout:7/602: write d2/d23/d3a/f5c [789811,89996] 0 2024-09-20T18:35:44.045 INFO:tasks.workunit.client.0.smithi017.stdout:2/36: truncate d1/f4 5972146 0 2024-09-20T18:35:44.045 INFO:tasks.workunit.client.1.smithi172.stdout:7/603: chown d2/d23/d3a/d72/d9b/fa3 21311 1 2024-09-20T18:35:44.048 INFO:tasks.workunit.client.0.smithi017.stdout:2/37: symlink d1/la 0 2024-09-20T18:35:44.048 INFO:tasks.workunit.client.0.smithi017.stdout:2/38: write d1/f7 [992289,43530] 0 2024-09-20T18:35:44.049 INFO:tasks.workunit.client.1.smithi172.stdout:1/499: dwrite d0/f4 [0,4194304] 0 2024-09-20T18:35:44.049 INFO:tasks.workunit.client.1.smithi172.stdout:4/536: dread d0/de/d21/d24/f69 [0,4194304] 0 2024-09-20T18:35:44.049 INFO:tasks.workunit.client.1.smithi172.stdout:6/470: rmdir d0/d18/d1c/d4c 0 2024-09-20T18:35:44.053 INFO:tasks.workunit.client.0.smithi017.stdout:2/39: rename d1/f7 to d1/fb 0 2024-09-20T18:35:44.054 INFO:tasks.workunit.client.1.smithi172.stdout:7/604: mkdir d2/d3/d10/d40/d46/dd2 0 2024-09-20T18:35:44.056 INFO:tasks.workunit.client.0.smithi017.stdout:2/40: write d1/fb [1358382,109141] 0 2024-09-20T18:35:44.057 INFO:tasks.workunit.client.1.smithi172.stdout:9/507: truncate d15/d1f/f53 3311792 0 2024-09-20T18:35:44.059 INFO:tasks.workunit.client.1.smithi172.stdout:4/537: symlink d0/de/d39/d9f/lc9 0 2024-09-20T18:35:44.060 INFO:tasks.workunit.client.1.smithi172.stdout:8/493: truncate dd/d1b/f8d 2800569 0 2024-09-20T18:35:44.060 INFO:tasks.workunit.client.1.smithi172.stdout:2/466: dread d0/d2c/f3d [0,4194304] 0 2024-09-20T18:35:44.061 INFO:tasks.workunit.client.0.smithi017.stdout:2/41: mkdir d1/dc 0 2024-09-20T18:35:44.064 INFO:tasks.workunit.client.1.smithi172.stdout:7/605: write d2/d23/d9d/fc4 [120749,46695] 0 2024-09-20T18:35:44.065 INFO:tasks.workunit.client.1.smithi172.stdout:7/606: write d2/d23/d3c/f58 [3989001,29093] 0 2024-09-20T18:35:44.065 INFO:tasks.workunit.client.1.smithi172.stdout:0/675: truncate d4/d5/d2e/d33/de1/d15/f1b 5273786 0 2024-09-20T18:35:44.066 INFO:tasks.workunit.client.0.smithi017.stdout:2/42: symlink d1/dc/ld 0 2024-09-20T18:35:44.070 INFO:tasks.workunit.client.1.smithi172.stdout:9/508: rename d15/d1f/d2c/d7d/d34/l5d to d15/d1f/d2c/d7d/d34/la7 0 2024-09-20T18:35:44.073 INFO:tasks.workunit.client.1.smithi172.stdout:7/607: dwrite d2/d3/d10/d40/d46/f60 [4194304,4194304] 0 2024-09-20T18:35:44.077 INFO:tasks.workunit.client.1.smithi172.stdout:6/471: dread d0/d18/f54 [0,4194304] 0 2024-09-20T18:35:44.078 INFO:tasks.workunit.client.1.smithi172.stdout:3/574: getdents d0/d13/d58/d6d/db9 0 2024-09-20T18:35:44.082 INFO:tasks.workunit.client.1.smithi172.stdout:0/676: stat d4/d5/d2e/d33/f5a 0 2024-09-20T18:35:44.085 INFO:tasks.workunit.client.1.smithi172.stdout:8/494: write dd/d1b/f1f [10406835,116287] 0 2024-09-20T18:35:44.086 INFO:tasks.workunit.client.1.smithi172.stdout:4/538: symlink d0/lca 0 2024-09-20T18:35:44.087 INFO:tasks.workunit.client.1.smithi172.stdout:7/608: symlink d2/d3/d10/d40/d6a/ld3 0 2024-09-20T18:35:44.089 INFO:tasks.workunit.client.1.smithi172.stdout:2/467: unlink d0/d2c/d3f/d17/d45/ca0 0 2024-09-20T18:35:44.091 INFO:tasks.workunit.client.1.smithi172.stdout:1/500: rmdir d0/d8/db/d25/d6d/da4 0 2024-09-20T18:35:44.092 INFO:tasks.workunit.client.1.smithi172.stdout:6/472: mkdir d0/d18/d1c/d21/d26/d34/d6b/d9a 0 2024-09-20T18:35:44.095 INFO:tasks.workunit.client.1.smithi172.stdout:4/539: dwrite d0/f63 [0,4194304] 0 2024-09-20T18:35:44.095 INFO:tasks.workunit.client.1.smithi172.stdout:0/677: creat d4/d1a/d28/d42/db8/dcd/ff2 x:0 0 0 2024-09-20T18:35:44.095 INFO:tasks.workunit.client.1.smithi172.stdout:9/509: dread d15/d1f/d2c/d7d/d48/f95 [0,4194304] 0 2024-09-20T18:35:44.097 INFO:tasks.workunit.client.1.smithi172.stdout:7/609: dwrite d2/d3/d3d/d4e/d5f/f61 [0,4194304] 0 2024-09-20T18:35:44.098 INFO:tasks.workunit.client.1.smithi172.stdout:8/495: creat dd/d1b/d4f/fae x:0 0 0 2024-09-20T18:35:44.100 INFO:tasks.workunit.client.1.smithi172.stdout:9/510: chown d15/d20/c4b 11 1 2024-09-20T18:35:44.101 INFO:tasks.workunit.client.1.smithi172.stdout:8/496: dread - dd/d1b/d3b/d51/f8e zero size 2024-09-20T18:35:44.104 INFO:tasks.workunit.client.0.smithi017.stdout:2/43: write d1/f4 [373066,49116] 0 2024-09-20T18:35:44.106 INFO:tasks.workunit.client.1.smithi172.stdout:2/468: creat d0/d2c/d3f/d17/d22/d10/d3c/d7b/fa1 x:0 0 0 2024-09-20T18:35:44.107 INFO:tasks.workunit.client.1.smithi172.stdout:4/540: dwrite d0/de/d21/faa [0,4194304] 0 2024-09-20T18:35:44.107 INFO:tasks.workunit.client.0.smithi017.stdout:2/44: mknod d1/dc/ce 0 2024-09-20T18:35:44.107 INFO:tasks.workunit.client.1.smithi172.stdout:2/469: fdatasync d0/d2c/f3e 0 2024-09-20T18:35:44.109 INFO:tasks.workunit.client.1.smithi172.stdout:6/473: mkdir d0/d18/d1c/d21/d26/d9b 0 2024-09-20T18:35:44.111 INFO:tasks.workunit.client.0.smithi017.stdout:2/45: mkdir d1/df 0 2024-09-20T18:35:44.112 INFO:tasks.workunit.client.0.smithi017.stdout:7/12: sync 2024-09-20T18:35:44.113 INFO:tasks.workunit.client.0.smithi017.stdout:7/13: chown c0 46415599 1 2024-09-20T18:35:44.117 INFO:tasks.workunit.client.0.smithi017.stdout:2/46: dread d1/f4 [0,4194304] 0 2024-09-20T18:35:44.117 INFO:tasks.workunit.client.0.smithi017.stdout:2/47: stat d1/dc 0 2024-09-20T18:35:44.119 INFO:tasks.workunit.client.0.smithi017.stdout:7/14: rename c0 to c2 0 2024-09-20T18:35:44.123 INFO:tasks.workunit.client.1.smithi172.stdout:7/610: mkdir d2/d3/d3d/dd4 0 2024-09-20T18:35:44.124 INFO:tasks.workunit.client.1.smithi172.stdout:3/575: truncate d0/dc/f2e 2249804 0 2024-09-20T18:35:44.124 INFO:tasks.workunit.client.1.smithi172.stdout:8/497: rename dd/d1b/d3b/d51/d34/d39 to dd/d1b/d3b/d51/d5b/daf 0 2024-09-20T18:35:44.124 INFO:tasks.workunit.client.1.smithi172.stdout:2/470: creat d0/d2c/d3f/d17/d18/d29/d42/d4b/d53/fa2 x:0 0 0 2024-09-20T18:35:44.125 INFO:tasks.workunit.client.1.smithi172.stdout:6/474: mkdir d0/d18/d1c/d21/d26/d34/d9c 0 2024-09-20T18:35:44.125 INFO:tasks.workunit.client.0.smithi017.stdout:2/48: dwrite d1/fb [0,4194304] 0 2024-09-20T18:35:44.126 INFO:tasks.workunit.client.0.smithi017.stdout:2/49: chown d1/df 37622 1 2024-09-20T18:35:44.131 INFO:tasks.workunit.client.1.smithi172.stdout:9/511: dread f12 [0,4194304] 0 2024-09-20T18:35:44.132 INFO:tasks.workunit.client.0.smithi017.stdout:2/50: rename d1/l5 to d1/l10 0 2024-09-20T18:35:44.134 INFO:tasks.workunit.client.1.smithi172.stdout:7/611: dwrite d2/d23/d3a/f88 [8388608,4194304] 0 2024-09-20T18:35:44.135 INFO:tasks.workunit.client.1.smithi172.stdout:7/612: chown d2/d3/dd/f42 10237 1 2024-09-20T18:35:44.136 INFO:tasks.workunit.client.1.smithi172.stdout:2/471: dwrite d0/d2c/d3f/d17/d18/d29/f56 [0,4194304] 0 2024-09-20T18:35:44.143 INFO:tasks.workunit.client.0.smithi017.stdout:7/15: rename c2 to c3 0 2024-09-20T18:35:44.143 INFO:tasks.workunit.client.0.smithi017.stdout:7/16: dread - no filename 2024-09-20T18:35:44.143 INFO:tasks.workunit.client.0.smithi017.stdout:7/17: rmdir - no directory 2024-09-20T18:35:44.143 INFO:tasks.workunit.client.0.smithi017.stdout:7/18: readlink - no filename 2024-09-20T18:35:44.143 INFO:tasks.workunit.client.0.smithi017.stdout:7/19: dread - no filename 2024-09-20T18:35:44.147 INFO:tasks.workunit.client.0.smithi017.stdout:2/51: fdatasync d1/fb 0 2024-09-20T18:35:44.149 INFO:tasks.workunit.client.0.smithi017.stdout:7/20: creat f4 x:0 0 0 2024-09-20T18:35:44.150 INFO:tasks.workunit.client.0.smithi017.stdout:7/21: chown f4 395203328 1 2024-09-20T18:35:44.151 INFO:tasks.workunit.client.0.smithi017.stdout:7/22: write f4 [367100,85875] 0 2024-09-20T18:35:44.154 INFO:tasks.workunit.client.1.smithi172.stdout:0/678: rename d4/d5/d2e/d67/l8a to d4/d1a/d28/d75/d60/dba/lf3 0 2024-09-20T18:35:44.157 INFO:tasks.workunit.client.0.smithi017.stdout:7/23: symlink l5 0 2024-09-20T18:35:44.157 INFO:tasks.workunit.client.1.smithi172.stdout:0/679: dread d4/d1a/d28/f5e [0,4194304] 0 2024-09-20T18:35:44.158 INFO:tasks.workunit.client.0.smithi017.stdout:2/52: dwrite d1/f4 [4194304,4194304] 0 2024-09-20T18:35:44.159 INFO:tasks.workunit.client.1.smithi172.stdout:0/680: chown d4/d5/d2e/d33/de1/d15/fd4 133685681 1 2024-09-20T18:35:44.159 INFO:tasks.workunit.client.1.smithi172.stdout:0/681: readlink d4/d20/l36 0 2024-09-20T18:35:44.159 INFO:tasks.workunit.client.1.smithi172.stdout:9/512: symlink d15/d4a/la8 0 2024-09-20T18:35:44.162 INFO:tasks.workunit.client.1.smithi172.stdout:7/613: creat d2/d23/d51/fd5 x:0 0 0 2024-09-20T18:35:44.163 INFO:tasks.workunit.client.1.smithi172.stdout:7/614: dread - d2/d3/d10/d40/d6a/f8f zero size 2024-09-20T18:35:44.163 INFO:tasks.workunit.client.0.smithi017.stdout:7/24: dread f4 [0,4194304] 0 2024-09-20T18:35:44.164 INFO:tasks.workunit.client.0.smithi017.stdout:2/53: mkdir d1/d11 0 2024-09-20T18:35:44.166 INFO:tasks.workunit.client.1.smithi172.stdout:1/501: getdents d0/d8/db/d25/d2b/d3d 0 2024-09-20T18:35:44.167 INFO:tasks.workunit.client.1.smithi172.stdout:5/541: sync 2024-09-20T18:35:44.167 INFO:tasks.workunit.client.0.smithi017.stdout:2/54: readlink d1/l10 0 2024-09-20T18:35:44.170 INFO:tasks.workunit.client.1.smithi172.stdout:6/475: rename d0/d18/d65/l66 to d0/d18/d1c/d21/d26/d34/d7a/d47/l9d 0 2024-09-20T18:35:44.172 INFO:tasks.workunit.client.0.smithi017.stdout:2/55: mknod d1/c12 0 2024-09-20T18:35:44.172 INFO:tasks.workunit.client.0.smithi017.stdout:2/56: chown d1/d11 1005906611 1 2024-09-20T18:35:44.174 INFO:tasks.workunit.client.0.smithi017.stdout:7/25: rename c3 to c6 0 2024-09-20T18:35:44.177 INFO:tasks.workunit.client.1.smithi172.stdout:0/682: mknod d4/d5/d2e/d33/de1/dac/cf4 0 2024-09-20T18:35:44.178 INFO:tasks.workunit.client.1.smithi172.stdout:0/683: truncate d4/d20/f91 1498150 0 2024-09-20T18:35:44.180 INFO:tasks.workunit.client.0.smithi017.stdout:2/57: link d1/c12 d1/c13 0 2024-09-20T18:35:44.180 INFO:tasks.workunit.client.1.smithi172.stdout:7/615: read d2/d23/f24 [863362,52583] 0 2024-09-20T18:35:44.181 INFO:tasks.workunit.client.1.smithi172.stdout:2/472: creat d0/d2c/d3f/d17/d22/d10/d97/d9f/fa3 x:0 0 0 2024-09-20T18:35:44.184 INFO:tasks.workunit.client.0.smithi017.stdout:2/58: rename d1/l9 to d1/dc/l14 0 2024-09-20T18:35:44.185 INFO:tasks.workunit.client.1.smithi172.stdout:3/576: rmdir d0/d13/d32/d54/daf 0 2024-09-20T18:35:44.186 INFO:tasks.workunit.client.1.smithi172.stdout:8/498: truncate dd/d1b/f33 160885 0 2024-09-20T18:35:44.189 INFO:tasks.workunit.client.1.smithi172.stdout:2/473: mknod d0/d2c/d3f/d17/d18/d29/d42/d4b/ca4 0 2024-09-20T18:35:44.189 INFO:tasks.workunit.client.1.smithi172.stdout:2/474: write d0/d2c/d51/d61/f9e [439903,37352] 0 2024-09-20T18:35:44.192 INFO:tasks.workunit.client.1.smithi172.stdout:3/577: mkdir d0/d13/d58/d6d/dc3 0 2024-09-20T18:35:44.193 INFO:tasks.workunit.client.1.smithi172.stdout:3/578: write d0/dc/d6a/d22/f7a [9378799,96868] 0 2024-09-20T18:35:44.193 INFO:tasks.workunit.client.0.smithi017.stdout:2/59: getdents d1 0 2024-09-20T18:35:44.196 INFO:tasks.workunit.client.1.smithi172.stdout:9/513: rmdir d15/d1f/d2c/d6e/da3 0 2024-09-20T18:35:44.198 INFO:tasks.workunit.client.1.smithi172.stdout:7/616: link d2/d3/d10/d40/f7c d2/d3/d10/d40/d6a/dc6/fd6 0 2024-09-20T18:35:44.199 INFO:tasks.workunit.client.1.smithi172.stdout:8/499: dwrite dd/d1b/d3b/d5d/f60 [0,4194304] 0 2024-09-20T18:35:44.203 INFO:tasks.workunit.client.1.smithi172.stdout:0/684: dwrite d4/d1a/d28/f9a [4194304,4194304] 0 2024-09-20T18:35:44.205 INFO:tasks.workunit.client.1.smithi172.stdout:3/579: mknod d0/d13/d1e/cc4 0 2024-09-20T18:35:44.205 INFO:tasks.workunit.client.0.smithi017.stdout:2/60: link d1/l6 d1/d11/l15 0 2024-09-20T18:35:44.206 INFO:tasks.workunit.client.1.smithi172.stdout:9/514: symlink d15/d1f/d2c/d37/la9 0 2024-09-20T18:35:44.207 INFO:tasks.workunit.client.0.smithi017.stdout:2/61: truncate d1/fb 4841235 0 2024-09-20T18:35:44.208 INFO:tasks.workunit.client.1.smithi172.stdout:1/502: getdents d0/d8/db/d25/d2b/d3d/d65 0 2024-09-20T18:35:44.210 INFO:tasks.workunit.client.1.smithi172.stdout:8/500: rmdir dd/d65/d85 39 2024-09-20T18:35:44.214 INFO:tasks.workunit.client.0.smithi017.stdout:2/62: creat d1/df/f16 x:0 0 0 2024-09-20T18:35:44.215 INFO:tasks.workunit.client.0.smithi017.stdout:2/63: write d1/f4 [1411858,130858] 0 2024-09-20T18:35:44.215 INFO:tasks.workunit.client.1.smithi172.stdout:0/685: dread d4/d5/fc [0,4194304] 0 2024-09-20T18:35:44.217 INFO:tasks.workunit.client.1.smithi172.stdout:3/580: rmdir d0/dc/d6a/d22 39 2024-09-20T18:35:44.218 INFO:tasks.workunit.client.0.smithi017.stdout:2/64: mkdir d1/df/d17 0 2024-09-20T18:35:44.219 INFO:tasks.workunit.client.1.smithi172.stdout:2/475: dwrite d0/d2c/d3f/d17/d22/fc [0,4194304] 0 2024-09-20T18:35:44.220 INFO:tasks.workunit.client.1.smithi172.stdout:0/686: chown d4/d1a/fb5 201811877 1 2024-09-20T18:35:44.222 INFO:tasks.workunit.client.1.smithi172.stdout:0/687: chown d4/d94 482842 1 2024-09-20T18:35:44.222 INFO:tasks.workunit.client.1.smithi172.stdout:1/503: getdents d0/d8/db/d25/d2b/d3d/d65/d93 0 2024-09-20T18:35:44.222 INFO:tasks.workunit.client.0.smithi017.stdout:2/65: rename d1/c13 to d1/df/c18 0 2024-09-20T18:35:44.223 INFO:tasks.workunit.client.1.smithi172.stdout:8/501: dwrite dd/d1b/d3b/d51/d34/f84 [0,4194304] 0 2024-09-20T18:35:44.223 INFO:tasks.workunit.client.0.smithi017.stdout:2/66: fsync d1/fb 0 2024-09-20T18:35:44.223 INFO:tasks.workunit.client.1.smithi172.stdout:2/476: read - d0/d2c/d3f/d17/f80 zero size 2024-09-20T18:35:44.224 INFO:tasks.workunit.client.0.smithi017.stdout:2/67: rmdir d1/dc 39 2024-09-20T18:35:44.226 INFO:tasks.workunit.client.1.smithi172.stdout:0/688: fdatasync d4/d1a/d28/d75/f43 0 2024-09-20T18:35:44.228 INFO:tasks.workunit.client.1.smithi172.stdout:1/504: symlink d0/d8/lac 0 2024-09-20T18:35:44.229 INFO:tasks.workunit.client.1.smithi172.stdout:3/581: dwrite d0/d13/d32/f8a [0,4194304] 0 2024-09-20T18:35:44.230 INFO:tasks.workunit.client.1.smithi172.stdout:3/582: stat d0/d13/d58/f4a 0 2024-09-20T18:35:44.231 INFO:tasks.workunit.client.1.smithi172.stdout:3/583: chown d0/d13/d58/d6d/db9/d87/f8f 241731 1 2024-09-20T18:35:44.233 INFO:tasks.workunit.client.1.smithi172.stdout:8/502: symlink dd/d1b/d3b/d51/d5b/daf/d91/lb0 0 2024-09-20T18:35:44.234 INFO:tasks.workunit.client.1.smithi172.stdout:8/503: fsync dd/d1b/d4f/fad 0 2024-09-20T18:35:44.235 INFO:tasks.workunit.client.0.smithi017.stdout:2/68: rename d1/l6 to d1/df/d17/l19 0 2024-09-20T18:35:44.236 INFO:tasks.workunit.client.1.smithi172.stdout:2/477: dread d0/d2c/d3f/d17/d18/f32 [0,4194304] 0 2024-09-20T18:35:44.236 INFO:tasks.workunit.client.1.smithi172.stdout:8/504: write dd/d1b/d3b/d51/d34/f36 [209608,51115] 0 2024-09-20T18:35:44.237 INFO:tasks.workunit.client.1.smithi172.stdout:7/617: write d2/f39 [1128078,44692] 0 2024-09-20T18:35:44.239 INFO:tasks.workunit.client.1.smithi172.stdout:7/618: stat d2/d23/d51/fd5 0 2024-09-20T18:35:44.243 INFO:tasks.workunit.client.1.smithi172.stdout:0/689: creat d4/d5/d2e/d76/ff5 x:0 0 0 2024-09-20T18:35:44.243 INFO:tasks.workunit.client.1.smithi172.stdout:1/505: mknod d0/d22/cad 0 2024-09-20T18:35:44.244 INFO:tasks.workunit.client.1.smithi172.stdout:0/690: chown d4/d1a/d28/d9d 26 1 2024-09-20T18:35:44.244 INFO:tasks.workunit.client.0.smithi017.stdout:2/69: dwrite d1/f4 [0,4194304] 0 2024-09-20T18:35:44.244 INFO:tasks.workunit.client.1.smithi172.stdout:9/515: dwrite d15/d1f/d88/f98 [0,4194304] 0 2024-09-20T18:35:44.245 INFO:tasks.workunit.client.1.smithi172.stdout:3/584: rmdir d0/d13/d58/d6d/d7f 39 2024-09-20T18:35:44.248 INFO:tasks.workunit.client.1.smithi172.stdout:2/478: creat d0/d2c/d3f/d17/d22/d10/d35/fa5 x:0 0 0 2024-09-20T18:35:44.250 INFO:tasks.workunit.client.0.smithi017.stdout:2/70: creat d1/df/d17/f1a x:0 0 0 2024-09-20T18:35:44.253 INFO:tasks.workunit.client.1.smithi172.stdout:1/506: creat d0/d8/db/d25/d2b/d3d/fae x:0 0 0 2024-09-20T18:35:44.255 INFO:tasks.workunit.client.0.smithi017.stdout:2/71: mknod d1/df/c1b 0 2024-09-20T18:35:44.256 INFO:tasks.workunit.client.0.smithi017.stdout:2/72: dread - d1/df/f16 zero size 2024-09-20T18:35:44.257 INFO:tasks.workunit.client.0.smithi017.stdout:2/73: write d1/fb [5678067,3720] 0 2024-09-20T18:35:44.257 INFO:tasks.workunit.client.1.smithi172.stdout:9/516: creat d15/d1a/d8d/faa x:0 0 0 2024-09-20T18:35:44.258 INFO:tasks.workunit.client.0.smithi017.stdout:2/74: read - d1/df/d17/f1a zero size 2024-09-20T18:35:44.259 INFO:tasks.workunit.client.1.smithi172.stdout:1/507: mknod d0/d8/d12/caf 0 2024-09-20T18:35:44.260 INFO:tasks.workunit.client.1.smithi172.stdout:3/585: mkdir d0/dc/d6a/dc5 0 2024-09-20T18:35:44.265 INFO:tasks.workunit.client.1.smithi172.stdout:9/517: creat d15/d4a/d8c/fab x:0 0 0 2024-09-20T18:35:44.266 INFO:tasks.workunit.client.1.smithi172.stdout:9/518: chown d15/d1a/f26 373715364 1 2024-09-20T18:35:44.267 INFO:tasks.workunit.client.0.smithi017.stdout:2/75: rename d1/d11/l15 to d1/df/d17/l1c 0 2024-09-20T18:35:44.268 INFO:tasks.workunit.client.0.smithi017.stdout:2/76: chown d1/f4 383379 1 2024-09-20T18:35:44.271 INFO:tasks.workunit.client.1.smithi172.stdout:0/691: link d4/d1a/d28/d75/d60/cc4 d4/d46/cf6 0 2024-09-20T18:35:44.273 INFO:tasks.workunit.client.1.smithi172.stdout:9/519: mknod d15/d1f/d2c/d7d/d58/cac 0 2024-09-20T18:35:44.273 INFO:tasks.workunit.client.1.smithi172.stdout:3/586: dread d0/d13/d58/d6d/db9/f66 [0,4194304] 0 2024-09-20T18:35:44.273 INFO:tasks.workunit.client.1.smithi172.stdout:8/505: truncate f0 2141357 0 2024-09-20T18:35:44.274 INFO:tasks.workunit.client.0.smithi017.stdout:2/77: dwrite d1/f4 [0,4194304] 0 2024-09-20T18:35:44.275 INFO:tasks.workunit.client.1.smithi172.stdout:2/479: getdents d0/d2c/d3f/d17/d22/d10/d35/d5d 0 2024-09-20T18:35:44.275 INFO:tasks.workunit.client.1.smithi172.stdout:9/520: read d15/d1f/d2c/d7d/d48/f66 [929866,123705] 0 2024-09-20T18:35:44.275 INFO:tasks.workunit.client.1.smithi172.stdout:2/480: readlink d0/d2c/d3f/le 0 2024-09-20T18:35:44.279 INFO:tasks.workunit.client.1.smithi172.stdout:8/506: creat dd/d1b/d3b/d51/d5b/daf/d91/fb1 x:0 0 0 2024-09-20T18:35:44.279 INFO:tasks.workunit.client.1.smithi172.stdout:0/692: mknod d4/d1a/d28/cf7 0 2024-09-20T18:35:44.279 INFO:tasks.workunit.client.1.smithi172.stdout:3/587: read d0/dc/d6a/d3a/f7d [437751,131009] 0 2024-09-20T18:35:44.280 INFO:tasks.workunit.client.0.smithi017.stdout:2/78: creat d1/f1d x:0 0 0 2024-09-20T18:35:44.281 INFO:tasks.workunit.client.1.smithi172.stdout:3/588: stat d0/dc/d6a/d3a/f3f 0 2024-09-20T18:35:44.281 INFO:tasks.workunit.client.1.smithi172.stdout:1/508: getdents d0/d8/db/d25/d2b/d3d/d65 0 2024-09-20T18:35:44.281 INFO:tasks.workunit.client.0.smithi017.stdout:2/79: write d1/f4 [1558287,114985] 0 2024-09-20T18:35:44.282 INFO:tasks.workunit.client.0.smithi017.stdout:2/80: dread - d1/df/d17/f1a zero size 2024-09-20T18:35:44.283 INFO:tasks.workunit.client.1.smithi172.stdout:8/507: fsync dd/f3d 0 2024-09-20T18:35:44.284 INFO:tasks.workunit.client.1.smithi172.stdout:9/521: fsync d15/d20/d76/f9b 0 2024-09-20T18:35:44.285 INFO:tasks.workunit.client.1.smithi172.stdout:9/522: read - d15/d4a/f96 zero size 2024-09-20T18:35:44.285 INFO:tasks.workunit.client.1.smithi172.stdout:0/693: mkdir d4/d1a/d28/d42/d45/d54/df8 0 2024-09-20T18:35:44.287 INFO:tasks.workunit.client.1.smithi172.stdout:3/589: mknod d0/d13/d32/d54/d83/cc6 0 2024-09-20T18:35:44.288 INFO:tasks.workunit.client.1.smithi172.stdout:3/590: write d0/d13/d32/d54/d83/fa6 [1029643,122945] 0 2024-09-20T18:35:44.290 INFO:tasks.workunit.client.1.smithi172.stdout:8/508: chown dd/d1b/d3b/d51/d34/c7c 982 1 2024-09-20T18:35:44.290 INFO:tasks.workunit.client.0.smithi017.stdout:2/81: dwrite d1/df/d17/f1a [0,4194304] 0 2024-09-20T18:35:44.295 INFO:tasks.workunit.client.0.smithi017.stdout:2/82: creat d1/df/f1e x:0 0 0 2024-09-20T18:35:44.296 INFO:tasks.workunit.client.0.smithi017.stdout:2/83: dread - d1/df/f16 zero size 2024-09-20T18:35:44.299 INFO:tasks.workunit.client.1.smithi172.stdout:9/523: symlink d15/d1f/d2c/d57/lad 0 2024-09-20T18:35:44.300 INFO:tasks.workunit.client.1.smithi172.stdout:0/694: unlink d4/d20/lca 0 2024-09-20T18:35:44.304 INFO:tasks.workunit.client.1.smithi172.stdout:8/509: rename dd/d1b/d4f/l50 to dd/d1b/d3b/d51/d5b/daf/d91/lb2 0 2024-09-20T18:35:44.304 INFO:tasks.workunit.client.0.smithi017.stdout:2/84: mkdir d1/d1f 0 2024-09-20T18:35:44.305 INFO:tasks.workunit.client.0.smithi017.stdout:2/85: dread - d1/df/f1e zero size 2024-09-20T18:35:44.305 INFO:tasks.workunit.client.1.smithi172.stdout:8/510: readlink dd/d1b/d3b/d5d/d7d/l7e 0 2024-09-20T18:35:44.306 INFO:tasks.workunit.client.1.smithi172.stdout:1/509: rmdir d0/d9a 0 2024-09-20T18:35:44.307 INFO:tasks.workunit.client.1.smithi172.stdout:2/481: dwrite d0/d2c/d3f/d17/d22/d10/f1f [4194304,4194304] 0 2024-09-20T18:35:44.307 INFO:tasks.workunit.client.1.smithi172.stdout:8/511: chown dd/c43 16485642 1 2024-09-20T18:35:44.308 INFO:tasks.workunit.client.1.smithi172.stdout:1/510: fsync d0/d22/f9c 0 2024-09-20T18:35:44.310 INFO:tasks.workunit.client.1.smithi172.stdout:3/591: creat d0/d13/d58/d6d/dc3/fc7 x:0 0 0 2024-09-20T18:35:44.311 INFO:tasks.workunit.client.1.smithi172.stdout:1/511: readlink d0/d8/db/d39/l6c 0 2024-09-20T18:35:44.311 INFO:tasks.workunit.client.1.smithi172.stdout:9/524: dread d15/d4a/f55 [0,4194304] 0 2024-09-20T18:35:44.312 INFO:tasks.workunit.client.1.smithi172.stdout:1/512: chown d0/d8/f44 248486 1 2024-09-20T18:35:44.312 INFO:tasks.workunit.client.0.smithi017.stdout:2/86: rename d1/d11 to d1/dc/d20 0 2024-09-20T18:35:44.313 INFO:tasks.workunit.client.1.smithi172.stdout:0/695: fdatasync d4/d1a/d28/d42/d45/d54/f64 0 2024-09-20T18:35:44.314 INFO:tasks.workunit.client.1.smithi172.stdout:2/482: creat d0/d2c/d3f/d17/d22/d10/d35/fa6 x:0 0 0 2024-09-20T18:35:44.315 INFO:tasks.workunit.client.1.smithi172.stdout:8/512: creat dd/d1b/d3b/d51/d5b/daf/d4d/fb3 x:0 0 0 2024-09-20T18:35:44.316 INFO:tasks.workunit.client.1.smithi172.stdout:8/513: chown dd 438 1 2024-09-20T18:35:44.316 INFO:tasks.workunit.client.1.smithi172.stdout:9/525: creat d15/d4a/d8c/fae x:0 0 0 2024-09-20T18:35:44.317 INFO:tasks.workunit.client.1.smithi172.stdout:1/513: read - d0/f59 zero size 2024-09-20T18:35:44.317 INFO:tasks.workunit.client.1.smithi172.stdout:9/526: stat d15/d54/f78 0 2024-09-20T18:35:44.318 INFO:tasks.workunit.client.1.smithi172.stdout:1/514: fsync d0/d8/db/d25/d6f/f86 0 2024-09-20T18:35:44.318 INFO:tasks.workunit.client.1.smithi172.stdout:0/696: fsync d4/d1a/f1e 0 2024-09-20T18:35:44.319 INFO:tasks.workunit.client.1.smithi172.stdout:1/515: dread - d0/d22/fab zero size 2024-09-20T18:35:44.319 INFO:tasks.workunit.client.1.smithi172.stdout:9/527: dread d15/d1f/d2c/f70 [0,4194304] 0 2024-09-20T18:35:44.320 INFO:tasks.workunit.client.1.smithi172.stdout:0/697: read d4/d5/f2f [928199,127008] 0 2024-09-20T18:35:44.322 INFO:tasks.workunit.client.1.smithi172.stdout:0/698: chown d4/d1a/d28/c39 19 1 2024-09-20T18:35:44.325 INFO:tasks.workunit.client.1.smithi172.stdout:3/592: rename d0/d13/d58/d6d/db9/f66 to d0/d13/fc8 0 2024-09-20T18:35:44.325 INFO:tasks.workunit.client.1.smithi172.stdout:9/528: dwrite d15/d1f/d2c/d57/fa0 [0,4194304] 0 2024-09-20T18:35:44.326 INFO:tasks.workunit.client.1.smithi172.stdout:3/593: dread - d0/d13/d58/d6d/dc3/fc7 zero size 2024-09-20T18:35:44.329 INFO:tasks.workunit.client.1.smithi172.stdout:8/514: creat dd/d1b/d3b/d51/d34/fb4 x:0 0 0 2024-09-20T18:35:44.333 INFO:tasks.workunit.client.1.smithi172.stdout:1/516: link d0/d8/d12/f1a d0/d8/db/d39/fb0 0 2024-09-20T18:35:44.335 INFO:tasks.workunit.client.1.smithi172.stdout:9/529: creat d15/d1f/d2c/d7d/d34/faf x:0 0 0 2024-09-20T18:35:44.337 INFO:tasks.workunit.client.1.smithi172.stdout:9/530: dread - d15/d1a/d6f/f8a zero size 2024-09-20T18:35:44.337 INFO:tasks.workunit.client.1.smithi172.stdout:2/483: getdents d0/d2c/d3f/d17/d22/d10/d3c/d68 0 2024-09-20T18:35:44.338 INFO:tasks.workunit.client.1.smithi172.stdout:6/476: sync 2024-09-20T18:35:44.338 INFO:tasks.workunit.client.1.smithi172.stdout:4/541: sync 2024-09-20T18:35:44.338 INFO:tasks.workunit.client.1.smithi172.stdout:5/542: sync 2024-09-20T18:35:44.338 INFO:tasks.workunit.client.0.smithi017.stdout:2/87: truncate d1/df/d17/f1a 1074211 0 2024-09-20T18:35:44.340 INFO:tasks.workunit.client.1.smithi172.stdout:0/699: mknod d4/cf9 0 2024-09-20T18:35:44.340 INFO:tasks.workunit.client.1.smithi172.stdout:1/517: dwrite d0/d22/f9c [0,4194304] 0 2024-09-20T18:35:44.341 INFO:tasks.workunit.client.0.smithi017.stdout:2/88: mknod d1/dc/c21 0 2024-09-20T18:35:44.343 INFO:tasks.workunit.client.1.smithi172.stdout:9/531: symlink d15/d54/lb0 0 2024-09-20T18:35:44.346 INFO:tasks.workunit.client.1.smithi172.stdout:8/515: symlink dd/d1b/d3b/d51/lb5 0 2024-09-20T18:35:44.349 INFO:tasks.workunit.client.0.smithi017.stdout:2/89: dwrite d1/f4 [4194304,4194304] 0 2024-09-20T18:35:44.349 INFO:tasks.workunit.client.1.smithi172.stdout:3/594: creat d0/fc9 x:0 0 0 2024-09-20T18:35:44.361 INFO:tasks.workunit.client.1.smithi172.stdout:3/595: symlink d0/dba/lca 0 2024-09-20T18:35:44.362 INFO:tasks.workunit.client.1.smithi172.stdout:6/477: mkdir d0/d18/d1c/d21/d26/d34/d7a/d99/d9e 0 2024-09-20T18:35:44.363 INFO:tasks.workunit.client.1.smithi172.stdout:0/700: dread d4/d1a/d28/d42/f83 [0,4194304] 0 2024-09-20T18:35:44.365 INFO:tasks.workunit.client.1.smithi172.stdout:3/596: write d0/d13/d32/d54/d83/fad [733195,77078] 0 2024-09-20T18:35:44.367 INFO:tasks.workunit.client.1.smithi172.stdout:5/543: dwrite d4/f14 [0,4194304] 0 2024-09-20T18:35:44.370 INFO:tasks.workunit.client.1.smithi172.stdout:2/484: creat d0/d2c/d3f/d17/d22/d10/d6a/d98/fa7 x:0 0 0 2024-09-20T18:35:44.370 INFO:tasks.workunit.client.1.smithi172.stdout:4/542: rename d0/de/d39/db8/d72/d18/d51/cc6 to d0/de/d39/db8/d72/ccb 0 2024-09-20T18:35:44.373 INFO:tasks.workunit.client.1.smithi172.stdout:0/701: mkdir d4/d1a/ddf/dfa 0 2024-09-20T18:35:44.377 INFO:tasks.workunit.client.1.smithi172.stdout:2/485: creat d0/d2c/d3f/d17/d22/d10/d6a/d98/d59/fa8 x:0 0 0 2024-09-20T18:35:44.380 INFO:tasks.workunit.client.1.smithi172.stdout:2/486: fdatasync d0/d2c/d3f/f4a 0 2024-09-20T18:35:44.380 INFO:tasks.workunit.client.1.smithi172.stdout:8/516: rename dd/d1b/f49 to dd/d65/fb6 0 2024-09-20T18:35:44.382 INFO:tasks.workunit.client.1.smithi172.stdout:4/543: creat d0/de/fcc x:0 0 0 2024-09-20T18:35:44.384 INFO:tasks.workunit.client.1.smithi172.stdout:1/518: dwrite d0/d8/db/fe [0,4194304] 0 2024-09-20T18:35:44.386 INFO:tasks.workunit.client.1.smithi172.stdout:9/532: dwrite d15/f1b [0,4194304] 0 2024-09-20T18:35:44.386 INFO:tasks.workunit.client.1.smithi172.stdout:1/519: chown d0/d22 347243 1 2024-09-20T18:35:44.388 INFO:tasks.workunit.client.1.smithi172.stdout:4/544: read d0/d7/d6f/f9c [1528509,124168] 0 2024-09-20T18:35:44.391 INFO:tasks.workunit.client.1.smithi172.stdout:2/487: read - d0/d2c/d3f/d17/d22/d10/d97/d9f/fa3 zero size 2024-09-20T18:35:44.393 INFO:tasks.workunit.client.0.smithi017.stdout:2/90: dwrite d1/df/d17/f1a [0,4194304] 0 2024-09-20T18:35:44.393 INFO:tasks.workunit.client.1.smithi172.stdout:4/545: stat d0/d48/d90/fbf 0 2024-09-20T18:35:44.394 INFO:tasks.workunit.client.1.smithi172.stdout:1/520: creat d0/d22/fb1 x:0 0 0 2024-09-20T18:35:44.394 INFO:tasks.workunit.client.1.smithi172.stdout:5/544: dread d4/df/dad/d26/d41/fae [0,4194304] 0 2024-09-20T18:35:44.395 INFO:tasks.workunit.client.1.smithi172.stdout:9/533: creat d15/d1f/d88/fb1 x:0 0 0 2024-09-20T18:35:44.395 INFO:tasks.workunit.client.0.smithi017.stdout:2/91: read d1/fb [2642543,104640] 0 2024-09-20T18:35:44.397 INFO:tasks.workunit.client.1.smithi172.stdout:3/597: dread d0/d13/d1e/f59 [0,4194304] 0 2024-09-20T18:35:44.397 INFO:tasks.workunit.client.1.smithi172.stdout:1/521: write d0/d8/db/d25/d2b/d3d/d65/f6a [2841441,29815] 0 2024-09-20T18:35:44.398 INFO:tasks.workunit.client.1.smithi172.stdout:8/517: link dd/d1b/d3b/d51/f8e dd/d1b/d3b/d51/d5b/d6b/fb7 0 2024-09-20T18:35:44.398 INFO:tasks.workunit.client.1.smithi172.stdout:3/598: fdatasync d0/dc/d6a/d3a/f75 0 2024-09-20T18:35:44.399 INFO:tasks.workunit.client.1.smithi172.stdout:1/522: chown d0/d22/f7a 0 1 2024-09-20T18:35:44.399 INFO:tasks.workunit.client.1.smithi172.stdout:2/488: mknod d0/d2c/d3f/d17/d18/d29/d42/d87/ca9 0 2024-09-20T18:35:44.400 INFO:tasks.workunit.client.1.smithi172.stdout:8/518: dread - dd/d1b/d3b/d51/f81 zero size 2024-09-20T18:35:44.401 INFO:tasks.workunit.client.1.smithi172.stdout:1/523: write d0/d8/f8a [910625,102591] 0 2024-09-20T18:35:44.402 INFO:tasks.workunit.client.1.smithi172.stdout:5/545: chown d4/c6 838 1 2024-09-20T18:35:44.402 INFO:tasks.workunit.client.1.smithi172.stdout:1/524: readlink d0/d8/la8 0 2024-09-20T18:35:44.403 INFO:tasks.workunit.client.1.smithi172.stdout:4/546: fdatasync d0/de/d39/db8/d72/f11 0 2024-09-20T18:35:44.403 INFO:tasks.workunit.client.1.smithi172.stdout:3/599: truncate d0/d13/d32/d54/d83/fad 1220919 0 2024-09-20T18:35:44.404 INFO:tasks.workunit.client.0.smithi017.stdout:2/92: dwrite d1/f1d [0,4194304] 0 2024-09-20T18:35:44.405 INFO:tasks.workunit.client.1.smithi172.stdout:5/546: truncate d4/df/dad/fa4 466275 0 2024-09-20T18:35:44.406 INFO:tasks.workunit.client.1.smithi172.stdout:0/702: dread d4/d1a/d28/d42/f4c [0,4194304] 0 2024-09-20T18:35:44.406 INFO:tasks.workunit.client.1.smithi172.stdout:4/547: truncate d0/d7/f25 3933390 0 2024-09-20T18:35:44.408 INFO:tasks.workunit.client.1.smithi172.stdout:2/489: mknod d0/d2c/d3f/d17/d18/d3b/caa 0 2024-09-20T18:35:44.409 INFO:tasks.workunit.client.1.smithi172.stdout:4/548: write d0/de/f5e [90609,115957] 0 2024-09-20T18:35:44.412 INFO:tasks.workunit.client.1.smithi172.stdout:2/490: dread - d0/d2c/d51/d61/f67 zero size 2024-09-20T18:35:44.412 INFO:tasks.workunit.client.1.smithi172.stdout:5/547: rmdir d4 39 2024-09-20T18:35:44.412 INFO:tasks.workunit.client.1.smithi172.stdout:1/525: dwrite d0/d8/f8a [0,4194304] 0 2024-09-20T18:35:44.414 INFO:tasks.workunit.client.1.smithi172.stdout:0/703: write d4/d44/f6e [348026,100842] 0 2024-09-20T18:35:44.416 INFO:tasks.workunit.client.1.smithi172.stdout:1/526: chown d0/d8/db/d25/d2b/f2d 55767 1 2024-09-20T18:35:44.417 INFO:tasks.workunit.client.0.smithi017.stdout:2/93: dwrite d1/df/f1e [0,4194304] 0 2024-09-20T18:35:44.418 INFO:tasks.workunit.client.1.smithi172.stdout:5/548: read d4/df/d3f/f7c [2042147,24641] 0 2024-09-20T18:35:44.418 INFO:tasks.workunit.client.1.smithi172.stdout:1/527: write d0/d8/db/d39/f64 [1039353,47690] 0 2024-09-20T18:35:44.420 INFO:tasks.workunit.client.1.smithi172.stdout:5/549: write d4/df/dad/d26/d41/d69/dac/f84 [324184,130426] 0 2024-09-20T18:35:44.421 INFO:tasks.workunit.client.0.smithi017.stdout:2/94: mkdir d1/dc/d20/d22 0 2024-09-20T18:35:44.428 INFO:tasks.workunit.client.1.smithi172.stdout:0/704: rename d4/d1a/d28/f5e to d4/d5/d2e/d38/d96/ffb 0 2024-09-20T18:35:44.429 INFO:tasks.workunit.client.1.smithi172.stdout:7/619: sync 2024-09-20T18:35:44.429 INFO:tasks.workunit.client.1.smithi172.stdout:9/534: write d15/d1f/d2c/d7d/d48/f81 [2272532,32814] 0 2024-09-20T18:35:44.431 INFO:tasks.workunit.client.1.smithi172.stdout:2/491: rename d0/d2c/d3f/d17 to d0/d2c/d3f/dab 0 2024-09-20T18:35:44.431 INFO:tasks.workunit.client.1.smithi172.stdout:7/620: write d2/d23/d51/fd5 [380413,66905] 0 2024-09-20T18:35:44.432 INFO:tasks.workunit.client.0.smithi017.stdout:2/95: fdatasync d1/f1d 0 2024-09-20T18:35:44.433 INFO:tasks.workunit.client.1.smithi172.stdout:4/549: creat d0/fcd x:0 0 0 2024-09-20T18:35:44.434 INFO:tasks.workunit.client.1.smithi172.stdout:8/519: link c4 dd/d65/cb8 0 2024-09-20T18:35:44.438 INFO:tasks.workunit.client.0.smithi017.stdout:2/96: dread d1/df/f1e [0,4194304] 0 2024-09-20T18:35:44.438 INFO:tasks.workunit.client.1.smithi172.stdout:3/600: write d0/d13/fc8 [396260,21999] 0 2024-09-20T18:35:44.438 INFO:tasks.workunit.client.1.smithi172.stdout:2/492: write d0/d2c/d3f/dab/d18/d3b/f44 [1629003,130685] 0 2024-09-20T18:35:44.439 INFO:tasks.workunit.client.1.smithi172.stdout:1/528: unlink d0/d8/db/d25/d2b/d3d/l4c 0 2024-09-20T18:35:44.439 INFO:tasks.workunit.client.1.smithi172.stdout:5/550: symlink d4/df/dad/d26/d2d/lbb 0 2024-09-20T18:35:44.440 INFO:tasks.workunit.client.0.smithi017.stdout:2/97: dread d1/f1d [0,4194304] 0 2024-09-20T18:35:44.441 INFO:tasks.workunit.client.1.smithi172.stdout:9/535: dwrite d15/d1a/f28 [0,4194304] 0 2024-09-20T18:35:44.442 INFO:tasks.workunit.client.1.smithi172.stdout:4/550: chown d0/d48/d4e/c7a 480914 1 2024-09-20T18:35:44.443 INFO:tasks.workunit.client.1.smithi172.stdout:8/520: truncate dd/d1b/d3b/d51/d5b/daf/d4d/fb3 462182 0 2024-09-20T18:35:44.444 INFO:tasks.workunit.client.1.smithi172.stdout:9/536: stat d15/d20/l71 0 2024-09-20T18:35:44.444 INFO:tasks.workunit.client.0.smithi017.stdout:2/98: mknod d1/df/c23 0 2024-09-20T18:35:44.447 INFO:tasks.workunit.client.1.smithi172.stdout:3/601: mkdir d0/dc/d6a/d3a/dcb 0 2024-09-20T18:35:44.447 INFO:tasks.workunit.client.0.smithi017.stdout:2/99: fsync d1/df/f1e 0 2024-09-20T18:35:44.448 INFO:tasks.workunit.client.1.smithi172.stdout:7/621: link d2/d3/d86/f8d d2/d3/d3d/dd4/fd7 0 2024-09-20T18:35:44.449 INFO:tasks.workunit.client.1.smithi172.stdout:4/551: write d0/de/d39/db8/d72/fbb [915470,12454] 0 2024-09-20T18:35:44.450 INFO:tasks.workunit.client.1.smithi172.stdout:2/493: rename d0/d2c/d3f/dab/d22/d10/l2b to d0/d2c/d3f/dab/d45/lac 0 2024-09-20T18:35:44.450 INFO:tasks.workunit.client.1.smithi172.stdout:6/478: sync 2024-09-20T18:35:44.450 INFO:tasks.workunit.client.1.smithi172.stdout:5/551: truncate d4/df/dad/d26/d41/d65/d8f/fa5 612062 0 2024-09-20T18:35:44.451 INFO:tasks.workunit.client.1.smithi172.stdout:8/521: creat dd/d1b/d4f/d9a/fb9 x:0 0 0 2024-09-20T18:35:44.452 INFO:tasks.workunit.client.1.smithi172.stdout:9/537: truncate d15/d1a/f91 461890 0 2024-09-20T18:35:44.452 INFO:tasks.workunit.client.0.smithi017.stdout:2/100: mknod d1/d1f/c24 0 2024-09-20T18:35:44.454 INFO:tasks.workunit.client.1.smithi172.stdout:1/529: dwrite d0/d8/db/d25/d2b/d3d/f8e [0,4194304] 0 2024-09-20T18:35:44.456 INFO:tasks.workunit.client.1.smithi172.stdout:9/538: mkdir d15/d20/db2 0 2024-09-20T18:35:44.457 INFO:tasks.workunit.client.0.smithi017.stdout:2/101: unlink d1/dc/l14 0 2024-09-20T18:35:44.458 INFO:tasks.workunit.client.1.smithi172.stdout:4/552: truncate d0/d48/d90/db4/fc1 934361 0 2024-09-20T18:35:44.458 INFO:tasks.workunit.client.1.smithi172.stdout:8/522: truncate dd/d1b/d3b/d51/f88 139696 0 2024-09-20T18:35:44.459 INFO:tasks.workunit.client.1.smithi172.stdout:9/539: chown d15/d20/f21 48132 1 2024-09-20T18:35:44.460 INFO:tasks.workunit.client.1.smithi172.stdout:1/530: readlink d0/d8/db/d25/d6f/la1 0 2024-09-20T18:35:44.460 INFO:tasks.workunit.client.1.smithi172.stdout:5/552: creat d4/df/dad/d26/d2d/fbc x:0 0 0 2024-09-20T18:35:44.462 INFO:tasks.workunit.client.1.smithi172.stdout:4/553: chown d0/d48/d90/d55/d53/f83 1320673 1 2024-09-20T18:35:44.462 INFO:tasks.workunit.client.1.smithi172.stdout:5/553: write f3 [4855685,122332] 0 2024-09-20T18:35:44.464 INFO:tasks.workunit.client.1.smithi172.stdout:2/494: rename d0/d2c/d3f/dab/d22/f79 to d0/d2c/d3f/dab/d22/d10/d35/fad 0 2024-09-20T18:35:44.467 INFO:tasks.workunit.client.1.smithi172.stdout:0/705: dread d4/d5/fb [4194304,4194304] 0 2024-09-20T18:35:44.468 INFO:tasks.workunit.client.1.smithi172.stdout:6/479: dwrite d0/d18/f54 [0,4194304] 0 2024-09-20T18:35:44.471 INFO:tasks.workunit.client.1.smithi172.stdout:9/540: creat d15/d1f/d2c/d37/fb3 x:0 0 0 2024-09-20T18:35:44.476 INFO:tasks.workunit.client.1.smithi172.stdout:1/531: rename d0/l15 to d0/d8/db/d25/d2b/lb2 0 2024-09-20T18:35:44.480 INFO:tasks.workunit.client.1.smithi172.stdout:9/541: truncate d15/f18 2539655 0 2024-09-20T18:35:44.480 INFO:tasks.workunit.client.1.smithi172.stdout:7/622: dread d2/d3/dd/f42 [0,4194304] 0 2024-09-20T18:35:44.481 INFO:tasks.workunit.client.1.smithi172.stdout:5/554: dwrite d4/df/dad/d26/d41/d65/d8f/fba [0,4194304] 0 2024-09-20T18:35:44.481 INFO:tasks.workunit.client.1.smithi172.stdout:2/495: dread d0/d2c/d3f/dab/d18/d29/d42/d4b/d53/f5b [0,4194304] 0 2024-09-20T18:35:44.483 INFO:tasks.workunit.client.1.smithi172.stdout:5/555: stat d4/df/f89 0 2024-09-20T18:35:44.483 INFO:tasks.workunit.client.0.smithi017.stdout:2/102: truncate d1/f4 4523989 0 2024-09-20T18:35:44.484 INFO:tasks.workunit.client.1.smithi172.stdout:6/480: dwrite d0/d18/d1c/d21/d26/d34/d7a/d47/f78 [0,4194304] 0 2024-09-20T18:35:44.486 INFO:tasks.workunit.client.1.smithi172.stdout:8/523: rename dd/d1b/d3b/d51/d5b/daf/d4d/f97 to dd/d1b/d3b/d51/d5b/d6b/fba 0 2024-09-20T18:35:44.491 INFO:tasks.workunit.client.1.smithi172.stdout:8/524: write f1 [4832925,91512] 0 2024-09-20T18:35:44.495 INFO:tasks.workunit.client.1.smithi172.stdout:0/706: truncate d4/d1a/d28/d42/f55 1472513 0 2024-09-20T18:35:44.499 INFO:tasks.workunit.client.1.smithi172.stdout:6/481: symlink d0/d18/d1c/l9f 0 2024-09-20T18:35:44.500 INFO:tasks.workunit.client.1.smithi172.stdout:5/556: unlink d4/df/dad/d26/d41/d69/dac/f24 0 2024-09-20T18:35:44.500 INFO:tasks.workunit.client.1.smithi172.stdout:7/623: dwrite d2/d23/d9d/fc4 [0,4194304] 0 2024-09-20T18:35:44.501 INFO:tasks.workunit.client.1.smithi172.stdout:8/525: truncate dd/d65/fa8 587460 0 2024-09-20T18:35:44.503 INFO:tasks.workunit.client.1.smithi172.stdout:4/554: dwrite d0/f32 [0,4194304] 0 2024-09-20T18:35:44.503 INFO:tasks.workunit.client.1.smithi172.stdout:9/542: dwrite d15/d1f/d2c/d7d/d34/f49 [0,4194304] 0 2024-09-20T18:35:44.504 INFO:tasks.workunit.client.1.smithi172.stdout:2/496: chown d0/d2c/d3f/dab/d22/fc 6431 1 2024-09-20T18:35:44.506 INFO:tasks.workunit.client.1.smithi172.stdout:0/707: symlink d4/d1a/d28/d73/lfc 0 2024-09-20T18:35:44.530 INFO:tasks.workunit.client.0.smithi017.stdout:2/103: write d1/f4 [517848,42168] 0 2024-09-20T18:35:44.535 INFO:tasks.workunit.client.0.smithi017.stdout:2/104: dread d1/fb [0,4194304] 0 2024-09-20T18:35:44.536 INFO:tasks.workunit.client.0.smithi017.stdout:2/105: symlink d1/df/l25 0 2024-09-20T18:35:44.538 INFO:tasks.workunit.client.0.smithi017.stdout:2/106: creat d1/dc/d20/f26 x:0 0 0 2024-09-20T18:35:44.541 INFO:tasks.workunit.client.0.smithi017.stdout:2/107: dread d1/df/f1e [0,4194304] 0 2024-09-20T18:35:44.541 INFO:tasks.workunit.client.0.smithi017.stdout:2/108: dread - d1/dc/d20/f26 zero size 2024-09-20T18:35:44.543 INFO:tasks.workunit.client.0.smithi017.stdout:2/109: chown d1/df/c18 62415416 1 2024-09-20T18:35:44.544 INFO:tasks.workunit.client.0.smithi017.stdout:2/110: symlink d1/l27 0 2024-09-20T18:35:44.546 INFO:tasks.workunit.client.0.smithi017.stdout:2/111: unlink d1/dc/ce 0 2024-09-20T18:35:44.549 INFO:tasks.workunit.client.0.smithi017.stdout:2/112: link d1/df/f1e d1/f28 0 2024-09-20T18:35:44.550 INFO:tasks.workunit.client.0.smithi017.stdout:2/113: write d1/f1d [1144163,46660] 0 2024-09-20T18:35:44.551 INFO:tasks.workunit.client.0.smithi017.stdout:2/114: stat d1/dc/d20/d22 0 2024-09-20T18:35:44.552 INFO:tasks.workunit.client.0.smithi017.stdout:2/115: fdatasync d1/df/f16 0 2024-09-20T18:35:44.553 INFO:tasks.workunit.client.0.smithi017.stdout:2/116: chown d1/df/d17/f1a 3 1 2024-09-20T18:35:44.555 INFO:tasks.workunit.client.1.smithi172.stdout:8/526: getdents dd/d1b/d3b/d51/dac 0 2024-09-20T18:35:44.556 INFO:tasks.workunit.client.1.smithi172.stdout:0/708: creat d4/d1a/d28/d42/ffd x:0 0 0 2024-09-20T18:35:44.557 INFO:tasks.workunit.client.0.smithi017.stdout:2/117: rename d1/la to d1/dc/d20/l29 0 2024-09-20T18:35:44.557 INFO:tasks.workunit.client.0.smithi017.stdout:2/118: chown d1/df 3 1 2024-09-20T18:35:44.560 INFO:tasks.workunit.client.1.smithi172.stdout:1/532: dwrite d0/d8/db/d25/d6f/f79 [0,4194304] 0 2024-09-20T18:35:44.562 INFO:tasks.workunit.client.1.smithi172.stdout:4/555: dwrite d0/d7/d6f/f79 [0,4194304] 0 2024-09-20T18:35:44.562 INFO:tasks.workunit.client.1.smithi172.stdout:6/482: dwrite d0/d18/d1c/d21/d26/d34/d6b/f84 [0,4194304] 0 2024-09-20T18:35:44.564 INFO:tasks.workunit.client.0.smithi017.stdout:2/119: symlink d1/d1f/l2a 0 2024-09-20T18:35:44.565 INFO:tasks.workunit.client.1.smithi172.stdout:8/527: chown dd/d1b/d3b/d51/d5b/daf/d91 30395986 1 2024-09-20T18:35:44.566 INFO:tasks.workunit.client.1.smithi172.stdout:5/557: dwrite d4/df/dad/d26/d41/d65/d8f/fba [0,4194304] 0 2024-09-20T18:35:44.567 INFO:tasks.workunit.client.0.smithi017.stdout:2/120: mknod d1/d1f/c2b 0 2024-09-20T18:35:44.568 INFO:tasks.workunit.client.0.smithi017.stdout:2/121: dread - d1/dc/d20/f26 zero size 2024-09-20T18:35:44.569 INFO:tasks.workunit.client.0.smithi017.stdout:2/122: stat d1/df/d17/f1a 0 2024-09-20T18:35:44.571 INFO:tasks.workunit.client.0.smithi017.stdout:2/123: symlink d1/df/d17/l2c 0 2024-09-20T18:35:44.573 INFO:tasks.workunit.client.0.smithi017.stdout:2/124: write d1/df/d17/f1a [735083,88260] 0 2024-09-20T18:35:44.574 INFO:tasks.workunit.client.1.smithi172.stdout:6/483: rmdir d0/d18/d1c/d21/d26/d34/d7a/d47 39 2024-09-20T18:35:44.576 INFO:tasks.workunit.client.1.smithi172.stdout:1/533: rename d0/d22/fab to d0/d8/db/d25/d2b/fb3 0 2024-09-20T18:35:44.578 INFO:tasks.workunit.client.1.smithi172.stdout:4/556: dwrite d0/d48/d90/d55/fa0 [0,4194304] 0 2024-09-20T18:35:44.580 INFO:tasks.workunit.client.1.smithi172.stdout:8/528: dwrite dd/d1b/d3b/d51/d5b/d6b/f8c [0,4194304] 0 2024-09-20T18:35:44.581 INFO:tasks.workunit.client.0.smithi017.stdout:2/125: creat d1/f2d x:0 0 0 2024-09-20T18:35:44.581 INFO:tasks.workunit.client.1.smithi172.stdout:9/543: dread d15/d20/d76/fa1 [0,4194304] 0 2024-09-20T18:35:44.583 INFO:tasks.workunit.client.1.smithi172.stdout:9/544: fdatasync d15/d1f/d2c/d7d/d34/faf 0 2024-09-20T18:35:44.583 INFO:tasks.workunit.client.1.smithi172.stdout:1/534: rmdir d0/d73 39 2024-09-20T18:35:44.587 INFO:tasks.workunit.client.1.smithi172.stdout:6/484: write d0/d18/d1c/d21/d26/d34/d39/d74/f95 [909533,25461] 0 2024-09-20T18:35:44.587 INFO:tasks.workunit.client.1.smithi172.stdout:3/602: sync 2024-09-20T18:35:44.589 INFO:tasks.workunit.client.0.smithi017.stdout:2/126: dwrite d1/f1d [0,4194304] 0 2024-09-20T18:35:44.589 INFO:tasks.workunit.client.1.smithi172.stdout:8/529: mkdir dd/d1b/d4f/d9a/dbb 0 2024-09-20T18:35:44.590 INFO:tasks.workunit.client.1.smithi172.stdout:2/497: write d0/d2c/d3f/dab/d22/d4c/f43 [1280353,81755] 0 2024-09-20T18:35:44.591 INFO:tasks.workunit.client.0.smithi017.stdout:2/127: chown d1/d1f 132865 1 2024-09-20T18:35:44.593 INFO:tasks.workunit.client.1.smithi172.stdout:9/545: mknod d15/d1f/d7e/cb4 0 2024-09-20T18:35:44.595 INFO:tasks.workunit.client.1.smithi172.stdout:3/603: unlink d0/d13/d1e/c6b 0 2024-09-20T18:35:44.596 INFO:tasks.workunit.client.1.smithi172.stdout:8/530: unlink dd/c44 0 2024-09-20T18:35:44.599 INFO:tasks.workunit.client.1.smithi172.stdout:8/531: fdatasync dd/d1b/d3b/d51/d5b/daf/f72 0 2024-09-20T18:35:44.599 INFO:tasks.workunit.client.1.smithi172.stdout:4/557: truncate d0/d48/d90/d55/d53/f77 1279566 0 2024-09-20T18:35:44.599 INFO:tasks.workunit.client.1.smithi172.stdout:2/498: dwrite d0/f8e [4194304,4194304] 0 2024-09-20T18:35:44.604 INFO:tasks.workunit.client.1.smithi172.stdout:4/558: creat d0/de/dc/d3c/d99/fce x:0 0 0 2024-09-20T18:35:44.606 INFO:tasks.workunit.client.1.smithi172.stdout:2/499: unlink d0/d2c/d51/d61/l8f 0 2024-09-20T18:35:44.607 INFO:tasks.workunit.client.1.smithi172.stdout:6/485: rmdir d0/d18/d1c/d21/d26/d34/d6b/d9a 0 2024-09-20T18:35:44.608 INFO:tasks.workunit.client.1.smithi172.stdout:3/604: dwrite d0/dc/d6a/d22/f99 [0,4194304] 0 2024-09-20T18:35:44.608 INFO:tasks.workunit.client.1.smithi172.stdout:2/500: write d0/d2c/d3f/f4a [1296575,13526] 0 2024-09-20T18:35:44.609 INFO:tasks.workunit.client.1.smithi172.stdout:8/532: truncate dd/d1b/d3b/d51/f35 825093 0 2024-09-20T18:35:44.610 INFO:tasks.workunit.client.1.smithi172.stdout:9/546: getdents d15/d1a/d6f/d7a 0 2024-09-20T18:35:44.611 INFO:tasks.workunit.client.1.smithi172.stdout:6/486: write d0/f36 [3207540,113484] 0 2024-09-20T18:35:44.613 INFO:tasks.workunit.client.1.smithi172.stdout:3/605: chown d0/d13/d58/d6d/d7f 326735 1 2024-09-20T18:35:44.614 INFO:tasks.workunit.client.1.smithi172.stdout:6/487: write d0/fe [4042536,46658] 0 2024-09-20T18:35:44.617 INFO:tasks.workunit.client.1.smithi172.stdout:3/606: write d0/dc/fa0 [670298,79464] 0 2024-09-20T18:35:44.618 INFO:tasks.workunit.client.1.smithi172.stdout:4/559: dwrite d0/de/f4c [0,4194304] 0 2024-09-20T18:35:44.621 INFO:tasks.workunit.client.1.smithi172.stdout:9/547: dread d15/d1f/d2c/d7d/d48/f95 [0,4194304] 0 2024-09-20T18:35:44.623 INFO:tasks.workunit.client.1.smithi172.stdout:6/488: mkdir d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0 0 2024-09-20T18:35:44.627 INFO:tasks.workunit.client.1.smithi172.stdout:3/607: link d0/d13/d32/f9b d0/dc/d6a/d3a/d74/fcc 0 2024-09-20T18:35:44.629 INFO:tasks.workunit.client.1.smithi172.stdout:4/560: getdents d0/d48/d90/db4 0 2024-09-20T18:35:44.629 INFO:tasks.workunit.client.1.smithi172.stdout:9/548: dwrite d15/d20/d76/f92 [0,4194304] 0 2024-09-20T18:35:44.630 INFO:tasks.workunit.client.1.smithi172.stdout:1/535: write d0/d8/db/d25/f91 [227928,7840] 0 2024-09-20T18:35:44.631 INFO:tasks.workunit.client.0.smithi017.stdout:2/128: write d1/df/f1e [5218586,46841] 0 2024-09-20T18:35:44.631 INFO:tasks.workunit.client.1.smithi172.stdout:4/561: fdatasync d0/d48/d90/d55/d53/fb9 0 2024-09-20T18:35:44.638 INFO:tasks.workunit.client.1.smithi172.stdout:1/536: write d0/d8/db/d25/f91 [695190,44726] 0 2024-09-20T18:35:44.642 INFO:tasks.workunit.client.1.smithi172.stdout:8/533: dread dd/d1b/f55 [0,4194304] 0 2024-09-20T18:35:44.648 INFO:tasks.workunit.client.1.smithi172.stdout:2/501: dread d0/d2c/d3f/dab/d22/d10/f21 [0,4194304] 0 2024-09-20T18:35:44.648 INFO:tasks.workunit.client.1.smithi172.stdout:6/489: dread d0/d18/d1c/f6e [0,4194304] 0 2024-09-20T18:35:44.649 INFO:tasks.workunit.client.1.smithi172.stdout:2/502: write d0/d2c/d3f/dab/d22/d10/d35/fa5 [735655,87148] 0 2024-09-20T18:35:44.668 INFO:tasks.workunit.client.1.smithi172.stdout:7/624: sync 2024-09-20T18:35:44.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:44 smithi172 ceph-mon[35456]: pgmap v26: 65 pgs: 65 active+clean; 732 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 9.9 MiB/s rd, 82 MiB/s wr, 273 op/s 2024-09-20T18:35:44.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:44 smithi172 ceph-mon[35456]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:35:44.710 INFO:tasks.workunit.client.1.smithi172.stdout:5/558: sync 2024-09-20T18:35:44.710 INFO:tasks.workunit.client.1.smithi172.stdout:0/709: sync 2024-09-20T18:35:44.714 INFO:tasks.workunit.client.1.smithi172.stdout:0/710: dread d4/d1a/d28/d42/d45/d99/dc9/fa2 [0,4194304] 0 2024-09-20T18:35:44.736 INFO:tasks.workunit.client.0.smithi017.stdout:6/25: sync 2024-09-20T18:35:44.737 INFO:tasks.workunit.client.1.smithi172.stdout:3/608: link d0/dc/f3c d0/dc/fcd 0 2024-09-20T18:35:44.738 INFO:tasks.workunit.client.1.smithi172.stdout:4/562: symlink d0/lcf 0 2024-09-20T18:35:44.740 INFO:tasks.workunit.client.0.smithi017.stdout:6/26: rename f2 to d4/f9 0 2024-09-20T18:35:44.741 INFO:tasks.workunit.client.0.smithi017.stdout:6/27: chown c1 45 1 2024-09-20T18:35:44.743 INFO:tasks.workunit.client.1.smithi172.stdout:8/534: mkdir dd/d1b/d4f/d86/dbc 0 2024-09-20T18:35:44.744 INFO:tasks.workunit.client.1.smithi172.stdout:8/535: fsync dd/d1b/d3b/d51/d34/f84 0 2024-09-20T18:35:44.745 INFO:tasks.workunit.client.1.smithi172.stdout:2/503: creat d0/d2c/d3f/dab/d22/d10/d35/d5d/fae x:0 0 0 2024-09-20T18:35:44.746 INFO:tasks.workunit.client.1.smithi172.stdout:2/504: truncate d0/d90/f95 1003114 0 2024-09-20T18:35:44.746 INFO:tasks.workunit.client.0.smithi017.stdout:6/28: link d4/f9 d4/fa 0 2024-09-20T18:35:44.747 INFO:tasks.workunit.client.1.smithi172.stdout:5/559: rmdir d4/df/dad/d26/d41/d65 39 2024-09-20T18:35:44.748 INFO:tasks.workunit.client.1.smithi172.stdout:8/536: dread dd/d1b/d3b/f5e [0,4194304] 0 2024-09-20T18:35:44.748 INFO:tasks.workunit.client.1.smithi172.stdout:7/625: dread d2/f3e [0,4194304] 0 2024-09-20T18:35:44.749 INFO:tasks.workunit.client.0.smithi017.stdout:6/29: unlink d4/f5 0 2024-09-20T18:35:44.749 INFO:tasks.workunit.client.1.smithi172.stdout:8/537: readlink dd/d1b/d3b/d51/l56 0 2024-09-20T18:35:44.752 INFO:tasks.workunit.client.1.smithi172.stdout:0/711: mkdir d4/d5/d2e/d33/de1/d15/dfe 0 2024-09-20T18:35:44.753 INFO:tasks.workunit.client.1.smithi172.stdout:2/505: dwrite d0/d2c/d3f/dab/d18/d3b/f44 [0,4194304] 0 2024-09-20T18:35:44.753 INFO:tasks.workunit.client.0.smithi017.stdout:6/30: creat d4/fb x:0 0 0 2024-09-20T18:35:44.754 INFO:tasks.workunit.client.1.smithi172.stdout:3/609: creat d0/d13/db2/fce x:0 0 0 2024-09-20T18:35:44.755 INFO:tasks.workunit.client.1.smithi172.stdout:3/610: dread - d0/d13/d9e/f92 zero size 2024-09-20T18:35:44.756 INFO:tasks.workunit.client.1.smithi172.stdout:3/611: write d0/d13/d1e/fa3 [1147136,64469] 0 2024-09-20T18:35:44.757 INFO:tasks.workunit.client.0.smithi017.stdout:6/31: write d4/fa [2108880,61701] 0 2024-09-20T18:35:44.759 INFO:tasks.workunit.client.1.smithi172.stdout:3/612: chown d0/d13/d1e/c38 4 1 2024-09-20T18:35:44.761 INFO:tasks.workunit.client.0.smithi017.stdout:6/32: dread d4/f9 [0,4194304] 0 2024-09-20T18:35:44.765 INFO:tasks.workunit.client.1.smithi172.stdout:3/613: dwrite d0/d13/d32/fbf [0,4194304] 0 2024-09-20T18:35:44.766 INFO:tasks.workunit.client.1.smithi172.stdout:3/614: fdatasync d0/f7 0 2024-09-20T18:35:44.768 INFO:tasks.workunit.client.0.smithi017.stdout:6/33: creat d4/fc x:0 0 0 2024-09-20T18:35:44.770 INFO:tasks.workunit.client.1.smithi172.stdout:8/538: chown dd/d1b/d3b/c63 738211176 1 2024-09-20T18:35:44.772 INFO:tasks.workunit.client.1.smithi172.stdout:7/626: rename d2/d3/d3d/d68/db8 to d2/d3/d10/d40/d6a/dc6/dd8 0 2024-09-20T18:35:44.773 INFO:tasks.workunit.client.1.smithi172.stdout:9/549: truncate d15/d1f/d2c/d7d/f2a 1859025 0 2024-09-20T18:35:44.775 INFO:tasks.workunit.client.1.smithi172.stdout:2/506: write d0/d2c/d3f/dab/d22/f36 [4529167,35764] 0 2024-09-20T18:35:44.775 INFO:tasks.workunit.client.1.smithi172.stdout:1/537: truncate d0/f4 5574788 0 2024-09-20T18:35:44.777 INFO:tasks.workunit.client.1.smithi172.stdout:2/507: rename d0/d2c to d0/d2c/d3f/dab/d22/d10/d3c/d7b/daf 22 2024-09-20T18:35:44.777 INFO:tasks.workunit.client.1.smithi172.stdout:6/490: write d0/d18/d1c/d21/d26/d34/d6b/d7d/f2f [2486654,52559] 0 2024-09-20T18:35:44.779 INFO:tasks.workunit.client.1.smithi172.stdout:6/491: dread - d0/d18/d1c/d21/d26/d34/d39/f64 zero size 2024-09-20T18:35:44.780 INFO:tasks.workunit.client.0.smithi017.stdout:6/34: dwrite d4/fa [0,4194304] 0 2024-09-20T18:35:44.781 INFO:tasks.workunit.client.1.smithi172.stdout:5/560: write d4/df/dad/d26/d41/d69/dac/f2b [24814,8531] 0 2024-09-20T18:35:44.783 INFO:tasks.workunit.client.1.smithi172.stdout:2/508: dwrite d0/d2c/d3f/fd [4194304,4194304] 0 2024-09-20T18:35:44.786 INFO:tasks.workunit.client.0.smithi017.stdout:6/35: rename d4/fb to d4/fd 0 2024-09-20T18:35:44.793 INFO:tasks.workunit.client.0.smithi017.stdout:6/36: rmdir d4 39 2024-09-20T18:35:44.794 INFO:tasks.workunit.client.1.smithi172.stdout:3/615: symlink d0/d13/d32/lcf 0 2024-09-20T18:35:44.796 INFO:tasks.workunit.client.0.smithi017.stdout:6/37: dread - d4/fc zero size 2024-09-20T18:35:44.798 INFO:tasks.workunit.client.1.smithi172.stdout:3/616: dread d0/d13/d1e/f46 [0,4194304] 0 2024-09-20T18:35:44.799 INFO:tasks.workunit.client.0.smithi017.stdout:6/38: dread d4/f8 [0,4194304] 0 2024-09-20T18:35:44.800 INFO:tasks.workunit.client.1.smithi172.stdout:9/550: mkdir d15/d1f/d2c/d7d/d34/db5 0 2024-09-20T18:35:44.801 INFO:tasks.workunit.client.1.smithi172.stdout:8/539: dread dd/d1b/f23 [0,4194304] 0 2024-09-20T18:35:44.802 INFO:tasks.workunit.client.0.smithi017.stdout:6/39: mknod d4/ce 0 2024-09-20T18:35:44.804 INFO:tasks.workunit.client.0.smithi017.stdout:6/40: mkdir d4/df 0 2024-09-20T18:35:44.805 INFO:tasks.workunit.client.1.smithi172.stdout:5/561: creat d4/df/dad/d26/fbd x:0 0 0 2024-09-20T18:35:44.807 INFO:tasks.workunit.client.0.smithi017.stdout:6/41: creat d4/f10 x:0 0 0 2024-09-20T18:35:44.809 INFO:tasks.workunit.client.1.smithi172.stdout:9/551: mknod d15/d1f/d7e/cb6 0 2024-09-20T18:35:44.810 INFO:tasks.workunit.client.0.smithi017.stdout:6/42: creat d4/f11 x:0 0 0 2024-09-20T18:35:44.811 INFO:tasks.workunit.client.1.smithi172.stdout:1/538: mknod d0/d8/db/d39/cb4 0 2024-09-20T18:35:44.811 INFO:tasks.workunit.client.1.smithi172.stdout:5/562: dread d4/df/f74 [0,4194304] 0 2024-09-20T18:35:44.811 INFO:tasks.workunit.client.0.smithi017.stdout:6/43: truncate d4/f10 710809 0 2024-09-20T18:35:44.813 INFO:tasks.workunit.client.1.smithi172.stdout:0/712: link d4/d1a/d28/d42/d45/le8 d4/d5/d2e/d33/de1/d15/lff 0 2024-09-20T18:35:44.814 INFO:tasks.workunit.client.0.smithi017.stdout:6/44: creat d4/f12 x:0 0 0 2024-09-20T18:35:44.815 INFO:tasks.workunit.client.1.smithi172.stdout:4/563: getdents d0/de/d39/d9f 0 2024-09-20T18:35:44.817 INFO:tasks.workunit.client.1.smithi172.stdout:6/492: mknod d0/d18/d1c/d21/d26/d34/d7a/d47/ca1 0 2024-09-20T18:35:44.817 INFO:tasks.workunit.client.1.smithi172.stdout:5/563: dwrite d4/df/dad/d26/d41/d69/dac/f7e [0,4194304] 0 2024-09-20T18:35:44.819 INFO:tasks.workunit.client.1.smithi172.stdout:6/493: dread - d0/d18/d1c/d21/d26/d34/d7a/d47/d7b/f94 zero size 2024-09-20T18:35:44.820 INFO:tasks.workunit.client.1.smithi172.stdout:3/617: symlink d0/dc/d6a/dc5/ld0 0 2024-09-20T18:35:44.821 INFO:tasks.workunit.client.1.smithi172.stdout:9/552: unlink d15/c19 0 2024-09-20T18:35:44.823 INFO:tasks.workunit.client.1.smithi172.stdout:9/553: fdatasync d15/d4a/d8c/fab 0 2024-09-20T18:35:44.823 INFO:tasks.workunit.client.1.smithi172.stdout:8/540: mkdir dd/d1b/d3b/d51/dbd 0 2024-09-20T18:35:44.823 INFO:tasks.workunit.client.1.smithi172.stdout:2/509: dwrite d0/d2c/d3f/dab/d18/f32 [0,4194304] 0 2024-09-20T18:35:44.825 INFO:tasks.workunit.client.1.smithi172.stdout:1/539: rename d0/d8/db/d25/d6f/f86 to d0/d8/db/d25/d2b/d3d/d65/d93/fb5 0 2024-09-20T18:35:44.826 INFO:tasks.workunit.client.1.smithi172.stdout:1/540: write d0/f57 [3916337,51750] 0 2024-09-20T18:35:44.829 INFO:tasks.workunit.client.1.smithi172.stdout:2/510: read d0/d2c/d3f/dab/d18/d29/f41 [368799,53854] 0 2024-09-20T18:35:44.830 INFO:tasks.workunit.client.1.smithi172.stdout:4/564: creat d0/d48/d90/d55/d53/d78/fd0 x:0 0 0 2024-09-20T18:35:44.831 INFO:tasks.workunit.client.1.smithi172.stdout:7/627: getdents d2/d23 0 2024-09-20T18:35:44.831 INFO:tasks.workunit.client.1.smithi172.stdout:6/494: fsync d0/d18/d1c/f6e 0 2024-09-20T18:35:44.835 INFO:tasks.workunit.client.1.smithi172.stdout:9/554: creat d15/d1f/d2c/d37/fb7 x:0 0 0 2024-09-20T18:35:44.836 INFO:tasks.workunit.client.1.smithi172.stdout:9/555: stat d15 0 2024-09-20T18:35:44.836 INFO:tasks.workunit.client.1.smithi172.stdout:9/556: write d15/d1f/d7e/f93 [3311914,83311] 0 2024-09-20T18:35:44.837 INFO:tasks.workunit.client.1.smithi172.stdout:9/557: dread - d15/d1f/f69 zero size 2024-09-20T18:35:44.841 INFO:tasks.workunit.client.1.smithi172.stdout:5/564: creat d4/df/dad/d26/d41/d69/dac/da7/fbe x:0 0 0 2024-09-20T18:35:44.843 INFO:tasks.workunit.client.1.smithi172.stdout:5/565: read d4/df/dad/d26/d41/d69/dac/f5d [2665256,13785] 0 2024-09-20T18:35:44.852 INFO:tasks.workunit.client.1.smithi172.stdout:2/511: creat d0/d2c/d3f/dab/d22/d10/d35/fb0 x:0 0 0 2024-09-20T18:35:44.852 INFO:tasks.workunit.client.1.smithi172.stdout:4/565: rename d0/de/d21/l97 to d0/de/dc/d3c/d99/ld1 0 2024-09-20T18:35:44.853 INFO:tasks.workunit.client.1.smithi172.stdout:8/541: creat dd/d1b/d3b/d51/dac/fbe x:0 0 0 2024-09-20T18:35:44.854 INFO:tasks.workunit.client.1.smithi172.stdout:0/713: truncate d4/d5/d2e/d38/d96/f9f 230322 0 2024-09-20T18:35:44.855 INFO:tasks.workunit.client.1.smithi172.stdout:3/618: truncate d0/d13/d32/f8a 2702233 0 2024-09-20T18:35:44.858 INFO:tasks.workunit.client.1.smithi172.stdout:9/558: write f12 [1791684,39819] 0 2024-09-20T18:35:44.860 INFO:tasks.workunit.client.1.smithi172.stdout:5/566: creat d4/df/dad/d26/d41/d69/db9/fbf x:0 0 0 2024-09-20T18:35:44.861 INFO:tasks.workunit.client.1.smithi172.stdout:0/714: creat d4/d5/d2e/d38/d96/f100 x:0 0 0 2024-09-20T18:35:44.863 INFO:tasks.workunit.client.1.smithi172.stdout:2/512: symlink d0/d2c/d3f/dab/d22/lb1 0 2024-09-20T18:35:44.865 INFO:tasks.workunit.client.1.smithi172.stdout:1/541: getdents d0/d8/d12 0 2024-09-20T18:35:44.866 INFO:tasks.workunit.client.1.smithi172.stdout:4/566: dread d0/fa [0,4194304] 0 2024-09-20T18:35:44.866 INFO:tasks.workunit.client.1.smithi172.stdout:3/619: dwrite d0/dc/d6a/f3e [4194304,4194304] 0 2024-09-20T18:35:44.868 INFO:tasks.workunit.client.1.smithi172.stdout:0/715: creat d4/d5/d2e/d38/f101 x:0 0 0 2024-09-20T18:35:44.871 INFO:tasks.workunit.client.1.smithi172.stdout:5/567: write d4/df/dad/d26/d41/d69/dac/f7e [2644194,42161] 0 2024-09-20T18:35:44.871 INFO:tasks.workunit.client.1.smithi172.stdout:1/542: fdatasync d0/f59 0 2024-09-20T18:35:44.873 INFO:tasks.workunit.client.1.smithi172.stdout:6/495: dread d0/fc [4194304,4194304] 0 2024-09-20T18:35:44.874 INFO:tasks.workunit.client.1.smithi172.stdout:3/620: readlink d0/d13/d32/d54/d71/la4 0 2024-09-20T18:35:44.876 INFO:tasks.workunit.client.1.smithi172.stdout:9/559: dwrite d15/d1f/d2c/d7d/d48/f79 [0,4194304] 0 2024-09-20T18:35:44.877 INFO:tasks.workunit.client.1.smithi172.stdout:4/567: mkdir d0/d48/d90/d55/d53/d78/dd2 0 2024-09-20T18:35:44.881 INFO:tasks.workunit.client.1.smithi172.stdout:6/496: stat d0/d18/d1c/d21/d26/d34/d7a/d47/d62/l6f 0 2024-09-20T18:35:44.882 INFO:tasks.workunit.client.1.smithi172.stdout:8/542: dwrite dd/d1b/d3b/d51/d5b/daf/f4b [0,4194304] 0 2024-09-20T18:35:44.882 INFO:tasks.workunit.client.1.smithi172.stdout:4/568: read d0/d48/d90/d55/f3e [530023,98495] 0 2024-09-20T18:35:44.882 INFO:tasks.workunit.client.1.smithi172.stdout:0/716: getdents d4/d5 0 2024-09-20T18:35:44.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:44 smithi017 ceph-mon[28058]: pgmap v26: 65 pgs: 65 active+clean; 732 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 9.9 MiB/s rd, 82 MiB/s wr, 273 op/s 2024-09-20T18:35:44.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:44 smithi017 ceph-mon[28058]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:35:44.926 INFO:tasks.workunit.client.1.smithi172.stdout:1/543: write d0/d22/f28 [2230039,66418] 0 2024-09-20T18:35:44.927 INFO:tasks.workunit.client.1.smithi172.stdout:5/568: dread d4/df/d3f/f7c [0,4194304] 0 2024-09-20T18:35:44.928 INFO:tasks.workunit.client.1.smithi172.stdout:8/543: write dd/d1b/d3b/d51/d5b/daf/d91/fb1 [980652,61432] 0 2024-09-20T18:35:44.928 INFO:tasks.workunit.client.1.smithi172.stdout:3/621: link d0/dc/d6a/d3a/f3f d0/dc/fd1 0 2024-09-20T18:35:44.931 INFO:tasks.workunit.client.1.smithi172.stdout:5/569: creat d4/df/fc0 x:0 0 0 2024-09-20T18:35:44.931 INFO:tasks.workunit.client.1.smithi172.stdout:0/717: mkdir d4/d5/d2e/d33/de1/d15/dfe/d102 0 2024-09-20T18:35:44.934 INFO:tasks.workunit.client.1.smithi172.stdout:5/570: creat d4/df/d98/fc1 x:0 0 0 2024-09-20T18:35:44.934 INFO:tasks.workunit.client.1.smithi172.stdout:8/544: getdents dd/d1b/d3b/d51/dbd 0 2024-09-20T18:35:44.935 INFO:tasks.workunit.client.1.smithi172.stdout:3/622: rename d0/d13/d32/d54/d71/fa7 to d0/dc/d6a/d76/fd2 0 2024-09-20T18:35:44.936 INFO:tasks.workunit.client.1.smithi172.stdout:0/718: mkdir d4/d5/d2e/d67/d8c/d103 0 2024-09-20T18:35:44.936 INFO:tasks.workunit.client.1.smithi172.stdout:4/569: dwrite d0/de/d21/d24/f2d [0,4194304] 0 2024-09-20T18:35:44.938 INFO:tasks.workunit.client.1.smithi172.stdout:5/571: chown d4/df/dad/faf 310102 1 2024-09-20T18:35:44.938 INFO:tasks.workunit.client.1.smithi172.stdout:8/545: dread - dd/d1b/d3b/d51/f89 zero size 2024-09-20T18:35:44.940 INFO:tasks.workunit.client.1.smithi172.stdout:1/544: dwrite d0/d8/db/d25/d6d/f7e [0,4194304] 0 2024-09-20T18:35:44.940 INFO:tasks.workunit.client.1.smithi172.stdout:4/570: chown d0/de/d39/f8a 607 1 2024-09-20T18:35:44.941 INFO:tasks.workunit.client.1.smithi172.stdout:0/719: creat d4/d1a/d28/d9d/f104 x:0 0 0 2024-09-20T18:35:44.943 INFO:tasks.workunit.client.1.smithi172.stdout:1/545: chown d0/d73/l67 153833 1 2024-09-20T18:35:44.943 INFO:tasks.workunit.client.1.smithi172.stdout:0/720: write d4/d1a/d28/d42/ffd [777660,29256] 0 2024-09-20T18:35:44.944 INFO:tasks.workunit.client.1.smithi172.stdout:5/572: mknod d4/df/dad/d26/d2d/d86/cc2 0 2024-09-20T18:35:44.945 INFO:tasks.workunit.client.1.smithi172.stdout:3/623: dread d0/d13/fc8 [0,4194304] 0 2024-09-20T18:35:44.946 INFO:tasks.workunit.client.1.smithi172.stdout:8/546: unlink dd/d1b/d3b/d51/d5b/d6b/l8a 0 2024-09-20T18:35:44.946 INFO:tasks.workunit.client.1.smithi172.stdout:0/721: read - d4/d5/d2e/d33/de1/f59 zero size 2024-09-20T18:35:44.948 INFO:tasks.workunit.client.1.smithi172.stdout:1/546: mkdir d0/d8/db/d25/d2b/db6 0 2024-09-20T18:35:44.951 INFO:tasks.workunit.client.1.smithi172.stdout:3/624: symlink d0/d13/d32/d54/d83/ld3 0 2024-09-20T18:35:44.951 INFO:tasks.workunit.client.1.smithi172.stdout:4/571: dwrite d0/de/d21/fc4 [0,4194304] 0 2024-09-20T18:35:44.952 INFO:tasks.workunit.client.1.smithi172.stdout:0/722: symlink d4/d1a/d28/d42/l105 0 2024-09-20T18:35:44.954 INFO:tasks.workunit.client.1.smithi172.stdout:0/723: chown d4/d5/d2e/d33/lc3 154560 1 2024-09-20T18:35:44.954 INFO:tasks.workunit.client.1.smithi172.stdout:3/625: chown d0/dc/d6a/d76/fa2 5 1 2024-09-20T18:35:44.954 INFO:tasks.workunit.client.1.smithi172.stdout:7/628: sync 2024-09-20T18:35:44.954 INFO:tasks.workunit.client.1.smithi172.stdout:5/573: symlink d4/df/dad/d26/d41/d65/d8f/lc3 0 2024-09-20T18:35:44.954 INFO:tasks.workunit.client.1.smithi172.stdout:1/547: unlink d0/d8/d12/c81 0 2024-09-20T18:35:44.956 INFO:tasks.workunit.client.1.smithi172.stdout:4/572: mknod d0/d7/d6f/cd3 0 2024-09-20T18:35:44.961 INFO:tasks.workunit.client.1.smithi172.stdout:4/573: rename d0/d48 to d0/d48/d90/d55/d53/d78/dd4 22 2024-09-20T18:35:44.962 INFO:tasks.workunit.client.1.smithi172.stdout:8/547: dwrite dd/d1b/d3b/d51/d5b/daf/d4d/f8f [0,4194304] 0 2024-09-20T18:35:44.964 INFO:tasks.workunit.client.1.smithi172.stdout:0/724: mkdir d4/d1a/d28/d42/d45/dd1/d106 0 2024-09-20T18:35:44.964 INFO:tasks.workunit.client.1.smithi172.stdout:5/574: mknod d4/df/dad/d26/d41/d69/dac/cc4 0 2024-09-20T18:35:44.966 INFO:tasks.workunit.client.1.smithi172.stdout:4/574: unlink d0/de/d39/f8a 0 2024-09-20T18:35:44.967 INFO:tasks.workunit.client.1.smithi172.stdout:3/626: getdents d0/dc/d6a/d22 0 2024-09-20T18:35:44.967 INFO:tasks.workunit.client.1.smithi172.stdout:5/575: rmdir d4/df/dad/d26 39 2024-09-20T18:35:44.968 INFO:tasks.workunit.client.1.smithi172.stdout:0/725: rmdir d4/d1a/d28/d42/d45/d99/dc9 39 2024-09-20T18:35:44.971 INFO:tasks.workunit.client.1.smithi172.stdout:4/575: rename d0/c2 to d0/de/dc/cd5 0 2024-09-20T18:35:44.975 INFO:tasks.workunit.client.1.smithi172.stdout:5/576: dread d4/df/dad/d26/d41/d69/dac/f6d [0,4194304] 0 2024-09-20T18:35:44.975 INFO:tasks.workunit.client.1.smithi172.stdout:3/627: dwrite d0/dc/d6a/d3a/d74/fa5 [0,4194304] 0 2024-09-20T18:35:44.978 INFO:tasks.workunit.client.1.smithi172.stdout:0/726: mkdir d4/d1a/d28/d42/d45/d99/dc9/d107 0 2024-09-20T18:35:44.978 INFO:tasks.workunit.client.1.smithi172.stdout:3/628: dread - d0/d13/d9e/f92 zero size 2024-09-20T18:35:44.980 INFO:tasks.workunit.client.1.smithi172.stdout:5/577: dread - d4/df/dad/d26/d41/d69/dac/d2c/f8b zero size 2024-09-20T18:35:44.982 INFO:tasks.workunit.client.1.smithi172.stdout:0/727: stat d4/d1a/d28/d75/c3c 0 2024-09-20T18:35:44.983 INFO:tasks.workunit.client.1.smithi172.stdout:4/576: dread d0/f2a [0,4194304] 0 2024-09-20T18:35:44.986 INFO:tasks.workunit.client.1.smithi172.stdout:4/577: write d0/de/fac [66404,34583] 0 2024-09-20T18:35:44.986 INFO:tasks.workunit.client.1.smithi172.stdout:3/629: mknod d0/d13/d32/d54/d83/dbb/cd4 0 2024-09-20T18:35:44.987 INFO:tasks.workunit.client.1.smithi172.stdout:7/629: dwrite d2/d23/f24 [0,4194304] 0 2024-09-20T18:35:44.987 INFO:tasks.workunit.client.1.smithi172.stdout:4/578: readlink d0/de/l44 0 2024-09-20T18:35:44.988 INFO:tasks.workunit.client.1.smithi172.stdout:5/578: rename d4/f5a to d4/df/dad/d26/d41/d65/d8f/fc5 0 2024-09-20T18:35:44.989 INFO:tasks.workunit.client.1.smithi172.stdout:4/579: read - d0/d7/fba zero size 2024-09-20T18:35:44.989 INFO:tasks.workunit.client.1.smithi172.stdout:3/630: rmdir d0/d13/d32/d88 39 2024-09-20T18:35:44.990 INFO:tasks.workunit.client.1.smithi172.stdout:7/630: rmdir d2/d23/d3a 39 2024-09-20T18:35:44.991 INFO:tasks.workunit.client.0.smithi017.stdout:5/28: sync 2024-09-20T18:35:44.992 INFO:tasks.workunit.client.1.smithi172.stdout:5/579: rmdir d4/df/dad/d26/d41/d69/db9 39 2024-09-20T18:35:44.992 INFO:tasks.workunit.client.1.smithi172.stdout:4/580: write d0/d7/fba [534237,13792] 0 2024-09-20T18:35:44.993 INFO:tasks.workunit.client.1.smithi172.stdout:1/548: dread d0/d8/d12/f29 [0,4194304] 0 2024-09-20T18:35:44.993 INFO:tasks.workunit.client.1.smithi172.stdout:7/631: chown d2/d3/d3d/faf 0 1 2024-09-20T18:35:44.995 INFO:tasks.workunit.client.0.smithi017.stdout:5/29: getdents d0 0 2024-09-20T18:35:44.997 INFO:tasks.workunit.client.1.smithi172.stdout:5/580: write d4/df/dad/d26/d41/d69/f6e [2021234,69775] 0 2024-09-20T18:35:44.998 INFO:tasks.workunit.client.1.smithi172.stdout:5/581: chown d4/df/d3f/f61 2657 1 2024-09-20T18:35:45.000 INFO:tasks.workunit.client.1.smithi172.stdout:0/728: dread d4/d5/d2e/d33/f6b [0,4194304] 0 2024-09-20T18:35:45.003 INFO:tasks.workunit.client.1.smithi172.stdout:3/631: truncate d0/dc/d6a/d3a/f75 340687 0 2024-09-20T18:35:45.004 INFO:tasks.workunit.client.1.smithi172.stdout:4/581: dwrite d0/de/dc/d3c/f5f [0,4194304] 0 2024-09-20T18:35:45.004 INFO:tasks.workunit.client.1.smithi172.stdout:5/582: write d4/df/dad/d26/d41/d69/dac/da7/fbe [862596,10715] 0 2024-09-20T18:35:45.005 INFO:tasks.workunit.client.0.smithi017.stdout:5/30: link d0/f6 d0/fa 0 2024-09-20T18:35:45.007 INFO:tasks.workunit.client.1.smithi172.stdout:1/549: dwrite d0/d8/db/f1b [4194304,4194304] 0 2024-09-20T18:35:45.009 INFO:tasks.workunit.client.1.smithi172.stdout:7/632: rename d2/d23/d3c/f58 to d2/d3/d10/d40/fd9 0 2024-09-20T18:35:45.009 INFO:tasks.workunit.client.0.smithi017.stdout:5/31: dread d0/fa [0,4194304] 0 2024-09-20T18:35:45.011 INFO:tasks.workunit.client.1.smithi172.stdout:7/633: chown d2/d3/fb 119 1 2024-09-20T18:35:45.014 INFO:tasks.workunit.client.1.smithi172.stdout:5/583: unlink d4/f23 0 2024-09-20T18:35:45.017 INFO:tasks.workunit.client.1.smithi172.stdout:0/729: creat d4/d1a/d28/d42/db8/dcd/dce/f108 x:0 0 0 2024-09-20T18:35:45.020 INFO:tasks.workunit.client.1.smithi172.stdout:5/584: dwrite d4/df/dad/d26/d2d/d86/f88 [0,4194304] 0 2024-09-20T18:35:45.022 INFO:tasks.workunit.client.1.smithi172.stdout:5/585: stat d4/df/dad/d26/d41/d69/dac/d2c/c90 0 2024-09-20T18:35:45.024 INFO:tasks.workunit.client.1.smithi172.stdout:3/632: mknod d0/d13/d32/d88/cd5 0 2024-09-20T18:35:45.025 INFO:tasks.workunit.client.1.smithi172.stdout:1/550: mkdir d0/d8/db/d25/db7 0 2024-09-20T18:35:45.027 INFO:tasks.workunit.client.1.smithi172.stdout:1/551: stat d0/d8/d12/c13 0 2024-09-20T18:35:45.028 INFO:tasks.workunit.client.1.smithi172.stdout:1/552: write d0/d22/f9c [1094253,85041] 0 2024-09-20T18:35:45.030 INFO:tasks.workunit.client.1.smithi172.stdout:3/633: mkdir d0/d13/d58/d6d/db9/dd6 0 2024-09-20T18:35:45.032 INFO:tasks.workunit.client.1.smithi172.stdout:3/634: write d0/dc/d6a/f50 [1323203,62920] 0 2024-09-20T18:35:45.033 INFO:tasks.workunit.client.1.smithi172.stdout:1/553: unlink d0/f57 0 2024-09-20T18:35:45.033 INFO:tasks.workunit.client.1.smithi172.stdout:4/582: getdents d0/de/d39/db8/d72/d18 0 2024-09-20T18:35:45.035 INFO:tasks.workunit.client.1.smithi172.stdout:7/634: dwrite d2/f4a [4194304,4194304] 0 2024-09-20T18:35:45.036 INFO:tasks.workunit.client.1.smithi172.stdout:0/730: rename d4/d1a/d28/d75/d60/dba/lf3 to d4/d5/d2e/l109 0 2024-09-20T18:35:45.039 INFO:tasks.workunit.client.1.smithi172.stdout:0/731: truncate d4/d1a/d28/d75/d60/fa3 205855 0 2024-09-20T18:35:45.039 INFO:tasks.workunit.client.1.smithi172.stdout:4/583: write d0/de/d21/d24/fa7 [1561222,30331] 0 2024-09-20T18:35:45.041 INFO:tasks.workunit.client.1.smithi172.stdout:0/732: write d4/d5/d2e/d67/d8c/fa5 [309266,40595] 0 2024-09-20T18:35:45.041 INFO:tasks.workunit.client.1.smithi172.stdout:7/635: mkdir d2/d3/d10/d40/d46/d8e/dbd/dda 0 2024-09-20T18:35:45.041 INFO:tasks.workunit.client.1.smithi172.stdout:4/584: fsync d0/de/d39/db8/d72/d18/d51/d9a/fab 0 2024-09-20T18:35:45.047 INFO:tasks.workunit.client.1.smithi172.stdout:3/635: link d0/dc/d6a/d22/f7a d0/dc/d6a/d3a/dcb/fd7 0 2024-09-20T18:35:45.051 INFO:tasks.workunit.client.1.smithi172.stdout:2/513: sync 2024-09-20T18:35:45.054 INFO:tasks.workunit.client.1.smithi172.stdout:2/514: stat d0/d1a 0 2024-09-20T18:35:45.056 INFO:tasks.workunit.client.1.smithi172.stdout:7/636: dwrite d2/d3/d10/faa [0,4194304] 0 2024-09-20T18:35:45.056 INFO:tasks.workunit.client.1.smithi172.stdout:0/733: dwrite d4/d1a/d28/d42/d45/d54/fea [0,4194304] 0 2024-09-20T18:35:45.060 INFO:tasks.workunit.client.1.smithi172.stdout:4/585: dwrite d0/de/d39/db8/d72/d18/d51/d9a/fab [0,4194304] 0 2024-09-20T18:35:45.068 INFO:tasks.workunit.client.1.smithi172.stdout:3/636: dwrite d0/dc/f28 [0,4194304] 0 2024-09-20T18:35:45.072 INFO:tasks.workunit.client.1.smithi172.stdout:5/586: dwrite d4/df/dad/f4a [0,4194304] 0 2024-09-20T18:35:45.075 INFO:tasks.workunit.client.1.smithi172.stdout:4/586: creat d0/d48/d90/d55/d53/d78/dd2/fd6 x:0 0 0 2024-09-20T18:35:45.078 INFO:tasks.workunit.client.1.smithi172.stdout:9/560: sync 2024-09-20T18:35:45.078 INFO:tasks.workunit.client.1.smithi172.stdout:6/497: sync 2024-09-20T18:35:45.080 INFO:tasks.workunit.client.1.smithi172.stdout:1/554: dwrite d0/d8/db/d39/f42 [0,4194304] 0 2024-09-20T18:35:45.081 INFO:tasks.workunit.client.1.smithi172.stdout:5/587: dread - d4/df/dad/d26/fbd zero size 2024-09-20T18:35:45.083 INFO:tasks.workunit.client.1.smithi172.stdout:7/637: dwrite d2/d3/fa7 [0,4194304] 0 2024-09-20T18:35:45.086 INFO:tasks.workunit.client.1.smithi172.stdout:6/498: mkdir d0/d18/d1c/d21/d26/d34/da2 0 2024-09-20T18:35:45.087 INFO:tasks.workunit.client.1.smithi172.stdout:3/637: dwrite d0/dc/d6a/d3a/fb3 [0,4194304] 0 2024-09-20T18:35:45.088 INFO:tasks.workunit.client.1.smithi172.stdout:5/588: symlink d4/df/dad/d26/d41/d65/lc6 0 2024-09-20T18:35:45.090 INFO:tasks.workunit.client.1.smithi172.stdout:7/638: truncate d2/f91 1010 0 2024-09-20T18:35:45.093 INFO:tasks.workunit.client.1.smithi172.stdout:7/639: write d2/d3/d10/d40/d6a/fb4 [541871,1444] 0 2024-09-20T18:35:45.096 INFO:tasks.workunit.client.1.smithi172.stdout:6/499: symlink d0/d18/d1c/d21/d26/d34/da2/la3 0 2024-09-20T18:35:45.097 INFO:tasks.workunit.client.1.smithi172.stdout:2/515: write d0/d2c/d3f/dab/d22/f38 [39645,41895] 0 2024-09-20T18:35:45.097 INFO:tasks.workunit.client.1.smithi172.stdout:5/589: creat d4/df/dad/d26/d2d/d63/fc7 x:0 0 0 2024-09-20T18:35:45.099 INFO:tasks.workunit.client.1.smithi172.stdout:3/638: rename d0/dba/lca to d0/dc/ld8 0 2024-09-20T18:35:45.101 INFO:tasks.workunit.client.1.smithi172.stdout:4/587: truncate d0/f63 2026405 0 2024-09-20T18:35:45.102 INFO:tasks.workunit.client.1.smithi172.stdout:0/734: dwrite d4/f18 [0,4194304] 0 2024-09-20T18:35:45.104 INFO:tasks.workunit.client.1.smithi172.stdout:6/500: creat d0/d18/d1c/d21/d26/d34/d7a/d99/fa4 x:0 0 0 2024-09-20T18:35:45.109 INFO:tasks.workunit.client.1.smithi172.stdout:0/735: dread - d4/d20/fec zero size 2024-09-20T18:35:45.109 INFO:tasks.workunit.client.1.smithi172.stdout:4/588: read d0/d48/d90/f37 [1994211,38251] 0 2024-09-20T18:35:45.111 INFO:tasks.workunit.client.1.smithi172.stdout:5/590: getdents d4/df/dad/d26/d41/d65/d8f 0 2024-09-20T18:35:45.113 INFO:tasks.workunit.client.1.smithi172.stdout:9/561: dread d15/d1f/d2c/d7d/d48/f66 [0,4194304] 0 2024-09-20T18:35:45.114 INFO:tasks.workunit.client.1.smithi172.stdout:3/639: dwrite d0/d13/f1c [0,4194304] 0 2024-09-20T18:35:45.114 INFO:tasks.workunit.client.1.smithi172.stdout:4/589: chown d0/f63 7002 1 2024-09-20T18:35:45.116 INFO:tasks.workunit.client.1.smithi172.stdout:4/590: fsync d0/de/dc/d3c/f5f 0 2024-09-20T18:35:45.117 INFO:tasks.workunit.client.1.smithi172.stdout:0/736: rename d4/d44/dab/cb6 to d4/d1a/d28/d42/db8/c10a 0 2024-09-20T18:35:45.119 INFO:tasks.workunit.client.1.smithi172.stdout:9/562: mkdir d15/d1f/d2c/d37/db8 0 2024-09-20T18:35:45.128 INFO:tasks.workunit.client.1.smithi172.stdout:3/640: mkdir d0/d13/d58/d6d/d7f/d84/dd9 0 2024-09-20T18:35:45.129 INFO:tasks.workunit.client.1.smithi172.stdout:0/737: creat d4/d5/d2e/d38/d96/f10b x:0 0 0 2024-09-20T18:35:45.129 INFO:tasks.workunit.client.1.smithi172.stdout:4/591: rename d0/d48/d90/d55/d53/f9e to d0/de/dc/fd7 0 2024-09-20T18:35:45.130 INFO:tasks.workunit.client.1.smithi172.stdout:7/640: truncate d2/d3/d10/d40/d46/fa8 195781 0 2024-09-20T18:35:45.131 INFO:tasks.workunit.client.1.smithi172.stdout:7/641: readlink d2/d3/d10/d40/l89 0 2024-09-20T18:35:45.131 INFO:tasks.workunit.client.1.smithi172.stdout:0/738: write d4/d1a/d28/d42/db8/dcd/dce/f108 [840919,104671] 0 2024-09-20T18:35:45.131 INFO:tasks.workunit.client.1.smithi172.stdout:7/642: chown d2/f4a 32502 1 2024-09-20T18:35:45.133 INFO:tasks.workunit.client.1.smithi172.stdout:2/516: truncate d0/d2c/d3f/dab/d22/d10/d35/fad 202224 0 2024-09-20T18:35:45.138 INFO:tasks.workunit.client.1.smithi172.stdout:5/591: dwrite d4/df/dad/f57 [0,4194304] 0 2024-09-20T18:35:45.139 INFO:tasks.workunit.client.1.smithi172.stdout:6/501: dread d0/d18/d1c/d21/d26/f45 [4194304,4194304] 0 2024-09-20T18:35:45.139 INFO:tasks.workunit.client.1.smithi172.stdout:6/502: dread - d0/d18/d1c/d21/f88 zero size 2024-09-20T18:35:45.140 INFO:tasks.workunit.client.1.smithi172.stdout:6/503: chown d0/d18/d1c/l5c 1 1 2024-09-20T18:35:45.140 INFO:tasks.workunit.client.1.smithi172.stdout:9/563: rename d15/d1f/d2c/d6e/f9a to d15/d1f/d2c/d37/fb9 0 2024-09-20T18:35:45.141 INFO:tasks.workunit.client.1.smithi172.stdout:3/641: symlink d0/d13/d58/d6d/d7f/lda 0 2024-09-20T18:35:45.142 INFO:tasks.workunit.client.1.smithi172.stdout:3/642: stat d0/dc 0 2024-09-20T18:35:45.142 INFO:tasks.workunit.client.1.smithi172.stdout:0/739: unlink d4/d5/d2e/d38/f101 0 2024-09-20T18:35:45.144 INFO:tasks.workunit.client.1.smithi172.stdout:2/517: write d0/d2c/d3f/dab/d22/d10/d35/d5d/f5f [3993205,80253] 0 2024-09-20T18:35:45.144 INFO:tasks.workunit.client.1.smithi172.stdout:6/504: read d0/fe [5258978,82340] 0 2024-09-20T18:35:45.144 INFO:tasks.workunit.client.1.smithi172.stdout:0/740: fsync d4/d5/d2e/d76/ff5 0 2024-09-20T18:35:45.145 INFO:tasks.workunit.client.1.smithi172.stdout:6/505: write d0/d18/f29 [1498691,99212] 0 2024-09-20T18:35:45.146 INFO:tasks.workunit.client.1.smithi172.stdout:2/518: chown d0/d2c/d51/d61/f67 18 1 2024-09-20T18:35:45.147 INFO:tasks.workunit.client.1.smithi172.stdout:7/643: mkdir d2/d23/d9d/ddb 0 2024-09-20T18:35:45.148 INFO:tasks.workunit.client.1.smithi172.stdout:9/564: creat d15/d1f/d2c/d7d/d48/fba x:0 0 0 2024-09-20T18:35:45.148 INFO:tasks.workunit.client.1.smithi172.stdout:7/644: fdatasync d2/d3/d10/d40/d6a/fb4 0 2024-09-20T18:35:45.149 INFO:tasks.workunit.client.1.smithi172.stdout:3/643: mkdir d0/d13/d1e/ddb 0 2024-09-20T18:35:45.149 INFO:tasks.workunit.client.1.smithi172.stdout:3/644: stat d0/l7e 0 2024-09-20T18:35:45.152 INFO:tasks.workunit.client.0.smithi017.stdout:8/33: sync 2024-09-20T18:35:45.152 INFO:tasks.workunit.client.0.smithi017.stdout:4/32: sync 2024-09-20T18:35:45.156 INFO:tasks.workunit.client.0.smithi017.stdout:4/33: mkdir d4/de 0 2024-09-20T18:35:45.161 INFO:tasks.workunit.client.0.smithi017.stdout:8/34: creat d0/d6/fe x:0 0 0 2024-09-20T18:35:45.162 INFO:tasks.workunit.client.0.smithi017.stdout:4/34: dwrite f0 [0,4194304] 0 2024-09-20T18:35:45.165 INFO:tasks.workunit.client.0.smithi017.stdout:4/35: mkdir d4/de/df 0 2024-09-20T18:35:45.168 INFO:tasks.workunit.client.1.smithi172.stdout:8/548: sync 2024-09-20T18:35:45.170 INFO:tasks.workunit.client.0.smithi017.stdout:8/35: dwrite d0/f7 [0,4194304] 0 2024-09-20T18:35:45.172 INFO:tasks.workunit.client.0.smithi017.stdout:4/36: mkdir d4/d10 0 2024-09-20T18:35:45.173 INFO:tasks.workunit.client.0.smithi017.stdout:8/36: mknod d0/cf 0 2024-09-20T18:35:45.175 INFO:tasks.workunit.client.0.smithi017.stdout:8/37: truncate d0/fc 511462 0 2024-09-20T18:35:45.175 INFO:tasks.workunit.client.0.smithi017.stdout:4/37: creat d4/f11 x:0 0 0 2024-09-20T18:35:45.176 INFO:tasks.workunit.client.0.smithi017.stdout:8/38: chown d0/l5 1122120 1 2024-09-20T18:35:45.176 INFO:tasks.workunit.client.0.smithi017.stdout:4/38: write d4/fa [481699,45350] 0 2024-09-20T18:35:45.177 INFO:tasks.workunit.client.0.smithi017.stdout:4/39: write d4/f7 [453132,4691] 0 2024-09-20T18:35:45.184 INFO:tasks.workunit.client.0.smithi017.stdout:4/40: creat d4/dc/f12 x:0 0 0 2024-09-20T18:35:45.188 INFO:tasks.workunit.client.1.smithi172.stdout:0/741: rename d4/d1a/ddf/dfa to d4/d5/d2e/d33/de1/d15/dfe/d10c 0 2024-09-20T18:35:45.190 INFO:tasks.workunit.client.1.smithi172.stdout:6/506: dwrite d0/d18/d1c/d21/d26/d34/d7a/d47/d62/f8f [0,4194304] 0 2024-09-20T18:35:45.191 INFO:tasks.workunit.client.1.smithi172.stdout:7/645: truncate d2/d3/d3d/f7f 1430400 0 2024-09-20T18:35:45.191 INFO:tasks.workunit.client.1.smithi172.stdout:4/592: write d0/f63 [2712715,8672] 0 2024-09-20T18:35:45.191 INFO:tasks.workunit.client.1.smithi172.stdout:3/645: creat d0/d13/db2/fdc x:0 0 0 2024-09-20T18:35:45.193 INFO:tasks.workunit.client.1.smithi172.stdout:0/742: unlink d4/d5/d2e/d67/f9e 0 2024-09-20T18:35:45.194 INFO:tasks.workunit.client.1.smithi172.stdout:5/592: getdents d4/df/dad 0 2024-09-20T18:35:45.195 INFO:tasks.workunit.client.1.smithi172.stdout:3/646: chown d0/dc/d6a/c47 1765 1 2024-09-20T18:35:45.196 INFO:tasks.workunit.client.1.smithi172.stdout:9/565: creat d15/d1a/fbb x:0 0 0 2024-09-20T18:35:45.197 INFO:tasks.workunit.client.1.smithi172.stdout:8/549: creat dd/d1b/d4f/d86/dbc/fbf x:0 0 0 2024-09-20T18:35:45.197 INFO:tasks.workunit.client.1.smithi172.stdout:5/593: read - d4/df/dad/d26/d41/d69/f9d zero size 2024-09-20T18:35:45.197 INFO:tasks.workunit.client.0.smithi017.stdout:8/39: truncate d0/fa 2790567 0 2024-09-20T18:35:45.198 INFO:tasks.workunit.client.1.smithi172.stdout:5/594: chown d4/df/dad/d26/d2d/lbb 489 1 2024-09-20T18:35:45.198 INFO:tasks.workunit.client.1.smithi172.stdout:8/550: dread dd/d1b/d3b/d51/f88 [0,4194304] 0 2024-09-20T18:35:45.199 INFO:tasks.workunit.client.0.smithi017.stdout:4/41: write f3 [1525580,13923] 0 2024-09-20T18:35:45.200 INFO:tasks.workunit.client.1.smithi172.stdout:8/551: chown dd/d1b/d3b/d5d/d7d/f9c 91 1 2024-09-20T18:35:45.200 INFO:tasks.workunit.client.0.smithi017.stdout:4/42: dread - d4/f11 zero size 2024-09-20T18:35:45.201 INFO:tasks.workunit.client.0.smithi017.stdout:4/43: stat d4/f7 0 2024-09-20T18:35:45.201 INFO:tasks.workunit.client.1.smithi172.stdout:6/507: creat d0/d18/d1c/d21/d26/d34/d39/d46/fa5 x:0 0 0 2024-09-20T18:35:45.201 INFO:tasks.workunit.client.0.smithi017.stdout:8/40: dread d0/f4 [0,4194304] 0 2024-09-20T18:35:45.203 INFO:tasks.workunit.client.0.smithi017.stdout:8/41: write d0/fb [1294462,119000] 0 2024-09-20T18:35:45.204 INFO:tasks.workunit.client.1.smithi172.stdout:3/647: creat d0/dc/d6a/d3a/fdd x:0 0 0 2024-09-20T18:35:45.206 INFO:tasks.workunit.client.1.smithi172.stdout:3/648: write d0/dc/d6a/d3a/fb3 [4168393,22436] 0 2024-09-20T18:35:45.206 INFO:tasks.workunit.client.0.smithi017.stdout:4/44: rename d4/de/df to d4/dd/d13 0 2024-09-20T18:35:45.208 INFO:tasks.workunit.client.1.smithi172.stdout:4/593: mknod d0/d7/cd8 0 2024-09-20T18:35:45.210 INFO:tasks.workunit.client.0.smithi017.stdout:8/42: mkdir d0/d6/d10 0 2024-09-20T18:35:45.211 INFO:tasks.workunit.client.0.smithi017.stdout:9/95: sync 2024-09-20T18:35:45.211 INFO:tasks.workunit.client.0.smithi017.stdout:5/32: sync 2024-09-20T18:35:45.211 INFO:tasks.workunit.client.0.smithi017.stdout:0/57: sync 2024-09-20T18:35:45.211 INFO:tasks.workunit.client.0.smithi017.stdout:6/45: sync 2024-09-20T18:35:45.211 INFO:tasks.workunit.client.0.smithi017.stdout:3/261: sync 2024-09-20T18:35:45.211 INFO:tasks.workunit.client.0.smithi017.stdout:1/11: sync 2024-09-20T18:35:45.211 INFO:tasks.workunit.client.0.smithi017.stdout:2/129: sync 2024-09-20T18:35:45.211 INFO:tasks.workunit.client.0.smithi017.stdout:7/26: sync 2024-09-20T18:35:45.211 INFO:tasks.workunit.client.1.smithi172.stdout:5/595: creat d4/df/dad/fc8 x:0 0 0 2024-09-20T18:35:45.212 INFO:tasks.workunit.client.0.smithi017.stdout:0/58: fdatasync d4/f11 0 2024-09-20T18:35:45.213 INFO:tasks.workunit.client.0.smithi017.stdout:6/46: read d4/fa [2550325,49689] 0 2024-09-20T18:35:45.213 INFO:tasks.workunit.client.0.smithi017.stdout:4/45: mkdir d4/dd/d14 0 2024-09-20T18:35:45.214 INFO:tasks.workunit.client.1.smithi172.stdout:8/552: mknod dd/d1b/d3b/d51/d5b/daf/cc0 0 2024-09-20T18:35:45.215 INFO:tasks.workunit.client.0.smithi017.stdout:6/47: stat d4/f10 0 2024-09-20T18:35:45.218 INFO:tasks.workunit.client.0.smithi017.stdout:5/33: unlink d0/fa 0 2024-09-20T18:35:45.219 INFO:tasks.workunit.client.1.smithi172.stdout:9/566: fsync d15/d1f/d2c/d7d/f2a 0 2024-09-20T18:35:45.225 INFO:tasks.workunit.client.0.smithi017.stdout:8/43: dwrite d0/f2 [0,4194304] 0 2024-09-20T18:35:45.226 INFO:tasks.workunit.client.1.smithi172.stdout:3/649: symlink d0/d13/db2/lde 0 2024-09-20T18:35:45.226 INFO:tasks.workunit.client.0.smithi017.stdout:3/262: dread da/de/f12 [0,4194304] 0 2024-09-20T18:35:45.227 INFO:tasks.workunit.client.1.smithi172.stdout:3/650: write d0/dc/d6a/d3a/f80 [82113,88833] 0 2024-09-20T18:35:45.228 INFO:tasks.workunit.client.1.smithi172.stdout:8/553: dread dd/d1b/d3b/d51/d5b/daf/f83 [0,4194304] 0 2024-09-20T18:35:45.229 INFO:tasks.workunit.client.0.smithi017.stdout:8/44: chown d0/cf 133 1 2024-09-20T18:35:45.229 INFO:tasks.workunit.client.1.smithi172.stdout:8/554: stat dd/d1b/d3b/d51/d34/ca6 0 2024-09-20T18:35:45.229 INFO:tasks.workunit.client.0.smithi017.stdout:0/59: dwrite f2 [0,4194304] 0 2024-09-20T18:35:45.231 INFO:tasks.workunit.client.0.smithi017.stdout:2/130: dread d1/df/f1e [0,4194304] 0 2024-09-20T18:35:45.231 INFO:tasks.workunit.client.0.smithi017.stdout:8/45: chown d0/l5 1021908122 1 2024-09-20T18:35:45.234 INFO:tasks.workunit.client.1.smithi172.stdout:4/594: mkdir d0/d48/d90/d55/d53/d78/dd9 0 2024-09-20T18:35:45.237 INFO:tasks.workunit.client.0.smithi017.stdout:7/27: unlink c6 0 2024-09-20T18:35:45.237 INFO:tasks.workunit.client.0.smithi017.stdout:5/34: dread d0/f7 [0,4194304] 0 2024-09-20T18:35:45.238 INFO:tasks.workunit.client.0.smithi017.stdout:5/35: read d0/f7 [672699,9520] 0 2024-09-20T18:35:45.240 INFO:tasks.workunit.client.0.smithi017.stdout:4/46: rename d4/f11 to d4/d10/f15 0 2024-09-20T18:35:45.242 INFO:tasks.workunit.client.1.smithi172.stdout:0/743: write d4/d5/d2e/d38/d96/f9f [741856,17122] 0 2024-09-20T18:35:45.243 INFO:tasks.workunit.client.1.smithi172.stdout:0/744: chown d4/d5/d2e/d38/cae 27239041 1 2024-09-20T18:35:45.245 INFO:tasks.workunit.client.1.smithi172.stdout:6/508: rename d0/d18/d1c/d21/d26/d34/d7a/d47/c48 to d0/d18/d1c/d21/d26/d9b/ca6 0 2024-09-20T18:35:45.246 INFO:tasks.workunit.client.1.smithi172.stdout:6/509: readlink d0/d18/d1c/d21/d26/d34/d6b/l92 0 2024-09-20T18:35:45.250 INFO:tasks.workunit.client.0.smithi017.stdout:3/263: creat da/de/d13/d2f/f60 x:0 0 0 2024-09-20T18:35:45.250 INFO:tasks.workunit.client.0.smithi017.stdout:8/46: rmdir d0/d6 39 2024-09-20T18:35:45.251 INFO:tasks.workunit.client.1.smithi172.stdout:1/555: sync 2024-09-20T18:35:45.251 INFO:tasks.workunit.client.1.smithi172.stdout:1/556: chown d0/d8/d12/l24 56203 1 2024-09-20T18:35:45.252 INFO:tasks.workunit.client.0.smithi017.stdout:8/47: write d0/fc [316177,3518] 0 2024-09-20T18:35:45.252 INFO:tasks.workunit.client.1.smithi172.stdout:8/555: creat dd/d1b/d3b/d51/d5b/daf/d4d/fc1 x:0 0 0 2024-09-20T18:35:45.252 INFO:tasks.workunit.client.0.smithi017.stdout:0/60: fdatasync d4/f6 0 2024-09-20T18:35:45.253 INFO:tasks.workunit.client.0.smithi017.stdout:2/131: mkdir d1/dc/d20/d2e 0 2024-09-20T18:35:45.253 INFO:tasks.workunit.client.1.smithi172.stdout:1/557: write d0/d8/db/d25/d2b/d3d/f4d [1144021,62651] 0 2024-09-20T18:35:45.254 INFO:tasks.workunit.client.0.smithi017.stdout:2/132: write d1/f2d [540682,40675] 0 2024-09-20T18:35:45.254 INFO:tasks.workunit.client.1.smithi172.stdout:4/595: chown d0/de/c93 4058542 1 2024-09-20T18:35:45.257 INFO:tasks.workunit.client.0.smithi017.stdout:9/96: write d6/d1f/f20 [3661872,35897] 0 2024-09-20T18:35:45.258 INFO:tasks.workunit.client.1.smithi172.stdout:7/646: getdents d2/d3/d86/d6e 0 2024-09-20T18:35:45.258 INFO:tasks.workunit.client.0.smithi017.stdout:7/28: write f4 [410359,47503] 0 2024-09-20T18:35:45.266 INFO:tasks.workunit.client.0.smithi017.stdout:3/264: rmdir da 39 2024-09-20T18:35:45.273 INFO:tasks.workunit.client.0.smithi017.stdout:0/61: symlink d4/db/l14 0 2024-09-20T18:35:45.273 INFO:tasks.workunit.client.0.smithi017.stdout:0/62: fsync d4/ff 0 2024-09-20T18:35:45.274 INFO:tasks.workunit.client.0.smithi017.stdout:6/48: truncate d4/f9 3180472 0 2024-09-20T18:35:45.274 INFO:tasks.workunit.client.0.smithi017.stdout:6/49: chown l3 43062 1 2024-09-20T18:35:45.276 INFO:tasks.workunit.client.0.smithi017.stdout:9/97: mkdir d6/d23 0 2024-09-20T18:35:45.279 INFO:tasks.workunit.client.0.smithi017.stdout:7/29: symlink l7 0 2024-09-20T18:35:45.281 INFO:tasks.workunit.client.0.smithi017.stdout:0/63: dwrite d4/ff [0,4194304] 0 2024-09-20T18:35:45.283 INFO:tasks.workunit.client.0.smithi017.stdout:0/64: write f2 [4066363,103046] 0 2024-09-20T18:35:45.285 INFO:tasks.workunit.client.1.smithi172.stdout:8/556: dwrite dd/d1b/d3b/d51/d5b/daf/d4d/f92 [0,4194304] 0 2024-09-20T18:35:45.285 INFO:tasks.workunit.client.1.smithi172.stdout:0/745: rename d4/d94/fcb to d4/d5/d2e/d38/d96/f10d 0 2024-09-20T18:35:45.287 INFO:tasks.workunit.client.0.smithi017.stdout:9/98: rename d6/d1d to d6/d23/d24 0 2024-09-20T18:35:45.288 INFO:tasks.workunit.client.1.smithi172.stdout:9/567: link d15/d1f/d2c/d7d/f2a d15/d1f/d2c/d7d/d34/db5/fbc 0 2024-09-20T18:35:45.288 INFO:tasks.workunit.client.0.smithi017.stdout:2/133: mknod d1/dc/d20/d2e/c2f 0 2024-09-20T18:35:45.288 INFO:tasks.workunit.client.1.smithi172.stdout:3/651: fdatasync d0/dc/fd1 0 2024-09-20T18:35:45.290 INFO:tasks.workunit.client.0.smithi017.stdout:7/30: creat f8 x:0 0 0 2024-09-20T18:35:45.293 INFO:tasks.workunit.client.0.smithi017.stdout:8/48: mknod d0/d6/d10/c11 0 2024-09-20T18:35:45.294 INFO:tasks.workunit.client.1.smithi172.stdout:4/596: fdatasync d0/d48/d90/fbf 0 2024-09-20T18:35:45.294 INFO:tasks.workunit.client.1.smithi172.stdout:0/746: chown d4/d5/d2e/d67/d8c/fa5 12747182 1 2024-09-20T18:35:45.294 INFO:tasks.workunit.client.0.smithi017.stdout:8/49: fsync d0/f4 0 2024-09-20T18:35:45.295 INFO:tasks.workunit.client.1.smithi172.stdout:7/647: dwrite d2/d3/d10/d40/d6a/f8a [0,4194304] 0 2024-09-20T18:35:45.295 INFO:tasks.workunit.client.0.smithi017.stdout:0/65: symlink d4/l15 0 2024-09-20T18:35:45.295 INFO:tasks.workunit.client.1.smithi172.stdout:5/596: truncate d4/df/dad/d26/d41/d69/dac/d2c/f7d 878781 0 2024-09-20T18:35:45.297 INFO:tasks.workunit.client.0.smithi017.stdout:6/50: mknod d4/df/c13 0 2024-09-20T18:35:45.297 INFO:tasks.workunit.client.0.smithi017.stdout:8/50: dread - d0/d6/fe zero size 2024-09-20T18:35:45.298 INFO:tasks.workunit.client.0.smithi017.stdout:5/36: dwrite d0/f6 [0,4194304] 0 2024-09-20T18:35:45.298 INFO:tasks.workunit.client.1.smithi172.stdout:4/597: write d0/d48/d90/db4/fc1 [598832,16268] 0 2024-09-20T18:35:45.298 INFO:tasks.workunit.client.1.smithi172.stdout:5/597: chown d4/df/dad/d26/d41/d69/c92 836 1 2024-09-20T18:35:45.299 INFO:tasks.workunit.client.0.smithi017.stdout:8/51: fsync d0/f4 0 2024-09-20T18:35:45.303 INFO:tasks.workunit.client.1.smithi172.stdout:6/510: creat d0/d18/fa7 x:0 0 0 2024-09-20T18:35:45.304 INFO:tasks.workunit.client.0.smithi017.stdout:2/134: rmdir d1/dc/d20/d2e 39 2024-09-20T18:35:45.305 INFO:tasks.workunit.client.1.smithi172.stdout:8/557: symlink dd/da9/lc2 0 2024-09-20T18:35:45.305 INFO:tasks.workunit.client.0.smithi017.stdout:2/135: chown d1/d1f/l2a 4916 1 2024-09-20T18:35:45.305 INFO:tasks.workunit.client.0.smithi017.stdout:7/31: symlink l9 0 2024-09-20T18:35:45.306 INFO:tasks.workunit.client.1.smithi172.stdout:8/558: dread - dd/d1b/d3b/d51/f8e zero size 2024-09-20T18:35:45.307 INFO:tasks.workunit.client.1.smithi172.stdout:8/559: readlink dd/d1b/d3b/d51/l56 0 2024-09-20T18:35:45.307 INFO:tasks.workunit.client.0.smithi017.stdout:0/66: dwrite f2 [4194304,4194304] 0 2024-09-20T18:35:45.307 INFO:tasks.workunit.client.1.smithi172.stdout:3/652: creat d0/d13/d58/d6d/d7f/d84/fdf x:0 0 0 2024-09-20T18:35:45.308 INFO:tasks.workunit.client.0.smithi017.stdout:7/32: chown f4 193343 1 2024-09-20T18:35:45.308 INFO:tasks.workunit.client.0.smithi017.stdout:7/33: stat l9 0 2024-09-20T18:35:45.309 INFO:tasks.workunit.client.0.smithi017.stdout:7/34: rmdir - no directory 2024-09-20T18:35:45.309 INFO:tasks.workunit.client.0.smithi017.stdout:0/67: stat d4/db/fd 0 2024-09-20T18:35:45.310 INFO:tasks.workunit.client.0.smithi017.stdout:0/68: write f2 [6874551,107425] 0 2024-09-20T18:35:45.310 INFO:tasks.workunit.client.0.smithi017.stdout:3/265: symlink da/l61 0 2024-09-20T18:35:45.314 INFO:tasks.workunit.client.0.smithi017.stdout:8/52: stat d0/l3 0 2024-09-20T18:35:45.315 INFO:tasks.workunit.client.0.smithi017.stdout:5/37: write d0/f7 [1115711,86006] 0 2024-09-20T18:35:45.317 INFO:tasks.workunit.client.0.smithi017.stdout:8/53: truncate d0/fc 1051507 0 2024-09-20T18:35:45.317 INFO:tasks.workunit.client.0.smithi017.stdout:5/38: read d0/f6 [1944477,8694] 0 2024-09-20T18:35:45.318 INFO:tasks.workunit.client.1.smithi172.stdout:4/598: rename d0/d48/d4e/c7a to d0/de/dc/cda 0 2024-09-20T18:35:45.318 INFO:tasks.workunit.client.1.smithi172.stdout:4/599: fdatasync d0/de/d39/f73 0 2024-09-20T18:35:45.318 INFO:tasks.workunit.client.1.smithi172.stdout:4/600: stat d0/de/d21/c87 0 2024-09-20T18:35:45.320 INFO:tasks.workunit.client.0.smithi017.stdout:3/266: unlink da/de/d14/f28 0 2024-09-20T18:35:45.321 INFO:tasks.workunit.client.1.smithi172.stdout:2/519: sync 2024-09-20T18:35:45.321 INFO:tasks.workunit.client.0.smithi017.stdout:5/39: write d0/f6 [3733148,16386] 0 2024-09-20T18:35:45.322 INFO:tasks.workunit.client.0.smithi017.stdout:0/69: mknod d4/c16 0 2024-09-20T18:35:45.322 INFO:tasks.workunit.client.0.smithi017.stdout:7/35: dwrite f8 [0,4194304] 0 2024-09-20T18:35:45.323 INFO:tasks.workunit.client.0.smithi017.stdout:3/267: dread - da/f58 zero size 2024-09-20T18:35:45.325 INFO:tasks.workunit.client.1.smithi172.stdout:8/560: creat dd/d1b/d4f/d9a/fc3 x:0 0 0 2024-09-20T18:35:45.327 INFO:tasks.workunit.client.1.smithi172.stdout:8/561: write dd/d1b/d3b/f42 [1126087,86382] 0 2024-09-20T18:35:45.328 INFO:tasks.workunit.client.1.smithi172.stdout:2/520: dwrite d0/d2c/d3f/dab/d22/d10/d6a/d98/d59/f92 [0,4194304] 0 2024-09-20T18:35:45.332 INFO:tasks.workunit.client.1.smithi172.stdout:3/653: rename d0/dba to d0/d13/d58/d6d/db9/de0 0 2024-09-20T18:35:45.334 INFO:tasks.workunit.client.1.smithi172.stdout:4/601: chown d0/de/dc/d3c/d99/ld1 58 1 2024-09-20T18:35:45.335 INFO:tasks.workunit.client.1.smithi172.stdout:6/511: mknod d0/d18/d1c/d21/d26/d34/d7a/ca8 0 2024-09-20T18:35:45.339 INFO:tasks.workunit.client.1.smithi172.stdout:2/521: mkdir d0/d2c/db2 0 2024-09-20T18:35:45.340 INFO:tasks.workunit.client.1.smithi172.stdout:9/568: dwrite d15/d1f/d2c/d7d/f27 [0,4194304] 0 2024-09-20T18:35:45.341 INFO:tasks.workunit.client.1.smithi172.stdout:3/654: mknod d0/d13/d9e/ce1 0 2024-09-20T18:35:45.342 INFO:tasks.workunit.client.1.smithi172.stdout:8/562: dread dd/d1b/f33 [0,4194304] 0 2024-09-20T18:35:45.344 INFO:tasks.workunit.client.1.smithi172.stdout:8/563: dread - dd/d1b/d3b/d51/f9d zero size 2024-09-20T18:35:45.345 INFO:tasks.workunit.client.1.smithi172.stdout:3/655: truncate d0/dc/d6a/d76/fa2 1017345 0 2024-09-20T18:35:45.345 INFO:tasks.workunit.client.1.smithi172.stdout:5/598: getdents d4/df/d3f 0 2024-09-20T18:35:45.346 INFO:tasks.workunit.client.1.smithi172.stdout:1/558: sync 2024-09-20T18:35:45.350 INFO:tasks.workunit.client.1.smithi172.stdout:4/602: symlink d0/d7/ldb 0 2024-09-20T18:35:45.350 INFO:tasks.workunit.client.1.smithi172.stdout:5/599: write d4/df/dad/d26/d2d/d86/faa [218853,10202] 0 2024-09-20T18:35:45.354 INFO:tasks.workunit.client.1.smithi172.stdout:5/600: fdatasync d4/df/dad/d26/f72 0 2024-09-20T18:35:45.355 INFO:tasks.workunit.client.1.smithi172.stdout:3/656: fsync d0/dc/d6a/d22/f7a 0 2024-09-20T18:35:45.357 INFO:tasks.workunit.client.1.smithi172.stdout:5/601: chown d4/df/l19 50657048 1 2024-09-20T18:35:45.357 INFO:tasks.workunit.client.1.smithi172.stdout:9/569: unlink d15/d1f/d2c/d7d/d34/l43 0 2024-09-20T18:35:45.357 INFO:tasks.workunit.client.1.smithi172.stdout:2/522: dread d0/d1a/f20 [0,4194304] 0 2024-09-20T18:35:45.358 INFO:tasks.workunit.client.1.smithi172.stdout:0/747: dwrite d4/d5/d2e/d38/f4b [4194304,4194304] 0 2024-09-20T18:35:45.360 INFO:tasks.workunit.client.1.smithi172.stdout:2/523: dread d0/d2c/f63 [0,4194304] 0 2024-09-20T18:35:45.361 INFO:tasks.workunit.client.1.smithi172.stdout:4/603: mkdir d0/de/d39/db8/d72/d18/d51/d9a/ddc 0 2024-09-20T18:35:45.361 INFO:tasks.workunit.client.1.smithi172.stdout:4/604: stat d0/f2a 0 2024-09-20T18:35:45.362 INFO:tasks.workunit.client.1.smithi172.stdout:7/648: truncate d2/d3/d3d/d4e/d5f/f9c 1523046 0 2024-09-20T18:35:45.363 INFO:tasks.workunit.client.1.smithi172.stdout:7/649: chown d2/d3/d10/d40/d46/d8e/dbd/ld0 129461 1 2024-09-20T18:35:45.365 INFO:tasks.workunit.client.1.smithi172.stdout:3/657: unlink d0/f44 0 2024-09-20T18:35:45.368 INFO:tasks.workunit.client.1.smithi172.stdout:6/512: getdents d0/d18/d1c/d21/d26/d34/d7a/d99 0 2024-09-20T18:35:45.372 INFO:tasks.workunit.client.1.smithi172.stdout:5/602: truncate d4/df/dad/d26/d41/d69/db9/fbf 799228 0 2024-09-20T18:35:45.372 INFO:tasks.workunit.client.1.smithi172.stdout:2/524: rmdir d0/d60 39 2024-09-20T18:35:45.374 INFO:tasks.workunit.client.1.smithi172.stdout:1/559: creat d0/d8/fb8 x:0 0 0 2024-09-20T18:35:45.374 INFO:tasks.workunit.client.1.smithi172.stdout:2/525: write d0/d2c/d3f/dab/d22/d10/d6a/d98/d59/f92 [805483,66900] 0 2024-09-20T18:35:45.375 INFO:tasks.workunit.client.1.smithi172.stdout:1/560: chown d0/d8/d12 1680 1 2024-09-20T18:35:45.376 INFO:tasks.workunit.client.1.smithi172.stdout:7/650: write d2/f54 [6054101,55137] 0 2024-09-20T18:35:45.376 INFO:tasks.workunit.client.1.smithi172.stdout:3/658: rename d0/d13/d1e/f93 to d0/d13/d32/d54/fe2 0 2024-09-20T18:35:45.378 INFO:tasks.workunit.client.0.smithi017.stdout:0/70: read - d4/db/f12 zero size 2024-09-20T18:35:45.379 INFO:tasks.workunit.client.0.smithi017.stdout:8/54: mknod d0/d6/c12 0 2024-09-20T18:35:45.380 INFO:tasks.workunit.client.1.smithi172.stdout:8/564: getdents dd/d1b/d3b/d51/d5b/daf 0 2024-09-20T18:35:45.380 INFO:tasks.workunit.client.0.smithi017.stdout:9/99: getdents d6/d11 0 2024-09-20T18:35:45.380 INFO:tasks.workunit.client.1.smithi172.stdout:3/659: fdatasync d0/d13/db2/fce 0 2024-09-20T18:35:45.381 INFO:tasks.workunit.client.0.smithi017.stdout:2/136: dwrite d1/df/f1e [0,4194304] 0 2024-09-20T18:35:45.382 INFO:tasks.workunit.client.1.smithi172.stdout:9/570: dwrite d15/d1f/d2c/d7d/f27 [4194304,4194304] 0 2024-09-20T18:35:45.383 INFO:tasks.workunit.client.0.smithi017.stdout:8/55: chown d0/f2 16192962 1 2024-09-20T18:35:45.384 INFO:tasks.workunit.client.1.smithi172.stdout:5/603: chown d4/df/dad/f8c 31717 1 2024-09-20T18:35:45.384 INFO:tasks.workunit.client.1.smithi172.stdout:3/660: chown d0/dc/d6a/d76/fd2 48932 1 2024-09-20T18:35:45.386 INFO:tasks.workunit.client.0.smithi017.stdout:0/71: creat d4/f17 x:0 0 0 2024-09-20T18:35:45.388 INFO:tasks.workunit.client.1.smithi172.stdout:3/661: truncate d0/d13/db2/fce 40107 0 2024-09-20T18:35:45.388 INFO:tasks.workunit.client.1.smithi172.stdout:1/561: dwrite d0/d22/f28 [0,4194304] 0 2024-09-20T18:35:45.390 INFO:tasks.workunit.client.0.smithi017.stdout:7/36: dwrite f4 [0,4194304] 0 2024-09-20T18:35:45.393 INFO:tasks.workunit.client.0.smithi017.stdout:2/137: rmdir d1 39 2024-09-20T18:35:45.394 INFO:tasks.workunit.client.0.smithi017.stdout:9/100: dread d6/fb [0,4194304] 0 2024-09-20T18:35:45.402 INFO:tasks.workunit.client.0.smithi017.stdout:7/37: dwrite f4 [0,4194304] 0 2024-09-20T18:35:45.403 INFO:tasks.workunit.client.0.smithi017.stdout:9/101: mknod d6/d23/d24/c25 0 2024-09-20T18:35:45.406 INFO:tasks.workunit.client.1.smithi172.stdout:7/651: rename d2/d3/d10/d40/d46/d8e/f67 to d2/d23/d9d/ddb/fdc 0 2024-09-20T18:35:45.411 INFO:tasks.workunit.client.1.smithi172.stdout:5/604: chown d4/df/dad/d26/d41/d69/dac/c94 121287711 1 2024-09-20T18:35:45.412 INFO:tasks.workunit.client.1.smithi172.stdout:2/526: write d0/d2c/d3f/dab/d22/d10/d6a/d98/d59/f5c [183301,99548] 0 2024-09-20T18:35:45.413 INFO:tasks.workunit.client.1.smithi172.stdout:2/527: write d0/d2c/f3e [3715282,37855] 0 2024-09-20T18:35:45.415 INFO:tasks.workunit.client.1.smithi172.stdout:2/528: read d0/d2c/d3f/dab/d18/d29/d42/d4b/d53/f5b [12764,83020] 0 2024-09-20T18:35:45.416 INFO:tasks.workunit.client.0.smithi017.stdout:7/38: unlink l5 0 2024-09-20T18:35:45.418 INFO:tasks.workunit.client.0.smithi017.stdout:9/102: mknod d6/d11/c26 0 2024-09-20T18:35:45.418 INFO:tasks.workunit.client.0.smithi017.stdout:7/39: chown f4 0 1 2024-09-20T18:35:45.419 INFO:tasks.workunit.client.0.smithi017.stdout:0/72: dwrite d4/f8 [4194304,4194304] 0 2024-09-20T18:35:45.419 INFO:tasks.workunit.client.0.smithi017.stdout:3/268: getdents da/de/d13 0 2024-09-20T18:35:45.422 INFO:tasks.workunit.client.0.smithi017.stdout:2/138: mkdir d1/dc/d20/d2e/d30 0 2024-09-20T18:35:45.423 INFO:tasks.workunit.client.0.smithi017.stdout:7/40: mkdir da 0 2024-09-20T18:35:45.425 INFO:tasks.workunit.client.0.smithi017.stdout:0/73: rmdir d4 39 2024-09-20T18:35:45.425 INFO:tasks.workunit.client.0.smithi017.stdout:2/139: chown d1/l10 0 1 2024-09-20T18:35:45.427 INFO:tasks.workunit.client.0.smithi017.stdout:3/269: mkdir da/de/d13/d2f/d26/d62 0 2024-09-20T18:35:45.428 INFO:tasks.workunit.client.0.smithi017.stdout:2/140: rename d1/df/d17 to d1/df/d17/d31 22 2024-09-20T18:35:45.430 INFO:tasks.workunit.client.0.smithi017.stdout:9/103: dwrite d6/f18 [4194304,4194304] 0 2024-09-20T18:35:45.432 INFO:tasks.workunit.client.0.smithi017.stdout:2/141: write d1/df/d17/f1a [619527,113464] 0 2024-09-20T18:35:45.436 INFO:tasks.workunit.client.0.smithi017.stdout:7/41: mknod da/cb 0 2024-09-20T18:35:45.438 INFO:tasks.workunit.client.1.smithi172.stdout:8/565: write dd/d1b/f8d [1776220,101325] 0 2024-09-20T18:35:45.439 INFO:tasks.workunit.client.1.smithi172.stdout:2/529: readlink d0/d2c/d3f/dab/d22/l81 0 2024-09-20T18:35:45.440 INFO:tasks.workunit.client.1.smithi172.stdout:4/605: getdents d0/d48/d90/d55/d53/d78/dd2 0 2024-09-20T18:35:45.441 INFO:tasks.workunit.client.1.smithi172.stdout:2/530: chown d0/d2c/d3f/dab/d18/d29/d42 10 1 2024-09-20T18:35:45.441 INFO:tasks.workunit.client.1.smithi172.stdout:1/562: truncate d0/d8/db/d39/fb0 1559820 0 2024-09-20T18:35:45.442 INFO:tasks.workunit.client.0.smithi017.stdout:0/74: mkdir d4/db/d18 0 2024-09-20T18:35:45.443 INFO:tasks.workunit.client.1.smithi172.stdout:6/513: getdents d0/d18/d1c/d21 0 2024-09-20T18:35:45.444 INFO:tasks.workunit.client.1.smithi172.stdout:2/531: write d0/d2c/d3f/dab/d22/d4c/f88 [1616112,71183] 0 2024-09-20T18:35:45.445 INFO:tasks.workunit.client.1.smithi172.stdout:6/514: chown d0/d18/d1c/d21/d26/d34/d6b/d7d/c2d 0 1 2024-09-20T18:35:45.446 INFO:tasks.workunit.client.0.smithi017.stdout:7/42: rename f8 to da/fc 0 2024-09-20T18:35:45.446 INFO:tasks.workunit.client.0.smithi017.stdout:0/75: dread d4/ff [0,4194304] 0 2024-09-20T18:35:45.447 INFO:tasks.workunit.client.1.smithi172.stdout:7/652: creat d2/d3/d3d/dd4/fdd x:0 0 0 2024-09-20T18:35:45.447 INFO:tasks.workunit.client.1.smithi172.stdout:4/606: dwrite d0/d48/d4e/f96 [0,4194304] 0 2024-09-20T18:35:45.447 INFO:tasks.workunit.client.1.smithi172.stdout:6/515: chown d0/d18/d1c/d21/d26/d34/d39/d46/c4d 870 1 2024-09-20T18:35:45.448 INFO:tasks.workunit.client.0.smithi017.stdout:3/270: creat da/de/d53/d52/f63 x:0 0 0 2024-09-20T18:35:45.452 INFO:tasks.workunit.client.0.smithi017.stdout:9/104: truncate d6/ff 1692099 0 2024-09-20T18:35:45.455 INFO:tasks.workunit.client.1.smithi172.stdout:8/566: creat dd/d1b/d3b/d51/dac/fc4 x:0 0 0 2024-09-20T18:35:45.455 INFO:tasks.workunit.client.1.smithi172.stdout:0/748: sync 2024-09-20T18:35:45.456 INFO:tasks.workunit.client.0.smithi017.stdout:7/43: dwrite f4 [0,4194304] 0 2024-09-20T18:35:45.458 INFO:tasks.workunit.client.0.smithi017.stdout:7/44: read da/fc [3550002,3124] 0 2024-09-20T18:35:45.464 INFO:tasks.workunit.client.0.smithi017.stdout:9/105: dwrite d6/fe [0,4194304] 0 2024-09-20T18:35:45.465 INFO:tasks.workunit.client.1.smithi172.stdout:1/563: mknod d0/d8/db/d25/d6f/cb9 0 2024-09-20T18:35:45.469 INFO:tasks.workunit.client.1.smithi172.stdout:2/532: unlink d0/d2c/d51/d61/f67 0 2024-09-20T18:35:45.471 INFO:tasks.workunit.client.0.smithi017.stdout:0/76: rename d4/db/fd to d4/db/d18/f19 0 2024-09-20T18:35:45.471 INFO:tasks.workunit.client.1.smithi172.stdout:5/605: write d4/f36 [795606,19502] 0 2024-09-20T18:35:45.472 INFO:tasks.workunit.client.1.smithi172.stdout:6/516: mknod d0/d18/d1c/d21/d26/ca9 0 2024-09-20T18:35:45.473 INFO:tasks.workunit.client.0.smithi017.stdout:3/271: rmdir da/de/d53/d52 39 2024-09-20T18:35:45.473 INFO:tasks.workunit.client.1.smithi172.stdout:5/606: readlink d4/df/dad/d26/l9f 0 2024-09-20T18:35:45.475 INFO:tasks.workunit.client.1.smithi172.stdout:9/571: getdents d15/d1a/d6f 0 2024-09-20T18:35:45.477 INFO:tasks.workunit.client.1.smithi172.stdout:5/607: write d4/df/dad/d26/d41/d69/dac/da7/fbe [898520,33175] 0 2024-09-20T18:35:45.478 INFO:tasks.workunit.client.1.smithi172.stdout:2/533: dwrite d0/d2c/d3f/dab/d22/d10/d35/fa5 [0,4194304] 0 2024-09-20T18:35:45.478 INFO:tasks.workunit.client.1.smithi172.stdout:4/607: creat d0/de/d39/db8/d72/d18/d51/d9a/fdd x:0 0 0 2024-09-20T18:35:45.479 INFO:tasks.workunit.client.0.smithi017.stdout:2/142: truncate d1/f4 3410507 0 2024-09-20T18:35:45.480 INFO:tasks.workunit.client.1.smithi172.stdout:5/608: write d4/df/dad/d26/d41/d69/dac/d2c/f5c [866105,117684] 0 2024-09-20T18:35:45.482 INFO:tasks.workunit.client.1.smithi172.stdout:7/653: creat d2/d3/d10/d40/d46/d8e/dbd/fde x:0 0 0 2024-09-20T18:35:45.483 INFO:tasks.workunit.client.0.smithi017.stdout:7/45: write da/fc [1118385,45724] 0 2024-09-20T18:35:45.486 INFO:tasks.workunit.client.1.smithi172.stdout:3/662: getdents d0/dc/d6a/d3a/d74 0 2024-09-20T18:35:45.487 INFO:tasks.workunit.client.0.smithi017.stdout:7/46: dread da/fc [0,4194304] 0 2024-09-20T18:35:45.491 INFO:tasks.workunit.client.0.smithi017.stdout:7/47: dread f4 [0,4194304] 0 2024-09-20T18:35:45.492 INFO:tasks.workunit.client.0.smithi017.stdout:7/48: fsync da/fc 0 2024-09-20T18:35:45.500 INFO:tasks.workunit.client.0.smithi017.stdout:3/272: rmdir da/de/d53/d52 39 2024-09-20T18:35:45.501 INFO:tasks.workunit.client.1.smithi172.stdout:6/517: dread d0/d18/d1c/d21/d26/d34/f3e [0,4194304] 0 2024-09-20T18:35:45.502 INFO:tasks.workunit.client.1.smithi172.stdout:5/609: creat d4/df/dad/d26/d41/d65/d8f/fc9 x:0 0 0 2024-09-20T18:35:45.505 INFO:tasks.workunit.client.0.smithi017.stdout:2/143: symlink d1/dc/d20/d22/l32 0 2024-09-20T18:35:45.506 INFO:tasks.workunit.client.1.smithi172.stdout:8/567: write dd/f3d [248641,103794] 0 2024-09-20T18:35:45.508 INFO:tasks.workunit.client.1.smithi172.stdout:6/518: dwrite d0/d18/d1c/d21/d26/f5f [0,4194304] 0 2024-09-20T18:35:45.509 INFO:tasks.workunit.client.0.smithi017.stdout:9/106: link l5 d6/l27 0 2024-09-20T18:35:45.509 INFO:tasks.workunit.client.1.smithi172.stdout:8/568: readlink dd/d1b/d3b/d51/l77 0 2024-09-20T18:35:45.510 INFO:tasks.workunit.client.1.smithi172.stdout:6/519: chown d0/d18/d1c/d21/d26/d9b 75063 1 2024-09-20T18:35:45.511 INFO:tasks.workunit.client.1.smithi172.stdout:7/654: mkdir d2/ddf 0 2024-09-20T18:35:45.511 INFO:tasks.workunit.client.1.smithi172.stdout:4/608: write d0/de/d39/fc8 [3848126,33136] 0 2024-09-20T18:35:45.513 INFO:tasks.workunit.client.1.smithi172.stdout:3/663: mknod d0/d13/d32/ce3 0 2024-09-20T18:35:45.513 INFO:tasks.workunit.client.1.smithi172.stdout:6/520: chown d0/d18/f54 0 1 2024-09-20T18:35:45.515 INFO:tasks.workunit.client.0.smithi017.stdout:2/144: creat d1/d1f/f33 x:0 0 0 2024-09-20T18:35:45.515 INFO:tasks.workunit.client.1.smithi172.stdout:0/749: dwrite d4/d5/d2e/d33/f6b [0,4194304] 0 2024-09-20T18:35:45.522 INFO:tasks.workunit.client.0.smithi017.stdout:0/77: getdents d4/db 0 2024-09-20T18:35:45.523 INFO:tasks.workunit.client.0.smithi017.stdout:2/145: dwrite d1/f28 [0,4194304] 0 2024-09-20T18:35:45.523 INFO:tasks.workunit.client.0.smithi017.stdout:0/78: dread - d4/db/fc zero size 2024-09-20T18:35:45.524 INFO:tasks.workunit.client.1.smithi172.stdout:5/610: symlink d4/lca 0 2024-09-20T18:35:45.526 INFO:tasks.workunit.client.1.smithi172.stdout:8/569: dread dd/d1b/d3b/d51/f35 [0,4194304] 0 2024-09-20T18:35:45.528 INFO:tasks.workunit.client.1.smithi172.stdout:8/570: write dd/d1b/d3b/d51/d5b/daf/f72 [385644,92967] 0 2024-09-20T18:35:45.530 INFO:tasks.workunit.client.0.smithi017.stdout:9/107: truncate d6/ff 2265221 0 2024-09-20T18:35:45.531 INFO:tasks.workunit.client.1.smithi172.stdout:0/750: rename d4/d1a/ddf to d4/d5/d2e/d33/de1/d10e 0 2024-09-20T18:35:45.532 INFO:tasks.workunit.client.1.smithi172.stdout:3/664: mknod d0/dc/d6a/d3a/ce4 0 2024-09-20T18:35:45.534 INFO:tasks.workunit.client.0.smithi017.stdout:0/79: write d4/db/d18/f19 [220745,54240] 0 2024-09-20T18:35:45.535 INFO:tasks.workunit.client.1.smithi172.stdout:4/609: truncate d0/d48/d90/d55/f3e 128513 0 2024-09-20T18:35:45.536 INFO:tasks.workunit.client.0.smithi017.stdout:7/49: truncate f4 3802784 0 2024-09-20T18:35:45.537 INFO:tasks.workunit.client.0.smithi017.stdout:7/50: chown l7 167602 1 2024-09-20T18:35:45.537 INFO:tasks.workunit.client.0.smithi017.stdout:2/146: creat d1/dc/d20/d22/f34 x:0 0 0 2024-09-20T18:35:45.538 INFO:tasks.workunit.client.1.smithi172.stdout:3/665: dwrite d0/d13/d58/d6d/db9/d87/f9d [0,4194304] 0 2024-09-20T18:35:45.538 INFO:tasks.workunit.client.0.smithi017.stdout:7/51: chown l9 5522 1 2024-09-20T18:35:45.538 INFO:tasks.workunit.client.1.smithi172.stdout:1/564: getdents d0/d8/d5f 0 2024-09-20T18:35:45.539 INFO:tasks.workunit.client.0.smithi017.stdout:9/108: rmdir d6/d11 39 2024-09-20T18:35:45.541 INFO:tasks.workunit.client.0.smithi017.stdout:3/273: getdents da/de/d13/d16/d50 0 2024-09-20T18:35:45.546 INFO:tasks.workunit.client.0.smithi017.stdout:3/274: fsync da/de/d13/d2f/d26/d31/f36 0 2024-09-20T18:35:45.546 INFO:tasks.workunit.client.0.smithi017.stdout:0/80: dwrite d4/db/fe [0,4194304] 0 2024-09-20T18:35:45.548 INFO:tasks.workunit.client.1.smithi172.stdout:8/571: mkdir dd/d1b/d3b/d51/d5b/dc5 0 2024-09-20T18:35:45.549 INFO:tasks.workunit.client.1.smithi172.stdout:8/572: chown dd/d1b/d3b/d51/d5b/daf/d4d/f92 401370886 1 2024-09-20T18:35:45.552 INFO:tasks.workunit.client.1.smithi172.stdout:8/573: truncate dd/d1b/d3b/d51/d34/fb4 462675 0 2024-09-20T18:35:45.554 INFO:tasks.workunit.client.0.smithi017.stdout:9/109: symlink d6/d1f/l28 0 2024-09-20T18:35:45.556 INFO:tasks.workunit.client.1.smithi172.stdout:4/610: creat d0/de/d39/d9f/fde x:0 0 0 2024-09-20T18:35:45.558 INFO:tasks.workunit.client.1.smithi172.stdout:4/611: truncate d0/d7/d6f/f9c 4812445 0 2024-09-20T18:35:45.560 INFO:tasks.workunit.client.1.smithi172.stdout:1/565: mknod d0/d8/db/d25/d6d/d77/cba 0 2024-09-20T18:35:45.565 INFO:tasks.workunit.client.1.smithi172.stdout:8/574: creat dd/d1b/d3b/d51/d5b/daf/fc6 x:0 0 0 2024-09-20T18:35:45.567 INFO:tasks.workunit.client.1.smithi172.stdout:4/612: rename d0/de/d39/db8/d72/d18/d51/d9a/fbe to d0/d48/d90/d55/d53/d5c/fdf 0 2024-09-20T18:35:45.568 INFO:tasks.workunit.client.0.smithi017.stdout:7/52: getdents da 0 2024-09-20T18:35:45.568 INFO:tasks.workunit.client.1.smithi172.stdout:1/566: mkdir d0/d8/db/d25/d2b/d3d/d65/d93/dbb 0 2024-09-20T18:35:45.569 INFO:tasks.workunit.client.1.smithi172.stdout:5/611: dwrite d4/df/dad/d26/f32 [4194304,4194304] 0 2024-09-20T18:35:45.569 INFO:tasks.workunit.client.1.smithi172.stdout:7/655: getdents d2/d3/d10/d40 0 2024-09-20T18:35:45.572 INFO:tasks.workunit.client.0.smithi017.stdout:9/110: link d6/d11/f12 d6/d11/f29 0 2024-09-20T18:35:45.572 INFO:tasks.workunit.client.0.smithi017.stdout:9/111: chown d6 1668182690 1 2024-09-20T18:35:45.573 INFO:tasks.workunit.client.0.smithi017.stdout:9/112: chown d6/d11/f12 31 1 2024-09-20T18:35:45.573 INFO:tasks.workunit.client.1.smithi172.stdout:0/751: dwrite d4/d5/d2e/d33/de1/fd6 [0,4194304] 0 2024-09-20T18:35:45.573 INFO:tasks.workunit.client.1.smithi172.stdout:6/521: dwrite d0/d18/f1e [0,4194304] 0 2024-09-20T18:35:45.574 INFO:tasks.workunit.client.1.smithi172.stdout:8/575: mkdir dd/d1b/d3b/dc7 0 2024-09-20T18:35:45.575 INFO:tasks.workunit.client.0.smithi017.stdout:9/113: read d6/d11/f21 [506263,88491] 0 2024-09-20T18:35:45.577 INFO:tasks.workunit.client.1.smithi172.stdout:1/567: fdatasync d0/d8/d12/f29 0 2024-09-20T18:35:45.577 INFO:tasks.workunit.client.1.smithi172.stdout:0/752: chown d4/d1a/d28/d42/db8/fc7 1 1 2024-09-20T18:35:45.577 INFO:tasks.workunit.client.1.smithi172.stdout:4/613: dread d0/d48/d90/d55/d53/d78/f95 [0,4194304] 0 2024-09-20T18:35:45.580 INFO:tasks.workunit.client.1.smithi172.stdout:8/576: dread - dd/d1b/d3b/d5d/d7d/f9c zero size 2024-09-20T18:35:45.583 INFO:tasks.workunit.client.0.smithi017.stdout:9/114: creat d6/d23/f2a x:0 0 0 2024-09-20T18:35:45.584 INFO:tasks.workunit.client.0.smithi017.stdout:3/275: write da/de/d14/d19/f32 [3643556,93706] 0 2024-09-20T18:35:45.585 INFO:tasks.workunit.client.1.smithi172.stdout:7/656: dread d2/d3/dd/f1d [0,4194304] 0 2024-09-20T18:35:45.586 INFO:tasks.workunit.client.1.smithi172.stdout:5/612: rename d4/df/d98/ca1 to d4/df/dad/d26/ccb 0 2024-09-20T18:35:45.587 INFO:tasks.workunit.client.0.smithi017.stdout:9/115: write d6/fb [2906957,14876] 0 2024-09-20T18:35:45.588 INFO:tasks.workunit.client.1.smithi172.stdout:4/614: dwrite d0/d48/d90/db4/fc1 [0,4194304] 0 2024-09-20T18:35:45.588 INFO:tasks.workunit.client.0.smithi017.stdout:3/276: chown da/de/d14/d19/f1c 4 1 2024-09-20T18:35:45.592 INFO:tasks.workunit.client.0.smithi017.stdout:0/81: truncate d4/fa 3844391 0 2024-09-20T18:35:45.603 INFO:tasks.workunit.client.1.smithi172.stdout:8/577: rename dd/d1b/d3b/l58 to dd/d1b/d3b/lc8 0 2024-09-20T18:35:45.604 INFO:tasks.workunit.client.1.smithi172.stdout:8/578: chown dd/d1b/d3b/d51/d34/f36 116788 1 2024-09-20T18:35:45.604 INFO:tasks.workunit.client.0.smithi017.stdout:9/116: dread d6/ff [0,4194304] 0 2024-09-20T18:35:45.605 INFO:tasks.workunit.client.1.smithi172.stdout:8/579: chown dd/d1b/d3b/d51/d5b/d6b/fb7 732929 1 2024-09-20T18:35:45.605 INFO:tasks.workunit.client.0.smithi017.stdout:3/277: unlink da/de/d14/d19/f32 0 2024-09-20T18:35:45.606 INFO:tasks.workunit.client.1.smithi172.stdout:0/753: rename d4/d1a/l30 to d4/d5/d2e/d33/de1/d15/dfe/l10f 0 2024-09-20T18:35:45.609 INFO:tasks.workunit.client.0.smithi017.stdout:0/82: rename d4/c16 to d4/db/d18/c1a 0 2024-09-20T18:35:45.610 INFO:tasks.workunit.client.0.smithi017.stdout:3/278: dread da/de/d13/d2f/d26/d31/f45 [0,4194304] 0 2024-09-20T18:35:45.610 INFO:tasks.workunit.client.1.smithi172.stdout:8/580: dwrite dd/d1b/d3b/d5d/d7d/f9c [0,4194304] 0 2024-09-20T18:35:45.610 INFO:tasks.workunit.client.1.smithi172.stdout:7/657: symlink d2/d3/d3d/dd4/le0 0 2024-09-20T18:35:45.611 INFO:tasks.workunit.client.0.smithi017.stdout:0/83: truncate d4/f11 689476 0 2024-09-20T18:35:45.613 INFO:tasks.workunit.client.1.smithi172.stdout:5/613: mkdir d4/df/d98/dcc 0 2024-09-20T18:35:45.619 INFO:tasks.workunit.client.1.smithi172.stdout:6/522: creat d0/d18/d1c/d21/d26/d34/d9c/faa x:0 0 0 2024-09-20T18:35:45.620 INFO:tasks.workunit.client.0.smithi017.stdout:9/117: dread d6/f7 [0,4194304] 0 2024-09-20T18:35:45.621 INFO:tasks.workunit.client.0.smithi017.stdout:3/279: mknod da/de/c64 0 2024-09-20T18:35:45.622 INFO:tasks.workunit.client.1.smithi172.stdout:6/523: dread d0/f13 [4194304,4194304] 0 2024-09-20T18:35:45.623 INFO:tasks.workunit.client.0.smithi017.stdout:0/84: mknod d4/db/c1b 0 2024-09-20T18:35:45.624 INFO:tasks.workunit.client.0.smithi017.stdout:7/53: dread f4 [0,4194304] 0 2024-09-20T18:35:45.627 INFO:tasks.workunit.client.0.smithi017.stdout:7/54: dread da/fc [0,4194304] 0 2024-09-20T18:35:45.632 INFO:tasks.workunit.client.0.smithi017.stdout:3/280: unlink da/c56 0 2024-09-20T18:35:45.636 INFO:tasks.workunit.client.0.smithi017.stdout:0/85: creat d4/db/f1c x:0 0 0 2024-09-20T18:35:45.636 INFO:tasks.workunit.client.1.smithi172.stdout:5/614: dread - d4/df/dad/d26/f47 zero size 2024-09-20T18:35:45.637 INFO:tasks.workunit.client.0.smithi017.stdout:3/281: dread da/de/d14/d19/f4c [0,4194304] 0 2024-09-20T18:35:45.637 INFO:tasks.workunit.client.0.smithi017.stdout:0/86: chown d4/l15 1 1 2024-09-20T18:35:45.638 INFO:tasks.workunit.client.0.smithi017.stdout:7/55: mknod da/cd 0 2024-09-20T18:35:45.638 INFO:tasks.workunit.client.0.smithi017.stdout:7/56: stat l7 0 2024-09-20T18:35:45.642 INFO:tasks.workunit.client.0.smithi017.stdout:7/57: dread da/fc [0,4194304] 0 2024-09-20T18:35:45.643 INFO:tasks.workunit.client.0.smithi017.stdout:9/118: link d6/d23/f2a d6/d23/d24/f2b 0 2024-09-20T18:35:45.644 INFO:tasks.workunit.client.1.smithi172.stdout:1/568: rmdir d0/d8/db/d25/d2b/d3d/d65/da3 0 2024-09-20T18:35:45.644 INFO:tasks.workunit.client.1.smithi172.stdout:1/569: dread - d0/f82 zero size 2024-09-20T18:35:45.645 INFO:tasks.workunit.client.1.smithi172.stdout:1/570: chown d0/d8/db/d25/d6d/d77/c89 2916 1 2024-09-20T18:35:45.646 INFO:tasks.workunit.client.1.smithi172.stdout:0/754: rename d4/d1a/d28/d42/db8/c10a to d4/d20/c110 0 2024-09-20T18:35:45.647 INFO:tasks.workunit.client.0.smithi017.stdout:3/282: stat da/de/c18 0 2024-09-20T18:35:45.648 INFO:tasks.workunit.client.1.smithi172.stdout:7/658: mkdir d2/d3/de1 0 2024-09-20T18:35:45.648 INFO:tasks.workunit.client.0.smithi017.stdout:0/87: rmdir d4/db/d18 39 2024-09-20T18:35:45.649 INFO:tasks.workunit.client.1.smithi172.stdout:8/581: mknod dd/d65/cc9 0 2024-09-20T18:35:45.650 INFO:tasks.workunit.client.1.smithi172.stdout:8/582: fdatasync dd/d1b/f8d 0 2024-09-20T18:35:45.652 INFO:tasks.workunit.client.1.smithi172.stdout:6/524: dwrite d0/fc [0,4194304] 0 2024-09-20T18:35:45.655 INFO:tasks.workunit.client.1.smithi172.stdout:9/572: sync 2024-09-20T18:35:45.655 INFO:tasks.workunit.client.1.smithi172.stdout:2/534: sync 2024-09-20T18:35:45.656 INFO:tasks.workunit.client.1.smithi172.stdout:7/659: symlink d2/d3/d86/le2 0 2024-09-20T18:35:45.656 INFO:tasks.workunit.client.0.smithi017.stdout:0/88: dwrite d4/f8 [4194304,4194304] 0 2024-09-20T18:35:45.658 INFO:tasks.workunit.client.0.smithi017.stdout:0/89: chown d4/f11 626 1 2024-09-20T18:35:45.666 INFO:tasks.workunit.client.0.smithi017.stdout:0/90: dwrite d4/f6 [0,4194304] 0 2024-09-20T18:35:45.669 INFO:tasks.workunit.client.1.smithi172.stdout:4/615: getdents d0/de/d21/d24 0 2024-09-20T18:35:45.673 INFO:tasks.workunit.client.1.smithi172.stdout:1/571: mkdir d0/d8/db/d25/d6d/dbc 0 2024-09-20T18:35:45.673 INFO:tasks.workunit.client.1.smithi172.stdout:1/572: readlink d0/d22/l5c 0 2024-09-20T18:35:45.674 INFO:tasks.workunit.client.0.smithi017.stdout:9/119: dwrite d6/d23/f2a [0,4194304] 0 2024-09-20T18:35:45.676 INFO:tasks.workunit.client.1.smithi172.stdout:5/615: truncate d4/df/dad/d26/d41/d69/f6e 2131246 0 2024-09-20T18:35:45.676 INFO:tasks.workunit.client.0.smithi017.stdout:3/283: rename da/l11 to da/de/d53/l65 0 2024-09-20T18:35:45.677 INFO:tasks.workunit.client.0.smithi017.stdout:0/91: dwrite d4/f17 [0,4194304] 0 2024-09-20T18:35:45.677 INFO:tasks.workunit.client.0.smithi017.stdout:7/58: getdents da 0 2024-09-20T18:35:45.679 INFO:tasks.workunit.client.0.smithi017.stdout:0/92: fsync d4/db/fe 0 2024-09-20T18:35:45.681 INFO:tasks.workunit.client.0.smithi017.stdout:3/284: readlink l7 0 2024-09-20T18:35:45.684 INFO:tasks.workunit.client.1.smithi172.stdout:4/616: creat d0/de/dc/d3c/d99/fe0 x:0 0 0 2024-09-20T18:35:45.687 INFO:tasks.workunit.client.0.smithi017.stdout:7/59: fdatasync da/fc 0 2024-09-20T18:35:45.688 INFO:tasks.workunit.client.1.smithi172.stdout:9/573: dread - d15/d1f/d2c/d37/fb3 zero size 2024-09-20T18:35:45.690 INFO:tasks.workunit.client.0.smithi017.stdout:7/60: chown da/fc 293585 1 2024-09-20T18:35:45.690 INFO:tasks.workunit.client.1.smithi172.stdout:7/660: mknod d2/d3/d10/d40/d74/dcb/ce3 0 2024-09-20T18:35:45.691 INFO:tasks.workunit.client.1.smithi172.stdout:4/617: chown d0/de/l88 446 1 2024-09-20T18:35:45.691 INFO:tasks.workunit.client.0.smithi017.stdout:9/120: dwrite d6/d11/f1b [0,4194304] 0 2024-09-20T18:35:45.692 INFO:tasks.workunit.client.1.smithi172.stdout:4/618: chown d0/de/d21/faa 1 1 2024-09-20T18:35:45.692 INFO:tasks.workunit.client.0.smithi017.stdout:0/93: mknod d4/db/d18/c1d 0 2024-09-20T18:35:45.692 INFO:tasks.workunit.client.1.smithi172.stdout:0/755: getdents d4/d1a/d28/d42/d45/d99/dc9 0 2024-09-20T18:35:45.694 INFO:tasks.workunit.client.1.smithi172.stdout:2/535: rename d0/d90/l96 to d0/lb3 0 2024-09-20T18:35:45.696 INFO:tasks.workunit.client.0.smithi017.stdout:3/285: dwrite da/de/d13/d2f/d26/d31/f36 [0,4194304] 0 2024-09-20T18:35:45.697 INFO:tasks.workunit.client.1.smithi172.stdout:5/616: mkdir d4/df/dad/d26/d41/d69/dcd 0 2024-09-20T18:35:45.697 INFO:tasks.workunit.client.0.smithi017.stdout:3/286: write da/f5c [694287,5638] 0 2024-09-20T18:35:45.698 INFO:tasks.workunit.client.0.smithi017.stdout:9/121: rmdir d6/d11 39 2024-09-20T18:35:45.699 INFO:tasks.workunit.client.0.smithi017.stdout:1/12: sync 2024-09-20T18:35:45.700 INFO:tasks.workunit.client.1.smithi172.stdout:1/573: dread d0/f4 [4194304,4194304] 0 2024-09-20T18:35:45.701 INFO:tasks.workunit.client.0.smithi017.stdout:3/287: dread - da/de/d53/f44 zero size 2024-09-20T18:35:45.701 INFO:tasks.workunit.client.1.smithi172.stdout:9/574: creat d15/d1a/d6f/fbd x:0 0 0 2024-09-20T18:35:45.702 INFO:tasks.workunit.client.1.smithi172.stdout:9/575: fsync d15/d1a/d82/f8e 0 2024-09-20T18:35:45.702 INFO:tasks.workunit.client.1.smithi172.stdout:9/576: fsync d15/d1a/d82/f8e 0 2024-09-20T18:35:45.706 INFO:tasks.workunit.client.0.smithi017.stdout:7/61: link da/fc da/fe 0 2024-09-20T18:35:45.707 INFO:tasks.workunit.client.1.smithi172.stdout:4/619: chown d0/de/c4b 17081431 1 2024-09-20T18:35:45.708 INFO:tasks.workunit.client.0.smithi017.stdout:1/13: creat f1 x:0 0 0 2024-09-20T18:35:45.710 INFO:tasks.workunit.client.1.smithi172.stdout:0/756: mkdir d4/d1a/d28/d75/d60/dba/d111 0 2024-09-20T18:35:45.710 INFO:tasks.workunit.client.0.smithi017.stdout:9/122: rmdir d6 39 2024-09-20T18:35:45.712 INFO:tasks.workunit.client.1.smithi172.stdout:2/536: chown d0/d2c/d3f/dab/d22/d10/d35/fad 447311 1 2024-09-20T18:35:45.712 INFO:tasks.workunit.client.1.smithi172.stdout:1/574: dread d0/d8/db/d39/f64 [0,4194304] 0 2024-09-20T18:35:45.713 INFO:tasks.workunit.client.0.smithi017.stdout:0/94: mkdir d4/db/d1e 0 2024-09-20T18:35:45.714 INFO:tasks.workunit.client.0.smithi017.stdout:0/95: write d4/f6 [7354680,3077] 0 2024-09-20T18:35:45.715 INFO:tasks.workunit.client.1.smithi172.stdout:2/537: read - d0/d2c/d3f/dab/d22/d10/d35/fb0 zero size 2024-09-20T18:35:45.716 INFO:tasks.workunit.client.1.smithi172.stdout:0/757: dwrite d4/d1a/d28/fa4 [0,4194304] 0 2024-09-20T18:35:45.717 INFO:tasks.workunit.client.0.smithi017.stdout:7/62: rename da/cb to da/cf 0 2024-09-20T18:35:45.717 INFO:tasks.workunit.client.0.smithi017.stdout:7/63: readlink l7 0 2024-09-20T18:35:45.718 INFO:tasks.workunit.client.1.smithi172.stdout:7/661: mkdir d2/d3/d10/de4 0 2024-09-20T18:35:45.719 INFO:tasks.workunit.client.1.smithi172.stdout:7/662: dread - d2/d3/d3d/dd4/fdd zero size 2024-09-20T18:35:45.720 INFO:tasks.workunit.client.0.smithi017.stdout:1/14: rename f1 to f2 0 2024-09-20T18:35:45.724 INFO:tasks.workunit.client.0.smithi017.stdout:0/96: dwrite d4/db/f1c [0,4194304] 0 2024-09-20T18:35:45.725 INFO:tasks.workunit.client.0.smithi017.stdout:7/64: dread f4 [0,4194304] 0 2024-09-20T18:35:45.726 INFO:tasks.workunit.client.0.smithi017.stdout:0/97: fdatasync d4/f11 0 2024-09-20T18:35:45.726 INFO:tasks.workunit.client.0.smithi017.stdout:7/65: chown da 25 1 2024-09-20T18:35:45.727 INFO:tasks.workunit.client.0.smithi017.stdout:3/288: rename c2 to da/de/d13/c66 0 2024-09-20T18:35:45.727 INFO:tasks.workunit.client.0.smithi017.stdout:0/98: fsync d4/f17 0 2024-09-20T18:35:45.730 INFO:tasks.workunit.client.0.smithi017.stdout:3/289: dread da/f4e [0,4194304] 0 2024-09-20T18:35:45.732 INFO:tasks.workunit.client.0.smithi017.stdout:1/15: creat f3 x:0 0 0 2024-09-20T18:35:45.733 INFO:tasks.workunit.client.0.smithi017.stdout:3/290: dread - da/de/d14/f38 zero size 2024-09-20T18:35:45.733 INFO:tasks.workunit.client.1.smithi172.stdout:7/663: creat d2/d3/d10/d40/d74/fe5 x:0 0 0 2024-09-20T18:35:45.733 INFO:tasks.workunit.client.0.smithi017.stdout:1/16: chown f3 6 1 2024-09-20T18:35:45.734 INFO:tasks.workunit.client.1.smithi172.stdout:4/620: creat d0/d48/d90/d55/d53/d78/dd9/fe1 x:0 0 0 2024-09-20T18:35:45.734 INFO:tasks.workunit.client.0.smithi017.stdout:1/17: dread - f2 zero size 2024-09-20T18:35:45.735 INFO:tasks.workunit.client.1.smithi172.stdout:4/621: dread - d0/d48/d90/d55/d53/d5c/fdf zero size 2024-09-20T18:35:45.736 INFO:tasks.workunit.client.0.smithi017.stdout:0/99: dwrite d4/f8 [4194304,4194304] 0 2024-09-20T18:35:45.738 INFO:tasks.workunit.client.1.smithi172.stdout:5/617: rename d4/df/dad/d26/d2d/d63/d80/db1 to d4/df/dad/d26/d2d/dce 0 2024-09-20T18:35:45.741 INFO:tasks.workunit.client.0.smithi017.stdout:7/66: creat da/f10 x:0 0 0 2024-09-20T18:35:45.744 INFO:tasks.workunit.client.1.smithi172.stdout:2/538: creat d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/fb4 x:0 0 0 2024-09-20T18:35:45.744 INFO:tasks.workunit.client.1.smithi172.stdout:5/618: read d4/df/dad/d26/d41/d69/dac/d2c/f82 [3525540,24106] 0 2024-09-20T18:35:45.745 INFO:tasks.workunit.client.1.smithi172.stdout:5/619: chown d4/df/d3f/f7c 459619 1 2024-09-20T18:35:45.745 INFO:tasks.workunit.client.0.smithi017.stdout:9/123: mkdir d6/d2c 0 2024-09-20T18:35:45.746 INFO:tasks.workunit.client.1.smithi172.stdout:2/539: write d0/d2c/d3f/dab/d22/d10/d6a/d98/d59/f5c [1879751,4533] 0 2024-09-20T18:35:45.747 INFO:tasks.workunit.client.1.smithi172.stdout:7/664: symlink d2/d3/dd/d84/le6 0 2024-09-20T18:35:45.747 INFO:tasks.workunit.client.1.smithi172.stdout:2/540: chown d0/d2c/d51/c62 894091124 1 2024-09-20T18:35:45.749 INFO:tasks.workunit.client.1.smithi172.stdout:3/666: sync 2024-09-20T18:35:45.752 INFO:tasks.workunit.client.1.smithi172.stdout:5/620: dwrite d4/df/dad/d26/d2d/d63/d80/f87 [0,4194304] 0 2024-09-20T18:35:45.753 INFO:tasks.workunit.client.1.smithi172.stdout:4/622: creat d0/d48/d90/d55/fe2 x:0 0 0 2024-09-20T18:35:45.754 INFO:tasks.workunit.client.0.smithi017.stdout:9/124: dwrite d6/fb [0,4194304] 0 2024-09-20T18:35:45.756 INFO:tasks.workunit.client.1.smithi172.stdout:0/758: rename d4/d46/f56 to d4/d5/d2e/d33/de1/d10e/f112 0 2024-09-20T18:35:45.761 INFO:tasks.workunit.client.1.smithi172.stdout:1/575: rmdir d0/d8/db/d25/d6d/dbc 0 2024-09-20T18:35:45.761 INFO:tasks.workunit.client.1.smithi172.stdout:1/576: stat d0/d8/d5f 0 2024-09-20T18:35:45.761 INFO:tasks.workunit.client.0.smithi017.stdout:1/18: dwrite f2 [0,4194304] 0 2024-09-20T18:35:45.772 INFO:tasks.workunit.client.1.smithi172.stdout:2/541: unlink d0/d2c/d3f/dab/d22/d10/d6a/d98/f50 0 2024-09-20T18:35:45.773 INFO:tasks.workunit.client.0.smithi017.stdout:0/100: symlink d4/db/l1f 0 2024-09-20T18:35:45.775 INFO:tasks.workunit.client.0.smithi017.stdout:9/125: dread - d6/d11/f13 zero size 2024-09-20T18:35:45.776 INFO:tasks.workunit.client.1.smithi172.stdout:3/667: unlink d0/d13/db2/fc0 0 2024-09-20T18:35:45.777 INFO:tasks.workunit.client.1.smithi172.stdout:4/623: dread d0/d7/d6f/fc0 [0,4194304] 0 2024-09-20T18:35:45.779 INFO:tasks.workunit.client.1.smithi172.stdout:5/621: write d4/df/f89 [818002,69411] 0 2024-09-20T18:35:45.779 INFO:tasks.workunit.client.1.smithi172.stdout:5/622: chown d4/df/d3f/l85 0 1 2024-09-20T18:35:45.780 INFO:tasks.workunit.client.0.smithi017.stdout:1/19: mknod c4 0 2024-09-20T18:35:45.780 INFO:tasks.workunit.client.0.smithi017.stdout:1/20: chown c4 1870877 1 2024-09-20T18:35:45.780 INFO:tasks.workunit.client.0.smithi017.stdout:1/21: dread - f3 zero size 2024-09-20T18:35:45.781 INFO:tasks.workunit.client.0.smithi017.stdout:1/22: truncate f3 676186 0 2024-09-20T18:35:45.784 INFO:tasks.workunit.client.1.smithi172.stdout:0/759: rename d4/d1a/d28/d73/l92 to d4/d5/d2e/d33/de1/d10e/l113 0 2024-09-20T18:35:45.785 INFO:tasks.workunit.client.1.smithi172.stdout:0/760: write d4/d5/d2e/d38/d96/f10b [1016506,99582] 0 2024-09-20T18:35:45.785 INFO:tasks.workunit.client.1.smithi172.stdout:1/577: symlink d0/d8/db/d25/d2b/d3d/d65/d93/lbd 0 2024-09-20T18:35:45.786 INFO:tasks.workunit.client.1.smithi172.stdout:0/761: chown d4/d1a/d28/d42/d45/ca7 402165 1 2024-09-20T18:35:45.788 INFO:tasks.workunit.client.1.smithi172.stdout:7/665: fsync d2/d23/d51/f59 0 2024-09-20T18:35:45.789 INFO:tasks.workunit.client.1.smithi172.stdout:1/578: dread d0/d8/db/d39/f42 [0,4194304] 0 2024-09-20T18:35:45.789 INFO:tasks.workunit.client.1.smithi172.stdout:7/666: dread - d2/d3/d3d/d4e/fb1 zero size 2024-09-20T18:35:45.790 INFO:tasks.workunit.client.0.smithi017.stdout:9/126: symlink d6/d11/l2d 0 2024-09-20T18:35:45.790 INFO:tasks.workunit.client.1.smithi172.stdout:7/667: write d2/d3/d10/d40/d6a/fca [471151,78622] 0 2024-09-20T18:35:45.791 INFO:tasks.workunit.client.1.smithi172.stdout:7/668: chown d2/d3/d10/f14 25437 1 2024-09-20T18:35:45.791 INFO:tasks.workunit.client.0.smithi017.stdout:7/67: dwrite f4 [0,4194304] 0 2024-09-20T18:35:45.792 INFO:tasks.workunit.client.0.smithi017.stdout:7/68: fdatasync da/f10 0 2024-09-20T18:35:45.795 INFO:tasks.workunit.client.0.smithi017.stdout:3/291: creat da/de/d13/f67 x:0 0 0 2024-09-20T18:35:45.795 INFO:tasks.workunit.client.1.smithi172.stdout:6/525: sync 2024-09-20T18:35:45.795 INFO:tasks.workunit.client.1.smithi172.stdout:8/583: sync 2024-09-20T18:35:45.796 INFO:tasks.workunit.client.1.smithi172.stdout:3/668: mknod d0/d13/d32/d54/d83/ce5 0 2024-09-20T18:35:45.797 INFO:tasks.workunit.client.0.smithi017.stdout:3/292: fsync da/de/d14/f38 0 2024-09-20T18:35:45.797 INFO:tasks.workunit.client.1.smithi172.stdout:6/526: write d0/d18/f43 [1964949,21400] 0 2024-09-20T18:35:45.797 INFO:tasks.workunit.client.1.smithi172.stdout:8/584: read - dd/d1b/d3b/d51/d5b/daf/fc6 zero size 2024-09-20T18:35:45.802 INFO:tasks.workunit.client.0.smithi017.stdout:7/69: rename da/fe to da/f11 0 2024-09-20T18:35:45.804 INFO:tasks.workunit.client.0.smithi017.stdout:2/147: sync 2024-09-20T18:35:45.804 INFO:tasks.workunit.client.0.smithi017.stdout:6/51: sync 2024-09-20T18:35:45.804 INFO:tasks.workunit.client.0.smithi017.stdout:4/47: sync 2024-09-20T18:35:45.804 INFO:tasks.workunit.client.0.smithi017.stdout:8/56: sync 2024-09-20T18:35:45.804 INFO:tasks.workunit.client.0.smithi017.stdout:5/40: sync 2024-09-20T18:35:45.804 INFO:tasks.workunit.client.1.smithi172.stdout:1/579: mkdir d0/d8/db/d25/d2b/d3d/d65/d93/dbe 0 2024-09-20T18:35:45.805 INFO:tasks.workunit.client.0.smithi017.stdout:2/148: dread - d1/dc/d20/f26 zero size 2024-09-20T18:35:45.805 INFO:tasks.workunit.client.0.smithi017.stdout:8/57: stat d0/d6/d10/c11 0 2024-09-20T18:35:45.806 INFO:tasks.workunit.client.0.smithi017.stdout:6/52: chown d4/l6 31 1 2024-09-20T18:35:45.806 INFO:tasks.workunit.client.1.smithi172.stdout:2/542: mknod d0/d2c/d3f/dab/d18/d29/cb5 0 2024-09-20T18:35:45.806 INFO:tasks.workunit.client.0.smithi017.stdout:6/53: readlink l0 0 2024-09-20T18:35:45.807 INFO:tasks.workunit.client.0.smithi017.stdout:6/54: chown d4/fd 123047033 1 2024-09-20T18:35:45.808 INFO:tasks.workunit.client.0.smithi017.stdout:7/70: creat da/f12 x:0 0 0 2024-09-20T18:35:45.809 INFO:tasks.workunit.client.0.smithi017.stdout:1/23: truncate f2 2375006 0 2024-09-20T18:35:45.811 INFO:tasks.workunit.client.0.smithi017.stdout:0/101: getdents d4 0 2024-09-20T18:35:45.814 INFO:tasks.workunit.client.0.smithi017.stdout:0/102: truncate d4/db/d18/f19 958087 0 2024-09-20T18:35:45.814 INFO:tasks.workunit.client.0.smithi017.stdout:6/55: dwrite d4/fc [0,4194304] 0 2024-09-20T18:35:45.814 INFO:tasks.workunit.client.1.smithi172.stdout:8/585: rename f1 to dd/d1b/d4f/d9a/dbb/fca 0 2024-09-20T18:35:45.816 INFO:tasks.workunit.client.1.smithi172.stdout:8/586: truncate dd/d1b/d3b/d51/d5b/daf/d4d/fc1 664531 0 2024-09-20T18:35:45.816 INFO:tasks.workunit.client.1.smithi172.stdout:6/527: symlink d0/d18/d1c/d21/d26/d34/d7a/d47/lab 0 2024-09-20T18:35:45.817 INFO:tasks.workunit.client.0.smithi017.stdout:5/41: mknod d0/cb 0 2024-09-20T18:35:45.817 INFO:tasks.workunit.client.1.smithi172.stdout:8/587: truncate dd/d1b/d3b/d51/d34/fb4 1201447 0 2024-09-20T18:35:45.818 INFO:tasks.workunit.client.1.smithi172.stdout:4/624: mknod d0/de/d21/ce3 0 2024-09-20T18:35:45.820 INFO:tasks.workunit.client.0.smithi017.stdout:9/127: creat d6/f2e x:0 0 0 2024-09-20T18:35:45.820 INFO:tasks.workunit.client.1.smithi172.stdout:5/623: creat d4/df/dad/d26/d41/d69/dcd/fcf x:0 0 0 2024-09-20T18:35:45.821 INFO:tasks.workunit.client.0.smithi017.stdout:2/149: mkdir d1/dc/d35 0 2024-09-20T18:35:45.822 INFO:tasks.workunit.client.1.smithi172.stdout:0/762: getdents d4/d1a/d28/d42/d45/dd1/d106 0 2024-09-20T18:35:45.822 INFO:tasks.workunit.client.0.smithi017.stdout:4/48: dwrite d4/d10/f15 [0,4194304] 0 2024-09-20T18:35:45.823 INFO:tasks.workunit.client.0.smithi017.stdout:4/49: readlink l2 0 2024-09-20T18:35:45.823 INFO:tasks.workunit.client.0.smithi017.stdout:7/71: creat da/f13 x:0 0 0 2024-09-20T18:35:45.827 INFO:tasks.workunit.client.1.smithi172.stdout:8/588: dread dd/d65/f9e [0,4194304] 0 2024-09-20T18:35:45.828 INFO:tasks.workunit.client.0.smithi017.stdout:1/24: mknod c5 0 2024-09-20T18:35:45.828 INFO:tasks.workunit.client.1.smithi172.stdout:2/543: symlink d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/lb6 0 2024-09-20T18:35:45.829 INFO:tasks.workunit.client.1.smithi172.stdout:0/763: dwrite d4/d5/d2e/d33/de1/f59 [0,4194304] 0 2024-09-20T18:35:45.831 INFO:tasks.workunit.client.0.smithi017.stdout:3/293: creat da/de/d13/d2f/d26/d62/f68 x:0 0 0 2024-09-20T18:35:45.831 INFO:tasks.workunit.client.1.smithi172.stdout:3/669: symlink d0/dc/le6 0 2024-09-20T18:35:45.833 INFO:tasks.workunit.client.0.smithi017.stdout:0/103: mkdir d4/d20 0 2024-09-20T18:35:45.835 INFO:tasks.workunit.client.1.smithi172.stdout:6/528: mkdir d0/d18/d1c/d21/d26/d34/d9c/dac 0 2024-09-20T18:35:45.836 INFO:tasks.workunit.client.0.smithi017.stdout:5/42: creat d0/fc x:0 0 0 2024-09-20T18:35:45.837 INFO:tasks.workunit.client.1.smithi172.stdout:0/764: dwrite d4/d1a/d28/d42/db8/fc7 [0,4194304] 0 2024-09-20T18:35:45.839 INFO:tasks.workunit.client.1.smithi172.stdout:4/625: rename d0/de/d39/db8/d72/fbb to d0/d48/d90/d55/d53/d78/fe4 0 2024-09-20T18:35:45.841 INFO:tasks.workunit.client.0.smithi017.stdout:2/150: dwrite d1/f2d [0,4194304] 0 2024-09-20T18:35:45.842 INFO:tasks.workunit.client.1.smithi172.stdout:5/624: mknod d4/df/dad/d26/cd0 0 2024-09-20T18:35:45.844 INFO:tasks.workunit.client.0.smithi017.stdout:4/50: dwrite f0 [0,4194304] 0 2024-09-20T18:35:45.849 INFO:tasks.workunit.client.0.smithi017.stdout:1/25: dwrite f3 [0,4194304] 0 2024-09-20T18:35:45.855 INFO:tasks.workunit.client.1.smithi172.stdout:8/589: creat dd/d1b/d4f/fcb x:0 0 0 2024-09-20T18:35:45.856 INFO:tasks.workunit.client.1.smithi172.stdout:9/577: sync 2024-09-20T18:35:45.857 INFO:tasks.workunit.client.1.smithi172.stdout:9/578: dread - d15/d4a/d8c/f97 zero size 2024-09-20T18:35:45.858 INFO:tasks.workunit.client.1.smithi172.stdout:2/544: symlink d0/d2c/d3f/dab/d22/d10/d35/lb7 0 2024-09-20T18:35:45.862 INFO:tasks.workunit.client.0.smithi017.stdout:6/56: unlink d4/fa 0 2024-09-20T18:35:45.864 INFO:tasks.workunit.client.0.smithi017.stdout:1/26: dwrite f3 [0,4194304] 0 2024-09-20T18:35:45.865 INFO:tasks.workunit.client.0.smithi017.stdout:3/294: unlink da/de/d14/d19/f1f 0 2024-09-20T18:35:45.874 INFO:tasks.workunit.client.1.smithi172.stdout:0/765: unlink d4/d5/d2e/d33/f4e 0 2024-09-20T18:35:45.875 INFO:tasks.workunit.client.0.smithi017.stdout:3/295: dwrite da/de/d13/d2f/d26/d62/f68 [0,4194304] 0 2024-09-20T18:35:45.877 INFO:tasks.workunit.client.0.smithi017.stdout:3/296: write da/de/d13/f67 [310363,90780] 0 2024-09-20T18:35:45.878 INFO:tasks.workunit.client.1.smithi172.stdout:4/626: creat d0/de/d39/d9f/fe5 x:0 0 0 2024-09-20T18:35:45.879 INFO:tasks.workunit.client.0.smithi017.stdout:3/297: write da/de/d14/f30 [4119083,32458] 0 2024-09-20T18:35:45.879 INFO:tasks.workunit.client.0.smithi017.stdout:9/128: mkdir d6/d2c/d2f 0 2024-09-20T18:35:45.881 INFO:tasks.workunit.client.1.smithi172.stdout:4/627: truncate d0/d48/d90/d55/d53/d78/dd2/fd6 376961 0 2024-09-20T18:35:45.884 INFO:tasks.workunit.client.1.smithi172.stdout:2/545: dread d0/d2c/d3f/dab/d22/d10/d3c/f6d [0,4194304] 0 2024-09-20T18:35:45.886 INFO:tasks.workunit.client.0.smithi017.stdout:4/51: mkdir d4/de/d16 0 2024-09-20T18:35:45.888 INFO:tasks.workunit.client.0.smithi017.stdout:3/298: dwrite da/de/d13/d2f/d26/d62/f68 [0,4194304] 0 2024-09-20T18:35:45.891 INFO:tasks.workunit.client.0.smithi017.stdout:7/72: link da/f12 da/f14 0 2024-09-20T18:35:45.894 INFO:tasks.workunit.client.0.smithi017.stdout:6/57: creat d4/f14 x:0 0 0 2024-09-20T18:35:45.896 INFO:tasks.workunit.client.0.smithi017.stdout:7/73: dread da/f11 [0,4194304] 0 2024-09-20T18:35:45.898 INFO:tasks.workunit.client.0.smithi017.stdout:1/27: mknod c6 0 2024-09-20T18:35:45.899 INFO:tasks.workunit.client.1.smithi172.stdout:6/529: mkdir d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0/dad 0 2024-09-20T18:35:45.902 INFO:tasks.workunit.client.0.smithi017.stdout:8/58: getdents d0/d6 0 2024-09-20T18:35:45.905 INFO:tasks.workunit.client.0.smithi017.stdout:5/43: dwrite d0/f1 [0,4194304] 0 2024-09-20T18:35:45.905 INFO:tasks.workunit.client.0.smithi017.stdout:6/58: dwrite d4/f10 [0,4194304] 0 2024-09-20T18:35:45.905 INFO:tasks.workunit.client.1.smithi172.stdout:6/530: dwrite d0/d18/d1c/d21/d26/d34/f85 [0,4194304] 0 2024-09-20T18:35:45.906 INFO:tasks.workunit.client.1.smithi172.stdout:7/669: sync 2024-09-20T18:35:45.906 INFO:tasks.workunit.client.1.smithi172.stdout:1/580: getdents d0/d8/db/d25/d2b/d3d/d65 0 2024-09-20T18:35:45.908 INFO:tasks.workunit.client.1.smithi172.stdout:9/579: dread d15/d1f/d2c/d7d/d48/f4f [0,4194304] 0 2024-09-20T18:35:45.910 INFO:tasks.workunit.client.1.smithi172.stdout:4/628: creat d0/d48/d90/d55/d53/d78/dd9/fe6 x:0 0 0 2024-09-20T18:35:45.912 INFO:tasks.workunit.client.0.smithi017.stdout:2/151: fsync d1/f4 0 2024-09-20T18:35:45.913 INFO:tasks.workunit.client.0.smithi017.stdout:2/152: read d1/f28 [2002344,24113] 0 2024-09-20T18:35:45.914 INFO:tasks.workunit.client.0.smithi017.stdout:2/153: fsync d1/df/f1e 0 2024-09-20T18:35:45.917 INFO:tasks.workunit.client.1.smithi172.stdout:9/580: dwrite d15/d1a/d6f/f8a [0,4194304] 0 2024-09-20T18:35:45.917 INFO:tasks.workunit.client.1.smithi172.stdout:2/546: symlink d0/d2c/d3f/dab/d22/d10/d35/lb8 0 2024-09-20T18:35:45.920 INFO:tasks.workunit.client.1.smithi172.stdout:9/581: chown d15/l99 436783296 1 2024-09-20T18:35:45.923 INFO:tasks.workunit.client.1.smithi172.stdout:4/629: dwrite d0/d7/d6f/f79 [0,4194304] 0 2024-09-20T18:35:45.924 INFO:tasks.workunit.client.1.smithi172.stdout:5/625: truncate d4/df/d3f/f7c 3239476 0 2024-09-20T18:35:45.925 INFO:tasks.workunit.client.0.smithi017.stdout:3/299: symlink da/de/d13/d2f/l69 0 2024-09-20T18:35:45.926 INFO:tasks.workunit.client.0.smithi017.stdout:3/300: read da/de/d13/d2f/f2e [548822,2999] 0 2024-09-20T18:35:45.930 INFO:tasks.workunit.client.0.smithi017.stdout:0/104: truncate d4/db/f1c 3502610 0 2024-09-20T18:35:45.930 INFO:tasks.workunit.client.1.smithi172.stdout:6/531: creat d0/fae x:0 0 0 2024-09-20T18:35:45.932 INFO:tasks.workunit.client.1.smithi172.stdout:6/532: fdatasync d0/fae 0 2024-09-20T18:35:45.934 INFO:tasks.workunit.client.0.smithi017.stdout:7/74: symlink da/l15 0 2024-09-20T18:35:45.934 INFO:tasks.workunit.client.1.smithi172.stdout:7/670: chown d2/d3/d10/f96 1023600 1 2024-09-20T18:35:45.934 INFO:tasks.workunit.client.1.smithi172.stdout:0/766: dwrite d4/f85 [0,4194304] 0 2024-09-20T18:35:45.936 INFO:tasks.workunit.client.1.smithi172.stdout:8/590: link dd/d1b/d3b/d51/d5b/d6b/f98 dd/d65/d85/fcc 0 2024-09-20T18:35:45.938 INFO:tasks.workunit.client.0.smithi017.stdout:8/59: rename d0/d6/d10 to d0/d6/d13 0 2024-09-20T18:35:45.938 INFO:tasks.workunit.client.1.smithi172.stdout:7/671: stat d2/d3/dd/c36 0 2024-09-20T18:35:45.940 INFO:tasks.workunit.client.1.smithi172.stdout:5/626: dwrite d4/f14 [0,4194304] 0 2024-09-20T18:35:45.941 INFO:tasks.workunit.client.1.smithi172.stdout:8/591: chown dd/d65/fb6 625 1 2024-09-20T18:35:45.941 INFO:tasks.workunit.client.1.smithi172.stdout:4/630: dwrite d0/de/dc/d3c/d99/fce [0,4194304] 0 2024-09-20T18:35:45.941 INFO:tasks.workunit.client.0.smithi017.stdout:5/44: creat d0/fd x:0 0 0 2024-09-20T18:35:45.942 INFO:tasks.workunit.client.1.smithi172.stdout:5/627: write d4/df/fc0 [331189,64383] 0 2024-09-20T18:35:45.943 INFO:tasks.workunit.client.0.smithi017.stdout:5/45: write d0/f1 [2444905,29302] 0 2024-09-20T18:35:45.943 INFO:tasks.workunit.client.1.smithi172.stdout:3/670: getdents d0/d13/d32/d54/d71 0 2024-09-20T18:35:45.944 INFO:tasks.workunit.client.0.smithi017.stdout:6/59: creat d4/df/f15 x:0 0 0 2024-09-20T18:35:45.946 INFO:tasks.workunit.client.0.smithi017.stdout:6/60: write d4/df/f15 [586926,27717] 0 2024-09-20T18:35:45.947 INFO:tasks.workunit.client.1.smithi172.stdout:5/628: dread d4/df/dad/d26/d41/d69/dac/d2c/f7d [0,4194304] 0 2024-09-20T18:35:45.949 INFO:tasks.workunit.client.1.smithi172.stdout:2/547: creat d0/d2c/d3f/dab/d22/d10/d35/d5d/fb9 x:0 0 0 2024-09-20T18:35:45.953 INFO:tasks.workunit.client.0.smithi017.stdout:3/301: readlink da/de/d13/d16/l3a 0 2024-09-20T18:35:45.956 INFO:tasks.workunit.client.0.smithi017.stdout:0/105: symlink d4/l21 0 2024-09-20T18:35:45.957 INFO:tasks.workunit.client.1.smithi172.stdout:5/629: dwrite d4/df/dad/d26/fbd [0,4194304] 0 2024-09-20T18:35:45.958 INFO:tasks.workunit.client.0.smithi017.stdout:7/75: mkdir da/d16 0 2024-09-20T18:35:45.959 INFO:tasks.workunit.client.1.smithi172.stdout:5/630: write d4/df/dad/d26/d41/d69/dac/da7/fbe [1370086,103557] 0 2024-09-20T18:35:45.961 INFO:tasks.workunit.client.1.smithi172.stdout:8/592: creat dd/d1b/d4f/fcd x:0 0 0 2024-09-20T18:35:45.962 INFO:tasks.workunit.client.1.smithi172.stdout:9/582: symlink d15/d1f/d2c/d7d/d34/db5/lbe 0 2024-09-20T18:35:45.965 INFO:tasks.workunit.client.1.smithi172.stdout:5/631: dread d4/df/dad/d26/d41/f7f [0,4194304] 0 2024-09-20T18:35:45.967 INFO:tasks.workunit.client.1.smithi172.stdout:4/631: symlink d0/d48/d90/d55/d53/d78/le7 0 2024-09-20T18:35:45.969 INFO:tasks.workunit.client.1.smithi172.stdout:2/548: creat d0/d2c/d3f/fba x:0 0 0 2024-09-20T18:35:45.970 INFO:tasks.workunit.client.1.smithi172.stdout:1/581: creat d0/d8/fbf x:0 0 0 2024-09-20T18:35:45.970 INFO:tasks.workunit.client.1.smithi172.stdout:6/533: mkdir d0/d18/daf 0 2024-09-20T18:35:45.972 INFO:tasks.workunit.client.1.smithi172.stdout:1/582: fdatasync d0/d8/db/d25/d2b/d3d/f4d 0 2024-09-20T18:35:45.972 INFO:tasks.workunit.client.1.smithi172.stdout:6/534: dread - d0/d18/fa7 zero size 2024-09-20T18:35:45.973 INFO:tasks.workunit.client.0.smithi017.stdout:3/302: creat da/de/d14/f6a x:0 0 0 2024-09-20T18:35:45.974 INFO:tasks.workunit.client.1.smithi172.stdout:0/767: fdatasync d4/d5/d2e/d33/de1/d15/fd4 0 2024-09-20T18:35:45.974 INFO:tasks.workunit.client.0.smithi017.stdout:3/303: chown da/de/c18 30062 1 2024-09-20T18:35:45.975 INFO:tasks.workunit.client.1.smithi172.stdout:1/583: chown d0/d8/db/d39/f64 21 1 2024-09-20T18:35:45.976 INFO:tasks.workunit.client.1.smithi172.stdout:2/549: dwrite d0/f39 [0,4194304] 0 2024-09-20T18:35:45.977 INFO:tasks.workunit.client.1.smithi172.stdout:1/584: chown d0/d8/db/d39/l95 5483 1 2024-09-20T18:35:45.977 INFO:tasks.workunit.client.0.smithi017.stdout:7/76: creat da/f17 x:0 0 0 2024-09-20T18:35:45.978 INFO:tasks.workunit.client.1.smithi172.stdout:7/672: mkdir d2/de7 0 2024-09-20T18:35:45.980 INFO:tasks.workunit.client.0.smithi017.stdout:5/46: link d0/fd d0/fe 0 2024-09-20T18:35:45.981 INFO:tasks.workunit.client.1.smithi172.stdout:2/550: dread - d0/d2c/d3f/dab/d22/d10/d35/fb0 zero size 2024-09-20T18:35:45.981 INFO:tasks.workunit.client.0.smithi017.stdout:5/47: chown d0/l2 24290 1 2024-09-20T18:35:45.983 INFO:tasks.workunit.client.1.smithi172.stdout:1/585: write d0/d8/f2c [134275,117642] 0 2024-09-20T18:35:45.983 INFO:tasks.workunit.client.0.smithi017.stdout:6/61: link d4/f14 d4/df/f16 0 2024-09-20T18:35:45.984 INFO:tasks.workunit.client.0.smithi017.stdout:9/129: truncate d6/d23/d24/f2b 1415078 0 2024-09-20T18:35:45.985 INFO:tasks.workunit.client.1.smithi172.stdout:6/535: dwrite d0/d18/d1c/d21/d26/d34/d7a/f8b [0,4194304] 0 2024-09-20T18:35:45.986 INFO:tasks.workunit.client.0.smithi017.stdout:2/154: dwrite d1/fb [0,4194304] 0 2024-09-20T18:35:45.991 INFO:tasks.workunit.client.1.smithi172.stdout:7/673: dwrite d2/d3/fa7 [0,4194304] 0 2024-09-20T18:35:46.000 INFO:tasks.workunit.client.1.smithi172.stdout:5/632: dread d4/fe [0,4194304] 0 2024-09-20T18:35:46.002 INFO:tasks.workunit.client.1.smithi172.stdout:5/633: chown d4/df/dad/d26/d41/d69/dac/d2c/cb8 244253 1 2024-09-20T18:35:46.016 INFO:tasks.workunit.client.1.smithi172.stdout:9/583: mknod d15/cbf 0 2024-09-20T18:35:46.019 INFO:tasks.workunit.client.1.smithi172.stdout:6/536: creat d0/d18/d1c/d21/d26/d34/d7a/d47/d7b/d7e/fb0 x:0 0 0 2024-09-20T18:35:46.019 INFO:tasks.workunit.client.1.smithi172.stdout:3/671: link d0/d13/d1e/l42 d0/d13/d1e/le7 0 2024-09-20T18:35:46.023 INFO:tasks.workunit.client.1.smithi172.stdout:5/634: mkdir d4/df/dad/d26/d41/d69/dac/d2c/dd1 0 2024-09-20T18:35:46.023 INFO:tasks.workunit.client.1.smithi172.stdout:0/768: getdents d4/d1a/d28/d42/d45/d99/dc9/d107 0 2024-09-20T18:35:46.026 INFO:tasks.workunit.client.1.smithi172.stdout:2/551: truncate d0/d2c/d3f/dab/d18/d29/f57 497005 0 2024-09-20T18:35:46.029 INFO:tasks.workunit.client.1.smithi172.stdout:1/586: link d0/d8/db/d25/d6d/f7e d0/d8/db/d25/d2b/d3d/d65/fc0 0 2024-09-20T18:35:46.031 INFO:tasks.workunit.client.1.smithi172.stdout:7/674: truncate d2/d23/fce 1008893 0 2024-09-20T18:35:46.032 INFO:tasks.workunit.client.1.smithi172.stdout:5/635: symlink d4/df/d98/ld2 0 2024-09-20T18:35:46.033 INFO:tasks.workunit.client.1.smithi172.stdout:4/632: write d0/d48/d90/d55/d53/d78/f95 [424919,74511] 0 2024-09-20T18:35:46.036 INFO:tasks.workunit.client.1.smithi172.stdout:8/593: getdents dd/d1b 0 2024-09-20T18:35:46.038 INFO:tasks.workunit.client.1.smithi172.stdout:9/584: rename l3 to d15/d1a/d8d/lc0 0 2024-09-20T18:35:46.040 INFO:tasks.workunit.client.1.smithi172.stdout:9/585: write f6 [8122276,129991] 0 2024-09-20T18:35:46.041 INFO:tasks.workunit.client.1.smithi172.stdout:1/587: fsync d0/d8/d5f/fa9 0 2024-09-20T18:35:46.043 INFO:tasks.workunit.client.1.smithi172.stdout:6/537: mknod d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0/dad/cb1 0 2024-09-20T18:35:46.044 INFO:tasks.workunit.client.1.smithi172.stdout:7/675: dwrite d2/d3/d10/d40/d46/d8e/f6f [0,4194304] 0 2024-09-20T18:35:46.048 INFO:tasks.workunit.client.1.smithi172.stdout:7/676: chown d2/d3/d3d/d4e/d5f/c90 3306807 1 2024-09-20T18:35:46.049 INFO:tasks.workunit.client.1.smithi172.stdout:1/588: creat d0/d8/db/d25/d2b/fc1 x:0 0 0 2024-09-20T18:35:46.051 INFO:tasks.workunit.client.1.smithi172.stdout:1/589: fdatasync d0/f5a 0 2024-09-20T18:35:46.052 INFO:tasks.workunit.client.1.smithi172.stdout:8/594: dwrite dd/d1b/d3b/d51/dac/fbe [0,4194304] 0 2024-09-20T18:35:46.053 INFO:tasks.workunit.client.1.smithi172.stdout:1/590: dread - d0/f82 zero size 2024-09-20T18:35:46.055 INFO:tasks.workunit.client.1.smithi172.stdout:0/769: getdents d4/d44/dab 0 2024-09-20T18:35:46.055 INFO:tasks.workunit.client.1.smithi172.stdout:6/538: getdents d0/d18/d1c/d21/d26/d79 0 2024-09-20T18:35:46.057 INFO:tasks.workunit.client.1.smithi172.stdout:9/586: dwrite d15/d1f/d7e/f93 [0,4194304] 0 2024-09-20T18:35:46.057 INFO:tasks.workunit.client.1.smithi172.stdout:7/677: rename d2/d3/d10/l4b to d2/de7/le8 0 2024-09-20T18:35:46.059 INFO:tasks.workunit.client.1.smithi172.stdout:0/770: write d4/d5/d2e/d33/de1/fda [149716,13877] 0 2024-09-20T18:35:46.060 INFO:tasks.workunit.client.1.smithi172.stdout:2/552: dread d0/d2c/f63 [0,4194304] 0 2024-09-20T18:35:46.063 INFO:tasks.workunit.client.1.smithi172.stdout:9/587: chown d15/d1a/f91 64829 1 2024-09-20T18:35:46.064 INFO:tasks.workunit.client.1.smithi172.stdout:0/771: mknod d4/d20/c114 0 2024-09-20T18:35:46.066 INFO:tasks.workunit.client.1.smithi172.stdout:1/591: mkdir d0/dc2 0 2024-09-20T18:35:46.066 INFO:tasks.workunit.client.1.smithi172.stdout:3/672: write d0/dc/d6a/d22/f34 [6356484,34080] 0 2024-09-20T18:35:46.068 INFO:tasks.workunit.client.1.smithi172.stdout:8/595: mknod dd/d1b/d3b/d5d/cce 0 2024-09-20T18:35:46.069 INFO:tasks.workunit.client.1.smithi172.stdout:2/553: dwrite d0/d2c/d3f/dab/d22/d10/d35/fb0 [0,4194304] 0 2024-09-20T18:35:46.075 INFO:tasks.workunit.client.1.smithi172.stdout:7/678: creat d2/d3/d10/d40/d46/dd2/fe9 x:0 0 0 2024-09-20T18:35:46.075 INFO:tasks.workunit.client.1.smithi172.stdout:1/592: creat d0/d8/db/d25/d2b/fc3 x:0 0 0 2024-09-20T18:35:46.075 INFO:tasks.workunit.client.1.smithi172.stdout:1/593: chown d0/d8/lac 15 1 2024-09-20T18:35:46.075 INFO:tasks.workunit.client.1.smithi172.stdout:7/679: write d2/d3/d3d/d4e/fb1 [911230,17457] 0 2024-09-20T18:35:46.075 INFO:tasks.workunit.client.1.smithi172.stdout:3/673: symlink d0/dc/d6a/d3a/le8 0 2024-09-20T18:35:46.076 INFO:tasks.workunit.client.1.smithi172.stdout:5/636: write d4/df/dad/d26/f47 [328521,112449] 0 2024-09-20T18:35:46.077 INFO:tasks.workunit.client.0.smithi017.stdout:7/77: creat da/f18 x:0 0 0 2024-09-20T18:35:46.079 INFO:tasks.workunit.client.0.smithi017.stdout:9/130: symlink d6/d23/l30 0 2024-09-20T18:35:46.080 INFO:tasks.workunit.client.1.smithi172.stdout:2/554: rename d0/d2c/d51/d61 to d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/dbb 0 2024-09-20T18:35:46.080 INFO:tasks.workunit.client.0.smithi017.stdout:5/48: write d0/fd [270135,29131] 0 2024-09-20T18:35:46.080 INFO:tasks.workunit.client.0.smithi017.stdout:7/78: chown da/f12 34584915 1 2024-09-20T18:35:46.083 INFO:tasks.workunit.client.1.smithi172.stdout:1/594: mknod d0/d8/d12/d96/cc4 0 2024-09-20T18:35:46.084 INFO:tasks.workunit.client.0.smithi017.stdout:6/62: dwrite d4/f11 [0,4194304] 0 2024-09-20T18:35:46.085 INFO:tasks.workunit.client.1.smithi172.stdout:4/633: dwrite d0/d48/d90/f14 [4194304,4194304] 0 2024-09-20T18:35:46.085 INFO:tasks.workunit.client.1.smithi172.stdout:9/588: creat d15/fc1 x:0 0 0 2024-09-20T18:35:46.086 INFO:tasks.workunit.client.0.smithi017.stdout:7/79: write da/f13 [907995,92635] 0 2024-09-20T18:35:46.086 INFO:tasks.workunit.client.1.smithi172.stdout:1/595: write d0/d8/db/d25/d6f/f79 [566870,37847] 0 2024-09-20T18:35:46.087 INFO:tasks.workunit.client.0.smithi017.stdout:8/60: getdents d0/d6/d13 0 2024-09-20T18:35:46.091 INFO:tasks.workunit.client.0.smithi017.stdout:5/49: dread d0/f7 [0,4194304] 0 2024-09-20T18:35:46.092 INFO:tasks.workunit.client.0.smithi017.stdout:0/106: dwrite d4/ff [0,4194304] 0 2024-09-20T18:35:46.093 INFO:tasks.workunit.client.0.smithi017.stdout:5/50: chown d0/fc 1168302 1 2024-09-20T18:35:46.094 INFO:tasks.workunit.client.1.smithi172.stdout:3/674: chown d0/d13/d1e/l42 682482896 1 2024-09-20T18:35:46.094 INFO:tasks.workunit.client.0.smithi017.stdout:2/155: dread d1/df/f1e [4194304,4194304] 0 2024-09-20T18:35:46.096 INFO:tasks.workunit.client.0.smithi017.stdout:2/156: read d1/f1d [4148069,11858] 0 2024-09-20T18:35:46.096 INFO:tasks.workunit.client.0.smithi017.stdout:5/51: read d0/fd [105469,6300] 0 2024-09-20T18:35:46.097 INFO:tasks.workunit.client.1.smithi172.stdout:7/680: fdatasync d2/f87 0 2024-09-20T18:35:46.097 INFO:tasks.workunit.client.1.smithi172.stdout:6/539: dwrite d0/fe [4194304,4194304] 0 2024-09-20T18:35:46.098 INFO:tasks.workunit.client.0.smithi017.stdout:6/63: symlink d4/df/l17 0 2024-09-20T18:35:46.101 INFO:tasks.workunit.client.1.smithi172.stdout:2/555: creat d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/dbb/fbc x:0 0 0 2024-09-20T18:35:46.102 INFO:tasks.workunit.client.0.smithi017.stdout:5/52: dread d0/f1 [0,4194304] 0 2024-09-20T18:35:46.106 INFO:tasks.workunit.client.0.smithi017.stdout:7/80: unlink da/f10 0 2024-09-20T18:35:46.110 INFO:tasks.workunit.client.1.smithi172.stdout:4/634: mkdir d0/de/d39/d9f/de8 0 2024-09-20T18:35:46.111 INFO:tasks.workunit.client.1.smithi172.stdout:5/637: mknod d4/cd3 0 2024-09-20T18:35:46.112 INFO:tasks.workunit.client.0.smithi017.stdout:0/107: creat d4/db/d18/f22 x:0 0 0 2024-09-20T18:35:46.116 INFO:tasks.workunit.client.1.smithi172.stdout:0/772: getdents d4/d5/d2e 0 2024-09-20T18:35:46.117 INFO:tasks.workunit.client.0.smithi017.stdout:9/131: dwrite d6/d11/f12 [0,4194304] 0 2024-09-20T18:35:46.118 INFO:tasks.workunit.client.0.smithi017.stdout:2/157: unlink d1/f4 0 2024-09-20T18:35:46.119 INFO:tasks.workunit.client.1.smithi172.stdout:3/675: symlink d0/d13/d58/d6d/db9/de0/le9 0 2024-09-20T18:35:46.122 INFO:tasks.workunit.client.0.smithi017.stdout:2/158: read - d1/d1f/f33 zero size 2024-09-20T18:35:46.122 INFO:tasks.workunit.client.0.smithi017.stdout:6/64: mknod d4/c18 0 2024-09-20T18:35:46.124 INFO:tasks.workunit.client.0.smithi017.stdout:0/108: dwrite d4/db/d18/f19 [0,4194304] 0 2024-09-20T18:35:46.125 INFO:tasks.workunit.client.0.smithi017.stdout:6/65: dread - d4/f12 zero size 2024-09-20T18:35:46.126 INFO:tasks.workunit.client.1.smithi172.stdout:2/556: creat d0/d2c/d3f/dab/d22/d10/d35/d5d/fbd x:0 0 0 2024-09-20T18:35:46.126 INFO:tasks.workunit.client.1.smithi172.stdout:3/676: dwrite d0/dc/d6a/d22/f89 [0,4194304] 0 2024-09-20T18:35:46.127 INFO:tasks.workunit.client.0.smithi017.stdout:0/109: write d4/f6 [7280375,79950] 0 2024-09-20T18:35:46.127 INFO:tasks.workunit.client.0.smithi017.stdout:5/53: creat d0/ff x:0 0 0 2024-09-20T18:35:46.128 INFO:tasks.workunit.client.1.smithi172.stdout:2/557: write d0/d2c/d3f/dab/d22/d10/d3c/d68/f73 [1448887,90712] 0 2024-09-20T18:35:46.133 INFO:tasks.workunit.client.0.smithi017.stdout:7/81: symlink da/l19 0 2024-09-20T18:35:46.133 INFO:tasks.workunit.client.0.smithi017.stdout:7/82: dread - da/f12 zero size 2024-09-20T18:35:46.135 INFO:tasks.workunit.client.1.smithi172.stdout:6/540: rename d0/d18/d1c/d21/d26/d34/d6b/d7d/d35/f89 to d0/d18/d1c/d21/d26/d34/d7a/d47/d7b/d7e/fb2 0 2024-09-20T18:35:46.135 INFO:tasks.workunit.client.1.smithi172.stdout:4/635: mknod d0/d48/d90/db4/ce9 0 2024-09-20T18:35:46.136 INFO:tasks.workunit.client.1.smithi172.stdout:2/558: write d0/d1a/f33 [2645604,87485] 0 2024-09-20T18:35:46.139 INFO:tasks.workunit.client.1.smithi172.stdout:1/596: mknod d0/d8/db/d25/d2b/d3d/d65/d93/dbb/cc5 0 2024-09-20T18:35:46.141 INFO:tasks.workunit.client.0.smithi017.stdout:7/83: dwrite da/f18 [0,4194304] 0 2024-09-20T18:35:46.141 INFO:tasks.workunit.client.1.smithi172.stdout:4/636: dread d0/d7/d6f/fc0 [0,4194304] 0 2024-09-20T18:35:46.142 INFO:tasks.workunit.client.0.smithi017.stdout:7/84: fsync f4 0 2024-09-20T18:35:46.142 INFO:tasks.workunit.client.1.smithi172.stdout:6/541: dwrite d0/fc [8388608,4194304] 0 2024-09-20T18:35:46.146 INFO:tasks.workunit.client.1.smithi172.stdout:6/542: read d0/d18/d1c/d21/d26/d34/d6b/d7d/d35/f4f [8565754,107846] 0 2024-09-20T18:35:46.153 INFO:tasks.workunit.client.0.smithi017.stdout:2/159: creat d1/dc/d20/d22/f36 x:0 0 0 2024-09-20T18:35:46.154 INFO:tasks.workunit.client.0.smithi017.stdout:8/61: write d0/fa [1934029,27285] 0 2024-09-20T18:35:46.154 INFO:tasks.workunit.client.1.smithi172.stdout:3/677: fdatasync d0/d13/d32/d54/fe2 0 2024-09-20T18:35:46.155 INFO:tasks.workunit.client.0.smithi017.stdout:8/62: write d0/f2 [4417190,33921] 0 2024-09-20T18:35:46.156 INFO:tasks.workunit.client.0.smithi017.stdout:8/63: truncate d0/f7 4951536 0 2024-09-20T18:35:46.157 INFO:tasks.workunit.client.1.smithi172.stdout:7/681: dwrite d2/d3/d10/f18 [0,4194304] 0 2024-09-20T18:35:46.159 INFO:tasks.workunit.client.1.smithi172.stdout:8/596: link dd/d1b/c5a dd/d1b/d3b/d51/d34/ccf 0 2024-09-20T18:35:46.160 INFO:tasks.workunit.client.0.smithi017.stdout:6/66: mknod d4/c19 0 2024-09-20T18:35:46.162 INFO:tasks.workunit.client.0.smithi017.stdout:0/110: symlink d4/l23 0 2024-09-20T18:35:46.165 INFO:tasks.workunit.client.0.smithi017.stdout:5/54: rename d0/fd to d0/f10 0 2024-09-20T18:35:46.165 INFO:tasks.workunit.client.0.smithi017.stdout:5/55: stat d0/ff 0 2024-09-20T18:35:46.167 INFO:tasks.workunit.client.1.smithi172.stdout:0/773: write d4/d1a/d28/d75/d60/fa3 [1245305,28936] 0 2024-09-20T18:35:46.169 INFO:tasks.workunit.client.1.smithi172.stdout:6/543: dread d0/d18/d1c/d21/d26/f45 [0,4194304] 0 2024-09-20T18:35:46.171 INFO:tasks.workunit.client.1.smithi172.stdout:6/544: write d0/fae [1016771,55667] 0 2024-09-20T18:35:46.173 INFO:tasks.workunit.client.0.smithi017.stdout:7/85: creat da/f1a x:0 0 0 2024-09-20T18:35:46.176 INFO:tasks.workunit.client.0.smithi017.stdout:9/132: rename d6/d23/d24/f2b to d6/d2c/d2f/f31 0 2024-09-20T18:35:46.178 INFO:tasks.workunit.client.0.smithi017.stdout:2/160: mkdir d1/d1f/d37 0 2024-09-20T18:35:46.180 INFO:tasks.workunit.client.0.smithi017.stdout:9/133: dread d6/d11/f1b [0,4194304] 0 2024-09-20T18:35:46.182 INFO:tasks.workunit.client.0.smithi017.stdout:9/134: write d6/fb [5098498,8966] 0 2024-09-20T18:35:46.184 INFO:tasks.workunit.client.0.smithi017.stdout:6/67: symlink d4/l1a 0 2024-09-20T18:35:46.186 INFO:tasks.workunit.client.0.smithi017.stdout:6/68: read - d4/f14 zero size 2024-09-20T18:35:46.186 INFO:tasks.workunit.client.1.smithi172.stdout:6/545: dread d0/d18/d1c/d21/d26/d34/d39/d46/f7 [4194304,4194304] 0 2024-09-20T18:35:46.187 INFO:tasks.workunit.client.1.smithi172.stdout:6/546: chown d0/d18/d1c/d21/d26/d34/d39/d74 1 1 2024-09-20T18:35:46.188 INFO:tasks.workunit.client.0.smithi017.stdout:2/161: dwrite d1/dc/d20/d22/f34 [0,4194304] 0 2024-09-20T18:35:46.194 INFO:tasks.workunit.client.0.smithi017.stdout:9/135: symlink d6/d1f/l32 0 2024-09-20T18:35:46.199 INFO:tasks.workunit.client.1.smithi172.stdout:8/597: rmdir dd/d1b/d3b/d51 39 2024-09-20T18:35:46.202 INFO:tasks.workunit.client.1.smithi172.stdout:0/774: creat d4/d5/d2e/d67/f115 x:0 0 0 2024-09-20T18:35:46.207 INFO:tasks.workunit.client.1.smithi172.stdout:6/547: creat d0/d18/d1c/d21/d26/d34/fb3 x:0 0 0 2024-09-20T18:35:46.208 INFO:tasks.workunit.client.1.smithi172.stdout:5/638: sync 2024-09-20T18:35:46.208 INFO:tasks.workunit.client.1.smithi172.stdout:6/548: stat d0/d18/d1c/d21/d26/d34/d6b/d7d 0 2024-09-20T18:35:46.209 INFO:tasks.workunit.client.0.smithi017.stdout:7/86: write da/f14 [381600,99376] 0 2024-09-20T18:35:46.209 INFO:tasks.workunit.client.0.smithi017.stdout:2/162: creat d1/dc/d20/d2e/f38 x:0 0 0 2024-09-20T18:35:46.209 INFO:tasks.workunit.client.0.smithi017.stdout:7/87: fsync da/f17 0 2024-09-20T18:35:46.210 INFO:tasks.workunit.client.0.smithi017.stdout:2/163: stat d1/df/c23 0 2024-09-20T18:35:46.211 INFO:tasks.workunit.client.1.smithi172.stdout:4/637: mkdir d0/d48/d90/dea 0 2024-09-20T18:35:46.212 INFO:tasks.workunit.client.1.smithi172.stdout:4/638: stat d0/de/l6 0 2024-09-20T18:35:46.212 INFO:tasks.workunit.client.1.smithi172.stdout:4/639: readlink d0/de/l88 0 2024-09-20T18:35:46.212 INFO:tasks.workunit.client.0.smithi017.stdout:8/64: rename d0/fb to d0/f14 0 2024-09-20T18:35:46.213 INFO:tasks.workunit.client.0.smithi017.stdout:9/136: rmdir d6/d1f 39 2024-09-20T18:35:46.214 INFO:tasks.workunit.client.0.smithi017.stdout:9/137: chown d6 53551 1 2024-09-20T18:35:46.214 INFO:tasks.workunit.client.0.smithi017.stdout:0/111: truncate f2 2643596 0 2024-09-20T18:35:46.217 INFO:tasks.workunit.client.1.smithi172.stdout:7/682: dwrite d2/d3/dd/f19 [0,4194304] 0 2024-09-20T18:35:46.218 INFO:tasks.workunit.client.0.smithi017.stdout:2/164: symlink d1/dc/l39 0 2024-09-20T18:35:46.219 INFO:tasks.workunit.client.1.smithi172.stdout:8/598: chown dd/c22 3222669 1 2024-09-20T18:35:46.220 INFO:tasks.workunit.client.1.smithi172.stdout:8/599: write dd/d1b/d4f/d86/dbc/fbf [971816,108621] 0 2024-09-20T18:35:46.220 INFO:tasks.workunit.client.1.smithi172.stdout:0/775: rmdir d4/d5 39 2024-09-20T18:35:46.221 INFO:tasks.workunit.client.0.smithi017.stdout:8/65: rmdir d0 39 2024-09-20T18:35:46.222 INFO:tasks.workunit.client.1.smithi172.stdout:9/589: link d15/d1f/d2c/d37/l5b d15/lc2 0 2024-09-20T18:35:46.223 INFO:tasks.workunit.client.1.smithi172.stdout:9/590: dread - d15/d1f/d2c/d7d/d34/faf zero size 2024-09-20T18:35:46.223 INFO:tasks.workunit.client.1.smithi172.stdout:9/591: dread - d15/d1a/d6f/fbd zero size 2024-09-20T18:35:46.225 INFO:tasks.workunit.client.0.smithi017.stdout:5/56: dwrite d0/f10 [0,4194304] 0 2024-09-20T18:35:46.227 INFO:tasks.workunit.client.1.smithi172.stdout:3/678: truncate d0/dc/d6a/f3e 1849073 0 2024-09-20T18:35:46.228 INFO:tasks.workunit.client.0.smithi017.stdout:5/57: readlink d0/l2 0 2024-09-20T18:35:46.229 INFO:tasks.workunit.client.0.smithi017.stdout:9/138: truncate d6/d1f/f20 9185855 0 2024-09-20T18:35:46.229 INFO:tasks.workunit.client.0.smithi017.stdout:5/58: write d0/ff [990586,83912] 0 2024-09-20T18:35:46.230 INFO:tasks.workunit.client.0.smithi017.stdout:9/139: write d6/fb [3500581,23254] 0 2024-09-20T18:35:46.232 INFO:tasks.workunit.client.0.smithi017.stdout:5/59: truncate d0/fc 602155 0 2024-09-20T18:35:46.232 INFO:tasks.workunit.client.0.smithi017.stdout:9/140: write d6/d1f/f20 [5039845,122188] 0 2024-09-20T18:35:46.232 INFO:tasks.workunit.client.0.smithi017.stdout:7/88: mkdir da/d16/d1b 0 2024-09-20T18:35:46.234 INFO:tasks.workunit.client.0.smithi017.stdout:9/141: write d6/f14 [422224,120690] 0 2024-09-20T18:35:46.234 INFO:tasks.workunit.client.1.smithi172.stdout:6/549: unlink d0/d18/d1c/d21/d26/d34/d7a/c3d 0 2024-09-20T18:35:46.234 INFO:tasks.workunit.client.0.smithi017.stdout:7/89: write da/f14 [643556,59760] 0 2024-09-20T18:35:46.238 INFO:tasks.workunit.client.1.smithi172.stdout:5/639: write d4/f62 [1044685,119338] 0 2024-09-20T18:35:46.241 INFO:tasks.workunit.client.1.smithi172.stdout:7/683: creat d2/d3/d3d/d4e/d8b/fea x:0 0 0 2024-09-20T18:35:46.241 INFO:tasks.workunit.client.0.smithi017.stdout:0/112: mkdir d4/db/d1e/d24 0 2024-09-20T18:35:46.242 INFO:tasks.workunit.client.0.smithi017.stdout:0/113: chown d4/l23 17019899 1 2024-09-20T18:35:46.242 INFO:tasks.workunit.client.1.smithi172.stdout:8/600: fdatasync dd/d1b/d3b/d51/d5b/daf/d4d/fc1 0 2024-09-20T18:35:46.243 INFO:tasks.workunit.client.1.smithi172.stdout:8/601: readlink dd/d1b/l6f 0 2024-09-20T18:35:46.243 INFO:tasks.workunit.client.1.smithi172.stdout:0/776: fsync d4/d44/f61 0 2024-09-20T18:35:46.244 INFO:tasks.workunit.client.1.smithi172.stdout:9/592: creat d15/d1f/d7e/fc3 x:0 0 0 2024-09-20T18:35:46.245 INFO:tasks.workunit.client.0.smithi017.stdout:9/142: rmdir d6/d1f 39 2024-09-20T18:35:46.245 INFO:tasks.workunit.client.0.smithi017.stdout:9/143: dread - d6/f2e zero size 2024-09-20T18:35:46.246 INFO:tasks.workunit.client.0.smithi017.stdout:9/144: chown d6/d23/d24/c25 11710 1 2024-09-20T18:35:46.247 INFO:tasks.workunit.client.1.smithi172.stdout:2/559: getdents d0/d2c/d3f/dab/d22/d10/d35 0 2024-09-20T18:35:46.247 INFO:tasks.workunit.client.0.smithi017.stdout:7/90: mkdir da/d16/d1c 0 2024-09-20T18:35:46.248 INFO:tasks.workunit.client.1.smithi172.stdout:6/550: readlink d0/d18/d1c/d21/d26/d34/d39/d46/l41 0 2024-09-20T18:35:46.248 INFO:tasks.workunit.client.0.smithi017.stdout:7/91: write da/f18 [428322,46481] 0 2024-09-20T18:35:46.249 INFO:tasks.workunit.client.0.smithi017.stdout:7/92: chown da/f17 418 1 2024-09-20T18:35:46.249 INFO:tasks.workunit.client.1.smithi172.stdout:1/597: getdents d0/d73 0 2024-09-20T18:35:46.249 INFO:tasks.workunit.client.1.smithi172.stdout:6/551: chown d0/d18/d1c/d21/d26/d34/d7a/d47/d62 1 1 2024-09-20T18:35:46.250 INFO:tasks.workunit.client.0.smithi017.stdout:8/66: rename d0/d6/d13/c11 to d0/d6/c15 0 2024-09-20T18:35:46.251 INFO:tasks.workunit.client.0.smithi017.stdout:0/114: mkdir d4/db/d18/d25 0 2024-09-20T18:35:46.252 INFO:tasks.workunit.client.1.smithi172.stdout:2/560: read d0/d2c/f3d [3232594,92003] 0 2024-09-20T18:35:46.252 INFO:tasks.workunit.client.1.smithi172.stdout:5/640: readlink d4/df/dad/d26/d41/d69/la0 0 2024-09-20T18:35:46.253 INFO:tasks.workunit.client.0.smithi017.stdout:2/165: creat d1/f3a x:0 0 0 2024-09-20T18:35:46.253 INFO:tasks.workunit.client.1.smithi172.stdout:5/641: chown d4/f36 264 1 2024-09-20T18:35:46.256 INFO:tasks.workunit.client.1.smithi172.stdout:5/642: fsync d4/df/dad/d26/d41/d69/dac/f1e 0 2024-09-20T18:35:46.257 INFO:tasks.workunit.client.1.smithi172.stdout:1/598: dwrite d0/d8/db/d25/d2b/d3d/f8e [4194304,4194304] 0 2024-09-20T18:35:46.259 INFO:tasks.workunit.client.1.smithi172.stdout:8/602: fdatasync dd/d65/f9e 0 2024-09-20T18:35:46.262 INFO:tasks.workunit.client.0.smithi017.stdout:8/67: creat d0/d6/f16 x:0 0 0 2024-09-20T18:35:46.263 INFO:tasks.workunit.client.1.smithi172.stdout:9/593: mknod d15/d20/d76/cc4 0 2024-09-20T18:35:46.266 INFO:tasks.workunit.client.0.smithi017.stdout:2/166: chown d1/df/d17/l1c 1 1 2024-09-20T18:35:46.267 INFO:tasks.workunit.client.0.smithi017.stdout:2/167: chown d1/df/c23 14584026 1 2024-09-20T18:35:46.269 INFO:tasks.workunit.client.0.smithi017.stdout:9/145: creat d6/d1f/f33 x:0 0 0 2024-09-20T18:35:46.272 INFO:tasks.workunit.client.0.smithi017.stdout:7/93: creat da/d16/d1c/f1d x:0 0 0 2024-09-20T18:35:46.273 INFO:tasks.workunit.client.0.smithi017.stdout:7/94: write da/f17 [970215,67090] 0 2024-09-20T18:35:46.273 INFO:tasks.workunit.client.0.smithi017.stdout:7/95: stat l7 0 2024-09-20T18:35:46.273 INFO:tasks.workunit.client.1.smithi172.stdout:4/640: creat d0/feb x:0 0 0 2024-09-20T18:35:46.274 INFO:tasks.workunit.client.1.smithi172.stdout:3/679: dwrite d0/dc/d6a/d3a/d74/fcc [0,4194304] 0 2024-09-20T18:35:46.275 INFO:tasks.workunit.client.0.smithi017.stdout:8/68: unlink d0/c9 0 2024-09-20T18:35:46.278 INFO:tasks.workunit.client.1.smithi172.stdout:3/680: dread - d0/d13/d58/d6d/db9/fb4 zero size 2024-09-20T18:35:46.278 INFO:tasks.workunit.client.1.smithi172.stdout:2/561: chown d0/lb3 2 1 2024-09-20T18:35:46.279 INFO:tasks.workunit.client.0.smithi017.stdout:0/115: symlink d4/d20/l26 0 2024-09-20T18:35:46.279 INFO:tasks.workunit.client.1.smithi172.stdout:7/684: fsync d2/d3/d10/d40/d46/fa8 0 2024-09-20T18:35:46.281 INFO:tasks.workunit.client.1.smithi172.stdout:9/594: dread d15/d1a/d82/f77 [0,4194304] 0 2024-09-20T18:35:46.282 INFO:tasks.workunit.client.1.smithi172.stdout:7/685: truncate d2/d3/d3d/d4e/d5f/f61 4264694 0 2024-09-20T18:35:46.285 INFO:tasks.workunit.client.0.smithi017.stdout:7/96: mknod da/c1e 0 2024-09-20T18:35:46.285 INFO:tasks.workunit.client.0.smithi017.stdout:7/97: stat l7 0 2024-09-20T18:35:46.286 INFO:tasks.workunit.client.1.smithi172.stdout:6/552: write d0/d18/d1c/d21/f56 [1022326,63231] 0 2024-09-20T18:35:46.287 INFO:tasks.workunit.client.1.smithi172.stdout:1/599: mknod d0/d8/db/d25/d2b/d3d/cc6 0 2024-09-20T18:35:46.287 INFO:tasks.workunit.client.1.smithi172.stdout:1/600: read - d0/d8/db/d25/d2b/fc3 zero size 2024-09-20T18:35:46.289 INFO:tasks.workunit.client.1.smithi172.stdout:8/603: unlink dd/d1b/d3b/d51/d5b/d6b/fba 0 2024-09-20T18:35:46.289 INFO:tasks.workunit.client.1.smithi172.stdout:1/601: dread - d0/d8/db/d25/d2b/fc1 zero size 2024-09-20T18:35:46.291 INFO:tasks.workunit.client.1.smithi172.stdout:0/777: mkdir d4/d1a/d28/d42/d45/d99/de9/d116 0 2024-09-20T18:35:46.293 INFO:tasks.workunit.client.1.smithi172.stdout:3/681: dread d0/d13/d58/f4a [0,4194304] 0 2024-09-20T18:35:46.293 INFO:tasks.workunit.client.1.smithi172.stdout:6/553: dwrite d0/d18/f1e [0,4194304] 0 2024-09-20T18:35:46.293 INFO:tasks.workunit.client.0.smithi017.stdout:2/168: write d1/f1d [11174,19575] 0 2024-09-20T18:35:46.295 INFO:tasks.workunit.client.0.smithi017.stdout:2/169: write d1/dc/d20/d22/f34 [3263517,85298] 0 2024-09-20T18:35:46.295 INFO:tasks.workunit.client.0.smithi017.stdout:7/98: creat da/d16/d1c/f1f x:0 0 0 2024-09-20T18:35:46.295 INFO:tasks.workunit.client.1.smithi172.stdout:4/641: rmdir d0/de/d39/db8/d72 39 2024-09-20T18:35:46.296 INFO:tasks.workunit.client.0.smithi017.stdout:2/170: read d1/f28 [2223534,85796] 0 2024-09-20T18:35:46.296 INFO:tasks.workunit.client.0.smithi017.stdout:7/99: write da/f12 [992312,101974] 0 2024-09-20T18:35:46.297 INFO:tasks.workunit.client.0.smithi017.stdout:7/100: readlink da/l15 0 2024-09-20T18:35:46.298 INFO:tasks.workunit.client.0.smithi017.stdout:7/101: chown da/f17 1 1 2024-09-20T18:35:46.299 INFO:tasks.workunit.client.1.smithi172.stdout:1/602: dwrite d0/d8/db/d25/d6f/f79 [0,4194304] 0 2024-09-20T18:35:46.300 INFO:tasks.workunit.client.1.smithi172.stdout:6/554: truncate d0/d18/d1c/d21/d26/d34/d39/d74/f95 1603187 0 2024-09-20T18:35:46.300 INFO:tasks.workunit.client.1.smithi172.stdout:2/562: symlink d0/d2c/d3f/dab/d22/d10/d97/lbe 0 2024-09-20T18:35:46.302 INFO:tasks.workunit.client.0.smithi017.stdout:9/146: creat d6/f34 x:0 0 0 2024-09-20T18:35:46.302 INFO:tasks.workunit.client.1.smithi172.stdout:3/682: dwrite d0/d13/f1c [0,4194304] 0 2024-09-20T18:35:46.303 INFO:tasks.workunit.client.1.smithi172.stdout:2/563: fdatasync d0/d1a/f33 0 2024-09-20T18:35:46.307 INFO:tasks.workunit.client.1.smithi172.stdout:2/564: write d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/dbb/f9e [1279699,29085] 0 2024-09-20T18:35:46.311 INFO:tasks.workunit.client.1.smithi172.stdout:3/683: dwrite d0/dc/d6a/d22/f34 [8388608,4194304] 0 2024-09-20T18:35:46.312 INFO:tasks.workunit.client.1.smithi172.stdout:5/643: fsync d4/df/d3f/f7c 0 2024-09-20T18:35:46.316 INFO:tasks.workunit.client.0.smithi017.stdout:8/69: truncate d0/fa 1853020 0 2024-09-20T18:35:46.316 INFO:tasks.workunit.client.0.smithi017.stdout:7/102: mknod da/d16/d1c/c20 0 2024-09-20T18:35:46.316 INFO:tasks.workunit.client.0.smithi017.stdout:0/116: write d4/f6 [3569424,114727] 0 2024-09-20T18:35:46.317 INFO:tasks.workunit.client.0.smithi017.stdout:8/70: fdatasync d0/d6/fe 0 2024-09-20T18:35:46.317 INFO:tasks.workunit.client.0.smithi017.stdout:0/117: chown d4/l15 835 1 2024-09-20T18:35:46.318 INFO:tasks.workunit.client.1.smithi172.stdout:5/644: read d4/df/dad/d26/d41/d69/dac/f2b [3914250,39515] 0 2024-09-20T18:35:46.319 INFO:tasks.workunit.client.1.smithi172.stdout:5/645: chown d4/df/dad/d26/d2d/d86 52679 1 2024-09-20T18:35:46.319 INFO:tasks.workunit.client.0.smithi017.stdout:9/147: symlink d6/d23/l35 0 2024-09-20T18:35:46.320 INFO:tasks.workunit.client.1.smithi172.stdout:5/646: write d4/df/dad/d26/d41/d69/dac/f2b [2164883,33941] 0 2024-09-20T18:35:46.321 INFO:tasks.workunit.client.1.smithi172.stdout:5/647: readlink d4/df/dad/d26/l9f 0 2024-09-20T18:35:46.324 INFO:tasks.workunit.client.0.smithi017.stdout:2/171: creat d1/d1f/d37/f3b x:0 0 0 2024-09-20T18:35:46.325 INFO:tasks.workunit.client.0.smithi017.stdout:8/71: symlink d0/d6/l17 0 2024-09-20T18:35:46.326 INFO:tasks.workunit.client.1.smithi172.stdout:1/603: rmdir d0/d8/db/d25/d2b/d3d/d65 39 2024-09-20T18:35:46.326 INFO:tasks.workunit.client.0.smithi017.stdout:7/103: dwrite da/f17 [0,4194304] 0 2024-09-20T18:35:46.329 INFO:tasks.workunit.client.0.smithi017.stdout:9/148: mknod d6/d11/c36 0 2024-09-20T18:35:46.331 INFO:tasks.workunit.client.0.smithi017.stdout:0/118: mknod d4/db/d1e/d24/c27 0 2024-09-20T18:35:46.332 INFO:tasks.workunit.client.0.smithi017.stdout:0/119: fdatasync d4/f8 0 2024-09-20T18:35:46.333 INFO:tasks.workunit.client.0.smithi017.stdout:0/120: write f2 [269005,87178] 0 2024-09-20T18:35:46.333 INFO:tasks.workunit.client.0.smithi017.stdout:0/121: chown d4/c7 6 1 2024-09-20T18:35:46.334 INFO:tasks.workunit.client.1.smithi172.stdout:9/595: creat d15/d1f/d88/fc5 x:0 0 0 2024-09-20T18:35:46.334 INFO:tasks.workunit.client.1.smithi172.stdout:9/596: dread - d15/d1f/d7e/fc3 zero size 2024-09-20T18:35:46.335 INFO:tasks.workunit.client.0.smithi017.stdout:7/104: mknod da/c21 0 2024-09-20T18:35:46.336 INFO:tasks.workunit.client.0.smithi017.stdout:7/105: write da/f12 [1742025,94891] 0 2024-09-20T18:35:46.337 INFO:tasks.workunit.client.0.smithi017.stdout:7/106: readlink l7 0 2024-09-20T18:35:46.338 INFO:tasks.workunit.client.1.smithi172.stdout:3/684: dread d0/dc/d6a/d22/f7a [4194304,4194304] 0 2024-09-20T18:35:46.339 INFO:tasks.workunit.client.1.smithi172.stdout:3/685: chown d0/d13/d32/d54/d71/f9c 198235 1 2024-09-20T18:35:46.340 INFO:tasks.workunit.client.0.smithi017.stdout:2/172: symlink d1/dc/d20/d2e/d30/l3c 0 2024-09-20T18:35:46.343 INFO:tasks.workunit.client.1.smithi172.stdout:2/565: rmdir d0/d2c/d3f/dab/d22/d10/d3c 39 2024-09-20T18:35:46.345 INFO:tasks.workunit.client.1.smithi172.stdout:3/686: dwrite d0/d13/d58/d6d/db9/d87/f9d [0,4194304] 0 2024-09-20T18:35:46.351 INFO:tasks.workunit.client.1.smithi172.stdout:0/778: mknod d4/d5/d2e/d33/de1/d7f/c117 0 2024-09-20T18:35:46.353 INFO:tasks.workunit.client.1.smithi172.stdout:4/642: mknod d0/de/d39/db8/d72/d18/d51/d9a/cec 0 2024-09-20T18:35:46.354 INFO:tasks.workunit.client.0.smithi017.stdout:2/173: readlink d1/dc/d20/l29 0 2024-09-20T18:35:46.355 INFO:tasks.workunit.client.1.smithi172.stdout:7/686: truncate d2/d3/d10/f2c 4070437 0 2024-09-20T18:35:46.355 INFO:tasks.workunit.client.1.smithi172.stdout:4/643: read d0/f2a [660277,66570] 0 2024-09-20T18:35:46.368 INFO:tasks.workunit.client.1.smithi172.stdout:4/644: dread d0/fa [0,4194304] 0 2024-09-20T18:35:46.369 INFO:tasks.workunit.client.1.smithi172.stdout:4/645: chown d0/d48/d90/d55/d53/d5c/cb6 5204 1 2024-09-20T18:35:46.372 INFO:tasks.workunit.client.1.smithi172.stdout:1/604: dread d0/d8/db/f33 [0,4194304] 0 2024-09-20T18:35:46.460 INFO:tasks.workunit.client.0.smithi017.stdout:8/72: rmdir d0/d6/d13 0 2024-09-20T18:35:46.461 INFO:tasks.workunit.client.0.smithi017.stdout:8/73: fsync d0/d6/fe 0 2024-09-20T18:35:46.462 INFO:tasks.workunit.client.1.smithi172.stdout:6/555: link d0/d18/f23 d0/d18/d1c/d21/d26/d34/d39/d46/fb4 0 2024-09-20T18:35:46.463 INFO:tasks.workunit.client.1.smithi172.stdout:9/597: mkdir d15/d20/d76/dc6 0 2024-09-20T18:35:46.494 INFO:tasks.workunit.client.0.smithi017.stdout:4/52: sync 2024-09-20T18:35:46.497 INFO:tasks.workunit.client.0.smithi017.stdout:9/149: creat d6/f37 x:0 0 0 2024-09-20T18:35:46.498 INFO:tasks.workunit.client.0.smithi017.stdout:9/150: stat d6/ca 0 2024-09-20T18:35:46.502 INFO:tasks.workunit.client.0.smithi017.stdout:7/107: dwrite da/f11 [4194304,4194304] 0 2024-09-20T18:35:46.504 INFO:tasks.workunit.client.0.smithi017.stdout:2/174: rename d1/dc/d20/d22 to d1/dc/d35/d3d 0 2024-09-20T18:35:46.507 INFO:tasks.workunit.client.0.smithi017.stdout:0/122: write d4/db/f1c [268918,32186] 0 2024-09-20T18:35:46.508 INFO:tasks.workunit.client.0.smithi017.stdout:0/123: chown d4/d20/l26 609493564 1 2024-09-20T18:35:46.509 INFO:tasks.workunit.client.0.smithi017.stdout:0/124: chown d4/l15 38850 1 2024-09-20T18:35:46.509 INFO:tasks.workunit.client.1.smithi172.stdout:8/604: creat dd/d1b/d3b/d5d/fd0 x:0 0 0 2024-09-20T18:35:46.511 INFO:tasks.workunit.client.1.smithi172.stdout:5/648: mkdir d4/df/dad/dd4 0 2024-09-20T18:35:46.512 INFO:tasks.workunit.client.1.smithi172.stdout:5/649: dread - d4/df/dad/d26/d41/f9e zero size 2024-09-20T18:35:46.515 INFO:tasks.workunit.client.1.smithi172.stdout:2/566: write d0/d2c/d3f/dab/d18/f6e [505380,76199] 0 2024-09-20T18:35:46.515 INFO:tasks.workunit.client.0.smithi017.stdout:0/125: dread f2 [0,4194304] 0 2024-09-20T18:35:46.515 INFO:tasks.workunit.client.1.smithi172.stdout:7/687: truncate d2/d3/d10/d40/d46/fa8 41455 0 2024-09-20T18:35:46.516 INFO:tasks.workunit.client.1.smithi172.stdout:2/567: dread - d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/dbb/fbc zero size 2024-09-20T18:35:46.518 INFO:tasks.workunit.client.0.smithi017.stdout:7/108: creat da/f22 x:0 0 0 2024-09-20T18:35:46.520 INFO:tasks.workunit.client.0.smithi017.stdout:2/175: creat d1/d1f/f3e x:0 0 0 2024-09-20T18:35:46.522 INFO:tasks.workunit.client.1.smithi172.stdout:6/556: symlink d0/d18/d1c/d21/d26/d34/da2/lb5 0 2024-09-20T18:35:46.522 INFO:tasks.workunit.client.1.smithi172.stdout:4/646: dwrite d0/de/d39/db8/d72/f70 [0,4194304] 0 2024-09-20T18:35:46.522 INFO:tasks.workunit.client.0.smithi017.stdout:2/176: dread - d1/dc/d20/d2e/f38 zero size 2024-09-20T18:35:46.525 INFO:tasks.workunit.client.0.smithi017.stdout:7/109: dwrite da/f11 [0,4194304] 0 2024-09-20T18:35:46.526 INFO:tasks.workunit.client.0.smithi017.stdout:4/53: creat d4/de/d16/f17 x:0 0 0 2024-09-20T18:35:46.530 INFO:tasks.workunit.client.0.smithi017.stdout:8/74: unlink d0/fa 0 2024-09-20T18:35:46.532 INFO:tasks.workunit.client.1.smithi172.stdout:2/568: dread d0/f91 [0,4194304] 0 2024-09-20T18:35:46.532 INFO:tasks.workunit.client.1.smithi172.stdout:3/687: creat d0/d13/d58/d6d/d7f/d84/dd9/fea x:0 0 0 2024-09-20T18:35:46.535 INFO:tasks.workunit.client.1.smithi172.stdout:0/779: creat d4/d1a/d28/d42/d45/d54/df8/f118 x:0 0 0 2024-09-20T18:35:46.537 INFO:tasks.workunit.client.1.smithi172.stdout:5/650: creat d4/df/dad/d26/fd5 x:0 0 0 2024-09-20T18:35:46.539 INFO:tasks.workunit.client.0.smithi017.stdout:2/177: creat d1/d1f/f3f x:0 0 0 2024-09-20T18:35:46.541 INFO:tasks.workunit.client.1.smithi172.stdout:7/688: rename d2/d3/d3d/d68/ca5 to d2/d3/d86/ceb 0 2024-09-20T18:35:46.542 INFO:tasks.workunit.client.0.smithi017.stdout:7/110: mknod da/c23 0 2024-09-20T18:35:46.544 INFO:tasks.workunit.client.0.smithi017.stdout:2/178: dread d1/fb [0,4194304] 0 2024-09-20T18:35:46.546 INFO:tasks.workunit.client.0.smithi017.stdout:8/75: mknod d0/d6/c18 0 2024-09-20T18:35:46.546 INFO:tasks.workunit.client.0.smithi017.stdout:2/179: write d1/dc/d20/d2e/f38 [821097,60653] 0 2024-09-20T18:35:46.547 INFO:tasks.workunit.client.0.smithi017.stdout:2/180: write d1/fb [1975745,79125] 0 2024-09-20T18:35:46.549 INFO:tasks.workunit.client.0.smithi017.stdout:0/126: mkdir d4/db/d28 0 2024-09-20T18:35:46.554 INFO:tasks.workunit.client.0.smithi017.stdout:7/111: rename l7 to da/l24 0 2024-09-20T18:35:46.554 INFO:tasks.workunit.client.0.smithi017.stdout:2/181: rename d1/dc to d1/dc/d40 22 2024-09-20T18:35:46.555 INFO:tasks.workunit.client.0.smithi017.stdout:7/112: chown da/f18 2932 1 2024-09-20T18:35:46.555 INFO:tasks.workunit.client.0.smithi017.stdout:4/54: getdents d4/dd/d14 0 2024-09-20T18:35:46.557 INFO:tasks.workunit.client.1.smithi172.stdout:3/688: creat d0/dc/d6a/dc5/feb x:0 0 0 2024-09-20T18:35:46.558 INFO:tasks.workunit.client.1.smithi172.stdout:8/605: creat dd/d1b/d3b/d51/d5b/dc5/fd1 x:0 0 0 2024-09-20T18:35:46.559 INFO:tasks.workunit.client.0.smithi017.stdout:9/151: link l5 d6/d23/l38 0 2024-09-20T18:35:46.560 INFO:tasks.workunit.client.1.smithi172.stdout:8/606: read dd/d1b/f8d [450338,12457] 0 2024-09-20T18:35:46.562 INFO:tasks.workunit.client.0.smithi017.stdout:4/55: dwrite d4/dc/f12 [0,4194304] 0 2024-09-20T18:35:46.563 INFO:tasks.workunit.client.0.smithi017.stdout:0/127: creat d4/f29 x:0 0 0 2024-09-20T18:35:46.564 INFO:tasks.workunit.client.0.smithi017.stdout:0/128: read - d4/f29 zero size 2024-09-20T18:35:46.568 INFO:tasks.workunit.client.0.smithi017.stdout:9/152: dwrite d6/fb [0,4194304] 0 2024-09-20T18:35:46.569 INFO:tasks.workunit.client.1.smithi172.stdout:7/689: symlink d2/d3/d10/d40/d6a/dc6/dd8/lec 0 2024-09-20T18:35:46.569 INFO:tasks.workunit.client.0.smithi017.stdout:9/153: fsync d6/d11/f29 0 2024-09-20T18:35:46.571 INFO:tasks.workunit.client.0.smithi017.stdout:7/113: creat da/f25 x:0 0 0 2024-09-20T18:35:46.573 INFO:tasks.workunit.client.1.smithi172.stdout:7/690: dread d2/d3/d10/f1b [0,4194304] 0 2024-09-20T18:35:46.576 INFO:tasks.workunit.client.1.smithi172.stdout:1/605: creat d0/d8/db/d25/d2b/d3d/fc7 x:0 0 0 2024-09-20T18:35:46.578 INFO:tasks.workunit.client.1.smithi172.stdout:7/691: dwrite d2/d3/d10/f18 [0,4194304] 0 2024-09-20T18:35:46.580 INFO:tasks.workunit.client.0.smithi017.stdout:7/114: dwrite da/f25 [0,4194304] 0 2024-09-20T18:35:46.581 INFO:tasks.workunit.client.0.smithi017.stdout:7/115: chown da/c21 0 1 2024-09-20T18:35:46.584 INFO:tasks.workunit.client.0.smithi017.stdout:4/56: creat d4/dd/f18 x:0 0 0 2024-09-20T18:35:46.584 INFO:tasks.workunit.client.0.smithi017.stdout:4/57: chown d4/fa 49050741 1 2024-09-20T18:35:46.585 INFO:tasks.workunit.client.1.smithi172.stdout:9/598: rmdir d15/d4a/d8c/da5 0 2024-09-20T18:35:46.586 INFO:tasks.workunit.client.1.smithi172.stdout:0/780: dwrite d4/d5/d2e/d33/de1/f37 [0,4194304] 0 2024-09-20T18:35:46.589 INFO:tasks.workunit.client.0.smithi017.stdout:2/182: mknod d1/c41 0 2024-09-20T18:35:46.589 INFO:tasks.workunit.client.1.smithi172.stdout:3/689: creat d0/d13/d58/d6d/d7f/d84/fec x:0 0 0 2024-09-20T18:35:46.589 INFO:tasks.workunit.client.0.smithi017.stdout:2/183: chown d1/d1f/f3e 4930177 1 2024-09-20T18:35:46.591 INFO:tasks.workunit.client.0.smithi017.stdout:9/154: mknod d6/d23/d24/c39 0 2024-09-20T18:35:46.592 INFO:tasks.workunit.client.0.smithi017.stdout:8/76: creat d0/f19 x:0 0 0 2024-09-20T18:35:46.594 INFO:tasks.workunit.client.1.smithi172.stdout:3/690: dread d0/d13/d32/f9b [0,4194304] 0 2024-09-20T18:35:46.595 INFO:tasks.workunit.client.0.smithi017.stdout:7/116: rename l9 to da/d16/d1b/l26 0 2024-09-20T18:35:46.596 INFO:tasks.workunit.client.0.smithi017.stdout:2/184: dread d1/f28 [0,4194304] 0 2024-09-20T18:35:46.596 INFO:tasks.workunit.client.1.smithi172.stdout:3/691: dread - d0/d13/d58/d6d/d7f/fb1 zero size 2024-09-20T18:35:46.597 INFO:tasks.workunit.client.0.smithi017.stdout:7/117: write da/f18 [4006690,75846] 0 2024-09-20T18:35:46.599 INFO:tasks.workunit.client.0.smithi017.stdout:0/129: getdents d4/db/d18/d25 0 2024-09-20T18:35:46.600 INFO:tasks.workunit.client.0.smithi017.stdout:2/185: dread d1/f28 [0,4194304] 0 2024-09-20T18:35:46.602 INFO:tasks.workunit.client.0.smithi017.stdout:4/58: rename d4/d10 to d4/d19 0 2024-09-20T18:35:46.603 INFO:tasks.workunit.client.0.smithi017.stdout:4/59: write f0 [555491,113333] 0 2024-09-20T18:35:46.604 INFO:tasks.workunit.client.1.smithi172.stdout:4/647: truncate d0/d48/d90/fbf 308752 0 2024-09-20T18:35:46.610 INFO:tasks.workunit.client.1.smithi172.stdout:2/569: truncate d0/d2c/d3f/dab/d22/d10/d35/d5d/f64 176365 0 2024-09-20T18:35:46.612 INFO:tasks.workunit.client.1.smithi172.stdout:0/781: stat d4/d5/d2e/d33/de1/d15/dfe/d10c 0 2024-09-20T18:35:46.616 INFO:tasks.workunit.client.0.smithi017.stdout:8/77: dwrite d0/f2 [4194304,4194304] 0 2024-09-20T18:35:46.617 INFO:tasks.workunit.client.0.smithi017.stdout:8/78: chown d0/cf 78069869 1 2024-09-20T18:35:46.617 INFO:tasks.workunit.client.0.smithi017.stdout:1/28: sync 2024-09-20T18:35:46.619 INFO:tasks.workunit.client.0.smithi017.stdout:0/130: creat d4/d20/f2a x:0 0 0 2024-09-20T18:35:46.621 INFO:tasks.workunit.client.0.smithi017.stdout:0/131: write d4/db/f12 [721016,96660] 0 2024-09-20T18:35:46.622 INFO:tasks.workunit.client.0.smithi017.stdout:2/186: creat d1/dc/d20/d2e/f42 x:0 0 0 2024-09-20T18:35:46.623 INFO:tasks.workunit.client.0.smithi017.stdout:8/79: dread d0/f2 [4194304,4194304] 0 2024-09-20T18:35:46.623 INFO:tasks.workunit.client.1.smithi172.stdout:1/606: mknod d0/d8/db/d25/db7/cc8 0 2024-09-20T18:35:46.624 INFO:tasks.workunit.client.0.smithi017.stdout:0/132: write d4/db/fc [661047,130734] 0 2024-09-20T18:35:46.624 INFO:tasks.workunit.client.0.smithi017.stdout:2/187: read d1/f2d [1272461,56499] 0 2024-09-20T18:35:46.625 INFO:tasks.workunit.client.0.smithi017.stdout:0/133: stat d4/db/d1e/d24 0 2024-09-20T18:35:46.626 INFO:tasks.workunit.client.1.smithi172.stdout:6/557: getdents d0/d18 0 2024-09-20T18:35:46.627 INFO:tasks.workunit.client.1.smithi172.stdout:6/558: chown d0/d18/d1c/d21/d26/d9b 9113 1 2024-09-20T18:35:46.628 INFO:tasks.workunit.client.1.smithi172.stdout:6/559: write d0/f36 [3409554,125911] 0 2024-09-20T18:35:46.629 INFO:tasks.workunit.client.1.smithi172.stdout:6/560: chown d0/d18 15840077 1 2024-09-20T18:35:46.629 INFO:tasks.workunit.client.1.smithi172.stdout:6/561: write d0/f4a [2487067,91828] 0 2024-09-20T18:35:46.629 INFO:tasks.workunit.client.1.smithi172.stdout:4/648: mkdir d0/d48/d90/db4/ded 0 2024-09-20T18:35:46.631 INFO:tasks.workunit.client.1.smithi172.stdout:4/649: write d0/de/d39/db8/d72/d18/d51/d9a/fab [4787138,21406] 0 2024-09-20T18:35:46.632 INFO:tasks.workunit.client.1.smithi172.stdout:4/650: chown d0 13465 1 2024-09-20T18:35:46.634 INFO:tasks.workunit.client.1.smithi172.stdout:7/692: unlink d2/d23/lb3 0 2024-09-20T18:35:46.635 INFO:tasks.workunit.client.1.smithi172.stdout:9/599: creat d15/d20/db2/fc7 x:0 0 0 2024-09-20T18:35:46.636 INFO:tasks.workunit.client.0.smithi017.stdout:1/29: rename c0 to c7 0 2024-09-20T18:35:46.637 INFO:tasks.workunit.client.1.smithi172.stdout:2/570: creat d0/d2c/d3f/dab/d22/d10/d97/fbf x:0 0 0 2024-09-20T18:35:46.638 INFO:tasks.workunit.client.1.smithi172.stdout:7/693: truncate d2/d3/d3d/dd4/fdd 306737 0 2024-09-20T18:35:46.638 INFO:tasks.workunit.client.1.smithi172.stdout:6/562: dwrite d0/d18/d1c/d21/f56 [0,4194304] 0 2024-09-20T18:35:46.639 INFO:tasks.workunit.client.1.smithi172.stdout:7/694: stat d2/d3/c48 0 2024-09-20T18:35:46.640 INFO:tasks.workunit.client.1.smithi172.stdout:0/782: creat d4/d1a/d28/d75/d60/dba/f119 x:0 0 0 2024-09-20T18:35:46.641 INFO:tasks.workunit.client.0.smithi017.stdout:8/80: rmdir d0/d6 39 2024-09-20T18:35:46.641 INFO:tasks.workunit.client.1.smithi172.stdout:6/563: write d0/d18/fa7 [644744,36849] 0 2024-09-20T18:35:46.642 INFO:tasks.workunit.client.0.smithi017.stdout:2/188: rmdir d1/df/d17 39 2024-09-20T18:35:46.643 INFO:tasks.workunit.client.1.smithi172.stdout:0/783: fdatasync d4/fbe 0 2024-09-20T18:35:46.644 INFO:tasks.workunit.client.1.smithi172.stdout:4/651: dwrite d0/de/d39/d9f/fc5 [0,4194304] 0 2024-09-20T18:35:46.644 INFO:tasks.workunit.client.1.smithi172.stdout:5/651: getdents d4/df/dad/d26 0 2024-09-20T18:35:46.646 INFO:tasks.workunit.client.1.smithi172.stdout:0/784: stat d4/d1a/d28/d42/d45/d99/dc9/fe3 0 2024-09-20T18:35:46.646 INFO:tasks.workunit.client.1.smithi172.stdout:3/692: creat d0/dc/d6a/d3a/dcb/fed x:0 0 0 2024-09-20T18:35:46.647 INFO:tasks.workunit.client.1.smithi172.stdout:3/693: chown d0/d13/d32/ce3 320250 1 2024-09-20T18:35:46.647 INFO:tasks.workunit.client.0.smithi017.stdout:4/60: getdents d4/dd/d14 0 2024-09-20T18:35:46.650 INFO:tasks.workunit.client.0.smithi017.stdout:4/61: read - d4/dd/f18 zero size 2024-09-20T18:35:46.651 INFO:tasks.workunit.client.0.smithi017.stdout:9/155: dwrite d6/d2c/d2f/f31 [0,4194304] 0 2024-09-20T18:35:46.659 INFO:tasks.workunit.client.1.smithi172.stdout:1/607: write d0/d8/d12/f29 [1661159,63777] 0 2024-09-20T18:35:46.659 INFO:tasks.workunit.client.0.smithi017.stdout:1/30: dread f2 [0,4194304] 0 2024-09-20T18:35:46.659 INFO:tasks.workunit.client.0.smithi017.stdout:1/31: chown c4 8691542 1 2024-09-20T18:35:46.660 INFO:tasks.workunit.client.0.smithi017.stdout:1/32: readlink - no filename 2024-09-20T18:35:46.660 INFO:tasks.workunit.client.0.smithi017.stdout:1/33: chown c6 2093416 1 2024-09-20T18:35:46.661 INFO:tasks.workunit.client.0.smithi017.stdout:8/81: rmdir d0 39 2024-09-20T18:35:46.663 INFO:tasks.workunit.client.0.smithi017.stdout:2/189: rmdir d1/dc/d35 39 2024-09-20T18:35:46.665 INFO:tasks.workunit.client.1.smithi172.stdout:9/600: chown d15/d1a/l7b 112255795 1 2024-09-20T18:35:46.665 INFO:tasks.workunit.client.1.smithi172.stdout:9/601: stat d15 0 2024-09-20T18:35:46.667 INFO:tasks.workunit.client.1.smithi172.stdout:2/571: mkdir d0/d1a/dc0 0 2024-09-20T18:35:46.668 INFO:tasks.workunit.client.1.smithi172.stdout:2/572: write d0/d2c/d3f/dab/d22/d10/f1f [509385,7246] 0 2024-09-20T18:35:46.670 INFO:tasks.workunit.client.0.smithi017.stdout:4/62: symlink d4/d19/l1a 0 2024-09-20T18:35:46.678 INFO:tasks.workunit.client.1.smithi172.stdout:4/652: mknod d0/de/d39/cee 0 2024-09-20T18:35:46.678 INFO:tasks.workunit.client.0.smithi017.stdout:0/134: link d4/l15 d4/db/d28/l2b 0 2024-09-20T18:35:46.682 INFO:tasks.workunit.client.0.smithi017.stdout:4/63: mkdir d4/de/d1b 0 2024-09-20T18:35:46.683 INFO:tasks.workunit.client.0.smithi017.stdout:4/64: dread - d4/dd/f18 zero size 2024-09-20T18:35:46.683 INFO:tasks.workunit.client.0.smithi017.stdout:9/156: write d6/ff [2861931,61845] 0 2024-09-20T18:35:46.684 INFO:tasks.workunit.client.0.smithi017.stdout:4/65: write d4/dd/f18 [321324,7710] 0 2024-09-20T18:35:46.684 INFO:tasks.workunit.client.1.smithi172.stdout:2/573: dread d0/f3 [0,4194304] 0 2024-09-20T18:35:46.685 INFO:tasks.workunit.client.1.smithi172.stdout:3/694: creat d0/dc/d6a/d3a/d74/fee x:0 0 0 2024-09-20T18:35:46.691 INFO:tasks.workunit.client.0.smithi017.stdout:2/190: rename d1/f1d to d1/dc/d35/d3d/f43 0 2024-09-20T18:35:46.691 INFO:tasks.workunit.client.0.smithi017.stdout:4/66: mknod d4/c1c 0 2024-09-20T18:35:46.691 INFO:tasks.workunit.client.1.smithi172.stdout:1/608: readlink d0/d8/db/d25/d2b/d3d/d65/l80 0 2024-09-20T18:35:46.691 INFO:tasks.workunit.client.1.smithi172.stdout:0/785: dread d4/d1a/d28/d42/f55 [0,4194304] 0 2024-09-20T18:35:46.692 INFO:tasks.workunit.client.1.smithi172.stdout:1/609: fsync d0/d8/d12/d96/f9e 0 2024-09-20T18:35:46.692 INFO:tasks.workunit.client.1.smithi172.stdout:2/574: dwrite d0/d2c/d3f/dab/d22/d10/f21 [4194304,4194304] 0 2024-09-20T18:35:46.692 INFO:tasks.workunit.client.1.smithi172.stdout:0/786: readlink d4/d20/le7 0 2024-09-20T18:35:46.692 INFO:tasks.workunit.client.0.smithi017.stdout:8/82: symlink d0/d6/l1a 0 2024-09-20T18:35:46.693 INFO:tasks.workunit.client.1.smithi172.stdout:0/787: stat d4/d94 0 2024-09-20T18:35:46.693 INFO:tasks.workunit.client.1.smithi172.stdout:1/610: chown d0/d8/db/d25/d2b/d3d/fc7 858006278 1 2024-09-20T18:35:46.693 INFO:tasks.workunit.client.1.smithi172.stdout:2/575: stat d0/d2c/d3f/dab/d22/d10/f1f 0 2024-09-20T18:35:46.696 INFO:tasks.workunit.client.0.smithi017.stdout:2/191: creat d1/dc/d35/d3d/f44 x:0 0 0 2024-09-20T18:35:46.698 INFO:tasks.workunit.client.0.smithi017.stdout:4/67: symlink d4/dc/l1d 0 2024-09-20T18:35:46.698 INFO:tasks.workunit.client.0.smithi017.stdout:9/157: dwrite d6/d11/f1b [4194304,4194304] 0 2024-09-20T18:35:46.699 INFO:tasks.workunit.client.0.smithi017.stdout:2/192: dread - d1/dc/d20/f26 zero size 2024-09-20T18:35:46.700 INFO:tasks.workunit.client.1.smithi172.stdout:0/788: dwrite d4/d94/ff1 [0,4194304] 0 2024-09-20T18:35:46.701 INFO:tasks.workunit.client.0.smithi017.stdout:8/83: creat d0/d6/f1b x:0 0 0 2024-09-20T18:35:46.701 INFO:tasks.workunit.client.0.smithi017.stdout:2/193: readlink d1/l27 0 2024-09-20T18:35:46.702 INFO:tasks.workunit.client.0.smithi017.stdout:2/194: dread - d1/dc/d20/f26 zero size 2024-09-20T18:35:46.705 INFO:tasks.workunit.client.0.smithi017.stdout:0/135: creat d4/db/f2c x:0 0 0 2024-09-20T18:35:46.706 INFO:tasks.workunit.client.0.smithi017.stdout:2/195: write d1/dc/d35/d3d/f36 [737821,98213] 0 2024-09-20T18:35:46.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:46 smithi172 ceph-mon[35456]: pgmap v27: 65 pgs: 65 active+clean; 1.2 GiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 30 MiB/s rd, 159 MiB/s wr, 418 op/s 2024-09-20T18:35:46.709 INFO:tasks.workunit.client.1.smithi172.stdout:9/602: symlink d15/d20/d76/dc6/lc8 0 2024-09-20T18:35:46.710 INFO:tasks.workunit.client.0.smithi017.stdout:2/196: write d1/dc/d20/d2e/f38 [1456411,104563] 0 2024-09-20T18:35:46.711 INFO:tasks.workunit.client.0.smithi017.stdout:8/84: dwrite d0/f19 [0,4194304] 0 2024-09-20T18:35:46.714 INFO:tasks.workunit.client.0.smithi017.stdout:4/68: rename d4/dd to d4/dc/d1e 0 2024-09-20T18:35:46.716 INFO:tasks.workunit.client.1.smithi172.stdout:7/695: write d2/d23/f30 [1135113,102659] 0 2024-09-20T18:35:46.718 INFO:tasks.workunit.client.0.smithi017.stdout:9/158: mkdir d6/d23/d3a 0 2024-09-20T18:35:46.720 INFO:tasks.workunit.client.0.smithi017.stdout:0/136: mknod d4/c2d 0 2024-09-20T18:35:46.720 INFO:tasks.workunit.client.0.smithi017.stdout:0/137: dread - d4/f29 zero size 2024-09-20T18:35:46.721 INFO:tasks.workunit.client.1.smithi172.stdout:2/576: symlink d0/d2c/d3f/dab/d18/d3b/lc1 0 2024-09-20T18:35:46.721 INFO:tasks.workunit.client.1.smithi172.stdout:1/611: dread d0/d8/f8a [0,4194304] 0 2024-09-20T18:35:46.723 INFO:tasks.workunit.client.1.smithi172.stdout:4/653: rename d0/de/d39/db8/d72/d18/c3d to d0/d48/d90/db4/ded/cef 0 2024-09-20T18:35:46.724 INFO:tasks.workunit.client.0.smithi017.stdout:2/197: rmdir d1/dc/d35/d3d 39 2024-09-20T18:35:46.725 INFO:tasks.workunit.client.1.smithi172.stdout:2/577: dread d0/f39 [0,4194304] 0 2024-09-20T18:35:46.725 INFO:tasks.workunit.client.1.smithi172.stdout:5/652: creat d4/df/dad/d26/d41/fd6 x:0 0 0 2024-09-20T18:35:46.727 INFO:tasks.workunit.client.1.smithi172.stdout:2/578: chown d0/d2c/d3f/dab/d22/d10/d6a/d98/d59/c8c 64140315 1 2024-09-20T18:35:46.728 INFO:tasks.workunit.client.0.smithi017.stdout:4/69: creat d4/d19/f1f x:0 0 0 2024-09-20T18:35:46.729 INFO:tasks.workunit.client.0.smithi017.stdout:0/138: dwrite d4/db/d18/f22 [0,4194304] 0 2024-09-20T18:35:46.732 INFO:tasks.workunit.client.1.smithi172.stdout:0/789: rmdir d4/d1a/d28/d42/d45/d99/de9 39 2024-09-20T18:35:46.732 INFO:tasks.workunit.client.0.smithi017.stdout:9/159: creat d6/d2c/d2f/f3b x:0 0 0 2024-09-20T18:35:46.733 INFO:tasks.workunit.client.1.smithi172.stdout:0/790: write d4/d1a/d28/d42/f83 [314248,34350] 0 2024-09-20T18:35:46.734 INFO:tasks.workunit.client.1.smithi172.stdout:0/791: write d4/d5/d2e/d33/de1/fdb [252243,33049] 0 2024-09-20T18:35:46.735 INFO:tasks.workunit.client.0.smithi017.stdout:4/70: dread d4/fa [0,4194304] 0 2024-09-20T18:35:46.735 INFO:tasks.workunit.client.1.smithi172.stdout:0/792: readlink d4/d5/d2e/d38/la8 0 2024-09-20T18:35:46.736 INFO:tasks.workunit.client.0.smithi017.stdout:4/71: chown l2 592057455 1 2024-09-20T18:35:46.736 INFO:tasks.workunit.client.1.smithi172.stdout:8/607: sync 2024-09-20T18:35:46.736 INFO:tasks.workunit.client.1.smithi172.stdout:9/603: unlink d15/d1a/f26 0 2024-09-20T18:35:46.738 INFO:tasks.workunit.client.0.smithi017.stdout:2/198: chown d1/df/d17/l2c 15 1 2024-09-20T18:35:46.739 INFO:tasks.workunit.client.1.smithi172.stdout:7/696: stat d2/d23/d3a/f5c 0 2024-09-20T18:35:46.742 INFO:tasks.workunit.client.1.smithi172.stdout:9/604: dwrite d15/d4a/d8c/f97 [0,4194304] 0 2024-09-20T18:35:46.743 INFO:tasks.workunit.client.1.smithi172.stdout:9/605: fsync d15/d1f/d2c/d7d/d48/f81 0 2024-09-20T18:35:46.745 INFO:tasks.workunit.client.0.smithi017.stdout:0/139: creat d4/d20/f2e x:0 0 0 2024-09-20T18:35:46.746 INFO:tasks.workunit.client.0.smithi017.stdout:0/140: read d4/db/f1c [1510580,60895] 0 2024-09-20T18:35:46.751 INFO:tasks.workunit.client.0.smithi017.stdout:9/160: rename d6/d11/f1e to d6/d23/d3a/f3c 0 2024-09-20T18:35:46.752 INFO:tasks.workunit.client.0.smithi017.stdout:9/161: chown d6/ff 234233299 1 2024-09-20T18:35:46.755 INFO:tasks.workunit.client.0.smithi017.stdout:2/199: creat d1/d1f/f45 x:0 0 0 2024-09-20T18:35:46.756 INFO:tasks.workunit.client.1.smithi172.stdout:5/653: truncate d4/df/f74 1216628 0 2024-09-20T18:35:46.757 INFO:tasks.workunit.client.0.smithi017.stdout:2/200: write d1/f3a [771670,51405] 0 2024-09-20T18:35:46.758 INFO:tasks.workunit.client.0.smithi017.stdout:8/85: creat d0/f1c x:0 0 0 2024-09-20T18:35:46.760 INFO:tasks.workunit.client.1.smithi172.stdout:2/579: unlink d0/l5 0 2024-09-20T18:35:46.760 INFO:tasks.workunit.client.0.smithi017.stdout:2/201: dread - d1/dc/d20/f26 zero size 2024-09-20T18:35:46.761 INFO:tasks.workunit.client.0.smithi017.stdout:9/162: dwrite d6/d11/f13 [0,4194304] 0 2024-09-20T18:35:46.762 INFO:tasks.workunit.client.0.smithi017.stdout:9/163: stat d6/d1f/l32 0 2024-09-20T18:35:46.762 INFO:tasks.workunit.client.0.smithi017.stdout:2/202: truncate d1/dc/d20/f26 12314 0 2024-09-20T18:35:46.763 INFO:tasks.workunit.client.0.smithi017.stdout:2/203: dread - d1/d1f/f45 zero size 2024-09-20T18:35:46.765 INFO:tasks.workunit.client.1.smithi172.stdout:0/793: creat d4/d5/d2e/d33/f11a x:0 0 0 2024-09-20T18:35:46.766 INFO:tasks.workunit.client.1.smithi172.stdout:8/608: chown dd/c20 0 1 2024-09-20T18:35:46.767 INFO:tasks.workunit.client.0.smithi017.stdout:4/72: symlink d4/dc/d1e/d14/l20 0 2024-09-20T18:35:46.769 INFO:tasks.workunit.client.0.smithi017.stdout:4/73: write d4/d19/f15 [974170,108412] 0 2024-09-20T18:35:46.770 INFO:tasks.workunit.client.1.smithi172.stdout:0/794: dwrite d4/d1a/d28/f9a [0,4194304] 0 2024-09-20T18:35:46.771 INFO:tasks.workunit.client.1.smithi172.stdout:0/795: fdatasync d4/d1a/d28/d75/f8d 0 2024-09-20T18:35:46.771 INFO:tasks.workunit.client.0.smithi017.stdout:8/86: unlink d0/d6/fe 0 2024-09-20T18:35:46.772 INFO:tasks.workunit.client.1.smithi172.stdout:0/796: fdatasync d4/d5/d2e/d33/de1/d15/fd4 0 2024-09-20T18:35:46.773 INFO:tasks.workunit.client.1.smithi172.stdout:6/564: sync 2024-09-20T18:35:46.774 INFO:tasks.workunit.client.1.smithi172.stdout:9/606: dread - d15/d1f/f69 zero size 2024-09-20T18:35:46.775 INFO:tasks.workunit.client.1.smithi172.stdout:9/607: write d15/d1a/d6f/f94 [1181384,14123] 0 2024-09-20T18:35:46.776 INFO:tasks.workunit.client.1.smithi172.stdout:1/612: mkdir d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9 0 2024-09-20T18:35:46.777 INFO:tasks.workunit.client.1.smithi172.stdout:9/608: read f14 [974959,1827] 0 2024-09-20T18:35:46.777 INFO:tasks.workunit.client.1.smithi172.stdout:9/609: chown d15/d1f/d2c/d7d/d34/c56 316 1 2024-09-20T18:35:46.778 INFO:tasks.workunit.client.1.smithi172.stdout:9/610: chown d15/d1f/d7e/cb4 75153 1 2024-09-20T18:35:46.779 INFO:tasks.workunit.client.0.smithi017.stdout:0/141: truncate d4/f8 318234 0 2024-09-20T18:35:46.781 INFO:tasks.workunit.client.1.smithi172.stdout:4/654: symlink d0/de/d21/dc7/lf0 0 2024-09-20T18:35:46.782 INFO:tasks.workunit.client.0.smithi017.stdout:2/204: dread d1/df/d17/f1a [0,4194304] 0 2024-09-20T18:35:46.783 INFO:tasks.workunit.client.0.smithi017.stdout:2/205: fsync d1/d1f/f33 0 2024-09-20T18:35:46.787 INFO:tasks.workunit.client.0.smithi017.stdout:5/60: sync 2024-09-20T18:35:46.787 INFO:tasks.workunit.client.0.smithi017.stdout:3/304: sync 2024-09-20T18:35:46.787 INFO:tasks.workunit.client.0.smithi017.stdout:6/69: sync 2024-09-20T18:35:46.790 INFO:tasks.workunit.client.1.smithi172.stdout:3/695: getdents d0/dc 0 2024-09-20T18:35:46.790 INFO:tasks.workunit.client.0.smithi017.stdout:5/61: dread d0/fc [0,4194304] 0 2024-09-20T18:35:46.792 INFO:tasks.workunit.client.0.smithi017.stdout:5/62: chown d0 20200888 1 2024-09-20T18:35:46.792 INFO:tasks.workunit.client.0.smithi017.stdout:4/74: creat d4/de/d16/f21 x:0 0 0 2024-09-20T18:35:46.792 INFO:tasks.workunit.client.0.smithi017.stdout:2/206: dwrite d1/d1f/d37/f3b [0,4194304] 0 2024-09-20T18:35:46.793 INFO:tasks.workunit.client.0.smithi017.stdout:4/75: chown d4/d19/f1f 14836023 1 2024-09-20T18:35:46.795 INFO:tasks.workunit.client.1.smithi172.stdout:8/609: creat dd/d1b/d3b/d51/d5b/d6b/fd2 x:0 0 0 2024-09-20T18:35:46.797 INFO:tasks.workunit.client.0.smithi017.stdout:8/87: rename d0/cf to d0/d6/c1d 0 2024-09-20T18:35:46.797 INFO:tasks.workunit.client.1.smithi172.stdout:3/696: dwrite d0/d13/d58/d6d/dc3/fc7 [0,4194304] 0 2024-09-20T18:35:46.799 INFO:tasks.workunit.client.1.smithi172.stdout:3/697: dread - d0/d13/db2/fdc zero size 2024-09-20T18:35:46.801 INFO:tasks.workunit.client.0.smithi017.stdout:0/142: mkdir d4/db/d1e/d24/d2f 0 2024-09-20T18:35:46.802 INFO:tasks.workunit.client.1.smithi172.stdout:5/654: dread d4/df/d3f/d64/f76 [0,4194304] 0 2024-09-20T18:35:46.806 INFO:tasks.workunit.client.0.smithi017.stdout:8/88: dwrite d0/d6/f16 [0,4194304] 0 2024-09-20T18:35:46.808 INFO:tasks.workunit.client.1.smithi172.stdout:2/580: dread d0/d2c/d3f/dab/d18/d29/f56 [0,4194304] 0 2024-09-20T18:35:46.808 INFO:tasks.workunit.client.0.smithi017.stdout:7/118: sync 2024-09-20T18:35:46.808 INFO:tasks.workunit.client.0.smithi017.stdout:1/34: sync 2024-09-20T18:35:46.809 INFO:tasks.workunit.client.1.smithi172.stdout:5/655: dread d4/df/dad/d26/d41/d69/dac/f84 [0,4194304] 0 2024-09-20T18:35:46.811 INFO:tasks.workunit.client.0.smithi017.stdout:6/70: unlink d4/df/l17 0 2024-09-20T18:35:46.815 INFO:tasks.workunit.client.1.smithi172.stdout:9/611: unlink d15/d1a/l52 0 2024-09-20T18:35:46.815 INFO:tasks.workunit.client.0.smithi017.stdout:5/63: read d0/f7 [786099,4804] 0 2024-09-20T18:35:46.817 INFO:tasks.workunit.client.0.smithi017.stdout:9/164: creat d6/f3d x:0 0 0 2024-09-20T18:35:46.822 INFO:tasks.workunit.client.0.smithi017.stdout:0/143: creat d4/db/d1e/d24/f30 x:0 0 0 2024-09-20T18:35:46.824 INFO:tasks.workunit.client.1.smithi172.stdout:7/697: dwrite d2/f47 [0,4194304] 0 2024-09-20T18:35:46.826 INFO:tasks.workunit.client.1.smithi172.stdout:0/797: dread d4/d5/d2e/d33/de1/d15/f50 [0,4194304] 0 2024-09-20T18:35:46.831 INFO:tasks.workunit.client.1.smithi172.stdout:6/565: creat d0/d18/d1c/d21/d26/d34/d7a/d99/d9e/fb6 x:0 0 0 2024-09-20T18:35:46.831 INFO:tasks.workunit.client.1.smithi172.stdout:2/581: dwrite d0/f91 [0,4194304] 0 2024-09-20T18:35:46.833 INFO:tasks.workunit.client.0.smithi017.stdout:7/119: unlink da/f25 0 2024-09-20T18:35:46.835 INFO:tasks.workunit.client.1.smithi172.stdout:2/582: write d0/d2c/d3f/dab/d22/d10/d35/d5d/fb9 [717680,448] 0 2024-09-20T18:35:46.836 INFO:tasks.workunit.client.0.smithi017.stdout:6/71: mknod d4/c1b 0 2024-09-20T18:35:46.837 INFO:tasks.workunit.client.1.smithi172.stdout:5/656: mkdir d4/df/dad/d26/d2d/d63/d80/dd7 0 2024-09-20T18:35:46.838 INFO:tasks.workunit.client.1.smithi172.stdout:2/583: write d0/d2c/d3f/dab/d22/d10/d35/fb0 [1037116,73707] 0 2024-09-20T18:35:46.839 INFO:tasks.workunit.client.1.smithi172.stdout:1/613: mknod d0/d8/db/cca 0 2024-09-20T18:35:46.841 INFO:tasks.workunit.client.1.smithi172.stdout:9/612: creat d15/d1a/d6f/d7a/fc9 x:0 0 0 2024-09-20T18:35:46.841 INFO:tasks.workunit.client.1.smithi172.stdout:9/613: chown d15/d54 42569341 1 2024-09-20T18:35:46.842 INFO:tasks.workunit.client.1.smithi172.stdout:4/655: creat d0/d48/d90/dea/ff1 x:0 0 0 2024-09-20T18:35:46.843 INFO:tasks.workunit.client.0.smithi017.stdout:1/35: write f2 [2789557,70187] 0 2024-09-20T18:35:46.843 INFO:tasks.workunit.client.0.smithi017.stdout:5/64: symlink d0/l11 0 2024-09-20T18:35:46.844 INFO:tasks.workunit.client.0.smithi017.stdout:9/165: creat d6/d11/f3e x:0 0 0 2024-09-20T18:35:46.846 INFO:tasks.workunit.client.1.smithi172.stdout:7/698: creat d2/d3/dd/d84/fed x:0 0 0 2024-09-20T18:35:46.847 INFO:tasks.workunit.client.1.smithi172.stdout:4/656: fsync d0/de/d39/db8/d72/d18/d51/d9a/fab 0 2024-09-20T18:35:46.848 INFO:tasks.workunit.client.1.smithi172.stdout:0/798: creat d4/d44/dab/f11b x:0 0 0 2024-09-20T18:35:46.849 INFO:tasks.workunit.client.1.smithi172.stdout:6/566: readlink d0/d18/d1c/d21/d26/d34/d7a/d47/l9d 0 2024-09-20T18:35:46.851 INFO:tasks.workunit.client.1.smithi172.stdout:3/698: dread d0/d13/d32/d88/fae [0,4194304] 0 2024-09-20T18:35:46.851 INFO:tasks.workunit.client.1.smithi172.stdout:2/584: dwrite d0/d2c/d3f/dab/d22/d4c/f43 [0,4194304] 0 2024-09-20T18:35:46.851 INFO:tasks.workunit.client.0.smithi017.stdout:9/166: dwrite d6/f37 [0,4194304] 0 2024-09-20T18:35:46.852 INFO:tasks.workunit.client.1.smithi172.stdout:9/614: dwrite d15/d4a/f96 [0,4194304] 0 2024-09-20T18:35:46.853 INFO:tasks.workunit.client.0.smithi017.stdout:9/167: write d6/f14 [2813395,65572] 0 2024-09-20T18:35:46.854 INFO:tasks.workunit.client.0.smithi017.stdout:7/120: mknod da/d16/c27 0 2024-09-20T18:35:46.854 INFO:tasks.workunit.client.1.smithi172.stdout:4/657: write d0/de/dc/d3c/d99/fce [549219,24899] 0 2024-09-20T18:35:46.854 INFO:tasks.workunit.client.1.smithi172.stdout:1/614: chown d0/d8/db/d25/d2b/d3d/d65/l8f 1 1 2024-09-20T18:35:46.857 INFO:tasks.workunit.client.0.smithi017.stdout:1/36: symlink l8 0 2024-09-20T18:35:46.857 INFO:tasks.workunit.client.0.smithi017.stdout:1/37: stat c6 0 2024-09-20T18:35:46.858 INFO:tasks.workunit.client.0.smithi017.stdout:1/38: write f3 [4638196,1012] 0 2024-09-20T18:35:46.858 INFO:tasks.workunit.client.1.smithi172.stdout:6/567: write d0/d18/d1c/d21/d26/d34/d39/d74/f95 [1912624,90905] 0 2024-09-20T18:35:46.859 INFO:tasks.workunit.client.0.smithi017.stdout:5/65: symlink d0/l12 0 2024-09-20T18:35:46.860 INFO:tasks.workunit.client.0.smithi017.stdout:5/66: fdatasync d0/ff 0 2024-09-20T18:35:46.861 INFO:tasks.workunit.client.1.smithi172.stdout:1/615: fdatasync d0/d8/db/d25/d2b/d3d/f4d 0 2024-09-20T18:35:46.862 INFO:tasks.workunit.client.0.smithi017.stdout:2/207: rename d1/d1f/d37 to d1/dc/d35/d46 0 2024-09-20T18:35:46.864 INFO:tasks.workunit.client.0.smithi017.stdout:0/144: creat d4/db/d18/d25/f31 x:0 0 0 2024-09-20T18:35:46.865 INFO:tasks.workunit.client.0.smithi017.stdout:2/208: read - d1/dc/d20/d2e/f42 zero size 2024-09-20T18:35:46.866 INFO:tasks.workunit.client.1.smithi172.stdout:0/799: dwrite d4/d1a/d28/d42/d45/d54/f64 [0,4194304] 0 2024-09-20T18:35:46.868 INFO:tasks.workunit.client.0.smithi017.stdout:2/209: read - d1/d1f/f45 zero size 2024-09-20T18:35:46.868 INFO:tasks.workunit.client.1.smithi172.stdout:9/615: mknod d15/d1f/d2c/d37/cca 0 2024-09-20T18:35:46.869 INFO:tasks.workunit.client.0.smithi017.stdout:1/39: dwrite f3 [0,4194304] 0 2024-09-20T18:35:46.869 INFO:tasks.workunit.client.0.smithi017.stdout:9/168: readlink d6/d23/l38 0 2024-09-20T18:35:46.870 INFO:tasks.workunit.client.1.smithi172.stdout:4/658: dwrite d0/d48/d90/dea/ff1 [0,4194304] 0 2024-09-20T18:35:46.871 INFO:tasks.workunit.client.0.smithi017.stdout:2/210: write d1/f3a [1463737,129799] 0 2024-09-20T18:35:46.872 INFO:tasks.workunit.client.0.smithi017.stdout:7/121: creat da/d16/d1b/f28 x:0 0 0 2024-09-20T18:35:46.873 INFO:tasks.workunit.client.0.smithi017.stdout:2/211: truncate d1/dc/d20/f26 832750 0 2024-09-20T18:35:46.874 INFO:tasks.workunit.client.0.smithi017.stdout:3/305: link da/de/d13/d16/l3a da/de/d53/l6b 0 2024-09-20T18:35:46.875 INFO:tasks.workunit.client.0.smithi017.stdout:3/306: fsync da/f58 0 2024-09-20T18:35:46.878 INFO:tasks.workunit.client.1.smithi172.stdout:4/659: dread d0/fa [0,4194304] 0 2024-09-20T18:35:46.879 INFO:tasks.workunit.client.1.smithi172.stdout:4/660: chown d0/de/c93 1190 1 2024-09-20T18:35:46.880 INFO:tasks.workunit.client.1.smithi172.stdout:3/699: rename d0/dc/d6a/d3a/l8d to d0/d13/d58/d6d/dc3/lef 0 2024-09-20T18:35:46.881 INFO:tasks.workunit.client.1.smithi172.stdout:0/800: dwrite d4/d1a/f1e [0,4194304] 0 2024-09-20T18:35:46.881 INFO:tasks.workunit.client.1.smithi172.stdout:7/699: link d2/d23/d3a/c94 d2/d3/d3d/d4e/cee 0 2024-09-20T18:35:46.882 INFO:tasks.workunit.client.0.smithi017.stdout:5/67: dread d0/fc [0,4194304] 0 2024-09-20T18:35:46.882 INFO:tasks.workunit.client.0.smithi017.stdout:5/68: chown d0/l12 109714129 1 2024-09-20T18:35:46.883 INFO:tasks.workunit.client.1.smithi172.stdout:0/801: stat d4/d5/f6a 0 2024-09-20T18:35:46.883 INFO:tasks.workunit.client.0.smithi017.stdout:4/76: rename d4/de/d16 to d4/dc/d1e/d14/d22 0 2024-09-20T18:35:46.885 INFO:tasks.workunit.client.0.smithi017.stdout:4/77: chown d4/d19/l1a 1047691 1 2024-09-20T18:35:46.888 INFO:tasks.workunit.client.0.smithi017.stdout:0/145: creat d4/d20/f32 x:0 0 0 2024-09-20T18:35:46.891 INFO:tasks.workunit.client.0.smithi017.stdout:8/89: getdents d0/d6 0 2024-09-20T18:35:46.891 INFO:tasks.workunit.client.1.smithi172.stdout:0/802: dwrite d4/fa1 [0,4194304] 0 2024-09-20T18:35:46.897 INFO:tasks.workunit.client.0.smithi017.stdout:1/40: symlink l9 0 2024-09-20T18:35:46.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:46 smithi017 ceph-mon[28058]: pgmap v27: 65 pgs: 65 active+clean; 1.2 GiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 30 MiB/s rd, 159 MiB/s wr, 418 op/s 2024-09-20T18:35:46.902 INFO:tasks.workunit.client.0.smithi017.stdout:7/122: mknod da/d16/d1b/c29 0 2024-09-20T18:35:46.903 INFO:tasks.workunit.client.0.smithi017.stdout:8/90: dwrite d0/f7 [0,4194304] 0 2024-09-20T18:35:46.905 INFO:tasks.workunit.client.0.smithi017.stdout:8/91: truncate d0/d6/f1b 203514 0 2024-09-20T18:35:46.905 INFO:tasks.workunit.client.1.smithi172.stdout:3/700: creat d0/d13/d32/d88/ff0 x:0 0 0 2024-09-20T18:35:46.907 INFO:tasks.workunit.client.1.smithi172.stdout:3/701: truncate d0/dc/f5a 4437157 0 2024-09-20T18:35:46.910 INFO:tasks.workunit.client.0.smithi017.stdout:8/92: dread d0/f19 [0,4194304] 0 2024-09-20T18:35:46.912 INFO:tasks.workunit.client.0.smithi017.stdout:1/41: fdatasync f3 0 2024-09-20T18:35:46.913 INFO:tasks.workunit.client.0.smithi017.stdout:3/307: creat da/de/d13/d2f/f6c x:0 0 0 2024-09-20T18:35:46.915 INFO:tasks.workunit.client.0.smithi017.stdout:3/308: write da/de/d13/d16/f1e [4571969,96422] 0 2024-09-20T18:35:46.915 INFO:tasks.workunit.client.1.smithi172.stdout:5/657: write d4/df/dad/d26/d41/d65/d8f/fa5 [1094323,81843] 0 2024-09-20T18:35:46.916 INFO:tasks.workunit.client.1.smithi172.stdout:7/700: mkdir d2/d3/d10/d40/d6a/dc6/def 0 2024-09-20T18:35:46.916 INFO:tasks.workunit.client.1.smithi172.stdout:7/701: chown d2/d3/d3d/d4e/d92 114 1 2024-09-20T18:35:46.918 INFO:tasks.workunit.client.0.smithi017.stdout:5/69: mkdir d0/d13 0 2024-09-20T18:35:46.922 INFO:tasks.workunit.client.0.smithi017.stdout:9/169: rename d6/d2c to d6/d23/d24/d3f 0 2024-09-20T18:35:46.923 INFO:tasks.workunit.client.1.smithi172.stdout:1/616: link d0/d8/db/f75 d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/fcb 0 2024-09-20T18:35:46.928 INFO:tasks.workunit.client.1.smithi172.stdout:0/803: symlink d4/d1a/d28/d42/db8/dcd/l11c 0 2024-09-20T18:35:46.928 INFO:tasks.workunit.client.0.smithi017.stdout:0/146: mknod d4/c33 0 2024-09-20T18:35:46.931 INFO:tasks.workunit.client.1.smithi172.stdout:9/616: rmdir d15/d1f/d2c/d37/db8 0 2024-09-20T18:35:46.933 INFO:tasks.workunit.client.1.smithi172.stdout:3/702: symlink d0/d13/d9e/lf1 0 2024-09-20T18:35:46.933 INFO:tasks.workunit.client.1.smithi172.stdout:5/658: dread f3 [0,4194304] 0 2024-09-20T18:35:46.935 INFO:tasks.workunit.client.1.smithi172.stdout:5/659: write d4/df/dad/d26/d2d/d63/fc7 [168998,105287] 0 2024-09-20T18:35:46.935 INFO:tasks.workunit.client.1.smithi172.stdout:4/661: fdatasync d0/d48/d90/d55/d53/d78/f95 0 2024-09-20T18:35:46.936 INFO:tasks.workunit.client.1.smithi172.stdout:5/660: write d4/df/fc0 [472773,90015] 0 2024-09-20T18:35:46.941 INFO:tasks.workunit.client.1.smithi172.stdout:7/702: rename d2/d23/f30 to d2/d3/d10/d40/d6a/ff0 0 2024-09-20T18:35:46.942 INFO:tasks.workunit.client.0.smithi017.stdout:2/212: mknod d1/dc/d35/d3d/c47 0 2024-09-20T18:35:46.942 INFO:tasks.workunit.client.1.smithi172.stdout:6/568: getdents d0/d18/d1c/d21/d26/d34/d39/d74 0 2024-09-20T18:35:46.943 INFO:tasks.workunit.client.1.smithi172.stdout:6/569: write d0/d18/d1c/d21/d26/d34/d39/d46/f7 [3161564,64690] 0 2024-09-20T18:35:46.944 INFO:tasks.workunit.client.1.smithi172.stdout:6/570: chown d0/c31 4 1 2024-09-20T18:35:46.945 INFO:tasks.workunit.client.0.smithi017.stdout:1/42: mkdir da 0 2024-09-20T18:35:46.946 INFO:tasks.workunit.client.0.smithi017.stdout:1/43: write f2 [2771230,109207] 0 2024-09-20T18:35:46.947 INFO:tasks.workunit.client.1.smithi172.stdout:8/610: sync 2024-09-20T18:35:46.947 INFO:tasks.workunit.client.1.smithi172.stdout:0/804: creat d4/d5/d2e/d33/de1/dac/dd0/f11d x:0 0 0 2024-09-20T18:35:46.950 INFO:tasks.workunit.client.1.smithi172.stdout:9/617: creat d15/d54/fcb x:0 0 0 2024-09-20T18:35:46.950 INFO:tasks.workunit.client.1.smithi172.stdout:9/618: readlink d15/l99 0 2024-09-20T18:35:46.952 INFO:tasks.workunit.client.0.smithi017.stdout:1/44: dwrite f3 [0,4194304] 0 2024-09-20T18:35:46.954 INFO:tasks.workunit.client.1.smithi172.stdout:3/703: fsync d0/dc/d6a/d3a/f60 0 2024-09-20T18:35:46.954 INFO:tasks.workunit.client.1.smithi172.stdout:3/704: readlink d0/d13/d32/d54/d83/ld3 0 2024-09-20T18:35:46.955 INFO:tasks.workunit.client.1.smithi172.stdout:3/705: chown d0/dc/c4f 40102 1 2024-09-20T18:35:46.955 INFO:tasks.workunit.client.1.smithi172.stdout:3/706: chown d0/d13/d58/d6d/db9/de0 9551214 1 2024-09-20T18:35:46.957 INFO:tasks.workunit.client.0.smithi017.stdout:3/309: rename da/de/f12 to da/de/d13/d2f/d26/d31/d5a/f6d 0 2024-09-20T18:35:46.958 INFO:tasks.workunit.client.0.smithi017.stdout:9/170: mkdir d6/d23/d40 0 2024-09-20T18:35:46.961 INFO:tasks.workunit.client.0.smithi017.stdout:7/123: link da/fc da/f2a 0 2024-09-20T18:35:46.965 INFO:tasks.workunit.client.0.smithi017.stdout:2/213: mkdir d1/dc/d35/d46/d48 0 2024-09-20T18:35:46.966 INFO:tasks.workunit.client.1.smithi172.stdout:4/662: dwrite d0/d48/d90/f89 [4194304,4194304] 0 2024-09-20T18:35:46.966 INFO:tasks.workunit.client.0.smithi017.stdout:2/214: truncate d1/df/f16 983481 0 2024-09-20T18:35:46.966 INFO:tasks.workunit.client.0.smithi017.stdout:2/215: stat d1/fb 0 2024-09-20T18:35:46.967 INFO:tasks.workunit.client.1.smithi172.stdout:4/663: write d0/d48/d90/f14 [6119196,12196] 0 2024-09-20T18:35:46.972 INFO:tasks.workunit.client.1.smithi172.stdout:4/664: dwrite d0/de/d39/db8/d72/f40 [0,4194304] 0 2024-09-20T18:35:46.974 INFO:tasks.workunit.client.0.smithi017.stdout:4/78: dwrite d4/fa [0,4194304] 0 2024-09-20T18:35:46.975 INFO:tasks.workunit.client.1.smithi172.stdout:1/617: creat d0/d8/db/d25/d2b/db6/fcc x:0 0 0 2024-09-20T18:35:46.976 INFO:tasks.workunit.client.1.smithi172.stdout:6/571: fsync d0/d18/d1c/d21/d26/d34/d39/d46/fb4 0 2024-09-20T18:35:46.976 INFO:tasks.workunit.client.1.smithi172.stdout:1/618: write d0/d73/f90 [121499,105514] 0 2024-09-20T18:35:46.977 INFO:tasks.workunit.client.0.smithi017.stdout:4/79: read f3 [44432,76760] 0 2024-09-20T18:35:46.979 INFO:tasks.workunit.client.1.smithi172.stdout:6/572: dread - d0/d18/d1c/d21/d26/d34/d7a/d99/fa4 zero size 2024-09-20T18:35:46.980 INFO:tasks.workunit.client.1.smithi172.stdout:6/573: chown d0/d18/d1c/d21/d26/d34/d7a/d47/lab 9 1 2024-09-20T18:35:46.981 INFO:tasks.workunit.client.1.smithi172.stdout:8/611: symlink dd/d1b/ld3 0 2024-09-20T18:35:46.983 INFO:tasks.workunit.client.0.smithi017.stdout:3/310: mkdir da/de/d13/d16/d6e 0 2024-09-20T18:35:46.986 INFO:tasks.workunit.client.0.smithi017.stdout:9/171: creat d6/d1f/f41 x:0 0 0 2024-09-20T18:35:46.988 INFO:tasks.workunit.client.1.smithi172.stdout:8/612: dwrite dd/d1b/d3b/f3c [0,4194304] 0 2024-09-20T18:35:46.991 INFO:tasks.workunit.client.0.smithi017.stdout:8/93: creat d0/f1e x:0 0 0 2024-09-20T18:35:46.992 INFO:tasks.workunit.client.1.smithi172.stdout:3/707: symlink d0/d13/db2/lf2 0 2024-09-20T18:35:46.992 INFO:tasks.workunit.client.0.smithi017.stdout:5/70: write d0/f1 [5082900,13786] 0 2024-09-20T18:35:46.993 INFO:tasks.workunit.client.1.smithi172.stdout:3/708: write d0/d13/d58/d6d/d7f/fb1 [866942,51278] 0 2024-09-20T18:35:46.994 INFO:tasks.workunit.client.1.smithi172.stdout:3/709: fdatasync d0/d13/d32/d54/d83/fad 0 2024-09-20T18:35:46.996 INFO:tasks.workunit.client.1.smithi172.stdout:3/710: dread - d0/d13/d32/d88/ff0 zero size 2024-09-20T18:35:46.997 INFO:tasks.workunit.client.1.smithi172.stdout:3/711: truncate d0/dc/d6a/dc5/feb 818897 0 2024-09-20T18:35:46.997 INFO:tasks.workunit.client.0.smithi017.stdout:5/71: dread d0/f10 [0,4194304] 0 2024-09-20T18:35:46.999 INFO:tasks.workunit.client.0.smithi017.stdout:5/72: truncate d0/ff 1562530 0 2024-09-20T18:35:47.003 INFO:tasks.workunit.client.1.smithi172.stdout:3/712: dwrite d0/d13/d58/d6d/d7f/d84/fec [0,4194304] 0 2024-09-20T18:35:47.003 INFO:tasks.workunit.client.0.smithi017.stdout:4/80: mknod d4/dc/c23 0 2024-09-20T18:35:47.004 INFO:tasks.workunit.client.1.smithi172.stdout:3/713: stat d0/d13/d58/f4a 0 2024-09-20T18:35:47.004 INFO:tasks.workunit.client.0.smithi017.stdout:4/81: fsync d4/dc/d1e/f18 0 2024-09-20T18:35:47.006 INFO:tasks.workunit.client.1.smithi172.stdout:7/703: creat d2/d23/d9d/dbc/ff1 x:0 0 0 2024-09-20T18:35:47.009 INFO:tasks.workunit.client.0.smithi017.stdout:3/311: write da/de/d13/d2f/d26/d31/d5a/f6d [7058548,110906] 0 2024-09-20T18:35:47.009 INFO:tasks.workunit.client.1.smithi172.stdout:3/714: dwrite d0/d13/d58/d6d/db9/fb4 [0,4194304] 0 2024-09-20T18:35:47.011 INFO:tasks.workunit.client.0.smithi017.stdout:3/312: stat da/de/d13/d2f/f6c 0 2024-09-20T18:35:47.013 INFO:tasks.workunit.client.0.smithi017.stdout:3/313: stat da/de/d53/c4b 0 2024-09-20T18:35:47.013 INFO:tasks.workunit.client.0.smithi017.stdout:4/82: dwrite d4/dc/d1e/d14/d22/f21 [0,4194304] 0 2024-09-20T18:35:47.014 INFO:tasks.workunit.client.1.smithi172.stdout:1/619: mknod d0/d8/d5f/ccd 0 2024-09-20T18:35:47.016 INFO:tasks.workunit.client.1.smithi172.stdout:1/620: truncate d0/d22/f7a 1074418 0 2024-09-20T18:35:47.017 INFO:tasks.workunit.client.1.smithi172.stdout:0/805: write d4/d1a/d28/d42/d45/f52 [3741057,42638] 0 2024-09-20T18:35:47.017 INFO:tasks.workunit.client.0.smithi017.stdout:7/124: rename da/d16/d1b/l26 to da/d16/d1b/l2b 0 2024-09-20T18:35:47.018 INFO:tasks.workunit.client.1.smithi172.stdout:3/715: dwrite d0/dc/d6a/d76/fa2 [0,4194304] 0 2024-09-20T18:35:47.021 INFO:tasks.workunit.client.0.smithi017.stdout:8/94: unlink d0/f7 0 2024-09-20T18:35:47.031 INFO:tasks.workunit.client.1.smithi172.stdout:2/585: sync 2024-09-20T18:35:47.031 INFO:tasks.workunit.client.1.smithi172.stdout:2/586: readlink d0/lb3 0 2024-09-20T18:35:47.032 INFO:tasks.workunit.client.1.smithi172.stdout:5/661: truncate d4/df/dad/d26/d41/d69/dac/f7e 3354100 0 2024-09-20T18:35:47.034 INFO:tasks.workunit.client.0.smithi017.stdout:5/73: mkdir d0/d14 0 2024-09-20T18:35:47.034 INFO:tasks.workunit.client.1.smithi172.stdout:8/613: mkdir dd/d1b/d4f/dd4 0 2024-09-20T18:35:47.039 INFO:tasks.workunit.client.0.smithi017.stdout:1/45: rmdir da 0 2024-09-20T18:35:47.044 INFO:tasks.workunit.client.1.smithi172.stdout:7/704: symlink d2/d3/d10/d40/d46/d8e/dbd/lf2 0 2024-09-20T18:35:47.046 INFO:tasks.workunit.client.0.smithi017.stdout:9/172: mkdir d6/d42 0 2024-09-20T18:35:47.049 INFO:tasks.workunit.client.0.smithi017.stdout:3/314: unlink da/de/d14/l43 0 2024-09-20T18:35:47.052 INFO:tasks.workunit.client.0.smithi017.stdout:4/83: symlink d4/dc/d1e/l24 0 2024-09-20T18:35:47.053 INFO:tasks.workunit.client.0.smithi017.stdout:4/84: write d4/dc/f12 [3416569,74828] 0 2024-09-20T18:35:47.054 INFO:tasks.workunit.client.0.smithi017.stdout:7/125: creat da/d16/d1b/f2c x:0 0 0 2024-09-20T18:35:47.056 INFO:tasks.workunit.client.0.smithi017.stdout:2/216: truncate d1/f3a 1510987 0 2024-09-20T18:35:47.057 INFO:tasks.workunit.client.1.smithi172.stdout:3/716: mknod d0/dc/d6a/d22/cf3 0 2024-09-20T18:35:47.058 INFO:tasks.workunit.client.1.smithi172.stdout:4/665: sync 2024-09-20T18:35:47.059 INFO:tasks.workunit.client.1.smithi172.stdout:4/666: fsync d0/d48/d90/d55/fe2 0 2024-09-20T18:35:47.060 INFO:tasks.workunit.client.1.smithi172.stdout:0/806: rename d4/d5/d2e/d33/de1/fdb to d4/d5/d2e/d38/d96/f11e 0 2024-09-20T18:35:47.061 INFO:tasks.workunit.client.1.smithi172.stdout:9/619: truncate d15/d1a/d6f/f8a 4975 0 2024-09-20T18:35:47.063 INFO:tasks.workunit.client.1.smithi172.stdout:9/620: chown d15/d20/d76/fa1 495 1 2024-09-20T18:35:47.064 INFO:tasks.workunit.client.1.smithi172.stdout:2/587: creat d0/d2c/d3f/dab/d22/d10/d35/fc2 x:0 0 0 2024-09-20T18:35:47.064 INFO:tasks.workunit.client.1.smithi172.stdout:3/717: dwrite d0/dc/d6a/d22/f8c [0,4194304] 0 2024-09-20T18:35:47.064 INFO:tasks.workunit.client.1.smithi172.stdout:9/621: dread - d15/d1f/d88/fb1 zero size 2024-09-20T18:35:47.065 INFO:tasks.workunit.client.0.smithi017.stdout:5/74: mkdir d0/d15 0 2024-09-20T18:35:47.066 INFO:tasks.workunit.client.1.smithi172.stdout:9/622: stat d15/d1f/d2c/d57/c83 0 2024-09-20T18:35:47.067 INFO:tasks.workunit.client.1.smithi172.stdout:5/662: mkdir d4/df/dad/d26/d41/d69/dac/da7/dd8 0 2024-09-20T18:35:47.069 INFO:tasks.workunit.client.1.smithi172.stdout:5/663: write d4/df/dad/d26/d41/d69/dac/f3e [834946,1322] 0 2024-09-20T18:35:47.069 INFO:tasks.workunit.client.0.smithi017.stdout:1/46: mknod cb 0 2024-09-20T18:35:47.070 INFO:tasks.workunit.client.1.smithi172.stdout:8/614: symlink dd/da9/ld5 0 2024-09-20T18:35:47.072 INFO:tasks.workunit.client.1.smithi172.stdout:3/718: dread d0/d13/d58/d6d/d7f/fb1 [0,4194304] 0 2024-09-20T18:35:47.072 INFO:tasks.workunit.client.0.smithi017.stdout:9/173: mkdir d6/d23/d24/d3f/d43 0 2024-09-20T18:35:47.073 INFO:tasks.workunit.client.0.smithi017.stdout:9/174: chown l5 721781 1 2024-09-20T18:35:47.077 INFO:tasks.workunit.client.1.smithi172.stdout:4/667: dread d0/f6d [0,4194304] 0 2024-09-20T18:35:47.080 INFO:tasks.workunit.client.0.smithi017.stdout:7/126: mkdir da/d16/d1c/d2d 0 2024-09-20T18:35:47.081 INFO:tasks.workunit.client.1.smithi172.stdout:8/615: dwrite dd/d1b/d3b/d51/d5b/dc5/fd1 [0,4194304] 0 2024-09-20T18:35:47.082 INFO:tasks.workunit.client.0.smithi017.stdout:2/217: fsync d1/dc/d35/d3d/f43 0 2024-09-20T18:35:47.082 INFO:tasks.workunit.client.1.smithi172.stdout:3/719: dwrite d0/dc/d6a/dc5/feb [0,4194304] 0 2024-09-20T18:35:47.083 INFO:tasks.workunit.client.1.smithi172.stdout:8/616: dread - dd/d1b/d3b/d51/d5b/d6b/fb7 zero size 2024-09-20T18:35:47.085 INFO:tasks.workunit.client.1.smithi172.stdout:3/720: write d0/dc/d6a/d3a/d74/fa5 [4615528,115639] 0 2024-09-20T18:35:47.085 INFO:tasks.workunit.client.1.smithi172.stdout:0/807: creat d4/d5/d2e/d67/d8c/f11f x:0 0 0 2024-09-20T18:35:47.087 INFO:tasks.workunit.client.1.smithi172.stdout:2/588: dread d0/d2c/f3d [0,4194304] 0 2024-09-20T18:35:47.088 INFO:tasks.workunit.client.1.smithi172.stdout:3/721: write d0/d13/d32/d54/fe2 [523608,38608] 0 2024-09-20T18:35:47.089 INFO:tasks.workunit.client.1.smithi172.stdout:3/722: chown d0/f16 46818 1 2024-09-20T18:35:47.090 INFO:tasks.workunit.client.1.smithi172.stdout:9/623: readlink d15/d1f/l22 0 2024-09-20T18:35:47.094 INFO:tasks.workunit.client.0.smithi017.stdout:9/175: mkdir d6/d23/d24/d3f/d44 0 2024-09-20T18:35:47.094 INFO:tasks.workunit.client.1.smithi172.stdout:5/664: mkdir d4/df/dad/d26/d2d/dce/dd9 0 2024-09-20T18:35:47.096 INFO:tasks.workunit.client.1.smithi172.stdout:7/705: symlink d2/d3/lf3 0 2024-09-20T18:35:47.097 INFO:tasks.workunit.client.0.smithi017.stdout:7/127: rmdir da/d16 39 2024-09-20T18:35:47.099 INFO:tasks.workunit.client.0.smithi017.stdout:2/218: rmdir d1 39 2024-09-20T18:35:47.100 INFO:tasks.workunit.client.1.smithi172.stdout:1/621: creat d0/fce x:0 0 0 2024-09-20T18:35:47.102 INFO:tasks.workunit.client.1.smithi172.stdout:7/706: dread d2/d3/d10/d40/d6a/fb4 [0,4194304] 0 2024-09-20T18:35:47.102 INFO:tasks.workunit.client.0.smithi017.stdout:5/75: creat d0/d13/f16 x:0 0 0 2024-09-20T18:35:47.102 INFO:tasks.workunit.client.1.smithi172.stdout:6/574: getdents d0/d18/d1c/d21/d26/d9b 0 2024-09-20T18:35:47.103 INFO:tasks.workunit.client.1.smithi172.stdout:6/575: chown d0/d18/d1c/d21 16464 1 2024-09-20T18:35:47.103 INFO:tasks.workunit.client.0.smithi017.stdout:5/76: stat d0/cb 0 2024-09-20T18:35:47.108 INFO:tasks.workunit.client.0.smithi017.stdout:9/176: mkdir d6/d23/d24/d3f/d45 0 2024-09-20T18:35:47.109 INFO:tasks.workunit.client.0.smithi017.stdout:8/95: dwrite d0/f19 [4194304,4194304] 0 2024-09-20T18:35:47.111 INFO:tasks.workunit.client.0.smithi017.stdout:5/77: dread d0/f1 [0,4194304] 0 2024-09-20T18:35:47.111 INFO:tasks.workunit.client.0.smithi017.stdout:7/128: stat da/d16/d1b/f28 0 2024-09-20T18:35:47.113 INFO:tasks.workunit.client.0.smithi017.stdout:8/96: fsync d0/d6/f1b 0 2024-09-20T18:35:47.113 INFO:tasks.workunit.client.0.smithi017.stdout:8/97: fsync d0/f4 0 2024-09-20T18:35:47.120 INFO:tasks.workunit.client.0.smithi017.stdout:8/98: dread d0/d6/f16 [0,4194304] 0 2024-09-20T18:35:47.120 INFO:tasks.workunit.client.0.smithi017.stdout:3/315: getdents da/de/d13/d16 0 2024-09-20T18:35:47.122 INFO:tasks.workunit.client.0.smithi017.stdout:8/99: chown d0/f1c 35352 1 2024-09-20T18:35:47.126 INFO:tasks.workunit.client.1.smithi172.stdout:4/668: dread d0/d48/d90/f37 [0,4194304] 0 2024-09-20T18:35:47.127 INFO:tasks.workunit.client.1.smithi172.stdout:4/669: stat d0/ca1 0 2024-09-20T18:35:47.127 INFO:tasks.workunit.client.0.smithi017.stdout:9/177: symlink d6/d23/d24/d3f/l46 0 2024-09-20T18:35:47.128 INFO:tasks.workunit.client.0.smithi017.stdout:4/85: dwrite f3 [0,4194304] 0 2024-09-20T18:35:47.133 INFO:tasks.workunit.client.0.smithi017.stdout:8/100: dwrite d0/fc [0,4194304] 0 2024-09-20T18:35:47.133 INFO:tasks.workunit.client.0.smithi017.stdout:8/101: stat d0/f1e 0 2024-09-20T18:35:47.139 INFO:tasks.workunit.client.0.smithi017.stdout:2/219: creat d1/dc/d20/d2e/f49 x:0 0 0 2024-09-20T18:35:47.141 INFO:tasks.workunit.client.1.smithi172.stdout:1/622: fdatasync d0/d8/db/f75 0 2024-09-20T18:35:47.142 INFO:tasks.workunit.client.1.smithi172.stdout:7/707: creat d2/d23/d3c/ff4 x:0 0 0 2024-09-20T18:35:47.142 INFO:tasks.workunit.client.0.smithi017.stdout:8/102: dwrite d0/f19 [8388608,4194304] 0 2024-09-20T18:35:47.143 INFO:tasks.workunit.client.1.smithi172.stdout:8/617: write dd/d1b/d3b/d51/d5b/d6b/fb7 [472951,24161] 0 2024-09-20T18:35:47.143 INFO:tasks.workunit.client.0.smithi017.stdout:8/103: chown d0/d6/l17 64530 1 2024-09-20T18:35:47.143 INFO:tasks.workunit.client.1.smithi172.stdout:1/623: chown d0/d8/db/cca 7 1 2024-09-20T18:35:47.146 INFO:tasks.workunit.client.1.smithi172.stdout:6/576: mkdir d0/d18/d1c/d21/d26/db7 0 2024-09-20T18:35:47.147 INFO:tasks.workunit.client.1.smithi172.stdout:8/618: dread dd/d1b/f33 [0,4194304] 0 2024-09-20T18:35:47.154 INFO:tasks.workunit.client.0.smithi017.stdout:3/316: unlink da/de/d13/d2f/l69 0 2024-09-20T18:35:47.155 INFO:tasks.workunit.client.1.smithi172.stdout:2/589: mkdir d0/d2c/db2/dc3 0 2024-09-20T18:35:47.157 INFO:tasks.workunit.client.1.smithi172.stdout:0/808: link d4/d1a/d28/d42/d45/d99/dc9/fd2 d4/d1a/d28/d75/d60/dba/d111/f120 0 2024-09-20T18:35:47.158 INFO:tasks.workunit.client.1.smithi172.stdout:0/809: chown d4/d1a/d28/d42/d45/d54/lb7 0 1 2024-09-20T18:35:47.158 INFO:tasks.workunit.client.1.smithi172.stdout:4/670: unlink d0/de/dc/f7f 0 2024-09-20T18:35:47.159 INFO:tasks.workunit.client.1.smithi172.stdout:2/590: dread d0/d2c/d3f/dab/d22/d10/d35/d5d/fb9 [0,4194304] 0 2024-09-20T18:35:47.161 INFO:tasks.workunit.client.0.smithi017.stdout:5/78: creat d0/d14/f17 x:0 0 0 2024-09-20T18:35:47.161 INFO:tasks.workunit.client.0.smithi017.stdout:5/79: dread - d0/d13/f16 zero size 2024-09-20T18:35:47.163 INFO:tasks.workunit.client.0.smithi017.stdout:5/80: truncate d0/d13/f16 317153 0 2024-09-20T18:35:47.168 INFO:tasks.workunit.client.0.smithi017.stdout:8/104: dread - d0/fd zero size 2024-09-20T18:35:47.171 INFO:tasks.workunit.client.0.smithi017.stdout:9/178: creat d6/d23/d24/d3f/d44/f47 x:0 0 0 2024-09-20T18:35:47.171 INFO:tasks.workunit.client.0.smithi017.stdout:3/317: dread da/de/d13/f54 [0,4194304] 0 2024-09-20T18:35:47.172 INFO:tasks.workunit.client.0.smithi017.stdout:4/86: link d4/dc/f12 d4/de/f25 0 2024-09-20T18:35:47.173 INFO:tasks.workunit.client.0.smithi017.stdout:2/220: creat d1/dc/d35/d46/d48/f4a x:0 0 0 2024-09-20T18:35:47.175 INFO:tasks.workunit.client.0.smithi017.stdout:8/105: mknod d0/d6/c1f 0 2024-09-20T18:35:47.175 INFO:tasks.workunit.client.0.smithi017.stdout:8/106: fdatasync d0/f19 0 2024-09-20T18:35:47.175 INFO:tasks.workunit.client.1.smithi172.stdout:5/665: sync 2024-09-20T18:35:47.177 INFO:tasks.workunit.client.0.smithi017.stdout:7/129: getdents da/d16/d1b 0 2024-09-20T18:35:47.180 INFO:tasks.workunit.client.0.smithi017.stdout:8/107: dread d0/fc [0,4194304] 0 2024-09-20T18:35:47.182 INFO:tasks.workunit.client.0.smithi017.stdout:2/221: rename d1/d1f/f45 to d1/dc/d20/d2e/d30/f4b 0 2024-09-20T18:35:47.182 INFO:tasks.workunit.client.0.smithi017.stdout:7/130: dread da/f18 [0,4194304] 0 2024-09-20T18:35:47.187 INFO:tasks.workunit.client.0.smithi017.stdout:4/87: dwrite d4/de/f25 [0,4194304] 0 2024-09-20T18:35:47.199 INFO:tasks.workunit.client.0.smithi017.stdout:8/108: unlink d0/f4 0 2024-09-20T18:35:47.202 INFO:tasks.workunit.client.0.smithi017.stdout:2/222: unlink d1/dc/c21 0 2024-09-20T18:35:47.205 INFO:tasks.workunit.client.0.smithi017.stdout:7/131: creat da/d16/d1c/f2e x:0 0 0 2024-09-20T18:35:47.206 INFO:tasks.workunit.client.0.smithi017.stdout:8/109: dwrite d0/d6/f1b [0,4194304] 0 2024-09-20T18:35:47.208 INFO:tasks.workunit.client.0.smithi017.stdout:8/110: read d0/d6/f1b [1513441,86586] 0 2024-09-20T18:35:47.208 INFO:tasks.workunit.client.0.smithi017.stdout:7/132: truncate da/d16/d1c/f2e 436790 0 2024-09-20T18:35:47.208 INFO:tasks.workunit.client.0.smithi017.stdout:4/88: rename d4/dc/d1e/d14 to d4/dc/d1e/d26 0 2024-09-20T18:35:47.209 INFO:tasks.workunit.client.0.smithi017.stdout:4/89: chown d4/l8 0 1 2024-09-20T18:35:47.210 INFO:tasks.workunit.client.0.smithi017.stdout:8/111: chown d0/fd 0 1 2024-09-20T18:35:47.213 INFO:tasks.workunit.client.1.smithi172.stdout:7/708: mknod d2/d3/d10/d40/d74/dcb/cf5 0 2024-09-20T18:35:47.214 INFO:tasks.workunit.client.0.smithi017.stdout:9/179: link d6/l9 d6/d23/l48 0 2024-09-20T18:35:47.216 INFO:tasks.workunit.client.1.smithi172.stdout:8/619: rename dd/d1b/la1 to dd/d1b/ld6 0 2024-09-20T18:35:47.216 INFO:tasks.workunit.client.0.smithi017.stdout:4/90: dread d4/f7 [0,4194304] 0 2024-09-20T18:35:47.218 INFO:tasks.workunit.client.0.smithi017.stdout:7/133: dwrite da/f1a [0,4194304] 0 2024-09-20T18:35:47.223 INFO:tasks.workunit.client.1.smithi172.stdout:3/723: link d0/d13/d9e/ca8 d0/d13/d1e/cf4 0 2024-09-20T18:35:47.227 INFO:tasks.workunit.client.1.smithi172.stdout:2/591: mkdir d0/d2c/d3f/dab/d22/d10/d35/dc4 0 2024-09-20T18:35:47.228 INFO:tasks.workunit.client.1.smithi172.stdout:3/724: dread d0/d13/d58/d6d/db9/fb4 [0,4194304] 0 2024-09-20T18:35:47.229 INFO:tasks.workunit.client.1.smithi172.stdout:3/725: stat d0/d13/d58/d6d/dc3 0 2024-09-20T18:35:47.231 INFO:tasks.workunit.client.1.smithi172.stdout:7/709: dread d2/d3/d10/d40/d46/d8e/f6f [0,4194304] 0 2024-09-20T18:35:47.232 INFO:tasks.workunit.client.1.smithi172.stdout:9/624: rename d15/d1f/d2c/d7d/d34/faf to d15/fcc 0 2024-09-20T18:35:47.234 INFO:tasks.workunit.client.1.smithi172.stdout:5/666: truncate d4/df/d3f/f61 394078 0 2024-09-20T18:35:47.235 INFO:tasks.workunit.client.1.smithi172.stdout:5/667: dread - d4/df/dad/d26/d41/f9e zero size 2024-09-20T18:35:47.235 INFO:tasks.workunit.client.0.smithi017.stdout:9/180: symlink d6/d23/d3a/l49 0 2024-09-20T18:35:47.238 INFO:tasks.workunit.client.1.smithi172.stdout:1/624: truncate d0/d22/f23 792228 0 2024-09-20T18:35:47.241 INFO:tasks.workunit.client.0.smithi017.stdout:7/134: symlink da/d16/d1b/l2f 0 2024-09-20T18:35:47.242 INFO:tasks.workunit.client.1.smithi172.stdout:8/620: readlink dd/l12 0 2024-09-20T18:35:47.246 INFO:tasks.workunit.client.1.smithi172.stdout:0/810: write d4/d5/f2f [4812822,74494] 0 2024-09-20T18:35:47.249 INFO:tasks.workunit.client.1.smithi172.stdout:0/811: read d4/d1a/d28/d42/d45/d54/f89 [1140708,123240] 0 2024-09-20T18:35:47.249 INFO:tasks.workunit.client.0.smithi017.stdout:7/135: dwrite da/f22 [0,4194304] 0 2024-09-20T18:35:47.249 INFO:tasks.workunit.client.1.smithi172.stdout:0/812: readlink d4/d5/l53 0 2024-09-20T18:35:47.250 INFO:tasks.workunit.client.0.smithi017.stdout:7/136: stat da/d16/d1c/f2e 0 2024-09-20T18:35:47.251 INFO:tasks.workunit.client.1.smithi172.stdout:2/592: unlink d0/d2c/d3f/f26 0 2024-09-20T18:35:47.252 INFO:tasks.workunit.client.0.smithi017.stdout:7/137: write da/f22 [2773648,94670] 0 2024-09-20T18:35:47.255 INFO:tasks.workunit.client.0.smithi017.stdout:7/138: stat da/d16/d1c/f2e 0 2024-09-20T18:35:47.257 INFO:tasks.workunit.client.0.smithi017.stdout:2/223: creat d1/df/f4c x:0 0 0 2024-09-20T18:35:47.257 INFO:tasks.workunit.client.1.smithi172.stdout:3/726: mknod d0/d13/d32/d54/d83/cf5 0 2024-09-20T18:35:47.258 INFO:tasks.workunit.client.0.smithi017.stdout:2/224: chown d1/d1f/c2b 7 1 2024-09-20T18:35:47.259 INFO:tasks.workunit.client.0.smithi017.stdout:2/225: fsync d1/dc/d20/f26 0 2024-09-20T18:35:47.260 INFO:tasks.workunit.client.0.smithi017.stdout:8/112: dwrite d0/fd [0,4194304] 0 2024-09-20T18:35:47.262 INFO:tasks.workunit.client.0.smithi017.stdout:9/181: mkdir d6/d23/d40/d4a 0 2024-09-20T18:35:47.263 INFO:tasks.workunit.client.0.smithi017.stdout:9/182: stat d6/d1f/l28 0 2024-09-20T18:35:47.264 INFO:tasks.workunit.client.1.smithi172.stdout:7/710: dwrite d2/d3/dd/f42 [0,4194304] 0 2024-09-20T18:35:47.266 INFO:tasks.workunit.client.1.smithi172.stdout:6/577: rename d0/d18/fa7 to d0/d18/d1c/fb8 0 2024-09-20T18:35:47.268 INFO:tasks.workunit.client.0.smithi017.stdout:2/226: dread d1/dc/d35/d3d/f36 [0,4194304] 0 2024-09-20T18:35:47.271 INFO:tasks.workunit.client.1.smithi172.stdout:1/625: readlink d0/l9d 0 2024-09-20T18:35:47.272 INFO:tasks.workunit.client.1.smithi172.stdout:1/626: chown d0/d22/l7f 30603 1 2024-09-20T18:35:47.272 INFO:tasks.workunit.client.0.smithi017.stdout:4/91: truncate f0 971742 0 2024-09-20T18:35:47.276 INFO:tasks.workunit.client.1.smithi172.stdout:8/621: symlink dd/d1b/d4f/ld7 0 2024-09-20T18:35:47.277 INFO:tasks.workunit.client.0.smithi017.stdout:8/113: creat d0/d6/f20 x:0 0 0 2024-09-20T18:35:47.280 INFO:tasks.workunit.client.1.smithi172.stdout:4/671: creat d0/de/d39/db8/d72/ff2 x:0 0 0 2024-09-20T18:35:47.281 INFO:tasks.workunit.client.0.smithi017.stdout:9/183: rmdir d6/d23 39 2024-09-20T18:35:47.282 INFO:tasks.workunit.client.1.smithi172.stdout:8/622: dwrite dd/d1b/d3b/d51/d5b/daf/fc6 [0,4194304] 0 2024-09-20T18:35:47.282 INFO:tasks.workunit.client.1.smithi172.stdout:8/623: write dd/d1b/d3b/d5d/fd0 [438021,7151] 0 2024-09-20T18:35:47.284 INFO:tasks.workunit.client.1.smithi172.stdout:8/624: write dd/d65/f9e [677731,74403] 0 2024-09-20T18:35:47.284 INFO:tasks.workunit.client.0.smithi017.stdout:7/139: mkdir da/d16/d1c/d2d/d30 0 2024-09-20T18:35:47.287 INFO:tasks.workunit.client.0.smithi017.stdout:4/92: rename d4/de/f25 to d4/de/f27 0 2024-09-20T18:35:47.287 INFO:tasks.workunit.client.1.smithi172.stdout:8/625: chown dd/d1b/d3b/d5d/cce 0 1 2024-09-20T18:35:47.288 INFO:tasks.workunit.client.1.smithi172.stdout:4/672: dread d0/d7/fba [0,4194304] 0 2024-09-20T18:35:47.289 INFO:tasks.workunit.client.0.smithi017.stdout:4/93: truncate d4/d19/f1f 394064 0 2024-09-20T18:35:47.289 INFO:tasks.workunit.client.1.smithi172.stdout:3/727: symlink d0/d13/d32/d54/lf6 0 2024-09-20T18:35:47.290 INFO:tasks.workunit.client.1.smithi172.stdout:8/626: chown dd/d1b/d3b/d5d/c69 7 1 2024-09-20T18:35:47.291 INFO:tasks.workunit.client.1.smithi172.stdout:4/673: write d0/de/d39/fc8 [3248073,66397] 0 2024-09-20T18:35:47.291 INFO:tasks.workunit.client.1.smithi172.stdout:9/625: dwrite d15/d1f/d2c/f70 [0,4194304] 0 2024-09-20T18:35:47.292 INFO:tasks.workunit.client.0.smithi017.stdout:7/140: mknod da/d16/d1c/c31 0 2024-09-20T18:35:47.293 INFO:tasks.workunit.client.1.smithi172.stdout:9/626: dread - d15/d1a/d6f/fbd zero size 2024-09-20T18:35:47.294 INFO:tasks.workunit.client.0.smithi017.stdout:8/114: link d0/d6/f20 d0/d6/f21 0 2024-09-20T18:35:47.299 INFO:tasks.workunit.client.0.smithi017.stdout:7/141: creat da/d16/f32 x:0 0 0 2024-09-20T18:35:47.303 INFO:tasks.workunit.client.0.smithi017.stdout:2/227: getdents d1/dc/d20/d2e 0 2024-09-20T18:35:47.305 INFO:tasks.workunit.client.0.smithi017.stdout:7/142: symlink da/d16/d1c/d2d/l33 0 2024-09-20T18:35:47.305 INFO:tasks.workunit.client.0.smithi017.stdout:2/228: dread d1/df/f1e [4194304,4194304] 0 2024-09-20T18:35:47.306 INFO:tasks.workunit.client.1.smithi172.stdout:0/813: mknod d4/d1a/d28/c121 0 2024-09-20T18:35:47.309 INFO:tasks.workunit.client.1.smithi172.stdout:7/711: dread d2/d3/dd/f7e [0,4194304] 0 2024-09-20T18:35:47.309 INFO:tasks.workunit.client.0.smithi017.stdout:4/94: rmdir d4/dc/d1e/d13 0 2024-09-20T18:35:47.311 INFO:tasks.workunit.client.0.smithi017.stdout:2/229: dread d1/dc/d35/d3d/f34 [0,4194304] 0 2024-09-20T18:35:47.314 INFO:tasks.workunit.client.0.smithi017.stdout:2/230: write d1/dc/d20/d2e/f38 [1603995,24417] 0 2024-09-20T18:35:47.316 INFO:tasks.workunit.client.1.smithi172.stdout:8/627: rmdir dd/d1b 39 2024-09-20T18:35:47.317 INFO:tasks.workunit.client.1.smithi172.stdout:8/628: write dd/f27 [7225881,96505] 0 2024-09-20T18:35:47.318 INFO:tasks.workunit.client.0.smithi017.stdout:8/115: rename d0/fc to d0/f22 0 2024-09-20T18:35:47.319 INFO:tasks.workunit.client.0.smithi017.stdout:8/116: readlink d0/d6/l1a 0 2024-09-20T18:35:47.319 INFO:tasks.workunit.client.1.smithi172.stdout:3/728: symlink d0/d13/d9e/lf7 0 2024-09-20T18:35:47.320 INFO:tasks.workunit.client.0.smithi017.stdout:8/117: dread - d0/f1c zero size 2024-09-20T18:35:47.320 INFO:tasks.workunit.client.1.smithi172.stdout:3/729: chown d0/d13/d32/d54/d83/f85 1 1 2024-09-20T18:35:47.326 INFO:tasks.workunit.client.1.smithi172.stdout:7/712: dread d2/d23/d9d/fc4 [0,4194304] 0 2024-09-20T18:35:47.329 INFO:tasks.workunit.client.0.smithi017.stdout:7/143: truncate da/f2a 1319937 0 2024-09-20T18:35:47.331 INFO:tasks.workunit.client.0.smithi017.stdout:7/144: write da/d16/d1b/f2c [1018938,126828] 0 2024-09-20T18:35:47.331 INFO:tasks.workunit.client.1.smithi172.stdout:3/730: dread d0/dc/d6a/d22/f89 [0,4194304] 0 2024-09-20T18:35:47.332 INFO:tasks.workunit.client.1.smithi172.stdout:1/627: write d0/d8/f44 [692705,33412] 0 2024-09-20T18:35:47.334 INFO:tasks.workunit.client.1.smithi172.stdout:0/814: chown d4/d5/d2e/d33/de1/d7f/ld8 1430766 1 2024-09-20T18:35:47.334 INFO:tasks.workunit.client.0.smithi017.stdout:2/231: symlink d1/l4d 0 2024-09-20T18:35:47.335 INFO:tasks.workunit.client.1.smithi172.stdout:2/593: link d0/d2c/d3f/dab/d22/d10/c6c d0/d2c/d3f/dab/d18/d29/d42/d83/cc5 0 2024-09-20T18:35:47.336 INFO:tasks.workunit.client.0.smithi017.stdout:4/95: link d4/dc/d1e/d26/l20 d4/l28 0 2024-09-20T18:35:47.336 INFO:tasks.workunit.client.1.smithi172.stdout:3/731: dread d0/d13/d58/d6d/db9/d87/f8f [0,4194304] 0 2024-09-20T18:35:47.336 INFO:tasks.workunit.client.0.smithi017.stdout:4/96: read f3 [1978653,86384] 0 2024-09-20T18:35:47.343 INFO:tasks.workunit.client.0.smithi017.stdout:2/232: symlink d1/dc/d20/d2e/d30/l4e 0 2024-09-20T18:35:47.352 INFO:tasks.workunit.client.1.smithi172.stdout:7/713: symlink d2/d3/d10/d40/d46/dd2/lf6 0 2024-09-20T18:35:47.353 INFO:tasks.workunit.client.0.smithi017.stdout:2/233: creat d1/dc/d20/d2e/f4f x:0 0 0 2024-09-20T18:35:47.354 INFO:tasks.workunit.client.0.smithi017.stdout:2/234: truncate d1/df/f4c 892858 0 2024-09-20T18:35:47.355 INFO:tasks.workunit.client.1.smithi172.stdout:6/578: truncate d0/f13 104297 0 2024-09-20T18:35:47.356 INFO:tasks.workunit.client.1.smithi172.stdout:1/628: mkdir d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dcf 0 2024-09-20T18:35:47.357 INFO:tasks.workunit.client.1.smithi172.stdout:4/674: dwrite d0/de/d39/db8/d72/d18/d51/f8e [0,4194304] 0 2024-09-20T18:35:47.358 INFO:tasks.workunit.client.0.smithi017.stdout:6/72: sync 2024-09-20T18:35:47.358 INFO:tasks.workunit.client.0.smithi017.stdout:0/147: sync 2024-09-20T18:35:47.359 INFO:tasks.workunit.client.1.smithi172.stdout:4/675: write d0/d48/d90/d55/d53/d78/fd0 [733087,47192] 0 2024-09-20T18:35:47.359 INFO:tasks.workunit.client.0.smithi017.stdout:6/73: write d4/f10 [3966124,43239] 0 2024-09-20T18:35:47.362 INFO:tasks.workunit.client.1.smithi172.stdout:2/594: unlink d0/c54 0 2024-09-20T18:35:47.365 INFO:tasks.workunit.client.0.smithi017.stdout:8/118: truncate d0/d6/f16 1398712 0 2024-09-20T18:35:47.370 INFO:tasks.workunit.client.0.smithi017.stdout:6/74: write d4/f8 [708221,101898] 0 2024-09-20T18:35:47.372 INFO:tasks.workunit.client.1.smithi172.stdout:5/668: rename d4/df/d3f/d64/c66 to d4/df/dad/d26/d2d/cda 0 2024-09-20T18:35:47.375 INFO:tasks.workunit.client.1.smithi172.stdout:0/815: dread d4/d1a/d28/d42/f81 [0,4194304] 0 2024-09-20T18:35:47.375 INFO:tasks.workunit.client.0.smithi017.stdout:4/97: dwrite d4/f7 [0,4194304] 0 2024-09-20T18:35:47.379 INFO:tasks.workunit.client.0.smithi017.stdout:2/235: symlink d1/dc/d35/l50 0 2024-09-20T18:35:47.380 INFO:tasks.workunit.client.0.smithi017.stdout:6/75: dwrite d4/df/f15 [0,4194304] 0 2024-09-20T18:35:47.381 INFO:tasks.workunit.client.0.smithi017.stdout:2/236: chown d1/d1f/f3e 3010 1 2024-09-20T18:35:47.383 INFO:tasks.workunit.client.1.smithi172.stdout:0/816: dwrite d4/d44/faf [0,4194304] 0 2024-09-20T18:35:47.384 INFO:tasks.workunit.client.0.smithi017.stdout:2/237: write d1/dc/d35/d3d/f43 [1224922,127687] 0 2024-09-20T18:35:47.384 INFO:tasks.workunit.client.1.smithi172.stdout:7/714: dwrite d2/d3/dd/f19 [0,4194304] 0 2024-09-20T18:35:47.387 INFO:tasks.workunit.client.0.smithi017.stdout:2/238: chown d1/dc/d35/d3d/f43 7 1 2024-09-20T18:35:47.389 INFO:tasks.workunit.client.0.smithi017.stdout:4/98: dwrite d4/dc/d1e/d26/d22/f21 [0,4194304] 0 2024-09-20T18:35:47.393 INFO:tasks.workunit.client.1.smithi172.stdout:1/629: read d0/d8/db/fe [3321059,93660] 0 2024-09-20T18:35:47.394 INFO:tasks.workunit.client.1.smithi172.stdout:1/630: write d0/d8/db/d25/d6d/d77/f9b [405115,85180] 0 2024-09-20T18:35:47.397 INFO:tasks.workunit.client.0.smithi017.stdout:4/99: dread d4/dc/f12 [0,4194304] 0 2024-09-20T18:35:47.407 INFO:tasks.workunit.client.1.smithi172.stdout:5/669: fsync d4/df/dad/d26/d41/d69/dac/d2c/f82 0 2024-09-20T18:35:47.408 INFO:tasks.workunit.client.1.smithi172.stdout:5/670: readlink d4/df/dad/d26/d41/d69/la0 0 2024-09-20T18:35:47.408 INFO:tasks.workunit.client.1.smithi172.stdout:5/671: chown d4/df/dad/d26/f32 1648 1 2024-09-20T18:35:47.409 INFO:tasks.workunit.client.0.smithi017.stdout:8/119: link d0/fd d0/d6/f23 0 2024-09-20T18:35:47.411 INFO:tasks.workunit.client.1.smithi172.stdout:0/817: mknod d4/d5/d2e/d38/c122 0 2024-09-20T18:35:47.414 INFO:tasks.workunit.client.1.smithi172.stdout:7/715: creat d2/d3/d86/ff7 x:0 0 0 2024-09-20T18:35:47.414 INFO:tasks.workunit.client.0.smithi017.stdout:4/100: rmdir d4/de 39 2024-09-20T18:35:47.414 INFO:tasks.workunit.client.1.smithi172.stdout:4/676: write d0/d7/fba [869844,8147] 0 2024-09-20T18:35:47.416 INFO:tasks.workunit.client.0.smithi017.stdout:0/148: truncate d4/db/d18/f22 698042 0 2024-09-20T18:35:47.417 INFO:tasks.workunit.client.1.smithi172.stdout:7/716: write d2/d3/d10/d40/d46/d8e/dbd/fde [906084,4544] 0 2024-09-20T18:35:47.420 INFO:tasks.workunit.client.0.smithi017.stdout:7/145: truncate da/fc 1164004 0 2024-09-20T18:35:47.422 INFO:tasks.workunit.client.1.smithi172.stdout:4/677: dwrite d0/de/d39/f73 [0,4194304] 0 2024-09-20T18:35:47.423 INFO:tasks.workunit.client.1.smithi172.stdout:3/732: dwrite d0/d13/d32/f8a [0,4194304] 0 2024-09-20T18:35:47.423 INFO:tasks.workunit.client.0.smithi017.stdout:2/239: link d1/d1f/f3e d1/dc/d35/d46/f51 0 2024-09-20T18:35:47.424 INFO:tasks.workunit.client.0.smithi017.stdout:2/240: dread - d1/dc/d20/d2e/f42 zero size 2024-09-20T18:35:47.425 INFO:tasks.workunit.client.0.smithi017.stdout:2/241: chown d1/dc/d35/d46/f3b 441 1 2024-09-20T18:35:47.425 INFO:tasks.workunit.client.1.smithi172.stdout:1/631: mkdir d0/d8/d12/d96/dd0 0 2024-09-20T18:35:47.426 INFO:tasks.workunit.client.1.smithi172.stdout:5/672: dread d4/df/d3f/f49 [0,4194304] 0 2024-09-20T18:35:47.428 INFO:tasks.workunit.client.0.smithi017.stdout:0/149: symlink d4/db/d1e/l34 0 2024-09-20T18:35:47.428 INFO:tasks.workunit.client.1.smithi172.stdout:5/673: truncate d4/f14 4802538 0 2024-09-20T18:35:47.429 INFO:tasks.workunit.client.1.smithi172.stdout:5/674: dread - d4/df/d98/fc1 zero size 2024-09-20T18:35:47.429 INFO:tasks.workunit.client.1.smithi172.stdout:4/678: dread d0/d48/d90/d55/d53/d78/fd0 [0,4194304] 0 2024-09-20T18:35:47.431 INFO:tasks.workunit.client.1.smithi172.stdout:4/679: chown d0/de/d39/db8/l58 56 1 2024-09-20T18:35:47.433 INFO:tasks.workunit.client.1.smithi172.stdout:2/595: creat d0/d2c/d3f/dab/d22/d10/d3c/d68/fc6 x:0 0 0 2024-09-20T18:35:47.434 INFO:tasks.workunit.client.1.smithi172.stdout:8/629: creat dd/d1b/d3b/d51/fd8 x:0 0 0 2024-09-20T18:35:47.436 INFO:tasks.workunit.client.1.smithi172.stdout:4/680: dread d0/de/d39/db8/d72/d18/d51/f8e [0,4194304] 0 2024-09-20T18:35:47.439 INFO:tasks.workunit.client.1.smithi172.stdout:6/579: unlink d0/d18/d1c/d21/c5d 0 2024-09-20T18:35:47.439 INFO:tasks.workunit.client.0.smithi017.stdout:2/242: mknod d1/dc/d20/d2e/d30/c52 0 2024-09-20T18:35:47.441 INFO:tasks.workunit.client.1.smithi172.stdout:4/681: dwrite d0/de/d21/d24/fa7 [0,4194304] 0 2024-09-20T18:35:47.442 INFO:tasks.workunit.client.0.smithi017.stdout:0/150: dwrite d4/db/f2c [0,4194304] 0 2024-09-20T18:35:47.443 INFO:tasks.workunit.client.0.smithi017.stdout:6/76: dwrite d4/f9 [0,4194304] 0 2024-09-20T18:35:47.452 INFO:tasks.workunit.client.0.smithi017.stdout:4/101: dwrite d4/de/f27 [0,4194304] 0 2024-09-20T18:35:47.455 INFO:tasks.workunit.client.0.smithi017.stdout:8/120: dwrite d0/f22 [4194304,4194304] 0 2024-09-20T18:35:47.460 INFO:tasks.workunit.client.0.smithi017.stdout:2/243: unlink d1/dc/d20/f26 0 2024-09-20T18:35:47.461 INFO:tasks.workunit.client.0.smithi017.stdout:6/77: symlink d4/l1c 0 2024-09-20T18:35:47.461 INFO:tasks.workunit.client.1.smithi172.stdout:8/630: creat dd/da9/fd9 x:0 0 0 2024-09-20T18:35:47.465 INFO:tasks.workunit.client.1.smithi172.stdout:9/627: rename d15/d20/l71 to d15/lcd 0 2024-09-20T18:35:47.466 INFO:tasks.workunit.client.0.smithi017.stdout:8/121: dread d0/d6/f23 [0,4194304] 0 2024-09-20T18:35:47.467 INFO:tasks.workunit.client.1.smithi172.stdout:2/596: symlink d0/d2c/d3f/dab/d22/d10/d97/d9f/lc7 0 2024-09-20T18:35:47.468 INFO:tasks.workunit.client.1.smithi172.stdout:8/631: dwrite dd/d1b/d3b/d51/f76 [0,4194304] 0 2024-09-20T18:35:47.469 INFO:tasks.workunit.client.1.smithi172.stdout:1/632: dread d0/d8/db/d25/d6f/f79 [0,4194304] 0 2024-09-20T18:35:47.469 INFO:tasks.workunit.client.0.smithi017.stdout:4/102: dwrite d4/d19/f15 [0,4194304] 0 2024-09-20T18:35:47.470 INFO:tasks.workunit.client.1.smithi172.stdout:2/597: dread - d0/d2c/d3f/dab/d22/d10/d3c/d68/fc6 zero size 2024-09-20T18:35:47.472 INFO:tasks.workunit.client.0.smithi017.stdout:6/78: dwrite d4/fc [0,4194304] 0 2024-09-20T18:35:47.478 INFO:tasks.workunit.client.0.smithi017.stdout:2/244: unlink d1/df/c23 0 2024-09-20T18:35:47.481 INFO:tasks.workunit.client.1.smithi172.stdout:0/818: mkdir d4/d1a/d28/d123 0 2024-09-20T18:35:47.482 INFO:tasks.workunit.client.0.smithi017.stdout:2/245: chown d1/c12 11252740 1 2024-09-20T18:35:47.483 INFO:tasks.workunit.client.1.smithi172.stdout:4/682: truncate d0/d48/d90/f37 229482 0 2024-09-20T18:35:47.483 INFO:tasks.workunit.client.0.smithi017.stdout:4/103: dwrite d4/dc/d1e/f18 [0,4194304] 0 2024-09-20T18:35:47.485 INFO:tasks.workunit.client.1.smithi172.stdout:4/683: write d0/d48/d90/d55/fe2 [753118,32363] 0 2024-09-20T18:35:47.489 INFO:tasks.workunit.client.0.smithi017.stdout:8/122: chown d0/d6/f16 274 1 2024-09-20T18:35:47.492 INFO:tasks.workunit.client.1.smithi172.stdout:5/675: mknod d4/df/dad/cdb 0 2024-09-20T18:35:47.494 INFO:tasks.workunit.client.0.smithi017.stdout:4/104: mknod d4/de/c29 0 2024-09-20T18:35:47.495 INFO:tasks.workunit.client.1.smithi172.stdout:4/684: dwrite d0/de/d39/db8/d72/d18/d51/d9a/fab [4194304,4194304] 0 2024-09-20T18:35:47.495 INFO:tasks.workunit.client.0.smithi017.stdout:2/246: dwrite d1/dc/d20/d2e/f42 [0,4194304] 0 2024-09-20T18:35:47.497 INFO:tasks.workunit.client.1.smithi172.stdout:3/733: rename d0/dc/d6a/d3a/dcb/fd7 to d0/d13/d58/d6d/db9/dd6/ff8 0 2024-09-20T18:35:47.498 INFO:tasks.workunit.client.0.smithi017.stdout:4/105: write d4/de/f27 [1298410,130037] 0 2024-09-20T18:35:47.499 INFO:tasks.workunit.client.1.smithi172.stdout:3/734: chown d0/d13/d32/d54/d83/cf5 0 1 2024-09-20T18:35:47.500 INFO:tasks.workunit.client.0.smithi017.stdout:4/106: read d4/fa [3589205,29702] 0 2024-09-20T18:35:47.500 INFO:tasks.workunit.client.0.smithi017.stdout:2/247: fsync d1/dc/d35/d46/d48/f4a 0 2024-09-20T18:35:47.502 INFO:tasks.workunit.client.1.smithi172.stdout:2/598: dread d0/d2c/f70 [0,4194304] 0 2024-09-20T18:35:47.506 INFO:tasks.workunit.client.1.smithi172.stdout:1/633: truncate d0/d8/f32 851205 0 2024-09-20T18:35:47.506 INFO:tasks.workunit.client.1.smithi172.stdout:0/819: creat d4/d5/d2e/d33/de1/dac/dd0/f124 x:0 0 0 2024-09-20T18:35:47.507 INFO:tasks.workunit.client.0.smithi017.stdout:8/123: symlink d0/l24 0 2024-09-20T18:35:47.508 INFO:tasks.workunit.client.1.smithi172.stdout:5/676: fdatasync d4/df/dad/d26/d41/d69/dac/d2c/f7d 0 2024-09-20T18:35:47.513 INFO:tasks.workunit.client.0.smithi017.stdout:6/79: link l3 d4/df/l1d 0 2024-09-20T18:35:47.516 INFO:tasks.workunit.client.0.smithi017.stdout:8/124: creat d0/d6/f25 x:0 0 0 2024-09-20T18:35:47.516 INFO:tasks.workunit.client.1.smithi172.stdout:3/735: fsync d0/dc/d6a/d22/f89 0 2024-09-20T18:35:47.517 INFO:tasks.workunit.client.0.smithi017.stdout:2/248: mkdir d1/dc/d35/d53 0 2024-09-20T18:35:47.518 INFO:tasks.workunit.client.1.smithi172.stdout:8/632: symlink dd/d1b/d3b/dc7/lda 0 2024-09-20T18:35:47.520 INFO:tasks.workunit.client.0.smithi017.stdout:6/80: creat d4/f1e x:0 0 0 2024-09-20T18:35:47.521 INFO:tasks.workunit.client.1.smithi172.stdout:2/599: readlink d0/d2c/d3f/dab/d45/lac 0 2024-09-20T18:35:47.522 INFO:tasks.workunit.client.0.smithi017.stdout:8/125: symlink d0/d6/l26 0 2024-09-20T18:35:47.525 INFO:tasks.workunit.client.0.smithi017.stdout:2/249: creat d1/dc/d20/d2e/d30/f54 x:0 0 0 2024-09-20T18:35:47.527 INFO:tasks.workunit.client.1.smithi172.stdout:1/634: unlink d0/d8/fbf 0 2024-09-20T18:35:47.529 INFO:tasks.workunit.client.1.smithi172.stdout:0/820: creat d4/d94/f125 x:0 0 0 2024-09-20T18:35:47.531 INFO:tasks.workunit.client.1.smithi172.stdout:5/677: symlink d4/df/dad/d26/d41/d69/dac/ldc 0 2024-09-20T18:35:47.532 INFO:tasks.workunit.client.1.smithi172.stdout:5/678: chown d4/df/dad/d26/d41/l4f 13 1 2024-09-20T18:35:47.534 INFO:tasks.workunit.client.0.smithi017.stdout:2/250: mknod d1/dc/c55 0 2024-09-20T18:35:47.535 INFO:tasks.workunit.client.1.smithi172.stdout:8/633: mkdir dd/d1b/d3b/dc7/ddb 0 2024-09-20T18:35:47.536 INFO:tasks.workunit.client.0.smithi017.stdout:2/251: truncate d1/dc/d35/d3d/f44 82372 0 2024-09-20T18:35:47.538 INFO:tasks.workunit.client.0.smithi017.stdout:8/126: rename d0/d6/l1a to d0/l27 0 2024-09-20T18:35:47.540 INFO:tasks.workunit.client.1.smithi172.stdout:6/580: creat d0/d18/d1c/d21/d26/d79/fb9 x:0 0 0 2024-09-20T18:35:47.540 INFO:tasks.workunit.client.0.smithi017.stdout:6/81: getdents d4/df 0 2024-09-20T18:35:47.541 INFO:tasks.workunit.client.1.smithi172.stdout:8/634: dwrite dd/f27 [4194304,4194304] 0 2024-09-20T18:35:47.541 INFO:tasks.workunit.client.1.smithi172.stdout:7/717: sync 2024-09-20T18:35:47.542 INFO:tasks.workunit.client.0.smithi017.stdout:8/127: rmdir d0 39 2024-09-20T18:35:47.544 INFO:tasks.workunit.client.1.smithi172.stdout:3/736: dread d0/d13/d1e/f24 [0,4194304] 0 2024-09-20T18:35:47.545 INFO:tasks.workunit.client.0.smithi017.stdout:2/252: mknod d1/dc/c56 0 2024-09-20T18:35:47.545 INFO:tasks.workunit.client.0.smithi017.stdout:2/253: stat d1/dc/d20/d2e/d30 0 2024-09-20T18:35:47.547 INFO:tasks.workunit.client.0.smithi017.stdout:2/254: readlink d1/dc/d20/l29 0 2024-09-20T18:35:47.548 INFO:tasks.workunit.client.1.smithi172.stdout:4/685: creat d0/ff3 x:0 0 0 2024-09-20T18:35:47.550 INFO:tasks.workunit.client.0.smithi017.stdout:2/255: unlink d1/df/f4c 0 2024-09-20T18:35:47.552 INFO:tasks.workunit.client.1.smithi172.stdout:5/679: creat d4/df/dad/d26/d41/d65/fdd x:0 0 0 2024-09-20T18:35:47.554 INFO:tasks.workunit.client.0.smithi017.stdout:8/128: dwrite d0/f19 [0,4194304] 0 2024-09-20T18:35:47.555 INFO:tasks.workunit.client.1.smithi172.stdout:2/600: symlink d0/d2c/d3f/dab/d22/d10/d3c/d7b/d9d/lc8 0 2024-09-20T18:35:47.557 INFO:tasks.workunit.client.0.smithi017.stdout:6/82: getdents d4 0 2024-09-20T18:35:47.560 INFO:tasks.workunit.client.0.smithi017.stdout:8/129: mkdir d0/d6/d28 0 2024-09-20T18:35:47.563 INFO:tasks.workunit.client.0.smithi017.stdout:6/83: mkdir d4/df/d1f 0 2024-09-20T18:35:47.564 INFO:tasks.workunit.client.1.smithi172.stdout:6/581: dwrite d0/d18/d1c/d21/f88 [0,4194304] 0 2024-09-20T18:35:47.565 INFO:tasks.workunit.client.1.smithi172.stdout:7/718: creat d2/d3/d3d/ff8 x:0 0 0 2024-09-20T18:35:47.570 INFO:tasks.workunit.client.0.smithi017.stdout:6/84: rmdir d4/df 39 2024-09-20T18:35:47.570 INFO:tasks.workunit.client.1.smithi172.stdout:9/628: sync 2024-09-20T18:35:47.570 INFO:tasks.workunit.client.1.smithi172.stdout:9/629: chown d15/d1f/d2c/d7d/d58 135271 1 2024-09-20T18:35:47.571 INFO:tasks.workunit.client.1.smithi172.stdout:3/737: rename d0/l5e to d0/dc/d6a/dc5/lf9 0 2024-09-20T18:35:47.572 INFO:tasks.workunit.client.0.smithi017.stdout:2/256: getdents d1/dc/d35 0 2024-09-20T18:35:47.572 INFO:tasks.workunit.client.0.smithi017.stdout:2/257: chown d1/df/d17/l19 915034363 1 2024-09-20T18:35:47.573 INFO:tasks.workunit.client.0.smithi017.stdout:8/130: creat d0/d6/d28/f29 x:0 0 0 2024-09-20T18:35:47.574 INFO:tasks.workunit.client.0.smithi017.stdout:2/258: read - d1/dc/d35/d46/d48/f4a zero size 2024-09-20T18:35:47.576 INFO:tasks.workunit.client.1.smithi172.stdout:8/635: write fa [4080086,15420] 0 2024-09-20T18:35:47.577 INFO:tasks.workunit.client.0.smithi017.stdout:1/47: sync 2024-09-20T18:35:47.577 INFO:tasks.workunit.client.1.smithi172.stdout:8/636: dread - dd/d65/d85/fcc zero size 2024-09-20T18:35:47.578 INFO:tasks.workunit.client.1.smithi172.stdout:8/637: fdatasync dd/d1b/f1f 0 2024-09-20T18:35:47.579 INFO:tasks.workunit.client.1.smithi172.stdout:1/635: truncate d0/d8/db/d25/d2b/d3d/f8e 3929043 0 2024-09-20T18:35:47.581 INFO:tasks.workunit.client.0.smithi017.stdout:1/48: dread f3 [0,4194304] 0 2024-09-20T18:35:47.581 INFO:tasks.workunit.client.0.smithi017.stdout:2/259: symlink d1/dc/d20/d2e/d30/l57 0 2024-09-20T18:35:47.583 INFO:tasks.workunit.client.1.smithi172.stdout:0/821: truncate d4/d44/f5c 2462202 0 2024-09-20T18:35:47.584 INFO:tasks.workunit.client.0.smithi017.stdout:6/85: mknod d4/df/c20 0 2024-09-20T18:35:47.585 INFO:tasks.workunit.client.0.smithi017.stdout:1/49: dread f2 [0,4194304] 0 2024-09-20T18:35:47.586 INFO:tasks.workunit.client.0.smithi017.stdout:6/86: write d4/fc [2015090,91221] 0 2024-09-20T18:35:47.588 INFO:tasks.workunit.client.1.smithi172.stdout:4/686: write d0/de/d39/db8/d72/d18/d51/f8e [1542907,13382] 0 2024-09-20T18:35:47.588 INFO:tasks.workunit.client.1.smithi172.stdout:6/582: rmdir d0/d18/d1c/d21/d26/d34/d7a 39 2024-09-20T18:35:47.590 INFO:tasks.workunit.client.1.smithi172.stdout:5/680: write d4/df/f89 [2722380,7291] 0 2024-09-20T18:35:47.594 INFO:tasks.workunit.client.1.smithi172.stdout:4/687: dwrite d0/de/f4c [4194304,4194304] 0 2024-09-20T18:35:47.596 INFO:tasks.workunit.client.1.smithi172.stdout:9/630: creat d15/d1a/d64/fce x:0 0 0 2024-09-20T18:35:47.599 INFO:tasks.workunit.client.0.smithi017.stdout:2/260: dread d1/df/d17/f1a [0,4194304] 0 2024-09-20T18:35:47.600 INFO:tasks.workunit.client.0.smithi017.stdout:1/50: creat fc x:0 0 0 2024-09-20T18:35:47.601 INFO:tasks.workunit.client.0.smithi017.stdout:2/261: chown d1/dc/d20/d2e/c2f 24 1 2024-09-20T18:35:47.602 INFO:tasks.workunit.client.0.smithi017.stdout:6/87: unlink d4/df/c13 0 2024-09-20T18:35:47.607 INFO:tasks.workunit.client.1.smithi172.stdout:1/636: chown d0/d8/db/d39/l95 0 1 2024-09-20T18:35:47.609 INFO:tasks.workunit.client.1.smithi172.stdout:1/637: read d0/d8/db/d25/d6d/f7e [3416080,18127] 0 2024-09-20T18:35:47.609 INFO:tasks.workunit.client.1.smithi172.stdout:2/601: rename d0/d60/f66 to d0/d2c/d3f/dab/d18/d29/d42/d4b/d53/fc9 0 2024-09-20T18:35:47.610 INFO:tasks.workunit.client.0.smithi017.stdout:1/51: rename l9 to ld 0 2024-09-20T18:35:47.613 INFO:tasks.workunit.client.0.smithi017.stdout:8/131: getdents d0 0 2024-09-20T18:35:47.614 INFO:tasks.workunit.client.0.smithi017.stdout:8/132: read d0/f22 [6509303,127371] 0 2024-09-20T18:35:47.614 INFO:tasks.workunit.client.1.smithi172.stdout:7/719: unlink d2/d3/d3d/d4e/fad 0 2024-09-20T18:35:47.614 INFO:tasks.workunit.client.0.smithi017.stdout:8/133: fsync d0/d6/f25 0 2024-09-20T18:35:47.615 INFO:tasks.workunit.client.0.smithi017.stdout:1/52: mknod ce 0 2024-09-20T18:35:47.615 INFO:tasks.workunit.client.1.smithi172.stdout:7/720: read d2/d23/d3a/f71 [659086,114550] 0 2024-09-20T18:35:47.617 INFO:tasks.workunit.client.1.smithi172.stdout:7/721: write d2/d3/d10/f20 [4146099,50331] 0 2024-09-20T18:35:47.617 INFO:tasks.workunit.client.0.smithi017.stdout:2/262: fsync d1/f3a 0 2024-09-20T18:35:47.618 INFO:tasks.workunit.client.0.smithi017.stdout:6/88: getdents d4/df/d1f 0 2024-09-20T18:35:47.619 INFO:tasks.workunit.client.0.smithi017.stdout:6/89: truncate d4/f1e 580532 0 2024-09-20T18:35:47.619 INFO:tasks.workunit.client.1.smithi172.stdout:9/631: creat d15/d20/fcf x:0 0 0 2024-09-20T18:35:47.621 INFO:tasks.workunit.client.1.smithi172.stdout:3/738: mknod d0/dc/d6a/cfa 0 2024-09-20T18:35:47.624 INFO:tasks.workunit.client.0.smithi017.stdout:1/53: dread f2 [0,4194304] 0 2024-09-20T18:35:47.631 INFO:tasks.workunit.client.1.smithi172.stdout:5/681: dwrite d4/df/dad/d26/d41/f54 [0,4194304] 0 2024-09-20T18:35:47.632 INFO:tasks.workunit.client.1.smithi172.stdout:2/602: mkdir d0/d2c/dca 0 2024-09-20T18:35:47.632 INFO:tasks.workunit.client.0.smithi017.stdout:1/54: read f3 [2387276,58197] 0 2024-09-20T18:35:47.633 INFO:tasks.workunit.client.0.smithi017.stdout:1/55: write fc [908459,89635] 0 2024-09-20T18:35:47.634 INFO:tasks.workunit.client.1.smithi172.stdout:0/822: symlink d4/d5/d2e/d33/de1/dac/dbc/l126 0 2024-09-20T18:35:47.634 INFO:tasks.workunit.client.0.smithi017.stdout:1/56: readlink l8 0 2024-09-20T18:35:47.639 INFO:tasks.workunit.client.1.smithi172.stdout:0/823: dwrite d4/d1a/d28/d42/f83 [0,4194304] 0 2024-09-20T18:35:47.643 INFO:tasks.workunit.client.0.smithi017.stdout:2/263: rename d1/dc/d35 to d1/dc/d58 0 2024-09-20T18:35:47.644 INFO:tasks.workunit.client.1.smithi172.stdout:1/638: write d0/d8/d5f/f6e [999016,111701] 0 2024-09-20T18:35:47.645 INFO:tasks.workunit.client.1.smithi172.stdout:4/688: mkdir d0/de/df4 0 2024-09-20T18:35:47.647 INFO:tasks.workunit.client.0.smithi017.stdout:6/90: creat d4/f21 x:0 0 0 2024-09-20T18:35:47.647 INFO:tasks.workunit.client.1.smithi172.stdout:1/639: chown d0/d8/db/d25/d2b/d3d/d65/fc0 0 1 2024-09-20T18:35:47.648 INFO:tasks.workunit.client.0.smithi017.stdout:6/91: write d4/fc [3757161,42539] 0 2024-09-20T18:35:47.649 INFO:tasks.workunit.client.1.smithi172.stdout:7/722: creat d2/d3/d86/ff9 x:0 0 0 2024-09-20T18:35:47.649 INFO:tasks.workunit.client.0.smithi017.stdout:8/134: getdents d0/d6/d28 0 2024-09-20T18:35:47.650 INFO:tasks.workunit.client.0.smithi017.stdout:8/135: stat d0/f22 0 2024-09-20T18:35:47.650 INFO:tasks.workunit.client.1.smithi172.stdout:6/583: write d0/d18/f23 [2231747,63453] 0 2024-09-20T18:35:47.650 INFO:tasks.workunit.client.1.smithi172.stdout:9/632: write d15/d54/f60 [169257,22266] 0 2024-09-20T18:35:47.651 INFO:tasks.workunit.client.0.smithi017.stdout:8/136: truncate d0/d6/f20 254415 0 2024-09-20T18:35:47.652 INFO:tasks.workunit.client.1.smithi172.stdout:9/633: write d15/fc1 [437132,64278] 0 2024-09-20T18:35:47.652 INFO:tasks.workunit.client.1.smithi172.stdout:3/739: truncate d0/dc/d6a/d3a/f3f 1099748 0 2024-09-20T18:35:47.653 INFO:tasks.workunit.client.0.smithi017.stdout:8/137: write d0/d6/d28/f29 [665823,123308] 0 2024-09-20T18:35:47.653 INFO:tasks.workunit.client.0.smithi017.stdout:8/138: chown d0/f22 838 1 2024-09-20T18:35:47.653 INFO:tasks.workunit.client.1.smithi172.stdout:3/740: fdatasync d0/dc/fa0 0 2024-09-20T18:35:47.654 INFO:tasks.workunit.client.0.smithi017.stdout:1/57: write f2 [1632382,112206] 0 2024-09-20T18:35:47.658 INFO:tasks.workunit.client.0.smithi017.stdout:8/139: creat d0/f2a x:0 0 0 2024-09-20T18:35:47.661 INFO:tasks.workunit.client.0.smithi017.stdout:1/58: chown c7 448 1 2024-09-20T18:35:47.665 INFO:tasks.workunit.client.0.smithi017.stdout:2/264: creat d1/f59 x:0 0 0 2024-09-20T18:35:47.667 INFO:tasks.workunit.client.0.smithi017.stdout:1/59: fdatasync f3 0 2024-09-20T18:35:47.668 INFO:tasks.workunit.client.1.smithi172.stdout:8/638: rmdir dd/d1b/d4f/dd4 0 2024-09-20T18:35:47.669 INFO:tasks.workunit.client.1.smithi172.stdout:5/682: creat d4/df/d98/fde x:0 0 0 2024-09-20T18:35:47.669 INFO:tasks.workunit.client.1.smithi172.stdout:2/603: rmdir d0/d2c/d3f 39 2024-09-20T18:35:47.670 INFO:tasks.workunit.client.1.smithi172.stdout:0/824: rmdir d4/d20 39 2024-09-20T18:35:47.671 INFO:tasks.workunit.client.1.smithi172.stdout:6/584: creat d0/d18/d1c/d21/d26/d34/d6b/d7d/fba x:0 0 0 2024-09-20T18:35:47.673 INFO:tasks.workunit.client.0.smithi017.stdout:6/92: dwrite d4/f14 [0,4194304] 0 2024-09-20T18:35:47.673 INFO:tasks.workunit.client.0.smithi017.stdout:2/265: write d1/dc/d20/d2e/d30/f4b [570995,82733] 0 2024-09-20T18:35:47.675 INFO:tasks.workunit.client.1.smithi172.stdout:9/634: dwrite d15/d1f/d2c/d37/fb7 [0,4194304] 0 2024-09-20T18:35:47.675 INFO:tasks.workunit.client.1.smithi172.stdout:0/825: write d4/d1a/d28/d42/db8/dcd/dce/f108 [86543,71277] 0 2024-09-20T18:35:47.676 INFO:tasks.workunit.client.0.smithi017.stdout:1/60: mkdir df 0 2024-09-20T18:35:47.676 INFO:tasks.workunit.client.0.smithi017.stdout:2/266: truncate d1/dc/d58/d3d/f44 190129 0 2024-09-20T18:35:47.680 INFO:tasks.workunit.client.1.smithi172.stdout:5/683: dwrite d4/df/d98/f9c [0,4194304] 0 2024-09-20T18:35:47.683 INFO:tasks.workunit.client.0.smithi017.stdout:1/61: dwrite f2 [0,4194304] 0 2024-09-20T18:35:47.684 INFO:tasks.workunit.client.0.smithi017.stdout:2/267: creat d1/d1f/f5a x:0 0 0 2024-09-20T18:35:47.704 INFO:tasks.workunit.client.1.smithi172.stdout:3/741: mkdir d0/d13/dfb 0 2024-09-20T18:35:47.705 INFO:tasks.workunit.client.1.smithi172.stdout:0/826: mkdir d4/d1a/d28/d42/db8/dcd/dce/d127 0 2024-09-20T18:35:47.706 INFO:tasks.workunit.client.1.smithi172.stdout:7/723: write d2/d3/d10/d40/d74/f9e [309036,53018] 0 2024-09-20T18:35:47.710 INFO:tasks.workunit.client.1.smithi172.stdout:2/604: creat d0/d2c/d3f/dab/d22/d10/d6a/fcb x:0 0 0 2024-09-20T18:35:47.711 INFO:tasks.workunit.client.0.smithi017.stdout:2/268: truncate d1/df/f1e 3218491 0 2024-09-20T18:35:47.711 INFO:tasks.workunit.client.1.smithi172.stdout:8/639: getdents dd/d65/d85/da2 0 2024-09-20T18:35:47.711 INFO:tasks.workunit.client.1.smithi172.stdout:8/640: fdatasync dd/d1b/d3b/d51/d5b/d6b/fb7 0 2024-09-20T18:35:47.711 INFO:tasks.workunit.client.0.smithi017.stdout:8/140: rename d0/d6/c1d to d0/c2b 0 2024-09-20T18:35:47.712 INFO:tasks.workunit.client.0.smithi017.stdout:1/62: creat df/f10 x:0 0 0 2024-09-20T18:35:47.713 INFO:tasks.workunit.client.1.smithi172.stdout:6/585: mknod d0/d18/d65/cbb 0 2024-09-20T18:35:47.713 INFO:tasks.workunit.client.0.smithi017.stdout:2/269: mknod d1/d1f/c5b 0 2024-09-20T18:35:47.715 INFO:tasks.workunit.client.1.smithi172.stdout:3/742: symlink d0/d13/d58/d6d/d7f/lfc 0 2024-09-20T18:35:47.716 INFO:tasks.workunit.client.0.smithi017.stdout:6/93: truncate d4/df/f15 1529862 0 2024-09-20T18:35:47.717 INFO:tasks.workunit.client.0.smithi017.stdout:6/94: dread - d4/f21 zero size 2024-09-20T18:35:47.718 INFO:tasks.workunit.client.1.smithi172.stdout:0/827: unlink d4/d1a/d28/c8f 0 2024-09-20T18:35:47.719 INFO:tasks.workunit.client.0.smithi017.stdout:1/63: creat df/f11 x:0 0 0 2024-09-20T18:35:47.720 INFO:tasks.workunit.client.1.smithi172.stdout:0/828: truncate d4/d1a/d28/d75/f8d 4612646 0 2024-09-20T18:35:47.720 INFO:tasks.workunit.client.1.smithi172.stdout:7/724: mkdir d2/de7/dfa 0 2024-09-20T18:35:47.721 INFO:tasks.workunit.client.0.smithi017.stdout:1/64: chown df/f11 9905424 1 2024-09-20T18:35:47.721 INFO:tasks.workunit.client.1.smithi172.stdout:3/743: dwrite d0/dc/d6a/d22/f8c [4194304,4194304] 0 2024-09-20T18:35:47.721 INFO:tasks.workunit.client.0.smithi017.stdout:2/270: dwrite d1/d1f/f3f [0,4194304] 0 2024-09-20T18:35:47.723 INFO:tasks.workunit.client.0.smithi017.stdout:2/271: stat d1/f59 0 2024-09-20T18:35:47.724 INFO:tasks.workunit.client.1.smithi172.stdout:5/684: write d4/f91 [123765,44255] 0 2024-09-20T18:35:47.728 INFO:tasks.workunit.client.1.smithi172.stdout:8/641: symlink dd/d1b/d3b/d51/d5b/ldc 0 2024-09-20T18:35:47.730 INFO:tasks.workunit.client.0.smithi017.stdout:6/95: dwrite d4/df/f16 [0,4194304] 0 2024-09-20T18:35:47.732 INFO:tasks.workunit.client.0.smithi017.stdout:1/65: dwrite df/f11 [0,4194304] 0 2024-09-20T18:35:47.735 INFO:tasks.workunit.client.1.smithi172.stdout:0/829: symlink d4/d1a/d28/d42/l128 0 2024-09-20T18:35:47.736 INFO:tasks.workunit.client.1.smithi172.stdout:7/725: creat d2/d3/d10/d40/d46/d8e/dbd/ffb x:0 0 0 2024-09-20T18:35:47.738 INFO:tasks.workunit.client.1.smithi172.stdout:3/744: mknod d0/d13/d58/d6d/d7f/d84/dd9/cfd 0 2024-09-20T18:35:47.740 INFO:tasks.workunit.client.1.smithi172.stdout:2/605: creat d0/d1a/dc0/fcc x:0 0 0 2024-09-20T18:35:47.741 INFO:tasks.workunit.client.0.smithi017.stdout:6/96: creat d4/df/d1f/f22 x:0 0 0 2024-09-20T18:35:47.742 INFO:tasks.workunit.client.1.smithi172.stdout:2/606: readlink d0/d2c/d3f/dab/d22/d10/d35/lb7 0 2024-09-20T18:35:47.744 INFO:tasks.workunit.client.0.smithi017.stdout:1/66: rename ld to df/l12 0 2024-09-20T18:35:47.745 INFO:tasks.workunit.client.0.smithi017.stdout:1/67: rename df to df/d13 22 2024-09-20T18:35:47.748 INFO:tasks.workunit.client.0.smithi017.stdout:6/97: dwrite d4/f10 [0,4194304] 0 2024-09-20T18:35:47.749 INFO:tasks.workunit.client.0.smithi017.stdout:6/98: readlink d4/l6 0 2024-09-20T18:35:47.751 INFO:tasks.workunit.client.0.smithi017.stdout:1/68: creat df/f14 x:0 0 0 2024-09-20T18:35:47.752 INFO:tasks.workunit.client.0.smithi017.stdout:1/69: chown f3 7108 1 2024-09-20T18:35:47.753 INFO:tasks.workunit.client.0.smithi017.stdout:1/70: write fc [1756520,19510] 0 2024-09-20T18:35:47.757 INFO:tasks.workunit.client.1.smithi172.stdout:0/830: chown d4/d5/d2e/d33/de1/d15/f1b 372 1 2024-09-20T18:35:47.758 INFO:tasks.workunit.client.0.smithi017.stdout:5/81: sync 2024-09-20T18:35:47.761 INFO:tasks.workunit.client.0.smithi017.stdout:1/71: rename c5 to df/c15 0 2024-09-20T18:35:47.763 INFO:tasks.workunit.client.0.smithi017.stdout:8/141: truncate d0/f14 2053844 0 2024-09-20T18:35:47.764 INFO:tasks.workunit.client.1.smithi172.stdout:5/685: creat d4/df/dad/d26/d2d/d63/d80/dd7/fdf x:0 0 0 2024-09-20T18:35:47.767 INFO:tasks.workunit.client.1.smithi172.stdout:2/607: rename d0/d2c/d3f/dab/d22/d4c/f5e to d0/d2c/d3f/dab/d22/d10/d97/d9f/fcd 0 2024-09-20T18:35:47.768 INFO:tasks.workunit.client.1.smithi172.stdout:4/689: sync 2024-09-20T18:35:47.769 INFO:tasks.workunit.client.1.smithi172.stdout:4/690: write d0/de/d39/d9f/fe5 [313427,102154] 0 2024-09-20T18:35:47.771 INFO:tasks.workunit.client.1.smithi172.stdout:0/831: chown d4/d5/d2e/d33/de1/d15/dfe/l10f 12579 1 2024-09-20T18:35:47.774 INFO:tasks.workunit.client.1.smithi172.stdout:7/726: truncate d2/d3/d10/d40/d46/fa8 315891 0 2024-09-20T18:35:47.777 INFO:tasks.workunit.client.1.smithi172.stdout:3/745: mkdir d0/d13/dfe 0 2024-09-20T18:35:47.777 INFO:tasks.workunit.client.1.smithi172.stdout:8/642: write dd/d1b/d3b/d51/d5b/d6b/f64 [321816,25017] 0 2024-09-20T18:35:47.780 INFO:tasks.workunit.client.1.smithi172.stdout:5/686: creat d4/df/d3f/fe0 x:0 0 0 2024-09-20T18:35:47.781 INFO:tasks.workunit.client.1.smithi172.stdout:6/586: truncate d0/d18/d1c/d21/d26/d34/d39/d46/f2a 1271928 0 2024-09-20T18:35:47.782 INFO:tasks.workunit.client.1.smithi172.stdout:6/587: chown d0/d18/d1c/d21/d26/d34/l8d 52421 1 2024-09-20T18:35:47.782 INFO:tasks.workunit.client.1.smithi172.stdout:2/608: creat d0/d90/fce x:0 0 0 2024-09-20T18:35:47.791 INFO:tasks.workunit.client.1.smithi172.stdout:7/727: mknod d2/d3/d10/d40/d6a/dc6/cfc 0 2024-09-20T18:35:47.793 INFO:tasks.workunit.client.1.smithi172.stdout:8/643: mkdir dd/d1b/d4f/ddd 0 2024-09-20T18:35:47.795 INFO:tasks.workunit.client.1.smithi172.stdout:3/746: creat d0/d13/d58/d6d/d7f/fff x:0 0 0 2024-09-20T18:35:47.795 INFO:tasks.workunit.client.0.smithi017.stdout:5/82: truncate d0/ff 1255586 0 2024-09-20T18:35:47.795 INFO:tasks.workunit.client.0.smithi017.stdout:5/83: stat d0/d14/f17 0 2024-09-20T18:35:47.796 INFO:tasks.workunit.client.1.smithi172.stdout:6/588: dread d0/d18/d1c/d21/d26/d34/d6b/f84 [0,4194304] 0 2024-09-20T18:35:47.802 INFO:tasks.workunit.client.1.smithi172.stdout:0/832: getdents d4/d5/d2e/d67/d8c/d103 0 2024-09-20T18:35:47.804 INFO:tasks.workunit.client.0.smithi017.stdout:5/84: chown d0/ff 8465296 1 2024-09-20T18:35:47.805 INFO:tasks.workunit.client.0.smithi017.stdout:5/85: chown d0/fc 4 1 2024-09-20T18:35:47.808 INFO:tasks.workunit.client.0.smithi017.stdout:2/272: write d1/df/f1e [3713928,17345] 0 2024-09-20T18:35:47.808 INFO:tasks.workunit.client.0.smithi017.stdout:8/142: dwrite d0/d6/f23 [0,4194304] 0 2024-09-20T18:35:47.810 INFO:tasks.workunit.client.0.smithi017.stdout:6/99: truncate d4/df/f15 1047718 0 2024-09-20T18:35:47.816 INFO:tasks.workunit.client.0.smithi017.stdout:5/86: truncate d0/fe 116703 0 2024-09-20T18:35:47.817 INFO:tasks.workunit.client.0.smithi017.stdout:5/87: truncate d0/d13/f16 1185688 0 2024-09-20T18:35:47.819 INFO:tasks.workunit.client.1.smithi172.stdout:6/589: creat d0/fbc x:0 0 0 2024-09-20T18:35:47.819 INFO:tasks.workunit.client.1.smithi172.stdout:4/691: truncate d0/d48/d90/d55/d53/d5c/f75 123609 0 2024-09-20T18:35:47.820 INFO:tasks.workunit.client.1.smithi172.stdout:6/590: fsync d0/fe 0 2024-09-20T18:35:47.821 INFO:tasks.workunit.client.1.smithi172.stdout:0/833: creat d4/d5/d2e/d8e/f129 x:0 0 0 2024-09-20T18:35:47.825 INFO:tasks.workunit.client.1.smithi172.stdout:7/728: unlink d2/c8 0 2024-09-20T18:35:47.825 INFO:tasks.workunit.client.1.smithi172.stdout:3/747: write d0/dc/fcd [2312908,50363] 0 2024-09-20T18:35:47.826 INFO:tasks.workunit.client.1.smithi172.stdout:7/729: write d2/f54 [7919653,61246] 0 2024-09-20T18:35:47.827 INFO:tasks.workunit.client.1.smithi172.stdout:8/644: symlink dd/d1b/d3b/lde 0 2024-09-20T18:35:47.831 INFO:tasks.workunit.client.1.smithi172.stdout:5/687: creat d4/df/dad/d26/d2d/fe1 x:0 0 0 2024-09-20T18:35:47.837 INFO:tasks.workunit.client.1.smithi172.stdout:4/692: rmdir d0/de/d39/db8/d72/d18 39 2024-09-20T18:35:47.840 INFO:tasks.workunit.client.0.smithi017.stdout:2/273: dwrite d1/dc/d58/d3d/f36 [0,4194304] 0 2024-09-20T18:35:47.840 INFO:tasks.workunit.client.1.smithi172.stdout:6/591: creat d0/d18/d65/fbd x:0 0 0 2024-09-20T18:35:47.842 INFO:tasks.workunit.client.0.smithi017.stdout:8/143: write d0/f22 [1268413,108229] 0 2024-09-20T18:35:47.844 INFO:tasks.workunit.client.1.smithi172.stdout:0/834: mkdir d4/d1a/d28/d42/d45/d54/d12a 0 2024-09-20T18:35:47.845 INFO:tasks.workunit.client.1.smithi172.stdout:0/835: fsync d4/d5/d2e/d38/d96/f9f 0 2024-09-20T18:35:47.849 INFO:tasks.workunit.client.1.smithi172.stdout:7/730: chown d2/d23/f24 85256126 1 2024-09-20T18:35:47.850 INFO:tasks.workunit.client.0.smithi017.stdout:6/100: getdents d4 0 2024-09-20T18:35:47.851 INFO:tasks.workunit.client.1.smithi172.stdout:3/748: creat d0/d13/d58/d6d/d7f/d84/f100 x:0 0 0 2024-09-20T18:35:47.852 INFO:tasks.workunit.client.0.smithi017.stdout:2/274: symlink d1/dc/d58/d3d/l5c 0 2024-09-20T18:35:47.853 INFO:tasks.workunit.client.0.smithi017.stdout:8/144: symlink d0/d6/d28/l2c 0 2024-09-20T18:35:47.854 INFO:tasks.workunit.client.1.smithi172.stdout:4/693: write d0/de/dc/fd7 [447470,85104] 0 2024-09-20T18:35:47.855 INFO:tasks.workunit.client.1.smithi172.stdout:6/592: rename d0/d18/d1c/d21/d26/d34/d39/d46/l98 to d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0/lbe 0 2024-09-20T18:35:47.858 INFO:tasks.workunit.client.1.smithi172.stdout:4/694: dread d0/d7/d6f/f91 [0,4194304] 0 2024-09-20T18:35:47.858 INFO:tasks.workunit.client.0.smithi017.stdout:6/101: creat d4/df/f23 x:0 0 0 2024-09-20T18:35:47.859 INFO:tasks.workunit.client.1.smithi172.stdout:0/836: dread d4/d1a/d28/d42/f55 [0,4194304] 0 2024-09-20T18:35:47.860 INFO:tasks.workunit.client.0.smithi017.stdout:6/102: write d4/f8 [1217810,119341] 0 2024-09-20T18:35:47.860 INFO:tasks.workunit.client.1.smithi172.stdout:0/837: write d4/d1a/d28/fa4 [3348135,21328] 0 2024-09-20T18:35:47.860 INFO:tasks.workunit.client.0.smithi017.stdout:2/275: creat d1/dc/d58/d46/d48/f5d x:0 0 0 2024-09-20T18:35:47.862 INFO:tasks.workunit.client.0.smithi017.stdout:8/145: rmdir d0/d6 39 2024-09-20T18:35:47.865 INFO:tasks.workunit.client.1.smithi172.stdout:4/695: dwrite d0/d7/f25 [8388608,4194304] 0 2024-09-20T18:35:47.866 INFO:tasks.workunit.client.1.smithi172.stdout:7/731: creat d2/d23/d51/ffd x:0 0 0 2024-09-20T18:35:47.867 INFO:tasks.workunit.client.1.smithi172.stdout:3/749: dread d0/dc/d6a/d22/f34 [0,4194304] 0 2024-09-20T18:35:47.868 INFO:tasks.workunit.client.0.smithi017.stdout:5/88: dread d0/ff [0,4194304] 0 2024-09-20T18:35:47.868 INFO:tasks.workunit.client.0.smithi017.stdout:2/276: dwrite d1/dc/d58/d46/d48/f5d [0,4194304] 0 2024-09-20T18:35:47.869 INFO:tasks.workunit.client.1.smithi172.stdout:3/750: read - d0/dc/d6a/d3a/dcb/fed zero size 2024-09-20T18:35:47.869 INFO:tasks.workunit.client.1.smithi172.stdout:8/645: link fa dd/d65/d85/da2/fdf 0 2024-09-20T18:35:47.870 INFO:tasks.workunit.client.0.smithi017.stdout:2/277: fdatasync d1/dc/d58/d3d/f43 0 2024-09-20T18:35:47.870 INFO:tasks.workunit.client.0.smithi017.stdout:6/103: symlink d4/df/d1f/l24 0 2024-09-20T18:35:47.871 INFO:tasks.workunit.client.0.smithi017.stdout:2/278: write d1/f28 [1464319,44956] 0 2024-09-20T18:35:47.872 INFO:tasks.workunit.client.0.smithi017.stdout:6/104: write d4/f12 [888347,97696] 0 2024-09-20T18:35:47.875 INFO:tasks.workunit.client.0.smithi017.stdout:8/146: stat d0/d6/c1f 0 2024-09-20T18:35:47.875 INFO:tasks.workunit.client.1.smithi172.stdout:5/688: mkdir d4/df/d98/dcc/de2 0 2024-09-20T18:35:47.879 INFO:tasks.workunit.client.0.smithi017.stdout:6/105: fsync d4/df/f23 0 2024-09-20T18:35:47.880 INFO:tasks.workunit.client.0.smithi017.stdout:5/89: truncate d0/fc 603638 0 2024-09-20T18:35:47.884 INFO:tasks.workunit.client.1.smithi172.stdout:1/640: sync 2024-09-20T18:35:47.884 INFO:tasks.workunit.client.1.smithi172.stdout:9/635: sync 2024-09-20T18:35:47.885 INFO:tasks.workunit.client.1.smithi172.stdout:6/593: dwrite d0/d18/d1c/d21/d26/d34/d7a/d47/d62/f8f [0,4194304] 0 2024-09-20T18:35:47.887 INFO:tasks.workunit.client.1.smithi172.stdout:6/594: write d0/d18/d1c/d21/d26/d34/d39/d46/f7 [4979611,91024] 0 2024-09-20T18:35:47.891 INFO:tasks.workunit.client.0.smithi017.stdout:8/147: creat d0/d6/d28/f2d x:0 0 0 2024-09-20T18:35:47.893 INFO:tasks.workunit.client.1.smithi172.stdout:3/751: mkdir d0/d13/d58/d6d/db9/dd6/d101 0 2024-09-20T18:35:47.895 INFO:tasks.workunit.client.0.smithi017.stdout:5/90: write d0/f6 [5088435,60723] 0 2024-09-20T18:35:47.896 INFO:tasks.workunit.client.0.smithi017.stdout:2/279: write d1/d1f/f3e [342975,121378] 0 2024-09-20T18:35:47.897 INFO:tasks.workunit.client.1.smithi172.stdout:0/838: write d4/d1a/d28/d42/f55 [2320243,71670] 0 2024-09-20T18:35:47.897 INFO:tasks.workunit.client.0.smithi017.stdout:8/148: dread - d0/f1e zero size 2024-09-20T18:35:47.897 INFO:tasks.workunit.client.1.smithi172.stdout:5/689: rmdir d4/df/dad/d26/d41/d65/d8f 39 2024-09-20T18:35:47.898 INFO:tasks.workunit.client.0.smithi017.stdout:2/280: chown d1/df/d17 21949766 1 2024-09-20T18:35:47.898 INFO:tasks.workunit.client.1.smithi172.stdout:5/690: readlink d4/df/la3 0 2024-09-20T18:35:47.899 INFO:tasks.workunit.client.0.smithi017.stdout:2/281: write d1/dc/d20/d2e/f4f [103352,6379] 0 2024-09-20T18:35:47.900 INFO:tasks.workunit.client.1.smithi172.stdout:5/691: truncate d4/df/dad/d26/f47 1054942 0 2024-09-20T18:35:47.900 INFO:tasks.workunit.client.1.smithi172.stdout:5/692: fsync d4/df/d3f/f9a 0 2024-09-20T18:35:47.900 INFO:tasks.workunit.client.0.smithi017.stdout:2/282: chown d1/dc/d58/d3d/l32 13 1 2024-09-20T18:35:47.902 INFO:tasks.workunit.client.1.smithi172.stdout:0/839: read d4/d5/d2e/d33/de1/f37 [2392935,107311] 0 2024-09-20T18:35:47.902 INFO:tasks.workunit.client.1.smithi172.stdout:5/693: write d4/df/dad/d26/d41/d69/f9d [469001,59240] 0 2024-09-20T18:35:47.903 INFO:tasks.workunit.client.0.smithi017.stdout:5/91: rename d0/d15 to d0/d14/d18 0 2024-09-20T18:35:47.903 INFO:tasks.workunit.client.1.smithi172.stdout:0/840: chown d4/d1a/d28/d75/d60/fa3 148547964 1 2024-09-20T18:35:47.906 INFO:tasks.workunit.client.0.smithi017.stdout:6/106: truncate d4/f11 3536016 0 2024-09-20T18:35:47.907 INFO:tasks.workunit.client.1.smithi172.stdout:6/595: fsync d0/d18/f2b 0 2024-09-20T18:35:47.909 INFO:tasks.workunit.client.1.smithi172.stdout:0/841: dwrite d4/d1a/fb5 [0,4194304] 0 2024-09-20T18:35:47.909 INFO:tasks.workunit.client.0.smithi017.stdout:2/283: dwrite d1/dc/d20/d2e/f49 [0,4194304] 0 2024-09-20T18:35:47.909 INFO:tasks.workunit.client.1.smithi172.stdout:0/842: readlink d4/d1a/d28/d73/lfc 0 2024-09-20T18:35:47.910 INFO:tasks.workunit.client.0.smithi017.stdout:2/284: dread - d1/dc/d20/d2e/d30/f54 zero size 2024-09-20T18:35:47.911 INFO:tasks.workunit.client.1.smithi172.stdout:4/696: mkdir d0/d7/df5 0 2024-09-20T18:35:47.915 INFO:tasks.workunit.client.0.smithi017.stdout:2/285: dread - d1/dc/d58/d46/d48/f4a zero size 2024-09-20T18:35:47.915 INFO:tasks.workunit.client.0.smithi017.stdout:2/286: stat d1/d1f/c24 0 2024-09-20T18:35:47.915 INFO:tasks.workunit.client.1.smithi172.stdout:4/697: chown d0/de/dc/d3c 23 1 2024-09-20T18:35:47.915 INFO:tasks.workunit.client.1.smithi172.stdout:7/732: rename d2/d23/d3a/c94 to d2/d3/d3d/dd4/cfe 0 2024-09-20T18:35:47.915 INFO:tasks.workunit.client.1.smithi172.stdout:7/733: readlink d2/d23/d3a/l63 0 2024-09-20T18:35:47.916 INFO:tasks.workunit.client.1.smithi172.stdout:3/752: fsync d0/dc/d6a/d22/fbd 0 2024-09-20T18:35:47.917 INFO:tasks.workunit.client.1.smithi172.stdout:3/753: fsync d0/f62 0 2024-09-20T18:35:47.918 INFO:tasks.workunit.client.1.smithi172.stdout:8/646: link dd/f27 dd/d1b/fe0 0 2024-09-20T18:35:47.918 INFO:tasks.workunit.client.1.smithi172.stdout:0/843: dwrite d4/d1a/d28/d42/d45/d54/fea [0,4194304] 0 2024-09-20T18:35:47.921 INFO:tasks.workunit.client.0.smithi017.stdout:2/287: rename d1/d1f/c5b to d1/d1f/c5e 0 2024-09-20T18:35:47.923 INFO:tasks.workunit.client.0.smithi017.stdout:2/288: chown d1/dc/d58/d3d/l32 55878 1 2024-09-20T18:35:47.926 INFO:tasks.workunit.client.1.smithi172.stdout:0/844: dwrite d4/d1a/f66 [0,4194304] 0 2024-09-20T18:35:47.932 INFO:tasks.workunit.client.0.smithi017.stdout:5/92: dwrite d0/f1 [0,4194304] 0 2024-09-20T18:35:47.932 INFO:tasks.workunit.client.0.smithi017.stdout:2/289: write d1/f2d [3578065,116196] 0 2024-09-20T18:35:47.932 INFO:tasks.workunit.client.0.smithi017.stdout:8/149: write d0/f2 [312416,23352] 0 2024-09-20T18:35:47.933 INFO:tasks.workunit.client.0.smithi017.stdout:5/93: stat d0/d13 0 2024-09-20T18:35:47.934 INFO:tasks.workunit.client.0.smithi017.stdout:6/107: getdents d4 0 2024-09-20T18:35:47.935 INFO:tasks.workunit.client.0.smithi017.stdout:2/290: read d1/d1f/f3f [1665503,11398] 0 2024-09-20T18:35:47.935 INFO:tasks.workunit.client.1.smithi172.stdout:0/845: dread d4/d5/d2e/d33/de1/d15/f50 [4194304,4194304] 0 2024-09-20T18:35:47.936 INFO:tasks.workunit.client.1.smithi172.stdout:0/846: fsync d4/d5/f2f 0 2024-09-20T18:35:47.937 INFO:tasks.workunit.client.1.smithi172.stdout:0/847: write d4/d1a/d28/d75/d60/fa3 [2114497,91722] 0 2024-09-20T18:35:47.942 INFO:tasks.workunit.client.0.smithi017.stdout:5/94: fdatasync d0/f7 0 2024-09-20T18:35:47.943 INFO:tasks.workunit.client.0.smithi017.stdout:8/150: dwrite d0/d6/f25 [0,4194304] 0 2024-09-20T18:35:47.943 INFO:tasks.workunit.client.0.smithi017.stdout:3/318: sync 2024-09-20T18:35:47.944 INFO:tasks.workunit.client.0.smithi017.stdout:3/319: dread - da/f58 zero size 2024-09-20T18:35:47.948 INFO:tasks.workunit.client.0.smithi017.stdout:6/108: mkdir d4/df/d1f/d25 0 2024-09-20T18:35:47.948 INFO:tasks.workunit.client.1.smithi172.stdout:0/848: dwrite d4/d5/d2e/d38/f4b [8388608,4194304] 0 2024-09-20T18:35:47.948 INFO:tasks.workunit.client.1.smithi172.stdout:3/754: dread d0/d13/d58/d6d/d7f/d84/fc1 [0,4194304] 0 2024-09-20T18:35:47.951 INFO:tasks.workunit.client.1.smithi172.stdout:6/596: dread d0/fc [0,4194304] 0 2024-09-20T18:35:47.952 INFO:tasks.workunit.client.0.smithi017.stdout:6/109: dread d4/f9 [0,4194304] 0 2024-09-20T18:35:47.954 INFO:tasks.workunit.client.1.smithi172.stdout:8/647: write dd/d65/fb6 [721702,53702] 0 2024-09-20T18:35:47.955 INFO:tasks.workunit.client.0.smithi017.stdout:5/95: rmdir d0 39 2024-09-20T18:35:47.957 INFO:tasks.workunit.client.1.smithi172.stdout:0/849: write d4/d5/d2e/d38/d96/f10b [238631,62224] 0 2024-09-20T18:35:47.959 INFO:tasks.workunit.client.1.smithi172.stdout:1/641: link d0/d8/db/f26 d0/d8/db/d25/d2b/d3d/d65/fd1 0 2024-09-20T18:35:47.962 INFO:tasks.workunit.client.1.smithi172.stdout:1/642: chown d0/d22/c70 23 1 2024-09-20T18:35:47.962 INFO:tasks.workunit.client.0.smithi017.stdout:6/110: dwrite d4/f9 [4194304,4194304] 0 2024-09-20T18:35:47.963 INFO:tasks.workunit.client.1.smithi172.stdout:4/698: dwrite d0/de/d39/db8/d72/d18/d51/d9a/fdd [0,4194304] 0 2024-09-20T18:35:47.965 INFO:tasks.workunit.client.1.smithi172.stdout:5/694: dwrite f3 [0,4194304] 0 2024-09-20T18:35:47.967 INFO:tasks.workunit.client.1.smithi172.stdout:4/699: write d0/de/d21/d24/f2d [5114705,119755] 0 2024-09-20T18:35:47.969 INFO:tasks.workunit.client.1.smithi172.stdout:4/700: fdatasync d0/de/f4c 0 2024-09-20T18:35:47.970 INFO:tasks.workunit.client.1.smithi172.stdout:8/648: dwrite dd/d1b/d3b/d51/d5b/daf/d4d/f92 [0,4194304] 0 2024-09-20T18:35:47.972 INFO:tasks.workunit.client.0.smithi017.stdout:6/111: dwrite d4/f10 [0,4194304] 0 2024-09-20T18:35:47.974 INFO:tasks.workunit.client.0.smithi017.stdout:6/112: stat d4/f14 0 2024-09-20T18:35:47.975 INFO:tasks.workunit.client.1.smithi172.stdout:2/609: sync 2024-09-20T18:35:47.982 INFO:tasks.workunit.client.0.smithi017.stdout:6/113: dread d4/f10 [0,4194304] 0 2024-09-20T18:35:47.984 INFO:tasks.workunit.client.0.smithi017.stdout:6/114: write d4/df/f23 [1045128,67750] 0 2024-09-20T18:35:48.001 INFO:tasks.workunit.client.0.smithi017.stdout:6/115: read d4/df/f23 [936843,66723] 0 2024-09-20T18:35:48.033 INFO:tasks.workunit.client.0.smithi017.stdout:8/151: symlink d0/l2e 0 2024-09-20T18:35:48.062 INFO:tasks.workunit.client.0.smithi017.stdout:5/96: dread d0/fe [0,4194304] 0 2024-09-20T18:35:48.063 INFO:tasks.workunit.client.0.smithi017.stdout:5/97: write d0/f6 [2575818,95410] 0 2024-09-20T18:35:48.067 INFO:tasks.workunit.client.1.smithi172.stdout:8/649: creat dd/d1b/d4f/d9a/fe1 x:0 0 0 2024-09-20T18:35:48.068 INFO:tasks.workunit.client.1.smithi172.stdout:8/650: read dd/d1b/d3b/f3c [954902,108215] 0 2024-09-20T18:35:48.070 INFO:tasks.workunit.client.0.smithi017.stdout:5/98: dwrite d0/f6 [0,4194304] 0 2024-09-20T18:35:48.076 INFO:tasks.workunit.client.1.smithi172.stdout:2/610: creat d0/d90/fcf x:0 0 0 2024-09-20T18:35:48.076 INFO:tasks.workunit.client.1.smithi172.stdout:9/636: sync 2024-09-20T18:35:48.077 INFO:tasks.workunit.client.1.smithi172.stdout:7/734: link d2/d3/d10/d40/d46/c4d d2/d3/d10/d40/d46/d8e/dbd/cff 0 2024-09-20T18:35:48.090 INFO:tasks.workunit.client.0.smithi017.stdout:8/152: link d0/l5 d0/d6/l2f 0 2024-09-20T18:35:48.091 INFO:tasks.workunit.client.1.smithi172.stdout:4/701: getdents d0/de/d39/db8/d72/d18/d51/d9a/ddc 0 2024-09-20T18:35:48.098 INFO:tasks.workunit.client.0.smithi017.stdout:8/153: fdatasync d0/d6/f16 0 2024-09-20T18:35:48.101 INFO:tasks.workunit.client.1.smithi172.stdout:9/637: creat d15/d1f/d2c/d37/fd0 x:0 0 0 2024-09-20T18:35:48.101 INFO:tasks.workunit.client.1.smithi172.stdout:9/638: chown d15/d1f/d2c/d37 43 1 2024-09-20T18:35:48.105 INFO:tasks.workunit.client.0.smithi017.stdout:8/154: rename d0/f2a to d0/d6/f30 0 2024-09-20T18:35:48.109 INFO:tasks.workunit.client.1.smithi172.stdout:0/850: creat d4/d5/d2e/d33/de1/d15/f12b x:0 0 0 2024-09-20T18:35:48.111 INFO:tasks.workunit.client.1.smithi172.stdout:5/695: creat d4/df/dad/fe3 x:0 0 0 2024-09-20T18:35:48.114 INFO:tasks.workunit.client.0.smithi017.stdout:8/155: mknod d0/c31 0 2024-09-20T18:35:48.115 INFO:tasks.workunit.client.0.smithi017.stdout:8/156: dread - d0/d6/d28/f2d zero size 2024-09-20T18:35:48.118 INFO:tasks.workunit.client.1.smithi172.stdout:1/643: sync 2024-09-20T18:35:48.118 INFO:tasks.workunit.client.1.smithi172.stdout:8/651: link dd/d1b/d3b/d51/f81 dd/da9/fe2 0 2024-09-20T18:35:48.118 INFO:tasks.workunit.client.1.smithi172.stdout:8/652: stat dd/d65 0 2024-09-20T18:35:48.122 INFO:tasks.workunit.client.1.smithi172.stdout:9/639: creat d15/d1f/d2c/d7d/d34/db5/fd1 x:0 0 0 2024-09-20T18:35:48.124 INFO:tasks.workunit.client.0.smithi017.stdout:8/157: unlink d0/l8 0 2024-09-20T18:35:48.129 INFO:tasks.workunit.client.1.smithi172.stdout:5/696: read - d4/df/dad/d26/d41/d65/d8f/fc9 zero size 2024-09-20T18:35:48.130 INFO:tasks.workunit.client.1.smithi172.stdout:5/697: stat d4/df/dad/f8c 0 2024-09-20T18:35:48.131 INFO:tasks.workunit.client.1.smithi172.stdout:5/698: chown d4/df/dad/d26/d2d/f5b 36 1 2024-09-20T18:35:48.131 INFO:tasks.workunit.client.0.smithi017.stdout:8/158: mknod d0/d6/c32 0 2024-09-20T18:35:48.131 INFO:tasks.workunit.client.0.smithi017.stdout:8/159: fdatasync d0/d6/d28/f2d 0 2024-09-20T18:35:48.133 INFO:tasks.workunit.client.1.smithi172.stdout:1/644: rmdir d0/d8/db/d25/d2b/d3d/d65/d93/dbe 39 2024-09-20T18:35:48.134 INFO:tasks.workunit.client.1.smithi172.stdout:1/645: dread - d0/d22/fb1 zero size 2024-09-20T18:35:48.140 INFO:tasks.workunit.client.0.smithi017.stdout:8/160: rename d0/d6/l2f to d0/d6/d28/l33 0 2024-09-20T18:35:48.142 INFO:tasks.workunit.client.0.smithi017.stdout:2/291: truncate d1/df/f16 387461 0 2024-09-20T18:35:48.142 INFO:tasks.workunit.client.0.smithi017.stdout:2/292: read - d1/f59 zero size 2024-09-20T18:35:48.143 INFO:tasks.workunit.client.0.smithi017.stdout:8/161: write d0/d6/f30 [366217,74993] 0 2024-09-20T18:35:48.145 INFO:tasks.workunit.client.1.smithi172.stdout:2/611: getdents d0/d2c/d3f/dab/d22/d10/d3c 0 2024-09-20T18:35:48.147 INFO:tasks.workunit.client.1.smithi172.stdout:0/851: rmdir d4/d1a/d28/d42/d45/d54/d12a 0 2024-09-20T18:35:48.157 INFO:tasks.workunit.client.1.smithi172.stdout:2/612: dread d0/f8e [4194304,4194304] 0 2024-09-20T18:35:48.218 INFO:tasks.workunit.client.1.smithi172.stdout:9/640: sync 2024-09-20T18:35:48.219 INFO:tasks.workunit.client.1.smithi172.stdout:9/641: fdatasync d15/d1a/d82/f3e 0 2024-09-20T18:35:48.249 INFO:tasks.workunit.client.0.smithi017.stdout:2/293: rename d1/d1f/f5a to d1/dc/d20/d2e/f5f 0 2024-09-20T18:35:48.250 INFO:tasks.workunit.client.1.smithi172.stdout:1/646: mknod d0/dc2/cd2 0 2024-09-20T18:35:48.250 INFO:tasks.workunit.client.0.smithi017.stdout:8/162: mkdir d0/d34 0 2024-09-20T18:35:48.251 INFO:tasks.workunit.client.0.smithi017.stdout:8/163: write d0/d6/f30 [1165773,100705] 0 2024-09-20T18:35:48.255 INFO:tasks.workunit.client.1.smithi172.stdout:1/647: dwrite d0/d8/db/d25/d2b/d3d/fae [0,4194304] 0 2024-09-20T18:35:48.259 INFO:tasks.workunit.client.1.smithi172.stdout:5/699: sync 2024-09-20T18:35:48.261 INFO:tasks.workunit.client.1.smithi172.stdout:1/648: dwrite d0/d73/f90 [0,4194304] 0 2024-09-20T18:35:48.266 INFO:tasks.workunit.client.1.smithi172.stdout:5/700: dread d4/df/dad/d26/d41/d69/f9d [0,4194304] 0 2024-09-20T18:35:48.309 INFO:tasks.workunit.client.0.smithi017.stdout:2/294: mknod d1/dc/d58/d53/c60 0 2024-09-20T18:35:48.312 INFO:tasks.workunit.client.0.smithi017.stdout:8/164: mknod d0/d6/d28/c35 0 2024-09-20T18:35:48.313 INFO:tasks.workunit.client.0.smithi017.stdout:2/295: rmdir d1 39 2024-09-20T18:35:48.317 INFO:tasks.workunit.client.1.smithi172.stdout:7/735: rmdir d2 39 2024-09-20T18:35:48.330 INFO:tasks.workunit.client.0.smithi017.stdout:3/320: dwrite da/de/f1a [0,4194304] 0 2024-09-20T18:35:48.331 INFO:tasks.workunit.client.0.smithi017.stdout:3/321: read da/fb [1049575,109893] 0 2024-09-20T18:35:48.332 INFO:tasks.workunit.client.0.smithi017.stdout:3/322: chown da/de/f5b 1742721 1 2024-09-20T18:35:48.336 INFO:tasks.workunit.client.1.smithi172.stdout:4/702: mkdir d0/de/df6 0 2024-09-20T18:35:48.337 INFO:tasks.workunit.client.1.smithi172.stdout:4/703: readlink d0/d48/d90/d55/d53/d78/le7 0 2024-09-20T18:35:48.337 INFO:tasks.workunit.client.1.smithi172.stdout:4/704: chown d0/f71 223 1 2024-09-20T18:35:48.343 INFO:tasks.workunit.client.1.smithi172.stdout:0/852: creat d4/d5/d2e/d33/de1/f12c x:0 0 0 2024-09-20T18:35:48.345 INFO:tasks.workunit.client.1.smithi172.stdout:6/597: truncate d0/d18/d1c/d21/d26/d34/d7a/d47/d62/f8f 3296358 0 2024-09-20T18:35:48.345 INFO:tasks.workunit.client.1.smithi172.stdout:1/649: sync 2024-09-20T18:35:48.349 INFO:tasks.workunit.client.0.smithi017.stdout:5/99: truncate d0/f6 5129157 0 2024-09-20T18:35:48.350 INFO:tasks.workunit.client.1.smithi172.stdout:7/736: dread - d2/d23/d51/ffd zero size 2024-09-20T18:35:48.350 INFO:tasks.workunit.client.0.smithi017.stdout:5/100: write d0/d14/f17 [105723,31774] 0 2024-09-20T18:35:48.353 INFO:tasks.workunit.client.0.smithi017.stdout:5/101: mkdir d0/d14/d18/d19 0 2024-09-20T18:35:48.354 INFO:tasks.workunit.client.0.smithi017.stdout:6/116: rmdir d4 39 2024-09-20T18:35:48.355 INFO:tasks.workunit.client.1.smithi172.stdout:7/737: dwrite d2/d3/d10/d40/d46/d8e/dbd/ffb [0,4194304] 0 2024-09-20T18:35:48.355 INFO:tasks.workunit.client.1.smithi172.stdout:1/650: mkdir d0/d8/db/d25/d2b/d3d/d65/d93/dbb/dd3 0 2024-09-20T18:35:48.360 INFO:tasks.workunit.client.0.smithi017.stdout:5/102: creat d0/d14/d18/d19/f1a x:0 0 0 2024-09-20T18:35:48.362 INFO:tasks.workunit.client.0.smithi017.stdout:9/184: sync 2024-09-20T18:35:48.363 INFO:tasks.workunit.client.0.smithi017.stdout:9/185: dread - d6/d1f/f41 zero size 2024-09-20T18:35:48.363 INFO:tasks.workunit.client.0.smithi017.stdout:6/117: dread d4/fc [0,4194304] 0 2024-09-20T18:35:48.367 INFO:tasks.workunit.client.0.smithi017.stdout:5/103: mkdir d0/d14/d18/d1b 0 2024-09-20T18:35:48.368 INFO:tasks.workunit.client.0.smithi017.stdout:3/323: creat da/de/f6f x:0 0 0 2024-09-20T18:35:48.369 INFO:tasks.workunit.client.1.smithi172.stdout:9/642: creat d15/fd2 x:0 0 0 2024-09-20T18:35:48.370 INFO:tasks.workunit.client.1.smithi172.stdout:9/643: write d15/d1f/d88/fc5 [1011675,6521] 0 2024-09-20T18:35:48.371 INFO:tasks.workunit.client.1.smithi172.stdout:7/738: rmdir d2/dcc 39 2024-09-20T18:35:48.372 INFO:tasks.workunit.client.0.smithi017.stdout:6/118: fsync d4/f9 0 2024-09-20T18:35:48.374 INFO:tasks.workunit.client.1.smithi172.stdout:1/651: creat d0/d8/d12/d96/fd4 x:0 0 0 2024-09-20T18:35:48.375 INFO:tasks.workunit.client.1.smithi172.stdout:5/701: link d4/df/dad/d26/d41/d69/dac/d2c/f38 d4/df/d98/fe4 0 2024-09-20T18:35:48.376 INFO:tasks.workunit.client.1.smithi172.stdout:9/644: dwrite d15/d1f/d88/f98 [0,4194304] 0 2024-09-20T18:35:48.377 INFO:tasks.workunit.client.1.smithi172.stdout:4/705: link d0/d48/d90/db4/ce9 d0/d48/d90/d55/d53/cf7 0 2024-09-20T18:35:48.379 INFO:tasks.workunit.client.1.smithi172.stdout:4/706: write d0/de/dc/d3c/d99/fe0 [624099,41560] 0 2024-09-20T18:35:48.379 INFO:tasks.workunit.client.0.smithi017.stdout:3/324: rename da/de/d13/d2f/d26/l3e to da/de/d13/d16/d6e/l70 0 2024-09-20T18:35:48.381 INFO:tasks.workunit.client.1.smithi172.stdout:3/755: rename d0/d13/d58/d6d/d7f/fb1 to d0/dc/d6a/d3a/dcb/f102 0 2024-09-20T18:35:48.385 INFO:tasks.workunit.client.0.smithi017.stdout:9/186: unlink d6/d23/d24/c22 0 2024-09-20T18:35:48.386 INFO:tasks.workunit.client.0.smithi017.stdout:9/187: stat d6/d11/c19 0 2024-09-20T18:35:48.386 INFO:tasks.workunit.client.1.smithi172.stdout:9/645: dread d15/d1f/d88/fc5 [0,4194304] 0 2024-09-20T18:35:48.389 INFO:tasks.workunit.client.1.smithi172.stdout:7/739: creat d2/d23/d3a/d72/d9b/f100 x:0 0 0 2024-09-20T18:35:48.393 INFO:tasks.workunit.client.1.smithi172.stdout:8/653: truncate dd/d1b/d3b/d5d/d7d/f9c 2857087 0 2024-09-20T18:35:48.394 INFO:tasks.workunit.client.0.smithi017.stdout:5/104: mknod d0/d14/d18/d1b/c1c 0 2024-09-20T18:35:48.394 INFO:tasks.workunit.client.0.smithi017.stdout:5/105: chown d0/ff 0 1 2024-09-20T18:35:48.399 INFO:tasks.workunit.client.0.smithi017.stdout:3/325: chown l7 1904 1 2024-09-20T18:35:48.399 INFO:tasks.workunit.client.0.smithi017.stdout:3/326: dread - da/de/d13/d2f/f60 zero size 2024-09-20T18:35:48.400 INFO:tasks.workunit.client.1.smithi172.stdout:4/707: mkdir d0/d7/db7/df8 0 2024-09-20T18:35:48.406 INFO:tasks.workunit.client.0.smithi017.stdout:3/327: dwrite da/de/d13/f67 [0,4194304] 0 2024-09-20T18:35:48.406 INFO:tasks.workunit.client.1.smithi172.stdout:7/740: creat d2/d3/d10/d40/d6a/f101 x:0 0 0 2024-09-20T18:35:48.407 INFO:tasks.workunit.client.0.smithi017.stdout:3/328: write da/de/d13/f67 [878864,54013] 0 2024-09-20T18:35:48.407 INFO:tasks.workunit.client.0.smithi017.stdout:5/106: symlink d0/d14/d18/l1d 0 2024-09-20T18:35:48.408 INFO:tasks.workunit.client.1.smithi172.stdout:1/652: mkdir d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dd5 0 2024-09-20T18:35:48.409 INFO:tasks.workunit.client.0.smithi017.stdout:5/107: dread d0/fe [0,4194304] 0 2024-09-20T18:35:48.410 INFO:tasks.workunit.client.0.smithi017.stdout:8/165: write d0/d6/f1b [4328679,68240] 0 2024-09-20T18:35:48.415 INFO:tasks.workunit.client.1.smithi172.stdout:4/708: mknod d0/de/d39/db8/d72/d18/cf9 0 2024-09-20T18:35:48.416 INFO:tasks.workunit.client.0.smithi017.stdout:3/329: symlink da/de/d13/d2f/d26/d31/l71 0 2024-09-20T18:35:48.420 INFO:tasks.workunit.client.0.smithi017.stdout:8/166: truncate d0/f1c 643183 0 2024-09-20T18:35:48.420 INFO:tasks.workunit.client.1.smithi172.stdout:4/709: dwrite d0/de/d39/f9b [0,4194304] 0 2024-09-20T18:35:48.423 INFO:tasks.workunit.client.0.smithi017.stdout:9/188: rmdir d6/d23/d24/d3f/d43 0 2024-09-20T18:35:48.427 INFO:tasks.workunit.client.1.smithi172.stdout:8/654: mkdir dd/de3 0 2024-09-20T18:35:48.430 INFO:tasks.workunit.client.1.smithi172.stdout:2/613: rename d0/d2c/d3f/dab/d22/d10/d97 to d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0 0 2024-09-20T18:35:48.431 INFO:tasks.workunit.client.1.smithi172.stdout:2/614: dread - d0/d90/fcf zero size 2024-09-20T18:35:48.431 INFO:tasks.workunit.client.0.smithi017.stdout:9/189: symlink d6/d23/d24/d3f/d2f/l4b 0 2024-09-20T18:35:48.435 INFO:tasks.workunit.client.0.smithi017.stdout:7/146: sync 2024-09-20T18:35:48.435 INFO:tasks.workunit.client.0.smithi017.stdout:0/151: sync 2024-09-20T18:35:48.435 INFO:tasks.workunit.client.0.smithi017.stdout:8/167: mknod d0/c36 0 2024-09-20T18:35:48.440 INFO:tasks.workunit.client.1.smithi172.stdout:6/598: rename d0/d18/d1c/d21/d26/d34/d7a/d99/d9e to d0/d18/d1c/d21/d26/d34/d39/d74/dbf 0 2024-09-20T18:35:48.442 INFO:tasks.workunit.client.0.smithi017.stdout:7/147: mkdir da/d16/d1c/d2d/d34 0 2024-09-20T18:35:48.443 INFO:tasks.workunit.client.1.smithi172.stdout:2/615: read d0/f3 [841737,103963] 0 2024-09-20T18:35:48.444 INFO:tasks.workunit.client.0.smithi017.stdout:9/190: creat d6/d23/d24/d3f/d45/f4c x:0 0 0 2024-09-20T18:35:48.445 INFO:tasks.workunit.client.0.smithi017.stdout:9/191: read - d6/d23/d24/d3f/d2f/f3b zero size 2024-09-20T18:35:48.448 INFO:tasks.workunit.client.1.smithi172.stdout:1/653: creat d0/d8/db/d25/d2b/d3d/fd6 x:0 0 0 2024-09-20T18:35:48.450 INFO:tasks.workunit.client.1.smithi172.stdout:8/655: symlink dd/le4 0 2024-09-20T18:35:48.456 INFO:tasks.workunit.client.0.smithi017.stdout:8/168: link d0/d6/l17 d0/d6/d28/l37 0 2024-09-20T18:35:48.459 INFO:tasks.workunit.client.0.smithi017.stdout:5/108: dread d0/f6 [0,4194304] 0 2024-09-20T18:35:48.460 INFO:tasks.workunit.client.1.smithi172.stdout:4/710: rmdir d0/de/df6 0 2024-09-20T18:35:48.462 INFO:tasks.workunit.client.0.smithi017.stdout:8/169: creat d0/d6/f38 x:0 0 0 2024-09-20T18:35:48.465 INFO:tasks.workunit.client.1.smithi172.stdout:1/654: creat d0/d8/d12/d96/fd7 x:0 0 0 2024-09-20T18:35:48.465 INFO:tasks.workunit.client.1.smithi172.stdout:1/655: write d0/f61 [1422196,73814] 0 2024-09-20T18:35:48.466 INFO:tasks.workunit.client.0.smithi017.stdout:5/109: dwrite d0/d13/f16 [0,4194304] 0 2024-09-20T18:35:48.469 INFO:tasks.workunit.client.0.smithi017.stdout:7/148: getdents da/d16/d1b 0 2024-09-20T18:35:48.469 INFO:tasks.workunit.client.1.smithi172.stdout:8/656: symlink dd/d1b/d4f/d9a/le5 0 2024-09-20T18:35:48.470 INFO:tasks.workunit.client.1.smithi172.stdout:8/657: fsync dd/d1b/d4f/d9a/fb9 0 2024-09-20T18:35:48.470 INFO:tasks.workunit.client.0.smithi017.stdout:7/149: truncate da/f22 4976964 0 2024-09-20T18:35:48.471 INFO:tasks.workunit.client.1.smithi172.stdout:0/853: write d4/f7e [27834,105183] 0 2024-09-20T18:35:48.472 INFO:tasks.workunit.client.1.smithi172.stdout:8/658: truncate dd/d1b/d4f/d9a/dbb/fca 5275589 0 2024-09-20T18:35:48.472 INFO:tasks.workunit.client.0.smithi017.stdout:5/110: dread d0/f1 [0,4194304] 0 2024-09-20T18:35:48.474 INFO:tasks.workunit.client.0.smithi017.stdout:5/111: write d0/f1 [1634618,36566] 0 2024-09-20T18:35:48.474 INFO:tasks.workunit.client.1.smithi172.stdout:8/659: readlink dd/d1b/d3b/d51/d5b/daf/l68 0 2024-09-20T18:35:48.474 INFO:tasks.workunit.client.1.smithi172.stdout:0/854: write d4/d1a/d28/d42/f55 [2228394,120660] 0 2024-09-20T18:35:48.476 INFO:tasks.workunit.client.1.smithi172.stdout:8/660: write dd/d65/d85/f8b [210518,79391] 0 2024-09-20T18:35:48.476 INFO:tasks.workunit.client.1.smithi172.stdout:9/646: rename d15/d1f/d2c/d7d/d34/la7 to d15/d4a/d8c/ld3 0 2024-09-20T18:35:48.479 INFO:tasks.workunit.client.1.smithi172.stdout:1/656: dread d0/f10 [0,4194304] 0 2024-09-20T18:35:48.481 INFO:tasks.workunit.client.1.smithi172.stdout:2/616: mknod d0/d2c/db2/dc3/cd1 0 2024-09-20T18:35:48.482 INFO:tasks.workunit.client.1.smithi172.stdout:0/855: dwrite d4/d94/f125 [0,4194304] 0 2024-09-20T18:35:48.484 INFO:tasks.workunit.client.1.smithi172.stdout:2/617: write d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/fb4 [294415,109875] 0 2024-09-20T18:35:48.484 INFO:tasks.workunit.client.1.smithi172.stdout:4/711: creat d0/de/d39/ffa x:0 0 0 2024-09-20T18:35:48.484 INFO:tasks.workunit.client.0.smithi017.stdout:7/150: symlink da/d16/d1b/l35 0 2024-09-20T18:35:48.485 INFO:tasks.workunit.client.0.smithi017.stdout:7/151: readlink da/d16/d1c/d2d/l33 0 2024-09-20T18:35:48.486 INFO:tasks.workunit.client.1.smithi172.stdout:0/856: truncate d4/d1a/d28/d9d/f104 424724 0 2024-09-20T18:35:48.486 INFO:tasks.workunit.client.1.smithi172.stdout:4/712: write d0/de/d39/d9f/fc5 [4357762,77129] 0 2024-09-20T18:35:48.486 INFO:tasks.workunit.client.1.smithi172.stdout:2/618: readlink d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/lb6 0 2024-09-20T18:35:48.492 INFO:tasks.workunit.client.1.smithi172.stdout:0/857: dwrite d4/d5/d2e/d33/de1/fd6 [4194304,4194304] 0 2024-09-20T18:35:48.493 INFO:tasks.workunit.client.1.smithi172.stdout:2/619: dwrite d0/d2c/d3f/dab/d18/f32 [4194304,4194304] 0 2024-09-20T18:35:48.504 INFO:tasks.workunit.client.0.smithi017.stdout:6/119: dwrite d4/df/f23 [0,4194304] 0 2024-09-20T18:35:48.505 INFO:tasks.workunit.client.0.smithi017.stdout:2/296: dwrite d1/df/f16 [0,4194304] 0 2024-09-20T18:35:48.518 INFO:tasks.workunit.client.1.smithi172.stdout:6/599: creat d0/d18/d1c/d21/d26/d34/d39/fc0 x:0 0 0 2024-09-20T18:35:48.518 INFO:tasks.workunit.client.0.smithi017.stdout:6/120: dwrite d4/df/f23 [0,4194304] 0 2024-09-20T18:35:48.521 INFO:tasks.workunit.client.1.smithi172.stdout:6/600: write d0/d18/d1c/d21/d26/d34/d39/f64 [195427,111080] 0 2024-09-20T18:35:48.522 INFO:tasks.workunit.client.0.smithi017.stdout:8/170: rmdir d0/d34 0 2024-09-20T18:35:48.523 INFO:tasks.workunit.client.0.smithi017.stdout:8/171: write d0/d6/f38 [883221,46781] 0 2024-09-20T18:35:48.525 INFO:tasks.workunit.client.1.smithi172.stdout:1/657: rmdir d0/d8/db 39 2024-09-20T18:35:48.525 INFO:tasks.workunit.client.1.smithi172.stdout:5/702: dwrite d4/df/dad/d26/d41/d69/dac/f2b [0,4194304] 0 2024-09-20T18:35:48.529 INFO:tasks.workunit.client.1.smithi172.stdout:3/756: dwrite d0/d13/d9e/f92 [0,4194304] 0 2024-09-20T18:35:48.532 INFO:tasks.workunit.client.0.smithi017.stdout:2/297: rename d1/c41 to d1/dc/d58/c61 0 2024-09-20T18:35:48.535 INFO:tasks.workunit.client.0.smithi017.stdout:3/330: write da/de/d13/d2f/d26/d31/f45 [137574,120908] 0 2024-09-20T18:35:48.536 INFO:tasks.workunit.client.1.smithi172.stdout:4/713: creat d0/de/dc/d3c/d99/ffb x:0 0 0 2024-09-20T18:35:48.537 INFO:tasks.workunit.client.1.smithi172.stdout:0/858: dread d4/d1a/d28/f9a [0,4194304] 0 2024-09-20T18:35:48.543 INFO:tasks.workunit.client.0.smithi017.stdout:6/121: mknod d4/df/c26 0 2024-09-20T18:35:48.545 INFO:tasks.workunit.client.0.smithi017.stdout:6/122: chown d4/fd 506197466 1 2024-09-20T18:35:48.546 INFO:tasks.workunit.client.0.smithi017.stdout:3/331: dwrite da/de/d13/d2f/d26/d31/f45 [0,4194304] 0 2024-09-20T18:35:48.550 INFO:tasks.workunit.client.1.smithi172.stdout:2/620: rmdir d0/d1a/d58 39 2024-09-20T18:35:48.553 INFO:tasks.workunit.client.0.smithi017.stdout:0/152: dwrite f2 [0,4194304] 0 2024-09-20T18:35:48.554 INFO:tasks.workunit.client.0.smithi017.stdout:0/153: stat d4/f6 0 2024-09-20T18:35:48.555 INFO:tasks.workunit.client.0.smithi017.stdout:2/298: fdatasync d1/dc/d58/d46/d48/f5d 0 2024-09-20T18:35:48.555 INFO:tasks.workunit.client.0.smithi017.stdout:0/154: chown d4/l23 5460240 1 2024-09-20T18:35:48.556 INFO:tasks.workunit.client.0.smithi017.stdout:6/123: dread d4/df/f23 [0,4194304] 0 2024-09-20T18:35:48.556 INFO:tasks.workunit.client.0.smithi017.stdout:0/155: dread - d4/d20/f2a zero size 2024-09-20T18:35:48.557 INFO:tasks.workunit.client.0.smithi017.stdout:2/299: chown d1/df/f16 509331 1 2024-09-20T18:35:48.557 INFO:tasks.workunit.client.1.smithi172.stdout:9/647: unlink d15/d4a/c59 0 2024-09-20T18:35:48.557 INFO:tasks.workunit.client.0.smithi017.stdout:6/124: read d4/f1e [51295,78968] 0 2024-09-20T18:35:48.559 INFO:tasks.workunit.client.0.smithi017.stdout:2/300: write d1/f2d [274400,46055] 0 2024-09-20T18:35:48.559 INFO:tasks.workunit.client.0.smithi017.stdout:7/152: link da/c21 da/d16/d1c/d2d/d30/c36 0 2024-09-20T18:35:48.561 INFO:tasks.workunit.client.1.smithi172.stdout:8/661: mknod dd/d65/d85/dab/ce6 0 2024-09-20T18:35:48.563 INFO:tasks.workunit.client.0.smithi017.stdout:2/301: dread - d1/dc/d20/d2e/d30/f54 zero size 2024-09-20T18:35:48.567 INFO:tasks.workunit.client.1.smithi172.stdout:1/658: read d0/d22/f23 [116484,42885] 0 2024-09-20T18:35:48.571 INFO:tasks.workunit.client.0.smithi017.stdout:0/156: dwrite d4/f11 [0,4194304] 0 2024-09-20T18:35:48.571 INFO:tasks.workunit.client.0.smithi017.stdout:8/172: symlink d0/l39 0 2024-09-20T18:35:48.572 INFO:tasks.workunit.client.1.smithi172.stdout:5/703: unlink d4/df/d3f/f43 0 2024-09-20T18:35:48.573 INFO:tasks.workunit.client.0.smithi017.stdout:0/157: write d4/db/fc [13183,64085] 0 2024-09-20T18:35:48.577 INFO:tasks.workunit.client.0.smithi017.stdout:7/153: dwrite da/d16/d1c/f1f [0,4194304] 0 2024-09-20T18:35:48.577 INFO:tasks.workunit.client.0.smithi017.stdout:2/302: dread d1/dc/d20/d2e/d30/f4b [0,4194304] 0 2024-09-20T18:35:48.577 INFO:tasks.workunit.client.0.smithi017.stdout:7/154: chown da/d16/d1c/d2d/d34 2 1 2024-09-20T18:35:48.579 INFO:tasks.workunit.client.0.smithi017.stdout:7/155: chown da/d16 51 1 2024-09-20T18:35:48.583 INFO:tasks.workunit.client.0.smithi017.stdout:5/112: write d0/fc [1131450,70645] 0 2024-09-20T18:35:48.585 INFO:tasks.workunit.client.1.smithi172.stdout:7/741: rename d2/d3/dd/d84/le6 to d2/d3/d3d/d4e/l102 0 2024-09-20T18:35:48.587 INFO:tasks.workunit.client.1.smithi172.stdout:2/621: symlink d0/d2c/d3f/dab/d22/d10/d6a/d98/d59/ld2 0 2024-09-20T18:35:48.588 INFO:tasks.workunit.client.1.smithi172.stdout:2/622: fsync d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/dbb/fbc 0 2024-09-20T18:35:48.590 INFO:tasks.workunit.client.1.smithi172.stdout:9/648: fdatasync d15/d1f/d2c/d7d/d34/db5/fbc 0 2024-09-20T18:35:48.593 INFO:tasks.workunit.client.1.smithi172.stdout:8/662: mknod dd/da9/ce7 0 2024-09-20T18:35:48.595 INFO:tasks.workunit.client.1.smithi172.stdout:9/649: dwrite d15/d1a/d8d/faa [0,4194304] 0 2024-09-20T18:35:48.596 INFO:tasks.workunit.client.1.smithi172.stdout:9/650: write d15/d4a/f80 [1733720,48059] 0 2024-09-20T18:35:48.598 INFO:tasks.workunit.client.0.smithi017.stdout:8/173: readlink d0/d6/l17 0 2024-09-20T18:35:48.599 INFO:tasks.workunit.client.0.smithi017.stdout:8/174: write d0/f14 [1676540,50595] 0 2024-09-20T18:35:48.600 INFO:tasks.workunit.client.0.smithi017.stdout:0/158: creat d4/db/d1e/f35 x:0 0 0 2024-09-20T18:35:48.602 INFO:tasks.workunit.client.0.smithi017.stdout:4/107: sync 2024-09-20T18:35:48.602 INFO:tasks.workunit.client.0.smithi017.stdout:1/72: sync 2024-09-20T18:35:48.602 INFO:tasks.workunit.client.1.smithi172.stdout:5/704: truncate d4/df/dad/faf 1492747 0 2024-09-20T18:35:48.603 INFO:tasks.workunit.client.0.smithi017.stdout:2/303: creat d1/dc/d20/d2e/f62 x:0 0 0 2024-09-20T18:35:48.606 INFO:tasks.workunit.client.1.smithi172.stdout:0/859: unlink d4/d5/d2e/d33/de1/d15/f3b 0 2024-09-20T18:35:48.609 INFO:tasks.workunit.client.0.smithi017.stdout:6/125: creat d4/df/d1f/d25/f27 x:0 0 0 2024-09-20T18:35:48.611 INFO:tasks.workunit.client.1.smithi172.stdout:4/714: rename d0/de/dc/c52 to d0/de/dc/d3c/cfc 0 2024-09-20T18:35:48.611 INFO:tasks.workunit.client.1.smithi172.stdout:3/757: write d0/d13/d32/d54/d83/f85 [923162,110884] 0 2024-09-20T18:35:48.612 INFO:tasks.workunit.client.0.smithi017.stdout:5/113: fsync d0/f1 0 2024-09-20T18:35:48.618 INFO:tasks.workunit.client.1.smithi172.stdout:1/659: readlink d0/d8/db/d39/l3b 0 2024-09-20T18:35:48.623 INFO:tasks.workunit.client.0.smithi017.stdout:3/332: creat da/de/d13/f72 x:0 0 0 2024-09-20T18:35:48.624 INFO:tasks.workunit.client.1.smithi172.stdout:6/601: truncate d0/d18/d1c/d21/d26/f5f 1572022 0 2024-09-20T18:35:48.624 INFO:tasks.workunit.client.0.smithi017.stdout:3/333: dread - da/de/d14/f38 zero size 2024-09-20T18:35:48.625 INFO:tasks.workunit.client.1.smithi172.stdout:6/602: read d0/d18/d1c/d21/d26/d34/f3e [327897,90330] 0 2024-09-20T18:35:48.627 INFO:tasks.workunit.client.1.smithi172.stdout:4/715: creat d0/de/d21/d24/ffd x:0 0 0 2024-09-20T18:35:48.628 INFO:tasks.workunit.client.1.smithi172.stdout:4/716: readlink d0/d48/d90/d55/d53/d78/le7 0 2024-09-20T18:35:48.628 INFO:tasks.workunit.client.0.smithi017.stdout:8/175: mkdir d0/d6/d28/d3a 0 2024-09-20T18:35:48.629 INFO:tasks.workunit.client.0.smithi017.stdout:8/176: readlink d0/d6/l17 0 2024-09-20T18:35:48.631 INFO:tasks.workunit.client.1.smithi172.stdout:7/742: getdents d2/ddf 0 2024-09-20T18:35:48.632 INFO:tasks.workunit.client.0.smithi017.stdout:1/73: readlink df/l12 0 2024-09-20T18:35:48.633 INFO:tasks.workunit.client.1.smithi172.stdout:1/660: mknod d0/d8/db/d25/d2b/d3d/d65/cd8 0 2024-09-20T18:35:48.634 INFO:tasks.workunit.client.0.smithi017.stdout:4/108: mknod d4/dc/d1e/d26/d22/c2a 0 2024-09-20T18:35:48.637 INFO:tasks.workunit.client.1.smithi172.stdout:5/705: mknod d4/df/d3f/d64/ce5 0 2024-09-20T18:35:48.638 INFO:tasks.workunit.client.0.smithi017.stdout:7/156: mkdir da/d16/d1c/d2d/d30/d37 0 2024-09-20T18:35:48.639 INFO:tasks.workunit.client.0.smithi017.stdout:2/304: dread d1/dc/d58/d3d/f36 [0,4194304] 0 2024-09-20T18:35:48.639 INFO:tasks.workunit.client.1.smithi172.stdout:0/860: mkdir d4/d1a/d28/d12d 0 2024-09-20T18:35:48.640 INFO:tasks.workunit.client.0.smithi017.stdout:7/157: truncate da/d16/f32 557329 0 2024-09-20T18:35:48.641 INFO:tasks.workunit.client.0.smithi017.stdout:2/305: write d1/dc/d20/d2e/f62 [992852,4844] 0 2024-09-20T18:35:48.641 INFO:tasks.workunit.client.0.smithi017.stdout:6/126: mkdir d4/df/d28 0 2024-09-20T18:35:48.641 INFO:tasks.workunit.client.0.smithi017.stdout:7/158: chown da/f17 8703 1 2024-09-20T18:35:48.642 INFO:tasks.workunit.client.0.smithi017.stdout:2/306: chown d1/dc/d58/d46/d48/f4a 27 1 2024-09-20T18:35:48.642 INFO:tasks.workunit.client.1.smithi172.stdout:9/651: dwrite d15/d54/f6a [0,4194304] 0 2024-09-20T18:35:48.643 INFO:tasks.workunit.client.1.smithi172.stdout:3/758: link d0/dc/d6a/d76/fa2 d0/d13/d58/d6d/d7f/d84/f103 0 2024-09-20T18:35:48.644 INFO:tasks.workunit.client.0.smithi017.stdout:5/114: symlink d0/d14/d18/l1e 0 2024-09-20T18:35:48.646 INFO:tasks.workunit.client.1.smithi172.stdout:7/743: mkdir d2/d23/d3a/d72/d9b/d103 0 2024-09-20T18:35:48.647 INFO:tasks.workunit.client.0.smithi017.stdout:3/334: creat da/de/d13/d2f/d26/d41/f73 x:0 0 0 2024-09-20T18:35:48.647 INFO:tasks.workunit.client.1.smithi172.stdout:7/744: write d2/d23/d51/fd5 [195045,44312] 0 2024-09-20T18:35:48.648 INFO:tasks.workunit.client.0.smithi017.stdout:7/159: dwrite f4 [0,4194304] 0 2024-09-20T18:35:48.648 INFO:tasks.workunit.client.1.smithi172.stdout:1/661: rename d0/d8/db/d25/d2b/f63 to d0/d8/d12/fd9 0 2024-09-20T18:35:48.649 INFO:tasks.workunit.client.0.smithi017.stdout:7/160: chown da/d16/d1c/d2d/d34 580227820 1 2024-09-20T18:35:48.650 INFO:tasks.workunit.client.0.smithi017.stdout:8/177: mkdir d0/d6/d28/d3b 0 2024-09-20T18:35:48.651 INFO:tasks.workunit.client.0.smithi017.stdout:2/307: dread d1/dc/d58/d46/f3b [0,4194304] 0 2024-09-20T18:35:48.651 INFO:tasks.workunit.client.0.smithi017.stdout:0/159: truncate d4/db/d18/f22 600773 0 2024-09-20T18:35:48.651 INFO:tasks.workunit.client.0.smithi017.stdout:3/335: truncate da/de/d53/f44 757010 0 2024-09-20T18:35:48.653 INFO:tasks.workunit.client.0.smithi017.stdout:1/74: mkdir df/d16 0 2024-09-20T18:35:48.655 INFO:tasks.workunit.client.0.smithi017.stdout:7/161: read - da/d16/d1c/f1d zero size 2024-09-20T18:35:48.655 INFO:tasks.workunit.client.0.smithi017.stdout:4/109: unlink c1 0 2024-09-20T18:35:48.657 INFO:tasks.workunit.client.0.smithi017.stdout:2/308: truncate d1/dc/d20/d2e/f5f 256790 0 2024-09-20T18:35:48.658 INFO:tasks.workunit.client.0.smithi017.stdout:6/127: mkdir d4/d29 0 2024-09-20T18:35:48.659 INFO:tasks.workunit.client.0.smithi017.stdout:0/160: read d4/f17 [1526367,56402] 0 2024-09-20T18:35:48.663 INFO:tasks.workunit.client.0.smithi017.stdout:0/161: chown d4/f11 277 1 2024-09-20T18:35:48.663 INFO:tasks.workunit.client.0.smithi017.stdout:9/192: sync 2024-09-20T18:35:48.664 INFO:tasks.workunit.client.0.smithi017.stdout:5/115: creat d0/d13/f1f x:0 0 0 2024-09-20T18:35:48.665 INFO:tasks.workunit.client.0.smithi017.stdout:0/162: truncate f2 4653328 0 2024-09-20T18:35:48.665 INFO:tasks.workunit.client.1.smithi172.stdout:1/662: fsync d0/d8/db/d25/d2b/d3d/f3e 0 2024-09-20T18:35:48.667 INFO:tasks.workunit.client.1.smithi172.stdout:5/706: getdents d4/df/dad/dd4 0 2024-09-20T18:35:48.667 INFO:tasks.workunit.client.0.smithi017.stdout:1/75: dwrite fc [0,4194304] 0 2024-09-20T18:35:48.667 INFO:tasks.workunit.client.0.smithi017.stdout:0/163: stat d4/d20/f2a 0 2024-09-20T18:35:48.668 INFO:tasks.workunit.client.1.smithi172.stdout:5/707: fdatasync d4/df/dad/d26/d2d/d63/d80/dd7/fdf 0 2024-09-20T18:35:48.668 INFO:tasks.workunit.client.0.smithi017.stdout:1/76: dread - df/f14 zero size 2024-09-20T18:35:48.670 INFO:tasks.workunit.client.0.smithi017.stdout:7/162: unlink da/l15 0 2024-09-20T18:35:48.670 INFO:tasks.workunit.client.0.smithi017.stdout:1/77: write df/f10 [685989,37808] 0 2024-09-20T18:35:48.672 INFO:tasks.workunit.client.0.smithi017.stdout:5/116: dread d0/ff [0,4194304] 0 2024-09-20T18:35:48.673 INFO:tasks.workunit.client.0.smithi017.stdout:7/163: truncate da/f13 1696022 0 2024-09-20T18:35:48.674 INFO:tasks.workunit.client.0.smithi017.stdout:4/110: unlink d4/dc/l1d 0 2024-09-20T18:35:48.675 INFO:tasks.workunit.client.1.smithi172.stdout:5/708: dwrite d4/df/dad/d26/d41/d69/dac/d2c/f5c [0,4194304] 0 2024-09-20T18:35:48.677 INFO:tasks.workunit.client.1.smithi172.stdout:4/717: rmdir d0/de/df4 0 2024-09-20T18:35:48.679 INFO:tasks.workunit.client.1.smithi172.stdout:9/652: symlink d15/d1f/ld4 0 2024-09-20T18:35:48.680 INFO:tasks.workunit.client.1.smithi172.stdout:9/653: readlink d15/d1f/d2c/d7d/l8b 0 2024-09-20T18:35:48.683 INFO:tasks.workunit.client.0.smithi017.stdout:6/128: dread d4/f10 [0,4194304] 0 2024-09-20T18:35:48.684 INFO:tasks.workunit.client.0.smithi017.stdout:2/309: rename d1/dc/d58/d46/f3b to d1/dc/d58/d46/f63 0 2024-09-20T18:35:48.695 INFO:tasks.workunit.client.0.smithi017.stdout:0/164: unlink d4/l23 0 2024-09-20T18:35:48.696 INFO:tasks.workunit.client.1.smithi172.stdout:5/709: unlink d4/f62 0 2024-09-20T18:35:48.697 INFO:tasks.workunit.client.1.smithi172.stdout:4/718: stat d0/c1 0 2024-09-20T18:35:48.699 INFO:tasks.workunit.client.1.smithi172.stdout:9/654: creat d15/d20/fd5 x:0 0 0 2024-09-20T18:35:48.699 INFO:tasks.workunit.client.1.smithi172.stdout:4/719: read d0/de/d39/db8/d72/d18/d51/d9a/fab [967133,786] 0 2024-09-20T18:35:48.700 INFO:tasks.workunit.client.0.smithi017.stdout:5/117: creat d0/d14/f20 x:0 0 0 2024-09-20T18:35:48.700 INFO:tasks.workunit.client.0.smithi017.stdout:5/118: stat d0/fc 0 2024-09-20T18:35:48.702 INFO:tasks.workunit.client.0.smithi017.stdout:4/111: mkdir d4/dc/d1e/d26/d2b 0 2024-09-20T18:35:48.702 INFO:tasks.workunit.client.0.smithi017.stdout:4/112: fsync d4/dc/f12 0 2024-09-20T18:35:48.708 INFO:tasks.workunit.client.0.smithi017.stdout:6/129: mknod d4/df/d1f/d25/c2a 0 2024-09-20T18:35:48.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:48 smithi172 ceph-mon[35456]: pgmap v28: 65 pgs: 65 active+clean; 1.2 GiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 29 MiB/s rd, 147 MiB/s wr, 297 op/s 2024-09-20T18:35:48.709 INFO:tasks.workunit.client.1.smithi172.stdout:9/655: symlink d15/d1f/d7e/ld6 0 2024-09-20T18:35:48.710 INFO:tasks.workunit.client.1.smithi172.stdout:0/861: dwrite d4/d5/d2e/d33/de1/d15/f50 [0,4194304] 0 2024-09-20T18:35:48.710 INFO:tasks.workunit.client.0.smithi017.stdout:2/310: creat d1/df/d17/f64 x:0 0 0 2024-09-20T18:35:48.711 INFO:tasks.workunit.client.1.smithi172.stdout:7/745: getdents d2/d3/d10/d40/d6a/dc6 0 2024-09-20T18:35:48.711 INFO:tasks.workunit.client.1.smithi172.stdout:3/759: truncate d0/d13/d58/d6d/d7f/d84/fec 2650033 0 2024-09-20T18:35:48.714 INFO:tasks.workunit.client.1.smithi172.stdout:5/710: rename d4/df/dad/d26/d41/d69/dac/f7e to d4/df/dad/d26/d2d/dce/dd9/fe6 0 2024-09-20T18:35:48.715 INFO:tasks.workunit.client.0.smithi017.stdout:9/193: truncate d6/d11/f29 1935353 0 2024-09-20T18:35:48.716 INFO:tasks.workunit.client.1.smithi172.stdout:0/862: dread d4/d5/d2e/d33/f5a [0,4194304] 0 2024-09-20T18:35:48.717 INFO:tasks.workunit.client.0.smithi017.stdout:8/178: truncate d0/f1c 32789 0 2024-09-20T18:35:48.719 INFO:tasks.workunit.client.0.smithi017.stdout:1/78: mknod df/d16/c17 0 2024-09-20T18:35:48.720 INFO:tasks.workunit.client.1.smithi172.stdout:1/663: write d0/d8/d12/f5d [1992405,70301] 0 2024-09-20T18:35:48.720 INFO:tasks.workunit.client.0.smithi017.stdout:1/79: read f2 [1665726,66617] 0 2024-09-20T18:35:48.722 INFO:tasks.workunit.client.1.smithi172.stdout:5/711: dwrite d4/df/dad/d26/d2d/d86/faa [0,4194304] 0 2024-09-20T18:35:48.722 INFO:tasks.workunit.client.0.smithi017.stdout:5/119: unlink d0/cb 0 2024-09-20T18:35:48.723 INFO:tasks.workunit.client.1.smithi172.stdout:1/664: dread d0/d73/f92 [0,4194304] 0 2024-09-20T18:35:48.724 INFO:tasks.workunit.client.0.smithi017.stdout:9/194: dwrite d6/d1f/f33 [0,4194304] 0 2024-09-20T18:35:48.725 INFO:tasks.workunit.client.1.smithi172.stdout:0/863: dwrite d4/d5/d2e/d8e/f129 [0,4194304] 0 2024-09-20T18:35:48.727 INFO:tasks.workunit.client.1.smithi172.stdout:5/712: read d4/df/dad/d26/d41/d69/dac/f5d [2307906,65464] 0 2024-09-20T18:35:48.731 INFO:tasks.workunit.client.1.smithi172.stdout:3/760: creat d0/d13/d32/d54/d71/f104 x:0 0 0 2024-09-20T18:35:48.733 INFO:tasks.workunit.client.0.smithi017.stdout:1/80: dwrite df/f11 [4194304,4194304] 0 2024-09-20T18:35:48.742 INFO:tasks.workunit.client.0.smithi017.stdout:6/130: mkdir d4/df/d1f/d25/d2b 0 2024-09-20T18:35:48.742 INFO:tasks.workunit.client.0.smithi017.stdout:3/336: truncate da/de/d13/f67 2525104 0 2024-09-20T18:35:48.742 INFO:tasks.workunit.client.1.smithi172.stdout:4/720: rename d0/de/d39/db8/d72/d18/d51/d9a/cec to d0/de/dc/d3c/cfe 0 2024-09-20T18:35:48.744 INFO:tasks.workunit.client.0.smithi017.stdout:2/311: creat d1/dc/d58/d46/f65 x:0 0 0 2024-09-20T18:35:48.748 INFO:tasks.workunit.client.0.smithi017.stdout:8/179: chown d0/c2b 148326 1 2024-09-20T18:35:48.749 INFO:tasks.workunit.client.0.smithi017.stdout:8/180: dread - d0/f1e zero size 2024-09-20T18:35:48.750 INFO:tasks.workunit.client.1.smithi172.stdout:3/761: dread d0/d13/d58/d6d/db9/fb4 [0,4194304] 0 2024-09-20T18:35:48.750 INFO:tasks.workunit.client.1.smithi172.stdout:6/603: sync 2024-09-20T18:35:48.751 INFO:tasks.workunit.client.1.smithi172.stdout:2/623: sync 2024-09-20T18:35:48.751 INFO:tasks.workunit.client.1.smithi172.stdout:8/663: sync 2024-09-20T18:35:48.751 INFO:tasks.workunit.client.1.smithi172.stdout:7/746: mknod d2/c104 0 2024-09-20T18:35:48.752 INFO:tasks.workunit.client.1.smithi172.stdout:2/624: chown d0/d1a/dc0/fcc 85453617 1 2024-09-20T18:35:48.752 INFO:tasks.workunit.client.1.smithi172.stdout:0/864: creat d4/d5/d2e/d76/f12e x:0 0 0 2024-09-20T18:35:48.753 INFO:tasks.workunit.client.1.smithi172.stdout:2/625: dread - d0/d2c/d3f/dab/d22/d10/d35/fa6 zero size 2024-09-20T18:35:48.764 INFO:tasks.workunit.client.0.smithi017.stdout:7/164: creat da/f38 x:0 0 0 2024-09-20T18:35:48.765 INFO:tasks.workunit.client.1.smithi172.stdout:4/721: readlink d0/d48/d4e/l68 0 2024-09-20T18:35:48.767 INFO:tasks.workunit.client.0.smithi017.stdout:9/195: mkdir d6/d23/d24/d3f/d4d 0 2024-09-20T18:35:48.767 INFO:tasks.workunit.client.0.smithi017.stdout:9/196: dread - d6/f3d zero size 2024-09-20T18:35:48.772 INFO:tasks.workunit.client.1.smithi172.stdout:8/664: mkdir dd/d1b/d4f/d86/de8 0 2024-09-20T18:35:48.775 INFO:tasks.workunit.client.1.smithi172.stdout:3/762: mkdir d0/d13/d58/d6d/db9/d87/d105 0 2024-09-20T18:35:48.777 INFO:tasks.workunit.client.0.smithi017.stdout:6/131: rename d4/df/f23 to d4/df/d1f/d25/d2b/f2c 0 2024-09-20T18:35:48.777 INFO:tasks.workunit.client.1.smithi172.stdout:6/604: symlink d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/lc1 0 2024-09-20T18:35:48.781 INFO:tasks.workunit.client.1.smithi172.stdout:2/626: rename d0/d2c/d3f/dab/d22/d10/d6a/d98/fa7 to d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/fd3 0 2024-09-20T18:35:48.783 INFO:tasks.workunit.client.1.smithi172.stdout:1/665: write d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/fcb [203188,120412] 0 2024-09-20T18:35:48.783 INFO:tasks.workunit.client.1.smithi172.stdout:5/713: mknod d4/ce7 0 2024-09-20T18:35:48.784 INFO:tasks.workunit.client.1.smithi172.stdout:5/714: fdatasync d4/df/dad/d26/d41/fd6 0 2024-09-20T18:35:48.786 INFO:tasks.workunit.client.1.smithi172.stdout:9/656: getdents d15/d1f/d2c 0 2024-09-20T18:35:48.787 INFO:tasks.workunit.client.1.smithi172.stdout:9/657: stat d15/d1a/c4d 0 2024-09-20T18:35:48.788 INFO:tasks.workunit.client.1.smithi172.stdout:7/747: creat d2/dcc/f105 x:0 0 0 2024-09-20T18:35:48.789 INFO:tasks.workunit.client.1.smithi172.stdout:8/665: symlink dd/d1b/d4f/d9a/le9 0 2024-09-20T18:35:48.790 INFO:tasks.workunit.client.1.smithi172.stdout:8/666: read - dd/d1b/d4f/fcb zero size 2024-09-20T18:35:48.790 INFO:tasks.workunit.client.0.smithi017.stdout:5/120: dwrite d0/fe [0,4194304] 0 2024-09-20T18:35:48.791 INFO:tasks.workunit.client.1.smithi172.stdout:8/667: truncate dd/d1b/d3b/f42 2125654 0 2024-09-20T18:35:48.791 INFO:tasks.workunit.client.1.smithi172.stdout:8/668: readlink dd/d1b/d3b/d51/d5b/l9f 0 2024-09-20T18:35:48.793 INFO:tasks.workunit.client.1.smithi172.stdout:3/763: unlink d0/dc/d6a/d3a/d74/fcc 0 2024-09-20T18:35:48.797 INFO:tasks.workunit.client.0.smithi017.stdout:2/312: rename d1/dc/d58/d3d/l5c to d1/df/d17/l66 0 2024-09-20T18:35:48.797 INFO:tasks.workunit.client.1.smithi172.stdout:6/605: fsync d0/d18/d1c/d21/d26/f45 0 2024-09-20T18:35:48.798 INFO:tasks.workunit.client.0.smithi017.stdout:1/81: dwrite f3 [0,4194304] 0 2024-09-20T18:35:48.798 INFO:tasks.workunit.client.1.smithi172.stdout:6/606: read d0/fc [101084,75946] 0 2024-09-20T18:35:48.799 INFO:tasks.workunit.client.1.smithi172.stdout:6/607: chown d0/f5 312831731 1 2024-09-20T18:35:48.799 INFO:tasks.workunit.client.1.smithi172.stdout:3/764: dwrite d0/dc/d6a/d22/fa9 [0,4194304] 0 2024-09-20T18:35:48.800 INFO:tasks.workunit.client.1.smithi172.stdout:0/865: mknod d4/d1a/c12f 0 2024-09-20T18:35:48.800 INFO:tasks.workunit.client.0.smithi017.stdout:6/132: creat d4/df/d1f/d25/f2d x:0 0 0 2024-09-20T18:35:48.801 INFO:tasks.workunit.client.1.smithi172.stdout:0/866: stat d4/d5/d2e/d8e/f129 0 2024-09-20T18:35:48.801 INFO:tasks.workunit.client.0.smithi017.stdout:3/337: dwrite da/de/d14/d19/f4c [0,4194304] 0 2024-09-20T18:35:48.803 INFO:tasks.workunit.client.0.smithi017.stdout:5/121: dread d0/f10 [0,4194304] 0 2024-09-20T18:35:48.803 INFO:tasks.workunit.client.0.smithi017.stdout:2/313: truncate d1/dc/d58/d3d/f44 196904 0 2024-09-20T18:35:48.803 INFO:tasks.workunit.client.0.smithi017.stdout:3/338: chown da/de/d13/d2f/l33 7148 1 2024-09-20T18:35:48.803 INFO:tasks.workunit.client.0.smithi017.stdout:9/197: mknod d6/d23/d24/d3f/d4d/c4e 0 2024-09-20T18:35:48.805 INFO:tasks.workunit.client.0.smithi017.stdout:5/122: chown d0/d14/f17 1214669004 1 2024-09-20T18:35:48.806 INFO:tasks.workunit.client.1.smithi172.stdout:9/658: mkdir d15/d4a/dd7 0 2024-09-20T18:35:48.809 INFO:tasks.workunit.client.0.smithi017.stdout:4/113: getdents d4/de 0 2024-09-20T18:35:48.809 INFO:tasks.workunit.client.0.smithi017.stdout:4/114: readlink l2 0 2024-09-20T18:35:48.810 INFO:tasks.workunit.client.0.smithi017.stdout:4/115: chown d4/dc/d1e/d26/d2b 3832831 1 2024-09-20T18:35:48.818 INFO:tasks.workunit.client.0.smithi017.stdout:1/82: rename df/f14 to df/f18 0 2024-09-20T18:35:48.827 INFO:tasks.workunit.client.0.smithi017.stdout:7/165: rmdir da/d16/d1c/d2d/d30/d37 0 2024-09-20T18:35:48.828 INFO:tasks.workunit.client.0.smithi017.stdout:1/83: chown df/f10 450 1 2024-09-20T18:35:48.829 INFO:tasks.workunit.client.1.smithi172.stdout:4/722: creat d0/de/d39/db8/d72/fff x:0 0 0 2024-09-20T18:35:48.829 INFO:tasks.workunit.client.1.smithi172.stdout:1/666: creat d0/d8/db/d25/d2b/d3d/d65/d93/dbb/dd3/fda x:0 0 0 2024-09-20T18:35:48.829 INFO:tasks.workunit.client.0.smithi017.stdout:6/133: symlink d4/df/d1f/d25/d2b/l2e 0 2024-09-20T18:35:48.831 INFO:tasks.workunit.client.1.smithi172.stdout:6/608: rename d0/d18/d1c/d21/d26/d34/d7a/d47/d62/l6f to d0/d18/d1c/d21/d26/d34/d7a/d47/d7b/d7e/lc2 0 2024-09-20T18:35:48.832 INFO:tasks.workunit.client.0.smithi017.stdout:9/198: rmdir d6 39 2024-09-20T18:35:48.832 INFO:tasks.workunit.client.1.smithi172.stdout:6/609: dread d0/f13 [0,4194304] 0 2024-09-20T18:35:48.832 INFO:tasks.workunit.client.1.smithi172.stdout:5/715: getdents d4/df/dad/d26/d41/d69/dac/d2c/dd1 0 2024-09-20T18:35:48.838 INFO:tasks.workunit.client.1.smithi172.stdout:2/627: truncate d0/d2c/d3f/dab/d22/d10/f1f 642175 0 2024-09-20T18:35:48.840 INFO:tasks.workunit.client.0.smithi017.stdout:4/116: dread f3 [0,4194304] 0 2024-09-20T18:35:48.847 INFO:tasks.workunit.client.1.smithi172.stdout:6/610: dread d0/f4a [0,4194304] 0 2024-09-20T18:35:48.848 INFO:tasks.workunit.client.0.smithi017.stdout:7/166: mknod da/d16/d1b/c39 0 2024-09-20T18:35:48.851 INFO:tasks.workunit.client.1.smithi172.stdout:4/723: rename d0/de/fac to d0/d48/f100 0 2024-09-20T18:35:48.851 INFO:tasks.workunit.client.1.smithi172.stdout:4/724: readlink d0/de/l44 0 2024-09-20T18:35:48.853 INFO:tasks.workunit.client.1.smithi172.stdout:2/628: dread d0/d2c/d3f/dab/d22/f36 [0,4194304] 0 2024-09-20T18:35:48.854 INFO:tasks.workunit.client.1.smithi172.stdout:3/765: write d0/dc/d6a/d22/f7a [3439086,71591] 0 2024-09-20T18:35:48.856 INFO:tasks.workunit.client.0.smithi017.stdout:2/314: dwrite d1/dc/d58/d3d/f34 [0,4194304] 0 2024-09-20T18:35:48.860 INFO:tasks.workunit.client.1.smithi172.stdout:0/867: dwrite d4/d44/f5c [0,4194304] 0 2024-09-20T18:35:48.860 INFO:tasks.workunit.client.0.smithi017.stdout:8/181: dwrite d0/f1c [0,4194304] 0 2024-09-20T18:35:48.862 INFO:tasks.workunit.client.1.smithi172.stdout:3/766: dread d0/d13/d1e/fa3 [0,4194304] 0 2024-09-20T18:35:48.864 INFO:tasks.workunit.client.1.smithi172.stdout:1/667: getdents d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dd5 0 2024-09-20T18:35:48.864 INFO:tasks.workunit.client.0.smithi017.stdout:7/167: chown da/d16/d1c/d2d/d30/c36 11 1 2024-09-20T18:35:48.865 INFO:tasks.workunit.client.1.smithi172.stdout:1/668: write d0/d22/f28 [3561142,97401] 0 2024-09-20T18:35:48.867 INFO:tasks.workunit.client.0.smithi017.stdout:3/339: creat da/f74 x:0 0 0 2024-09-20T18:35:48.870 INFO:tasks.workunit.client.1.smithi172.stdout:7/748: rename d2/d3/d3d/d4e/d92/c93 to d2/d3/d10/d40/d6a/dc6/c106 0 2024-09-20T18:35:48.870 INFO:tasks.workunit.client.0.smithi017.stdout:3/340: stat da/de/d14/f6a 0 2024-09-20T18:35:48.870 INFO:tasks.workunit.client.0.smithi017.stdout:9/199: dwrite d6/d23/d24/d3f/d2f/f31 [0,4194304] 0 2024-09-20T18:35:48.871 INFO:tasks.workunit.client.0.smithi017.stdout:6/134: creat d4/df/d28/f2f x:0 0 0 2024-09-20T18:35:48.871 INFO:tasks.workunit.client.1.smithi172.stdout:7/749: readlink d2/d23/d3a/d72/lb7 0 2024-09-20T18:35:48.872 INFO:tasks.workunit.client.0.smithi017.stdout:6/135: stat d4/f21 0 2024-09-20T18:35:48.872 INFO:tasks.workunit.client.1.smithi172.stdout:7/750: stat d2 0 2024-09-20T18:35:48.873 INFO:tasks.workunit.client.0.smithi017.stdout:6/136: chown d4/f8 15389 1 2024-09-20T18:35:48.873 INFO:tasks.workunit.client.1.smithi172.stdout:1/669: dwrite d0/d8/db/d25/d2b/f37 [0,4194304] 0 2024-09-20T18:35:48.874 INFO:tasks.workunit.client.1.smithi172.stdout:7/751: chown d2/d3/dd/f4c 408990 1 2024-09-20T18:35:48.874 INFO:tasks.workunit.client.0.smithi017.stdout:6/137: write d4/df/d1f/d25/f2d [1019261,115697] 0 2024-09-20T18:35:48.875 INFO:tasks.workunit.client.1.smithi172.stdout:5/716: mknod d4/df/dad/dd4/ce8 0 2024-09-20T18:35:48.876 INFO:tasks.workunit.client.0.smithi017.stdout:6/138: chown d4/l1a 1560901 1 2024-09-20T18:35:48.877 INFO:tasks.workunit.client.1.smithi172.stdout:9/659: creat d15/fd8 x:0 0 0 2024-09-20T18:35:48.880 INFO:tasks.workunit.client.0.smithi017.stdout:7/168: mkdir da/d16/d1c/d2d/d3a 0 2024-09-20T18:35:48.881 INFO:tasks.workunit.client.1.smithi172.stdout:0/868: symlink d4/d1a/d28/d9d/l130 0 2024-09-20T18:35:48.881 INFO:tasks.workunit.client.1.smithi172.stdout:8/669: getdents dd/d1b/d4f/d9a/dbb 0 2024-09-20T18:35:48.882 INFO:tasks.workunit.client.1.smithi172.stdout:5/717: dread d4/f36 [0,4194304] 0 2024-09-20T18:35:48.883 INFO:tasks.workunit.client.0.smithi017.stdout:8/182: fdatasync d0/fd 0 2024-09-20T18:35:48.883 INFO:tasks.workunit.client.0.smithi017.stdout:9/200: creat d6/d1f/f4f x:0 0 0 2024-09-20T18:35:48.884 INFO:tasks.workunit.client.1.smithi172.stdout:0/869: write d4/d5/d2e/d38/d96/f10b [1218685,43914] 0 2024-09-20T18:35:48.885 INFO:tasks.workunit.client.1.smithi172.stdout:1/670: dwrite d0/d8/d12/f5d [0,4194304] 0 2024-09-20T18:35:48.888 INFO:tasks.workunit.client.0.smithi017.stdout:6/139: dwrite d4/df/d1f/d25/f27 [0,4194304] 0 2024-09-20T18:35:48.892 INFO:tasks.workunit.client.1.smithi172.stdout:1/671: dwrite d0/d8/db/d25/d6d/d77/f9b [0,4194304] 0 2024-09-20T18:35:48.896 INFO:tasks.workunit.client.0.smithi017.stdout:9/201: chown d6/d23/d24/d3f/d45 475590 1 2024-09-20T18:35:48.898 INFO:tasks.workunit.client.0.smithi017.stdout:7/169: dwrite f4 [4194304,4194304] 0 2024-09-20T18:35:48.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:48 smithi017 ceph-mon[28058]: pgmap v28: 65 pgs: 65 active+clean; 1.2 GiB data, 3.5 GiB used, 533 GiB / 536 GiB avail; 29 MiB/s rd, 147 MiB/s wr, 297 op/s 2024-09-20T18:35:48.915 INFO:tasks.workunit.client.1.smithi172.stdout:8/670: dread dd/d65/d85/f8b [0,4194304] 0 2024-09-20T18:35:48.916 INFO:tasks.workunit.client.1.smithi172.stdout:8/671: fsync dd/d1b/d3b/d51/d5b/daf/d91/fb1 0 2024-09-20T18:35:48.930 INFO:tasks.workunit.client.0.smithi017.stdout:2/315: mkdir d1/d67 0 2024-09-20T18:35:48.931 INFO:tasks.workunit.client.0.smithi017.stdout:5/123: getdents d0/d14/d18 0 2024-09-20T18:35:48.934 INFO:tasks.workunit.client.0.smithi017.stdout:4/117: creat d4/f2c x:0 0 0 2024-09-20T18:35:48.934 INFO:tasks.workunit.client.0.smithi017.stdout:5/124: read d0/d14/f17 [30622,116765] 0 2024-09-20T18:35:48.941 INFO:tasks.workunit.client.0.smithi017.stdout:6/140: truncate d4/f10 2226057 0 2024-09-20T18:35:48.952 INFO:tasks.workunit.client.1.smithi172.stdout:0/870: mknod d4/d1a/d28/d42/db8/c131 0 2024-09-20T18:35:48.952 INFO:tasks.workunit.client.1.smithi172.stdout:0/871: chown d4/d1a/c57 51 1 2024-09-20T18:35:48.953 INFO:tasks.workunit.client.1.smithi172.stdout:2/629: write d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/d9f/fcd [4341615,118159] 0 2024-09-20T18:35:48.954 INFO:tasks.workunit.client.0.smithi017.stdout:8/183: rename d0/l27 to d0/d6/d28/d3a/l3c 0 2024-09-20T18:35:48.955 INFO:tasks.workunit.client.1.smithi172.stdout:1/672: stat d0/d8/db/l69 0 2024-09-20T18:35:48.956 INFO:tasks.workunit.client.0.smithi017.stdout:6/141: creat d4/f30 x:0 0 0 2024-09-20T18:35:48.963 INFO:tasks.workunit.client.1.smithi172.stdout:3/767: link d0/dc/d6a/dc5/feb d0/d13/d58/d6d/db9/f106 0 2024-09-20T18:35:48.966 INFO:tasks.workunit.client.0.smithi017.stdout:4/118: unlink f0 0 2024-09-20T18:35:48.967 INFO:tasks.workunit.client.0.smithi017.stdout:4/119: chown d4/c6 3041 1 2024-09-20T18:35:48.968 INFO:tasks.workunit.client.0.smithi017.stdout:4/120: chown d4/dc/c23 14063633 1 2024-09-20T18:35:48.968 INFO:tasks.workunit.client.0.smithi017.stdout:5/125: dwrite d0/f1 [4194304,4194304] 0 2024-09-20T18:35:48.969 INFO:tasks.workunit.client.0.smithi017.stdout:3/341: getdents da/de/d13/d2f 0 2024-09-20T18:35:48.971 INFO:tasks.workunit.client.0.smithi017.stdout:3/342: truncate da/de/f6f 14025 0 2024-09-20T18:35:48.971 INFO:tasks.workunit.client.1.smithi172.stdout:8/672: write dd/d1b/d3b/d51/f88 [357648,57378] 0 2024-09-20T18:35:48.972 INFO:tasks.workunit.client.1.smithi172.stdout:9/660: creat d15/d4a/dd7/fd9 x:0 0 0 2024-09-20T18:35:48.972 INFO:tasks.workunit.client.1.smithi172.stdout:8/673: dread - dd/d1b/d3b/d51/d5b/d6b/fd2 zero size 2024-09-20T18:35:48.973 INFO:tasks.workunit.client.0.smithi017.stdout:8/184: readlink d0/d6/d28/l33 0 2024-09-20T18:35:48.975 INFO:tasks.workunit.client.0.smithi017.stdout:6/142: rename d4/ce to d4/df/d1f/d25/d2b/c31 0 2024-09-20T18:35:48.976 INFO:tasks.workunit.client.0.smithi017.stdout:6/143: stat d4/f1e 0 2024-09-20T18:35:48.977 INFO:tasks.workunit.client.0.smithi017.stdout:9/202: dwrite d6/d11/f12 [0,4194304] 0 2024-09-20T18:35:48.980 INFO:tasks.workunit.client.1.smithi172.stdout:7/752: truncate d2/d23/d3a/f71 983726 0 2024-09-20T18:35:48.982 INFO:tasks.workunit.client.1.smithi172.stdout:5/718: dwrite d4/df/d3f/f9a [0,4194304] 0 2024-09-20T18:35:48.982 INFO:tasks.workunit.client.1.smithi172.stdout:7/753: chown d2/d3/c6 14 1 2024-09-20T18:35:48.983 INFO:tasks.workunit.client.0.smithi017.stdout:8/185: dwrite d0/d6/d28/f2d [0,4194304] 0 2024-09-20T18:35:48.984 INFO:tasks.workunit.client.1.smithi172.stdout:6/611: rename d0/d18/d1c/d21/d26/d34/d39/c76 to d0/d18/d1c/d21/d26/d34/cc3 0 2024-09-20T18:35:48.985 INFO:tasks.workunit.client.0.smithi017.stdout:5/126: mknod d0/c21 0 2024-09-20T18:35:48.986 INFO:tasks.workunit.client.0.smithi017.stdout:4/121: creat d4/dc/d1e/d26/d22/f2d x:0 0 0 2024-09-20T18:35:48.987 INFO:tasks.workunit.client.0.smithi017.stdout:9/203: dread d6/f7 [0,4194304] 0 2024-09-20T18:35:48.987 INFO:tasks.workunit.client.1.smithi172.stdout:9/661: mkdir d15/d1a/d64/dda 0 2024-09-20T18:35:48.988 INFO:tasks.workunit.client.0.smithi017.stdout:9/204: chown d6/f34 72 1 2024-09-20T18:35:48.990 INFO:tasks.workunit.client.1.smithi172.stdout:2/630: mkdir d0/dd4 0 2024-09-20T18:35:48.991 INFO:tasks.workunit.client.0.smithi017.stdout:6/144: chown d4/df/l1d 35 1 2024-09-20T18:35:48.992 INFO:tasks.workunit.client.0.smithi017.stdout:6/145: fdatasync d4/f8 0 2024-09-20T18:35:48.992 INFO:tasks.workunit.client.0.smithi017.stdout:7/170: getdents da/d16 0 2024-09-20T18:35:48.993 INFO:tasks.workunit.client.1.smithi172.stdout:5/719: creat d4/df/dad/d26/d41/d69/dac/da7/fe9 x:0 0 0 2024-09-20T18:35:48.994 INFO:tasks.workunit.client.1.smithi172.stdout:9/662: dread d15/d54/f6a [0,4194304] 0 2024-09-20T18:35:48.995 INFO:tasks.workunit.client.1.smithi172.stdout:9/663: chown d15/d1f/d2c/d7d/d34/f49 1798 1 2024-09-20T18:35:48.996 INFO:tasks.workunit.client.1.smithi172.stdout:9/664: write d15/d20/d76/f92 [3951647,98925] 0 2024-09-20T18:35:48.996 INFO:tasks.workunit.client.1.smithi172.stdout:4/725: rename d0/de/d39/db8/d72 to d0/d48/d90/d55/d101 0 2024-09-20T18:35:48.997 INFO:tasks.workunit.client.1.smithi172.stdout:4/726: chown d0/d48/d90/d55/d101/f11 782667220 1 2024-09-20T18:35:48.999 INFO:tasks.workunit.client.1.smithi172.stdout:6/612: creat d0/d18/d1c/d21/d26/d34/d7a/d47/d62/fc4 x:0 0 0 2024-09-20T18:35:49.002 INFO:tasks.workunit.client.1.smithi172.stdout:6/613: truncate d0/d18/d1c/d21/d26/d34/d7a/d99/fa4 658719 0 2024-09-20T18:35:49.002 INFO:tasks.workunit.client.0.smithi017.stdout:7/171: dread da/f13 [0,4194304] 0 2024-09-20T18:35:49.004 INFO:tasks.workunit.client.0.smithi017.stdout:4/122: fsync d4/dc/d1e/d26/d22/f2d 0 2024-09-20T18:35:49.006 INFO:tasks.workunit.client.0.smithi017.stdout:4/123: write d4/d19/f1f [1079950,115294] 0 2024-09-20T18:35:49.006 INFO:tasks.workunit.client.0.smithi017.stdout:4/124: chown d4/de 973319973 1 2024-09-20T18:35:49.010 INFO:tasks.workunit.client.1.smithi172.stdout:5/720: creat d4/df/d98/dcc/fea x:0 0 0 2024-09-20T18:35:49.010 INFO:tasks.workunit.client.0.smithi017.stdout:3/343: mknod da/de/d53/c75 0 2024-09-20T18:35:49.011 INFO:tasks.workunit.client.1.smithi172.stdout:5/721: write d4/df/dad/d26/d2d/d63/d80/fa8 [3232768,118081] 0 2024-09-20T18:35:49.013 INFO:tasks.workunit.client.0.smithi017.stdout:9/205: creat d6/d23/f50 x:0 0 0 2024-09-20T18:35:49.016 INFO:tasks.workunit.client.1.smithi172.stdout:1/673: rename d0/d8/d12/caf to d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dcf/cdb 0 2024-09-20T18:35:49.017 INFO:tasks.workunit.client.0.smithi017.stdout:3/344: dwrite da/f58 [0,4194304] 0 2024-09-20T18:35:49.020 INFO:tasks.workunit.client.0.smithi017.stdout:5/127: write d0/ff [93282,12374] 0 2024-09-20T18:35:49.024 INFO:tasks.workunit.client.1.smithi172.stdout:9/665: creat d15/d54/fdb x:0 0 0 2024-09-20T18:35:49.026 INFO:tasks.workunit.client.1.smithi172.stdout:0/872: getdents d4/d1a/d28/d42/d45/d54/df8 0 2024-09-20T18:35:49.027 INFO:tasks.workunit.client.1.smithi172.stdout:0/873: truncate d4/d1a/d28/d9d/f104 617841 0 2024-09-20T18:35:49.028 INFO:tasks.workunit.client.1.smithi172.stdout:6/614: creat d0/d18/d1c/d21/d26/d34/d7a/d47/d7b/d7e/fc5 x:0 0 0 2024-09-20T18:35:49.029 INFO:tasks.workunit.client.0.smithi017.stdout:3/345: dwrite da/de/d13/d2f/d26/d41/f73 [0,4194304] 0 2024-09-20T18:35:49.029 INFO:tasks.workunit.client.0.smithi017.stdout:7/172: rmdir da/d16/d1c/d2d/d30 39 2024-09-20T18:35:49.032 INFO:tasks.workunit.client.0.smithi017.stdout:5/128: dwrite d0/f1 [4194304,4194304] 0 2024-09-20T18:35:49.034 INFO:tasks.workunit.client.0.smithi017.stdout:5/129: truncate d0/d14/f20 624098 0 2024-09-20T18:35:49.034 INFO:tasks.workunit.client.1.smithi172.stdout:5/722: unlink d4/df/dad/d26/d41/d69/la0 0 2024-09-20T18:35:49.034 INFO:tasks.workunit.client.1.smithi172.stdout:5/723: chown d4/df/dad/fe3 32 1 2024-09-20T18:35:49.035 INFO:tasks.workunit.client.0.smithi017.stdout:4/125: mknod d4/dc/d1e/d26/c2e 0 2024-09-20T18:35:49.038 INFO:tasks.workunit.client.1.smithi172.stdout:3/768: rename d0/d13/db2/fce to d0/d13/d1e/f107 0 2024-09-20T18:35:49.040 INFO:tasks.workunit.client.1.smithi172.stdout:1/674: truncate d0/d8/db/d25/d2b/d3d/d65/f66 491751 0 2024-09-20T18:35:49.045 INFO:tasks.workunit.client.1.smithi172.stdout:9/666: mknod d15/d1a/d64/cdc 0 2024-09-20T18:35:49.047 INFO:tasks.workunit.client.1.smithi172.stdout:0/874: creat d4/d1a/d28/d42/db8/f132 x:0 0 0 2024-09-20T18:35:49.048 INFO:tasks.workunit.client.0.smithi017.stdout:6/146: truncate d4/f11 2197529 0 2024-09-20T18:35:49.052 INFO:tasks.workunit.client.1.smithi172.stdout:7/754: getdents d2/d3/d10 0 2024-09-20T18:35:49.054 INFO:tasks.workunit.client.1.smithi172.stdout:0/875: dwrite d4/d5/d2e/d33/de1/fda [0,4194304] 0 2024-09-20T18:35:49.054 INFO:tasks.workunit.client.0.smithi017.stdout:3/346: rename da/de/d14 to da/de/d13/d2f/d26/d31/d5a/d76 0 2024-09-20T18:35:49.055 INFO:tasks.workunit.client.0.smithi017.stdout:5/130: rmdir d0/d14 39 2024-09-20T18:35:49.057 INFO:tasks.workunit.client.0.smithi017.stdout:5/131: truncate d0/d13/f1f 662601 0 2024-09-20T18:35:49.059 INFO:tasks.workunit.client.0.smithi017.stdout:4/126: truncate f3 2998312 0 2024-09-20T18:35:49.059 INFO:tasks.workunit.client.0.smithi017.stdout:4/127: chown d4/l9 439 1 2024-09-20T18:35:49.060 INFO:tasks.workunit.client.0.smithi017.stdout:4/128: fsync d4/dc/d1e/f18 0 2024-09-20T18:35:49.061 INFO:tasks.workunit.client.0.smithi017.stdout:4/129: fsync d4/dc/d1e/f18 0 2024-09-20T18:35:49.065 INFO:tasks.workunit.client.1.smithi172.stdout:3/769: dwrite d0/d13/d1e/f107 [0,4194304] 0 2024-09-20T18:35:49.066 INFO:tasks.workunit.client.0.smithi017.stdout:9/206: link d6/f18 d6/d23/f51 0 2024-09-20T18:35:49.066 INFO:tasks.workunit.client.1.smithi172.stdout:1/675: dread - d0/f59 zero size 2024-09-20T18:35:49.066 INFO:tasks.workunit.client.0.smithi017.stdout:9/207: write d6/d11/f13 [3974435,36943] 0 2024-09-20T18:35:49.067 INFO:tasks.workunit.client.1.smithi172.stdout:1/676: write d0/d8/d5f/f6e [1324164,118038] 0 2024-09-20T18:35:49.068 INFO:tasks.workunit.client.0.smithi017.stdout:6/147: unlink d4/c1b 0 2024-09-20T18:35:49.069 INFO:tasks.workunit.client.1.smithi172.stdout:5/724: dread d4/df/dad/d26/d2d/f73 [0,4194304] 0 2024-09-20T18:35:49.071 INFO:tasks.workunit.client.1.smithi172.stdout:9/667: mknod d15/d1f/d2c/d7d/d34/cdd 0 2024-09-20T18:35:49.072 INFO:tasks.workunit.client.0.smithi017.stdout:8/186: getdents d0/d6 0 2024-09-20T18:35:49.074 INFO:tasks.workunit.client.0.smithi017.stdout:8/187: write d0/f2 [1198189,30610] 0 2024-09-20T18:35:49.075 INFO:tasks.workunit.client.1.smithi172.stdout:6/615: mknod d0/d18/d1c/d21/d26/d34/d39/cc6 0 2024-09-20T18:35:49.079 INFO:tasks.workunit.client.0.smithi017.stdout:4/130: dread d4/dc/d1e/d26/d22/f21 [0,4194304] 0 2024-09-20T18:35:49.081 INFO:tasks.workunit.client.1.smithi172.stdout:0/876: mkdir d4/d5/d2e/d8e/d133 0 2024-09-20T18:35:49.086 INFO:tasks.workunit.client.0.smithi017.stdout:9/208: mknod d6/d23/d40/c52 0 2024-09-20T18:35:49.088 INFO:tasks.workunit.client.0.smithi017.stdout:6/148: unlink d4/df/d1f/d25/f2d 0 2024-09-20T18:35:49.089 INFO:tasks.workunit.client.1.smithi172.stdout:1/677: mknod d0/d8/db/d39/cdc 0 2024-09-20T18:35:49.090 INFO:tasks.workunit.client.0.smithi017.stdout:6/149: write d4/df/d1f/d25/f27 [4642695,80047] 0 2024-09-20T18:35:49.090 INFO:tasks.workunit.client.0.smithi017.stdout:6/150: write d4/f12 [349891,130460] 0 2024-09-20T18:35:49.091 INFO:tasks.workunit.client.0.smithi017.stdout:6/151: read - d4/f21 zero size 2024-09-20T18:35:49.092 INFO:tasks.workunit.client.0.smithi017.stdout:8/188: mkdir d0/d6/d28/d3d 0 2024-09-20T18:35:49.094 INFO:tasks.workunit.client.0.smithi017.stdout:8/189: write d0/d6/f30 [1615549,126865] 0 2024-09-20T18:35:49.095 INFO:tasks.workunit.client.1.smithi172.stdout:1/678: dwrite d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/fcb [0,4194304] 0 2024-09-20T18:35:49.095 INFO:tasks.workunit.client.1.smithi172.stdout:5/725: creat d4/df/dad/d26/d41/d69/db9/feb x:0 0 0 2024-09-20T18:35:49.098 INFO:tasks.workunit.client.0.smithi017.stdout:6/152: dread d4/f14 [0,4194304] 0 2024-09-20T18:35:49.099 INFO:tasks.workunit.client.1.smithi172.stdout:6/616: mkdir d0/d18/d1c/d21/d26/d34/d9c/dc7 0 2024-09-20T18:35:49.102 INFO:tasks.workunit.client.1.smithi172.stdout:7/755: creat d2/d3/d10/de4/f107 x:0 0 0 2024-09-20T18:35:49.105 INFO:tasks.workunit.client.0.smithi017.stdout:8/190: dwrite d0/f22 [4194304,4194304] 0 2024-09-20T18:35:49.107 INFO:tasks.workunit.client.0.smithi017.stdout:7/173: dwrite da/f18 [0,4194304] 0 2024-09-20T18:35:49.110 INFO:tasks.workunit.client.1.smithi172.stdout:7/756: dwrite d2/d3/fa7 [4194304,4194304] 0 2024-09-20T18:35:49.110 INFO:tasks.workunit.client.0.smithi017.stdout:6/153: dread d4/df/d1f/d25/f27 [0,4194304] 0 2024-09-20T18:35:49.111 INFO:tasks.workunit.client.0.smithi017.stdout:6/154: dread - d4/fd zero size 2024-09-20T18:35:49.113 INFO:tasks.workunit.client.1.smithi172.stdout:8/674: rename dd/d1b/d3b/d51/d34/f5c to dd/d1b/d3b/d51/fea 0 2024-09-20T18:35:49.114 INFO:tasks.workunit.client.0.smithi017.stdout:9/209: creat d6/d11/f53 x:0 0 0 2024-09-20T18:35:49.115 INFO:tasks.workunit.client.1.smithi172.stdout:3/770: mkdir d0/d13/d108 0 2024-09-20T18:35:49.122 INFO:tasks.workunit.client.1.smithi172.stdout:1/679: dread d0/d8/db/d25/d2b/d3d/d65/f66 [0,4194304] 0 2024-09-20T18:35:49.124 INFO:tasks.workunit.client.1.smithi172.stdout:5/726: rmdir d4/df/dad/d26/d41/d69/db9 39 2024-09-20T18:35:49.125 INFO:tasks.workunit.client.1.smithi172.stdout:5/727: chown d4/df/dad/d26/d2d/c5e 105976527 1 2024-09-20T18:35:49.129 INFO:tasks.workunit.client.1.smithi172.stdout:6/617: read d0/d18/d1c/d21/f7c [1380329,68864] 0 2024-09-20T18:35:49.130 INFO:tasks.workunit.client.1.smithi172.stdout:0/877: creat d4/d5/d2e/d33/de1/d15/dfe/f134 x:0 0 0 2024-09-20T18:35:49.133 INFO:tasks.workunit.client.0.smithi017.stdout:3/347: truncate da/de/d13/d2f/d26/d41/f73 2147291 0 2024-09-20T18:35:49.135 INFO:tasks.workunit.client.1.smithi172.stdout:2/631: rename d0/d2c/d3f/dab/d18/d29/d42/d4b/d53/f5b to d0/d2c/d3f/dab/d18/d29/d42/fd5 0 2024-09-20T18:35:49.138 INFO:tasks.workunit.client.1.smithi172.stdout:3/771: dread d0/f16 [0,4194304] 0 2024-09-20T18:35:49.142 INFO:tasks.workunit.client.0.smithi017.stdout:5/132: write d0/d14/f17 [305020,105190] 0 2024-09-20T18:35:49.144 INFO:tasks.workunit.client.1.smithi172.stdout:8/675: dread dd/d1b/d3b/d51/d5b/daf/d4d/f8f [0,4194304] 0 2024-09-20T18:35:49.144 INFO:tasks.workunit.client.0.smithi017.stdout:6/155: creat d4/df/f32 x:0 0 0 2024-09-20T18:35:49.148 INFO:tasks.workunit.client.1.smithi172.stdout:5/728: mknod d4/df/dad/d26/d2d/d63/cec 0 2024-09-20T18:35:49.149 INFO:tasks.workunit.client.1.smithi172.stdout:6/618: chown d0/d18/f1e 895 1 2024-09-20T18:35:49.152 INFO:tasks.workunit.client.0.smithi017.stdout:3/348: creat da/de/d13/d16/f77 x:0 0 0 2024-09-20T18:35:49.155 INFO:tasks.workunit.client.1.smithi172.stdout:4/727: rename d0/de/dc/d3c/ca3 to d0/d48/d90/db4/ded/c102 0 2024-09-20T18:35:49.157 INFO:tasks.workunit.client.1.smithi172.stdout:2/632: chown d0/d2c/d3f/dab/d18/d29/c34 21439796 1 2024-09-20T18:35:49.160 INFO:tasks.workunit.client.0.smithi017.stdout:8/191: write d0/d6/f21 [143540,72758] 0 2024-09-20T18:35:49.161 INFO:tasks.workunit.client.1.smithi172.stdout:3/772: chown d0/dc/fd1 6 1 2024-09-20T18:35:49.165 INFO:tasks.workunit.client.0.smithi017.stdout:6/156: symlink d4/df/d28/l33 0 2024-09-20T18:35:49.166 INFO:tasks.workunit.client.1.smithi172.stdout:1/680: mkdir d0/d8/db/d25/d6d/ddd 0 2024-09-20T18:35:49.170 INFO:tasks.workunit.client.0.smithi017.stdout:3/349: dread da/de/d13/d2f/d26/d31/d5a/f6d [4194304,4194304] 0 2024-09-20T18:35:49.171 INFO:tasks.workunit.client.1.smithi172.stdout:0/878: dwrite d4/f11 [0,4194304] 0 2024-09-20T18:35:49.172 INFO:tasks.workunit.client.0.smithi017.stdout:7/174: write da/f11 [1933922,14586] 0 2024-09-20T18:35:49.173 INFO:tasks.workunit.client.0.smithi017.stdout:7/175: chown da/d16/d1c/f1f 10899 1 2024-09-20T18:35:49.177 INFO:tasks.workunit.client.0.smithi017.stdout:6/157: rename d4/df/c26 to d4/d29/c34 0 2024-09-20T18:35:49.180 INFO:tasks.workunit.client.0.smithi017.stdout:5/133: dwrite d0/f7 [0,4194304] 0 2024-09-20T18:35:49.183 INFO:tasks.workunit.client.0.smithi017.stdout:5/134: chown d0/d14/f17 14203 1 2024-09-20T18:35:49.184 INFO:tasks.workunit.client.0.smithi017.stdout:8/192: link d0/f22 d0/d6/f3e 0 2024-09-20T18:35:49.185 INFO:tasks.workunit.client.0.smithi017.stdout:7/176: dwrite da/d16/d1b/f28 [0,4194304] 0 2024-09-20T18:35:49.185 INFO:tasks.workunit.client.0.smithi017.stdout:3/350: truncate da/de/f5b 620087 0 2024-09-20T18:35:49.187 INFO:tasks.workunit.client.0.smithi017.stdout:4/131: dread f3 [0,4194304] 0 2024-09-20T18:35:49.190 INFO:tasks.workunit.client.1.smithi172.stdout:9/668: sync 2024-09-20T18:35:49.190 INFO:tasks.workunit.client.0.smithi017.stdout:6/158: read d4/fc [1485592,76234] 0 2024-09-20T18:35:49.193 INFO:tasks.workunit.client.0.smithi017.stdout:7/177: mknod da/d16/d1b/c3b 0 2024-09-20T18:35:49.194 INFO:tasks.workunit.client.0.smithi017.stdout:5/135: dwrite d0/f1 [4194304,4194304] 0 2024-09-20T18:35:49.195 INFO:tasks.workunit.client.0.smithi017.stdout:3/351: unlink da/de/d13/d2f/l33 0 2024-09-20T18:35:49.196 INFO:tasks.workunit.client.0.smithi017.stdout:7/178: write da/d16/d1c/f1f [4743482,60166] 0 2024-09-20T18:35:49.199 INFO:tasks.workunit.client.0.smithi017.stdout:7/179: write da/f18 [3139089,10756] 0 2024-09-20T18:35:49.200 INFO:tasks.workunit.client.0.smithi017.stdout:8/193: symlink d0/d6/d28/d3b/l3f 0 2024-09-20T18:35:49.204 INFO:tasks.workunit.client.0.smithi017.stdout:5/136: dwrite d0/f1 [8388608,4194304] 0 2024-09-20T18:35:49.204 INFO:tasks.workunit.client.0.smithi017.stdout:7/180: read da/f1a [1510229,55980] 0 2024-09-20T18:35:49.210 INFO:tasks.workunit.client.0.smithi017.stdout:4/132: creat d4/de/d1b/f2f x:0 0 0 2024-09-20T18:35:49.213 INFO:tasks.workunit.client.0.smithi017.stdout:3/352: creat da/de/d13/d16/d50/f78 x:0 0 0 2024-09-20T18:35:49.219 INFO:tasks.workunit.client.0.smithi017.stdout:4/133: dwrite d4/dc/d1e/f18 [4194304,4194304] 0 2024-09-20T18:35:49.219 INFO:tasks.workunit.client.0.smithi017.stdout:8/194: unlink d0/c2b 0 2024-09-20T18:35:49.220 INFO:tasks.workunit.client.0.smithi017.stdout:3/353: dread da/f5c [0,4194304] 0 2024-09-20T18:35:49.223 INFO:tasks.workunit.client.0.smithi017.stdout:5/137: write d0/f10 [3512192,63089] 0 2024-09-20T18:35:49.231 INFO:tasks.workunit.client.0.smithi017.stdout:6/159: dwrite d4/df/f16 [0,4194304] 0 2024-09-20T18:35:49.235 INFO:tasks.workunit.client.0.smithi017.stdout:4/134: stat d4/dc/d1e/d26/l20 0 2024-09-20T18:35:49.236 INFO:tasks.workunit.client.0.smithi017.stdout:4/135: chown d4/d19/f1f 1466311 1 2024-09-20T18:35:49.237 INFO:tasks.workunit.client.0.smithi017.stdout:4/136: stat d4/de/d1b/f2f 0 2024-09-20T18:35:49.238 INFO:tasks.workunit.client.0.smithi017.stdout:3/354: chown da/de/d53/d52 0 1 2024-09-20T18:35:49.240 INFO:tasks.workunit.client.0.smithi017.stdout:5/138: rename d0/f6 to d0/d13/f22 0 2024-09-20T18:35:49.243 INFO:tasks.workunit.client.0.smithi017.stdout:7/181: mkdir da/d16/d1c/d2d/d34/d3c 0 2024-09-20T18:35:49.261 INFO:tasks.workunit.client.1.smithi172.stdout:5/729: creat d4/df/dad/d26/d41/d69/dcd/fed x:0 0 0 2024-09-20T18:35:49.261 INFO:tasks.workunit.client.1.smithi172.stdout:6/619: rmdir d0/d18/d1c/d21/d26/d34/d39 39 2024-09-20T18:35:49.263 INFO:tasks.workunit.client.1.smithi172.stdout:6/620: chown d0/d18/d1c/d21/d26/d34/da2/lb5 4091078 1 2024-09-20T18:35:49.263 INFO:tasks.workunit.client.1.smithi172.stdout:4/728: creat d0/d48/d90/d55/d101/d18/f103 x:0 0 0 2024-09-20T18:35:49.279 INFO:tasks.workunit.client.1.smithi172.stdout:3/773: readlink d0/l17 0 2024-09-20T18:35:49.279 INFO:tasks.workunit.client.0.smithi017.stdout:6/160: mkdir d4/d35 0 2024-09-20T18:35:49.279 INFO:tasks.workunit.client.1.smithi172.stdout:1/681: creat d0/dc2/fde x:0 0 0 2024-09-20T18:35:49.280 INFO:tasks.workunit.client.1.smithi172.stdout:8/676: symlink dd/d65/leb 0 2024-09-20T18:35:49.282 INFO:tasks.workunit.client.1.smithi172.stdout:0/879: symlink d4/d1a/d28/d42/d45/dd1/l135 0 2024-09-20T18:35:49.283 INFO:tasks.workunit.client.0.smithi017.stdout:5/139: dwrite d0/f1 [12582912,4194304] 0 2024-09-20T18:35:49.284 INFO:tasks.workunit.client.1.smithi172.stdout:7/757: getdents d2/d3/d10/d40/d6a/dc6 0 2024-09-20T18:35:49.287 INFO:tasks.workunit.client.0.smithi017.stdout:8/195: dwrite d0/d6/f3e [4194304,4194304] 0 2024-09-20T18:35:49.287 INFO:tasks.workunit.client.0.smithi017.stdout:5/140: dread d0/d13/f22 [4194304,4194304] 0 2024-09-20T18:35:49.288 INFO:tasks.workunit.client.1.smithi172.stdout:0/880: dwrite d4/d1a/d28/d42/f55 [0,4194304] 0 2024-09-20T18:35:49.289 INFO:tasks.workunit.client.1.smithi172.stdout:5/730: unlink d4/df/dad/d26/d2d/d86/f88 0 2024-09-20T18:35:49.291 INFO:tasks.workunit.client.0.smithi017.stdout:6/161: symlink d4/l36 0 2024-09-20T18:35:49.292 INFO:tasks.workunit.client.0.smithi017.stdout:8/196: write d0/f1e [204036,64059] 0 2024-09-20T18:35:49.295 INFO:tasks.workunit.client.1.smithi172.stdout:2/633: write d0/d1a/d58/f78 [5223077,49439] 0 2024-09-20T18:35:49.298 INFO:tasks.workunit.client.1.smithi172.stdout:4/729: creat d0/d48/d90/d55/d53/d78/dd9/f104 x:0 0 0 2024-09-20T18:35:49.299 INFO:tasks.workunit.client.0.smithi017.stdout:5/141: rmdir d0/d14 39 2024-09-20T18:35:49.300 INFO:tasks.workunit.client.1.smithi172.stdout:1/682: rmdir d0/d8/db/d25/d6d 39 2024-09-20T18:35:49.301 INFO:tasks.workunit.client.0.smithi017.stdout:6/162: mkdir d4/d37 0 2024-09-20T18:35:49.302 INFO:tasks.workunit.client.0.smithi017.stdout:6/163: stat d4/df/f32 0 2024-09-20T18:35:49.304 INFO:tasks.workunit.client.0.smithi017.stdout:6/164: truncate d4/df/d1f/f22 80266 0 2024-09-20T18:35:49.304 INFO:tasks.workunit.client.1.smithi172.stdout:8/677: truncate dd/d1b/d3b/d51/d5b/daf/f73 2788062 0 2024-09-20T18:35:49.304 INFO:tasks.workunit.client.0.smithi017.stdout:6/165: chown d4/d29 14620718 1 2024-09-20T18:35:49.304 INFO:tasks.workunit.client.1.smithi172.stdout:3/774: dread d0/dc/fa0 [0,4194304] 0 2024-09-20T18:35:49.305 INFO:tasks.workunit.client.0.smithi017.stdout:7/182: mknod da/d16/d1c/d2d/d34/d3c/c3d 0 2024-09-20T18:35:49.305 INFO:tasks.workunit.client.1.smithi172.stdout:8/678: chown dd/d1b/d4f 123 1 2024-09-20T18:35:49.306 INFO:tasks.workunit.client.0.smithi017.stdout:7/183: write da/d16/d1b/f2c [1787365,88368] 0 2024-09-20T18:35:49.307 INFO:tasks.workunit.client.1.smithi172.stdout:7/758: rmdir d2/d3/d10 39 2024-09-20T18:35:49.307 INFO:tasks.workunit.client.1.smithi172.stdout:4/730: dwrite d0/de/d39/ffa [0,4194304] 0 2024-09-20T18:35:49.308 INFO:tasks.workunit.client.0.smithi017.stdout:7/184: write da/f11 [675233,92750] 0 2024-09-20T18:35:49.308 INFO:tasks.workunit.client.0.smithi017.stdout:4/137: getdents d4/dc/d1e/d26/d22 0 2024-09-20T18:35:49.312 INFO:tasks.workunit.client.1.smithi172.stdout:8/679: dwrite dd/d65/fa8 [0,4194304] 0 2024-09-20T18:35:49.317 INFO:tasks.workunit.client.1.smithi172.stdout:9/669: sync 2024-09-20T18:35:49.317 INFO:tasks.workunit.client.0.smithi017.stdout:6/166: creat d4/df/d1f/f38 x:0 0 0 2024-09-20T18:35:49.317 INFO:tasks.workunit.client.0.smithi017.stdout:7/185: dwrite da/d16/d1c/f1d [0,4194304] 0 2024-09-20T18:35:49.322 INFO:tasks.workunit.client.0.smithi017.stdout:3/355: truncate da/de/d13/d2f/d26/d31/f45 3876105 0 2024-09-20T18:35:49.325 INFO:tasks.workunit.client.0.smithi017.stdout:8/197: mknod d0/d6/d28/d3d/c40 0 2024-09-20T18:35:49.326 INFO:tasks.workunit.client.1.smithi172.stdout:2/634: symlink d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/ld6 0 2024-09-20T18:35:49.328 INFO:tasks.workunit.client.1.smithi172.stdout:2/635: read d0/d2c/f3d [2563335,20598] 0 2024-09-20T18:35:49.330 INFO:tasks.workunit.client.0.smithi017.stdout:5/142: rename d0/d13/f1f to d0/d14/f23 0 2024-09-20T18:35:49.332 INFO:tasks.workunit.client.1.smithi172.stdout:3/775: unlink d0/d13/d32/ce3 0 2024-09-20T18:35:49.333 INFO:tasks.workunit.client.0.smithi017.stdout:8/198: dwrite d0/f14 [0,4194304] 0 2024-09-20T18:35:49.339 INFO:tasks.workunit.client.0.smithi017.stdout:6/167: creat d4/d29/f39 x:0 0 0 2024-09-20T18:35:49.339 INFO:tasks.workunit.client.0.smithi017.stdout:6/168: chown d4/d35 2216 1 2024-09-20T18:35:49.340 INFO:tasks.workunit.client.0.smithi017.stdout:6/169: dread - d4/df/d1f/f38 zero size 2024-09-20T18:35:49.341 INFO:tasks.workunit.client.0.smithi017.stdout:6/170: fsync d4/f21 0 2024-09-20T18:35:49.342 INFO:tasks.workunit.client.0.smithi017.stdout:7/186: fsync da/d16/d1c/f1d 0 2024-09-20T18:35:49.342 INFO:tasks.workunit.client.0.smithi017.stdout:6/171: write d4/df/f32 [935382,119669] 0 2024-09-20T18:35:49.346 INFO:tasks.workunit.client.0.smithi017.stdout:6/172: chown d4/df/d1f/l24 14931979 1 2024-09-20T18:35:49.346 INFO:tasks.workunit.client.0.smithi017.stdout:4/138: getdents d4/dc/d1e/d26/d22 0 2024-09-20T18:35:49.351 INFO:tasks.workunit.client.1.smithi172.stdout:8/680: unlink dd/d1b/d3b/d51/f76 0 2024-09-20T18:35:49.352 INFO:tasks.workunit.client.0.smithi017.stdout:3/356: rename da/de/d53/l48 to da/de/d13/d16/l79 0 2024-09-20T18:35:49.353 INFO:tasks.workunit.client.1.smithi172.stdout:5/731: mknod d4/df/dad/d26/d41/d69/dac/d2c/dd1/cee 0 2024-09-20T18:35:49.355 INFO:tasks.workunit.client.0.smithi017.stdout:5/143: write d0/d14/f23 [1683657,120064] 0 2024-09-20T18:35:49.356 INFO:tasks.workunit.client.1.smithi172.stdout:9/670: mknod d15/d1f/d88/cde 0 2024-09-20T18:35:49.357 INFO:tasks.workunit.client.1.smithi172.stdout:8/681: dwrite dd/d1b/d4f/d9a/fc3 [0,4194304] 0 2024-09-20T18:35:49.357 INFO:tasks.workunit.client.0.smithi017.stdout:8/199: mkdir d0/d6/d28/d41 0 2024-09-20T18:35:49.358 INFO:tasks.workunit.client.1.smithi172.stdout:7/759: dread d2/d23/d3a/f88 [4194304,4194304] 0 2024-09-20T18:35:49.358 INFO:tasks.workunit.client.1.smithi172.stdout:9/671: fsync d15/d1f/d2c/f70 0 2024-09-20T18:35:49.359 INFO:tasks.workunit.client.1.smithi172.stdout:6/621: creat d0/d18/daf/fc8 x:0 0 0 2024-09-20T18:35:49.362 INFO:tasks.workunit.client.0.smithi017.stdout:6/173: rmdir d4/df 39 2024-09-20T18:35:49.365 INFO:tasks.workunit.client.0.smithi017.stdout:4/139: rmdir d4/de 39 2024-09-20T18:35:49.366 INFO:tasks.workunit.client.1.smithi172.stdout:3/776: symlink d0/d13/d58/d6d/db9/d87/l109 0 2024-09-20T18:35:49.367 INFO:tasks.workunit.client.1.smithi172.stdout:0/881: truncate d4/f11 481738 0 2024-09-20T18:35:49.368 INFO:tasks.workunit.client.0.smithi017.stdout:3/357: mknod da/de/d13/d2f/d26/d31/c7a 0 2024-09-20T18:35:49.370 INFO:tasks.workunit.client.0.smithi017.stdout:3/358: write da/de/d13/d16/d50/f78 [415729,36263] 0 2024-09-20T18:35:49.371 INFO:tasks.workunit.client.1.smithi172.stdout:4/731: sync 2024-09-20T18:35:49.371 INFO:tasks.workunit.client.0.smithi017.stdout:5/144: creat d0/d14/d18/d1b/f24 x:0 0 0 2024-09-20T18:35:49.372 INFO:tasks.workunit.client.1.smithi172.stdout:4/732: write d0/d7/f62 [4272877,108053] 0 2024-09-20T18:35:49.372 INFO:tasks.workunit.client.0.smithi017.stdout:5/145: write d0/f7 [1457730,63798] 0 2024-09-20T18:35:49.374 INFO:tasks.workunit.client.0.smithi017.stdout:8/200: mknod d0/d6/d28/c42 0 2024-09-20T18:35:49.376 INFO:tasks.workunit.client.1.smithi172.stdout:5/732: creat d4/df/dad/d26/d41/d69/dac/d2c/fef x:0 0 0 2024-09-20T18:35:49.381 INFO:tasks.workunit.client.1.smithi172.stdout:2/636: write d0/d2c/d3f/dab/d22/d10/d35/d5d/fb9 [171844,44014] 0 2024-09-20T18:35:49.381 INFO:tasks.workunit.client.1.smithi172.stdout:8/682: rmdir dd/d1b/d3b/d51/dac 39 2024-09-20T18:35:49.387 INFO:tasks.workunit.client.0.smithi017.stdout:4/140: write d4/de/d1b/f2f [157282,127090] 0 2024-09-20T18:35:49.387 INFO:tasks.workunit.client.1.smithi172.stdout:2/637: dwrite d0/d2c/d3f/dab/d22/d10/d3c/d68/fc6 [0,4194304] 0 2024-09-20T18:35:49.388 INFO:tasks.workunit.client.0.smithi017.stdout:4/141: chown d4/de/f27 3302925 1 2024-09-20T18:35:49.388 INFO:tasks.workunit.client.0.smithi017.stdout:3/359: readlink da/de/d13/d2f/d26/d41/l51 0 2024-09-20T18:35:49.389 INFO:tasks.workunit.client.0.smithi017.stdout:4/142: chown d4/c6 253 1 2024-09-20T18:35:49.393 INFO:tasks.workunit.client.1.smithi172.stdout:1/683: link d0/d8/db/cca d0/d8/d5f/cdf 0 2024-09-20T18:35:49.393 INFO:tasks.workunit.client.0.smithi017.stdout:7/187: truncate da/f11 1011093 0 2024-09-20T18:35:49.395 INFO:tasks.workunit.client.0.smithi017.stdout:5/146: creat d0/d13/f25 x:0 0 0 2024-09-20T18:35:49.395 INFO:tasks.workunit.client.1.smithi172.stdout:1/684: dread - d0/d8/db/d25/d2b/d3d/d65/d93/dbb/dd3/fda zero size 2024-09-20T18:35:49.396 INFO:tasks.workunit.client.1.smithi172.stdout:6/622: dwrite d0/d18/d1c/d21/d26/d34/d39/fc0 [0,4194304] 0 2024-09-20T18:35:49.396 INFO:tasks.workunit.client.1.smithi172.stdout:1/685: dread - d0/d8/db/d25/d2b/fc3 zero size 2024-09-20T18:35:49.397 INFO:tasks.workunit.client.0.smithi017.stdout:6/174: mknod d4/df/c3a 0 2024-09-20T18:35:49.397 INFO:tasks.workunit.client.0.smithi017.stdout:4/143: dwrite d4/d19/f1f [0,4194304] 0 2024-09-20T18:35:49.400 INFO:tasks.workunit.client.0.smithi017.stdout:3/360: readlink da/de/d13/l25 0 2024-09-20T18:35:49.406 INFO:tasks.workunit.client.1.smithi172.stdout:4/733: creat d0/d48/d90/d55/d101/d18/f105 x:0 0 0 2024-09-20T18:35:49.407 INFO:tasks.workunit.client.0.smithi017.stdout:5/147: creat d0/d14/d18/d1b/f26 x:0 0 0 2024-09-20T18:35:49.407 INFO:tasks.workunit.client.1.smithi172.stdout:7/760: dwrite d2/d23/d3a/d72/d9b/fa3 [0,4194304] 0 2024-09-20T18:35:49.408 INFO:tasks.workunit.client.1.smithi172.stdout:5/733: fdatasync d4/df/dad/d26/d41/f7f 0 2024-09-20T18:35:49.409 INFO:tasks.workunit.client.0.smithi017.stdout:4/144: dwrite d4/de/f27 [4194304,4194304] 0 2024-09-20T18:35:49.409 INFO:tasks.workunit.client.0.smithi017.stdout:5/148: write d0/d13/f25 [56768,44839] 0 2024-09-20T18:35:49.410 INFO:tasks.workunit.client.0.smithi017.stdout:6/175: truncate d4/f9 363670 0 2024-09-20T18:35:49.411 INFO:tasks.workunit.client.0.smithi017.stdout:3/361: mknod da/de/d13/d2f/d26/d31/d5a/d76/d19/c7b 0 2024-09-20T18:35:49.412 INFO:tasks.workunit.client.1.smithi172.stdout:4/734: dwrite d0/de/dc/d3c/f5f [4194304,4194304] 0 2024-09-20T18:35:49.414 INFO:tasks.workunit.client.0.smithi017.stdout:7/188: dread da/f14 [0,4194304] 0 2024-09-20T18:35:49.415 INFO:tasks.workunit.client.1.smithi172.stdout:9/672: rename d15/lcd to d15/d20/d76/dc6/ldf 0 2024-09-20T18:35:49.418 INFO:tasks.workunit.client.0.smithi017.stdout:4/145: creat d4/d19/f30 x:0 0 0 2024-09-20T18:35:49.421 INFO:tasks.workunit.client.0.smithi017.stdout:5/149: dwrite d0/d13/f25 [0,4194304] 0 2024-09-20T18:35:49.423 INFO:tasks.workunit.client.1.smithi172.stdout:6/623: creat d0/d18/d1c/d21/d26/d79/fc9 x:0 0 0 2024-09-20T18:35:49.428 INFO:tasks.workunit.client.1.smithi172.stdout:1/686: rmdir d0/d8/db/d25/d2b/d3d/d65/d93/dbb/dd3 39 2024-09-20T18:35:49.428 INFO:tasks.workunit.client.1.smithi172.stdout:1/687: chown d0/f4 135655460 1 2024-09-20T18:35:49.431 INFO:tasks.workunit.client.1.smithi172.stdout:0/882: creat d4/d1a/d28/d42/d45/dd1/d106/f136 x:0 0 0 2024-09-20T18:35:49.433 INFO:tasks.workunit.client.1.smithi172.stdout:7/761: symlink d2/d3/d3d/l108 0 2024-09-20T18:35:49.433 INFO:tasks.workunit.client.0.smithi017.stdout:4/146: dwrite d4/f7 [0,4194304] 0 2024-09-20T18:35:49.433 INFO:tasks.workunit.client.1.smithi172.stdout:7/762: chown d2/d3/d3d/d4e/d92/c9a 7916320 1 2024-09-20T18:35:49.435 INFO:tasks.workunit.client.1.smithi172.stdout:4/735: creat d0/de/d21/d24/f106 x:0 0 0 2024-09-20T18:35:49.436 INFO:tasks.workunit.client.0.smithi017.stdout:5/150: dwrite d0/d14/f23 [0,4194304] 0 2024-09-20T18:35:49.436 INFO:tasks.workunit.client.1.smithi172.stdout:8/683: rename c6 to dd/d1b/d3b/dc7/cec 0 2024-09-20T18:35:49.437 INFO:tasks.workunit.client.0.smithi017.stdout:7/189: unlink da/f18 0 2024-09-20T18:35:49.438 INFO:tasks.workunit.client.0.smithi017.stdout:5/151: rename d0/d14 to d0/d14/d27 22 2024-09-20T18:35:49.439 INFO:tasks.workunit.client.1.smithi172.stdout:2/638: getdents d0/dd4 0 2024-09-20T18:35:49.442 INFO:tasks.workunit.client.1.smithi172.stdout:9/673: truncate d15/d1f/d2c/d7d/d34/db5/fbc 1469568 0 2024-09-20T18:35:49.444 INFO:tasks.workunit.client.1.smithi172.stdout:9/674: truncate d15/d4a/f96 5238895 0 2024-09-20T18:35:49.446 INFO:tasks.workunit.client.1.smithi172.stdout:3/777: creat d0/d13/d58/d6d/f10a x:0 0 0 2024-09-20T18:35:49.450 INFO:tasks.workunit.client.1.smithi172.stdout:6/624: creat d0/d18/d1c/d21/d26/d34/d7a/d47/d7b/d7e/fca x:0 0 0 2024-09-20T18:35:49.454 INFO:tasks.workunit.client.1.smithi172.stdout:0/883: dread - d4/d1a/d28/d42/d45/d99/dc9/fe3 zero size 2024-09-20T18:35:49.455 INFO:tasks.workunit.client.1.smithi172.stdout:0/884: dread - d4/d5/d2e/d33/de1/d15/f12b zero size 2024-09-20T18:35:49.455 INFO:tasks.workunit.client.0.smithi017.stdout:6/176: dread d4/df/f15 [0,4194304] 0 2024-09-20T18:35:49.456 INFO:tasks.workunit.client.0.smithi017.stdout:5/152: rename d0/f1 to d0/d14/f28 0 2024-09-20T18:35:49.460 INFO:tasks.workunit.client.1.smithi172.stdout:4/736: write d0/d48/d90/d55/d53/d78/fe4 [295285,8331] 0 2024-09-20T18:35:49.461 INFO:tasks.workunit.client.1.smithi172.stdout:4/737: chown d0/de/dc/fd7 468579 1 2024-09-20T18:35:49.461 INFO:tasks.workunit.client.1.smithi172.stdout:4/738: fsync d0/de/d21/d24/f69 0 2024-09-20T18:35:49.462 INFO:tasks.workunit.client.1.smithi172.stdout:4/739: stat d0/de/d21/l66 0 2024-09-20T18:35:49.463 INFO:tasks.workunit.client.1.smithi172.stdout:4/740: chown d0/d48/d90/d55/d101/d18/d51 0 1 2024-09-20T18:35:49.463 INFO:tasks.workunit.client.1.smithi172.stdout:5/734: rename d4/df/dad/d26/d2d/lbb to d4/df/dad/d26/d41/d69/dcd/lf0 0 2024-09-20T18:35:49.465 INFO:tasks.workunit.client.1.smithi172.stdout:8/684: truncate dd/d65/d85/fcc 99405 0 2024-09-20T18:35:49.465 INFO:tasks.workunit.client.0.smithi017.stdout:3/362: write da/de/d13/d16/f22 [255306,84155] 0 2024-09-20T18:35:49.465 INFO:tasks.workunit.client.1.smithi172.stdout:8/685: readlink dd/d65/leb 0 2024-09-20T18:35:49.466 INFO:tasks.workunit.client.1.smithi172.stdout:8/686: write dd/d1b/d4f/fcb [382547,45284] 0 2024-09-20T18:35:49.468 INFO:tasks.workunit.client.1.smithi172.stdout:2/639: mknod d0/d90/cd7 0 2024-09-20T18:35:49.469 INFO:tasks.workunit.client.0.smithi017.stdout:6/177: symlink d4/df/d1f/d25/l3b 0 2024-09-20T18:35:49.471 INFO:tasks.workunit.client.0.smithi017.stdout:5/153: symlink d0/d14/d18/l29 0 2024-09-20T18:35:49.472 INFO:tasks.workunit.client.1.smithi172.stdout:7/763: dread d2/d3/d10/f18 [0,4194304] 0 2024-09-20T18:35:49.472 INFO:tasks.workunit.client.1.smithi172.stdout:3/778: mknod d0/dc/c10b 0 2024-09-20T18:35:49.473 INFO:tasks.workunit.client.0.smithi017.stdout:3/363: dwrite da/f58 [0,4194304] 0 2024-09-20T18:35:49.474 INFO:tasks.workunit.client.1.smithi172.stdout:2/640: dwrite d0/d2c/d3f/dab/d22/d10/d3c/d68/fc6 [0,4194304] 0 2024-09-20T18:35:49.476 INFO:tasks.workunit.client.1.smithi172.stdout:1/688: symlink d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/le0 0 2024-09-20T18:35:49.479 INFO:tasks.workunit.client.1.smithi172.stdout:6/625: truncate d0/d18/d1c/d21/d26/d34/d7a/d47/d62/f91 627201 0 2024-09-20T18:35:49.480 INFO:tasks.workunit.client.0.smithi017.stdout:6/178: dwrite d4/d29/f39 [0,4194304] 0 2024-09-20T18:35:49.481 INFO:tasks.workunit.client.0.smithi017.stdout:6/179: write d4/df/f16 [2094680,50444] 0 2024-09-20T18:35:49.483 INFO:tasks.workunit.client.0.smithi017.stdout:5/154: mkdir d0/d14/d18/d2a 0 2024-09-20T18:35:49.483 INFO:tasks.workunit.client.0.smithi017.stdout:6/180: stat d4/df/f15 0 2024-09-20T18:35:49.484 INFO:tasks.workunit.client.1.smithi172.stdout:0/885: creat d4/d5/d2e/d33/de1/d10e/f137 x:0 0 0 2024-09-20T18:35:49.485 INFO:tasks.workunit.client.1.smithi172.stdout:0/886: readlink d4/d5/d2e/d33/de1/d15/dfe/l10f 0 2024-09-20T18:35:49.488 INFO:tasks.workunit.client.0.smithi017.stdout:5/155: dread d0/d14/f23 [0,4194304] 0 2024-09-20T18:35:49.495 INFO:tasks.workunit.client.0.smithi017.stdout:4/147: dwrite d4/dc/d1e/d26/d22/f21 [0,4194304] 0 2024-09-20T18:35:49.497 INFO:tasks.workunit.client.1.smithi172.stdout:0/887: dread d4/d1a/d28/d42/f4c [0,4194304] 0 2024-09-20T18:35:49.497 INFO:tasks.workunit.client.1.smithi172.stdout:2/641: dread d0/d2c/f70 [0,4194304] 0 2024-09-20T18:35:49.499 INFO:tasks.workunit.client.1.smithi172.stdout:2/642: write d0/d2c/d3f/fd [2295898,68582] 0 2024-09-20T18:35:49.500 INFO:tasks.workunit.client.0.smithi017.stdout:6/181: symlink d4/df/d1f/d25/l3c 0 2024-09-20T18:35:49.504 INFO:tasks.workunit.client.0.smithi017.stdout:7/190: rename da/l24 to da/d16/d1c/d2d/l3e 0 2024-09-20T18:35:49.505 INFO:tasks.workunit.client.1.smithi172.stdout:8/687: dwrite dd/d1b/d3b/d51/dac/fc4 [0,4194304] 0 2024-09-20T18:35:49.506 INFO:tasks.workunit.client.1.smithi172.stdout:9/675: truncate d15/d1f/f3f 2223909 0 2024-09-20T18:35:49.506 INFO:tasks.workunit.client.0.smithi017.stdout:5/156: fsync d0/d13/f22 0 2024-09-20T18:35:49.508 INFO:tasks.workunit.client.1.smithi172.stdout:3/779: creat d0/d13/d58/f10c x:0 0 0 2024-09-20T18:35:49.509 INFO:tasks.workunit.client.1.smithi172.stdout:3/780: read d0/dc/f4c [7403,101645] 0 2024-09-20T18:35:49.510 INFO:tasks.workunit.client.1.smithi172.stdout:1/689: write d0/d8/db/d25/d2b/d3d/d65/d93/dbb/dd3/fda [368451,63378] 0 2024-09-20T18:35:49.514 INFO:tasks.workunit.client.0.smithi017.stdout:7/191: dwrite da/d16/f32 [0,4194304] 0 2024-09-20T18:35:49.515 INFO:tasks.workunit.client.0.smithi017.stdout:4/148: truncate d4/fa 802232 0 2024-09-20T18:35:49.515 INFO:tasks.workunit.client.0.smithi017.stdout:7/192: fsync da/d16/d1b/f28 0 2024-09-20T18:35:49.516 INFO:tasks.workunit.client.0.smithi017.stdout:4/149: readlink d4/dc/d1e/d26/l20 0 2024-09-20T18:35:49.516 INFO:tasks.workunit.client.0.smithi017.stdout:7/193: fsync da/f17 0 2024-09-20T18:35:49.517 INFO:tasks.workunit.client.0.smithi017.stdout:7/194: write da/f22 [5433585,24086] 0 2024-09-20T18:35:49.518 INFO:tasks.workunit.client.0.smithi017.stdout:4/150: fsync d4/dc/d1e/f18 0 2024-09-20T18:35:49.519 INFO:tasks.workunit.client.0.smithi017.stdout:4/151: chown d4/d19/l1a 40465049 1 2024-09-20T18:35:49.520 INFO:tasks.workunit.client.0.smithi017.stdout:4/152: chown d4/f7 1712544434 1 2024-09-20T18:35:49.520 INFO:tasks.workunit.client.0.smithi017.stdout:3/364: rename da/de/d13/d2f/d26/d31/d5a/d76/f30 to da/de/f7c 0 2024-09-20T18:35:49.521 INFO:tasks.workunit.client.1.smithi172.stdout:5/735: mknod d4/df/dad/cf1 0 2024-09-20T18:35:49.522 INFO:tasks.workunit.client.1.smithi172.stdout:0/888: mknod d4/d5/d2e/c138 0 2024-09-20T18:35:49.524 INFO:tasks.workunit.client.1.smithi172.stdout:5/736: truncate d4/df/dad/d26/d41/d69/dac/d2c/fef 328368 0 2024-09-20T18:35:49.537 INFO:tasks.workunit.client.0.smithi017.stdout:7/195: creat da/d16/f3f x:0 0 0 2024-09-20T18:35:49.541 INFO:tasks.workunit.client.0.smithi017.stdout:3/365: symlink da/de/d13/d16/d50/l7d 0 2024-09-20T18:35:49.543 INFO:tasks.workunit.client.0.smithi017.stdout:5/157: symlink d0/d14/d18/d2a/l2b 0 2024-09-20T18:35:49.543 INFO:tasks.workunit.client.0.smithi017.stdout:5/158: chown d0/d13 27482635 1 2024-09-20T18:35:49.544 INFO:tasks.workunit.client.0.smithi017.stdout:6/182: link d4/df/d1f/d25/c2a d4/df/d28/c3d 0 2024-09-20T18:35:49.546 INFO:tasks.workunit.client.1.smithi172.stdout:4/741: creat d0/f107 x:0 0 0 2024-09-20T18:35:49.547 INFO:tasks.workunit.client.0.smithi017.stdout:7/196: rename da/d16/d1c/d2d to da/d16/d1c/d40 0 2024-09-20T18:35:49.547 INFO:tasks.workunit.client.0.smithi017.stdout:7/197: chown da/f12 6910 1 2024-09-20T18:35:49.549 INFO:tasks.workunit.client.1.smithi172.stdout:5/737: fsync d4/df/dad/d26/d41/d69/dac/d2c/f82 0 2024-09-20T18:35:49.551 INFO:tasks.workunit.client.0.smithi017.stdout:3/366: rename da/f5c to da/de/d13/d2f/d26/d31/f7e 0 2024-09-20T18:35:49.552 INFO:tasks.workunit.client.0.smithi017.stdout:5/159: symlink d0/d14/l2c 0 2024-09-20T18:35:49.553 INFO:tasks.workunit.client.1.smithi172.stdout:8/688: creat dd/d1b/d3b/dc7/ddb/fed x:0 0 0 2024-09-20T18:35:49.555 INFO:tasks.workunit.client.0.smithi017.stdout:6/183: symlink d4/df/d1f/l3e 0 2024-09-20T18:35:49.556 INFO:tasks.workunit.client.1.smithi172.stdout:3/781: dwrite d0/f20 [0,4194304] 0 2024-09-20T18:35:49.557 INFO:tasks.workunit.client.0.smithi017.stdout:5/160: symlink d0/d14/d18/d1b/l2d 0 2024-09-20T18:35:49.558 INFO:tasks.workunit.client.1.smithi172.stdout:1/690: creat d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dd5/fe1 x:0 0 0 2024-09-20T18:35:49.561 INFO:tasks.workunit.client.1.smithi172.stdout:6/626: rename d0/d18/d1c/d21/d26/d34/c86 to d0/d18/ccb 0 2024-09-20T18:35:49.563 INFO:tasks.workunit.client.1.smithi172.stdout:7/764: sync 2024-09-20T18:35:49.565 INFO:tasks.workunit.client.0.smithi017.stdout:5/161: creat d0/d14/d18/d1b/f2e x:0 0 0 2024-09-20T18:35:49.568 INFO:tasks.workunit.client.1.smithi172.stdout:5/738: creat d4/df/dad/dd4/ff2 x:0 0 0 2024-09-20T18:35:49.570 INFO:tasks.workunit.client.1.smithi172.stdout:2/643: creat d0/d2c/d3f/dab/d18/d29/fd8 x:0 0 0 2024-09-20T18:35:49.571 INFO:tasks.workunit.client.1.smithi172.stdout:0/889: dwrite d4/d5/d2e/d33/f6b [0,4194304] 0 2024-09-20T18:35:49.572 INFO:tasks.workunit.client.0.smithi017.stdout:5/162: dwrite d0/d13/f22 [4194304,4194304] 0 2024-09-20T18:35:49.574 INFO:tasks.workunit.client.1.smithi172.stdout:9/676: rename d15/d1f/d88/l9f to d15/d1f/d7e/le0 0 2024-09-20T18:35:49.574 INFO:tasks.workunit.client.0.smithi017.stdout:5/163: write d0/d14/d18/d1b/f26 [887653,31073] 0 2024-09-20T18:35:49.575 INFO:tasks.workunit.client.0.smithi017.stdout:5/164: read d0/f10 [4114826,40405] 0 2024-09-20T18:35:49.578 INFO:tasks.workunit.client.1.smithi172.stdout:5/739: dwrite d4/df/dad/d26/d41/d69/dac/d2c/f5c [4194304,4194304] 0 2024-09-20T18:35:49.579 INFO:tasks.workunit.client.0.smithi017.stdout:4/153: read d4/fa [181601,24251] 0 2024-09-20T18:35:49.580 INFO:tasks.workunit.client.0.smithi017.stdout:4/154: dread - d4/f2c zero size 2024-09-20T18:35:49.584 INFO:tasks.workunit.client.0.smithi017.stdout:7/198: truncate da/f14 659040 0 2024-09-20T18:35:49.585 INFO:tasks.workunit.client.0.smithi017.stdout:7/199: chown da/d16 2 1 2024-09-20T18:35:49.585 INFO:tasks.workunit.client.1.smithi172.stdout:4/742: write d0/d48/d90/d55/d53/d78/f8d [196888,123352] 0 2024-09-20T18:35:49.586 INFO:tasks.workunit.client.1.smithi172.stdout:9/677: dwrite d15/d20/fd5 [0,4194304] 0 2024-09-20T18:35:49.586 INFO:tasks.workunit.client.0.smithi017.stdout:7/200: chown da/d16/d1c/d40/d34 1065 1 2024-09-20T18:35:49.589 INFO:tasks.workunit.client.0.smithi017.stdout:4/155: rmdir d4 39 2024-09-20T18:35:49.592 INFO:tasks.workunit.client.1.smithi172.stdout:8/689: mkdir dd/d1b/d3b/d51/d34/dee 0 2024-09-20T18:35:49.593 INFO:tasks.workunit.client.1.smithi172.stdout:7/765: write d2/f87 [938018,101081] 0 2024-09-20T18:35:49.594 INFO:tasks.workunit.client.1.smithi172.stdout:1/691: mknod d0/d8/db/d25/ce2 0 2024-09-20T18:35:49.595 INFO:tasks.workunit.client.1.smithi172.stdout:7/766: write d2/d23/d3a/d72/d9b/f100 [77301,9750] 0 2024-09-20T18:35:49.595 INFO:tasks.workunit.client.1.smithi172.stdout:1/692: read d0/d22/f7a [578213,118239] 0 2024-09-20T18:35:49.596 INFO:tasks.workunit.client.1.smithi172.stdout:1/693: chown d0/f4 207639 1 2024-09-20T18:35:49.598 INFO:tasks.workunit.client.0.smithi017.stdout:5/165: write d0/d14/f23 [4179014,74684] 0 2024-09-20T18:35:49.598 INFO:tasks.workunit.client.0.smithi017.stdout:4/156: chown d4/d19/f15 208 1 2024-09-20T18:35:49.599 INFO:tasks.workunit.client.1.smithi172.stdout:8/690: dread dd/d1b/d3b/d51/f35 [0,4194304] 0 2024-09-20T18:35:49.599 INFO:tasks.workunit.client.1.smithi172.stdout:8/691: readlink dd/d1b/d3b/d51/l75 0 2024-09-20T18:35:49.600 INFO:tasks.workunit.client.0.smithi017.stdout:5/166: write d0/f7 [831758,48108] 0 2024-09-20T18:35:49.600 INFO:tasks.workunit.client.0.smithi017.stdout:4/157: write d4/dc/d1e/d26/d22/f21 [4717330,16771] 0 2024-09-20T18:35:49.600 INFO:tasks.workunit.client.0.smithi017.stdout:0/165: sync 2024-09-20T18:35:49.600 INFO:tasks.workunit.client.0.smithi017.stdout:1/84: sync 2024-09-20T18:35:49.601 INFO:tasks.workunit.client.1.smithi172.stdout:3/782: rename d0/dc/d6a/d3a/le8 to d0/dc/d6a/d22/l10d 0 2024-09-20T18:35:49.601 INFO:tasks.workunit.client.0.smithi017.stdout:4/158: readlink d4/d19/l1a 0 2024-09-20T18:35:49.601 INFO:tasks.workunit.client.0.smithi017.stdout:1/85: stat c6 0 2024-09-20T18:35:49.603 INFO:tasks.workunit.client.0.smithi017.stdout:1/86: chown cb 402457 1 2024-09-20T18:35:49.603 INFO:tasks.workunit.client.1.smithi172.stdout:6/627: symlink d0/d18/d1c/d21/lcc 0 2024-09-20T18:35:49.605 INFO:tasks.workunit.client.0.smithi017.stdout:5/167: creat d0/d14/d18/f2f x:0 0 0 2024-09-20T18:35:49.606 INFO:tasks.workunit.client.0.smithi017.stdout:0/166: mkdir d4/db/d18/d25/d36 0 2024-09-20T18:35:49.609 INFO:tasks.workunit.client.0.smithi017.stdout:4/159: creat d4/dc/d1e/d26/f31 x:0 0 0 2024-09-20T18:35:49.611 INFO:tasks.workunit.client.0.smithi017.stdout:1/87: symlink df/d16/l19 0 2024-09-20T18:35:49.612 INFO:tasks.workunit.client.0.smithi017.stdout:1/88: fsync df/f10 0 2024-09-20T18:35:49.613 INFO:tasks.workunit.client.0.smithi017.stdout:0/167: dwrite d4/db/fe [0,4194304] 0 2024-09-20T18:35:49.614 INFO:tasks.workunit.client.0.smithi017.stdout:5/168: creat d0/d14/d18/f30 x:0 0 0 2024-09-20T18:35:49.615 INFO:tasks.workunit.client.0.smithi017.stdout:5/169: chown d0/d13/f25 21423 1 2024-09-20T18:35:49.617 INFO:tasks.workunit.client.0.smithi017.stdout:4/160: rename d4/c1c to d4/dc/d1e/d26/d22/c32 0 2024-09-20T18:35:49.618 INFO:tasks.workunit.client.0.smithi017.stdout:4/161: fdatasync d4/dc/d1e/d26/d22/f17 0 2024-09-20T18:35:49.620 INFO:tasks.workunit.client.0.smithi017.stdout:7/201: write da/f11 [920476,107319] 0 2024-09-20T18:35:49.621 INFO:tasks.workunit.client.0.smithi017.stdout:7/202: chown da/d16/d1c/f1f 1722 1 2024-09-20T18:35:49.622 INFO:tasks.workunit.client.1.smithi172.stdout:8/692: creat dd/d65/d85/dab/fef x:0 0 0 2024-09-20T18:35:49.623 INFO:tasks.workunit.client.0.smithi017.stdout:0/168: mkdir d4/d37 0 2024-09-20T18:35:49.625 INFO:tasks.workunit.client.0.smithi017.stdout:0/169: read d4/f6 [4174692,15399] 0 2024-09-20T18:35:49.625 INFO:tasks.workunit.client.1.smithi172.stdout:0/890: rename d4/d1a/l90 to d4/d1a/d28/d42/d45/d99/de9/d116/l139 0 2024-09-20T18:35:49.626 INFO:tasks.workunit.client.0.smithi017.stdout:4/162: dwrite d4/dc/f12 [4194304,4194304] 0 2024-09-20T18:35:49.627 INFO:tasks.workunit.client.0.smithi017.stdout:4/163: dread - d4/dc/d1e/d26/d22/f2d zero size 2024-09-20T18:35:49.627 INFO:tasks.workunit.client.0.smithi017.stdout:5/170: rename d0/d14/f17 to d0/d14/d18/d1b/f31 0 2024-09-20T18:35:49.628 INFO:tasks.workunit.client.0.smithi017.stdout:4/164: chown d4/dc/d1e/d26/l20 142296617 1 2024-09-20T18:35:49.630 INFO:tasks.workunit.client.1.smithi172.stdout:9/678: write d15/d1f/d2c/d37/f63 [610274,105083] 0 2024-09-20T18:35:49.631 INFO:tasks.workunit.client.1.smithi172.stdout:6/628: symlink d0/d18/daf/lcd 0 2024-09-20T18:35:49.631 INFO:tasks.workunit.client.1.smithi172.stdout:0/891: dwrite d4/f7e [0,4194304] 0 2024-09-20T18:35:49.633 INFO:tasks.workunit.client.1.smithi172.stdout:9/679: write f6 [462689,64150] 0 2024-09-20T18:35:49.634 INFO:tasks.workunit.client.0.smithi017.stdout:5/171: dwrite d0/d14/f20 [0,4194304] 0 2024-09-20T18:35:49.635 INFO:tasks.workunit.client.1.smithi172.stdout:5/740: mknod d4/cf3 0 2024-09-20T18:35:49.640 INFO:tasks.workunit.client.0.smithi017.stdout:0/170: mkdir d4/d20/d38 0 2024-09-20T18:35:49.644 INFO:tasks.workunit.client.0.smithi017.stdout:4/165: creat d4/de/d1b/f33 x:0 0 0 2024-09-20T18:35:49.645 INFO:tasks.workunit.client.1.smithi172.stdout:8/693: mknod dd/d1b/d3b/d51/dac/cf0 0 2024-09-20T18:35:49.645 INFO:tasks.workunit.client.1.smithi172.stdout:2/644: dwrite d0/d2c/d3f/dab/d22/d10/d35/d5d/f5f [4194304,4194304] 0 2024-09-20T18:35:49.648 INFO:tasks.workunit.client.0.smithi017.stdout:5/172: rmdir d0/d14/d18/d1b 39 2024-09-20T18:35:49.648 INFO:tasks.workunit.client.1.smithi172.stdout:2/645: chown d0/d2c/d3f/dab/d45/lac 1227 1 2024-09-20T18:35:49.652 INFO:tasks.workunit.client.1.smithi172.stdout:9/680: unlink d15/d1a/fbb 0 2024-09-20T18:35:49.653 INFO:tasks.workunit.client.1.smithi172.stdout:3/783: dread d0/dc/d6a/d22/f99 [0,4194304] 0 2024-09-20T18:35:49.653 INFO:tasks.workunit.client.0.smithi017.stdout:1/89: getdents df/d16 0 2024-09-20T18:35:49.653 INFO:tasks.workunit.client.1.smithi172.stdout:6/629: mknod d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/cce 0 2024-09-20T18:35:49.654 INFO:tasks.workunit.client.1.smithi172.stdout:2/646: chown d0/d2c/d3f/dab/d22/d10/d3c/d7b/fa1 1894021432 1 2024-09-20T18:35:49.655 INFO:tasks.workunit.client.1.smithi172.stdout:3/784: chown d0/dc/d6a/dc5/feb 462129 1 2024-09-20T18:35:49.656 INFO:tasks.workunit.client.0.smithi017.stdout:4/166: unlink d4/dc/d1e/d26/d22/f2d 0 2024-09-20T18:35:49.657 INFO:tasks.workunit.client.1.smithi172.stdout:0/892: dread d4/d5/d2e/d38/d96/f9f [0,4194304] 0 2024-09-20T18:35:49.658 INFO:tasks.workunit.client.1.smithi172.stdout:6/630: dread d0/d18/d1c/d21/d26/d34/d39/f64 [0,4194304] 0 2024-09-20T18:35:49.659 INFO:tasks.workunit.client.1.smithi172.stdout:0/893: dread - d4/d5/d2e/d33/f11a zero size 2024-09-20T18:35:49.659 INFO:tasks.workunit.client.0.smithi017.stdout:5/173: mknod d0/d14/d18/d19/c32 0 2024-09-20T18:35:49.660 INFO:tasks.workunit.client.1.smithi172.stdout:0/894: write d4/d1a/d28/d75/f8d [4158625,97936] 0 2024-09-20T18:35:49.660 INFO:tasks.workunit.client.1.smithi172.stdout:6/631: stat d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0/dad/cb1 0 2024-09-20T18:35:49.662 INFO:tasks.workunit.client.0.smithi017.stdout:0/171: mknod d4/db/c39 0 2024-09-20T18:35:49.664 INFO:tasks.workunit.client.0.smithi017.stdout:1/90: creat df/f1a x:0 0 0 2024-09-20T18:35:49.664 INFO:tasks.workunit.client.0.smithi017.stdout:1/91: dread - df/f1a zero size 2024-09-20T18:35:49.665 INFO:tasks.workunit.client.1.smithi172.stdout:8/694: truncate dd/d1b/d3b/d51/d5b/daf/d4d/f90 746018 0 2024-09-20T18:35:49.665 INFO:tasks.workunit.client.1.smithi172.stdout:8/695: chown dd/d1b 1723221399 1 2024-09-20T18:35:49.667 INFO:tasks.workunit.client.1.smithi172.stdout:5/741: mkdir d4/df/d3f/df4 0 2024-09-20T18:35:49.669 INFO:tasks.workunit.client.1.smithi172.stdout:9/681: symlink d15/d1f/d2c/d7d/d34/le1 0 2024-09-20T18:35:49.669 INFO:tasks.workunit.client.1.smithi172.stdout:9/682: readlink d15/d54/lb0 0 2024-09-20T18:35:49.674 INFO:tasks.workunit.client.1.smithi172.stdout:4/743: sync 2024-09-20T18:35:49.675 INFO:tasks.workunit.client.1.smithi172.stdout:1/694: write d0/d8/db/fa5 [310622,629] 0 2024-09-20T18:35:49.676 INFO:tasks.workunit.client.1.smithi172.stdout:7/767: getdents d2 0 2024-09-20T18:35:49.678 INFO:tasks.workunit.client.1.smithi172.stdout:0/895: unlink d4/d1a/d28/d42/f81 0 2024-09-20T18:35:49.682 INFO:tasks.workunit.client.1.smithi172.stdout:9/683: truncate f14 2931305 0 2024-09-20T18:35:49.686 INFO:tasks.workunit.client.1.smithi172.stdout:4/744: rename d0/d7/ldb to d0/d48/l108 0 2024-09-20T18:35:49.687 INFO:tasks.workunit.client.1.smithi172.stdout:9/684: dwrite d15/d1f/d2c/d7d/d48/f79 [0,4194304] 0 2024-09-20T18:35:49.688 INFO:tasks.workunit.client.1.smithi172.stdout:4/745: truncate d0/de/fcc 111046 0 2024-09-20T18:35:49.688 INFO:tasks.workunit.client.1.smithi172.stdout:7/768: rmdir d2/d3/d10/d40/d6a/dc6 39 2024-09-20T18:35:49.690 INFO:tasks.workunit.client.1.smithi172.stdout:4/746: readlink d0/d48/d90/d55/d53/d78/l7e 0 2024-09-20T18:35:49.690 INFO:tasks.workunit.client.1.smithi172.stdout:0/896: chown d4/d5/d2e/d8e 470140083 1 2024-09-20T18:35:49.690 INFO:tasks.workunit.client.1.smithi172.stdout:4/747: stat d0/de/d21/d24/f69 0 2024-09-20T18:35:49.691 INFO:tasks.workunit.client.1.smithi172.stdout:2/647: creat d0/fd9 x:0 0 0 2024-09-20T18:35:49.692 INFO:tasks.workunit.client.1.smithi172.stdout:2/648: chown d0/d2c/d3f/dab/d22/d10/d35/d5d/f5f 12 1 2024-09-20T18:35:49.695 INFO:tasks.workunit.client.1.smithi172.stdout:3/785: rmdir d0/d13/d108 0 2024-09-20T18:35:49.695 INFO:tasks.workunit.client.0.smithi017.stdout:0/172: rmdir d4/db/d1e/d24 39 2024-09-20T18:35:49.695 INFO:tasks.workunit.client.0.smithi017.stdout:1/92: symlink df/l1b 0 2024-09-20T18:35:49.696 INFO:tasks.workunit.client.1.smithi172.stdout:3/786: write d0/d13/d1e/f46 [1385312,42467] 0 2024-09-20T18:35:49.697 INFO:tasks.workunit.client.1.smithi172.stdout:3/787: write d0/dc/d6a/d22/fbd [2945980,119888] 0 2024-09-20T18:35:49.700 INFO:tasks.workunit.client.0.smithi017.stdout:5/174: mknod d0/c33 0 2024-09-20T18:35:49.701 INFO:tasks.workunit.client.0.smithi017.stdout:7/203: dwrite da/f1a [0,4194304] 0 2024-09-20T18:35:49.706 INFO:tasks.workunit.client.0.smithi017.stdout:4/167: write d4/fa [1501995,53418] 0 2024-09-20T18:35:49.707 INFO:tasks.workunit.client.1.smithi172.stdout:0/897: dread - d4/d1a/d28/d42/fde zero size 2024-09-20T18:35:49.708 INFO:tasks.workunit.client.0.smithi017.stdout:4/168: write d4/d19/f15 [2766755,107863] 0 2024-09-20T18:35:49.710 INFO:tasks.workunit.client.1.smithi172.stdout:4/748: creat d0/d48/d90/d55/f109 x:0 0 0 2024-09-20T18:35:49.711 INFO:tasks.workunit.client.0.smithi017.stdout:7/204: symlink da/d16/l41 0 2024-09-20T18:35:49.712 INFO:tasks.workunit.client.0.smithi017.stdout:7/205: read da/d16/d1c/f1f [3119258,117816] 0 2024-09-20T18:35:49.714 INFO:tasks.workunit.client.0.smithi017.stdout:1/93: getdents df/d16 0 2024-09-20T18:35:49.715 INFO:tasks.workunit.client.0.smithi017.stdout:1/94: write df/f10 [711676,114085] 0 2024-09-20T18:35:49.716 INFO:tasks.workunit.client.0.smithi017.stdout:1/95: write df/f1a [1003494,69616] 0 2024-09-20T18:35:49.716 INFO:tasks.workunit.client.0.smithi017.stdout:0/173: creat d4/d37/f3a x:0 0 0 2024-09-20T18:35:49.717 INFO:tasks.workunit.client.0.smithi017.stdout:0/174: stat d4/db/d1e 0 2024-09-20T18:35:49.719 INFO:tasks.workunit.client.1.smithi172.stdout:3/788: truncate d0/dc/fd1 2111241 0 2024-09-20T18:35:49.719 INFO:tasks.workunit.client.0.smithi017.stdout:0/175: truncate d4/d37/f3a 477922 0 2024-09-20T18:35:49.719 INFO:tasks.workunit.client.1.smithi172.stdout:8/696: dwrite dd/d65/f7f [0,4194304] 0 2024-09-20T18:35:49.720 INFO:tasks.workunit.client.0.smithi017.stdout:5/175: symlink d0/d14/d18/l34 0 2024-09-20T18:35:49.721 INFO:tasks.workunit.client.1.smithi172.stdout:5/742: dwrite d4/df/dad/d26/d41/d69/dac/d2c/f35 [0,4194304] 0 2024-09-20T18:35:49.722 INFO:tasks.workunit.client.1.smithi172.stdout:5/743: stat d4/df/dad/d26/d41/d69/dac/d2c/f5c 0 2024-09-20T18:35:49.723 INFO:tasks.workunit.client.0.smithi017.stdout:1/96: dwrite df/f11 [0,4194304] 0 2024-09-20T18:35:49.725 INFO:tasks.workunit.client.1.smithi172.stdout:6/632: getdents d0/d18/d1c/d21/d26/d34/d7a 0 2024-09-20T18:35:49.725 INFO:tasks.workunit.client.0.smithi017.stdout:1/97: write f3 [1802391,88090] 0 2024-09-20T18:35:49.725 INFO:tasks.workunit.client.1.smithi172.stdout:6/633: chown d0/f6d 16134 1 2024-09-20T18:35:49.732 INFO:tasks.workunit.client.1.smithi172.stdout:2/649: write d0/d2c/d3f/dab/d18/d29/f41 [549398,28232] 0 2024-09-20T18:35:49.733 INFO:tasks.workunit.client.1.smithi172.stdout:9/685: dwrite d15/d1f/d2c/d37/f44 [0,4194304] 0 2024-09-20T18:35:49.734 INFO:tasks.workunit.client.0.smithi017.stdout:5/176: write d0/d14/f28 [17793237,2938] 0 2024-09-20T18:35:49.736 INFO:tasks.workunit.client.1.smithi172.stdout:4/749: symlink d0/d48/d90/d55/d101/d18/l10a 0 2024-09-20T18:35:49.740 INFO:tasks.workunit.client.1.smithi172.stdout:1/695: getdents d0/d8/d12/d96 0 2024-09-20T18:35:49.741 INFO:tasks.workunit.client.1.smithi172.stdout:1/696: chown d0/d73/l74 358912 1 2024-09-20T18:35:49.743 INFO:tasks.workunit.client.1.smithi172.stdout:8/697: mkdir dd/d1b/d3b/d51/d5b/dc5/df1 0 2024-09-20T18:35:49.744 INFO:tasks.workunit.client.1.smithi172.stdout:8/698: truncate dd/d65/fb6 2139148 0 2024-09-20T18:35:49.744 INFO:tasks.workunit.client.0.smithi017.stdout:0/176: creat d4/db/f3b x:0 0 0 2024-09-20T18:35:49.745 INFO:tasks.workunit.client.1.smithi172.stdout:7/769: link d2/f54 d2/d3/d10/d40/d6a/dc6/dd8/f109 0 2024-09-20T18:35:49.747 INFO:tasks.workunit.client.1.smithi172.stdout:3/789: dread d0/d13/d32/f8a [0,4194304] 0 2024-09-20T18:35:49.747 INFO:tasks.workunit.client.0.smithi017.stdout:1/98: getdents df 0 2024-09-20T18:35:49.748 INFO:tasks.workunit.client.1.smithi172.stdout:9/686: creat d15/d1a/d6f/d7a/fe2 x:0 0 0 2024-09-20T18:35:49.750 INFO:tasks.workunit.client.1.smithi172.stdout:1/697: read d0/d8/d5f/fa9 [3471091,130764] 0 2024-09-20T18:35:49.750 INFO:tasks.workunit.client.0.smithi017.stdout:0/177: unlink d4/db/f1c 0 2024-09-20T18:35:49.754 INFO:tasks.workunit.client.1.smithi172.stdout:9/687: dwrite d15/d1f/d2c/d37/fb7 [0,4194304] 0 2024-09-20T18:35:49.754 INFO:tasks.workunit.client.0.smithi017.stdout:1/99: unlink df/d16/c17 0 2024-09-20T18:35:49.757 INFO:tasks.workunit.client.0.smithi017.stdout:5/177: link d0/d14/d18/d1b/l2d d0/d13/l35 0 2024-09-20T18:35:49.758 INFO:tasks.workunit.client.1.smithi172.stdout:5/744: symlink d4/df/dad/d26/d41/d69/dac/da7/dd8/lf5 0 2024-09-20T18:35:49.761 INFO:tasks.workunit.client.1.smithi172.stdout:4/750: dread d0/de/d39/f9b [0,4194304] 0 2024-09-20T18:35:49.761 INFO:tasks.workunit.client.1.smithi172.stdout:6/634: link d0/d18/d1c/d21/d26/f45 d0/d18/d1c/d21/d26/d34/d7a/d47/d7b/fcf 0 2024-09-20T18:35:49.761 INFO:tasks.workunit.client.1.smithi172.stdout:9/688: dwrite d15/d1f/d88/f98 [0,4194304] 0 2024-09-20T18:35:49.763 INFO:tasks.workunit.client.1.smithi172.stdout:9/689: chown d15/f1b 28120 1 2024-09-20T18:35:49.763 INFO:tasks.workunit.client.1.smithi172.stdout:0/898: symlink d4/d5/d2e/d67/d8c/d103/l13a 0 2024-09-20T18:35:49.765 INFO:tasks.workunit.client.0.smithi017.stdout:0/178: dread d4/db/d18/f19 [0,4194304] 0 2024-09-20T18:35:49.766 INFO:tasks.workunit.client.0.smithi017.stdout:4/169: truncate d4/de/f27 1566677 0 2024-09-20T18:35:49.769 INFO:tasks.workunit.client.0.smithi017.stdout:5/178: mknod d0/d14/d18/c36 0 2024-09-20T18:35:49.770 INFO:tasks.workunit.client.1.smithi172.stdout:7/770: dread d2/d3/f45 [0,4194304] 0 2024-09-20T18:35:49.775 INFO:tasks.workunit.client.0.smithi017.stdout:5/179: creat d0/d14/d18/d2a/f37 x:0 0 0 2024-09-20T18:35:49.776 INFO:tasks.workunit.client.0.smithi017.stdout:4/170: dwrite d4/dc/d1e/d26/d22/f17 [0,4194304] 0 2024-09-20T18:35:49.777 INFO:tasks.workunit.client.1.smithi172.stdout:8/699: unlink dd/ca3 0 2024-09-20T18:35:49.777 INFO:tasks.workunit.client.0.smithi017.stdout:5/180: chown d0/d13/f22 99 1 2024-09-20T18:35:49.778 INFO:tasks.workunit.client.0.smithi017.stdout:5/181: read d0/d14/f28 [5712137,28694] 0 2024-09-20T18:35:49.783 INFO:tasks.workunit.client.0.smithi017.stdout:4/171: dwrite d4/d19/f1f [0,4194304] 0 2024-09-20T18:35:49.788 INFO:tasks.workunit.client.1.smithi172.stdout:6/635: dwrite d0/d18/f29 [0,4194304] 0 2024-09-20T18:35:49.788 INFO:tasks.workunit.client.1.smithi172.stdout:0/899: creat d4/d1a/d28/d73/f13b x:0 0 0 2024-09-20T18:35:49.789 INFO:tasks.workunit.client.0.smithi017.stdout:4/172: dread d4/f7 [0,4194304] 0 2024-09-20T18:35:49.790 INFO:tasks.workunit.client.1.smithi172.stdout:0/900: dread d4/d1a/d28/d9d/f104 [0,4194304] 0 2024-09-20T18:35:49.793 INFO:tasks.workunit.client.0.smithi017.stdout:1/100: truncate f3 2088770 0 2024-09-20T18:35:49.800 INFO:tasks.workunit.client.1.smithi172.stdout:2/650: rename d0/d2c/d3f/dab/d18/f32 to d0/d2c/d3f/dab/d22/fda 0 2024-09-20T18:35:49.804 INFO:tasks.workunit.client.1.smithi172.stdout:5/745: mknod d4/df/dad/d26/d41/cf6 0 2024-09-20T18:35:49.807 INFO:tasks.workunit.client.0.smithi017.stdout:5/182: creat d0/d14/d18/f38 x:0 0 0 2024-09-20T18:35:49.812 INFO:tasks.workunit.client.0.smithi017.stdout:1/101: dwrite df/f18 [0,4194304] 0 2024-09-20T18:35:49.813 INFO:tasks.workunit.client.1.smithi172.stdout:7/771: dread d2/d3/d3d/d4e/f5d [0,4194304] 0 2024-09-20T18:35:49.814 INFO:tasks.workunit.client.1.smithi172.stdout:7/772: chown d2/d3/d10/d40/d46/dd2 2241 1 2024-09-20T18:35:49.816 INFO:tasks.workunit.client.1.smithi172.stdout:1/698: link d0/d8/db/d25/d2b/fb3 d0/d8/db/d25/fe3 0 2024-09-20T18:35:49.818 INFO:tasks.workunit.client.0.smithi017.stdout:5/183: unlink d0/d14/d18/d1b/c1c 0 2024-09-20T18:35:49.819 INFO:tasks.workunit.client.1.smithi172.stdout:8/700: write dd/d1b/f33 [1172012,7211] 0 2024-09-20T18:35:49.822 INFO:tasks.workunit.client.1.smithi172.stdout:9/690: rename d15/d4a/la8 to d15/d1f/d2c/d7d/d48/le3 0 2024-09-20T18:35:49.822 INFO:tasks.workunit.client.1.smithi172.stdout:9/691: stat d15/d54/lb0 0 2024-09-20T18:35:49.823 INFO:tasks.workunit.client.1.smithi172.stdout:2/651: dread d0/d2c/d3f/dab/d22/d10/d35/fa5 [0,4194304] 0 2024-09-20T18:35:49.823 INFO:tasks.workunit.client.1.smithi172.stdout:3/790: sync 2024-09-20T18:35:49.824 INFO:tasks.workunit.client.1.smithi172.stdout:4/751: truncate d0/f2a 361302 0 2024-09-20T18:35:49.824 INFO:tasks.workunit.client.1.smithi172.stdout:3/791: chown d0/d13/d58/d6d/f77 1 1 2024-09-20T18:35:49.825 INFO:tasks.workunit.client.1.smithi172.stdout:3/792: fdatasync d0/d13/d32/d54/d71/f104 0 2024-09-20T18:35:49.826 INFO:tasks.workunit.client.0.smithi017.stdout:5/184: mkdir d0/d14/d18/d2a/d39 0 2024-09-20T18:35:49.829 INFO:tasks.workunit.client.0.smithi017.stdout:5/185: readlink d0/d13/l35 0 2024-09-20T18:35:49.830 INFO:tasks.workunit.client.0.smithi017.stdout:5/186: write d0/d14/f20 [4282366,25805] 0 2024-09-20T18:35:49.831 INFO:tasks.workunit.client.1.smithi172.stdout:0/901: dwrite d4/d1a/d28/d42/d45/d54/f89 [0,4194304] 0 2024-09-20T18:35:49.831 INFO:tasks.workunit.client.1.smithi172.stdout:1/699: mknod d0/d8/db/d25/d2b/d3d/d65/ce4 0 2024-09-20T18:35:49.836 INFO:tasks.workunit.client.0.smithi017.stdout:1/102: fdatasync f3 0 2024-09-20T18:35:49.839 INFO:tasks.workunit.client.1.smithi172.stdout:6/636: rename d0/d18/d1c/d21/d26/d34/d7a/c8e to d0/d18/d1c/d21/d26/d79/cd0 0 2024-09-20T18:35:49.840 INFO:tasks.workunit.client.1.smithi172.stdout:8/701: dread dd/d1b/d3b/d51/d5b/daf/f4b [0,4194304] 0 2024-09-20T18:35:49.841 INFO:tasks.workunit.client.1.smithi172.stdout:8/702: stat dd/d1b/d4f/d86/dbc 0 2024-09-20T18:35:49.843 INFO:tasks.workunit.client.1.smithi172.stdout:9/692: symlink d15/d1a/d64/le4 0 2024-09-20T18:35:49.843 INFO:tasks.workunit.client.1.smithi172.stdout:9/693: chown d15/d54/f60 320 1 2024-09-20T18:35:49.844 INFO:tasks.workunit.client.0.smithi017.stdout:1/103: dwrite df/f18 [0,4194304] 0 2024-09-20T18:35:49.844 INFO:tasks.workunit.client.1.smithi172.stdout:2/652: rmdir d0/d2c/d3f 39 2024-09-20T18:35:49.845 INFO:tasks.workunit.client.0.smithi017.stdout:4/173: truncate d4/dc/f12 1991326 0 2024-09-20T18:35:49.852 INFO:tasks.workunit.client.0.smithi017.stdout:1/104: dwrite df/f10 [0,4194304] 0 2024-09-20T18:35:49.853 INFO:tasks.workunit.client.0.smithi017.stdout:4/174: mknod d4/d19/c34 0 2024-09-20T18:35:49.855 INFO:tasks.workunit.client.1.smithi172.stdout:7/773: mknod d2/d3/d3d/d68/dc8/c10a 0 2024-09-20T18:35:49.857 INFO:tasks.workunit.client.0.smithi017.stdout:5/187: link d0/d14/d18/d2a/l2b d0/d14/l3a 0 2024-09-20T18:35:49.859 INFO:tasks.workunit.client.0.smithi017.stdout:4/175: dread d4/de/d1b/f2f [0,4194304] 0 2024-09-20T18:35:49.860 INFO:tasks.workunit.client.1.smithi172.stdout:1/700: write d0/d8/db/f1b [5788134,7489] 0 2024-09-20T18:35:49.861 INFO:tasks.workunit.client.1.smithi172.stdout:1/701: chown d0/d8/db/l69 1835 1 2024-09-20T18:35:49.861 INFO:tasks.workunit.client.1.smithi172.stdout:0/902: mknod d4/d5/d2e/d38/d96/c13c 0 2024-09-20T18:35:49.862 INFO:tasks.workunit.client.0.smithi017.stdout:1/105: dwrite df/f1a [0,4194304] 0 2024-09-20T18:35:49.862 INFO:tasks.workunit.client.1.smithi172.stdout:1/702: dread d0/d8/db/d25/d2b/d3d/d65/f66 [0,4194304] 0 2024-09-20T18:35:49.863 INFO:tasks.workunit.client.0.smithi017.stdout:4/176: write d4/dc/d1e/d26/d22/f21 [2474607,42372] 0 2024-09-20T18:35:49.864 INFO:tasks.workunit.client.0.smithi017.stdout:4/177: fdatasync d4/dc/d1e/d26/d22/f17 0 2024-09-20T18:35:49.867 INFO:tasks.workunit.client.1.smithi172.stdout:5/746: rename d4/df/dad/d26/d2d/c5e to d4/df/dad/d26/d2d/d63/d80/dd7/cf7 0 2024-09-20T18:35:49.867 INFO:tasks.workunit.client.1.smithi172.stdout:4/752: dwrite d0/d48/d90/d55/f8c [0,4194304] 0 2024-09-20T18:35:49.871 INFO:tasks.workunit.client.1.smithi172.stdout:2/653: readlink d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/ld6 0 2024-09-20T18:35:49.872 INFO:tasks.workunit.client.0.smithi017.stdout:4/178: dwrite d4/d19/f30 [0,4194304] 0 2024-09-20T18:35:49.872 INFO:tasks.workunit.client.1.smithi172.stdout:9/694: truncate d15/d1f/d2c/d7d/d48/f4f 2159160 0 2024-09-20T18:35:49.873 INFO:tasks.workunit.client.0.smithi017.stdout:4/179: stat d4/dc/d1e/f18 0 2024-09-20T18:35:49.874 INFO:tasks.workunit.client.0.smithi017.stdout:4/180: chown d4/d19/c34 421294412 1 2024-09-20T18:35:49.874 INFO:tasks.workunit.client.1.smithi172.stdout:3/793: creat d0/d13/d58/d6d/db9/dd6/d101/f10e x:0 0 0 2024-09-20T18:35:49.876 INFO:tasks.workunit.client.0.smithi017.stdout:5/188: creat d0/d14/d18/f3b x:0 0 0 2024-09-20T18:35:49.877 INFO:tasks.workunit.client.0.smithi017.stdout:5/189: readlink d0/d14/d18/l1d 0 2024-09-20T18:35:49.878 INFO:tasks.workunit.client.0.smithi017.stdout:4/181: creat d4/d19/f35 x:0 0 0 2024-09-20T18:35:49.880 INFO:tasks.workunit.client.0.smithi017.stdout:5/190: truncate d0/d14/d18/f38 247746 0 2024-09-20T18:35:49.881 INFO:tasks.workunit.client.1.smithi172.stdout:6/637: creat d0/d18/d1c/d21/d26/db7/fd1 x:0 0 0 2024-09-20T18:35:49.882 INFO:tasks.workunit.client.1.smithi172.stdout:4/753: fsync d0/f71 0 2024-09-20T18:35:49.883 INFO:tasks.workunit.client.1.smithi172.stdout:4/754: fsync d0/de/d39/f73 0 2024-09-20T18:35:49.884 INFO:tasks.workunit.client.1.smithi172.stdout:5/747: creat d4/df/dad/d26/d2d/d86/ff8 x:0 0 0 2024-09-20T18:35:49.884 INFO:tasks.workunit.client.1.smithi172.stdout:4/755: stat d0/d7/fba 0 2024-09-20T18:35:49.885 INFO:tasks.workunit.client.1.smithi172.stdout:2/654: symlink d0/d2c/d51/ldb 0 2024-09-20T18:35:49.885 INFO:tasks.workunit.client.1.smithi172.stdout:5/748: dread - d4/df/dad/d26/d2d/d63/d80/dd7/fdf zero size 2024-09-20T18:35:49.886 INFO:tasks.workunit.client.1.smithi172.stdout:5/749: chown d4/df/dad/d26/ccb 143 1 2024-09-20T18:35:49.887 INFO:tasks.workunit.client.1.smithi172.stdout:9/695: unlink d15/d1a/l23 0 2024-09-20T18:35:49.887 INFO:tasks.workunit.client.1.smithi172.stdout:5/750: dread - d4/df/d98/fc1 zero size 2024-09-20T18:35:49.887 INFO:tasks.workunit.client.1.smithi172.stdout:9/696: fsync d15/d4a/f96 0 2024-09-20T18:35:49.888 INFO:tasks.workunit.client.1.smithi172.stdout:9/697: dread - d15/d20/fcf zero size 2024-09-20T18:35:49.888 INFO:tasks.workunit.client.0.smithi017.stdout:5/191: dwrite d0/d14/d18/d2a/f37 [0,4194304] 0 2024-09-20T18:35:49.889 INFO:tasks.workunit.client.1.smithi172.stdout:5/751: fsync d4/df/dad/d26/d41/f9e 0 2024-09-20T18:35:49.894 INFO:tasks.workunit.client.0.smithi017.stdout:5/192: mknod d0/d14/d18/d1b/c3c 0 2024-09-20T18:35:49.896 INFO:tasks.workunit.client.0.smithi017.stdout:5/193: dread d0/d14/d18/f38 [0,4194304] 0 2024-09-20T18:35:49.898 INFO:tasks.workunit.client.1.smithi172.stdout:6/638: rename d0/d18/f1e to d0/d18/d1c/d21/d26/d34/d39/d46/fd2 0 2024-09-20T18:35:49.900 INFO:tasks.workunit.client.1.smithi172.stdout:4/756: symlink d0/d48/d90/d55/d53/d5c/l10b 0 2024-09-20T18:35:49.902 INFO:tasks.workunit.client.0.smithi017.stdout:5/194: creat d0/d14/d18/d1b/f3d x:0 0 0 2024-09-20T18:35:49.904 INFO:tasks.workunit.client.1.smithi172.stdout:2/655: mkdir d0/d2c/d3f/dab/d45/ddc 0 2024-09-20T18:35:49.904 INFO:tasks.workunit.client.1.smithi172.stdout:2/656: chown d0/d2c/d3f/dab/d22/d10/d3c/d7b/d9d 781161 1 2024-09-20T18:35:49.905 INFO:tasks.workunit.client.1.smithi172.stdout:2/657: dread - d0/d2c/d3f/dab/d18/d29/fd8 zero size 2024-09-20T18:35:49.910 INFO:tasks.workunit.client.0.smithi017.stdout:4/182: truncate d4/d19/f1f 1896978 0 2024-09-20T18:35:49.911 INFO:tasks.workunit.client.0.smithi017.stdout:4/183: readlink d4/l5 0 2024-09-20T18:35:49.911 INFO:tasks.workunit.client.1.smithi172.stdout:1/703: creat d0/d8/db/d25/d2b/d3d/d65/d93/fe5 x:0 0 0 2024-09-20T18:35:49.915 INFO:tasks.workunit.client.0.smithi017.stdout:5/195: getdents d0/d14/d18 0 2024-09-20T18:35:49.915 INFO:tasks.workunit.client.0.smithi017.stdout:5/196: readlink d0/l9 0 2024-09-20T18:35:49.923 INFO:tasks.workunit.client.0.smithi017.stdout:4/184: fdatasync d4/de/f27 0 2024-09-20T18:35:49.924 INFO:tasks.workunit.client.1.smithi172.stdout:4/757: creat d0/de/d39/d9f/f10c x:0 0 0 2024-09-20T18:35:49.926 INFO:tasks.workunit.client.0.smithi017.stdout:5/197: mkdir d0/d14/d18/d3e 0 2024-09-20T18:35:49.929 INFO:tasks.workunit.client.1.smithi172.stdout:0/903: getdents d4/d5/d2e/d33/de1/dac/dbc 0 2024-09-20T18:35:49.930 INFO:tasks.workunit.client.1.smithi172.stdout:4/758: dwrite d0/de/d21/d24/f69 [0,4194304] 0 2024-09-20T18:35:49.934 INFO:tasks.workunit.client.1.smithi172.stdout:5/752: dwrite d4/df/dad/d26/d41/fa6 [0,4194304] 0 2024-09-20T18:35:49.936 INFO:tasks.workunit.client.1.smithi172.stdout:6/639: write d0/f5 [3611245,66971] 0 2024-09-20T18:35:49.937 INFO:tasks.workunit.client.1.smithi172.stdout:3/794: link d0/dc/d6a/f3e d0/d13/db2/f10f 0 2024-09-20T18:35:49.939 INFO:tasks.workunit.client.1.smithi172.stdout:5/753: fdatasync d4/df/dad/d26/d41/d69/dac/d2c/fef 0 2024-09-20T18:35:49.941 INFO:tasks.workunit.client.1.smithi172.stdout:4/759: rename d0/l36 to d0/d7/d6f/l10d 0 2024-09-20T18:35:49.941 INFO:tasks.workunit.client.1.smithi172.stdout:3/795: chown d0/dc/d6a/dc5/feb 248736 1 2024-09-20T18:35:49.942 INFO:tasks.workunit.client.1.smithi172.stdout:3/796: fdatasync d0/d13/d1e/f46 0 2024-09-20T18:35:49.943 INFO:tasks.workunit.client.1.smithi172.stdout:2/658: write d0/d2c/d3f/dab/d22/d4c/f99 [465600,7819] 0 2024-09-20T18:35:49.949 INFO:tasks.workunit.client.0.smithi017.stdout:5/198: unlink d0/d14/d18/l34 0 2024-09-20T18:35:49.949 INFO:tasks.workunit.client.1.smithi172.stdout:5/754: creat d4/df/dad/dd4/ff9 x:0 0 0 2024-09-20T18:35:49.950 INFO:tasks.workunit.client.1.smithi172.stdout:4/760: rmdir d0/d48/d90/d55/d53 39 2024-09-20T18:35:49.951 INFO:tasks.workunit.client.1.smithi172.stdout:4/761: fsync d0/d48/d90/dea/ff1 0 2024-09-20T18:35:49.952 INFO:tasks.workunit.client.1.smithi172.stdout:1/704: symlink d0/d8/db/d25/d6d/le6 0 2024-09-20T18:35:49.953 INFO:tasks.workunit.client.1.smithi172.stdout:2/659: write d0/d2c/d3f/dab/d22/d10/d3c/f6d [1232664,103116] 0 2024-09-20T18:35:49.958 INFO:tasks.workunit.client.1.smithi172.stdout:5/755: creat d4/df/dad/d26/d41/d69/dac/da7/dd8/ffa x:0 0 0 2024-09-20T18:35:49.960 INFO:tasks.workunit.client.1.smithi172.stdout:3/797: mknod d0/d13/d32/c110 0 2024-09-20T18:35:49.961 INFO:tasks.workunit.client.1.smithi172.stdout:0/904: dwrite d4/d1a/d28/d75/f3a [0,4194304] 0 2024-09-20T18:35:49.961 INFO:tasks.workunit.client.1.smithi172.stdout:1/705: creat d0/d8/db/d25/db7/fe7 x:0 0 0 2024-09-20T18:35:49.965 INFO:tasks.workunit.client.1.smithi172.stdout:5/756: mknod d4/df/dad/d26/d41/d69/dac/d2c/dd1/cfb 0 2024-09-20T18:35:49.966 INFO:tasks.workunit.client.0.smithi017.stdout:5/199: truncate d0/d14/d18/d2a/f37 3119841 0 2024-09-20T18:35:49.970 INFO:tasks.workunit.client.1.smithi172.stdout:3/798: dwrite d0/dc/d6a/d22/f7a [0,4194304] 0 2024-09-20T18:35:49.970 INFO:tasks.workunit.client.1.smithi172.stdout:6/640: dwrite d0/d18/d1c/d21/d26/d34/d7a/d47/d7b/d7e/fb2 [0,4194304] 0 2024-09-20T18:35:49.970 INFO:tasks.workunit.client.1.smithi172.stdout:2/660: symlink d0/d2c/d3f/dab/d18/d29/ldd 0 2024-09-20T18:35:49.973 INFO:tasks.workunit.client.1.smithi172.stdout:8/703: sync 2024-09-20T18:35:49.974 INFO:tasks.workunit.client.1.smithi172.stdout:8/704: dread - dd/d1b/d4f/fad zero size 2024-09-20T18:35:49.974 INFO:tasks.workunit.client.1.smithi172.stdout:0/905: rename d4/d5/d2e/d8e/feb to d4/d44/dab/f13d 0 2024-09-20T18:35:49.976 INFO:tasks.workunit.client.1.smithi172.stdout:0/906: readlink d4/d1a/d28/d42/l105 0 2024-09-20T18:35:49.977 INFO:tasks.workunit.client.0.smithi017.stdout:5/200: symlink d0/d14/d18/d2a/d39/l3f 0 2024-09-20T18:35:49.978 INFO:tasks.workunit.client.1.smithi172.stdout:3/799: truncate d0/f8 2965558 0 2024-09-20T18:35:49.982 INFO:tasks.workunit.client.1.smithi172.stdout:0/907: dread d4/d1a/d28/d75/d60/dba/d111/f120 [0,4194304] 0 2024-09-20T18:35:49.983 INFO:tasks.workunit.client.1.smithi172.stdout:6/641: mkdir d0/d18/d1c/d21/d26/d34/d7a/d47/d7b/d7e/dd3 0 2024-09-20T18:35:49.989 INFO:tasks.workunit.client.1.smithi172.stdout:1/706: creat d0/d8/db/fe8 x:0 0 0 2024-09-20T18:35:49.990 INFO:tasks.workunit.client.1.smithi172.stdout:6/642: dwrite d0/d18/d1c/d21/d26/d34/d39/d46/fb4 [0,4194304] 0 2024-09-20T18:35:49.993 INFO:tasks.workunit.client.1.smithi172.stdout:0/908: creat d4/d1a/d28/d42/d45/d54/df8/f13e x:0 0 0 2024-09-20T18:35:49.996 INFO:tasks.workunit.client.1.smithi172.stdout:0/909: dread d4/f7e [0,4194304] 0 2024-09-20T18:35:50.000 INFO:tasks.workunit.client.1.smithi172.stdout:5/757: rename d4/df/d3f/f7c to d4/df/d98/ffc 0 2024-09-20T18:35:50.005 INFO:tasks.workunit.client.1.smithi172.stdout:2/661: creat d0/d2c/d3f/dab/d22/d10/d6a/d98/fde x:0 0 0 2024-09-20T18:35:50.005 INFO:tasks.workunit.client.1.smithi172.stdout:5/758: dwrite d4/df/d3f/f9a [0,4194304] 0 2024-09-20T18:35:50.007 INFO:tasks.workunit.client.1.smithi172.stdout:0/910: symlink d4/d44/l13f 0 2024-09-20T18:35:50.010 INFO:tasks.workunit.client.1.smithi172.stdout:3/800: write d0/d13/fc8 [4306594,21368] 0 2024-09-20T18:35:50.011 INFO:tasks.workunit.client.0.smithi017.stdout:5/201: dwrite d0/d14/f28 [8388608,4194304] 0 2024-09-20T18:35:50.012 INFO:tasks.workunit.client.1.smithi172.stdout:8/705: getdents dd/d65/d85/dab 0 2024-09-20T18:35:50.013 INFO:tasks.workunit.client.1.smithi172.stdout:5/759: stat d4/df/dad/c3c 0 2024-09-20T18:35:50.014 INFO:tasks.workunit.client.1.smithi172.stdout:5/760: chown d4/df/dad/d26/d41/d69/dac/d2c/dd1 1 1 2024-09-20T18:35:50.015 INFO:tasks.workunit.client.1.smithi172.stdout:2/662: mkdir d0/d2c/d3f/dab/d22/d10/d6a/ddf 0 2024-09-20T18:35:50.017 INFO:tasks.workunit.client.0.smithi017.stdout:5/202: dread d0/d14/f28 [12582912,4194304] 0 2024-09-20T18:35:50.019 INFO:tasks.workunit.client.1.smithi172.stdout:0/911: creat d4/d1a/d28/d75/d60/f140 x:0 0 0 2024-09-20T18:35:50.024 INFO:tasks.workunit.client.0.smithi017.stdout:5/203: dread - d0/d14/d18/f3b zero size 2024-09-20T18:35:50.024 INFO:tasks.workunit.client.1.smithi172.stdout:8/706: rmdir dd/d1b/d3b/d51/d5b 39 2024-09-20T18:35:50.025 INFO:tasks.workunit.client.1.smithi172.stdout:8/707: fsync dd/d1b/d3b/d5d/fd0 0 2024-09-20T18:35:50.026 INFO:tasks.workunit.client.1.smithi172.stdout:5/761: symlink d4/df/dad/d26/d2d/d63/d80/lfd 0 2024-09-20T18:35:50.026 INFO:tasks.workunit.client.1.smithi172.stdout:0/912: fsync d4/d1a/d28/f9a 0 2024-09-20T18:35:50.027 INFO:tasks.workunit.client.1.smithi172.stdout:8/708: write dd/d1b/d4f/fcb [413110,102557] 0 2024-09-20T18:35:50.027 INFO:tasks.workunit.client.0.smithi017.stdout:5/204: mkdir d0/d14/d40 0 2024-09-20T18:35:50.028 INFO:tasks.workunit.client.1.smithi172.stdout:1/707: getdents d0/d8/db/d25/db7 0 2024-09-20T18:35:50.028 INFO:tasks.workunit.client.0.smithi017.stdout:5/205: dread - d0/d14/d18/f3b zero size 2024-09-20T18:35:50.031 INFO:tasks.workunit.client.1.smithi172.stdout:2/663: mknod d0/ce0 0 2024-09-20T18:35:50.032 INFO:tasks.workunit.client.1.smithi172.stdout:2/664: dread - d0/d2c/d3f/dab/d22/d10/d35/d5d/fbd zero size 2024-09-20T18:35:50.034 INFO:tasks.workunit.client.0.smithi017.stdout:5/206: mkdir d0/d14/d18/d19/d41 0 2024-09-20T18:35:50.036 INFO:tasks.workunit.client.1.smithi172.stdout:0/913: unlink d4/d1a/d28/d42/db8/dcd/dce/f108 0 2024-09-20T18:35:50.038 INFO:tasks.workunit.client.1.smithi172.stdout:2/665: dwrite d0/d1a/d58/f78 [4194304,4194304] 0 2024-09-20T18:35:50.041 INFO:tasks.workunit.client.1.smithi172.stdout:3/801: write d0/d13/d58/d6d/d7f/d84/fec [900751,31451] 0 2024-09-20T18:35:50.045 INFO:tasks.workunit.client.1.smithi172.stdout:0/914: truncate d4/d1a/d28/d75/f43 2567533 0 2024-09-20T18:35:50.046 INFO:tasks.workunit.client.1.smithi172.stdout:0/915: chown d4/d44/dab/fcc 8665 1 2024-09-20T18:35:50.047 INFO:tasks.workunit.client.1.smithi172.stdout:1/708: write d0/d8/f47 [560326,92339] 0 2024-09-20T18:35:50.047 INFO:tasks.workunit.client.1.smithi172.stdout:3/802: creat d0/dc/d6a/d3a/d74/f111 x:0 0 0 2024-09-20T18:35:50.048 INFO:tasks.workunit.client.1.smithi172.stdout:1/709: dread - d0/f82 zero size 2024-09-20T18:35:50.049 INFO:tasks.workunit.client.1.smithi172.stdout:2/666: unlink d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/c9c 0 2024-09-20T18:35:50.050 INFO:tasks.workunit.client.1.smithi172.stdout:2/667: chown d0/d2c/d3f/dab/d22/d4c 325428 1 2024-09-20T18:35:50.052 INFO:tasks.workunit.client.1.smithi172.stdout:0/916: rename d4/d1a/d28/d75/d60/dba/d111 to d4/d5/d2e/d38/d96/d141 0 2024-09-20T18:35:50.053 INFO:tasks.workunit.client.0.smithi017.stdout:5/207: dwrite d0/fe [4194304,4194304] 0 2024-09-20T18:35:50.053 INFO:tasks.workunit.client.1.smithi172.stdout:1/710: symlink d0/d22/le9 0 2024-09-20T18:35:50.054 INFO:tasks.workunit.client.1.smithi172.stdout:0/917: write d4/d1a/d28/d42/d45/d54/fea [3883353,106414] 0 2024-09-20T18:35:50.054 INFO:tasks.workunit.client.1.smithi172.stdout:5/762: truncate d4/f58 6509164 0 2024-09-20T18:35:50.055 INFO:tasks.workunit.client.1.smithi172.stdout:1/711: write d0/d22/f9c [423680,90118] 0 2024-09-20T18:35:50.056 INFO:tasks.workunit.client.1.smithi172.stdout:3/803: dread d0/dc/d6a/f5b [0,4194304] 0 2024-09-20T18:35:50.056 INFO:tasks.workunit.client.1.smithi172.stdout:0/918: chown d4/d94/ff1 105093 1 2024-09-20T18:35:50.057 INFO:tasks.workunit.client.1.smithi172.stdout:8/709: truncate dd/d1b/d3b/d51/d34/fb4 847875 0 2024-09-20T18:35:50.058 INFO:tasks.workunit.client.1.smithi172.stdout:3/804: readlink d0/d13/l1d 0 2024-09-20T18:35:50.061 INFO:tasks.workunit.client.1.smithi172.stdout:5/763: dread d4/df/dad/d26/d2d/d63/fc7 [0,4194304] 0 2024-09-20T18:35:50.062 INFO:tasks.workunit.client.1.smithi172.stdout:5/764: chown d4/df/dad/fc8 2 1 2024-09-20T18:35:50.063 INFO:tasks.workunit.client.1.smithi172.stdout:3/805: truncate d0/dc/f2e 1444251 0 2024-09-20T18:35:50.063 INFO:tasks.workunit.client.1.smithi172.stdout:7/774: sync 2024-09-20T18:35:50.064 INFO:tasks.workunit.client.1.smithi172.stdout:2/668: creat d0/d2c/d3f/dab/d18/d29/fe1 x:0 0 0 2024-09-20T18:35:50.064 INFO:tasks.workunit.client.1.smithi172.stdout:5/765: readlink d4/df/dad/d26/d41/l60 0 2024-09-20T18:35:50.066 INFO:tasks.workunit.client.1.smithi172.stdout:7/775: symlink d2/dcc/l10b 0 2024-09-20T18:35:50.066 INFO:tasks.workunit.client.1.smithi172.stdout:3/806: dread - d0/d13/d58/d6d/f10a zero size 2024-09-20T18:35:50.067 INFO:tasks.workunit.client.0.smithi017.stdout:5/208: dwrite d0/d14/d18/d1b/f31 [0,4194304] 0 2024-09-20T18:35:50.068 INFO:tasks.workunit.client.1.smithi172.stdout:3/807: dread - d0/dc/d6a/d3a/fdd zero size 2024-09-20T18:35:50.068 INFO:tasks.workunit.client.1.smithi172.stdout:7/776: write d2/d3/d10/d40/d74/f9e [709659,55433] 0 2024-09-20T18:35:50.069 INFO:tasks.workunit.client.1.smithi172.stdout:8/710: getdents dd/d1b/d3b/d51/d5b/dc5/df1 0 2024-09-20T18:35:50.070 INFO:tasks.workunit.client.0.smithi017.stdout:5/209: write d0/d14/d18/d1b/f2e [137127,62462] 0 2024-09-20T18:35:50.070 INFO:tasks.workunit.client.1.smithi172.stdout:8/711: dread - dd/d1b/d3b/d51/f81 zero size 2024-09-20T18:35:50.070 INFO:tasks.workunit.client.0.smithi017.stdout:5/210: fdatasync d0/d14/f20 0 2024-09-20T18:35:50.071 INFO:tasks.workunit.client.1.smithi172.stdout:1/712: link d0/d8/db/d25/db7/cc8 d0/d8/d12/cea 0 2024-09-20T18:35:50.072 INFO:tasks.workunit.client.1.smithi172.stdout:5/766: creat d4/df/dad/dd4/ffe x:0 0 0 2024-09-20T18:35:50.072 INFO:tasks.workunit.client.1.smithi172.stdout:1/713: chown d0/d8/db/d25/d2b/d3d/d65/f66 16980 1 2024-09-20T18:35:50.075 INFO:tasks.workunit.client.1.smithi172.stdout:2/669: rmdir d0/d2c/d3f/dab/d22/d10/d6a/d98/d59 39 2024-09-20T18:35:50.079 INFO:tasks.workunit.client.0.smithi017.stdout:5/211: mkdir d0/d14/d18/d2a/d39/d42 0 2024-09-20T18:35:50.080 INFO:tasks.workunit.client.0.smithi017.stdout:5/212: chown d0/d14/d18/d1b/f31 298 1 2024-09-20T18:35:50.088 INFO:tasks.workunit.client.1.smithi172.stdout:8/712: mknod dd/d1b/cf2 0 2024-09-20T18:35:50.088 INFO:tasks.workunit.client.1.smithi172.stdout:0/919: dread d4/d44/f61 [0,4194304] 0 2024-09-20T18:35:50.088 INFO:tasks.workunit.client.1.smithi172.stdout:5/767: creat d4/df/dad/d26/d41/d69/dac/d2c/fff x:0 0 0 2024-09-20T18:35:50.089 INFO:tasks.workunit.client.0.smithi017.stdout:5/213: rename d0/d14/d18/l29 to d0/d14/d18/d1b/l43 0 2024-09-20T18:35:50.089 INFO:tasks.workunit.client.0.smithi017.stdout:5/214: stat d0/d14/d18/d1b/c3c 0 2024-09-20T18:35:50.090 INFO:tasks.workunit.client.1.smithi172.stdout:0/920: truncate d4/d5/d2e/d33/de1/f12c 131991 0 2024-09-20T18:35:50.091 INFO:tasks.workunit.client.1.smithi172.stdout:5/768: stat d4/df/f74 0 2024-09-20T18:35:50.092 INFO:tasks.workunit.client.1.smithi172.stdout:0/921: truncate d4/d1a/d28/d75/d60/dba/f119 436247 0 2024-09-20T18:35:50.095 INFO:tasks.workunit.client.0.smithi017.stdout:5/215: truncate d0/d14/f20 3868646 0 2024-09-20T18:35:50.096 INFO:tasks.workunit.client.1.smithi172.stdout:2/670: getdents d0/d2c/d3f/dab/d22/d10/d35/dc4 0 2024-09-20T18:35:50.096 INFO:tasks.workunit.client.0.smithi017.stdout:5/216: dread - d0/d14/d18/d1b/f24 zero size 2024-09-20T18:35:50.097 INFO:tasks.workunit.client.1.smithi172.stdout:5/769: chown d4/df/dad/d26/d2d/dce/dd9/fe6 10497932 1 2024-09-20T18:35:50.099 INFO:tasks.workunit.client.1.smithi172.stdout:1/714: rename d0/d8/f2c to d0/feb 0 2024-09-20T18:35:50.100 INFO:tasks.workunit.client.1.smithi172.stdout:7/777: write d2/d3/dd/f7e [1653613,123852] 0 2024-09-20T18:35:50.100 INFO:tasks.workunit.client.1.smithi172.stdout:8/713: symlink dd/d1b/d3b/d51/dbd/lf3 0 2024-09-20T18:35:50.103 INFO:tasks.workunit.client.1.smithi172.stdout:0/922: fsync d4/d20/fec 0 2024-09-20T18:35:50.109 INFO:tasks.workunit.client.1.smithi172.stdout:7/778: mkdir d2/d3/d10/d40/d10c 0 2024-09-20T18:35:50.110 INFO:tasks.workunit.client.1.smithi172.stdout:2/671: mknod d0/d2c/dca/ce2 0 2024-09-20T18:35:50.112 INFO:tasks.workunit.client.1.smithi172.stdout:2/672: write d0/d2c/d3f/dab/d22/d10/d3c/d68/f73 [64894,4123] 0 2024-09-20T18:35:50.113 INFO:tasks.workunit.client.1.smithi172.stdout:0/923: mknod d4/d1a/d28/d42/db8/c142 0 2024-09-20T18:35:50.116 INFO:tasks.workunit.client.1.smithi172.stdout:1/715: mknod d0/cec 0 2024-09-20T18:35:50.117 INFO:tasks.workunit.client.1.smithi172.stdout:5/770: write d4/df/dad/d26/d41/fb6 [840082,32584] 0 2024-09-20T18:35:50.117 INFO:tasks.workunit.client.1.smithi172.stdout:1/716: chown d0/d8/c21 11013317 1 2024-09-20T18:35:50.118 INFO:tasks.workunit.client.1.smithi172.stdout:8/714: creat dd/d1b/d4f/ddd/ff4 x:0 0 0 2024-09-20T18:35:50.119 INFO:tasks.workunit.client.1.smithi172.stdout:7/779: mkdir d2/d23/d3a/d72/d10d 0 2024-09-20T18:35:50.119 INFO:tasks.workunit.client.1.smithi172.stdout:1/717: write d0/d8/d12/d96/fd4 [126648,36983] 0 2024-09-20T18:35:50.121 INFO:tasks.workunit.client.1.smithi172.stdout:2/673: symlink d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/d9f/le3 0 2024-09-20T18:35:50.122 INFO:tasks.workunit.client.1.smithi172.stdout:7/780: truncate d2/d3/d10/d40/d74/fe5 143543 0 2024-09-20T18:35:50.123 INFO:tasks.workunit.client.1.smithi172.stdout:8/715: dread dd/d65/fa8 [0,4194304] 0 2024-09-20T18:35:50.124 INFO:tasks.workunit.client.1.smithi172.stdout:5/771: unlink d4/df/dad/d26/d41/d69/dac/d2c/f35 0 2024-09-20T18:35:50.125 INFO:tasks.workunit.client.1.smithi172.stdout:8/716: write dd/da9/fd9 [54760,26616] 0 2024-09-20T18:35:50.128 INFO:tasks.workunit.client.1.smithi172.stdout:2/674: dwrite d0/d2c/d3f/fd [4194304,4194304] 0 2024-09-20T18:35:50.129 INFO:tasks.workunit.client.1.smithi172.stdout:5/772: symlink d4/df/dad/d26/d2d/dce/dd9/l100 0 2024-09-20T18:35:50.129 INFO:tasks.workunit.client.1.smithi172.stdout:9/698: sync 2024-09-20T18:35:50.129 INFO:tasks.workunit.client.1.smithi172.stdout:4/762: sync 2024-09-20T18:35:50.130 INFO:tasks.workunit.client.1.smithi172.stdout:8/717: mkdir dd/d65/df5 0 2024-09-20T18:35:50.130 INFO:tasks.workunit.client.1.smithi172.stdout:5/773: chown d4/df/dad/d26/d2d/l3b 6096 1 2024-09-20T18:35:50.130 INFO:tasks.workunit.client.1.smithi172.stdout:2/675: dread - d0/d60/f69 zero size 2024-09-20T18:35:50.131 INFO:tasks.workunit.client.1.smithi172.stdout:8/718: stat dd/d1b/d3b/d5d/f60 0 2024-09-20T18:35:50.131 INFO:tasks.workunit.client.1.smithi172.stdout:9/699: dread - d15/d1f/d2c/d7d/d48/fba zero size 2024-09-20T18:35:50.131 INFO:tasks.workunit.client.1.smithi172.stdout:7/781: rename d2/d23/d3a to d2/d23/d51/d10e 0 2024-09-20T18:35:50.132 INFO:tasks.workunit.client.1.smithi172.stdout:9/700: chown d15/fc1 5943194 1 2024-09-20T18:35:50.133 INFO:tasks.workunit.client.1.smithi172.stdout:9/701: readlink d15/d1f/d2c/d7d/l7c 0 2024-09-20T18:35:50.136 INFO:tasks.workunit.client.1.smithi172.stdout:2/676: mkdir d0/dd4/de4 0 2024-09-20T18:35:50.136 INFO:tasks.workunit.client.1.smithi172.stdout:5/774: dread d4/df/dad/d26/d41/d69/dac/d2c/f38 [0,4194304] 0 2024-09-20T18:35:50.137 INFO:tasks.workunit.client.1.smithi172.stdout:7/782: mknod d2/d3/d3d/d68/dc8/c10f 0 2024-09-20T18:35:50.138 INFO:tasks.workunit.client.1.smithi172.stdout:8/719: mkdir dd/d1b/d3b/d5d/df6 0 2024-09-20T18:35:50.139 INFO:tasks.workunit.client.1.smithi172.stdout:9/702: creat d15/d1f/d2c/d57/fe5 x:0 0 0 2024-09-20T18:35:50.140 INFO:tasks.workunit.client.1.smithi172.stdout:2/677: mkdir d0/d2c/d51/de5 0 2024-09-20T18:35:50.188 INFO:tasks.workunit.client.1.smithi172.stdout:5/775: unlink d4/df/dad/d26/d41/d69/dac/f3e 0 2024-09-20T18:35:50.188 INFO:tasks.workunit.client.1.smithi172.stdout:7/783: truncate d2/d23/d9d/fac 554147 0 2024-09-20T18:35:50.188 INFO:tasks.workunit.client.1.smithi172.stdout:9/703: mkdir d15/d1f/d2c/d7d/d48/de6 0 2024-09-20T18:35:50.191 INFO:tasks.workunit.client.0.smithi017.stdout:2/316: sync 2024-09-20T18:35:50.222 INFO:tasks.workunit.client.1.smithi172.stdout:6/643: sync 2024-09-20T18:35:50.223 INFO:tasks.workunit.client.1.smithi172.stdout:8/720: mknod dd/d1b/d3b/d5d/cf7 0 2024-09-20T18:35:50.224 INFO:tasks.workunit.client.1.smithi172.stdout:8/721: stat dd/d1b/d3b/d51/d5b/dc5/fd1 0 2024-09-20T18:35:50.226 INFO:tasks.workunit.client.1.smithi172.stdout:5/776: unlink d4/df/l31 0 2024-09-20T18:35:50.227 INFO:tasks.workunit.client.1.smithi172.stdout:5/777: chown d4/df/dad/d26/d41/d65/d8f 5 1 2024-09-20T18:35:50.227 INFO:tasks.workunit.client.1.smithi172.stdout:7/784: symlink d2/d3/d10/d40/l110 0 2024-09-20T18:35:50.229 INFO:tasks.workunit.client.1.smithi172.stdout:9/704: mknod d15/d1f/d2c/d7d/d34/db5/ce7 0 2024-09-20T18:35:50.229 INFO:tasks.workunit.client.0.smithi017.stdout:2/317: dwrite d1/df/d17/f1a [0,4194304] 0 2024-09-20T18:35:50.229 INFO:tasks.workunit.client.1.smithi172.stdout:9/705: chown d15/d1f/d2c/d37/fb7 13162193 1 2024-09-20T18:35:50.229 INFO:tasks.workunit.client.1.smithi172.stdout:6/644: mknod d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0/cd4 0 2024-09-20T18:35:50.230 INFO:tasks.workunit.client.1.smithi172.stdout:2/678: creat d0/d2c/d3f/dab/d18/d29/d42/d83/fe6 x:0 0 0 2024-09-20T18:35:50.231 INFO:tasks.workunit.client.1.smithi172.stdout:8/722: creat dd/d65/d85/dab/ff8 x:0 0 0 2024-09-20T18:35:50.231 INFO:tasks.workunit.client.1.smithi172.stdout:2/679: read - d0/d2c/d3f/dab/d18/d29/fe1 zero size 2024-09-20T18:35:50.233 INFO:tasks.workunit.client.0.smithi017.stdout:2/318: creat d1/dc/d58/d46/f68 x:0 0 0 2024-09-20T18:35:50.236 INFO:tasks.workunit.client.1.smithi172.stdout:7/785: rename d2/d23/d51/ffd to d2/de7/f111 0 2024-09-20T18:35:50.237 INFO:tasks.workunit.client.1.smithi172.stdout:9/706: creat d15/d1f/d2c/d7d/d34/fe8 x:0 0 0 2024-09-20T18:35:50.238 INFO:tasks.workunit.client.0.smithi017.stdout:2/319: rmdir d1/dc/d58/d46 39 2024-09-20T18:35:50.240 INFO:tasks.workunit.client.1.smithi172.stdout:6/645: creat d0/d18/d1c/d21/d26/d34/d7a/d47/d62/fd5 x:0 0 0 2024-09-20T18:35:50.241 INFO:tasks.workunit.client.1.smithi172.stdout:8/723: fsync dd/d1b/d3b/d51/d5b/daf/f6e 0 2024-09-20T18:35:50.243 INFO:tasks.workunit.client.1.smithi172.stdout:2/680: mkdir d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/de7 0 2024-09-20T18:35:50.244 INFO:tasks.workunit.client.0.smithi017.stdout:2/320: mknod d1/dc/d58/d53/c69 0 2024-09-20T18:35:50.245 INFO:tasks.workunit.client.0.smithi017.stdout:2/321: write d1/df/f1e [3646897,40156] 0 2024-09-20T18:35:50.246 INFO:tasks.workunit.client.1.smithi172.stdout:9/707: mknod d15/d54/ce9 0 2024-09-20T18:35:50.247 INFO:tasks.workunit.client.0.smithi017.stdout:2/322: write d1/dc/d58/d3d/f43 [372267,86739] 0 2024-09-20T18:35:50.249 INFO:tasks.workunit.client.1.smithi172.stdout:6/646: creat d0/d18/d1c/d21/d26/d34/d7a/d47/d7b/fd6 x:0 0 0 2024-09-20T18:35:50.251 INFO:tasks.workunit.client.1.smithi172.stdout:2/681: unlink d0/d2c/d3f/dab/d22/d10/d35/lb7 0 2024-09-20T18:35:50.252 INFO:tasks.workunit.client.1.smithi172.stdout:7/786: unlink d2/d3/d10/d40/d46/d8e/lba 0 2024-09-20T18:35:50.253 INFO:tasks.workunit.client.1.smithi172.stdout:7/787: chown d2/d3/d10/d40/d6a 9 1 2024-09-20T18:35:50.254 INFO:tasks.workunit.client.1.smithi172.stdout:6/647: creat d0/d18/d1c/d21/d26/fd7 x:0 0 0 2024-09-20T18:35:50.256 INFO:tasks.workunit.client.1.smithi172.stdout:5/778: rename d4/df/dad/d26/d2d to d4/df/d3f/d64/d101 0 2024-09-20T18:35:50.257 INFO:tasks.workunit.client.1.smithi172.stdout:3/808: sync 2024-09-20T18:35:50.257 INFO:tasks.workunit.client.1.smithi172.stdout:0/924: sync 2024-09-20T18:35:50.257 INFO:tasks.workunit.client.1.smithi172.stdout:2/682: mknod d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/dbb/ce8 0 2024-09-20T18:35:50.259 INFO:tasks.workunit.client.1.smithi172.stdout:8/724: creat dd/d1b/d3b/d5d/ff9 x:0 0 0 2024-09-20T18:35:50.261 INFO:tasks.workunit.client.1.smithi172.stdout:0/925: creat d4/d5/d2e/d33/f143 x:0 0 0 2024-09-20T18:35:50.262 INFO:tasks.workunit.client.1.smithi172.stdout:9/708: link d15/d1f/d2c/d7d/d58/cac d15/d1f/d2c/d7d/d34/db5/cea 0 2024-09-20T18:35:50.263 INFO:tasks.workunit.client.1.smithi172.stdout:3/809: creat d0/d13/d58/d6d/db9/dd6/d101/f112 x:0 0 0 2024-09-20T18:35:50.265 INFO:tasks.workunit.client.1.smithi172.stdout:6/648: creat d0/d18/d1c/d21/d26/d34/d7a/d47/d7b/d7e/dd3/fd8 x:0 0 0 2024-09-20T18:35:50.267 INFO:tasks.workunit.client.1.smithi172.stdout:9/709: unlink d15/d20/c32 0 2024-09-20T18:35:50.268 INFO:tasks.workunit.client.1.smithi172.stdout:3/810: symlink d0/d13/d58/d6d/db9/dd6/l113 0 2024-09-20T18:35:50.269 INFO:tasks.workunit.client.1.smithi172.stdout:7/788: dread d2/d3/d3d/dd4/fd7 [0,4194304] 0 2024-09-20T18:35:50.271 INFO:tasks.workunit.client.1.smithi172.stdout:9/710: rmdir d15/d20/d76 39 2024-09-20T18:35:50.272 INFO:tasks.workunit.client.1.smithi172.stdout:5/779: link d4/df/dad/d26/d41/d69/dac/c94 d4/df/dad/d26/d41/d69/db9/c102 0 2024-09-20T18:35:50.272 INFO:tasks.workunit.client.1.smithi172.stdout:0/926: dwrite d4/d5/d2e/d33/de1/d15/f12b [0,4194304] 0 2024-09-20T18:35:50.275 INFO:tasks.workunit.client.1.smithi172.stdout:3/811: creat d0/d13/dfe/f114 x:0 0 0 2024-09-20T18:35:50.277 INFO:tasks.workunit.client.1.smithi172.stdout:7/789: symlink d2/d23/d51/d10e/l112 0 2024-09-20T18:35:50.277 INFO:tasks.workunit.client.1.smithi172.stdout:2/683: dread d0/d2c/d3f/f30 [0,4194304] 0 2024-09-20T18:35:50.280 INFO:tasks.workunit.client.1.smithi172.stdout:0/927: unlink d4/d1a/d28/d75/f3a 0 2024-09-20T18:35:50.281 INFO:tasks.workunit.client.1.smithi172.stdout:1/718: sync 2024-09-20T18:35:50.281 INFO:tasks.workunit.client.1.smithi172.stdout:4/763: sync 2024-09-20T18:35:50.281 INFO:tasks.workunit.client.1.smithi172.stdout:6/649: rename d0/d18/d1c/d21/d26/d34/d7a/d47/d62/c8a to d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0/cd9 0 2024-09-20T18:35:50.283 INFO:tasks.workunit.client.1.smithi172.stdout:5/780: creat d4/df/dad/d26/d41/d65/d8f/f103 x:0 0 0 2024-09-20T18:35:50.284 INFO:tasks.workunit.client.1.smithi172.stdout:3/812: dwrite d0/d13/d32/d54/d71/f104 [0,4194304] 0 2024-09-20T18:35:50.284 INFO:tasks.workunit.client.1.smithi172.stdout:4/764: chown d0/de/d39/d9f/lc9 523 1 2024-09-20T18:35:50.285 INFO:tasks.workunit.client.1.smithi172.stdout:1/719: fsync d0/d8/db/d25/d2b/d3d/d65/d93/dbb/dd3/fda 0 2024-09-20T18:35:50.288 INFO:tasks.workunit.client.1.smithi172.stdout:7/790: creat d2/d3/d3d/d4e/d92/f113 x:0 0 0 2024-09-20T18:35:50.289 INFO:tasks.workunit.client.1.smithi172.stdout:1/720: write d0/d8/db/d25/d6d/d77/f9b [2293133,117217] 0 2024-09-20T18:35:50.290 INFO:tasks.workunit.client.1.smithi172.stdout:1/721: chown d0/d8/fc 18013759 1 2024-09-20T18:35:50.291 INFO:tasks.workunit.client.1.smithi172.stdout:6/650: dwrite d0/fbc [0,4194304] 0 2024-09-20T18:35:50.292 INFO:tasks.workunit.client.1.smithi172.stdout:0/928: mknod d4/d5/d2e/d67/d8c/c144 0 2024-09-20T18:35:50.292 INFO:tasks.workunit.client.1.smithi172.stdout:0/929: stat d4/c7d 0 2024-09-20T18:35:50.294 INFO:tasks.workunit.client.1.smithi172.stdout:6/651: truncate d0/d18/d1c/d21/d26/d34/d7a/d47/d7b/d7e/fb0 237909 0 2024-09-20T18:35:50.297 INFO:tasks.workunit.client.1.smithi172.stdout:9/711: getdents d15/d1a/d64/dda 0 2024-09-20T18:35:50.299 INFO:tasks.workunit.client.1.smithi172.stdout:3/813: symlink d0/d13/d32/d54/l115 0 2024-09-20T18:35:50.304 INFO:tasks.workunit.client.1.smithi172.stdout:7/791: read d2/d3/d3d/d4e/d5f/f61 [664210,96968] 0 2024-09-20T18:35:50.309 INFO:tasks.workunit.client.1.smithi172.stdout:3/814: rmdir d0/d13/d32/d54/d71 39 2024-09-20T18:35:50.312 INFO:tasks.workunit.client.1.smithi172.stdout:7/792: write d2/d3/d3d/dd4/fd7 [130768,19454] 0 2024-09-20T18:35:50.312 INFO:tasks.workunit.client.1.smithi172.stdout:0/930: truncate d4/d5/d2e/d76/ff5 5579 0 2024-09-20T18:35:50.315 INFO:tasks.workunit.client.1.smithi172.stdout:8/725: dwrite dd/d1b/d3b/f7b [0,4194304] 0 2024-09-20T18:35:50.315 INFO:tasks.workunit.client.1.smithi172.stdout:9/712: truncate d15/d1f/d2c/f70 2233788 0 2024-09-20T18:35:50.315 INFO:tasks.workunit.client.1.smithi172.stdout:7/793: read d2/d3/fb [4072440,24055] 0 2024-09-20T18:35:50.319 INFO:tasks.workunit.client.1.smithi172.stdout:1/722: rename d0/d8/db/cca to d0/d8/db/d25/d2b/d3d/d65/d93/ced 0 2024-09-20T18:35:50.320 INFO:tasks.workunit.client.1.smithi172.stdout:1/723: stat d0/f82 0 2024-09-20T18:35:50.321 INFO:tasks.workunit.client.1.smithi172.stdout:3/815: dwrite d0/dc/f5a [0,4194304] 0 2024-09-20T18:35:50.330 INFO:tasks.workunit.client.1.smithi172.stdout:2/684: dwrite d0/d2c/d3f/dab/d22/d10/f85 [0,4194304] 0 2024-09-20T18:35:50.330 INFO:tasks.workunit.client.1.smithi172.stdout:6/652: rename d0/d18/d1c/d21/d26/d34/d7a/d47 to d0/d18/d1c/d21/d26/d34/da2/dda 0 2024-09-20T18:35:50.331 INFO:tasks.workunit.client.1.smithi172.stdout:1/724: creat d0/d8/db/d25/d2b/fee x:0 0 0 2024-09-20T18:35:50.334 INFO:tasks.workunit.client.1.smithi172.stdout:0/931: mknod d4/d5/d2e/d8e/d133/c145 0 2024-09-20T18:35:50.335 INFO:tasks.workunit.client.1.smithi172.stdout:9/713: dwrite d15/fcc [0,4194304] 0 2024-09-20T18:35:50.336 INFO:tasks.workunit.client.1.smithi172.stdout:5/781: chown d4/df/dad/d26/d41/d69/dac/d2c/c2f 23 1 2024-09-20T18:35:50.337 INFO:tasks.workunit.client.1.smithi172.stdout:7/794: symlink d2/d3/d10/d40/d46/d8e/dbd/dda/l114 0 2024-09-20T18:35:50.340 INFO:tasks.workunit.client.1.smithi172.stdout:2/685: fsync d0/f3 0 2024-09-20T18:35:50.341 INFO:tasks.workunit.client.1.smithi172.stdout:4/765: dwrite d0/d48/d90/d55/d53/fb9 [0,4194304] 0 2024-09-20T18:35:50.343 INFO:tasks.workunit.client.1.smithi172.stdout:2/686: chown d0/d2c/d3f/dab/d22/d4c/f99 7716041 1 2024-09-20T18:35:50.343 INFO:tasks.workunit.client.1.smithi172.stdout:2/687: stat d0/d2c/d3f/f8a 0 2024-09-20T18:35:50.344 INFO:tasks.workunit.client.1.smithi172.stdout:3/816: mknod d0/d13/c116 0 2024-09-20T18:35:50.345 INFO:tasks.workunit.client.1.smithi172.stdout:1/725: unlink d0/d8/d12/f5d 0 2024-09-20T18:35:50.345 INFO:tasks.workunit.client.1.smithi172.stdout:8/726: write dd/d1b/d3b/f3c [1682366,72428] 0 2024-09-20T18:35:50.350 INFO:tasks.workunit.client.1.smithi172.stdout:9/714: mkdir d15/d1f/d2c/d7d/d34/db5/deb 0 2024-09-20T18:35:50.350 INFO:tasks.workunit.client.1.smithi172.stdout:6/653: symlink d0/d18/d1c/d21/d26/d34/da2/ldb 0 2024-09-20T18:35:50.350 INFO:tasks.workunit.client.1.smithi172.stdout:0/932: mknod d4/d5/d2e/d67/c146 0 2024-09-20T18:35:50.351 INFO:tasks.workunit.client.1.smithi172.stdout:1/726: fsync d0/d8/db/d25/d2b/d3d/d65/d93/fe5 0 2024-09-20T18:35:50.353 INFO:tasks.workunit.client.1.smithi172.stdout:0/933: dread - d4/d1a/d28/d75/d60/f140 zero size 2024-09-20T18:35:50.354 INFO:tasks.workunit.client.1.smithi172.stdout:6/654: dread - d0/d18/d1c/d21/d26/d34/da2/dda/d62/fc4 zero size 2024-09-20T18:35:50.354 INFO:tasks.workunit.client.1.smithi172.stdout:4/766: mkdir d0/d48/d90/d55/d53/d5c/d10e 0 2024-09-20T18:35:50.355 INFO:tasks.workunit.client.1.smithi172.stdout:4/767: chown d0/de/d39/fc8 6684 1 2024-09-20T18:35:50.356 INFO:tasks.workunit.client.1.smithi172.stdout:2/688: chown d0/d2c/d3f/dab/d22/cf 6 1 2024-09-20T18:35:50.356 INFO:tasks.workunit.client.1.smithi172.stdout:1/727: dread d0/d8/db/d25/d2b/d3d/d65/d93/dbb/dd3/fda [0,4194304] 0 2024-09-20T18:35:50.357 INFO:tasks.workunit.client.1.smithi172.stdout:4/768: read d0/de/fcc [40001,41472] 0 2024-09-20T18:35:50.357 INFO:tasks.workunit.client.1.smithi172.stdout:3/817: mkdir d0/d13/d58/d6d/d7f/d84/dd9/d117 0 2024-09-20T18:35:50.359 INFO:tasks.workunit.client.1.smithi172.stdout:9/715: symlink d15/d1f/d2c/lec 0 2024-09-20T18:35:50.359 INFO:tasks.workunit.client.1.smithi172.stdout:2/689: read d0/d2c/d3f/dab/d18/d29/f56 [3483852,53099] 0 2024-09-20T18:35:50.362 INFO:tasks.workunit.client.1.smithi172.stdout:2/690: read - d0/d2c/d3f/dab/d18/d29/fd8 zero size 2024-09-20T18:35:50.364 INFO:tasks.workunit.client.1.smithi172.stdout:4/769: dwrite d0/d48/d90/dea/ff1 [0,4194304] 0 2024-09-20T18:35:50.364 INFO:tasks.workunit.client.1.smithi172.stdout:6/655: rename d0/d18/d1c/d21/d26/d9b to d0/d18/d1c/d21/d26/d34/da2/dda/d62/ddc 0 2024-09-20T18:35:50.365 INFO:tasks.workunit.client.1.smithi172.stdout:1/728: rmdir d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dcf 39 2024-09-20T18:35:50.370 INFO:tasks.workunit.client.1.smithi172.stdout:8/727: mknod dd/d1b/d3b/cfa 0 2024-09-20T18:35:50.370 INFO:tasks.workunit.client.1.smithi172.stdout:5/782: mknod d4/df/dad/d26/d41/d65/c104 0 2024-09-20T18:35:50.370 INFO:tasks.workunit.client.1.smithi172.stdout:1/729: dread - d0/d8/db/d25/d2b/fc3 zero size 2024-09-20T18:35:50.371 INFO:tasks.workunit.client.1.smithi172.stdout:0/934: truncate d4/d1a/d28/d75/f43 1015293 0 2024-09-20T18:35:50.375 INFO:tasks.workunit.client.1.smithi172.stdout:4/770: mkdir d0/d48/d90/dea/d10f 0 2024-09-20T18:35:50.376 INFO:tasks.workunit.client.1.smithi172.stdout:6/656: mknod d0/d18/d1c/d21/d26/d34/da2/cdd 0 2024-09-20T18:35:50.376 INFO:tasks.workunit.client.1.smithi172.stdout:0/935: dwrite d4/d1a/d28/d42/d45/d54/f64 [4194304,4194304] 0 2024-09-20T18:35:50.377 INFO:tasks.workunit.client.1.smithi172.stdout:1/730: symlink d0/d73/lef 0 2024-09-20T18:35:50.378 INFO:tasks.workunit.client.1.smithi172.stdout:5/783: mkdir d4/df/d98/dcc/d105 0 2024-09-20T18:35:50.380 INFO:tasks.workunit.client.1.smithi172.stdout:0/936: creat d4/d44/dab/f147 x:0 0 0 2024-09-20T18:35:50.381 INFO:tasks.workunit.client.1.smithi172.stdout:6/657: write d0/d18/d1c/d21/f7c [2957954,16278] 0 2024-09-20T18:35:50.383 INFO:tasks.workunit.client.1.smithi172.stdout:7/795: dwrite d2/d3/d10/faa [0,4194304] 0 2024-09-20T18:35:50.383 INFO:tasks.workunit.client.1.smithi172.stdout:8/728: creat dd/d1b/d3b/d51/ffb x:0 0 0 2024-09-20T18:35:50.384 INFO:tasks.workunit.client.1.smithi172.stdout:6/658: fdatasync d0/d18/d1c/d21/d26/d34/d39/d74/dbf/fb6 0 2024-09-20T18:35:50.385 INFO:tasks.workunit.client.1.smithi172.stdout:4/771: mkdir d0/d48/d4e/d110 0 2024-09-20T18:35:50.386 INFO:tasks.workunit.client.1.smithi172.stdout:5/784: mkdir d4/df/d106 0 2024-09-20T18:35:50.386 INFO:tasks.workunit.client.1.smithi172.stdout:4/772: chown d0/d48/d90/d55/d101/f11 95382811 1 2024-09-20T18:35:50.387 INFO:tasks.workunit.client.0.smithi017.stdout:9/210: sync 2024-09-20T18:35:50.388 INFO:tasks.workunit.client.1.smithi172.stdout:4/773: read d0/de/d39/f9b [1371700,24814] 0 2024-09-20T18:35:50.391 INFO:tasks.workunit.client.0.smithi017.stdout:9/211: read d6/d11/f17 [61145,107950] 0 2024-09-20T18:35:50.394 INFO:tasks.workunit.client.1.smithi172.stdout:0/937: dread d4/f11 [0,4194304] 0 2024-09-20T18:35:50.395 INFO:tasks.workunit.client.1.smithi172.stdout:5/785: unlink d4/df/dad/d26/d41/d65/d8f/fa5 0 2024-09-20T18:35:50.397 INFO:tasks.workunit.client.1.smithi172.stdout:9/716: mkdir d15/d1f/d2c/d7d/d34/db5/ded 0 2024-09-20T18:35:50.398 INFO:tasks.workunit.client.1.smithi172.stdout:5/786: chown d4/df/d3f/d64/d101/d63/d80/dd7 2 1 2024-09-20T18:35:50.399 INFO:tasks.workunit.client.0.smithi017.stdout:9/212: creat d6/d23/f54 x:0 0 0 2024-09-20T18:35:50.401 INFO:tasks.workunit.client.1.smithi172.stdout:0/938: dread d4/d5/fc1 [0,4194304] 0 2024-09-20T18:35:50.401 INFO:tasks.workunit.client.1.smithi172.stdout:2/691: dwrite d0/d2c/d3f/dab/d22/f36 [0,4194304] 0 2024-09-20T18:35:50.403 INFO:tasks.workunit.client.0.smithi017.stdout:9/213: creat d6/d23/d24/d3f/d45/f55 x:0 0 0 2024-09-20T18:35:50.409 INFO:tasks.workunit.client.1.smithi172.stdout:6/659: dread d0/d18/d1c/d21/d26/d34/da2/dda/d7b/fcf [0,4194304] 0 2024-09-20T18:35:50.410 INFO:tasks.workunit.client.1.smithi172.stdout:0/939: read d4/d44/f6e [182061,52556] 0 2024-09-20T18:35:50.412 INFO:tasks.workunit.client.1.smithi172.stdout:0/940: chown d4/d44/dab 115955 1 2024-09-20T18:35:50.413 INFO:tasks.workunit.client.1.smithi172.stdout:6/660: write d0/d18/d1c/d21/d26/db7/fd1 [274797,45975] 0 2024-09-20T18:35:50.415 INFO:tasks.workunit.client.0.smithi017.stdout:9/214: getdents d6/d23 0 2024-09-20T18:35:50.418 INFO:tasks.workunit.client.0.smithi017.stdout:9/215: rename d6/ff to d6/d23/d24/d3f/d45/f56 0 2024-09-20T18:35:50.420 INFO:tasks.workunit.client.1.smithi172.stdout:8/729: dwrite dd/f1c [0,4194304] 0 2024-09-20T18:35:50.420 INFO:tasks.workunit.client.1.smithi172.stdout:2/692: creat d0/d2c/d3f/dab/d22/d10/d6a/ddf/fe9 x:0 0 0 2024-09-20T18:35:50.420 INFO:tasks.workunit.client.1.smithi172.stdout:4/774: write d0/de/dc/f81 [1524494,11699] 0 2024-09-20T18:35:50.422 INFO:tasks.workunit.client.1.smithi172.stdout:8/730: readlink dd/d1b/d4f/l57 0 2024-09-20T18:35:50.422 INFO:tasks.workunit.client.0.smithi017.stdout:9/216: unlink d6/d23/l35 0 2024-09-20T18:35:50.424 INFO:tasks.workunit.client.1.smithi172.stdout:0/941: dwrite d4/d5/d2e/d67/f115 [0,4194304] 0 2024-09-20T18:35:50.424 INFO:tasks.workunit.client.1.smithi172.stdout:6/661: mkdir d0/d18/d1c/d21/d26/d79/dde 0 2024-09-20T18:35:50.426 INFO:tasks.workunit.client.1.smithi172.stdout:8/731: truncate dd/d1b/d3b/f3c 4424421 0 2024-09-20T18:35:50.426 INFO:tasks.workunit.client.0.smithi017.stdout:9/217: creat d6/d23/d24/f57 x:0 0 0 2024-09-20T18:35:50.427 INFO:tasks.workunit.client.1.smithi172.stdout:0/942: write d4/d5/d2e/d33/de1/f12c [858128,85149] 0 2024-09-20T18:35:50.430 INFO:tasks.workunit.client.1.smithi172.stdout:9/717: getdents d15/d1f/d2c/d57 0 2024-09-20T18:35:50.431 INFO:tasks.workunit.client.1.smithi172.stdout:5/787: dread d4/df/f89 [0,4194304] 0 2024-09-20T18:35:50.434 INFO:tasks.workunit.client.1.smithi172.stdout:2/693: rename d0/d2c/d3f/dab/d18/d29/d42/d83/fe6 to d0/d2c/d3f/dab/d22/d4c/fea 0 2024-09-20T18:35:50.437 INFO:tasks.workunit.client.0.smithi017.stdout:9/218: rename d6/d23/d24 to d6/d23/d58 0 2024-09-20T18:35:50.438 INFO:tasks.workunit.client.1.smithi172.stdout:8/732: symlink dd/d1b/d4f/lfc 0 2024-09-20T18:35:50.439 INFO:tasks.workunit.client.1.smithi172.stdout:0/943: rmdir d4/d94/dd5 39 2024-09-20T18:35:50.443 INFO:tasks.workunit.client.1.smithi172.stdout:2/694: unlink d0/d2c/d3f/dab/d22/d10/d3c/d68/fc6 0 2024-09-20T18:35:50.444 INFO:tasks.workunit.client.1.smithi172.stdout:0/944: dread d4/d1a/d28/d42/d45/d99/dc9/fa2 [0,4194304] 0 2024-09-20T18:35:50.444 INFO:tasks.workunit.client.1.smithi172.stdout:6/662: symlink d0/d18/d1c/d21/d26/d34/d39/ldf 0 2024-09-20T18:35:50.445 INFO:tasks.workunit.client.1.smithi172.stdout:8/733: rename dd/d1b/d4f/d9a/fc3 to dd/d1b/d3b/dc7/ffd 0 2024-09-20T18:35:50.446 INFO:tasks.workunit.client.1.smithi172.stdout:9/718: fsync d15/d1f/d2c/f70 0 2024-09-20T18:35:50.447 INFO:tasks.workunit.client.1.smithi172.stdout:4/775: link d0/de/d21/lb3 d0/d48/d90/d55/d101/d18/l111 0 2024-09-20T18:35:50.448 INFO:tasks.workunit.client.1.smithi172.stdout:5/788: chown d4/df/dad/d26/d41/d69/dac/da7/dd8/lf5 1473395604 1 2024-09-20T18:35:50.449 INFO:tasks.workunit.client.1.smithi172.stdout:0/945: dread d4/d5/d2e/d33/de1/f12c [0,4194304] 0 2024-09-20T18:35:50.450 INFO:tasks.workunit.client.1.smithi172.stdout:5/789: fdatasync d4/df/d3f/d64/d101/d63/d80/fa8 0 2024-09-20T18:35:50.450 INFO:tasks.workunit.client.1.smithi172.stdout:2/695: fsync d0/d2c/f63 0 2024-09-20T18:35:50.451 INFO:tasks.workunit.client.1.smithi172.stdout:2/696: chown d0/d2c/d3f/dab/d18/d29/f57 418 1 2024-09-20T18:35:50.452 INFO:tasks.workunit.client.0.smithi017.stdout:9/219: dread f4 [0,4194304] 0 2024-09-20T18:35:50.455 INFO:tasks.workunit.client.1.smithi172.stdout:8/734: symlink dd/d1b/d3b/d51/d5b/dc5/lfe 0 2024-09-20T18:35:50.456 INFO:tasks.workunit.client.1.smithi172.stdout:8/735: chown dd/d1b/d3b/d51/d5b/fa5 22523783 1 2024-09-20T18:35:50.457 INFO:tasks.workunit.client.0.smithi017.stdout:9/220: creat d6/d23/d58/d3f/d44/f59 x:0 0 0 2024-09-20T18:35:50.457 INFO:tasks.workunit.client.1.smithi172.stdout:8/736: truncate dd/d1b/d4f/d9a/fb9 531567 0 2024-09-20T18:35:50.460 INFO:tasks.workunit.client.1.smithi172.stdout:4/776: chown d0/d48/d90/d55/f3e 43 1 2024-09-20T18:35:50.462 INFO:tasks.workunit.client.1.smithi172.stdout:5/790: symlink d4/df/dad/d26/d41/d69/dac/d2c/dd1/l107 0 2024-09-20T18:35:50.464 INFO:tasks.workunit.client.1.smithi172.stdout:0/946: dread d4/d5/d2e/d33/de1/fda [0,4194304] 0 2024-09-20T18:35:50.465 INFO:tasks.workunit.client.0.smithi017.stdout:9/221: getdents d6/d23/d58/d3f/d45 0 2024-09-20T18:35:50.465 INFO:tasks.workunit.client.1.smithi172.stdout:0/947: chown d4/d5/d2e/d33/de1/f59 232 1 2024-09-20T18:35:50.468 INFO:tasks.workunit.client.1.smithi172.stdout:8/737: unlink dd/d1b/fe0 0 2024-09-20T18:35:50.469 INFO:tasks.workunit.client.0.smithi017.stdout:9/222: mknod d6/d23/d58/d3f/d44/c5a 0 2024-09-20T18:35:50.470 INFO:tasks.workunit.client.1.smithi172.stdout:9/719: fdatasync d15/d20/d76/f84 0 2024-09-20T18:35:50.470 INFO:tasks.workunit.client.1.smithi172.stdout:2/697: write d0/d60/f69 [773082,73138] 0 2024-09-20T18:35:50.471 INFO:tasks.workunit.client.1.smithi172.stdout:0/948: dwrite d4/d1a/d28/fa4 [0,4194304] 0 2024-09-20T18:35:50.472 INFO:tasks.workunit.client.0.smithi017.stdout:9/223: symlink d6/d23/d58/l5b 0 2024-09-20T18:35:50.473 INFO:tasks.workunit.client.1.smithi172.stdout:2/698: dread - d0/d2c/d3f/dab/d18/d29/fe1 zero size 2024-09-20T18:35:50.473 INFO:tasks.workunit.client.1.smithi172.stdout:5/791: dread - d4/df/d3f/fe0 zero size 2024-09-20T18:35:50.474 INFO:tasks.workunit.client.1.smithi172.stdout:6/663: link d0/d18/d1c/d21/d26/d34/d39/d46/c55 d0/d18/d1c/d21/d26/d79/ce0 0 2024-09-20T18:35:50.475 INFO:tasks.workunit.client.0.smithi017.stdout:9/224: mknod d6/d23/d58/d3f/c5c 0 2024-09-20T18:35:50.476 INFO:tasks.workunit.client.1.smithi172.stdout:6/664: stat d0/d18/d1c/d21/f88 0 2024-09-20T18:35:50.476 INFO:tasks.workunit.client.1.smithi172.stdout:4/777: dread d0/de/dc/d3c/d99/fce [0,4194304] 0 2024-09-20T18:35:50.481 INFO:tasks.workunit.client.0.smithi017.stdout:9/225: dwrite d6/d11/f13 [0,4194304] 0 2024-09-20T18:35:50.482 INFO:tasks.workunit.client.1.smithi172.stdout:6/665: dwrite d0/d18/d1c/d21/d26/d34/da2/dda/d7b/d7e/dd3/fd8 [0,4194304] 0 2024-09-20T18:35:50.482 INFO:tasks.workunit.client.1.smithi172.stdout:5/792: creat d4/df/dad/d26/f108 x:0 0 0 2024-09-20T18:35:50.485 INFO:tasks.workunit.client.1.smithi172.stdout:8/738: mkdir dd/d1b/d3b/dff 0 2024-09-20T18:35:50.486 INFO:tasks.workunit.client.1.smithi172.stdout:8/739: chown dd/d1b/f1f 109 1 2024-09-20T18:35:50.487 INFO:tasks.workunit.client.1.smithi172.stdout:4/778: dread - d0/fcd zero size 2024-09-20T18:35:50.489 INFO:tasks.workunit.client.0.smithi017.stdout:9/226: dwrite d6/d23/f54 [0,4194304] 0 2024-09-20T18:35:50.490 INFO:tasks.workunit.client.0.smithi017.stdout:9/227: fdatasync d6/d1f/f33 0 2024-09-20T18:35:50.502 INFO:tasks.workunit.client.0.smithi017.stdout:8/201: sync 2024-09-20T18:35:50.504 INFO:tasks.workunit.client.1.smithi172.stdout:6/666: creat d0/d18/d1c/d21/d26/d34/da2/dda/d62/fe1 x:0 0 0 2024-09-20T18:35:50.505 INFO:tasks.workunit.client.0.smithi017.stdout:9/228: chown d6/d23/l48 6 1 2024-09-20T18:35:50.507 INFO:tasks.workunit.client.1.smithi172.stdout:6/667: dread d0/d18/d1c/d21/d26/f45 [0,4194304] 0 2024-09-20T18:35:50.509 INFO:tasks.workunit.client.1.smithi172.stdout:6/668: write d0/d18/d1c/d21/d26/d34/da2/dda/d7b/d7e/dd3/fd8 [4034732,30464] 0 2024-09-20T18:35:50.510 INFO:tasks.workunit.client.0.smithi017.stdout:9/229: dread d6/d23/f54 [0,4194304] 0 2024-09-20T18:35:50.512 INFO:tasks.workunit.client.1.smithi172.stdout:9/720: getdents d15/d1a/d64 0 2024-09-20T18:35:50.512 INFO:tasks.workunit.client.0.smithi017.stdout:8/202: truncate d0/fd 213351 0 2024-09-20T18:35:50.513 INFO:tasks.workunit.client.0.smithi017.stdout:8/203: readlink d0/d6/l26 0 2024-09-20T18:35:50.513 INFO:tasks.workunit.client.1.smithi172.stdout:0/949: link d4/d5/d2e/d33/de1/d15/f7b d4/d1a/d28/d42/db8/dcd/dce/f148 0 2024-09-20T18:35:50.514 INFO:tasks.workunit.client.1.smithi172.stdout:6/669: dread d0/d18/d1c/d21/d26/d34/da2/dda/d7b/fcf [4194304,4194304] 0 2024-09-20T18:35:50.515 INFO:tasks.workunit.client.1.smithi172.stdout:3/818: sync 2024-09-20T18:35:50.516 INFO:tasks.workunit.client.1.smithi172.stdout:4/779: rename d0/f2a to d0/d48/d90/d55/d53/d5c/f112 0 2024-09-20T18:35:50.516 INFO:tasks.workunit.client.1.smithi172.stdout:2/699: write d0/d2c/d3f/dab/d22/d10/d3c/d7b/fa1 [920124,24440] 0 2024-09-20T18:35:50.517 INFO:tasks.workunit.client.1.smithi172.stdout:5/793: creat d4/df/d3f/d64/f109 x:0 0 0 2024-09-20T18:35:50.518 INFO:tasks.workunit.client.0.smithi017.stdout:9/230: rename d6/d23/d58/d3f/d45 to d6/d23/d58/d3f/d2f/d5d 0 2024-09-20T18:35:50.519 INFO:tasks.workunit.client.0.smithi017.stdout:9/231: dread - d6/d1f/f41 zero size 2024-09-20T18:35:50.519 INFO:tasks.workunit.client.1.smithi172.stdout:8/740: dread dd/d1b/d3b/d51/d5b/daf/d4d/f8f [0,4194304] 0 2024-09-20T18:35:50.520 INFO:tasks.workunit.client.0.smithi017.stdout:8/204: creat d0/d6/f43 x:0 0 0 2024-09-20T18:35:50.520 INFO:tasks.workunit.client.0.smithi017.stdout:9/232: truncate d6/d23/d58/f57 318104 0 2024-09-20T18:35:50.524 INFO:tasks.workunit.client.1.smithi172.stdout:3/819: dwrite d0/d13/d58/d6d/db9/dd6/d101/f10e [0,4194304] 0 2024-09-20T18:35:50.524 INFO:tasks.workunit.client.0.smithi017.stdout:8/205: dread d0/f1c [0,4194304] 0 2024-09-20T18:35:50.525 INFO:tasks.workunit.client.1.smithi172.stdout:3/820: chown d0/dc/d6a/d22/cf3 0 1 2024-09-20T18:35:50.526 INFO:tasks.workunit.client.1.smithi172.stdout:3/821: fdatasync d0/dc/fcd 0 2024-09-20T18:35:50.528 INFO:tasks.workunit.client.0.smithi017.stdout:9/233: creat d6/d23/d3a/f5e x:0 0 0 2024-09-20T18:35:50.528 INFO:tasks.workunit.client.1.smithi172.stdout:6/670: read d0/d18/d1c/d21/d26/d34/da2/dda/d62/f8f [3237925,4508] 0 2024-09-20T18:35:50.528 INFO:tasks.workunit.client.1.smithi172.stdout:3/822: truncate d0/d13/d32/d54/fe2 1287919 0 2024-09-20T18:35:50.530 INFO:tasks.workunit.client.1.smithi172.stdout:4/780: symlink d0/d48/d90/db4/l113 0 2024-09-20T18:35:50.532 INFO:tasks.workunit.client.1.smithi172.stdout:4/781: fsync d0/d48/d90/d55/d101/d18/f103 0 2024-09-20T18:35:50.532 INFO:tasks.workunit.client.1.smithi172.stdout:9/721: dread f6 [4194304,4194304] 0 2024-09-20T18:35:50.535 INFO:tasks.workunit.client.1.smithi172.stdout:5/794: rmdir d4/df 39 2024-09-20T18:35:50.538 INFO:tasks.workunit.client.0.smithi017.stdout:9/234: mkdir d6/d23/d58/d3f/d5f 0 2024-09-20T18:35:50.540 INFO:tasks.workunit.client.0.smithi017.stdout:8/206: getdents d0/d6/d28/d41 0 2024-09-20T18:35:50.541 INFO:tasks.workunit.client.1.smithi172.stdout:0/950: dwrite d4/d5/fb [4194304,4194304] 0 2024-09-20T18:35:50.542 INFO:tasks.workunit.client.0.smithi017.stdout:9/235: symlink d6/d23/d58/d3f/d5f/l60 0 2024-09-20T18:35:50.543 INFO:tasks.workunit.client.1.smithi172.stdout:2/700: write d0/d2c/d3f/dab/d22/d10/d35/fad [240492,23711] 0 2024-09-20T18:35:50.545 INFO:tasks.workunit.client.0.smithi017.stdout:8/207: mknod d0/d6/d28/d3b/c44 0 2024-09-20T18:35:50.545 INFO:tasks.workunit.client.1.smithi172.stdout:7/796: sync 2024-09-20T18:35:50.545 INFO:tasks.workunit.client.1.smithi172.stdout:1/731: sync 2024-09-20T18:35:50.547 INFO:tasks.workunit.client.1.smithi172.stdout:2/701: write d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/dbb/f9e [681796,20569] 0 2024-09-20T18:35:50.547 INFO:tasks.workunit.client.0.smithi017.stdout:9/236: mkdir d6/d23/d3a/d61 0 2024-09-20T18:35:50.548 INFO:tasks.workunit.client.1.smithi172.stdout:7/797: dread - d2/d3/d10/de4/f107 zero size 2024-09-20T18:35:50.550 INFO:tasks.workunit.client.1.smithi172.stdout:9/722: readlink d15/d1a/d6f/d7a/l85 0 2024-09-20T18:35:50.551 INFO:tasks.workunit.client.1.smithi172.stdout:8/741: creat dd/d1b/d3b/d5d/df6/f100 x:0 0 0 2024-09-20T18:35:50.556 INFO:tasks.workunit.client.1.smithi172.stdout:4/782: dwrite d0/d7/d6f/f9c [4194304,4194304] 0 2024-09-20T18:35:50.556 INFO:tasks.workunit.client.1.smithi172.stdout:2/702: chown d0/d2c/d3f/dab/d22/d10/f1f 7727487 1 2024-09-20T18:35:50.556 INFO:tasks.workunit.client.1.smithi172.stdout:1/732: dwrite d0/d8/d5f/fa9 [4194304,4194304] 0 2024-09-20T18:35:50.558 INFO:tasks.workunit.client.1.smithi172.stdout:3/823: truncate d0/d13/d58/d6d/d7f/d84/fc1 1877176 0 2024-09-20T18:35:50.558 INFO:tasks.workunit.client.1.smithi172.stdout:7/798: rmdir d2/d3/d3d/d4e 39 2024-09-20T18:35:50.559 INFO:tasks.workunit.client.0.smithi017.stdout:8/208: dwrite d0/f1c [0,4194304] 0 2024-09-20T18:35:50.559 INFO:tasks.workunit.client.1.smithi172.stdout:5/795: chown d4/df/d3f/l40 6708 1 2024-09-20T18:35:50.560 INFO:tasks.workunit.client.0.smithi017.stdout:8/209: write d0/f22 [64549,26628] 0 2024-09-20T18:35:50.561 INFO:tasks.workunit.client.1.smithi172.stdout:6/671: creat d0/d18/fe2 x:0 0 0 2024-09-20T18:35:50.564 INFO:tasks.workunit.client.1.smithi172.stdout:8/742: mkdir dd/d1b/d4f/d9a/dbb/d101 0 2024-09-20T18:35:50.565 INFO:tasks.workunit.client.1.smithi172.stdout:4/783: unlink d0/de/d21/faa 0 2024-09-20T18:35:50.566 INFO:tasks.workunit.client.1.smithi172.stdout:6/672: truncate d0/d18/fe2 192589 0 2024-09-20T18:35:50.568 INFO:tasks.workunit.client.1.smithi172.stdout:3/824: unlink d0/d13/d32/d54/f78 0 2024-09-20T18:35:50.569 INFO:tasks.workunit.client.1.smithi172.stdout:5/796: truncate d4/df/dad/d26/f108 100129 0 2024-09-20T18:35:50.572 INFO:tasks.workunit.client.1.smithi172.stdout:0/951: getdents d4/d1a/d28/d75/d60 0 2024-09-20T18:35:50.572 INFO:tasks.workunit.client.1.smithi172.stdout:2/703: dwrite d0/d60/f69 [0,4194304] 0 2024-09-20T18:35:50.572 INFO:tasks.workunit.client.1.smithi172.stdout:4/784: truncate d0/f32 4816384 0 2024-09-20T18:35:50.573 INFO:tasks.workunit.client.1.smithi172.stdout:3/825: write d0/dc/f5a [3346584,62863] 0 2024-09-20T18:35:50.574 INFO:tasks.workunit.client.1.smithi172.stdout:0/952: chown d4/d5/l8 66378833 1 2024-09-20T18:35:50.575 INFO:tasks.workunit.client.1.smithi172.stdout:9/723: link d15/d20/d76/f84 d15/d1f/d2c/d6e/fee 0 2024-09-20T18:35:50.577 INFO:tasks.workunit.client.1.smithi172.stdout:7/799: getdents d2/d23/d51/d10e 0 2024-09-20T18:35:50.578 INFO:tasks.workunit.client.1.smithi172.stdout:5/797: mknod d4/df/d3f/d64/d101/d63/c10a 0 2024-09-20T18:35:50.579 INFO:tasks.workunit.client.1.smithi172.stdout:4/785: creat d0/de/dc/f114 x:0 0 0 2024-09-20T18:35:50.579 INFO:tasks.workunit.client.1.smithi172.stdout:0/953: mkdir d4/d5/d149 0 2024-09-20T18:35:50.580 INFO:tasks.workunit.client.1.smithi172.stdout:6/673: mknod d0/d18/d1c/d21/d26/d34/d9c/dac/ce3 0 2024-09-20T18:35:50.581 INFO:tasks.workunit.client.1.smithi172.stdout:0/954: fsync d4/fbe 0 2024-09-20T18:35:50.582 INFO:tasks.workunit.client.1.smithi172.stdout:2/704: rmdir d0/d2c/d3f/dab/d18/d29/d42 39 2024-09-20T18:35:50.586 INFO:tasks.workunit.client.1.smithi172.stdout:6/674: rmdir d0/d18/d1c/d21/d26/d34/da2/dda/d7b 39 2024-09-20T18:35:50.588 INFO:tasks.workunit.client.1.smithi172.stdout:3/826: rename d0/d13/d58/d6d/d7f/fac to d0/dc/d6a/dc5/f118 0 2024-09-20T18:35:50.591 INFO:tasks.workunit.client.1.smithi172.stdout:9/724: dwrite d15/d1f/d2c/d7d/d34/db5/fd1 [0,4194304] 0 2024-09-20T18:35:50.591 INFO:tasks.workunit.client.1.smithi172.stdout:4/786: getdents d0/d48/d90/d55 0 2024-09-20T18:35:50.596 INFO:tasks.workunit.client.1.smithi172.stdout:9/725: chown d15/d20/f21 761999 1 2024-09-20T18:35:50.597 INFO:tasks.workunit.client.1.smithi172.stdout:1/733: dwrite d0/f4 [0,4194304] 0 2024-09-20T18:35:50.599 INFO:tasks.workunit.client.1.smithi172.stdout:5/798: rename d4/c6 to d4/df/d3f/c10b 0 2024-09-20T18:35:50.599 INFO:tasks.workunit.client.1.smithi172.stdout:0/955: dwrite d4/d5/fc1 [0,4194304] 0 2024-09-20T18:35:50.601 INFO:tasks.workunit.client.1.smithi172.stdout:2/705: dwrite d0/d2c/d3f/dab/d22/d10/d35/fc2 [0,4194304] 0 2024-09-20T18:35:50.603 INFO:tasks.workunit.client.1.smithi172.stdout:4/787: chown d0/d48/d90/d55/d53/d5c/f75 627951778 1 2024-09-20T18:35:50.607 INFO:tasks.workunit.client.1.smithi172.stdout:3/827: creat d0/dc/d6a/f119 x:0 0 0 2024-09-20T18:35:50.610 INFO:tasks.workunit.client.1.smithi172.stdout:1/734: creat d0/d8/db/d25/d2b/d3d/d65/ff0 x:0 0 0 2024-09-20T18:35:50.610 INFO:tasks.workunit.client.1.smithi172.stdout:5/799: mkdir d4/df/d3f/d64/d101/d86/d10c 0 2024-09-20T18:35:50.612 INFO:tasks.workunit.client.1.smithi172.stdout:4/788: symlink d0/d48/d90/d55/d53/l115 0 2024-09-20T18:35:50.612 INFO:tasks.workunit.client.1.smithi172.stdout:2/706: write d0/d2c/d3f/dab/d22/d10/d35/fa5 [2871419,103803] 0 2024-09-20T18:35:50.612 INFO:tasks.workunit.client.1.smithi172.stdout:9/726: dwrite d15/d54/fcb [0,4194304] 0 2024-09-20T18:35:50.615 INFO:tasks.workunit.client.1.smithi172.stdout:5/800: read - d4/df/dad/d26/d41/d65/d8f/fc5 zero size 2024-09-20T18:35:50.616 INFO:tasks.workunit.client.1.smithi172.stdout:4/789: chown d0/d48/d90/d55/d101/f5d 8017198 1 2024-09-20T18:35:50.617 INFO:tasks.workunit.client.1.smithi172.stdout:0/956: creat d4/d1a/d28/d42/d45/d99/dc9/d107/f14a x:0 0 0 2024-09-20T18:35:50.617 INFO:tasks.workunit.client.1.smithi172.stdout:9/727: read d15/d1f/d2c/d7d/d34/db5/fd1 [990399,53963] 0 2024-09-20T18:35:50.622 INFO:tasks.workunit.client.1.smithi172.stdout:5/801: write d4/df/dad/dd4/ff9 [116233,97190] 0 2024-09-20T18:35:50.623 INFO:tasks.workunit.client.1.smithi172.stdout:0/957: symlink d4/d1a/d28/d42/d45/d54/df8/l14b 0 2024-09-20T18:35:50.624 INFO:tasks.workunit.client.1.smithi172.stdout:2/707: dwrite d0/d2c/d3f/dab/d22/d4c/f88 [0,4194304] 0 2024-09-20T18:35:50.626 INFO:tasks.workunit.client.1.smithi172.stdout:5/802: mkdir d4/df/d3f/d64/d101/d86/d10d 0 2024-09-20T18:35:50.627 INFO:tasks.workunit.client.1.smithi172.stdout:9/728: rename d15/d1f/d2c/d37/fb3 to d15/d1a/d82/fef 0 2024-09-20T18:35:50.628 INFO:tasks.workunit.client.1.smithi172.stdout:9/729: fsync d15/d1a/d6f/f94 0 2024-09-20T18:35:50.633 INFO:tasks.workunit.client.0.smithi017.stdout:3/367: sync 2024-09-20T18:35:50.634 INFO:tasks.workunit.client.1.smithi172.stdout:9/730: mkdir d15/d1f/d2c/d7d/d48/df0 0 2024-09-20T18:35:50.636 INFO:tasks.workunit.client.1.smithi172.stdout:5/803: creat d4/df/d3f/f10e x:0 0 0 2024-09-20T18:35:50.639 INFO:tasks.workunit.client.1.smithi172.stdout:9/731: mkdir d15/d1a/d6f/df1 0 2024-09-20T18:35:50.639 INFO:tasks.workunit.client.1.smithi172.stdout:3/828: write d0/dc/d6a/d3a/d74/f8b [4914029,71122] 0 2024-09-20T18:35:50.641 INFO:tasks.workunit.client.1.smithi172.stdout:2/708: dread d0/f91 [0,4194304] 0 2024-09-20T18:35:50.643 INFO:tasks.workunit.client.1.smithi172.stdout:9/732: write d15/d1a/d82/fef [860992,79914] 0 2024-09-20T18:35:50.644 INFO:tasks.workunit.client.1.smithi172.stdout:3/829: fsync d0/dc/d6a/d3a/f7d 0 2024-09-20T18:35:50.644 INFO:tasks.workunit.client.1.smithi172.stdout:9/733: readlink d15/d1f/d2c/d57/lad 0 2024-09-20T18:35:50.645 INFO:tasks.workunit.client.1.smithi172.stdout:3/830: fdatasync d0/d13/d58/d6d/d7f/fff 0 2024-09-20T18:35:50.645 INFO:tasks.workunit.client.1.smithi172.stdout:4/790: dread d0/d48/d90/d55/d101/d18/d51/f8e [0,4194304] 0 2024-09-20T18:35:50.646 INFO:tasks.workunit.client.1.smithi172.stdout:5/804: link d4/df/d3f/f9a d4/df/dad/f10f 0 2024-09-20T18:35:50.646 INFO:tasks.workunit.client.1.smithi172.stdout:9/734: chown d15/d1f/d2c/d57/lad 1 1 2024-09-20T18:35:50.652 INFO:tasks.workunit.client.1.smithi172.stdout:3/831: truncate d0/dc/d6a/d3a/f80 4431245 0 2024-09-20T18:35:50.652 INFO:tasks.workunit.client.1.smithi172.stdout:9/735: truncate d15/d1f/d2c/d37/f44 4771125 0 2024-09-20T18:35:50.652 INFO:tasks.workunit.client.1.smithi172.stdout:5/805: creat d4/df/dad/d26/d41/d65/d8f/f110 x:0 0 0 2024-09-20T18:35:50.653 INFO:tasks.workunit.client.1.smithi172.stdout:0/958: dwrite d4/d5/d2e/d76/ff5 [0,4194304] 0 2024-09-20T18:35:50.654 INFO:tasks.workunit.client.0.smithi017.stdout:3/368: dread da/de/d13/d2f/d26/d62/f68 [0,4194304] 0 2024-09-20T18:35:50.654 INFO:tasks.workunit.client.1.smithi172.stdout:2/709: truncate d0/d2c/d3f/dab/d22/d10/d35/d5d/f64 454009 0 2024-09-20T18:35:50.655 INFO:tasks.workunit.client.1.smithi172.stdout:9/736: readlink d15/d1a/l7b 0 2024-09-20T18:35:50.655 INFO:tasks.workunit.client.1.smithi172.stdout:0/959: fdatasync d4/d1a/fb5 0 2024-09-20T18:35:50.656 INFO:tasks.workunit.client.1.smithi172.stdout:2/710: chown d0/d2c/d3f/dab/d22/d10/d6a 14109072 1 2024-09-20T18:35:50.657 INFO:tasks.workunit.client.1.smithi172.stdout:5/806: unlink d4/df/d3f/d64/d101/c9b 0 2024-09-20T18:35:50.659 INFO:tasks.workunit.client.0.smithi017.stdout:3/369: creat da/de/d13/d2f/d26/d31/d5a/f7f x:0 0 0 2024-09-20T18:35:50.659 INFO:tasks.workunit.client.1.smithi172.stdout:2/711: readlink d0/d2c/d3f/dab/d45/l47 0 2024-09-20T18:35:50.659 INFO:tasks.workunit.client.0.smithi017.stdout:3/370: chown da/c42 19 1 2024-09-20T18:35:50.661 INFO:tasks.workunit.client.1.smithi172.stdout:0/960: rmdir d4/d44 39 2024-09-20T18:35:50.662 INFO:tasks.workunit.client.1.smithi172.stdout:4/791: dread d0/d7/f25 [0,4194304] 0 2024-09-20T18:35:50.663 INFO:tasks.workunit.client.1.smithi172.stdout:3/832: truncate d0/d13/d58/d6d/d7f/d84/fc1 2625084 0 2024-09-20T18:35:50.671 INFO:tasks.workunit.client.1.smithi172.stdout:0/961: creat d4/d5/d2e/d38/d96/f14c x:0 0 0 2024-09-20T18:35:50.671 INFO:tasks.workunit.client.1.smithi172.stdout:4/792: rmdir d0/d48/d90/d55/d101/d18 39 2024-09-20T18:35:50.672 INFO:tasks.workunit.client.1.smithi172.stdout:9/737: write f12 [255299,73806] 0 2024-09-20T18:35:50.673 INFO:tasks.workunit.client.1.smithi172.stdout:3/833: creat d0/d13/d32/d54/d83/dbb/f11a x:0 0 0 2024-09-20T18:35:50.674 INFO:tasks.workunit.client.0.smithi017.stdout:3/371: write da/de/f5b [1426606,62117] 0 2024-09-20T18:35:50.675 INFO:tasks.workunit.client.1.smithi172.stdout:4/793: dread d0/d48/d90/fbf [0,4194304] 0 2024-09-20T18:35:50.675 INFO:tasks.workunit.client.1.smithi172.stdout:2/712: mkdir d0/d2c/d3f/dab/d22/d10/d35/dc4/deb 0 2024-09-20T18:35:50.676 INFO:tasks.workunit.client.1.smithi172.stdout:9/738: dread d15/fc1 [0,4194304] 0 2024-09-20T18:35:50.676 INFO:tasks.workunit.client.1.smithi172.stdout:0/962: mknod d4/d5/d2e/d33/de1/d15/dfe/d10c/c14d 0 2024-09-20T18:35:50.677 INFO:tasks.workunit.client.0.smithi017.stdout:3/372: creat da/de/d53/d52/f80 x:0 0 0 2024-09-20T18:35:50.678 INFO:tasks.workunit.client.1.smithi172.stdout:3/834: mknod d0/d13/d9e/c11b 0 2024-09-20T18:35:50.679 INFO:tasks.workunit.client.1.smithi172.stdout:9/739: creat d15/d20/d76/ff2 x:0 0 0 2024-09-20T18:35:50.680 INFO:tasks.workunit.client.1.smithi172.stdout:5/807: dwrite d4/df/dad/d26/d41/d69/dac/d2c/f30 [0,4194304] 0 2024-09-20T18:35:50.680 INFO:tasks.workunit.client.0.smithi017.stdout:3/373: mknod da/de/d13/d2f/d26/d31/d5a/d76/c81 0 2024-09-20T18:35:50.682 INFO:tasks.workunit.client.1.smithi172.stdout:4/794: creat d0/de/d39/d9f/de8/f116 x:0 0 0 2024-09-20T18:35:50.684 INFO:tasks.workunit.client.1.smithi172.stdout:5/808: truncate d4/df/dad/d26/fd5 24580 0 2024-09-20T18:35:50.686 INFO:tasks.workunit.client.1.smithi172.stdout:2/713: dwrite d0/d2c/d3f/dab/d22/d10/d35/fb0 [0,4194304] 0 2024-09-20T18:35:50.689 INFO:tasks.workunit.client.1.smithi172.stdout:4/795: unlink d0/de/d39/c84 0 2024-09-20T18:35:50.690 INFO:tasks.workunit.client.1.smithi172.stdout:4/796: write d0/d7/fba [1806739,75398] 0 2024-09-20T18:35:50.691 INFO:tasks.workunit.client.1.smithi172.stdout:5/809: unlink d4/df/d3f/d64/d101/d86/cc2 0 2024-09-20T18:35:50.695 INFO:tasks.workunit.client.1.smithi172.stdout:4/797: write d0/de/d39/f9b [2096978,65901] 0 2024-09-20T18:35:50.698 INFO:tasks.workunit.client.1.smithi172.stdout:8/743: sync 2024-09-20T18:35:50.702 INFO:tasks.workunit.client.1.smithi172.stdout:8/744: creat dd/d1b/d3b/dc7/f102 x:0 0 0 2024-09-20T18:35:50.702 INFO:tasks.workunit.client.1.smithi172.stdout:5/810: getdents d4/df/dad/d26/d41/d69/dac/d2c/dd1 0 2024-09-20T18:35:50.703 INFO:tasks.workunit.client.1.smithi172.stdout:0/963: write d4/d5/d2e/d33/de1/d15/f1b [5016184,17512] 0 2024-09-20T18:35:50.704 INFO:tasks.workunit.client.1.smithi172.stdout:8/745: write dd/d1b/d4f/d9a/dbb/fca [692671,29942] 0 2024-09-20T18:35:50.704 INFO:tasks.workunit.client.1.smithi172.stdout:9/740: write f14 [3359099,124028] 0 2024-09-20T18:35:50.706 INFO:tasks.workunit.client.0.smithi017.stdout:3/374: dwrite da/de/d13/d2f/f2e [0,4194304] 0 2024-09-20T18:35:50.707 INFO:tasks.workunit.client.1.smithi172.stdout:9/741: stat d15/d1f/d2c/d37/la9 0 2024-09-20T18:35:50.707 INFO:tasks.workunit.client.1.smithi172.stdout:5/811: read d4/df/dad/d26/d41/d69/f6e [1493702,110964] 0 2024-09-20T18:35:50.709 INFO:tasks.workunit.client.0.smithi017.stdout:3/375: unlink l7 0 2024-09-20T18:35:50.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:50 smithi172 ceph-mon[35456]: pgmap v29: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 60 MiB/s rd, 268 MiB/s wr, 501 op/s 2024-09-20T18:35:50.710 INFO:tasks.workunit.client.0.smithi017.stdout:3/376: write da/f58 [370290,73219] 0 2024-09-20T18:35:50.711 INFO:tasks.workunit.client.0.smithi017.stdout:3/377: read - da/f74 zero size 2024-09-20T18:35:50.711 INFO:tasks.workunit.client.1.smithi172.stdout:9/742: creat d15/d1f/d2c/d7d/ff3 x:0 0 0 2024-09-20T18:35:50.711 INFO:tasks.workunit.client.1.smithi172.stdout:3/835: dwrite d0/d13/d58/d6d/db9/f106 [0,4194304] 0 2024-09-20T18:35:50.712 INFO:tasks.workunit.client.1.smithi172.stdout:5/812: chown d4/df/dad/d26/d41/d69/db9/feb 92824 1 2024-09-20T18:35:50.712 INFO:tasks.workunit.client.0.smithi017.stdout:3/378: write da/f58 [2588384,37503] 0 2024-09-20T18:35:50.713 INFO:tasks.workunit.client.1.smithi172.stdout:8/746: mkdir dd/d1b/d3b/d51/d34/dee/d103 0 2024-09-20T18:35:50.714 INFO:tasks.workunit.client.1.smithi172.stdout:5/813: fdatasync d4/df/d98/dcc/fea 0 2024-09-20T18:35:50.717 INFO:tasks.workunit.client.0.smithi017.stdout:3/379: mkdir da/de/d13/d16/d6e/d82 0 2024-09-20T18:35:50.719 INFO:tasks.workunit.client.1.smithi172.stdout:9/743: creat d15/d4a/ff4 x:0 0 0 2024-09-20T18:35:50.720 INFO:tasks.workunit.client.1.smithi172.stdout:4/798: write d0/de/f5e [2681321,106631] 0 2024-09-20T18:35:50.720 INFO:tasks.workunit.client.1.smithi172.stdout:8/747: creat dd/d1b/d3b/d51/d5b/f104 x:0 0 0 2024-09-20T18:35:50.721 INFO:tasks.workunit.client.0.smithi017.stdout:3/380: creat da/de/d13/d2f/d26/d41/f83 x:0 0 0 2024-09-20T18:35:50.724 INFO:tasks.workunit.client.1.smithi172.stdout:5/814: creat d4/df/d3f/d64/d101/d63/f111 x:0 0 0 2024-09-20T18:35:50.724 INFO:tasks.workunit.client.1.smithi172.stdout:4/799: write d0/de/d21/d24/f69 [2303580,8864] 0 2024-09-20T18:35:50.726 INFO:tasks.workunit.client.1.smithi172.stdout:2/714: dwrite d0/d2c/d3f/dab/d22/d10/f93 [0,4194304] 0 2024-09-20T18:35:50.729 INFO:tasks.workunit.client.1.smithi172.stdout:9/744: dwrite d15/d1f/d2c/d37/fd0 [0,4194304] 0 2024-09-20T18:35:50.731 INFO:tasks.workunit.client.1.smithi172.stdout:4/800: symlink d0/d48/d90/d55/d53/d78/l117 0 2024-09-20T18:35:50.731 INFO:tasks.workunit.client.1.smithi172.stdout:5/815: truncate d4/df/dad/d26/d41/d69/db9/feb 299279 0 2024-09-20T18:35:50.733 INFO:tasks.workunit.client.1.smithi172.stdout:4/801: dread d0/d48/d90/d55/d53/d78/dd2/fd6 [0,4194304] 0 2024-09-20T18:35:50.735 INFO:tasks.workunit.client.1.smithi172.stdout:4/802: write d0/de/d21/d24/f2d [3714680,91423] 0 2024-09-20T18:35:50.740 INFO:tasks.workunit.client.1.smithi172.stdout:0/964: dread d4/d1a/d28/d42/d45/d54/f64 [0,4194304] 0 2024-09-20T18:35:50.756 INFO:tasks.workunit.client.1.smithi172.stdout:2/715: dread d0/d2c/d3f/f46 [0,4194304] 0 2024-09-20T18:35:50.760 INFO:tasks.workunit.client.0.smithi017.stdout:6/184: sync 2024-09-20T18:35:50.785 INFO:tasks.workunit.client.0.smithi017.stdout:6/185: mkdir d4/df/d1f/d25/d3f 0 2024-09-20T18:35:50.785 INFO:tasks.workunit.client.0.smithi017.stdout:6/186: stat d4/df/c20 0 2024-09-20T18:35:50.786 INFO:tasks.workunit.client.1.smithi172.stdout:3/836: write d0/dc/f28 [1100588,79211] 0 2024-09-20T18:35:50.786 INFO:tasks.workunit.client.0.smithi017.stdout:6/187: read d4/df/d1f/f22 [73614,125825] 0 2024-09-20T18:35:50.790 INFO:tasks.workunit.client.1.smithi172.stdout:2/716: mkdir d0/d2c/d51/de5/dec 0 2024-09-20T18:35:50.791 INFO:tasks.workunit.client.0.smithi017.stdout:6/188: dread d4/d29/f39 [0,4194304] 0 2024-09-20T18:35:50.791 INFO:tasks.workunit.client.0.smithi017.stdout:6/189: stat d4/d37 0 2024-09-20T18:35:50.792 INFO:tasks.workunit.client.1.smithi172.stdout:0/965: dwrite d4/d5/d2e/d38/d96/f11e [0,4194304] 0 2024-09-20T18:35:50.793 INFO:tasks.workunit.client.1.smithi172.stdout:3/837: dwrite d0/d13/d58/d6d/db9/dd6/ff8 [4194304,4194304] 0 2024-09-20T18:35:50.795 INFO:tasks.workunit.client.1.smithi172.stdout:2/717: write d0/d2c/d3f/dab/d22/d10/d35/d5d/fbd [646972,73526] 0 2024-09-20T18:35:50.795 INFO:tasks.workunit.client.1.smithi172.stdout:4/803: creat d0/f118 x:0 0 0 2024-09-20T18:35:50.796 INFO:tasks.workunit.client.0.smithi017.stdout:6/190: getdents d4/d37 0 2024-09-20T18:35:50.798 INFO:tasks.workunit.client.1.smithi172.stdout:6/675: sync 2024-09-20T18:35:50.799 INFO:tasks.workunit.client.1.smithi172.stdout:7/800: sync 2024-09-20T18:35:50.800 INFO:tasks.workunit.client.1.smithi172.stdout:1/735: sync 2024-09-20T18:35:50.802 INFO:tasks.workunit.client.1.smithi172.stdout:0/966: creat d4/d1a/d28/d12d/f14e x:0 0 0 2024-09-20T18:35:50.803 INFO:tasks.workunit.client.1.smithi172.stdout:3/838: mknod d0/d13/d58/d6d/dc3/c11c 0 2024-09-20T18:35:50.804 INFO:tasks.workunit.client.1.smithi172.stdout:1/736: chown d0/d8/db/d25/fe3 0 1 2024-09-20T18:35:50.804 INFO:tasks.workunit.client.0.smithi017.stdout:6/191: rmdir d4/d35 0 2024-09-20T18:35:50.807 INFO:tasks.workunit.client.1.smithi172.stdout:9/745: dwrite d15/d1f/d2c/f70 [0,4194304] 0 2024-09-20T18:35:50.807 INFO:tasks.workunit.client.0.smithi017.stdout:6/192: mknod d4/df/d1f/d25/c40 0 2024-09-20T18:35:50.808 INFO:tasks.workunit.client.1.smithi172.stdout:7/801: chown d2/d3/d10/d40/d46/d8e/dbd/cc7 1260035790 1 2024-09-20T18:35:50.811 INFO:tasks.workunit.client.0.smithi017.stdout:6/193: mkdir d4/d37/d41 0 2024-09-20T18:35:50.812 INFO:tasks.workunit.client.1.smithi172.stdout:4/804: dwrite d0/de/dc/fd7 [0,4194304] 0 2024-09-20T18:35:50.814 INFO:tasks.workunit.client.1.smithi172.stdout:7/802: creat d2/d3/d10/d40/d6a/dc6/f115 x:0 0 0 2024-09-20T18:35:50.815 INFO:tasks.workunit.client.1.smithi172.stdout:7/803: chown d2/d3/dd/d84 81816167 1 2024-09-20T18:35:50.816 INFO:tasks.workunit.client.1.smithi172.stdout:9/746: dwrite d15/d1a/d82/f3e [0,4194304] 0 2024-09-20T18:35:50.818 INFO:tasks.workunit.client.1.smithi172.stdout:2/718: rename d0/d2c/d3f/dab/d45/d7a to d0/d2c/d3f/dab/d22/ded 0 2024-09-20T18:35:50.819 INFO:tasks.workunit.client.1.smithi172.stdout:2/719: fsync d0/d90/fce 0 2024-09-20T18:35:50.820 INFO:tasks.workunit.client.1.smithi172.stdout:3/839: truncate d0/d13/d58/f4a 1185683 0 2024-09-20T18:35:50.821 INFO:tasks.workunit.client.0.smithi017.stdout:6/194: symlink d4/df/d1f/d25/d3f/l42 0 2024-09-20T18:35:50.823 INFO:tasks.workunit.client.1.smithi172.stdout:6/676: write d0/d18/d1c/d21/d26/d34/f82 [364232,129191] 0 2024-09-20T18:35:50.824 INFO:tasks.workunit.client.1.smithi172.stdout:1/737: link d0/d8/db/d39/l95 d0/d73/lf1 0 2024-09-20T18:35:50.825 INFO:tasks.workunit.client.1.smithi172.stdout:6/677: readlink d0/d18/d1c/d21/d26/d34/da2/dda/l9d 0 2024-09-20T18:35:50.827 INFO:tasks.workunit.client.1.smithi172.stdout:9/747: creat d15/d1f/d2c/d7d/d34/db5/ff5 x:0 0 0 2024-09-20T18:35:50.828 INFO:tasks.workunit.client.1.smithi172.stdout:2/720: mknod d0/d2c/d3f/dab/d22/d10/d6a/ddf/cee 0 2024-09-20T18:35:50.829 INFO:tasks.workunit.client.1.smithi172.stdout:3/840: rmdir d0/d13/d58/d6d/db9 39 2024-09-20T18:35:50.831 INFO:tasks.workunit.client.1.smithi172.stdout:1/738: truncate d0/d73/f92 989905 0 2024-09-20T18:35:50.832 INFO:tasks.workunit.client.1.smithi172.stdout:0/967: dread d4/d5/d2e/d38/d96/f10b [0,4194304] 0 2024-09-20T18:35:50.832 INFO:tasks.workunit.client.1.smithi172.stdout:2/721: chown d0/d2c/d3f/dab/d18/d29/fd8 133480711 1 2024-09-20T18:35:50.834 INFO:tasks.workunit.client.1.smithi172.stdout:3/841: fdatasync d0/d13/d58/d6d/db9/d87/f9d 0 2024-09-20T18:35:50.839 INFO:tasks.workunit.client.1.smithi172.stdout:7/804: write d2/d3/d10/f96 [604499,8575] 0 2024-09-20T18:35:50.840 INFO:tasks.workunit.client.1.smithi172.stdout:1/739: dread d0/d8/db/d39/f55 [0,4194304] 0 2024-09-20T18:35:50.841 INFO:tasks.workunit.client.1.smithi172.stdout:7/805: dread d2/d3/d10/d40/f7c [0,4194304] 0 2024-09-20T18:35:50.841 INFO:tasks.workunit.client.1.smithi172.stdout:3/842: mkdir d0/dc/d6a/dc5/d11d 0 2024-09-20T18:35:50.842 INFO:tasks.workunit.client.1.smithi172.stdout:8/748: sync 2024-09-20T18:35:50.842 INFO:tasks.workunit.client.0.smithi017.stdout:6/195: truncate d4/f14 4165000 0 2024-09-20T18:35:50.844 INFO:tasks.workunit.client.1.smithi172.stdout:6/678: link d0/d18/d1c/d21/d26/d34/d7a/f8b d0/d18/d1c/d21/d26/d34/d9c/dac/fe4 0 2024-09-20T18:35:50.847 INFO:tasks.workunit.client.0.smithi017.stdout:6/196: read d4/df/d1f/d25/d2b/f2c [2111379,48341] 0 2024-09-20T18:35:50.848 INFO:tasks.workunit.client.1.smithi172.stdout:7/806: creat d2/d3/d10/d40/d46/d8e/dbd/f116 x:0 0 0 2024-09-20T18:35:50.849 INFO:tasks.workunit.client.1.smithi172.stdout:2/722: creat d0/d2c/fef x:0 0 0 2024-09-20T18:35:50.849 INFO:tasks.workunit.client.1.smithi172.stdout:1/740: creat d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/ff2 x:0 0 0 2024-09-20T18:35:50.850 INFO:tasks.workunit.client.1.smithi172.stdout:4/805: dwrite d0/d48/d90/f37 [0,4194304] 0 2024-09-20T18:35:50.850 INFO:tasks.workunit.client.1.smithi172.stdout:3/843: symlink d0/dc/d6a/d22/l11e 0 2024-09-20T18:35:50.853 INFO:tasks.workunit.client.1.smithi172.stdout:9/748: dwrite d15/f18 [0,4194304] 0 2024-09-20T18:35:50.853 INFO:tasks.workunit.client.1.smithi172.stdout:0/968: rename d4/d94/ff1 to d4/d5/d2e/f14f 0 2024-09-20T18:35:50.855 INFO:tasks.workunit.client.1.smithi172.stdout:0/969: chown d4/d1a/d28/d42/d45/d99/dc9 32516 1 2024-09-20T18:35:50.857 INFO:tasks.workunit.client.1.smithi172.stdout:8/749: dread dd/d1b/d3b/d51/d34/f96 [0,4194304] 0 2024-09-20T18:35:50.863 INFO:tasks.workunit.client.1.smithi172.stdout:7/807: chown d2/f91 6757233 1 2024-09-20T18:35:50.864 INFO:tasks.workunit.client.1.smithi172.stdout:6/679: dwrite d0/d18/d1c/d21/d26/d34/da2/dda/d7b/d7e/fca [0,4194304] 0 2024-09-20T18:35:50.870 INFO:tasks.workunit.client.1.smithi172.stdout:8/750: dwrite dd/d1b/d4f/ddd/ff4 [0,4194304] 0 2024-09-20T18:35:50.871 INFO:tasks.workunit.client.1.smithi172.stdout:9/749: write d15/d1f/d2c/d7d/d34/db5/fd1 [4015831,77686] 0 2024-09-20T18:35:50.872 INFO:tasks.workunit.client.1.smithi172.stdout:0/970: mkdir d4/d1a/d28/d42/db8/d150 0 2024-09-20T18:35:50.874 INFO:tasks.workunit.client.1.smithi172.stdout:2/723: symlink d0/d2c/d3f/dab/d22/lf0 0 2024-09-20T18:35:50.875 INFO:tasks.workunit.client.0.smithi017.stdout:6/197: dwrite d4/f9 [0,4194304] 0 2024-09-20T18:35:50.877 INFO:tasks.workunit.client.1.smithi172.stdout:4/806: write d0/fcd [323934,112398] 0 2024-09-20T18:35:50.879 INFO:tasks.workunit.client.1.smithi172.stdout:7/808: mknod d2/d3/d10/d40/d74/dcb/c117 0 2024-09-20T18:35:50.880 INFO:tasks.workunit.client.1.smithi172.stdout:9/750: creat d15/d20/d76/dc6/ff6 x:0 0 0 2024-09-20T18:35:50.882 INFO:tasks.workunit.client.1.smithi172.stdout:2/724: dread - d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/d9f/fa3 zero size 2024-09-20T18:35:50.883 INFO:tasks.workunit.client.1.smithi172.stdout:8/751: mknod dd/d1b/d3b/d51/d5b/dc5/df1/c105 0 2024-09-20T18:35:50.888 INFO:tasks.workunit.client.1.smithi172.stdout:3/844: dread d0/d13/fc8 [0,4194304] 0 2024-09-20T18:35:50.888 INFO:tasks.workunit.client.1.smithi172.stdout:4/807: dwrite d0/de/d39/d9f/de8/f116 [0,4194304] 0 2024-09-20T18:35:50.889 INFO:tasks.workunit.client.1.smithi172.stdout:2/725: dread - d0/d2c/d3f/dab/d22/d10/d35/d5d/fae zero size 2024-09-20T18:35:50.893 INFO:tasks.workunit.client.1.smithi172.stdout:3/845: mknod d0/dc/c11f 0 2024-09-20T18:35:50.893 INFO:tasks.workunit.client.1.smithi172.stdout:2/726: mkdir d0/d2c/dca/df1 0 2024-09-20T18:35:50.894 INFO:tasks.workunit.client.1.smithi172.stdout:0/971: dwrite d4/d44/dab/f11b [0,4194304] 0 2024-09-20T18:35:50.895 INFO:tasks.workunit.client.1.smithi172.stdout:4/808: mkdir d0/de/d39/d9f/de8/d119 0 2024-09-20T18:35:50.900 INFO:tasks.workunit.client.1.smithi172.stdout:3/846: creat d0/d13/d32/d54/d83/f120 x:0 0 0 2024-09-20T18:35:50.900 INFO:tasks.workunit.client.1.smithi172.stdout:2/727: mkdir d0/d2c/d3f/dab/d22/d10/d35/dc4/df2 0 2024-09-20T18:35:50.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:50 smithi017 ceph-mon[28058]: pgmap v29: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 60 MiB/s rd, 268 MiB/s wr, 501 op/s 2024-09-20T18:35:50.902 INFO:tasks.workunit.client.0.smithi017.stdout:6/198: fsync d4/f9 0 2024-09-20T18:35:50.903 INFO:tasks.workunit.client.0.smithi017.stdout:6/199: fsync d4/f9 0 2024-09-20T18:35:50.904 INFO:tasks.workunit.client.1.smithi172.stdout:3/847: write d0/d13/d58/d6d/db9/d87/f9d [373795,25846] 0 2024-09-20T18:35:50.906 INFO:tasks.workunit.client.1.smithi172.stdout:2/728: fdatasync d0/d2c/d3f/dab/d22/d10/d35/fb0 0 2024-09-20T18:35:50.906 INFO:tasks.workunit.client.1.smithi172.stdout:1/741: dwrite d0/d8/db/d25/f49 [0,4194304] 0 2024-09-20T18:35:50.906 INFO:tasks.workunit.client.0.smithi017.stdout:7/206: sync 2024-09-20T18:35:50.906 INFO:tasks.workunit.client.0.smithi017.stdout:0/179: sync 2024-09-20T18:35:50.909 INFO:tasks.workunit.client.1.smithi172.stdout:4/809: dwrite d0/de/d39/d9f/fde [0,4194304] 0 2024-09-20T18:35:50.910 INFO:tasks.workunit.client.0.smithi017.stdout:7/207: rename da/d16/c27 to da/d16/c42 0 2024-09-20T18:35:50.911 INFO:tasks.workunit.client.0.smithi017.stdout:7/208: stat da/d16/l41 0 2024-09-20T18:35:50.912 INFO:tasks.workunit.client.0.smithi017.stdout:7/209: readlink da/d16/d1b/l2f 0 2024-09-20T18:35:50.912 INFO:tasks.workunit.client.1.smithi172.stdout:1/742: mknod d0/d8/db/d25/d6f/cf3 0 2024-09-20T18:35:50.913 INFO:tasks.workunit.client.1.smithi172.stdout:3/848: creat d0/d13/dfb/f121 x:0 0 0 2024-09-20T18:35:50.915 INFO:tasks.workunit.client.1.smithi172.stdout:4/810: mknod d0/d48/d90/d55/d53/c11a 0 2024-09-20T18:35:50.915 INFO:tasks.workunit.client.1.smithi172.stdout:8/752: write dd/d1b/d3b/d5d/d7d/f9c [3456018,70730] 0 2024-09-20T18:35:50.915 INFO:tasks.workunit.client.1.smithi172.stdout:7/809: dwrite d2/d3/d3d/f7f [0,4194304] 0 2024-09-20T18:35:50.922 INFO:tasks.workunit.client.1.smithi172.stdout:3/849: creat d0/d13/d32/d54/d83/f122 x:0 0 0 2024-09-20T18:35:50.922 INFO:tasks.workunit.client.0.smithi017.stdout:0/180: dread d4/fa [0,4194304] 0 2024-09-20T18:35:50.925 INFO:tasks.workunit.client.1.smithi172.stdout:0/972: write d4/d1a/d28/d42/d45/d99/dc9/fe3 [444254,34680] 0 2024-09-20T18:35:50.926 INFO:tasks.workunit.client.1.smithi172.stdout:0/973: readlink d4/d5/l53 0 2024-09-20T18:35:50.929 INFO:tasks.workunit.client.1.smithi172.stdout:2/729: rename d0/d2c/d3f/dab/d22/d10/l16 to d0/d2c/d3f/dab/d18/d29/d42/d4b/d53/lf3 0 2024-09-20T18:35:50.929 INFO:tasks.workunit.client.0.smithi017.stdout:6/200: write d4/df/d1f/f22 [67975,55508] 0 2024-09-20T18:35:50.931 INFO:tasks.workunit.client.0.smithi017.stdout:0/181: dwrite d4/db/d18/d25/f31 [0,4194304] 0 2024-09-20T18:35:50.931 INFO:tasks.workunit.client.0.smithi017.stdout:6/201: write d4/df/f32 [734917,112917] 0 2024-09-20T18:35:50.933 INFO:tasks.workunit.client.1.smithi172.stdout:0/974: dwrite d4/d5/d2e/d33/de1/d15/dfe/f134 [0,4194304] 0 2024-09-20T18:35:50.936 INFO:tasks.workunit.client.1.smithi172.stdout:2/730: dwrite d0/d90/fce [0,4194304] 0 2024-09-20T18:35:50.939 INFO:tasks.workunit.client.0.smithi017.stdout:6/202: truncate d4/d29/f39 2784199 0 2024-09-20T18:35:50.941 INFO:tasks.workunit.client.0.smithi017.stdout:6/203: truncate d4/f30 298552 0 2024-09-20T18:35:50.941 INFO:tasks.workunit.client.1.smithi172.stdout:8/753: creat dd/de3/f106 x:0 0 0 2024-09-20T18:35:50.942 INFO:tasks.workunit.client.0.smithi017.stdout:7/210: rename da/d16/c42 to da/d16/d1c/d40/d34/c43 0 2024-09-20T18:35:50.943 INFO:tasks.workunit.client.0.smithi017.stdout:6/204: dread d4/df/f15 [0,4194304] 0 2024-09-20T18:35:50.944 INFO:tasks.workunit.client.1.smithi172.stdout:4/811: creat d0/de/d21/f11b x:0 0 0 2024-09-20T18:35:50.944 INFO:tasks.workunit.client.0.smithi017.stdout:0/182: creat d4/db/d1e/d24/f3c x:0 0 0 2024-09-20T18:35:50.950 INFO:tasks.workunit.client.1.smithi172.stdout:1/743: truncate d0/d8/db/d25/d2b/f37 249001 0 2024-09-20T18:35:50.950 INFO:tasks.workunit.client.1.smithi172.stdout:8/754: dwrite dd/d1b/d4f/fcb [0,4194304] 0 2024-09-20T18:35:50.951 INFO:tasks.workunit.client.0.smithi017.stdout:7/211: symlink da/d16/l44 0 2024-09-20T18:35:50.952 INFO:tasks.workunit.client.1.smithi172.stdout:0/975: creat d4/d1a/d28/d42/db8/f151 x:0 0 0 2024-09-20T18:35:50.953 INFO:tasks.workunit.client.1.smithi172.stdout:2/731: creat d0/d2c/dca/ff4 x:0 0 0 2024-09-20T18:35:50.958 INFO:tasks.workunit.client.0.smithi017.stdout:7/212: dwrite da/d16/d1c/f1d [0,4194304] 0 2024-09-20T18:35:50.959 INFO:tasks.workunit.client.1.smithi172.stdout:0/976: dwrite d4/d1a/d28/d42/d45/d54/df8/f118 [0,4194304] 0 2024-09-20T18:35:50.959 INFO:tasks.workunit.client.1.smithi172.stdout:4/812: truncate d0/de/f5a 2619818 0 2024-09-20T18:35:50.961 INFO:tasks.workunit.client.1.smithi172.stdout:8/755: truncate dd/d65/d85/f8b 2603095 0 2024-09-20T18:35:50.961 INFO:tasks.workunit.client.1.smithi172.stdout:8/756: readlink dd/da9/lc2 0 2024-09-20T18:35:50.962 INFO:tasks.workunit.client.1.smithi172.stdout:5/816: sync 2024-09-20T18:35:50.962 INFO:tasks.workunit.client.1.smithi172.stdout:5/817: chown d4/fc 98 1 2024-09-20T18:35:50.964 INFO:tasks.workunit.client.1.smithi172.stdout:5/818: write d4/df/d3f/d64/f109 [595012,30393] 0 2024-09-20T18:35:50.966 INFO:tasks.workunit.client.1.smithi172.stdout:1/744: mkdir d0/d8/df4 0 2024-09-20T18:35:50.967 INFO:tasks.workunit.client.1.smithi172.stdout:0/977: mknod d4/d5/d2e/d33/c152 0 2024-09-20T18:35:50.969 INFO:tasks.workunit.client.0.smithi017.stdout:7/213: creat da/d16/d1c/d40/d3a/f45 x:0 0 0 2024-09-20T18:35:50.971 INFO:tasks.workunit.client.0.smithi017.stdout:7/214: fdatasync da/d16/d1c/f2e 0 2024-09-20T18:35:50.972 INFO:tasks.workunit.client.1.smithi172.stdout:2/732: link d0/d2c/fef d0/d90/ff5 0 2024-09-20T18:35:50.974 INFO:tasks.workunit.client.1.smithi172.stdout:4/813: rename d0/d48/d90/fbf to d0/d48/d90/d55/f11c 0 2024-09-20T18:35:50.980 INFO:tasks.workunit.client.0.smithi017.stdout:7/215: fdatasync da/f12 0 2024-09-20T18:35:50.981 INFO:tasks.workunit.client.0.smithi017.stdout:7/216: dread - da/d16/f3f zero size 2024-09-20T18:35:50.984 INFO:tasks.workunit.client.1.smithi172.stdout:5/819: rename d4/fe to d4/df/d98/dcc/d105/f112 0 2024-09-20T18:35:50.985 INFO:tasks.workunit.client.1.smithi172.stdout:3/850: truncate d0/d13/d58/d6d/db9/dd6/d101/f10e 119003 0 2024-09-20T18:35:50.987 INFO:tasks.workunit.client.0.smithi017.stdout:0/183: write f2 [4670786,85432] 0 2024-09-20T18:35:50.987 INFO:tasks.workunit.client.0.smithi017.stdout:0/184: chown d4/db/d1e 8165529 1 2024-09-20T18:35:50.991 INFO:tasks.workunit.client.1.smithi172.stdout:8/757: symlink dd/d1b/d4f/d86/de8/l107 0 2024-09-20T18:35:50.991 INFO:tasks.workunit.client.0.smithi017.stdout:7/217: creat da/d16/d1c/d40/d34/d3c/f46 x:0 0 0 2024-09-20T18:35:50.991 INFO:tasks.workunit.client.0.smithi017.stdout:6/205: write d4/df/f16 [4475047,71097] 0 2024-09-20T18:35:50.991 INFO:tasks.workunit.client.1.smithi172.stdout:1/745: fsync d0/d8/d12/f1a 0 2024-09-20T18:35:50.995 INFO:tasks.workunit.client.0.smithi017.stdout:7/218: creat da/d16/f47 x:0 0 0 2024-09-20T18:35:50.996 INFO:tasks.workunit.client.1.smithi172.stdout:5/820: dread d4/df/f89 [0,4194304] 0 2024-09-20T18:35:50.996 INFO:tasks.workunit.client.1.smithi172.stdout:2/733: fdatasync d0/d2c/d3f/dab/d22/d10/d35/d5d/f64 0 2024-09-20T18:35:51.004 INFO:tasks.workunit.client.1.smithi172.stdout:8/758: fsync dd/d1b/d3b/d5d/f60 0 2024-09-20T18:35:51.005 INFO:tasks.workunit.client.0.smithi017.stdout:6/206: mkdir d4/d37/d41/d43 0 2024-09-20T18:35:51.006 INFO:tasks.workunit.client.0.smithi017.stdout:0/185: dread d4/ff [0,4194304] 0 2024-09-20T18:35:51.006 INFO:tasks.workunit.client.0.smithi017.stdout:6/207: read d4/df/f16 [3763173,96318] 0 2024-09-20T18:35:51.007 INFO:tasks.workunit.client.0.smithi017.stdout:0/186: dread - d4/d20/f32 zero size 2024-09-20T18:35:51.008 INFO:tasks.workunit.client.0.smithi017.stdout:0/187: truncate d4/db/f12 1417249 0 2024-09-20T18:35:51.010 INFO:tasks.workunit.client.1.smithi172.stdout:0/978: dwrite d4/d5/d2e/d33/de1/fb4 [0,4194304] 0 2024-09-20T18:35:51.012 INFO:tasks.workunit.client.1.smithi172.stdout:5/821: symlink d4/df/dad/d26/d41/d69/dac/d2c/dd1/l113 0 2024-09-20T18:35:51.013 INFO:tasks.workunit.client.1.smithi172.stdout:5/822: fsync d4/df/d3f/d64/f109 0 2024-09-20T18:35:51.014 INFO:tasks.workunit.client.0.smithi017.stdout:6/208: mknod d4/df/c44 0 2024-09-20T18:35:51.017 INFO:tasks.workunit.client.1.smithi172.stdout:2/734: rename d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/d9f/le3 to d0/d1a/d58/lf6 0 2024-09-20T18:35:51.019 INFO:tasks.workunit.client.1.smithi172.stdout:3/851: fdatasync d0/dc/f2e 0 2024-09-20T18:35:51.028 INFO:tasks.workunit.client.0.smithi017.stdout:6/209: rmdir d4/df/d1f 39 2024-09-20T18:35:51.030 INFO:tasks.workunit.client.0.smithi017.stdout:7/219: getdents da/d16/d1c/d40/d34/d3c 0 2024-09-20T18:35:51.032 INFO:tasks.workunit.client.0.smithi017.stdout:7/220: dread da/f14 [0,4194304] 0 2024-09-20T18:35:51.032 INFO:tasks.workunit.client.1.smithi172.stdout:1/746: unlink d0/d8/db/f87 0 2024-09-20T18:35:51.034 INFO:tasks.workunit.client.1.smithi172.stdout:4/814: dwrite d0/d48/d90/d55/f109 [0,4194304] 0 2024-09-20T18:35:51.041 INFO:tasks.workunit.client.1.smithi172.stdout:2/735: creat d0/d2c/d3f/dab/d22/d10/d3c/ff7 x:0 0 0 2024-09-20T18:35:51.041 INFO:tasks.workunit.client.1.smithi172.stdout:4/815: dwrite d0/d48/d90/d55/f109 [0,4194304] 0 2024-09-20T18:35:51.043 INFO:tasks.workunit.client.1.smithi172.stdout:4/816: truncate d0/d48/d90/f89 13433507 0 2024-09-20T18:35:51.043 INFO:tasks.workunit.client.1.smithi172.stdout:2/736: write d0/d2c/d3f/dab/d22/d10/d35/d5d/fb9 [31493,38590] 0 2024-09-20T18:35:51.044 INFO:tasks.workunit.client.0.smithi017.stdout:6/210: rename d4/f11 to d4/d29/f45 0 2024-09-20T18:35:51.044 INFO:tasks.workunit.client.0.smithi017.stdout:6/211: fsync d4/df/d28/f2f 0 2024-09-20T18:35:51.047 INFO:tasks.workunit.client.0.smithi017.stdout:0/188: getdents d4/d20 0 2024-09-20T18:35:51.052 INFO:tasks.workunit.client.0.smithi017.stdout:7/221: rename da/f1a to da/d16/d1c/d40/d34/d3c/f48 0 2024-09-20T18:35:51.054 INFO:tasks.workunit.client.0.smithi017.stdout:6/212: dwrite d4/df/d28/f2f [0,4194304] 0 2024-09-20T18:35:51.054 INFO:tasks.workunit.client.0.smithi017.stdout:6/213: fsync d4/f21 0 2024-09-20T18:35:51.055 INFO:tasks.workunit.client.1.smithi172.stdout:8/759: write dd/d1b/d3b/d51/d5b/daf/f6e [4718,76666] 0 2024-09-20T18:35:51.057 INFO:tasks.workunit.client.0.smithi017.stdout:0/189: symlink d4/db/d28/l3d 0 2024-09-20T18:35:51.058 INFO:tasks.workunit.client.0.smithi017.stdout:0/190: dread - d4/db/d1e/f35 zero size 2024-09-20T18:35:51.059 INFO:tasks.workunit.client.1.smithi172.stdout:6/680: sync 2024-09-20T18:35:51.059 INFO:tasks.workunit.client.0.smithi017.stdout:0/191: write d4/f29 [810256,18538] 0 2024-09-20T18:35:51.060 INFO:tasks.workunit.client.0.smithi017.stdout:0/192: dread - d4/d20/f32 zero size 2024-09-20T18:35:51.062 INFO:tasks.workunit.client.1.smithi172.stdout:0/979: symlink d4/d5/d2e/d33/de1/d15/dfe/d102/l153 0 2024-09-20T18:35:51.063 INFO:tasks.workunit.client.1.smithi172.stdout:5/823: link d4/df/d3f/f10e d4/df/dad/d26/d41/d69/dac/d2c/dd1/f114 0 2024-09-20T18:35:51.063 INFO:tasks.workunit.client.1.smithi172.stdout:0/980: stat d4/f85 0 2024-09-20T18:35:51.064 INFO:tasks.workunit.client.1.smithi172.stdout:5/824: chown d4/df/dad/d26/d41/d69/f6e 106 1 2024-09-20T18:35:51.065 INFO:tasks.workunit.client.1.smithi172.stdout:0/981: write d4/d5/d2e/d38/f4b [5745370,114085] 0 2024-09-20T18:35:51.066 INFO:tasks.workunit.client.0.smithi017.stdout:6/214: truncate d4/f8 871102 0 2024-09-20T18:35:51.067 INFO:tasks.workunit.client.1.smithi172.stdout:0/982: fsync d4/d1a/d28/d42/d45/d54/f89 0 2024-09-20T18:35:51.067 INFO:tasks.workunit.client.1.smithi172.stdout:0/983: stat d4/d1a/d28/d42/db8/c142 0 2024-09-20T18:35:51.068 INFO:tasks.workunit.client.0.smithi017.stdout:0/193: dwrite d4/db/d18/d25/f31 [0,4194304] 0 2024-09-20T18:35:51.069 INFO:tasks.workunit.client.1.smithi172.stdout:0/984: read - d4/d1a/d28/d42/d45/d99/dc9/f9b zero size 2024-09-20T18:35:51.070 INFO:tasks.workunit.client.0.smithi017.stdout:0/194: write d4/db/d1e/d24/f3c [763696,116695] 0 2024-09-20T18:35:51.075 INFO:tasks.workunit.client.0.smithi017.stdout:1/106: sync 2024-09-20T18:35:51.075 INFO:tasks.workunit.client.1.smithi172.stdout:3/852: mkdir d0/d13/d32/d123 0 2024-09-20T18:35:51.078 INFO:tasks.workunit.client.0.smithi017.stdout:0/195: dwrite d4/db/f2c [0,4194304] 0 2024-09-20T18:35:51.079 INFO:tasks.workunit.client.0.smithi017.stdout:7/222: creat da/f49 x:0 0 0 2024-09-20T18:35:51.084 INFO:tasks.workunit.client.0.smithi017.stdout:1/107: dwrite df/f10 [0,4194304] 0 2024-09-20T18:35:51.085 INFO:tasks.workunit.client.1.smithi172.stdout:8/760: mkdir dd/d1b/d3b/d51/d5b/d6b/d108 0 2024-09-20T18:35:51.087 INFO:tasks.workunit.client.1.smithi172.stdout:2/737: dread d0/d2c/d3f/f4a [0,4194304] 0 2024-09-20T18:35:51.087 INFO:tasks.workunit.client.0.smithi017.stdout:6/215: chown d4/df/d1f/d25/d2b 448719741 1 2024-09-20T18:35:51.088 INFO:tasks.workunit.client.1.smithi172.stdout:6/681: creat d0/d18/d1c/d21/d26/d34/da2/dda/d7b/fe5 x:0 0 0 2024-09-20T18:35:51.089 INFO:tasks.workunit.client.0.smithi017.stdout:6/216: dread - d4/fd zero size 2024-09-20T18:35:51.091 INFO:tasks.workunit.client.0.smithi017.stdout:7/223: dwrite da/f2a [0,4194304] 0 2024-09-20T18:35:51.092 INFO:tasks.workunit.client.0.smithi017.stdout:6/217: write d4/f21 [251013,68185] 0 2024-09-20T18:35:51.098 INFO:tasks.workunit.client.1.smithi172.stdout:0/985: read d4/d1a/d28/d42/ffd [647381,34771] 0 2024-09-20T18:35:51.102 INFO:tasks.workunit.client.0.smithi017.stdout:7/224: creat da/d16/f4a x:0 0 0 2024-09-20T18:35:51.103 INFO:tasks.workunit.client.1.smithi172.stdout:1/747: rename d0/d8/db/f1b to d0/d8/ff5 0 2024-09-20T18:35:51.104 INFO:tasks.workunit.client.1.smithi172.stdout:1/748: dread - d0/d8/db/fe8 zero size 2024-09-20T18:35:51.107 INFO:tasks.workunit.client.1.smithi172.stdout:2/738: creat d0/d2c/d3f/dab/d22/d10/d35/dc4/ff8 x:0 0 0 2024-09-20T18:35:51.108 INFO:tasks.workunit.client.1.smithi172.stdout:2/739: write d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/dbb/f9e [683580,13316] 0 2024-09-20T18:35:51.109 INFO:tasks.workunit.client.0.smithi017.stdout:6/218: rename d4/f30 to d4/f46 0 2024-09-20T18:35:51.109 INFO:tasks.workunit.client.0.smithi017.stdout:0/196: dread d4/f8 [0,4194304] 0 2024-09-20T18:35:51.110 INFO:tasks.workunit.client.0.smithi017.stdout:6/219: chown d4/df/f32 2153 1 2024-09-20T18:35:51.112 INFO:tasks.workunit.client.1.smithi172.stdout:5/825: symlink d4/df/d3f/d64/d101/l115 0 2024-09-20T18:35:51.114 INFO:tasks.workunit.client.0.smithi017.stdout:7/225: rename da/d16/f32 to da/d16/d1c/d40/d3a/f4b 0 2024-09-20T18:35:51.116 INFO:tasks.workunit.client.1.smithi172.stdout:0/986: creat d4/d5/d2e/d76/f154 x:0 0 0 2024-09-20T18:35:51.117 INFO:tasks.workunit.client.1.smithi172.stdout:0/987: fdatasync d4/d1a/d28/d42/d45/f52 0 2024-09-20T18:35:51.120 INFO:tasks.workunit.client.1.smithi172.stdout:6/682: dread d0/d18/d1c/d21/d26/d34/d7a/f2e [0,4194304] 0 2024-09-20T18:35:51.122 INFO:tasks.workunit.client.1.smithi172.stdout:4/817: rename d0/d7/db7 to d0/d48/d90/d55/d53/d5c/d11d 0 2024-09-20T18:35:51.122 INFO:tasks.workunit.client.1.smithi172.stdout:4/818: readlink d0/de/dc/d3c/d99/la9 0 2024-09-20T18:35:51.128 INFO:tasks.workunit.client.0.smithi017.stdout:0/197: symlink d4/db/l3e 0 2024-09-20T18:35:51.128 INFO:tasks.workunit.client.1.smithi172.stdout:7/810: sync 2024-09-20T18:35:51.128 INFO:tasks.workunit.client.1.smithi172.stdout:9/751: sync 2024-09-20T18:35:51.129 INFO:tasks.workunit.client.1.smithi172.stdout:9/752: fdatasync d15/fd2 0 2024-09-20T18:35:51.130 INFO:tasks.workunit.client.0.smithi017.stdout:6/220: write d4/df/d1f/d25/f27 [3299406,113730] 0 2024-09-20T18:35:51.131 INFO:tasks.workunit.client.1.smithi172.stdout:9/753: fdatasync d15/d1f/d2c/d37/f63 0 2024-09-20T18:35:51.134 INFO:tasks.workunit.client.0.smithi017.stdout:0/198: rename d4/c7 to d4/d20/c3f 0 2024-09-20T18:35:51.135 INFO:tasks.workunit.client.1.smithi172.stdout:3/853: dwrite d0/dc/fd1 [0,4194304] 0 2024-09-20T18:35:51.135 INFO:tasks.workunit.client.1.smithi172.stdout:4/819: dread d0/de/dc/d3c/f5f [0,4194304] 0 2024-09-20T18:35:51.135 INFO:tasks.workunit.client.0.smithi017.stdout:7/226: write da/f14 [1378585,5040] 0 2024-09-20T18:35:51.139 INFO:tasks.workunit.client.0.smithi017.stdout:0/199: getdents d4/db/d18/d25/d36 0 2024-09-20T18:35:51.139 INFO:tasks.workunit.client.1.smithi172.stdout:5/826: write d4/fc [258776,111506] 0 2024-09-20T18:35:51.142 INFO:tasks.workunit.client.0.smithi017.stdout:6/221: link d4/d29/c34 d4/d37/c47 0 2024-09-20T18:35:51.144 INFO:tasks.workunit.client.0.smithi017.stdout:6/222: write d4/df/d1f/f38 [681625,104897] 0 2024-09-20T18:35:51.144 INFO:tasks.workunit.client.0.smithi017.stdout:0/200: mknod d4/db/d1e/c40 0 2024-09-20T18:35:51.145 INFO:tasks.workunit.client.0.smithi017.stdout:7/227: dread da/f13 [0,4194304] 0 2024-09-20T18:35:51.146 INFO:tasks.workunit.client.0.smithi017.stdout:7/228: fdatasync da/f2a 0 2024-09-20T18:35:51.147 INFO:tasks.workunit.client.1.smithi172.stdout:3/854: dwrite d0/dc/d6a/d22/f7a [0,4194304] 0 2024-09-20T18:35:51.147 INFO:tasks.workunit.client.1.smithi172.stdout:2/740: dwrite d0/d2c/d3f/f8a [0,4194304] 0 2024-09-20T18:35:51.149 INFO:tasks.workunit.client.1.smithi172.stdout:0/988: link d4/d1a/d28/d12d/f14e d4/d5/d2e/d33/de1/dac/dbc/f155 0 2024-09-20T18:35:51.150 INFO:tasks.workunit.client.0.smithi017.stdout:0/201: mknod d4/c41 0 2024-09-20T18:35:51.152 INFO:tasks.workunit.client.1.smithi172.stdout:8/761: getdents dd/d1b/d4f 0 2024-09-20T18:35:51.154 INFO:tasks.workunit.client.1.smithi172.stdout:1/749: rmdir d0/d8/db/d25/d6d/ddd 0 2024-09-20T18:35:51.158 INFO:tasks.workunit.client.0.smithi017.stdout:7/229: rmdir da/d16/d1c/d40/d34/d3c 39 2024-09-20T18:35:51.159 INFO:tasks.workunit.client.0.smithi017.stdout:7/230: chown da/f22 2 1 2024-09-20T18:35:51.160 INFO:tasks.workunit.client.1.smithi172.stdout:7/811: readlink d2/d3/d3d/d4e/l102 0 2024-09-20T18:35:51.161 INFO:tasks.workunit.client.1.smithi172.stdout:4/820: write d0/d48/d90/d55/d53/d5c/f75 [337679,34094] 0 2024-09-20T18:35:51.166 INFO:tasks.workunit.client.0.smithi017.stdout:7/231: dwrite da/f14 [0,4194304] 0 2024-09-20T18:35:51.168 INFO:tasks.workunit.client.1.smithi172.stdout:5/827: creat d4/df/dad/d26/d41/d69/dac/da7/dd8/f116 x:0 0 0 2024-09-20T18:35:51.169 INFO:tasks.workunit.client.1.smithi172.stdout:9/754: truncate d15/f18 2658547 0 2024-09-20T18:35:51.170 INFO:tasks.workunit.client.0.smithi017.stdout:0/202: mkdir d4/db/d1e/d42 0 2024-09-20T18:35:51.171 INFO:tasks.workunit.client.0.smithi017.stdout:7/232: creat da/d16/d1c/f4c x:0 0 0 2024-09-20T18:35:51.172 INFO:tasks.workunit.client.0.smithi017.stdout:7/233: chown da/d16/d1b/l2f 194255 1 2024-09-20T18:35:51.173 INFO:tasks.workunit.client.0.smithi017.stdout:6/223: getdents d4/df/d1f 0 2024-09-20T18:35:51.174 INFO:tasks.workunit.client.0.smithi017.stdout:7/234: fdatasync da/d16/d1c/d40/d3a/f45 0 2024-09-20T18:35:51.174 INFO:tasks.workunit.client.0.smithi017.stdout:7/235: readlink da/l19 0 2024-09-20T18:35:51.176 INFO:tasks.workunit.client.1.smithi172.stdout:0/989: rename d4/d5/d2e/d33/de1/fb4 to d4/d5/d2e/d76/f156 0 2024-09-20T18:35:51.176 INFO:tasks.workunit.client.1.smithi172.stdout:7/812: dread d2/d3/d3d/d4e/f5d [0,4194304] 0 2024-09-20T18:35:51.176 INFO:tasks.workunit.client.0.smithi017.stdout:6/224: mknod d4/df/d1f/d25/d2b/c48 0 2024-09-20T18:35:51.176 INFO:tasks.workunit.client.1.smithi172.stdout:8/762: creat dd/d1b/d3b/d51/d34/dee/f109 x:0 0 0 2024-09-20T18:35:51.177 INFO:tasks.workunit.client.1.smithi172.stdout:4/821: fdatasync d0/f6d 0 2024-09-20T18:35:51.178 INFO:tasks.workunit.client.0.smithi017.stdout:0/203: dread d4/f29 [0,4194304] 0 2024-09-20T18:35:51.178 INFO:tasks.workunit.client.1.smithi172.stdout:4/822: stat d0/c1 0 2024-09-20T18:35:51.178 INFO:tasks.workunit.client.1.smithi172.stdout:8/763: stat dd/d1b/d3b/d51/d5b/c5f 0 2024-09-20T18:35:51.179 INFO:tasks.workunit.client.1.smithi172.stdout:9/755: symlink d15/d4a/lf7 0 2024-09-20T18:35:51.180 INFO:tasks.workunit.client.1.smithi172.stdout:5/828: chown d4/df/dad/d26/d41/l60 891595522 1 2024-09-20T18:35:51.180 INFO:tasks.workunit.client.1.smithi172.stdout:1/750: dread d0/d8/db/d25/d6d/f7e [0,4194304] 0 2024-09-20T18:35:51.180 INFO:tasks.workunit.client.1.smithi172.stdout:9/756: chown d15/d54/f60 96 1 2024-09-20T18:35:51.180 INFO:tasks.workunit.client.1.smithi172.stdout:3/855: mkdir d0/d13/d32/d54/d71/d124 0 2024-09-20T18:35:51.181 INFO:tasks.workunit.client.0.smithi017.stdout:7/236: dread da/d16/d1c/f1f [0,4194304] 0 2024-09-20T18:35:51.187 INFO:tasks.workunit.client.0.smithi017.stdout:7/237: stat da/cf 0 2024-09-20T18:35:51.187 INFO:tasks.workunit.client.1.smithi172.stdout:0/990: fsync d4/d1a/d28/d42/db8/fc2 0 2024-09-20T18:35:51.192 INFO:tasks.workunit.client.0.smithi017.stdout:0/204: dread d4/f11 [0,4194304] 0 2024-09-20T18:35:51.193 INFO:tasks.workunit.client.0.smithi017.stdout:7/238: dwrite da/d16/d1c/f2e [0,4194304] 0 2024-09-20T18:35:51.196 INFO:tasks.workunit.client.1.smithi172.stdout:4/823: unlink d0/f63 0 2024-09-20T18:35:51.197 INFO:tasks.workunit.client.1.smithi172.stdout:7/813: rename d2/d3/d10/d40/d6a/fca to d2/d23/d51/f118 0 2024-09-20T18:35:51.197 INFO:tasks.workunit.client.1.smithi172.stdout:8/764: symlink dd/d1b/d4f/d9a/dbb/l10a 0 2024-09-20T18:35:51.197 INFO:tasks.workunit.client.0.smithi017.stdout:0/205: fsync d4/ff 0 2024-09-20T18:35:51.198 INFO:tasks.workunit.client.1.smithi172.stdout:8/765: readlink dd/l12 0 2024-09-20T18:35:51.199 INFO:tasks.workunit.client.1.smithi172.stdout:1/751: write d0/feb [4049672,52051] 0 2024-09-20T18:35:51.199 INFO:tasks.workunit.client.1.smithi172.stdout:5/829: rmdir d4/df/d3f/d64/d101/dce 39 2024-09-20T18:35:51.199 INFO:tasks.workunit.client.1.smithi172.stdout:2/741: dwrite d0/d2c/d3f/dab/d22/d4c/f72 [0,4194304] 0 2024-09-20T18:35:51.199 INFO:tasks.workunit.client.1.smithi172.stdout:7/814: readlink d2/d3/d10/l99 0 2024-09-20T18:35:51.201 INFO:tasks.workunit.client.1.smithi172.stdout:3/856: mkdir d0/d13/d58/d6d/db9/dd6/d101/d125 0 2024-09-20T18:35:51.201 INFO:tasks.workunit.client.0.smithi017.stdout:6/225: write d4/df/d1f/d25/d2b/f2c [2587444,11935] 0 2024-09-20T18:35:51.202 INFO:tasks.workunit.client.0.smithi017.stdout:0/206: creat d4/d20/f43 x:0 0 0 2024-09-20T18:35:51.204 INFO:tasks.workunit.client.1.smithi172.stdout:2/742: read - d0/d1a/dc0/fcc zero size 2024-09-20T18:35:51.204 INFO:tasks.workunit.client.1.smithi172.stdout:1/752: read - d0/d8/db/fe8 zero size 2024-09-20T18:35:51.208 INFO:tasks.workunit.client.0.smithi017.stdout:0/207: rename d4/d20/d38 to d4/db/d28/d44 0 2024-09-20T18:35:51.208 INFO:tasks.workunit.client.1.smithi172.stdout:2/743: dread d0/d2c/d3f/dab/d22/d10/d35/fb0 [0,4194304] 0 2024-09-20T18:35:51.213 INFO:tasks.workunit.client.0.smithi017.stdout:0/208: creat d4/db/d1e/d24/f45 x:0 0 0 2024-09-20T18:35:51.214 INFO:tasks.workunit.client.1.smithi172.stdout:2/744: dwrite d0/d2c/d3f/dab/d22/d10/d3c/d68/f73 [0,4194304] 0 2024-09-20T18:35:51.214 INFO:tasks.workunit.client.0.smithi017.stdout:0/209: truncate d4/d20/f2e 568966 0 2024-09-20T18:35:51.216 INFO:tasks.workunit.client.0.smithi017.stdout:0/210: write d4/d37/f3a [493726,107330] 0 2024-09-20T18:35:51.217 INFO:tasks.workunit.client.0.smithi017.stdout:0/211: write d4/db/f3b [591000,55320] 0 2024-09-20T18:35:51.224 INFO:tasks.workunit.client.0.smithi017.stdout:7/239: truncate da/d16/d1b/f2c 567990 0 2024-09-20T18:35:51.226 INFO:tasks.workunit.client.1.smithi172.stdout:6/683: sync 2024-09-20T18:35:51.226 INFO:tasks.workunit.client.0.smithi017.stdout:6/226: dread d4/df/d1f/d25/f27 [0,4194304] 0 2024-09-20T18:35:51.227 INFO:tasks.workunit.client.0.smithi017.stdout:6/227: fsync d4/df/d28/f2f 0 2024-09-20T18:35:51.228 INFO:tasks.workunit.client.0.smithi017.stdout:6/228: chown d4/df/f32 6700864 1 2024-09-20T18:35:51.230 INFO:tasks.workunit.client.0.smithi017.stdout:0/212: link d4/db/c13 d4/db/d1e/d42/c46 0 2024-09-20T18:35:51.232 INFO:tasks.workunit.client.0.smithi017.stdout:7/240: write da/d16/d1c/d40/d34/d3c/f48 [2057710,95783] 0 2024-09-20T18:35:51.234 INFO:tasks.workunit.client.0.smithi017.stdout:7/241: chown da/d16/d1c/c20 710457680 1 2024-09-20T18:35:51.235 INFO:tasks.workunit.client.0.smithi017.stdout:6/229: dwrite d4/df/d28/f2f [0,4194304] 0 2024-09-20T18:35:51.238 INFO:tasks.workunit.client.0.smithi017.stdout:0/213: rename d4/db/d28 to d4/db/d18/d25/d36/d47 0 2024-09-20T18:35:51.242 INFO:tasks.workunit.client.0.smithi017.stdout:7/242: dwrite da/d16/f4a [0,4194304] 0 2024-09-20T18:35:51.243 INFO:tasks.workunit.client.0.smithi017.stdout:0/214: fsync d4/fa 0 2024-09-20T18:35:51.244 INFO:tasks.workunit.client.0.smithi017.stdout:0/215: write d4/db/f12 [434094,6376] 0 2024-09-20T18:35:51.246 INFO:tasks.workunit.client.0.smithi017.stdout:6/230: mknod d4/d37/d41/d43/c49 0 2024-09-20T18:35:51.252 INFO:tasks.workunit.client.0.smithi017.stdout:0/216: dwrite d4/db/f12 [0,4194304] 0 2024-09-20T18:35:51.260 INFO:tasks.workunit.client.0.smithi017.stdout:0/217: unlink d4/db/d1e/d24/f3c 0 2024-09-20T18:35:51.263 INFO:tasks.workunit.client.0.smithi017.stdout:6/231: mkdir d4/df/d4a 0 2024-09-20T18:35:51.264 INFO:tasks.workunit.client.0.smithi017.stdout:5/217: sync 2024-09-20T18:35:51.264 INFO:tasks.workunit.client.0.smithi017.stdout:4/185: sync 2024-09-20T18:35:51.264 INFO:tasks.workunit.client.0.smithi017.stdout:2/323: sync 2024-09-20T18:35:51.267 INFO:tasks.workunit.client.0.smithi017.stdout:7/243: link da/d16/d1c/c31 da/d16/d1c/d40/d34/d3c/c4d 0 2024-09-20T18:35:51.268 INFO:tasks.workunit.client.0.smithi017.stdout:7/244: read da/f14 [1814576,105893] 0 2024-09-20T18:35:51.268 INFO:tasks.workunit.client.0.smithi017.stdout:7/245: chown da/c1e 27 1 2024-09-20T18:35:51.269 INFO:tasks.workunit.client.0.smithi017.stdout:6/232: truncate d4/df/f15 828481 0 2024-09-20T18:35:51.272 INFO:tasks.workunit.client.0.smithi017.stdout:4/186: unlink d4/fa 0 2024-09-20T18:35:51.275 INFO:tasks.workunit.client.0.smithi017.stdout:6/233: dwrite d4/f9 [0,4194304] 0 2024-09-20T18:35:51.276 INFO:tasks.workunit.client.0.smithi017.stdout:0/218: symlink d4/db/d1e/d24/d2f/l48 0 2024-09-20T18:35:51.281 INFO:tasks.workunit.client.0.smithi017.stdout:4/187: dwrite d4/f2c [0,4194304] 0 2024-09-20T18:35:51.283 INFO:tasks.workunit.client.0.smithi017.stdout:7/246: creat da/d16/d1c/d40/d34/d3c/f4e x:0 0 0 2024-09-20T18:35:51.283 INFO:tasks.workunit.client.0.smithi017.stdout:1/108: sync 2024-09-20T18:35:51.283 INFO:tasks.workunit.client.0.smithi017.stdout:3/381: sync 2024-09-20T18:35:51.283 INFO:tasks.workunit.client.0.smithi017.stdout:9/237: sync 2024-09-20T18:35:51.284 INFO:tasks.workunit.client.0.smithi017.stdout:8/210: sync 2024-09-20T18:35:51.284 INFO:tasks.workunit.client.0.smithi017.stdout:1/109: stat ce 0 2024-09-20T18:35:51.284 INFO:tasks.workunit.client.1.smithi172.stdout:9/757: creat d15/d1f/d2c/d7d/d48/df0/ff8 x:0 0 0 2024-09-20T18:35:51.285 INFO:tasks.workunit.client.1.smithi172.stdout:9/758: write f14 [668860,125142] 0 2024-09-20T18:35:51.285 INFO:tasks.workunit.client.1.smithi172.stdout:9/759: readlink d15/l99 0 2024-09-20T18:35:51.286 INFO:tasks.workunit.client.0.smithi017.stdout:2/324: symlink d1/dc/d20/l6a 0 2024-09-20T18:35:51.286 INFO:tasks.workunit.client.0.smithi017.stdout:1/110: write df/f18 [4635913,39774] 0 2024-09-20T18:35:51.287 INFO:tasks.workunit.client.0.smithi017.stdout:8/211: write d0/d6/d28/f29 [1785531,109316] 0 2024-09-20T18:35:51.289 INFO:tasks.workunit.client.0.smithi017.stdout:8/212: readlink d0/d6/l17 0 2024-09-20T18:35:51.290 INFO:tasks.workunit.client.1.smithi172.stdout:8/766: dread dd/d65/d85/fcc [0,4194304] 0 2024-09-20T18:35:51.290 INFO:tasks.workunit.client.1.smithi172.stdout:8/767: fdatasync dd/d65/f7f 0 2024-09-20T18:35:51.291 INFO:tasks.workunit.client.0.smithi017.stdout:5/218: mknod d0/d14/d18/d3e/c44 0 2024-09-20T18:35:51.294 INFO:tasks.workunit.client.0.smithi017.stdout:1/111: dread df/f1a [0,4194304] 0 2024-09-20T18:35:51.295 INFO:tasks.workunit.client.0.smithi017.stdout:1/112: chown fc 358 1 2024-09-20T18:35:51.298 INFO:tasks.workunit.client.1.smithi172.stdout:3/857: rmdir d0/d13/d58/d6d/db9/dd6 39 2024-09-20T18:35:51.300 INFO:tasks.workunit.client.0.smithi017.stdout:0/219: unlink d4/db/l14 0 2024-09-20T18:35:51.300 INFO:tasks.workunit.client.0.smithi017.stdout:5/219: dread d0/ff [0,4194304] 0 2024-09-20T18:35:51.302 INFO:tasks.workunit.client.0.smithi017.stdout:0/220: write d4/db/f12 [1441717,62674] 0 2024-09-20T18:35:51.303 INFO:tasks.workunit.client.1.smithi172.stdout:7/815: truncate d2/d3/dd/f4c 1280902 0 2024-09-20T18:35:51.303 INFO:tasks.workunit.client.1.smithi172.stdout:7/816: stat d2/d3/d3d/d68/cb2 0 2024-09-20T18:35:51.304 INFO:tasks.workunit.client.0.smithi017.stdout:1/113: dwrite df/f18 [0,4194304] 0 2024-09-20T18:35:51.305 INFO:tasks.workunit.client.0.smithi017.stdout:4/188: creat d4/dc/d1e/d26/d22/f36 x:0 0 0 2024-09-20T18:35:51.307 INFO:tasks.workunit.client.0.smithi017.stdout:0/221: write d4/db/d1e/d24/f30 [536206,43130] 0 2024-09-20T18:35:51.309 INFO:tasks.workunit.client.1.smithi172.stdout:1/753: symlink d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dd5/lf6 0 2024-09-20T18:35:51.309 INFO:tasks.workunit.client.1.smithi172.stdout:6/684: sync 2024-09-20T18:35:51.311 INFO:tasks.workunit.client.0.smithi017.stdout:9/238: dread d6/f37 [0,4194304] 0 2024-09-20T18:35:51.314 INFO:tasks.workunit.client.0.smithi017.stdout:1/114: dwrite df/f18 [0,4194304] 0 2024-09-20T18:35:51.320 INFO:tasks.workunit.client.1.smithi172.stdout:9/760: creat d15/d1f/d2c/d7d/d48/df0/ff9 x:0 0 0 2024-09-20T18:35:51.323 INFO:tasks.workunit.client.0.smithi017.stdout:2/325: mkdir d1/dc/d58/d53/d6b 0 2024-09-20T18:35:51.328 INFO:tasks.workunit.client.0.smithi017.stdout:6/234: creat d4/df/d4a/f4b x:0 0 0 2024-09-20T18:35:51.329 INFO:tasks.workunit.client.1.smithi172.stdout:3/858: mknod d0/d13/d32/d54/d83/c126 0 2024-09-20T18:35:51.332 INFO:tasks.workunit.client.1.smithi172.stdout:5/830: mkdir d4/df/d3f/d64/d101/d117 0 2024-09-20T18:35:51.332 INFO:tasks.workunit.client.0.smithi017.stdout:5/220: rmdir d0/d14/d18/d19 39 2024-09-20T18:35:51.333 INFO:tasks.workunit.client.1.smithi172.stdout:5/831: write d4/df/fc0 [148741,55881] 0 2024-09-20T18:35:51.333 INFO:tasks.workunit.client.1.smithi172.stdout:5/832: stat d4/f91 0 2024-09-20T18:35:51.335 INFO:tasks.workunit.client.1.smithi172.stdout:7/817: write d2/d23/d9d/fc4 [1131054,72994] 0 2024-09-20T18:35:51.338 INFO:tasks.workunit.client.0.smithi017.stdout:4/189: mkdir d4/d19/d37 0 2024-09-20T18:35:51.338 INFO:tasks.workunit.client.0.smithi017.stdout:4/190: readlink d4/l8 0 2024-09-20T18:35:51.341 INFO:tasks.workunit.client.1.smithi172.stdout:2/745: write d0/d2c/d3f/dab/d18/d29/d42/d4b/d53/fa2 [392895,66834] 0 2024-09-20T18:35:51.342 INFO:tasks.workunit.client.0.smithi017.stdout:7/247: rename da/d16/d1c/d40/l3e to da/d16/l4f 0 2024-09-20T18:35:51.343 INFO:tasks.workunit.client.1.smithi172.stdout:8/768: symlink dd/d65/df5/l10b 0 2024-09-20T18:35:51.343 INFO:tasks.workunit.client.0.smithi017.stdout:7/248: readlink da/d16/d1b/l2b 0 2024-09-20T18:35:51.343 INFO:tasks.workunit.client.1.smithi172.stdout:8/769: chown dd/d1b/d3b/d51/d34/f96 1 1 2024-09-20T18:35:51.344 INFO:tasks.workunit.client.0.smithi017.stdout:1/115: mkdir df/d1c 0 2024-09-20T18:35:51.344 INFO:tasks.workunit.client.0.smithi017.stdout:3/382: write da/de/d53/d52/f63 [537206,124219] 0 2024-09-20T18:35:51.346 INFO:tasks.workunit.client.1.smithi172.stdout:4/824: rename d0/de/d39/d9f/fc5 to d0/d48/d90/d55/d101/d18/d51/f11e 0 2024-09-20T18:35:51.347 INFO:tasks.workunit.client.1.smithi172.stdout:0/991: link d4/d1a/d28/d42/db8/c131 d4/d1a/d28/d75/d60/dba/c157 0 2024-09-20T18:35:51.347 INFO:tasks.workunit.client.1.smithi172.stdout:0/992: fdatasync d4/d1a/fb5 0 2024-09-20T18:35:51.352 INFO:tasks.workunit.client.1.smithi172.stdout:5/833: rmdir d4/df/d3f/d64/d101/d63/d80 39 2024-09-20T18:35:51.353 INFO:tasks.workunit.client.0.smithi017.stdout:5/221: read d0/d14/f20 [3248975,60181] 0 2024-09-20T18:35:51.355 INFO:tasks.workunit.client.1.smithi172.stdout:7/818: unlink d2/d3/d10/d40/d6a/fb4 0 2024-09-20T18:35:51.357 INFO:tasks.workunit.client.1.smithi172.stdout:6/685: unlink d0/d18/d1c/d21/l83 0 2024-09-20T18:35:51.358 INFO:tasks.workunit.client.1.smithi172.stdout:1/754: mkdir d0/d8/db/d25/d2b/d3d/d65/d93/dbb/df7 0 2024-09-20T18:35:51.363 INFO:tasks.workunit.client.0.smithi017.stdout:8/213: rename d0/d6/f43 to d0/d6/d28/d3b/f45 0 2024-09-20T18:35:51.364 INFO:tasks.workunit.client.1.smithi172.stdout:2/746: mknod d0/d1a/dc0/cf9 0 2024-09-20T18:35:51.366 INFO:tasks.workunit.client.1.smithi172.stdout:8/770: mkdir dd/de3/d10c 0 2024-09-20T18:35:51.366 INFO:tasks.workunit.client.1.smithi172.stdout:3/859: write d0/d13/d58/d6d/f77 [1000153,32670] 0 2024-09-20T18:35:51.367 INFO:tasks.workunit.client.1.smithi172.stdout:3/860: dread - d0/d13/dfe/f114 zero size 2024-09-20T18:35:51.369 INFO:tasks.workunit.client.1.smithi172.stdout:4/825: mknod d0/d48/d90/dea/c11f 0 2024-09-20T18:35:51.370 INFO:tasks.workunit.client.1.smithi172.stdout:4/826: write d0/de/dc/fd7 [2020371,53411] 0 2024-09-20T18:35:51.371 INFO:tasks.workunit.client.1.smithi172.stdout:3/861: dread d0/dc/d6a/d22/f7a [0,4194304] 0 2024-09-20T18:35:51.371 INFO:tasks.workunit.client.1.smithi172.stdout:0/993: mkdir d4/d20/d158 0 2024-09-20T18:35:51.372 INFO:tasks.workunit.client.0.smithi017.stdout:0/222: write d4/db/d18/f22 [1117268,121879] 0 2024-09-20T18:35:51.374 INFO:tasks.workunit.client.1.smithi172.stdout:5/834: creat d4/df/dad/dd4/f118 x:0 0 0 2024-09-20T18:35:51.376 INFO:tasks.workunit.client.0.smithi017.stdout:9/239: rename d6/d23/d58/d3f/d2f/d5d/f55 to d6/d23/d3a/f62 0 2024-09-20T18:35:51.377 INFO:tasks.workunit.client.1.smithi172.stdout:9/761: dwrite d15/d20/d76/f84 [0,4194304] 0 2024-09-20T18:35:51.377 INFO:tasks.workunit.client.1.smithi172.stdout:7/819: fdatasync d2/d3/d10/f14 0 2024-09-20T18:35:51.378 INFO:tasks.workunit.client.0.smithi017.stdout:8/214: mknod d0/d6/d28/d3a/c46 0 2024-09-20T18:35:51.380 INFO:tasks.workunit.client.0.smithi017.stdout:7/249: mkdir da/d16/d1c/d40/d30/d50 0 2024-09-20T18:35:51.383 INFO:tasks.workunit.client.1.smithi172.stdout:6/686: creat d0/d18/d1c/d21/d26/d34/d9c/fe6 x:0 0 0 2024-09-20T18:35:51.384 INFO:tasks.workunit.client.0.smithi017.stdout:7/250: dread da/d16/d1c/f1f [0,4194304] 0 2024-09-20T18:35:51.384 INFO:tasks.workunit.client.1.smithi172.stdout:6/687: dread - d0/d18/d1c/d21/d26/d34/da2/dda/d62/fc4 zero size 2024-09-20T18:35:51.385 INFO:tasks.workunit.client.1.smithi172.stdout:1/755: write d0/d8/d12/fd9 [290978,109611] 0 2024-09-20T18:35:51.391 INFO:tasks.workunit.client.1.smithi172.stdout:6/688: dread d0/d18/d1c/d21/d26/f45 [0,4194304] 0 2024-09-20T18:35:51.391 INFO:tasks.workunit.client.0.smithi017.stdout:4/191: creat d4/f38 x:0 0 0 2024-09-20T18:35:51.394 INFO:tasks.workunit.client.0.smithi017.stdout:0/223: unlink d4/d20/l26 0 2024-09-20T18:35:51.395 INFO:tasks.workunit.client.0.smithi017.stdout:0/224: write d4/db/fe [807331,84415] 0 2024-09-20T18:35:51.396 INFO:tasks.workunit.client.0.smithi017.stdout:0/225: readlink d4/db/d18/d25/d36/d47/l2b 0 2024-09-20T18:35:51.397 INFO:tasks.workunit.client.0.smithi017.stdout:0/226: dread - d4/d20/f2a zero size 2024-09-20T18:35:51.398 INFO:tasks.workunit.client.1.smithi172.stdout:3/862: creat d0/d13/dfb/f127 x:0 0 0 2024-09-20T18:35:51.400 INFO:tasks.workunit.client.1.smithi172.stdout:3/863: truncate d0/d13/d58/d6d/d7f/d84/f100 956521 0 2024-09-20T18:35:51.401 INFO:tasks.workunit.client.0.smithi017.stdout:3/383: mknod da/de/d13/d2f/d26/c84 0 2024-09-20T18:35:51.404 INFO:tasks.workunit.client.0.smithi017.stdout:7/251: symlink da/d16/d1c/d40/d3a/l51 0 2024-09-20T18:35:51.405 INFO:tasks.workunit.client.1.smithi172.stdout:8/771: write dd/d1b/d3b/d51/f35 [1628171,19970] 0 2024-09-20T18:35:51.405 INFO:tasks.workunit.client.1.smithi172.stdout:5/835: truncate d4/df/dad/d26/d41/d65/fb3 68725 0 2024-09-20T18:35:51.406 INFO:tasks.workunit.client.1.smithi172.stdout:2/747: dread d0/d2c/d3f/dab/d18/d29/f56 [0,4194304] 0 2024-09-20T18:35:51.407 INFO:tasks.workunit.client.0.smithi017.stdout:2/326: getdents d1/d1f 0 2024-09-20T18:35:51.409 INFO:tasks.workunit.client.0.smithi017.stdout:5/222: creat d0/f45 x:0 0 0 2024-09-20T18:35:51.409 INFO:tasks.workunit.client.0.smithi017.stdout:9/240: write d6/fe [1692869,127371] 0 2024-09-20T18:35:51.410 INFO:tasks.workunit.client.0.smithi017.stdout:5/223: chown d0/d14/d18/d2a/d39/l3f 2526675 1 2024-09-20T18:35:51.411 INFO:tasks.workunit.client.1.smithi172.stdout:7/820: creat d2/d3/d10/d40/f119 x:0 0 0 2024-09-20T18:35:51.411 INFO:tasks.workunit.client.0.smithi017.stdout:5/224: chown d0/l12 4310 1 2024-09-20T18:35:51.412 INFO:tasks.workunit.client.1.smithi172.stdout:8/772: dwrite dd/d65/f9e [0,4194304] 0 2024-09-20T18:35:51.412 INFO:tasks.workunit.client.1.smithi172.stdout:2/748: dread d0/d2c/d3f/f4a [0,4194304] 0 2024-09-20T18:35:51.413 INFO:tasks.workunit.client.1.smithi172.stdout:1/756: rmdir d0/d8/d12/d96 39 2024-09-20T18:35:51.420 INFO:tasks.workunit.client.1.smithi172.stdout:1/757: dwrite d0/d8/db/d25/d2b/d3d/d65/d93/dbb/dd3/fda [0,4194304] 0 2024-09-20T18:35:51.421 INFO:tasks.workunit.client.1.smithi172.stdout:0/994: link d4/d1a/d28/d73/f13b d4/d1a/d28/d73/f159 0 2024-09-20T18:35:51.421 INFO:tasks.workunit.client.1.smithi172.stdout:0/995: dread - d4/d20/fec zero size 2024-09-20T18:35:51.422 INFO:tasks.workunit.client.0.smithi017.stdout:3/384: rename da/de/f5b to da/de/f85 0 2024-09-20T18:35:51.424 INFO:tasks.workunit.client.1.smithi172.stdout:6/689: write d0/d18/d1c/d21/d26/d34/f85 [779824,7538] 0 2024-09-20T18:35:51.428 INFO:tasks.workunit.client.0.smithi017.stdout:5/225: readlink d0/d14/d18/l1d 0 2024-09-20T18:35:51.429 INFO:tasks.workunit.client.1.smithi172.stdout:9/762: creat d15/d1f/d2c/d7d/d34/db5/ded/ffa x:0 0 0 2024-09-20T18:35:51.431 INFO:tasks.workunit.client.0.smithi017.stdout:6/235: rename d4/df/d1f/l3e to d4/l4c 0 2024-09-20T18:35:51.431 INFO:tasks.workunit.client.0.smithi017.stdout:1/116: rename df to df/d1c/d1d 22 2024-09-20T18:35:51.431 INFO:tasks.workunit.client.1.smithi172.stdout:9/763: write d15/d1a/d6f/fbd [478680,99808] 0 2024-09-20T18:35:51.431 INFO:tasks.workunit.client.1.smithi172.stdout:8/773: mknod dd/d1b/d3b/d51/d5b/dc5/c10d 0 2024-09-20T18:35:51.431 INFO:tasks.workunit.client.1.smithi172.stdout:4/827: dwrite d0/d48/d90/d55/f3e [0,4194304] 0 2024-09-20T18:35:51.433 INFO:tasks.workunit.client.1.smithi172.stdout:8/774: chown dd/d1b/d3b/d51/d34/f96 1151 1 2024-09-20T18:35:51.434 INFO:tasks.workunit.client.1.smithi172.stdout:4/828: readlink d0/d48/d90/d55/d53/d78/l117 0 2024-09-20T18:35:51.434 INFO:tasks.workunit.client.0.smithi017.stdout:8/215: rmdir d0/d6/d28/d41 0 2024-09-20T18:35:51.434 INFO:tasks.workunit.client.1.smithi172.stdout:8/775: dread - dd/de3/f106 zero size 2024-09-20T18:35:51.439 INFO:tasks.workunit.client.0.smithi017.stdout:7/252: creat da/d16/d1c/d40/d30/d50/f52 x:0 0 0 2024-09-20T18:35:51.439 INFO:tasks.workunit.client.1.smithi172.stdout:4/829: dwrite d0/d48/d90/d55/d101/fff [0,4194304] 0 2024-09-20T18:35:51.440 INFO:tasks.workunit.client.0.smithi017.stdout:2/327: mkdir d1/d6c 0 2024-09-20T18:35:51.442 INFO:tasks.workunit.client.1.smithi172.stdout:1/758: creat d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/ff8 x:0 0 0 2024-09-20T18:35:51.443 INFO:tasks.workunit.client.0.smithi017.stdout:9/241: truncate d6/d1f/f20 2941635 0 2024-09-20T18:35:51.444 INFO:tasks.workunit.client.0.smithi017.stdout:4/192: link d4/dc/c23 d4/dc/d1e/c39 0 2024-09-20T18:35:51.444 INFO:tasks.workunit.client.1.smithi172.stdout:0/996: mknod d4/d5/d2e/d38/c15a 0 2024-09-20T18:35:51.445 INFO:tasks.workunit.client.0.smithi017.stdout:5/226: symlink d0/d14/d18/d2a/l46 0 2024-09-20T18:35:51.446 INFO:tasks.workunit.client.1.smithi172.stdout:5/836: mkdir d4/df/d106/d119 0 2024-09-20T18:35:51.450 INFO:tasks.workunit.client.0.smithi017.stdout:0/227: rmdir d4/db/d18/d25/d36/d47/d44 0 2024-09-20T18:35:51.453 INFO:tasks.workunit.client.0.smithi017.stdout:5/227: dwrite d0/f45 [0,4194304] 0 2024-09-20T18:35:51.455 INFO:tasks.workunit.client.0.smithi017.stdout:5/228: truncate d0/d13/f16 4462901 0 2024-09-20T18:35:51.457 INFO:tasks.workunit.client.1.smithi172.stdout:2/749: unlink d0/d2c/d3f/dab/d22/d10/d6a/d98/d59/c8c 0 2024-09-20T18:35:51.459 INFO:tasks.workunit.client.0.smithi017.stdout:3/385: write da/de/d13/d2f/d26/d31/f36 [33878,55147] 0 2024-09-20T18:35:51.459 INFO:tasks.workunit.client.1.smithi172.stdout:7/821: write d2/f39 [1604368,53582] 0 2024-09-20T18:35:51.461 INFO:tasks.workunit.client.1.smithi172.stdout:7/822: write d2/d23/d51/d10e/d72/d9b/f100 [131949,13451] 0 2024-09-20T18:35:51.462 INFO:tasks.workunit.client.1.smithi172.stdout:7/823: dread - d2/dcc/f105 zero size 2024-09-20T18:35:51.464 INFO:tasks.workunit.client.0.smithi017.stdout:2/328: unlink d1/dc/d20/d2e/c2f 0 2024-09-20T18:35:51.467 INFO:tasks.workunit.client.0.smithi017.stdout:9/242: mknod d6/d23/d40/c63 0 2024-09-20T18:35:51.469 INFO:tasks.workunit.client.0.smithi017.stdout:1/117: creat df/d1c/f1e x:0 0 0 2024-09-20T18:35:51.470 INFO:tasks.workunit.client.0.smithi017.stdout:1/118: chown c6 156 1 2024-09-20T18:35:51.471 INFO:tasks.workunit.client.1.smithi172.stdout:1/759: rmdir d0/d8/db/d25/d2b/d3d/d65/d93 39 2024-09-20T18:35:51.471 INFO:tasks.workunit.client.0.smithi017.stdout:4/193: dread f3 [0,4194304] 0 2024-09-20T18:35:51.478 INFO:tasks.workunit.client.0.smithi017.stdout:1/119: dwrite df/f10 [4194304,4194304] 0 2024-09-20T18:35:51.479 INFO:tasks.workunit.client.1.smithi172.stdout:7/824: dread d2/d3/d10/d40/d46/d8e/dbd/ffb [0,4194304] 0 2024-09-20T18:35:51.485 INFO:tasks.workunit.client.0.smithi017.stdout:7/253: write da/f13 [2592487,34800] 0 2024-09-20T18:35:51.486 INFO:tasks.workunit.client.0.smithi017.stdout:5/229: chown d0/d14/d18/f30 1959912171 1 2024-09-20T18:35:51.490 INFO:tasks.workunit.client.0.smithi017.stdout:3/386: mknod da/de/d13/d2f/d26/d31/d5a/d76/c86 0 2024-09-20T18:35:51.492 INFO:tasks.workunit.client.1.smithi172.stdout:4/830: symlink d0/de/d21/l120 0 2024-09-20T18:35:51.492 INFO:tasks.workunit.client.0.smithi017.stdout:3/387: truncate da/de/d13/d2f/f60 935487 0 2024-09-20T18:35:51.493 INFO:tasks.workunit.client.0.smithi017.stdout:7/254: dread da/f22 [4194304,4194304] 0 2024-09-20T18:35:51.494 INFO:tasks.workunit.client.1.smithi172.stdout:3/864: getdents d0/dc 0 2024-09-20T18:35:51.495 INFO:tasks.workunit.client.1.smithi172.stdout:3/865: chown d0/d13/d32/d54/d83/c126 107232 1 2024-09-20T18:35:51.495 INFO:tasks.workunit.client.0.smithi017.stdout:2/329: rename d1/f59 to d1/dc/d58/d53/d6b/f6d 0 2024-09-20T18:35:51.495 INFO:tasks.workunit.client.0.smithi017.stdout:6/236: truncate d4/df/d1f/d25/f27 732199 0 2024-09-20T18:35:51.496 INFO:tasks.workunit.client.0.smithi017.stdout:7/255: write da/d16/d1c/f2e [2059122,54486] 0 2024-09-20T18:35:51.496 INFO:tasks.workunit.client.1.smithi172.stdout:3/866: fsync d0/dc/d6a/f119 0 2024-09-20T18:35:51.496 INFO:tasks.workunit.client.1.smithi172.stdout:1/760: truncate d0/d22/f54 251906 0 2024-09-20T18:35:51.498 INFO:tasks.workunit.client.1.smithi172.stdout:6/690: dwrite d0/d18/d1c/d21/d26/d34/d39/d46/f2a [0,4194304] 0 2024-09-20T18:35:51.498 INFO:tasks.workunit.client.1.smithi172.stdout:1/761: fsync d0/d8/db/d25/d2b/fc1 0 2024-09-20T18:35:51.499 INFO:tasks.workunit.client.0.smithi017.stdout:9/243: mknod d6/d23/d3a/c64 0 2024-09-20T18:35:51.500 INFO:tasks.workunit.client.1.smithi172.stdout:6/691: chown d0/d18/d1c/d21/d26/d34/d6b/d7d/c2d 117732237 1 2024-09-20T18:35:51.500 INFO:tasks.workunit.client.0.smithi017.stdout:3/388: dwrite da/f58 [0,4194304] 0 2024-09-20T18:35:51.502 INFO:tasks.workunit.client.1.smithi172.stdout:7/825: fdatasync d2/d3/d10/f14 0 2024-09-20T18:35:51.503 INFO:tasks.workunit.client.1.smithi172.stdout:7/826: dread d2/d3/d10/d40/d74/fe5 [0,4194304] 0 2024-09-20T18:35:51.508 INFO:tasks.workunit.client.0.smithi017.stdout:8/216: link d0/d6/d28/l2c d0/d6/d28/d3a/l47 0 2024-09-20T18:35:51.508 INFO:tasks.workunit.client.1.smithi172.stdout:9/764: rename d15/d1f/d2c/d37 to d15/d1a/dfb 0 2024-09-20T18:35:51.509 INFO:tasks.workunit.client.0.smithi017.stdout:8/217: chown d0/d6/d28/d3b/c44 5912 1 2024-09-20T18:35:51.513 INFO:tasks.workunit.client.1.smithi172.stdout:3/867: creat d0/d13/dfe/f128 x:0 0 0 2024-09-20T18:35:51.513 INFO:tasks.workunit.client.0.smithi017.stdout:5/230: stat d0/d14/l3a 0 2024-09-20T18:35:51.515 INFO:tasks.workunit.client.1.smithi172.stdout:1/762: stat d0/d8/db/d25/d2b/d3d/d65/d93/dbb/dd3 0 2024-09-20T18:35:51.518 INFO:tasks.workunit.client.1.smithi172.stdout:6/692: mkdir d0/d18/d1c/d21/d26/d34/d39/d74/dbf/de7 0 2024-09-20T18:35:51.522 INFO:tasks.workunit.client.1.smithi172.stdout:1/763: dread d0/d8/d5f/f6e [0,4194304] 0 2024-09-20T18:35:51.523 INFO:tasks.workunit.client.0.smithi017.stdout:2/330: creat d1/d1f/f6e x:0 0 0 2024-09-20T18:35:51.525 INFO:tasks.workunit.client.0.smithi017.stdout:6/237: creat d4/d37/f4d x:0 0 0 2024-09-20T18:35:51.525 INFO:tasks.workunit.client.0.smithi017.stdout:6/238: stat d4/df/d1f/f38 0 2024-09-20T18:35:51.526 INFO:tasks.workunit.client.1.smithi172.stdout:1/764: dread d0/d8/db/d25/d6d/f7e [0,4194304] 0 2024-09-20T18:35:51.526 INFO:tasks.workunit.client.0.smithi017.stdout:6/239: chown d4/l36 2671794 1 2024-09-20T18:35:51.526 INFO:tasks.workunit.client.0.smithi017.stdout:6/240: readlink l0 0 2024-09-20T18:35:51.527 INFO:tasks.workunit.client.0.smithi017.stdout:7/256: rename da/f2a to da/d16/d1c/d40/d34/d3c/f53 0 2024-09-20T18:35:51.527 INFO:tasks.workunit.client.1.smithi172.stdout:1/765: dread - d0/d8/db/d25/fe3 zero size 2024-09-20T18:35:51.527 INFO:tasks.workunit.client.1.smithi172.stdout:1/766: chown d0/d22/l5c 2187 1 2024-09-20T18:35:51.527 INFO:tasks.workunit.client.1.smithi172.stdout:2/750: truncate d0/d2c/f3d 802831 0 2024-09-20T18:35:51.528 INFO:tasks.workunit.client.1.smithi172.stdout:1/767: truncate d0/d8/db/fe 4477775 0 2024-09-20T18:35:51.528 INFO:tasks.workunit.client.1.smithi172.stdout:1/768: stat d0/d8/d12/fd9 0 2024-09-20T18:35:51.529 INFO:tasks.workunit.client.0.smithi017.stdout:4/194: symlink d4/l3a 0 2024-09-20T18:35:51.532 INFO:tasks.workunit.client.1.smithi172.stdout:8/776: rename dd/d1b/d3b/d51/d5b/d6b/fd2 to dd/d1b/d3b/d51/d34/dee/d103/f10e 0 2024-09-20T18:35:51.533 INFO:tasks.workunit.client.1.smithi172.stdout:8/777: chown dd/d1b/d3b/d51/ffb 7559377 1 2024-09-20T18:35:51.534 INFO:tasks.workunit.client.1.smithi172.stdout:4/831: write d0/d48/d90/d55/d53/d78/dd9/fe1 [616780,108646] 0 2024-09-20T18:35:51.536 INFO:tasks.workunit.client.0.smithi017.stdout:0/228: creat d4/db/f49 x:0 0 0 2024-09-20T18:35:51.536 INFO:tasks.workunit.client.0.smithi017.stdout:7/257: dwrite da/d16/d1b/f28 [4194304,4194304] 0 2024-09-20T18:35:51.536 INFO:tasks.workunit.client.0.smithi017.stdout:1/120: dwrite f2 [0,4194304] 0 2024-09-20T18:35:51.537 INFO:tasks.workunit.client.1.smithi172.stdout:0/997: getdents d4/d5/d2e/d38/d96 0 2024-09-20T18:35:51.539 INFO:tasks.workunit.client.0.smithi017.stdout:7/258: write da/d16/d1c/d40/d34/d3c/f48 [595048,40143] 0 2024-09-20T18:35:51.541 INFO:tasks.workunit.client.0.smithi017.stdout:7/259: fsync da/d16/d1c/d40/d3a/f45 0 2024-09-20T18:35:51.543 INFO:tasks.workunit.client.0.smithi017.stdout:5/231: readlink d0/d14/d18/d1b/l43 0 2024-09-20T18:35:51.544 INFO:tasks.workunit.client.0.smithi017.stdout:5/232: chown d0/fe 37 1 2024-09-20T18:35:51.545 INFO:tasks.workunit.client.1.smithi172.stdout:6/693: mknod d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/ce8 0 2024-09-20T18:35:51.546 INFO:tasks.workunit.client.0.smithi017.stdout:2/331: rmdir d1/dc 39 2024-09-20T18:35:51.547 INFO:tasks.workunit.client.0.smithi017.stdout:2/332: write d1/df/d17/f64 [215233,11279] 0 2024-09-20T18:35:51.549 INFO:tasks.workunit.client.0.smithi017.stdout:2/333: write d1/f28 [2554557,74264] 0 2024-09-20T18:35:51.551 INFO:tasks.workunit.client.1.smithi172.stdout:8/778: dread dd/d1b/d3b/d51/d5b/daf/d4d/f92 [0,4194304] 0 2024-09-20T18:35:51.555 INFO:tasks.workunit.client.0.smithi017.stdout:9/244: rename d6/d11/f12 to d6/d23/d58/d3f/d5f/f65 0 2024-09-20T18:35:51.557 INFO:tasks.workunit.client.0.smithi017.stdout:4/195: symlink d4/dc/d1e/d26/d22/l3b 0 2024-09-20T18:35:51.559 INFO:tasks.workunit.client.1.smithi172.stdout:2/751: creat d0/d2c/d3f/dab/d22/d4c/ffa x:0 0 0 2024-09-20T18:35:51.560 INFO:tasks.workunit.client.0.smithi017.stdout:3/389: write da/de/d13/f54 [249788,53048] 0 2024-09-20T18:35:51.563 INFO:tasks.workunit.client.1.smithi172.stdout:9/765: chown d15/d1f/d2c/d6e/fee 48285 1 2024-09-20T18:35:51.568 INFO:tasks.workunit.client.1.smithi172.stdout:5/837: rename d4/df/dad/d26/d41/d69/dac/d2c/dd1/f114 to d4/df/d3f/d64/d101/d86/d10c/f11a 0 2024-09-20T18:35:51.570 INFO:tasks.workunit.client.0.smithi017.stdout:6/241: dwrite d4/df/f16 [0,4194304] 0 2024-09-20T18:35:51.571 INFO:tasks.workunit.client.0.smithi017.stdout:6/242: rename d4/df/d1f/d25 to d4/df/d1f/d25/d2b/d4e 22 2024-09-20T18:35:51.574 INFO:tasks.workunit.client.1.smithi172.stdout:0/998: creat d4/d1a/d28/d42/d45/d99/dc9/d107/f15b x:0 0 0 2024-09-20T18:35:51.579 INFO:tasks.workunit.client.0.smithi017.stdout:9/245: creat d6/d23/f66 x:0 0 0 2024-09-20T18:35:51.580 INFO:tasks.workunit.client.0.smithi017.stdout:9/246: dread - d6/f2e zero size 2024-09-20T18:35:51.580 INFO:tasks.workunit.client.0.smithi017.stdout:4/196: mknod d4/dc/c3c 0 2024-09-20T18:35:51.582 INFO:tasks.workunit.client.1.smithi172.stdout:8/779: symlink dd/d1b/d3b/d5d/df6/l10f 0 2024-09-20T18:35:51.582 INFO:tasks.workunit.client.0.smithi017.stdout:2/334: dwrite d1/dc/d20/d2e/f49 [0,4194304] 0 2024-09-20T18:35:51.584 INFO:tasks.workunit.client.0.smithi017.stdout:3/390: creat da/de/d13/d16/d6e/f87 x:0 0 0 2024-09-20T18:35:51.587 INFO:tasks.workunit.client.1.smithi172.stdout:2/752: truncate d0/f8e 1096362 0 2024-09-20T18:35:51.588 INFO:tasks.workunit.client.1.smithi172.stdout:2/753: dread - d0/d2c/d3f/dab/d22/d10/d35/d5d/fae zero size 2024-09-20T18:35:51.588 INFO:tasks.workunit.client.0.smithi017.stdout:0/229: symlink d4/db/d1e/l4a 0 2024-09-20T18:35:51.589 INFO:tasks.workunit.client.0.smithi017.stdout:0/230: write f2 [4871654,24863] 0 2024-09-20T18:35:51.592 INFO:tasks.workunit.client.0.smithi017.stdout:7/260: mkdir da/d54 0 2024-09-20T18:35:51.592 INFO:tasks.workunit.client.1.smithi172.stdout:9/766: read - d15/d4a/d8c/fae zero size 2024-09-20T18:35:51.593 INFO:tasks.workunit.client.1.smithi172.stdout:6/694: write d0/d18/d1c/d21/d26/d34/d39/d46/fa5 [1000946,23226] 0 2024-09-20T18:35:51.594 INFO:tasks.workunit.client.0.smithi017.stdout:6/243: mknod d4/d37/d41/d43/c4f 0 2024-09-20T18:35:51.598 INFO:tasks.workunit.client.0.smithi017.stdout:4/197: symlink d4/de/d1b/l3d 0 2024-09-20T18:35:51.603 INFO:tasks.workunit.client.1.smithi172.stdout:6/695: dwrite d0/f5 [4194304,4194304] 0 2024-09-20T18:35:51.603 INFO:tasks.workunit.client.1.smithi172.stdout:4/832: mkdir d0/de/d39/d9f/de8/d119/d121 0 2024-09-20T18:35:51.604 INFO:tasks.workunit.client.0.smithi017.stdout:2/335: write d1/dc/d20/d2e/f5f [1059261,112065] 0 2024-09-20T18:35:51.604 INFO:tasks.workunit.client.0.smithi017.stdout:7/261: dwrite da/d16/d1c/d40/d3a/f45 [0,4194304] 0 2024-09-20T18:35:51.605 INFO:tasks.workunit.client.0.smithi017.stdout:7/262: chown da/f12 113469812 1 2024-09-20T18:35:51.607 INFO:tasks.workunit.client.0.smithi017.stdout:7/263: truncate da/d16/f3f 151344 0 2024-09-20T18:35:51.611 INFO:tasks.workunit.client.1.smithi172.stdout:0/999: rename d4/d44/faf to d4/d5/d2e/d33/de1/d7f/f15c 0 2024-09-20T18:35:51.614 INFO:tasks.workunit.client.1.smithi172.stdout:1/769: truncate d0/d8/db/fa5 213794 0 2024-09-20T18:35:51.616 INFO:tasks.workunit.client.0.smithi017.stdout:2/336: dwrite d1/dc/d20/d2e/d30/f54 [0,4194304] 0 2024-09-20T18:35:51.617 INFO:tasks.workunit.client.1.smithi172.stdout:7/827: getdents d2/d3/d10/d40/d6a 0 2024-09-20T18:35:51.618 INFO:tasks.workunit.client.0.smithi017.stdout:9/247: dread d6/d23/d3a/f3c [0,4194304] 0 2024-09-20T18:35:51.620 INFO:tasks.workunit.client.0.smithi017.stdout:9/248: write d6/f2e [330894,4165] 0 2024-09-20T18:35:51.622 INFO:tasks.workunit.client.0.smithi017.stdout:0/231: dread d4/f6 [0,4194304] 0 2024-09-20T18:35:51.623 INFO:tasks.workunit.client.1.smithi172.stdout:2/754: mknod d0/d2c/db2/cfb 0 2024-09-20T18:35:51.624 INFO:tasks.workunit.client.0.smithi017.stdout:0/232: chown d4/f29 1841 1 2024-09-20T18:35:51.624 INFO:tasks.workunit.client.1.smithi172.stdout:2/755: chown d0/d2c/d3f/dab/d22/cf 7320 1 2024-09-20T18:35:51.627 INFO:tasks.workunit.client.1.smithi172.stdout:5/838: fsync d4/df/dad/f4a 0 2024-09-20T18:35:51.628 INFO:tasks.workunit.client.0.smithi017.stdout:7/264: dread f4 [0,4194304] 0 2024-09-20T18:35:51.628 INFO:tasks.workunit.client.1.smithi172.stdout:5/839: chown d4/df/d3f/d64/d101/l115 33030 1 2024-09-20T18:35:51.629 INFO:tasks.workunit.client.1.smithi172.stdout:5/840: chown d4/df/d3f/d64/d101/d86/faa 20654 1 2024-09-20T18:35:51.629 INFO:tasks.workunit.client.1.smithi172.stdout:4/833: mkdir d0/de/dc/d122 0 2024-09-20T18:35:51.631 INFO:tasks.workunit.client.0.smithi017.stdout:4/198: fdatasync d4/de/f27 0 2024-09-20T18:35:51.632 INFO:tasks.workunit.client.1.smithi172.stdout:3/868: getdents d0/d13/d32/d54/d83 0 2024-09-20T18:35:51.633 INFO:tasks.workunit.client.0.smithi017.stdout:4/199: dread - d4/dc/d1e/d26/d22/f36 zero size 2024-09-20T18:35:51.635 INFO:tasks.workunit.client.1.smithi172.stdout:8/780: rename dd/d1b/d3b/d51/l75 to dd/d1b/d4f/d9a/l110 0 2024-09-20T18:35:51.636 INFO:tasks.workunit.client.0.smithi017.stdout:7/265: dwrite da/d16/d1c/d40/d34/d3c/f46 [0,4194304] 0 2024-09-20T18:35:51.638 INFO:tasks.workunit.client.0.smithi017.stdout:1/121: getdents df/d16 0 2024-09-20T18:35:51.639 INFO:tasks.workunit.client.0.smithi017.stdout:7/266: write da/d16/d1c/d40/d34/d3c/f4e [458615,9351] 0 2024-09-20T18:35:51.639 INFO:tasks.workunit.client.0.smithi017.stdout:1/122: chown l8 126379345 1 2024-09-20T18:35:51.646 INFO:tasks.workunit.client.0.smithi017.stdout:9/249: creat d6/d23/d58/d3f/d4d/f67 x:0 0 0 2024-09-20T18:35:51.648 INFO:tasks.workunit.client.0.smithi017.stdout:5/233: getdents d0/d14/d18/d2a/d39 0 2024-09-20T18:35:51.649 INFO:tasks.workunit.client.0.smithi017.stdout:0/233: rmdir d4/db/d18 39 2024-09-20T18:35:51.651 INFO:tasks.workunit.client.1.smithi172.stdout:3/869: truncate d0/dc/f2e 1364826 0 2024-09-20T18:35:51.651 INFO:tasks.workunit.client.0.smithi017.stdout:0/234: write d4/d20/f32 [149121,62720] 0 2024-09-20T18:35:51.652 INFO:tasks.workunit.client.1.smithi172.stdout:3/870: write d0/dc/d6a/d22/fbd [1773430,56599] 0 2024-09-20T18:35:51.653 INFO:tasks.workunit.client.1.smithi172.stdout:2/756: rename d0/d2c/d3f/dab/d18/d3b/c94 to d0/d90/cfc 0 2024-09-20T18:35:51.653 INFO:tasks.workunit.client.1.smithi172.stdout:3/871: read d0/dc/f28 [1774145,3101] 0 2024-09-20T18:35:51.654 INFO:tasks.workunit.client.0.smithi017.stdout:5/234: dwrite d0/d13/f22 [0,4194304] 0 2024-09-20T18:35:51.654 INFO:tasks.workunit.client.1.smithi172.stdout:2/757: read - d0/d2c/d3f/dab/d22/d10/d6a/ddf/fe9 zero size 2024-09-20T18:35:51.655 INFO:tasks.workunit.client.0.smithi017.stdout:5/235: dread - d0/d14/d18/f3b zero size 2024-09-20T18:35:51.655 INFO:tasks.workunit.client.1.smithi172.stdout:8/781: stat dd/d1b/d3b/dc7/cec 0 2024-09-20T18:35:51.656 INFO:tasks.workunit.client.0.smithi017.stdout:3/391: truncate da/de/d13/f54 221957 0 2024-09-20T18:35:51.658 INFO:tasks.workunit.client.0.smithi017.stdout:4/200: symlink d4/de/l3e 0 2024-09-20T18:35:51.662 INFO:tasks.workunit.client.1.smithi172.stdout:9/767: creat d15/ffc x:0 0 0 2024-09-20T18:35:51.663 INFO:tasks.workunit.client.0.smithi017.stdout:7/267: write da/d16/d1c/d40/d3a/f4b [3316799,76577] 0 2024-09-20T18:35:51.665 INFO:tasks.workunit.client.0.smithi017.stdout:2/337: rmdir d1/dc/d58/d46/d48 39 2024-09-20T18:35:51.667 INFO:tasks.workunit.client.1.smithi172.stdout:4/834: symlink d0/d48/d90/dea/d10f/l123 0 2024-09-20T18:35:51.668 INFO:tasks.workunit.client.0.smithi017.stdout:1/123: creat df/d1c/f1f x:0 0 0 2024-09-20T18:35:51.670 INFO:tasks.workunit.client.0.smithi017.stdout:3/392: dread da/de/f1a [0,4194304] 0 2024-09-20T18:35:51.671 INFO:tasks.workunit.client.0.smithi017.stdout:3/393: fsync da/de/d53/f44 0 2024-09-20T18:35:51.673 INFO:tasks.workunit.client.0.smithi017.stdout:3/394: write da/de/d13/d16/f22 [247140,73219] 0 2024-09-20T18:35:51.675 INFO:tasks.workunit.client.0.smithi017.stdout:0/235: fsync d4/f29 0 2024-09-20T18:35:51.676 INFO:tasks.workunit.client.1.smithi172.stdout:2/758: symlink d0/d1a/d58/lfd 0 2024-09-20T18:35:51.676 INFO:tasks.workunit.client.0.smithi017.stdout:1/124: dwrite f3 [0,4194304] 0 2024-09-20T18:35:51.678 INFO:tasks.workunit.client.0.smithi017.stdout:5/236: rmdir d0/d14/d18/d3e 39 2024-09-20T18:35:51.679 INFO:tasks.workunit.client.1.smithi172.stdout:8/782: mkdir dd/d1b/d3b/d51/d5b/daf/d111 0 2024-09-20T18:35:51.688 INFO:tasks.workunit.client.1.smithi172.stdout:5/841: dwrite d4/df/dad/faf [0,4194304] 0 2024-09-20T18:35:51.691 INFO:tasks.workunit.client.1.smithi172.stdout:4/835: mknod d0/de/d39/c124 0 2024-09-20T18:35:51.692 INFO:tasks.workunit.client.1.smithi172.stdout:6/696: link d0/d18/d1c/d21/d26/d34/da2/dda/ca1 d0/d18/d1c/d21/d26/d34/d39/ce9 0 2024-09-20T18:35:51.698 INFO:tasks.workunit.client.1.smithi172.stdout:2/759: fsync d0/d2c/d3f/dab/d18/d29/d42/f8b 0 2024-09-20T18:35:51.699 INFO:tasks.workunit.client.1.smithi172.stdout:9/768: write d15/d1a/d82/f8e [806952,70433] 0 2024-09-20T18:35:51.701 INFO:tasks.workunit.client.0.smithi017.stdout:1/125: unlink f3 0 2024-09-20T18:35:51.702 INFO:tasks.workunit.client.0.smithi017.stdout:1/126: readlink df/l12 0 2024-09-20T18:35:51.703 INFO:tasks.workunit.client.0.smithi017.stdout:5/237: dread d0/f7 [0,4194304] 0 2024-09-20T18:35:51.705 INFO:tasks.workunit.client.1.smithi172.stdout:5/842: rmdir d4/df/dad/d26/d41/d69/dac 39 2024-09-20T18:35:51.705 INFO:tasks.workunit.client.1.smithi172.stdout:5/843: readlink d4/l59 0 2024-09-20T18:35:51.706 INFO:tasks.workunit.client.0.smithi017.stdout:5/238: truncate d0/d14/d18/f3b 578270 0 2024-09-20T18:35:51.707 INFO:tasks.workunit.client.1.smithi172.stdout:4/836: creat d0/d48/d90/d55/d53/d78/f125 x:0 0 0 2024-09-20T18:35:51.708 INFO:tasks.workunit.client.1.smithi172.stdout:4/837: fdatasync d0/fcd 0 2024-09-20T18:35:51.709 INFO:tasks.workunit.client.0.smithi017.stdout:1/127: dwrite f2 [4194304,4194304] 0 2024-09-20T18:35:51.712 INFO:tasks.workunit.client.1.smithi172.stdout:6/697: creat d0/d18/d1c/d21/d26/d34/da2/dda/d7b/d7e/dd3/fea x:0 0 0 2024-09-20T18:35:51.712 INFO:tasks.workunit.client.1.smithi172.stdout:6/698: readlink d0/l1d 0 2024-09-20T18:35:51.715 INFO:tasks.workunit.client.0.smithi017.stdout:9/250: link d6/d23/d40/c52 d6/d42/c68 0 2024-09-20T18:35:51.715 INFO:tasks.workunit.client.0.smithi017.stdout:1/128: dread df/f18 [0,4194304] 0 2024-09-20T18:35:51.718 INFO:tasks.workunit.client.1.smithi172.stdout:8/783: creat dd/d1b/d4f/d9a/dbb/d101/f112 x:0 0 0 2024-09-20T18:35:51.719 INFO:tasks.workunit.client.0.smithi017.stdout:3/395: mkdir da/de/d53/d88 0 2024-09-20T18:35:51.720 INFO:tasks.workunit.client.0.smithi017.stdout:3/396: chown da/de/f7c 0 1 2024-09-20T18:35:51.720 INFO:tasks.workunit.client.1.smithi172.stdout:9/769: creat d15/d1f/d7e/ffd x:0 0 0 2024-09-20T18:35:51.724 INFO:tasks.workunit.client.0.smithi017.stdout:0/236: link d4/ff d4/db/d1e/d24/f4b 0 2024-09-20T18:35:51.726 INFO:tasks.workunit.client.0.smithi017.stdout:2/338: truncate d1/d1f/f3e 342750 0 2024-09-20T18:35:51.726 INFO:tasks.workunit.client.0.smithi017.stdout:2/339: readlink d1/df/d17/l19 0 2024-09-20T18:35:51.727 INFO:tasks.workunit.client.0.smithi017.stdout:2/340: fdatasync d1/dc/d58/d3d/f44 0 2024-09-20T18:35:51.728 INFO:tasks.workunit.client.1.smithi172.stdout:4/838: symlink d0/d48/d90/d55/d53/d78/dd9/l126 0 2024-09-20T18:35:51.728 INFO:tasks.workunit.client.0.smithi017.stdout:4/201: link d4/c6 d4/de/d1b/c3f 0 2024-09-20T18:35:51.730 INFO:tasks.workunit.client.0.smithi017.stdout:7/268: creat da/d16/d1c/d40/d34/f55 x:0 0 0 2024-09-20T18:35:51.731 INFO:tasks.workunit.client.1.smithi172.stdout:2/760: mkdir d0/d2c/dca/df1/dfe 0 2024-09-20T18:35:51.732 INFO:tasks.workunit.client.1.smithi172.stdout:8/784: truncate dd/d1b/d3b/d51/d5b/daf/d4d/f92 4073707 0 2024-09-20T18:35:51.733 INFO:tasks.workunit.client.0.smithi017.stdout:1/129: unlink c4 0 2024-09-20T18:35:51.735 INFO:tasks.workunit.client.0.smithi017.stdout:3/397: creat da/de/f89 x:0 0 0 2024-09-20T18:35:51.736 INFO:tasks.workunit.client.0.smithi017.stdout:3/398: stat da/de/d13/d2f/d26/d31/d5a/d76/d19/l2b 0 2024-09-20T18:35:51.736 INFO:tasks.workunit.client.0.smithi017.stdout:0/237: mknod d4/c4c 0 2024-09-20T18:35:51.737 INFO:tasks.workunit.client.0.smithi017.stdout:0/238: readlink d4/db/l10 0 2024-09-20T18:35:51.737 INFO:tasks.workunit.client.1.smithi172.stdout:4/839: creat d0/de/d21/d24/f127 x:0 0 0 2024-09-20T18:35:51.740 INFO:tasks.workunit.client.1.smithi172.stdout:6/699: link d0/d18/fe2 d0/d18/d1c/d21/d26/d34/da2/feb 0 2024-09-20T18:35:51.741 INFO:tasks.workunit.client.0.smithi017.stdout:0/239: dread d4/db/f12 [0,4194304] 0 2024-09-20T18:35:51.743 INFO:tasks.workunit.client.1.smithi172.stdout:9/770: mkdir d15/d1a/d64/dda/dfe 0 2024-09-20T18:35:51.745 INFO:tasks.workunit.client.0.smithi017.stdout:4/202: rename d4/dc/d1e/f18 to d4/dc/f40 0 2024-09-20T18:35:51.746 INFO:tasks.workunit.client.1.smithi172.stdout:8/785: mkdir dd/d1b/d3b/d51/d5b/dc5/d113 0 2024-09-20T18:35:51.749 INFO:tasks.workunit.client.1.smithi172.stdout:2/761: rename d0/d2c/d3f/dab/d22/d4c/f72 to d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/d9f/fff 0 2024-09-20T18:35:51.749 INFO:tasks.workunit.client.1.smithi172.stdout:1/770: sync 2024-09-20T18:35:51.750 INFO:tasks.workunit.client.1.smithi172.stdout:7/828: getdents d2 0 2024-09-20T18:35:51.751 INFO:tasks.workunit.client.1.smithi172.stdout:7/829: chown d2/d23/d51 1 1 2024-09-20T18:35:51.751 INFO:tasks.workunit.client.1.smithi172.stdout:7/830: readlink d2/d3/d10/d40/d6a/ld3 0 2024-09-20T18:35:51.752 INFO:tasks.workunit.client.1.smithi172.stdout:7/831: fsync d2/dcc/f105 0 2024-09-20T18:35:51.752 INFO:tasks.workunit.client.0.smithi017.stdout:9/251: creat d6/d23/d3a/d61/f69 x:0 0 0 2024-09-20T18:35:51.753 INFO:tasks.workunit.client.0.smithi017.stdout:9/252: write d6/f14 [3420667,115572] 0 2024-09-20T18:35:51.753 INFO:tasks.workunit.client.0.smithi017.stdout:1/130: mknod df/d16/c20 0 2024-09-20T18:35:51.756 INFO:tasks.workunit.client.1.smithi172.stdout:5/844: dwrite d4/df/d3f/d64/d101/dce/dd9/fe6 [0,4194304] 0 2024-09-20T18:35:51.757 INFO:tasks.workunit.client.1.smithi172.stdout:6/700: truncate d0/d18/d1c/d21/d26/d34/d6b/d7d/d35/f4f 3605830 0 2024-09-20T18:35:51.758 INFO:tasks.workunit.client.1.smithi172.stdout:5/845: write d4/df/d98/fde [694447,114957] 0 2024-09-20T18:35:51.761 INFO:tasks.workunit.client.0.smithi017.stdout:2/341: mknod d1/d67/c6f 0 2024-09-20T18:35:51.766 INFO:tasks.workunit.client.1.smithi172.stdout:9/771: dwrite d15/d1f/d2c/d7d/ff3 [0,4194304] 0 2024-09-20T18:35:51.766 INFO:tasks.workunit.client.0.smithi017.stdout:0/240: rename d4/db/d1e/d24/f45 to d4/d37/f4d 0 2024-09-20T18:35:51.767 INFO:tasks.workunit.client.1.smithi172.stdout:9/772: chown d15/d54/fdb 20 1 2024-09-20T18:35:51.768 INFO:tasks.workunit.client.0.smithi017.stdout:0/241: read d4/db/d1e/d24/f4b [289136,103752] 0 2024-09-20T18:35:51.768 INFO:tasks.workunit.client.1.smithi172.stdout:2/762: symlink d0/d1a/dc0/l100 0 2024-09-20T18:35:51.769 INFO:tasks.workunit.client.1.smithi172.stdout:2/763: dread - d0/fd9 zero size 2024-09-20T18:35:51.770 INFO:tasks.workunit.client.0.smithi017.stdout:4/203: mkdir d4/dc/d41 0 2024-09-20T18:35:51.771 INFO:tasks.workunit.client.1.smithi172.stdout:2/764: chown d0/d2c/d3f/dab/d22/d10/d35/fc2 6901 1 2024-09-20T18:35:51.772 INFO:tasks.workunit.client.1.smithi172.stdout:5/846: dread d4/f14 [0,4194304] 0 2024-09-20T18:35:51.775 INFO:tasks.workunit.client.0.smithi017.stdout:1/131: rmdir df/d16 39 2024-09-20T18:35:51.779 INFO:tasks.workunit.client.0.smithi017.stdout:2/342: mknod d1/df/d17/c70 0 2024-09-20T18:35:51.781 INFO:tasks.workunit.client.0.smithi017.stdout:2/343: write d1/dc/d58/d46/f65 [970998,97111] 0 2024-09-20T18:35:51.781 INFO:tasks.workunit.client.1.smithi172.stdout:4/840: dwrite d0/d48/d90/db4/fc1 [4194304,4194304] 0 2024-09-20T18:35:51.782 INFO:tasks.workunit.client.1.smithi172.stdout:8/786: mknod dd/d1b/d3b/d51/d5b/dc5/d113/c114 0 2024-09-20T18:35:51.782 INFO:tasks.workunit.client.0.smithi017.stdout:2/344: write d1/dc/d58/d46/f65 [1934546,31907] 0 2024-09-20T18:35:51.785 INFO:tasks.workunit.client.1.smithi172.stdout:7/832: write d2/d3/d10/d40/f7c [683892,79461] 0 2024-09-20T18:35:51.786 INFO:tasks.workunit.client.0.smithi017.stdout:3/399: rename da/de/d13/d2f/d26/d31/d5a/d76/f38 to da/de/d13/d2f/d26/d62/f8a 0 2024-09-20T18:35:51.788 INFO:tasks.workunit.client.1.smithi172.stdout:9/773: symlink d15/d54/lff 0 2024-09-20T18:35:51.791 INFO:tasks.workunit.client.0.smithi017.stdout:0/242: truncate d4/db/d18/f22 1925615 0 2024-09-20T18:35:51.792 INFO:tasks.workunit.client.1.smithi172.stdout:4/841: dwrite d0/f107 [0,4194304] 0 2024-09-20T18:35:51.793 INFO:tasks.workunit.client.0.smithi017.stdout:2/345: dread d1/dc/d20/d2e/f62 [0,4194304] 0 2024-09-20T18:35:51.794 INFO:tasks.workunit.client.1.smithi172.stdout:6/701: mknod d0/d18/d1c/d21/d26/d34/d39/d74/dbf/de7/cec 0 2024-09-20T18:35:51.794 INFO:tasks.workunit.client.1.smithi172.stdout:4/842: stat d0/d48/d90/d55/d101/d18/cbd 0 2024-09-20T18:35:51.794 INFO:tasks.workunit.client.1.smithi172.stdout:8/787: dwrite dd/d65/d85/dab/fef [0,4194304] 0 2024-09-20T18:35:51.797 INFO:tasks.workunit.client.0.smithi017.stdout:3/400: mknod da/de/d13/d2f/d26/d62/c8b 0 2024-09-20T18:35:51.798 INFO:tasks.workunit.client.1.smithi172.stdout:1/771: link d0/d8/db/d25/d2b/d3d/l94 d0/d8/db/d25/d2b/db6/lf9 0 2024-09-20T18:35:51.798 INFO:tasks.workunit.client.0.smithi017.stdout:7/269: getdents da/d16 0 2024-09-20T18:35:51.798 INFO:tasks.workunit.client.1.smithi172.stdout:6/702: chown d0/d18/d1c/d21/d26/d34/da2/dda/f78 10726 1 2024-09-20T18:35:51.800 INFO:tasks.workunit.client.1.smithi172.stdout:2/765: symlink d0/d2c/d3f/dab/d22/d10/d6a/d98/l101 0 2024-09-20T18:35:51.801 INFO:tasks.workunit.client.1.smithi172.stdout:6/703: write d0/d18/d1c/d21/d26/d34/d39/d74/dbf/fb6 [775330,116905] 0 2024-09-20T18:35:51.802 INFO:tasks.workunit.client.1.smithi172.stdout:9/774: rename d15/d1f/d2c/d7d/d34/db5/ce7 to d15/d1f/d2c/d7d/d48/de6/c100 0 2024-09-20T18:35:51.806 INFO:tasks.workunit.client.0.smithi017.stdout:1/132: creat df/d16/f21 x:0 0 0 2024-09-20T18:35:51.806 INFO:tasks.workunit.client.0.smithi017.stdout:7/270: read da/d16/d1b/f28 [3177928,71650] 0 2024-09-20T18:35:51.806 INFO:tasks.workunit.client.0.smithi017.stdout:1/133: truncate df/d1c/f1e 535300 0 2024-09-20T18:35:51.807 INFO:tasks.workunit.client.1.smithi172.stdout:7/833: mkdir d2/d3/d11a 0 2024-09-20T18:35:51.807 INFO:tasks.workunit.client.0.smithi017.stdout:1/134: dread df/d1c/f1e [0,4194304] 0 2024-09-20T18:35:51.809 INFO:tasks.workunit.client.0.smithi017.stdout:7/271: dread da/d16/f4a [0,4194304] 0 2024-09-20T18:35:51.810 INFO:tasks.workunit.client.0.smithi017.stdout:3/401: chown da/de/d13/d2f/d26/d41/l51 1530748 1 2024-09-20T18:35:51.810 INFO:tasks.workunit.client.0.smithi017.stdout:7/272: chown da/d16/d1c/f2e 1384 1 2024-09-20T18:35:51.814 INFO:tasks.workunit.client.1.smithi172.stdout:8/788: dread dd/f30 [0,4194304] 0 2024-09-20T18:35:51.814 INFO:tasks.workunit.client.1.smithi172.stdout:1/772: rename d0/d8/db/d25/d2b/d3d/d65/d93/lbd to d0/d22/lfa 0 2024-09-20T18:35:51.816 INFO:tasks.workunit.client.1.smithi172.stdout:6/704: symlink d0/d18/d1c/d21/d26/led 0 2024-09-20T18:35:51.817 INFO:tasks.workunit.client.0.smithi017.stdout:7/273: dwrite da/d16/d1c/f4c [0,4194304] 0 2024-09-20T18:35:51.817 INFO:tasks.workunit.client.0.smithi017.stdout:7/274: chown da/d54 7768139 1 2024-09-20T18:35:51.825 INFO:tasks.workunit.client.0.smithi017.stdout:1/135: creat df/d16/f22 x:0 0 0 2024-09-20T18:35:51.825 INFO:tasks.workunit.client.0.smithi017.stdout:1/136: stat df/d1c 0 2024-09-20T18:35:51.826 INFO:tasks.workunit.client.1.smithi172.stdout:1/773: fdatasync d0/d8/db/d39/f64 0 2024-09-20T18:35:51.827 INFO:tasks.workunit.client.1.smithi172.stdout:1/774: chown d0/d8/db/d25/d2b/d3d/d65/d93/dbb/cc5 814534250 1 2024-09-20T18:35:51.827 INFO:tasks.workunit.client.0.smithi017.stdout:3/402: chown da/de/d13/d16/l3a 2031 1 2024-09-20T18:35:51.828 INFO:tasks.workunit.client.1.smithi172.stdout:1/775: chown d0/f10 44991305 1 2024-09-20T18:35:51.828 INFO:tasks.workunit.client.1.smithi172.stdout:1/776: chown d0/d8/db/f75 520 1 2024-09-20T18:35:51.829 INFO:tasks.workunit.client.0.smithi017.stdout:3/403: write da/de/d13/d16/f22 [623888,70066] 0 2024-09-20T18:35:51.829 INFO:tasks.workunit.client.1.smithi172.stdout:8/789: mknod dd/d1b/d3b/d51/d5b/daf/d91/c115 0 2024-09-20T18:35:51.831 INFO:tasks.workunit.client.0.smithi017.stdout:4/204: getdents d4/dc 0 2024-09-20T18:35:51.833 INFO:tasks.workunit.client.1.smithi172.stdout:3/872: sync 2024-09-20T18:35:51.836 INFO:tasks.workunit.client.0.smithi017.stdout:0/243: rename d4/ff to d4/db/f4e 0 2024-09-20T18:35:51.836 INFO:tasks.workunit.client.1.smithi172.stdout:9/775: dwrite d15/fc1 [0,4194304] 0 2024-09-20T18:35:51.837 INFO:tasks.workunit.client.1.smithi172.stdout:1/777: mkdir d0/d8/d5f/dfb 0 2024-09-20T18:35:51.838 INFO:tasks.workunit.client.1.smithi172.stdout:8/790: creat dd/d1b/d4f/d9a/f116 x:0 0 0 2024-09-20T18:35:51.839 INFO:tasks.workunit.client.1.smithi172.stdout:8/791: readlink dd/d1b/d4f/d86/la0 0 2024-09-20T18:35:51.840 INFO:tasks.workunit.client.0.smithi017.stdout:2/346: creat d1/df/f71 x:0 0 0 2024-09-20T18:35:51.841 INFO:tasks.workunit.client.0.smithi017.stdout:2/347: write d1/df/f71 [71079,118370] 0 2024-09-20T18:35:51.842 INFO:tasks.workunit.client.1.smithi172.stdout:7/834: mkdir d2/d23/dc0/d11b 0 2024-09-20T18:35:51.843 INFO:tasks.workunit.client.0.smithi017.stdout:1/137: truncate df/f18 4915711 0 2024-09-20T18:35:51.846 INFO:tasks.workunit.client.1.smithi172.stdout:3/873: creat d0/d13/d58/d6d/d7f/d84/dd9/f129 x:0 0 0 2024-09-20T18:35:51.850 INFO:tasks.workunit.client.0.smithi017.stdout:2/348: dwrite d1/dc/d58/d46/f68 [0,4194304] 0 2024-09-20T18:35:51.851 INFO:tasks.workunit.client.1.smithi172.stdout:1/778: symlink d0/dc2/lfc 0 2024-09-20T18:35:51.855 INFO:tasks.workunit.client.0.smithi017.stdout:7/275: rename da/f38 to da/d16/d1c/d40/d30/f56 0 2024-09-20T18:35:51.856 INFO:tasks.workunit.client.0.smithi017.stdout:2/349: dread d1/dc/d20/d2e/d30/f54 [0,4194304] 0 2024-09-20T18:35:51.856 INFO:tasks.workunit.client.1.smithi172.stdout:9/776: dread d15/d1f/d2c/d7d/d48/f4f [0,4194304] 0 2024-09-20T18:35:51.857 INFO:tasks.workunit.client.0.smithi017.stdout:0/244: rmdir d4/d37 39 2024-09-20T18:35:51.857 INFO:tasks.workunit.client.1.smithi172.stdout:6/705: creat d0/d18/fee x:0 0 0 2024-09-20T18:35:51.859 INFO:tasks.workunit.client.1.smithi172.stdout:8/792: rename dd/d1b/d3b/d51/d34/dee/d103 to dd/d1b/d4f/ddd/d117 0 2024-09-20T18:35:51.859 INFO:tasks.workunit.client.1.smithi172.stdout:9/777: write d15/d1a/d64/fce [950013,10985] 0 2024-09-20T18:35:51.861 INFO:tasks.workunit.client.1.smithi172.stdout:7/835: fdatasync d2/d23/d51/d10e/d72/fcd 0 2024-09-20T18:35:51.862 INFO:tasks.workunit.client.1.smithi172.stdout:1/779: dwrite d0/d8/db/d25/f49 [4194304,4194304] 0 2024-09-20T18:35:51.862 INFO:tasks.workunit.client.0.smithi017.stdout:1/138: mknod df/d1c/c23 0 2024-09-20T18:35:51.864 INFO:tasks.workunit.client.1.smithi172.stdout:3/874: mknod d0/d13/dfb/c12a 0 2024-09-20T18:35:51.864 INFO:tasks.workunit.client.0.smithi017.stdout:4/205: write f3 [1135174,102533] 0 2024-09-20T18:35:51.865 INFO:tasks.workunit.client.1.smithi172.stdout:3/875: dread - d0/dc/d6a/d76/fd2 zero size 2024-09-20T18:35:51.866 INFO:tasks.workunit.client.0.smithi017.stdout:4/206: write d4/f38 [323125,103198] 0 2024-09-20T18:35:51.866 INFO:tasks.workunit.client.1.smithi172.stdout:3/876: write d0/f20 [1774266,45009] 0 2024-09-20T18:35:51.867 INFO:tasks.workunit.client.0.smithi017.stdout:4/207: fsync d4/dc/d1e/d26/f31 0 2024-09-20T18:35:51.867 INFO:tasks.workunit.client.1.smithi172.stdout:9/778: symlink d15/d1a/d6f/l101 0 2024-09-20T18:35:51.868 INFO:tasks.workunit.client.1.smithi172.stdout:3/877: stat d0/f16 0 2024-09-20T18:35:51.871 INFO:tasks.workunit.client.1.smithi172.stdout:6/706: mkdir d0/d18/d1c/d21/d26/d34/da2/def 0 2024-09-20T18:35:51.871 INFO:tasks.workunit.client.0.smithi017.stdout:7/276: fdatasync da/f12 0 2024-09-20T18:35:51.872 INFO:tasks.workunit.client.1.smithi172.stdout:6/707: fsync d0/d18/d1c/d21/d26/d34/d39/fc0 0 2024-09-20T18:35:51.873 INFO:tasks.workunit.client.1.smithi172.stdout:8/793: creat dd/d1b/d3b/d51/dbd/f118 x:0 0 0 2024-09-20T18:35:51.873 INFO:tasks.workunit.client.0.smithi017.stdout:3/404: dread da/f15 [0,4194304] 0 2024-09-20T18:35:51.874 INFO:tasks.workunit.client.1.smithi172.stdout:8/794: dread dd/d1b/d3b/d51/d5b/d6b/f98 [0,4194304] 0 2024-09-20T18:35:51.875 INFO:tasks.workunit.client.0.smithi017.stdout:3/405: write da/f58 [2669910,104388] 0 2024-09-20T18:35:51.876 INFO:tasks.workunit.client.0.smithi017.stdout:3/406: chown da/de/d13/l25 14024350 1 2024-09-20T18:35:51.876 INFO:tasks.workunit.client.1.smithi172.stdout:7/836: mknod d2/d3/d10/d40/c11c 0 2024-09-20T18:35:51.878 INFO:tasks.workunit.client.0.smithi017.stdout:0/245: dread d4/db/f4e [0,4194304] 0 2024-09-20T18:35:51.879 INFO:tasks.workunit.client.0.smithi017.stdout:0/246: readlink d4/l15 0 2024-09-20T18:35:51.880 INFO:tasks.workunit.client.1.smithi172.stdout:1/780: creat d0/d8/db/d25/d6f/ffd x:0 0 0 2024-09-20T18:35:51.882 INFO:tasks.workunit.client.0.smithi017.stdout:2/350: dread d1/dc/d20/d2e/d30/f4b [0,4194304] 0 2024-09-20T18:35:51.883 INFO:tasks.workunit.client.0.smithi017.stdout:0/247: dread d4/fa [0,4194304] 0 2024-09-20T18:35:51.884 INFO:tasks.workunit.client.0.smithi017.stdout:4/208: creat d4/d19/f42 x:0 0 0 2024-09-20T18:35:51.885 INFO:tasks.workunit.client.0.smithi017.stdout:4/209: chown d4/de/c29 0 1 2024-09-20T18:35:51.885 INFO:tasks.workunit.client.1.smithi172.stdout:5/847: sync 2024-09-20T18:35:51.886 INFO:tasks.workunit.client.1.smithi172.stdout:3/878: symlink d0/d13/d9e/l12b 0 2024-09-20T18:35:51.888 INFO:tasks.workunit.client.1.smithi172.stdout:8/795: dread dd/d65/f7f [0,4194304] 0 2024-09-20T18:35:51.889 INFO:tasks.workunit.client.1.smithi172.stdout:6/708: creat d0/d18/d1c/d21/d26/d79/ff0 x:0 0 0 2024-09-20T18:35:51.892 INFO:tasks.workunit.client.1.smithi172.stdout:7/837: fsync d2/f3e 0 2024-09-20T18:35:51.896 INFO:tasks.workunit.client.0.smithi017.stdout:7/277: dwrite da/f14 [0,4194304] 0 2024-09-20T18:35:51.897 INFO:tasks.workunit.client.1.smithi172.stdout:9/779: symlink d15/d1f/d2c/l102 0 2024-09-20T18:35:51.899 INFO:tasks.workunit.client.1.smithi172.stdout:3/879: unlink d0/c5d 0 2024-09-20T18:35:51.900 INFO:tasks.workunit.client.1.smithi172.stdout:3/880: chown d0/dc/d6a/d3a/d74/fee 60 1 2024-09-20T18:35:51.900 INFO:tasks.workunit.client.1.smithi172.stdout:3/881: write d0/dc/d6a/d3a/d74/fa5 [622813,17956] 0 2024-09-20T18:35:51.901 INFO:tasks.workunit.client.1.smithi172.stdout:5/848: chown d4/df/dad/d26/d41/d69/dac/d2c 106821 1 2024-09-20T18:35:51.902 INFO:tasks.workunit.client.1.smithi172.stdout:5/849: chown d4/f48 2984 1 2024-09-20T18:35:51.903 INFO:tasks.workunit.client.1.smithi172.stdout:8/796: symlink dd/d1b/d4f/d86/de8/l119 0 2024-09-20T18:35:51.905 INFO:tasks.workunit.client.0.smithi017.stdout:0/248: read - d4/d37/f4d zero size 2024-09-20T18:35:51.906 INFO:tasks.workunit.client.0.smithi017.stdout:7/278: rmdir da/d16/d1c/d40/d34/d3c 39 2024-09-20T18:35:51.907 INFO:tasks.workunit.client.0.smithi017.stdout:3/407: dwrite da/de/d13/d16/f3f [0,4194304] 0 2024-09-20T18:35:51.908 INFO:tasks.workunit.client.0.smithi017.stdout:3/408: chown da/de/l55 19389537 1 2024-09-20T18:35:51.909 INFO:tasks.workunit.client.0.smithi017.stdout:2/351: mknod d1/dc/d58/d46/d48/c72 0 2024-09-20T18:35:51.910 INFO:tasks.workunit.client.0.smithi017.stdout:1/139: creat df/f24 x:0 0 0 2024-09-20T18:35:51.915 INFO:tasks.workunit.client.0.smithi017.stdout:3/409: fdatasync da/de/d13/d2f/d26/d31/d5a/d76/f6a 0 2024-09-20T18:35:51.917 INFO:tasks.workunit.client.0.smithi017.stdout:0/249: mkdir d4/db/d1e/d4f 0 2024-09-20T18:35:51.922 INFO:tasks.workunit.client.1.smithi172.stdout:3/882: mkdir d0/d13/d1e/d12c 0 2024-09-20T18:35:51.923 INFO:tasks.workunit.client.0.smithi017.stdout:0/250: creat d4/d20/f50 x:0 0 0 2024-09-20T18:35:51.924 INFO:tasks.workunit.client.1.smithi172.stdout:5/850: write d4/df/dad/d26/d41/d69/dac/d2c/fff [150347,38015] 0 2024-09-20T18:35:51.924 INFO:tasks.workunit.client.0.smithi017.stdout:0/251: write d4/db/f3b [174640,49114] 0 2024-09-20T18:35:51.926 INFO:tasks.workunit.client.1.smithi172.stdout:8/797: dread dd/d1b/d3b/d51/f88 [0,4194304] 0 2024-09-20T18:35:51.926 INFO:tasks.workunit.client.0.smithi017.stdout:4/210: truncate d4/d19/f30 2686087 0 2024-09-20T18:35:51.926 INFO:tasks.workunit.client.1.smithi172.stdout:1/781: mknod d0/d8/d12/d96/dd0/cfe 0 2024-09-20T18:35:51.928 INFO:tasks.workunit.client.1.smithi172.stdout:9/780: symlink d15/d20/l103 0 2024-09-20T18:35:51.930 INFO:tasks.workunit.client.1.smithi172.stdout:8/798: dread dd/d1b/d4f/fcb [0,4194304] 0 2024-09-20T18:35:51.930 INFO:tasks.workunit.client.1.smithi172.stdout:7/838: truncate d2/d3/d3d/d4e/d8b/fb0 208534 0 2024-09-20T18:35:51.931 INFO:tasks.workunit.client.0.smithi017.stdout:2/352: write d1/dc/d58/d3d/f36 [4747413,127954] 0 2024-09-20T18:35:51.935 INFO:tasks.workunit.client.0.smithi017.stdout:1/140: getdents df/d16 0 2024-09-20T18:35:51.936 INFO:tasks.workunit.client.0.smithi017.stdout:1/141: dread - df/d16/f21 zero size 2024-09-20T18:35:51.939 INFO:tasks.workunit.client.1.smithi172.stdout:9/781: truncate d15/d1f/d7e/f93 3217237 0 2024-09-20T18:35:51.939 INFO:tasks.workunit.client.1.smithi172.stdout:9/782: chown d15/d1f/l22 60718382 1 2024-09-20T18:35:51.941 INFO:tasks.workunit.client.0.smithi017.stdout:7/279: getdents da/d16/d1c/d40/d34/d3c 0 2024-09-20T18:35:51.942 INFO:tasks.workunit.client.1.smithi172.stdout:7/839: rmdir d2/d23/d51 39 2024-09-20T18:35:51.944 INFO:tasks.workunit.client.0.smithi017.stdout:3/410: dwrite da/de/d13/d2f/d26/d31/d5a/d76/d19/f1c [0,4194304] 0 2024-09-20T18:35:51.946 INFO:tasks.workunit.client.1.smithi172.stdout:3/883: link d0/d13/d32/d54/d83/dbb/f11a d0/dc/d6a/dc5/d11d/f12d 0 2024-09-20T18:35:51.947 INFO:tasks.workunit.client.1.smithi172.stdout:3/884: truncate d0/d13/db2/fdc 675440 0 2024-09-20T18:35:51.948 INFO:tasks.workunit.client.0.smithi017.stdout:0/252: unlink d4/db/d1e/d42/c46 0 2024-09-20T18:35:51.950 INFO:tasks.workunit.client.0.smithi017.stdout:4/211: mkdir d4/dc/d41/d43 0 2024-09-20T18:35:51.950 INFO:tasks.workunit.client.0.smithi017.stdout:4/212: fdatasync f3 0 2024-09-20T18:35:51.951 INFO:tasks.workunit.client.1.smithi172.stdout:1/782: symlink d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dcf/lff 0 2024-09-20T18:35:51.952 INFO:tasks.workunit.client.0.smithi017.stdout:1/142: creat df/d1c/f25 x:0 0 0 2024-09-20T18:35:51.953 INFO:tasks.workunit.client.1.smithi172.stdout:4/843: sync 2024-09-20T18:35:51.953 INFO:tasks.workunit.client.1.smithi172.stdout:2/766: sync 2024-09-20T18:35:51.956 INFO:tasks.workunit.client.1.smithi172.stdout:7/840: fsync d2/d3/dd/f1d 0 2024-09-20T18:35:51.957 INFO:tasks.workunit.client.0.smithi017.stdout:2/353: mknod d1/d6c/c73 0 2024-09-20T18:35:51.958 INFO:tasks.workunit.client.1.smithi172.stdout:9/783: dread d15/d1f/d88/fc5 [0,4194304] 0 2024-09-20T18:35:51.959 INFO:tasks.workunit.client.0.smithi017.stdout:2/354: dread - d1/d1f/f6e zero size 2024-09-20T18:35:51.959 INFO:tasks.workunit.client.0.smithi017.stdout:3/411: readlink da/de/d13/d2f/d26/l34 0 2024-09-20T18:35:51.959 INFO:tasks.workunit.client.1.smithi172.stdout:1/783: unlink d0/d8/db/d25/d2b/d3d/c60 0 2024-09-20T18:35:51.960 INFO:tasks.workunit.client.1.smithi172.stdout:1/784: readlink d0/d8/db/d25/d2b/d3d/d65/l7d 0 2024-09-20T18:35:51.961 INFO:tasks.workunit.client.0.smithi017.stdout:3/412: write da/de/d13/d16/d50/f78 [1080869,13000] 0 2024-09-20T18:35:51.961 INFO:tasks.workunit.client.1.smithi172.stdout:1/785: chown d0/d8/db/d39/cdc 16528293 1 2024-09-20T18:35:51.962 INFO:tasks.workunit.client.1.smithi172.stdout:4/844: readlink d0/de/d21/lb3 0 2024-09-20T18:35:51.962 INFO:tasks.workunit.client.1.smithi172.stdout:1/786: write d0/d8/db/d25/d2b/fc1 [379897,68360] 0 2024-09-20T18:35:51.965 INFO:tasks.workunit.client.1.smithi172.stdout:2/767: creat d0/d2c/d3f/dab/d22/d10/d6a/d98/d59/f102 x:0 0 0 2024-09-20T18:35:51.968 INFO:tasks.workunit.client.0.smithi017.stdout:0/253: mkdir d4/db/d1e/d24/d2f/d51 0 2024-09-20T18:35:51.971 INFO:tasks.workunit.client.0.smithi017.stdout:7/280: dread da/d16/d1b/f28 [0,4194304] 0 2024-09-20T18:35:51.971 INFO:tasks.workunit.client.1.smithi172.stdout:2/768: dwrite d0/d2c/d3f/dab/d22/d10/d35/fc2 [0,4194304] 0 2024-09-20T18:35:51.972 INFO:tasks.workunit.client.1.smithi172.stdout:7/841: symlink d2/d23/dc0/l11d 0 2024-09-20T18:35:51.973 INFO:tasks.workunit.client.0.smithi017.stdout:4/213: symlink d4/dc/d1e/d26/l44 0 2024-09-20T18:35:51.981 INFO:tasks.workunit.client.0.smithi017.stdout:3/413: chown da/de/d13/d2f/d26/d31/f7e 454685 1 2024-09-20T18:35:51.982 INFO:tasks.workunit.client.1.smithi172.stdout:2/769: creat d0/d2c/d3f/dab/d22/d10/d3c/f103 x:0 0 0 2024-09-20T18:35:51.983 INFO:tasks.workunit.client.1.smithi172.stdout:1/787: dread d0/d8/db/d25/d2b/d3d/f4d [0,4194304] 0 2024-09-20T18:35:51.983 INFO:tasks.workunit.client.0.smithi017.stdout:7/281: truncate da/d16/d1c/f1f 1589897 0 2024-09-20T18:35:51.984 INFO:tasks.workunit.client.1.smithi172.stdout:4/845: dwrite d0/d48/f100 [0,4194304] 0 2024-09-20T18:35:51.984 INFO:tasks.workunit.client.0.smithi017.stdout:7/282: chown da/d16/f47 20468 1 2024-09-20T18:35:51.984 INFO:tasks.workunit.client.1.smithi172.stdout:9/784: mkdir d15/d20/d104 0 2024-09-20T18:35:51.986 INFO:tasks.workunit.client.1.smithi172.stdout:4/846: truncate d0/de/d21/f11b 944107 0 2024-09-20T18:35:51.987 INFO:tasks.workunit.client.1.smithi172.stdout:7/842: getdents d2/ddf 0 2024-09-20T18:35:51.987 INFO:tasks.workunit.client.0.smithi017.stdout:3/414: truncate da/f29 2169344 0 2024-09-20T18:35:51.988 INFO:tasks.workunit.client.1.smithi172.stdout:1/788: write d0/d8/ff5 [1708622,21294] 0 2024-09-20T18:35:52.012 INFO:tasks.workunit.client.1.smithi172.stdout:6/709: sync 2024-09-20T18:35:52.061 INFO:tasks.workunit.client.1.smithi172.stdout:2/770: fdatasync d0/d2c/d3f/f30 0 2024-09-20T18:35:52.062 INFO:tasks.workunit.client.1.smithi172.stdout:2/771: fdatasync d0/d2c/d3f/f8a 0 2024-09-20T18:35:52.063 INFO:tasks.workunit.client.1.smithi172.stdout:2/772: chown d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/de7 356093189 1 2024-09-20T18:35:52.065 INFO:tasks.workunit.client.0.smithi017.stdout:0/254: truncate d4/f17 2713545 0 2024-09-20T18:35:52.068 INFO:tasks.workunit.client.1.smithi172.stdout:4/847: symlink d0/d48/d90/d55/d53/l128 0 2024-09-20T18:35:52.068 INFO:tasks.workunit.client.1.smithi172.stdout:8/799: sync 2024-09-20T18:35:52.068 INFO:tasks.workunit.client.1.smithi172.stdout:5/851: sync 2024-09-20T18:35:52.068 INFO:tasks.workunit.client.1.smithi172.stdout:3/885: sync 2024-09-20T18:35:52.069 INFO:tasks.workunit.client.0.smithi017.stdout:1/143: creat df/f26 x:0 0 0 2024-09-20T18:35:52.069 INFO:tasks.workunit.client.1.smithi172.stdout:8/800: dread - dd/d1b/d4f/ddd/d117/f10e zero size 2024-09-20T18:35:52.069 INFO:tasks.workunit.client.0.smithi017.stdout:1/144: chown df/d1c/f1e 1920 1 2024-09-20T18:35:52.070 INFO:tasks.workunit.client.1.smithi172.stdout:7/843: creat d2/d3/d86/f11e x:0 0 0 2024-09-20T18:35:52.071 INFO:tasks.workunit.client.0.smithi017.stdout:2/355: creat d1/dc/d20/f74 x:0 0 0 2024-09-20T18:35:52.073 INFO:tasks.workunit.client.1.smithi172.stdout:5/852: dwrite d4/df/d3f/d64/d101/d86/faa [0,4194304] 0 2024-09-20T18:35:52.082 INFO:tasks.workunit.client.1.smithi172.stdout:2/773: mkdir d0/d2c/d3f/dab/d18/d29/d42/d4b/d53/d104 0 2024-09-20T18:35:52.083 INFO:tasks.workunit.client.0.smithi017.stdout:2/356: dread d1/df/f1e [0,4194304] 0 2024-09-20T18:35:52.083 INFO:tasks.workunit.client.1.smithi172.stdout:2/774: write d0/d2c/d3f/dab/d22/d10/d35/fa6 [249909,59360] 0 2024-09-20T18:35:52.086 INFO:tasks.workunit.client.1.smithi172.stdout:9/785: unlink d15/d1a/l65 0 2024-09-20T18:35:52.086 INFO:tasks.workunit.client.1.smithi172.stdout:6/710: sync 2024-09-20T18:35:52.088 INFO:tasks.workunit.client.0.smithi017.stdout:7/283: symlink da/d16/d1c/d40/d34/l57 0 2024-09-20T18:35:52.090 INFO:tasks.workunit.client.1.smithi172.stdout:4/848: symlink d0/d48/d90/db4/l129 0 2024-09-20T18:35:52.090 INFO:tasks.workunit.client.0.smithi017.stdout:1/145: mknod df/d16/c27 0 2024-09-20T18:35:52.091 INFO:tasks.workunit.client.1.smithi172.stdout:3/886: read - d0/dc/d6a/d76/f94 zero size 2024-09-20T18:35:52.095 INFO:tasks.workunit.client.0.smithi017.stdout:3/415: truncate da/de/d13/f54 567398 0 2024-09-20T18:35:52.097 INFO:tasks.workunit.client.0.smithi017.stdout:3/416: dread da/de/d53/f44 [0,4194304] 0 2024-09-20T18:35:52.098 INFO:tasks.workunit.client.0.smithi017.stdout:0/255: mkdir d4/db/d1e/d24/d2f/d51/d52 0 2024-09-20T18:35:52.100 INFO:tasks.workunit.client.1.smithi172.stdout:5/853: truncate d4/df/dad/d26/d41/d69/f9d 562459 0 2024-09-20T18:35:52.100 INFO:tasks.workunit.client.0.smithi017.stdout:2/357: mknod d1/dc/d58/d3d/c75 0 2024-09-20T18:35:52.102 INFO:tasks.workunit.client.1.smithi172.stdout:2/775: creat d0/d90/f105 x:0 0 0 2024-09-20T18:35:52.105 INFO:tasks.workunit.client.1.smithi172.stdout:5/854: dwrite d4/df/d3f/d64/d101/dce/dd9/fe6 [0,4194304] 0 2024-09-20T18:35:52.106 INFO:tasks.workunit.client.0.smithi017.stdout:1/146: dread df/f18 [0,4194304] 0 2024-09-20T18:35:52.106 INFO:tasks.workunit.client.1.smithi172.stdout:5/855: chown d4/df/dad/d26/d41/d65/lc6 62935 1 2024-09-20T18:35:52.107 INFO:tasks.workunit.client.0.smithi017.stdout:1/147: truncate df/d16/f22 384473 0 2024-09-20T18:35:52.107 INFO:tasks.workunit.client.1.smithi172.stdout:1/789: rename d0/d8/db/d25/d2b/l68 to d0/d8/db/d25/d2b/d3d/d65/d93/dbb/l100 0 2024-09-20T18:35:52.107 INFO:tasks.workunit.client.1.smithi172.stdout:5/856: chown d4/df/dad/d26/d41/l60 779 1 2024-09-20T18:35:52.108 INFO:tasks.workunit.client.0.smithi017.stdout:4/214: write d4/d19/f30 [2359475,62343] 0 2024-09-20T18:35:52.115 INFO:tasks.workunit.client.0.smithi017.stdout:7/284: link da/f13 da/d54/f58 0 2024-09-20T18:35:52.119 INFO:tasks.workunit.client.1.smithi172.stdout:8/801: rename dd/d1b/d3b/d5d/fd0 to dd/d1b/d3b/dc7/f11a 0 2024-09-20T18:35:52.121 INFO:tasks.workunit.client.1.smithi172.stdout:5/857: read d4/df/dad/d26/fbd [3730812,2014] 0 2024-09-20T18:35:52.123 INFO:tasks.workunit.client.0.smithi017.stdout:1/148: creat df/d16/f28 x:0 0 0 2024-09-20T18:35:52.126 INFO:tasks.workunit.client.0.smithi017.stdout:3/417: unlink da/de/d13/d16/l79 0 2024-09-20T18:35:52.126 INFO:tasks.workunit.client.1.smithi172.stdout:6/711: dread d0/d18/f2b [0,4194304] 0 2024-09-20T18:35:52.127 INFO:tasks.workunit.client.0.smithi017.stdout:3/418: chown da/de/d13/d2f/d26 15 1 2024-09-20T18:35:52.133 INFO:tasks.workunit.client.1.smithi172.stdout:1/790: dread d0/d8/db/d25/d2b/d3d/fae [0,4194304] 0 2024-09-20T18:35:52.134 INFO:tasks.workunit.client.1.smithi172.stdout:7/844: rename d2/d3/d10/d40/f119 to d2/d23/d51/d10e/d72/d9b/f11f 0 2024-09-20T18:35:52.138 INFO:tasks.workunit.client.0.smithi017.stdout:4/215: unlink d4/dc/d1e/d26/f31 0 2024-09-20T18:35:52.139 INFO:tasks.workunit.client.1.smithi172.stdout:5/858: mknod d4/df/d3f/d64/d101/dce/c11b 0 2024-09-20T18:35:52.140 INFO:tasks.workunit.client.0.smithi017.stdout:4/216: fsync d4/d19/f42 0 2024-09-20T18:35:52.141 INFO:tasks.workunit.client.0.smithi017.stdout:1/149: dread df/d1c/f1e [0,4194304] 0 2024-09-20T18:35:52.141 INFO:tasks.workunit.client.0.smithi017.stdout:0/256: link d4/l15 d4/d37/l53 0 2024-09-20T18:35:52.144 INFO:tasks.workunit.client.1.smithi172.stdout:3/887: getdents d0/dc/d6a/d3a/dcb 0 2024-09-20T18:35:52.146 INFO:tasks.workunit.client.0.smithi017.stdout:3/419: rename da/de/f6f to da/de/d13/d16/d6e/d82/f8c 0 2024-09-20T18:35:52.146 INFO:tasks.workunit.client.1.smithi172.stdout:9/786: dwrite d15/d1f/f7f [0,4194304] 0 2024-09-20T18:35:52.149 INFO:tasks.workunit.client.1.smithi172.stdout:1/791: symlink d0/d22/l101 0 2024-09-20T18:35:52.154 INFO:tasks.workunit.client.1.smithi172.stdout:2/776: rename d0/d2c/d3f/dab/d22/d10/d3c/d7b to d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/d9f/d106 0 2024-09-20T18:35:52.155 INFO:tasks.workunit.client.1.smithi172.stdout:6/712: dread d0/f4a [0,4194304] 0 2024-09-20T18:35:52.155 INFO:tasks.workunit.client.1.smithi172.stdout:1/792: dwrite d0/d8/db/d25/d6d/d77/f9b [0,4194304] 0 2024-09-20T18:35:52.157 INFO:tasks.workunit.client.1.smithi172.stdout:8/802: write dd/d1b/f23 [2467384,107485] 0 2024-09-20T18:35:52.161 INFO:tasks.workunit.client.1.smithi172.stdout:9/787: write d15/d1f/d2c/d7d/d48/f79 [2088883,56969] 0 2024-09-20T18:35:52.165 INFO:tasks.workunit.client.0.smithi017.stdout:4/217: rmdir d4/dc/d1e/d26/d2b 0 2024-09-20T18:35:52.166 INFO:tasks.workunit.client.0.smithi017.stdout:3/420: dwrite da/de/d13/d16/d6e/d82/f8c [0,4194304] 0 2024-09-20T18:35:52.169 INFO:tasks.workunit.client.1.smithi172.stdout:3/888: creat d0/d13/d32/d123/f12e x:0 0 0 2024-09-20T18:35:52.172 INFO:tasks.workunit.client.0.smithi017.stdout:1/150: getdents df 0 2024-09-20T18:35:52.175 INFO:tasks.workunit.client.0.smithi017.stdout:3/421: mknod da/de/d13/d16/d6e/c8d 0 2024-09-20T18:35:52.178 INFO:tasks.workunit.client.0.smithi017.stdout:1/151: mkdir df/d29 0 2024-09-20T18:35:52.179 INFO:tasks.workunit.client.1.smithi172.stdout:3/889: fdatasync d0/d13/d1e/f59 0 2024-09-20T18:35:52.182 INFO:tasks.workunit.client.1.smithi172.stdout:7/845: rename d2/d3/de1 to d2/d23/d120 0 2024-09-20T18:35:52.182 INFO:tasks.workunit.client.1.smithi172.stdout:6/713: dread d0/d18/f54 [0,4194304] 0 2024-09-20T18:35:52.183 INFO:tasks.workunit.client.0.smithi017.stdout:0/257: truncate d4/f6 3452155 0 2024-09-20T18:35:52.185 INFO:tasks.workunit.client.1.smithi172.stdout:1/793: creat d0/d8/d12/f102 x:0 0 0 2024-09-20T18:35:52.192 INFO:tasks.workunit.client.1.smithi172.stdout:2/777: dread d0/d2c/d3f/dab/d22/d4c/f88 [0,4194304] 0 2024-09-20T18:35:52.192 INFO:tasks.workunit.client.0.smithi017.stdout:0/258: truncate d4/f8 954193 0 2024-09-20T18:35:52.193 INFO:tasks.workunit.client.0.smithi017.stdout:0/259: stat d4/db/fe 0 2024-09-20T18:35:52.194 INFO:tasks.workunit.client.0.smithi017.stdout:0/260: truncate d4/d20/f2a 487675 0 2024-09-20T18:35:52.194 INFO:tasks.workunit.client.1.smithi172.stdout:9/788: rename d15/d4a/d8c/fab to d15/d1f/d2c/d7d/d34/db5/f105 0 2024-09-20T18:35:52.196 INFO:tasks.workunit.client.0.smithi017.stdout:4/218: getdents d4/dc 0 2024-09-20T18:35:52.197 INFO:tasks.workunit.client.0.smithi017.stdout:4/219: write d4/de/d1b/f33 [773421,59104] 0 2024-09-20T18:35:52.201 INFO:tasks.workunit.client.1.smithi172.stdout:7/846: unlink d2/d3/d10/d40/d46/d8e/dbd/cc7 0 2024-09-20T18:35:52.202 INFO:tasks.workunit.client.1.smithi172.stdout:6/714: dread d0/f36 [0,4194304] 0 2024-09-20T18:35:52.203 INFO:tasks.workunit.client.1.smithi172.stdout:4/849: sync 2024-09-20T18:35:52.203 INFO:tasks.workunit.client.1.smithi172.stdout:5/859: sync 2024-09-20T18:35:52.204 INFO:tasks.workunit.client.1.smithi172.stdout:4/850: chown d0/de/d21 10372 1 2024-09-20T18:35:52.204 INFO:tasks.workunit.client.0.smithi017.stdout:1/152: write df/f26 [109494,9785] 0 2024-09-20T18:35:52.205 INFO:tasks.workunit.client.1.smithi172.stdout:4/851: stat d0/feb 0 2024-09-20T18:35:52.205 INFO:tasks.workunit.client.0.smithi017.stdout:4/220: creat d4/de/d1b/f45 x:0 0 0 2024-09-20T18:35:52.206 INFO:tasks.workunit.client.1.smithi172.stdout:6/715: dread d0/d18/d1c/fb8 [0,4194304] 0 2024-09-20T18:35:52.208 INFO:tasks.workunit.client.1.smithi172.stdout:9/789: rmdir d15/d1f/d7e 39 2024-09-20T18:35:52.209 INFO:tasks.workunit.client.1.smithi172.stdout:9/790: stat d15/d1f/d2c/d7d 0 2024-09-20T18:35:52.209 INFO:tasks.workunit.client.1.smithi172.stdout:9/791: readlink d15/d1f/d2c/d7d/l7c 0 2024-09-20T18:35:52.210 INFO:tasks.workunit.client.0.smithi017.stdout:1/153: read - df/f24 zero size 2024-09-20T18:35:52.210 INFO:tasks.workunit.client.0.smithi017.stdout:3/422: dwrite da/de/d13/f67 [0,4194304] 0 2024-09-20T18:35:52.212 INFO:tasks.workunit.client.0.smithi017.stdout:3/423: read - da/de/d13/d2f/d26/d41/f83 zero size 2024-09-20T18:35:52.212 INFO:tasks.workunit.client.0.smithi017.stdout:4/221: dread d4/f2c [0,4194304] 0 2024-09-20T18:35:52.213 INFO:tasks.workunit.client.0.smithi017.stdout:4/222: read d4/f38 [350581,109849] 0 2024-09-20T18:35:52.220 INFO:tasks.workunit.client.0.smithi017.stdout:0/261: getdents d4/db/d1e 0 2024-09-20T18:35:52.222 INFO:tasks.workunit.client.0.smithi017.stdout:1/154: symlink df/d1c/l2a 0 2024-09-20T18:35:52.223 INFO:tasks.workunit.client.0.smithi017.stdout:1/155: dread df/f26 [0,4194304] 0 2024-09-20T18:35:52.224 INFO:tasks.workunit.client.0.smithi017.stdout:4/223: symlink d4/l46 0 2024-09-20T18:35:52.225 INFO:tasks.workunit.client.0.smithi017.stdout:1/156: truncate df/f26 836487 0 2024-09-20T18:35:52.226 INFO:tasks.workunit.client.0.smithi017.stdout:1/157: truncate df/f26 1485028 0 2024-09-20T18:35:52.226 INFO:tasks.workunit.client.0.smithi017.stdout:1/158: stat df/f24 0 2024-09-20T18:35:52.227 INFO:tasks.workunit.client.0.smithi017.stdout:4/224: write d4/dc/f40 [4948989,9408] 0 2024-09-20T18:35:52.234 INFO:tasks.workunit.client.0.smithi017.stdout:4/225: dwrite d4/d19/f35 [0,4194304] 0 2024-09-20T18:35:52.239 INFO:tasks.workunit.client.0.smithi017.stdout:4/226: unlink d4/dc/f40 0 2024-09-20T18:35:52.245 INFO:tasks.workunit.client.1.smithi172.stdout:8/803: sync 2024-09-20T18:35:52.245 INFO:tasks.workunit.client.1.smithi172.stdout:8/804: dread - dd/d1b/d3b/d5d/df6/f100 zero size 2024-09-20T18:35:52.246 INFO:tasks.workunit.client.0.smithi017.stdout:4/227: dwrite d4/dc/d1e/d26/d22/f36 [0,4194304] 0 2024-09-20T18:35:52.250 INFO:tasks.workunit.client.0.smithi017.stdout:4/228: mknod d4/d19/c47 0 2024-09-20T18:35:52.251 INFO:tasks.workunit.client.0.smithi017.stdout:0/262: truncate d4/db/fe 2568943 0 2024-09-20T18:35:52.256 INFO:tasks.workunit.client.0.smithi017.stdout:0/263: creat d4/db/d18/f54 x:0 0 0 2024-09-20T18:35:52.256 INFO:tasks.workunit.client.0.smithi017.stdout:4/229: dread d4/f38 [0,4194304] 0 2024-09-20T18:35:52.257 INFO:tasks.workunit.client.0.smithi017.stdout:0/264: truncate d4/d20/f50 131631 0 2024-09-20T18:35:52.258 INFO:tasks.workunit.client.0.smithi017.stdout:4/230: write d4/dc/d1e/d26/d22/f21 [1126707,101104] 0 2024-09-20T18:35:52.261 INFO:tasks.workunit.client.0.smithi017.stdout:1/159: truncate df/f11 6111492 0 2024-09-20T18:35:52.262 INFO:tasks.workunit.client.0.smithi017.stdout:0/265: readlink d4/d37/l53 0 2024-09-20T18:35:52.264 INFO:tasks.workunit.client.0.smithi017.stdout:4/231: symlink d4/dc/d1e/l48 0 2024-09-20T18:35:52.264 INFO:tasks.workunit.client.0.smithi017.stdout:4/232: fdatasync d4/de/d1b/f45 0 2024-09-20T18:35:52.266 INFO:tasks.workunit.client.0.smithi017.stdout:1/160: read df/f1a [2065344,85092] 0 2024-09-20T18:35:52.267 INFO:tasks.workunit.client.0.smithi017.stdout:4/233: fdatasync d4/de/d1b/f2f 0 2024-09-20T18:35:52.272 INFO:tasks.workunit.client.0.smithi017.stdout:4/234: mknod d4/de/d1b/c49 0 2024-09-20T18:35:52.278 INFO:tasks.workunit.client.0.smithi017.stdout:0/266: getdents d4/d20 0 2024-09-20T18:35:52.281 INFO:tasks.workunit.client.0.smithi017.stdout:1/161: rename df/d16/f28 to df/f2b 0 2024-09-20T18:35:52.286 INFO:tasks.workunit.client.1.smithi172.stdout:2/778: mkdir d0/d2c/d3f/dab/d45/ddc/d107 0 2024-09-20T18:35:52.287 INFO:tasks.workunit.client.0.smithi017.stdout:1/162: dread df/f26 [0,4194304] 0 2024-09-20T18:35:52.290 INFO:tasks.workunit.client.1.smithi172.stdout:1/794: link d0/d22/f7a d0/d8/d5f/dfb/f103 0 2024-09-20T18:35:52.291 INFO:tasks.workunit.client.1.smithi172.stdout:3/890: getdents d0/d13/d58/d6d/db9/de0 0 2024-09-20T18:35:52.293 INFO:tasks.workunit.client.1.smithi172.stdout:5/860: mkdir d4/df/d3f/d64/d101/d11c 0 2024-09-20T18:35:52.296 INFO:tasks.workunit.client.1.smithi172.stdout:4/852: creat d0/d48/d4e/d110/f12a x:0 0 0 2024-09-20T18:35:52.297 INFO:tasks.workunit.client.1.smithi172.stdout:7/847: write d2/d3/d10/f18 [584069,125738] 0 2024-09-20T18:35:52.297 INFO:tasks.workunit.client.1.smithi172.stdout:6/716: creat d0/d18/d1c/d21/d26/d34/da2/def/ff1 x:0 0 0 2024-09-20T18:35:52.298 INFO:tasks.workunit.client.1.smithi172.stdout:4/853: write d0/de/d21/d24/f127 [486765,38396] 0 2024-09-20T18:35:52.299 INFO:tasks.workunit.client.1.smithi172.stdout:2/779: write d0/d2c/d3f/dab/d22/fda [8216707,2311] 0 2024-09-20T18:35:52.300 INFO:tasks.workunit.client.1.smithi172.stdout:6/717: chown d0/d18/d1c/d21/d26/d34/d39/d46/c50 751695252 1 2024-09-20T18:35:52.301 INFO:tasks.workunit.client.1.smithi172.stdout:1/795: rmdir d0/d8/d12/d96/dd0 39 2024-09-20T18:35:52.304 INFO:tasks.workunit.client.0.smithi017.stdout:1/163: write df/f18 [5584588,100103] 0 2024-09-20T18:35:52.305 INFO:tasks.workunit.client.1.smithi172.stdout:7/848: rmdir d2/d3/d3d/d68 39 2024-09-20T18:35:52.306 INFO:tasks.workunit.client.1.smithi172.stdout:9/792: creat d15/f106 x:0 0 0 2024-09-20T18:35:52.306 INFO:tasks.workunit.client.1.smithi172.stdout:5/861: dread d4/f9 [0,4194304] 0 2024-09-20T18:35:52.307 INFO:tasks.workunit.client.1.smithi172.stdout:7/849: chown d2/d3/d10/d40/d74/dcb 0 1 2024-09-20T18:35:52.308 INFO:tasks.workunit.client.1.smithi172.stdout:8/805: dwrite dd/d1b/d3b/d51/d34/f96 [0,4194304] 0 2024-09-20T18:35:52.309 INFO:tasks.workunit.client.1.smithi172.stdout:5/862: chown d4/df/dad/d26/d41/d65/lc6 1331573 1 2024-09-20T18:35:52.310 INFO:tasks.workunit.client.0.smithi017.stdout:1/164: mkdir df/d29/d2c 0 2024-09-20T18:35:52.312 INFO:tasks.workunit.client.1.smithi172.stdout:3/891: creat d0/d13/d58/d6d/db9/dd6/f12f x:0 0 0 2024-09-20T18:35:52.313 INFO:tasks.workunit.client.0.smithi017.stdout:1/165: chown df/d16/c20 3973 1 2024-09-20T18:35:52.316 INFO:tasks.workunit.client.1.smithi172.stdout:5/863: mkdir d4/df/dad/d26/d11d 0 2024-09-20T18:35:52.318 INFO:tasks.workunit.client.0.smithi017.stdout:1/166: write df/f1a [5204822,105765] 0 2024-09-20T18:35:52.321 INFO:tasks.workunit.client.1.smithi172.stdout:8/806: rename dd/d65/d85/fcc to dd/d65/d85/da2/f11b 0 2024-09-20T18:35:52.322 INFO:tasks.workunit.client.1.smithi172.stdout:1/796: mkdir d0/d8/db/d25/d2b/d3d/d104 0 2024-09-20T18:35:52.322 INFO:tasks.workunit.client.1.smithi172.stdout:8/807: readlink dd/d1b/d3b/d51/lb5 0 2024-09-20T18:35:52.323 INFO:tasks.workunit.client.1.smithi172.stdout:8/808: readlink dd/d1b/d3b/d51/l40 0 2024-09-20T18:35:52.323 INFO:tasks.workunit.client.1.smithi172.stdout:2/780: dread d0/d2c/f3e [0,4194304] 0 2024-09-20T18:35:52.323 INFO:tasks.workunit.client.0.smithi017.stdout:1/167: rmdir df/d1c 39 2024-09-20T18:35:52.325 INFO:tasks.workunit.client.1.smithi172.stdout:7/850: link d2/d3/d10/d40/d46/d8e/dbd/ffb d2/d3/dd/f121 0 2024-09-20T18:35:52.326 INFO:tasks.workunit.client.0.smithi017.stdout:1/168: symlink df/d29/l2d 0 2024-09-20T18:35:52.326 INFO:tasks.workunit.client.0.smithi017.stdout:1/169: stat df/d16/c20 0 2024-09-20T18:35:52.326 INFO:tasks.workunit.client.1.smithi172.stdout:6/718: link d0/d18/d1c/d21/d26/d34/da2/dda/l9d d0/d18/d1c/d21/d26/d34/d9c/dac/lf2 0 2024-09-20T18:35:52.327 INFO:tasks.workunit.client.1.smithi172.stdout:4/854: getdents d0/de/d21/dc7 0 2024-09-20T18:35:52.328 INFO:tasks.workunit.client.1.smithi172.stdout:4/855: chown d0/d48/d90/d55/d53/d78/dd9 123320 1 2024-09-20T18:35:52.328 INFO:tasks.workunit.client.1.smithi172.stdout:9/793: creat d15/d1f/f107 x:0 0 0 2024-09-20T18:35:52.329 INFO:tasks.workunit.client.1.smithi172.stdout:1/797: creat d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/f105 x:0 0 0 2024-09-20T18:35:52.329 INFO:tasks.workunit.client.1.smithi172.stdout:1/798: stat d0/d8/la8 0 2024-09-20T18:35:52.329 INFO:tasks.workunit.client.0.smithi017.stdout:1/170: fdatasync df/f11 0 2024-09-20T18:35:52.330 INFO:tasks.workunit.client.0.smithi017.stdout:1/171: read df/f18 [1091313,93774] 0 2024-09-20T18:35:52.335 INFO:tasks.workunit.client.0.smithi017.stdout:1/172: creat df/d16/f2e x:0 0 0 2024-09-20T18:35:52.337 INFO:tasks.workunit.client.1.smithi172.stdout:4/856: symlink d0/d48/d90/dea/l12b 0 2024-09-20T18:35:52.341 INFO:tasks.workunit.client.0.smithi017.stdout:1/173: getdents df/d29/d2c 0 2024-09-20T18:35:52.342 INFO:tasks.workunit.client.1.smithi172.stdout:5/864: unlink d4/df/d3f/d64/d101/d63/d80/dd7/cf7 0 2024-09-20T18:35:52.344 INFO:tasks.workunit.client.1.smithi172.stdout:7/851: unlink d2/d3/d3d/d4e/l57 0 2024-09-20T18:35:52.344 INFO:tasks.workunit.client.0.smithi017.stdout:1/174: fsync df/d1c/f25 0 2024-09-20T18:35:52.345 INFO:tasks.workunit.client.1.smithi172.stdout:8/809: dwrite dd/d1b/d3b/d51/dac/fbe [0,4194304] 0 2024-09-20T18:35:52.345 INFO:tasks.workunit.client.1.smithi172.stdout:4/857: symlink d0/de/d21/d24/l12c 0 2024-09-20T18:35:52.346 INFO:tasks.workunit.client.1.smithi172.stdout:8/810: readlink dd/d1b/d3b/d51/d5b/l9f 0 2024-09-20T18:35:52.346 INFO:tasks.workunit.client.1.smithi172.stdout:4/858: chown d0/de/d21/d24/f127 1262 1 2024-09-20T18:35:52.348 INFO:tasks.workunit.client.1.smithi172.stdout:5/865: creat d4/df/d106/f11e x:0 0 0 2024-09-20T18:35:52.348 INFO:tasks.workunit.client.1.smithi172.stdout:2/781: truncate d0/d2c/d3f/dab/d22/fda 1896484 0 2024-09-20T18:35:52.350 INFO:tasks.workunit.client.1.smithi172.stdout:8/811: mkdir dd/d1b/d4f/d86/d11c 0 2024-09-20T18:35:52.351 INFO:tasks.workunit.client.0.smithi017.stdout:1/175: dwrite df/d16/f21 [0,4194304] 0 2024-09-20T18:35:52.351 INFO:tasks.workunit.client.1.smithi172.stdout:9/794: creat d15/d20/f108 x:0 0 0 2024-09-20T18:35:52.354 INFO:tasks.workunit.client.1.smithi172.stdout:7/852: symlink d2/d3/d11a/l122 0 2024-09-20T18:35:52.355 INFO:tasks.workunit.client.1.smithi172.stdout:1/799: dread d0/d8/fc [0,4194304] 0 2024-09-20T18:35:52.356 INFO:tasks.workunit.client.1.smithi172.stdout:2/782: fdatasync d0/d2c/f63 0 2024-09-20T18:35:52.357 INFO:tasks.workunit.client.1.smithi172.stdout:5/866: symlink d4/df/d3f/d64/d101/d86/d10c/l11f 0 2024-09-20T18:35:52.357 INFO:tasks.workunit.client.0.smithi017.stdout:1/176: dread df/f18 [4194304,4194304] 0 2024-09-20T18:35:52.360 INFO:tasks.workunit.client.1.smithi172.stdout:8/812: dwrite dd/d1b/f33 [0,4194304] 0 2024-09-20T18:35:52.363 INFO:tasks.workunit.client.1.smithi172.stdout:1/800: write d0/d8/db/fe [2221245,20918] 0 2024-09-20T18:35:52.363 INFO:tasks.workunit.client.0.smithi017.stdout:1/177: mknod df/d29/d2c/c2f 0 2024-09-20T18:35:52.367 INFO:tasks.workunit.client.1.smithi172.stdout:5/867: chown d4/df/d3f/l85 7808986 1 2024-09-20T18:35:52.369 INFO:tasks.workunit.client.1.smithi172.stdout:5/868: write d4/df/d98/fde [1812436,104274] 0 2024-09-20T18:35:52.372 INFO:tasks.workunit.client.1.smithi172.stdout:2/783: symlink d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/l108 0 2024-09-20T18:35:52.376 INFO:tasks.workunit.client.0.smithi017.stdout:1/178: dwrite df/f10 [8388608,4194304] 0 2024-09-20T18:35:52.376 INFO:tasks.workunit.client.1.smithi172.stdout:8/813: mknod dd/d1b/d3b/d51/d5b/dc5/df1/c11d 0 2024-09-20T18:35:52.377 INFO:tasks.workunit.client.0.smithi017.stdout:1/179: stat df/f2b 0 2024-09-20T18:35:52.377 INFO:tasks.workunit.client.0.smithi017.stdout:1/180: chown df/d16 15 1 2024-09-20T18:35:52.381 INFO:tasks.workunit.client.1.smithi172.stdout:7/853: write d2/d3/d10/d40/d6a/dc6/dd8/f109 [4176802,56305] 0 2024-09-20T18:35:52.382 INFO:tasks.workunit.client.1.smithi172.stdout:2/784: unlink d0/f91 0 2024-09-20T18:35:52.385 INFO:tasks.workunit.client.1.smithi172.stdout:9/795: write d15/d1f/d2c/d7d/d34/db5/f105 [971456,34300] 0 2024-09-20T18:35:52.386 INFO:tasks.workunit.client.1.smithi172.stdout:4/859: dwrite d0/d48/d90/d55/d53/d78/f95 [0,4194304] 0 2024-09-20T18:35:52.388 INFO:tasks.workunit.client.1.smithi172.stdout:4/860: fsync d0/de/d21/d24/f127 0 2024-09-20T18:35:52.388 INFO:tasks.workunit.client.0.smithi017.stdout:1/181: creat df/f30 x:0 0 0 2024-09-20T18:35:52.389 INFO:tasks.workunit.client.0.smithi017.stdout:1/182: fdatasync df/d1c/f25 0 2024-09-20T18:35:52.389 INFO:tasks.workunit.client.1.smithi172.stdout:4/861: write d0/d48/d90/d55/d101/fff [593506,85704] 0 2024-09-20T18:35:52.390 INFO:tasks.workunit.client.0.smithi017.stdout:1/183: chown fc 2 1 2024-09-20T18:35:52.390 INFO:tasks.workunit.client.1.smithi172.stdout:7/854: fsync d2/d3/f35 0 2024-09-20T18:35:52.391 INFO:tasks.workunit.client.1.smithi172.stdout:7/855: stat d2/d3/dd/d84/ca2 0 2024-09-20T18:35:52.391 INFO:tasks.workunit.client.1.smithi172.stdout:1/801: creat d0/d8/db/d25/d2b/d3d/d65/d93/dbe/f106 x:0 0 0 2024-09-20T18:35:52.392 INFO:tasks.workunit.client.1.smithi172.stdout:2/785: chown d0/d2c/d3f/dab/d18/d29/d42/d4b/d53/lf3 22782 1 2024-09-20T18:35:52.396 INFO:tasks.workunit.client.1.smithi172.stdout:9/796: fdatasync d15/d1f/f69 0 2024-09-20T18:35:52.398 INFO:tasks.workunit.client.0.smithi017.stdout:1/184: rename df/l1b to df/d16/l31 0 2024-09-20T18:35:52.401 INFO:tasks.workunit.client.1.smithi172.stdout:7/856: mkdir d2/d3/d3d/d4e/d92/d123 0 2024-09-20T18:35:52.402 INFO:tasks.workunit.client.1.smithi172.stdout:5/869: dwrite d4/df/dad/d26/d41/d65/fb3 [0,4194304] 0 2024-09-20T18:35:52.403 INFO:tasks.workunit.client.1.smithi172.stdout:5/870: write d4/df/d98/fde [1845325,34857] 0 2024-09-20T18:35:52.404 INFO:tasks.workunit.client.1.smithi172.stdout:9/797: write d15/f9e [714716,114504] 0 2024-09-20T18:35:52.404 INFO:tasks.workunit.client.1.smithi172.stdout:5/871: chown d4/f36 1432771391 1 2024-09-20T18:35:52.407 INFO:tasks.workunit.client.1.smithi172.stdout:9/798: read d15/d20/f21 [5789042,57244] 0 2024-09-20T18:35:52.412 INFO:tasks.workunit.client.1.smithi172.stdout:2/786: creat d0/d2c/d3f/dab/d18/d29/f109 x:0 0 0 2024-09-20T18:35:52.414 INFO:tasks.workunit.client.1.smithi172.stdout:2/787: write d0/d2c/d3f/dab/d22/d10/d35/d5d/f5f [1272856,55275] 0 2024-09-20T18:35:52.414 INFO:tasks.workunit.client.1.smithi172.stdout:7/857: creat d2/d23/d51/d10e/d72/d9b/d103/f124 x:0 0 0 2024-09-20T18:35:52.414 INFO:tasks.workunit.client.1.smithi172.stdout:5/872: symlink d4/df/d3f/d64/d101/d11c/l120 0 2024-09-20T18:35:52.417 INFO:tasks.workunit.client.1.smithi172.stdout:2/788: write d0/d2c/d3f/fd [9749677,128610] 0 2024-09-20T18:35:52.423 INFO:tasks.workunit.client.1.smithi172.stdout:9/799: read d15/d1f/d7e/f93 [2629057,128038] 0 2024-09-20T18:35:52.423 INFO:tasks.workunit.client.1.smithi172.stdout:5/873: read d4/df/dad/d26/d41/d69/dac/f2b [1917582,83828] 0 2024-09-20T18:35:52.423 INFO:tasks.workunit.client.1.smithi172.stdout:2/789: read d0/d2c/d3f/dab/d22/d10/d35/d5d/f64 [143524,41851] 0 2024-09-20T18:35:52.424 INFO:tasks.workunit.client.1.smithi172.stdout:1/802: dwrite d0/d22/f54 [0,4194304] 0 2024-09-20T18:35:52.425 INFO:tasks.workunit.client.1.smithi172.stdout:9/800: write d15/d1a/d8d/faa [2477171,79293] 0 2024-09-20T18:35:52.427 INFO:tasks.workunit.client.1.smithi172.stdout:5/874: write d4/df/f74 [515318,123996] 0 2024-09-20T18:35:52.429 INFO:tasks.workunit.client.1.smithi172.stdout:2/790: write d0/d2c/d3f/dab/d22/d10/d35/d5d/fbd [79635,52540] 0 2024-09-20T18:35:52.431 INFO:tasks.workunit.client.1.smithi172.stdout:1/803: write d0/d8/db/f26 [428910,30748] 0 2024-09-20T18:35:52.432 INFO:tasks.workunit.client.1.smithi172.stdout:7/858: dwrite d2/d3/dd/f75 [0,4194304] 0 2024-09-20T18:35:52.435 INFO:tasks.workunit.client.1.smithi172.stdout:9/801: fdatasync d15/d1f/d2c/d57/fa0 0 2024-09-20T18:35:52.436 INFO:tasks.workunit.client.1.smithi172.stdout:2/791: creat d0/d2c/d3f/dab/d45/ddc/f10a x:0 0 0 2024-09-20T18:35:52.438 INFO:tasks.workunit.client.1.smithi172.stdout:7/859: symlink d2/d23/dc0/l125 0 2024-09-20T18:35:52.438 INFO:tasks.workunit.client.1.smithi172.stdout:1/804: mkdir d0/d8/db/d25/d2b/d107 0 2024-09-20T18:35:52.442 INFO:tasks.workunit.client.1.smithi172.stdout:1/805: chown d0/d8/db/d25/c6b 347432 1 2024-09-20T18:35:52.443 INFO:tasks.workunit.client.1.smithi172.stdout:1/806: dread - d0/d22/fb1 zero size 2024-09-20T18:35:52.450 INFO:tasks.workunit.client.1.smithi172.stdout:5/875: dread d4/f4e [0,4194304] 0 2024-09-20T18:35:52.452 INFO:tasks.workunit.client.1.smithi172.stdout:3/892: sync 2024-09-20T18:35:52.453 INFO:tasks.workunit.client.1.smithi172.stdout:5/876: symlink d4/df/dad/d26/d41/d69/dcd/l121 0 2024-09-20T18:35:52.454 INFO:tasks.workunit.client.1.smithi172.stdout:2/792: write d0/d2c/d3f/dab/d18/d29/f57 [188985,70621] 0 2024-09-20T18:35:52.455 INFO:tasks.workunit.client.1.smithi172.stdout:9/802: write d15/d1f/f53 [4093317,51555] 0 2024-09-20T18:35:52.455 INFO:tasks.workunit.client.1.smithi172.stdout:5/877: chown d4/df/dad/d26/d41/d69/dac/f5d 26035 1 2024-09-20T18:35:52.458 INFO:tasks.workunit.client.1.smithi172.stdout:9/803: creat d15/d1f/d2c/d7d/d48/f109 x:0 0 0 2024-09-20T18:35:52.460 INFO:tasks.workunit.client.1.smithi172.stdout:2/793: getdents d0/d2c/d3f/dab/d22/d10/d6a 0 2024-09-20T18:35:52.460 INFO:tasks.workunit.client.1.smithi172.stdout:1/807: dread d0/d8/db/d25/d2b/d3d/f8e [0,4194304] 0 2024-09-20T18:35:52.460 INFO:tasks.workunit.client.1.smithi172.stdout:3/893: dread d0/d13/d32/d54/d83/fa6 [0,4194304] 0 2024-09-20T18:35:52.461 INFO:tasks.workunit.client.1.smithi172.stdout:2/794: fsync d0/d2c/d3f/dab/d22/f36 0 2024-09-20T18:35:52.462 INFO:tasks.workunit.client.1.smithi172.stdout:9/804: rename fe to d15/d1f/d2c/d7d/d48/df0/f10a 0 2024-09-20T18:35:52.463 INFO:tasks.workunit.client.1.smithi172.stdout:3/894: mknod d0/d13/d32/d54/d83/dbb/c130 0 2024-09-20T18:35:52.464 INFO:tasks.workunit.client.1.smithi172.stdout:1/808: creat d0/d8/db/d25/d2b/d3d/d104/f108 x:0 0 0 2024-09-20T18:35:52.464 INFO:tasks.workunit.client.1.smithi172.stdout:2/795: mkdir d0/d1a/d58/d10b 0 2024-09-20T18:35:52.465 INFO:tasks.workunit.client.1.smithi172.stdout:4/862: sync 2024-09-20T18:35:52.465 INFO:tasks.workunit.client.1.smithi172.stdout:8/814: sync 2024-09-20T18:35:52.465 INFO:tasks.workunit.client.1.smithi172.stdout:6/719: sync 2024-09-20T18:35:52.466 INFO:tasks.workunit.client.1.smithi172.stdout:1/809: fdatasync d0/d8/db/d25/d6f/faa 0 2024-09-20T18:35:52.468 INFO:tasks.workunit.client.1.smithi172.stdout:8/815: chown dd/d65/c93 43101 1 2024-09-20T18:35:52.468 INFO:tasks.workunit.client.1.smithi172.stdout:4/863: dread - d0/de/d21/d24/f106 zero size 2024-09-20T18:35:52.472 INFO:tasks.workunit.client.1.smithi172.stdout:7/860: dread d2/d3/fb [0,4194304] 0 2024-09-20T18:35:52.472 INFO:tasks.workunit.client.1.smithi172.stdout:9/805: write d15/d1a/d82/f77 [88060,105737] 0 2024-09-20T18:35:52.472 INFO:tasks.workunit.client.1.smithi172.stdout:8/816: truncate dd/d65/f9e 5131564 0 2024-09-20T18:35:52.473 INFO:tasks.workunit.client.1.smithi172.stdout:1/810: read d0/d8/db/d25/d2b/d3d/f3e [3640217,16958] 0 2024-09-20T18:35:52.476 INFO:tasks.workunit.client.1.smithi172.stdout:3/895: dwrite d0/f20 [0,4194304] 0 2024-09-20T18:35:52.477 INFO:tasks.workunit.client.1.smithi172.stdout:6/720: rename d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0/lbe to d0/d18/d1c/d21/d26/d34/d9c/lf3 0 2024-09-20T18:35:52.478 INFO:tasks.workunit.client.1.smithi172.stdout:9/806: chown d15/d1f/d2c/d57/c83 127611 1 2024-09-20T18:35:52.481 INFO:tasks.workunit.client.1.smithi172.stdout:1/811: read - d0/d8/d12/d96/f9e zero size 2024-09-20T18:35:52.482 INFO:tasks.workunit.client.1.smithi172.stdout:8/817: write dd/d1b/f55 [1693840,112570] 0 2024-09-20T18:35:52.483 INFO:tasks.workunit.client.1.smithi172.stdout:3/896: dread - d0/d13/d32/d88/ff0 zero size 2024-09-20T18:35:52.484 INFO:tasks.workunit.client.1.smithi172.stdout:2/796: dwrite d0/d2c/d3f/dab/d18/f6e [0,4194304] 0 2024-09-20T18:35:52.489 INFO:tasks.workunit.client.1.smithi172.stdout:1/812: mkdir d0/d8/d109 0 2024-09-20T18:35:52.490 INFO:tasks.workunit.client.1.smithi172.stdout:6/721: read d0/d18/d1c/d21/d26/d34/da2/dda/d7b/d7e/fca [377472,90550] 0 2024-09-20T18:35:52.492 INFO:tasks.workunit.client.1.smithi172.stdout:8/818: fsync dd/d1b/d3b/d51/d5b/dc5/fd1 0 2024-09-20T18:35:52.493 INFO:tasks.workunit.client.1.smithi172.stdout:9/807: link d15/d1f/d7e/le0 d15/d20/d76/dc6/l10b 0 2024-09-20T18:35:52.495 INFO:tasks.workunit.client.1.smithi172.stdout:8/819: fsync dd/d65/fb6 0 2024-09-20T18:35:52.496 INFO:tasks.workunit.client.1.smithi172.stdout:7/861: dwrite d2/d3/dd/f121 [4194304,4194304] 0 2024-09-20T18:35:52.498 INFO:tasks.workunit.client.1.smithi172.stdout:2/797: creat d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/de7/f10c x:0 0 0 2024-09-20T18:35:52.499 INFO:tasks.workunit.client.1.smithi172.stdout:8/820: write dd/de3/f106 [101345,96368] 0 2024-09-20T18:35:52.500 INFO:tasks.workunit.client.1.smithi172.stdout:7/862: write d2/d3/fa7 [2127291,40300] 0 2024-09-20T18:35:52.502 INFO:tasks.workunit.client.1.smithi172.stdout:3/897: dwrite d0/dc/fa0 [0,4194304] 0 2024-09-20T18:35:52.507 INFO:tasks.workunit.client.1.smithi172.stdout:2/798: mknod d0/d2c/d51/de5/c10d 0 2024-09-20T18:35:52.508 INFO:tasks.workunit.client.1.smithi172.stdout:3/898: read d0/d13/d32/f8a [3554286,86807] 0 2024-09-20T18:35:52.509 INFO:tasks.workunit.client.1.smithi172.stdout:6/722: dwrite d0/f6d [0,4194304] 0 2024-09-20T18:35:52.511 INFO:tasks.workunit.client.1.smithi172.stdout:6/723: dread - d0/d18/d65/fbd zero size 2024-09-20T18:35:52.513 INFO:tasks.workunit.client.1.smithi172.stdout:9/808: truncate d15/d1a/d8d/faa 2670421 0 2024-09-20T18:35:52.513 INFO:tasks.workunit.client.1.smithi172.stdout:7/863: symlink d2/d23/d51/d10e/d72/d9b/l126 0 2024-09-20T18:35:52.516 INFO:tasks.workunit.client.1.smithi172.stdout:2/799: rmdir d0/d2c/d3f/dab/d22/d10/d35/d5d 39 2024-09-20T18:35:52.516 INFO:tasks.workunit.client.1.smithi172.stdout:1/813: getdents d0/d8/db/d25/d2b/d3d/d104 0 2024-09-20T18:35:52.519 INFO:tasks.workunit.client.1.smithi172.stdout:6/724: symlink d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/lf4 0 2024-09-20T18:35:52.520 INFO:tasks.workunit.client.1.smithi172.stdout:2/800: symlink d0/d1a/d58/l10e 0 2024-09-20T18:35:52.525 INFO:tasks.workunit.client.1.smithi172.stdout:3/899: dread d0/dc/f79 [0,4194304] 0 2024-09-20T18:35:52.526 INFO:tasks.workunit.client.1.smithi172.stdout:9/809: dwrite d15/d1f/f7f [0,4194304] 0 2024-09-20T18:35:52.528 INFO:tasks.workunit.client.1.smithi172.stdout:7/864: truncate d2/d3/d3d/d4e/d5f/f9c 2225226 0 2024-09-20T18:35:52.532 INFO:tasks.workunit.client.1.smithi172.stdout:6/725: creat d0/d18/d1c/d21/ff5 x:0 0 0 2024-09-20T18:35:52.533 INFO:tasks.workunit.client.1.smithi172.stdout:3/900: mkdir d0/d13/d32/d54/d71/d131 0 2024-09-20T18:35:52.537 INFO:tasks.workunit.client.1.smithi172.stdout:7/865: mknod d2/d3/d10/d40/d74/dcb/c127 0 2024-09-20T18:35:52.537 INFO:tasks.workunit.client.1.smithi172.stdout:1/814: dwrite d0/d8/db/fe [0,4194304] 0 2024-09-20T18:35:52.542 INFO:tasks.workunit.client.1.smithi172.stdout:6/726: fdatasync d0/d18/d1c/d21/d26/fd7 0 2024-09-20T18:35:52.543 INFO:tasks.workunit.client.1.smithi172.stdout:8/821: dwrite dd/d1b/d3b/d51/d5b/d6b/f98 [0,4194304] 0 2024-09-20T18:35:52.543 INFO:tasks.workunit.client.1.smithi172.stdout:2/801: dwrite d0/d2c/d3f/f8a [0,4194304] 0 2024-09-20T18:35:52.548 INFO:tasks.workunit.client.1.smithi172.stdout:7/866: creat d2/d3/d86/f128 x:0 0 0 2024-09-20T18:35:52.553 INFO:tasks.workunit.client.1.smithi172.stdout:8/822: symlink dd/d1b/d4f/d86/dbc/l11e 0 2024-09-20T18:35:52.558 INFO:tasks.workunit.client.1.smithi172.stdout:2/802: truncate d0/d2c/d3f/dab/d22/d10/f21 9311922 0 2024-09-20T18:35:52.560 INFO:tasks.workunit.client.1.smithi172.stdout:1/815: dwrite d0/d8/db/d25/d2b/fee [0,4194304] 0 2024-09-20T18:35:52.561 INFO:tasks.workunit.client.1.smithi172.stdout:7/867: write d2/d3/f45 [323570,61674] 0 2024-09-20T18:35:52.570 INFO:tasks.workunit.client.1.smithi172.stdout:9/810: dwrite d15/d1f/d2c/d7d/f2a [0,4194304] 0 2024-09-20T18:35:52.574 INFO:tasks.workunit.client.1.smithi172.stdout:6/727: dwrite d0/d18/d1c/d21/d26/d79/fb9 [0,4194304] 0 2024-09-20T18:35:52.575 INFO:tasks.workunit.client.1.smithi172.stdout:8/823: dread dd/d1b/d3b/d51/d5b/daf/d4d/fc1 [0,4194304] 0 2024-09-20T18:35:52.576 INFO:tasks.workunit.client.1.smithi172.stdout:3/901: dwrite d0/dc/d6a/f5b [0,4194304] 0 2024-09-20T18:35:52.580 INFO:tasks.workunit.client.1.smithi172.stdout:9/811: symlink d15/d1f/d2c/d7d/l10c 0 2024-09-20T18:35:52.581 INFO:tasks.workunit.client.1.smithi172.stdout:5/878: sync 2024-09-20T18:35:52.582 INFO:tasks.workunit.client.1.smithi172.stdout:6/728: creat d0/d18/d1c/d21/d26/d34/da2/def/ff6 x:0 0 0 2024-09-20T18:35:52.586 INFO:tasks.workunit.client.1.smithi172.stdout:3/902: rename d0/d13/d32/lcf to d0/d13/d58/l132 0 2024-09-20T18:35:52.591 INFO:tasks.workunit.client.1.smithi172.stdout:7/868: link d2/l11 d2/d23/d51/d10e/d72/d9b/d103/l129 0 2024-09-20T18:35:52.591 INFO:tasks.workunit.client.1.smithi172.stdout:1/816: dwrite d0/d8/db/d25/d6d/d77/f9b [0,4194304] 0 2024-09-20T18:35:52.591 INFO:tasks.workunit.client.1.smithi172.stdout:3/903: fdatasync d0/d13/d1e/f46 0 2024-09-20T18:35:52.592 INFO:tasks.workunit.client.1.smithi172.stdout:9/812: chown d15/d4a/d8c/ld3 120737272 1 2024-09-20T18:35:52.592 INFO:tasks.workunit.client.1.smithi172.stdout:6/729: readlink d0/d18/d1c/d21/d26/d34/d39/d46/l41 0 2024-09-20T18:35:52.596 INFO:tasks.workunit.client.1.smithi172.stdout:9/813: chown d15/d1f/d2c/d57/c83 117675779 1 2024-09-20T18:35:52.596 INFO:tasks.workunit.client.1.smithi172.stdout:3/904: write d0/dc/d6a/dc5/feb [4711218,10923] 0 2024-09-20T18:35:52.597 INFO:tasks.workunit.client.1.smithi172.stdout:8/824: dread dd/d1b/d3b/d51/f82 [0,4194304] 0 2024-09-20T18:35:52.598 INFO:tasks.workunit.client.1.smithi172.stdout:1/817: creat d0/d8/db/d25/d2b/d3d/d104/f10a x:0 0 0 2024-09-20T18:35:52.602 INFO:tasks.workunit.client.1.smithi172.stdout:5/879: truncate d4/df/d3f/d64/d101/d63/d80/fa8 1799984 0 2024-09-20T18:35:52.605 INFO:tasks.workunit.client.1.smithi172.stdout:8/825: creat dd/d1b/d4f/d9a/dbb/d101/f11f x:0 0 0 2024-09-20T18:35:52.606 INFO:tasks.workunit.client.1.smithi172.stdout:3/905: fdatasync d0/d13/d32/d54/d71/f9c 0 2024-09-20T18:35:52.608 INFO:tasks.workunit.client.1.smithi172.stdout:2/803: write d0/d2c/d3f/dab/d18/d29/d42/f8b [386463,125578] 0 2024-09-20T18:35:52.609 INFO:tasks.workunit.client.1.smithi172.stdout:7/869: dread d2/d3/d10/f20 [0,4194304] 0 2024-09-20T18:35:52.610 INFO:tasks.workunit.client.1.smithi172.stdout:3/906: stat d0/d13/d58/d6d/db9 0 2024-09-20T18:35:52.610 INFO:tasks.workunit.client.1.smithi172.stdout:5/880: rename d4/l29 to d4/df/d98/dcc/l122 0 2024-09-20T18:35:52.614 INFO:tasks.workunit.client.1.smithi172.stdout:6/730: dwrite d0/d18/d1c/d21/d26/f45 [4194304,4194304] 0 2024-09-20T18:35:52.616 INFO:tasks.workunit.client.1.smithi172.stdout:7/870: fdatasync d2/f47 0 2024-09-20T18:35:52.619 INFO:tasks.workunit.client.1.smithi172.stdout:2/804: mknod d0/d2c/d3f/dab/d22/d10/d3c/d68/c10f 0 2024-09-20T18:35:52.621 INFO:tasks.workunit.client.1.smithi172.stdout:9/814: dwrite d15/d20/d76/ff2 [0,4194304] 0 2024-09-20T18:35:52.627 INFO:tasks.workunit.client.1.smithi172.stdout:7/871: chown d2/d3/d10/d40/d6a/ld3 122214590 1 2024-09-20T18:35:52.630 INFO:tasks.workunit.client.1.smithi172.stdout:3/907: getdents d0/d13/d58/d6d/dc3 0 2024-09-20T18:35:52.631 INFO:tasks.workunit.client.1.smithi172.stdout:1/818: dwrite d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/f105 [0,4194304] 0 2024-09-20T18:35:52.632 INFO:tasks.workunit.client.1.smithi172.stdout:2/805: mknod d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/c110 0 2024-09-20T18:35:52.634 INFO:tasks.workunit.client.1.smithi172.stdout:3/908: readlink d0/d13/d32/d88/laa 0 2024-09-20T18:35:52.635 INFO:tasks.workunit.client.1.smithi172.stdout:4/864: sync 2024-09-20T18:35:52.635 INFO:tasks.workunit.client.1.smithi172.stdout:8/826: dwrite dd/d65/fa8 [0,4194304] 0 2024-09-20T18:35:52.636 INFO:tasks.workunit.client.1.smithi172.stdout:6/731: creat d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0/ff7 x:0 0 0 2024-09-20T18:35:52.637 INFO:tasks.workunit.client.0.smithi017.stdout:8/218: sync 2024-09-20T18:35:52.638 INFO:tasks.workunit.client.0.smithi017.stdout:8/219: chown d0/d6/f25 414989 1 2024-09-20T18:35:52.640 INFO:tasks.workunit.client.0.smithi017.stdout:8/220: creat d0/d6/d28/d3b/f48 x:0 0 0 2024-09-20T18:35:52.641 INFO:tasks.workunit.client.0.smithi017.stdout:8/221: chown d0/d6/f38 12280587 1 2024-09-20T18:35:52.642 INFO:tasks.workunit.client.1.smithi172.stdout:1/819: creat d0/d8/db/d25/d2b/d3d/d104/f10b x:0 0 0 2024-09-20T18:35:52.644 INFO:tasks.workunit.client.1.smithi172.stdout:2/806: chown d0/d2c/d3f/dab/d22/d10/d35/fa5 11846880 1 2024-09-20T18:35:52.644 INFO:tasks.workunit.client.1.smithi172.stdout:6/732: dread - d0/d18/d65/fbd zero size 2024-09-20T18:35:52.645 INFO:tasks.workunit.client.1.smithi172.stdout:5/881: dread d4/fc [0,4194304] 0 2024-09-20T18:35:52.645 INFO:tasks.workunit.client.1.smithi172.stdout:9/815: dwrite d15/d1a/d82/f77 [0,4194304] 0 2024-09-20T18:35:52.646 INFO:tasks.workunit.client.1.smithi172.stdout:4/865: unlink d0/de/dc/d3c/ca6 0 2024-09-20T18:35:52.646 INFO:tasks.workunit.client.1.smithi172.stdout:8/827: chown dd/d1b/d4f/ddd/d117/f10e 20 1 2024-09-20T18:35:52.650 INFO:tasks.workunit.client.1.smithi172.stdout:5/882: dread - d4/df/dad/dd4/f118 zero size 2024-09-20T18:35:52.651 INFO:tasks.workunit.client.1.smithi172.stdout:3/909: getdents d0/d13/d58/d6d/db9 0 2024-09-20T18:35:52.653 INFO:tasks.workunit.client.1.smithi172.stdout:7/872: dwrite d2/d3/d86/ff9 [0,4194304] 0 2024-09-20T18:35:52.656 INFO:tasks.workunit.client.1.smithi172.stdout:1/820: creat d0/d8/d5f/dfb/f10c x:0 0 0 2024-09-20T18:35:52.660 INFO:tasks.workunit.client.1.smithi172.stdout:9/816: rename d15/c16 to d15/d1f/d2c/d7d/d34/c10d 0 2024-09-20T18:35:52.663 INFO:tasks.workunit.client.1.smithi172.stdout:3/910: mknod d0/d13/dfb/c133 0 2024-09-20T18:35:52.667 INFO:tasks.workunit.client.1.smithi172.stdout:1/821: fdatasync d0/d8/d12/f29 0 2024-09-20T18:35:52.667 INFO:tasks.workunit.client.0.smithi017.stdout:8/222: dwrite d0/d6/f23 [0,4194304] 0 2024-09-20T18:35:52.670 INFO:tasks.workunit.client.1.smithi172.stdout:3/911: stat d0/d13/d1e/d12c 0 2024-09-20T18:35:52.670 INFO:tasks.workunit.client.1.smithi172.stdout:6/733: write d0/d18/f2b [3069132,102127] 0 2024-09-20T18:35:52.673 INFO:tasks.workunit.client.1.smithi172.stdout:8/828: dwrite dd/d1b/f1f [4194304,4194304] 0 2024-09-20T18:35:52.674 INFO:tasks.workunit.client.1.smithi172.stdout:4/866: dwrite d0/d7/d6f/f9c [4194304,4194304] 0 2024-09-20T18:35:52.674 INFO:tasks.workunit.client.1.smithi172.stdout:9/817: truncate d15/d1a/d6f/d7a/fc9 91465 0 2024-09-20T18:35:52.677 INFO:tasks.workunit.client.1.smithi172.stdout:7/873: dwrite d2/d23/d51/d10e/d72/d9b/fa3 [4194304,4194304] 0 2024-09-20T18:35:52.682 INFO:tasks.workunit.client.1.smithi172.stdout:8/829: mknod dd/d1b/c120 0 2024-09-20T18:35:52.683 INFO:tasks.workunit.client.1.smithi172.stdout:6/734: mkdir d0/d18/d1c/d21/d26/d79/df8 0 2024-09-20T18:35:52.686 INFO:tasks.workunit.client.1.smithi172.stdout:9/818: chown d15/d1a/d8d/faa 500 1 2024-09-20T18:35:52.686 INFO:tasks.workunit.client.1.smithi172.stdout:4/867: unlink d0/de/d39/db8/l58 0 2024-09-20T18:35:52.689 INFO:tasks.workunit.client.1.smithi172.stdout:7/874: creat d2/d23/d3c/da9/f12a x:0 0 0 2024-09-20T18:35:52.691 INFO:tasks.workunit.client.1.smithi172.stdout:3/912: dwrite d0/d13/d58/d6d/db9/d87/f9d [0,4194304] 0 2024-09-20T18:35:52.691 INFO:tasks.workunit.client.1.smithi172.stdout:9/819: creat d15/d1f/d2c/d7d/d34/db5/ded/f10e x:0 0 0 2024-09-20T18:35:52.781 INFO:tasks.workunit.client.1.smithi172.stdout:6/735: symlink d0/d18/d65/lf9 0 2024-09-20T18:35:52.781 INFO:tasks.workunit.client.1.smithi172.stdout:3/913: chown d0/dc/d6a/cfa 96719 1 2024-09-20T18:35:52.782 INFO:tasks.workunit.client.1.smithi172.stdout:2/807: dread d0/d2c/d3f/dab/d22/d10/f85 [0,4194304] 0 2024-09-20T18:35:52.782 INFO:tasks.workunit.client.1.smithi172.stdout:4/868: creat d0/d48/f12d x:0 0 0 2024-09-20T18:35:52.782 INFO:tasks.workunit.client.1.smithi172.stdout:6/736: stat d0/d18/d1c/d21/d26/d34/da2/lb5 0 2024-09-20T18:35:52.782 INFO:tasks.workunit.client.1.smithi172.stdout:1/822: write d0/d8/f32 [320333,91812] 0 2024-09-20T18:35:52.782 INFO:tasks.workunit.client.1.smithi172.stdout:7/875: chown d2/d23/c33 2824000 1 2024-09-20T18:35:52.782 INFO:tasks.workunit.client.1.smithi172.stdout:9/820: mknod d15/d20/db2/c10f 0 2024-09-20T18:35:52.782 INFO:tasks.workunit.client.1.smithi172.stdout:7/876: unlink d2/d3/d86/ff9 0 2024-09-20T18:35:52.782 INFO:tasks.workunit.client.1.smithi172.stdout:9/821: chown d15/d1f/d2c/d7d/d34 5 1 2024-09-20T18:35:52.782 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:52 smithi172 ceph-mon[35456]: pgmap v30: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 52 MiB/s rd, 197 MiB/s wr, 349 op/s 2024-09-20T18:35:52.783 INFO:tasks.workunit.client.0.smithi017.stdout:8/223: truncate d0/f22 8025820 0 2024-09-20T18:35:52.783 INFO:tasks.workunit.client.0.smithi017.stdout:8/224: dwrite d0/d6/d28/d3b/f45 [0,4194304] 0 2024-09-20T18:35:52.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/225: fsync d0/f1c 0 2024-09-20T18:35:52.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/226: truncate d0/d6/d28/d3b/f48 481565 0 2024-09-20T18:35:52.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/227: creat d0/d6/d28/d3a/f49 x:0 0 0 2024-09-20T18:35:52.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/228: creat d0/d6/d28/d3d/f4a x:0 0 0 2024-09-20T18:35:52.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/229: fsync d0/d6/d28/f29 0 2024-09-20T18:35:52.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/230: fdatasync d0/d6/f16 0 2024-09-20T18:35:52.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/231: rename d0/d6/c18 to d0/d6/d28/d3b/c4b 0 2024-09-20T18:35:52.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/232: rename d0/d6 to d0/d6/d28/d4c 22 2024-09-20T18:35:52.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/233: dwrite d0/f19 [0,4194304] 0 2024-09-20T18:35:52.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/234: symlink d0/d6/d28/l4d 0 2024-09-20T18:35:52.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/235: write d0/d6/d28/f29 [647139,122513] 0 2024-09-20T18:35:52.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/236: chown d0/l5 1138 1 2024-09-20T18:35:52.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/237: dwrite d0/f1e [0,4194304] 0 2024-09-20T18:35:52.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/238: unlink d0/d6/d28/d3b/f48 0 2024-09-20T18:35:52.785 INFO:tasks.workunit.client.0.smithi017.stdout:8/239: chown d0/d6/d28/c42 26 1 2024-09-20T18:35:52.788 INFO:tasks.workunit.client.1.smithi172.stdout:5/883: dread d4/f48 [0,4194304] 0 2024-09-20T18:35:52.788 INFO:tasks.workunit.client.1.smithi172.stdout:2/808: link d0/d2c/d3f/dab/d22/d10/d35/fc2 d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/de7/f111 0 2024-09-20T18:35:52.788 INFO:tasks.workunit.client.1.smithi172.stdout:9/822: symlink d15/d1f/l110 0 2024-09-20T18:35:52.788 INFO:tasks.workunit.client.1.smithi172.stdout:8/830: write dd/d65/d85/f8b [429926,63295] 0 2024-09-20T18:35:52.788 INFO:tasks.workunit.client.1.smithi172.stdout:1/823: dwrite d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/fcb [4194304,4194304] 0 2024-09-20T18:35:52.788 INFO:tasks.workunit.client.1.smithi172.stdout:3/914: write d0/d13/d58/d6d/d7f/f9f [8725,9700] 0 2024-09-20T18:35:52.788 INFO:tasks.workunit.client.1.smithi172.stdout:8/831: fsync dd/da9/fd9 0 2024-09-20T18:35:52.788 INFO:tasks.workunit.client.1.smithi172.stdout:6/737: dwrite d0/d18/d1c/d21/d26/d34/da2/dda/d7b/fd6 [0,4194304] 0 2024-09-20T18:35:52.788 INFO:tasks.workunit.client.1.smithi172.stdout:2/809: chown d0/d2c/d3f/f8a 1774276164 1 2024-09-20T18:35:52.788 INFO:tasks.workunit.client.1.smithi172.stdout:5/884: dread - d4/df/d3f/d64/d101/f5b zero size 2024-09-20T18:35:52.788 INFO:tasks.workunit.client.1.smithi172.stdout:1/824: dread - d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dd5/fe1 zero size 2024-09-20T18:35:52.789 INFO:tasks.workunit.client.1.smithi172.stdout:6/738: chown d0/d18/d1c/d21/d26/d34/d9c/faa 120 1 2024-09-20T18:35:52.789 INFO:tasks.workunit.client.1.smithi172.stdout:3/915: mkdir d0/d13/d58/d6d/d7f/d84/dd9/d134 0 2024-09-20T18:35:52.789 INFO:tasks.workunit.client.1.smithi172.stdout:7/877: dwrite d2/d3/d10/f1b [0,4194304] 0 2024-09-20T18:35:52.789 INFO:tasks.workunit.client.1.smithi172.stdout:2/810: mknod d0/d2c/d3f/dab/d22/d10/d35/dc4/c112 0 2024-09-20T18:35:52.789 INFO:tasks.workunit.client.1.smithi172.stdout:5/885: rmdir d4/df/d98 39 2024-09-20T18:35:52.789 INFO:tasks.workunit.client.1.smithi172.stdout:1/825: chown d0/d8/db/d25/ce2 113168 1 2024-09-20T18:35:52.789 INFO:tasks.workunit.client.1.smithi172.stdout:4/869: dread d0/de/d39/d9f/de8/f116 [0,4194304] 0 2024-09-20T18:35:52.789 INFO:tasks.workunit.client.1.smithi172.stdout:3/916: chown d0/dc/d6a/d22/f89 814 1 2024-09-20T18:35:52.789 INFO:tasks.workunit.client.1.smithi172.stdout:2/811: stat d0/d2c/f3d 0 2024-09-20T18:35:52.789 INFO:tasks.workunit.client.1.smithi172.stdout:5/886: rename d4/cd3 to d4/df/d98/c123 0 2024-09-20T18:35:52.789 INFO:tasks.workunit.client.1.smithi172.stdout:9/823: dwrite d15/d1f/d2c/d7d/d34/db5/ff5 [0,4194304] 0 2024-09-20T18:35:52.789 INFO:tasks.workunit.client.1.smithi172.stdout:3/917: write d0/d13/d58/d6d/db9/f106 [1168592,113422] 0 2024-09-20T18:35:52.789 INFO:tasks.workunit.client.1.smithi172.stdout:7/878: mkdir d2/d3/d10/d40/d10c/d12b 0 2024-09-20T18:35:52.789 INFO:tasks.workunit.client.1.smithi172.stdout:7/879: stat d2/d23/d51/d10e/d72/d9b/fa3 0 2024-09-20T18:35:52.789 INFO:tasks.workunit.client.1.smithi172.stdout:1/826: truncate d0/d8/db/d25/d6d/f7e 751045 0 2024-09-20T18:35:52.790 INFO:tasks.workunit.client.1.smithi172.stdout:1/827: chown d0/d8/db/d25/d2b/d3d/d65/d93/fe5 0 1 2024-09-20T18:35:52.790 INFO:tasks.workunit.client.1.smithi172.stdout:1/828: readlink d0/d8/db/l69 0 2024-09-20T18:35:52.790 INFO:tasks.workunit.client.1.smithi172.stdout:3/918: rename d0/d13/d58/d6d/db9/de0/cbc to d0/dc/d6a/d22/c135 0 2024-09-20T18:35:52.790 INFO:tasks.workunit.client.1.smithi172.stdout:2/812: write d0/d2c/d3f/dab/d18/d29/d42/fd5 [657124,40279] 0 2024-09-20T18:35:52.790 INFO:tasks.workunit.client.1.smithi172.stdout:3/919: mkdir d0/d13/d32/d123/d136 0 2024-09-20T18:35:52.790 INFO:tasks.workunit.client.1.smithi172.stdout:7/880: creat d2/d3/d3d/f12c x:0 0 0 2024-09-20T18:35:52.790 INFO:tasks.workunit.client.1.smithi172.stdout:5/887: link d4/df/d98/ffc d4/df/d106/d119/f124 0 2024-09-20T18:35:52.790 INFO:tasks.workunit.client.1.smithi172.stdout:8/832: truncate dd/d1b/d3b/d51/d5b/daf/d4d/f8f 3473138 0 2024-09-20T18:35:52.790 INFO:tasks.workunit.client.1.smithi172.stdout:4/870: dread d0/d48/d90/f89 [0,4194304] 0 2024-09-20T18:35:52.790 INFO:tasks.workunit.client.1.smithi172.stdout:7/881: chown d2/d3/d10/d40/f7c 1853861 1 2024-09-20T18:35:52.790 INFO:tasks.workunit.client.1.smithi172.stdout:2/813: fsync d0/d2c/d3f/dab/f80 0 2024-09-20T18:35:52.790 INFO:tasks.workunit.client.1.smithi172.stdout:1/829: dwrite d0/d8/db/d39/f42 [4194304,4194304] 0 2024-09-20T18:35:52.790 INFO:tasks.workunit.client.1.smithi172.stdout:3/920: mknod d0/d13/d58/d6d/c137 0 2024-09-20T18:35:52.791 INFO:tasks.workunit.client.1.smithi172.stdout:9/824: dread d15/d20/d76/fa1 [0,4194304] 0 2024-09-20T18:35:52.791 INFO:tasks.workunit.client.1.smithi172.stdout:2/814: chown d0/ce0 567336538 1 2024-09-20T18:35:52.791 INFO:tasks.workunit.client.1.smithi172.stdout:3/921: chown d0/d13/dfe 34631155 1 2024-09-20T18:35:52.791 INFO:tasks.workunit.client.1.smithi172.stdout:2/815: write d0/d1a/d58/f78 [4782612,31873] 0 2024-09-20T18:35:52.791 INFO:tasks.workunit.client.1.smithi172.stdout:3/922: read d0/dc/f79 [1008793,84803] 0 2024-09-20T18:35:52.792 INFO:tasks.workunit.client.1.smithi172.stdout:2/816: dwrite d0/d2c/d3f/dab/d22/d10/d35/fb0 [0,4194304] 0 2024-09-20T18:35:52.805 INFO:tasks.workunit.client.1.smithi172.stdout:5/888: dread d4/df/f89 [0,4194304] 0 2024-09-20T18:35:52.832 INFO:tasks.workunit.client.1.smithi172.stdout:4/871: rename d0/de/l7d to d0/d48/d90/d55/d53/d5c/l12e 0 2024-09-20T18:35:52.834 INFO:tasks.workunit.client.1.smithi172.stdout:3/923: unlink d0/d13/d58/d6d/d7f/d84/fc1 0 2024-09-20T18:35:52.836 INFO:tasks.workunit.client.1.smithi172.stdout:5/889: mknod d4/df/d3f/d64/d101/d86/c125 0 2024-09-20T18:35:52.836 INFO:tasks.workunit.client.1.smithi172.stdout:5/890: chown d4/df/d3f/d64/f109 7362 1 2024-09-20T18:35:52.839 INFO:tasks.workunit.client.1.smithi172.stdout:8/833: link dd/d65/f7f dd/d1b/d3b/d51/d34/dee/f121 0 2024-09-20T18:35:52.840 INFO:tasks.workunit.client.1.smithi172.stdout:7/882: dread d2/d3/d3d/d68/fbe [0,4194304] 0 2024-09-20T18:35:52.843 INFO:tasks.workunit.client.1.smithi172.stdout:3/924: creat d0/d13/d32/d123/f138 x:0 0 0 2024-09-20T18:35:52.845 INFO:tasks.workunit.client.1.smithi172.stdout:9/825: rmdir d15/d1a/d6f/df1 0 2024-09-20T18:35:52.846 INFO:tasks.workunit.client.1.smithi172.stdout:8/834: creat dd/d1b/d3b/d51/d5b/dc5/d113/f122 x:0 0 0 2024-09-20T18:35:52.846 INFO:tasks.workunit.client.0.smithi017.stdout:8/240: write d0/d6/f3e [885853,92245] 0 2024-09-20T18:35:52.847 INFO:tasks.workunit.client.1.smithi172.stdout:7/883: symlink d2/d3/d10/d40/d46/d8e/dbd/l12d 0 2024-09-20T18:35:52.848 INFO:tasks.workunit.client.0.smithi017.stdout:8/241: write d0/d6/d28/d3d/f4a [529594,88340] 0 2024-09-20T18:35:52.850 INFO:tasks.workunit.client.1.smithi172.stdout:5/891: truncate d4/df/dad/d26/d41/d69/f9d 26149 0 2024-09-20T18:35:52.851 INFO:tasks.workunit.client.1.smithi172.stdout:4/872: dread d0/de/d39/fc8 [0,4194304] 0 2024-09-20T18:35:52.851 INFO:tasks.workunit.client.0.smithi017.stdout:8/242: mkdir d0/d6/d28/d3d/d4e 0 2024-09-20T18:35:52.852 INFO:tasks.workunit.client.1.smithi172.stdout:4/873: chown d0/d48/d90/d55/d101/d18/f103 8889599 1 2024-09-20T18:35:52.853 INFO:tasks.workunit.client.1.smithi172.stdout:8/835: rename dd/d1b/d4f/d86/c99 to dd/d1b/d3b/d51/d5b/daf/d111/c123 0 2024-09-20T18:35:52.855 INFO:tasks.workunit.client.0.smithi017.stdout:8/243: creat d0/d6/d28/f4f x:0 0 0 2024-09-20T18:35:52.855 INFO:tasks.workunit.client.1.smithi172.stdout:1/830: write d0/d8/db/f3c [562932,59198] 0 2024-09-20T18:35:52.859 INFO:tasks.workunit.client.1.smithi172.stdout:4/874: dwrite d0/d48/d90/d55/d53/d78/dd9/fe1 [0,4194304] 0 2024-09-20T18:35:52.860 INFO:tasks.workunit.client.1.smithi172.stdout:4/875: read d0/d48/f100 [888152,48525] 0 2024-09-20T18:35:52.861 INFO:tasks.workunit.client.1.smithi172.stdout:7/884: rename d2/d3/d10/d40/d46/d8e/dbd/fc9 to d2/d3/d10/d40/d46/d8e/f12e 0 2024-09-20T18:35:52.862 INFO:tasks.workunit.client.1.smithi172.stdout:8/836: symlink dd/d1b/d4f/l124 0 2024-09-20T18:35:52.863 INFO:tasks.workunit.client.1.smithi172.stdout:1/831: symlink d0/d8/d5f/l10d 0 2024-09-20T18:35:52.863 INFO:tasks.workunit.client.1.smithi172.stdout:7/885: fdatasync d2/d3/d86/f128 0 2024-09-20T18:35:52.864 INFO:tasks.workunit.client.1.smithi172.stdout:9/826: getdents d15/d1f/d2c/d7d/d48/df0 0 2024-09-20T18:35:52.866 INFO:tasks.workunit.client.1.smithi172.stdout:7/886: stat d2/d3/d3d/dd4/fdd 0 2024-09-20T18:35:52.867 INFO:tasks.workunit.client.1.smithi172.stdout:9/827: chown d15/ffc 2738 1 2024-09-20T18:35:52.868 INFO:tasks.workunit.client.1.smithi172.stdout:4/876: truncate d0/d48/d90/d55/d53/d78/f8d 1209292 0 2024-09-20T18:35:52.868 INFO:tasks.workunit.client.1.smithi172.stdout:1/832: creat d0/d8/db/d25/d6f/f10e x:0 0 0 2024-09-20T18:35:52.871 INFO:tasks.workunit.client.1.smithi172.stdout:3/925: dwrite d0/d13/d58/d6d/db9/dd6/ff8 [4194304,4194304] 0 2024-09-20T18:35:52.872 INFO:tasks.workunit.client.1.smithi172.stdout:8/837: rename dd/d1b/d3b/dc7/cec to dd/d1b/d3b/d51/d5b/d6b/c125 0 2024-09-20T18:35:52.877 INFO:tasks.workunit.client.1.smithi172.stdout:1/833: mknod d0/d8/db/d25/d6f/c10f 0 2024-09-20T18:35:52.877 INFO:tasks.workunit.client.1.smithi172.stdout:4/877: mkdir d0/d48/d90/dea/d10f/d12f 0 2024-09-20T18:35:52.877 INFO:tasks.workunit.client.1.smithi172.stdout:9/828: unlink d15/d1f/d2c/d7d/d34/c10d 0 2024-09-20T18:35:52.878 INFO:tasks.workunit.client.1.smithi172.stdout:3/926: creat d0/d13/d58/d6d/db9/de0/f139 x:0 0 0 2024-09-20T18:35:52.878 INFO:tasks.workunit.client.1.smithi172.stdout:8/838: mknod dd/d1b/d3b/d5d/df6/c126 0 2024-09-20T18:35:52.879 INFO:tasks.workunit.client.1.smithi172.stdout:7/887: dwrite d2/d3/d3d/dd4/fd7 [0,4194304] 0 2024-09-20T18:35:52.880 INFO:tasks.workunit.client.0.smithi017.stdout:8/244: dread d0/f22 [4194304,4194304] 0 2024-09-20T18:35:52.884 INFO:tasks.workunit.client.1.smithi172.stdout:4/878: mknod d0/de/d39/d9f/c130 0 2024-09-20T18:35:52.885 INFO:tasks.workunit.client.1.smithi172.stdout:3/927: symlink d0/d13/d1e/l13a 0 2024-09-20T18:35:52.887 INFO:tasks.workunit.client.1.smithi172.stdout:7/888: mkdir d2/dcc/d12f 0 2024-09-20T18:35:52.888 INFO:tasks.workunit.client.1.smithi172.stdout:9/829: dread d15/d1f/d2c/d7d/d34/db5/fbc [0,4194304] 0 2024-09-20T18:35:52.889 INFO:tasks.workunit.client.1.smithi172.stdout:1/834: truncate d0/d8/db/d25/d2b/d3d/f4d 1745760 0 2024-09-20T18:35:52.890 INFO:tasks.workunit.client.1.smithi172.stdout:9/830: fsync d15/d54/fdb 0 2024-09-20T18:35:52.890 INFO:tasks.workunit.client.1.smithi172.stdout:7/889: mknod d2/d23/d3c/da9/c130 0 2024-09-20T18:35:52.891 INFO:tasks.workunit.client.1.smithi172.stdout:1/835: readlink d0/d8/db/d25/d2b/l36 0 2024-09-20T18:35:52.891 INFO:tasks.workunit.client.1.smithi172.stdout:3/928: creat d0/d13/d58/d6d/f13b x:0 0 0 2024-09-20T18:35:52.892 INFO:tasks.workunit.client.1.smithi172.stdout:9/831: write d15/d1f/f107 [338207,11755] 0 2024-09-20T18:35:52.892 INFO:tasks.workunit.client.1.smithi172.stdout:7/890: mkdir d2/d23/d3c/d131 0 2024-09-20T18:35:52.893 INFO:tasks.workunit.client.1.smithi172.stdout:3/929: write d0/d13/d32/d123/f12e [897290,1934] 0 2024-09-20T18:35:52.894 INFO:tasks.workunit.client.1.smithi172.stdout:9/832: rmdir d15/d1f/d2c/d7d/d34/db5 39 2024-09-20T18:35:52.895 INFO:tasks.workunit.client.1.smithi172.stdout:1/836: mknod d0/d8/c110 0 2024-09-20T18:35:52.895 INFO:tasks.workunit.client.1.smithi172.stdout:7/891: creat d2/d3/d10/d40/f132 x:0 0 0 2024-09-20T18:35:52.896 INFO:tasks.workunit.client.1.smithi172.stdout:9/833: truncate d15/d1a/d82/f2e 2231134 0 2024-09-20T18:35:52.898 INFO:tasks.workunit.client.1.smithi172.stdout:1/837: chown d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9 169596335 1 2024-09-20T18:35:52.898 INFO:tasks.workunit.client.1.smithi172.stdout:9/834: symlink d15/d1f/d88/l111 0 2024-09-20T18:35:52.899 INFO:tasks.workunit.client.1.smithi172.stdout:7/892: readlink d2/d3/dd/lc2 0 2024-09-20T18:35:52.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:52 smithi017 ceph-mon[28058]: pgmap v30: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 52 MiB/s rd, 197 MiB/s wr, 349 op/s 2024-09-20T18:35:52.900 INFO:tasks.workunit.client.1.smithi172.stdout:9/835: creat d15/d1a/d82/f112 x:0 0 0 2024-09-20T18:35:52.902 INFO:tasks.workunit.client.1.smithi172.stdout:7/893: dread - d2/d23/d3c/ff4 zero size 2024-09-20T18:35:52.903 INFO:tasks.workunit.client.1.smithi172.stdout:9/836: symlink d15/d1a/d6f/l113 0 2024-09-20T18:35:52.904 INFO:tasks.workunit.client.1.smithi172.stdout:1/838: rename d0/d8/db/d25/d2b/d3d/d65/d93/fb5 to d0/d8/db/f111 0 2024-09-20T18:35:52.906 INFO:tasks.workunit.client.1.smithi172.stdout:7/894: unlink d2/d23/d51/d10e/c9f 0 2024-09-20T18:35:52.907 INFO:tasks.workunit.client.1.smithi172.stdout:9/837: creat d15/d1f/d2c/d7d/d48/df0/f114 x:0 0 0 2024-09-20T18:35:52.908 INFO:tasks.workunit.client.1.smithi172.stdout:1/839: creat d0/d8/db/d25/d2b/f112 x:0 0 0 2024-09-20T18:35:52.908 INFO:tasks.workunit.client.1.smithi172.stdout:1/840: dread - d0/d8/d12/d96/f9e zero size 2024-09-20T18:35:52.909 INFO:tasks.workunit.client.1.smithi172.stdout:9/838: fdatasync d15/d20/db2/fc7 0 2024-09-20T18:35:52.917 INFO:tasks.workunit.client.1.smithi172.stdout:1/841: truncate d0/d8/db/d25/d2b/d3d/d104/f10a 812509 0 2024-09-20T18:35:52.918 INFO:tasks.workunit.client.1.smithi172.stdout:4/879: dwrite d0/d48/d90/d55/d53/d5c/fdf [0,4194304] 0 2024-09-20T18:35:52.918 INFO:tasks.workunit.client.1.smithi172.stdout:8/839: dwrite dd/d1b/d3b/d51/d5b/daf/f72 [0,4194304] 0 2024-09-20T18:35:52.919 INFO:tasks.workunit.client.1.smithi172.stdout:1/842: stat d0/d8/db/d25/d6d/d77/cba 0 2024-09-20T18:35:52.922 INFO:tasks.workunit.client.1.smithi172.stdout:9/839: write d15/d1f/d2c/d7d/f27 [105884,122677] 0 2024-09-20T18:35:52.927 INFO:tasks.workunit.client.1.smithi172.stdout:8/840: creat dd/d1b/d3b/d51/d5b/dc5/d113/f127 x:0 0 0 2024-09-20T18:35:52.928 INFO:tasks.workunit.client.1.smithi172.stdout:1/843: rename d0/d8/d12 to d0/d8/d5f/d113 0 2024-09-20T18:35:52.928 INFO:tasks.workunit.client.1.smithi172.stdout:9/840: truncate d15/d1a/d6f/d7a/fe2 320284 0 2024-09-20T18:35:52.930 INFO:tasks.workunit.client.1.smithi172.stdout:7/895: dwrite d2/d23/d3c/fc3 [0,4194304] 0 2024-09-20T18:35:52.933 INFO:tasks.workunit.client.1.smithi172.stdout:9/841: read d15/fc1 [1705679,72355] 0 2024-09-20T18:35:52.934 INFO:tasks.workunit.client.1.smithi172.stdout:7/896: symlink d2/d23/d120/l133 0 2024-09-20T18:35:52.935 INFO:tasks.workunit.client.1.smithi172.stdout:8/841: mknod dd/d1b/d3b/d51/d34/c128 0 2024-09-20T18:35:52.936 INFO:tasks.workunit.client.1.smithi172.stdout:1/844: mkdir d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/d114 0 2024-09-20T18:35:52.940 INFO:tasks.workunit.client.1.smithi172.stdout:7/897: creat d2/d23/d51/d10e/d72/d10d/f134 x:0 0 0 2024-09-20T18:35:52.941 INFO:tasks.workunit.client.1.smithi172.stdout:9/842: dwrite d15/d1a/dfb/fb7 [0,4194304] 0 2024-09-20T18:35:52.942 INFO:tasks.workunit.client.1.smithi172.stdout:8/842: unlink dd/d1b/d3b/d51/d5b/daf/d91/lb0 0 2024-09-20T18:35:52.945 INFO:tasks.workunit.client.1.smithi172.stdout:7/898: fsync d2/f3e 0 2024-09-20T18:35:52.946 INFO:tasks.workunit.client.1.smithi172.stdout:7/899: write d2/d3/dd/f42 [9400804,7521] 0 2024-09-20T18:35:52.946 INFO:tasks.workunit.client.1.smithi172.stdout:9/843: creat d15/d20/d76/dc6/f115 x:0 0 0 2024-09-20T18:35:52.949 INFO:tasks.workunit.client.1.smithi172.stdout:4/880: dread d0/de/d21/f80 [0,4194304] 0 2024-09-20T18:35:52.953 INFO:tasks.workunit.client.1.smithi172.stdout:4/881: readlink d0/de/d39/l8f 0 2024-09-20T18:35:52.956 INFO:tasks.workunit.client.1.smithi172.stdout:1/845: write d0/d8/db/f33 [4424410,25127] 0 2024-09-20T18:35:52.957 INFO:tasks.workunit.client.1.smithi172.stdout:1/846: chown d0/d8/f32 227873 1 2024-09-20T18:35:52.957 INFO:tasks.workunit.client.1.smithi172.stdout:9/844: getdents d15/d1f/d2c/d7d/d34 0 2024-09-20T18:35:52.958 INFO:tasks.workunit.client.1.smithi172.stdout:7/900: write d2/d3/d10/f2c [4182982,80358] 0 2024-09-20T18:35:52.965 INFO:tasks.workunit.client.1.smithi172.stdout:8/843: dwrite dd/d1b/d3b/d5d/f60 [4194304,4194304] 0 2024-09-20T18:35:52.968 INFO:tasks.workunit.client.1.smithi172.stdout:6/739: sync 2024-09-20T18:35:52.970 INFO:tasks.workunit.client.1.smithi172.stdout:1/847: dwrite d0/d8/ff5 [8388608,4194304] 0 2024-09-20T18:35:52.976 INFO:tasks.workunit.client.1.smithi172.stdout:4/882: dread d0/d48/f100 [0,4194304] 0 2024-09-20T18:35:53.019 INFO:tasks.workunit.client.1.smithi172.stdout:7/901: mkdir d2/d135 0 2024-09-20T18:35:53.021 INFO:tasks.workunit.client.1.smithi172.stdout:9/845: rmdir d15/d1a/d6f/d7a 39 2024-09-20T18:35:53.024 INFO:tasks.workunit.client.1.smithi172.stdout:1/848: dread - d0/fce zero size 2024-09-20T18:35:53.026 INFO:tasks.workunit.client.1.smithi172.stdout:8/844: rename dd/d1b/d3b/d51/d5b/dc5 to dd/d1b/d4f/d9a/dbb/d101/d129 0 2024-09-20T18:35:53.028 INFO:tasks.workunit.client.1.smithi172.stdout:4/883: truncate d0/d48/f100 4873033 0 2024-09-20T18:35:53.034 INFO:tasks.workunit.client.1.smithi172.stdout:7/902: dwrite d2/d3/d10/d40/d6a/dc6/f115 [0,4194304] 0 2024-09-20T18:35:53.034 INFO:tasks.workunit.client.1.smithi172.stdout:6/740: creat d0/d18/d1c/d21/d26/d34/d7a/d99/ffa x:0 0 0 2024-09-20T18:35:53.035 INFO:tasks.workunit.client.1.smithi172.stdout:9/846: dwrite d15/d1f/d2c/d7d/d48/fba [0,4194304] 0 2024-09-20T18:35:53.035 INFO:tasks.workunit.client.1.smithi172.stdout:4/884: mknod d0/de/dc/d3c/d99/c131 0 2024-09-20T18:35:53.044 INFO:tasks.workunit.client.1.smithi172.stdout:6/741: dwrite d0/d18/d1c/d21/d26/d34/d39/d74/dbf/fb6 [0,4194304] 0 2024-09-20T18:35:53.047 INFO:tasks.workunit.client.1.smithi172.stdout:6/742: truncate d0/d18/d1c/d21/ff5 488855 0 2024-09-20T18:35:53.048 INFO:tasks.workunit.client.1.smithi172.stdout:4/885: dread d0/d48/d90/d55/d53/d78/dd2/fd6 [0,4194304] 0 2024-09-20T18:35:53.048 INFO:tasks.workunit.client.1.smithi172.stdout:9/847: truncate d15/d1f/f3f 2722770 0 2024-09-20T18:35:53.056 INFO:tasks.workunit.client.1.smithi172.stdout:6/743: dwrite d0/d18/daf/fc8 [0,4194304] 0 2024-09-20T18:35:53.059 INFO:tasks.workunit.client.1.smithi172.stdout:4/886: dwrite d0/de/f4c [0,4194304] 0 2024-09-20T18:35:53.062 INFO:tasks.workunit.client.1.smithi172.stdout:6/744: mknod d0/d18/d1c/d21/d26/d34/d7a/d99/cfb 0 2024-09-20T18:35:53.064 INFO:tasks.workunit.client.1.smithi172.stdout:6/745: readlink d0/d18/d1c/d21/d26/d34/d39/l3f 0 2024-09-20T18:35:53.073 INFO:tasks.workunit.client.1.smithi172.stdout:4/887: creat d0/d48/d90/d55/f132 x:0 0 0 2024-09-20T18:35:53.073 INFO:tasks.workunit.client.1.smithi172.stdout:4/888: chown d0/c7c 0 1 2024-09-20T18:35:53.075 INFO:tasks.workunit.client.1.smithi172.stdout:4/889: read d0/de/d21/d24/f69 [1055471,16939] 0 2024-09-20T18:35:53.114 INFO:tasks.workunit.client.1.smithi172.stdout:1/849: mknod d0/d8/db/c115 0 2024-09-20T18:35:53.116 INFO:tasks.workunit.client.1.smithi172.stdout:7/903: truncate d2/f39 1080325 0 2024-09-20T18:35:53.117 INFO:tasks.workunit.client.1.smithi172.stdout:1/850: getdents d0/d8/db/d25/d2b/d3d/d65/d93/dbb/df7 0 2024-09-20T18:35:53.120 INFO:tasks.workunit.client.1.smithi172.stdout:8/845: rename dd/d1b/d4f/fae to dd/d1b/d3b/d51/d34/f12a 0 2024-09-20T18:35:53.122 INFO:tasks.workunit.client.1.smithi172.stdout:1/851: creat d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dd5/f116 x:0 0 0 2024-09-20T18:35:53.123 INFO:tasks.workunit.client.1.smithi172.stdout:4/890: rename d0/d48/d4e to d0/d48/d90/d55/d53/d5c/d10e/d133 0 2024-09-20T18:35:53.123 INFO:tasks.workunit.client.1.smithi172.stdout:7/904: link d2/d23/c33 d2/d3/d10/d40/d74/dcb/c136 0 2024-09-20T18:35:53.123 INFO:tasks.workunit.client.1.smithi172.stdout:4/891: readlink d0/lcf 0 2024-09-20T18:35:53.125 INFO:tasks.workunit.client.1.smithi172.stdout:8/846: mkdir dd/d1b/d3b/d51/dac/d12b 0 2024-09-20T18:35:53.126 INFO:tasks.workunit.client.0.smithi017.stdout:9/253: sync 2024-09-20T18:35:53.126 INFO:tasks.workunit.client.0.smithi017.stdout:5/239: sync 2024-09-20T18:35:53.126 INFO:tasks.workunit.client.0.smithi017.stdout:6/244: sync 2024-09-20T18:35:53.126 INFO:tasks.workunit.client.1.smithi172.stdout:7/905: write d2/d3/dd/f42 [960382,21932] 0 2024-09-20T18:35:53.127 INFO:tasks.workunit.client.0.smithi017.stdout:5/240: stat d0/d13/l35 0 2024-09-20T18:35:53.128 INFO:tasks.workunit.client.0.smithi017.stdout:9/254: chown d6/d23/d58/d3f/d44/f59 238 1 2024-09-20T18:35:53.132 INFO:tasks.workunit.client.0.smithi017.stdout:6/245: creat d4/df/d4a/f50 x:0 0 0 2024-09-20T18:35:53.134 INFO:tasks.workunit.client.1.smithi172.stdout:1/852: rename d0/d73/c84 to d0/d8/d5f/d113/d96/dd0/c117 0 2024-09-20T18:35:53.136 INFO:tasks.workunit.client.0.smithi017.stdout:5/241: mknod d0/d14/d18/d1b/c47 0 2024-09-20T18:35:53.137 INFO:tasks.workunit.client.1.smithi172.stdout:4/892: creat d0/d48/d90/dea/d10f/d12f/f134 x:0 0 0 2024-09-20T18:35:53.139 INFO:tasks.workunit.client.0.smithi017.stdout:9/255: write d6/d23/d58/d3f/d2f/d5d/f56 [1864661,103937] 0 2024-09-20T18:35:53.139 INFO:tasks.workunit.client.0.smithi017.stdout:6/246: dwrite d4/df/d1f/d25/d2b/f2c [0,4194304] 0 2024-09-20T18:35:53.145 INFO:tasks.workunit.client.0.smithi017.stdout:9/256: symlink d6/d23/d58/d3f/l6a 0 2024-09-20T18:35:53.147 INFO:tasks.workunit.client.0.smithi017.stdout:6/247: creat d4/d37/d41/d43/f51 x:0 0 0 2024-09-20T18:35:53.147 INFO:tasks.workunit.client.1.smithi172.stdout:6/746: dwrite d0/d18/d1c/d21/f56 [0,4194304] 0 2024-09-20T18:35:53.148 INFO:tasks.workunit.client.0.smithi017.stdout:6/248: write d4/f12 [1621313,125192] 0 2024-09-20T18:35:53.149 INFO:tasks.workunit.client.1.smithi172.stdout:7/906: rename d2/d3/l1a to d2/d23/d9d/ddb/l137 0 2024-09-20T18:35:53.150 INFO:tasks.workunit.client.0.smithi017.stdout:5/242: symlink d0/d14/d18/d2a/d39/d42/l48 0 2024-09-20T18:35:53.156 INFO:tasks.workunit.client.1.smithi172.stdout:7/907: symlink d2/d23/d51/d10e/l138 0 2024-09-20T18:35:53.158 INFO:tasks.workunit.client.0.smithi017.stdout:9/257: dwrite d6/d11/f29 [0,4194304] 0 2024-09-20T18:35:53.159 INFO:tasks.workunit.client.1.smithi172.stdout:4/893: creat d0/de/f135 x:0 0 0 2024-09-20T18:35:53.161 INFO:tasks.workunit.client.1.smithi172.stdout:6/747: creat d0/d18/d1c/d21/d26/d79/df8/ffc x:0 0 0 2024-09-20T18:35:53.164 INFO:tasks.workunit.client.0.smithi017.stdout:9/258: symlink d6/d23/d58/d3f/d5f/l6b 0 2024-09-20T18:35:53.165 INFO:tasks.workunit.client.1.smithi172.stdout:6/748: dread d0/d18/d1c/d21/f56 [0,4194304] 0 2024-09-20T18:35:53.166 INFO:tasks.workunit.client.1.smithi172.stdout:4/894: creat d0/de/d39/d9f/de8/f136 x:0 0 0 2024-09-20T18:35:53.169 INFO:tasks.workunit.client.0.smithi017.stdout:6/249: rename d4/f46 to d4/df/d1f/d25/d3f/f52 0 2024-09-20T18:35:53.172 INFO:tasks.workunit.client.1.smithi172.stdout:2/817: sync 2024-09-20T18:35:53.172 INFO:tasks.workunit.client.1.smithi172.stdout:5/892: sync 2024-09-20T18:35:53.173 INFO:tasks.workunit.client.1.smithi172.stdout:6/749: unlink d0/d18/d1c/d21/d26/d34/d6b/d7d/d35/l5e 0 2024-09-20T18:35:53.175 INFO:tasks.workunit.client.0.smithi017.stdout:9/259: dwrite f4 [4194304,4194304] 0 2024-09-20T18:35:53.175 INFO:tasks.workunit.client.1.smithi172.stdout:5/893: chown d4/df/d98/ffc 591 1 2024-09-20T18:35:53.178 INFO:tasks.workunit.client.0.smithi017.stdout:6/250: dwrite d4/df/f16 [0,4194304] 0 2024-09-20T18:35:53.178 INFO:tasks.workunit.client.1.smithi172.stdout:1/853: mknod d0/d8/db/d25/d2b/d3d/d65/d93/c118 0 2024-09-20T18:35:53.178 INFO:tasks.workunit.client.1.smithi172.stdout:5/894: dread - d4/df/dad/d26/d41/d65/d8f/f103 zero size 2024-09-20T18:35:53.178 INFO:tasks.workunit.client.1.smithi172.stdout:2/818: dwrite d0/d2c/d3f/dab/d22/d10/d3c/f6d [0,4194304] 0 2024-09-20T18:35:53.180 INFO:tasks.workunit.client.1.smithi172.stdout:6/750: rename d0/d18/d1c/d21/d26/d34/d39/d46/c50 to d0/d18/d1c/d21/d26/d34/da2/dda/d7b/d7e/dd3/cfd 0 2024-09-20T18:35:53.181 INFO:tasks.workunit.client.1.smithi172.stdout:5/895: dread - d4/df/d98/dcc/fea zero size 2024-09-20T18:35:53.186 INFO:tasks.workunit.client.1.smithi172.stdout:6/751: stat d0/d18/d1c/d21/d26/d34/d6b/d7d/c59 0 2024-09-20T18:35:53.186 INFO:tasks.workunit.client.0.smithi017.stdout:9/260: link d6/d11/c19 d6/d42/c6c 0 2024-09-20T18:35:53.190 INFO:tasks.workunit.client.1.smithi172.stdout:1/854: truncate d0/d8/db/d39/fb0 1423888 0 2024-09-20T18:35:53.190 INFO:tasks.workunit.client.1.smithi172.stdout:3/930: sync 2024-09-20T18:35:53.190 INFO:tasks.workunit.client.1.smithi172.stdout:9/848: sync 2024-09-20T18:35:53.191 INFO:tasks.workunit.client.1.smithi172.stdout:1/855: dread - d0/d8/db/d25/fe3 zero size 2024-09-20T18:35:53.193 INFO:tasks.workunit.client.0.smithi017.stdout:9/261: creat d6/d23/f6d x:0 0 0 2024-09-20T18:35:53.194 INFO:tasks.workunit.client.0.smithi017.stdout:9/262: chown d6/d23/l30 71295 1 2024-09-20T18:35:53.195 INFO:tasks.workunit.client.1.smithi172.stdout:5/896: mknod d4/df/dad/d26/d11d/c126 0 2024-09-20T18:35:53.197 INFO:tasks.workunit.client.1.smithi172.stdout:3/931: write d0/dc/d6a/d76/fd2 [31165,99099] 0 2024-09-20T18:35:53.200 INFO:tasks.workunit.client.0.smithi017.stdout:9/263: creat d6/d23/d58/d3f/d5f/f6e x:0 0 0 2024-09-20T18:35:53.209 INFO:tasks.workunit.client.1.smithi172.stdout:1/856: read d0/d8/db/d25/d6d/f7e [539166,103184] 0 2024-09-20T18:35:53.213 INFO:tasks.workunit.client.0.smithi017.stdout:9/264: link d6/l9 d6/d1f/l6f 0 2024-09-20T18:35:53.214 INFO:tasks.workunit.client.0.smithi017.stdout:9/265: chown d6/d23/d58/d3f/d2f 26 1 2024-09-20T18:35:53.216 INFO:tasks.workunit.client.1.smithi172.stdout:6/752: dread d0/d18/f29 [0,4194304] 0 2024-09-20T18:35:53.218 INFO:tasks.workunit.client.1.smithi172.stdout:8/847: dwrite dd/d1b/d3b/d51/f82 [0,4194304] 0 2024-09-20T18:35:53.218 INFO:tasks.workunit.client.0.smithi017.stdout:9/266: dread d6/d11/f29 [0,4194304] 0 2024-09-20T18:35:53.223 INFO:tasks.workunit.client.1.smithi172.stdout:6/753: dread d0/d18/d1c/d21/d26/db7/fd1 [0,4194304] 0 2024-09-20T18:35:53.224 INFO:tasks.workunit.client.0.smithi017.stdout:9/267: mkdir d6/d23/d58/d3f/d70 0 2024-09-20T18:35:53.225 INFO:tasks.workunit.client.1.smithi172.stdout:6/754: stat d0/d18/d1c/d21/d26/f45 0 2024-09-20T18:35:53.225 INFO:tasks.workunit.client.1.smithi172.stdout:8/848: dwrite dd/d1b/f55 [4194304,4194304] 0 2024-09-20T18:35:53.227 INFO:tasks.workunit.client.1.smithi172.stdout:6/755: stat d0/d18/d1c/d21/d26/d34/d6b/d7d/d90 0 2024-09-20T18:35:53.228 INFO:tasks.workunit.client.1.smithi172.stdout:6/756: stat d0/d18/d1c/d21/d26/d34/d39/d46/fb4 0 2024-09-20T18:35:53.240 INFO:tasks.workunit.client.0.smithi017.stdout:9/268: getdents d6/d23/d3a/d61 0 2024-09-20T18:35:53.240 INFO:tasks.workunit.client.0.smithi017.stdout:5/243: dwrite d0/d14/d18/d2a/f37 [0,4194304] 0 2024-09-20T18:35:53.240 INFO:tasks.workunit.client.1.smithi172.stdout:7/908: dwrite d2/d3/dd/f2f [0,4194304] 0 2024-09-20T18:35:53.242 INFO:tasks.workunit.client.0.smithi017.stdout:9/269: truncate d6/d23/f6d 955581 0 2024-09-20T18:35:53.244 INFO:tasks.workunit.client.1.smithi172.stdout:4/895: write d0/de/d39/db8/fad [368136,66578] 0 2024-09-20T18:35:53.245 INFO:tasks.workunit.client.0.smithi017.stdout:5/244: unlink d0/l2 0 2024-09-20T18:35:53.246 INFO:tasks.workunit.client.1.smithi172.stdout:4/896: write d0/d48/d90/d55/d53/fb9 [1139000,2908] 0 2024-09-20T18:35:53.247 INFO:tasks.workunit.client.1.smithi172.stdout:4/897: fdatasync d0/d48/d90/d55/d53/d78/f125 0 2024-09-20T18:35:53.248 INFO:tasks.workunit.client.0.smithi017.stdout:5/245: write d0/d13/f25 [2521388,6222] 0 2024-09-20T18:35:53.252 INFO:tasks.workunit.client.0.smithi017.stdout:9/270: dwrite d6/d23/d58/f57 [0,4194304] 0 2024-09-20T18:35:53.255 INFO:tasks.workunit.client.0.smithi017.stdout:6/251: write d4/fc [5006341,9803] 0 2024-09-20T18:35:53.256 INFO:tasks.workunit.client.0.smithi017.stdout:6/252: fdatasync d4/d37/d41/d43/f51 0 2024-09-20T18:35:53.260 INFO:tasks.workunit.client.0.smithi017.stdout:9/271: fsync d6/d23/d3a/f62 0 2024-09-20T18:35:53.261 INFO:tasks.workunit.client.0.smithi017.stdout:9/272: stat d6/d11/c36 0 2024-09-20T18:35:53.261 INFO:tasks.workunit.client.1.smithi172.stdout:2/819: truncate d0/d2c/d3f/fd 9598812 0 2024-09-20T18:35:53.262 INFO:tasks.workunit.client.0.smithi017.stdout:9/273: dread - d6/d23/d3a/f62 zero size 2024-09-20T18:35:53.263 INFO:tasks.workunit.client.0.smithi017.stdout:9/274: dread - d6/d23/d3a/f5e zero size 2024-09-20T18:35:53.264 INFO:tasks.workunit.client.0.smithi017.stdout:6/253: symlink d4/df/d1f/d25/l53 0 2024-09-20T18:35:53.265 INFO:tasks.workunit.client.0.smithi017.stdout:6/254: chown d4/df/f32 51219 1 2024-09-20T18:35:53.267 INFO:tasks.workunit.client.1.smithi172.stdout:2/820: dwrite d0/d2c/d3f/dab/d22/d10/d3c/f6d [0,4194304] 0 2024-09-20T18:35:53.268 INFO:tasks.workunit.client.0.smithi017.stdout:9/275: rename d6/d11/f53 to d6/d23/f71 0 2024-09-20T18:35:53.269 INFO:tasks.workunit.client.0.smithi017.stdout:5/246: getdents d0/d14/d18/d2a/d39 0 2024-09-20T18:35:53.272 INFO:tasks.workunit.client.0.smithi017.stdout:6/255: creat d4/d37/d41/f54 x:0 0 0 2024-09-20T18:35:53.273 INFO:tasks.workunit.client.1.smithi172.stdout:5/897: dwrite d4/f4e [0,4194304] 0 2024-09-20T18:35:53.277 INFO:tasks.workunit.client.0.smithi017.stdout:5/247: rename d0/d13/f22 to d0/d14/d18/d2a/d39/d42/f49 0 2024-09-20T18:35:53.279 INFO:tasks.workunit.client.0.smithi017.stdout:5/248: write d0/f10 [4563100,23224] 0 2024-09-20T18:35:53.286 INFO:tasks.workunit.client.0.smithi017.stdout:9/276: dread d6/f37 [0,4194304] 0 2024-09-20T18:35:53.289 INFO:tasks.workunit.client.0.smithi017.stdout:5/249: mknod d0/d14/c4a 0 2024-09-20T18:35:53.291 INFO:tasks.workunit.client.0.smithi017.stdout:9/277: mknod d6/d23/d3a/c72 0 2024-09-20T18:35:53.293 INFO:tasks.workunit.client.0.smithi017.stdout:5/250: mknod d0/d14/d18/d2a/d39/c4b 0 2024-09-20T18:35:53.295 INFO:tasks.workunit.client.1.smithi172.stdout:3/932: creat d0/d13/d32/d54/d71/d124/f13c x:0 0 0 2024-09-20T18:35:53.296 INFO:tasks.workunit.client.0.smithi017.stdout:5/251: dread - d0/d14/d18/d1b/f3d zero size 2024-09-20T18:35:53.300 INFO:tasks.workunit.client.1.smithi172.stdout:8/849: rmdir dd/d65/d85/dab 39 2024-09-20T18:35:53.301 INFO:tasks.workunit.client.0.smithi017.stdout:9/278: dwrite d6/d23/d58/d3f/d44/f59 [0,4194304] 0 2024-09-20T18:35:53.302 INFO:tasks.workunit.client.0.smithi017.stdout:6/256: dread d4/f9 [0,4194304] 0 2024-09-20T18:35:53.303 INFO:tasks.workunit.client.1.smithi172.stdout:6/757: symlink d0/d18/d65/lfe 0 2024-09-20T18:35:53.304 INFO:tasks.workunit.client.0.smithi017.stdout:9/279: write d6/d23/f2a [4696663,106846] 0 2024-09-20T18:35:53.310 INFO:tasks.workunit.client.1.smithi172.stdout:4/898: creat d0/de/d21/dc7/f137 x:0 0 0 2024-09-20T18:35:53.310 INFO:tasks.workunit.client.0.smithi017.stdout:9/280: dwrite f4 [4194304,4194304] 0 2024-09-20T18:35:53.318 INFO:tasks.workunit.client.0.smithi017.stdout:9/281: mkdir d6/d23/d58/d3f/d4d/d73 0 2024-09-20T18:35:53.319 INFO:tasks.workunit.client.1.smithi172.stdout:5/898: rmdir d4/df/dad/d26/d41/d69/dac/d2c/dd1 39 2024-09-20T18:35:53.321 INFO:tasks.workunit.client.1.smithi172.stdout:3/933: rmdir d0/d13/dfe 39 2024-09-20T18:35:53.323 INFO:tasks.workunit.client.0.smithi017.stdout:5/252: dread d0/f45 [0,4194304] 0 2024-09-20T18:35:53.323 INFO:tasks.workunit.client.0.smithi017.stdout:9/282: symlink d6/d23/d58/d3f/d2f/l74 0 2024-09-20T18:35:53.324 INFO:tasks.workunit.client.1.smithi172.stdout:8/850: dread dd/d1b/f1f [0,4194304] 0 2024-09-20T18:35:53.326 INFO:tasks.workunit.client.1.smithi172.stdout:6/758: chown d0/d18/d1c/d21/d26/d79/ce0 454723501 1 2024-09-20T18:35:53.327 INFO:tasks.workunit.client.1.smithi172.stdout:6/759: readlink d0/l15 0 2024-09-20T18:35:53.329 INFO:tasks.workunit.client.0.smithi017.stdout:9/283: creat d6/d23/d58/d3f/d44/f75 x:0 0 0 2024-09-20T18:35:53.330 INFO:tasks.workunit.client.0.smithi017.stdout:5/253: symlink d0/l4c 0 2024-09-20T18:35:53.331 INFO:tasks.workunit.client.0.smithi017.stdout:5/254: readlink d0/d14/d18/d2a/d39/d42/l48 0 2024-09-20T18:35:53.331 INFO:tasks.workunit.client.0.smithi017.stdout:9/284: rmdir d6/d23/d3a 39 2024-09-20T18:35:53.332 INFO:tasks.workunit.client.1.smithi172.stdout:2/821: creat d0/d2c/d3f/dab/d45/ddc/d107/f113 x:0 0 0 2024-09-20T18:35:53.333 INFO:tasks.workunit.client.1.smithi172.stdout:2/822: chown d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/fd3 1276628842 1 2024-09-20T18:35:53.334 INFO:tasks.workunit.client.1.smithi172.stdout:5/899: unlink d4/df/dad/d26/d41/d69/dcd/l121 0 2024-09-20T18:35:53.334 INFO:tasks.workunit.client.1.smithi172.stdout:5/900: readlink d4/l59 0 2024-09-20T18:35:53.337 INFO:tasks.workunit.client.1.smithi172.stdout:3/934: unlink d0/dc/d6a/d76/fd2 0 2024-09-20T18:35:53.338 INFO:tasks.workunit.client.0.smithi017.stdout:5/255: mkdir d0/d14/d18/d19/d4d 0 2024-09-20T18:35:53.343 INFO:tasks.workunit.client.1.smithi172.stdout:4/899: dread d0/de/dc/d3c/d99/fce [0,4194304] 0 2024-09-20T18:35:53.345 INFO:tasks.workunit.client.0.smithi017.stdout:5/256: dwrite d0/fc [0,4194304] 0 2024-09-20T18:35:53.345 INFO:tasks.workunit.client.1.smithi172.stdout:6/760: rename d0/d18/d1c/d21/d26/d34/da2/dda/d62 to d0/d18/d1c/d21/d26/d34/da2/def/dff 0 2024-09-20T18:35:53.347 INFO:tasks.workunit.client.0.smithi017.stdout:9/285: link d6/f34 d6/d23/d58/d3f/f76 0 2024-09-20T18:35:53.348 INFO:tasks.workunit.client.1.smithi172.stdout:2/823: read d0/f8e [558809,53996] 0 2024-09-20T18:35:53.349 INFO:tasks.workunit.client.1.smithi172.stdout:5/901: read d4/df/dad/d26/f72 [1784616,96293] 0 2024-09-20T18:35:53.356 INFO:tasks.workunit.client.0.smithi017.stdout:5/257: link d0/d14/d18/f3b d0/d14/d18/d3e/f4e 0 2024-09-20T18:35:53.358 INFO:tasks.workunit.client.1.smithi172.stdout:6/761: rmdir d0 39 2024-09-20T18:35:53.360 INFO:tasks.workunit.client.0.smithi017.stdout:6/257: dwrite d4/d29/f39 [0,4194304] 0 2024-09-20T18:35:53.361 INFO:tasks.workunit.client.0.smithi017.stdout:6/258: stat d4/df/d4a 0 2024-09-20T18:35:53.362 INFO:tasks.workunit.client.0.smithi017.stdout:6/259: chown d4/df/d28/l33 1596162 1 2024-09-20T18:35:53.362 INFO:tasks.workunit.client.1.smithi172.stdout:7/909: truncate d2/d3/d10/faa 4146026 0 2024-09-20T18:35:53.365 INFO:tasks.workunit.client.1.smithi172.stdout:9/849: sync 2024-09-20T18:35:53.366 INFO:tasks.workunit.client.1.smithi172.stdout:1/857: sync 2024-09-20T18:35:53.367 INFO:tasks.workunit.client.1.smithi172.stdout:1/858: stat d0/d22/l7f 0 2024-09-20T18:35:53.368 INFO:tasks.workunit.client.0.smithi017.stdout:6/260: rename d4/df/d1f/d25/l3c to d4/df/d1f/d25/d2b/l55 0 2024-09-20T18:35:53.371 INFO:tasks.workunit.client.0.smithi017.stdout:5/258: creat d0/f4f x:0 0 0 2024-09-20T18:35:53.372 INFO:tasks.workunit.client.0.smithi017.stdout:7/285: sync 2024-09-20T18:35:53.372 INFO:tasks.workunit.client.0.smithi017.stdout:4/235: sync 2024-09-20T18:35:53.372 INFO:tasks.workunit.client.0.smithi017.stdout:2/358: sync 2024-09-20T18:35:53.372 INFO:tasks.workunit.client.1.smithi172.stdout:1/859: dwrite d0/f82 [0,4194304] 0 2024-09-20T18:35:53.373 INFO:tasks.workunit.client.0.smithi017.stdout:5/259: write d0/d13/f16 [3925202,43979] 0 2024-09-20T18:35:53.374 INFO:tasks.workunit.client.0.smithi017.stdout:7/286: fsync da/f17 0 2024-09-20T18:35:53.375 INFO:tasks.workunit.client.0.smithi017.stdout:9/286: dread d6/d11/f21 [0,4194304] 0 2024-09-20T18:35:53.376 INFO:tasks.workunit.client.0.smithi017.stdout:5/260: chown d0/d14/d18/d2a/l46 1 1 2024-09-20T18:35:53.376 INFO:tasks.workunit.client.0.smithi017.stdout:7/287: chown da/d16/d1c/c20 14755 1 2024-09-20T18:35:53.377 INFO:tasks.workunit.client.0.smithi017.stdout:5/261: chown d0/f7 83355820 1 2024-09-20T18:35:53.383 INFO:tasks.workunit.client.0.smithi017.stdout:6/261: rename d4/df/d1f/d25/c2a to d4/df/d1f/d25/d2b/c56 0 2024-09-20T18:35:53.386 INFO:tasks.workunit.client.0.smithi017.stdout:7/288: fdatasync da/d16/d1b/f28 0 2024-09-20T18:35:53.388 INFO:tasks.workunit.client.1.smithi172.stdout:8/851: getdents dd/d65/d85/da2 0 2024-09-20T18:35:53.389 INFO:tasks.workunit.client.0.smithi017.stdout:3/424: sync 2024-09-20T18:35:53.389 INFO:tasks.workunit.client.0.smithi017.stdout:0/267: sync 2024-09-20T18:35:53.389 INFO:tasks.workunit.client.0.smithi017.stdout:8/245: sync 2024-09-20T18:35:53.389 INFO:tasks.workunit.client.0.smithi017.stdout:1/185: sync 2024-09-20T18:35:53.389 INFO:tasks.workunit.client.1.smithi172.stdout:4/900: dwrite d0/de/d21/f80 [0,4194304] 0 2024-09-20T18:35:53.389 INFO:tasks.workunit.client.1.smithi172.stdout:5/902: write d4/f48 [480074,62740] 0 2024-09-20T18:35:53.390 INFO:tasks.workunit.client.0.smithi017.stdout:5/262: creat d0/d14/d18/d2a/d39/f50 x:0 0 0 2024-09-20T18:35:53.391 INFO:tasks.workunit.client.0.smithi017.stdout:0/268: read - d4/db/d1e/f35 zero size 2024-09-20T18:35:53.391 INFO:tasks.workunit.client.1.smithi172.stdout:4/901: stat d0/de/d21/dc7/f137 0 2024-09-20T18:35:53.392 INFO:tasks.workunit.client.0.smithi017.stdout:8/246: read d0/d6/f3e [4665159,91076] 0 2024-09-20T18:35:53.394 INFO:tasks.workunit.client.0.smithi017.stdout:6/262: creat d4/df/d1f/f57 x:0 0 0 2024-09-20T18:35:53.395 INFO:tasks.workunit.client.0.smithi017.stdout:2/359: dread d1/dc/d58/d46/d48/f5d [0,4194304] 0 2024-09-20T18:35:53.396 INFO:tasks.workunit.client.1.smithi172.stdout:1/860: mkdir d0/d8/db/d25/d2b/db6/d119 0 2024-09-20T18:35:53.396 INFO:tasks.workunit.client.0.smithi017.stdout:6/263: write d4/d37/f4d [535279,65482] 0 2024-09-20T18:35:53.397 INFO:tasks.workunit.client.0.smithi017.stdout:6/264: truncate d4/fd 793196 0 2024-09-20T18:35:53.398 INFO:tasks.workunit.client.1.smithi172.stdout:2/824: truncate d0/d2c/d3f/dab/d22/d10/d6a/d98/d59/f5c 2938293 0 2024-09-20T18:35:53.399 INFO:tasks.workunit.client.1.smithi172.stdout:7/910: mkdir d2/de7/dfa/d139 0 2024-09-20T18:35:53.402 INFO:tasks.workunit.client.1.smithi172.stdout:3/935: dwrite d0/d13/db2/f10f [0,4194304] 0 2024-09-20T18:35:53.402 INFO:tasks.workunit.client.1.smithi172.stdout:7/911: chown d2/dcc/dd1 43 1 2024-09-20T18:35:53.403 INFO:tasks.workunit.client.1.smithi172.stdout:8/852: mknod dd/d1b/d3b/d51/d5b/c12c 0 2024-09-20T18:35:53.403 INFO:tasks.workunit.client.0.smithi017.stdout:1/186: mkdir df/d16/d32 0 2024-09-20T18:35:53.404 INFO:tasks.workunit.client.0.smithi017.stdout:1/187: dread - df/d16/f2e zero size 2024-09-20T18:35:53.404 INFO:tasks.workunit.client.1.smithi172.stdout:9/850: symlink d15/d20/d104/l116 0 2024-09-20T18:35:53.405 INFO:tasks.workunit.client.0.smithi017.stdout:0/269: mkdir d4/db/d18/d55 0 2024-09-20T18:35:53.406 INFO:tasks.workunit.client.0.smithi017.stdout:0/270: chown d4/db/d1e/d24/d2f/d51 292111 1 2024-09-20T18:35:53.406 INFO:tasks.workunit.client.1.smithi172.stdout:7/912: write d2/d23/d51/fd5 [1456142,88314] 0 2024-09-20T18:35:53.406 INFO:tasks.workunit.client.1.smithi172.stdout:4/902: dwrite d0/d48/d90/d55/d53/d5c/d10e/d133/d110/f12a [0,4194304] 0 2024-09-20T18:35:53.407 INFO:tasks.workunit.client.0.smithi017.stdout:8/247: symlink d0/d6/d28/l50 0 2024-09-20T18:35:53.407 INFO:tasks.workunit.client.0.smithi017.stdout:8/248: chown d0/d6/d28 193672 1 2024-09-20T18:35:53.409 INFO:tasks.workunit.client.1.smithi172.stdout:6/762: dread d0/d18/d1c/d21/d26/d34/d39/f64 [0,4194304] 0 2024-09-20T18:35:53.411 INFO:tasks.workunit.client.0.smithi017.stdout:5/263: rename d0/d14/d18/d1b/f2e to d0/d14/d18/d1b/f51 0 2024-09-20T18:35:53.411 INFO:tasks.workunit.client.1.smithi172.stdout:6/763: chown d0/d18/d1c/d21/d26/d34/da2/la3 0 1 2024-09-20T18:35:53.413 INFO:tasks.workunit.client.1.smithi172.stdout:2/825: creat d0/dd4/f114 x:0 0 0 2024-09-20T18:35:53.413 INFO:tasks.workunit.client.1.smithi172.stdout:4/903: truncate d0/d48/d90/d55/d53/d5c/f75 542331 0 2024-09-20T18:35:53.415 INFO:tasks.workunit.client.0.smithi017.stdout:2/360: write d1/dc/d20/d2e/d30/f54 [573474,117973] 0 2024-09-20T18:35:53.415 INFO:tasks.workunit.client.0.smithi017.stdout:7/289: dread da/f13 [0,4194304] 0 2024-09-20T18:35:53.418 INFO:tasks.workunit.client.0.smithi017.stdout:6/265: creat d4/df/d1f/d25/f58 x:0 0 0 2024-09-20T18:35:53.418 INFO:tasks.workunit.client.1.smithi172.stdout:1/861: mkdir d0/d8/df4/d11a 0 2024-09-20T18:35:53.421 INFO:tasks.workunit.client.0.smithi017.stdout:4/236: rename d4/dc/d1e/l48 to d4/l4a 0 2024-09-20T18:35:53.423 INFO:tasks.workunit.client.1.smithi172.stdout:3/936: creat d0/d13/d32/d54/d71/d124/f13d x:0 0 0 2024-09-20T18:35:53.423 INFO:tasks.workunit.client.1.smithi172.stdout:4/904: dread d0/d48/d90/d55/d53/d5c/f75 [0,4194304] 0 2024-09-20T18:35:53.424 INFO:tasks.workunit.client.0.smithi017.stdout:9/287: dwrite d6/d23/d58/d3f/f76 [0,4194304] 0 2024-09-20T18:35:53.425 INFO:tasks.workunit.client.1.smithi172.stdout:3/937: chown d0/d13/d9e/lf1 726430 1 2024-09-20T18:35:53.425 INFO:tasks.workunit.client.1.smithi172.stdout:9/851: mknod d15/d1f/d2c/d7d/d48/c117 0 2024-09-20T18:35:53.427 INFO:tasks.workunit.client.1.smithi172.stdout:7/913: dread - d2/d3/d86/ff7 zero size 2024-09-20T18:35:53.429 INFO:tasks.workunit.client.0.smithi017.stdout:5/264: symlink d0/d13/l52 0 2024-09-20T18:35:53.432 INFO:tasks.workunit.client.1.smithi172.stdout:5/903: dwrite d4/df/f22 [0,4194304] 0 2024-09-20T18:35:53.441 INFO:tasks.workunit.client.0.smithi017.stdout:8/249: rename d0/fd to d0/d6/d28/d3d/d4e/f51 0 2024-09-20T18:35:53.442 INFO:tasks.workunit.client.0.smithi017.stdout:8/250: readlink d0/d6/l26 0 2024-09-20T18:35:53.446 INFO:tasks.workunit.client.1.smithi172.stdout:3/938: symlink d0/dc/d6a/d22/l13e 0 2024-09-20T18:35:53.448 INFO:tasks.workunit.client.0.smithi017.stdout:7/290: dread da/f11 [0,4194304] 0 2024-09-20T18:35:53.449 INFO:tasks.workunit.client.1.smithi172.stdout:9/852: rename d15/d1f/d2c/d7d/d34/l90 to d15/d1f/d2c/d7d/d48/l118 0 2024-09-20T18:35:53.450 INFO:tasks.workunit.client.1.smithi172.stdout:9/853: chown d15/d4a/lf7 0 1 2024-09-20T18:35:53.450 INFO:tasks.workunit.client.0.smithi017.stdout:0/271: fsync d4/f17 0 2024-09-20T18:35:53.451 INFO:tasks.workunit.client.0.smithi017.stdout:0/272: chown d4/f11 0 1 2024-09-20T18:35:53.453 INFO:tasks.workunit.client.0.smithi017.stdout:5/265: creat d0/d14/d18/d2a/d39/f53 x:0 0 0 2024-09-20T18:35:53.454 INFO:tasks.workunit.client.1.smithi172.stdout:7/914: creat d2/d3/d10/d40/d6a/f13a x:0 0 0 2024-09-20T18:35:53.456 INFO:tasks.workunit.client.1.smithi172.stdout:5/904: chown d4/df/dad/cb5 25548 1 2024-09-20T18:35:53.457 INFO:tasks.workunit.client.0.smithi017.stdout:0/273: dwrite d4/db/f2c [0,4194304] 0 2024-09-20T18:35:53.459 INFO:tasks.workunit.client.0.smithi017.stdout:8/251: truncate d0/d6/f16 555896 0 2024-09-20T18:35:53.459 INFO:tasks.workunit.client.0.smithi017.stdout:0/274: write d4/d37/f3a [473160,71313] 0 2024-09-20T18:35:53.460 INFO:tasks.workunit.client.1.smithi172.stdout:2/826: dwrite d0/d2c/f3d [0,4194304] 0 2024-09-20T18:35:53.460 INFO:tasks.workunit.client.1.smithi172.stdout:5/905: write d4/df/dad/d26/d41/d69/dac/d2c/f30 [2311131,123991] 0 2024-09-20T18:35:53.461 INFO:tasks.workunit.client.0.smithi017.stdout:0/275: write d4/f29 [862661,48369] 0 2024-09-20T18:35:53.465 INFO:tasks.workunit.client.0.smithi017.stdout:1/188: creat df/f33 x:0 0 0 2024-09-20T18:35:53.467 INFO:tasks.workunit.client.0.smithi017.stdout:9/288: mknod d6/c77 0 2024-09-20T18:35:53.468 INFO:tasks.workunit.client.1.smithi172.stdout:2/827: dread d0/d2c/d3f/dab/d18/d29/d42/d4b/d53/fa2 [0,4194304] 0 2024-09-20T18:35:53.472 INFO:tasks.workunit.client.0.smithi017.stdout:6/266: truncate d4/df/d1f/f38 751622 0 2024-09-20T18:35:53.474 INFO:tasks.workunit.client.1.smithi172.stdout:6/764: creat d0/d18/d1c/d21/f100 x:0 0 0 2024-09-20T18:35:53.474 INFO:tasks.workunit.client.0.smithi017.stdout:7/291: dwrite da/d54/f58 [0,4194304] 0 2024-09-20T18:35:53.477 INFO:tasks.workunit.client.0.smithi017.stdout:5/266: unlink d0/d14/f23 0 2024-09-20T18:35:53.479 INFO:tasks.workunit.client.1.smithi172.stdout:1/862: link d0/d8/d5f/d113/l4f d0/d8/d109/l11b 0 2024-09-20T18:35:53.480 INFO:tasks.workunit.client.0.smithi017.stdout:8/252: write d0/d6/f3e [5709639,128687] 0 2024-09-20T18:35:53.482 INFO:tasks.workunit.client.1.smithi172.stdout:5/906: stat d4/df/d3f/d64/d101/d63/d80/fa8 0 2024-09-20T18:35:53.482 INFO:tasks.workunit.client.0.smithi017.stdout:8/253: dread - d0/d6/d28/d3a/f49 zero size 2024-09-20T18:35:53.483 INFO:tasks.workunit.client.0.smithi017.stdout:7/292: dwrite da/f49 [0,4194304] 0 2024-09-20T18:35:53.487 INFO:tasks.workunit.client.1.smithi172.stdout:3/939: symlink d0/d13/dfe/l13f 0 2024-09-20T18:35:53.492 INFO:tasks.workunit.client.0.smithi017.stdout:4/237: write d4/d19/f1f [39652,91400] 0 2024-09-20T18:35:53.492 INFO:tasks.workunit.client.0.smithi017.stdout:6/267: dread d4/f1e [0,4194304] 0 2024-09-20T18:35:53.495 INFO:tasks.workunit.client.1.smithi172.stdout:1/863: unlink d0/d8/d5f/l10d 0 2024-09-20T18:35:53.497 INFO:tasks.workunit.client.1.smithi172.stdout:5/907: creat d4/df/d3f/d64/d101/dce/f127 x:0 0 0 2024-09-20T18:35:53.497 INFO:tasks.workunit.client.0.smithi017.stdout:1/189: getdents df/d16/d32 0 2024-09-20T18:35:53.500 INFO:tasks.workunit.client.0.smithi017.stdout:8/254: rmdir d0/d6/d28/d3d/d4e 39 2024-09-20T18:35:53.502 INFO:tasks.workunit.client.1.smithi172.stdout:4/905: getdents d0/d48/d90/d55/d53/d78 0 2024-09-20T18:35:53.502 INFO:tasks.workunit.client.1.smithi172.stdout:5/908: dread d4/df/fc0 [0,4194304] 0 2024-09-20T18:35:53.503 INFO:tasks.workunit.client.1.smithi172.stdout:9/854: dwrite d15/d1a/dfb/fb9 [4194304,4194304] 0 2024-09-20T18:35:53.503 INFO:tasks.workunit.client.1.smithi172.stdout:7/915: write d2/d3/d3d/dd4/fdd [608596,15535] 0 2024-09-20T18:35:53.504 INFO:tasks.workunit.client.1.smithi172.stdout:9/855: chown d15/d4a 192 1 2024-09-20T18:35:53.505 INFO:tasks.workunit.client.1.smithi172.stdout:3/940: creat d0/dc/d6a/d3a/dcb/f140 x:0 0 0 2024-09-20T18:35:53.506 INFO:tasks.workunit.client.1.smithi172.stdout:7/916: write d2/dcc/f105 [588624,86518] 0 2024-09-20T18:35:53.506 INFO:tasks.workunit.client.1.smithi172.stdout:5/909: chown d4/df/d3f/d64/d101/d86/faa 52103750 1 2024-09-20T18:35:53.508 INFO:tasks.workunit.client.1.smithi172.stdout:9/856: dread d15/d20/d76/fa1 [0,4194304] 0 2024-09-20T18:35:53.509 INFO:tasks.workunit.client.0.smithi017.stdout:6/268: rmdir d4/df/d4a 39 2024-09-20T18:35:53.513 INFO:tasks.workunit.client.1.smithi172.stdout:2/828: write d0/d2c/d3f/dab/f80 [411732,43790] 0 2024-09-20T18:35:53.513 INFO:tasks.workunit.client.0.smithi017.stdout:1/190: mkdir df/d29/d2c/d34 0 2024-09-20T18:35:53.515 INFO:tasks.workunit.client.1.smithi172.stdout:2/829: write d0/d2c/d3f/dab/d22/f36 [2208804,81014] 0 2024-09-20T18:35:53.515 INFO:tasks.workunit.client.0.smithi017.stdout:8/255: mkdir d0/d6/d28/d52 0 2024-09-20T18:35:53.516 INFO:tasks.workunit.client.1.smithi172.stdout:4/906: dread d0/de/d39/d9f/fe5 [0,4194304] 0 2024-09-20T18:35:53.517 INFO:tasks.workunit.client.1.smithi172.stdout:7/917: mkdir d2/d23/d9d/dbc/d13b 0 2024-09-20T18:35:53.519 INFO:tasks.workunit.client.0.smithi017.stdout:9/289: rename d6/f18 to d6/d23/d3a/d61/f78 0 2024-09-20T18:35:53.519 INFO:tasks.workunit.client.0.smithi017.stdout:9/290: chown d6/d23/d3a/d61 396456 1 2024-09-20T18:35:53.520 INFO:tasks.workunit.client.1.smithi172.stdout:5/910: mknod d4/df/d98/c128 0 2024-09-20T18:35:53.522 INFO:tasks.workunit.client.1.smithi172.stdout:3/941: dread - d0/dc/d6a/d3a/dcb/fed zero size 2024-09-20T18:35:53.524 INFO:tasks.workunit.client.1.smithi172.stdout:9/857: mknod d15/d1f/d2c/d7d/d48/df0/c119 0 2024-09-20T18:35:53.525 INFO:tasks.workunit.client.0.smithi017.stdout:0/276: dwrite d4/f8 [0,4194304] 0 2024-09-20T18:35:53.526 INFO:tasks.workunit.client.0.smithi017.stdout:0/277: stat d4/db/c1b 0 2024-09-20T18:35:53.528 INFO:tasks.workunit.client.0.smithi017.stdout:6/269: mknod d4/d37/c59 0 2024-09-20T18:35:53.531 INFO:tasks.workunit.client.0.smithi017.stdout:1/191: unlink df/f10 0 2024-09-20T18:35:53.531 INFO:tasks.workunit.client.1.smithi172.stdout:9/858: dwrite d15/d1f/d2c/d7d/d48/df0/ff8 [0,4194304] 0 2024-09-20T18:35:53.532 INFO:tasks.workunit.client.0.smithi017.stdout:6/270: dread d4/d29/f39 [0,4194304] 0 2024-09-20T18:35:53.536 INFO:tasks.workunit.client.1.smithi172.stdout:2/830: chown d0/d2c/d3f/dab/d22/fda 137 1 2024-09-20T18:35:53.536 INFO:tasks.workunit.client.1.smithi172.stdout:4/907: creat d0/de/dc/d3c/f138 x:0 0 0 2024-09-20T18:35:53.538 INFO:tasks.workunit.client.0.smithi017.stdout:9/291: unlink d6/d23/f66 0 2024-09-20T18:35:53.540 INFO:tasks.workunit.client.1.smithi172.stdout:7/918: mkdir d2/d23/d51/d10e/d72/d9b/d13c 0 2024-09-20T18:35:53.540 INFO:tasks.workunit.client.0.smithi017.stdout:1/192: dwrite df/d1c/f25 [0,4194304] 0 2024-09-20T18:35:53.542 INFO:tasks.workunit.client.0.smithi017.stdout:1/193: chown df/d1c/c23 0 1 2024-09-20T18:35:53.548 INFO:tasks.workunit.client.1.smithi172.stdout:8/853: sync 2024-09-20T18:35:53.549 INFO:tasks.workunit.client.1.smithi172.stdout:8/854: chown dd/d1b/d3b/f7b 89667 1 2024-09-20T18:35:53.549 INFO:tasks.workunit.client.0.smithi017.stdout:8/256: dread d0/d6/f3e [0,4194304] 0 2024-09-20T18:35:53.550 INFO:tasks.workunit.client.0.smithi017.stdout:7/293: truncate da/d16/d1c/d40/d34/d3c/f46 1405721 0 2024-09-20T18:35:53.550 INFO:tasks.workunit.client.0.smithi017.stdout:1/194: dread df/f1a [0,4194304] 0 2024-09-20T18:35:53.550 INFO:tasks.workunit.client.0.smithi017.stdout:1/195: chown df/d1c 45728 1 2024-09-20T18:35:53.551 INFO:tasks.workunit.client.0.smithi017.stdout:8/257: fsync d0/f19 0 2024-09-20T18:35:53.551 INFO:tasks.workunit.client.0.smithi017.stdout:1/196: chown df/d16 1 1 2024-09-20T18:35:53.551 INFO:tasks.workunit.client.1.smithi172.stdout:9/859: dread d15/d1f/f53 [0,4194304] 0 2024-09-20T18:35:53.552 INFO:tasks.workunit.client.0.smithi017.stdout:4/238: creat d4/f4b x:0 0 0 2024-09-20T18:35:53.553 INFO:tasks.workunit.client.1.smithi172.stdout:1/864: getdents d0/d8/d5f/d113 0 2024-09-20T18:35:53.559 INFO:tasks.workunit.client.0.smithi017.stdout:8/258: dwrite d0/d6/d28/d3b/f45 [0,4194304] 0 2024-09-20T18:35:53.561 INFO:tasks.workunit.client.1.smithi172.stdout:4/908: symlink d0/d48/d90/d55/d53/d5c/l139 0 2024-09-20T18:35:53.563 INFO:tasks.workunit.client.0.smithi017.stdout:6/271: unlink d4/df/f32 0 2024-09-20T18:35:53.564 INFO:tasks.workunit.client.0.smithi017.stdout:6/272: chown d4/df/d1f/d25/l53 1165 1 2024-09-20T18:35:53.565 INFO:tasks.workunit.client.1.smithi172.stdout:2/831: creat d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/d9f/d106/f115 x:0 0 0 2024-09-20T18:35:53.567 INFO:tasks.workunit.client.1.smithi172.stdout:2/832: write d0/d2c/d3f/dab/d18/d29/d42/fd5 [1762575,43722] 0 2024-09-20T18:35:53.572 INFO:tasks.workunit.client.0.smithi017.stdout:9/292: symlink d6/d23/d58/d3f/d2f/d5d/l79 0 2024-09-20T18:35:53.573 INFO:tasks.workunit.client.0.smithi017.stdout:9/293: truncate d6/f3d 731309 0 2024-09-20T18:35:53.575 INFO:tasks.workunit.client.1.smithi172.stdout:1/865: creat d0/d8/d5f/dfb/f11c x:0 0 0 2024-09-20T18:35:53.576 INFO:tasks.workunit.client.0.smithi017.stdout:7/294: creat da/d16/d1c/d40/d30/f59 x:0 0 0 2024-09-20T18:35:53.577 INFO:tasks.workunit.client.0.smithi017.stdout:7/295: write da/f49 [4225184,93739] 0 2024-09-20T18:35:53.580 INFO:tasks.workunit.client.0.smithi017.stdout:0/278: getdents d4/db/d18/d55 0 2024-09-20T18:35:53.581 INFO:tasks.workunit.client.0.smithi017.stdout:7/296: dread da/f49 [0,4194304] 0 2024-09-20T18:35:53.583 INFO:tasks.workunit.client.1.smithi172.stdout:5/911: creat d4/df/dad/d26/d41/d69/dac/d2c/f129 x:0 0 0 2024-09-20T18:35:53.583 INFO:tasks.workunit.client.0.smithi017.stdout:7/297: truncate da/d16/d1c/d40/d30/f56 963765 0 2024-09-20T18:35:53.584 INFO:tasks.workunit.client.0.smithi017.stdout:4/239: creat d4/de/d1b/f4c x:0 0 0 2024-09-20T18:35:53.584 INFO:tasks.workunit.client.1.smithi172.stdout:7/919: write d2/d3/d10/f14 [2714701,86951] 0 2024-09-20T18:35:53.585 INFO:tasks.workunit.client.1.smithi172.stdout:2/833: fsync d0/d2c/d3f/dab/d22/d10/d6a/fcb 0 2024-09-20T18:35:53.588 INFO:tasks.workunit.client.1.smithi172.stdout:8/855: symlink dd/d1b/d3b/d5d/l12d 0 2024-09-20T18:35:53.590 INFO:tasks.workunit.client.1.smithi172.stdout:1/866: rename d0/d8/db/d25/d2b/d3d/fae to d0/d8/d5f/dfb/f11d 0 2024-09-20T18:35:53.591 INFO:tasks.workunit.client.1.smithi172.stdout:4/909: symlink d0/de/l13a 0 2024-09-20T18:35:53.591 INFO:tasks.workunit.client.1.smithi172.stdout:1/867: fsync d0/d8/db/f33 0 2024-09-20T18:35:53.592 INFO:tasks.workunit.client.1.smithi172.stdout:3/942: dwrite d0/f7 [0,4194304] 0 2024-09-20T18:35:53.592 INFO:tasks.workunit.client.1.smithi172.stdout:1/868: dread - d0/d8/db/fe8 zero size 2024-09-20T18:35:53.593 INFO:tasks.workunit.client.1.smithi172.stdout:5/912: fsync d4/df/dad/d26/fbd 0 2024-09-20T18:35:53.595 INFO:tasks.workunit.client.1.smithi172.stdout:5/913: write d4/df/dad/d26/f108 [856873,31016] 0 2024-09-20T18:35:53.597 INFO:tasks.workunit.client.1.smithi172.stdout:7/920: mknod d2/d23/d51/d10e/d72/d10d/c13d 0 2024-09-20T18:35:53.598 INFO:tasks.workunit.client.1.smithi172.stdout:7/921: dread - d2/d3/d86/f11e zero size 2024-09-20T18:35:53.599 INFO:tasks.workunit.client.1.smithi172.stdout:7/922: fdatasync d2/d3/d10/d40/d46/d8e/dbd/f116 0 2024-09-20T18:35:53.607 INFO:tasks.workunit.client.0.smithi017.stdout:7/298: mknod da/d16/d1b/c5a 0 2024-09-20T18:35:53.608 INFO:tasks.workunit.client.0.smithi017.stdout:4/240: mknod d4/de/c4d 0 2024-09-20T18:35:53.610 INFO:tasks.workunit.client.0.smithi017.stdout:8/259: truncate d0/f1c 3036834 0 2024-09-20T18:35:53.611 INFO:tasks.workunit.client.0.smithi017.stdout:6/273: rmdir d4/df/d4a 39 2024-09-20T18:35:53.613 INFO:tasks.workunit.client.0.smithi017.stdout:6/274: write d4/d37/d41/d43/f51 [24047,28563] 0 2024-09-20T18:35:53.615 INFO:tasks.workunit.client.0.smithi017.stdout:1/197: rmdir df/d29/d2c/d34 0 2024-09-20T18:35:53.617 INFO:tasks.workunit.client.0.smithi017.stdout:6/275: dread d4/df/f16 [0,4194304] 0 2024-09-20T18:35:53.624 INFO:tasks.workunit.client.0.smithi017.stdout:8/260: creat d0/d6/d28/d3b/f53 x:0 0 0 2024-09-20T18:35:53.626 INFO:tasks.workunit.client.0.smithi017.stdout:9/294: rename d6/d23/d58/d3f/d44/f75 to d6/d23/f7a 0 2024-09-20T18:35:53.627 INFO:tasks.workunit.client.1.smithi172.stdout:6/765: sync 2024-09-20T18:35:53.628 INFO:tasks.workunit.client.1.smithi172.stdout:2/834: getdents d0/d2c/d3f/dab/d22/d10/d35/dc4/df2 0 2024-09-20T18:35:53.631 INFO:tasks.workunit.client.0.smithi017.stdout:6/276: stat d4/df/d4a/f4b 0 2024-09-20T18:35:53.632 INFO:tasks.workunit.client.0.smithi017.stdout:6/277: readlink d4/l1c 0 2024-09-20T18:35:53.632 INFO:tasks.workunit.client.1.smithi172.stdout:2/835: fdatasync d0/d2c/d3f/dab/d22/d10/d3c/f6d 0 2024-09-20T18:35:53.633 INFO:tasks.workunit.client.0.smithi017.stdout:0/279: rmdir d4/db/d1e/d4f 0 2024-09-20T18:35:53.635 INFO:tasks.workunit.client.1.smithi172.stdout:1/869: mknod d0/d8/d109/c11e 0 2024-09-20T18:35:53.636 INFO:tasks.workunit.client.0.smithi017.stdout:9/295: readlink l5 0 2024-09-20T18:35:53.636 INFO:tasks.workunit.client.1.smithi172.stdout:7/923: dwrite d2/d23/d51/d10e/d72/d9b/fa3 [4194304,4194304] 0 2024-09-20T18:35:53.637 INFO:tasks.workunit.client.1.smithi172.stdout:5/914: dwrite d4/df/dad/d26/d41/d69/dac/d2c/f7d [0,4194304] 0 2024-09-20T18:35:53.637 INFO:tasks.workunit.client.0.smithi017.stdout:9/296: chown d6/d11/f21 3409584 1 2024-09-20T18:35:53.638 INFO:tasks.workunit.client.1.smithi172.stdout:6/766: creat d0/d18/d1c/d21/d26/d34/d39/d74/dbf/de7/f101 x:0 0 0 2024-09-20T18:35:53.639 INFO:tasks.workunit.client.0.smithi017.stdout:9/297: chown d6/d23/d58/d3f/d2f/l4b 614 1 2024-09-20T18:35:53.641 INFO:tasks.workunit.client.0.smithi017.stdout:9/298: truncate d6/f2e 353965 0 2024-09-20T18:35:53.641 INFO:tasks.workunit.client.1.smithi172.stdout:6/767: write d0/d18/d1c/d21/d26/d34/da2/def/ff1 [352978,98211] 0 2024-09-20T18:35:53.641 INFO:tasks.workunit.client.0.smithi017.stdout:4/241: dwrite d4/f38 [0,4194304] 0 2024-09-20T18:35:53.643 INFO:tasks.workunit.client.1.smithi172.stdout:8/856: truncate dd/d1b/d3b/d51/f2e 5289287 0 2024-09-20T18:35:53.644 INFO:tasks.workunit.client.1.smithi172.stdout:8/857: chown dd 364029907 1 2024-09-20T18:35:53.644 INFO:tasks.workunit.client.1.smithi172.stdout:1/870: dwrite d0/d8/db/d25/d2b/fee [0,4194304] 0 2024-09-20T18:35:53.645 INFO:tasks.workunit.client.1.smithi172.stdout:4/910: dread d0/d48/d90/db4/fc1 [0,4194304] 0 2024-09-20T18:35:53.651 INFO:tasks.workunit.client.1.smithi172.stdout:8/858: chown dd/d1b/d3b/d51/d5b/daf/l68 178940319 1 2024-09-20T18:35:53.652 INFO:tasks.workunit.client.0.smithi017.stdout:1/198: mkdir df/d35 0 2024-09-20T18:35:53.652 INFO:tasks.workunit.client.0.smithi017.stdout:9/299: dwrite d6/d1f/f33 [4194304,4194304] 0 2024-09-20T18:35:53.654 INFO:tasks.workunit.client.1.smithi172.stdout:5/915: creat d4/df/d3f/d64/d101/d86/f12a x:0 0 0 2024-09-20T18:35:53.656 INFO:tasks.workunit.client.0.smithi017.stdout:4/242: mkdir d4/dc/d1e/d26/d4e 0 2024-09-20T18:35:53.659 INFO:tasks.workunit.client.1.smithi172.stdout:4/911: creat d0/de/d21/dc7/f13b x:0 0 0 2024-09-20T18:35:53.660 INFO:tasks.workunit.client.1.smithi172.stdout:4/912: dread - d0/de/dc/f114 zero size 2024-09-20T18:35:53.661 INFO:tasks.workunit.client.0.smithi017.stdout:6/278: dwrite d4/df/d1f/d25/d3f/f52 [0,4194304] 0 2024-09-20T18:35:53.661 INFO:tasks.workunit.client.1.smithi172.stdout:1/871: mkdir d0/d8/db/d25/d6f/d11f 0 2024-09-20T18:35:53.661 INFO:tasks.workunit.client.1.smithi172.stdout:4/913: stat d0/de/d21/c87 0 2024-09-20T18:35:53.662 INFO:tasks.workunit.client.0.smithi017.stdout:1/199: truncate df/f1a 1357065 0 2024-09-20T18:35:53.665 INFO:tasks.workunit.client.0.smithi017.stdout:9/300: creat d6/d23/d3a/f7b x:0 0 0 2024-09-20T18:35:53.666 INFO:tasks.workunit.client.1.smithi172.stdout:8/859: write dd/d1b/d4f/f80 [2332747,5182] 0 2024-09-20T18:35:53.667 INFO:tasks.workunit.client.1.smithi172.stdout:8/860: readlink dd/d1b/l46 0 2024-09-20T18:35:53.667 INFO:tasks.workunit.client.0.smithi017.stdout:7/299: rename da/d16/d1b/l2b to da/d16/d1c/d40/l5b 0 2024-09-20T18:35:53.668 INFO:tasks.workunit.client.0.smithi017.stdout:7/300: fsync da/f13 0 2024-09-20T18:35:53.678 INFO:tasks.workunit.client.1.smithi172.stdout:4/914: rename d0/d48/d90/d55/d53/d5c/d11d/lc3 to d0/de/d21/dc7/l13c 0 2024-09-20T18:35:53.679 INFO:tasks.workunit.client.0.smithi017.stdout:1/200: readlink df/l12 0 2024-09-20T18:35:53.680 INFO:tasks.workunit.client.1.smithi172.stdout:7/924: write d2/d3/f35 [2308021,129834] 0 2024-09-20T18:35:53.680 INFO:tasks.workunit.client.0.smithi017.stdout:1/201: dread df/d16/f22 [0,4194304] 0 2024-09-20T18:35:53.681 INFO:tasks.workunit.client.0.smithi017.stdout:9/301: rmdir d6/d1f 39 2024-09-20T18:35:53.683 INFO:tasks.workunit.client.1.smithi172.stdout:2/836: dread d0/d2c/d3f/dab/d22/d10/d6a/d98/d59/f5c [0,4194304] 0 2024-09-20T18:35:53.684 INFO:tasks.workunit.client.1.smithi172.stdout:6/768: creat d0/d18/d1c/d21/d26/d34/f102 x:0 0 0 2024-09-20T18:35:53.688 INFO:tasks.workunit.client.1.smithi172.stdout:8/861: dread dd/d1b/d3b/d51/dac/fc4 [0,4194304] 0 2024-09-20T18:35:53.690 INFO:tasks.workunit.client.0.smithi017.stdout:7/301: dwrite f4 [4194304,4194304] 0 2024-09-20T18:35:53.690 INFO:tasks.workunit.client.1.smithi172.stdout:1/872: creat d0/d8/db/d25/d2b/d3d/d65/d93/f120 x:0 0 0 2024-09-20T18:35:53.691 INFO:tasks.workunit.client.1.smithi172.stdout:6/769: unlink d0/d18/d65/lf9 0 2024-09-20T18:35:53.692 INFO:tasks.workunit.client.0.smithi017.stdout:9/302: symlink d6/d23/d58/d3f/d4d/l7c 0 2024-09-20T18:35:53.694 INFO:tasks.workunit.client.0.smithi017.stdout:4/243: rmdir d4/dc/d41/d43 0 2024-09-20T18:35:53.696 INFO:tasks.workunit.client.1.smithi172.stdout:8/862: rename dd/d1b/d3b/d51/f88 to dd/de3/d10c/f12e 0 2024-09-20T18:35:53.698 INFO:tasks.workunit.client.0.smithi017.stdout:7/302: unlink da/f17 0 2024-09-20T18:35:53.700 INFO:tasks.workunit.client.1.smithi172.stdout:7/925: creat d2/d23/f13e x:0 0 0 2024-09-20T18:35:53.702 INFO:tasks.workunit.client.0.smithi017.stdout:4/244: creat d4/de/f4f x:0 0 0 2024-09-20T18:35:53.703 INFO:tasks.workunit.client.0.smithi017.stdout:1/202: rename df/f30 to df/f36 0 2024-09-20T18:35:53.704 INFO:tasks.workunit.client.1.smithi172.stdout:9/860: sync 2024-09-20T18:35:53.704 INFO:tasks.workunit.client.1.smithi172.stdout:1/873: symlink d0/d8/db/d25/d2b/d3d/d65/d93/dbb/df7/l121 0 2024-09-20T18:35:53.705 INFO:tasks.workunit.client.0.smithi017.stdout:7/303: dwrite da/f13 [0,4194304] 0 2024-09-20T18:35:53.706 INFO:tasks.workunit.client.1.smithi172.stdout:1/874: dread - d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/ff8 zero size 2024-09-20T18:35:53.706 INFO:tasks.workunit.client.0.smithi017.stdout:7/304: chown da/d16/d1b 0 1 2024-09-20T18:35:53.706 INFO:tasks.workunit.client.0.smithi017.stdout:7/305: stat da/d54/f58 0 2024-09-20T18:35:53.707 INFO:tasks.workunit.client.1.smithi172.stdout:6/770: mknod d0/d18/d1c/d21/d26/d34/d9c/dc7/c103 0 2024-09-20T18:35:53.707 INFO:tasks.workunit.client.1.smithi172.stdout:2/837: dread d0/d2c/d3f/dab/d22/fda [0,4194304] 0 2024-09-20T18:35:53.707 INFO:tasks.workunit.client.1.smithi172.stdout:1/875: chown d0/f82 12794 1 2024-09-20T18:35:53.708 INFO:tasks.workunit.client.1.smithi172.stdout:8/863: symlink dd/d1b/d4f/d86/dbc/l12f 0 2024-09-20T18:35:53.709 INFO:tasks.workunit.client.1.smithi172.stdout:2/838: stat d0/d2c/d3f/dab/d22/d10/f1f 0 2024-09-20T18:35:53.712 INFO:tasks.workunit.client.0.smithi017.stdout:4/245: symlink d4/de/l50 0 2024-09-20T18:35:53.713 INFO:tasks.workunit.client.1.smithi172.stdout:9/861: symlink d15/d1a/d82/l11a 0 2024-09-20T18:35:53.715 INFO:tasks.workunit.client.1.smithi172.stdout:1/876: mknod d0/d8/d109/c122 0 2024-09-20T18:35:53.716 INFO:tasks.workunit.client.1.smithi172.stdout:9/862: chown d15/d1f/d2c/d57/c83 28930903 1 2024-09-20T18:35:53.717 INFO:tasks.workunit.client.1.smithi172.stdout:6/771: creat d0/d18/d1c/d21/d26/d34/d39/d74/dbf/f104 x:0 0 0 2024-09-20T18:35:53.717 INFO:tasks.workunit.client.0.smithi017.stdout:4/246: fsync d4/dc/f12 0 2024-09-20T18:35:53.719 INFO:tasks.workunit.client.1.smithi172.stdout:2/839: creat d0/d2c/db2/f116 x:0 0 0 2024-09-20T18:35:53.719 INFO:tasks.workunit.client.0.smithi017.stdout:1/203: mknod df/c37 0 2024-09-20T18:35:53.719 INFO:tasks.workunit.client.1.smithi172.stdout:1/877: dread - d0/d8/db/d25/d2b/f112 zero size 2024-09-20T18:35:53.721 INFO:tasks.workunit.client.1.smithi172.stdout:8/864: fdatasync dd/d1b/d3b/d51/f8e 0 2024-09-20T18:35:53.722 INFO:tasks.workunit.client.1.smithi172.stdout:7/926: dwrite d2/d3/d10/d40/fd9 [0,4194304] 0 2024-09-20T18:35:53.723 INFO:tasks.workunit.client.0.smithi017.stdout:7/306: mkdir da/d5c 0 2024-09-20T18:35:53.725 INFO:tasks.workunit.client.1.smithi172.stdout:6/772: write d0/d18/d1c/d21/d26/d34/d39/d46/fb4 [2379366,102528] 0 2024-09-20T18:35:53.725 INFO:tasks.workunit.client.1.smithi172.stdout:5/916: dwrite d4/df/dad/d26/d41/d69/f6e [0,4194304] 0 2024-09-20T18:35:53.726 INFO:tasks.workunit.client.0.smithi017.stdout:6/279: write d4/f10 [751003,52924] 0 2024-09-20T18:35:53.728 INFO:tasks.workunit.client.0.smithi017.stdout:6/280: stat d4/df/c44 0 2024-09-20T18:35:53.728 INFO:tasks.workunit.client.0.smithi017.stdout:4/247: creat d4/dc/d1e/f51 x:0 0 0 2024-09-20T18:35:53.734 INFO:tasks.workunit.client.1.smithi172.stdout:6/773: dwrite d0/d18/daf/fc8 [0,4194304] 0 2024-09-20T18:35:53.735 INFO:tasks.workunit.client.1.smithi172.stdout:4/915: write d0/d48/d90/d55/d101/f11 [506039,96522] 0 2024-09-20T18:35:53.736 INFO:tasks.workunit.client.1.smithi172.stdout:2/840: symlink d0/d2c/d3f/dab/d22/ded/l117 0 2024-09-20T18:35:53.738 INFO:tasks.workunit.client.1.smithi172.stdout:7/927: dread d2/f25 [0,4194304] 0 2024-09-20T18:35:53.740 INFO:tasks.workunit.client.1.smithi172.stdout:2/841: fdatasync d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/d9f/d106/fa1 0 2024-09-20T18:35:53.740 INFO:tasks.workunit.client.0.smithi017.stdout:1/204: creat df/d35/f38 x:0 0 0 2024-09-20T18:35:53.744 INFO:tasks.workunit.client.1.smithi172.stdout:5/917: fdatasync d4/df/d98/ffc 0 2024-09-20T18:35:53.749 INFO:tasks.workunit.client.0.smithi017.stdout:9/303: dwrite d6/d11/f1b [0,4194304] 0 2024-09-20T18:35:53.749 INFO:tasks.workunit.client.0.smithi017.stdout:1/205: mknod df/d1c/c39 0 2024-09-20T18:35:53.749 INFO:tasks.workunit.client.1.smithi172.stdout:1/878: dread d0/d22/f54 [0,4194304] 0 2024-09-20T18:35:53.751 INFO:tasks.workunit.client.0.smithi017.stdout:9/304: write d6/d23/d58/f57 [3931345,10905] 0 2024-09-20T18:35:53.751 INFO:tasks.workunit.client.0.smithi017.stdout:6/281: link d4/l6 d4/d37/l5a 0 2024-09-20T18:35:53.753 INFO:tasks.workunit.client.0.smithi017.stdout:9/305: write d6/d23/d3a/f5e [704232,53246] 0 2024-09-20T18:35:53.753 INFO:tasks.workunit.client.1.smithi172.stdout:6/774: creat d0/d18/d1c/d21/d26/d34/d6b/d7d/f105 x:0 0 0 2024-09-20T18:35:53.754 INFO:tasks.workunit.client.0.smithi017.stdout:1/206: creat df/d29/f3a x:0 0 0 2024-09-20T18:35:53.754 INFO:tasks.workunit.client.1.smithi172.stdout:6/775: dread - d0/d18/d1c/d21/f100 zero size 2024-09-20T18:35:53.755 INFO:tasks.workunit.client.1.smithi172.stdout:8/865: truncate dd/d65/fb6 573282 0 2024-09-20T18:35:53.758 INFO:tasks.workunit.client.0.smithi017.stdout:6/282: creat d4/df/d1f/d25/d3f/f5b x:0 0 0 2024-09-20T18:35:53.758 INFO:tasks.workunit.client.1.smithi172.stdout:4/916: rename d0/de/la4 to d0/d48/d90/d55/d53/d5c/d10e/d133/d110/l13d 0 2024-09-20T18:35:53.761 INFO:tasks.workunit.client.0.smithi017.stdout:1/207: rmdir df/d29/d2c 39 2024-09-20T18:35:53.763 INFO:tasks.workunit.client.1.smithi172.stdout:2/842: write d0/d2c/d3f/dab/d18/f6e [1947498,94486] 0 2024-09-20T18:35:53.765 INFO:tasks.workunit.client.0.smithi017.stdout:6/283: readlink d4/df/d1f/d25/d2b/l55 0 2024-09-20T18:35:53.766 INFO:tasks.workunit.client.1.smithi172.stdout:5/918: rmdir d4 39 2024-09-20T18:35:53.766 INFO:tasks.workunit.client.0.smithi017.stdout:6/284: write d4/df/d1f/d25/d3f/f52 [1715745,36329] 0 2024-09-20T18:35:53.767 INFO:tasks.workunit.client.0.smithi017.stdout:9/306: mkdir d6/d23/d58/d3f/d4d/d73/d7d 0 2024-09-20T18:35:53.772 INFO:tasks.workunit.client.0.smithi017.stdout:6/285: mkdir d4/df/d1f/d25/d3f/d5c 0 2024-09-20T18:35:53.774 INFO:tasks.workunit.client.0.smithi017.stdout:9/307: mknod d6/d23/d58/d3f/d44/c7e 0 2024-09-20T18:35:53.776 INFO:tasks.workunit.client.0.smithi017.stdout:7/307: truncate da/f11 555318 0 2024-09-20T18:35:53.777 INFO:tasks.workunit.client.0.smithi017.stdout:6/286: creat d4/df/d4a/f5d x:0 0 0 2024-09-20T18:35:53.777 INFO:tasks.workunit.client.0.smithi017.stdout:6/287: read d4/f1e [140591,88148] 0 2024-09-20T18:35:53.779 INFO:tasks.workunit.client.1.smithi172.stdout:2/843: dread d0/d2c/d3f/f30 [0,4194304] 0 2024-09-20T18:35:53.784 INFO:tasks.workunit.client.0.smithi017.stdout:9/308: link d6/d23/f50 d6/d23/d58/d3f/f7f 0 2024-09-20T18:35:53.785 INFO:tasks.workunit.client.0.smithi017.stdout:9/309: dread - d6/d23/d58/d3f/f7f zero size 2024-09-20T18:35:53.786 INFO:tasks.workunit.client.0.smithi017.stdout:7/308: mkdir da/d16/d1c/d40/d5d 0 2024-09-20T18:35:53.787 INFO:tasks.workunit.client.0.smithi017.stdout:7/309: chown da/f22 14872369 1 2024-09-20T18:35:53.789 INFO:tasks.workunit.client.0.smithi017.stdout:1/208: dread df/f1a [0,4194304] 0 2024-09-20T18:35:53.793 INFO:tasks.workunit.client.1.smithi172.stdout:3/943: sync 2024-09-20T18:35:53.794 INFO:tasks.workunit.client.1.smithi172.stdout:2/844: dread d0/d2c/d3f/dab/d22/d10/d35/fb0 [0,4194304] 0 2024-09-20T18:35:53.794 INFO:tasks.workunit.client.0.smithi017.stdout:9/310: creat d6/d23/d58/d3f/d2f/d5d/f80 x:0 0 0 2024-09-20T18:35:53.795 INFO:tasks.workunit.client.0.smithi017.stdout:1/209: dwrite df/f33 [0,4194304] 0 2024-09-20T18:35:53.797 INFO:tasks.workunit.client.1.smithi172.stdout:1/879: dwrite d0/d8/db/d25/d2b/d3d/d65/f66 [0,4194304] 0 2024-09-20T18:35:53.797 INFO:tasks.workunit.client.0.smithi017.stdout:7/310: creat da/d16/f5e x:0 0 0 2024-09-20T18:35:53.799 INFO:tasks.workunit.client.0.smithi017.stdout:7/311: fdatasync da/f12 0 2024-09-20T18:35:53.799 INFO:tasks.workunit.client.0.smithi017.stdout:7/312: chown da/d16/d1c/d40/d5d 92307 1 2024-09-20T18:35:53.801 INFO:tasks.workunit.client.1.smithi172.stdout:4/917: creat d0/d7/f13e x:0 0 0 2024-09-20T18:35:53.804 INFO:tasks.workunit.client.1.smithi172.stdout:6/776: write d0/d18/d1c/d21/d26/d34/d6b/d7d/d35/f4f [2232971,72925] 0 2024-09-20T18:35:53.806 INFO:tasks.workunit.client.1.smithi172.stdout:5/919: mkdir d4/df/dad/d26/d41/d69/dac/d2c/dd1/d12b 0 2024-09-20T18:35:53.806 INFO:tasks.workunit.client.1.smithi172.stdout:8/866: dwrite dd/d1b/d3b/d51/d5b/daf/fc6 [0,4194304] 0 2024-09-20T18:35:53.807 INFO:tasks.workunit.client.0.smithi017.stdout:9/311: creat d6/d23/d58/d3f/d2f/f81 x:0 0 0 2024-09-20T18:35:53.810 INFO:tasks.workunit.client.0.smithi017.stdout:6/288: dwrite d4/d29/f45 [0,4194304] 0 2024-09-20T18:35:53.811 INFO:tasks.workunit.client.1.smithi172.stdout:9/863: sync 2024-09-20T18:35:53.812 INFO:tasks.workunit.client.1.smithi172.stdout:3/944: rmdir d0/dc/d6a/d3a/dcb 39 2024-09-20T18:35:53.813 INFO:tasks.workunit.client.1.smithi172.stdout:9/864: readlink d15/d1a/dfb/la9 0 2024-09-20T18:35:53.814 INFO:tasks.workunit.client.1.smithi172.stdout:7/928: dwrite d2/d3/d10/d40/d46/f60 [0,4194304] 0 2024-09-20T18:35:53.814 INFO:tasks.workunit.client.0.smithi017.stdout:1/210: mkdir df/d3b 0 2024-09-20T18:35:53.815 INFO:tasks.workunit.client.1.smithi172.stdout:6/777: dread d0/fc [0,4194304] 0 2024-09-20T18:35:53.816 INFO:tasks.workunit.client.1.smithi172.stdout:1/880: dwrite d0/f4 [0,4194304] 0 2024-09-20T18:35:53.821 INFO:tasks.workunit.client.1.smithi172.stdout:6/778: read - d0/d18/d1c/d21/d26/fd7 zero size 2024-09-20T18:35:53.821 INFO:tasks.workunit.client.1.smithi172.stdout:2/845: rename d0/d2c/d3f/dab/d18/d29/c49 to d0/d2c/d3f/dab/d18/d29/d42/c118 0 2024-09-20T18:35:53.823 INFO:tasks.workunit.client.0.smithi017.stdout:6/289: rename d4/c18 to d4/d37/c5e 0 2024-09-20T18:35:53.824 INFO:tasks.workunit.client.1.smithi172.stdout:2/846: readlink d0/d2c/d3f/dab/d22/l81 0 2024-09-20T18:35:53.825 INFO:tasks.workunit.client.0.smithi017.stdout:9/312: dwrite d6/d11/f29 [0,4194304] 0 2024-09-20T18:35:53.827 INFO:tasks.workunit.client.0.smithi017.stdout:9/313: fdatasync d6/d23/d58/d3f/f76 0 2024-09-20T18:35:53.829 INFO:tasks.workunit.client.0.smithi017.stdout:7/313: truncate da/d16/d1c/d40/d34/d3c/f46 116674 0 2024-09-20T18:35:53.829 INFO:tasks.workunit.client.1.smithi172.stdout:9/865: unlink d15/d54/f60 0 2024-09-20T18:35:53.829 INFO:tasks.workunit.client.1.smithi172.stdout:7/929: truncate d2/d3/d3d/d4e/f5d 2577927 0 2024-09-20T18:35:53.830 INFO:tasks.workunit.client.0.smithi017.stdout:1/211: chown df/d29/d2c/c2f 967 1 2024-09-20T18:35:53.831 INFO:tasks.workunit.client.1.smithi172.stdout:7/930: fsync d2/d3/d86/f8d 0 2024-09-20T18:35:53.833 INFO:tasks.workunit.client.0.smithi017.stdout:6/290: fdatasync d4/df/f16 0 2024-09-20T18:35:53.833 INFO:tasks.workunit.client.1.smithi172.stdout:1/881: dread d0/d8/fc [0,4194304] 0 2024-09-20T18:35:53.833 INFO:tasks.workunit.client.1.smithi172.stdout:7/931: write d2/d23/d51/d10e/d72/d9b/fa3 [8779735,104870] 0 2024-09-20T18:35:53.833 INFO:tasks.workunit.client.1.smithi172.stdout:4/918: rename d0/fcd to d0/d48/d90/d55/d101/d18/d51/d9a/f13f 0 2024-09-20T18:35:53.838 INFO:tasks.workunit.client.1.smithi172.stdout:3/945: truncate d0/d13/d32/d88/ff0 663154 0 2024-09-20T18:35:53.839 INFO:tasks.workunit.client.0.smithi017.stdout:7/314: dwrite da/d16/d1c/d40/d34/f55 [0,4194304] 0 2024-09-20T18:35:53.840 INFO:tasks.workunit.client.1.smithi172.stdout:5/920: symlink d4/df/dad/d26/d41/d69/dac/d2c/l12c 0 2024-09-20T18:35:53.841 INFO:tasks.workunit.client.1.smithi172.stdout:2/847: mknod d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/d9f/d106/d9d/c119 0 2024-09-20T18:35:53.842 INFO:tasks.workunit.client.0.smithi017.stdout:7/315: write da/d16/d1c/d40/d3a/f45 [3323996,107974] 0 2024-09-20T18:35:53.844 INFO:tasks.workunit.client.0.smithi017.stdout:9/314: rename d6/d1f to d6/d23/d58/d3f/d82 0 2024-09-20T18:35:53.847 INFO:tasks.workunit.client.0.smithi017.stdout:9/315: dread - d6/d23/d58/d3f/d82/f4f zero size 2024-09-20T18:35:53.848 INFO:tasks.workunit.client.1.smithi172.stdout:1/882: rmdir d0/d8/db/d25/d6f 39 2024-09-20T18:35:53.851 INFO:tasks.workunit.client.0.smithi017.stdout:7/316: dwrite da/d16/d1c/d40/d34/d3c/f4e [0,4194304] 0 2024-09-20T18:35:53.854 INFO:tasks.workunit.client.1.smithi172.stdout:4/919: creat d0/de/d39/d9f/de8/d119/f140 x:0 0 0 2024-09-20T18:35:53.854 INFO:tasks.workunit.client.1.smithi172.stdout:1/883: truncate d0/d8/db/d25/d2b/d3d/d65/ff0 61401 0 2024-09-20T18:35:53.855 INFO:tasks.workunit.client.0.smithi017.stdout:6/291: rename d4/df/d28 to d4/df/d4a/d5f 0 2024-09-20T18:35:53.856 INFO:tasks.workunit.client.1.smithi172.stdout:1/884: truncate d0/d8/d5f/d113/d96/fd7 234708 0 2024-09-20T18:35:53.856 INFO:tasks.workunit.client.1.smithi172.stdout:7/932: read d2/d3/d10/d40/d74/fe5 [30350,111334] 0 2024-09-20T18:35:53.859 INFO:tasks.workunit.client.0.smithi017.stdout:7/317: dwrite da/d16/d1c/d40/d3a/f45 [0,4194304] 0 2024-09-20T18:35:53.860 INFO:tasks.workunit.client.1.smithi172.stdout:2/848: unlink d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/c110 0 2024-09-20T18:35:53.862 INFO:tasks.workunit.client.1.smithi172.stdout:9/866: dread d15/d4a/f96 [0,4194304] 0 2024-09-20T18:35:53.862 INFO:tasks.workunit.client.0.smithi017.stdout:9/316: rename d6/d23/d58/d3f/d4d/l7c to d6/d23/d40/l83 0 2024-09-20T18:35:53.864 INFO:tasks.workunit.client.0.smithi017.stdout:6/292: mknod d4/df/d1f/d25/d2b/c60 0 2024-09-20T18:35:53.865 INFO:tasks.workunit.client.1.smithi172.stdout:6/779: write d0/d18/d1c/d21/d26/d34/d7a/f2e [3885259,104942] 0 2024-09-20T18:35:53.865 INFO:tasks.workunit.client.1.smithi172.stdout:7/933: symlink d2/d23/d3c/l13f 0 2024-09-20T18:35:53.866 INFO:tasks.workunit.client.0.smithi017.stdout:1/212: write df/f1a [1147411,74851] 0 2024-09-20T18:35:53.867 INFO:tasks.workunit.client.1.smithi172.stdout:7/934: stat d2/d23/dc0 0 2024-09-20T18:35:53.867 INFO:tasks.workunit.client.0.smithi017.stdout:1/213: dread - df/d1c/f1f zero size 2024-09-20T18:35:53.869 INFO:tasks.workunit.client.0.smithi017.stdout:7/318: dwrite da/d16/d1c/d40/d34/d3c/f48 [0,4194304] 0 2024-09-20T18:35:53.870 INFO:tasks.workunit.client.1.smithi172.stdout:2/849: chown d0/d2c/d3f/dab/d22/ded/l7c 4087861 1 2024-09-20T18:35:53.871 INFO:tasks.workunit.client.1.smithi172.stdout:7/935: truncate d2/d3/d3d/f7f 4903534 0 2024-09-20T18:35:53.872 INFO:tasks.workunit.client.1.smithi172.stdout:2/850: dread - d0/d2c/d3f/dab/d18/d29/fe1 zero size 2024-09-20T18:35:53.874 INFO:tasks.workunit.client.0.smithi017.stdout:1/214: creat df/d1c/f3c x:0 0 0 2024-09-20T18:35:53.874 INFO:tasks.workunit.client.1.smithi172.stdout:4/920: symlink d0/de/d21/l141 0 2024-09-20T18:35:53.876 INFO:tasks.workunit.client.0.smithi017.stdout:7/319: rmdir da 39 2024-09-20T18:35:53.876 INFO:tasks.workunit.client.0.smithi017.stdout:9/317: dwrite d6/d23/f54 [0,4194304] 0 2024-09-20T18:35:53.877 INFO:tasks.workunit.client.1.smithi172.stdout:1/885: mkdir d0/d8/df4/d11a/d123 0 2024-09-20T18:35:53.880 INFO:tasks.workunit.client.1.smithi172.stdout:7/936: symlink d2/d3/d10/d40/d46/d8e/dbd/dda/l140 0 2024-09-20T18:35:53.882 INFO:tasks.workunit.client.0.smithi017.stdout:7/320: write da/d16/d1c/f4c [5059941,21998] 0 2024-09-20T18:35:53.883 INFO:tasks.workunit.client.1.smithi172.stdout:7/937: fsync d2/d3/d3d/dd4/fd7 0 2024-09-20T18:35:53.883 INFO:tasks.workunit.client.0.smithi017.stdout:7/321: readlink da/d16/d1c/d40/l33 0 2024-09-20T18:35:53.884 INFO:tasks.workunit.client.0.smithi017.stdout:9/318: creat d6/d23/d58/d3f/d5f/f84 x:0 0 0 2024-09-20T18:35:53.885 INFO:tasks.workunit.client.0.smithi017.stdout:1/215: symlink df/d3b/l3d 0 2024-09-20T18:35:53.885 INFO:tasks.workunit.client.0.smithi017.stdout:1/216: fsync df/d1c/f1f 0 2024-09-20T18:35:53.887 INFO:tasks.workunit.client.0.smithi017.stdout:1/217: write f2 [6728644,40729] 0 2024-09-20T18:35:53.888 INFO:tasks.workunit.client.1.smithi172.stdout:1/886: dwrite d0/d8/d5f/d113/d96/fd4 [0,4194304] 0 2024-09-20T18:35:53.890 INFO:tasks.workunit.client.0.smithi017.stdout:9/319: unlink d6/d11/c1a 0 2024-09-20T18:35:53.892 INFO:tasks.workunit.client.0.smithi017.stdout:1/218: dread df/f33 [0,4194304] 0 2024-09-20T18:35:53.892 INFO:tasks.workunit.client.1.smithi172.stdout:2/851: creat d0/d1a/d58/d10b/f11a x:0 0 0 2024-09-20T18:35:53.892 INFO:tasks.workunit.client.1.smithi172.stdout:9/867: dread d15/d1a/d8d/faa [0,4194304] 0 2024-09-20T18:35:53.893 INFO:tasks.workunit.client.0.smithi017.stdout:1/219: chown df/d29/l2d 8623110 1 2024-09-20T18:35:53.894 INFO:tasks.workunit.client.0.smithi017.stdout:1/220: rename df/d29 to df/d29/d2c/d3e 22 2024-09-20T18:35:53.895 INFO:tasks.workunit.client.1.smithi172.stdout:2/852: stat d0/d2c/d3f/dab/d22/d4c/f74 0 2024-09-20T18:35:53.897 INFO:tasks.workunit.client.1.smithi172.stdout:2/853: chown d0/d2c/d3f/dab/d22/d10/d35/fa6 2855983 1 2024-09-20T18:35:53.898 INFO:tasks.workunit.client.0.smithi017.stdout:1/221: readlink df/d16/l31 0 2024-09-20T18:35:53.900 INFO:tasks.workunit.client.1.smithi172.stdout:7/938: truncate d2/d3/d3d/d4e/fae 198320 0 2024-09-20T18:35:53.900 INFO:tasks.workunit.client.1.smithi172.stdout:7/939: chown d2/d3/dd/d84/fed 65872778 1 2024-09-20T18:35:53.901 INFO:tasks.workunit.client.0.smithi017.stdout:1/222: rename df/d16/f22 to df/d29/d2c/f3f 0 2024-09-20T18:35:53.903 INFO:tasks.workunit.client.1.smithi172.stdout:2/854: fdatasync d0/d2c/d3f/dab/d22/d10/d35/d5d/fbd 0 2024-09-20T18:35:53.903 INFO:tasks.workunit.client.1.smithi172.stdout:4/921: dread d0/de/f5a [0,4194304] 0 2024-09-20T18:35:53.903 INFO:tasks.workunit.client.0.smithi017.stdout:1/223: truncate df/d1c/f1e 1507057 0 2024-09-20T18:35:53.905 INFO:tasks.workunit.client.1.smithi172.stdout:2/855: chown d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0 3591 1 2024-09-20T18:35:53.906 INFO:tasks.workunit.client.0.smithi017.stdout:1/224: creat df/d29/f40 x:0 0 0 2024-09-20T18:35:53.906 INFO:tasks.workunit.client.0.smithi017.stdout:1/225: stat df/d1c 0 2024-09-20T18:35:53.906 INFO:tasks.workunit.client.0.smithi017.stdout:1/226: dread - df/d16/f2e zero size 2024-09-20T18:35:53.908 INFO:tasks.workunit.client.1.smithi172.stdout:2/856: unlink d0/d2c/d3f/dab/d18/d29/d42/d4b/ca4 0 2024-09-20T18:35:53.909 INFO:tasks.workunit.client.0.smithi017.stdout:9/320: dread d6/d23/d3a/f5e [0,4194304] 0 2024-09-20T18:35:53.910 INFO:tasks.workunit.client.1.smithi172.stdout:2/857: write d0/d2c/d3f/dab/d22/d10/d3c/f6d [2470503,58004] 0 2024-09-20T18:35:53.910 INFO:tasks.workunit.client.0.smithi017.stdout:1/227: unlink df/d1c/f1f 0 2024-09-20T18:35:53.911 INFO:tasks.workunit.client.0.smithi017.stdout:9/321: truncate d6/d23/d58/d3f/d4d/f67 851622 0 2024-09-20T18:35:53.912 INFO:tasks.workunit.client.1.smithi172.stdout:2/858: write d0/d2c/d3f/dab/d18/d29/f57 [1000163,29090] 0 2024-09-20T18:35:53.913 INFO:tasks.workunit.client.0.smithi017.stdout:1/228: write df/f36 [561309,844] 0 2024-09-20T18:35:53.914 INFO:tasks.workunit.client.0.smithi017.stdout:1/229: write fc [2813382,2493] 0 2024-09-20T18:35:53.916 INFO:tasks.workunit.client.1.smithi172.stdout:2/859: mknod d0/d2c/d3f/dab/d18/d3b/c11b 0 2024-09-20T18:35:53.918 INFO:tasks.workunit.client.0.smithi017.stdout:9/322: creat d6/d23/d58/d3f/d4d/d73/d7d/f85 x:0 0 0 2024-09-20T18:35:53.920 INFO:tasks.workunit.client.0.smithi017.stdout:1/230: dread - df/f24 zero size 2024-09-20T18:35:53.921 INFO:tasks.workunit.client.1.smithi172.stdout:2/860: rename d0/d2c/d3f/dab/d22/d10/d3c/f6d to d0/d2c/d3f/dab/d22/d10/d35/dc4/df2/f11c 0 2024-09-20T18:35:53.922 INFO:tasks.workunit.client.0.smithi017.stdout:6/293: dwrite d4/f14 [4194304,4194304] 0 2024-09-20T18:35:53.922 INFO:tasks.workunit.client.1.smithi172.stdout:1/887: dread d0/f10 [0,4194304] 0 2024-09-20T18:35:53.923 INFO:tasks.workunit.client.1.smithi172.stdout:9/868: dread d15/f9e [0,4194304] 0 2024-09-20T18:35:53.928 INFO:tasks.workunit.client.1.smithi172.stdout:6/780: truncate d0/d18/d1c/d21/d26/d34/da2/dda/d7b/d7e/dd3/fd8 3329346 0 2024-09-20T18:35:53.932 INFO:tasks.workunit.client.1.smithi172.stdout:9/869: mknod d15/d1f/d88/c11b 0 2024-09-20T18:35:53.934 INFO:tasks.workunit.client.1.smithi172.stdout:6/781: dwrite d0/d18/d1c/d21/d26/d34/f82 [0,4194304] 0 2024-09-20T18:35:53.935 INFO:tasks.workunit.client.1.smithi172.stdout:9/870: mkdir d15/d1f/d88/d11c 0 2024-09-20T18:35:53.935 INFO:tasks.workunit.client.1.smithi172.stdout:8/867: sync 2024-09-20T18:35:53.936 INFO:tasks.workunit.client.0.smithi017.stdout:1/231: mknod df/d16/c41 0 2024-09-20T18:35:53.937 INFO:tasks.workunit.client.1.smithi172.stdout:8/868: dread - dd/d1b/d3b/d51/dbd/f118 zero size 2024-09-20T18:35:53.937 INFO:tasks.workunit.client.0.smithi017.stdout:9/323: creat d6/d23/d58/d3f/d2f/d5d/f86 x:0 0 0 2024-09-20T18:35:53.938 INFO:tasks.workunit.client.1.smithi172.stdout:2/861: getdents d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/d9f/d106/d9d 0 2024-09-20T18:35:53.939 INFO:tasks.workunit.client.1.smithi172.stdout:2/862: write d0/d2c/d3f/dab/d22/d10/f93 [742896,45604] 0 2024-09-20T18:35:53.942 INFO:tasks.workunit.client.0.smithi017.stdout:6/294: creat d4/df/d1f/d25/d3f/d5c/f61 x:0 0 0 2024-09-20T18:35:53.943 INFO:tasks.workunit.client.0.smithi017.stdout:6/295: chown d4/fc 5 1 2024-09-20T18:35:53.944 INFO:tasks.workunit.client.1.smithi172.stdout:7/940: write d2/f91 [755446,35853] 0 2024-09-20T18:35:53.944 INFO:tasks.workunit.client.0.smithi017.stdout:1/232: mkdir df/d29/d2c/d42 0 2024-09-20T18:35:53.946 INFO:tasks.workunit.client.1.smithi172.stdout:9/871: mknod d15/d1f/d88/d11c/c11d 0 2024-09-20T18:35:53.948 INFO:tasks.workunit.client.1.smithi172.stdout:4/922: truncate d0/de/d39/d9f/de8/f116 428640 0 2024-09-20T18:35:53.949 INFO:tasks.workunit.client.1.smithi172.stdout:2/863: dwrite d0/d2c/d3f/dab/d45/ddc/d107/f113 [0,4194304] 0 2024-09-20T18:35:53.949 INFO:tasks.workunit.client.1.smithi172.stdout:9/872: chown d15/d20/d76/fa1 53952367 1 2024-09-20T18:35:53.949 INFO:tasks.workunit.client.0.smithi017.stdout:1/233: mknod df/d3b/c43 0 2024-09-20T18:35:53.954 INFO:tasks.workunit.client.1.smithi172.stdout:8/869: mknod dd/d1b/d3b/d5d/c130 0 2024-09-20T18:35:53.955 INFO:tasks.workunit.client.1.smithi172.stdout:8/870: dread - dd/d1b/d4f/d9a/dbb/d101/f112 zero size 2024-09-20T18:35:53.956 INFO:tasks.workunit.client.1.smithi172.stdout:7/941: rmdir d2/d3/d10/d40 39 2024-09-20T18:35:53.961 INFO:tasks.workunit.client.1.smithi172.stdout:6/782: rename d0/d18/d1c/d21/d26/d34/da2/dda/d7b/d7e/dd3/fd8 to d0/d18/d1c/d21/d26/d34/d9c/f106 0 2024-09-20T18:35:53.962 INFO:tasks.workunit.client.1.smithi172.stdout:1/888: write d0/d8/f16 [3946582,98092] 0 2024-09-20T18:35:53.963 INFO:tasks.workunit.client.1.smithi172.stdout:4/923: truncate d0/de/d21/f2b 3049578 0 2024-09-20T18:35:53.963 INFO:tasks.workunit.client.0.smithi017.stdout:1/234: symlink df/d29/d2c/d42/l44 0 2024-09-20T18:35:53.965 INFO:tasks.workunit.client.0.smithi017.stdout:9/324: getdents d6/d23/d58/d3f/d4d/d73 0 2024-09-20T18:35:53.965 INFO:tasks.workunit.client.1.smithi172.stdout:6/783: read d0/d18/d1c/d21/d26/d34/d39/d46/fb4 [5793194,27342] 0 2024-09-20T18:35:53.966 INFO:tasks.workunit.client.1.smithi172.stdout:8/871: symlink dd/d1b/d4f/d9a/dbb/l131 0 2024-09-20T18:35:53.967 INFO:tasks.workunit.client.0.smithi017.stdout:6/296: link d4/l4c d4/df/d1f/d25/d3f/l62 0 2024-09-20T18:35:53.967 INFO:tasks.workunit.client.1.smithi172.stdout:8/872: readlink dd/d65/leb 0 2024-09-20T18:35:53.967 INFO:tasks.workunit.client.0.smithi017.stdout:6/297: fdatasync d4/f14 0 2024-09-20T18:35:53.968 INFO:tasks.workunit.client.1.smithi172.stdout:8/873: chown dd/d1b/d3b/d51/lb5 68 1 2024-09-20T18:35:53.968 INFO:tasks.workunit.client.0.smithi017.stdout:6/298: dread - d4/d37/d41/f54 zero size 2024-09-20T18:35:53.969 INFO:tasks.workunit.client.0.smithi017.stdout:9/325: mknod d6/d23/d40/c87 0 2024-09-20T18:35:53.971 INFO:tasks.workunit.client.0.smithi017.stdout:9/326: write d6/d23/d58/d3f/d5f/f6e [562190,57679] 0 2024-09-20T18:35:53.973 INFO:tasks.workunit.client.0.smithi017.stdout:6/299: symlink d4/d37/d41/d43/l63 0 2024-09-20T18:35:53.975 INFO:tasks.workunit.client.0.smithi017.stdout:9/327: creat d6/d23/d58/d3f/d82/f88 x:0 0 0 2024-09-20T18:35:53.977 INFO:tasks.workunit.client.1.smithi172.stdout:7/942: readlink d2/d3/d10/d40/d46/d8e/dbd/dda/l140 0 2024-09-20T18:35:53.977 INFO:tasks.workunit.client.0.smithi017.stdout:6/300: fsync d4/f9 0 2024-09-20T18:35:53.979 INFO:tasks.workunit.client.1.smithi172.stdout:7/943: chown d2/d23/d51/d10e/d72/d9b 7522770 1 2024-09-20T18:35:53.982 INFO:tasks.workunit.client.0.smithi017.stdout:6/301: truncate d4/f1e 849681 0 2024-09-20T18:35:53.982 INFO:tasks.workunit.client.1.smithi172.stdout:6/784: dread d0/fbc [0,4194304] 0 2024-09-20T18:35:53.983 INFO:tasks.workunit.client.0.smithi017.stdout:6/302: fdatasync d4/df/d1f/d25/d2b/f2c 0 2024-09-20T18:35:53.983 INFO:tasks.workunit.client.1.smithi172.stdout:9/873: dread d15/d20/d76/f84 [0,4194304] 0 2024-09-20T18:35:53.985 INFO:tasks.workunit.client.1.smithi172.stdout:2/864: dread d0/d2c/d3f/f2a [4194304,4194304] 0 2024-09-20T18:35:53.986 INFO:tasks.workunit.client.0.smithi017.stdout:9/328: creat d6/d42/f89 x:0 0 0 2024-09-20T18:35:53.986 INFO:tasks.workunit.client.1.smithi172.stdout:6/785: chown d0/d18/d1c/d21/d26/d34/d39/d46/fd2 28543267 1 2024-09-20T18:35:53.987 INFO:tasks.workunit.client.1.smithi172.stdout:6/786: write d0/d18/f2b [1352372,62649] 0 2024-09-20T18:35:53.987 INFO:tasks.workunit.client.0.smithi017.stdout:1/235: dread df/f11 [0,4194304] 0 2024-09-20T18:35:53.987 INFO:tasks.workunit.client.1.smithi172.stdout:8/874: symlink dd/d65/d85/da2/l132 0 2024-09-20T18:35:53.990 INFO:tasks.workunit.client.0.smithi017.stdout:9/329: mknod d6/d23/d58/d3f/d2f/d5d/c8a 0 2024-09-20T18:35:53.992 INFO:tasks.workunit.client.1.smithi172.stdout:1/889: mknod d0/d8/db/d25/d6d/c124 0 2024-09-20T18:35:53.992 INFO:tasks.workunit.client.0.smithi017.stdout:9/330: read - d6/d23/d58/d3f/d82/f4f zero size 2024-09-20T18:35:53.992 INFO:tasks.workunit.client.1.smithi172.stdout:8/875: truncate dd/d1b/d4f/d9a/dbb/d101/f11f 673553 0 2024-09-20T18:35:53.993 INFO:tasks.workunit.client.0.smithi017.stdout:1/236: mkdir df/d1c/d45 0 2024-09-20T18:35:53.993 INFO:tasks.workunit.client.1.smithi172.stdout:2/865: dwrite d0/dd4/f114 [0,4194304] 0 2024-09-20T18:35:53.994 INFO:tasks.workunit.client.0.smithi017.stdout:1/237: read - df/d1c/f3c zero size 2024-09-20T18:35:53.994 INFO:tasks.workunit.client.1.smithi172.stdout:8/876: chown dd/d1b/f23 37167907 1 2024-09-20T18:35:53.994 INFO:tasks.workunit.client.0.smithi017.stdout:9/331: dread - d6/d11/f3e zero size 2024-09-20T18:35:53.994 INFO:tasks.workunit.client.0.smithi017.stdout:1/238: chown df/d29/l2d 15302552 1 2024-09-20T18:35:53.995 INFO:tasks.workunit.client.1.smithi172.stdout:2/866: chown d0/d2c/d3f/dab/d22/ded/l117 7602265 1 2024-09-20T18:35:53.998 INFO:tasks.workunit.client.1.smithi172.stdout:7/944: rename d2/d3/d86/f11e to d2/d3/d11a/f141 0 2024-09-20T18:35:53.999 INFO:tasks.workunit.client.0.smithi017.stdout:9/332: mknod d6/d23/d3a/d61/c8b 0 2024-09-20T18:35:53.999 INFO:tasks.workunit.client.1.smithi172.stdout:2/867: read d0/d2c/d3f/dab/d22/d10/f93 [2520892,116278] 0 2024-09-20T18:35:54.001 INFO:tasks.workunit.client.0.smithi017.stdout:1/239: truncate df/f11 5250885 0 2024-09-20T18:35:54.002 INFO:tasks.workunit.client.1.smithi172.stdout:4/924: dwrite d0/d48/d90/d55/d101/f40 [0,4194304] 0 2024-09-20T18:35:54.004 INFO:tasks.workunit.client.1.smithi172.stdout:4/925: write d0/de/dc/d3c/d99/ffb [161250,102055] 0 2024-09-20T18:35:54.004 INFO:tasks.workunit.client.1.smithi172.stdout:1/890: mkdir d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dd5/d125 0 2024-09-20T18:35:54.006 INFO:tasks.workunit.client.1.smithi172.stdout:1/891: write d0/d8/d5f/dfb/f11c [798510,95578] 0 2024-09-20T18:35:54.007 INFO:tasks.workunit.client.0.smithi017.stdout:9/333: dwrite d6/d23/d3a/d61/f69 [0,4194304] 0 2024-09-20T18:35:54.007 INFO:tasks.workunit.client.1.smithi172.stdout:7/945: rmdir d2/d23/d51/d10e/d72/d9b 39 2024-09-20T18:35:54.010 INFO:tasks.workunit.client.0.smithi017.stdout:1/240: dwrite df/d29/f40 [0,4194304] 0 2024-09-20T18:35:54.011 INFO:tasks.workunit.client.1.smithi172.stdout:2/868: creat d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/f11d x:0 0 0 2024-09-20T18:35:54.013 INFO:tasks.workunit.client.1.smithi172.stdout:4/926: creat d0/de/dc/d3c/f142 x:0 0 0 2024-09-20T18:35:54.015 INFO:tasks.workunit.client.1.smithi172.stdout:1/892: creat d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dd5/d125/f126 x:0 0 0 2024-09-20T18:35:54.015 INFO:tasks.workunit.client.0.smithi017.stdout:1/241: mknod df/d29/d2c/c46 0 2024-09-20T18:35:54.016 INFO:tasks.workunit.client.1.smithi172.stdout:9/874: dread d15/d20/d76/ff2 [0,4194304] 0 2024-09-20T18:35:54.016 INFO:tasks.workunit.client.0.smithi017.stdout:1/242: fdatasync df/d29/f3a 0 2024-09-20T18:35:54.018 INFO:tasks.workunit.client.0.smithi017.stdout:9/334: getdents d6/d23/d58/d3f/d82 0 2024-09-20T18:35:54.020 INFO:tasks.workunit.client.1.smithi172.stdout:1/893: creat d0/d8/d5f/d113/f127 x:0 0 0 2024-09-20T18:35:54.021 INFO:tasks.workunit.client.0.smithi017.stdout:1/243: symlink df/d3b/l47 0 2024-09-20T18:35:54.021 INFO:tasks.workunit.client.0.smithi017.stdout:1/244: readlink df/l12 0 2024-09-20T18:35:54.022 INFO:tasks.workunit.client.0.smithi017.stdout:9/335: readlink d6/d23/d40/l83 0 2024-09-20T18:35:54.025 INFO:tasks.workunit.client.0.smithi017.stdout:9/336: write d6/d23/d58/d3f/d82/f33 [4132983,62202] 0 2024-09-20T18:35:54.026 INFO:tasks.workunit.client.1.smithi172.stdout:9/875: creat d15/d1a/d6f/d7a/f11e x:0 0 0 2024-09-20T18:35:54.027 INFO:tasks.workunit.client.1.smithi172.stdout:4/927: dwrite d0/de/dc/d3c/f138 [0,4194304] 0 2024-09-20T18:35:54.028 INFO:tasks.workunit.client.1.smithi172.stdout:2/869: dread d0/d2c/d3f/dab/d22/d10/d35/d5d/f64 [0,4194304] 0 2024-09-20T18:35:54.028 INFO:tasks.workunit.client.0.smithi017.stdout:9/337: write d6/d23/d58/d3f/d82/f88 [15047,58779] 0 2024-09-20T18:35:54.030 INFO:tasks.workunit.client.1.smithi172.stdout:1/894: symlink d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dcf/l128 0 2024-09-20T18:35:54.031 INFO:tasks.workunit.client.0.smithi017.stdout:1/245: dwrite df/d29/f3a [0,4194304] 0 2024-09-20T18:35:54.032 INFO:tasks.workunit.client.0.smithi017.stdout:9/338: fsync d6/d23/d58/d3f/d2f/d5d/f86 0 2024-09-20T18:35:54.032 INFO:tasks.workunit.client.1.smithi172.stdout:4/928: truncate d0/d48/d90/d55/d101/fff 4359643 0 2024-09-20T18:35:54.034 INFO:tasks.workunit.client.1.smithi172.stdout:8/877: write dd/d1b/d3b/d51/d5b/fa5 [1241984,125386] 0 2024-09-20T18:35:54.035 INFO:tasks.workunit.client.1.smithi172.stdout:4/929: chown d0/de/d39/cee 191452 1 2024-09-20T18:35:54.036 INFO:tasks.workunit.client.0.smithi017.stdout:1/246: symlink df/d35/l48 0 2024-09-20T18:35:54.038 INFO:tasks.workunit.client.0.smithi017.stdout:9/339: creat d6/d23/d58/d3f/d5f/f8c x:0 0 0 2024-09-20T18:35:54.039 INFO:tasks.workunit.client.0.smithi017.stdout:9/340: read - d6/d23/d3a/f7b zero size 2024-09-20T18:35:54.039 INFO:tasks.workunit.client.1.smithi172.stdout:9/876: getdents d15/d1a/d64 0 2024-09-20T18:35:54.040 INFO:tasks.workunit.client.0.smithi017.stdout:1/247: truncate df/d29/d2c/f3f 75682 0 2024-09-20T18:35:54.041 INFO:tasks.workunit.client.0.smithi017.stdout:9/341: fdatasync d6/d23/d3a/f5e 0 2024-09-20T18:35:54.043 INFO:tasks.workunit.client.0.smithi017.stdout:9/342: creat d6/d23/d58/d3f/d5f/f8d x:0 0 0 2024-09-20T18:35:54.044 INFO:tasks.workunit.client.0.smithi017.stdout:9/343: chown d6/d23/d40/c52 1 1 2024-09-20T18:35:54.044 INFO:tasks.workunit.client.0.smithi017.stdout:9/344: chown d6/d23/f6d 12522 1 2024-09-20T18:35:54.046 INFO:tasks.workunit.client.0.smithi017.stdout:9/345: write d6/d23/d3a/f7b [975248,43787] 0 2024-09-20T18:35:54.049 INFO:tasks.workunit.client.1.smithi172.stdout:3/946: sync 2024-09-20T18:35:54.049 INFO:tasks.workunit.client.1.smithi172.stdout:4/930: link d0/d48/d90/d55/d101/f70 d0/d48/d90/d55/f143 0 2024-09-20T18:35:54.049 INFO:tasks.workunit.client.1.smithi172.stdout:7/946: dread d2/d3/fb [0,4194304] 0 2024-09-20T18:35:54.050 INFO:tasks.workunit.client.1.smithi172.stdout:8/878: dwrite dd/d1b/d3b/dc7/ffd [0,4194304] 0 2024-09-20T18:35:54.051 INFO:tasks.workunit.client.1.smithi172.stdout:9/877: rename d15/d1f/d2c/d7d/d58/cac to d15/d1f/d2c/d6e/c11f 0 2024-09-20T18:35:54.053 INFO:tasks.workunit.client.0.smithi017.stdout:9/346: dwrite d6/f37 [0,4194304] 0 2024-09-20T18:35:54.054 INFO:tasks.workunit.client.1.smithi172.stdout:8/879: chown dd/c28 448 1 2024-09-20T18:35:54.056 INFO:tasks.workunit.client.1.smithi172.stdout:3/947: read d0/dc/d6a/d22/fa9 [2772406,81984] 0 2024-09-20T18:35:54.057 INFO:tasks.workunit.client.1.smithi172.stdout:3/948: dread - d0/d13/d58/d6d/db9/dd6/d101/f112 zero size 2024-09-20T18:35:54.058 INFO:tasks.workunit.client.0.smithi017.stdout:9/347: dread d6/d23/d3a/f7b [0,4194304] 0 2024-09-20T18:35:54.058 INFO:tasks.workunit.client.0.smithi017.stdout:1/248: getdents df/d29/d2c 0 2024-09-20T18:35:54.062 INFO:tasks.workunit.client.1.smithi172.stdout:7/947: fdatasync d2/d3/dd/f4c 0 2024-09-20T18:35:54.063 INFO:tasks.workunit.client.0.smithi017.stdout:1/249: symlink df/d35/l49 0 2024-09-20T18:35:54.066 INFO:tasks.workunit.client.1.smithi172.stdout:3/949: dwrite d0/d13/d58/d6d/d7f/f9f [0,4194304] 0 2024-09-20T18:35:54.066 INFO:tasks.workunit.client.0.smithi017.stdout:9/348: creat d6/d23/d58/d3f/d2f/f8e x:0 0 0 2024-09-20T18:35:54.073 INFO:tasks.workunit.client.0.smithi017.stdout:1/250: truncate df/f26 1462831 0 2024-09-20T18:35:54.075 INFO:tasks.workunit.client.1.smithi172.stdout:3/950: dwrite d0/d13/d32/d123/f12e [0,4194304] 0 2024-09-20T18:35:54.075 INFO:tasks.workunit.client.0.smithi017.stdout:9/349: mkdir d6/d23/d58/d3f/d4d/d73/d8f 0 2024-09-20T18:35:54.079 INFO:tasks.workunit.client.1.smithi172.stdout:2/870: dwrite d0/d2c/d3f/dab/d22/f38 [0,4194304] 0 2024-09-20T18:35:54.080 INFO:tasks.workunit.client.1.smithi172.stdout:2/871: stat d0/d2c/d3f/dab/d18/d29/c34 0 2024-09-20T18:35:54.083 INFO:tasks.workunit.client.0.smithi017.stdout:1/251: dread df/d1c/f1e [0,4194304] 0 2024-09-20T18:35:54.090 INFO:tasks.workunit.client.1.smithi172.stdout:3/951: rename d0/d13/d58/d6d/db9/dd6/d101/f112 to d0/d13/d58/d6d/d7f/d84/dd9/d117/f141 0 2024-09-20T18:35:54.093 INFO:tasks.workunit.client.1.smithi172.stdout:8/880: getdents dd/d1b 0 2024-09-20T18:35:54.095 INFO:tasks.workunit.client.1.smithi172.stdout:9/878: write d15/d1a/f28 [3351356,122997] 0 2024-09-20T18:35:54.097 INFO:tasks.workunit.client.1.smithi172.stdout:2/872: fsync d0/d2c/d3f/fd 0 2024-09-20T18:35:54.097 INFO:tasks.workunit.client.0.smithi017.stdout:9/350: dread d6/d23/d58/d3f/d82/f20 [0,4194304] 0 2024-09-20T18:35:54.098 INFO:tasks.workunit.client.1.smithi172.stdout:3/952: read d0/d13/d58/d6d/d7f/d84/fec [441404,58873] 0 2024-09-20T18:35:54.100 INFO:tasks.workunit.client.0.smithi017.stdout:9/351: mknod d6/d23/d58/d3f/d2f/d5d/c90 0 2024-09-20T18:35:54.100 INFO:tasks.workunit.client.1.smithi172.stdout:3/953: stat d0/d13/d32/c8e 0 2024-09-20T18:35:54.101 INFO:tasks.workunit.client.1.smithi172.stdout:8/881: read dd/d1b/d3b/d51/f2e [3484426,42639] 0 2024-09-20T18:35:54.101 INFO:tasks.workunit.client.1.smithi172.stdout:2/873: readlink d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/lb6 0 2024-09-20T18:35:54.103 INFO:tasks.workunit.client.1.smithi172.stdout:8/882: write dd/d1b/d3b/d51/d5b/fa5 [1298054,62502] 0 2024-09-20T18:35:54.106 INFO:tasks.workunit.client.1.smithi172.stdout:9/879: truncate d15/d1f/d2c/d7d/d34/db5/ded/ffa 785961 0 2024-09-20T18:35:54.109 INFO:tasks.workunit.client.1.smithi172.stdout:2/874: dwrite d0/d90/f105 [0,4194304] 0 2024-09-20T18:35:54.110 INFO:tasks.workunit.client.1.smithi172.stdout:9/880: creat d15/d1f/d2c/d7d/d34/db5/ded/f120 x:0 0 0 2024-09-20T18:35:54.112 INFO:tasks.workunit.client.1.smithi172.stdout:3/954: dwrite d0/d13/d32/f9b [0,4194304] 0 2024-09-20T18:35:54.115 INFO:tasks.workunit.client.1.smithi172.stdout:9/881: unlink d15/d4a/d8c/ld3 0 2024-09-20T18:35:54.115 INFO:tasks.workunit.client.1.smithi172.stdout:3/955: write d0/dc/d6a/d3a/fdd [809531,7950] 0 2024-09-20T18:35:54.120 INFO:tasks.workunit.client.1.smithi172.stdout:9/882: write d15/d1a/dfb/fb9 [1199206,45503] 0 2024-09-20T18:35:54.120 INFO:tasks.workunit.client.0.smithi017.stdout:9/352: write d6/d23/d3a/d61/f78 [2300583,122213] 0 2024-09-20T18:35:54.122 INFO:tasks.workunit.client.1.smithi172.stdout:9/883: fsync d15/d1f/d2c/d7d/d48/df0/ff8 0 2024-09-20T18:35:54.123 INFO:tasks.workunit.client.1.smithi172.stdout:2/875: dwrite d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/d9f/d106/fa1 [0,4194304] 0 2024-09-20T18:35:54.123 INFO:tasks.workunit.client.1.smithi172.stdout:3/956: fsync d0/d13/d32/d54/d83/dbb/f11a 0 2024-09-20T18:35:54.125 INFO:tasks.workunit.client.1.smithi172.stdout:3/957: chown d0/d13/d1e/c91 109786263 1 2024-09-20T18:35:54.125 INFO:tasks.workunit.client.1.smithi172.stdout:2/876: write d0/d1a/d58/f78 [604471,34425] 0 2024-09-20T18:35:54.129 INFO:tasks.workunit.client.1.smithi172.stdout:2/877: rename d0/d2c/d51/ldb to d0/d2c/d3f/dab/d45/ddc/d107/l11e 0 2024-09-20T18:35:54.130 INFO:tasks.workunit.client.1.smithi172.stdout:9/884: dwrite d15/d1a/f28 [0,4194304] 0 2024-09-20T18:35:54.131 INFO:tasks.workunit.client.1.smithi172.stdout:5/921: sync 2024-09-20T18:35:54.132 INFO:tasks.workunit.client.1.smithi172.stdout:2/878: truncate d0/f3 3899504 0 2024-09-20T18:35:54.134 INFO:tasks.workunit.client.1.smithi172.stdout:9/885: creat d15/f121 x:0 0 0 2024-09-20T18:35:54.134 INFO:tasks.workunit.client.1.smithi172.stdout:5/922: fdatasync d4/df/dad/fa4 0 2024-09-20T18:35:54.135 INFO:tasks.workunit.client.1.smithi172.stdout:2/879: mknod d0/d2c/d51/c11f 0 2024-09-20T18:35:54.136 INFO:tasks.workunit.client.1.smithi172.stdout:9/886: write f6 [2478228,35703] 0 2024-09-20T18:35:54.136 INFO:tasks.workunit.client.1.smithi172.stdout:3/958: dread d0/f8 [0,4194304] 0 2024-09-20T18:35:54.141 INFO:tasks.workunit.client.1.smithi172.stdout:3/959: mknod d0/d13/d32/d54/d83/dbb/c142 0 2024-09-20T18:35:54.142 INFO:tasks.workunit.client.1.smithi172.stdout:5/923: symlink d4/df/dad/d26/d41/d69/dac/d2c/l12d 0 2024-09-20T18:35:54.144 INFO:tasks.workunit.client.1.smithi172.stdout:3/960: creat d0/d13/d58/f143 x:0 0 0 2024-09-20T18:35:54.145 INFO:tasks.workunit.client.1.smithi172.stdout:2/880: write d0/d2c/d3f/dab/d22/d10/d35/d5d/f5f [7547366,71793] 0 2024-09-20T18:35:54.146 INFO:tasks.workunit.client.1.smithi172.stdout:5/924: write d4/df/dad/f10f [1657010,2131] 0 2024-09-20T18:35:54.148 INFO:tasks.workunit.client.1.smithi172.stdout:3/961: symlink d0/d13/d32/d54/d83/l144 0 2024-09-20T18:35:54.149 INFO:tasks.workunit.client.1.smithi172.stdout:5/925: unlink d4/df/dad/d26/d41/d69/dac/f33 0 2024-09-20T18:35:54.153 INFO:tasks.workunit.client.1.smithi172.stdout:5/926: unlink d4/df/dad/d26/d41/d65/d8f/fc9 0 2024-09-20T18:35:54.153 INFO:tasks.workunit.client.1.smithi172.stdout:3/962: link d0/f62 d0/d13/d58/d6d/db9/de0/f145 0 2024-09-20T18:35:54.153 INFO:tasks.workunit.client.1.smithi172.stdout:5/927: dread - d4/df/dad/dd4/ff2 zero size 2024-09-20T18:35:54.155 INFO:tasks.workunit.client.1.smithi172.stdout:5/928: dread - d4/df/d3f/d64/d101/d63/f111 zero size 2024-09-20T18:35:54.157 INFO:tasks.workunit.client.1.smithi172.stdout:3/963: link d0/dc/d6a/d22/l13e d0/d13/d58/d6d/d7f/d84/l146 0 2024-09-20T18:35:54.159 INFO:tasks.workunit.client.1.smithi172.stdout:5/929: rename d4/df/d3f/d64/d101/fbc to d4/df/dad/d26/d41/d69/dac/d2c/f12e 0 2024-09-20T18:35:54.162 INFO:tasks.workunit.client.1.smithi172.stdout:5/930: creat d4/df/dad/d26/d41/d69/db9/f12f x:0 0 0 2024-09-20T18:35:54.163 INFO:tasks.workunit.client.1.smithi172.stdout:3/964: dwrite d0/d13/d32/d54/d71/f9c [4194304,4194304] 0 2024-09-20T18:35:54.166 INFO:tasks.workunit.client.1.smithi172.stdout:3/965: dread - d0/d13/d58/d6d/d7f/d84/dd9/f129 zero size 2024-09-20T18:35:54.171 INFO:tasks.workunit.client.1.smithi172.stdout:5/931: dwrite d4/df/d3f/d64/d101/d86/ff8 [0,4194304] 0 2024-09-20T18:35:54.176 INFO:tasks.workunit.client.1.smithi172.stdout:5/932: creat d4/df/dad/d26/d41/d69/db9/f130 x:0 0 0 2024-09-20T18:35:54.178 INFO:tasks.workunit.client.1.smithi172.stdout:3/966: write d0/d13/d32/d54/d83/dbb/f11a [394191,122379] 0 2024-09-20T18:35:54.178 INFO:tasks.workunit.client.0.smithi017.stdout:9/353: write d6/d23/d58/d3f/d44/f47 [999680,91610] 0 2024-09-20T18:35:54.179 INFO:tasks.workunit.client.1.smithi172.stdout:5/933: rename d4 to d4/df/dad/d26/d11d/d131 22 2024-09-20T18:35:54.180 INFO:tasks.workunit.client.1.smithi172.stdout:5/934: fsync d4/df/d106/f11e 0 2024-09-20T18:35:54.181 INFO:tasks.workunit.client.0.smithi017.stdout:9/354: creat d6/d23/d58/d3f/f91 x:0 0 0 2024-09-20T18:35:54.183 INFO:tasks.workunit.client.1.smithi172.stdout:3/967: mkdir d0/dc/d6a/d3a/d74/d147 0 2024-09-20T18:35:54.187 INFO:tasks.workunit.client.1.smithi172.stdout:5/935: creat d4/df/dad/d26/d41/d69/dac/da7/dd8/f132 x:0 0 0 2024-09-20T18:35:54.188 INFO:tasks.workunit.client.0.smithi017.stdout:9/355: dwrite d6/fb [4194304,4194304] 0 2024-09-20T18:35:54.188 INFO:tasks.workunit.client.1.smithi172.stdout:5/936: chown d4/df/dad/d26/d41/d69/dac/f5d 1 1 2024-09-20T18:35:54.189 INFO:tasks.workunit.client.1.smithi172.stdout:3/968: creat d0/d13/d32/d54/d71/f148 x:0 0 0 2024-09-20T18:35:54.190 INFO:tasks.workunit.client.0.smithi017.stdout:9/356: chown d6/d23/d58/d3f/d5f/f65 3247554 1 2024-09-20T18:35:54.192 INFO:tasks.workunit.client.1.smithi172.stdout:5/937: mkdir d4/df/dad/d26/d41/d69/db9/d133 0 2024-09-20T18:35:54.192 INFO:tasks.workunit.client.0.smithi017.stdout:9/357: fsync d6/d23/f71 0 2024-09-20T18:35:54.194 INFO:tasks.workunit.client.0.smithi017.stdout:9/358: write d6/d23/d58/d3f/d5f/f84 [307859,22226] 0 2024-09-20T18:35:54.195 INFO:tasks.workunit.client.0.smithi017.stdout:9/359: fdatasync d6/d23/d58/d3f/d5f/f8d 0 2024-09-20T18:35:54.197 INFO:tasks.workunit.client.0.smithi017.stdout:9/360: chown d6/d23/d58/d3f/d2f/d5d/f56 260 1 2024-09-20T18:35:54.197 INFO:tasks.workunit.client.1.smithi172.stdout:3/969: link d0/d13/d32/d123/f138 d0/d13/d1e/f149 0 2024-09-20T18:35:54.198 INFO:tasks.workunit.client.0.smithi017.stdout:9/361: write d6/d23/d58/f57 [4991470,124624] 0 2024-09-20T18:35:54.199 INFO:tasks.workunit.client.1.smithi172.stdout:9/887: dwrite d15/d4a/f80 [4194304,4194304] 0 2024-09-20T18:35:54.199 INFO:tasks.workunit.client.1.smithi172.stdout:1/895: sync 2024-09-20T18:35:54.200 INFO:tasks.workunit.client.1.smithi172.stdout:6/787: sync 2024-09-20T18:35:54.200 INFO:tasks.workunit.client.1.smithi172.stdout:4/931: sync 2024-09-20T18:35:54.200 INFO:tasks.workunit.client.1.smithi172.stdout:5/938: mknod d4/df/dad/d26/d41/d69/dac/da7/c134 0 2024-09-20T18:35:54.205 INFO:tasks.workunit.client.1.smithi172.stdout:5/939: read d4/df/d3f/d64/d101/d63/d80/fa8 [1367996,79035] 0 2024-09-20T18:35:54.206 INFO:tasks.workunit.client.1.smithi172.stdout:3/970: rename d0/d13/d32/c35 to d0/dc/d6a/d3a/d74/c14a 0 2024-09-20T18:35:54.218 INFO:tasks.workunit.client.1.smithi172.stdout:4/932: fsync d0/d48/d90/d55/f143 0 2024-09-20T18:35:54.219 INFO:tasks.workunit.client.1.smithi172.stdout:5/940: dread - d4/df/dad/d26/d41/d65/d8f/f110 zero size 2024-09-20T18:35:54.221 INFO:tasks.workunit.client.1.smithi172.stdout:6/788: dwrite d0/d18/d1c/d21/d26/d34/d39/d74/dbf/fb6 [0,4194304] 0 2024-09-20T18:35:54.221 INFO:tasks.workunit.client.1.smithi172.stdout:5/941: chown d4/df/dad/d26/d41/d69/db9/f12f 1330 1 2024-09-20T18:35:54.226 INFO:tasks.workunit.client.1.smithi172.stdout:6/789: dread d0/d18/daf/fc8 [0,4194304] 0 2024-09-20T18:35:54.227 INFO:tasks.workunit.client.1.smithi172.stdout:6/790: stat d0/d18/d1c/d21/d26/d34/d7a/d99 0 2024-09-20T18:35:54.228 INFO:tasks.workunit.client.1.smithi172.stdout:6/791: readlink d0/d18/d1c/d21/d26/d34/l8d 0 2024-09-20T18:35:54.238 INFO:tasks.workunit.client.1.smithi172.stdout:5/942: symlink d4/df/d3f/d64/d101/dce/dd9/l135 0 2024-09-20T18:35:54.238 INFO:tasks.workunit.client.1.smithi172.stdout:6/792: symlink d0/d18/d1c/d21/d26/d34/d7a/d99/l107 0 2024-09-20T18:35:54.239 INFO:tasks.workunit.client.1.smithi172.stdout:6/793: chown d0/d18/d1c/d21/d26/d34/d39/d74 2 1 2024-09-20T18:35:54.240 INFO:tasks.workunit.client.1.smithi172.stdout:4/933: mkdir d0/d144 0 2024-09-20T18:35:54.241 INFO:tasks.workunit.client.1.smithi172.stdout:3/971: creat d0/d13/d32/f14b x:0 0 0 2024-09-20T18:35:54.242 INFO:tasks.workunit.client.1.smithi172.stdout:5/943: unlink d4/df/d3f/d64/d101/d63/d80/l93 0 2024-09-20T18:35:54.242 INFO:tasks.workunit.client.1.smithi172.stdout:1/896: getdents d0/d8/db/d25/d2b/d3d/d65/d93/dbb/dd3 0 2024-09-20T18:35:54.244 INFO:tasks.workunit.client.1.smithi172.stdout:4/934: fsync d0/d7/f62 0 2024-09-20T18:35:54.246 INFO:tasks.workunit.client.1.smithi172.stdout:1/897: rmdir d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dd5 39 2024-09-20T18:35:54.246 INFO:tasks.workunit.client.1.smithi172.stdout:1/898: chown d0/c7 38036 1 2024-09-20T18:35:54.247 INFO:tasks.workunit.client.1.smithi172.stdout:6/794: creat d0/d18/d1c/d21/d26/d34/d7a/f108 x:0 0 0 2024-09-20T18:35:54.249 INFO:tasks.workunit.client.1.smithi172.stdout:5/944: rename d4/df/d3f/d64/d101/d63/d80/l83 to d4/df/d3f/l136 0 2024-09-20T18:35:54.250 INFO:tasks.workunit.client.1.smithi172.stdout:1/899: stat d0/d8/db/fa5 0 2024-09-20T18:35:54.251 INFO:tasks.workunit.client.1.smithi172.stdout:6/795: creat d0/d18/d1c/d21/d26/d34/da2/dda/d7b/f109 x:0 0 0 2024-09-20T18:35:54.252 INFO:tasks.workunit.client.1.smithi172.stdout:4/935: rename d0/d48/d90/db4/ded to d0/d48/d90/d55/d53/d5c/d10e/d145 0 2024-09-20T18:35:54.254 INFO:tasks.workunit.client.1.smithi172.stdout:6/796: fdatasync d0/d18/d1c/d21/d26/d34/da2/def/dff/f8f 0 2024-09-20T18:35:54.257 INFO:tasks.workunit.client.1.smithi172.stdout:1/900: symlink d0/d8/d5f/d113/l129 0 2024-09-20T18:35:54.258 INFO:tasks.workunit.client.1.smithi172.stdout:1/901: chown d0/d8/db/d25/d2b/db6/fcc 7854 1 2024-09-20T18:35:54.261 INFO:tasks.workunit.client.1.smithi172.stdout:4/936: rename d0/d48/d90/d55/d53/d5c/d10e/d145/c102 to d0/de/d39/d9f/de8/c146 0 2024-09-20T18:35:54.263 INFO:tasks.workunit.client.1.smithi172.stdout:4/937: dread d0/de/d39/d9f/fe5 [0,4194304] 0 2024-09-20T18:35:54.265 INFO:tasks.workunit.client.1.smithi172.stdout:6/797: dread d0/d18/d1c/d21/d26/f5f [0,4194304] 0 2024-09-20T18:35:54.265 INFO:tasks.workunit.client.1.smithi172.stdout:4/938: fsync d0/de/dc/d3c/f5f 0 2024-09-20T18:35:54.266 INFO:tasks.workunit.client.1.smithi172.stdout:4/939: read - d0/de/d21/dc7/f137 zero size 2024-09-20T18:35:54.272 INFO:tasks.workunit.client.1.smithi172.stdout:4/940: getdents d0/d48/d90/d55/d53/d5c 0 2024-09-20T18:35:54.278 INFO:tasks.workunit.client.1.smithi172.stdout:3/972: dwrite d0/dc/f28 [0,4194304] 0 2024-09-20T18:35:54.282 INFO:tasks.workunit.client.1.smithi172.stdout:3/973: unlink d0/d13/db2/fdc 0 2024-09-20T18:35:54.286 INFO:tasks.workunit.client.1.smithi172.stdout:4/941: write d0/d48/d90/d55/d101/ff2 [733944,118248] 0 2024-09-20T18:35:54.288 INFO:tasks.workunit.client.1.smithi172.stdout:3/974: creat d0/d13/d32/d88/dc2/f14c x:0 0 0 2024-09-20T18:35:54.288 INFO:tasks.workunit.client.1.smithi172.stdout:1/902: mkdir d0/d8/d5f/d113/d96/d12a 0 2024-09-20T18:35:54.290 INFO:tasks.workunit.client.1.smithi172.stdout:6/798: dwrite d0/d18/f43 [0,4194304] 0 2024-09-20T18:35:54.291 INFO:tasks.workunit.client.1.smithi172.stdout:1/903: write d0/d8/db/f33 [3785466,21774] 0 2024-09-20T18:35:54.293 INFO:tasks.workunit.client.1.smithi172.stdout:3/975: mknod d0/d13/d58/d6d/db9/c14d 0 2024-09-20T18:35:54.296 INFO:tasks.workunit.client.1.smithi172.stdout:4/942: rename d0/d48/d90/d55/d101/f5d to d0/d48/d90/d55/d53/d5c/d11d/df8/f147 0 2024-09-20T18:35:54.300 INFO:tasks.workunit.client.1.smithi172.stdout:6/799: creat d0/d18/d1c/d21/d26/d34/da2/f10a x:0 0 0 2024-09-20T18:35:54.300 INFO:tasks.workunit.client.1.smithi172.stdout:7/948: sync 2024-09-20T18:35:54.301 INFO:tasks.workunit.client.1.smithi172.stdout:7/949: read - d2/de7/f111 zero size 2024-09-20T18:35:54.302 INFO:tasks.workunit.client.1.smithi172.stdout:3/976: dwrite d0/dc/d6a/f5b [0,4194304] 0 2024-09-20T18:35:54.303 INFO:tasks.workunit.client.1.smithi172.stdout:6/800: unlink d0/d18/d1c/d21/d26/d34/d6b/d7d/c2d 0 2024-09-20T18:35:54.305 INFO:tasks.workunit.client.1.smithi172.stdout:7/950: creat d2/d23/d51/f142 x:0 0 0 2024-09-20T18:35:54.307 INFO:tasks.workunit.client.1.smithi172.stdout:3/977: unlink d0/d13/d32/d54/d71/la4 0 2024-09-20T18:35:54.309 INFO:tasks.workunit.client.1.smithi172.stdout:6/801: write d0/d18/d1c/fb8 [827027,106228] 0 2024-09-20T18:35:54.312 INFO:tasks.workunit.client.1.smithi172.stdout:1/904: dwrite d0/d22/f23 [0,4194304] 0 2024-09-20T18:35:54.313 INFO:tasks.workunit.client.1.smithi172.stdout:6/802: chown d0/d18/d1c/d21/d26/d34/f3e 10293 1 2024-09-20T18:35:54.313 INFO:tasks.workunit.client.1.smithi172.stdout:3/978: mkdir d0/d13/d32/d54/d14e 0 2024-09-20T18:35:54.313 INFO:tasks.workunit.client.1.smithi172.stdout:7/951: dread d2/d3/d10/d40/d46/fa8 [0,4194304] 0 2024-09-20T18:35:54.315 INFO:tasks.workunit.client.0.smithi017.stdout:3/425: sync 2024-09-20T18:35:54.315 INFO:tasks.workunit.client.1.smithi172.stdout:1/905: write d0/d8/db/d25/d2b/d3d/d104/f10a [79585,47134] 0 2024-09-20T18:35:54.316 INFO:tasks.workunit.client.0.smithi017.stdout:3/426: dread - da/f74 zero size 2024-09-20T18:35:54.319 INFO:tasks.workunit.client.1.smithi172.stdout:1/906: read - d0/d8/db/d25/d2b/d3d/d65/d93/f120 zero size 2024-09-20T18:35:54.320 INFO:tasks.workunit.client.0.smithi017.stdout:3/427: rmdir da/de/d13/d2f/d26 39 2024-09-20T18:35:54.321 INFO:tasks.workunit.client.1.smithi172.stdout:7/952: dread d2/d23/d51/d10e/f71 [0,4194304] 0 2024-09-20T18:35:54.322 INFO:tasks.workunit.client.1.smithi172.stdout:6/803: rename d0/d18/d1c/d21/ff5 to d0/d18/d1c/d21/d26/d34/da2/dda/d7b/d7e/dd3/f10b 0 2024-09-20T18:35:54.329 INFO:tasks.workunit.client.1.smithi172.stdout:1/907: symlink d0/d8/db/d25/d6d/l12b 0 2024-09-20T18:35:54.331 INFO:tasks.workunit.client.1.smithi172.stdout:6/804: creat d0/d18/d1c/d21/d26/f10c x:0 0 0 2024-09-20T18:35:54.332 INFO:tasks.workunit.client.0.smithi017.stdout:3/428: getdents da/de/d13 0 2024-09-20T18:35:54.333 INFO:tasks.workunit.client.1.smithi172.stdout:7/953: mkdir d2/d23/d51/d10e/d72/d9b/d103/d143 0 2024-09-20T18:35:54.336 INFO:tasks.workunit.client.1.smithi172.stdout:6/805: symlink d0/d18/d1c/d21/d26/d34/d7a/d99/l10d 0 2024-09-20T18:35:54.337 INFO:tasks.workunit.client.1.smithi172.stdout:6/806: chown d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0/dad 385587 1 2024-09-20T18:35:54.338 INFO:tasks.workunit.client.0.smithi017.stdout:3/429: dwrite da/de/d53/d52/f80 [0,4194304] 0 2024-09-20T18:35:54.339 INFO:tasks.workunit.client.1.smithi172.stdout:1/908: mkdir d0/d12c 0 2024-09-20T18:35:54.342 INFO:tasks.workunit.client.0.smithi017.stdout:3/430: unlink da/de/l2a 0 2024-09-20T18:35:54.343 INFO:tasks.workunit.client.1.smithi172.stdout:3/979: dwrite d0/d13/d58/d6d/db9/fb4 [0,4194304] 0 2024-09-20T18:35:54.346 INFO:tasks.workunit.client.0.smithi017.stdout:3/431: creat da/de/f8e x:0 0 0 2024-09-20T18:35:54.348 INFO:tasks.workunit.client.1.smithi172.stdout:1/909: mkdir d0/d8/db/d25/d2b/db6/d119/d12d 0 2024-09-20T18:35:54.349 INFO:tasks.workunit.client.1.smithi172.stdout:1/910: fdatasync d0/d8/d5f/d113/d96/fd4 0 2024-09-20T18:35:54.351 INFO:tasks.workunit.client.1.smithi172.stdout:9/888: sync 2024-09-20T18:35:54.351 INFO:tasks.workunit.client.1.smithi172.stdout:8/883: sync 2024-09-20T18:35:54.351 INFO:tasks.workunit.client.1.smithi172.stdout:2/881: sync 2024-09-20T18:35:54.353 INFO:tasks.workunit.client.1.smithi172.stdout:9/889: readlink d15/d1f/d2c/lec 0 2024-09-20T18:35:54.357 INFO:tasks.workunit.client.1.smithi172.stdout:7/954: dwrite d2/f47 [0,4194304] 0 2024-09-20T18:35:54.358 INFO:tasks.workunit.client.1.smithi172.stdout:1/911: unlink d0/d8/db/d39/f42 0 2024-09-20T18:35:54.359 INFO:tasks.workunit.client.1.smithi172.stdout:7/955: read d2/d3/f35 [583462,12428] 0 2024-09-20T18:35:54.360 INFO:tasks.workunit.client.0.smithi017.stdout:3/432: getdents da/de/d13 0 2024-09-20T18:35:54.361 INFO:tasks.workunit.client.1.smithi172.stdout:6/807: dwrite d0/d18/d1c/d21/d26/f60 [0,4194304] 0 2024-09-20T18:35:54.361 INFO:tasks.workunit.client.1.smithi172.stdout:9/890: readlink d15/d1a/d8d/lc0 0 2024-09-20T18:35:54.364 INFO:tasks.workunit.client.1.smithi172.stdout:9/891: truncate d15/d1f/d2c/d7d/d34/db5/ded/ffa 1133599 0 2024-09-20T18:35:54.365 INFO:tasks.workunit.client.0.smithi017.stdout:3/433: readlink da/de/d13/d2f/d26/d31/d5a/d76/d19/l46 0 2024-09-20T18:35:54.366 INFO:tasks.workunit.client.0.smithi017.stdout:3/434: readlink da/de/d13/d2f/d26/d31/l4a 0 2024-09-20T18:35:54.368 INFO:tasks.workunit.client.0.smithi017.stdout:3/435: dread da/de/d13/d2f/f60 [0,4194304] 0 2024-09-20T18:35:54.370 INFO:tasks.workunit.client.0.smithi017.stdout:3/436: write da/de/d13/d16/f22 [1625119,107216] 0 2024-09-20T18:35:54.372 INFO:tasks.workunit.client.1.smithi172.stdout:3/980: creat d0/dc/d6a/d3a/f14f x:0 0 0 2024-09-20T18:35:54.372 INFO:tasks.workunit.client.1.smithi172.stdout:2/882: creat d0/d2c/d51/de5/dec/f120 x:0 0 0 2024-09-20T18:35:54.373 INFO:tasks.workunit.client.1.smithi172.stdout:7/956: mkdir d2/d3/d3d/d4e/d5f/d144 0 2024-09-20T18:35:54.373 INFO:tasks.workunit.client.1.smithi172.stdout:1/912: chown d0/d8/db/d25/d6f/d11f 490 1 2024-09-20T18:35:54.374 INFO:tasks.workunit.client.1.smithi172.stdout:9/892: creat d15/d4a/d8c/f122 x:0 0 0 2024-09-20T18:35:54.374 INFO:tasks.workunit.client.1.smithi172.stdout:1/913: chown d0/d73/l67 35738284 1 2024-09-20T18:35:54.376 INFO:tasks.workunit.client.1.smithi172.stdout:1/914: fsync d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/fcb 0 2024-09-20T18:35:54.381 INFO:tasks.workunit.client.1.smithi172.stdout:2/883: mknod d0/d2c/d51/de5/dec/c121 0 2024-09-20T18:35:54.383 INFO:tasks.workunit.client.1.smithi172.stdout:2/884: write d0/d2c/d3f/dab/d22/f38 [949074,40752] 0 2024-09-20T18:35:54.383 INFO:tasks.workunit.client.1.smithi172.stdout:3/981: mkdir d0/d13/d32/d88/dc2/d150 0 2024-09-20T18:35:54.384 INFO:tasks.workunit.client.1.smithi172.stdout:7/957: write d2/d3/d10/d40/d46/d8e/f6f [1046515,126596] 0 2024-09-20T18:35:54.386 INFO:tasks.workunit.client.1.smithi172.stdout:2/885: read d0/d2c/d3f/dab/d18/d29/f57 [141961,39162] 0 2024-09-20T18:35:54.386 INFO:tasks.workunit.client.1.smithi172.stdout:1/915: mkdir d0/d8/d5f/d12e 0 2024-09-20T18:35:54.388 INFO:tasks.workunit.client.1.smithi172.stdout:3/982: write d0/d13/d58/d6d/db9/d87/f9d [4250013,53940] 0 2024-09-20T18:35:54.389 INFO:tasks.workunit.client.1.smithi172.stdout:2/886: chown d0/d2c/d3f/dab/d22/d10/d35/fc2 107 1 2024-09-20T18:35:54.389 INFO:tasks.workunit.client.1.smithi172.stdout:1/916: write d0/d8/db/f3c [4900259,58996] 0 2024-09-20T18:35:54.391 INFO:tasks.workunit.client.1.smithi172.stdout:1/917: readlink d0/d22/l4e 0 2024-09-20T18:35:54.393 INFO:tasks.workunit.client.1.smithi172.stdout:9/893: dread d15/d1f/d2c/d7d/ff3 [0,4194304] 0 2024-09-20T18:35:54.395 INFO:tasks.workunit.client.1.smithi172.stdout:1/918: chown d0/d22/la7 0 1 2024-09-20T18:35:54.396 INFO:tasks.workunit.client.1.smithi172.stdout:3/983: rename d0/d13/d32/d88/laa to d0/d13/d58/l151 0 2024-09-20T18:35:54.397 INFO:tasks.workunit.client.0.smithi017.stdout:3/437: write da/de/d13/d2f/f6c [141938,64168] 0 2024-09-20T18:35:54.397 INFO:tasks.workunit.client.1.smithi172.stdout:7/958: fsync d2/d3/d10/d40/d6a/ff0 0 2024-09-20T18:35:54.398 INFO:tasks.workunit.client.1.smithi172.stdout:2/887: dwrite d0/d2c/d3f/dab/d18/d29/fd8 [0,4194304] 0 2024-09-20T18:35:54.398 INFO:tasks.workunit.client.1.smithi172.stdout:1/919: write d0/d8/db/d25/d2b/d3d/d104/f10b [853548,45265] 0 2024-09-20T18:35:54.400 INFO:tasks.workunit.client.1.smithi172.stdout:9/894: creat d15/d1f/d2c/d7d/f123 x:0 0 0 2024-09-20T18:35:54.401 INFO:tasks.workunit.client.1.smithi172.stdout:2/888: dread - d0/d2c/d3f/dab/d22/d10/d3c/f103 zero size 2024-09-20T18:35:54.401 INFO:tasks.workunit.client.1.smithi172.stdout:9/895: readlink d15/d1f/d2c/d57/lad 0 2024-09-20T18:35:54.403 INFO:tasks.workunit.client.0.smithi017.stdout:3/438: dwrite da/de/d13/f67 [0,4194304] 0 2024-09-20T18:35:54.408 INFO:tasks.workunit.client.1.smithi172.stdout:3/984: creat d0/d13/d58/d6d/d7f/d84/dd9/d134/f152 x:0 0 0 2024-09-20T18:35:54.410 INFO:tasks.workunit.client.1.smithi172.stdout:7/959: read d2/d3/d10/d40/d6a/f8a [1065121,127004] 0 2024-09-20T18:35:54.411 INFO:tasks.workunit.client.0.smithi017.stdout:3/439: creat da/de/d13/d2f/d26/d31/d5a/f8f x:0 0 0 2024-09-20T18:35:54.411 INFO:tasks.workunit.client.1.smithi172.stdout:9/896: dwrite d15/d1f/d2c/d7d/d34/db5/ded/f10e [0,4194304] 0 2024-09-20T18:35:54.413 INFO:tasks.workunit.client.1.smithi172.stdout:2/889: symlink d0/d2c/d3f/dab/d22/d10/d35/dc4/deb/l122 0 2024-09-20T18:35:54.413 INFO:tasks.workunit.client.1.smithi172.stdout:1/920: truncate d0/d73/f92 1146826 0 2024-09-20T18:35:54.414 INFO:tasks.workunit.client.1.smithi172.stdout:3/985: creat d0/d13/d58/d6d/dc3/f153 x:0 0 0 2024-09-20T18:35:54.417 INFO:tasks.workunit.client.1.smithi172.stdout:3/986: chown d0/d13/d32/d88/cd5 15755 1 2024-09-20T18:35:54.418 INFO:tasks.workunit.client.1.smithi172.stdout:9/897: symlink d15/d1a/d6f/d7a/l124 0 2024-09-20T18:35:54.419 INFO:tasks.workunit.client.1.smithi172.stdout:7/960: write d2/de7/f111 [833643,51707] 0 2024-09-20T18:35:54.419 INFO:tasks.workunit.client.1.smithi172.stdout:5/945: sync 2024-09-20T18:35:54.419 INFO:tasks.workunit.client.1.smithi172.stdout:4/943: sync 2024-09-20T18:35:54.425 INFO:tasks.workunit.client.1.smithi172.stdout:2/890: mknod d0/d2c/d3f/dab/d22/d10/c123 0 2024-09-20T18:35:54.427 INFO:tasks.workunit.client.0.smithi017.stdout:3/440: dread da/de/d13/d16/d50/f78 [0,4194304] 0 2024-09-20T18:35:54.428 INFO:tasks.workunit.client.1.smithi172.stdout:7/961: dread d2/d3/d3d/d4e/d8b/fb0 [0,4194304] 0 2024-09-20T18:35:54.428 INFO:tasks.workunit.client.1.smithi172.stdout:9/898: mknod d15/d1f/d2c/d7d/d34/db5/ded/c125 0 2024-09-20T18:35:54.430 INFO:tasks.workunit.client.0.smithi017.stdout:3/441: symlink da/de/d13/d2f/d26/d41/l90 0 2024-09-20T18:35:54.433 INFO:tasks.workunit.client.1.smithi172.stdout:2/891: fdatasync d0/d2c/d3f/dab/d22/d4c/f4d 0 2024-09-20T18:35:54.435 INFO:tasks.workunit.client.1.smithi172.stdout:1/921: rmdir d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/d114 0 2024-09-20T18:35:54.435 INFO:tasks.workunit.client.0.smithi017.stdout:3/442: creat da/de/d53/d88/f91 x:0 0 0 2024-09-20T18:35:54.436 INFO:tasks.workunit.client.1.smithi172.stdout:2/892: readlink d0/d2c/d3f/dab/d22/ded/l7c 0 2024-09-20T18:35:54.436 INFO:tasks.workunit.client.1.smithi172.stdout:1/922: readlink d0/d8/db/l69 0 2024-09-20T18:35:54.437 INFO:tasks.workunit.client.1.smithi172.stdout:7/962: mkdir d2/d3/d10/d40/d46/d8e/dbd/dda/d145 0 2024-09-20T18:35:54.439 INFO:tasks.workunit.client.1.smithi172.stdout:7/963: stat d2/d23/dc0/l125 0 2024-09-20T18:35:54.440 INFO:tasks.workunit.client.1.smithi172.stdout:5/946: dwrite d4/f14 [4194304,4194304] 0 2024-09-20T18:35:54.441 INFO:tasks.workunit.client.1.smithi172.stdout:1/923: rename d0/d8/l31 to d0/dc2/l12f 0 2024-09-20T18:35:54.441 INFO:tasks.workunit.client.1.smithi172.stdout:3/987: getdents d0/dc/d6a/dc5/d11d 0 2024-09-20T18:35:54.442 INFO:tasks.workunit.client.0.smithi017.stdout:3/443: getdents da/de/d13 0 2024-09-20T18:35:54.442 INFO:tasks.workunit.client.1.smithi172.stdout:2/893: read d0/d2c/d3f/dab/d18/d3b/f44 [403268,62605] 0 2024-09-20T18:35:54.442 INFO:tasks.workunit.client.1.smithi172.stdout:9/899: read d15/d20/d76/f9b [884320,52622] 0 2024-09-20T18:35:54.443 INFO:tasks.workunit.client.0.smithi017.stdout:3/444: readlink da/de/d13/d2f/l3c 0 2024-09-20T18:35:54.443 INFO:tasks.workunit.client.1.smithi172.stdout:7/964: unlink d2/c21 0 2024-09-20T18:35:54.444 INFO:tasks.workunit.client.1.smithi172.stdout:5/947: mkdir d4/df/d98/d137 0 2024-09-20T18:35:54.446 INFO:tasks.workunit.client.1.smithi172.stdout:4/944: dread d0/d48/d90/d55/d101/d18/d51/d9a/fab [4194304,4194304] 0 2024-09-20T18:35:54.446 INFO:tasks.workunit.client.1.smithi172.stdout:1/924: symlink d0/d8/d5f/d12e/l130 0 2024-09-20T18:35:54.449 INFO:tasks.workunit.client.1.smithi172.stdout:7/965: unlink d2/d23/d51/d10e/f88 0 2024-09-20T18:35:54.449 INFO:tasks.workunit.client.1.smithi172.stdout:3/988: dwrite d0/d13/dfb/f127 [0,4194304] 0 2024-09-20T18:35:54.450 INFO:tasks.workunit.client.0.smithi017.stdout:3/445: dwrite da/de/f7c [0,4194304] 0 2024-09-20T18:35:54.452 INFO:tasks.workunit.client.1.smithi172.stdout:9/900: link d15/d1f/d2c/d6e/fee d15/d1a/f126 0 2024-09-20T18:35:54.452 INFO:tasks.workunit.client.1.smithi172.stdout:9/901: dread - d15/d1f/d2c/d57/fe5 zero size 2024-09-20T18:35:54.453 INFO:tasks.workunit.client.1.smithi172.stdout:4/945: creat d0/d7/d6f/f148 x:0 0 0 2024-09-20T18:35:54.454 INFO:tasks.workunit.client.1.smithi172.stdout:2/894: mknod d0/d2c/d3f/dab/d18/d29/d42/d4b/d53/d104/c124 0 2024-09-20T18:35:54.457 INFO:tasks.workunit.client.1.smithi172.stdout:3/989: mkdir d0/d13/d32/d123/d154 0 2024-09-20T18:35:54.457 INFO:tasks.workunit.client.0.smithi017.stdout:3/446: mkdir da/de/d13/d2f/d92 0 2024-09-20T18:35:54.457 INFO:tasks.workunit.client.1.smithi172.stdout:5/948: getdents d4/df/d3f/df4 0 2024-09-20T18:35:54.458 INFO:tasks.workunit.client.1.smithi172.stdout:9/902: stat d15/d1f/d2c/d7d/d48/le3 0 2024-09-20T18:35:54.459 INFO:tasks.workunit.client.1.smithi172.stdout:4/946: mknod d0/d48/d90/dea/d10f/c149 0 2024-09-20T18:35:54.462 INFO:tasks.workunit.client.1.smithi172.stdout:4/947: chown d0/de/d39/f9b 13233804 1 2024-09-20T18:35:54.465 INFO:tasks.workunit.client.1.smithi172.stdout:2/895: unlink d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/de7/f111 0 2024-09-20T18:35:54.466 INFO:tasks.workunit.client.1.smithi172.stdout:7/966: truncate d2/d3/d3d/d4e/f5d 266180 0 2024-09-20T18:35:54.470 INFO:tasks.workunit.client.0.smithi017.stdout:2/361: sync 2024-09-20T18:35:54.472 INFO:tasks.workunit.client.1.smithi172.stdout:5/949: dwrite d4/df/d3f/d64/f109 [0,4194304] 0 2024-09-20T18:35:54.474 INFO:tasks.workunit.client.0.smithi017.stdout:2/362: mknod d1/dc/d58/d46/d48/c76 0 2024-09-20T18:35:54.475 INFO:tasks.workunit.client.0.smithi017.stdout:2/363: chown d1/dc/d20 6492279 1 2024-09-20T18:35:54.477 INFO:tasks.workunit.client.1.smithi172.stdout:3/990: dwrite d0/f16 [0,4194304] 0 2024-09-20T18:35:54.477 INFO:tasks.workunit.client.1.smithi172.stdout:2/896: creat d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/f125 x:0 0 0 2024-09-20T18:35:54.478 INFO:tasks.workunit.client.0.smithi017.stdout:2/364: mkdir d1/dc/d58/d3d/d77 0 2024-09-20T18:35:54.479 INFO:tasks.workunit.client.0.smithi017.stdout:2/365: dread - d1/dc/d20/f74 zero size 2024-09-20T18:35:54.480 INFO:tasks.workunit.client.1.smithi172.stdout:4/948: dwrite d0/d7/fba [0,4194304] 0 2024-09-20T18:35:54.481 INFO:tasks.workunit.client.1.smithi172.stdout:3/991: write d0/d13/dfb/f127 [282583,45983] 0 2024-09-20T18:35:54.482 INFO:tasks.workunit.client.1.smithi172.stdout:2/897: chown d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/fd3 931803699 1 2024-09-20T18:35:54.485 INFO:tasks.workunit.client.1.smithi172.stdout:4/949: rmdir d0/de/dc/d3c/d99 39 2024-09-20T18:35:54.489 INFO:tasks.workunit.client.1.smithi172.stdout:2/898: truncate d0/d2c/d3f/dab/d22/fda 2296604 0 2024-09-20T18:35:54.489 INFO:tasks.workunit.client.0.smithi017.stdout:3/447: dwrite da/de/d13/d2f/d26/d31/f7e [0,4194304] 0 2024-09-20T18:35:54.490 INFO:tasks.workunit.client.1.smithi172.stdout:2/899: write d0/d1a/dc0/fcc [56859,52419] 0 2024-09-20T18:35:54.495 INFO:tasks.workunit.client.1.smithi172.stdout:3/992: mkdir d0/d13/d58/d6d/db9/d87/d105/d155 0 2024-09-20T18:35:54.496 INFO:tasks.workunit.client.0.smithi017.stdout:3/448: fsync da/de/d13/f54 0 2024-09-20T18:35:54.498 INFO:tasks.workunit.client.1.smithi172.stdout:2/900: mknod d0/d2c/d3f/dab/d18/d29/d42/d4b/c126 0 2024-09-20T18:35:54.499 INFO:tasks.workunit.client.1.smithi172.stdout:9/903: truncate d15/d1f/d2c/d7d/d48/fba 1651175 0 2024-09-20T18:35:54.500 INFO:tasks.workunit.client.1.smithi172.stdout:9/904: dread - d15/d1f/d2c/d7d/d48/df0/f114 zero size 2024-09-20T18:35:54.504 INFO:tasks.workunit.client.1.smithi172.stdout:9/905: dread d15/d1a/f28 [0,4194304] 0 2024-09-20T18:35:54.505 INFO:tasks.workunit.client.1.smithi172.stdout:5/950: write d4/df/dad/d26/d41/d69/dac/f5d [305458,77228] 0 2024-09-20T18:35:54.506 INFO:tasks.workunit.client.1.smithi172.stdout:2/901: fdatasync d0/f39 0 2024-09-20T18:35:54.507 INFO:tasks.workunit.client.1.smithi172.stdout:3/993: dread d0/d13/f72 [0,4194304] 0 2024-09-20T18:35:54.507 INFO:tasks.workunit.client.0.smithi017.stdout:2/366: write d1/dc/d20/d2e/f62 [1680194,54161] 0 2024-09-20T18:35:54.509 INFO:tasks.workunit.client.0.smithi017.stdout:3/449: symlink da/de/d13/d2f/l93 0 2024-09-20T18:35:54.509 INFO:tasks.workunit.client.0.smithi017.stdout:2/367: write d1/d1f/f6e [499332,68580] 0 2024-09-20T18:35:54.512 INFO:tasks.workunit.client.1.smithi172.stdout:8/884: sync 2024-09-20T18:35:54.513 INFO:tasks.workunit.client.1.smithi172.stdout:5/951: dwrite d4/df/f74 [0,4194304] 0 2024-09-20T18:35:54.518 INFO:tasks.workunit.client.1.smithi172.stdout:4/950: dwrite d0/d48/d90/d55/d53/d5c/f112 [0,4194304] 0 2024-09-20T18:35:54.521 INFO:tasks.workunit.client.1.smithi172.stdout:3/994: dread - d0/dc/d6a/d3a/d74/fee zero size 2024-09-20T18:35:54.522 INFO:tasks.workunit.client.0.smithi017.stdout:2/368: symlink d1/dc/d58/l78 0 2024-09-20T18:35:54.524 INFO:tasks.workunit.client.1.smithi172.stdout:4/951: dwrite d0/d7/f13e [0,4194304] 0 2024-09-20T18:35:54.527 INFO:tasks.workunit.client.1.smithi172.stdout:8/885: mknod dd/d1b/d4f/d86/c133 0 2024-09-20T18:35:54.529 INFO:tasks.workunit.client.0.smithi017.stdout:2/369: creat d1/dc/d20/d2e/d30/f79 x:0 0 0 2024-09-20T18:35:54.532 INFO:tasks.workunit.client.0.smithi017.stdout:3/450: write da/de/d13/d2f/d26/d41/f73 [1994275,127128] 0 2024-09-20T18:35:54.534 INFO:tasks.workunit.client.0.smithi017.stdout:3/451: chown da/de/d13/d16/d6e/d82 30 1 2024-09-20T18:35:54.536 INFO:tasks.workunit.client.1.smithi172.stdout:8/886: rmdir dd/d1b/d4f/d9a/dbb/d101 39 2024-09-20T18:35:54.537 INFO:tasks.workunit.client.1.smithi172.stdout:5/952: symlink d4/df/d3f/d64/d101/d86/d10d/l138 0 2024-09-20T18:35:54.538 INFO:tasks.workunit.client.0.smithi017.stdout:2/370: read d1/df/f1e [1299975,12842] 0 2024-09-20T18:35:54.539 INFO:tasks.workunit.client.0.smithi017.stdout:3/452: symlink da/de/d53/d52/l94 0 2024-09-20T18:35:54.540 INFO:tasks.workunit.client.1.smithi172.stdout:2/902: creat d0/d2c/d3f/dab/d22/d10/d35/f127 x:0 0 0 2024-09-20T18:35:54.540 INFO:tasks.workunit.client.1.smithi172.stdout:2/903: readlink d0/d2c/l8d 0 2024-09-20T18:35:54.541 INFO:tasks.workunit.client.1.smithi172.stdout:2/904: chown d0/lb3 175 1 2024-09-20T18:35:54.543 INFO:tasks.workunit.client.0.smithi017.stdout:2/371: mkdir d1/dc/d58/d3d/d77/d7a 0 2024-09-20T18:35:54.546 INFO:tasks.workunit.client.1.smithi172.stdout:8/887: dread - dd/d1b/d3b/d51/fd8 zero size 2024-09-20T18:35:54.547 INFO:tasks.workunit.client.1.smithi172.stdout:5/953: mknod d4/df/d3f/d64/d101/d86/d10c/c139 0 2024-09-20T18:35:54.547 INFO:tasks.workunit.client.0.smithi017.stdout:3/453: dwrite da/de/d13/d2f/d26/d31/d5a/f8f [0,4194304] 0 2024-09-20T18:35:54.549 INFO:tasks.workunit.client.0.smithi017.stdout:3/454: stat da/de/d13/d2f/d26/d31/l71 0 2024-09-20T18:35:54.549 INFO:tasks.workunit.client.1.smithi172.stdout:3/995: rmdir d0/d13/d32/d54/d71/d131 0 2024-09-20T18:35:54.556 INFO:tasks.workunit.client.1.smithi172.stdout:5/954: chown d4/df/dad/d26/d41/l6a 1447579 1 2024-09-20T18:35:54.556 INFO:tasks.workunit.client.1.smithi172.stdout:4/952: truncate d0/d7/f25 1678036 0 2024-09-20T18:35:54.557 INFO:tasks.workunit.client.1.smithi172.stdout:5/955: write d4/df/d98/fc1 [191109,43383] 0 2024-09-20T18:35:54.558 INFO:tasks.workunit.client.1.smithi172.stdout:2/905: link d0/d2c/d3f/dab/d18/d29/d42/f8b d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/f128 0 2024-09-20T18:35:54.559 INFO:tasks.workunit.client.1.smithi172.stdout:5/956: truncate d4/df/d3f/fe0 542169 0 2024-09-20T18:35:54.560 INFO:tasks.workunit.client.1.smithi172.stdout:8/888: truncate dd/d1b/d3b/d51/d5b/daf/d4d/f8f 4421272 0 2024-09-20T18:35:54.561 INFO:tasks.workunit.client.1.smithi172.stdout:8/889: truncate dd/d1b/d3b/d5d/ff9 85600 0 2024-09-20T18:35:54.562 INFO:tasks.workunit.client.0.smithi017.stdout:2/372: write d1/dc/d58/d46/f51 [1090375,67668] 0 2024-09-20T18:35:54.563 INFO:tasks.workunit.client.1.smithi172.stdout:2/906: mkdir d0/d2c/d3f/d129 0 2024-09-20T18:35:54.564 INFO:tasks.workunit.client.0.smithi017.stdout:3/455: getdents da/de/d13/d2f/d26/d41 0 2024-09-20T18:35:54.565 INFO:tasks.workunit.client.1.smithi172.stdout:5/957: symlink d4/df/d3f/d64/d101/d63/d80/l13a 0 2024-09-20T18:35:54.565 INFO:tasks.workunit.client.1.smithi172.stdout:5/958: stat d4/df/dad/d26/d41/d69/dac/da7/fbe 0 2024-09-20T18:35:54.566 INFO:tasks.workunit.client.0.smithi017.stdout:3/456: write da/de/d13/d2f/d26/d31/d5a/f7f [740506,122936] 0 2024-09-20T18:35:54.566 INFO:tasks.workunit.client.1.smithi172.stdout:8/890: unlink dd/d1b/d3b/d5d/f60 0 2024-09-20T18:35:54.567 INFO:tasks.workunit.client.1.smithi172.stdout:4/953: symlink d0/de/d39/d9f/de8/d119/d121/l14a 0 2024-09-20T18:35:54.571 INFO:tasks.workunit.client.0.smithi017.stdout:2/373: creat d1/dc/d20/f7b x:0 0 0 2024-09-20T18:35:54.573 INFO:tasks.workunit.client.0.smithi017.stdout:3/457: mknod da/de/d13/d2f/d26/c95 0 2024-09-20T18:35:54.574 INFO:tasks.workunit.client.1.smithi172.stdout:4/954: read d0/d48/d90/d55/f109 [3706959,85376] 0 2024-09-20T18:35:54.576 INFO:tasks.workunit.client.1.smithi172.stdout:5/959: dwrite d4/df/dad/d26/d41/f9e [0,4194304] 0 2024-09-20T18:35:54.580 INFO:tasks.workunit.client.0.smithi017.stdout:3/458: creat da/de/d13/d16/d50/f96 x:0 0 0 2024-09-20T18:35:54.582 INFO:tasks.workunit.client.1.smithi172.stdout:2/907: dread d0/d2c/f70 [0,4194304] 0 2024-09-20T18:35:54.583 INFO:tasks.workunit.client.0.smithi017.stdout:2/374: mknod d1/df/c7c 0 2024-09-20T18:35:54.585 INFO:tasks.workunit.client.1.smithi172.stdout:4/955: truncate d0/d7/d6f/fc0 615885 0 2024-09-20T18:35:54.586 INFO:tasks.workunit.client.0.smithi017.stdout:3/459: mkdir da/de/d13/d16/d6e/d97 0 2024-09-20T18:35:54.587 INFO:tasks.workunit.client.1.smithi172.stdout:5/960: symlink d4/df/dad/dd4/l13b 0 2024-09-20T18:35:54.587 INFO:tasks.workunit.client.1.smithi172.stdout:8/891: write dd/d1b/d3b/d51/fd8 [940744,101733] 0 2024-09-20T18:35:54.589 INFO:tasks.workunit.client.0.smithi017.stdout:2/375: unlink d1/dc/d20/d2e/d30/f54 0 2024-09-20T18:35:54.590 INFO:tasks.workunit.client.0.smithi017.stdout:2/376: write d1/dc/d58/d46/f65 [2239967,59778] 0 2024-09-20T18:35:54.594 INFO:tasks.workunit.client.1.smithi172.stdout:2/908: creat d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/dbb/f12a x:0 0 0 2024-09-20T18:35:54.594 INFO:tasks.workunit.client.1.smithi172.stdout:2/909: chown d0/d1a/f33 12341315 1 2024-09-20T18:35:54.596 INFO:tasks.workunit.client.1.smithi172.stdout:4/956: mkdir d0/d48/d90/d55/d101/d18/d51/d14b 0 2024-09-20T18:35:54.597 INFO:tasks.workunit.client.0.smithi017.stdout:2/377: dwrite d1/dc/d20/d2e/f62 [0,4194304] 0 2024-09-20T18:35:54.597 INFO:tasks.workunit.client.0.smithi017.stdout:3/460: mknod da/de/d13/d2f/d92/c98 0 2024-09-20T18:35:54.601 INFO:tasks.workunit.client.1.smithi172.stdout:2/910: symlink d0/d60/l12b 0 2024-09-20T18:35:54.604 INFO:tasks.workunit.client.1.smithi172.stdout:4/957: chown d0/d7/d6f/l10d 1052098 1 2024-09-20T18:35:54.604 INFO:tasks.workunit.client.1.smithi172.stdout:2/911: chown d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/dbb 7 1 2024-09-20T18:35:54.605 INFO:tasks.workunit.client.1.smithi172.stdout:5/961: mkdir d4/df/d3f/d13c 0 2024-09-20T18:35:54.605 INFO:tasks.workunit.client.1.smithi172.stdout:5/962: fsync d4/df/dad/faf 0 2024-09-20T18:35:54.606 INFO:tasks.workunit.client.1.smithi172.stdout:8/892: creat dd/d1b/d3b/d51/dac/d12b/f134 x:0 0 0 2024-09-20T18:35:54.611 INFO:tasks.workunit.client.1.smithi172.stdout:2/912: read d0/d1a/f20 [3371920,118935] 0 2024-09-20T18:35:54.613 INFO:tasks.workunit.client.1.smithi172.stdout:5/963: rmdir d4/df/dad/d26/d41/d69/dcd 39 2024-09-20T18:35:54.614 INFO:tasks.workunit.client.1.smithi172.stdout:5/964: dread - d4/df/d3f/d64/d101/f5b zero size 2024-09-20T18:35:54.615 INFO:tasks.workunit.client.1.smithi172.stdout:5/965: chown d4/df/dad/d26/d41/d69/dac 0 1 2024-09-20T18:35:54.616 INFO:tasks.workunit.client.1.smithi172.stdout:5/966: chown d4/df/dad/d26/d41/d69/dac/d2c/dd1/l107 189 1 2024-09-20T18:35:54.616 INFO:tasks.workunit.client.1.smithi172.stdout:4/958: mknod d0/de/d21/c14c 0 2024-09-20T18:35:54.618 INFO:tasks.workunit.client.1.smithi172.stdout:5/967: dread d4/df/d98/fc1 [0,4194304] 0 2024-09-20T18:35:54.627 INFO:tasks.workunit.client.0.smithi017.stdout:2/378: dwrite d1/f3a [0,4194304] 0 2024-09-20T18:35:54.629 INFO:tasks.workunit.client.0.smithi017.stdout:2/379: read d1/dc/d58/d46/f63 [2428617,39327] 0 2024-09-20T18:35:54.631 INFO:tasks.workunit.client.1.smithi172.stdout:2/913: dread d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/d9f/fcd [0,4194304] 0 2024-09-20T18:35:54.632 INFO:tasks.workunit.client.1.smithi172.stdout:5/968: dread d4/df/f22 [0,4194304] 0 2024-09-20T18:35:54.633 INFO:tasks.workunit.client.1.smithi172.stdout:8/893: write dd/d65/f7f [744419,37808] 0 2024-09-20T18:35:54.634 INFO:tasks.workunit.client.0.smithi017.stdout:3/461: getdents da/de/d53 0 2024-09-20T18:35:54.636 INFO:tasks.workunit.client.0.smithi017.stdout:2/380: dwrite d1/dc/d20/d2e/f49 [0,4194304] 0 2024-09-20T18:35:54.640 INFO:tasks.workunit.client.1.smithi172.stdout:6/808: sync 2024-09-20T18:35:54.640 INFO:tasks.workunit.client.1.smithi172.stdout:1/925: sync 2024-09-20T18:35:54.644 INFO:tasks.workunit.client.0.smithi017.stdout:2/381: rmdir d1/dc/d58/d3d/d77 39 2024-09-20T18:35:54.648 INFO:tasks.workunit.client.0.smithi017.stdout:2/382: rename d1/f2d to d1/dc/d58/f7d 0 2024-09-20T18:35:54.648 INFO:tasks.workunit.client.1.smithi172.stdout:2/914: mknod d0/d2c/d3f/dab/d45/c12c 0 2024-09-20T18:35:54.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:54 smithi017 ceph-mon[28058]: pgmap v31: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 52 MiB/s rd, 197 MiB/s wr, 349 op/s 2024-09-20T18:35:54.651 INFO:tasks.workunit.client.1.smithi172.stdout:6/809: chown d0/d18/d1c/d21/d26/d34/d6b/d7d/f2f 3163 1 2024-09-20T18:35:54.651 INFO:tasks.workunit.client.1.smithi172.stdout:8/894: rmdir dd/d65/d85/dab 39 2024-09-20T18:35:54.653 INFO:tasks.workunit.client.1.smithi172.stdout:6/810: rmdir d0/d18 39 2024-09-20T18:35:54.654 INFO:tasks.workunit.client.0.smithi017.stdout:2/383: dwrite d1/dc/d58/d3d/f43 [4194304,4194304] 0 2024-09-20T18:35:54.655 INFO:tasks.workunit.client.1.smithi172.stdout:6/811: stat d0/d18/d1c/d21/d26/led 0 2024-09-20T18:35:54.655 INFO:tasks.workunit.client.1.smithi172.stdout:8/895: symlink dd/d1b/d3b/d51/d5b/d6b/d108/l135 0 2024-09-20T18:35:54.656 INFO:tasks.workunit.client.1.smithi172.stdout:6/812: rmdir d0/d18/d1c/d21/d26/d79 39 2024-09-20T18:35:54.661 INFO:tasks.workunit.client.0.smithi017.stdout:2/384: getdents d1/dc/d58/d3d 0 2024-09-20T18:35:54.662 INFO:tasks.workunit.client.1.smithi172.stdout:8/896: getdents dd/d1b/d4f/d9a/dbb 0 2024-09-20T18:35:54.662 INFO:tasks.workunit.client.1.smithi172.stdout:6/813: dwrite d0/d18/d1c/d21/d26/d34/d39/d46/fa5 [0,4194304] 0 2024-09-20T18:35:54.663 INFO:tasks.workunit.client.0.smithi017.stdout:2/385: mknod d1/df/d17/c7e 0 2024-09-20T18:35:54.664 INFO:tasks.workunit.client.1.smithi172.stdout:8/897: stat dd/d1b/d4f/d9a/dbb/l131 0 2024-09-20T18:35:54.665 INFO:tasks.workunit.client.0.smithi017.stdout:2/386: unlink d1/dc/d58/l78 0 2024-09-20T18:35:54.671 INFO:tasks.workunit.client.1.smithi172.stdout:6/814: truncate d0/d18/d1c/d21/d26/d34/da2/def/dff/f8f 38224 0 2024-09-20T18:35:54.673 INFO:tasks.workunit.client.1.smithi172.stdout:6/815: fsync d0/d18/d1c/d21/d26/f45 0 2024-09-20T18:35:54.678 INFO:tasks.workunit.client.1.smithi172.stdout:5/969: dwrite d4/df/d3f/f75 [0,4194304] 0 2024-09-20T18:35:54.679 INFO:tasks.workunit.client.1.smithi172.stdout:2/915: dwrite d0/d2c/d3f/dab/d18/d29/f57 [0,4194304] 0 2024-09-20T18:35:54.681 INFO:tasks.workunit.client.1.smithi172.stdout:5/970: dread - d4/df/d3f/d64/d101/d86/f12a zero size 2024-09-20T18:35:54.681 INFO:tasks.workunit.client.1.smithi172.stdout:2/916: truncate d0/fd9 563728 0 2024-09-20T18:35:54.684 INFO:tasks.workunit.client.1.smithi172.stdout:5/971: chown d4/df/dad/d26/d41/d69/dac/d2c/cb8 1635100 1 2024-09-20T18:35:54.687 INFO:tasks.workunit.client.1.smithi172.stdout:2/917: symlink d0/d2c/d3f/dab/d22/ded/l12d 0 2024-09-20T18:35:54.688 INFO:tasks.workunit.client.1.smithi172.stdout:5/972: chown d4/df/d3f/d64/d101/f5b 423 1 2024-09-20T18:35:54.690 INFO:tasks.workunit.client.0.smithi017.stdout:2/387: dwrite d1/df/f16 [0,4194304] 0 2024-09-20T18:35:54.691 INFO:tasks.workunit.client.1.smithi172.stdout:8/898: dwrite dd/d1b/d4f/d9a/dbb/d101/d129/fd1 [0,4194304] 0 2024-09-20T18:35:54.692 INFO:tasks.workunit.client.0.smithi017.stdout:2/388: write d1/dc/d58/d3d/f44 [680835,1135] 0 2024-09-20T18:35:54.694 INFO:tasks.workunit.client.1.smithi172.stdout:6/816: dread d0/d18/d1c/d21/d26/d34/d6b/d7d/f2f [0,4194304] 0 2024-09-20T18:35:54.694 INFO:tasks.workunit.client.1.smithi172.stdout:8/899: symlink dd/d1b/d4f/ddd/l136 0 2024-09-20T18:35:54.696 INFO:tasks.workunit.client.1.smithi172.stdout:5/973: mkdir d4/df/d3f/d13d 0 2024-09-20T18:35:54.698 INFO:tasks.workunit.client.1.smithi172.stdout:8/900: readlink dd/d1b/d3b/d51/d5b/daf/d91/lb2 0 2024-09-20T18:35:54.698 INFO:tasks.workunit.client.1.smithi172.stdout:8/901: chown dd/d1b/c120 10 1 2024-09-20T18:35:54.700 INFO:tasks.workunit.client.1.smithi172.stdout:6/817: creat d0/d18/d1c/d21/d26/d34/d39/d74/f10e x:0 0 0 2024-09-20T18:35:54.701 INFO:tasks.workunit.client.0.smithi017.stdout:2/389: symlink d1/dc/d20/l7f 0 2024-09-20T18:35:54.701 INFO:tasks.workunit.client.1.smithi172.stdout:6/818: dread - d0/d18/d1c/d21/d26/d34/da2/def/dff/fd5 zero size 2024-09-20T18:35:54.702 INFO:tasks.workunit.client.1.smithi172.stdout:5/974: rename d4/cf3 to d4/df/d3f/d13c/c13e 0 2024-09-20T18:35:54.706 INFO:tasks.workunit.client.1.smithi172.stdout:6/819: creat d0/d18/d1c/d21/d26/d34/d9c/dc7/f10f x:0 0 0 2024-09-20T18:35:54.708 INFO:tasks.workunit.client.1.smithi172.stdout:5/975: rename d4/df/dad/d26/d41/d69/dac/cc4 to d4/df/d3f/df4/c13f 0 2024-09-20T18:35:54.708 INFO:tasks.workunit.client.1.smithi172.stdout:6/820: chown d0/d18/d1c/d21/d26/d34/d6b/f84 66306270 1 2024-09-20T18:35:54.708 INFO:tasks.workunit.client.1.smithi172.stdout:8/902: unlink dd/d1b/d3b/d51/d5b/d6b/c125 0 2024-09-20T18:35:54.709 INFO:tasks.workunit.client.1.smithi172.stdout:6/821: fdatasync d0/d18/d1c/d21/d26/d34/d39/fc0 0 2024-09-20T18:35:54.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:54 smithi172 ceph-mon[35456]: pgmap v31: 65 pgs: 65 active+clean; 2.0 GiB data, 5.9 GiB used, 531 GiB / 536 GiB avail; 52 MiB/s rd, 197 MiB/s wr, 349 op/s 2024-09-20T18:35:54.710 INFO:tasks.workunit.client.1.smithi172.stdout:5/976: creat d4/df/d106/f140 x:0 0 0 2024-09-20T18:35:54.710 INFO:tasks.workunit.client.1.smithi172.stdout:8/903: mknod dd/d1b/d4f/ddd/c137 0 2024-09-20T18:35:54.711 INFO:tasks.workunit.client.1.smithi172.stdout:6/822: write d0/d18/d1c/d21/d26/d34/da2/def/ff1 [1083484,91917] 0 2024-09-20T18:35:54.714 INFO:tasks.workunit.client.1.smithi172.stdout:8/904: fdatasync dd/d1b/f21 0 2024-09-20T18:35:54.716 INFO:tasks.workunit.client.1.smithi172.stdout:6/823: mkdir d0/d18/d1c/d21/d26/d34/d39/d74/dbf/d110 0 2024-09-20T18:35:54.718 INFO:tasks.workunit.client.1.smithi172.stdout:5/977: link d4/df/dad/c99 d4/df/d98/dcc/c141 0 2024-09-20T18:35:54.718 INFO:tasks.workunit.client.0.smithi017.stdout:2/390: dread d1/dc/d58/d3d/f36 [0,4194304] 0 2024-09-20T18:35:54.719 INFO:tasks.workunit.client.1.smithi172.stdout:2/918: dread d0/d2c/d3f/dab/d22/d4c/f4d [0,4194304] 0 2024-09-20T18:35:54.720 INFO:tasks.workunit.client.1.smithi172.stdout:8/905: creat dd/d1b/d3b/dff/f138 x:0 0 0 2024-09-20T18:35:54.721 INFO:tasks.workunit.client.0.smithi017.stdout:5/267: sync 2024-09-20T18:35:54.723 INFO:tasks.workunit.client.1.smithi172.stdout:5/978: dread d4/df/d3f/f75 [0,4194304] 0 2024-09-20T18:35:54.723 INFO:tasks.workunit.client.0.smithi017.stdout:2/391: dread d1/dc/d58/d46/f51 [0,4194304] 0 2024-09-20T18:35:54.725 INFO:tasks.workunit.client.1.smithi172.stdout:8/906: mknod dd/d65/d85/da2/c139 0 2024-09-20T18:35:54.727 INFO:tasks.workunit.client.0.smithi017.stdout:5/268: symlink d0/l54 0 2024-09-20T18:35:54.729 INFO:tasks.workunit.client.1.smithi172.stdout:2/919: creat d0/d2c/d3f/dab/d18/d29/d42/d4b/d53/f12e x:0 0 0 2024-09-20T18:35:54.730 INFO:tasks.workunit.client.0.smithi017.stdout:2/392: unlink d1/f3a 0 2024-09-20T18:35:54.731 INFO:tasks.workunit.client.0.smithi017.stdout:2/393: dread - d1/dc/d58/d53/d6b/f6d zero size 2024-09-20T18:35:54.734 INFO:tasks.workunit.client.1.smithi172.stdout:2/920: symlink d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/d9f/d106/d9d/l12f 0 2024-09-20T18:35:54.735 INFO:tasks.workunit.client.0.smithi017.stdout:5/269: getdents d0/d14/d18/d19/d4d 0 2024-09-20T18:35:54.735 INFO:tasks.workunit.client.1.smithi172.stdout:6/824: write d0/d18/d1c/d21/d26/d34/d39/d46/f20 [8621020,60614] 0 2024-09-20T18:35:54.735 INFO:tasks.workunit.client.0.smithi017.stdout:5/270: chown d0/d14/d18/d3e/f4e 734927 1 2024-09-20T18:35:54.736 INFO:tasks.workunit.client.1.smithi172.stdout:5/979: fdatasync d4/df/d98/dcc/d105/f112 0 2024-09-20T18:35:54.737 INFO:tasks.workunit.client.1.smithi172.stdout:6/825: write d0/d18/d1c/d21/d26/fd7 [1011706,82947] 0 2024-09-20T18:35:54.739 INFO:tasks.workunit.client.1.smithi172.stdout:6/826: write d0/d18/fee [736538,114425] 0 2024-09-20T18:35:54.739 INFO:tasks.workunit.client.0.smithi017.stdout:5/271: rename d0/d14/d18/d19/d41 to d0/d13/d55 0 2024-09-20T18:35:54.741 INFO:tasks.workunit.client.1.smithi172.stdout:6/827: dread - d0/d18/d1c/d21/d26/d34/da2/dda/d7b/fe5 zero size 2024-09-20T18:35:54.742 INFO:tasks.workunit.client.1.smithi172.stdout:2/921: mknod d0/d2c/dca/df1/dfe/c130 0 2024-09-20T18:35:54.743 INFO:tasks.workunit.client.1.smithi172.stdout:6/828: chown d0/d18/d1c/d21/d26/d34/d9c/faa 15 1 2024-09-20T18:35:54.743 INFO:tasks.workunit.client.0.smithi017.stdout:5/272: write d0/d14/d18/d1b/f51 [620873,75290] 0 2024-09-20T18:35:54.745 INFO:tasks.workunit.client.1.smithi172.stdout:2/922: read d0/d2c/d3f/dab/d18/d29/d42/d4b/d53/fc9 [265459,4921] 0 2024-09-20T18:35:54.746 INFO:tasks.workunit.client.1.smithi172.stdout:8/907: dread dd/d65/d85/dab/fef [0,4194304] 0 2024-09-20T18:35:54.747 INFO:tasks.workunit.client.0.smithi017.stdout:5/273: symlink d0/d14/l56 0 2024-09-20T18:35:54.749 INFO:tasks.workunit.client.1.smithi172.stdout:8/908: creat dd/de3/f13a x:0 0 0 2024-09-20T18:35:54.749 INFO:tasks.workunit.client.0.smithi017.stdout:2/394: truncate d1/d1f/f3f 1723212 0 2024-09-20T18:35:54.750 INFO:tasks.workunit.client.1.smithi172.stdout:8/909: chown dd/d1b/d3b/d51/l40 87646967 1 2024-09-20T18:35:54.751 INFO:tasks.workunit.client.0.smithi017.stdout:5/274: rename d0/d14/d18/d3e to d0/d14/d18/d57 0 2024-09-20T18:35:54.752 INFO:tasks.workunit.client.0.smithi017.stdout:2/395: mknod d1/dc/d20/d2e/d30/c80 0 2024-09-20T18:35:54.753 INFO:tasks.workunit.client.0.smithi017.stdout:2/396: truncate d1/dc/d20/d2e/d30/f79 283003 0 2024-09-20T18:35:54.754 INFO:tasks.workunit.client.1.smithi172.stdout:8/910: write dd/d65/d85/dab/fef [3621387,47033] 0 2024-09-20T18:35:54.754 INFO:tasks.workunit.client.0.smithi017.stdout:5/275: symlink d0/d14/d18/d2a/d39/d42/l58 0 2024-09-20T18:35:54.755 INFO:tasks.workunit.client.0.smithi017.stdout:2/397: symlink d1/d67/l81 0 2024-09-20T18:35:54.755 INFO:tasks.workunit.client.0.smithi017.stdout:5/276: write d0/d14/d18/f30 [501883,121930] 0 2024-09-20T18:35:54.759 INFO:tasks.workunit.client.1.smithi172.stdout:6/829: dread d0/d18/d1c/d21/d26/d34/da2/dda/f78 [0,4194304] 0 2024-09-20T18:35:54.759 INFO:tasks.workunit.client.1.smithi172.stdout:2/923: dread d0/d2c/d3f/dab/d22/fda [0,4194304] 0 2024-09-20T18:35:54.760 INFO:tasks.workunit.client.0.smithi017.stdout:5/277: dwrite d0/fe [0,4194304] 0 2024-09-20T18:35:54.761 INFO:tasks.workunit.client.1.smithi172.stdout:2/924: creat d0/d2c/d3f/dab/f131 x:0 0 0 2024-09-20T18:35:54.762 INFO:tasks.workunit.client.1.smithi172.stdout:2/925: fdatasync d0/d90/fce 0 2024-09-20T18:35:54.765 INFO:tasks.workunit.client.1.smithi172.stdout:6/830: mknod d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/c111 0 2024-09-20T18:35:54.770 INFO:tasks.workunit.client.0.smithi017.stdout:2/398: write d1/dc/d20/d2e/f42 [1258819,22808] 0 2024-09-20T18:35:54.772 INFO:tasks.workunit.client.1.smithi172.stdout:2/926: dwrite d0/dd4/f114 [0,4194304] 0 2024-09-20T18:35:54.773 INFO:tasks.workunit.client.0.smithi017.stdout:2/399: fdatasync d1/dc/d58/d46/f63 0 2024-09-20T18:35:54.774 INFO:tasks.workunit.client.1.smithi172.stdout:7/967: sync 2024-09-20T18:35:54.774 INFO:tasks.workunit.client.1.smithi172.stdout:8/911: dread dd/d1b/d3b/d51/d5b/daf/f6a [0,4194304] 0 2024-09-20T18:35:54.776 INFO:tasks.workunit.client.0.smithi017.stdout:5/278: dread d0/d14/d18/d2a/f37 [0,4194304] 0 2024-09-20T18:35:54.776 INFO:tasks.workunit.client.0.smithi017.stdout:2/400: symlink d1/dc/d20/d2e/d30/l82 0 2024-09-20T18:35:54.777 INFO:tasks.workunit.client.0.smithi017.stdout:5/279: chown d0/d14/d18/d1b/f26 26205 1 2024-09-20T18:35:54.777 INFO:tasks.workunit.client.1.smithi172.stdout:2/927: write d0/d1a/d58/f78 [5626352,33671] 0 2024-09-20T18:35:54.780 INFO:tasks.workunit.client.0.smithi017.stdout:2/401: creat d1/df/f83 x:0 0 0 2024-09-20T18:35:54.780 INFO:tasks.workunit.client.1.smithi172.stdout:6/831: dwrite d0/d18/d1c/d21/d26/d34/da2/dda/d7b/d7e/fb2 [0,4194304] 0 2024-09-20T18:35:54.781 INFO:tasks.workunit.client.0.smithi017.stdout:2/402: write d1/df/f83 [813065,19781] 0 2024-09-20T18:35:54.785 INFO:tasks.workunit.client.1.smithi172.stdout:2/928: rename d0/d2c/d3f/dab/d22/d10/d6a/d98/d59/f92 to d0/d2c/dca/f132 0 2024-09-20T18:35:54.786 INFO:tasks.workunit.client.1.smithi172.stdout:6/832: rmdir d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0 39 2024-09-20T18:35:54.788 INFO:tasks.workunit.client.1.smithi172.stdout:2/929: truncate d0/d2c/d3f/dab/d22/fc 2651390 0 2024-09-20T18:35:54.789 INFO:tasks.workunit.client.0.smithi017.stdout:2/403: dwrite d1/dc/d20/d2e/f49 [0,4194304] 0 2024-09-20T18:35:54.789 INFO:tasks.workunit.client.1.smithi172.stdout:6/833: read d0/d18/d1c/d21/d26/d34/d7a/d99/fa4 [66943,92469] 0 2024-09-20T18:35:54.790 INFO:tasks.workunit.client.0.smithi017.stdout:2/404: readlink d1/d1f/l2a 0 2024-09-20T18:35:54.791 INFO:tasks.workunit.client.1.smithi172.stdout:6/834: chown d0/d18/d1c/d21/d26/d34/da2/dda/d7b/f109 0 1 2024-09-20T18:35:54.793 INFO:tasks.workunit.client.1.smithi172.stdout:2/930: getdents d0/d60 0 2024-09-20T18:35:54.793 INFO:tasks.workunit.client.1.smithi172.stdout:2/931: stat d0/dd4/f114 0 2024-09-20T18:35:54.795 INFO:tasks.workunit.client.0.smithi017.stdout:2/405: creat d1/dc/d20/f84 x:0 0 0 2024-09-20T18:35:54.796 INFO:tasks.workunit.client.1.smithi172.stdout:6/835: creat d0/d18/d1c/d21/d26/d34/d39/d74/dbf/de7/f112 x:0 0 0 2024-09-20T18:35:54.798 INFO:tasks.workunit.client.1.smithi172.stdout:6/836: mkdir d0/d18/d1c/d21/d26/d34/da2/d113 0 2024-09-20T18:35:54.802 INFO:tasks.workunit.client.1.smithi172.stdout:6/837: fdatasync d0/d18/d1c/d21/d26/d34/da2/f10a 0 2024-09-20T18:35:54.803 INFO:tasks.workunit.client.1.smithi172.stdout:2/932: dwrite d0/d2c/f70 [0,4194304] 0 2024-09-20T18:35:54.808 INFO:tasks.workunit.client.1.smithi172.stdout:2/933: rename d0/d2c/d3f/dab/d22/d10/d6a/d98/l101 to d0/d2c/d3f/dab/d45/ddc/d107/l133 0 2024-09-20T18:35:54.809 INFO:tasks.workunit.client.1.smithi172.stdout:8/912: dread dd/d1b/d4f/ddd/ff4 [0,4194304] 0 2024-09-20T18:35:54.810 INFO:tasks.workunit.client.1.smithi172.stdout:2/934: chown d0/d2c/d3f/dab/f131 3094 1 2024-09-20T18:35:54.811 INFO:tasks.workunit.client.1.smithi172.stdout:6/838: creat d0/d18/d1c/d21/d26/d34/d39/d74/f114 x:0 0 0 2024-09-20T18:35:54.812 INFO:tasks.workunit.client.1.smithi172.stdout:6/839: fsync d0/d18/d1c/d21/f7c 0 2024-09-20T18:35:54.813 INFO:tasks.workunit.client.1.smithi172.stdout:8/913: symlink dd/d65/df5/l13b 0 2024-09-20T18:35:54.814 INFO:tasks.workunit.client.1.smithi172.stdout:2/935: symlink d0/d2c/d3f/dab/d18/d29/d42/d4b/d53/d104/l134 0 2024-09-20T18:35:54.814 INFO:tasks.workunit.client.1.smithi172.stdout:2/936: stat d0/dd4 0 2024-09-20T18:35:54.815 INFO:tasks.workunit.client.1.smithi172.stdout:6/840: chown d0/d18/d1c/d21/d26/d34/d6b/d7d/fba 1298 1 2024-09-20T18:35:54.817 INFO:tasks.workunit.client.1.smithi172.stdout:2/937: mknod d0/d2c/d3f/dab/d45/ddc/c135 0 2024-09-20T18:35:54.818 INFO:tasks.workunit.client.0.smithi017.stdout:2/406: dwrite d1/d1f/f3f [0,4194304] 0 2024-09-20T18:35:54.818 INFO:tasks.workunit.client.1.smithi172.stdout:6/841: mknod d0/c115 0 2024-09-20T18:35:54.818 INFO:tasks.workunit.client.1.smithi172.stdout:6/842: fdatasync d0/d18/f43 0 2024-09-20T18:35:54.820 INFO:tasks.workunit.client.1.smithi172.stdout:6/843: chown d0/d18/d1c/d21/d26/d34/d39/d74/f95 941 1 2024-09-20T18:35:54.823 INFO:tasks.workunit.client.0.smithi017.stdout:5/280: dread d0/d14/f20 [0,4194304] 0 2024-09-20T18:35:54.823 INFO:tasks.workunit.client.0.smithi017.stdout:2/407: dread d1/dc/d20/d2e/f4f [0,4194304] 0 2024-09-20T18:35:54.824 INFO:tasks.workunit.client.0.smithi017.stdout:5/281: write d0/fc [1784325,29667] 0 2024-09-20T18:35:54.825 INFO:tasks.workunit.client.1.smithi172.stdout:6/844: mkdir d0/d18/d1c/d21/d26/d34/d39/d74/d116 0 2024-09-20T18:35:54.829 INFO:tasks.workunit.client.0.smithi017.stdout:2/408: rename d1/dc/d58 to d1/dc/d20/d2e/d30/d85 0 2024-09-20T18:35:54.829 INFO:tasks.workunit.client.0.smithi017.stdout:5/282: rename d0/d14/d18/d2a to d0/d14/d18/d2a/d39/d59 22 2024-09-20T18:35:54.830 INFO:tasks.workunit.client.1.smithi172.stdout:6/845: dread - d0/d18/d1c/d21/d26/d34/d6b/d7d/fba zero size 2024-09-20T18:35:54.831 INFO:tasks.workunit.client.0.smithi017.stdout:2/409: truncate d1/dc/d20/d2e/d30/d85/d46/f68 4858965 0 2024-09-20T18:35:54.832 INFO:tasks.workunit.client.0.smithi017.stdout:2/410: rmdir d1/df 39 2024-09-20T18:35:54.834 INFO:tasks.workunit.client.0.smithi017.stdout:2/411: mknod d1/d1f/c86 0 2024-09-20T18:35:54.836 INFO:tasks.workunit.client.1.smithi172.stdout:8/914: dwrite dd/d1b/d3b/d51/f89 [0,4194304] 0 2024-09-20T18:35:54.837 INFO:tasks.workunit.client.1.smithi172.stdout:6/846: dread d0/d18/f43 [0,4194304] 0 2024-09-20T18:35:54.838 INFO:tasks.workunit.client.0.smithi017.stdout:2/412: creat d1/dc/d20/d2e/d30/d85/f87 x:0 0 0 2024-09-20T18:35:54.839 INFO:tasks.workunit.client.1.smithi172.stdout:2/938: dwrite d0/d2c/d3f/dab/d22/d10/d35/fc2 [0,4194304] 0 2024-09-20T18:35:54.841 INFO:tasks.workunit.client.1.smithi172.stdout:8/915: unlink dd/d1b/d4f/ddd/c137 0 2024-09-20T18:35:54.855 INFO:tasks.workunit.client.0.smithi017.stdout:2/413: dwrite d1/d1f/f33 [0,4194304] 0 2024-09-20T18:35:54.859 INFO:tasks.workunit.client.0.smithi017.stdout:2/414: mknod d1/dc/d20/d2e/d30/d85/d3d/d77/d7a/c88 0 2024-09-20T18:35:54.860 INFO:tasks.workunit.client.0.smithi017.stdout:2/415: rmdir d1 39 2024-09-20T18:35:54.862 INFO:tasks.workunit.client.0.smithi017.stdout:2/416: write d1/df/d17/f64 [646890,107996] 0 2024-09-20T18:35:54.863 INFO:tasks.workunit.client.0.smithi017.stdout:2/417: stat d1/dc/l39 0 2024-09-20T18:35:54.865 INFO:tasks.workunit.client.0.smithi017.stdout:2/418: write d1/d1f/f3f [442548,115131] 0 2024-09-20T18:35:54.866 INFO:tasks.workunit.client.1.smithi172.stdout:6/847: write d0/d18/d1c/d21/d26/d34/da2/def/dff/f8f [222811,93263] 0 2024-09-20T18:35:54.868 INFO:tasks.workunit.client.0.smithi017.stdout:5/283: dread d0/d14/d18/d2a/d39/d42/f49 [4194304,4194304] 0 2024-09-20T18:35:54.870 INFO:tasks.workunit.client.1.smithi172.stdout:2/939: dwrite d0/d2c/fef [0,4194304] 0 2024-09-20T18:35:54.873 INFO:tasks.workunit.client.0.smithi017.stdout:5/284: link d0/d14/d18/d1b/f51 d0/d14/d18/f5a 0 2024-09-20T18:35:54.873 INFO:tasks.workunit.client.0.smithi017.stdout:5/285: readlink d0/d14/d18/l1e 0 2024-09-20T18:35:54.875 INFO:tasks.workunit.client.0.smithi017.stdout:5/286: dread d0/d14/d18/f38 [0,4194304] 0 2024-09-20T18:35:54.879 INFO:tasks.workunit.client.1.smithi172.stdout:6/848: dwrite d0/d18/d1c/d21/d26/d34/da2/dda/d7b/d7e/dd3/f10b [0,4194304] 0 2024-09-20T18:35:54.880 INFO:tasks.workunit.client.0.smithi017.stdout:2/419: write d1/dc/d20/d2e/f38 [1031881,11172] 0 2024-09-20T18:35:54.881 INFO:tasks.workunit.client.1.smithi172.stdout:8/916: dread dd/d1b/f1f [8388608,4194304] 0 2024-09-20T18:35:54.883 INFO:tasks.workunit.client.1.smithi172.stdout:8/917: fsync dd/f3d 0 2024-09-20T18:35:54.889 INFO:tasks.workunit.client.0.smithi017.stdout:2/420: link d1/df/d17/c7e d1/dc/d20/d2e/d30/d85/d53/d6b/c89 0 2024-09-20T18:35:54.890 INFO:tasks.workunit.client.1.smithi172.stdout:8/918: rename dd/d1b/d4f/d86/de8/l119 to dd/d65/d85/da2/l13c 0 2024-09-20T18:35:54.891 INFO:tasks.workunit.client.1.smithi172.stdout:2/940: dwrite d0/d2c/d3f/dab/d22/d4c/f74 [0,4194304] 0 2024-09-20T18:35:54.892 INFO:tasks.workunit.client.1.smithi172.stdout:8/919: dread - dd/d1b/d4f/d9a/dbb/d101/f112 zero size 2024-09-20T18:35:54.893 INFO:tasks.workunit.client.1.smithi172.stdout:2/941: read - d0/d2c/d51/de5/dec/f120 zero size 2024-09-20T18:35:54.895 INFO:tasks.workunit.client.1.smithi172.stdout:2/942: fsync d0/d2c/f63 0 2024-09-20T18:35:54.895 INFO:tasks.workunit.client.1.smithi172.stdout:8/920: symlink dd/d1b/d3b/d51/d5b/d6b/l13d 0 2024-09-20T18:35:54.895 INFO:tasks.workunit.client.0.smithi017.stdout:2/421: dwrite d1/df/f16 [0,4194304] 0 2024-09-20T18:35:54.899 INFO:tasks.workunit.client.1.smithi172.stdout:8/921: fsync dd/d1b/d3b/d51/f8e 0 2024-09-20T18:35:54.900 INFO:tasks.workunit.client.0.smithi017.stdout:5/287: truncate d0/f7 243613 0 2024-09-20T18:35:54.900 INFO:tasks.workunit.client.1.smithi172.stdout:8/922: write dd/d1b/f55 [1810565,36166] 0 2024-09-20T18:35:54.901 INFO:tasks.workunit.client.0.smithi017.stdout:2/422: dread d1/d1f/f3f [0,4194304] 0 2024-09-20T18:35:54.902 INFO:tasks.workunit.client.1.smithi172.stdout:6/849: write d0/d18/d1c/d21/f88 [4887796,47802] 0 2024-09-20T18:35:54.904 INFO:tasks.workunit.client.1.smithi172.stdout:2/943: mknod d0/d2c/d3f/dab/d22/d10/d35/dc4/c136 0 2024-09-20T18:35:54.909 INFO:tasks.workunit.client.0.smithi017.stdout:5/288: rename d0/d14/d18/l1e to d0/d14/d40/l5b 0 2024-09-20T18:35:54.910 INFO:tasks.workunit.client.1.smithi172.stdout:9/906: sync 2024-09-20T18:35:54.910 INFO:tasks.workunit.client.1.smithi172.stdout:3/996: sync 2024-09-20T18:35:54.911 INFO:tasks.workunit.client.1.smithi172.stdout:3/997: fdatasync d0/d13/dfb/f127 0 2024-09-20T18:35:54.913 INFO:tasks.workunit.client.1.smithi172.stdout:2/944: fsync d0/d2c/d3f/dab/d18/d29/d42/d4b/d53/fc9 0 2024-09-20T18:35:54.914 INFO:tasks.workunit.client.0.smithi017.stdout:5/289: creat d0/d14/d18/d1b/f5c x:0 0 0 2024-09-20T18:35:54.915 INFO:tasks.workunit.client.1.smithi172.stdout:8/923: fdatasync dd/f27 0 2024-09-20T18:35:54.916 INFO:tasks.workunit.client.0.smithi017.stdout:5/290: write d0/d14/d18/d2a/d39/f53 [1031550,38559] 0 2024-09-20T18:35:54.917 INFO:tasks.workunit.client.1.smithi172.stdout:3/998: truncate d0/d13/d32/d54/d83/f122 465227 0 2024-09-20T18:35:54.918 INFO:tasks.workunit.client.0.smithi017.stdout:5/291: unlink d0/f4f 0 2024-09-20T18:35:54.919 INFO:tasks.workunit.client.1.smithi172.stdout:9/907: dwrite d15/d20/fd5 [4194304,4194304] 0 2024-09-20T18:35:54.920 INFO:tasks.workunit.client.1.smithi172.stdout:2/945: unlink d0/d2c/d3f/dab/d18/f6e 0 2024-09-20T18:35:54.922 INFO:tasks.workunit.client.1.smithi172.stdout:8/924: creat dd/de3/d10c/f13e x:0 0 0 2024-09-20T18:35:54.924 INFO:tasks.workunit.client.1.smithi172.stdout:3/999: rmdir d0/d13/d32/d54/d71/d124 39 2024-09-20T18:35:54.927 INFO:tasks.workunit.client.1.smithi172.stdout:2/946: rename d0/fd9 to d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/d9f/f137 0 2024-09-20T18:35:54.929 INFO:tasks.workunit.client.1.smithi172.stdout:8/925: dwrite dd/d65/d85/f8b [0,4194304] 0 2024-09-20T18:35:54.930 INFO:tasks.workunit.client.0.smithi017.stdout:5/292: getdents d0/d14/d18/d19 0 2024-09-20T18:35:54.931 INFO:tasks.workunit.client.1.smithi172.stdout:2/947: mkdir d0/d2c/d3f/dab/d22/ded/d138 0 2024-09-20T18:35:54.932 INFO:tasks.workunit.client.0.smithi017.stdout:2/423: dwrite d1/dc/d20/d2e/d30/d85/d46/f63 [0,4194304] 0 2024-09-20T18:35:54.933 INFO:tasks.workunit.client.0.smithi017.stdout:2/424: truncate d1/d1f/f6e 1449177 0 2024-09-20T18:35:54.934 INFO:tasks.workunit.client.0.smithi017.stdout:5/293: creat d0/d14/d18/d57/f5d x:0 0 0 2024-09-20T18:35:54.935 INFO:tasks.workunit.client.0.smithi017.stdout:2/425: fsync d1/df/d17/f64 0 2024-09-20T18:35:54.935 INFO:tasks.workunit.client.0.smithi017.stdout:5/294: stat d0/d14/d18/d57 0 2024-09-20T18:35:54.936 INFO:tasks.workunit.client.0.smithi017.stdout:5/295: stat d0/l9 0 2024-09-20T18:35:54.937 INFO:tasks.workunit.client.1.smithi172.stdout:2/948: creat d0/d2c/d3f/f139 x:0 0 0 2024-09-20T18:35:54.938 INFO:tasks.workunit.client.1.smithi172.stdout:8/926: dwrite dd/d1b/d3b/d51/dac/fbe [4194304,4194304] 0 2024-09-20T18:35:54.940 INFO:tasks.workunit.client.0.smithi017.stdout:5/296: unlink d0/d14/d18/d2a/l2b 0 2024-09-20T18:35:54.947 INFO:tasks.workunit.client.1.smithi172.stdout:8/927: link dd/d1b/d3b/d51/d5b/daf/f6e dd/de3/d10c/f13f 0 2024-09-20T18:35:54.948 INFO:tasks.workunit.client.0.smithi017.stdout:5/297: creat d0/d14/d18/d57/f5e x:0 0 0 2024-09-20T18:35:54.949 INFO:tasks.workunit.client.0.smithi017.stdout:2/426: getdents d1/dc/d20/d2e/d30/d85/d46/d48 0 2024-09-20T18:35:54.951 INFO:tasks.workunit.client.0.smithi017.stdout:2/427: mkdir d1/dc/d20/d2e/d30/d8a 0 2024-09-20T18:35:54.951 INFO:tasks.workunit.client.0.smithi017.stdout:2/428: readlink d1/dc/d20/d2e/d30/l57 0 2024-09-20T18:35:54.953 INFO:tasks.workunit.client.0.smithi017.stdout:5/298: rename d0/d14/d18/d1b/l43 to d0/d14/d18/d19/l5f 0 2024-09-20T18:35:54.955 INFO:tasks.workunit.client.1.smithi172.stdout:8/928: link dd/d1b/f1f dd/d65/df5/f140 0 2024-09-20T18:35:54.955 INFO:tasks.workunit.client.0.smithi017.stdout:8/261: sync 2024-09-20T18:35:54.955 INFO:tasks.workunit.client.0.smithi017.stdout:6/303: sync 2024-09-20T18:35:54.955 INFO:tasks.workunit.client.0.smithi017.stdout:0/280: sync 2024-09-20T18:35:54.955 INFO:tasks.workunit.client.0.smithi017.stdout:7/322: sync 2024-09-20T18:35:54.955 INFO:tasks.workunit.client.0.smithi017.stdout:9/362: sync 2024-09-20T18:35:54.956 INFO:tasks.workunit.client.0.smithi017.stdout:1/252: sync 2024-09-20T18:35:54.956 INFO:tasks.workunit.client.0.smithi017.stdout:4/248: sync 2024-09-20T18:35:54.956 INFO:tasks.workunit.client.1.smithi172.stdout:8/929: readlink dd/d65/df5/l10b 0 2024-09-20T18:35:54.956 INFO:tasks.workunit.client.1.smithi172.stdout:8/930: chown dd/d1b/d4f/d9a/dbb/d101/f11f 902308 1 2024-09-20T18:35:54.958 INFO:tasks.workunit.client.0.smithi017.stdout:5/299: dread d0/d14/d18/d2a/f37 [0,4194304] 0 2024-09-20T18:35:54.961 INFO:tasks.workunit.client.0.smithi017.stdout:8/262: dread d0/d6/f3e [0,4194304] 0 2024-09-20T18:35:54.963 INFO:tasks.workunit.client.0.smithi017.stdout:8/263: write d0/d6/d28/d3a/f49 [592367,121684] 0 2024-09-20T18:35:54.965 INFO:tasks.workunit.client.0.smithi017.stdout:5/300: mknod d0/d14/d18/d2a/d39/d42/c60 0 2024-09-20T18:35:54.965 INFO:tasks.workunit.client.0.smithi017.stdout:5/301: chown d0/d14 27036038 1 2024-09-20T18:35:54.966 INFO:tasks.workunit.client.0.smithi017.stdout:5/302: read - d0/d14/d18/d1b/f3d zero size 2024-09-20T18:35:54.968 INFO:tasks.workunit.client.0.smithi017.stdout:8/264: creat d0/d6/f54 x:0 0 0 2024-09-20T18:35:54.971 INFO:tasks.workunit.client.0.smithi017.stdout:0/281: creat d4/db/d1e/d24/d2f/d51/d52/f56 x:0 0 0 2024-09-20T18:35:54.973 INFO:tasks.workunit.client.0.smithi017.stdout:5/303: creat d0/d14/d18/d2a/d39/f61 x:0 0 0 2024-09-20T18:35:54.975 INFO:tasks.workunit.client.0.smithi017.stdout:4/249: link d4/d19/c47 d4/c52 0 2024-09-20T18:35:54.977 INFO:tasks.workunit.client.0.smithi017.stdout:0/282: rename d4/db/f49 to d4/db/d1e/d24/d2f/d51/d52/f57 0 2024-09-20T18:35:54.980 INFO:tasks.workunit.client.0.smithi017.stdout:5/304: dwrite d0/d14/d18/d2a/d39/f50 [0,4194304] 0 2024-09-20T18:35:54.982 INFO:tasks.workunit.client.0.smithi017.stdout:2/429: write d1/dc/d20/d2e/d30/f4b [991312,36743] 0 2024-09-20T18:35:54.984 INFO:tasks.workunit.client.0.smithi017.stdout:5/305: rmdir d0/d13 39 2024-09-20T18:35:54.985 INFO:tasks.workunit.client.1.smithi172.stdout:8/931: write dd/d65/df5/f140 [2442102,60557] 0 2024-09-20T18:35:54.990 INFO:tasks.workunit.client.0.smithi017.stdout:0/283: link d4/l21 d4/l58 0 2024-09-20T18:35:54.994 INFO:tasks.workunit.client.0.smithi017.stdout:2/430: rename d1/dc/d20/d2e/d30/d85/d53/d6b/f6d to d1/df/d17/f8b 0 2024-09-20T18:35:54.995 INFO:tasks.workunit.client.0.smithi017.stdout:9/363: dwrite d6/d11/f21 [0,4194304] 0 2024-09-20T18:35:54.998 INFO:tasks.workunit.client.0.smithi017.stdout:8/265: write d0/d6/d28/f2d [4844782,87641] 0 2024-09-20T18:35:54.998 INFO:tasks.workunit.client.0.smithi017.stdout:6/304: dwrite d4/df/f15 [0,4194304] 0 2024-09-20T18:35:54.999 INFO:tasks.workunit.client.0.smithi017.stdout:0/284: creat d4/db/d1e/d24/f59 x:0 0 0 2024-09-20T18:35:55.001 INFO:tasks.workunit.client.0.smithi017.stdout:1/253: dwrite df/f18 [4194304,4194304] 0 2024-09-20T18:35:55.007 INFO:tasks.workunit.client.1.smithi172.stdout:1/926: sync 2024-09-20T18:35:55.007 INFO:tasks.workunit.client.1.smithi172.stdout:4/959: sync 2024-09-20T18:35:55.008 INFO:tasks.workunit.client.0.smithi017.stdout:9/364: dwrite d6/d23/d58/d3f/d5f/f65 [0,4194304] 0 2024-09-20T18:35:55.008 INFO:tasks.workunit.client.1.smithi172.stdout:1/927: readlink d0/d8/db/d39/l3b 0 2024-09-20T18:35:55.009 INFO:tasks.workunit.client.0.smithi017.stdout:6/305: mkdir d4/d64 0 2024-09-20T18:35:55.011 INFO:tasks.workunit.client.0.smithi017.stdout:5/306: rename d0/d14/d18/f30 to d0/d14/d18/d2a/d39/d42/f62 0 2024-09-20T18:35:55.014 INFO:tasks.workunit.client.0.smithi017.stdout:9/365: truncate d6/d23/d58/d3f/d5f/f8c 816707 0 2024-09-20T18:35:55.015 INFO:tasks.workunit.client.1.smithi172.stdout:1/928: symlink d0/d8/d109/l131 0 2024-09-20T18:35:55.017 INFO:tasks.workunit.client.1.smithi172.stdout:1/929: write d0/d8/db/d25/d2b/d3d/d104/f10a [797722,24368] 0 2024-09-20T18:35:55.017 INFO:tasks.workunit.client.1.smithi172.stdout:4/960: creat d0/d48/d90/d55/d53/d5c/d10e/d133/d110/f14d x:0 0 0 2024-09-20T18:35:55.017 INFO:tasks.workunit.client.0.smithi017.stdout:9/366: write d6/f14 [294673,125167] 0 2024-09-20T18:35:55.021 INFO:tasks.workunit.client.0.smithi017.stdout:6/306: dwrite d4/d37/d41/d43/f51 [0,4194304] 0 2024-09-20T18:35:55.021 INFO:tasks.workunit.client.1.smithi172.stdout:4/961: stat d0/de/dc/d3c/d99/fce 0 2024-09-20T18:35:55.022 INFO:tasks.workunit.client.1.smithi172.stdout:1/930: rmdir d0/d8/db/d25/d2b/d3d/d65/d93 39 2024-09-20T18:35:55.022 INFO:tasks.workunit.client.0.smithi017.stdout:5/307: truncate d0/d14/d18/d1b/f24 118205 0 2024-09-20T18:35:55.028 INFO:tasks.workunit.client.1.smithi172.stdout:4/962: creat d0/de/d39/d9f/f14e x:0 0 0 2024-09-20T18:35:55.028 INFO:tasks.workunit.client.0.smithi017.stdout:5/308: chown d0/d14/d18/d2a/d39/d42/c60 5 1 2024-09-20T18:35:55.028 INFO:tasks.workunit.client.0.smithi017.stdout:6/307: symlink d4/d37/d41/d43/l65 0 2024-09-20T18:35:55.028 INFO:tasks.workunit.client.0.smithi017.stdout:9/367: mknod d6/d23/d58/d3f/d4d/c92 0 2024-09-20T18:35:55.030 INFO:tasks.workunit.client.1.smithi172.stdout:4/963: rename d0/d48/d90/d55/d53/d78/f125 to d0/d48/d90/dea/d10f/d12f/f14f 0 2024-09-20T18:35:55.032 INFO:tasks.workunit.client.0.smithi017.stdout:9/368: mkdir d6/d23/d58/d3f/d4d/d73/d93 0 2024-09-20T18:35:55.033 INFO:tasks.workunit.client.1.smithi172.stdout:4/964: creat d0/de/d39/d9f/de8/f150 x:0 0 0 2024-09-20T18:35:55.034 INFO:tasks.workunit.client.1.smithi172.stdout:1/931: getdents d0/d8/db/d25/d6f 0 2024-09-20T18:35:55.037 INFO:tasks.workunit.client.0.smithi017.stdout:9/369: creat d6/d23/d58/f94 x:0 0 0 2024-09-20T18:35:55.038 INFO:tasks.workunit.client.0.smithi017.stdout:9/370: chown d6/d23/d40/d4a 0 1 2024-09-20T18:35:55.038 INFO:tasks.workunit.client.0.smithi017.stdout:1/254: write df/d1c/f1e [427355,22105] 0 2024-09-20T18:35:55.039 INFO:tasks.workunit.client.0.smithi017.stdout:5/309: link d0/d14/d18/f3b d0/d14/d40/f63 0 2024-09-20T18:35:55.040 INFO:tasks.workunit.client.0.smithi017.stdout:1/255: chown df/f2b 607 1 2024-09-20T18:35:55.042 INFO:tasks.workunit.client.0.smithi017.stdout:2/431: write d1/dc/d20/d2e/d30/d85/f7d [3295680,60133] 0 2024-09-20T18:35:55.044 INFO:tasks.workunit.client.1.smithi172.stdout:1/932: mknod d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/c132 0 2024-09-20T18:35:55.046 INFO:tasks.workunit.client.0.smithi017.stdout:5/310: stat d0/d14/d18/f2f 0 2024-09-20T18:35:55.046 INFO:tasks.workunit.client.0.smithi017.stdout:1/256: rmdir df/d16 39 2024-09-20T18:35:55.047 INFO:tasks.workunit.client.0.smithi017.stdout:9/371: dwrite d6/d23/f54 [4194304,4194304] 0 2024-09-20T18:35:55.048 INFO:tasks.workunit.client.1.smithi172.stdout:4/965: dread d0/de/f4c [0,4194304] 0 2024-09-20T18:35:55.049 INFO:tasks.workunit.client.0.smithi017.stdout:9/372: fdatasync d6/f34 0 2024-09-20T18:35:55.051 INFO:tasks.workunit.client.1.smithi172.stdout:1/933: getdents d0/d8/db/d39 0 2024-09-20T18:35:55.054 INFO:tasks.workunit.client.0.smithi017.stdout:2/432: dread d1/dc/d20/d2e/f5f [0,4194304] 0 2024-09-20T18:35:55.056 INFO:tasks.workunit.client.1.smithi172.stdout:4/966: rename d0/d48/d90/d55/d53/d5c/f75 to d0/d48/d90/f151 0 2024-09-20T18:35:55.058 INFO:tasks.workunit.client.1.smithi172.stdout:1/934: truncate d0/d8/db/d25/d2b/d3d/d65/fc0 980682 0 2024-09-20T18:35:55.060 INFO:tasks.workunit.client.0.smithi017.stdout:5/311: dwrite d0/fe [4194304,4194304] 0 2024-09-20T18:35:55.064 INFO:tasks.workunit.client.1.smithi172.stdout:4/967: dwrite d0/d48/d90/d55/d101/d18/f103 [0,4194304] 0 2024-09-20T18:35:55.064 INFO:tasks.workunit.client.0.smithi017.stdout:1/257: dwrite df/d16/f21 [0,4194304] 0 2024-09-20T18:35:55.065 INFO:tasks.workunit.client.0.smithi017.stdout:6/308: dread d4/df/d4a/d5f/f2f [0,4194304] 0 2024-09-20T18:35:55.066 INFO:tasks.workunit.client.0.smithi017.stdout:9/373: dwrite d6/d23/d58/d3f/d5f/f6e [0,4194304] 0 2024-09-20T18:35:55.067 INFO:tasks.workunit.client.0.smithi017.stdout:5/312: rmdir d0/d14 39 2024-09-20T18:35:55.077 INFO:tasks.workunit.client.1.smithi172.stdout:4/968: rmdir d0/d48/d90/d55/d53/d5c/d10e/d133/d110 39 2024-09-20T18:35:55.080 INFO:tasks.workunit.client.1.smithi172.stdout:1/935: dread d0/d8/db/d25/f49 [4194304,4194304] 0 2024-09-20T18:35:55.082 INFO:tasks.workunit.client.0.smithi017.stdout:2/433: link d1/df/c1b d1/dc/d20/d2e/c8c 0 2024-09-20T18:35:55.085 INFO:tasks.workunit.client.1.smithi172.stdout:4/969: truncate d0/d48/d90/d55/d53/d78/fd0 1248529 0 2024-09-20T18:35:55.085 INFO:tasks.workunit.client.0.smithi017.stdout:1/258: symlink df/d29/l4a 0 2024-09-20T18:35:55.086 INFO:tasks.workunit.client.1.smithi172.stdout:6/850: sync 2024-09-20T18:35:55.086 INFO:tasks.workunit.client.1.smithi172.stdout:7/968: sync 2024-09-20T18:35:55.086 INFO:tasks.workunit.client.1.smithi172.stdout:5/980: sync 2024-09-20T18:35:55.087 INFO:tasks.workunit.client.0.smithi017.stdout:5/313: dwrite d0/d14/d18/d2a/d39/f50 [4194304,4194304] 0 2024-09-20T18:35:55.089 INFO:tasks.workunit.client.0.smithi017.stdout:2/434: dread d1/df/f16 [0,4194304] 0 2024-09-20T18:35:55.095 INFO:tasks.workunit.client.1.smithi172.stdout:7/969: fdatasync d2/d3/d11a/f141 0 2024-09-20T18:35:55.096 INFO:tasks.workunit.client.1.smithi172.stdout:7/970: chown d2/d3/d10/d40/d46/d8e/dbd/lf2 461842 1 2024-09-20T18:35:55.097 INFO:tasks.workunit.client.1.smithi172.stdout:6/851: fsync d0/d18/d1c/d21/d26/d34/da2/dda/f8c 0 2024-09-20T18:35:55.098 INFO:tasks.workunit.client.0.smithi017.stdout:6/309: rmdir d4/d64 0 2024-09-20T18:35:55.099 INFO:tasks.workunit.client.1.smithi172.stdout:4/970: mknod d0/de/c152 0 2024-09-20T18:35:55.100 INFO:tasks.workunit.client.0.smithi017.stdout:1/259: symlink df/d29/d2c/d42/l4b 0 2024-09-20T18:35:55.102 INFO:tasks.workunit.client.0.smithi017.stdout:2/435: mkdir d1/dc/d20/d2e/d30/d85/d3d/d8d 0 2024-09-20T18:35:55.104 INFO:tasks.workunit.client.1.smithi172.stdout:6/852: dwrite d0/d18/d1c/d21/d26/d34/da2/dda/d7b/d7e/dd3/f10b [0,4194304] 0 2024-09-20T18:35:55.106 INFO:tasks.workunit.client.1.smithi172.stdout:4/971: truncate d0/de/dc/d3c/d99/fe0 718848 0 2024-09-20T18:35:55.106 INFO:tasks.workunit.client.0.smithi017.stdout:5/314: mknod d0/c64 0 2024-09-20T18:35:55.108 INFO:tasks.workunit.client.0.smithi017.stdout:5/315: write d0/d14/d18/f2f [301908,114953] 0 2024-09-20T18:35:55.109 INFO:tasks.workunit.client.0.smithi017.stdout:5/316: readlink d0/l11 0 2024-09-20T18:35:55.110 INFO:tasks.workunit.client.1.smithi172.stdout:7/971: rename d2/d3/d10/d40/d46/d8e/dbd/cff to d2/dcc/d12f/c146 0 2024-09-20T18:35:55.113 INFO:tasks.workunit.client.1.smithi172.stdout:6/853: creat d0/d18/d1c/d21/d26/d34/da2/f117 x:0 0 0 2024-09-20T18:35:55.114 INFO:tasks.workunit.client.0.smithi017.stdout:2/436: unlink d1/dc/d20/d2e/d30/d85/d53/c60 0 2024-09-20T18:35:55.119 INFO:tasks.workunit.client.1.smithi172.stdout:4/972: mknod d0/d48/d90/d55/d53/c153 0 2024-09-20T18:35:55.119 INFO:tasks.workunit.client.0.smithi017.stdout:1/260: creat df/d16/d32/f4c x:0 0 0 2024-09-20T18:35:55.121 INFO:tasks.workunit.client.1.smithi172.stdout:7/972: symlink d2/d23/d3c/l147 0 2024-09-20T18:35:55.121 INFO:tasks.workunit.client.0.smithi017.stdout:5/317: write d0/d14/d18/d2a/d39/d42/f49 [7225578,100681] 0 2024-09-20T18:35:55.122 INFO:tasks.workunit.client.1.smithi172.stdout:6/854: symlink d0/d18/d65/l118 0 2024-09-20T18:35:55.123 INFO:tasks.workunit.client.0.smithi017.stdout:2/437: symlink d1/dc/d20/d2e/l8e 0 2024-09-20T18:35:55.125 INFO:tasks.workunit.client.0.smithi017.stdout:9/374: truncate d6/d23/d3a/d61/f78 1291192 0 2024-09-20T18:35:55.126 INFO:tasks.workunit.client.0.smithi017.stdout:1/261: read df/d29/d2c/f3f [41068,88500] 0 2024-09-20T18:35:55.128 INFO:tasks.workunit.client.0.smithi017.stdout:9/375: truncate d6/d23/d58/d3f/d44/f47 1644534 0 2024-09-20T18:35:55.131 INFO:tasks.workunit.client.1.smithi172.stdout:5/981: dwrite d4/df/d3f/f10e [0,4194304] 0 2024-09-20T18:35:55.132 INFO:tasks.workunit.client.0.smithi017.stdout:2/438: dwrite d1/df/d17/f1a [0,4194304] 0 2024-09-20T18:35:55.133 INFO:tasks.workunit.client.0.smithi017.stdout:1/262: symlink df/d1c/l4d 0 2024-09-20T18:35:55.134 INFO:tasks.workunit.client.1.smithi172.stdout:5/982: write d4/df/dad/d26/d41/d69/db9/f12f [406966,100487] 0 2024-09-20T18:35:55.135 INFO:tasks.workunit.client.1.smithi172.stdout:4/973: dread d0/de/d21/d24/f2d [0,4194304] 0 2024-09-20T18:35:55.137 INFO:tasks.workunit.client.1.smithi172.stdout:9/908: sync 2024-09-20T18:35:55.137 INFO:tasks.workunit.client.1.smithi172.stdout:8/932: sync 2024-09-20T18:35:55.137 INFO:tasks.workunit.client.1.smithi172.stdout:2/949: sync 2024-09-20T18:35:55.140 INFO:tasks.workunit.client.0.smithi017.stdout:9/376: creat d6/d23/d58/d3f/d2f/f95 x:0 0 0 2024-09-20T18:35:55.141 INFO:tasks.workunit.client.1.smithi172.stdout:6/855: mknod d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0/c119 0 2024-09-20T18:35:55.143 INFO:tasks.workunit.client.0.smithi017.stdout:2/439: mkdir d1/d67/d8f 0 2024-09-20T18:35:55.146 INFO:tasks.workunit.client.0.smithi017.stdout:1/263: dwrite df/f1a [0,4194304] 0 2024-09-20T18:35:55.151 INFO:tasks.workunit.client.0.smithi017.stdout:1/264: symlink df/d1c/l4e 0 2024-09-20T18:35:55.156 INFO:tasks.workunit.client.1.smithi172.stdout:9/909: dread d15/d1a/d82/f2e [0,4194304] 0 2024-09-20T18:35:55.157 INFO:tasks.workunit.client.0.smithi017.stdout:6/310: truncate d4/d37/f4d 297227 0 2024-09-20T18:35:55.158 INFO:tasks.workunit.client.1.smithi172.stdout:6/856: dread - d0/d18/d1c/d21/d26/d34/da2/dda/d7b/d7e/fc5 zero size 2024-09-20T18:35:55.160 INFO:tasks.workunit.client.0.smithi017.stdout:1/265: mkdir df/d35/d4f 0 2024-09-20T18:35:55.160 INFO:tasks.workunit.client.0.smithi017.stdout:1/266: read df/d29/f40 [127956,45079] 0 2024-09-20T18:35:55.161 INFO:tasks.workunit.client.1.smithi172.stdout:7/973: getdents d2/d3 0 2024-09-20T18:35:55.162 INFO:tasks.workunit.client.1.smithi172.stdout:8/933: dread dd/d65/f7f [0,4194304] 0 2024-09-20T18:35:55.166 INFO:tasks.workunit.client.0.smithi017.stdout:5/318: truncate d0/d14/d18/f2f 321561 0 2024-09-20T18:35:55.168 INFO:tasks.workunit.client.0.smithi017.stdout:6/311: link d4/df/d1f/f57 d4/df/d4a/f66 0 2024-09-20T18:35:55.169 INFO:tasks.workunit.client.0.smithi017.stdout:6/312: dread - d4/df/d4a/f4b zero size 2024-09-20T18:35:55.170 INFO:tasks.workunit.client.1.smithi172.stdout:1/936: sync 2024-09-20T18:35:55.171 INFO:tasks.workunit.client.1.smithi172.stdout:2/950: rename d0/d2c/d3f/dab/d18/d29/d42/c118 to d0/d2c/d3f/dab/d45/ddc/c13a 0 2024-09-20T18:35:55.172 INFO:tasks.workunit.client.0.smithi017.stdout:1/267: fdatasync df/f11 0 2024-09-20T18:35:55.174 INFO:tasks.workunit.client.1.smithi172.stdout:6/857: fdatasync d0/d18/d1c/d21/d26/d34/d6b/f84 0 2024-09-20T18:35:55.176 INFO:tasks.workunit.client.1.smithi172.stdout:8/934: mkdir dd/d1b/d4f/d9a/dbb/d101/d129/d141 0 2024-09-20T18:35:55.177 INFO:tasks.workunit.client.1.smithi172.stdout:6/858: write d0/d18/d1c/d21/d26/d34/d7a/f2e [1205841,12842] 0 2024-09-20T18:35:55.177 INFO:tasks.workunit.client.0.smithi017.stdout:9/377: truncate d6/d23/f54 8008911 0 2024-09-20T18:35:55.178 INFO:tasks.workunit.client.1.smithi172.stdout:7/974: truncate d2/d3/d10/d40/d6a/f8a 2334246 0 2024-09-20T18:35:55.179 INFO:tasks.workunit.client.1.smithi172.stdout:5/983: dwrite d4/df/d98/dcc/d105/f112 [0,4194304] 0 2024-09-20T18:35:55.181 INFO:tasks.workunit.client.1.smithi172.stdout:4/974: link d0/d48/d90/d55/d101/d18/c4a d0/de/d39/d9f/c154 0 2024-09-20T18:35:55.182 INFO:tasks.workunit.client.1.smithi172.stdout:2/951: rmdir d0/d2c 39 2024-09-20T18:35:55.182 INFO:tasks.workunit.client.0.smithi017.stdout:9/378: rmdir d6/d11 39 2024-09-20T18:35:55.188 INFO:tasks.workunit.client.1.smithi172.stdout:8/935: dwrite dd/d65/d85/dab/ff8 [0,4194304] 0 2024-09-20T18:35:55.191 INFO:tasks.workunit.client.1.smithi172.stdout:8/936: truncate dd/d1b/d4f/d9a/f116 91696 0 2024-09-20T18:35:55.192 INFO:tasks.workunit.client.1.smithi172.stdout:5/984: dwrite d4/df/dad/d26/d41/d69/dac/d2c/fff [0,4194304] 0 2024-09-20T18:35:55.193 INFO:tasks.workunit.client.0.smithi017.stdout:5/319: rename d0/d14/l3a to d0/d14/d18/l65 0 2024-09-20T18:35:55.193 INFO:tasks.workunit.client.1.smithi172.stdout:5/985: chown d4/df/dad/d26/d41/d65 221046 1 2024-09-20T18:35:55.193 INFO:tasks.workunit.client.1.smithi172.stdout:7/975: dread d2/d3/f35 [0,4194304] 0 2024-09-20T18:35:55.197 INFO:tasks.workunit.client.0.smithi017.stdout:1/268: getdents df/d1c 0 2024-09-20T18:35:55.198 INFO:tasks.workunit.client.0.smithi017.stdout:9/379: dread d6/d23/d3a/f3c [0,4194304] 0 2024-09-20T18:35:55.199 INFO:tasks.workunit.client.0.smithi017.stdout:9/380: chown d6/d42/f89 222 1 2024-09-20T18:35:55.199 INFO:tasks.workunit.client.0.smithi017.stdout:9/381: chown d6/d23/d40 375834862 1 2024-09-20T18:35:55.202 INFO:tasks.workunit.client.0.smithi017.stdout:9/382: read d6/f14 [4119417,71381] 0 2024-09-20T18:35:55.203 INFO:tasks.workunit.client.0.smithi017.stdout:9/383: dread - d6/d23/f71 zero size 2024-09-20T18:35:55.205 INFO:tasks.workunit.client.0.smithi017.stdout:6/313: rename d4/df to d4/df/d67 22 2024-09-20T18:35:55.207 INFO:tasks.workunit.client.0.smithi017.stdout:6/314: truncate d4/d37/d41/f54 516968 0 2024-09-20T18:35:55.207 INFO:tasks.workunit.client.0.smithi017.stdout:1/269: mkdir df/d16/d50 0 2024-09-20T18:35:55.208 INFO:tasks.workunit.client.0.smithi017.stdout:1/270: chown df/d29/l4a 15479 1 2024-09-20T18:35:55.209 INFO:tasks.workunit.client.0.smithi017.stdout:1/271: stat df/f1a 0 2024-09-20T18:35:55.212 INFO:tasks.workunit.client.1.smithi172.stdout:4/975: mknod d0/de/d39/d9f/de8/d119/c155 0 2024-09-20T18:35:55.213 INFO:tasks.workunit.client.1.smithi172.stdout:4/976: chown d0/d7/df5 38 1 2024-09-20T18:35:55.216 INFO:tasks.workunit.client.1.smithi172.stdout:9/910: creat d15/d1f/d2c/f127 x:0 0 0 2024-09-20T18:35:55.217 INFO:tasks.workunit.client.1.smithi172.stdout:9/911: dread - d15/d4a/d8c/fae zero size 2024-09-20T18:35:55.220 INFO:tasks.workunit.client.0.smithi017.stdout:9/384: mkdir d6/d23/d58/d3f/d4d/d73/d93/d96 0 2024-09-20T18:35:55.222 INFO:tasks.workunit.client.1.smithi172.stdout:8/937: creat dd/d1b/d3b/d5d/df6/f142 x:0 0 0 2024-09-20T18:35:55.222 INFO:tasks.workunit.client.1.smithi172.stdout:1/937: truncate d0/d8/db/d25/d2b/d3d/d65/f66 2928452 0 2024-09-20T18:35:55.223 INFO:tasks.workunit.client.1.smithi172.stdout:7/976: rename d2/d3/d10/d40/l89 to d2/d3/d10/d40/d46/d8e/dbd/dda/l148 0 2024-09-20T18:35:55.225 INFO:tasks.workunit.client.1.smithi172.stdout:2/952: creat d0/d2c/db2/f13b x:0 0 0 2024-09-20T18:35:55.226 INFO:tasks.workunit.client.0.smithi017.stdout:9/385: chown d6/d23/f51 92144 1 2024-09-20T18:35:55.227 INFO:tasks.workunit.client.1.smithi172.stdout:9/912: dread d15/d1a/d82/fef [0,4194304] 0 2024-09-20T18:35:55.227 INFO:tasks.workunit.client.1.smithi172.stdout:4/977: fsync d0/f71 0 2024-09-20T18:35:55.227 INFO:tasks.workunit.client.1.smithi172.stdout:9/913: chown d15/d54/f78 150194440 1 2024-09-20T18:35:55.233 INFO:tasks.workunit.client.0.smithi017.stdout:1/272: write df/f26 [2410907,55087] 0 2024-09-20T18:35:55.238 INFO:tasks.workunit.client.0.smithi017.stdout:9/386: dread d6/d23/f54 [0,4194304] 0 2024-09-20T18:35:55.240 INFO:tasks.workunit.client.1.smithi172.stdout:2/953: dread d0/d1a/d58/f78 [4194304,4194304] 0 2024-09-20T18:35:55.248 INFO:tasks.workunit.client.0.smithi017.stdout:1/273: truncate df/d16/f21 1546941 0 2024-09-20T18:35:55.251 INFO:tasks.workunit.client.0.smithi017.stdout:9/387: truncate d6/f37 2928775 0 2024-09-20T18:35:55.253 INFO:tasks.workunit.client.0.smithi017.stdout:9/388: truncate d6/d23/d58/d3f/d5f/f84 821469 0 2024-09-20T18:35:55.253 INFO:tasks.workunit.client.0.smithi017.stdout:1/274: creat df/f51 x:0 0 0 2024-09-20T18:35:55.254 INFO:tasks.workunit.client.0.smithi017.stdout:1/275: chown df/d1c 121323790 1 2024-09-20T18:35:55.254 INFO:tasks.workunit.client.0.smithi017.stdout:1/276: chown c6 0 1 2024-09-20T18:35:55.255 INFO:tasks.workunit.client.0.smithi017.stdout:1/277: write df/d16/f2e [208211,125231] 0 2024-09-20T18:35:55.255 INFO:tasks.workunit.client.0.smithi017.stdout:9/389: truncate d6/d23/f51 1772548 0 2024-09-20T18:35:55.257 INFO:tasks.workunit.client.0.smithi017.stdout:9/390: readlink d6/d23/d58/d3f/d2f/d5d/l79 0 2024-09-20T18:35:55.258 INFO:tasks.workunit.client.0.smithi017.stdout:1/278: symlink df/d16/d50/l52 0 2024-09-20T18:35:55.261 INFO:tasks.workunit.client.0.smithi017.stdout:9/391: rename d6/d23/d58/d3f/d82/f41 to d6/d23/d58/d3f/d4d/f97 0 2024-09-20T18:35:55.265 INFO:tasks.workunit.client.0.smithi017.stdout:1/279: dwrite df/f1a [0,4194304] 0 2024-09-20T18:35:55.268 INFO:tasks.workunit.client.0.smithi017.stdout:9/392: dread d6/f7 [0,4194304] 0 2024-09-20T18:35:55.269 INFO:tasks.workunit.client.0.smithi017.stdout:1/280: mkdir df/d16/d50/d53 0 2024-09-20T18:35:55.270 INFO:tasks.workunit.client.0.smithi017.stdout:1/281: truncate df/d1c/f1e 2132632 0 2024-09-20T18:35:55.270 INFO:tasks.workunit.client.0.smithi017.stdout:1/282: chown df/d16/d50/d53 23 1 2024-09-20T18:35:55.275 INFO:tasks.workunit.client.0.smithi017.stdout:1/283: dread df/f18 [4194304,4194304] 0 2024-09-20T18:35:55.277 INFO:tasks.workunit.client.0.smithi017.stdout:9/393: getdents d6/d23/d58/d3f/d70 0 2024-09-20T18:35:55.281 INFO:tasks.workunit.client.1.smithi172.stdout:6/859: creat d0/d18/d1c/d21/d26/d34/da2/dda/f11a x:0 0 0 2024-09-20T18:35:55.282 INFO:tasks.workunit.client.0.smithi017.stdout:9/394: mkdir d6/d23/d58/d3f/d2f/d98 0 2024-09-20T18:35:55.283 INFO:tasks.workunit.client.0.smithi017.stdout:9/395: chown d6/d23/d58/d3f/d5f/f65 8106350 1 2024-09-20T18:35:55.283 INFO:tasks.workunit.client.0.smithi017.stdout:1/284: symlink df/d35/d4f/l54 0 2024-09-20T18:35:55.284 INFO:tasks.workunit.client.0.smithi017.stdout:9/396: write d6/d23/f71 [94533,26113] 0 2024-09-20T18:35:55.286 INFO:tasks.workunit.client.0.smithi017.stdout:9/397: dread - d6/d23/d58/d3f/d2f/f8e zero size 2024-09-20T18:35:55.286 INFO:tasks.workunit.client.1.smithi172.stdout:7/977: chown d2/d3/d10/d40/d6a/la4 433 1 2024-09-20T18:35:55.288 INFO:tasks.workunit.client.0.smithi017.stdout:1/285: rmdir df/d35/d4f 39 2024-09-20T18:35:55.289 INFO:tasks.workunit.client.0.smithi017.stdout:1/286: stat df/d29/d2c/c2f 0 2024-09-20T18:35:55.290 INFO:tasks.workunit.client.1.smithi172.stdout:9/914: mkdir d15/d1a/d64/d128 0 2024-09-20T18:35:55.292 INFO:tasks.workunit.client.0.smithi017.stdout:9/398: dwrite d6/d23/d58/d3f/d2f/f95 [0,4194304] 0 2024-09-20T18:35:55.295 INFO:tasks.workunit.client.0.smithi017.stdout:1/287: unlink df/d35/l49 0 2024-09-20T18:35:55.296 INFO:tasks.workunit.client.1.smithi172.stdout:9/915: dwrite d15/d1f/d2c/d7d/d48/df0/ff9 [0,4194304] 0 2024-09-20T18:35:55.296 INFO:tasks.workunit.client.0.smithi017.stdout:1/288: chown df/d1c/l4d 26 1 2024-09-20T18:35:55.301 INFO:tasks.workunit.client.1.smithi172.stdout:5/986: creat d4/df/d3f/d64/d101/f142 x:0 0 0 2024-09-20T18:35:55.303 INFO:tasks.workunit.client.1.smithi172.stdout:1/938: creat d0/d12c/f133 x:0 0 0 2024-09-20T18:35:55.304 INFO:tasks.workunit.client.0.smithi017.stdout:1/289: symlink df/d1c/d45/l55 0 2024-09-20T18:35:55.305 INFO:tasks.workunit.client.1.smithi172.stdout:4/978: sync 2024-09-20T18:35:55.306 INFO:tasks.workunit.client.1.smithi172.stdout:4/979: chown d0/de/d21/dc7/lf0 4284 1 2024-09-20T18:35:55.307 INFO:tasks.workunit.client.0.smithi017.stdout:1/290: dread df/f36 [0,4194304] 0 2024-09-20T18:35:55.309 INFO:tasks.workunit.client.1.smithi172.stdout:9/916: rmdir d15/d1f/d2c/d7d/d48/df0 39 2024-09-20T18:35:55.310 INFO:tasks.workunit.client.1.smithi172.stdout:9/917: chown d15/d20/f73 644 1 2024-09-20T18:35:55.311 INFO:tasks.workunit.client.1.smithi172.stdout:6/860: mkdir d0/d18/d1c/d21/d26/d34/da2/d113/d11b 0 2024-09-20T18:35:55.311 INFO:tasks.workunit.client.1.smithi172.stdout:4/980: dwrite d0/d48/d90/d55/f132 [0,4194304] 0 2024-09-20T18:35:55.313 INFO:tasks.workunit.client.1.smithi172.stdout:4/981: chown d0/de/dc/fd7 13406 1 2024-09-20T18:35:55.317 INFO:tasks.workunit.client.0.smithi017.stdout:1/291: getdents df/d1c 0 2024-09-20T18:35:55.318 INFO:tasks.workunit.client.0.smithi017.stdout:1/292: fdatasync df/d1c/f1e 0 2024-09-20T18:35:55.320 INFO:tasks.workunit.client.1.smithi172.stdout:8/938: dwrite dd/d1b/d4f/d9a/fe1 [0,4194304] 0 2024-09-20T18:35:55.320 INFO:tasks.workunit.client.1.smithi172.stdout:9/918: mkdir d15/d1f/d2c/d6e/d129 0 2024-09-20T18:35:55.322 INFO:tasks.workunit.client.0.smithi017.stdout:9/399: write d6/d23/d3a/f3c [1384774,57391] 0 2024-09-20T18:35:55.323 INFO:tasks.workunit.client.1.smithi172.stdout:1/939: dwrite d0/f10 [0,4194304] 0 2024-09-20T18:35:55.323 INFO:tasks.workunit.client.1.smithi172.stdout:6/861: mknod d0/d18/d1c/d21/d26/d34/da2/def/dff/ddc/c11c 0 2024-09-20T18:35:55.326 INFO:tasks.workunit.client.1.smithi172.stdout:8/939: write dd/d1b/d3b/d5d/ff9 [859607,87948] 0 2024-09-20T18:35:55.327 INFO:tasks.workunit.client.1.smithi172.stdout:4/982: symlink d0/d7/d6f/l156 0 2024-09-20T18:35:55.332 INFO:tasks.workunit.client.1.smithi172.stdout:2/954: dread d0/d2c/d3f/dab/d22/d10/f93 [0,4194304] 0 2024-09-20T18:35:55.333 INFO:tasks.workunit.client.1.smithi172.stdout:5/987: rename d4/df/d3f/d64/d101/l115 to d4/l143 0 2024-09-20T18:35:55.333 INFO:tasks.workunit.client.1.smithi172.stdout:2/955: dread - d0/d2c/d3f/dab/d22/d4c/fea zero size 2024-09-20T18:35:55.333 INFO:tasks.workunit.client.0.smithi017.stdout:1/293: link df/d1c/f25 df/d29/f56 0 2024-09-20T18:35:55.333 INFO:tasks.workunit.client.0.smithi017.stdout:1/294: fsync fc 0 2024-09-20T18:35:55.333 INFO:tasks.workunit.client.1.smithi172.stdout:2/956: fsync d0/d2c/f3d 0 2024-09-20T18:35:55.334 INFO:tasks.workunit.client.1.smithi172.stdout:9/919: dread - d15/d1f/d2c/d7d/d48/df0/f114 zero size 2024-09-20T18:35:55.335 INFO:tasks.workunit.client.0.smithi017.stdout:1/295: write df/d1c/f3c [665507,107658] 0 2024-09-20T18:35:55.335 INFO:tasks.workunit.client.0.smithi017.stdout:9/400: creat d6/d23/d58/d3f/d4d/d73/d8f/f99 x:0 0 0 2024-09-20T18:35:55.336 INFO:tasks.workunit.client.0.smithi017.stdout:9/401: dread - d6/d23/f7a zero size 2024-09-20T18:35:55.337 INFO:tasks.workunit.client.1.smithi172.stdout:7/978: truncate d2/dcc/f105 182667 0 2024-09-20T18:35:55.340 INFO:tasks.workunit.client.0.smithi017.stdout:1/296: creat df/d1c/d45/f57 x:0 0 0 2024-09-20T18:35:55.341 INFO:tasks.workunit.client.1.smithi172.stdout:8/940: mkdir dd/d1b/d4f/d86/d143 0 2024-09-20T18:35:55.342 INFO:tasks.workunit.client.1.smithi172.stdout:8/941: write dd/d1b/d3b/d51/dbd/f118 [828829,193] 0 2024-09-20T18:35:55.343 INFO:tasks.workunit.client.0.smithi017.stdout:1/297: creat df/d16/f58 x:0 0 0 2024-09-20T18:35:55.346 INFO:tasks.workunit.client.0.smithi017.stdout:1/298: symlink df/d29/d2c/d42/l59 0 2024-09-20T18:35:55.346 INFO:tasks.workunit.client.1.smithi172.stdout:6/862: symlink d0/d18/d1c/d21/d26/d34/d39/d74/dbf/d110/l11d 0 2024-09-20T18:35:55.346 INFO:tasks.workunit.client.0.smithi017.stdout:1/299: dread df/d29/d2c/f3f [0,4194304] 0 2024-09-20T18:35:55.347 INFO:tasks.workunit.client.1.smithi172.stdout:8/942: read - dd/d1b/d3b/f4a zero size 2024-09-20T18:35:55.347 INFO:tasks.workunit.client.0.smithi017.stdout:1/300: write df/d1c/d45/f57 [233157,72984] 0 2024-09-20T18:35:55.348 INFO:tasks.workunit.client.1.smithi172.stdout:9/920: rename d15/d1a/f91 to d15/d1a/dfb/f12a 0 2024-09-20T18:35:55.352 INFO:tasks.workunit.client.1.smithi172.stdout:8/943: creat dd/d1b/d3b/d51/dac/d12b/f144 x:0 0 0 2024-09-20T18:35:55.352 INFO:tasks.workunit.client.0.smithi017.stdout:3/462: sync 2024-09-20T18:35:55.353 INFO:tasks.workunit.client.0.smithi017.stdout:1/301: creat df/f5a x:0 0 0 2024-09-20T18:35:55.354 INFO:tasks.workunit.client.1.smithi172.stdout:7/979: creat d2/d3/d10/f149 x:0 0 0 2024-09-20T18:35:55.354 INFO:tasks.workunit.client.1.smithi172.stdout:5/988: link d4/df/d3f/f49 d4/df/d98/dcc/d105/f144 0 2024-09-20T18:35:55.358 INFO:tasks.workunit.client.1.smithi172.stdout:2/957: getdents d0/d2c/d3f/dab/d18/d29/d42/d4b/d53 0 2024-09-20T18:35:55.359 INFO:tasks.workunit.client.1.smithi172.stdout:8/944: dwrite dd/d1b/d4f/d9a/dbb/d101/f112 [0,4194304] 0 2024-09-20T18:35:55.360 INFO:tasks.workunit.client.1.smithi172.stdout:8/945: chown dd/d1b/d3b/d51/d5b/daf/d4d 25970 1 2024-09-20T18:35:55.362 INFO:tasks.workunit.client.0.smithi017.stdout:1/302: dread df/f26 [0,4194304] 0 2024-09-20T18:35:55.362 INFO:tasks.workunit.client.1.smithi172.stdout:1/940: write d0/d8/d5f/d113/d96/f9e [349961,90186] 0 2024-09-20T18:35:55.363 INFO:tasks.workunit.client.0.smithi017.stdout:1/303: write df/d1c/d45/f57 [967611,4233] 0 2024-09-20T18:35:55.366 INFO:tasks.workunit.client.1.smithi172.stdout:2/958: creat d0/d2c/d3f/dab/d45/ddc/d107/f13c x:0 0 0 2024-09-20T18:35:55.368 INFO:tasks.workunit.client.0.smithi017.stdout:3/463: getdents da/de/d13/d2f/d26/d31/d5a 0 2024-09-20T18:35:55.369 INFO:tasks.workunit.client.1.smithi172.stdout:8/946: write dd/d1b/d4f/fcb [4465513,71681] 0 2024-09-20T18:35:55.370 INFO:tasks.workunit.client.1.smithi172.stdout:8/947: truncate dd/d1b/d3b/d51/d5b/f104 11100 0 2024-09-20T18:35:55.372 INFO:tasks.workunit.client.1.smithi172.stdout:8/948: write dd/d1b/d4f/d9a/dbb/d101/d129/d113/f127 [457989,102078] 0 2024-09-20T18:35:55.374 INFO:tasks.workunit.client.0.smithi017.stdout:1/304: rename df/d29/d2c/d42 to df/d29/d2c/d5b 0 2024-09-20T18:35:55.375 INFO:tasks.workunit.client.0.smithi017.stdout:9/402: dwrite d6/f7 [0,4194304] 0 2024-09-20T18:35:55.375 INFO:tasks.workunit.client.1.smithi172.stdout:5/989: symlink d4/df/d106/d119/l145 0 2024-09-20T18:35:55.376 INFO:tasks.workunit.client.0.smithi017.stdout:3/464: dwrite da/de/d13/d2f/f2e [0,4194304] 0 2024-09-20T18:35:55.385 INFO:tasks.workunit.client.0.smithi017.stdout:1/305: write df/f36 [1217546,97418] 0 2024-09-20T18:35:55.387 INFO:tasks.workunit.client.0.smithi017.stdout:9/403: symlink d6/d23/d3a/d61/l9a 0 2024-09-20T18:35:55.390 INFO:tasks.workunit.client.0.smithi017.stdout:3/465: truncate da/de/d13/f54 28351 0 2024-09-20T18:35:55.392 INFO:tasks.workunit.client.1.smithi172.stdout:8/949: rmdir dd 39 2024-09-20T18:35:55.392 INFO:tasks.workunit.client.1.smithi172.stdout:6/863: write d0/d18/d1c/d21/d26/d34/da2/dda/f78 [2738350,54556] 0 2024-09-20T18:35:55.393 INFO:tasks.workunit.client.0.smithi017.stdout:9/404: creat d6/d23/d58/f9b x:0 0 0 2024-09-20T18:35:55.395 INFO:tasks.workunit.client.1.smithi172.stdout:9/921: unlink d15/d1a/dfb/f12a 0 2024-09-20T18:35:55.399 INFO:tasks.workunit.client.0.smithi017.stdout:9/405: rmdir d6/d23/d58/d3f/d44 39 2024-09-20T18:35:55.399 INFO:tasks.workunit.client.1.smithi172.stdout:5/990: dwrite d4/df/d3f/f75 [4194304,4194304] 0 2024-09-20T18:35:55.405 INFO:tasks.workunit.client.1.smithi172.stdout:7/980: dwrite d2/d23/d9d/fac [0,4194304] 0 2024-09-20T18:35:55.405 INFO:tasks.workunit.client.0.smithi017.stdout:1/306: write df/d29/d2c/f3f [959163,84943] 0 2024-09-20T18:35:55.410 INFO:tasks.workunit.client.0.smithi017.stdout:3/466: write da/de/d13/f72 [370929,83410] 0 2024-09-20T18:35:55.411 INFO:tasks.workunit.client.0.smithi017.stdout:9/406: link d6/ca d6/d23/d58/d3f/d4d/d73/d7d/c9c 0 2024-09-20T18:35:55.412 INFO:tasks.workunit.client.1.smithi172.stdout:2/959: dwrite d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/f128 [0,4194304] 0 2024-09-20T18:35:55.412 INFO:tasks.workunit.client.0.smithi017.stdout:9/407: fsync d6/d23/d58/f57 0 2024-09-20T18:35:55.412 INFO:tasks.workunit.client.1.smithi172.stdout:6/864: rmdir d0/d18/d1c/d21/d26/d79/df8 39 2024-09-20T18:35:55.415 INFO:tasks.workunit.client.0.smithi017.stdout:1/307: creat df/d35/f5c x:0 0 0 2024-09-20T18:35:55.415 INFO:tasks.workunit.client.0.smithi017.stdout:3/467: symlink da/de/d13/d16/d6e/d97/l99 0 2024-09-20T18:35:55.416 INFO:tasks.workunit.client.1.smithi172.stdout:5/991: dwrite d4/df/d3f/f9a [0,4194304] 0 2024-09-20T18:35:55.416 INFO:tasks.workunit.client.1.smithi172.stdout:2/960: write d0/d2c/db2/f116 [351088,2112] 0 2024-09-20T18:35:55.423 INFO:tasks.workunit.client.1.smithi172.stdout:5/992: chown d4/df/d3f/d64/d101/d11c 1155118153 1 2024-09-20T18:35:55.423 INFO:tasks.workunit.client.1.smithi172.stdout:4/983: sync 2024-09-20T18:35:55.423 INFO:tasks.workunit.client.1.smithi172.stdout:7/981: mkdir d2/d3/dd/d84/d14a 0 2024-09-20T18:35:55.423 INFO:tasks.workunit.client.0.smithi017.stdout:1/308: getdents df/d16/d32 0 2024-09-20T18:35:55.427 INFO:tasks.workunit.client.1.smithi172.stdout:2/961: write d0/d2c/d3f/dab/d22/d4c/f88 [510345,14220] 0 2024-09-20T18:35:55.428 INFO:tasks.workunit.client.1.smithi172.stdout:8/950: dread f0 [0,4194304] 0 2024-09-20T18:35:55.428 INFO:tasks.workunit.client.1.smithi172.stdout:4/984: chown d0/de/d39/d9f/lc9 2653 1 2024-09-20T18:35:55.428 INFO:tasks.workunit.client.1.smithi172.stdout:2/962: stat d0/d2c/d3f/dab/d22/l81 0 2024-09-20T18:35:55.429 INFO:tasks.workunit.client.0.smithi017.stdout:1/309: creat df/f5d x:0 0 0 2024-09-20T18:35:55.429 INFO:tasks.workunit.client.0.smithi017.stdout:3/468: dwrite da/de/d13/d16/d50/f78 [0,4194304] 0 2024-09-20T18:35:55.431 INFO:tasks.workunit.client.0.smithi017.stdout:1/310: write df/d16/f58 [495477,82150] 0 2024-09-20T18:35:55.434 INFO:tasks.workunit.client.0.smithi017.stdout:3/469: truncate da/f15 14683 0 2024-09-20T18:35:55.436 INFO:tasks.workunit.client.1.smithi172.stdout:2/963: symlink d0/d2c/d51/l13d 0 2024-09-20T18:35:55.438 INFO:tasks.workunit.client.1.smithi172.stdout:6/865: getdents d0/d18/d1c/d21/d26/d34/d39/d74/dbf/d110 0 2024-09-20T18:35:55.439 INFO:tasks.workunit.client.1.smithi172.stdout:9/922: dread d15/d1f/d2c/d7d/d34/db5/fbc [0,4194304] 0 2024-09-20T18:35:55.440 INFO:tasks.workunit.client.1.smithi172.stdout:8/951: creat dd/da9/f145 x:0 0 0 2024-09-20T18:35:55.440 INFO:tasks.workunit.client.1.smithi172.stdout:6/866: fsync d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0/ff7 0 2024-09-20T18:35:55.440 INFO:tasks.workunit.client.1.smithi172.stdout:9/923: readlink d15/d1f/d2c/lec 0 2024-09-20T18:35:55.441 INFO:tasks.workunit.client.0.smithi017.stdout:1/311: creat df/f5e x:0 0 0 2024-09-20T18:35:55.442 INFO:tasks.workunit.client.1.smithi172.stdout:6/867: chown d0/d18/d1c/d21/d26/d34/d39/d46/l81 14984 1 2024-09-20T18:35:55.443 INFO:tasks.workunit.client.1.smithi172.stdout:7/982: rmdir d2/d23/d3c/d131 0 2024-09-20T18:35:55.444 INFO:tasks.workunit.client.1.smithi172.stdout:7/983: write d2/d23/d51/f142 [501398,102522] 0 2024-09-20T18:35:55.445 INFO:tasks.workunit.client.1.smithi172.stdout:9/924: unlink d15/d54/lb0 0 2024-09-20T18:35:55.448 INFO:tasks.workunit.client.1.smithi172.stdout:6/868: creat d0/d18/d1c/d21/d26/d34/da2/dda/d7b/d7e/f11e x:0 0 0 2024-09-20T18:35:55.450 INFO:tasks.workunit.client.1.smithi172.stdout:9/925: creat d15/d1f/d7e/f12b x:0 0 0 2024-09-20T18:35:55.450 INFO:tasks.workunit.client.1.smithi172.stdout:6/869: creat d0/d18/d1c/f11f x:0 0 0 2024-09-20T18:35:55.452 INFO:tasks.workunit.client.1.smithi172.stdout:8/952: rename dd/d1b/d3b/d51/d5b/d6b/d108/l135 to dd/d65/d85/l146 0 2024-09-20T18:35:55.454 INFO:tasks.workunit.client.1.smithi172.stdout:9/926: link d15/d1a/dfb/f44 d15/d1f/d2c/d7d/d34/db5/deb/f12c 0 2024-09-20T18:35:55.454 INFO:tasks.workunit.client.1.smithi172.stdout:8/953: symlink dd/d1b/d4f/d9a/dbb/l147 0 2024-09-20T18:35:55.456 INFO:tasks.workunit.client.1.smithi172.stdout:9/927: truncate d15/d1a/d64/fce 1689389 0 2024-09-20T18:35:55.456 INFO:tasks.workunit.client.1.smithi172.stdout:9/928: fdatasync d15/d1f/f7f 0 2024-09-20T18:35:55.457 INFO:tasks.workunit.client.1.smithi172.stdout:8/954: mknod dd/d1b/d3b/dc7/c148 0 2024-09-20T18:35:55.457 INFO:tasks.workunit.client.1.smithi172.stdout:6/870: getdents d0/d18/d1c/d21/d26/d34/d9c/dac 0 2024-09-20T18:35:55.457 INFO:tasks.workunit.client.1.smithi172.stdout:9/929: read - d15/d20/f108 zero size 2024-09-20T18:35:55.458 INFO:tasks.workunit.client.1.smithi172.stdout:9/930: fdatasync d15/d1a/d82/f77 0 2024-09-20T18:35:55.461 INFO:tasks.workunit.client.1.smithi172.stdout:9/931: dread d15/d1a/d6f/d7a/fe2 [0,4194304] 0 2024-09-20T18:35:55.461 INFO:tasks.workunit.client.1.smithi172.stdout:5/993: dread d4/df/dad/d26/d41/d65/fb3 [0,4194304] 0 2024-09-20T18:35:55.464 INFO:tasks.workunit.client.0.smithi017.stdout:9/408: dwrite d6/d23/d3a/d61/f78 [0,4194304] 0 2024-09-20T18:35:55.465 INFO:tasks.workunit.client.1.smithi172.stdout:6/871: dwrite d0/d18/d1c/d21/d26/d34/f82 [0,4194304] 0 2024-09-20T18:35:55.467 INFO:tasks.workunit.client.1.smithi172.stdout:4/985: write d0/d48/f100 [2905339,42239] 0 2024-09-20T18:35:55.470 INFO:tasks.workunit.client.1.smithi172.stdout:9/932: dwrite d15/d1f/d2c/d7d/d34/db5/ded/ffa [0,4194304] 0 2024-09-20T18:35:55.479 INFO:tasks.workunit.client.0.smithi017.stdout:9/409: mkdir d6/d23/d58/d3f/d9d 0 2024-09-20T18:35:55.479 INFO:tasks.workunit.client.1.smithi172.stdout:7/984: dwrite d2/d3/d3d/d4e/d8b/fb0 [0,4194304] 0 2024-09-20T18:35:55.480 INFO:tasks.workunit.client.0.smithi017.stdout:1/312: dwrite df/f33 [0,4194304] 0 2024-09-20T18:35:55.480 INFO:tasks.workunit.client.1.smithi172.stdout:7/985: chown d2/d3/d3d/d68/fbe 1938577 1 2024-09-20T18:35:55.481 INFO:tasks.workunit.client.1.smithi172.stdout:7/986: chown d2/d3/dd/f4c 11606 1 2024-09-20T18:35:55.483 INFO:tasks.workunit.client.1.smithi172.stdout:5/994: rename d4/df/d3f/d64/d101/d63/c67 to d4/df/d3f/d64/d101/d86/c146 0 2024-09-20T18:35:55.485 INFO:tasks.workunit.client.1.smithi172.stdout:5/995: chown d4/df/dad/dd4/ce8 238 1 2024-09-20T18:35:55.487 INFO:tasks.workunit.client.1.smithi172.stdout:1/941: sync 2024-09-20T18:35:55.491 INFO:tasks.workunit.client.1.smithi172.stdout:9/933: unlink d15/d1f/d2c/d7d/f123 0 2024-09-20T18:35:55.492 INFO:tasks.workunit.client.0.smithi017.stdout:1/313: unlink df/d1c/l4d 0 2024-09-20T18:35:55.495 INFO:tasks.workunit.client.1.smithi172.stdout:7/987: chown d2/d3/d3d/d4e/d5f/c90 7916 1 2024-09-20T18:35:55.499 INFO:tasks.workunit.client.1.smithi172.stdout:6/872: write d0/fbc [2679555,57956] 0 2024-09-20T18:35:55.500 INFO:tasks.workunit.client.1.smithi172.stdout:6/873: chown d0/d18/d1c/d21/f100 28935803 1 2024-09-20T18:35:55.501 INFO:tasks.workunit.client.1.smithi172.stdout:1/942: mknod d0/d8/d5f/d12e/c134 0 2024-09-20T18:35:55.502 INFO:tasks.workunit.client.0.smithi017.stdout:3/470: dwrite da/f15 [0,4194304] 0 2024-09-20T18:35:55.504 INFO:tasks.workunit.client.0.smithi017.stdout:3/471: write da/f58 [4631295,73351] 0 2024-09-20T18:35:55.506 INFO:tasks.workunit.client.1.smithi172.stdout:2/964: sync 2024-09-20T18:35:55.506 INFO:tasks.workunit.client.1.smithi172.stdout:1/943: mkdir d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dcf/d135 0 2024-09-20T18:35:55.509 INFO:tasks.workunit.client.1.smithi172.stdout:6/874: dwrite d0/d18/d1c/f11f [0,4194304] 0 2024-09-20T18:35:55.511 INFO:tasks.workunit.client.1.smithi172.stdout:1/944: dread - d0/d8/db/d25/d2b/d3d/d65/d93/dbe/f106 zero size 2024-09-20T18:35:55.511 INFO:tasks.workunit.client.1.smithi172.stdout:7/988: fdatasync d2/d3/d10/d40/d46/d8e/f12e 0 2024-09-20T18:35:55.512 INFO:tasks.workunit.client.1.smithi172.stdout:2/965: fsync d0/d2c/d51/de5/dec/f120 0 2024-09-20T18:35:55.513 INFO:tasks.workunit.client.1.smithi172.stdout:8/955: rename dd/d1b/d4f/d86/d11c to dd/d1b/d4f/d9a/dbb/d149 0 2024-09-20T18:35:55.514 INFO:tasks.workunit.client.1.smithi172.stdout:2/966: chown d0/d2c/dca 142 1 2024-09-20T18:35:55.515 INFO:tasks.workunit.client.1.smithi172.stdout:8/956: readlink dd/d1b/ld6 0 2024-09-20T18:35:55.516 INFO:tasks.workunit.client.0.smithi017.stdout:3/472: dwrite da/de/d13/d2f/d26/d62/f68 [0,4194304] 0 2024-09-20T18:35:55.519 INFO:tasks.workunit.client.1.smithi172.stdout:6/875: creat d0/d18/d1c/d21/d26/d34/da2/def/dff/ddc/f120 x:0 0 0 2024-09-20T18:35:55.519 INFO:tasks.workunit.client.1.smithi172.stdout:4/986: dwrite d0/d48/d90/d55/d53/d78/dd2/fd6 [0,4194304] 0 2024-09-20T18:35:55.525 INFO:tasks.workunit.client.0.smithi017.stdout:9/410: dwrite d6/f14 [4194304,4194304] 0 2024-09-20T18:35:55.529 INFO:tasks.workunit.client.1.smithi172.stdout:1/945: mknod d0/d8/db/d25/c136 0 2024-09-20T18:35:55.531 INFO:tasks.workunit.client.1.smithi172.stdout:5/996: dwrite d4/f91 [0,4194304] 0 2024-09-20T18:35:55.532 INFO:tasks.workunit.client.1.smithi172.stdout:1/946: fdatasync d0/d8/db/d25/d2b/d3d/d65/d93/f120 0 2024-09-20T18:35:55.533 INFO:tasks.workunit.client.1.smithi172.stdout:1/947: dread - d0/f59 zero size 2024-09-20T18:35:55.534 INFO:tasks.workunit.client.1.smithi172.stdout:5/997: write d4/df/d106/f11e [121221,113339] 0 2024-09-20T18:35:55.536 INFO:tasks.workunit.client.1.smithi172.stdout:9/934: dread d15/d1a/f28 [0,4194304] 0 2024-09-20T18:35:55.537 INFO:tasks.workunit.client.0.smithi017.stdout:9/411: symlink d6/d23/d58/l9e 0 2024-09-20T18:35:55.538 INFO:tasks.workunit.client.1.smithi172.stdout:6/876: mkdir d0/d18/d1c/d21/d26/d34/da2/def/d121 0 2024-09-20T18:35:55.540 INFO:tasks.workunit.client.0.smithi017.stdout:9/412: write d6/d23/d58/d3f/d2f/f8e [703742,75568] 0 2024-09-20T18:35:55.542 INFO:tasks.workunit.client.0.smithi017.stdout:9/413: truncate d6/d23/d58/d3f/f76 5178961 0 2024-09-20T18:35:55.544 INFO:tasks.workunit.client.1.smithi172.stdout:5/998: mkdir d4/df/d98/d147 0 2024-09-20T18:35:55.551 INFO:tasks.workunit.client.0.smithi017.stdout:9/414: dwrite d6/d23/f71 [0,4194304] 0 2024-09-20T18:35:55.552 INFO:tasks.workunit.client.0.smithi017.stdout:9/415: dread - d6/d23/d58/d3f/f7f zero size 2024-09-20T18:35:55.553 INFO:tasks.workunit.client.1.smithi172.stdout:1/948: rename d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dd5/lf6 to d0/d8/db/d25/d6d/d77/l137 0 2024-09-20T18:35:55.553 INFO:tasks.workunit.client.0.smithi017.stdout:3/473: dread da/f58 [0,4194304] 0 2024-09-20T18:35:55.554 INFO:tasks.workunit.client.1.smithi172.stdout:4/987: creat d0/d48/d90/f157 x:0 0 0 2024-09-20T18:35:55.557 INFO:tasks.workunit.client.1.smithi172.stdout:5/999: fdatasync d4/df/d98/dcc/d105/f144 0 2024-09-20T18:35:55.558 INFO:tasks.workunit.client.0.smithi017.stdout:9/416: creat d6/d23/d58/d3f/d2f/d5d/f9f x:0 0 0 2024-09-20T18:35:55.559 INFO:tasks.workunit.client.0.smithi017.stdout:9/417: readlink d6/d23/d58/l5b 0 2024-09-20T18:35:55.560 INFO:tasks.workunit.client.1.smithi172.stdout:1/949: write d0/d8/db/f111 [176453,54812] 0 2024-09-20T18:35:55.562 INFO:tasks.workunit.client.0.smithi017.stdout:3/474: dread da/de/d13/f54 [0,4194304] 0 2024-09-20T18:35:55.562 INFO:tasks.workunit.client.1.smithi172.stdout:8/957: dwrite dd/d1b/f8d [0,4194304] 0 2024-09-20T18:35:55.563 INFO:tasks.workunit.client.1.smithi172.stdout:4/988: read d0/d48/d90/d55/fa0 [3139414,75520] 0 2024-09-20T18:35:55.563 INFO:tasks.workunit.client.1.smithi172.stdout:8/958: write dd/d1b/d3b/dff/f138 [989907,5690] 0 2024-09-20T18:35:55.568 INFO:tasks.workunit.client.1.smithi172.stdout:1/950: symlink d0/d8/d5f/l138 0 2024-09-20T18:35:55.569 INFO:tasks.workunit.client.1.smithi172.stdout:1/951: chown d0/d8 1018 1 2024-09-20T18:35:55.570 INFO:tasks.workunit.client.0.smithi017.stdout:3/475: dread da/de/d53/d52/f63 [0,4194304] 0 2024-09-20T18:35:55.571 INFO:tasks.workunit.client.1.smithi172.stdout:6/877: getdents d0/d18/d1c/d21/d26/d34/d39/d74/dbf/de7 0 2024-09-20T18:35:55.573 INFO:tasks.workunit.client.1.smithi172.stdout:4/989: mkdir d0/d48/d90/d55/d53/d158 0 2024-09-20T18:35:55.574 INFO:tasks.workunit.client.1.smithi172.stdout:7/989: dwrite d2/d3/d3d/d4e/fb1 [0,4194304] 0 2024-09-20T18:35:55.574 INFO:tasks.workunit.client.1.smithi172.stdout:8/959: dread dd/d1b/d3b/d51/f35 [0,4194304] 0 2024-09-20T18:35:55.575 INFO:tasks.workunit.client.1.smithi172.stdout:2/967: dwrite d0/d2c/dca/f132 [0,4194304] 0 2024-09-20T18:35:55.575 INFO:tasks.workunit.client.0.smithi017.stdout:9/418: getdents d6 0 2024-09-20T18:35:55.577 INFO:tasks.workunit.client.0.smithi017.stdout:9/419: write d6/d23/d58/f94 [535167,7555] 0 2024-09-20T18:35:55.577 INFO:tasks.workunit.client.1.smithi172.stdout:2/968: write d0/d90/f105 [1513610,90018] 0 2024-09-20T18:35:55.579 INFO:tasks.workunit.client.1.smithi172.stdout:4/990: mkdir d0/de/d39/d9f/de8/d119/d159 0 2024-09-20T18:35:55.582 INFO:tasks.workunit.client.0.smithi017.stdout:9/420: mknod d6/d23/d3a/d61/ca0 0 2024-09-20T18:35:55.586 INFO:tasks.workunit.client.1.smithi172.stdout:6/878: rmdir d0/d18/d1c/d21/d26/d79/df8 39 2024-09-20T18:35:55.588 INFO:tasks.workunit.client.0.smithi017.stdout:9/421: rename d6/d23/d40/c63 to d6/d23/d58/ca1 0 2024-09-20T18:35:55.592 INFO:tasks.workunit.client.1.smithi172.stdout:7/990: rename d2/d3/d10/c26 to d2/d23/d51/c14b 0 2024-09-20T18:35:55.592 INFO:tasks.workunit.client.1.smithi172.stdout:7/991: stat d2/c104 0 2024-09-20T18:35:55.593 INFO:tasks.workunit.client.1.smithi172.stdout:1/952: read d0/d8/db/d25/d2b/d3d/d65/fd1 [319090,14160] 0 2024-09-20T18:35:55.593 INFO:tasks.workunit.client.0.smithi017.stdout:9/422: symlink d6/d23/d58/d3f/d82/la2 0 2024-09-20T18:35:55.594 INFO:tasks.workunit.client.1.smithi172.stdout:8/960: rmdir dd/d1b/d4f/d9a/dbb/d101/d129 39 2024-09-20T18:35:55.596 INFO:tasks.workunit.client.0.smithi017.stdout:3/476: dwrite da/de/d13/d16/f77 [0,4194304] 0 2024-09-20T18:35:55.596 INFO:tasks.workunit.client.0.smithi017.stdout:9/423: read d6/d23/d58/f94 [363599,20665] 0 2024-09-20T18:35:55.597 INFO:tasks.workunit.client.1.smithi172.stdout:4/991: mkdir d0/d48/d90/d55/d15a 0 2024-09-20T18:35:55.599 INFO:tasks.workunit.client.1.smithi172.stdout:1/953: read d0/f61 [201983,21885] 0 2024-09-20T18:35:55.599 INFO:tasks.workunit.client.1.smithi172.stdout:7/992: rename d2/d3/d10/d40/d46/dd2/lf6 to d2/d3/d3d/d68/dc8/l14c 0 2024-09-20T18:35:55.601 INFO:tasks.workunit.client.0.smithi017.stdout:3/477: creat da/de/d13/d2f/d26/d31/f9a x:0 0 0 2024-09-20T18:35:55.604 INFO:tasks.workunit.client.0.smithi017.stdout:9/424: creat d6/d23/d3a/d61/fa3 x:0 0 0 2024-09-20T18:35:55.605 INFO:tasks.workunit.client.1.smithi172.stdout:2/969: getdents d0/d1a 0 2024-09-20T18:35:55.612 INFO:tasks.workunit.client.1.smithi172.stdout:7/993: fdatasync d2/d3/d10/d40/d6a/f8a 0 2024-09-20T18:35:55.619 INFO:tasks.workunit.client.1.smithi172.stdout:8/961: write dd/d1b/d3b/d51/d5b/d6b/f8c [1543800,96632] 0 2024-09-20T18:35:55.621 INFO:tasks.workunit.client.1.smithi172.stdout:4/992: write d0/fa [1684609,29089] 0 2024-09-20T18:35:55.621 INFO:tasks.workunit.client.1.smithi172.stdout:1/954: link d0/d8/c110 d0/d8/db/d39/c139 0 2024-09-20T18:35:55.623 INFO:tasks.workunit.client.0.smithi017.stdout:3/478: write da/de/d13/d2f/d26/d31/d5a/d76/d19/f4c [493606,69338] 0 2024-09-20T18:35:55.625 INFO:tasks.workunit.client.0.smithi017.stdout:9/425: rmdir d6/d23/d40/d4a 0 2024-09-20T18:35:55.626 INFO:tasks.workunit.client.1.smithi172.stdout:7/994: dwrite d2/d3/d10/f18 [0,4194304] 0 2024-09-20T18:35:55.631 INFO:tasks.workunit.client.1.smithi172.stdout:8/962: mkdir dd/d1b/d4f/d9a/dbb/d101/d129/d113/d14a 0 2024-09-20T18:35:55.631 INFO:tasks.workunit.client.1.smithi172.stdout:2/970: dwrite d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/dbb/fbc [0,4194304] 0 2024-09-20T18:35:55.631 INFO:tasks.workunit.client.1.smithi172.stdout:4/993: dwrite d0/de/d39/f9b [0,4194304] 0 2024-09-20T18:35:55.634 INFO:tasks.workunit.client.0.smithi017.stdout:9/426: rename d6/d23/d58/d3f/d2f/f31 to d6/d23/d58/d3f/d44/fa4 0 2024-09-20T18:35:55.634 INFO:tasks.workunit.client.0.smithi017.stdout:3/479: dwrite da/de/f85 [0,4194304] 0 2024-09-20T18:35:55.635 INFO:tasks.workunit.client.1.smithi172.stdout:7/995: truncate d2/d3/d10/d40/d46/d8e/dbd/f116 43550 0 2024-09-20T18:35:55.639 INFO:tasks.workunit.client.1.smithi172.stdout:4/994: fsync d0/de/d39/f73 0 2024-09-20T18:35:55.640 INFO:tasks.workunit.client.1.smithi172.stdout:4/995: readlink d0/l54 0 2024-09-20T18:35:55.641 INFO:tasks.workunit.client.0.smithi017.stdout:7/323: sync 2024-09-20T18:35:55.641 INFO:tasks.workunit.client.1.smithi172.stdout:1/955: dread d0/d8/db/d39/fb0 [0,4194304] 0 2024-09-20T18:35:55.644 INFO:tasks.workunit.client.1.smithi172.stdout:8/963: creat dd/d1b/d3b/d51/d34/dee/f14b x:0 0 0 2024-09-20T18:35:55.647 INFO:tasks.workunit.client.0.smithi017.stdout:3/480: creat da/de/d13/d16/d6e/d97/f9b x:0 0 0 2024-09-20T18:35:55.647 INFO:tasks.workunit.client.0.smithi017.stdout:3/481: chown da 5344349 1 2024-09-20T18:35:55.649 INFO:tasks.workunit.client.1.smithi172.stdout:2/971: dread d0/d60/f69 [0,4194304] 0 2024-09-20T18:35:55.654 INFO:tasks.workunit.client.1.smithi172.stdout:4/996: creat d0/de/d39/d9f/f15b x:0 0 0 2024-09-20T18:35:55.655 INFO:tasks.workunit.client.1.smithi172.stdout:1/956: stat d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dcf/cdb 0 2024-09-20T18:35:55.656 INFO:tasks.workunit.client.1.smithi172.stdout:4/997: write d0/d48/d90/d55/d101/ff2 [469997,98994] 0 2024-09-20T18:35:55.657 INFO:tasks.workunit.client.0.smithi017.stdout:3/482: link da/de/d13/d16/d6e/d97/f9b da/de/d13/d2f/d26/d31/d5a/d76/d19/f9c 0 2024-09-20T18:35:55.658 INFO:tasks.workunit.client.1.smithi172.stdout:8/964: write dd/d1b/d3b/d51/d34/f36 [2975278,14272] 0 2024-09-20T18:35:55.658 INFO:tasks.workunit.client.0.smithi017.stdout:3/483: fdatasync da/de/d13/d2f/d26/d31/f7e 0 2024-09-20T18:35:55.658 INFO:tasks.workunit.client.1.smithi172.stdout:7/996: truncate d2/dcc/f105 903304 0 2024-09-20T18:35:55.659 INFO:tasks.workunit.client.1.smithi172.stdout:8/965: readlink dd/d1b/d4f/d9a/le5 0 2024-09-20T18:35:55.659 INFO:tasks.workunit.client.0.smithi017.stdout:3/484: dread - da/de/d13/d2f/d26/d62/f8a zero size 2024-09-20T18:35:55.660 INFO:tasks.workunit.client.1.smithi172.stdout:2/972: truncate d0/d2c/d3f/dab/d22/d10/d35/d5d/fae 413702 0 2024-09-20T18:35:55.663 INFO:tasks.workunit.client.1.smithi172.stdout:4/998: fsync d0/d48/d90/f14 0 2024-09-20T18:35:55.665 INFO:tasks.workunit.client.1.smithi172.stdout:7/997: dwrite d2/d3/d3d/dd4/fd7 [0,4194304] 0 2024-09-20T18:35:55.665 INFO:tasks.workunit.client.1.smithi172.stdout:4/999: truncate d0/de/d39/d9f/f15b 962030 0 2024-09-20T18:35:55.666 INFO:tasks.workunit.client.0.smithi017.stdout:9/427: truncate d6/d23/f51 1567916 0 2024-09-20T18:35:55.667 INFO:tasks.workunit.client.0.smithi017.stdout:9/428: write d6/d23/d3a/f5e [1248523,95934] 0 2024-09-20T18:35:55.671 INFO:tasks.workunit.client.1.smithi172.stdout:1/957: link d0/d8/db/d25/d2b/fc1 d0/d8/db/f13a 0 2024-09-20T18:35:55.673 INFO:tasks.workunit.client.1.smithi172.stdout:1/958: rmdir d0/dc2 39 2024-09-20T18:35:55.675 INFO:tasks.workunit.client.1.smithi172.stdout:1/959: creat d0/d8/db/d39/f13b x:0 0 0 2024-09-20T18:35:55.679 INFO:tasks.workunit.client.1.smithi172.stdout:1/960: rename d0/d8/db/d25/d2b/db6/d119/d12d to d0/d8/db/d25/d2b/db6/d119/d13c 0 2024-09-20T18:35:55.680 INFO:tasks.workunit.client.0.smithi017.stdout:3/485: truncate da/de/d13/d16/d50/f78 3731607 0 2024-09-20T18:35:55.680 INFO:tasks.workunit.client.1.smithi172.stdout:8/966: dwrite dd/d1b/d3b/d51/d5b/daf/f4b [0,4194304] 0 2024-09-20T18:35:55.681 INFO:tasks.workunit.client.1.smithi172.stdout:2/973: write d0/d2c/d3f/dab/d22/d10/d6a/d98/fde [796714,112263] 0 2024-09-20T18:35:55.682 INFO:tasks.workunit.client.1.smithi172.stdout:8/967: stat dd/d1b/d3b/d5d/c69 0 2024-09-20T18:35:55.684 INFO:tasks.workunit.client.1.smithi172.stdout:8/968: fdatasync dd/d1b/d4f/d9a/fb9 0 2024-09-20T18:35:55.686 INFO:tasks.workunit.client.1.smithi172.stdout:9/935: sync 2024-09-20T18:35:55.690 INFO:tasks.workunit.client.1.smithi172.stdout:1/961: rename d0/d8/d5f/dfb/f10c to d0/d8/db/d25/d2b/d3d/d65/d93/dbb/dd3/f13d 0 2024-09-20T18:35:55.690 INFO:tasks.workunit.client.1.smithi172.stdout:2/974: creat d0/d2c/d3f/dab/d22/d10/d35/dc4/f13e x:0 0 0 2024-09-20T18:35:55.690 INFO:tasks.workunit.client.1.smithi172.stdout:8/969: rmdir dd/d1b/d3b/dc7 39 2024-09-20T18:35:55.690 INFO:tasks.workunit.client.1.smithi172.stdout:7/998: dwrite d2/d23/d3c/ff4 [0,4194304] 0 2024-09-20T18:35:55.692 INFO:tasks.workunit.client.1.smithi172.stdout:8/970: stat dd/d1b/f8d 0 2024-09-20T18:35:55.693 INFO:tasks.workunit.client.1.smithi172.stdout:8/971: fdatasync dd/de3/f106 0 2024-09-20T18:35:55.695 INFO:tasks.workunit.client.1.smithi172.stdout:1/962: symlink d0/d8/l13e 0 2024-09-20T18:35:55.700 INFO:tasks.workunit.client.1.smithi172.stdout:9/936: mkdir d15/d1f/d2c/d7d/d34/db5/deb/d12d 0 2024-09-20T18:35:55.701 INFO:tasks.workunit.client.0.smithi017.stdout:3/486: write da/de/d13/d2f/d26/d31/d5a/d76/d19/f9c [581816,89935] 0 2024-09-20T18:35:55.702 INFO:tasks.workunit.client.0.smithi017.stdout:9/429: dread d6/d23/f2a [0,4194304] 0 2024-09-20T18:35:55.703 INFO:tasks.workunit.client.1.smithi172.stdout:2/975: mknod d0/d2c/d3f/dab/d22/d10/d35/dc4/c13f 0 2024-09-20T18:35:55.703 INFO:tasks.workunit.client.1.smithi172.stdout:1/963: dwrite d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dd5/d125/f126 [0,4194304] 0 2024-09-20T18:35:55.703 INFO:tasks.workunit.client.0.smithi017.stdout:3/487: write da/f15 [3008012,81910] 0 2024-09-20T18:35:55.706 INFO:tasks.workunit.client.1.smithi172.stdout:7/999: rename d2/d3/d10/d40/d46/d8e/dbd to d2/d23/d120/d14d 0 2024-09-20T18:35:55.707 INFO:tasks.workunit.client.1.smithi172.stdout:8/972: write dd/d1b/d3b/d51/f35 [1516067,30537] 0 2024-09-20T18:35:55.708 INFO:tasks.workunit.client.1.smithi172.stdout:8/973: chown dd/d1b/d3b/d5d/df6/f100 18353732 1 2024-09-20T18:35:55.709 INFO:tasks.workunit.client.1.smithi172.stdout:8/974: chown dd/d1b/d4f/d9a/dbb/d101/d129/c10d 12080898 1 2024-09-20T18:35:55.710 INFO:tasks.workunit.client.1.smithi172.stdout:9/937: mknod d15/d1f/d2c/d7d/c12e 0 2024-09-20T18:35:55.711 INFO:tasks.workunit.client.0.smithi017.stdout:3/488: creat da/de/d13/d2f/d26/d31/d5a/d76/f9d x:0 0 0 2024-09-20T18:35:55.712 INFO:tasks.workunit.client.0.smithi017.stdout:9/430: creat d6/d23/d58/d3f/d2f/d98/fa5 x:0 0 0 2024-09-20T18:35:55.713 INFO:tasks.workunit.client.1.smithi172.stdout:1/964: rmdir d0/d8/db/d25/d2b/d3d/d65/d93/dbb/df7 39 2024-09-20T18:35:55.713 INFO:tasks.workunit.client.0.smithi017.stdout:3/489: write da/de/d13/d2f/d26/d41/f83 [516540,95902] 0 2024-09-20T18:35:55.713 INFO:tasks.workunit.client.0.smithi017.stdout:9/431: write d6/f7 [3500809,76388] 0 2024-09-20T18:35:55.714 INFO:tasks.workunit.client.1.smithi172.stdout:1/965: fsync d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/ff2 0 2024-09-20T18:35:55.716 INFO:tasks.workunit.client.1.smithi172.stdout:8/975: unlink dd/d65/d85/da2/l132 0 2024-09-20T18:35:55.716 INFO:tasks.workunit.client.1.smithi172.stdout:9/938: mknod d15/d1f/d2c/d6e/c12f 0 2024-09-20T18:35:55.719 INFO:tasks.workunit.client.1.smithi172.stdout:2/976: mknod d0/d2c/d3f/dab/d18/d29/c140 0 2024-09-20T18:35:55.719 INFO:tasks.workunit.client.1.smithi172.stdout:2/977: chown d0/d1a/d58/l10e 8649650 1 2024-09-20T18:35:55.720 INFO:tasks.workunit.client.0.smithi017.stdout:3/490: symlink da/de/d13/d2f/d26/d31/d5a/l9e 0 2024-09-20T18:35:55.721 INFO:tasks.workunit.client.1.smithi172.stdout:9/939: rmdir d15/d20/d76 39 2024-09-20T18:35:55.722 INFO:tasks.workunit.client.0.smithi017.stdout:3/491: write da/f58 [5387079,44526] 0 2024-09-20T18:35:55.726 INFO:tasks.workunit.client.1.smithi172.stdout:1/966: mkdir d0/d8/db/d25/d2b/d107/d13f 0 2024-09-20T18:35:55.726 INFO:tasks.workunit.client.0.smithi017.stdout:9/432: mknod d6/d23/d58/d3f/d4d/d73/d93/d96/ca6 0 2024-09-20T18:35:55.727 INFO:tasks.workunit.client.1.smithi172.stdout:6/879: sync 2024-09-20T18:35:55.727 INFO:tasks.workunit.client.1.smithi172.stdout:9/940: mknod d15/d1a/dfb/c130 0 2024-09-20T18:35:55.728 INFO:tasks.workunit.client.0.smithi017.stdout:3/492: mknod da/de/d13/d16/d50/c9f 0 2024-09-20T18:35:55.730 INFO:tasks.workunit.client.0.smithi017.stdout:3/493: dread da/de/d53/f44 [0,4194304] 0 2024-09-20T18:35:55.731 INFO:tasks.workunit.client.0.smithi017.stdout:9/433: rename d6/f14 to d6/d23/d58/d3f/d2f/fa7 0 2024-09-20T18:35:55.733 INFO:tasks.workunit.client.0.smithi017.stdout:3/494: unlink da/f74 0 2024-09-20T18:35:55.735 INFO:tasks.workunit.client.0.smithi017.stdout:3/495: write da/de/d13/d2f/d26/d31/d5a/d76/d19/f4c [1627579,39331] 0 2024-09-20T18:35:55.746 INFO:tasks.workunit.client.1.smithi172.stdout:6/880: dwrite d0/d18/d1c/d21/d26/d34/d39/d74/dbf/de7/f112 [0,4194304] 0 2024-09-20T18:35:55.746 INFO:tasks.workunit.client.1.smithi172.stdout:2/978: dwrite d0/d2c/f3e [0,4194304] 0 2024-09-20T18:35:55.747 INFO:tasks.workunit.client.1.smithi172.stdout:9/941: truncate d15/d1f/d2c/d7d/d34/db5/fbc 3716888 0 2024-09-20T18:35:55.747 INFO:tasks.workunit.client.0.smithi017.stdout:9/434: dwrite d6/d23/d58/f9b [0,4194304] 0 2024-09-20T18:35:55.748 INFO:tasks.workunit.client.1.smithi172.stdout:2/979: chown d0/dd4/de4 0 1 2024-09-20T18:35:55.748 INFO:tasks.workunit.client.1.smithi172.stdout:9/942: chown d15/d1f/d2c/d6e/d129 2279424 1 2024-09-20T18:35:55.748 INFO:tasks.workunit.client.0.smithi017.stdout:9/435: readlink d6/d23/d40/l83 0 2024-09-20T18:35:55.748 INFO:tasks.workunit.client.1.smithi172.stdout:1/967: link d0/d8/db/d25/d2b/d3d/d65/d93/dbb/df7/l121 d0/d8/db/d25/db7/l140 0 2024-09-20T18:35:55.749 INFO:tasks.workunit.client.1.smithi172.stdout:9/943: chown d15/d4a/dd7 0 1 2024-09-20T18:35:55.754 INFO:tasks.workunit.client.1.smithi172.stdout:6/881: unlink d0/d18/d1c/d21/d26/d34/da2/def/dff/ddc/c11c 0 2024-09-20T18:35:55.757 INFO:tasks.workunit.client.0.smithi017.stdout:9/436: dwrite d6/f2e [0,4194304] 0 2024-09-20T18:35:55.757 INFO:tasks.workunit.client.0.smithi017.stdout:3/496: dread da/de/d53/d52/f80 [0,4194304] 0 2024-09-20T18:35:55.759 INFO:tasks.workunit.client.1.smithi172.stdout:9/944: unlink d15/d1a/d82/l11a 0 2024-09-20T18:35:55.760 INFO:tasks.workunit.client.0.smithi017.stdout:3/497: write da/de/d13/d16/d50/f96 [103246,117843] 0 2024-09-20T18:35:55.770 INFO:tasks.workunit.client.1.smithi172.stdout:6/882: link d0/d18/d1c/d21/d26/d34/d39/d46/c55 d0/d18/d1c/d21/d26/d34/da2/def/d121/c122 0 2024-09-20T18:35:55.771 INFO:tasks.workunit.client.1.smithi172.stdout:6/883: chown d0/d18/d1c/d21/d26/d34/d6b/f84 34 1 2024-09-20T18:35:55.778 INFO:tasks.workunit.client.1.smithi172.stdout:1/968: write d0/d22/f28 [2020922,101648] 0 2024-09-20T18:35:55.780 INFO:tasks.workunit.client.1.smithi172.stdout:2/980: truncate d0/d2c/d3f/dab/d22/d10/d35/fad 185199 0 2024-09-20T18:35:55.781 INFO:tasks.workunit.client.1.smithi172.stdout:2/981: write d0/d2c/d3f/dab/d22/d10/d3c/d68/f73 [3320712,107052] 0 2024-09-20T18:35:55.784 INFO:tasks.workunit.client.1.smithi172.stdout:2/982: mkdir d0/d2c/d3f/dab/d22/d10/d141 0 2024-09-20T18:35:55.785 INFO:tasks.workunit.client.0.smithi017.stdout:9/437: write d6/d11/f13 [4718018,113673] 0 2024-09-20T18:35:55.787 INFO:tasks.workunit.client.1.smithi172.stdout:6/884: rename d0/d18/d1c/d21/d26/d34/da2 to d0/d18/d1c/d123 0 2024-09-20T18:35:55.787 INFO:tasks.workunit.client.1.smithi172.stdout:2/983: dread d0/d2c/d3f/dab/d22/d10/d35/fa6 [0,4194304] 0 2024-09-20T18:35:55.788 INFO:tasks.workunit.client.0.smithi017.stdout:3/498: truncate da/de/f7c 1070944 0 2024-09-20T18:35:55.789 INFO:tasks.workunit.client.1.smithi172.stdout:2/984: read - d0/d2c/d3f/dab/d22/d4c/fea zero size 2024-09-20T18:35:55.789 INFO:tasks.workunit.client.0.smithi017.stdout:9/438: mknod d6/d23/d58/d3f/d4d/ca8 0 2024-09-20T18:35:55.789 INFO:tasks.workunit.client.0.smithi017.stdout:3/499: stat da/de/d13/d2f/d26/d41/l90 0 2024-09-20T18:35:55.791 INFO:tasks.workunit.client.0.smithi017.stdout:9/439: truncate d6/d23/d58/d3f/d4d/d73/d7d/f85 683222 0 2024-09-20T18:35:55.792 INFO:tasks.workunit.client.0.smithi017.stdout:9/440: write f4 [543439,126903] 0 2024-09-20T18:35:55.793 INFO:tasks.workunit.client.1.smithi172.stdout:6/885: rename d0/d18/d1c/d21/d26/d34/d39/d74/dbf/de7/f101 to d0/d18/d1c/d123/dda/d7b/d7e/f124 0 2024-09-20T18:35:55.795 INFO:tasks.workunit.client.1.smithi172.stdout:2/985: dwrite d0/d2c/d3f/dab/d22/d10/d6a/ddf/fe9 [0,4194304] 0 2024-09-20T18:35:55.803 INFO:tasks.workunit.client.1.smithi172.stdout:2/986: mkdir d0/d2c/d3f/dab/d22/d10/d6a/d98/d77/d142 0 2024-09-20T18:35:55.808 INFO:tasks.workunit.client.1.smithi172.stdout:6/886: creat d0/d18/d1c/d21/d26/d34/f125 x:0 0 0 2024-09-20T18:35:55.808 INFO:tasks.workunit.client.0.smithi017.stdout:3/500: truncate da/de/f85 3366119 0 2024-09-20T18:35:55.809 INFO:tasks.workunit.client.1.smithi172.stdout:6/887: stat d0/d18/d1c/d21/d26/d34/d39/d46/c11 0 2024-09-20T18:35:55.812 INFO:tasks.workunit.client.1.smithi172.stdout:6/888: mkdir d0/d18/d1c/d21/d26/d34/d9c/dc7/d126 0 2024-09-20T18:35:55.812 INFO:tasks.workunit.client.0.smithi017.stdout:9/441: truncate d6/d23/d58/d3f/d2f/fa7 3632173 0 2024-09-20T18:35:55.813 INFO:tasks.workunit.client.1.smithi172.stdout:6/889: chown d0/d18/d1c/d21/d26/d34/d9c/fe6 1537342 1 2024-09-20T18:35:55.813 INFO:tasks.workunit.client.0.smithi017.stdout:3/501: truncate da/de/d13/d2f/d26/d31/d5a/d76/f6a 8401 0 2024-09-20T18:35:55.817 INFO:tasks.workunit.client.1.smithi172.stdout:2/987: truncate d0/d2c/d3f/dab/d22/f38 559621 0 2024-09-20T18:35:55.817 INFO:tasks.workunit.client.0.smithi017.stdout:3/502: dread da/de/d13/d2f/f2e [0,4194304] 0 2024-09-20T18:35:55.818 INFO:tasks.workunit.client.1.smithi172.stdout:2/988: fdatasync d0/d2c/fef 0 2024-09-20T18:35:55.820 INFO:tasks.workunit.client.1.smithi172.stdout:6/890: creat d0/d18/f127 x:0 0 0 2024-09-20T18:35:55.820 INFO:tasks.workunit.client.1.smithi172.stdout:2/989: dread d0/d2c/d3f/dab/f80 [0,4194304] 0 2024-09-20T18:35:55.823 INFO:tasks.workunit.client.0.smithi017.stdout:3/503: fsync da/de/d13/f54 0 2024-09-20T18:35:55.826 INFO:tasks.workunit.client.0.smithi017.stdout:9/442: link f4 d6/d23/d58/d3f/d4d/d73/d7d/fa9 0 2024-09-20T18:35:55.829 INFO:tasks.workunit.client.1.smithi172.stdout:2/990: mknod d0/d2c/d3f/dab/c143 0 2024-09-20T18:35:55.831 INFO:tasks.workunit.client.0.smithi017.stdout:3/504: creat da/de/d13/d2f/d26/d31/fa0 x:0 0 0 2024-09-20T18:35:55.834 INFO:tasks.workunit.client.1.smithi172.stdout:2/991: mkdir d0/d2c/d3f/dab/d45/ddc/d144 0 2024-09-20T18:35:55.835 INFO:tasks.workunit.client.0.smithi017.stdout:9/443: rmdir d6/d23/d40 39 2024-09-20T18:35:55.837 INFO:tasks.workunit.client.1.smithi172.stdout:6/891: creat d0/d18/f128 x:0 0 0 2024-09-20T18:35:55.841 INFO:tasks.workunit.client.0.smithi017.stdout:9/444: unlink d6/d23/d58/f57 0 2024-09-20T18:35:55.842 INFO:tasks.workunit.client.1.smithi172.stdout:6/892: mkdir d0/d18/d1c/d21/d26/d34/d39/d129 0 2024-09-20T18:35:55.843 INFO:tasks.workunit.client.0.smithi017.stdout:9/445: truncate d6/d23/d58/d3f/d2f/d5d/f86 770404 0 2024-09-20T18:35:55.847 INFO:tasks.workunit.client.0.smithi017.stdout:9/446: rename d6/d23/d58/l5b to d6/d11/laa 0 2024-09-20T18:35:55.849 INFO:tasks.workunit.client.1.smithi172.stdout:6/893: symlink d0/d18/d1c/d21/d26/d34/d7a/l12a 0 2024-09-20T18:35:55.850 INFO:tasks.workunit.client.1.smithi172.stdout:6/894: fsync d0/d18/d1c/d21/d26/d34/d39/d46/fa5 0 2024-09-20T18:35:55.850 INFO:tasks.workunit.client.0.smithi017.stdout:9/447: symlink d6/d23/d58/d3f/d2f/d98/lab 0 2024-09-20T18:35:55.853 INFO:tasks.workunit.client.0.smithi017.stdout:9/448: write d6/d23/d58/d3f/d44/fa4 [1895768,29099] 0 2024-09-20T18:35:55.853 INFO:tasks.workunit.client.0.smithi017.stdout:3/505: dwrite da/de/d13/f54 [0,4194304] 0 2024-09-20T18:35:55.855 INFO:tasks.workunit.client.0.smithi017.stdout:9/449: readlink d6/d23/d58/d3f/l6a 0 2024-09-20T18:35:55.855 INFO:tasks.workunit.client.0.smithi017.stdout:3/506: read da/de/d13/d16/d50/f96 [118781,5303] 0 2024-09-20T18:35:55.859 INFO:tasks.workunit.client.0.smithi017.stdout:9/450: creat d6/d23/d3a/fac x:0 0 0 2024-09-20T18:35:55.860 INFO:tasks.workunit.client.0.smithi017.stdout:3/507: symlink da/de/d53/d88/la1 0 2024-09-20T18:35:55.861 INFO:tasks.workunit.client.1.smithi172.stdout:6/895: write d0/fe [1555697,71339] 0 2024-09-20T18:35:55.863 INFO:tasks.workunit.client.0.smithi017.stdout:9/451: truncate d6/d11/f3e 11023 0 2024-09-20T18:35:55.864 INFO:tasks.workunit.client.0.smithi017.stdout:3/508: mknod da/de/d13/d2f/d26/d62/ca2 0 2024-09-20T18:35:55.864 INFO:tasks.workunit.client.0.smithi017.stdout:9/452: readlink d6/d23/d58/d3f/l6a 0 2024-09-20T18:35:55.866 INFO:tasks.workunit.client.0.smithi017.stdout:9/453: rmdir d6/d23/d58/d3f/d4d/d73/d8f 39 2024-09-20T18:35:55.868 INFO:tasks.workunit.client.0.smithi017.stdout:3/509: dread da/de/f85 [0,4194304] 0 2024-09-20T18:35:55.868 INFO:tasks.workunit.client.0.smithi017.stdout:9/454: symlink d6/d23/d58/d3f/d4d/d73/d93/d96/lad 0 2024-09-20T18:35:55.871 INFO:tasks.workunit.client.0.smithi017.stdout:9/455: symlink d6/d23/d58/d3f/d2f/d98/lae 0 2024-09-20T18:35:55.874 INFO:tasks.workunit.client.0.smithi017.stdout:9/456: creat d6/d23/d58/d3f/d2f/d5d/faf x:0 0 0 2024-09-20T18:35:55.876 INFO:tasks.workunit.client.0.smithi017.stdout:9/457: unlink d6/d23/d58/d3f/d2f/d5d/f80 0 2024-09-20T18:35:55.878 INFO:tasks.workunit.client.0.smithi017.stdout:9/458: chown d6/c77 50 1 2024-09-20T18:35:55.883 INFO:tasks.workunit.client.1.smithi172.stdout:8/976: sync 2024-09-20T18:35:55.885 INFO:tasks.workunit.client.0.smithi017.stdout:3/510: dread da/de/d13/d2f/d26/d31/d5a/d76/d19/f1c [0,4194304] 0 2024-09-20T18:35:55.885 INFO:tasks.workunit.client.0.smithi017.stdout:9/459: dwrite d6/d23/d58/d3f/f91 [0,4194304] 0 2024-09-20T18:35:55.887 INFO:tasks.workunit.client.1.smithi172.stdout:8/977: creat dd/d1b/d4f/d9a/dbb/d101/d129/df1/f14c x:0 0 0 2024-09-20T18:35:55.887 INFO:tasks.workunit.client.0.smithi017.stdout:9/460: write d6/d23/d58/d3f/d5f/f8c [1146138,2894] 0 2024-09-20T18:35:55.891 INFO:tasks.workunit.client.1.smithi172.stdout:8/978: dread dd/d1b/d4f/d9a/dbb/d101/f112 [0,4194304] 0 2024-09-20T18:35:55.894 INFO:tasks.workunit.client.0.smithi017.stdout:3/511: dread da/de/d13/d16/f77 [0,4194304] 0 2024-09-20T18:35:55.894 INFO:tasks.workunit.client.0.smithi017.stdout:9/461: mkdir d6/d23/d58/d3f/d70/db0 0 2024-09-20T18:35:55.894 INFO:tasks.workunit.client.0.smithi017.stdout:3/512: symlink da/de/d53/la3 0 2024-09-20T18:35:55.897 INFO:tasks.workunit.client.1.smithi172.stdout:8/979: unlink dd/d1b/d3b/d51/d5b/daf/d4d/f92 0 2024-09-20T18:35:55.897 INFO:tasks.workunit.client.1.smithi172.stdout:8/980: dread - dd/de3/d10c/f13e zero size 2024-09-20T18:35:55.898 INFO:tasks.workunit.client.1.smithi172.stdout:8/981: readlink dd/l62 0 2024-09-20T18:35:55.898 INFO:tasks.workunit.client.0.smithi017.stdout:9/462: creat d6/d23/d40/fb1 x:0 0 0 2024-09-20T18:35:55.903 INFO:tasks.workunit.client.0.smithi017.stdout:9/463: link d6/d23/d3a/f7b d6/d23/d58/d3f/d70/fb2 0 2024-09-20T18:35:55.904 INFO:tasks.workunit.client.0.smithi017.stdout:9/464: dread - d6/d23/d58/d3f/d2f/d98/fa5 zero size 2024-09-20T18:35:55.905 INFO:tasks.workunit.client.0.smithi017.stdout:3/513: truncate da/de/d13/d16/f3f 1638999 0 2024-09-20T18:35:55.908 INFO:tasks.workunit.client.0.smithi017.stdout:3/514: readlink da/de/d13/d2f/d26/d31/d5a/d76/d19/l5d 0 2024-09-20T18:35:55.908 INFO:tasks.workunit.client.0.smithi017.stdout:9/465: dread d6/f2e [0,4194304] 0 2024-09-20T18:35:55.910 INFO:tasks.workunit.client.0.smithi017.stdout:4/250: sync 2024-09-20T18:35:55.915 INFO:tasks.workunit.client.0.smithi017.stdout:3/515: dwrite da/de/d13/d16/f22 [0,4194304] 0 2024-09-20T18:35:55.919 INFO:tasks.workunit.client.0.smithi017.stdout:4/251: write d4/de/d1b/f2f [9208,84420] 0 2024-09-20T18:35:55.920 INFO:tasks.workunit.client.0.smithi017.stdout:9/466: dwrite d6/d23/d58/f94 [0,4194304] 0 2024-09-20T18:35:55.921 INFO:tasks.workunit.client.0.smithi017.stdout:4/252: write d4/de/d1b/f33 [1879816,10480] 0 2024-09-20T18:35:55.922 INFO:tasks.workunit.client.0.smithi017.stdout:4/253: truncate d4/de/d1b/f4c 588380 0 2024-09-20T18:35:55.924 INFO:tasks.workunit.client.0.smithi017.stdout:3/516: getdents da/de/d13/d2f 0 2024-09-20T18:35:55.933 INFO:tasks.workunit.client.1.smithi172.stdout:8/982: link dd/d65/df5/l10b dd/d1b/d3b/d51/dac/d12b/l14d 0 2024-09-20T18:35:55.934 INFO:tasks.workunit.client.1.smithi172.stdout:8/983: rmdir dd/d1b/d3b/d51/d5b/daf/d91 39 2024-09-20T18:35:55.935 INFO:tasks.workunit.client.1.smithi172.stdout:8/984: chown dd/de3/f106 1554057 1 2024-09-20T18:35:55.939 INFO:tasks.workunit.client.1.smithi172.stdout:8/985: link dd/d1b/f55 dd/d1b/d3b/d51/d5b/daf/d91/f14e 0 2024-09-20T18:35:55.941 INFO:tasks.workunit.client.1.smithi172.stdout:8/986: mkdir dd/d1b/d3b/d5d/d14f 0 2024-09-20T18:35:55.942 INFO:tasks.workunit.client.1.smithi172.stdout:8/987: mkdir dd/d1b/d4f/d9a/dbb/d150 0 2024-09-20T18:35:55.951 INFO:tasks.workunit.client.0.smithi017.stdout:4/254: link d4/d19/c47 d4/dc/d1e/d26/d22/c53 0 2024-09-20T18:35:55.952 INFO:tasks.workunit.client.0.smithi017.stdout:4/255: write d4/d19/f30 [3172770,46214] 0 2024-09-20T18:35:55.952 INFO:tasks.workunit.client.0.smithi017.stdout:3/517: creat da/de/d53/fa4 x:0 0 0 2024-09-20T18:35:55.953 INFO:tasks.workunit.client.0.smithi017.stdout:4/256: read - d4/de/f4f zero size 2024-09-20T18:35:55.957 INFO:tasks.workunit.client.0.smithi017.stdout:3/518: unlink da/de/d13/d2f/d26/d62/f68 0 2024-09-20T18:35:55.958 INFO:tasks.workunit.client.0.smithi017.stdout:4/257: dwrite d4/de/d1b/f33 [0,4194304] 0 2024-09-20T18:35:55.960 INFO:tasks.workunit.client.0.smithi017.stdout:3/519: mkdir da/de/d13/d2f/d26/d62/da5 0 2024-09-20T18:35:55.962 INFO:tasks.workunit.client.0.smithi017.stdout:4/258: unlink d4/dc/d1e/d26/d22/c2a 0 2024-09-20T18:35:55.962 INFO:tasks.workunit.client.0.smithi017.stdout:3/520: read da/de/d13/d2f/d26/d31/d5a/d76/d19/f4c [1681346,29090] 0 2024-09-20T18:35:55.964 INFO:tasks.workunit.client.0.smithi017.stdout:4/259: creat d4/f54 x:0 0 0 2024-09-20T18:35:55.967 INFO:tasks.workunit.client.0.smithi017.stdout:4/260: creat d4/dc/d1e/f55 x:0 0 0 2024-09-20T18:35:55.968 INFO:tasks.workunit.client.0.smithi017.stdout:4/261: fdatasync d4/d19/f35 0 2024-09-20T18:35:55.972 INFO:tasks.workunit.client.1.smithi172.stdout:9/945: sync 2024-09-20T18:35:55.976 INFO:tasks.workunit.client.1.smithi172.stdout:9/946: read d15/d1f/d2c/d7d/d48/f95 [1509927,72025] 0 2024-09-20T18:35:55.978 INFO:tasks.workunit.client.1.smithi172.stdout:9/947: mkdir d15/d1f/d2c/d7d/d48/de6/d131 0 2024-09-20T18:35:55.980 INFO:tasks.workunit.client.1.smithi172.stdout:9/948: creat d15/d1a/d6f/d7a/f132 x:0 0 0 2024-09-20T18:35:55.980 INFO:tasks.workunit.client.1.smithi172.stdout:9/949: fdatasync d15/d54/fdb 0 2024-09-20T18:35:55.982 INFO:tasks.workunit.client.0.smithi017.stdout:4/262: truncate d4/d19/f35 2823944 0 2024-09-20T18:35:55.983 INFO:tasks.workunit.client.1.smithi172.stdout:9/950: symlink d15/d1a/dfb/l133 0 2024-09-20T18:35:55.984 INFO:tasks.workunit.client.0.smithi017.stdout:4/263: rmdir d4/dc/d1e 39 2024-09-20T18:35:55.984 INFO:tasks.workunit.client.0.smithi017.stdout:3/521: dwrite da/de/d13/d2f/d26/d31/d5a/f6d [0,4194304] 0 2024-09-20T18:35:55.985 INFO:tasks.workunit.client.1.smithi172.stdout:9/951: symlink d15/d1a/d64/l134 0 2024-09-20T18:35:55.985 INFO:tasks.workunit.client.0.smithi017.stdout:4/264: write d4/f4b [280424,130355] 0 2024-09-20T18:35:55.989 INFO:tasks.workunit.client.0.smithi017.stdout:4/265: mkdir d4/de/d1b/d56 0 2024-09-20T18:35:55.990 INFO:tasks.workunit.client.1.smithi172.stdout:9/952: dwrite d15/d1f/d2c/d7d/d58/f89 [0,4194304] 0 2024-09-20T18:35:55.991 INFO:tasks.workunit.client.1.smithi172.stdout:9/953: chown d15/d1f/d2c/d7d/d48/df0/c119 52 1 2024-09-20T18:35:55.995 INFO:tasks.workunit.client.1.smithi172.stdout:9/954: mkdir d15/d1f/d2c/d7d/d48/df0/d135 0 2024-09-20T18:35:55.996 INFO:tasks.workunit.client.0.smithi017.stdout:3/522: write da/de/d13/d16/d50/f78 [1391409,37540] 0 2024-09-20T18:35:55.998 INFO:tasks.workunit.client.0.smithi017.stdout:3/523: truncate da/de/d13/d16/f22 4900395 0 2024-09-20T18:35:55.999 INFO:tasks.workunit.client.0.smithi017.stdout:3/524: write da/de/d13/d2f/d26/d31/d5a/d76/d19/f9c [582020,81219] 0 2024-09-20T18:35:56.001 INFO:tasks.workunit.client.1.smithi172.stdout:9/955: dwrite d15/d1a/d64/fce [0,4194304] 0 2024-09-20T18:35:56.002 INFO:tasks.workunit.client.0.smithi017.stdout:3/525: fsync da/de/d13/d16/f3f 0 2024-09-20T18:35:56.005 INFO:tasks.workunit.client.0.smithi017.stdout:3/526: fsync da/de/d13/d2f/d26/d31/d5a/d76/d19/f9c 0 2024-09-20T18:35:56.006 INFO:tasks.workunit.client.0.smithi017.stdout:3/527: dread - da/de/f8e zero size 2024-09-20T18:35:56.009 INFO:tasks.workunit.client.0.smithi017.stdout:3/528: unlink da/de/d13/d2f/d26/d31/d5a/c5f 0 2024-09-20T18:35:56.010 INFO:tasks.workunit.client.1.smithi172.stdout:9/956: write d15/d20/fcf [149949,92813] 0 2024-09-20T18:35:56.012 INFO:tasks.workunit.client.0.smithi017.stdout:3/529: dread da/de/d13/d16/d6e/d97/f9b [0,4194304] 0 2024-09-20T18:35:56.013 INFO:tasks.workunit.client.1.smithi172.stdout:9/957: symlink d15/d1f/d2c/d7d/d34/db5/l136 0 2024-09-20T18:35:56.018 INFO:tasks.workunit.client.1.smithi172.stdout:9/958: truncate d15/d20/d76/f84 2579476 0 2024-09-20T18:35:56.018 INFO:tasks.workunit.client.0.smithi017.stdout:3/530: getdents da/de/d53/d52 0 2024-09-20T18:35:56.019 INFO:tasks.workunit.client.1.smithi172.stdout:9/959: getdents d15/d20 0 2024-09-20T18:35:56.019 INFO:tasks.workunit.client.0.smithi017.stdout:3/531: creat da/de/d13/d16/d6e/d97/fa6 x:0 0 0 2024-09-20T18:35:56.020 INFO:tasks.workunit.client.0.smithi017.stdout:3/532: readlink da/de/d13/d2f/d26/l34 0 2024-09-20T18:35:56.022 INFO:tasks.workunit.client.0.smithi017.stdout:3/533: write da/de/d53/d52/f63 [1244894,29037] 0 2024-09-20T18:35:56.022 INFO:tasks.workunit.client.1.smithi172.stdout:9/960: link d15/lc2 d15/d20/d76/dc6/l137 0 2024-09-20T18:35:56.024 INFO:tasks.workunit.client.1.smithi172.stdout:9/961: creat d15/d1f/d2c/d7d/d58/f138 x:0 0 0 2024-09-20T18:35:56.027 INFO:tasks.workunit.client.0.smithi017.stdout:3/534: dwrite da/de/d13/d2f/d26/d31/d5a/f6d [0,4194304] 0 2024-09-20T18:35:56.028 INFO:tasks.workunit.client.1.smithi172.stdout:9/962: dwrite d15/d1a/d6f/fbd [0,4194304] 0 2024-09-20T18:35:56.030 INFO:tasks.workunit.client.0.smithi017.stdout:3/535: creat da/de/d53/fa7 x:0 0 0 2024-09-20T18:35:56.033 INFO:tasks.workunit.client.1.smithi172.stdout:9/963: link d15/d1f/d2c/d7d/d48/f95 d15/d20/d76/f139 0 2024-09-20T18:35:56.035 INFO:tasks.workunit.client.1.smithi172.stdout:9/964: mkdir d15/d1a/d64/dda/dfe/d13a 0 2024-09-20T18:35:56.036 INFO:tasks.workunit.client.1.smithi172.stdout:9/965: stat d15/d1f/ld4 0 2024-09-20T18:35:56.036 INFO:tasks.workunit.client.0.smithi017.stdout:3/536: dwrite da/de/d53/d52/f63 [0,4194304] 0 2024-09-20T18:35:56.037 INFO:tasks.workunit.client.1.smithi172.stdout:9/966: chown d15/d1f/l5a 34439 1 2024-09-20T18:35:56.040 INFO:tasks.workunit.client.0.smithi017.stdout:3/537: creat da/de/d13/d2f/d26/d62/da5/fa8 x:0 0 0 2024-09-20T18:35:56.040 INFO:tasks.workunit.client.1.smithi172.stdout:2/992: sync 2024-09-20T18:35:56.040 INFO:tasks.workunit.client.1.smithi172.stdout:1/969: sync 2024-09-20T18:35:56.043 INFO:tasks.workunit.client.0.smithi017.stdout:3/538: mkdir da/de/d13/d2f/d26/d62/da5/da9 0 2024-09-20T18:35:56.046 INFO:tasks.workunit.client.1.smithi172.stdout:1/970: creat d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dd5/d125/f141 x:0 0 0 2024-09-20T18:35:56.048 INFO:tasks.workunit.client.1.smithi172.stdout:1/971: readlink d0/d8/db/d25/d2b/d3d/d65/l80 0 2024-09-20T18:35:56.048 INFO:tasks.workunit.client.1.smithi172.stdout:2/993: dwrite d0/d60/f69 [0,4194304] 0 2024-09-20T18:35:56.050 INFO:tasks.workunit.client.0.smithi017.stdout:3/539: getdents da/de/d13/d2f/d26/d31/d5a/d76 0 2024-09-20T18:35:56.050 INFO:tasks.workunit.client.1.smithi172.stdout:1/972: truncate d0/d8/d5f/dfb/f11d 4972873 0 2024-09-20T18:35:56.054 INFO:tasks.workunit.client.1.smithi172.stdout:1/973: creat d0/d8/d5f/d113/d96/dd0/f142 x:0 0 0 2024-09-20T18:35:56.055 INFO:tasks.workunit.client.1.smithi172.stdout:1/974: fsync d0/d22/f28 0 2024-09-20T18:35:56.055 INFO:tasks.workunit.client.1.smithi172.stdout:2/994: mkdir d0/d145 0 2024-09-20T18:35:56.056 INFO:tasks.workunit.client.1.smithi172.stdout:9/967: read d15/d20/f21 [6678989,42866] 0 2024-09-20T18:35:56.056 INFO:tasks.workunit.client.0.smithi017.stdout:3/540: symlink da/de/d13/d2f/d26/laa 0 2024-09-20T18:35:56.058 INFO:tasks.workunit.client.1.smithi172.stdout:2/995: chown d0/d2c/d3f/dab/d22/d10/d6a/d98/dd0/d9f/d106/d9d/c119 38893 1 2024-09-20T18:35:56.061 INFO:tasks.workunit.client.1.smithi172.stdout:2/996: truncate d0/d2c/d3f/dab/d18/d29/d42/d4b/d53/f12e 170659 0 2024-09-20T18:35:56.062 INFO:tasks.workunit.client.1.smithi172.stdout:1/975: creat d0/d8/db/d25/d2b/d3d/d65/d93/dbe/f143 x:0 0 0 2024-09-20T18:35:56.063 INFO:tasks.workunit.client.0.smithi017.stdout:3/541: link da/de/d13/d16/d6e/l70 da/lab 0 2024-09-20T18:35:56.066 INFO:tasks.workunit.client.1.smithi172.stdout:2/997: link d0/d2c/d3f/dab/d22/d10/d3c/c89 d0/d2c/d3f/dab/d22/d10/d3c/d68/c146 0 2024-09-20T18:35:56.068 INFO:tasks.workunit.client.1.smithi172.stdout:1/976: dwrite d0/d8/db/f3c [4194304,4194304] 0 2024-09-20T18:35:56.072 INFO:tasks.workunit.client.1.smithi172.stdout:1/977: creat d0/d8/f144 x:0 0 0 2024-09-20T18:35:56.072 INFO:tasks.workunit.client.1.smithi172.stdout:1/978: fdatasync d0/d8/db/f33 0 2024-09-20T18:35:56.078 INFO:tasks.workunit.client.1.smithi172.stdout:1/979: mkdir d0/d8/d5f/d113/d96/d12a/d145 0 2024-09-20T18:35:56.082 INFO:tasks.workunit.client.1.smithi172.stdout:8/988: sync 2024-09-20T18:35:56.082 INFO:tasks.workunit.client.1.smithi172.stdout:6/896: sync 2024-09-20T18:35:56.083 INFO:tasks.workunit.client.1.smithi172.stdout:1/980: rename d0/d8/db/d25/d6d/f7e to d0/d8/df4/f146 0 2024-09-20T18:35:56.084 INFO:tasks.workunit.client.1.smithi172.stdout:6/897: mkdir d0/d18/d1c/d21/d26/d34/d39/d74/dbf/d12b 0 2024-09-20T18:35:56.086 INFO:tasks.workunit.client.1.smithi172.stdout:8/989: rename dd/d1b/d3b/d51/d5b/daf/d91/lb2 to dd/de3/d10c/l151 0 2024-09-20T18:35:56.087 INFO:tasks.workunit.client.1.smithi172.stdout:1/981: creat d0/d8/db/d25/d2b/d3d/d104/f147 x:0 0 0 2024-09-20T18:35:56.087 INFO:tasks.workunit.client.1.smithi172.stdout:8/990: truncate dd/d1b/d3b/d51/dac/fc4 4577634 0 2024-09-20T18:35:56.089 INFO:tasks.workunit.client.1.smithi172.stdout:8/991: symlink dd/d1b/d4f/d86/de8/l152 0 2024-09-20T18:35:56.091 INFO:tasks.workunit.client.1.smithi172.stdout:6/898: getdents d0/d18/d1c/d123/dda/d7b/d7e/dd3 0 2024-09-20T18:35:56.094 INFO:tasks.workunit.client.1.smithi172.stdout:1/982: dwrite d0/d8/d5f/dfb/f11d [4194304,4194304] 0 2024-09-20T18:35:56.095 INFO:tasks.workunit.client.1.smithi172.stdout:6/899: mknod d0/d18/d1c/d21/d26/d34/d39/d129/c12c 0 2024-09-20T18:35:56.096 INFO:tasks.workunit.client.1.smithi172.stdout:1/983: write d0/d8/f144 [683267,125070] 0 2024-09-20T18:35:56.098 INFO:tasks.workunit.client.1.smithi172.stdout:6/900: stat d0/d18/d1c/d21/d26/d34/d39/fc0 0 2024-09-20T18:35:56.100 INFO:tasks.workunit.client.1.smithi172.stdout:1/984: mkdir d0/d8/db/d39/d148 0 2024-09-20T18:35:56.102 INFO:tasks.workunit.client.1.smithi172.stdout:2/998: truncate d0/d2c/d3f/dab/d18/d29/d42/fd5 1452532 0 2024-09-20T18:35:56.103 INFO:tasks.workunit.client.1.smithi172.stdout:9/968: dwrite d15/d1f/d7e/f93 [0,4194304] 0 2024-09-20T18:35:56.104 INFO:tasks.workunit.client.1.smithi172.stdout:1/985: fdatasync d0/d8/db/d25/d2b/d3d/d65/d93/dbe/f106 0 2024-09-20T18:35:56.105 INFO:tasks.workunit.client.1.smithi172.stdout:6/901: symlink d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0/l12d 0 2024-09-20T18:35:56.108 INFO:tasks.workunit.client.1.smithi172.stdout:6/902: dread - d0/d18/d1c/d21/d26/d34/d9c/dc7/f10f zero size 2024-09-20T18:35:56.113 INFO:tasks.workunit.client.0.smithi017.stdout:0/285: sync 2024-09-20T18:35:56.113 INFO:tasks.workunit.client.0.smithi017.stdout:8/266: sync 2024-09-20T18:35:56.115 INFO:tasks.workunit.client.0.smithi017.stdout:8/267: write d0/d6/d28/d3a/f49 [1141808,74241] 0 2024-09-20T18:35:56.115 INFO:tasks.workunit.client.0.smithi017.stdout:8/268: readlink d0/d6/l17 0 2024-09-20T18:35:56.120 INFO:tasks.workunit.client.1.smithi172.stdout:1/986: fdatasync d0/d8/df4/f146 0 2024-09-20T18:35:56.121 INFO:tasks.workunit.client.1.smithi172.stdout:2/999: rename d0/d2c/d3f/dab/d22/d10/d3c to d0/d2c/d3f/dab/d22/d147 0 2024-09-20T18:35:56.123 INFO:tasks.workunit.client.1.smithi172.stdout:1/987: dread d0/d8/db/f13a [0,4194304] 0 2024-09-20T18:35:56.127 INFO:tasks.workunit.client.1.smithi172.stdout:1/988: dread d0/d8/d5f/dfb/f11c [0,4194304] 0 2024-09-20T18:35:56.128 INFO:tasks.workunit.client.1.smithi172.stdout:8/992: dwrite dd/d1b/d3b/d51/d34/fb4 [0,4194304] 0 2024-09-20T18:35:56.130 INFO:tasks.workunit.client.1.smithi172.stdout:1/989: fdatasync d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/ff8 0 2024-09-20T18:35:56.130 INFO:tasks.workunit.client.0.smithi017.stdout:0/286: write d4/fa [4540354,17279] 0 2024-09-20T18:35:56.132 INFO:tasks.workunit.client.1.smithi172.stdout:8/993: creat dd/d1b/d3b/d5d/df6/f153 x:0 0 0 2024-09-20T18:35:56.133 INFO:tasks.workunit.client.1.smithi172.stdout:1/990: readlink d0/dc2/lfc 0 2024-09-20T18:35:56.134 INFO:tasks.workunit.client.1.smithi172.stdout:6/903: truncate d0/d18/f29 3183980 0 2024-09-20T18:35:56.135 INFO:tasks.workunit.client.1.smithi172.stdout:9/969: dwrite d15/d1f/d88/f98 [0,4194304] 0 2024-09-20T18:35:56.135 INFO:tasks.workunit.client.0.smithi017.stdout:0/287: mknod d4/db/d1e/d24/c5a 0 2024-09-20T18:35:56.136 INFO:tasks.workunit.client.0.smithi017.stdout:0/288: write d4/f8 [2267673,123942] 0 2024-09-20T18:35:56.137 INFO:tasks.workunit.client.1.smithi172.stdout:9/970: write d15/fd2 [842756,83775] 0 2024-09-20T18:35:56.138 INFO:tasks.workunit.client.1.smithi172.stdout:8/994: mknod dd/d1b/d4f/d86/de8/c154 0 2024-09-20T18:35:56.144 INFO:tasks.workunit.client.1.smithi172.stdout:6/904: dwrite d0/d18/f2b [0,4194304] 0 2024-09-20T18:35:56.148 INFO:tasks.workunit.client.1.smithi172.stdout:1/991: symlink d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dcf/d135/l149 0 2024-09-20T18:35:56.148 INFO:tasks.workunit.client.1.smithi172.stdout:9/971: dwrite d15/d1a/dfb/fb9 [0,4194304] 0 2024-09-20T18:35:56.150 INFO:tasks.workunit.client.1.smithi172.stdout:1/992: read d0/d8/db/d25/d2b/d3d/d65/ff0 [14034,80056] 0 2024-09-20T18:35:56.151 INFO:tasks.workunit.client.0.smithi017.stdout:0/289: creat d4/db/f5b x:0 0 0 2024-09-20T18:35:56.155 INFO:tasks.workunit.client.1.smithi172.stdout:8/995: rename dd/d1b/d3b/c53 to dd/da9/c155 0 2024-09-20T18:35:56.158 INFO:tasks.workunit.client.0.smithi017.stdout:0/290: dwrite d4/db/f2c [0,4194304] 0 2024-09-20T18:35:56.159 INFO:tasks.workunit.client.1.smithi172.stdout:1/993: rmdir d0/d12c 39 2024-09-20T18:35:56.160 INFO:tasks.workunit.client.1.smithi172.stdout:1/994: dread - d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/ff8 zero size 2024-09-20T18:35:56.161 INFO:tasks.workunit.client.1.smithi172.stdout:9/972: mkdir d15/d1f/d2c/d7d/d48/d13b 0 2024-09-20T18:35:56.164 INFO:tasks.workunit.client.1.smithi172.stdout:8/996: creat dd/d1b/d3b/dc7/f156 x:0 0 0 2024-09-20T18:35:56.165 INFO:tasks.workunit.client.1.smithi172.stdout:8/997: stat dd/d1b/d4f/ddd 0 2024-09-20T18:35:56.166 INFO:tasks.workunit.client.0.smithi017.stdout:0/291: dwrite d4/db/f3b [0,4194304] 0 2024-09-20T18:35:56.166 INFO:tasks.workunit.client.1.smithi172.stdout:1/995: rename d0/f5a to d0/d8/db/d25/d2b/d3d/d65/d93/dbe/dc9/f14a 0 2024-09-20T18:35:56.170 INFO:tasks.workunit.client.1.smithi172.stdout:9/973: rename d15/d20/c9d to d15/d1f/d2c/d57/c13c 0 2024-09-20T18:35:56.171 INFO:tasks.workunit.client.1.smithi172.stdout:1/996: symlink d0/d8/d5f/d12e/l14b 0 2024-09-20T18:35:56.174 INFO:tasks.workunit.client.1.smithi172.stdout:1/997: symlink d0/dc2/l14c 0 2024-09-20T18:35:56.176 INFO:tasks.workunit.client.1.smithi172.stdout:1/998: unlink d0/d8/f144 0 2024-09-20T18:35:56.179 INFO:tasks.workunit.client.1.smithi172.stdout:1/999: creat d0/d8/df4/d11a/d123/f14d x:0 0 0 2024-09-20T18:35:56.194 INFO:tasks.workunit.client.1.smithi172.stdout:9/974: truncate d15/d1a/d82/f3e 1108567 0 2024-09-20T18:35:56.194 INFO:tasks.workunit.client.1.smithi172.stdout:6/905: truncate d0/d18/f29 178033 0 2024-09-20T18:35:56.196 INFO:tasks.workunit.client.1.smithi172.stdout:9/975: read - d15/d4a/dd7/fd9 zero size 2024-09-20T18:35:56.196 INFO:tasks.workunit.client.1.smithi172.stdout:8/998: dwrite dd/d1b/d3b/d51/d5b/daf/f83 [0,4194304] 0 2024-09-20T18:35:56.197 INFO:tasks.workunit.client.1.smithi172.stdout:6/906: symlink d0/d18/d1c/d123/l12e 0 2024-09-20T18:35:56.200 INFO:tasks.workunit.client.1.smithi172.stdout:6/907: dread d0/f13 [0,4194304] 0 2024-09-20T18:35:56.206 INFO:tasks.workunit.client.1.smithi172.stdout:9/976: dwrite d15/fd2 [0,4194304] 0 2024-09-20T18:35:56.210 INFO:tasks.workunit.client.1.smithi172.stdout:9/977: symlink d15/d1a/l13d 0 2024-09-20T18:35:56.211 INFO:tasks.workunit.client.1.smithi172.stdout:8/999: dwrite dd/d1b/d3b/f4a [0,4194304] 0 2024-09-20T18:35:56.211 INFO:tasks.workunit.client.1.smithi172.stdout:9/978: dread - d15/d4a/ff4 zero size 2024-09-20T18:35:56.214 INFO:tasks.workunit.client.1.smithi172.stdout:9/979: rmdir d15/d1f/d88/d11c 39 2024-09-20T18:35:56.217 INFO:tasks.workunit.client.1.smithi172.stdout:9/980: readlink d15/d20/d104/l116 0 2024-09-20T18:35:56.217 INFO:tasks.workunit.client.1.smithi172.stdout:9/981: chown d15/d54/f78 26 1 2024-09-20T18:35:56.220 INFO:tasks.workunit.client.1.smithi172.stdout:9/982: truncate d15/d20/f108 557616 0 2024-09-20T18:35:56.230 INFO:tasks.workunit.client.1.smithi172.stdout:9/983: rename d15/d1f/d88/f98 to d15/d20/d76/dc6/f13e 0 2024-09-20T18:35:56.234 INFO:tasks.workunit.client.1.smithi172.stdout:9/984: dread d15/d1f/d2c/d7d/d34/db5/f105 [0,4194304] 0 2024-09-20T18:35:56.235 INFO:tasks.workunit.client.1.smithi172.stdout:6/908: dread d0/d18/d1c/d21/f7c [0,4194304] 0 2024-09-20T18:35:56.236 INFO:tasks.workunit.client.1.smithi172.stdout:6/909: stat d0/d18/d1c/d21/d26/d34/d39/d46/c11 0 2024-09-20T18:35:56.240 INFO:tasks.workunit.client.1.smithi172.stdout:9/985: dwrite d15/d1a/d64/fce [0,4194304] 0 2024-09-20T18:35:56.258 INFO:tasks.workunit.client.1.smithi172.stdout:6/910: fsync d0/d18/d1c/d21/d26/d34/d6b/d7d/fba 0 2024-09-20T18:35:56.259 INFO:tasks.workunit.client.1.smithi172.stdout:9/986: mkdir d15/d1f/d2c/d7d/d13f 0 2024-09-20T18:35:56.260 INFO:tasks.workunit.client.1.smithi172.stdout:6/911: mknod d0/d18/d1c/d123/def/dff/c12f 0 2024-09-20T18:35:56.261 INFO:tasks.workunit.client.1.smithi172.stdout:9/987: mkdir d15/d1a/d64/dda/dfe/d140 0 2024-09-20T18:35:56.262 INFO:tasks.workunit.client.1.smithi172.stdout:6/912: creat d0/d18/d1c/d21/d26/d34/d9c/dc7/f130 x:0 0 0 2024-09-20T18:35:56.264 INFO:tasks.workunit.client.1.smithi172.stdout:6/913: write d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0/ff7 [586482,98647] 0 2024-09-20T18:35:56.264 INFO:tasks.workunit.client.1.smithi172.stdout:9/988: mknod d15/d1f/d2c/d7d/d34/db5/ded/c141 0 2024-09-20T18:35:56.266 INFO:tasks.workunit.client.1.smithi172.stdout:6/914: chown d0/d18/d1c/d21/d26/d34/d7a/c49 6499 1 2024-09-20T18:35:56.268 INFO:tasks.workunit.client.1.smithi172.stdout:6/915: dread d0/d18/d1c/d123/dda/d7b/d7e/fb0 [0,4194304] 0 2024-09-20T18:35:56.271 INFO:tasks.workunit.client.1.smithi172.stdout:6/916: fsync d0/d18/d1c/d21/d26/d34/d6b/d7d/fba 0 2024-09-20T18:35:56.273 INFO:tasks.workunit.client.1.smithi172.stdout:9/989: dread d15/d1f/d2c/d7d/d48/fba [0,4194304] 0 2024-09-20T18:35:56.274 INFO:tasks.workunit.client.1.smithi172.stdout:9/990: read - d15/d54/fdb zero size 2024-09-20T18:35:56.292 INFO:tasks.workunit.client.1.smithi172.stdout:6/917: dwrite d0/d18/d1c/d21/d26/d34/d7a/d99/fa4 [0,4194304] 0 2024-09-20T18:35:56.292 INFO:tasks.workunit.client.1.smithi172.stdout:9/991: dwrite d15/d1f/d2c/d7d/d34/db5/deb/f12c [0,4194304] 0 2024-09-20T18:35:56.295 INFO:tasks.workunit.client.1.smithi172.stdout:6/918: mknod d0/d18/d1c/d21/d26/d34/d39/d46/c131 0 2024-09-20T18:35:56.298 INFO:tasks.workunit.client.1.smithi172.stdout:6/919: rmdir d0/d18/d65 39 2024-09-20T18:35:56.300 INFO:tasks.workunit.client.1.smithi172.stdout:9/992: truncate d15/d1f/d2c/d7d/d34/db5/fbc 2418519 0 2024-09-20T18:35:56.303 INFO:tasks.workunit.client.1.smithi172.stdout:9/993: symlink d15/d1f/d2c/d7d/d48/d13b/l142 0 2024-09-20T18:35:56.306 INFO:tasks.workunit.client.1.smithi172.stdout:9/994: creat d15/d20/d76/f143 x:0 0 0 2024-09-20T18:35:56.306 INFO:tasks.workunit.client.1.smithi172.stdout:6/920: dwrite d0/d18/d1c/d21/d26/d34/f82 [0,4194304] 0 2024-09-20T18:35:56.311 INFO:tasks.workunit.client.0.smithi017.stdout:2/440: sync 2024-09-20T18:35:56.312 INFO:tasks.workunit.client.1.smithi172.stdout:6/921: creat d0/d18/d1c/d21/d26/d79/f132 x:0 0 0 2024-09-20T18:35:56.314 INFO:tasks.workunit.client.1.smithi172.stdout:6/922: readlink d0/d18/l69 0 2024-09-20T18:35:56.315 INFO:tasks.workunit.client.1.smithi172.stdout:6/923: write d0/d18/d1c/d123/dda/f78 [4859618,25980] 0 2024-09-20T18:35:56.318 INFO:tasks.workunit.client.0.smithi017.stdout:2/441: link d1/dc/d20/d2e/d30/f79 d1/dc/d20/d2e/d30/d85/d46/d48/f90 0 2024-09-20T18:35:56.321 INFO:tasks.workunit.client.1.smithi172.stdout:6/924: dread d0/d18/fee [0,4194304] 0 2024-09-20T18:35:56.321 INFO:tasks.workunit.client.0.smithi017.stdout:2/442: write d1/dc/d20/d2e/d30/d85/d46/f51 [2191112,71435] 0 2024-09-20T18:35:56.322 INFO:tasks.workunit.client.0.smithi017.stdout:2/443: chown d1/dc/d20/f84 6 1 2024-09-20T18:35:56.323 INFO:tasks.workunit.client.1.smithi172.stdout:9/995: truncate d15/d1f/d2c/d7d/d58/f89 3974648 0 2024-09-20T18:35:56.324 INFO:tasks.workunit.client.1.smithi172.stdout:9/996: fdatasync d15/d1f/d2c/d7d/d48/df0/f114 0 2024-09-20T18:35:56.324 INFO:tasks.workunit.client.1.smithi172.stdout:9/997: stat d15/d1f/d2c/d7d/d48/c5c 0 2024-09-20T18:35:56.324 INFO:tasks.workunit.client.1.smithi172.stdout:6/925: mknod d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/c133 0 2024-09-20T18:35:56.327 INFO:tasks.workunit.client.1.smithi172.stdout:6/926: chown d0/d18/d1c/d21/d26/d34/d9c/dc7/f130 2720988 1 2024-09-20T18:35:56.327 INFO:tasks.workunit.client.1.smithi172.stdout:6/927: chown d0/d18/d1c/d123/dda/d7b/fcf 13 1 2024-09-20T18:35:56.328 INFO:tasks.workunit.client.1.smithi172.stdout:6/928: stat d0/d18/d1c/d21/d26/d34/d9c/dac/ce3 0 2024-09-20T18:35:56.332 INFO:tasks.workunit.client.0.smithi017.stdout:2/444: truncate d1/dc/d20/d2e/f42 1444846 0 2024-09-20T18:35:56.334 INFO:tasks.workunit.client.0.smithi017.stdout:2/445: symlink d1/d6c/l91 0 2024-09-20T18:35:56.335 INFO:tasks.workunit.client.0.smithi017.stdout:2/446: dread d1/dc/d20/d2e/d30/f79 [0,4194304] 0 2024-09-20T18:35:56.339 INFO:tasks.workunit.client.1.smithi172.stdout:6/929: dwrite d0/d18/d1c/d123/def/dff/fe1 [0,4194304] 0 2024-09-20T18:35:56.339 INFO:tasks.workunit.client.1.smithi172.stdout:9/998: dread d15/d1f/d2c/d7d/d34/db5/fbc [0,4194304] 0 2024-09-20T18:35:56.340 INFO:tasks.workunit.client.0.smithi017.stdout:2/447: rename d1/dc/d20/d2e/d30/d85/d46/f68 to d1/f92 0 2024-09-20T18:35:56.341 INFO:tasks.workunit.client.1.smithi172.stdout:6/930: fsync d0/d18/d1c/d21/d26/d34/d6b/d7d/f105 0 2024-09-20T18:35:56.343 INFO:tasks.workunit.client.1.smithi172.stdout:6/931: stat d0/d18/d1c/d21/d26/d34/d9c/dac/ce3 0 2024-09-20T18:35:56.344 INFO:tasks.workunit.client.0.smithi017.stdout:2/448: creat d1/dc/d20/d2e/d30/d85/f93 x:0 0 0 2024-09-20T18:35:56.344 INFO:tasks.workunit.client.1.smithi172.stdout:9/999: dread d15/d20/d76/dc6/f13e [0,4194304] 0 2024-09-20T18:35:56.346 INFO:tasks.workunit.client.1.smithi172.stdout:6/932: mknod d0/d18/d1c/d21/d26/d34/d39/d74/dbf/d12b/c134 0 2024-09-20T18:35:56.347 INFO:tasks.workunit.client.0.smithi017.stdout:2/449: rename d1/l10 to d1/dc/d20/d2e/d30/d85/d53/d6b/l94 0 2024-09-20T18:35:56.348 INFO:tasks.workunit.client.1.smithi172.stdout:6/933: symlink d0/d18/d1c/d123/def/d121/l135 0 2024-09-20T18:35:56.352 INFO:tasks.workunit.client.0.smithi017.stdout:2/450: getdents d1/dc/d20/d2e/d30/d85/d3d 0 2024-09-20T18:35:56.355 INFO:tasks.workunit.client.0.smithi017.stdout:2/451: link d1/dc/d20/d2e/d30/f79 d1/dc/d20/d2e/d30/d85/d53/d6b/f95 0 2024-09-20T18:35:56.357 INFO:tasks.workunit.client.0.smithi017.stdout:2/452: unlink d1/d67/c6f 0 2024-09-20T18:35:56.358 INFO:tasks.workunit.client.0.smithi017.stdout:2/453: write d1/dc/d20/d2e/d30/d85/d46/f51 [2697628,106212] 0 2024-09-20T18:35:56.361 INFO:tasks.workunit.client.1.smithi172.stdout:6/934: write d0/d18/d1c/d123/feb [82101,113132] 0 2024-09-20T18:35:56.364 INFO:tasks.workunit.client.0.smithi017.stdout:2/454: getdents d1 0 2024-09-20T18:35:56.365 INFO:tasks.workunit.client.1.smithi172.stdout:6/935: rename d0/d18/d1c/d21/d26/d34/fb3 to d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/f136 0 2024-09-20T18:35:56.366 INFO:tasks.workunit.client.0.smithi017.stdout:2/455: truncate d1/f28 2951065 0 2024-09-20T18:35:56.367 INFO:tasks.workunit.client.0.smithi017.stdout:2/456: fdatasync d1/dc/d20/d2e/d30/d85/d46/f65 0 2024-09-20T18:35:56.367 INFO:tasks.workunit.client.1.smithi172.stdout:6/936: mkdir d0/d18/d1c/d21/d26/d34/d6b/d7d/d35/d137 0 2024-09-20T18:35:56.370 INFO:tasks.workunit.client.1.smithi172.stdout:6/937: creat d0/d18/d1c/d21/d26/d34/d6b/d7d/d35/d137/f138 x:0 0 0 2024-09-20T18:35:56.375 INFO:tasks.workunit.client.1.smithi172.stdout:6/938: creat d0/d18/d1c/d21/d26/f139 x:0 0 0 2024-09-20T18:35:56.376 INFO:tasks.workunit.client.0.smithi017.stdout:2/457: truncate d1/dc/d20/d2e/d30/d85/d46/f63 4064776 0 2024-09-20T18:35:56.378 INFO:tasks.workunit.client.0.smithi017.stdout:2/458: fdatasync d1/dc/d20/d2e/d30/d85/d46/f63 0 2024-09-20T18:35:56.381 INFO:tasks.workunit.client.1.smithi172.stdout:6/939: dwrite d0/d18/d1c/d21/d26/d34/d39/d46/fd2 [0,4194304] 0 2024-09-20T18:35:56.386 INFO:tasks.workunit.client.1.smithi172.stdout:6/940: mknod d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0/c13a 0 2024-09-20T18:35:56.387 INFO:tasks.workunit.client.0.smithi017.stdout:2/459: dwrite d1/dc/d20/d2e/d30/d85/d3d/f44 [0,4194304] 0 2024-09-20T18:35:56.391 INFO:tasks.workunit.client.0.smithi017.stdout:2/460: mkdir d1/dc/d20/d2e/d30/d85/d53/d96 0 2024-09-20T18:35:56.394 INFO:tasks.workunit.client.0.smithi017.stdout:2/461: creat d1/dc/d20/d2e/d30/f97 x:0 0 0 2024-09-20T18:35:56.397 INFO:tasks.workunit.client.0.smithi017.stdout:2/462: mkdir d1/dc/d20/d2e/d30/d85/d98 0 2024-09-20T18:35:56.400 INFO:tasks.workunit.client.1.smithi172.stdout:6/941: truncate d0/d18/d1c/d21/d26/d34/d39/d74/dbf/de7/f112 3004215 0 2024-09-20T18:35:56.401 INFO:tasks.workunit.client.0.smithi017.stdout:2/463: write d1/dc/d20/d2e/f4f [867240,30474] 0 2024-09-20T18:35:56.401 INFO:tasks.workunit.client.1.smithi172.stdout:6/942: dread - d0/d18/d1c/d123/dda/d7b/f94 zero size 2024-09-20T18:35:56.403 INFO:tasks.workunit.client.1.smithi172.stdout:6/943: read d0/d18/d1c/d21/d26/d34/d39/f64 [35461,111281] 0 2024-09-20T18:35:56.404 INFO:tasks.workunit.client.0.smithi017.stdout:2/464: unlink d1/dc/d20/d2e/d30/c52 0 2024-09-20T18:35:56.405 INFO:tasks.workunit.client.1.smithi172.stdout:6/944: mknod d0/d18/d1c/d123/d113/d11b/c13b 0 2024-09-20T18:35:56.409 INFO:tasks.workunit.client.0.smithi017.stdout:2/465: dwrite d1/dc/d20/d2e/d30/d85/d46/f65 [0,4194304] 0 2024-09-20T18:35:56.410 INFO:tasks.workunit.client.0.smithi017.stdout:2/466: chown d1/d67 27018 1 2024-09-20T18:35:56.414 INFO:tasks.workunit.client.1.smithi172.stdout:6/945: truncate d0/d18/fee 57201 0 2024-09-20T18:35:56.415 INFO:tasks.workunit.client.0.smithi017.stdout:2/467: truncate d1/dc/d20/d2e/d30/d85/d46/d48/f4a 594767 0 2024-09-20T18:35:56.416 INFO:tasks.workunit.client.1.smithi172.stdout:6/946: rmdir d0/d18/d1c/d21/d26/d34/d39 39 2024-09-20T18:35:56.419 INFO:tasks.workunit.client.0.smithi017.stdout:2/468: dread d1/dc/d20/d2e/f4f [0,4194304] 0 2024-09-20T18:35:56.420 INFO:tasks.workunit.client.0.smithi017.stdout:2/469: mkdir d1/d1f/d99 0 2024-09-20T18:35:56.423 INFO:tasks.workunit.client.1.smithi172.stdout:6/947: rename d0/d18/d1c/d21/d26/d34/d39/d46/fa5 to d0/d18/d1c/d21/d26/d34/d39/f13c 0 2024-09-20T18:35:56.423 INFO:tasks.workunit.client.0.smithi017.stdout:2/470: symlink d1/dc/d20/d2e/d30/d85/d3d/l9a 0 2024-09-20T18:35:56.426 INFO:tasks.workunit.client.0.smithi017.stdout:2/471: link d1/dc/d20/d2e/d30/l82 d1/dc/d20/d2e/d30/d85/d46/l9b 0 2024-09-20T18:35:56.431 INFO:tasks.workunit.client.0.smithi017.stdout:2/472: dwrite d1/dc/d20/d2e/f49 [0,4194304] 0 2024-09-20T18:35:56.432 INFO:tasks.workunit.client.0.smithi017.stdout:2/473: chown d1/dc/d20/d2e/d30/l3c 2314 1 2024-09-20T18:35:56.445 INFO:tasks.workunit.client.0.smithi017.stdout:2/474: dread d1/fb [0,4194304] 0 2024-09-20T18:35:56.499 INFO:tasks.workunit.client.0.smithi017.stdout:2/475: dwrite d1/dc/d20/d2e/d30/f4b [0,4194304] 0 2024-09-20T18:35:56.515 INFO:tasks.workunit.client.0.smithi017.stdout:2/476: getdents d1/dc/d20/d2e/d30/d85/d3d/d77 0 2024-09-20T18:35:56.516 INFO:tasks.workunit.client.0.smithi017.stdout:2/477: mknod d1/dc/d20/d2e/d30/d85/d53/d6b/c9c 0 2024-09-20T18:35:56.518 INFO:tasks.workunit.client.0.smithi017.stdout:2/478: mkdir d1/dc/d20/d2e/d30/d9d 0 2024-09-20T18:35:56.519 INFO:tasks.workunit.client.0.smithi017.stdout:2/479: mkdir d1/d67/d8f/d9e 0 2024-09-20T18:35:56.521 INFO:tasks.workunit.client.0.smithi017.stdout:2/480: creat d1/d67/d8f/d9e/f9f x:0 0 0 2024-09-20T18:35:56.523 INFO:tasks.workunit.client.0.smithi017.stdout:2/481: rename d1/df/d17/c70 to d1/d67/d8f/d9e/ca0 0 2024-09-20T18:35:56.524 INFO:tasks.workunit.client.0.smithi017.stdout:2/482: fdatasync d1/dc/d20/d2e/d30/d85/d46/d48/f5d 0 2024-09-20T18:35:56.525 INFO:tasks.workunit.client.0.smithi017.stdout:2/483: dread - d1/dc/d20/d2e/d30/d85/f87 zero size 2024-09-20T18:35:56.527 INFO:tasks.workunit.client.0.smithi017.stdout:2/484: unlink d1/dc/d20/f74 0 2024-09-20T18:35:56.528 INFO:tasks.workunit.client.0.smithi017.stdout:2/485: write d1/f92 [4722415,114015] 0 2024-09-20T18:35:56.530 INFO:tasks.workunit.client.0.smithi017.stdout:2/486: unlink d1/df/f16 0 2024-09-20T18:35:56.531 INFO:tasks.workunit.client.0.smithi017.stdout:2/487: chown d1/df/d17/f64 778982681 1 2024-09-20T18:35:56.532 INFO:tasks.workunit.client.0.smithi017.stdout:2/488: chown d1/dc/d20/d2e/f42 15113582 1 2024-09-20T18:35:56.534 INFO:tasks.workunit.client.0.smithi017.stdout:2/489: symlink d1/dc/d20/d2e/d30/d85/d53/d6b/la1 0 2024-09-20T18:35:56.534 INFO:tasks.workunit.client.0.smithi017.stdout:2/490: write d1/dc/d20/d2e/d30/d85/f93 [43243,19152] 0 2024-09-20T18:35:56.545 INFO:tasks.workunit.client.0.smithi017.stdout:2/491: dread d1/dc/d20/d2e/d30/d85/d3d/f36 [0,4194304] 0 2024-09-20T18:35:56.547 INFO:tasks.workunit.client.0.smithi017.stdout:2/492: mknod d1/dc/d20/d2e/d30/d85/d46/ca2 0 2024-09-20T18:35:56.555 INFO:tasks.workunit.client.0.smithi017.stdout:2/493: truncate d1/d1f/f33 3061112 0 2024-09-20T18:35:56.556 INFO:tasks.workunit.client.0.smithi017.stdout:2/494: chown d1/dc/d20/d2e/d30/d85/d46/d48 23 1 2024-09-20T18:35:56.556 INFO:tasks.workunit.client.0.smithi017.stdout:2/495: readlink d1/d1f/l2a 0 2024-09-20T18:35:56.557 INFO:tasks.workunit.client.0.smithi017.stdout:2/496: chown d1/d1f/f6e 11 1 2024-09-20T18:35:56.559 INFO:tasks.workunit.client.0.smithi017.stdout:2/497: mkdir d1/dc/d20/d2e/d30/d85/d46/da3 0 2024-09-20T18:35:56.560 INFO:tasks.workunit.client.0.smithi017.stdout:2/498: write d1/f92 [386163,29637] 0 2024-09-20T18:35:56.566 INFO:tasks.workunit.client.0.smithi017.stdout:2/499: dwrite d1/df/f83 [0,4194304] 0 2024-09-20T18:35:56.566 INFO:tasks.workunit.client.1.smithi172.stdout:6/948: sync 2024-09-20T18:35:56.568 INFO:tasks.workunit.client.1.smithi172.stdout:6/949: stat d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0/c119 0 2024-09-20T18:35:56.568 INFO:tasks.workunit.client.0.smithi017.stdout:2/500: rmdir d1/dc/d20/d2e/d30/d85 39 2024-09-20T18:35:56.571 INFO:tasks.workunit.client.1.smithi172.stdout:6/950: unlink d0/d18/d1c/d123/dda/d7b/d7e/dd3/fea 0 2024-09-20T18:35:56.589 INFO:tasks.workunit.client.0.smithi017.stdout:2/501: dwrite d1/dc/d20/d2e/d30/d85/d53/d6b/f95 [0,4194304] 0 2024-09-20T18:35:56.592 INFO:tasks.workunit.client.0.smithi017.stdout:2/502: creat d1/d67/d8f/fa4 x:0 0 0 2024-09-20T18:35:56.594 INFO:tasks.workunit.client.0.smithi017.stdout:2/503: write d1/dc/d20/d2e/d30/f97 [450716,109237] 0 2024-09-20T18:35:56.597 INFO:tasks.workunit.client.0.smithi017.stdout:5/320: sync 2024-09-20T18:35:56.598 INFO:tasks.workunit.client.0.smithi017.stdout:2/504: creat d1/dc/d20/fa5 x:0 0 0 2024-09-20T18:35:56.600 INFO:tasks.workunit.client.0.smithi017.stdout:2/505: write d1/df/d17/f64 [1098250,122412] 0 2024-09-20T18:35:56.601 INFO:tasks.workunit.client.0.smithi017.stdout:2/506: fsync d1/dc/d20/d2e/d30/f97 0 2024-09-20T18:35:56.602 INFO:tasks.workunit.client.0.smithi017.stdout:2/507: read d1/df/d17/f1a [2949232,5454] 0 2024-09-20T18:35:56.604 INFO:tasks.workunit.client.0.smithi017.stdout:2/508: rmdir d1/dc/d20/d2e/d30/d85/d46/d48 39 2024-09-20T18:35:56.605 INFO:tasks.workunit.client.0.smithi017.stdout:2/509: chown d1/dc/d20/d2e/d30/d85/d3d/d77/d7a 357 1 2024-09-20T18:35:56.606 INFO:tasks.workunit.client.0.smithi017.stdout:5/321: write d0/d14/d18/d1b/f51 [563349,18475] 0 2024-09-20T18:35:56.608 INFO:tasks.workunit.client.0.smithi017.stdout:5/322: write d0/d14/d18/d2a/d39/f50 [6011838,75390] 0 2024-09-20T18:35:56.668 INFO:tasks.workunit.client.0.smithi017.stdout:7/324: sync 2024-09-20T18:35:56.668 INFO:tasks.workunit.client.0.smithi017.stdout:1/314: sync 2024-09-20T18:35:56.668 INFO:tasks.workunit.client.0.smithi017.stdout:6/315: sync 2024-09-20T18:35:56.683 INFO:tasks.workunit.client.1.smithi172.stdout:6/951: sync 2024-09-20T18:35:56.716 INFO:tasks.workunit.client.1.smithi172.stdout:6/952: link d0/d18/d1c/d21/f100 d0/d18/d1c/d21/d26/d34/d39/d74/f13d 0 2024-09-20T18:35:56.718 INFO:tasks.workunit.client.0.smithi017.stdout:2/510: dwrite d1/dc/d20/d2e/d30/d85/d3d/f36 [0,4194304] 0 2024-09-20T18:35:56.719 INFO:tasks.workunit.client.1.smithi172.stdout:6/953: truncate d0/d18/d65/fbd 808226 0 2024-09-20T18:35:56.720 INFO:tasks.workunit.client.1.smithi172.stdout:6/954: readlink d0/d18/d1c/d21/d26/d34/d7a/l12a 0 2024-09-20T18:35:56.723 INFO:tasks.workunit.client.1.smithi172.stdout:6/955: creat d0/d18/d1c/d123/dda/d7b/f13e x:0 0 0 2024-09-20T18:35:56.728 INFO:tasks.workunit.client.0.smithi017.stdout:6/316: mkdir d4/d37/d68 0 2024-09-20T18:35:56.730 INFO:tasks.workunit.client.0.smithi017.stdout:5/323: creat d0/d13/d55/f66 x:0 0 0 2024-09-20T18:35:56.733 INFO:tasks.workunit.client.0.smithi017.stdout:1/315: mknod df/c5f 0 2024-09-20T18:35:56.734 INFO:tasks.workunit.client.0.smithi017.stdout:6/317: symlink d4/d37/d41/l69 0 2024-09-20T18:35:56.735 INFO:tasks.workunit.client.0.smithi017.stdout:1/316: dread df/d16/f2e [0,4194304] 0 2024-09-20T18:35:56.736 INFO:tasks.workunit.client.0.smithi017.stdout:7/325: link da/f13 da/d16/d1c/d40/d5d/f5f 0 2024-09-20T18:35:56.736 INFO:tasks.workunit.client.0.smithi017.stdout:1/317: write df/f1a [621519,26224] 0 2024-09-20T18:35:56.738 INFO:tasks.workunit.client.0.smithi017.stdout:2/511: dread d1/dc/d20/d2e/d30/d85/d46/d48/f4a [0,4194304] 0 2024-09-20T18:35:56.739 INFO:tasks.workunit.client.0.smithi017.stdout:6/318: rename d4/df/d1f/f57 to d4/d37/f6a 0 2024-09-20T18:35:56.743 INFO:tasks.workunit.client.0.smithi017.stdout:1/318: dwrite df/d16/f58 [0,4194304] 0 2024-09-20T18:35:56.744 INFO:tasks.workunit.client.0.smithi017.stdout:2/512: mkdir d1/d1f/d99/da6 0 2024-09-20T18:35:56.744 INFO:tasks.workunit.client.1.smithi172.stdout:6/956: write d0/fae [727461,10770] 0 2024-09-20T18:35:56.745 INFO:tasks.workunit.client.0.smithi017.stdout:6/319: symlink d4/df/l6b 0 2024-09-20T18:35:56.746 INFO:tasks.workunit.client.0.smithi017.stdout:1/319: chown df/d16/f21 841089408 1 2024-09-20T18:35:56.747 INFO:tasks.workunit.client.0.smithi017.stdout:2/513: mknod d1/dc/d20/d2e/d30/d85/d46/d48/ca7 0 2024-09-20T18:35:56.750 INFO:tasks.workunit.client.0.smithi017.stdout:6/320: getdents d4 0 2024-09-20T18:35:56.751 INFO:tasks.workunit.client.0.smithi017.stdout:1/320: getdents df/d29 0 2024-09-20T18:35:56.753 INFO:tasks.workunit.client.0.smithi017.stdout:2/514: creat d1/df/fa8 x:0 0 0 2024-09-20T18:35:56.753 INFO:tasks.workunit.client.0.smithi017.stdout:1/321: truncate df/f33 5062686 0 2024-09-20T18:35:56.754 INFO:tasks.workunit.client.0.smithi017.stdout:6/321: creat d4/df/d4a/f6c x:0 0 0 2024-09-20T18:35:56.755 INFO:tasks.workunit.client.0.smithi017.stdout:6/322: dread - d4/d37/f6a zero size 2024-09-20T18:35:56.756 INFO:tasks.workunit.client.0.smithi017.stdout:1/322: mkdir df/d16/d50/d53/d60 0 2024-09-20T18:35:56.758 INFO:tasks.workunit.client.0.smithi017.stdout:1/323: chown df/f24 534736338 1 2024-09-20T18:35:56.760 INFO:tasks.workunit.client.0.smithi017.stdout:6/323: creat d4/df/d1f/d25/d3f/d5c/f6d x:0 0 0 2024-09-20T18:35:56.762 INFO:tasks.workunit.client.0.smithi017.stdout:2/515: dwrite d1/d1f/f3f [4194304,4194304] 0 2024-09-20T18:35:56.767 INFO:tasks.workunit.client.0.smithi017.stdout:1/324: dwrite df/d35/f38 [0,4194304] 0 2024-09-20T18:35:56.772 INFO:tasks.workunit.client.0.smithi017.stdout:6/324: dwrite d4/df/d4a/f4b [0,4194304] 0 2024-09-20T18:35:56.777 INFO:tasks.workunit.client.0.smithi017.stdout:1/325: dwrite df/f5e [0,4194304] 0 2024-09-20T18:35:56.777 INFO:tasks.workunit.client.0.smithi017.stdout:6/325: truncate d4/f9 2425821 0 2024-09-20T18:35:56.779 INFO:tasks.workunit.client.0.smithi017.stdout:6/326: chown d4/df/d4a 3789242 1 2024-09-20T18:35:56.779 INFO:tasks.workunit.client.0.smithi017.stdout:1/326: write df/d16/f58 [3398613,52611] 0 2024-09-20T18:35:56.783 INFO:tasks.workunit.client.0.smithi017.stdout:6/327: symlink d4/d37/d41/d43/l6e 0 2024-09-20T18:35:56.783 INFO:tasks.workunit.client.0.smithi017.stdout:1/327: creat df/d29/f61 x:0 0 0 2024-09-20T18:35:56.790 INFO:tasks.workunit.client.0.smithi017.stdout:6/328: dread d4/df/d1f/f38 [0,4194304] 0 2024-09-20T18:35:56.793 INFO:tasks.workunit.client.0.smithi017.stdout:6/329: rename d4/df/d1f/d25/d2b/f2c to d4/df/d4a/f6f 0 2024-09-20T18:35:56.795 INFO:tasks.workunit.client.0.smithi017.stdout:6/330: mkdir d4/df/d1f/d70 0 2024-09-20T18:35:56.796 INFO:tasks.workunit.client.0.smithi017.stdout:6/331: creat d4/df/d1f/d25/f71 x:0 0 0 2024-09-20T18:35:56.797 INFO:tasks.workunit.client.0.smithi017.stdout:6/332: write d4/df/d4a/f5d [528407,92634] 0 2024-09-20T18:35:56.798 INFO:tasks.workunit.client.0.smithi017.stdout:6/333: fdatasync d4/df/d1f/d25/d3f/d5c/f61 0 2024-09-20T18:35:56.799 INFO:tasks.workunit.client.0.smithi017.stdout:6/334: fsync d4/d37/f6a 0 2024-09-20T18:35:56.801 INFO:tasks.workunit.client.0.smithi017.stdout:6/335: mkdir d4/df/d1f/d70/d72 0 2024-09-20T18:35:56.806 INFO:tasks.workunit.client.0.smithi017.stdout:6/336: rename d4/d37/d41/d43/l6e to d4/d37/l73 0 2024-09-20T18:35:56.812 INFO:tasks.workunit.client.0.smithi017.stdout:6/337: dwrite d4/f14 [0,4194304] 0 2024-09-20T18:35:56.813 INFO:tasks.workunit.client.0.smithi017.stdout:1/328: write df/d29/f56 [3471637,115996] 0 2024-09-20T18:35:56.816 INFO:tasks.workunit.client.0.smithi017.stdout:1/329: mkdir df/d16/d32/d62 0 2024-09-20T18:35:56.818 INFO:tasks.workunit.client.0.smithi017.stdout:6/338: truncate d4/df/f16 832559 0 2024-09-20T18:35:56.819 INFO:tasks.workunit.client.0.smithi017.stdout:6/339: stat d4/df/d1f/d25/f71 0 2024-09-20T18:35:56.819 INFO:tasks.workunit.client.0.smithi017.stdout:1/330: chown df/d29/d2c/c46 216178011 1 2024-09-20T18:35:56.820 INFO:tasks.workunit.client.0.smithi017.stdout:6/340: symlink d4/df/d4a/l74 0 2024-09-20T18:35:56.821 INFO:tasks.workunit.client.0.smithi017.stdout:6/341: fdatasync d4/df/d4a/f50 0 2024-09-20T18:35:56.826 INFO:tasks.workunit.client.1.smithi172.stdout:6/957: sync 2024-09-20T18:35:56.834 INFO:tasks.workunit.client.1.smithi172.stdout:6/958: dwrite d0/d18/d1c/d21/d26/d34/d7a/f8b [0,4194304] 0 2024-09-20T18:35:56.837 INFO:tasks.workunit.client.0.smithi017.stdout:4/266: sync 2024-09-20T18:35:56.838 INFO:tasks.workunit.client.0.smithi017.stdout:9/467: sync 2024-09-20T18:35:56.842 INFO:tasks.workunit.client.0.smithi017.stdout:4/267: getdents d4 0 2024-09-20T18:35:56.843 INFO:tasks.workunit.client.0.smithi017.stdout:9/468: link d6/d23/d58/d3f/d5f/f65 d6/d23/d3a/d61/fb3 0 2024-09-20T18:35:56.845 INFO:tasks.workunit.client.1.smithi172.stdout:6/959: dwrite d0/d18/d1c/d123/def/dff/f91 [0,4194304] 0 2024-09-20T18:35:56.847 INFO:tasks.workunit.client.0.smithi017.stdout:4/268: link d4/dc/f12 d4/d19/d37/f57 0 2024-09-20T18:35:56.851 INFO:tasks.workunit.client.0.smithi017.stdout:9/469: dwrite d6/d23/d58/d3f/f76 [0,4194304] 0 2024-09-20T18:35:56.864 INFO:tasks.workunit.client.0.smithi017.stdout:9/470: dread d6/d23/d58/d3f/d5f/f65 [0,4194304] 0 2024-09-20T18:35:56.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:56 smithi017 ceph-mon[28058]: pgmap v32: 65 pgs: 65 active+clean; 2.6 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 88 MiB/s rd, 303 MiB/s wr, 556 op/s 2024-09-20T18:35:56.927 INFO:tasks.workunit.client.1.smithi172.stdout:6/960: unlink d0/d18/d1c/d21/d26/d34/d39/d74/dbf/de7/f112 0 2024-09-20T18:35:56.927 INFO:tasks.workunit.client.0.smithi017.stdout:4/269: dread - d4/dc/d1e/f51 zero size 2024-09-20T18:35:56.929 INFO:tasks.workunit.client.0.smithi017.stdout:9/471: rename d6/d23/d58/d3f/d4d/d73/d93/d96 to d6/d23/d40/db4 0 2024-09-20T18:35:56.931 INFO:tasks.workunit.client.0.smithi017.stdout:9/472: symlink d6/d23/d58/d3f/d2f/d98/lb5 0 2024-09-20T18:35:56.932 INFO:tasks.workunit.client.0.smithi017.stdout:4/270: truncate d4/d19/f35 2873835 0 2024-09-20T18:35:56.933 INFO:tasks.workunit.client.0.smithi017.stdout:9/473: symlink d6/d23/d58/d3f/d4d/lb6 0 2024-09-20T18:35:56.933 INFO:tasks.workunit.client.0.smithi017.stdout:4/271: dread - d4/dc/d1e/f55 zero size 2024-09-20T18:35:56.935 INFO:tasks.workunit.client.0.smithi017.stdout:4/272: creat d4/de/d1b/f58 x:0 0 0 2024-09-20T18:35:56.937 INFO:tasks.workunit.client.0.smithi017.stdout:9/474: write d6/d23/d58/d3f/d4d/d73/d8f/f99 [1026967,7248] 0 2024-09-20T18:35:56.940 INFO:tasks.workunit.client.1.smithi172.stdout:6/961: truncate d0/f36 144346 0 2024-09-20T18:35:56.942 INFO:tasks.workunit.client.1.smithi172.stdout:6/962: creat d0/d18/d1c/d123/f13f x:0 0 0 2024-09-20T18:35:56.943 INFO:tasks.workunit.client.0.smithi017.stdout:4/273: dwrite d4/dc/d1e/d26/d22/f36 [4194304,4194304] 0 2024-09-20T18:35:56.946 INFO:tasks.workunit.client.0.smithi017.stdout:9/475: creat d6/d23/d58/d3f/d4d/d73/fb7 x:0 0 0 2024-09-20T18:35:56.946 INFO:tasks.workunit.client.0.smithi017.stdout:9/476: chown d6/d23/d58/d3f/d4d 20 1 2024-09-20T18:35:56.947 INFO:tasks.workunit.client.0.smithi017.stdout:4/274: unlink d4/dc/d1e/d26/d22/f17 0 2024-09-20T18:35:56.948 INFO:tasks.workunit.client.1.smithi172.stdout:6/963: dread d0/d18/f29 [0,4194304] 0 2024-09-20T18:35:56.948 INFO:tasks.workunit.client.0.smithi017.stdout:3/542: sync 2024-09-20T18:35:56.949 INFO:tasks.workunit.client.0.smithi017.stdout:9/477: mkdir d6/d23/d3a/db8 0 2024-09-20T18:35:56.950 INFO:tasks.workunit.client.0.smithi017.stdout:9/478: write d6/d23/d58/f94 [3575290,58104] 0 2024-09-20T18:35:56.952 INFO:tasks.workunit.client.0.smithi017.stdout:3/543: write da/de/d13/d2f/d26/d31/d5a/d76/d19/f9c [1650590,129427] 0 2024-09-20T18:35:56.953 INFO:tasks.workunit.client.1.smithi172.stdout:6/964: rename d0/d18/d1c/d21/d26/d34/d9c/dc7/f130 to d0/d18/daf/f140 0 2024-09-20T18:35:56.956 INFO:tasks.workunit.client.0.smithi017.stdout:3/544: write da/de/d53/f44 [184101,121912] 0 2024-09-20T18:35:56.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:56 smithi172 ceph-mon[35456]: pgmap v32: 65 pgs: 65 active+clean; 2.6 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 88 MiB/s rd, 303 MiB/s wr, 556 op/s 2024-09-20T18:35:56.961 INFO:tasks.workunit.client.0.smithi017.stdout:9/479: link d6/d23/f2a d6/d23/d58/d3f/fb9 0 2024-09-20T18:35:56.961 INFO:tasks.workunit.client.0.smithi017.stdout:9/480: chown d6/d23/f2a 2469257 1 2024-09-20T18:35:56.963 INFO:tasks.workunit.client.0.smithi017.stdout:3/545: mknod da/de/d13/d2f/d26/d62/da5/da9/cac 0 2024-09-20T18:35:56.965 INFO:tasks.workunit.client.0.smithi017.stdout:9/481: rename d6/d23/d58/d3f/d5f to d6/d23/d40/db4/dba 0 2024-09-20T18:35:56.967 INFO:tasks.workunit.client.0.smithi017.stdout:9/482: fsync d6/f34 0 2024-09-20T18:35:56.967 INFO:tasks.workunit.client.0.smithi017.stdout:4/275: dread d4/de/f27 [0,4194304] 0 2024-09-20T18:35:56.969 INFO:tasks.workunit.client.0.smithi017.stdout:3/546: getdents da/de/d13/d16 0 2024-09-20T18:35:56.970 INFO:tasks.workunit.client.0.smithi017.stdout:4/276: creat d4/de/f59 x:0 0 0 2024-09-20T18:35:56.971 INFO:tasks.workunit.client.1.smithi172.stdout:6/965: dread d0/d18/d1c/d123/dda/d7b/fd6 [0,4194304] 0 2024-09-20T18:35:56.971 INFO:tasks.workunit.client.0.smithi017.stdout:4/277: write d4/f4b [902240,61377] 0 2024-09-20T18:35:56.971 INFO:tasks.workunit.client.0.smithi017.stdout:3/547: dread da/de/d13/d2f/d26/d31/d5a/d76/f6a [0,4194304] 0 2024-09-20T18:35:56.973 INFO:tasks.workunit.client.1.smithi172.stdout:6/966: truncate d0/d18/d1c/d21/d26/d34/d39/d74/f10e 85962 0 2024-09-20T18:35:56.974 INFO:tasks.workunit.client.1.smithi172.stdout:6/967: fdatasync d0/d18/d1c/d21/d26/d34/d7a/d99/ffa 0 2024-09-20T18:35:56.978 INFO:tasks.workunit.client.1.smithi172.stdout:6/968: dread d0/d18/d1c/d21/d26/d34/d6b/d7d/d90/da0/ff7 [0,4194304] 0 2024-09-20T18:35:56.979 INFO:tasks.workunit.client.0.smithi017.stdout:9/483: dwrite d6/d23/d58/d3f/d4d/f97 [0,4194304] 0 2024-09-20T18:35:56.979 INFO:tasks.workunit.client.1.smithi172.stdout:6/969: dread - d0/d18/d1c/d21/d26/d34/d9c/fe6 zero size 2024-09-20T18:35:56.980 INFO:tasks.workunit.client.0.smithi017.stdout:4/278: dwrite d4/f38 [4194304,4194304] 0 2024-09-20T18:35:56.982 INFO:tasks.workunit.client.0.smithi017.stdout:4/279: chown d4/de/l50 0 1 2024-09-20T18:35:56.982 INFO:tasks.workunit.client.0.smithi017.stdout:9/484: fsync d6/d23/d40/db4/dba/f65 0 2024-09-20T18:35:56.987 INFO:tasks.workunit.client.1.smithi172.stdout:6/970: getdents d0/d18/d1c/d21/d26/d34/d39/d74/dbf/d110 0 2024-09-20T18:35:56.988 INFO:tasks.workunit.client.0.smithi017.stdout:9/485: mkdir d6/d11/dbb 0 2024-09-20T18:35:56.989 INFO:tasks.workunit.client.0.smithi017.stdout:3/548: write da/de/d13/d2f/d26/d31/f36 [149825,130618] 0 2024-09-20T18:35:56.991 INFO:tasks.workunit.client.0.smithi017.stdout:4/280: creat d4/d19/d37/f5a x:0 0 0 2024-09-20T18:35:56.992 INFO:tasks.workunit.client.1.smithi172.stdout:6/971: creat d0/d18/d1c/d21/d26/d34/d6b/d7d/d35/f141 x:0 0 0 2024-09-20T18:35:56.993 INFO:tasks.workunit.client.0.smithi017.stdout:4/281: dread - d4/de/f4f zero size 2024-09-20T18:35:56.995 INFO:tasks.workunit.client.1.smithi172.stdout:6/972: creat d0/d18/d1c/d123/dda/d7b/f142 x:0 0 0 2024-09-20T18:35:56.996 INFO:tasks.workunit.client.0.smithi017.stdout:9/486: getdents d6/d23/d58/d3f/d70/db0 0 2024-09-20T18:35:56.996 INFO:tasks.workunit.client.1.smithi172.stdout:6/973: write d0/d18/d1c/d123/dda/d7b/f13e [195611,34268] 0 2024-09-20T18:35:56.998 INFO:tasks.workunit.client.0.smithi017.stdout:3/549: dwrite da/de/f8e [0,4194304] 0 2024-09-20T18:35:56.999 INFO:tasks.workunit.client.0.smithi017.stdout:9/487: mknod d6/d23/d58/cbc 0 2024-09-20T18:35:57.002 INFO:tasks.workunit.client.1.smithi172.stdout:6/974: dwrite d0/d18/d1c/d21/d26/fd7 [0,4194304] 0 2024-09-20T18:35:57.004 INFO:tasks.workunit.client.0.smithi017.stdout:3/550: dread da/de/d13/d2f/d26/d41/f83 [0,4194304] 0 2024-09-20T18:35:57.006 INFO:tasks.workunit.client.0.smithi017.stdout:4/282: truncate d4/f4b 583189 0 2024-09-20T18:35:57.016 INFO:tasks.workunit.client.0.smithi017.stdout:4/283: dwrite d4/d19/f1f [0,4194304] 0 2024-09-20T18:35:57.022 INFO:tasks.workunit.client.0.smithi017.stdout:9/488: dread d6/fe [0,4194304] 0 2024-09-20T18:35:57.023 INFO:tasks.workunit.client.0.smithi017.stdout:4/284: dwrite d4/de/f4f [0,4194304] 0 2024-09-20T18:35:57.024 INFO:tasks.workunit.client.0.smithi017.stdout:3/551: dread da/de/d13/d2f/d26/d31/f36 [0,4194304] 0 2024-09-20T18:35:57.025 INFO:tasks.workunit.client.0.smithi017.stdout:4/285: creat d4/f5b x:0 0 0 2024-09-20T18:35:57.027 INFO:tasks.workunit.client.0.smithi017.stdout:9/489: read d6/d23/d3a/d61/f78 [1033451,61102] 0 2024-09-20T18:35:57.029 INFO:tasks.workunit.client.0.smithi017.stdout:3/552: creat da/de/d13/d2f/d26/d41/fad x:0 0 0 2024-09-20T18:35:57.031 INFO:tasks.workunit.client.0.smithi017.stdout:9/490: chown d6/d42/c6c 2339 1 2024-09-20T18:35:57.032 INFO:tasks.workunit.client.0.smithi017.stdout:9/491: fdatasync d6/d23/d58/d3f/d2f/d98/fa5 0 2024-09-20T18:35:57.032 INFO:tasks.workunit.client.0.smithi017.stdout:3/553: mknod da/de/d13/d2f/d26/d31/cae 0 2024-09-20T18:35:57.034 INFO:tasks.workunit.client.0.smithi017.stdout:9/492: truncate d6/d23/d58/d3f/d82/f4f 673796 0 2024-09-20T18:35:57.035 INFO:tasks.workunit.client.0.smithi017.stdout:9/493: rmdir d6/d23/d58 39 2024-09-20T18:35:57.039 INFO:tasks.workunit.client.0.smithi017.stdout:3/554: dwrite da/de/d13/d16/d6e/d82/f8c [0,4194304] 0 2024-09-20T18:35:57.042 INFO:tasks.workunit.client.0.smithi017.stdout:9/494: dread d6/f2e [0,4194304] 0 2024-09-20T18:35:57.042 INFO:tasks.workunit.client.0.smithi017.stdout:4/286: write d4/de/d1b/f45 [612009,97299] 0 2024-09-20T18:35:57.044 INFO:tasks.workunit.client.0.smithi017.stdout:3/555: creat da/de/d13/d2f/d26/d31/faf x:0 0 0 2024-09-20T18:35:57.048 INFO:tasks.workunit.client.0.smithi017.stdout:3/556: symlink da/de/d13/d16/d6e/d82/lb0 0 2024-09-20T18:35:57.048 INFO:tasks.workunit.client.0.smithi017.stdout:4/287: read d4/d19/f15 [783080,35957] 0 2024-09-20T18:35:57.049 INFO:tasks.workunit.client.0.smithi017.stdout:9/495: getdents d6 0 2024-09-20T18:35:57.050 INFO:tasks.workunit.client.0.smithi017.stdout:3/557: chown da/de/d13/d2f/d26/d41/fad 41505 1 2024-09-20T18:35:57.053 INFO:tasks.workunit.client.0.smithi017.stdout:3/558: mknod da/de/d13/d16/cb1 0 2024-09-20T18:35:57.054 INFO:tasks.workunit.client.0.smithi017.stdout:9/496: mkdir d6/d23/d58/d3f/d4d/d73/d7d/dbd 0 2024-09-20T18:35:57.055 INFO:tasks.workunit.client.0.smithi017.stdout:3/559: read da/de/d13/d2f/f60 [50448,113553] 0 2024-09-20T18:35:57.056 INFO:tasks.workunit.client.0.smithi017.stdout:4/288: dwrite d4/de/d1b/f45 [0,4194304] 0 2024-09-20T18:35:57.058 INFO:tasks.workunit.client.0.smithi017.stdout:4/289: readlink d4/de/d1b/l3d 0 2024-09-20T18:35:57.062 INFO:tasks.workunit.client.0.smithi017.stdout:8/269: sync 2024-09-20T18:35:57.062 INFO:tasks.workunit.client.0.smithi017.stdout:0/292: sync 2024-09-20T18:35:57.066 INFO:tasks.workunit.client.0.smithi017.stdout:9/497: dwrite d6/d23/d3a/f3c [0,4194304] 0 2024-09-20T18:35:57.070 INFO:tasks.workunit.client.0.smithi017.stdout:4/290: dwrite d4/de/d1b/f33 [0,4194304] 0 2024-09-20T18:35:57.072 INFO:tasks.workunit.client.0.smithi017.stdout:9/498: dread d6/d23/f51 [0,4194304] 0 2024-09-20T18:35:57.074 INFO:tasks.workunit.client.0.smithi017.stdout:8/270: mkdir d0/d6/d28/d3d/d4e/d55 0 2024-09-20T18:35:57.075 INFO:tasks.workunit.client.0.smithi017.stdout:8/271: write d0/f22 [2725169,48057] 0 2024-09-20T18:35:57.078 INFO:tasks.workunit.client.0.smithi017.stdout:8/272: unlink d0/d6/d28/d3a/c46 0 2024-09-20T18:35:57.080 INFO:tasks.workunit.client.0.smithi017.stdout:8/273: write d0/f22 [7556624,102532] 0 2024-09-20T18:35:57.082 INFO:tasks.workunit.client.0.smithi017.stdout:3/560: dread da/f29 [0,4194304] 0 2024-09-20T18:35:57.085 INFO:tasks.workunit.client.1.smithi172.stdout:6/975: sync 2024-09-20T18:35:57.086 INFO:tasks.workunit.client.1.smithi172.stdout:6/976: chown d0/d18/d1c/d21/d26/d79/dde 3376 1 2024-09-20T18:35:57.088 INFO:tasks.workunit.client.0.smithi017.stdout:0/293: dread d4/db/fe [0,4194304] 0 2024-09-20T18:35:57.088 INFO:tasks.workunit.client.0.smithi017.stdout:8/274: rmdir d0/d6/d28/d52 0 2024-09-20T18:35:57.090 INFO:tasks.workunit.client.1.smithi172.stdout:6/977: rename d0/d18/d1c/d21/d26/f60 to d0/d18/d1c/d21/d26/d34/d9c/dc7/f143 0 2024-09-20T18:35:57.091 INFO:tasks.workunit.client.0.smithi017.stdout:0/294: truncate d4/f17 533843 0 2024-09-20T18:35:57.091 INFO:tasks.workunit.client.1.smithi172.stdout:6/978: truncate d0/d18/d1c/d21/d26/d34/f102 983336 0 2024-09-20T18:35:57.092 INFO:tasks.workunit.client.0.smithi017.stdout:8/275: rename d0/d6/d28/d3b/f45 to d0/d6/f56 0 2024-09-20T18:35:57.094 INFO:tasks.workunit.client.1.smithi172.stdout:6/979: creat d0/d18/d1c/d21/d26/db7/f144 x:0 0 0 2024-09-20T18:35:57.095 INFO:tasks.workunit.client.1.smithi172.stdout:6/980: fdatasync d0/d18/d1c/d123/f10a 0 2024-09-20T18:35:57.095 INFO:tasks.workunit.client.0.smithi017.stdout:0/295: symlink d4/db/d1e/d24/d2f/d51/l5c 0 2024-09-20T18:35:57.096 INFO:tasks.workunit.client.1.smithi172.stdout:6/981: write d0/d18/d1c/d21/d26/d34/d7a/f2e [4545589,43652] 0 2024-09-20T18:35:57.096 INFO:tasks.workunit.client.0.smithi017.stdout:8/276: creat d0/d6/d28/d3d/d4e/d55/f57 x:0 0 0 2024-09-20T18:35:57.097 INFO:tasks.workunit.client.0.smithi017.stdout:8/277: chown d0/d6/c32 233813419 1 2024-09-20T18:35:57.097 INFO:tasks.workunit.client.0.smithi017.stdout:4/291: fdatasync d4/de/d1b/f33 0 2024-09-20T18:35:57.098 INFO:tasks.workunit.client.0.smithi017.stdout:4/292: write d4/d19/f42 [1003700,21386] 0 2024-09-20T18:35:57.100 INFO:tasks.workunit.client.0.smithi017.stdout:0/296: rename d4/l21 to d4/db/d1e/d24/d2f/l5d 0 2024-09-20T18:35:57.102 INFO:tasks.workunit.client.0.smithi017.stdout:8/278: mknod d0/d6/d28/d3a/c58 0 2024-09-20T18:35:57.102 INFO:tasks.workunit.client.1.smithi172.stdout:6/982: dwrite d0/d18/d1c/d21/d26/d79/f132 [0,4194304] 0 2024-09-20T18:35:57.102 INFO:tasks.workunit.client.0.smithi017.stdout:8/279: stat d0/d6/c1f 0 2024-09-20T18:35:57.103 INFO:tasks.workunit.client.0.smithi017.stdout:8/280: stat d0/d6/d28/d3a 0 2024-09-20T18:35:57.103 INFO:tasks.workunit.client.0.smithi017.stdout:8/281: chown d0/d6/d28/d3d 503 1 2024-09-20T18:35:57.104 INFO:tasks.workunit.client.1.smithi172.stdout:6/983: write d0/d18/d1c/d21/d26/d34/d39/d46/f20 [7941516,79380] 0 2024-09-20T18:35:57.107 INFO:tasks.workunit.client.0.smithi017.stdout:3/561: write da/de/d13/d2f/d26/d31/d5a/d76/f6a [835279,89783] 0 2024-09-20T18:35:57.113 INFO:tasks.workunit.client.0.smithi017.stdout:8/282: dread d0/d6/f21 [0,4194304] 0 2024-09-20T18:35:57.114 INFO:tasks.workunit.client.1.smithi172.stdout:6/984: rename d0/d18/d1c/d123/dda/d7b/fe5 to d0/d18/d1c/d21/d26/d34/d9c/dac/f145 0 2024-09-20T18:35:57.115 INFO:tasks.workunit.client.0.smithi017.stdout:8/283: chown d0/d6/d28/d3d/d4e/d55 32644874 1 2024-09-20T18:35:57.115 INFO:tasks.workunit.client.1.smithi172.stdout:6/985: dread - d0/d18/d1c/d123/f13f zero size 2024-09-20T18:35:57.116 INFO:tasks.workunit.client.1.smithi172.stdout:6/986: chown d0/d18/f2b 349914 1 2024-09-20T18:35:57.118 INFO:tasks.workunit.client.0.smithi017.stdout:8/284: creat d0/d6/d28/d3d/d4e/f59 x:0 0 0 2024-09-20T18:35:57.124 INFO:tasks.workunit.client.1.smithi172.stdout:6/987: rename d0/d18/d1c/d123/dda/d7b/fcf to d0/d18/d1c/d21/d26/d34/d39/d74/dbf/f146 0 2024-09-20T18:35:57.130 INFO:tasks.workunit.client.0.smithi017.stdout:0/297: dread d4/f8 [0,4194304] 0 2024-09-20T18:35:57.130 INFO:tasks.workunit.client.1.smithi172.stdout:6/988: mknod d0/d18/d1c/d21/d26/c147 0 2024-09-20T18:35:57.130 INFO:tasks.workunit.client.1.smithi172.stdout:6/989: dread - d0/d18/d1c/d21/d26/d34/d9c/dc7/f10f zero size 2024-09-20T18:35:57.132 INFO:tasks.workunit.client.0.smithi017.stdout:0/298: unlink d4/db/d18/d25/d36/d47/l2b 0 2024-09-20T18:35:57.133 INFO:tasks.workunit.client.1.smithi172.stdout:6/990: creat d0/d18/d1c/d21/d26/d34/d39/d129/f148 x:0 0 0 2024-09-20T18:35:57.134 INFO:tasks.workunit.client.0.smithi017.stdout:0/299: creat d4/db/d1e/d24/d2f/f5e x:0 0 0 2024-09-20T18:35:57.136 INFO:tasks.workunit.client.0.smithi017.stdout:0/300: creat d4/db/d1e/d24/d2f/f5f x:0 0 0 2024-09-20T18:35:57.138 INFO:tasks.workunit.client.1.smithi172.stdout:6/991: link d0/d18/d1c/d21/d26/d34/d7a/c49 d0/d18/d1c/d123/def/dff/ddc/c149 0 2024-09-20T18:35:57.140 INFO:tasks.workunit.client.0.smithi017.stdout:0/301: rename d4/l15 to d4/db/d18/d25/d36/l60 0 2024-09-20T18:35:57.141 INFO:tasks.workunit.client.0.smithi017.stdout:4/293: write d4/d19/f15 [2324474,11374] 0 2024-09-20T18:35:57.142 INFO:tasks.workunit.client.0.smithi017.stdout:4/294: write d4/d19/f30 [2083893,93056] 0 2024-09-20T18:35:57.145 INFO:tasks.workunit.client.1.smithi172.stdout:6/992: link d0/d18/d1c/d123/dda/ca1 d0/d18/d1c/d123/def/dff/ddc/c14a 0 2024-09-20T18:35:57.145 INFO:tasks.workunit.client.0.smithi017.stdout:3/562: write da/de/d13/d16/f1e [4451873,77782] 0 2024-09-20T18:35:57.148 INFO:tasks.workunit.client.1.smithi172.stdout:6/993: mkdir d0/d18/d1c/d21/d26/d34/d39/d74/d14b 0 2024-09-20T18:35:57.150 INFO:tasks.workunit.client.0.smithi017.stdout:8/285: write d0/f1c [939034,78547] 0 2024-09-20T18:35:57.151 INFO:tasks.workunit.client.0.smithi017.stdout:4/295: mkdir d4/dc/d1e/d26/d22/d5c 0 2024-09-20T18:35:57.157 INFO:tasks.workunit.client.0.smithi017.stdout:3/563: unlink da/de/f7c 0 2024-09-20T18:35:57.158 INFO:tasks.workunit.client.0.smithi017.stdout:8/286: fsync d0/d6/f38 0 2024-09-20T18:35:57.161 INFO:tasks.workunit.client.0.smithi017.stdout:0/302: link d4/db/fc d4/db/d1e/d42/f61 0 2024-09-20T18:35:57.162 INFO:tasks.workunit.client.0.smithi017.stdout:3/564: symlink da/de/d13/d16/lb2 0 2024-09-20T18:35:57.162 INFO:tasks.workunit.client.0.smithi017.stdout:5/324: sync 2024-09-20T18:35:57.162 INFO:tasks.workunit.client.0.smithi017.stdout:7/326: sync 2024-09-20T18:35:57.164 INFO:tasks.workunit.client.0.smithi017.stdout:0/303: truncate d4/db/d1e/d24/d2f/f5f 218664 0 2024-09-20T18:35:57.165 INFO:tasks.workunit.client.0.smithi017.stdout:0/304: dread - d4/db/f5b zero size 2024-09-20T18:35:57.166 INFO:tasks.workunit.client.0.smithi017.stdout:8/287: creat d0/d6/d28/f5a x:0 0 0 2024-09-20T18:35:57.168 INFO:tasks.workunit.client.1.smithi172.stdout:6/994: write d0/d18/d1c/d21/d26/d34/f3e [487165,84850] 0 2024-09-20T18:35:57.171 INFO:tasks.workunit.client.0.smithi017.stdout:8/288: mknod d0/d6/c5b 0 2024-09-20T18:35:57.172 INFO:tasks.workunit.client.0.smithi017.stdout:8/289: chown d0/d6/c15 83388152 1 2024-09-20T18:35:57.173 INFO:tasks.workunit.client.1.smithi172.stdout:6/995: fdatasync d0/d18/d1c/d21/d26/db7/fd1 0 2024-09-20T18:35:57.174 INFO:tasks.workunit.client.1.smithi172.stdout:6/996: chown d0/d18/d1c/d21/d26/d34/f82 47605613 1 2024-09-20T18:35:57.174 INFO:tasks.workunit.client.0.smithi017.stdout:3/565: mkdir da/de/d53/d88/db3 0 2024-09-20T18:35:57.175 INFO:tasks.workunit.client.1.smithi172.stdout:6/997: chown d0/d18/d1c/l30 12845069 1 2024-09-20T18:35:57.176 INFO:tasks.workunit.client.0.smithi017.stdout:7/327: link da/d16/d1c/d40/d34/f55 da/d16/d1c/d40/d5d/f60 0 2024-09-20T18:35:57.177 INFO:tasks.workunit.client.0.smithi017.stdout:7/328: stat da/d54 0 2024-09-20T18:35:57.180 INFO:tasks.workunit.client.0.smithi017.stdout:4/296: dwrite d4/d19/f1f [4194304,4194304] 0 2024-09-20T18:35:57.188 INFO:tasks.workunit.client.1.smithi172.stdout:6/998: write d0/d18/f54 [1042126,108756] 0 2024-09-20T18:35:57.196 INFO:tasks.workunit.client.0.smithi017.stdout:0/305: creat d4/db/f62 x:0 0 0 2024-09-20T18:35:57.197 INFO:tasks.workunit.client.0.smithi017.stdout:0/306: fdatasync d4/db/f62 0 2024-09-20T18:35:57.197 INFO:tasks.workunit.client.0.smithi017.stdout:4/297: write d4/de/d1b/f4c [1026182,42170] 0 2024-09-20T18:35:57.200 INFO:tasks.workunit.client.0.smithi017.stdout:5/325: dwrite d0/f7 [0,4194304] 0 2024-09-20T18:35:57.202 INFO:tasks.workunit.client.0.smithi017.stdout:8/290: getdents d0/d6 0 2024-09-20T18:35:57.207 INFO:tasks.workunit.client.0.smithi017.stdout:7/329: dwrite da/d16/f4a [0,4194304] 0 2024-09-20T18:35:57.207 INFO:tasks.workunit.client.0.smithi017.stdout:5/326: unlink d0/fc 0 2024-09-20T18:35:57.208 INFO:tasks.workunit.client.1.smithi172.stdout:6/999: mkdir d0/d18/d1c/d123/def/d121/d14c 0 2024-09-20T18:35:57.208 INFO:tasks.workunit.client.0.smithi017.stdout:7/330: fdatasync da/d16/f5e 0 2024-09-20T18:35:57.209 INFO:tasks.workunit.client.0.smithi017.stdout:7/331: chown da/d16/d1c/d40/d30/f56 177569 1 2024-09-20T18:35:57.210 INFO:tasks.workunit.client.0.smithi017.stdout:4/298: rename d4/dc/d1e/d26/d22/c53 to d4/d19/c5d 0 2024-09-20T18:35:57.211 INFO:tasks.workunit.client.0.smithi017.stdout:8/291: mknod d0/d6/d28/d3a/c5c 0 2024-09-20T18:35:57.211 INFO:tasks.workunit.client.1.smithi172.stderr:+ rm -rf -- ./tmp.Q6xDQenbc7 2024-09-20T18:35:57.212 INFO:tasks.workunit.client.0.smithi017.stdout:4/299: creat d4/d19/f5e x:0 0 0 2024-09-20T18:35:57.214 INFO:tasks.workunit.client.0.smithi017.stdout:8/292: symlink d0/d6/d28/d3d/d4e/d55/l5d 0 2024-09-20T18:35:57.217 INFO:tasks.workunit.client.0.smithi017.stdout:4/300: creat d4/dc/d1e/d26/d4e/f5f x:0 0 0 2024-09-20T18:35:57.217 INFO:tasks.workunit.client.0.smithi017.stdout:5/327: link d0/d14/l56 d0/d14/d18/d19/d4d/l67 0 2024-09-20T18:35:57.225 INFO:tasks.workunit.client.0.smithi017.stdout:4/301: dread - d4/dc/d1e/f51 zero size 2024-09-20T18:35:57.225 INFO:tasks.workunit.client.0.smithi017.stdout:8/293: creat d0/f5e x:0 0 0 2024-09-20T18:35:57.225 INFO:tasks.workunit.client.0.smithi017.stdout:5/328: stat d0/d14/d18/d2a/d39 0 2024-09-20T18:35:57.225 INFO:tasks.workunit.client.0.smithi017.stdout:8/294: getdents d0/d6/d28/d3d/d4e 0 2024-09-20T18:35:57.225 INFO:tasks.workunit.client.0.smithi017.stdout:5/329: dwrite d0/f10 [4194304,4194304] 0 2024-09-20T18:35:57.226 INFO:tasks.workunit.client.0.smithi017.stdout:5/330: rmdir d0 39 2024-09-20T18:35:57.231 INFO:tasks.workunit.client.0.smithi017.stdout:5/331: chown d0/d14/d18/d19/d4d 61190 1 2024-09-20T18:35:57.234 INFO:tasks.workunit.client.0.smithi017.stdout:5/332: symlink d0/d14/d18/d2a/d39/l68 0 2024-09-20T18:35:57.243 INFO:tasks.workunit.client.0.smithi017.stdout:0/307: truncate d4/f29 23787 0 2024-09-20T18:35:57.246 INFO:tasks.workunit.client.0.smithi017.stdout:0/308: write d4/db/d1e/f35 [109528,92396] 0 2024-09-20T18:35:57.253 INFO:tasks.workunit.client.0.smithi017.stdout:0/309: dwrite d4/d20/f50 [0,4194304] 0 2024-09-20T18:35:57.254 INFO:tasks.workunit.client.0.smithi017.stdout:0/310: truncate d4/db/f5b 493696 0 2024-09-20T18:35:57.262 INFO:tasks.workunit.client.0.smithi017.stdout:0/311: getdents d4/db/d18 0 2024-09-20T18:35:57.266 INFO:tasks.workunit.client.0.smithi017.stdout:0/312: mkdir d4/d20/d63 0 2024-09-20T18:35:57.272 INFO:tasks.workunit.client.0.smithi017.stdout:8/295: dread d0/f22 [0,4194304] 0 2024-09-20T18:35:57.273 INFO:tasks.workunit.client.0.smithi017.stdout:0/313: link d4/db/d1e/l34 d4/db/d1e/d24/d2f/l64 0 2024-09-20T18:35:57.274 INFO:tasks.workunit.client.0.smithi017.stdout:7/332: truncate da/d16/d1c/d40/d34/d3c/f4e 2251836 0 2024-09-20T18:35:57.275 INFO:tasks.workunit.client.0.smithi017.stdout:0/314: stat d4/db/d18/d25/d36/d47 0 2024-09-20T18:35:57.277 INFO:tasks.workunit.client.0.smithi017.stdout:7/333: unlink da/d16/d1c/d40/d3a/f4b 0 2024-09-20T18:35:57.278 INFO:tasks.workunit.client.0.smithi017.stdout:7/334: dread - da/d16/f5e zero size 2024-09-20T18:35:57.279 INFO:tasks.workunit.client.0.smithi017.stdout:8/296: rename d0/d6/d28/d3d/d4e/d55/f57 to d0/f5f 0 2024-09-20T18:35:57.279 INFO:tasks.workunit.client.0.smithi017.stdout:7/335: fsync da/d16/d1c/d40/d34/d3c/f48 0 2024-09-20T18:35:57.283 INFO:tasks.workunit.client.0.smithi017.stdout:0/315: link d4/fa d4/db/d18/d25/d36/f65 0 2024-09-20T18:35:57.287 INFO:tasks.workunit.client.0.smithi017.stdout:6/342: sync 2024-09-20T18:35:57.287 INFO:tasks.workunit.client.0.smithi017.stdout:2/516: sync 2024-09-20T18:35:57.287 INFO:tasks.workunit.client.0.smithi017.stdout:1/331: sync 2024-09-20T18:35:57.291 INFO:tasks.workunit.client.0.smithi017.stdout:0/316: dwrite d4/db/d1e/d24/d2f/f5f [0,4194304] 0 2024-09-20T18:35:57.293 INFO:tasks.workunit.client.0.smithi017.stdout:8/297: creat d0/d6/d28/d3d/f60 x:0 0 0 2024-09-20T18:35:57.294 INFO:tasks.workunit.client.0.smithi017.stdout:0/317: chown d4/d37/f3a 38 1 2024-09-20T18:35:57.302 INFO:tasks.workunit.client.0.smithi017.stdout:6/343: dwrite d4/df/d1f/d25/f58 [0,4194304] 0 2024-09-20T18:35:57.304 INFO:tasks.workunit.client.0.smithi017.stdout:5/333: dwrite d0/d14/d18/f2f [0,4194304] 0 2024-09-20T18:35:57.306 INFO:tasks.workunit.client.0.smithi017.stdout:2/517: link d1/dc/d20/d2e/d30/d85/d46/d48/f90 d1/dc/fa9 0 2024-09-20T18:35:57.313 INFO:tasks.workunit.client.0.smithi017.stdout:0/318: mkdir d4/db/d1e/d66 0 2024-09-20T18:35:57.315 INFO:tasks.workunit.client.0.smithi017.stdout:5/334: read d0/d14/d40/f63 [406339,125922] 0 2024-09-20T18:35:57.316 INFO:tasks.workunit.client.0.smithi017.stdout:2/518: chown d1/dc/d20/d2e/d30/d85/d53/d6b/c89 29 1 2024-09-20T18:35:57.317 INFO:tasks.workunit.client.0.smithi017.stdout:6/344: dwrite d4/f14 [0,4194304] 0 2024-09-20T18:35:57.317 INFO:tasks.workunit.client.0.smithi017.stdout:5/335: stat d0/d14/d40/f63 0 2024-09-20T18:35:57.319 INFO:tasks.workunit.client.0.smithi017.stdout:5/336: chown d0/f7 15433194 1 2024-09-20T18:35:57.328 INFO:tasks.workunit.client.0.smithi017.stdout:5/337: unlink d0/d14/d18/d1b/f51 0 2024-09-20T18:35:57.334 INFO:tasks.workunit.client.0.smithi017.stdout:2/519: mkdir d1/dc/d20/daa 0 2024-09-20T18:35:57.334 INFO:tasks.workunit.client.0.smithi017.stdout:1/332: dread df/f18 [0,4194304] 0 2024-09-20T18:35:57.334 INFO:tasks.workunit.client.0.smithi017.stdout:6/345: symlink d4/d37/d68/l75 0 2024-09-20T18:35:57.334 INFO:tasks.workunit.client.0.smithi017.stdout:6/346: truncate d4/df/d4a/f50 762216 0 2024-09-20T18:35:57.340 INFO:tasks.workunit.client.0.smithi017.stdout:1/333: creat df/d16/f63 x:0 0 0 2024-09-20T18:35:57.341 INFO:tasks.workunit.client.0.smithi017.stdout:1/334: chown df/d16/l19 28344 1 2024-09-20T18:35:57.344 INFO:tasks.workunit.client.0.smithi017.stdout:6/347: rename d4/l1c to d4/d37/d68/l76 0 2024-09-20T18:35:57.345 INFO:tasks.workunit.client.0.smithi017.stdout:5/338: mknod d0/d14/c69 0 2024-09-20T18:35:57.347 INFO:tasks.workunit.client.0.smithi017.stdout:1/335: write df/f26 [1641654,117027] 0 2024-09-20T18:35:57.350 INFO:tasks.workunit.client.0.smithi017.stdout:5/339: creat d0/d14/d40/f6a x:0 0 0 2024-09-20T18:35:57.352 INFO:tasks.workunit.client.0.smithi017.stdout:2/520: creat d1/dc/d20/d2e/d30/d85/d3d/fab x:0 0 0 2024-09-20T18:35:57.353 INFO:tasks.workunit.client.0.smithi017.stdout:8/298: write d0/d6/f16 [354433,103369] 0 2024-09-20T18:35:57.353 INFO:tasks.workunit.client.0.smithi017.stdout:7/336: dwrite da/d16/d1b/f28 [0,4194304] 0 2024-09-20T18:35:57.365 INFO:tasks.workunit.client.0.smithi017.stdout:0/319: dwrite d4/f6 [0,4194304] 0 2024-09-20T18:35:57.368 INFO:tasks.workunit.client.0.smithi017.stdout:2/521: creat d1/dc/d20/d2e/d30/d85/d3d/d77/fac x:0 0 0 2024-09-20T18:35:57.375 INFO:tasks.workunit.client.0.smithi017.stdout:0/320: creat d4/db/d1e/d42/f67 x:0 0 0 2024-09-20T18:35:57.376 INFO:tasks.workunit.client.0.smithi017.stdout:0/321: chown d4/db/d18/f19 0 1 2024-09-20T18:35:57.379 INFO:tasks.workunit.client.0.smithi017.stdout:7/337: dread da/d16/d1c/d40/d5d/f5f [0,4194304] 0 2024-09-20T18:35:57.384 INFO:tasks.workunit.client.0.smithi017.stdout:1/336: truncate df/f5e 92206 0 2024-09-20T18:35:57.386 INFO:tasks.workunit.client.0.smithi017.stdout:8/299: link d0/l39 d0/l61 0 2024-09-20T18:35:57.401 INFO:tasks.workunit.client.0.smithi017.stdout:2/522: fsync d1/d1f/f33 0 2024-09-20T18:35:57.402 INFO:tasks.workunit.client.0.smithi017.stdout:1/337: dread df/d16/f2e [0,4194304] 0 2024-09-20T18:35:57.403 INFO:tasks.workunit.client.0.smithi017.stdout:1/338: fdatasync df/f1a 0 2024-09-20T18:35:57.403 INFO:tasks.workunit.client.0.smithi017.stdout:2/523: read d1/dc/d20/d2e/d30/f97 [50093,60681] 0 2024-09-20T18:35:57.405 INFO:tasks.workunit.client.0.smithi017.stdout:0/322: mkdir d4/d68 0 2024-09-20T18:35:57.410 INFO:tasks.workunit.client.0.smithi017.stdout:6/348: unlink d4/d37/f4d 0 2024-09-20T18:35:57.411 INFO:tasks.workunit.client.0.smithi017.stdout:0/323: mkdir d4/db/d1e/d24/d2f/d69 0 2024-09-20T18:35:57.414 INFO:tasks.workunit.client.0.smithi017.stdout:7/338: rmdir da/d5c 0 2024-09-20T18:35:57.414 INFO:tasks.workunit.client.0.smithi017.stdout:7/339: read - da/d16/f5e zero size 2024-09-20T18:35:57.419 INFO:tasks.workunit.client.0.smithi017.stdout:8/300: getdents d0/d6/d28 0 2024-09-20T18:35:57.422 INFO:tasks.workunit.client.0.smithi017.stdout:1/339: dread df/f11 [0,4194304] 0 2024-09-20T18:35:57.422 INFO:tasks.workunit.client.0.smithi017.stdout:2/524: rename d1/dc/d20/d2e/d30/d85/d46/da3 to d1/dc/d20/d2e/d30/d85/d3d/dad 0 2024-09-20T18:35:57.425 INFO:tasks.workunit.client.0.smithi017.stdout:8/301: readlink d0/d6/d28/d3a/l3c 0 2024-09-20T18:35:57.426 INFO:tasks.workunit.client.0.smithi017.stdout:7/340: rename da/d16/d1c/d40/d34/f55 to da/d16/d1c/f61 0 2024-09-20T18:35:57.426 INFO:tasks.workunit.client.0.smithi017.stdout:6/349: dread d4/f10 [0,4194304] 0 2024-09-20T18:35:57.428 INFO:tasks.workunit.client.0.smithi017.stdout:1/340: symlink df/d16/d50/l64 0 2024-09-20T18:35:57.429 INFO:tasks.workunit.client.0.smithi017.stdout:2/525: fsync d1/dc/d20/d2e/d30/d85/d46/d48/f90 0 2024-09-20T18:35:57.429 INFO:tasks.workunit.client.0.smithi017.stdout:0/324: dwrite d4/d37/f4d [0,4194304] 0 2024-09-20T18:35:57.430 INFO:tasks.workunit.client.0.smithi017.stdout:1/341: write f2 [2007987,24054] 0 2024-09-20T18:35:57.433 INFO:tasks.workunit.client.0.smithi017.stdout:7/341: symlink da/d16/l62 0 2024-09-20T18:35:57.435 INFO:tasks.workunit.client.0.smithi017.stdout:6/350: creat d4/d37/d41/f77 x:0 0 0 2024-09-20T18:35:57.437 INFO:tasks.workunit.client.0.smithi017.stdout:1/342: dwrite df/f1a [4194304,4194304] 0 2024-09-20T18:35:57.439 INFO:tasks.workunit.client.0.smithi017.stdout:1/343: write df/d35/f5c [369955,17016] 0 2024-09-20T18:35:57.445 INFO:tasks.workunit.client.0.smithi017.stdout:2/526: symlink d1/dc/d20/d2e/lae 0 2024-09-20T18:35:57.445 INFO:tasks.workunit.client.0.smithi017.stdout:2/527: readlink d1/d67/l81 0 2024-09-20T18:35:57.454 INFO:tasks.workunit.client.0.smithi017.stdout:1/344: creat df/d29/d2c/f65 x:0 0 0 2024-09-20T18:35:57.455 INFO:tasks.workunit.client.0.smithi017.stdout:1/345: read df/d29/f56 [3800349,22811] 0 2024-09-20T18:35:57.456 INFO:tasks.workunit.client.0.smithi017.stdout:0/325: rename d4/f29 to d4/d37/f6a 0 2024-09-20T18:35:57.459 INFO:tasks.workunit.client.0.smithi017.stdout:2/528: creat d1/dc/d20/d2e/d30/d85/d3d/d77/d7a/faf x:0 0 0 2024-09-20T18:35:57.461 INFO:tasks.workunit.client.0.smithi017.stdout:6/351: unlink d4/df/c20 0 2024-09-20T18:35:57.464 INFO:tasks.workunit.client.0.smithi017.stdout:1/346: symlink df/d16/l66 0 2024-09-20T18:35:57.465 INFO:tasks.workunit.client.0.smithi017.stdout:8/302: truncate d0/d6/f3e 7132795 0 2024-09-20T18:35:57.465 INFO:tasks.workunit.client.0.smithi017.stdout:1/347: fsync df/d29/f61 0 2024-09-20T18:35:57.466 INFO:tasks.workunit.client.0.smithi017.stdout:0/326: creat d4/db/d1e/d24/d2f/f6b x:0 0 0 2024-09-20T18:35:57.467 INFO:tasks.workunit.client.0.smithi017.stdout:8/303: readlink d0/d6/d28/d3b/l3f 0 2024-09-20T18:35:57.468 INFO:tasks.workunit.client.0.smithi017.stdout:7/342: dwrite da/d16/f47 [0,4194304] 0 2024-09-20T18:35:57.471 INFO:tasks.workunit.client.0.smithi017.stdout:7/343: write da/d16/d1c/f4c [1378117,10920] 0 2024-09-20T18:35:57.471 INFO:tasks.workunit.client.0.smithi017.stdout:7/344: readlink da/d16/l41 0 2024-09-20T18:35:57.472 INFO:tasks.workunit.client.0.smithi017.stdout:7/345: chown da/d16/d1c/f4c 975754 1 2024-09-20T18:35:57.473 INFO:tasks.workunit.client.0.smithi017.stdout:0/327: creat d4/d20/f6c x:0 0 0 2024-09-20T18:35:57.474 INFO:tasks.workunit.client.0.smithi017.stdout:1/348: creat df/d16/d50/d53/f67 x:0 0 0 2024-09-20T18:35:57.476 INFO:tasks.workunit.client.0.smithi017.stdout:8/304: dread d0/d6/f30 [0,4194304] 0 2024-09-20T18:35:57.483 INFO:tasks.workunit.client.0.smithi017.stdout:0/328: symlink d4/db/d18/l6d 0 2024-09-20T18:35:57.486 INFO:tasks.workunit.client.0.smithi017.stdout:2/529: truncate d1/dc/d20/d2e/f49 2882105 0 2024-09-20T18:35:57.489 INFO:tasks.workunit.client.0.smithi017.stdout:8/305: dread d0/d6/f1b [0,4194304] 0 2024-09-20T18:35:57.491 INFO:tasks.workunit.client.0.smithi017.stdout:0/329: mknod d4/d20/c6e 0 2024-09-20T18:35:57.491 INFO:tasks.workunit.client.0.smithi017.stdout:7/346: write da/d16/d1c/f2e [886969,120973] 0 2024-09-20T18:35:57.494 INFO:tasks.workunit.client.0.smithi017.stdout:8/306: symlink d0/d6/d28/d3b/l62 0 2024-09-20T18:35:57.495 INFO:tasks.workunit.client.0.smithi017.stdout:2/530: getdents d1/dc/d20/d2e/d30/d9d 0 2024-09-20T18:35:57.496 INFO:tasks.workunit.client.0.smithi017.stdout:6/352: truncate d4/f12 1004032 0 2024-09-20T18:35:57.501 INFO:tasks.workunit.client.0.smithi017.stdout:7/347: mknod da/c63 0 2024-09-20T18:35:57.503 INFO:tasks.workunit.client.0.smithi017.stdout:2/531: mkdir d1/dc/d20/d2e/d30/db0 0 2024-09-20T18:35:57.505 INFO:tasks.workunit.client.0.smithi017.stdout:8/307: getdents d0/d6/d28/d3d/d4e 0 2024-09-20T18:35:57.510 INFO:tasks.workunit.client.0.smithi017.stdout:7/348: dwrite da/d16/d1c/d40/d5d/f5f [0,4194304] 0 2024-09-20T18:35:57.512 INFO:tasks.workunit.client.0.smithi017.stdout:8/308: mknod d0/c63 0 2024-09-20T18:35:57.512 INFO:tasks.workunit.client.0.smithi017.stdout:2/532: dread d1/df/d17/f1a [0,4194304] 0 2024-09-20T18:35:57.512 INFO:tasks.workunit.client.0.smithi017.stdout:0/330: write d4/d20/f2e [513087,111704] 0 2024-09-20T18:35:57.514 INFO:tasks.workunit.client.0.smithi017.stdout:2/533: write d1/d1f/f3f [2182249,32285] 0 2024-09-20T18:35:57.518 INFO:tasks.workunit.client.0.smithi017.stdout:7/349: creat da/d16/d1c/d40/d34/d3c/f64 x:0 0 0 2024-09-20T18:35:57.523 INFO:tasks.workunit.client.0.smithi017.stdout:2/534: mknod d1/dc/d20/d2e/d30/d85/d53/d6b/cb1 0 2024-09-20T18:35:57.530 INFO:tasks.workunit.client.0.smithi017.stdout:2/535: creat d1/dc/d20/d2e/d30/d85/d53/d96/fb2 x:0 0 0 2024-09-20T18:35:57.531 INFO:tasks.workunit.client.0.smithi017.stdout:7/350: creat da/f65 x:0 0 0 2024-09-20T18:35:57.535 INFO:tasks.workunit.client.0.smithi017.stdout:2/536: mknod d1/dc/d20/d2e/cb3 0 2024-09-20T18:35:57.537 INFO:tasks.workunit.client.0.smithi017.stdout:2/537: dread - d1/dc/d20/f84 zero size 2024-09-20T18:35:57.537 INFO:tasks.workunit.client.0.smithi017.stdout:2/538: fsync d1/d1f/f6e 0 2024-09-20T18:35:57.539 INFO:tasks.workunit.client.0.smithi017.stdout:7/351: fsync da/d16/d1c/f1f 0 2024-09-20T18:35:57.542 INFO:tasks.workunit.client.0.smithi017.stdout:8/309: dread d0/f1e [0,4194304] 0 2024-09-20T18:35:57.546 INFO:tasks.workunit.client.0.smithi017.stdout:7/352: creat da/d16/d1c/d40/d30/f66 x:0 0 0 2024-09-20T18:35:57.547 INFO:tasks.workunit.client.0.smithi017.stdout:8/310: mknod d0/d6/d28/c64 0 2024-09-20T18:35:57.553 INFO:tasks.workunit.client.0.smithi017.stdout:7/353: creat da/d16/f67 x:0 0 0 2024-09-20T18:35:57.553 INFO:tasks.workunit.client.0.smithi017.stdout:7/354: stat da/d16/d1c/d40/d30/f56 0 2024-09-20T18:35:57.556 INFO:tasks.workunit.client.0.smithi017.stdout:8/311: fsync d0/f5f 0 2024-09-20T18:35:57.561 INFO:tasks.workunit.client.0.smithi017.stdout:7/355: fdatasync da/d16/d1c/d40/d30/f56 0 2024-09-20T18:35:57.568 INFO:tasks.workunit.client.0.smithi017.stdout:2/539: dwrite d1/df/f1e [0,4194304] 0 2024-09-20T18:35:57.569 INFO:tasks.workunit.client.0.smithi017.stdout:8/312: mkdir d0/d65 0 2024-09-20T18:35:57.569 INFO:tasks.workunit.client.0.smithi017.stdout:7/356: write da/d16/d1c/f61 [1430707,8917] 0 2024-09-20T18:35:57.574 INFO:tasks.workunit.client.0.smithi017.stdout:2/540: write d1/dc/d20/d2e/d30/d85/d3d/f43 [5188045,3922] 0 2024-09-20T18:35:57.575 INFO:tasks.workunit.client.0.smithi017.stdout:7/357: creat da/d16/f68 x:0 0 0 2024-09-20T18:35:57.576 INFO:tasks.workunit.client.0.smithi017.stdout:2/541: fsync d1/dc/d20/d2e/d30/d85/d3d/fab 0 2024-09-20T18:35:57.579 INFO:tasks.workunit.client.0.smithi017.stdout:7/358: mknod da/d16/d1c/d40/d34/d3c/c69 0 2024-09-20T18:35:57.579 INFO:tasks.workunit.client.0.smithi017.stdout:7/359: chown da/d16 12 1 2024-09-20T18:35:57.580 INFO:tasks.workunit.client.0.smithi017.stdout:8/313: link d0/d6/d28/c35 d0/d6/d28/d3d/d4e/c66 0 2024-09-20T18:35:57.583 INFO:tasks.workunit.client.0.smithi017.stdout:7/360: mknod da/d16/d1c/d40/d34/d3c/c6a 0 2024-09-20T18:35:57.586 INFO:tasks.workunit.client.0.smithi017.stdout:8/314: link d0/d6/d28/d3b/f53 d0/d6/f67 0 2024-09-20T18:35:57.588 INFO:tasks.workunit.client.0.smithi017.stdout:8/315: write d0/d6/d28/d3a/f49 [289308,17615] 0 2024-09-20T18:35:57.589 INFO:tasks.workunit.client.0.smithi017.stdout:9/499: sync 2024-09-20T18:35:57.590 INFO:tasks.workunit.client.0.smithi017.stdout:2/542: link d1/df/c1b d1/dc/d20/d2e/d30/cb4 0 2024-09-20T18:35:57.593 INFO:tasks.workunit.client.0.smithi017.stdout:7/361: link da/d16/d1c/d40/d3a/f45 da/d16/d1c/d40/d34/f6b 0 2024-09-20T18:35:57.594 INFO:tasks.workunit.client.0.smithi017.stdout:8/316: rmdir d0/d6/d28/d3d 39 2024-09-20T18:35:57.596 INFO:tasks.workunit.client.0.smithi017.stdout:2/543: dwrite d1/dc/d20/d2e/d30/d85/d3d/d77/fac [0,4194304] 0 2024-09-20T18:35:57.598 INFO:tasks.workunit.client.0.smithi017.stdout:2/544: readlink d1/dc/d20/d2e/lae 0 2024-09-20T18:35:57.610 INFO:tasks.workunit.client.0.smithi017.stdout:9/500: write d6/d23/d3a/d61/fb3 [1042577,14827] 0 2024-09-20T18:35:57.620 INFO:tasks.workunit.client.0.smithi017.stdout:7/362: dwrite da/d16/f3f [0,4194304] 0 2024-09-20T18:35:57.621 INFO:tasks.workunit.client.0.smithi017.stdout:8/317: dwrite d0/d6/f3e [0,4194304] 0 2024-09-20T18:35:57.623 INFO:tasks.workunit.client.0.smithi017.stdout:8/318: chown d0/d6/d28/l50 5443 1 2024-09-20T18:35:57.625 INFO:tasks.workunit.client.0.smithi017.stdout:8/319: write d0/d6/f3e [5904743,36229] 0 2024-09-20T18:35:57.626 INFO:tasks.workunit.client.0.smithi017.stdout:9/501: symlink d6/d23/d58/d3f/d4d/d73/lbe 0 2024-09-20T18:35:57.628 INFO:tasks.workunit.client.0.smithi017.stdout:7/363: rename da/d16/d1c/c20 to da/d16/d1c/d40/d30/c6c 0 2024-09-20T18:35:57.631 INFO:tasks.workunit.client.0.smithi017.stdout:9/502: creat d6/fbf x:0 0 0 2024-09-20T18:35:57.637 INFO:tasks.workunit.client.0.smithi017.stdout:8/320: creat d0/d6/d28/f68 x:0 0 0 2024-09-20T18:35:57.638 INFO:tasks.workunit.client.0.smithi017.stdout:8/321: write d0/d6/d28/f68 [597573,73222] 0 2024-09-20T18:35:57.644 INFO:tasks.workunit.client.0.smithi017.stdout:8/322: mkdir d0/d6/d28/d3d/d4e/d55/d69 0 2024-09-20T18:35:57.648 INFO:tasks.workunit.client.0.smithi017.stdout:8/323: mknod d0/d6/d28/d3d/d4e/d55/c6a 0 2024-09-20T18:35:57.654 INFO:tasks.workunit.client.0.smithi017.stdout:8/324: fsync d0/f14 0 2024-09-20T18:35:57.655 INFO:tasks.workunit.client.0.smithi017.stdout:8/325: chown d0/d6/f56 22887 1 2024-09-20T18:35:57.656 INFO:tasks.workunit.client.0.smithi017.stdout:8/326: readlink d0/d6/d28/l33 0 2024-09-20T18:35:57.656 INFO:tasks.workunit.client.0.smithi017.stdout:9/503: chown d6/f7 110699283 1 2024-09-20T18:35:57.656 INFO:tasks.workunit.client.0.smithi017.stdout:8/327: stat d0/d6/f3e 0 2024-09-20T18:35:57.658 INFO:tasks.workunit.client.0.smithi017.stdout:7/364: dread f4 [4194304,4194304] 0 2024-09-20T18:35:57.660 INFO:tasks.workunit.client.0.smithi017.stdout:7/365: chown da/d16/d1c/d40/d34/d3c/c6a 46331 1 2024-09-20T18:35:57.661 INFO:tasks.workunit.client.0.smithi017.stdout:7/366: write da/f14 [696060,62163] 0 2024-09-20T18:35:57.662 INFO:tasks.workunit.client.0.smithi017.stdout:8/328: rename d0/d6/d28/d3a/l3c to d0/d6/l6b 0 2024-09-20T18:35:57.663 INFO:tasks.workunit.client.0.smithi017.stdout:3/566: sync 2024-09-20T18:35:57.663 INFO:tasks.workunit.client.0.smithi017.stdout:8/329: chown d0/d6/l26 26027 1 2024-09-20T18:35:57.664 INFO:tasks.workunit.client.0.smithi017.stdout:9/504: dread d6/d23/d58/d3f/d4d/f97 [0,4194304] 0 2024-09-20T18:35:57.665 INFO:tasks.workunit.client.0.smithi017.stdout:7/367: mknod da/d16/d1b/c6d 0 2024-09-20T18:35:57.668 INFO:tasks.workunit.client.0.smithi017.stdout:8/330: dread d0/d6/d28/f68 [0,4194304] 0 2024-09-20T18:35:57.671 INFO:tasks.workunit.client.0.smithi017.stdout:7/368: chown da/d16/d1c/d40/d34/d3c/f53 56 1 2024-09-20T18:35:57.673 INFO:tasks.workunit.client.0.smithi017.stdout:3/567: rename da/de/d13/d16/d6e/d82/lb0 to da/de/d13/d2f/d26/d62/lb4 0 2024-09-20T18:35:57.687 INFO:tasks.workunit.client.0.smithi017.stdout:9/505: unlink d6/l9 0 2024-09-20T18:35:57.689 INFO:tasks.workunit.client.0.smithi017.stdout:3/568: write da/f58 [2026523,45650] 0 2024-09-20T18:35:57.695 INFO:tasks.workunit.client.0.smithi017.stdout:7/369: creat da/d16/d1c/d40/d34/f6e x:0 0 0 2024-09-20T18:35:57.696 INFO:tasks.workunit.client.0.smithi017.stdout:3/569: chown da/de/d13/d2f/d26/d62/f8a 5 1 2024-09-20T18:35:57.696 INFO:tasks.workunit.client.0.smithi017.stdout:8/331: dwrite d0/d6/f38 [0,4194304] 0 2024-09-20T18:35:57.699 INFO:tasks.workunit.client.0.smithi017.stdout:3/570: dread - da/de/d53/fa4 zero size 2024-09-20T18:35:57.701 INFO:tasks.workunit.client.0.smithi017.stdout:3/571: chown da/de/d13/f67 1335352255 1 2024-09-20T18:35:57.704 INFO:tasks.workunit.client.0.smithi017.stdout:9/506: dwrite d6/d23/d58/d3f/d4d/d73/d7d/f85 [0,4194304] 0 2024-09-20T18:35:57.708 INFO:tasks.workunit.client.0.smithi017.stdout:8/332: dwrite d0/d6/f3e [0,4194304] 0 2024-09-20T18:35:57.712 INFO:tasks.workunit.client.0.smithi017.stdout:7/370: rename da/d16/d1c/d40/d34/d3c/c3d to da/c6f 0 2024-09-20T18:35:57.712 INFO:tasks.workunit.client.0.smithi017.stdout:3/572: symlink da/de/d13/d16/d6e/lb5 0 2024-09-20T18:35:57.714 INFO:tasks.workunit.client.0.smithi017.stdout:7/371: dread - da/d16/d1c/d40/d30/f66 zero size 2024-09-20T18:35:57.716 INFO:tasks.workunit.client.0.smithi017.stdout:8/333: read d0/d6/f25 [4000648,54018] 0 2024-09-20T18:35:57.717 INFO:tasks.workunit.client.0.smithi017.stdout:3/573: symlink da/de/d53/d88/lb6 0 2024-09-20T18:35:57.718 INFO:tasks.workunit.client.0.smithi017.stdout:9/507: creat d6/d42/fc0 x:0 0 0 2024-09-20T18:35:57.719 INFO:tasks.workunit.client.0.smithi017.stdout:3/574: dread da/de/d13/d2f/d26/d41/f83 [0,4194304] 0 2024-09-20T18:35:57.719 INFO:tasks.workunit.client.0.smithi017.stdout:9/508: dread - d6/d23/d40/db4/dba/f8d zero size 2024-09-20T18:35:57.720 INFO:tasks.workunit.client.0.smithi017.stdout:8/334: unlink d0/f1c 0 2024-09-20T18:35:57.723 INFO:tasks.workunit.client.0.smithi017.stdout:3/575: mknod da/de/d13/d16/d6e/d82/cb7 0 2024-09-20T18:35:57.725 INFO:tasks.workunit.client.0.smithi017.stdout:7/372: getdents da/d16/d1c/d40/d30/d50 0 2024-09-20T18:35:57.728 INFO:tasks.workunit.client.0.smithi017.stdout:9/509: dwrite d6/d23/d58/d3f/d2f/d5d/f56 [0,4194304] 0 2024-09-20T18:35:57.729 INFO:tasks.workunit.client.0.smithi017.stdout:9/510: chown d6/d42 4841 1 2024-09-20T18:35:57.732 INFO:tasks.workunit.client.0.smithi017.stdout:9/511: mkdir d6/dc1 0 2024-09-20T18:35:57.734 INFO:tasks.workunit.client.0.smithi017.stdout:9/512: dread d6/d23/d3a/d61/f78 [0,4194304] 0 2024-09-20T18:35:57.734 INFO:tasks.workunit.client.0.smithi017.stdout:9/513: readlink d6/d23/d58/d3f/l46 0 2024-09-20T18:35:57.737 INFO:tasks.workunit.client.0.smithi017.stdout:8/335: dread d0/d6/d28/f29 [0,4194304] 0 2024-09-20T18:35:57.739 INFO:tasks.workunit.client.0.smithi017.stdout:9/514: unlink d6/d23/d40/db4/dba/f6e 0 2024-09-20T18:35:57.740 INFO:tasks.workunit.client.0.smithi017.stdout:9/515: readlink d6/d23/d58/d3f/d82/l28 0 2024-09-20T18:35:57.741 INFO:tasks.workunit.client.0.smithi017.stdout:9/516: readlink d6/d23/d58/l9e 0 2024-09-20T18:35:57.744 INFO:tasks.workunit.client.0.smithi017.stdout:3/576: dread da/f58 [4194304,4194304] 0 2024-09-20T18:35:57.745 INFO:tasks.workunit.client.0.smithi017.stdout:9/517: fdatasync d6/d23/d58/d3f/f7f 0 2024-09-20T18:35:57.750 INFO:tasks.workunit.client.0.smithi017.stdout:8/336: dread d0/d6/f23 [0,4194304] 0 2024-09-20T18:35:57.750 INFO:tasks.workunit.client.0.smithi017.stdout:7/373: truncate da/d16/f47 3277591 0 2024-09-20T18:35:57.751 INFO:tasks.workunit.client.0.smithi017.stdout:8/337: unlink d0/d6/f16 0 2024-09-20T18:35:57.752 INFO:tasks.workunit.client.0.smithi017.stdout:8/338: write d0/f5e [774224,14031] 0 2024-09-20T18:35:57.754 INFO:tasks.workunit.client.0.smithi017.stdout:9/518: creat d6/fc2 x:0 0 0 2024-09-20T18:35:57.759 INFO:tasks.workunit.client.0.smithi017.stdout:7/374: creat da/d16/d1c/d40/d5d/f70 x:0 0 0 2024-09-20T18:35:57.760 INFO:tasks.workunit.client.0.smithi017.stdout:9/519: symlink d6/d11/lc3 0 2024-09-20T18:35:57.762 INFO:tasks.workunit.client.0.smithi017.stdout:9/520: creat d6/d23/d3a/fc4 x:0 0 0 2024-09-20T18:35:57.763 INFO:tasks.workunit.client.0.smithi017.stdout:7/375: dread da/fc [0,4194304] 0 2024-09-20T18:35:57.766 INFO:tasks.workunit.client.0.smithi017.stdout:9/521: creat d6/d23/d40/db4/dba/fc5 x:0 0 0 2024-09-20T18:35:57.767 INFO:tasks.workunit.client.0.smithi017.stdout:7/376: rmdir da/d54 39 2024-09-20T18:35:57.772 INFO:tasks.workunit.client.0.smithi017.stdout:9/522: getdents d6/d23/d58/d3f/d70/db0 0 2024-09-20T18:35:57.774 INFO:tasks.workunit.client.0.smithi017.stdout:9/523: stat d6/d23/d3a/f7b 0 2024-09-20T18:35:57.779 INFO:tasks.workunit.client.0.smithi017.stdout:9/524: dwrite d6/d11/f1b [4194304,4194304] 0 2024-09-20T18:35:57.786 INFO:tasks.workunit.client.0.smithi017.stdout:9/525: creat d6/d23/d58/d3f/fc6 x:0 0 0 2024-09-20T18:35:57.787 INFO:tasks.workunit.client.0.smithi017.stdout:9/526: readlink d6/d23/d58/d3f/d2f/d98/lb5 0 2024-09-20T18:35:57.788 INFO:tasks.workunit.client.0.smithi017.stdout:7/377: dwrite da/d16/d1c/f1f [0,4194304] 0 2024-09-20T18:35:57.792 INFO:tasks.workunit.client.0.smithi017.stdout:9/527: creat d6/d23/d58/d3f/d2f/d5d/fc7 x:0 0 0 2024-09-20T18:35:57.867 INFO:tasks.workunit.client.0.smithi017.stdout:4/302: sync 2024-09-20T18:35:57.867 INFO:tasks.workunit.client.0.smithi017.stdout:5/340: sync 2024-09-20T18:35:57.867 INFO:tasks.workunit.client.0.smithi017.stdout:9/528: chown d6/d23/l30 28088607 1 2024-09-20T18:35:57.868 INFO:tasks.workunit.client.0.smithi017.stdout:7/378: dread da/f13 [0,4194304] 0 2024-09-20T18:35:57.868 INFO:tasks.workunit.client.0.smithi017.stdout:7/379: chown da/c21 0 1 2024-09-20T18:35:57.872 INFO:tasks.workunit.client.0.smithi017.stdout:4/303: fsync d4/f54 0 2024-09-20T18:35:57.873 INFO:tasks.workunit.client.0.smithi017.stdout:9/529: mkdir d6/d23/d58/d3f/d70/dc8 0 2024-09-20T18:35:57.874 INFO:tasks.workunit.client.0.smithi017.stdout:4/304: stat d4/dc/d1e/d26/d22 0 2024-09-20T18:35:57.874 INFO:tasks.workunit.client.0.smithi017.stdout:9/530: write d6/d11/f13 [3012717,12407] 0 2024-09-20T18:35:57.875 INFO:tasks.workunit.client.0.smithi017.stdout:5/341: readlink d0/d14/d18/d1b/l2d 0 2024-09-20T18:35:57.875 INFO:tasks.workunit.client.0.smithi017.stdout:9/531: chown d6/d23/d58/d3f/d4d/d73/d8f 909809124 1 2024-09-20T18:35:57.877 INFO:tasks.workunit.client.0.smithi017.stdout:4/305: symlink d4/de/l60 0 2024-09-20T18:35:57.879 INFO:tasks.workunit.client.0.smithi017.stdout:9/532: unlink d6/d23/d40/db4/lad 0 2024-09-20T18:35:57.879 INFO:tasks.workunit.client.0.smithi017.stdout:4/306: rmdir d4/d19/d37 39 2024-09-20T18:35:57.879 INFO:tasks.workunit.client.0.smithi017.stdout:9/533: chown d6/d23/d58/c39 486073643 1 2024-09-20T18:35:57.880 INFO:tasks.workunit.client.0.smithi017.stdout:4/307: chown d4/dc/d1e/l24 12247242 1 2024-09-20T18:35:57.883 INFO:tasks.workunit.client.0.smithi017.stdout:5/342: link d0/d14/d18/l1d d0/d14/d40/l6b 0 2024-09-20T18:35:57.889 INFO:tasks.workunit.client.0.smithi017.stdout:9/534: dwrite d6/d23/d58/d3f/d82/f4f [0,4194304] 0 2024-09-20T18:35:57.890 INFO:tasks.workunit.client.0.smithi017.stdout:4/308: dwrite d4/de/f4f [0,4194304] 0 2024-09-20T18:35:57.894 INFO:tasks.workunit.client.0.smithi017.stdout:5/343: rmdir d0/d14/d18/d57 39 2024-09-20T18:35:57.895 INFO:tasks.workunit.client.0.smithi017.stdout:5/344: dread - d0/d14/d18/d1b/f5c zero size 2024-09-20T18:35:57.902 INFO:tasks.workunit.client.0.smithi017.stdout:5/345: unlink d0/d13/l52 0 2024-09-20T18:35:57.907 INFO:tasks.workunit.client.0.smithi017.stdout:9/535: mknod d6/d11/dbb/cc9 0 2024-09-20T18:35:57.910 INFO:tasks.workunit.client.0.smithi017.stdout:9/536: write d6/d23/d58/d3f/d2f/d5d/f56 [730795,11439] 0 2024-09-20T18:35:57.910 INFO:tasks.workunit.client.0.smithi017.stdout:5/346: dwrite d0/d13/f16 [0,4194304] 0 2024-09-20T18:35:58.014 INFO:tasks.workunit.client.0.smithi017.stdout:5/347: chown d0/d14/d18/d57/f4e 49388954 1 2024-09-20T18:35:58.101 INFO:tasks.workunit.client.0.smithi017.stdout:9/537: mkdir d6/d23/d58/d3f/d70/db0/dca 0 2024-09-20T18:35:58.104 INFO:tasks.workunit.client.0.smithi017.stdout:5/348: mkdir d0/d14/d18/d2a/d39/d6c 0 2024-09-20T18:35:58.115 INFO:tasks.workunit.client.0.smithi017.stdout:5/349: mkdir d0/d14/d18/d19/d4d/d6d 0 2024-09-20T18:35:58.115 INFO:tasks.workunit.client.0.smithi017.stdout:9/538: getdents d6/d23/d58/d3f/d70 0 2024-09-20T18:35:58.120 INFO:tasks.workunit.client.0.smithi017.stdout:5/350: mkdir d0/d6e 0 2024-09-20T18:35:58.201 INFO:tasks.workunit.client.0.smithi017.stdout:9/539: dwrite d6/d11/f3e [0,4194304] 0 2024-09-20T18:35:58.201 INFO:tasks.workunit.client.0.smithi017.stdout:9/540: stat d6/d11/c36 0 2024-09-20T18:35:58.225 INFO:tasks.workunit.client.0.smithi017.stdout:9/541: rename d6/d23/d58/d3f/d2f/f3b to d6/d23/d58/d3f/d2f/d5d/fcb 0 2024-09-20T18:35:58.225 INFO:tasks.workunit.client.0.smithi017.stdout:9/542: readlink d6/d23/d3a/l49 0 2024-09-20T18:35:58.226 INFO:tasks.workunit.client.0.smithi017.stdout:9/543: readlink d6/d23/d40/l83 0 2024-09-20T18:35:58.229 INFO:tasks.workunit.client.0.smithi017.stdout:9/544: symlink d6/d23/d3a/d61/lcc 0 2024-09-20T18:35:58.235 INFO:tasks.workunit.client.0.smithi017.stdout:9/545: dread d6/d23/d58/d3f/d2f/f8e [0,4194304] 0 2024-09-20T18:35:58.237 INFO:tasks.workunit.client.0.smithi017.stdout:9/546: stat d6/d23/d3a/d61/f69 0 2024-09-20T18:35:58.240 INFO:tasks.workunit.client.0.smithi017.stdout:9/547: unlink d6/d23/d3a/c72 0 2024-09-20T18:35:58.242 INFO:tasks.workunit.client.0.smithi017.stdout:9/548: creat d6/d23/d58/d3f/d82/fcd x:0 0 0 2024-09-20T18:35:58.244 INFO:tasks.workunit.client.0.smithi017.stdout:9/549: truncate d6/d23/d58/d3f/d2f/f8e 1576235 0 2024-09-20T18:35:58.244 INFO:tasks.workunit.client.0.smithi017.stdout:9/550: fsync d6/d23/d40/fb1 0 2024-09-20T18:35:58.247 INFO:tasks.workunit.client.0.smithi017.stdout:9/551: rmdir d6/d23/d58/d3f/d70/db0 39 2024-09-20T18:35:58.254 INFO:tasks.workunit.client.0.smithi017.stdout:9/552: dwrite d6/d23/d58/d3f/d82/f4f [0,4194304] 0 2024-09-20T18:35:58.254 INFO:tasks.workunit.client.0.smithi017.stdout:9/553: chown d6/d11/f17 55 1 2024-09-20T18:35:58.261 INFO:tasks.workunit.client.0.smithi017.stdout:9/554: dwrite d6/d42/fc0 [0,4194304] 0 2024-09-20T18:35:58.265 INFO:tasks.workunit.client.0.smithi017.stdout:9/555: stat d6/c10 0 2024-09-20T18:35:58.273 INFO:tasks.workunit.client.0.smithi017.stdout:9/556: dwrite d6/d23/d58/d3f/d2f/d5d/f86 [0,4194304] 0 2024-09-20T18:35:58.282 INFO:tasks.workunit.client.0.smithi017.stdout:9/557: dwrite d6/d23/d3a/f62 [0,4194304] 0 2024-09-20T18:35:58.284 INFO:tasks.workunit.client.0.smithi017.stdout:9/558: chown d6/d23/d40/db4/dba/f84 18 1 2024-09-20T18:35:58.288 INFO:tasks.workunit.client.0.smithi017.stdout:9/559: creat d6/d23/d40/db4/fce x:0 0 0 2024-09-20T18:35:58.290 INFO:tasks.workunit.client.0.smithi017.stdout:9/560: truncate d6/d23/d58/d3f/d2f/d5d/faf 802923 0 2024-09-20T18:35:58.294 INFO:tasks.workunit.client.0.smithi017.stdout:9/561: dread d6/d23/d58/d3f/d2f/d5d/f86 [0,4194304] 0 2024-09-20T18:35:58.297 INFO:tasks.workunit.client.0.smithi017.stdout:9/562: link d6/d11/f13 d6/d23/d40/db4/fcf 0 2024-09-20T18:35:58.300 INFO:tasks.workunit.client.0.smithi017.stdout:9/563: dread d6/f2e [0,4194304] 0 2024-09-20T18:35:58.303 INFO:tasks.workunit.client.0.smithi017.stdout:9/564: mknod d6/d23/d58/d3f/d2f/d5d/cd0 0 2024-09-20T18:35:58.303 INFO:tasks.workunit.client.0.smithi017.stdout:9/565: truncate d6/d23/f7a 322500 0 2024-09-20T18:35:58.306 INFO:tasks.workunit.client.0.smithi017.stdout:9/566: mknod d6/d23/d58/d3f/d70/db0/cd1 0 2024-09-20T18:35:58.308 INFO:tasks.workunit.client.0.smithi017.stdout:9/567: write d6/f34 [6103344,81681] 0 2024-09-20T18:35:58.310 INFO:tasks.workunit.client.0.smithi017.stdout:9/568: symlink d6/d23/d58/d3f/d82/ld2 0 2024-09-20T18:35:58.311 INFO:tasks.workunit.client.0.smithi017.stdout:9/569: mknod d6/dc1/cd3 0 2024-09-20T18:35:58.314 INFO:tasks.workunit.client.0.smithi017.stdout:9/570: rename d6/d23/d58/cbc to d6/d23/d58/d3f/d70/db0/cd4 0 2024-09-20T18:35:58.315 INFO:tasks.workunit.client.0.smithi017.stdout:9/571: fdatasync d6/d23/f2a 0 2024-09-20T18:35:58.317 INFO:tasks.workunit.client.0.smithi017.stdout:9/572: unlink d6/d23/d58/d3f/d2f/d5d/c90 0 2024-09-20T18:35:58.320 INFO:tasks.workunit.client.0.smithi017.stdout:9/573: dread d6/d23/f51 [0,4194304] 0 2024-09-20T18:35:58.321 INFO:tasks.workunit.client.0.smithi017.stdout:9/574: readlink d6/d23/d58/d3f/d82/l28 0 2024-09-20T18:35:58.325 INFO:tasks.workunit.client.0.smithi017.stdout:9/575: creat d6/d23/d58/d3f/d4d/d73/d93/fd5 x:0 0 0 2024-09-20T18:35:58.329 INFO:tasks.workunit.client.0.smithi017.stdout:9/576: symlink d6/d23/d58/d3f/d2f/d5d/ld6 0 2024-09-20T18:35:58.330 INFO:tasks.workunit.client.0.smithi017.stdout:9/577: chown d6/d23/d58/d3f/d4d/d73 402 1 2024-09-20T18:35:58.330 INFO:tasks.workunit.client.0.smithi017.stdout:9/578: readlink d6/d11/lc3 0 2024-09-20T18:35:58.365 INFO:tasks.workunit.client.0.smithi017.stdout:1/349: sync 2024-09-20T18:35:58.366 INFO:tasks.workunit.client.0.smithi017.stdout:1/350: truncate df/f24 237368 0 2024-09-20T18:35:58.383 INFO:tasks.workunit.client.0.smithi017.stdout:9/579: write d6/fe [2816657,32810] 0 2024-09-20T18:35:58.385 INFO:tasks.workunit.client.0.smithi017.stdout:9/580: dread - d6/d23/d58/d3f/d2f/d5d/f4c zero size 2024-09-20T18:35:58.394 INFO:tasks.workunit.client.0.smithi017.stdout:9/581: write d6/d23/d3a/d61/f78 [1710592,52475] 0 2024-09-20T18:35:58.399 INFO:tasks.workunit.client.0.smithi017.stdout:1/351: dwrite df/f11 [4194304,4194304] 0 2024-09-20T18:35:58.401 INFO:tasks.workunit.client.0.smithi017.stdout:1/352: symlink df/d16/d50/d53/l68 0 2024-09-20T18:35:58.403 INFO:tasks.workunit.client.0.smithi017.stdout:9/582: dwrite d6/d23/d58/d3f/d82/f20 [0,4194304] 0 2024-09-20T18:35:58.403 INFO:tasks.workunit.client.0.smithi017.stdout:1/353: chown df/l12 265948 1 2024-09-20T18:35:58.404 INFO:tasks.workunit.client.0.smithi017.stdout:9/583: read d6/d23/d58/d3f/d4d/f67 [709150,86684] 0 2024-09-20T18:35:58.405 INFO:tasks.workunit.client.0.smithi017.stdout:9/584: dread - d6/d42/f89 zero size 2024-09-20T18:35:58.409 INFO:tasks.workunit.client.0.smithi017.stdout:1/354: rename df/d16/d32 to df/d16/d50/d69 0 2024-09-20T18:35:58.410 INFO:tasks.workunit.client.0.smithi017.stdout:9/585: mkdir d6/d23/d40/db4/dba/dd7 0 2024-09-20T18:35:58.414 INFO:tasks.workunit.client.0.smithi017.stdout:9/586: write d6/f7 [1328985,44698] 0 2024-09-20T18:35:58.420 INFO:tasks.workunit.client.0.smithi017.stdout:9/587: dwrite d6/d23/d3a/f62 [0,4194304] 0 2024-09-20T18:35:58.421 INFO:tasks.workunit.client.0.smithi017.stdout:9/588: chown d6/d23/f7a 517 1 2024-09-20T18:35:58.426 INFO:tasks.workunit.client.0.smithi017.stdout:9/589: truncate d6/d23/d58/d3f/d2f/fa7 2656698 0 2024-09-20T18:35:58.430 INFO:tasks.workunit.client.0.smithi017.stdout:9/590: unlink d6/d23/d58/d3f/d2f/d5d/l79 0 2024-09-20T18:35:58.438 INFO:tasks.workunit.client.0.smithi017.stdout:1/355: write df/d1c/f25 [4779983,41872] 0 2024-09-20T18:35:58.438 INFO:tasks.workunit.client.0.smithi017.stdout:9/591: getdents d6/d42 0 2024-09-20T18:35:58.441 INFO:tasks.workunit.client.0.smithi017.stdout:1/356: rmdir df/d1c/d45 39 2024-09-20T18:35:58.443 INFO:tasks.workunit.client.0.smithi017.stdout:9/592: creat d6/d23/d58/d3f/d4d/d73/d93/fd8 x:0 0 0 2024-09-20T18:35:58.445 INFO:tasks.workunit.client.0.smithi017.stdout:9/593: write d6/d23/d58/d3f/d4d/d73/d7d/f85 [1001218,79294] 0 2024-09-20T18:35:58.448 INFO:tasks.workunit.client.0.smithi017.stdout:1/357: dwrite df/d16/d50/d69/f4c [0,4194304] 0 2024-09-20T18:35:58.450 INFO:tasks.workunit.client.0.smithi017.stdout:1/358: write df/d29/d2c/f3f [1306820,128050] 0 2024-09-20T18:35:58.451 INFO:tasks.workunit.client.0.smithi017.stdout:1/359: readlink l8 0 2024-09-20T18:35:58.452 INFO:tasks.workunit.client.0.smithi017.stdout:9/594: mkdir d6/d23/d58/d3f/d70/dd9 0 2024-09-20T18:35:58.453 INFO:tasks.workunit.client.0.smithi017.stdout:1/360: write df/d16/d50/d53/f67 [466010,44549] 0 2024-09-20T18:35:58.458 INFO:tasks.workunit.client.0.smithi017.stdout:9/595: mkdir d6/d23/d58/dda 0 2024-09-20T18:35:58.463 INFO:tasks.workunit.client.0.smithi017.stdout:1/361: mknod df/c6a 0 2024-09-20T18:35:58.471 INFO:tasks.workunit.client.0.smithi017.stdout:1/362: mkdir df/d35/d6b 0 2024-09-20T18:35:58.472 INFO:tasks.workunit.client.0.smithi017.stdout:9/596: rmdir d6/d23/d58/d3f/d70/dc8 0 2024-09-20T18:35:58.472 INFO:tasks.workunit.client.0.smithi017.stdout:1/363: dread df/d16/f2e [0,4194304] 0 2024-09-20T18:35:58.474 INFO:tasks.workunit.client.0.smithi017.stdout:6/353: sync 2024-09-20T18:35:58.474 INFO:tasks.workunit.client.0.smithi017.stdout:0/331: sync 2024-09-20T18:35:58.475 INFO:tasks.workunit.client.0.smithi017.stdout:0/332: chown d4/c2d 19422863 1 2024-09-20T18:35:58.477 INFO:tasks.workunit.client.0.smithi017.stdout:9/597: symlink d6/d23/d58/d3f/d70/db0/ldb 0 2024-09-20T18:35:58.480 INFO:tasks.workunit.client.0.smithi017.stdout:1/364: dread df/f36 [0,4194304] 0 2024-09-20T18:35:58.481 INFO:tasks.workunit.client.0.smithi017.stdout:0/333: creat d4/d20/f6f x:0 0 0 2024-09-20T18:35:58.481 INFO:tasks.workunit.client.0.smithi017.stdout:1/365: fdatasync df/f33 0 2024-09-20T18:35:58.487 INFO:tasks.workunit.client.0.smithi017.stdout:6/354: dwrite d4/df/d1f/d25/d3f/d5c/f6d [0,4194304] 0 2024-09-20T18:35:58.487 INFO:tasks.workunit.client.0.smithi017.stdout:9/598: dwrite d6/d23/d58/d3f/d4d/d73/d7d/f85 [0,4194304] 0 2024-09-20T18:35:58.489 INFO:tasks.workunit.client.0.smithi017.stdout:9/599: dread - d6/d23/d3a/fac zero size 2024-09-20T18:35:58.489 INFO:tasks.workunit.client.0.smithi017.stdout:6/355: chown d4/df/l1d 303749 1 2024-09-20T18:35:58.491 INFO:tasks.workunit.client.0.smithi017.stdout:6/356: read - d4/df/d4a/f6c zero size 2024-09-20T18:35:58.496 INFO:tasks.workunit.client.0.smithi017.stdout:1/366: mknod df/d1c/d45/c6c 0 2024-09-20T18:35:58.501 INFO:tasks.workunit.client.0.smithi017.stdout:0/334: creat d4/f70 x:0 0 0 2024-09-20T18:35:58.502 INFO:tasks.workunit.client.0.smithi017.stdout:9/600: dwrite d6/d23/d58/d3f/d44/f59 [4194304,4194304] 0 2024-09-20T18:35:58.508 INFO:tasks.workunit.client.0.smithi017.stdout:1/367: symlink df/d16/d50/d53/l6d 0 2024-09-20T18:35:58.508 INFO:tasks.workunit.client.0.smithi017.stdout:1/368: stat df/d29/d2c/f65 0 2024-09-20T18:35:58.510 INFO:tasks.workunit.client.0.smithi017.stdout:9/601: dwrite d6/d23/d3a/f5e [0,4194304] 0 2024-09-20T18:35:58.512 INFO:tasks.workunit.client.0.smithi017.stdout:9/602: dread - d6/d23/d58/d3f/d2f/d98/fa5 zero size 2024-09-20T18:35:58.516 INFO:tasks.workunit.client.0.smithi017.stdout:6/357: link d4/df/d4a/f5d d4/d37/d41/d43/f78 0 2024-09-20T18:35:58.518 INFO:tasks.workunit.client.0.smithi017.stdout:7/380: sync 2024-09-20T18:35:58.518 INFO:tasks.workunit.client.0.smithi017.stdout:8/339: sync 2024-09-20T18:35:58.518 INFO:tasks.workunit.client.0.smithi017.stdout:5/351: sync 2024-09-20T18:35:58.518 INFO:tasks.workunit.client.0.smithi017.stdout:2/545: sync 2024-09-20T18:35:58.518 INFO:tasks.workunit.client.0.smithi017.stdout:4/309: sync 2024-09-20T18:35:58.519 INFO:tasks.workunit.client.0.smithi017.stdout:3/577: sync 2024-09-20T18:35:58.521 INFO:tasks.workunit.client.0.smithi017.stdout:1/369: creat df/d1c/d45/f6e x:0 0 0 2024-09-20T18:35:58.521 INFO:tasks.workunit.client.0.smithi017.stdout:8/340: dread - d0/d6/f67 zero size 2024-09-20T18:35:58.521 INFO:tasks.workunit.client.0.smithi017.stdout:0/335: creat d4/d68/f71 x:0 0 0 2024-09-20T18:35:58.525 INFO:tasks.workunit.client.0.smithi017.stdout:5/352: fdatasync d0/d14/d18/d1b/f3d 0 2024-09-20T18:35:58.527 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:58 smithi017 ceph-mon[28058]: pgmap v33: 65 pgs: 65 active+clean; 2.6 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 67 MiB/s rd, 227 MiB/s wr, 411 op/s 2024-09-20T18:35:58.527 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:58 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:35:58.527 INFO:tasks.workunit.client.0.smithi017.stdout:9/603: creat d6/d23/d40/db4/dba/dd7/fdc x:0 0 0 2024-09-20T18:35:58.530 INFO:tasks.workunit.client.0.smithi017.stdout:4/310: write d4/d19/d37/f5a [332352,83136] 0 2024-09-20T18:35:58.537 INFO:tasks.workunit.client.0.smithi017.stdout:5/353: mkdir d0/d14/d18/d2a/d6f 0 2024-09-20T18:35:58.542 INFO:tasks.workunit.client.0.smithi017.stdout:2/546: dwrite d1/d1f/f3e [0,4194304] 0 2024-09-20T18:35:58.542 INFO:tasks.workunit.client.0.smithi017.stdout:9/604: mknod d6/d23/d40/db4/cdd 0 2024-09-20T18:35:58.546 INFO:tasks.workunit.client.0.smithi017.stdout:4/311: fsync d4/d19/d37/f57 0 2024-09-20T18:35:58.546 INFO:tasks.workunit.client.0.smithi017.stdout:0/336: dwrite d4/d20/f2e [0,4194304] 0 2024-09-20T18:35:58.549 INFO:tasks.workunit.client.0.smithi017.stdout:8/341: creat d0/d6/d28/d3d/f6c x:0 0 0 2024-09-20T18:35:58.553 INFO:tasks.workunit.client.0.smithi017.stdout:1/370: dwrite df/f51 [0,4194304] 0 2024-09-20T18:35:58.554 INFO:tasks.workunit.client.0.smithi017.stdout:7/381: truncate da/f49 3479832 0 2024-09-20T18:35:58.564 INFO:tasks.workunit.client.0.smithi017.stdout:6/358: dwrite d4/f12 [0,4194304] 0 2024-09-20T18:35:58.564 INFO:tasks.workunit.client.0.smithi017.stdout:9/605: creat d6/d23/d58/d3f/d2f/d5d/fde x:0 0 0 2024-09-20T18:35:58.566 INFO:tasks.workunit.client.0.smithi017.stdout:4/312: symlink d4/de/d1b/l61 0 2024-09-20T18:35:58.566 INFO:tasks.workunit.client.0.smithi017.stdout:2/547: mkdir d1/dc/d20/d2e/db5 0 2024-09-20T18:35:58.566 INFO:tasks.workunit.client.0.smithi017.stdout:5/354: symlink d0/d14/d18/d19/d4d/d6d/l70 0 2024-09-20T18:35:58.568 INFO:tasks.workunit.client.0.smithi017.stdout:1/371: chown df/d29/d2c/f3f 5294 1 2024-09-20T18:35:58.572 INFO:tasks.workunit.client.0.smithi017.stdout:0/337: rename d4/f6 to d4/db/d18/d55/f72 0 2024-09-20T18:35:58.572 INFO:tasks.workunit.client.0.smithi017.stdout:8/342: mknod d0/d6/d28/d3d/d4e/c6d 0 2024-09-20T18:35:58.578 INFO:tasks.workunit.client.0.smithi017.stdout:3/578: dwrite da/de/d13/d2f/d26/d31/d5a/d76/d19/f4c [0,4194304] 0 2024-09-20T18:35:58.579 INFO:tasks.workunit.client.0.smithi017.stdout:8/343: read - d0/d6/d28/f5a zero size 2024-09-20T18:35:58.580 INFO:tasks.workunit.client.0.smithi017.stdout:6/359: fdatasync d4/df/d4a/f6f 0 2024-09-20T18:35:58.587 INFO:tasks.workunit.client.0.smithi017.stdout:1/372: dread df/f5e [0,4194304] 0 2024-09-20T18:35:58.591 INFO:tasks.workunit.client.0.smithi017.stdout:2/548: dwrite d1/dc/d20/d2e/d30/f4b [0,4194304] 0 2024-09-20T18:35:58.593 INFO:tasks.workunit.client.0.smithi017.stdout:4/313: mkdir d4/d19/d62 0 2024-09-20T18:35:58.598 INFO:tasks.workunit.client.0.smithi017.stdout:9/606: mknod d6/d23/d58/d3f/d4d/d73/d7d/cdf 0 2024-09-20T18:35:58.600 INFO:tasks.workunit.client.0.smithi017.stdout:9/607: readlink d6/d23/d58/d3f/l46 0 2024-09-20T18:35:58.602 INFO:tasks.workunit.client.0.smithi017.stdout:3/579: symlink da/de/d13/d2f/d26/d31/d5a/d76/lb8 0 2024-09-20T18:35:58.602 INFO:tasks.workunit.client.0.smithi017.stdout:4/314: dwrite d4/d19/f1f [8388608,4194304] 0 2024-09-20T18:35:58.604 INFO:tasks.workunit.client.0.smithi017.stdout:0/338: creat d4/db/d1e/d24/d2f/d69/f73 x:0 0 0 2024-09-20T18:35:58.612 INFO:tasks.workunit.client.0.smithi017.stdout:0/339: chown d4/db/d1e/d24/d2f/d51/l5c 31 1 2024-09-20T18:35:58.613 INFO:tasks.workunit.client.0.smithi017.stdout:7/382: getdents da/d16/d1c 0 2024-09-20T18:35:58.614 INFO:tasks.workunit.client.0.smithi017.stdout:2/549: symlink d1/dc/d20/d2e/d30/d85/d3d/lb6 0 2024-09-20T18:35:58.619 INFO:tasks.workunit.client.0.smithi017.stdout:9/608: dwrite d6/d23/d58/d3f/d4d/d73/d93/fd5 [0,4194304] 0 2024-09-20T18:35:58.619 INFO:tasks.workunit.client.0.smithi017.stdout:5/355: rename d0/l11 to d0/d14/d18/l71 0 2024-09-20T18:35:58.620 INFO:tasks.workunit.client.0.smithi017.stdout:2/550: dread - d1/d67/d8f/fa4 zero size 2024-09-20T18:35:58.627 INFO:tasks.workunit.client.0.smithi017.stdout:1/373: creat df/d1c/f6f x:0 0 0 2024-09-20T18:35:58.628 INFO:tasks.workunit.client.0.smithi017.stdout:8/344: truncate d0/d6/d28/d3d/d4e/f51 1130171 0 2024-09-20T18:35:58.630 INFO:tasks.workunit.client.0.smithi017.stdout:7/383: read da/d16/d1b/f2c [282189,126679] 0 2024-09-20T18:35:58.632 INFO:tasks.workunit.client.0.smithi017.stdout:0/340: dwrite d4/db/f62 [0,4194304] 0 2024-09-20T18:35:58.633 INFO:tasks.workunit.client.0.smithi017.stdout:8/345: dread - d0/d6/d28/d3d/f60 zero size 2024-09-20T18:35:58.637 INFO:tasks.workunit.client.0.smithi017.stdout:6/360: dwrite d4/df/d1f/d25/f27 [0,4194304] 0 2024-09-20T18:35:58.645 INFO:tasks.workunit.client.0.smithi017.stdout:5/356: rename d0/d13 to d0/d14/d18/d2a/d39/d6c/d72 0 2024-09-20T18:35:58.645 INFO:tasks.workunit.client.0.smithi017.stdout:8/346: rename d0/d6/d28/d3b to d0/d6/d28/d3b/d6e 22 2024-09-20T18:35:58.647 INFO:tasks.workunit.client.0.smithi017.stdout:4/315: creat d4/d19/f63 x:0 0 0 2024-09-20T18:35:58.655 INFO:tasks.workunit.client.0.smithi017.stdout:2/551: truncate d1/dc/d20/d2e/d30/d85/d53/d6b/f95 292087 0 2024-09-20T18:35:58.659 INFO:tasks.workunit.client.0.smithi017.stdout:0/341: unlink d4/db/d1e/d24/f59 0 2024-09-20T18:35:58.661 INFO:tasks.workunit.client.0.smithi017.stdout:6/361: creat d4/df/d4a/d5f/f79 x:0 0 0 2024-09-20T18:35:58.663 INFO:tasks.workunit.client.0.smithi017.stdout:3/580: truncate da/de/d13/f67 2173491 0 2024-09-20T18:35:58.664 INFO:tasks.workunit.client.0.smithi017.stdout:7/384: dwrite da/f13 [0,4194304] 0 2024-09-20T18:35:58.666 INFO:tasks.workunit.client.0.smithi017.stdout:7/385: write da/f65 [97984,96419] 0 2024-09-20T18:35:58.669 INFO:tasks.workunit.client.0.smithi017.stdout:0/342: symlink d4/db/d18/d25/l74 0 2024-09-20T18:35:58.670 INFO:tasks.workunit.client.0.smithi017.stdout:0/343: chown d4/db/l10 68 1 2024-09-20T18:35:58.672 INFO:tasks.workunit.client.0.smithi017.stdout:6/362: mkdir d4/d37/d41/d7a 0 2024-09-20T18:35:58.679 INFO:tasks.workunit.client.0.smithi017.stdout:9/609: dwrite d6/d23/d58/d3f/d70/fb2 [0,4194304] 0 2024-09-20T18:35:58.679 INFO:tasks.workunit.client.0.smithi017.stdout:1/374: link df/d29/f56 df/d1c/f70 0 2024-09-20T18:35:58.682 INFO:tasks.workunit.client.0.smithi017.stdout:1/375: write df/d16/f58 [2624934,75656] 0 2024-09-20T18:35:58.689 INFO:tasks.workunit.client.0.smithi017.stdout:8/347: write d0/d6/d28/f68 [1263243,101331] 0 2024-09-20T18:35:58.689 INFO:tasks.workunit.client.0.smithi017.stdout:8/348: write d0/d6/d28/d3d/f60 [264456,23026] 0 2024-09-20T18:35:58.690 INFO:tasks.workunit.client.0.smithi017.stdout:7/386: creat da/d54/f71 x:0 0 0 2024-09-20T18:35:58.692 INFO:tasks.workunit.client.0.smithi017.stdout:7/387: stat da/d16/d1c/d40/d30/c36 0 2024-09-20T18:35:58.696 INFO:tasks.workunit.client.0.smithi017.stdout:4/316: rename d4/d19/f15 to d4/d19/f64 0 2024-09-20T18:35:58.697 INFO:tasks.workunit.client.0.smithi017.stdout:8/349: dread d0/f1e [0,4194304] 0 2024-09-20T18:35:58.707 INFO:tasks.workunit.client.0.smithi017.stdout:9/610: creat d6/d23/d3a/d61/fe0 x:0 0 0 2024-09-20T18:35:58.707 INFO:tasks.workunit.client.0.smithi017.stdout:1/376: mkdir df/d16/d50/d69/d71 0 2024-09-20T18:35:58.707 INFO:tasks.workunit.client.0.smithi017.stdout:1/377: read - df/f2b zero size 2024-09-20T18:35:58.710 INFO:tasks.workunit.client.0.smithi017.stdout:7/388: mknod da/d16/d1c/d40/d34/d3c/c72 0 2024-09-20T18:35:58.716 INFO:tasks.workunit.client.0.smithi017.stdout:0/344: dwrite d4/db/d18/d25/f31 [0,4194304] 0 2024-09-20T18:35:58.721 INFO:tasks.workunit.client.0.smithi017.stdout:9/611: symlink d6/d23/d58/d3f/d4d/le1 0 2024-09-20T18:35:58.722 INFO:tasks.workunit.client.0.smithi017.stdout:9/612: chown d6/d23/d58/d3f/fb9 0 1 2024-09-20T18:35:58.730 INFO:tasks.workunit.client.0.smithi017.stdout:2/552: getdents d1/df/d17 0 2024-09-20T18:35:58.731 INFO:tasks.workunit.client.0.smithi017.stdout:6/363: truncate d4/df/f16 442460 0 2024-09-20T18:35:58.733 INFO:tasks.workunit.client.0.smithi017.stdout:2/553: write d1/dc/d20/d2e/d30/d85/d46/f51 [2917622,13534] 0 2024-09-20T18:35:58.733 INFO:tasks.workunit.client.0.smithi017.stdout:7/389: rename da/d16/d1c/d40/d34/d3c/f64 to da/d16/d1c/d40/d30/d50/f73 0 2024-09-20T18:35:58.734 INFO:tasks.workunit.client.0.smithi017.stdout:7/390: chown da/c23 10 1 2024-09-20T18:35:58.735 INFO:tasks.workunit.client.0.smithi017.stdout:2/554: chown d1/dc/d20/d2e/d30/d85/d53/d6b/c89 830 1 2024-09-20T18:35:58.736 INFO:tasks.workunit.client.0.smithi017.stdout:7/391: dread - da/d16/d1c/d40/d30/d50/f73 zero size 2024-09-20T18:35:58.738 INFO:tasks.workunit.client.0.smithi017.stdout:8/350: mknod d0/d6/d28/c6f 0 2024-09-20T18:35:58.741 INFO:tasks.workunit.client.0.smithi017.stdout:0/345: symlink d4/db/d18/l75 0 2024-09-20T18:35:58.743 INFO:tasks.workunit.client.0.smithi017.stdout:9/613: mkdir d6/d23/d40/de2 0 2024-09-20T18:35:58.747 INFO:tasks.workunit.client.0.smithi017.stdout:1/378: dwrite df/f5e [0,4194304] 0 2024-09-20T18:35:58.748 INFO:tasks.workunit.client.0.smithi017.stdout:1/379: chown c6 6824072 1 2024-09-20T18:35:58.751 INFO:tasks.workunit.client.0.smithi017.stdout:9/614: dread d6/d11/f3e [0,4194304] 0 2024-09-20T18:35:58.752 INFO:tasks.workunit.client.0.smithi017.stdout:6/364: rmdir d4/df/d1f/d25 39 2024-09-20T18:35:58.758 INFO:tasks.workunit.client.0.smithi017.stdout:3/581: dread da/de/d13/f67 [0,4194304] 0 2024-09-20T18:35:58.760 INFO:tasks.workunit.client.0.smithi017.stdout:2/555: creat d1/dc/d20/d2e/d30/d85/d53/fb7 x:0 0 0 2024-09-20T18:35:58.761 INFO:tasks.workunit.client.0.smithi017.stdout:2/556: read - d1/dc/d20/fa5 zero size 2024-09-20T18:35:58.762 INFO:tasks.workunit.client.0.smithi017.stdout:2/557: chown d1/dc/d20/fa5 7719165 1 2024-09-20T18:35:58.763 INFO:tasks.workunit.client.0.smithi017.stdout:2/558: dread - d1/dc/d20/fa5 zero size 2024-09-20T18:35:58.764 INFO:tasks.workunit.client.0.smithi017.stdout:0/346: creat d4/db/d18/d25/d36/f76 x:0 0 0 2024-09-20T18:35:58.768 INFO:tasks.workunit.client.0.smithi017.stdout:1/380: rename df/d29/d2c/c46 to df/d16/d50/d69/d71/c72 0 2024-09-20T18:35:58.770 INFO:tasks.workunit.client.0.smithi017.stdout:1/381: write df/f33 [5738096,74064] 0 2024-09-20T18:35:58.770 INFO:tasks.workunit.client.0.smithi017.stdout:1/382: dread - df/d16/f63 zero size 2024-09-20T18:35:58.771 INFO:tasks.workunit.client.0.smithi017.stdout:1/383: chown df/c5f 1652755 1 2024-09-20T18:35:58.772 INFO:tasks.workunit.client.0.smithi017.stdout:6/365: stat d4/df/d4a/d5f/c3d 0 2024-09-20T18:35:58.775 INFO:tasks.workunit.client.0.smithi017.stdout:3/582: creat da/de/d13/fb9 x:0 0 0 2024-09-20T18:35:58.775 INFO:tasks.workunit.client.0.smithi017.stdout:3/583: dread - da/de/d13/fb9 zero size 2024-09-20T18:35:58.777 INFO:tasks.workunit.client.0.smithi017.stdout:7/392: mknod da/c74 0 2024-09-20T18:35:58.778 INFO:tasks.workunit.client.0.smithi017.stdout:4/317: getdents d4/de/d1b 0 2024-09-20T18:35:58.782 INFO:tasks.workunit.client.0.smithi017.stdout:8/351: dwrite d0/f14 [0,4194304] 0 2024-09-20T18:35:58.784 INFO:tasks.workunit.client.0.smithi017.stdout:0/347: mkdir d4/db/d1e/d24/d2f/d51/d52/d77 0 2024-09-20T18:35:58.791 INFO:tasks.workunit.client.0.smithi017.stdout:9/615: dwrite f4 [4194304,4194304] 0 2024-09-20T18:35:58.793 INFO:tasks.workunit.client.0.smithi017.stdout:3/584: rename da/de/d13/d2f/d26/d31/c47 to da/de/d13/d2f/d26/d31/d5a/d76/cba 0 2024-09-20T18:35:58.795 INFO:tasks.workunit.client.0.smithi017.stdout:3/585: read da/de/d13/d2f/f60 [895130,104595] 0 2024-09-20T18:35:58.796 INFO:tasks.workunit.client.0.smithi017.stdout:7/393: dread da/d16/d1c/d40/d34/d3c/f46 [0,4194304] 0 2024-09-20T18:35:58.799 INFO:tasks.workunit.client.0.smithi017.stdout:8/352: unlink d0/d6/f30 0 2024-09-20T18:35:58.799 INFO:tasks.workunit.client.0.smithi017.stdout:1/384: mkdir df/d35/d6b/d73 0 2024-09-20T18:35:58.806 INFO:tasks.workunit.client.0.smithi017.stdout:7/394: dwrite da/d16/d1c/f2e [0,4194304] 0 2024-09-20T18:35:58.808 INFO:tasks.workunit.client.0.smithi017.stdout:3/586: rmdir da/de/d13/d2f/d26 39 2024-09-20T18:35:58.811 INFO:tasks.workunit.client.0.smithi017.stdout:4/318: dread d4/f38 [0,4194304] 0 2024-09-20T18:35:58.813 INFO:tasks.workunit.client.0.smithi017.stdout:0/348: dread d4/db/d18/d55/f72 [0,4194304] 0 2024-09-20T18:35:58.815 INFO:tasks.workunit.client.0.smithi017.stdout:8/353: mknod d0/d6/d28/d3a/c70 0 2024-09-20T18:35:58.818 INFO:tasks.workunit.client.0.smithi017.stdout:8/354: rename d0/d6/d28/d3d/d4e to d0/d6/d28/d3d/d4e/d71 22 2024-09-20T18:35:58.818 INFO:tasks.workunit.client.0.smithi017.stdout:6/366: rmdir d4/d37/d41/d7a 0 2024-09-20T18:35:58.820 INFO:tasks.workunit.client.0.smithi017.stdout:2/559: dwrite d1/dc/d20/d2e/d30/f79 [0,4194304] 0 2024-09-20T18:35:58.828 INFO:tasks.workunit.client.0.smithi017.stdout:1/385: mknod df/d35/c74 0 2024-09-20T18:35:58.830 INFO:tasks.workunit.client.0.smithi017.stdout:9/616: creat d6/fe3 x:0 0 0 2024-09-20T18:35:58.833 INFO:tasks.workunit.client.0.smithi017.stdout:7/395: dwrite f4 [0,4194304] 0 2024-09-20T18:35:58.833 INFO:tasks.workunit.client.0.smithi017.stdout:4/319: read d4/dc/d1e/d26/d22/f21 [2430433,100226] 0 2024-09-20T18:35:58.834 INFO:tasks.workunit.client.0.smithi017.stdout:8/355: dwrite d0/d6/d28/d3d/f60 [0,4194304] 0 2024-09-20T18:35:58.836 INFO:tasks.workunit.client.0.smithi017.stdout:8/356: dread - d0/d6/f54 zero size 2024-09-20T18:35:58.838 INFO:tasks.workunit.client.0.smithi017.stdout:8/357: stat d0/d6/d28/f5a 0 2024-09-20T18:35:58.839 INFO:tasks.workunit.client.0.smithi017.stdout:8/358: fdatasync d0/d6/f3e 0 2024-09-20T18:35:58.843 INFO:tasks.workunit.client.0.smithi017.stdout:0/349: fsync d4/db/fc 0 2024-09-20T18:35:58.847 INFO:tasks.workunit.client.0.smithi017.stdout:6/367: creat d4/df/d1f/d25/d3f/d5c/f7b x:0 0 0 2024-09-20T18:35:58.847 INFO:tasks.workunit.client.0.smithi017.stdout:9/617: creat d6/d23/d58/d3f/d82/fe4 x:0 0 0 2024-09-20T18:35:58.849 INFO:tasks.workunit.client.0.smithi017.stdout:7/396: rename da/d16/d1b to da/d16/d1c/d40/d30/d50/d75 0 2024-09-20T18:35:58.849 INFO:tasks.workunit.client.0.smithi017.stdout:2/560: symlink d1/dc/d20/d2e/d30/d85/d3d/lb8 0 2024-09-20T18:35:58.850 INFO:tasks.workunit.client.0.smithi017.stdout:6/368: chown d4/df/l1d 1600735279 1 2024-09-20T18:35:58.851 INFO:tasks.workunit.client.0.smithi017.stdout:0/350: mkdir d4/db/d18/d78 0 2024-09-20T18:35:58.852 INFO:tasks.workunit.client.0.smithi017.stdout:2/561: fdatasync d1/dc/d20/d2e/f38 0 2024-09-20T18:35:58.854 INFO:tasks.workunit.client.0.smithi017.stdout:7/397: write da/d16/d1c/f1f [142853,89079] 0 2024-09-20T18:35:58.855 INFO:tasks.workunit.client.0.smithi017.stdout:8/359: dwrite d0/d6/f3e [4194304,4194304] 0 2024-09-20T18:35:58.857 INFO:tasks.workunit.client.0.smithi017.stdout:2/562: dread - d1/d67/d8f/fa4 zero size 2024-09-20T18:35:58.860 INFO:tasks.workunit.client.0.smithi017.stdout:1/386: link df/d16/f21 df/d1c/f75 0 2024-09-20T18:35:58.861 INFO:tasks.workunit.client.0.smithi017.stdout:0/351: write d4/db/fc [466761,71450] 0 2024-09-20T18:35:58.861 INFO:tasks.workunit.client.0.smithi017.stdout:1/387: fsync df/f24 0 2024-09-20T18:35:58.864 INFO:tasks.workunit.client.0.smithi017.stdout:0/352: write d4/db/d1e/d24/d2f/d51/d52/f56 [112113,37237] 0 2024-09-20T18:35:58.869 INFO:tasks.workunit.client.0.smithi017.stdout:7/398: creat da/d54/f76 x:0 0 0 2024-09-20T18:35:58.870 INFO:tasks.workunit.client.0.smithi017.stdout:8/360: mkdir d0/d6/d28/d3b/d72 0 2024-09-20T18:35:58.870 INFO:tasks.workunit.client.0.smithi017.stdout:8/361: fdatasync d0/f14 0 2024-09-20T18:35:58.877 INFO:tasks.workunit.client.0.smithi017.stdout:3/587: truncate da/de/d13/d2f/f2e 987112 0 2024-09-20T18:35:58.878 INFO:tasks.workunit.client.0.smithi017.stdout:4/320: dwrite d4/f4b [0,4194304] 0 2024-09-20T18:35:58.878 INFO:tasks.workunit.client.0.smithi017.stdout:9/618: creat d6/d23/d58/d3f/d4d/d73/fe5 x:0 0 0 2024-09-20T18:35:58.881 INFO:tasks.workunit.client.0.smithi017.stdout:9/619: write d6/d23/d58/d3f/fc6 [80713,29479] 0 2024-09-20T18:35:58.881 INFO:tasks.workunit.client.0.smithi017.stdout:0/353: creat d4/db/d18/f79 x:0 0 0 2024-09-20T18:35:58.883 INFO:tasks.workunit.client.0.smithi017.stdout:6/369: link d4/df/d4a/f50 d4/df/d1f/d25/f7c 0 2024-09-20T18:35:58.884 INFO:tasks.workunit.client.0.smithi017.stdout:2/563: dread d1/dc/d20/d2e/d30/d85/f7d [0,4194304] 0 2024-09-20T18:35:58.884 INFO:tasks.workunit.client.0.smithi017.stdout:9/620: truncate d6/d23/d3a/d61/f69 4731976 0 2024-09-20T18:35:58.885 INFO:tasks.workunit.client.0.smithi017.stdout:8/362: mkdir d0/d6/d73 0 2024-09-20T18:35:58.901 INFO:tasks.workunit.client.0.smithi017.stdout:2/564: mknod d1/dc/d20/d2e/cb9 0 2024-09-20T18:35:58.904 INFO:tasks.workunit.client.0.smithi017.stdout:8/363: creat d0/d6/f74 x:0 0 0 2024-09-20T18:35:58.905 INFO:tasks.workunit.client.0.smithi017.stdout:8/364: chown d0/c36 25645 1 2024-09-20T18:35:58.906 INFO:tasks.workunit.client.0.smithi017.stdout:1/388: link df/f26 df/d35/f76 0 2024-09-20T18:35:58.908 INFO:tasks.workunit.client.0.smithi017.stdout:3/588: mkdir da/de/d13/d2f/d26/d62/da5/da9/dbb 0 2024-09-20T18:35:58.909 INFO:tasks.workunit.client.0.smithi017.stdout:0/354: mknod d4/c7a 0 2024-09-20T18:35:58.912 INFO:tasks.workunit.client.0.smithi017.stdout:1/389: dwrite df/f5a [0,4194304] 0 2024-09-20T18:35:58.913 INFO:tasks.workunit.client.0.smithi017.stdout:7/399: rename da/d16/d1c/d40/d5d/f5f to da/f77 0 2024-09-20T18:35:58.914 INFO:tasks.workunit.client.0.smithi017.stdout:2/565: symlink d1/df/d17/lba 0 2024-09-20T18:35:58.915 INFO:tasks.workunit.client.0.smithi017.stdout:9/621: mkdir d6/d23/d58/d3f/d4d/d73/d7d/dbd/de6 0 2024-09-20T18:35:58.920 INFO:tasks.workunit.client.0.smithi017.stdout:4/321: write d4/dc/f12 [468380,723] 0 2024-09-20T18:35:58.922 INFO:tasks.workunit.client.0.smithi017.stdout:0/355: creat d4/db/d1e/d42/f7b x:0 0 0 2024-09-20T18:35:58.923 INFO:tasks.workunit.client.0.smithi017.stdout:2/566: dwrite d1/d1f/f3e [0,4194304] 0 2024-09-20T18:35:58.925 INFO:tasks.workunit.client.0.smithi017.stdout:4/322: write d4/de/d1b/f4c [1652448,19334] 0 2024-09-20T18:35:58.926 INFO:tasks.workunit.client.0.smithi017.stdout:9/622: dwrite d6/d23/f71 [0,4194304] 0 2024-09-20T18:35:58.926 INFO:tasks.workunit.client.0.smithi017.stdout:6/370: rename d4/df/d4a/d5f to d4/d37/d41/d43/d7d 0 2024-09-20T18:35:58.928 INFO:tasks.workunit.client.0.smithi017.stdout:2/567: write d1/dc/d20/d2e/d30/d85/f93 [365893,58338] 0 2024-09-20T18:35:58.931 INFO:tasks.workunit.client.0.smithi017.stdout:9/623: dread - d6/d23/d58/d3f/d2f/d5d/fde zero size 2024-09-20T18:35:58.931 INFO:tasks.workunit.client.0.smithi017.stdout:9/624: write d6/d23/d3a/d61/f78 [3045852,48575] 0 2024-09-20T18:35:58.932 INFO:tasks.workunit.client.0.smithi017.stdout:8/365: link d0/f2 d0/d6/d28/d3d/d4e/f75 0 2024-09-20T18:35:58.942 INFO:tasks.workunit.client.0.smithi017.stdout:1/390: symlink df/l77 0 2024-09-20T18:35:58.946 INFO:tasks.workunit.client.0.smithi017.stdout:4/323: readlink d4/l28 0 2024-09-20T18:35:58.947 INFO:tasks.workunit.client.0.smithi017.stdout:6/371: write d4/f10 [416356,111992] 0 2024-09-20T18:35:58.950 INFO:tasks.workunit.client.0.smithi017.stdout:7/400: rename da/d16/d1c/d40/d34/d3c/f46 to da/d16/d1c/d40/d30/f78 0 2024-09-20T18:35:58.951 INFO:tasks.workunit.client.0.smithi017.stdout:7/401: readlink da/l19 0 2024-09-20T18:35:58.953 INFO:tasks.workunit.client.0.smithi017.stdout:2/568: chown d1/d67/d8f/d9e/ca0 1343 1 2024-09-20T18:35:58.956 INFO:tasks.workunit.client.0.smithi017.stdout:3/589: creat da/fbc x:0 0 0 2024-09-20T18:35:58.957 INFO:tasks.workunit.client.0.smithi017.stdout:1/391: fsync df/f26 0 2024-09-20T18:35:58.958 INFO:tasks.workunit.client.0.smithi017.stdout:1/392: dread - df/d29/f61 zero size 2024-09-20T18:35:58.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:58 smithi172 ceph-mon[35456]: pgmap v33: 65 pgs: 65 active+clean; 2.6 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 67 MiB/s rd, 227 MiB/s wr, 411 op/s 2024-09-20T18:35:58.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:58 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:35:58.960 INFO:tasks.workunit.client.0.smithi017.stdout:4/324: mkdir d4/de/d65 0 2024-09-20T18:35:58.961 INFO:tasks.workunit.client.0.smithi017.stdout:9/625: rename d6/d23/d58/d3f/d2f/d5d to d6/d23/d3a/d61/de7 0 2024-09-20T18:35:58.962 INFO:tasks.workunit.client.0.smithi017.stdout:9/626: fdatasync d6/d23/d3a/d61/de7/faf 0 2024-09-20T18:35:58.963 INFO:tasks.workunit.client.0.smithi017.stdout:8/366: symlink d0/d6/d73/l76 0 2024-09-20T18:35:58.965 INFO:tasks.workunit.client.0.smithi017.stdout:3/590: creat da/de/d13/d2f/d26/d31/d5a/fbd x:0 0 0 2024-09-20T18:35:58.966 INFO:tasks.workunit.client.0.smithi017.stdout:8/367: chown d0/f14 215 1 2024-09-20T18:35:58.966 INFO:tasks.workunit.client.0.smithi017.stdout:1/393: mknod df/d16/d50/d69/d71/c78 0 2024-09-20T18:35:58.966 INFO:tasks.workunit.client.0.smithi017.stdout:5/357: sync 2024-09-20T18:35:58.968 INFO:tasks.workunit.client.0.smithi017.stdout:9/627: dread d6/d11/f17 [0,4194304] 0 2024-09-20T18:35:58.968 INFO:tasks.workunit.client.0.smithi017.stdout:4/325: mkdir d4/d19/d37/d66 0 2024-09-20T18:35:58.969 INFO:tasks.workunit.client.0.smithi017.stdout:5/358: stat d0/d14/d40/f6a 0 2024-09-20T18:35:58.970 INFO:tasks.workunit.client.0.smithi017.stdout:6/372: rename d4/df/d1f/d25/d3f/f52 to d4/df/d1f/d25/d3f/d5c/f7e 0 2024-09-20T18:35:58.974 INFO:tasks.workunit.client.0.smithi017.stdout:0/356: dwrite d4/f11 [0,4194304] 0 2024-09-20T18:35:58.981 INFO:tasks.workunit.client.0.smithi017.stdout:8/368: dwrite d0/d6/f3e [0,4194304] 0 2024-09-20T18:35:58.985 INFO:tasks.workunit.client.0.smithi017.stdout:6/373: dwrite d4/df/d4a/f6f [4194304,4194304] 0 2024-09-20T18:35:58.988 INFO:tasks.workunit.client.0.smithi017.stdout:3/591: dread da/f15 [0,4194304] 0 2024-09-20T18:35:58.992 INFO:tasks.workunit.client.0.smithi017.stdout:7/402: creat da/d16/d1c/d40/f79 x:0 0 0 2024-09-20T18:35:58.997 INFO:tasks.workunit.client.0.smithi017.stdout:0/357: creat d4/db/d18/d25/f7c x:0 0 0 2024-09-20T18:35:59.000 INFO:tasks.workunit.client.0.smithi017.stdout:1/394: mkdir df/d1c/d79 0 2024-09-20T18:35:59.003 INFO:tasks.workunit.client.0.smithi017.stdout:5/359: write d0/ff [1190394,24863] 0 2024-09-20T18:35:59.004 INFO:tasks.workunit.client.0.smithi017.stdout:4/326: mkdir d4/de/d1b/d56/d67 0 2024-09-20T18:35:59.005 INFO:tasks.workunit.client.0.smithi017.stdout:6/374: truncate d4/df/d1f/f22 169979 0 2024-09-20T18:35:59.008 INFO:tasks.workunit.client.0.smithi017.stdout:1/395: dwrite f2 [0,4194304] 0 2024-09-20T18:35:59.008 INFO:tasks.workunit.client.0.smithi017.stdout:0/358: creat d4/db/d18/d25/f7d x:0 0 0 2024-09-20T18:35:59.009 INFO:tasks.workunit.client.0.smithi017.stdout:1/396: truncate df/f5d 440348 0 2024-09-20T18:35:59.011 INFO:tasks.workunit.client.0.smithi017.stdout:8/369: mknod d0/d65/c77 0 2024-09-20T18:35:59.012 INFO:tasks.workunit.client.0.smithi017.stdout:5/360: symlink d0/d14/d18/d2a/l73 0 2024-09-20T18:35:59.013 INFO:tasks.workunit.client.0.smithi017.stdout:4/327: mknod d4/d19/d37/c68 0 2024-09-20T18:35:59.015 INFO:tasks.workunit.client.0.smithi017.stdout:6/375: symlink d4/df/d1f/d70/l7f 0 2024-09-20T18:35:59.016 INFO:tasks.workunit.client.0.smithi017.stdout:6/376: stat d4/df/d4a/f66 0 2024-09-20T18:35:59.021 INFO:tasks.workunit.client.0.smithi017.stdout:0/359: creat d4/db/d18/d25/d36/d47/f7e x:0 0 0 2024-09-20T18:35:59.024 INFO:tasks.workunit.client.0.smithi017.stdout:4/328: mkdir d4/dc/d1e/d69 0 2024-09-20T18:35:59.027 INFO:tasks.workunit.client.0.smithi017.stdout:7/403: rename da/d16/d1c/d40/d30/f59 to da/d16/d1c/d40/f7a 0 2024-09-20T18:35:59.030 INFO:tasks.workunit.client.0.smithi017.stdout:3/592: dread da/de/d13/d2f/d26/d31/d5a/d76/d19/f1c [0,4194304] 0 2024-09-20T18:35:59.032 INFO:tasks.workunit.client.0.smithi017.stdout:6/377: unlink d4/df/d4a/l74 0 2024-09-20T18:35:59.033 INFO:tasks.workunit.client.0.smithi017.stdout:6/378: read - d4/df/d1f/d25/d3f/d5c/f7b zero size 2024-09-20T18:35:59.033 INFO:tasks.workunit.client.0.smithi017.stdout:1/397: symlink df/d1c/l7a 0 2024-09-20T18:35:59.036 INFO:tasks.workunit.client.0.smithi017.stdout:8/370: symlink d0/d6/d28/d3d/l78 0 2024-09-20T18:35:59.036 INFO:tasks.workunit.client.0.smithi017.stdout:8/371: fsync d0/f22 0 2024-09-20T18:35:59.037 INFO:tasks.workunit.client.0.smithi017.stdout:8/372: dread - d0/f5f zero size 2024-09-20T18:35:59.041 INFO:tasks.workunit.client.0.smithi017.stdout:0/360: rename d4/d20/f50 to d4/db/d18/d25/f7f 0 2024-09-20T18:35:59.042 INFO:tasks.workunit.client.0.smithi017.stdout:9/628: link d6/d23/d58/d3f/d70/db0/cd4 d6/d23/d58/d3f/ce8 0 2024-09-20T18:35:59.044 INFO:tasks.workunit.client.0.smithi017.stdout:3/593: symlink da/de/d13/d2f/d26/d31/lbe 0 2024-09-20T18:35:59.045 INFO:tasks.workunit.client.0.smithi017.stdout:9/629: chown d6/d23/d58/d3f/d2f/l74 212249 1 2024-09-20T18:35:59.048 INFO:tasks.workunit.client.0.smithi017.stdout:5/361: dwrite d0/d14/d40/f63 [0,4194304] 0 2024-09-20T18:35:59.049 INFO:tasks.workunit.client.0.smithi017.stdout:1/398: dread df/d1c/f70 [0,4194304] 0 2024-09-20T18:35:59.051 INFO:tasks.workunit.client.0.smithi017.stdout:0/361: dread d4/db/fc [0,4194304] 0 2024-09-20T18:35:59.061 INFO:tasks.workunit.client.0.smithi017.stdout:7/404: rename da/d16/f68 to da/d16/d1c/d40/d3a/f7b 0 2024-09-20T18:35:59.066 INFO:tasks.workunit.client.0.smithi017.stdout:3/594: mknod da/de/d53/d88/cbf 0 2024-09-20T18:35:59.070 INFO:tasks.workunit.client.0.smithi017.stdout:8/373: write d0/d6/d28/f4f [440968,124768] 0 2024-09-20T18:35:59.070 INFO:tasks.workunit.client.0.smithi017.stdout:4/329: truncate d4/d19/d37/f5a 279340 0 2024-09-20T18:35:59.072 INFO:tasks.workunit.client.0.smithi017.stdout:1/399: symlink df/d29/d2c/l7b 0 2024-09-20T18:35:59.072 INFO:tasks.workunit.client.0.smithi017.stdout:3/595: dread da/de/d13/d2f/d26/d31/f45 [0,4194304] 0 2024-09-20T18:35:59.075 INFO:tasks.workunit.client.0.smithi017.stdout:0/362: stat d4/f17 0 2024-09-20T18:35:59.076 INFO:tasks.workunit.client.0.smithi017.stdout:3/596: truncate da/de/d13/d2f/d26/d31/f9a 762317 0 2024-09-20T18:35:59.080 INFO:tasks.workunit.client.0.smithi017.stdout:7/405: rename da/d54/f58 to da/d16/d1c/d40/d30/f7c 0 2024-09-20T18:35:59.081 INFO:tasks.workunit.client.0.smithi017.stdout:6/379: creat d4/df/d1f/f80 x:0 0 0 2024-09-20T18:35:59.083 INFO:tasks.workunit.client.0.smithi017.stdout:6/380: fsync d4/df/d1f/d25/f27 0 2024-09-20T18:35:59.083 INFO:tasks.workunit.client.0.smithi017.stdout:9/630: mknod d6/d23/d58/d3f/ce9 0 2024-09-20T18:35:59.083 INFO:tasks.workunit.client.0.smithi017.stdout:4/330: dread d4/de/d1b/f45 [0,4194304] 0 2024-09-20T18:35:59.084 INFO:tasks.workunit.client.0.smithi017.stdout:8/374: mkdir d0/d65/d79 0 2024-09-20T18:35:59.088 INFO:tasks.workunit.client.0.smithi017.stdout:1/400: mkdir df/d3b/d7c 0 2024-09-20T18:35:59.090 INFO:tasks.workunit.client.0.smithi017.stdout:5/362: link d0/d14/d18/d2a/d39/f61 d0/d14/d18/d2a/d39/d6c/d72/f74 0 2024-09-20T18:35:59.094 INFO:tasks.workunit.client.0.smithi017.stdout:0/363: rename d4/db/fe to d4/db/d1e/d24/d2f/f80 0 2024-09-20T18:35:59.095 INFO:tasks.workunit.client.0.smithi017.stdout:9/631: dread d6/d23/d40/db4/dba/f65 [0,4194304] 0 2024-09-20T18:35:59.095 INFO:tasks.workunit.client.0.smithi017.stdout:0/364: dread - d4/db/d18/d25/f7c zero size 2024-09-20T18:35:59.097 INFO:tasks.workunit.client.0.smithi017.stdout:0/365: truncate d4/d20/f6f 464521 0 2024-09-20T18:35:59.098 INFO:tasks.workunit.client.0.smithi017.stdout:0/366: write d4/db/d1e/f35 [977088,122309] 0 2024-09-20T18:35:59.105 INFO:tasks.workunit.client.0.smithi017.stdout:4/331: creat d4/dc/d1e/d26/f6a x:0 0 0 2024-09-20T18:35:59.105 INFO:tasks.workunit.client.0.smithi017.stdout:6/381: dread d4/f21 [0,4194304] 0 2024-09-20T18:35:59.111 INFO:tasks.workunit.client.0.smithi017.stdout:1/401: rmdir df/d3b 39 2024-09-20T18:35:59.112 INFO:tasks.workunit.client.0.smithi017.stdout:6/382: dwrite d4/d37/d41/f54 [0,4194304] 0 2024-09-20T18:35:59.112 INFO:tasks.workunit.client.0.smithi017.stdout:1/402: chown f2 1388907 1 2024-09-20T18:35:59.114 INFO:tasks.workunit.client.0.smithi017.stdout:5/363: write d0/d14/d18/f3b [1368361,119504] 0 2024-09-20T18:35:59.117 INFO:tasks.workunit.client.0.smithi017.stdout:3/597: mkdir da/de/d13/d2f/d26/d62/da5/da9/dbb/dc0 0 2024-09-20T18:35:59.121 INFO:tasks.workunit.client.0.smithi017.stdout:0/367: fsync d4/db/d18/f22 0 2024-09-20T18:35:59.125 INFO:tasks.workunit.client.0.smithi017.stdout:5/364: dread d0/d14/d18/d2a/d39/f53 [0,4194304] 0 2024-09-20T18:35:59.125 INFO:tasks.workunit.client.0.smithi017.stdout:8/375: fdatasync d0/d6/f23 0 2024-09-20T18:35:59.126 INFO:tasks.workunit.client.0.smithi017.stdout:4/332: creat d4/dc/d1e/d26/d4e/f6b x:0 0 0 2024-09-20T18:35:59.128 INFO:tasks.workunit.client.0.smithi017.stdout:1/403: stat df/d1c/f75 0 2024-09-20T18:35:59.129 INFO:tasks.workunit.client.0.smithi017.stdout:1/404: readlink df/d16/d50/l52 0 2024-09-20T18:35:59.130 INFO:tasks.workunit.client.0.smithi017.stdout:1/405: dread df/f5d [0,4194304] 0 2024-09-20T18:35:59.132 INFO:tasks.workunit.client.0.smithi017.stdout:3/598: fsync da/de/d13/d2f/d26/d62/f8a 0 2024-09-20T18:35:59.134 INFO:tasks.workunit.client.0.smithi017.stdout:7/406: creat da/d16/d1c/d40/f7d x:0 0 0 2024-09-20T18:35:59.135 INFO:tasks.workunit.client.0.smithi017.stdout:3/599: write da/de/d13/d2f/d26/d31/d5a/d76/d19/f9c [444170,87656] 0 2024-09-20T18:35:59.135 INFO:tasks.workunit.client.0.smithi017.stdout:0/368: mkdir d4/db/d18/d25/d36/d47/d81 0 2024-09-20T18:35:59.136 INFO:tasks.workunit.client.0.smithi017.stdout:0/369: write d4/d20/f6c [611732,72545] 0 2024-09-20T18:35:59.137 INFO:tasks.workunit.client.0.smithi017.stdout:5/365: unlink d0/d14/d18/d2a/d39/l3f 0 2024-09-20T18:35:59.137 INFO:tasks.workunit.client.0.smithi017.stdout:0/370: readlink d4/db/l1f 0 2024-09-20T18:35:59.139 INFO:tasks.workunit.client.0.smithi017.stdout:0/371: stat d4/db/d1e/d24/d2f/d51/d52/d77 0 2024-09-20T18:35:59.140 INFO:tasks.workunit.client.0.smithi017.stdout:8/376: symlink d0/d6/d28/d3d/d4e/l7a 0 2024-09-20T18:35:59.140 INFO:tasks.workunit.client.0.smithi017.stdout:0/372: fdatasync d4/db/d1e/d42/f67 0 2024-09-20T18:35:59.141 INFO:tasks.workunit.client.0.smithi017.stdout:6/383: creat d4/d29/f81 x:0 0 0 2024-09-20T18:35:59.142 INFO:tasks.workunit.client.0.smithi017.stdout:6/384: dread - d4/d37/d41/d43/d7d/f79 zero size 2024-09-20T18:35:59.143 INFO:tasks.workunit.client.0.smithi017.stdout:1/406: write df/f18 [6214353,108491] 0 2024-09-20T18:35:59.144 INFO:tasks.workunit.client.0.smithi017.stdout:1/407: write df/d16/d50/d53/f67 [639800,72918] 0 2024-09-20T18:35:59.147 INFO:tasks.workunit.client.0.smithi017.stdout:7/407: unlink da/d16/d1c/d40/f79 0 2024-09-20T18:35:59.148 INFO:tasks.workunit.client.0.smithi017.stdout:3/600: mkdir da/de/d13/d16/d6e/d97/dc1 0 2024-09-20T18:35:59.154 INFO:tasks.workunit.client.0.smithi017.stdout:8/377: symlink d0/d6/d73/l7b 0 2024-09-20T18:35:59.157 INFO:tasks.workunit.client.0.smithi017.stdout:0/373: write d4/db/d18/d25/f7f [546731,17626] 0 2024-09-20T18:35:59.157 INFO:tasks.workunit.client.0.smithi017.stdout:9/632: truncate d6/d23/d3a/d61/fb3 699900 0 2024-09-20T18:35:59.158 INFO:tasks.workunit.client.0.smithi017.stdout:0/374: readlink d4/db/d18/d25/l74 0 2024-09-20T18:35:59.158 INFO:tasks.workunit.client.0.smithi017.stdout:6/385: unlink d4/df/d4a/f66 0 2024-09-20T18:35:59.158 INFO:tasks.workunit.client.0.smithi017.stdout:0/375: chown d4/db/d1e 32069 1 2024-09-20T18:35:59.162 INFO:tasks.workunit.client.0.smithi017.stdout:1/408: symlink df/d29/d2c/l7d 0 2024-09-20T18:35:59.163 INFO:tasks.workunit.client.0.smithi017.stdout:1/409: chown df/d16/d50/d69/f4c 5314752 1 2024-09-20T18:35:59.163 INFO:tasks.workunit.client.0.smithi017.stdout:7/408: write da/d16/d1c/d40/d30/f7c [4029172,127229] 0 2024-09-20T18:35:59.164 INFO:tasks.workunit.client.0.smithi017.stdout:1/410: write df/d29/f61 [534391,36341] 0 2024-09-20T18:35:59.165 INFO:tasks.workunit.client.0.smithi017.stdout:3/601: creat da/de/d13/d16/d6e/d97/fc2 x:0 0 0 2024-09-20T18:35:59.167 INFO:tasks.workunit.client.0.smithi017.stdout:4/333: creat d4/f6c x:0 0 0 2024-09-20T18:35:59.171 INFO:tasks.workunit.client.0.smithi017.stdout:8/378: readlink d0/l24 0 2024-09-20T18:35:59.174 INFO:tasks.workunit.client.0.smithi017.stdout:9/633: symlink d6/d23/d3a/d61/lea 0 2024-09-20T18:35:59.175 INFO:tasks.workunit.client.0.smithi017.stdout:0/376: creat d4/db/d18/d25/d36/f82 x:0 0 0 2024-09-20T18:35:59.178 INFO:tasks.workunit.client.0.smithi017.stdout:7/409: dread da/d16/d1c/f1d [0,4194304] 0 2024-09-20T18:35:59.180 INFO:tasks.workunit.client.0.smithi017.stdout:5/366: link d0/d14/d18/d2a/l73 d0/d14/d18/d2a/d39/d6c/l75 0 2024-09-20T18:35:59.182 INFO:tasks.workunit.client.0.smithi017.stdout:8/379: unlink d0/d6/d28/d3d/f6c 0 2024-09-20T18:35:59.184 INFO:tasks.workunit.client.0.smithi017.stdout:6/386: creat d4/df/d1f/d70/d72/f82 x:0 0 0 2024-09-20T18:35:59.184 INFO:tasks.workunit.client.0.smithi017.stdout:9/634: fsync d6/d11/f17 0 2024-09-20T18:35:59.185 INFO:tasks.workunit.client.0.smithi017.stdout:4/334: dwrite d4/f4b [0,4194304] 0 2024-09-20T18:35:59.185 INFO:tasks.workunit.client.0.smithi017.stdout:1/411: mkdir df/d29/d7e 0 2024-09-20T18:35:59.187 INFO:tasks.workunit.client.0.smithi017.stdout:4/335: dread - d4/f6c zero size 2024-09-20T18:35:59.187 INFO:tasks.workunit.client.0.smithi017.stdout:1/412: chown df/d1c/c39 1863570 1 2024-09-20T18:35:59.193 INFO:tasks.workunit.client.0.smithi017.stdout:5/367: creat d0/d14/d18/d1b/f76 x:0 0 0 2024-09-20T18:35:59.194 INFO:tasks.workunit.client.0.smithi017.stdout:8/380: rename d0/d65/d79 to d0/d6/d28/d3d/d4e/d55/d7c 0 2024-09-20T18:35:59.197 INFO:tasks.workunit.client.0.smithi017.stdout:0/377: symlink d4/l83 0 2024-09-20T18:35:59.197 INFO:tasks.workunit.client.0.smithi017.stdout:9/635: dwrite d6/d23/d58/d3f/d4d/d73/d7d/f85 [0,4194304] 0 2024-09-20T18:35:59.199 INFO:tasks.workunit.client.0.smithi017.stdout:6/387: symlink d4/df/d1f/d25/l83 0 2024-09-20T18:35:59.201 INFO:tasks.workunit.client.0.smithi017.stdout:0/378: dread - d4/db/d18/d25/f7c zero size 2024-09-20T18:35:59.201 INFO:tasks.workunit.client.0.smithi017.stdout:3/602: creat da/fc3 x:0 0 0 2024-09-20T18:35:59.202 INFO:tasks.workunit.client.0.smithi017.stdout:9/636: read d6/d23/d3a/d61/de7/f56 [3533724,60313] 0 2024-09-20T18:35:59.205 INFO:tasks.workunit.client.0.smithi017.stdout:0/379: chown d4/db/d1e/d24/f4b 32103038 1 2024-09-20T18:35:59.206 INFO:tasks.workunit.client.0.smithi017.stdout:7/410: fsync da/d16/d1c/d40/f7a 0 2024-09-20T18:35:59.206 INFO:tasks.workunit.client.0.smithi017.stdout:3/603: read - da/de/d13/d2f/d26/d31/d5a/d76/f9d zero size 2024-09-20T18:35:59.207 INFO:tasks.workunit.client.0.smithi017.stdout:8/381: dread d0/d6/f23 [0,4194304] 0 2024-09-20T18:35:59.211 INFO:tasks.workunit.client.0.smithi017.stdout:5/368: creat d0/d14/d18/d2a/d39/d6c/d72/d55/f77 x:0 0 0 2024-09-20T18:35:59.211 INFO:tasks.workunit.client.0.smithi017.stdout:8/382: chown d0/d6/c32 24203 1 2024-09-20T18:35:59.213 INFO:tasks.workunit.client.0.smithi017.stdout:6/388: dread d4/df/d1f/d25/d3f/d5c/f6d [0,4194304] 0 2024-09-20T18:35:59.215 INFO:tasks.workunit.client.0.smithi017.stdout:6/389: rename d4/df to d4/df/d1f/d25/d84 22 2024-09-20T18:35:59.217 INFO:tasks.workunit.client.0.smithi017.stdout:0/380: dwrite d4/d20/f2e [0,4194304] 0 2024-09-20T18:35:59.218 INFO:tasks.workunit.client.0.smithi017.stdout:0/381: chown d4/db/d18/d25 31234072 1 2024-09-20T18:35:59.219 INFO:tasks.workunit.client.0.smithi017.stdout:0/382: stat d4/db/d18/d25 0 2024-09-20T18:35:59.222 INFO:tasks.workunit.client.0.smithi017.stdout:9/637: symlink d6/d23/d58/d3f/d4d/d73/d93/leb 0 2024-09-20T18:35:59.225 INFO:tasks.workunit.client.0.smithi017.stdout:3/604: creat da/de/d13/fc4 x:0 0 0 2024-09-20T18:35:59.226 INFO:tasks.workunit.client.0.smithi017.stdout:3/605: readlink da/de/d53/d52/l94 0 2024-09-20T18:35:59.226 INFO:tasks.workunit.client.0.smithi017.stdout:7/411: mknod da/d16/d1c/d40/d3a/c7e 0 2024-09-20T18:35:59.231 INFO:tasks.workunit.client.0.smithi017.stdout:4/336: symlink d4/dc/l6d 0 2024-09-20T18:35:59.234 INFO:tasks.workunit.client.0.smithi017.stdout:5/369: rename d0/d14/d18/d2a/d39/d6c/d72/d55 to d0/d14/d18/d19/d4d/d6d/d78 0 2024-09-20T18:35:59.237 INFO:tasks.workunit.client.0.smithi017.stdout:6/390: creat d4/df/d1f/d25/d3f/d5c/f85 x:0 0 0 2024-09-20T18:35:59.239 INFO:tasks.workunit.client.0.smithi017.stdout:1/413: link df/d1c/c23 df/d16/d50/d69/d71/c7f 0 2024-09-20T18:35:59.239 INFO:tasks.workunit.client.0.smithi017.stdout:6/391: truncate d4/df/d1f/d25/d3f/d5c/f61 997591 0 2024-09-20T18:35:59.243 INFO:tasks.workunit.client.0.smithi017.stdout:0/383: creat d4/db/d1e/d42/f84 x:0 0 0 2024-09-20T18:35:59.245 INFO:tasks.workunit.client.0.smithi017.stdout:0/384: chown d4/db/d1e/d24/d2f/f6b 3021 1 2024-09-20T18:35:59.246 INFO:tasks.workunit.client.0.smithi017.stdout:6/392: dwrite d4/df/d1f/f80 [0,4194304] 0 2024-09-20T18:35:59.247 INFO:tasks.workunit.client.0.smithi017.stdout:0/385: readlink d4/db/d18/d25/d36/d47/l3d 0 2024-09-20T18:35:59.250 INFO:tasks.workunit.client.0.smithi017.stdout:7/412: unlink da/d16/d1c/f2e 0 2024-09-20T18:35:59.252 INFO:tasks.workunit.client.0.smithi017.stdout:3/606: creat da/de/d13/d2f/d26/d62/da5/da9/fc5 x:0 0 0 2024-09-20T18:35:59.254 INFO:tasks.workunit.client.0.smithi017.stdout:8/383: dwrite d0/d6/f67 [0,4194304] 0 2024-09-20T18:35:59.256 INFO:tasks.workunit.client.0.smithi017.stdout:4/337: chown d4/de/d1b/l3d 48077 1 2024-09-20T18:35:59.260 INFO:tasks.workunit.client.0.smithi017.stdout:5/370: write d0/d14/d18/f2f [3252829,908] 0 2024-09-20T18:35:59.261 INFO:tasks.workunit.client.0.smithi017.stdout:6/393: mknod d4/d37/d41/c86 0 2024-09-20T18:35:59.262 INFO:tasks.workunit.client.0.smithi017.stdout:4/338: dread - d4/f5b zero size 2024-09-20T18:35:59.264 INFO:tasks.workunit.client.0.smithi017.stdout:0/386: rmdir d4/db/d1e/d24/d2f/d51 39 2024-09-20T18:35:59.267 INFO:tasks.workunit.client.0.smithi017.stdout:7/413: dwrite da/d16/f67 [0,4194304] 0 2024-09-20T18:35:59.267 INFO:tasks.workunit.client.0.smithi017.stdout:5/371: stat d0/d14/d18/d19/d4d/d6d/d78 0 2024-09-20T18:35:59.268 INFO:tasks.workunit.client.0.smithi017.stdout:4/339: write d4/f4b [632584,94027] 0 2024-09-20T18:35:59.273 INFO:tasks.workunit.client.0.smithi017.stdout:0/387: read d4/db/f3b [217322,30788] 0 2024-09-20T18:35:59.273 INFO:tasks.workunit.client.0.smithi017.stdout:1/414: dwrite df/d1c/f70 [0,4194304] 0 2024-09-20T18:35:59.275 INFO:tasks.workunit.client.0.smithi017.stdout:0/388: fsync d4/d20/f2e 0 2024-09-20T18:35:59.280 INFO:tasks.workunit.client.0.smithi017.stdout:6/394: dwrite d4/df/d4a/f6f [4194304,4194304] 0 2024-09-20T18:35:59.280 INFO:tasks.workunit.client.0.smithi017.stdout:0/389: truncate d4/db/f5b 1347916 0 2024-09-20T18:35:59.281 INFO:tasks.workunit.client.0.smithi017.stdout:9/638: creat d6/fec x:0 0 0 2024-09-20T18:35:59.293 INFO:tasks.workunit.client.0.smithi017.stdout:5/372: readlink d0/d14/l56 0 2024-09-20T18:35:59.301 INFO:tasks.workunit.client.0.smithi017.stdout:0/390: creat d4/d68/f85 x:0 0 0 2024-09-20T18:35:59.304 INFO:tasks.workunit.client.0.smithi017.stdout:6/395: mkdir d4/d37/d41/d43/d7d/d87 0 2024-09-20T18:35:59.304 INFO:tasks.workunit.client.0.smithi017.stdout:6/396: chown d4/d29/f45 1048213637 1 2024-09-20T18:35:59.306 INFO:tasks.workunit.client.0.smithi017.stdout:7/414: dread da/d16/d1c/d40/d34/d3c/f48 [0,4194304] 0 2024-09-20T18:35:59.306 INFO:tasks.workunit.client.0.smithi017.stdout:9/639: creat d6/d23/d58/d3f/d4d/fed x:0 0 0 2024-09-20T18:35:59.313 INFO:tasks.workunit.client.0.smithi017.stdout:3/607: creat da/fc6 x:0 0 0 2024-09-20T18:35:59.315 INFO:tasks.workunit.client.0.smithi017.stdout:4/340: creat d4/de/d1b/d56/d67/f6e x:0 0 0 2024-09-20T18:35:59.316 INFO:tasks.workunit.client.0.smithi017.stdout:1/415: mkdir df/d1c/d80 0 2024-09-20T18:35:59.319 INFO:tasks.workunit.client.0.smithi017.stdout:6/397: creat d4/d37/d41/d43/d7d/f88 x:0 0 0 2024-09-20T18:35:59.320 INFO:tasks.workunit.client.0.smithi017.stdout:6/398: chown d4/df/d4a/f4b 6463 1 2024-09-20T18:35:59.323 INFO:tasks.workunit.client.0.smithi017.stdout:5/373: mkdir d0/d14/d18/d79 0 2024-09-20T18:35:59.326 INFO:tasks.workunit.client.0.smithi017.stdout:8/384: getdents d0/d6/d28/d3a 0 2024-09-20T18:35:59.327 INFO:tasks.workunit.client.0.smithi017.stdout:0/391: mkdir d4/d20/d63/d86 0 2024-09-20T18:35:59.328 INFO:tasks.workunit.client.0.smithi017.stdout:7/415: dwrite da/d16/d1c/d40/d30/d50/f73 [0,4194304] 0 2024-09-20T18:35:59.329 INFO:tasks.workunit.client.0.smithi017.stdout:9/640: unlink d6/d23/d58/d3f/d70/db0/cd4 0 2024-09-20T18:35:59.331 INFO:tasks.workunit.client.0.smithi017.stdout:9/641: readlink d6/d23/d58/d3f/d2f/d98/lae 0 2024-09-20T18:35:59.332 INFO:tasks.workunit.client.0.smithi017.stdout:9/642: chown d6/d42/c6c 1942702 1 2024-09-20T18:35:59.335 INFO:tasks.workunit.client.0.smithi017.stdout:8/385: symlink d0/d6/d28/d3a/l7d 0 2024-09-20T18:35:59.337 INFO:tasks.workunit.client.0.smithi017.stdout:7/416: mknod da/d16/d1c/c7f 0 2024-09-20T18:35:59.344 INFO:tasks.workunit.client.0.smithi017.stdout:4/341: creat d4/d19/d37/d66/f6f x:0 0 0 2024-09-20T18:35:59.347 INFO:tasks.workunit.client.0.smithi017.stdout:8/386: rename d0/f19 to d0/d6/f7e 0 2024-09-20T18:35:59.353 INFO:tasks.workunit.client.0.smithi017.stdout:8/387: dwrite d0/f5e [0,4194304] 0 2024-09-20T18:35:59.355 INFO:tasks.workunit.client.0.smithi017.stdout:8/388: chown d0/d6/d28/c6f 7630 1 2024-09-20T18:35:59.356 INFO:tasks.workunit.client.0.smithi017.stdout:3/608: getdents da/de/d13/d2f/d26 0 2024-09-20T18:35:59.359 INFO:tasks.workunit.client.0.smithi017.stdout:5/374: creat d0/d14/d18/f7a x:0 0 0 2024-09-20T18:35:59.363 INFO:tasks.workunit.client.0.smithi017.stdout:8/389: dwrite d0/d6/d28/d3b/f53 [0,4194304] 0 2024-09-20T18:35:59.365 INFO:tasks.workunit.client.0.smithi017.stdout:8/390: chown d0/d6/f54 947079134 1 2024-09-20T18:35:59.365 INFO:tasks.workunit.client.0.smithi017.stdout:9/643: dread d6/d23/d3a/d61/de7/f56 [0,4194304] 0 2024-09-20T18:35:59.367 INFO:tasks.workunit.client.0.smithi017.stdout:0/392: creat d4/db/d1e/d24/d2f/f87 x:0 0 0 2024-09-20T18:35:59.374 INFO:tasks.workunit.client.0.smithi017.stdout:9/644: dwrite d6/d23/d58/d3f/d4d/d73/d7d/f85 [0,4194304] 0 2024-09-20T18:35:59.378 INFO:tasks.workunit.client.0.smithi017.stdout:3/609: write da/de/d13/d2f/d26/d31/f45 [3863295,79211] 0 2024-09-20T18:35:59.380 INFO:tasks.workunit.client.0.smithi017.stdout:3/610: readlink da/de/d13/d2f/d26/d31/d5a/d76/d19/l2b 0 2024-09-20T18:35:59.382 INFO:tasks.workunit.client.0.smithi017.stdout:4/342: mknod d4/d19/d62/c70 0 2024-09-20T18:35:59.384 INFO:tasks.workunit.client.0.smithi017.stdout:4/343: truncate d4/de/d1b/f2f 1012746 0 2024-09-20T18:35:59.384 INFO:tasks.workunit.client.0.smithi017.stdout:5/375: mkdir d0/d14/d18/d19/d4d/d6d/d78/d7b 0 2024-09-20T18:35:59.386 INFO:tasks.workunit.client.0.smithi017.stdout:8/391: creat d0/d6/d28/d3d/d4e/d55/f7f x:0 0 0 2024-09-20T18:35:59.388 INFO:tasks.workunit.client.0.smithi017.stdout:0/393: creat d4/d37/f88 x:0 0 0 2024-09-20T18:35:59.390 INFO:tasks.workunit.client.0.smithi017.stdout:6/399: link d4/df/d1f/d25/d2b/c31 d4/df/d1f/c89 0 2024-09-20T18:35:59.392 INFO:tasks.workunit.client.0.smithi017.stdout:9/645: symlink d6/d42/lee 0 2024-09-20T18:35:59.392 INFO:tasks.workunit.client.0.smithi017.stdout:9/646: stat f4 0 2024-09-20T18:35:59.395 INFO:tasks.workunit.client.0.smithi017.stdout:9/647: dread d6/d23/d3a/d61/de7/faf [0,4194304] 0 2024-09-20T18:35:59.396 INFO:tasks.workunit.client.0.smithi017.stdout:6/400: dwrite d4/df/d1f/d25/d3f/f5b [0,4194304] 0 2024-09-20T18:35:59.397 INFO:tasks.workunit.client.0.smithi017.stdout:9/648: chown d6/fec 73117164 1 2024-09-20T18:35:59.401 INFO:tasks.workunit.client.0.smithi017.stdout:4/344: symlink d4/d19/d37/d66/l71 0 2024-09-20T18:35:59.404 INFO:tasks.workunit.client.0.smithi017.stdout:5/376: creat d0/d14/d18/d19/d4d/f7c x:0 0 0 2024-09-20T18:35:59.406 INFO:tasks.workunit.client.0.smithi017.stdout:5/377: readlink d0/d14/d18/d2a/d39/d42/l58 0 2024-09-20T18:35:59.407 INFO:tasks.workunit.client.0.smithi017.stdout:8/392: rename d0/d6/d28/c42 to d0/d6/d28/d3b/d72/c80 0 2024-09-20T18:35:59.408 INFO:tasks.workunit.client.0.smithi017.stdout:0/394: symlink d4/d20/l89 0 2024-09-20T18:35:59.410 INFO:tasks.workunit.client.0.smithi017.stdout:4/345: dwrite d4/de/d1b/d56/d67/f6e [0,4194304] 0 2024-09-20T18:35:59.410 INFO:tasks.workunit.client.0.smithi017.stdout:0/395: readlink d4/db/d18/l6d 0 2024-09-20T18:35:59.412 INFO:tasks.workunit.client.0.smithi017.stdout:7/417: write da/d16/d1c/d40/d34/d3c/f4e [2640440,34218] 0 2024-09-20T18:35:59.413 INFO:tasks.workunit.client.0.smithi017.stdout:7/418: fsync da/f77 0 2024-09-20T18:35:59.416 INFO:tasks.workunit.client.0.smithi017.stdout:7/419: fsync da/d16/d1c/d40/d34/d3c/f48 0 2024-09-20T18:35:59.419 INFO:tasks.workunit.client.0.smithi017.stdout:6/401: mkdir d4/df/d8a 0 2024-09-20T18:35:59.420 INFO:tasks.workunit.client.0.smithi017.stdout:6/402: truncate d4/d37/d41/f77 426605 0 2024-09-20T18:35:59.423 INFO:tasks.workunit.client.0.smithi017.stdout:3/611: link da/de/d13/d2f/d26/c95 da/de/cc7 0 2024-09-20T18:35:59.427 INFO:tasks.workunit.client.0.smithi017.stdout:5/378: link d0/d14/d18/d2a/d39/d42/f62 d0/d14/d18/d57/f7d 0 2024-09-20T18:35:59.430 INFO:tasks.workunit.client.0.smithi017.stdout:4/346: creat d4/dc/d1e/d69/f72 x:0 0 0 2024-09-20T18:35:59.431 INFO:tasks.workunit.client.0.smithi017.stdout:4/347: truncate d4/de/d1b/f2f 1636315 0 2024-09-20T18:35:59.431 INFO:tasks.workunit.client.0.smithi017.stdout:4/348: dread - d4/dc/d1e/d69/f72 zero size 2024-09-20T18:35:59.437 INFO:tasks.workunit.client.0.smithi017.stdout:5/379: mkdir d0/d14/d18/d2a/d39/d42/d7e 0 2024-09-20T18:35:59.437 INFO:tasks.workunit.client.0.smithi017.stdout:5/380: write d0/d14/d18/f2f [4874018,32375] 0 2024-09-20T18:35:59.441 INFO:tasks.workunit.client.0.smithi017.stdout:6/403: truncate d4/f9 617121 0 2024-09-20T18:35:59.441 INFO:tasks.workunit.client.0.smithi017.stdout:7/420: write da/d16/d1c/d40/f7a [346375,117374] 0 2024-09-20T18:35:59.443 INFO:tasks.workunit.client.0.smithi017.stdout:8/393: truncate d0/d6/d28/f4f 329628 0 2024-09-20T18:35:59.446 INFO:tasks.workunit.client.0.smithi017.stdout:9/649: dwrite d6/d23/d58/d3f/f91 [0,4194304] 0 2024-09-20T18:35:59.449 INFO:tasks.workunit.client.0.smithi017.stdout:4/349: write d4/f38 [9153179,27266] 0 2024-09-20T18:35:59.452 INFO:tasks.workunit.client.0.smithi017.stdout:5/381: symlink d0/l7f 0 2024-09-20T18:35:59.453 INFO:tasks.workunit.client.0.smithi017.stdout:8/394: dread d0/d6/f3e [4194304,4194304] 0 2024-09-20T18:35:59.456 INFO:tasks.workunit.client.0.smithi017.stdout:9/650: truncate d6/d23/d58/d3f/fc6 1126425 0 2024-09-20T18:35:59.457 INFO:tasks.workunit.client.0.smithi017.stdout:7/421: creat da/d16/d1c/d40/f80 x:0 0 0 2024-09-20T18:35:59.460 INFO:tasks.workunit.client.0.smithi017.stdout:4/350: dread d4/d19/d37/f57 [0,4194304] 0 2024-09-20T18:35:59.460 INFO:tasks.workunit.client.0.smithi017.stdout:7/422: read da/d16/d1c/f1d [2062674,41024] 0 2024-09-20T18:35:59.460 INFO:tasks.workunit.client.0.smithi017.stdout:6/404: rmdir d4/d37/d41/d43/d7d/d87 0 2024-09-20T18:35:59.461 INFO:tasks.workunit.client.0.smithi017.stdout:5/382: dwrite d0/fe [4194304,4194304] 0 2024-09-20T18:35:59.462 INFO:tasks.workunit.client.0.smithi017.stdout:3/612: getdents da/de/d13/d2f/d92 0 2024-09-20T18:35:59.463 INFO:tasks.workunit.client.0.smithi017.stdout:3/613: dread - da/fc3 zero size 2024-09-20T18:35:59.466 INFO:tasks.workunit.client.0.smithi017.stdout:8/395: unlink d0/d6/d28/d3a/l7d 0 2024-09-20T18:35:59.467 INFO:tasks.workunit.client.0.smithi017.stdout:8/396: truncate d0/d6/f74 1047126 0 2024-09-20T18:35:59.480 INFO:tasks.workunit.client.0.smithi017.stdout:5/383: mknod d0/d14/c80 0 2024-09-20T18:35:59.483 INFO:tasks.workunit.client.0.smithi017.stdout:5/384: dread d0/d14/d18/f3b [0,4194304] 0 2024-09-20T18:35:59.485 INFO:tasks.workunit.client.0.smithi017.stdout:5/385: dread - d0/d14/d18/d57/f5d zero size 2024-09-20T18:35:59.486 INFO:tasks.workunit.client.0.smithi017.stdout:4/351: write d4/dc/d1e/d26/d22/f21 [713426,114553] 0 2024-09-20T18:35:59.486 INFO:tasks.workunit.client.0.smithi017.stdout:3/614: write da/de/f89 [224754,313] 0 2024-09-20T18:35:59.487 INFO:tasks.workunit.client.0.smithi017.stdout:7/423: creat da/f81 x:0 0 0 2024-09-20T18:35:59.489 INFO:tasks.workunit.client.0.smithi017.stdout:5/386: truncate d0/d14/d18/d19/d4d/d6d/d78/f66 361177 0 2024-09-20T18:35:59.492 INFO:tasks.workunit.client.0.smithi017.stdout:8/397: write d0/d6/d28/d3d/d4e/f75 [1276113,23083] 0 2024-09-20T18:35:59.496 INFO:tasks.workunit.client.0.smithi017.stdout:5/387: dwrite d0/ff [0,4194304] 0 2024-09-20T18:35:59.496 INFO:tasks.workunit.client.0.smithi017.stdout:6/405: truncate d4/d37/d41/d43/f51 3620776 0 2024-09-20T18:35:59.502 INFO:tasks.workunit.client.0.smithi017.stdout:4/352: creat d4/dc/d1e/f73 x:0 0 0 2024-09-20T18:35:59.504 INFO:tasks.workunit.client.0.smithi017.stdout:3/615: mkdir da/de/d13/d2f/d92/dc8 0 2024-09-20T18:35:59.507 INFO:tasks.workunit.client.0.smithi017.stdout:9/651: rename d6/d23/d58/d3f/d2f/d98/lab to d6/d23/lef 0 2024-09-20T18:35:59.508 INFO:tasks.workunit.client.0.smithi017.stdout:9/652: write d6/d23/d40/db4/dba/f8d [900524,75296] 0 2024-09-20T18:35:59.511 INFO:tasks.workunit.client.0.smithi017.stdout:9/653: dread d6/d23/d40/db4/dba/f84 [0,4194304] 0 2024-09-20T18:35:59.513 INFO:tasks.workunit.client.0.smithi017.stdout:5/388: mknod d0/d14/d18/d2a/d39/d42/c81 0 2024-09-20T18:35:59.514 INFO:tasks.workunit.client.0.smithi017.stdout:6/406: symlink d4/df/d1f/d25/d3f/l8b 0 2024-09-20T18:35:59.517 INFO:tasks.workunit.client.0.smithi017.stdout:3/616: mkdir da/de/d13/d16/d6e/dc9 0 2024-09-20T18:35:59.518 INFO:tasks.workunit.client.0.smithi017.stdout:9/654: dwrite d6/d11/f21 [0,4194304] 0 2024-09-20T18:35:59.520 INFO:tasks.workunit.client.0.smithi017.stdout:7/424: dread da/d16/f47 [0,4194304] 0 2024-09-20T18:35:59.522 INFO:tasks.workunit.client.0.smithi017.stdout:5/389: creat d0/d14/d18/d19/f82 x:0 0 0 2024-09-20T18:35:59.526 INFO:tasks.workunit.client.0.smithi017.stdout:4/353: mknod d4/c74 0 2024-09-20T18:35:59.528 INFO:tasks.workunit.client.0.smithi017.stdout:8/398: rmdir d0/d6/d28/d3d/d4e/d55/d7c 0 2024-09-20T18:35:59.530 INFO:tasks.workunit.client.0.smithi017.stdout:8/399: fdatasync d0/d6/d28/f5a 0 2024-09-20T18:35:59.530 INFO:tasks.workunit.client.0.smithi017.stdout:9/655: chown d6/d23/d58/d3f/d70/db0/ldb 1903 1 2024-09-20T18:35:59.536 INFO:tasks.workunit.client.0.smithi017.stdout:4/354: write d4/d19/f64 [3682009,1962] 0 2024-09-20T18:35:59.536 INFO:tasks.workunit.client.0.smithi017.stdout:7/425: dread da/d16/d1c/f61 [0,4194304] 0 2024-09-20T18:35:59.537 INFO:tasks.workunit.client.0.smithi017.stdout:5/390: symlink d0/d14/d18/d19/d4d/d6d/d78/d7b/l83 0 2024-09-20T18:35:59.539 INFO:tasks.workunit.client.0.smithi017.stdout:8/400: dwrite d0/d6/f54 [0,4194304] 0 2024-09-20T18:35:59.542 INFO:tasks.workunit.client.0.smithi017.stdout:5/391: readlink d0/d14/d18/d2a/d39/d6c/d72/l35 0 2024-09-20T18:35:59.543 INFO:tasks.workunit.client.0.smithi017.stdout:6/407: link d4/fd d4/df/d4a/f8c 0 2024-09-20T18:35:59.548 INFO:tasks.workunit.client.0.smithi017.stdout:4/355: dwrite d4/dc/d1e/f55 [0,4194304] 0 2024-09-20T18:35:59.550 INFO:tasks.workunit.client.0.smithi017.stdout:4/356: fdatasync d4/dc/d1e/d26/f6a 0 2024-09-20T18:35:59.551 INFO:tasks.workunit.client.0.smithi017.stdout:6/408: chown d4/l6 10084824 1 2024-09-20T18:35:59.553 INFO:tasks.workunit.client.0.smithi017.stdout:6/409: write d4/df/d1f/d25/f71 [657264,109346] 0 2024-09-20T18:35:59.561 INFO:tasks.workunit.client.0.smithi017.stdout:8/401: rmdir d0/d6/d28/d3d/d4e/d55/d69 0 2024-09-20T18:35:59.562 INFO:tasks.workunit.client.0.smithi017.stdout:6/410: chown d4/d37/d68/l76 13380997 1 2024-09-20T18:35:59.563 INFO:tasks.workunit.client.0.smithi017.stdout:6/411: dread d4/d37/d41/f77 [0,4194304] 0 2024-09-20T18:35:59.564 INFO:tasks.workunit.client.0.smithi017.stdout:8/402: readlink d0/l61 0 2024-09-20T18:35:59.566 INFO:tasks.workunit.client.0.smithi017.stdout:9/656: link d6/d23/d3a/d61/fb3 d6/d23/d58/d3f/d4d/d73/d7d/dbd/de6/ff0 0 2024-09-20T18:35:59.568 INFO:tasks.workunit.client.0.smithi017.stdout:4/357: creat d4/dc/f75 x:0 0 0 2024-09-20T18:35:59.575 INFO:tasks.workunit.client.0.smithi017.stdout:4/358: dwrite d4/d19/f63 [0,4194304] 0 2024-09-20T18:35:59.583 INFO:tasks.workunit.client.0.smithi017.stdout:4/359: creat d4/de/d1b/d56/d67/f76 x:0 0 0 2024-09-20T18:35:59.584 INFO:tasks.workunit.client.0.smithi017.stdout:6/412: truncate d4/df/d4a/f8c 987809 0 2024-09-20T18:35:59.587 INFO:tasks.workunit.client.0.smithi017.stdout:7/426: truncate da/d16/d1c/d40/d30/f56 21838 0 2024-09-20T18:35:59.589 INFO:tasks.workunit.client.0.smithi017.stdout:6/413: mkdir d4/d37/d68/d8d 0 2024-09-20T18:35:59.593 INFO:tasks.workunit.client.0.smithi017.stdout:9/657: dread d6/d23/d3a/d61/de7/f86 [0,4194304] 0 2024-09-20T18:35:59.595 INFO:tasks.workunit.client.0.smithi017.stdout:9/658: fsync d6/fc2 0 2024-09-20T18:35:59.596 INFO:tasks.workunit.client.0.smithi017.stdout:5/392: dwrite d0/d14/d18/d19/f1a [0,4194304] 0 2024-09-20T18:35:59.597 INFO:tasks.workunit.client.0.smithi017.stdout:8/403: write d0/d6/f25 [4059644,117593] 0 2024-09-20T18:35:59.600 INFO:tasks.workunit.client.0.smithi017.stdout:6/414: dwrite d4/df/d4a/f4b [0,4194304] 0 2024-09-20T18:35:59.602 INFO:tasks.workunit.client.0.smithi017.stdout:4/360: getdents d4/de 0 2024-09-20T18:35:59.603 INFO:tasks.workunit.client.0.smithi017.stdout:4/361: read - d4/f6c zero size 2024-09-20T18:35:59.608 INFO:tasks.workunit.client.0.smithi017.stdout:5/393: creat d0/d14/d18/d19/d4d/f84 x:0 0 0 2024-09-20T18:35:59.611 INFO:tasks.workunit.client.0.smithi017.stdout:6/415: mknod d4/df/d1f/d25/d2b/c8e 0 2024-09-20T18:35:59.614 INFO:tasks.workunit.client.0.smithi017.stdout:9/659: rename d6/d23/d58/d3f/d82/fcd to d6/d23/d58/d3f/d4d/ff1 0 2024-09-20T18:35:59.615 INFO:tasks.workunit.client.0.smithi017.stdout:8/404: mkdir d0/d6/d28/d81 0 2024-09-20T18:35:59.616 INFO:tasks.workunit.client.0.smithi017.stdout:8/405: chown d0/l39 17 1 2024-09-20T18:35:59.616 INFO:tasks.workunit.client.0.smithi017.stdout:5/394: rmdir d0/d14/d18/d2a/d39/d6c 39 2024-09-20T18:35:59.618 INFO:tasks.workunit.client.0.smithi017.stdout:5/395: readlink d0/d14/d18/d2a/d39/d42/l48 0 2024-09-20T18:35:59.623 INFO:tasks.workunit.client.0.smithi017.stdout:6/416: mkdir d4/df/d4a/d8f 0 2024-09-20T18:35:59.623 INFO:tasks.workunit.client.0.smithi017.stdout:4/362: dread d4/dc/d1e/d26/d22/f36 [4194304,4194304] 0 2024-09-20T18:35:59.624 INFO:tasks.workunit.client.0.smithi017.stdout:9/660: chown d6/d23/d58/d3f/d4d/d73/d7d/c9c 43205988 1 2024-09-20T18:35:59.626 INFO:tasks.workunit.client.0.smithi017.stdout:5/396: chown d0/d14/d18/d57/f5d 6 1 2024-09-20T18:35:59.629 INFO:tasks.workunit.client.0.smithi017.stdout:8/406: dwrite d0/d6/d28/f5a [0,4194304] 0 2024-09-20T18:35:59.634 INFO:tasks.workunit.client.0.smithi017.stdout:9/661: dwrite d6/d23/d58/d3f/d4d/d73/fe5 [0,4194304] 0 2024-09-20T18:35:59.641 INFO:tasks.workunit.client.0.smithi017.stdout:6/417: creat d4/d37/d68/d8d/f90 x:0 0 0 2024-09-20T18:35:59.643 INFO:tasks.workunit.client.0.smithi017.stdout:9/662: write d6/d23/d58/d3f/d2f/f81 [551899,101145] 0 2024-09-20T18:35:59.644 INFO:tasks.workunit.client.0.smithi017.stdout:9/663: dread - d6/fec zero size 2024-09-20T18:35:59.646 INFO:tasks.workunit.client.0.smithi017.stdout:8/407: mkdir d0/d6/d28/d81/d82 0 2024-09-20T18:35:59.646 INFO:tasks.workunit.client.0.smithi017.stdout:8/408: fsync d0/f5e 0 2024-09-20T18:35:59.648 INFO:tasks.workunit.client.0.smithi017.stdout:8/409: chown d0/d6/f54 4 1 2024-09-20T18:35:59.648 INFO:tasks.workunit.client.0.smithi017.stdout:5/397: getdents d0/d14/d18/d2a/d39/d42 0 2024-09-20T18:35:59.649 INFO:tasks.workunit.client.0.smithi017.stdout:9/664: symlink d6/d23/d3a/db8/lf2 0 2024-09-20T18:35:59.651 INFO:tasks.workunit.client.0.smithi017.stdout:8/410: mkdir d0/d6/d28/d3d/d4e/d55/d83 0 2024-09-20T18:35:59.652 INFO:tasks.workunit.client.0.smithi017.stdout:6/418: getdents d4/df/d1f 0 2024-09-20T18:35:59.652 INFO:tasks.workunit.client.0.smithi017.stdout:6/419: readlink d4/l6 0 2024-09-20T18:35:59.653 INFO:tasks.workunit.client.0.smithi017.stdout:9/665: creat d6/dc1/ff3 x:0 0 0 2024-09-20T18:35:59.655 INFO:tasks.workunit.client.0.smithi017.stdout:8/411: rename d0/d6/d28/d3d/d4e/f59 to d0/d6/d28/d81/d82/f84 0 2024-09-20T18:35:59.656 INFO:tasks.workunit.client.0.smithi017.stdout:8/412: chown d0/d6/d28/d81/d82 14 1 2024-09-20T18:35:59.658 INFO:tasks.workunit.client.0.smithi017.stdout:6/420: fdatasync d4/f8 0 2024-09-20T18:35:59.659 INFO:tasks.workunit.client.0.smithi017.stdout:8/413: symlink d0/d6/d28/d3d/d4e/d55/l85 0 2024-09-20T18:35:59.660 INFO:tasks.workunit.client.0.smithi017.stdout:8/414: chown d0/f22 27 1 2024-09-20T18:35:59.661 INFO:tasks.workunit.client.0.smithi017.stdout:9/666: creat d6/d23/d58/dda/ff4 x:0 0 0 2024-09-20T18:35:59.661 INFO:tasks.workunit.client.0.smithi017.stdout:8/415: write d0/f14 [3110859,127456] 0 2024-09-20T18:35:59.662 INFO:tasks.workunit.client.0.smithi017.stdout:9/667: chown d6/d23/d58/d3f/d70/dd9 632112 1 2024-09-20T18:35:59.663 INFO:tasks.workunit.client.0.smithi017.stdout:9/668: write f4 [1996644,36510] 0 2024-09-20T18:35:59.663 INFO:tasks.workunit.client.0.smithi017.stdout:6/421: mknod d4/df/d1f/d25/d3f/d5c/c91 0 2024-09-20T18:35:59.667 INFO:tasks.workunit.client.0.smithi017.stdout:8/416: dread d0/d6/d28/f5a [0,4194304] 0 2024-09-20T18:35:59.669 INFO:tasks.workunit.client.0.smithi017.stdout:6/422: rename d4/df/d4a/f50 to d4/d37/d41/d43/f92 0 2024-09-20T18:35:59.672 INFO:tasks.workunit.client.0.smithi017.stdout:6/423: symlink d4/d29/l93 0 2024-09-20T18:35:59.674 INFO:tasks.workunit.client.0.smithi017.stdout:4/363: truncate d4/d19/f42 422964 0 2024-09-20T18:35:59.674 INFO:tasks.workunit.client.0.smithi017.stdout:2/569: sync 2024-09-20T18:35:59.675 INFO:tasks.workunit.client.0.smithi017.stdout:6/424: read d4/d37/d41/f77 [120593,38569] 0 2024-09-20T18:35:59.676 INFO:tasks.workunit.client.0.smithi017.stdout:6/425: chown d4/df/c3a 24 1 2024-09-20T18:35:59.676 INFO:tasks.workunit.client.0.smithi017.stdout:6/426: chown d4/df/d4a/f6c 86 1 2024-09-20T18:35:59.678 INFO:tasks.workunit.client.0.smithi017.stdout:4/364: creat d4/d19/d37/f77 x:0 0 0 2024-09-20T18:35:59.679 INFO:tasks.workunit.client.0.smithi017.stdout:2/570: truncate d1/fb 183967 0 2024-09-20T18:35:59.680 INFO:tasks.workunit.client.0.smithi017.stdout:4/365: truncate d4/dc/d1e/d26/f6a 552053 0 2024-09-20T18:35:59.680 INFO:tasks.workunit.client.0.smithi017.stdout:2/571: dread - d1/dc/d20/d2e/d30/d85/d3d/fab zero size 2024-09-20T18:35:59.681 INFO:tasks.workunit.client.0.smithi017.stdout:9/669: getdents d6/dc1 0 2024-09-20T18:35:59.682 INFO:tasks.workunit.client.0.smithi017.stdout:9/670: fdatasync d6/d23/d3a/d61/fa3 0 2024-09-20T18:35:59.683 INFO:tasks.workunit.client.0.smithi017.stdout:6/427: creat d4/d37/f94 x:0 0 0 2024-09-20T18:35:59.683 INFO:tasks.workunit.client.0.smithi017.stdout:9/671: fdatasync d6/d23/d3a/f5e 0 2024-09-20T18:35:59.691 INFO:tasks.workunit.client.0.smithi017.stdout:4/366: mknod d4/c78 0 2024-09-20T18:35:59.692 INFO:tasks.workunit.client.0.smithi017.stdout:4/367: fdatasync d4/de/f59 0 2024-09-20T18:35:59.692 INFO:tasks.workunit.client.0.smithi017.stdout:2/572: mknod d1/dc/d20/d2e/d30/db0/cbb 0 2024-09-20T18:35:59.699 INFO:tasks.workunit.client.0.smithi017.stdout:4/368: mkdir d4/dc/d1e/d69/d79 0 2024-09-20T18:35:59.700 INFO:tasks.workunit.client.0.smithi017.stdout:2/573: chown d1/dc/d20/d2e/d30/d85/d46/l9b 2 1 2024-09-20T18:35:59.701 INFO:tasks.workunit.client.0.smithi017.stdout:2/574: readlink d1/df/d17/l1c 0 2024-09-20T18:35:59.703 INFO:tasks.workunit.client.0.smithi017.stdout:6/428: dread d4/df/d1f/d25/f58 [0,4194304] 0 2024-09-20T18:35:59.705 INFO:tasks.workunit.client.0.smithi017.stdout:9/672: getdents d6/d23/d40/db4 0 2024-09-20T18:35:59.706 INFO:tasks.workunit.client.0.smithi017.stdout:9/673: chown d6/d23/d3a/d61 32613 1 2024-09-20T18:35:59.714 INFO:tasks.workunit.client.0.smithi017.stdout:9/674: mkdir d6/d23/d40/de2/df5 0 2024-09-20T18:35:59.716 INFO:tasks.workunit.client.0.smithi017.stdout:2/575: rmdir d1/dc/d20/d2e/d30/d9d 0 2024-09-20T18:35:59.716 INFO:tasks.workunit.client.0.smithi017.stdout:9/675: dread - d6/d23/d58/d3f/d4d/fed zero size 2024-09-20T18:35:59.718 INFO:tasks.workunit.client.0.smithi017.stdout:4/369: dread d4/f2c [0,4194304] 0 2024-09-20T18:35:59.720 INFO:tasks.workunit.client.0.smithi017.stdout:4/370: write d4/de/d1b/f58 [40905,120744] 0 2024-09-20T18:35:59.721 INFO:tasks.workunit.client.0.smithi017.stdout:9/676: symlink d6/d23/d3a/d61/lf6 0 2024-09-20T18:35:59.721 INFO:tasks.workunit.client.0.smithi017.stdout:2/576: read d1/dc/d20/d2e/f62 [3601078,5428] 0 2024-09-20T18:35:59.721 INFO:tasks.workunit.client.0.smithi017.stdout:6/429: dread d4/df/d1f/d25/d3f/d5c/f7e [0,4194304] 0 2024-09-20T18:35:59.723 INFO:tasks.workunit.client.0.smithi017.stdout:9/677: chown d6/d23/d58/d3f/d4d/d73/d7d/c9c 0 1 2024-09-20T18:35:59.723 INFO:tasks.workunit.client.0.smithi017.stdout:6/430: read d4/d37/d41/f54 [1542477,72153] 0 2024-09-20T18:35:59.726 INFO:tasks.workunit.client.0.smithi017.stdout:2/577: fsync d1/dc/d20/d2e/d30/d85/d3d/f44 0 2024-09-20T18:35:59.729 INFO:tasks.workunit.client.0.smithi017.stdout:4/371: dwrite d4/de/f4f [0,4194304] 0 2024-09-20T18:35:59.729 INFO:tasks.workunit.client.0.smithi017.stdout:2/578: write d1/dc/d20/d2e/d30/d85/d46/f65 [1231410,27372] 0 2024-09-20T18:35:59.736 INFO:tasks.workunit.client.0.smithi017.stdout:4/372: stat d4/l4a 0 2024-09-20T18:35:59.737 INFO:tasks.workunit.client.0.smithi017.stdout:2/579: chown d1/dc/d20/d2e/c8c 124574 1 2024-09-20T18:35:59.739 INFO:tasks.workunit.client.0.smithi017.stdout:4/373: mkdir d4/dc/d1e/d69/d7a 0 2024-09-20T18:35:59.740 INFO:tasks.workunit.client.0.smithi017.stdout:2/580: write d1/dc/d20/d2e/d30/d85/d3d/fab [130455,1799] 0 2024-09-20T18:35:59.740 INFO:tasks.workunit.client.0.smithi017.stdout:4/374: write d4/d19/f30 [4015362,2229] 0 2024-09-20T18:35:59.743 INFO:tasks.workunit.client.0.smithi017.stdout:2/581: write d1/dc/d20/d2e/d30/f4b [3145329,106663] 0 2024-09-20T18:35:59.743 INFO:tasks.workunit.client.0.smithi017.stdout:9/678: truncate d6/d23/f71 906998 0 2024-09-20T18:35:59.743 INFO:tasks.workunit.client.0.smithi017.stdout:4/375: write d4/dc/d1e/d26/d4e/f6b [542568,44448] 0 2024-09-20T18:35:59.746 INFO:tasks.workunit.client.0.smithi017.stdout:4/376: write d4/d19/f63 [1868426,65729] 0 2024-09-20T18:35:59.746 INFO:tasks.workunit.client.0.smithi017.stdout:9/679: readlink d6/d23/l38 0 2024-09-20T18:35:59.748 INFO:tasks.workunit.client.0.smithi017.stdout:2/582: readlink d1/dc/d20/d2e/d30/d85/l50 0 2024-09-20T18:35:59.749 INFO:tasks.workunit.client.0.smithi017.stdout:4/377: symlink d4/d19/d37/d66/l7b 0 2024-09-20T18:35:59.750 INFO:tasks.workunit.client.0.smithi017.stdout:2/583: chown d1/dc/d20/d2e/d30/d85/d46/d48/c72 51448048 1 2024-09-20T18:35:59.751 INFO:tasks.workunit.client.0.smithi017.stdout:4/378: rmdir d4 39 2024-09-20T18:35:59.758 INFO:tasks.workunit.client.0.smithi017.stdout:4/379: creat d4/d19/d37/f7c x:0 0 0 2024-09-20T18:35:59.760 INFO:tasks.workunit.client.0.smithi017.stdout:4/380: truncate d4/de/d1b/f2f 2347093 0 2024-09-20T18:35:59.766 INFO:tasks.workunit.client.0.smithi017.stdout:2/584: dwrite d1/dc/d20/f7b [0,4194304] 0 2024-09-20T18:35:59.768 INFO:tasks.workunit.client.0.smithi017.stdout:4/381: dwrite d4/d19/f64 [4194304,4194304] 0 2024-09-20T18:35:59.770 INFO:tasks.workunit.client.0.smithi017.stdout:2/585: fsync d1/df/f71 0 2024-09-20T18:35:59.781 INFO:tasks.workunit.client.0.smithi017.stdout:2/586: dwrite d1/dc/d20/f7b [0,4194304] 0 2024-09-20T18:35:59.784 INFO:tasks.workunit.client.0.smithi017.stdout:4/382: link d4/l9 d4/de/d1b/d56/l7d 0 2024-09-20T18:35:59.790 INFO:tasks.workunit.client.0.smithi017.stdout:2/587: mknod d1/dc/d20/d2e/d30/d85/d3d/cbc 0 2024-09-20T18:35:59.790 INFO:tasks.workunit.client.0.smithi017.stdout:2/588: chown d1/dc/d20/d2e/d30/f79 74418 1 2024-09-20T18:35:59.792 INFO:tasks.workunit.client.0.smithi017.stdout:4/383: link d4/d19/f63 d4/d19/f7e 0 2024-09-20T18:35:59.794 INFO:tasks.workunit.client.0.smithi017.stdout:4/384: chown d4/f7 33382359 1 2024-09-20T18:35:59.799 INFO:tasks.workunit.client.0.smithi017.stdout:2/589: dwrite d1/dc/d20/d2e/d30/d85/d46/d48/f5d [4194304,4194304] 0 2024-09-20T18:35:59.800 INFO:tasks.workunit.client.0.smithi017.stdout:2/590: stat d1/d67 0 2024-09-20T18:35:59.804 INFO:tasks.workunit.client.0.smithi017.stdout:2/591: truncate d1/dc/d20/d2e/d30/d85/d53/d96/fb2 994628 0 2024-09-20T18:35:59.811 INFO:tasks.workunit.client.0.smithi017.stdout:2/592: creat d1/dc/d20/d2e/d30/d85/d98/fbd x:0 0 0 2024-09-20T18:35:59.813 INFO:tasks.workunit.client.0.smithi017.stdout:4/385: dread d4/f38 [4194304,4194304] 0 2024-09-20T18:35:59.815 INFO:tasks.workunit.client.0.smithi017.stdout:2/593: creat d1/dc/d20/d2e/d30/db0/fbe x:0 0 0 2024-09-20T18:35:59.816 INFO:tasks.workunit.client.0.smithi017.stdout:4/386: dread d4/de/f27 [0,4194304] 0 2024-09-20T18:35:59.819 INFO:tasks.workunit.client.0.smithi017.stdout:2/594: mknod d1/dc/d20/d2e/d30/d85/d53/d96/cbf 0 2024-09-20T18:35:59.822 INFO:tasks.workunit.client.0.smithi017.stdout:4/387: mkdir d4/d7f 0 2024-09-20T18:35:59.824 INFO:tasks.workunit.client.0.smithi017.stdout:4/388: readlink d4/de/d1b/d56/l7d 0 2024-09-20T18:35:59.825 INFO:tasks.workunit.client.0.smithi017.stdout:4/389: readlink d4/d19/l1a 0 2024-09-20T18:35:59.825 INFO:tasks.workunit.client.0.smithi017.stdout:4/390: readlink d4/dc/d1e/d26/d22/l3b 0 2024-09-20T18:35:59.827 INFO:tasks.workunit.client.0.smithi017.stdout:2/595: creat d1/dc/d20/d2e/d30/d85/d3d/fc0 x:0 0 0 2024-09-20T18:35:59.829 INFO:tasks.workunit.client.0.smithi017.stdout:2/596: write d1/dc/d20/d2e/d30/d85/d3d/fc0 [578684,43978] 0 2024-09-20T18:35:59.830 INFO:tasks.workunit.client.0.smithi017.stdout:2/597: write d1/df/d17/f64 [1746339,27067] 0 2024-09-20T18:35:59.832 INFO:tasks.workunit.client.0.smithi017.stdout:2/598: chown d1/dc/d20/d2e/d30/d85/d3d/fab 656 1 2024-09-20T18:35:59.832 INFO:tasks.workunit.client.0.smithi017.stdout:2/599: chown d1/d1f/d99/da6 0 1 2024-09-20T18:35:59.834 INFO:tasks.workunit.client.0.smithi017.stdout:2/600: write d1/dc/d20/d2e/f38 [355470,107908] 0 2024-09-20T18:35:59.838 INFO:tasks.workunit.client.0.smithi017.stdout:2/601: symlink d1/dc/d20/d2e/d30/d85/d3d/dad/lc1 0 2024-09-20T18:35:59.844 INFO:tasks.workunit.client.0.smithi017.stdout:2/602: dwrite d1/d67/d8f/d9e/f9f [0,4194304] 0 2024-09-20T18:35:59.845 INFO:tasks.workunit.client.0.smithi017.stdout:2/603: truncate d1/d1f/f6e 1965699 0 2024-09-20T18:35:59.847 INFO:tasks.workunit.client.0.smithi017.stdout:2/604: chown d1/fb 22976 1 2024-09-20T18:35:59.849 INFO:tasks.workunit.client.0.smithi017.stdout:2/605: write d1/dc/d20/d2e/d30/d85/d46/f65 [2248018,34316] 0 2024-09-20T18:35:59.854 INFO:tasks.workunit.client.0.smithi017.stdout:2/606: mkdir d1/dc/d20/d2e/d30/db0/dc2 0 2024-09-20T18:35:59.868 INFO:tasks.workunit.client.0.smithi017.stdout:2/607: dread d1/dc/d20/d2e/d30/d85/d46/d48/f5d [0,4194304] 0 2024-09-20T18:35:59.871 INFO:tasks.workunit.client.0.smithi017.stdout:2/608: rename d1/dc/d20/d2e/d30/d85/d3d/d77/d7a/faf to d1/fc3 0 2024-09-20T18:35:59.873 INFO:tasks.workunit.client.0.smithi017.stdout:2/609: creat d1/dc/d20/d2e/d30/d85/d53/fc4 x:0 0 0 2024-09-20T18:35:59.878 INFO:tasks.workunit.client.0.smithi017.stdout:2/610: getdents d1/df/d17 0 2024-09-20T18:35:59.879 INFO:tasks.workunit.client.0.smithi017.stdout:2/611: write d1/dc/d20/d2e/d30/d85/d53/fc4 [321781,77280] 0 2024-09-20T18:35:59.879 INFO:tasks.workunit.client.0.smithi017.stdout:2/612: stat d1/df/d17/c7e 0 2024-09-20T18:35:59.882 INFO:tasks.workunit.client.0.smithi017.stdout:2/613: mknod d1/dc/d20/d2e/d30/db0/cc5 0 2024-09-20T18:35:59.888 INFO:tasks.workunit.client.0.smithi017.stdout:2/614: dwrite d1/dc/d20/d2e/d30/d85/d98/fbd [0,4194304] 0 2024-09-20T18:35:59.891 INFO:tasks.workunit.client.0.smithi017.stdout:2/615: write d1/dc/d20/d2e/d30/d85/f87 [191333,31633] 0 2024-09-20T18:35:59.893 INFO:tasks.workunit.client.0.smithi017.stdout:2/616: symlink d1/d6c/lc6 0 2024-09-20T18:35:59.895 INFO:tasks.workunit.client.0.smithi017.stdout:2/617: rmdir d1/df 39 2024-09-20T18:35:59.910 INFO:tasks.workunit.client.0.smithi017.stdout:2/618: write d1/dc/d20/d2e/d30/d85/d3d/f34 [3909593,130800] 0 2024-09-20T18:35:59.915 INFO:tasks.workunit.client.0.smithi017.stdout:2/619: dread d1/dc/d20/d2e/f4f [0,4194304] 0 2024-09-20T18:35:59.915 INFO:tasks.workunit.client.0.smithi017.stdout:2/620: readlink d1/dc/d20/d2e/d30/l3c 0 2024-09-20T18:35:59.918 INFO:tasks.workunit.client.0.smithi017.stdout:2/621: fdatasync d1/dc/d20/d2e/f49 0 2024-09-20T18:35:59.920 INFO:tasks.workunit.client.0.smithi017.stdout:2/622: rmdir d1/d6c 39 2024-09-20T18:35:59.928 INFO:tasks.workunit.client.0.smithi017.stdout:2/623: truncate d1/dc/d20/d2e/d30/d85/d46/d48/f5d 2545536 0 2024-09-20T18:35:59.941 INFO:tasks.workunit.client.0.smithi017.stdout:2/624: dread d1/df/f1e [0,4194304] 0 2024-09-20T18:35:59.947 INFO:tasks.workunit.client.0.smithi017.stdout:2/625: truncate d1/dc/d20/d2e/d30/d85/f7d 3565941 0 2024-09-20T18:35:59.948 INFO:tasks.workunit.client.0.smithi017.stdout:2/626: fdatasync d1/dc/d20/d2e/f38 0 2024-09-20T18:35:59.950 INFO:tasks.workunit.client.0.smithi017.stdout:2/627: truncate d1/dc/d20/d2e/d30/d85/d46/f65 5126372 0 2024-09-20T18:35:59.951 INFO:tasks.workunit.client.0.smithi017.stdout:2/628: symlink d1/d1f/lc7 0 2024-09-20T18:35:59.954 INFO:tasks.workunit.client.0.smithi017.stdout:2/629: symlink d1/dc/d20/d2e/d30/d85/d46/lc8 0 2024-09-20T18:35:59.954 INFO:tasks.workunit.client.0.smithi017.stdout:2/630: fdatasync d1/dc/d20/d2e/d30/d85/d3d/fc0 0 2024-09-20T18:35:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:59 smithi172 ceph-mon[35456]: pgmap v34: 65 pgs: 65 active+clean; 3.1 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 103 MiB/s rd, 326 MiB/s wr, 610 op/s 2024-09-20T18:35:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:59 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:59 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:35:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:59 smithi172 ceph-mon[35456]: Reconfiguring ceph-exporter.smithi172 (dependencies changed)... 2024-09-20T18:35:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:59 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:35:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:59 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:35:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:59 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:35:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:35:59 smithi172 ceph-mon[35456]: Deploying daemon ceph-exporter.smithi172 on smithi172 2024-09-20T18:35:59.966 INFO:tasks.workunit.client.0.smithi017.stdout:2/631: dread d1/dc/d20/d2e/d30/f79 [0,4194304] 0 2024-09-20T18:35:59.970 INFO:tasks.workunit.client.0.smithi017.stdout:2/632: mknod d1/dc/d20/d2e/d30/d85/d53/d6b/cc9 0 2024-09-20T18:35:59.972 INFO:tasks.workunit.client.0.smithi017.stdout:2/633: write d1/dc/d20/d2e/d30/d85/d3d/d77/fac [2910915,40444] 0 2024-09-20T18:35:59.984 INFO:tasks.workunit.client.0.smithi017.stdout:2/634: dread d1/dc/d20/d2e/d30/d85/d3d/f44 [0,4194304] 0 2024-09-20T18:35:59.986 INFO:tasks.workunit.client.0.smithi017.stdout:2/635: chown d1/dc/d20/d2e/d30/d85/d53/d96/cbf 1946447990 1 2024-09-20T18:35:59.990 INFO:tasks.workunit.client.0.smithi017.stdout:2/636: dread d1/d1f/f6e [0,4194304] 0 2024-09-20T18:35:59.998 INFO:tasks.workunit.client.0.smithi017.stdout:2/637: dwrite d1/dc/d20/d2e/d30/d85/d53/d6b/f95 [0,4194304] 0 2024-09-20T18:36:00.000 INFO:tasks.workunit.client.0.smithi017.stdout:2/638: symlink d1/dc/d20/d2e/d30/d85/d46/d48/lca 0 2024-09-20T18:36:00.002 INFO:tasks.workunit.client.0.smithi017.stdout:2/639: write d1/dc/d20/d2e/d30/d85/d3d/fc0 [1156167,73208] 0 2024-09-20T18:36:00.006 INFO:tasks.workunit.client.0.smithi017.stdout:2/640: creat d1/dc/d20/d2e/d30/d85/d53/d96/fcb x:0 0 0 2024-09-20T18:36:00.006 INFO:tasks.workunit.client.0.smithi017.stdout:2/641: stat d1/d1f/l2a 0 2024-09-20T18:36:00.008 INFO:tasks.workunit.client.0.smithi017.stdout:2/642: fsync d1/dc/d20/d2e/d30/d85/d46/f65 0 2024-09-20T18:36:00.011 INFO:tasks.workunit.client.0.smithi017.stdout:2/643: creat d1/dc/d20/d2e/d30/fcc x:0 0 0 2024-09-20T18:36:00.014 INFO:tasks.workunit.client.0.smithi017.stdout:2/644: dread d1/dc/d20/d2e/d30/d85/f87 [0,4194304] 0 2024-09-20T18:36:00.015 INFO:tasks.workunit.client.0.smithi017.stdout:2/645: chown d1/dc/d20/d2e/cb9 18905874 1 2024-09-20T18:36:00.015 INFO:tasks.workunit.client.0.smithi017.stdout:2/646: readlink d1/df/d17/l66 0 2024-09-20T18:36:00.022 INFO:tasks.workunit.client.0.smithi017.stdout:2/647: dwrite d1/dc/d20/d2e/d30/d85/d53/fb7 [0,4194304] 0 2024-09-20T18:36:00.025 INFO:tasks.workunit.client.0.smithi017.stdout:2/648: mkdir d1/d67/d8f/dcd 0 2024-09-20T18:36:00.026 INFO:tasks.workunit.client.0.smithi017.stdout:2/649: dread - d1/dc/d20/d2e/d30/d85/d53/d96/fcb zero size 2024-09-20T18:36:00.031 INFO:tasks.workunit.client.0.smithi017.stdout:2/650: mknod d1/dc/d20/d2e/d30/d85/d3d/cce 0 2024-09-20T18:36:00.033 INFO:tasks.workunit.client.0.smithi017.stdout:2/651: write d1/dc/d20/d2e/f5f [1494446,50736] 0 2024-09-20T18:36:00.042 INFO:tasks.workunit.client.0.smithi017.stdout:2/652: write d1/d1f/f6e [1099849,114169] 0 2024-09-20T18:36:00.046 INFO:tasks.workunit.client.0.smithi017.stdout:2/653: creat d1/d67/d8f/dcd/fcf x:0 0 0 2024-09-20T18:36:00.046 INFO:tasks.workunit.client.0.smithi017.stdout:2/654: chown d1/dc/d20/d2e/d30/d85/d3d/dad 549300 1 2024-09-20T18:36:00.050 INFO:tasks.workunit.client.0.smithi017.stdout:2/655: getdents d1/d67 0 2024-09-20T18:36:00.051 INFO:tasks.workunit.client.0.smithi017.stdout:2/656: read d1/d1f/f6e [134408,78097] 0 2024-09-20T18:36:00.054 INFO:tasks.workunit.client.0.smithi017.stdout:2/657: creat d1/d67/d8f/dcd/fd0 x:0 0 0 2024-09-20T18:36:00.118 INFO:tasks.workunit.client.0.smithi017.stdout:2/658: dwrite d1/dc/d20/d2e/d30/d85/d53/d96/fb2 [0,4194304] 0 2024-09-20T18:36:00.121 INFO:tasks.workunit.client.0.smithi017.stdout:2/659: write d1/dc/d20/d2e/d30/f79 [155869,40151] 0 2024-09-20T18:36:00.131 INFO:tasks.workunit.client.0.smithi017.stdout:2/660: dread d1/dc/d20/d2e/f42 [0,4194304] 0 2024-09-20T18:36:00.135 INFO:tasks.workunit.client.0.smithi017.stdout:2/661: creat d1/dc/d20/d2e/d30/d85/d3d/dad/fd1 x:0 0 0 2024-09-20T18:36:00.138 INFO:tasks.workunit.client.0.smithi017.stdout:2/662: write d1/dc/d20/d2e/d30/d85/d53/d6b/f95 [3175024,84906] 0 2024-09-20T18:36:00.140 INFO:tasks.workunit.client.0.smithi017.stdout:2/663: dread d1/dc/d20/d2e/d30/d85/f87 [0,4194304] 0 2024-09-20T18:36:00.142 INFO:tasks.workunit.client.0.smithi017.stdout:2/664: mknod d1/d6c/cd2 0 2024-09-20T18:36:00.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:59 smithi017 ceph-mon[28058]: pgmap v34: 65 pgs: 65 active+clean; 3.1 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 103 MiB/s rd, 326 MiB/s wr, 610 op/s 2024-09-20T18:36:00.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:59 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:00.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:59 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:00.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:59 smithi017 ceph-mon[28058]: Reconfiguring ceph-exporter.smithi172 (dependencies changed)... 2024-09-20T18:36:00.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:59 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:36:00.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:59 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-20T18:36:00.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:59 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:36:00.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:35:59 smithi017 ceph-mon[28058]: Deploying daemon ceph-exporter.smithi172 on smithi172 2024-09-20T18:36:00.202 INFO:tasks.workunit.client.0.smithi017.stdout:1/416: sync 2024-09-20T18:36:00.205 INFO:tasks.workunit.client.0.smithi017.stdout:1/417: dread df/d1c/f25 [0,4194304] 0 2024-09-20T18:36:00.211 INFO:tasks.workunit.client.0.smithi017.stdout:1/418: dread df/d16/f21 [0,4194304] 0 2024-09-20T18:36:00.216 INFO:tasks.workunit.client.0.smithi017.stdout:1/419: dwrite df/f33 [4194304,4194304] 0 2024-09-20T18:36:00.222 INFO:tasks.workunit.client.0.smithi017.stdout:1/420: dwrite df/f24 [0,4194304] 0 2024-09-20T18:36:00.247 INFO:tasks.workunit.client.0.smithi017.stdout:1/421: dwrite df/d16/f2e [0,4194304] 0 2024-09-20T18:36:00.252 INFO:tasks.workunit.client.0.smithi017.stdout:1/422: creat df/d16/d50/d69/d62/f81 x:0 0 0 2024-09-20T18:36:00.253 INFO:tasks.workunit.client.0.smithi017.stdout:1/423: read df/d1c/f70 [1288833,127697] 0 2024-09-20T18:36:00.259 INFO:tasks.workunit.client.0.smithi017.stdout:1/424: dwrite df/d16/f63 [0,4194304] 0 2024-09-20T18:36:00.282 INFO:tasks.workunit.client.0.smithi017.stdout:1/425: truncate df/d1c/f25 1512348 0 2024-09-20T18:36:00.286 INFO:tasks.workunit.client.0.smithi017.stdout:1/426: rename df/d16/d50/d69/d71 to df/d35/d4f/d82 0 2024-09-20T18:36:00.292 INFO:tasks.workunit.client.0.smithi017.stdout:1/427: dread df/d29/d2c/f3f [0,4194304] 0 2024-09-20T18:36:00.307 INFO:tasks.workunit.client.0.smithi017.stdout:0/396: sync 2024-09-20T18:36:00.312 INFO:tasks.workunit.client.0.smithi017.stdout:0/397: creat d4/db/d1e/d24/d2f/d51/d52/d77/f8a x:0 0 0 2024-09-20T18:36:00.324 INFO:tasks.workunit.client.0.smithi017.stdout:1/428: write df/d1c/f75 [1395141,9345] 0 2024-09-20T18:36:00.331 INFO:tasks.workunit.client.0.smithi017.stdout:0/398: write d4/db/d1e/d24/f30 [1469970,129073] 0 2024-09-20T18:36:00.336 INFO:tasks.workunit.client.0.smithi017.stdout:0/399: read d4/db/d1e/d24/d2f/f80 [1667829,72580] 0 2024-09-20T18:36:00.337 INFO:tasks.workunit.client.0.smithi017.stdout:1/429: rename df/d1c/f25 to df/d16/d50/f83 0 2024-09-20T18:36:00.340 INFO:tasks.workunit.client.0.smithi017.stdout:0/400: rename d4/d68/f71 to d4/d37/f8b 0 2024-09-20T18:36:00.343 INFO:tasks.workunit.client.0.smithi017.stdout:1/430: creat df/d3b/d7c/f84 x:0 0 0 2024-09-20T18:36:00.344 INFO:tasks.workunit.client.0.smithi017.stdout:0/401: mkdir d4/db/d18/d25/d36/d47/d8c 0 2024-09-20T18:36:00.345 INFO:tasks.workunit.client.0.smithi017.stdout:0/402: chown d4/db/d1e/d24/d2f/f5e 815 1 2024-09-20T18:36:00.345 INFO:tasks.workunit.client.0.smithi017.stdout:0/403: chown d4/db/d18/d25 208876517 1 2024-09-20T18:36:00.346 INFO:tasks.workunit.client.0.smithi017.stdout:1/431: mknod df/c85 0 2024-09-20T18:36:00.347 INFO:tasks.workunit.client.0.smithi017.stdout:1/432: dread - df/d3b/d7c/f84 zero size 2024-09-20T18:36:00.347 INFO:tasks.workunit.client.0.smithi017.stdout:0/404: readlink d4/db/d1e/d24/d2f/l64 0 2024-09-20T18:36:00.349 INFO:tasks.workunit.client.0.smithi017.stdout:0/405: creat d4/db/d18/f8d x:0 0 0 2024-09-20T18:36:00.353 INFO:tasks.workunit.client.0.smithi017.stdout:1/433: link df/f26 df/d16/d50/f86 0 2024-09-20T18:36:00.355 INFO:tasks.workunit.client.0.smithi017.stdout:0/406: dwrite d4/db/f2c [0,4194304] 0 2024-09-20T18:36:00.355 INFO:tasks.workunit.client.0.smithi017.stdout:1/434: mkdir df/d16/d50/d87 0 2024-09-20T18:36:00.356 INFO:tasks.workunit.client.0.smithi017.stdout:1/435: readlink df/d35/d4f/l54 0 2024-09-20T18:36:00.358 INFO:tasks.workunit.client.0.smithi017.stdout:0/407: mkdir d4/d68/d8e 0 2024-09-20T18:36:00.359 INFO:tasks.workunit.client.0.smithi017.stdout:1/436: rmdir df 39 2024-09-20T18:36:00.360 INFO:tasks.workunit.client.0.smithi017.stdout:0/408: write d4/db/d1e/d42/f84 [69268,69042] 0 2024-09-20T18:36:00.362 INFO:tasks.workunit.client.0.smithi017.stdout:0/409: write d4/db/d1e/d24/d2f/f5e [699738,126371] 0 2024-09-20T18:36:00.362 INFO:tasks.workunit.client.0.smithi017.stdout:0/410: chown d4 141 1 2024-09-20T18:36:00.364 INFO:tasks.workunit.client.0.smithi017.stdout:1/437: symlink df/d35/l88 0 2024-09-20T18:36:00.364 INFO:tasks.workunit.client.0.smithi017.stdout:1/438: chown df/d3b 956220489 1 2024-09-20T18:36:00.365 INFO:tasks.workunit.client.0.smithi017.stdout:0/411: mknod d4/d68/c8f 0 2024-09-20T18:36:00.367 INFO:tasks.workunit.client.0.smithi017.stdout:0/412: symlink d4/db/d18/l90 0 2024-09-20T18:36:00.372 INFO:tasks.workunit.client.0.smithi017.stdout:1/439: dwrite df/d16/d50/d69/d62/f81 [0,4194304] 0 2024-09-20T18:36:00.375 INFO:tasks.workunit.client.0.smithi017.stdout:0/413: dwrite d4/db/d1e/d24/d2f/f6b [0,4194304] 0 2024-09-20T18:36:00.377 INFO:tasks.workunit.client.0.smithi017.stdout:0/414: dread - d4/db/d18/d25/d36/f76 zero size 2024-09-20T18:36:00.381 INFO:tasks.workunit.client.0.smithi017.stdout:0/415: mknod d4/c91 0 2024-09-20T18:36:00.383 INFO:tasks.workunit.client.0.smithi017.stdout:0/416: readlink d4/db/d1e/l4a 0 2024-09-20T18:36:00.406 INFO:tasks.workunit.client.0.smithi017.stdout:0/417: write d4/d37/f6a [84611,44650] 0 2024-09-20T18:36:00.411 INFO:tasks.workunit.client.0.smithi017.stdout:0/418: write d4/d20/f2a [1485129,97000] 0 2024-09-20T18:36:00.411 INFO:tasks.workunit.client.0.smithi017.stdout:1/440: dwrite df/d29/f56 [0,4194304] 0 2024-09-20T18:36:00.412 INFO:tasks.workunit.client.0.smithi017.stdout:1/441: readlink df/d29/d2c/l7d 0 2024-09-20T18:36:00.413 INFO:tasks.workunit.client.0.smithi017.stdout:1/442: readlink df/d35/l48 0 2024-09-20T18:36:00.415 INFO:tasks.workunit.client.0.smithi017.stdout:1/443: write df/d3b/d7c/f84 [125705,100505] 0 2024-09-20T18:36:00.416 INFO:tasks.workunit.client.0.smithi017.stdout:0/419: rmdir d4/d37 39 2024-09-20T18:36:00.418 INFO:tasks.workunit.client.0.smithi017.stdout:0/420: symlink d4/db/d18/l92 0 2024-09-20T18:36:00.419 INFO:tasks.workunit.client.0.smithi017.stdout:0/421: chown d4/db/d1e/d42/f67 270 1 2024-09-20T18:36:00.422 INFO:tasks.workunit.client.0.smithi017.stdout:0/422: fdatasync d4/db/fc 0 2024-09-20T18:36:00.429 INFO:tasks.workunit.client.0.smithi017.stdout:0/423: dwrite d4/db/d1e/d24/d2f/d69/f73 [0,4194304] 0 2024-09-20T18:36:00.434 INFO:tasks.workunit.client.0.smithi017.stdout:0/424: rename d4/f70 to d4/db/d1e/d66/f93 0 2024-09-20T18:36:00.442 INFO:tasks.workunit.client.0.smithi017.stdout:0/425: dwrite f2 [0,4194304] 0 2024-09-20T18:36:00.448 INFO:tasks.workunit.client.0.smithi017.stdout:0/426: mkdir d4/db/d1e/d24/d2f/d94 0 2024-09-20T18:36:00.604 INFO:tasks.workunit.client.0.smithi017.stdout:3/617: sync 2024-09-20T18:36:00.608 INFO:tasks.workunit.client.0.smithi017.stdout:3/618: rename da/c4d to da/de/d53/d88/cca 0 2024-09-20T18:36:00.609 INFO:tasks.workunit.client.0.smithi017.stdout:3/619: rmdir da/de/d53 39 2024-09-20T18:36:00.611 INFO:tasks.workunit.client.0.smithi017.stdout:3/620: unlink da/de/l55 0 2024-09-20T18:36:00.617 INFO:tasks.workunit.client.0.smithi017.stdout:3/621: rename da/de/d13/d2f/d26/d62/da5/da9/fc5 to da/de/d13/d2f/d26/d62/da5/fcb 0 2024-09-20T18:36:00.618 INFO:tasks.workunit.client.0.smithi017.stdout:3/622: mkdir da/de/d13/d16/d6e/d97/dc1/dcc 0 2024-09-20T18:36:00.619 INFO:tasks.workunit.client.0.smithi017.stdout:3/623: chown da/de/d13/d2f/d26/d31/d5a/d76/c81 13 1 2024-09-20T18:36:00.621 INFO:tasks.workunit.client.0.smithi017.stdout:3/624: creat da/de/d13/d16/d6e/d97/fcd x:0 0 0 2024-09-20T18:36:00.621 INFO:tasks.workunit.client.0.smithi017.stdout:3/625: fdatasync da/fc3 0 2024-09-20T18:36:00.625 INFO:tasks.workunit.client.0.smithi017.stdout:3/626: write da/de/d53/d52/f80 [1991845,116520] 0 2024-09-20T18:36:00.634 INFO:tasks.workunit.client.0.smithi017.stdout:3/627: dread da/de/f85 [0,4194304] 0 2024-09-20T18:36:00.636 INFO:tasks.workunit.client.0.smithi017.stdout:3/628: chown da/de/d13/d2f/d26/d31/d5a/d76/lb8 635 1 2024-09-20T18:36:00.638 INFO:tasks.workunit.client.0.smithi017.stdout:3/629: symlink da/de/d13/d16/d50/lce 0 2024-09-20T18:36:00.678 INFO:tasks.workunit.client.0.smithi017.stdout:3/630: dwrite da/de/d13/d16/d50/f96 [0,4194304] 0 2024-09-20T18:36:00.703 INFO:tasks.workunit.client.0.smithi017.stdout:3/631: dread da/de/d53/d52/f80 [0,4194304] 0 2024-09-20T18:36:00.706 INFO:tasks.workunit.client.0.smithi017.stdout:3/632: mkdir da/de/d53/dcf 0 2024-09-20T18:36:00.707 INFO:tasks.workunit.client.0.smithi017.stdout:3/633: dread - da/de/d13/d2f/d26/d62/da5/fa8 zero size 2024-09-20T18:36:00.719 INFO:tasks.workunit.client.0.smithi017.stdout:3/634: dread da/de/d13/d2f/d26/d31/d5a/d76/d19/f4c [0,4194304] 0 2024-09-20T18:36:00.720 INFO:tasks.workunit.client.0.smithi017.stdout:3/635: write da/de/d13/d16/d50/f78 [1599385,108986] 0 2024-09-20T18:36:00.723 INFO:tasks.workunit.client.0.smithi017.stdout:3/636: mknod da/de/d13/d2f/d26/cd0 0 2024-09-20T18:36:00.730 INFO:tasks.workunit.client.0.smithi017.stdout:3/637: write da/de/d13/d2f/d26/d31/f9a [1658762,83159] 0 2024-09-20T18:36:00.732 INFO:tasks.workunit.client.0.smithi017.stdout:3/638: write da/de/d53/fa7 [571869,106531] 0 2024-09-20T18:36:00.734 INFO:tasks.workunit.client.0.smithi017.stdout:3/639: creat da/de/d13/d16/d6e/fd1 x:0 0 0 2024-09-20T18:36:00.745 INFO:tasks.workunit.client.0.smithi017.stdout:3/640: dwrite da/de/d13/d16/d6e/f87 [0,4194304] 0 2024-09-20T18:36:00.750 INFO:tasks.workunit.client.0.smithi017.stdout:3/641: write da/de/d13/d2f/d26/d41/f83 [1287918,115367] 0 2024-09-20T18:36:00.751 INFO:tasks.workunit.client.0.smithi017.stdout:3/642: chown da/de/d13/d2f/d26/d31/d5a/d76/c86 42492 1 2024-09-20T18:36:00.753 INFO:tasks.workunit.client.0.smithi017.stdout:7/427: sync 2024-09-20T18:36:00.753 INFO:tasks.workunit.client.0.smithi017.stdout:3/643: dread da/de/f89 [0,4194304] 0 2024-09-20T18:36:00.755 INFO:tasks.workunit.client.0.smithi017.stdout:3/644: fdatasync da/de/d13/d16/d6e/fd1 0 2024-09-20T18:36:00.755 INFO:tasks.workunit.client.0.smithi017.stdout:7/428: dread da/f65 [0,4194304] 0 2024-09-20T18:36:00.756 INFO:tasks.workunit.client.0.smithi017.stdout:7/429: chown da/cd 99935 1 2024-09-20T18:36:00.756 INFO:tasks.workunit.client.0.smithi017.stdout:3/645: dread - da/de/d13/d2f/d26/d31/d5a/d76/f9d zero size 2024-09-20T18:36:00.758 INFO:tasks.workunit.client.0.smithi017.stdout:7/430: unlink da/c21 0 2024-09-20T18:36:00.760 INFO:tasks.workunit.client.0.smithi017.stdout:7/431: creat da/d16/d1c/f82 x:0 0 0 2024-09-20T18:36:00.761 INFO:tasks.workunit.client.0.smithi017.stdout:7/432: read da/fc [312744,43171] 0 2024-09-20T18:36:00.761 INFO:tasks.workunit.client.0.smithi017.stdout:7/433: read - da/d16/d1c/d40/f80 zero size 2024-09-20T18:36:00.765 INFO:tasks.workunit.client.0.smithi017.stdout:7/434: rename da/d16/d1c/d40/d34/d3c/c4d to da/d16/d1c/d40/d5d/c83 0 2024-09-20T18:36:00.767 INFO:tasks.workunit.client.0.smithi017.stdout:7/435: unlink da/d16/d1c/d40/d34/d3c/c72 0 2024-09-20T18:36:00.769 INFO:tasks.workunit.client.0.smithi017.stdout:7/436: symlink da/d16/d1c/d40/d34/d3c/l84 0 2024-09-20T18:36:00.775 INFO:tasks.workunit.client.0.smithi017.stdout:7/437: link da/c6f da/d16/d1c/d40/d3a/c85 0 2024-09-20T18:36:00.776 INFO:tasks.workunit.client.0.smithi017.stdout:7/438: symlink da/d16/d1c/d40/d34/d3c/l86 0 2024-09-20T18:36:00.780 INFO:tasks.workunit.client.0.smithi017.stdout:7/439: dread da/fc [0,4194304] 0 2024-09-20T18:36:00.794 INFO:tasks.workunit.client.0.smithi017.stdout:7/440: dread da/d16/d1c/d40/d34/f6b [0,4194304] 0 2024-09-20T18:36:00.798 INFO:tasks.workunit.client.0.smithi017.stdout:7/441: truncate da/d16/d1c/d40/d34/d3c/f53 542983 0 2024-09-20T18:36:00.811 INFO:tasks.workunit.client.0.smithi017.stdout:7/442: creat da/d16/d1c/d40/d30/f87 x:0 0 0 2024-09-20T18:36:00.816 INFO:tasks.workunit.client.0.smithi017.stdout:7/443: getdents da/d16/d1c/d40/d3a 0 2024-09-20T18:36:00.818 INFO:tasks.workunit.client.0.smithi017.stdout:7/444: creat da/d16/d1c/d40/d34/d3c/f88 x:0 0 0 2024-09-20T18:36:00.832 INFO:tasks.workunit.client.0.smithi017.stdout:7/445: dwrite da/d16/d1c/d40/d30/f56 [0,4194304] 0 2024-09-20T18:36:00.833 INFO:tasks.workunit.client.0.smithi017.stdout:7/446: readlink da/d16/l41 0 2024-09-20T18:36:00.838 INFO:tasks.workunit.client.0.smithi017.stdout:7/447: creat da/d16/d1c/d40/d30/d50/d75/f89 x:0 0 0 2024-09-20T18:36:00.842 INFO:tasks.workunit.client.0.smithi017.stdout:7/448: mkdir da/d16/d1c/d40/d3a/d8a 0 2024-09-20T18:36:00.856 INFO:tasks.workunit.client.0.smithi017.stdout:7/449: dwrite da/d16/f47 [0,4194304] 0 2024-09-20T18:36:00.863 INFO:tasks.workunit.client.0.smithi017.stdout:7/450: symlink da/d16/d1c/d40/d30/l8b 0 2024-09-20T18:36:00.864 INFO:tasks.workunit.client.0.smithi017.stdout:7/451: write da/d16/f3f [78614,68701] 0 2024-09-20T18:36:00.866 INFO:tasks.workunit.client.0.smithi017.stdout:7/452: write da/d16/d1c/d40/d34/d3c/f88 [116301,14740] 0 2024-09-20T18:36:00.866 INFO:tasks.workunit.client.0.smithi017.stdout:7/453: chown da/c1e 15712 1 2024-09-20T18:36:00.881 INFO:tasks.workunit.client.0.smithi017.stdout:7/454: write da/f65 [539102,45168] 0 2024-09-20T18:36:00.895 INFO:tasks.workunit.client.0.smithi017.stdout:7/455: dread da/d16/d1c/f1d [0,4194304] 0 2024-09-20T18:36:00.896 INFO:tasks.workunit.client.0.smithi017.stdout:7/456: write da/d16/d1c/f82 [586977,3031] 0 2024-09-20T18:36:00.899 INFO:tasks.workunit.client.0.smithi017.stdout:7/457: creat da/d54/f8c x:0 0 0 2024-09-20T18:36:00.900 INFO:tasks.workunit.client.0.smithi017.stdout:7/458: read da/d16/d1c/d40/d34/d3c/f88 [30949,26519] 0 2024-09-20T18:36:00.901 INFO:tasks.workunit.client.0.smithi017.stdout:7/459: dread - da/d54/f76 zero size 2024-09-20T18:36:00.904 INFO:tasks.workunit.client.0.smithi017.stdout:7/460: read da/d16/d1c/d40/d30/d50/d75/f28 [1382229,102220] 0 2024-09-20T18:36:00.908 INFO:tasks.workunit.client.0.smithi017.stdout:7/461: unlink da/d16/l44 0 2024-09-20T18:36:00.911 INFO:tasks.workunit.client.0.smithi017.stdout:9/680: sync 2024-09-20T18:36:00.911 INFO:tasks.workunit.client.0.smithi017.stdout:8/417: sync 2024-09-20T18:36:00.911 INFO:tasks.workunit.client.0.smithi017.stdout:0/427: sync 2024-09-20T18:36:00.912 INFO:tasks.workunit.client.0.smithi017.stdout:1/444: sync 2024-09-20T18:36:00.912 INFO:tasks.workunit.client.0.smithi017.stdout:6/431: sync 2024-09-20T18:36:00.912 INFO:tasks.workunit.client.0.smithi017.stdout:4/391: sync 2024-09-20T18:36:00.912 INFO:tasks.workunit.client.0.smithi017.stdout:2/665: sync 2024-09-20T18:36:00.912 INFO:tasks.workunit.client.0.smithi017.stdout:5/398: sync 2024-09-20T18:36:00.912 INFO:tasks.workunit.client.0.smithi017.stdout:7/462: creat da/f8d x:0 0 0 2024-09-20T18:36:00.913 INFO:tasks.workunit.client.0.smithi017.stdout:1/445: fsync df/d29/d2c/f65 0 2024-09-20T18:36:00.916 INFO:tasks.workunit.client.0.smithi017.stdout:7/463: readlink da/d16/d1c/d40/d34/l57 0 2024-09-20T18:36:00.916 INFO:tasks.workunit.client.0.smithi017.stdout:8/418: creat d0/d6/d28/d3a/f86 x:0 0 0 2024-09-20T18:36:00.917 INFO:tasks.workunit.client.0.smithi017.stdout:9/681: mknod d6/d23/d58/d3f/d82/cf7 0 2024-09-20T18:36:00.918 INFO:tasks.workunit.client.0.smithi017.stdout:7/464: write da/d16/d1c/d40/d30/d50/f73 [1401585,98006] 0 2024-09-20T18:36:00.919 INFO:tasks.workunit.client.0.smithi017.stdout:9/682: write d6/d23/d40/db4/fce [866152,26087] 0 2024-09-20T18:36:00.920 INFO:tasks.workunit.client.0.smithi017.stdout:4/392: mknod d4/dc/d41/c80 0 2024-09-20T18:36:00.921 INFO:tasks.workunit.client.0.smithi017.stdout:0/428: mkdir d4/db/d1e/d42/d95 0 2024-09-20T18:36:00.922 INFO:tasks.workunit.client.0.smithi017.stdout:4/393: dread - d4/dc/d1e/d69/f72 zero size 2024-09-20T18:36:00.923 INFO:tasks.workunit.client.0.smithi017.stdout:0/429: write d4/db/d18/d25/d36/f82 [310525,129946] 0 2024-09-20T18:36:00.924 INFO:tasks.workunit.client.0.smithi017.stdout:6/432: mknod d4/df/d1f/d25/d3f/c95 0 2024-09-20T18:36:00.926 INFO:tasks.workunit.client.0.smithi017.stdout:0/430: chown d4/db/d1e/d24/d2f/d51/d52/f57 993 1 2024-09-20T18:36:00.929 INFO:tasks.workunit.client.0.smithi017.stdout:2/666: fdatasync d1/dc/d20/d2e/f42 0 2024-09-20T18:36:00.932 INFO:tasks.workunit.client.0.smithi017.stdout:1/446: unlink df/d35/f5c 0 2024-09-20T18:36:00.940 INFO:tasks.workunit.client.0.smithi017.stdout:7/465: rename da/d16/d1c/d40/d30/d50 to da/d16/d8e 0 2024-09-20T18:36:00.941 INFO:tasks.workunit.client.0.smithi017.stdout:7/466: chown da/d16/d1c/f61 936212214 1 2024-09-20T18:36:00.945 INFO:tasks.workunit.client.0.smithi017.stdout:6/433: readlink d4/l4c 0 2024-09-20T18:36:00.952 INFO:tasks.workunit.client.0.smithi017.stdout:1/447: symlink df/d16/l89 0 2024-09-20T18:36:00.954 INFO:tasks.workunit.client.0.smithi017.stdout:5/399: dwrite d0/d14/d18/d57/f4e [0,4194304] 0 2024-09-20T18:36:00.956 INFO:tasks.workunit.client.0.smithi017.stdout:8/419: mknod d0/c87 0 2024-09-20T18:36:00.963 INFO:tasks.workunit.client.0.smithi017.stdout:0/431: write d4/db/d1e/d42/f61 [595780,124388] 0 2024-09-20T18:36:00.964 INFO:tasks.workunit.client.0.smithi017.stdout:0/432: readlink d4/d20/l89 0 2024-09-20T18:36:00.966 INFO:tasks.workunit.client.0.smithi017.stdout:4/394: link d4/f5b d4/de/d1b/f81 0 2024-09-20T18:36:00.972 INFO:tasks.workunit.client.0.smithi017.stdout:1/448: mknod df/d3b/d7c/c8a 0 2024-09-20T18:36:00.972 INFO:tasks.workunit.client.0.smithi017.stdout:3/646: sync 2024-09-20T18:36:00.974 INFO:tasks.workunit.client.0.smithi017.stdout:5/400: unlink d0/d14/d18/d19/f1a 0 2024-09-20T18:36:00.975 INFO:tasks.workunit.client.0.smithi017.stdout:6/434: dwrite d4/d29/f39 [0,4194304] 0 2024-09-20T18:36:00.978 INFO:tasks.workunit.client.0.smithi017.stdout:9/683: dwrite d6/f37 [0,4194304] 0 2024-09-20T18:36:00.982 INFO:tasks.workunit.client.0.smithi017.stdout:0/433: unlink d4/d20/c6e 0 2024-09-20T18:36:00.982 INFO:tasks.workunit.client.0.smithi017.stdout:0/434: chown d4/db/l1f 8542553 1 2024-09-20T18:36:00.985 INFO:tasks.workunit.client.0.smithi017.stdout:1/449: rmdir df/d35 39 2024-09-20T18:36:00.986 INFO:tasks.workunit.client.0.smithi017.stdout:3/647: fsync da/de/d13/d2f/d26/d31/f36 0 2024-09-20T18:36:00.988 INFO:tasks.workunit.client.0.smithi017.stdout:5/401: fdatasync d0/d14/d18/d2a/d39/f53 0 2024-09-20T18:36:00.990 INFO:tasks.workunit.client.0.smithi017.stdout:2/667: rename d1/dc/d20/d2e/d30/d85/d46/d48/f4a to d1/dc/d20/d2e/d30/fd3 0 2024-09-20T18:36:00.992 INFO:tasks.workunit.client.0.smithi017.stdout:2/668: read d1/d67/d8f/d9e/f9f [2152110,129723] 0 2024-09-20T18:36:00.994 INFO:tasks.workunit.client.0.smithi017.stdout:0/435: dwrite d4/d20/f6c [0,4194304] 0 2024-09-20T18:36:00.995 INFO:tasks.workunit.client.0.smithi017.stdout:0/436: dread - d4/db/d1e/d66/f93 zero size 2024-09-20T18:36:00.995 INFO:tasks.workunit.client.0.smithi017.stdout:2/669: write d1/dc/d20/d2e/d30/d85/d46/f65 [1261407,40777] 0 2024-09-20T18:36:00.997 INFO:tasks.workunit.client.0.smithi017.stdout:6/435: truncate d4/d37/d41/f54 919143 0 2024-09-20T18:36:00.997 INFO:tasks.workunit.client.0.smithi017.stdout:4/395: mkdir d4/d82 0 2024-09-20T18:36:00.999 INFO:tasks.workunit.client.0.smithi017.stdout:5/402: mkdir d0/d14/d18/d19/d85 0 2024-09-20T18:36:01.002 INFO:tasks.workunit.client.0.smithi017.stdout:5/403: chown d0/d14/d40/f63 281117 1 2024-09-20T18:36:01.002 INFO:tasks.workunit.client.0.smithi017.stdout:7/467: rename da/fc to da/f8f 0 2024-09-20T18:36:01.004 INFO:tasks.workunit.client.0.smithi017.stdout:2/670: creat d1/d67/d8f/dcd/fd4 x:0 0 0 2024-09-20T18:36:01.007 INFO:tasks.workunit.client.0.smithi017.stdout:5/404: read d0/d14/d18/d2a/d39/d42/f62 [128680,21155] 0 2024-09-20T18:36:01.007 INFO:tasks.workunit.client.0.smithi017.stdout:3/648: dwrite da/f15 [4194304,4194304] 0 2024-09-20T18:36:01.008 INFO:tasks.workunit.client.0.smithi017.stdout:2/671: write d1/f92 [3892640,17658] 0 2024-09-20T18:36:01.011 INFO:tasks.workunit.client.0.smithi017.stdout:8/420: rename d0/d6/d28/d3d/d4e/c66 to d0/d6/d28/d3b/c88 0 2024-09-20T18:36:01.011 INFO:tasks.workunit.client.0.smithi017.stdout:3/649: chown da/de/d13/d16/d6e/d97/l99 12 1 2024-09-20T18:36:01.012 INFO:tasks.workunit.client.0.smithi017.stdout:3/650: stat da/de/c24 0 2024-09-20T18:36:01.014 INFO:tasks.workunit.client.0.smithi017.stdout:3/651: fdatasync da/de/d53/d52/f63 0 2024-09-20T18:36:01.017 INFO:tasks.workunit.client.0.smithi017.stdout:5/405: dwrite d0/d14/d18/d2a/d39/f50 [4194304,4194304] 0 2024-09-20T18:36:01.018 INFO:tasks.workunit.client.0.smithi017.stdout:7/468: write da/d16/d8e/d75/f28 [1459249,99895] 0 2024-09-20T18:36:01.025 INFO:tasks.workunit.client.0.smithi017.stdout:9/684: link d6/d23/d58/d3f/d4d/c92 d6/d23/d58/d3f/d2f/cf8 0 2024-09-20T18:36:01.027 INFO:tasks.workunit.client.0.smithi017.stdout:4/396: mknod d4/dc/d1e/d69/d7a/c83 0 2024-09-20T18:36:01.030 INFO:tasks.workunit.client.0.smithi017.stdout:4/397: write d4/d19/f64 [7488351,81661] 0 2024-09-20T18:36:01.031 INFO:tasks.workunit.client.0.smithi017.stdout:1/450: dwrite df/d1c/d45/f57 [0,4194304] 0 2024-09-20T18:36:01.034 INFO:tasks.workunit.client.0.smithi017.stdout:7/469: dwrite da/d54/f8c [0,4194304] 0 2024-09-20T18:36:01.035 INFO:tasks.workunit.client.0.smithi017.stdout:4/398: dread - d4/d19/d37/d66/f6f zero size 2024-09-20T18:36:01.038 INFO:tasks.workunit.client.0.smithi017.stdout:4/399: readlink d4/l9 0 2024-09-20T18:36:01.047 INFO:tasks.workunit.client.0.smithi017.stdout:7/470: dwrite da/d16/f47 [0,4194304] 0 2024-09-20T18:36:01.051 INFO:tasks.workunit.client.0.smithi017.stdout:4/400: dwrite d4/dc/d1e/d26/d4e/f6b [0,4194304] 0 2024-09-20T18:36:01.051 INFO:tasks.workunit.client.0.smithi017.stdout:1/451: symlink df/d16/d50/d69/l8b 0 2024-09-20T18:36:01.052 INFO:tasks.workunit.client.0.smithi017.stdout:4/401: stat d4/dc/f12 0 2024-09-20T18:36:01.055 INFO:tasks.workunit.client.0.smithi017.stdout:1/452: dread df/d16/f21 [0,4194304] 0 2024-09-20T18:36:01.055 INFO:tasks.workunit.client.0.smithi017.stdout:6/436: truncate d4/df/d1f/d25/d3f/d5c/f61 50530 0 2024-09-20T18:36:01.056 INFO:tasks.workunit.client.0.smithi017.stdout:6/437: write d4/d29/f81 [159396,537] 0 2024-09-20T18:36:01.058 INFO:tasks.workunit.client.0.smithi017.stdout:6/438: write d4/df/d1f/d25/d3f/f5b [470731,14226] 0 2024-09-20T18:36:01.059 INFO:tasks.workunit.client.0.smithi017.stdout:5/406: mknod d0/d14/d18/d19/d85/c86 0 2024-09-20T18:36:01.060 INFO:tasks.workunit.client.0.smithi017.stdout:6/439: fdatasync d4/d37/d41/d43/d7d/f88 0 2024-09-20T18:36:01.061 INFO:tasks.workunit.client.0.smithi017.stdout:7/471: creat da/d16/f90 x:0 0 0 2024-09-20T18:36:01.067 INFO:tasks.workunit.client.0.smithi017.stdout:2/672: creat d1/dc/d20/d2e/d30/d85/fd5 x:0 0 0 2024-09-20T18:36:01.067 INFO:tasks.workunit.client.0.smithi017.stdout:1/453: rmdir df/d29 39 2024-09-20T18:36:01.070 INFO:tasks.workunit.client.0.smithi017.stdout:5/407: creat d0/d14/d18/d19/d85/f87 x:0 0 0 2024-09-20T18:36:01.071 INFO:tasks.workunit.client.0.smithi017.stdout:6/440: mknod d4/df/d1f/d25/c96 0 2024-09-20T18:36:01.071 INFO:tasks.workunit.client.0.smithi017.stdout:2/673: truncate d1/dc/d20/d2e/d30/d85/d3d/fab 828283 0 2024-09-20T18:36:01.073 INFO:tasks.workunit.client.0.smithi017.stdout:5/408: readlink d0/d14/d18/d2a/d39/d42/l48 0 2024-09-20T18:36:01.075 INFO:tasks.workunit.client.0.smithi017.stdout:9/685: getdents d6/d11/dbb 0 2024-09-20T18:36:01.077 INFO:tasks.workunit.client.0.smithi017.stdout:1/454: chown df/d29/l2d 2018691 1 2024-09-20T18:36:01.078 INFO:tasks.workunit.client.0.smithi017.stdout:7/472: truncate da/f11 303080 0 2024-09-20T18:36:01.080 INFO:tasks.workunit.client.0.smithi017.stdout:7/473: truncate da/f81 592896 0 2024-09-20T18:36:01.080 INFO:tasks.workunit.client.0.smithi017.stdout:2/674: dwrite d1/df/d17/f64 [0,4194304] 0 2024-09-20T18:36:01.081 INFO:tasks.workunit.client.0.smithi017.stdout:6/441: creat d4/df/d1f/d70/f97 x:0 0 0 2024-09-20T18:36:01.083 INFO:tasks.workunit.client.0.smithi017.stdout:4/402: write d4/dc/d1e/d26/d4e/f6b [4551700,57184] 0 2024-09-20T18:36:01.087 INFO:tasks.workunit.client.0.smithi017.stdout:9/686: creat d6/d23/d58/d3f/d4d/d73/d93/ff9 x:0 0 0 2024-09-20T18:36:01.089 INFO:tasks.workunit.client.0.smithi017.stdout:9/687: truncate d6/d23/d58/d3f/d4d/d73/fb7 781436 0 2024-09-20T18:36:01.090 INFO:tasks.workunit.client.0.smithi017.stdout:1/455: write df/f36 [254276,6046] 0 2024-09-20T18:36:01.091 INFO:tasks.workunit.client.0.smithi017.stdout:9/688: write d6/d23/d40/db4/fce [1137223,28605] 0 2024-09-20T18:36:01.092 INFO:tasks.workunit.client.0.smithi017.stdout:1/456: truncate df/d29/f61 596166 0 2024-09-20T18:36:01.094 INFO:tasks.workunit.client.0.smithi017.stdout:6/442: rename d4/df/l6b to d4/df/d8a/l98 0 2024-09-20T18:36:01.095 INFO:tasks.workunit.client.0.smithi017.stdout:9/689: truncate d6/d23/d58/d3f/d4d/ff1 961290 0 2024-09-20T18:36:01.095 INFO:tasks.workunit.client.0.smithi017.stdout:4/403: rmdir d4/dc/d41 39 2024-09-20T18:36:01.095 INFO:tasks.workunit.client.0.smithi017.stdout:7/474: mkdir da/d16/d1c/d40/d3a/d8a/d91 0 2024-09-20T18:36:01.101 INFO:tasks.workunit.client.0.smithi017.stdout:5/409: rmdir d0/d14/d18/d2a/d6f 0 2024-09-20T18:36:01.102 INFO:tasks.workunit.client.0.smithi017.stdout:1/457: dwrite df/d1c/f70 [4194304,4194304] 0 2024-09-20T18:36:01.106 INFO:tasks.workunit.client.0.smithi017.stdout:6/443: read - d4/d37/f6a zero size 2024-09-20T18:36:01.108 INFO:tasks.workunit.client.0.smithi017.stdout:6/444: stat d4/d29 0 2024-09-20T18:36:01.108 INFO:tasks.workunit.client.0.smithi017.stdout:4/404: dwrite d4/d19/f64 [8388608,4194304] 0 2024-09-20T18:36:01.112 INFO:tasks.workunit.client.0.smithi017.stdout:9/690: dread d6/fe [0,4194304] 0 2024-09-20T18:36:01.122 INFO:tasks.workunit.client.0.smithi017.stdout:2/675: creat d1/dc/d20/d2e/d30/d85/d46/fd6 x:0 0 0 2024-09-20T18:36:01.123 INFO:tasks.workunit.client.0.smithi017.stdout:7/475: mkdir da/d16/d92 0 2024-09-20T18:36:01.126 INFO:tasks.workunit.client.0.smithi017.stdout:7/476: read da/d16/d1c/d40/f7a [459047,88135] 0 2024-09-20T18:36:01.128 INFO:tasks.workunit.client.0.smithi017.stdout:5/410: symlink d0/d14/d18/d1b/l88 0 2024-09-20T18:36:01.130 INFO:tasks.workunit.client.0.smithi017.stdout:2/676: dwrite d1/dc/d20/d2e/d30/d85/d3d/fab [0,4194304] 0 2024-09-20T18:36:01.131 INFO:tasks.workunit.client.0.smithi017.stdout:2/677: readlink d1/df/d17/l1c 0 2024-09-20T18:36:01.132 INFO:tasks.workunit.client.0.smithi017.stdout:4/405: write d4/de/d1b/f45 [4196136,57487] 0 2024-09-20T18:36:01.139 INFO:tasks.workunit.client.0.smithi017.stdout:5/411: dwrite d0/d14/d18/f2f [0,4194304] 0 2024-09-20T18:36:01.140 INFO:tasks.workunit.client.0.smithi017.stdout:7/477: creat da/d16/d1c/d40/d3a/f93 x:0 0 0 2024-09-20T18:36:01.143 INFO:tasks.workunit.client.0.smithi017.stdout:4/406: dwrite d4/dc/d1e/d26/d4e/f5f [0,4194304] 0 2024-09-20T18:36:01.145 INFO:tasks.workunit.client.0.smithi017.stdout:1/458: write df/d1c/f1e [3014528,100456] 0 2024-09-20T18:36:01.146 INFO:tasks.workunit.client.0.smithi017.stdout:2/678: mknod d1/dc/d20/d2e/d30/d85/d98/cd7 0 2024-09-20T18:36:01.151 INFO:tasks.workunit.client.0.smithi017.stdout:6/445: write d4/f21 [391360,6073] 0 2024-09-20T18:36:01.153 INFO:tasks.workunit.client.0.smithi017.stdout:7/478: dwrite da/d16/d1c/d40/f7d [0,4194304] 0 2024-09-20T18:36:01.159 INFO:tasks.workunit.client.0.smithi017.stdout:1/459: creat df/d16/d50/d69/f8c x:0 0 0 2024-09-20T18:36:01.163 INFO:tasks.workunit.client.0.smithi017.stdout:9/691: dwrite d6/d23/f6d [0,4194304] 0 2024-09-20T18:36:01.175 INFO:tasks.workunit.client.0.smithi017.stdout:7/479: mkdir da/d94 0 2024-09-20T18:36:01.176 INFO:tasks.workunit.client.0.smithi017.stdout:9/692: symlink d6/d23/d58/d3f/d4d/lfa 0 2024-09-20T18:36:01.179 INFO:tasks.workunit.client.0.smithi017.stdout:1/460: fsync df/d29/f3a 0 2024-09-20T18:36:01.181 INFO:tasks.workunit.client.0.smithi017.stdout:2/679: rename d1/dc/d20/d2e/d30/d85/d3d/f34 to d1/dc/d20/d2e/d30/d85/fd8 0 2024-09-20T18:36:01.181 INFO:tasks.workunit.client.0.smithi017.stdout:7/480: dwrite da/d16/d1c/f4c [0,4194304] 0 2024-09-20T18:36:01.188 INFO:tasks.workunit.client.0.smithi017.stdout:9/693: rename d6/d23/d58/d3f/d2f/l4b to d6/d23/d58/d3f/d82/lfb 0 2024-09-20T18:36:01.189 INFO:tasks.workunit.client.0.smithi017.stdout:7/481: rmdir da/d16/d1c/d40/d3a 39 2024-09-20T18:36:01.191 INFO:tasks.workunit.client.0.smithi017.stdout:2/680: symlink d1/dc/d20/d2e/db5/ld9 0 2024-09-20T18:36:01.192 INFO:tasks.workunit.client.0.smithi017.stdout:9/694: symlink d6/d23/d58/d3f/d2f/lfc 0 2024-09-20T18:36:01.196 INFO:tasks.workunit.client.0.smithi017.stdout:2/681: rename d1/dc/fa9 to d1/dc/d20/daa/fda 0 2024-09-20T18:36:01.199 INFO:tasks.workunit.client.0.smithi017.stdout:1/461: rmdir df/d35/d6b/d73 0 2024-09-20T18:36:01.200 INFO:tasks.workunit.client.0.smithi017.stdout:1/462: read df/d16/d50/f83 [5149715,37338] 0 2024-09-20T18:36:01.201 INFO:tasks.workunit.client.0.smithi017.stdout:1/463: read df/f18 [850778,106878] 0 2024-09-20T18:36:01.207 INFO:tasks.workunit.client.0.smithi017.stdout:5/412: write d0/d14/d18/d2a/d39/d6c/d72/f74 [78294,79777] 0 2024-09-20T18:36:01.209 INFO:tasks.workunit.client.0.smithi017.stdout:2/682: getdents d1/dc/d20/d2e/d30/db0/dc2 0 2024-09-20T18:36:01.210 INFO:tasks.workunit.client.0.smithi017.stdout:2/683: readlink d1/dc/d20/d2e/d30/d85/d3d/dad/lc1 0 2024-09-20T18:36:01.212 INFO:tasks.workunit.client.0.smithi017.stdout:4/407: write d4/d19/f42 [829030,53277] 0 2024-09-20T18:36:01.217 INFO:tasks.workunit.client.0.smithi017.stdout:4/408: creat d4/dc/d1e/d69/d7a/f84 x:0 0 0 2024-09-20T18:36:01.218 INFO:tasks.workunit.client.0.smithi017.stdout:5/413: symlink d0/d14/l89 0 2024-09-20T18:36:01.218 INFO:tasks.workunit.client.0.smithi017.stdout:2/684: dwrite d1/dc/d20/d2e/d30/d85/d53/fc4 [0,4194304] 0 2024-09-20T18:36:01.220 INFO:tasks.workunit.client.0.smithi017.stdout:2/685: stat d1/d1f/c5e 0 2024-09-20T18:36:01.222 INFO:tasks.workunit.client.0.smithi017.stdout:2/686: stat d1/dc/d20/d2e/d30/d85/fd8 0 2024-09-20T18:36:01.223 INFO:tasks.workunit.client.0.smithi017.stdout:4/409: symlink d4/dc/l85 0 2024-09-20T18:36:01.225 INFO:tasks.workunit.client.0.smithi017.stdout:6/446: dwrite d4/d37/d41/d43/f92 [0,4194304] 0 2024-09-20T18:36:01.228 INFO:tasks.workunit.client.0.smithi017.stdout:4/410: fdatasync d4/dc/d1e/d69/f72 0 2024-09-20T18:36:01.234 INFO:tasks.workunit.client.0.smithi017.stdout:6/447: chown d4/df/d1f/d25/d3f/d5c/f6d 131513394 1 2024-09-20T18:36:01.234 INFO:tasks.workunit.client.0.smithi017.stdout:5/414: dwrite d0/d14/d18/d19/d4d/d6d/d78/f66 [0,4194304] 0 2024-09-20T18:36:01.235 INFO:tasks.workunit.client.0.smithi017.stdout:4/411: write d4/dc/d1e/d69/d7a/f84 [65763,104751] 0 2024-09-20T18:36:01.238 INFO:tasks.workunit.client.0.smithi017.stdout:4/412: stat d4/d19/f64 0 2024-09-20T18:36:01.248 INFO:tasks.workunit.client.0.smithi017.stdout:2/687: dwrite d1/dc/d20/d2e/f38 [0,4194304] 0 2024-09-20T18:36:01.252 INFO:tasks.workunit.client.0.smithi017.stdout:4/413: mknod d4/dc/d1e/d26/d22/c86 0 2024-09-20T18:36:01.256 INFO:tasks.workunit.client.0.smithi017.stdout:7/482: truncate da/d16/f4a 2766571 0 2024-09-20T18:36:01.256 INFO:tasks.workunit.client.0.smithi017.stdout:6/448: dwrite d4/df/d1f/d70/f97 [0,4194304] 0 2024-09-20T18:36:01.256 INFO:tasks.workunit.client.0.smithi017.stdout:5/415: dwrite d0/d14/d18/d19/f82 [0,4194304] 0 2024-09-20T18:36:01.256 INFO:tasks.workunit.client.0.smithi017.stdout:2/688: write d1/df/fa8 [933627,130451] 0 2024-09-20T18:36:01.259 INFO:tasks.workunit.client.0.smithi017.stdout:7/483: chown da/d16/f5e 692307 1 2024-09-20T18:36:01.262 INFO:tasks.workunit.client.0.smithi017.stdout:6/449: dread - d4/d37/d41/d43/d7d/f79 zero size 2024-09-20T18:36:01.265 INFO:tasks.workunit.client.0.smithi017.stdout:4/414: dwrite d4/d19/d37/f77 [0,4194304] 0 2024-09-20T18:36:01.267 INFO:tasks.workunit.client.0.smithi017.stdout:4/415: write d4/f6c [402627,126552] 0 2024-09-20T18:36:01.270 INFO:tasks.workunit.client.0.smithi017.stdout:7/484: unlink da/f13 0 2024-09-20T18:36:01.271 INFO:tasks.workunit.client.0.smithi017.stdout:1/464: write fc [1736465,74109] 0 2024-09-20T18:36:01.272 INFO:tasks.workunit.client.0.smithi017.stdout:7/485: dread - da/d54/f76 zero size 2024-09-20T18:36:01.277 INFO:tasks.workunit.client.0.smithi017.stdout:9/695: truncate d6/d23/d58/d3f/d44/f59 1994740 0 2024-09-20T18:36:01.281 INFO:tasks.workunit.client.0.smithi017.stdout:5/416: rename d0/d14/d18/d2a/d39/l68 to d0/d6e/l8a 0 2024-09-20T18:36:01.283 INFO:tasks.workunit.client.0.smithi017.stdout:5/417: chown d0/d14/d18/d19/d4d/d6d/d78 488 1 2024-09-20T18:36:01.284 INFO:tasks.workunit.client.0.smithi017.stdout:6/450: symlink d4/d37/d41/d43/d7d/l99 0 2024-09-20T18:36:01.285 INFO:tasks.workunit.client.0.smithi017.stdout:6/451: fsync d4/df/d4a/f4b 0 2024-09-20T18:36:01.285 INFO:tasks.workunit.client.0.smithi017.stdout:4/416: creat d4/dc/d1e/d69/f87 x:0 0 0 2024-09-20T18:36:01.288 INFO:tasks.workunit.client.0.smithi017.stdout:4/417: write d4/de/d1b/f4c [1323437,24856] 0 2024-09-20T18:36:01.289 INFO:tasks.workunit.client.0.smithi017.stdout:4/418: dread - d4/d19/d37/d66/f6f zero size 2024-09-20T18:36:01.291 INFO:tasks.workunit.client.0.smithi017.stdout:4/419: dread - d4/dc/f75 zero size 2024-09-20T18:36:01.297 INFO:tasks.workunit.client.0.smithi017.stdout:5/418: symlink d0/d14/d18/d1b/l8b 0 2024-09-20T18:36:01.306 INFO:tasks.workunit.client.0.smithi017.stdout:0/437: sync 2024-09-20T18:36:01.306 INFO:tasks.workunit.client.0.smithi017.stdout:3/652: sync 2024-09-20T18:36:01.306 INFO:tasks.workunit.client.0.smithi017.stdout:8/421: sync 2024-09-20T18:36:01.310 INFO:tasks.workunit.client.0.smithi017.stdout:1/465: symlink df/d29/d7e/l8d 0 2024-09-20T18:36:01.319 INFO:tasks.workunit.client.0.smithi017.stdout:5/419: rmdir d0/d14/d18/d19/d4d/d6d/d78/d7b 39 2024-09-20T18:36:01.319 INFO:tasks.workunit.client.0.smithi017.stdout:5/420: chown d0/d14/d18 948 1 2024-09-20T18:36:01.320 INFO:tasks.workunit.client.0.smithi017.stdout:5/421: stat d0/d14/d18/d19/d4d 0 2024-09-20T18:36:01.322 INFO:tasks.workunit.client.0.smithi017.stdout:5/422: chown d0/d14/d18/d2a/d39/d6c/d72/f74 134287 1 2024-09-20T18:36:01.325 INFO:tasks.workunit.client.0.smithi017.stdout:0/438: mknod d4/db/d1e/d24/d2f/d51/d52/c96 0 2024-09-20T18:36:01.330 INFO:tasks.workunit.client.0.smithi017.stdout:3/653: mkdir da/de/d13/d16/d50/dd2 0 2024-09-20T18:36:01.330 INFO:tasks.workunit.client.0.smithi017.stdout:5/423: dwrite d0/d14/d18/d19/d85/f87 [0,4194304] 0 2024-09-20T18:36:01.340 INFO:tasks.workunit.client.0.smithi017.stdout:9/696: mkdir d6/d23/d58/d3f/d9d/dfd 0 2024-09-20T18:36:01.342 INFO:tasks.workunit.client.0.smithi017.stdout:6/452: link d4/df/d1f/d25/d3f/d5c/f7b d4/df/f9a 0 2024-09-20T18:36:01.349 INFO:tasks.workunit.client.0.smithi017.stdout:4/420: rename d4/dc/d1e/d26/d22 to d4/d82/d88 0 2024-09-20T18:36:01.356 INFO:tasks.workunit.client.0.smithi017.stdout:4/421: dread d4/dc/d1e/d26/d4e/f5f [0,4194304] 0 2024-09-20T18:36:01.357 INFO:tasks.workunit.client.0.smithi017.stdout:9/697: dread d6/d23/d3a/f7b [0,4194304] 0 2024-09-20T18:36:01.364 INFO:tasks.workunit.client.0.smithi017.stdout:8/422: link d0/d6/d28/f5a d0/d6/d28/d3d/d4e/f89 0 2024-09-20T18:36:01.368 INFO:tasks.workunit.client.0.smithi017.stdout:1/466: creat df/d16/d50/d87/f8e x:0 0 0 2024-09-20T18:36:01.370 INFO:tasks.workunit.client.0.smithi017.stdout:1/467: fdatasync df/d16/d50/d69/f4c 0 2024-09-20T18:36:01.382 INFO:tasks.workunit.client.0.smithi017.stdout:4/422: symlink d4/de/d1b/l89 0 2024-09-20T18:36:01.389 INFO:tasks.workunit.client.0.smithi017.stdout:2/689: write d1/dc/d20/d2e/d30/d85/f7d [3168282,77038] 0 2024-09-20T18:36:01.390 INFO:tasks.workunit.client.0.smithi017.stdout:6/453: dread d4/df/d1f/d25/d3f/d5c/f6d [0,4194304] 0 2024-09-20T18:36:01.392 INFO:tasks.workunit.client.0.smithi017.stdout:6/454: fsync d4/d29/f39 0 2024-09-20T18:36:01.393 INFO:tasks.workunit.client.0.smithi017.stdout:7/486: dwrite da/f22 [4194304,4194304] 0 2024-09-20T18:36:01.396 INFO:tasks.workunit.client.0.smithi017.stdout:4/423: dread d4/d19/d37/f57 [0,4194304] 0 2024-09-20T18:36:01.396 INFO:tasks.workunit.client.0.smithi017.stdout:6/455: truncate d4/df/d4a/f6c 996826 0 2024-09-20T18:36:01.397 INFO:tasks.workunit.client.0.smithi017.stdout:6/456: read d4/df/d4a/f6c [29050,98503] 0 2024-09-20T18:36:01.407 INFO:tasks.workunit.client.0.smithi017.stdout:1/468: dwrite df/f2b [0,4194304] 0 2024-09-20T18:36:01.409 INFO:tasks.workunit.client.0.smithi017.stdout:7/487: symlink da/d16/d8e/d75/l95 0 2024-09-20T18:36:01.410 INFO:tasks.workunit.client.0.smithi017.stdout:1/469: write df/d16/d50/d69/f4c [4075005,47443] 0 2024-09-20T18:36:01.412 INFO:tasks.workunit.client.0.smithi017.stdout:6/457: dread d4/df/d1f/d25/f58 [0,4194304] 0 2024-09-20T18:36:01.418 INFO:tasks.workunit.client.0.smithi017.stdout:2/690: dread d1/dc/d20/d2e/f49 [0,4194304] 0 2024-09-20T18:36:01.424 INFO:tasks.workunit.client.0.smithi017.stdout:0/439: write d4/f17 [1339745,105486] 0 2024-09-20T18:36:01.425 INFO:tasks.workunit.client.0.smithi017.stdout:4/424: symlink d4/dc/d1e/d69/d79/l8a 0 2024-09-20T18:36:01.426 INFO:tasks.workunit.client.0.smithi017.stdout:4/425: dread - d4/d19/f5e zero size 2024-09-20T18:36:01.428 INFO:tasks.workunit.client.0.smithi017.stdout:1/470: fsync df/f2b 0 2024-09-20T18:36:01.431 INFO:tasks.workunit.client.0.smithi017.stdout:7/488: mkdir da/d16/d1c/d40/d34/d96 0 2024-09-20T18:36:01.434 INFO:tasks.workunit.client.0.smithi017.stdout:0/440: truncate d4/d37/f8b 177487 0 2024-09-20T18:36:01.434 INFO:tasks.workunit.client.0.smithi017.stdout:5/424: dwrite d0/d14/d18/d2a/f37 [0,4194304] 0 2024-09-20T18:36:01.435 INFO:tasks.workunit.client.0.smithi017.stdout:4/426: mknod d4/dc/d1e/c8b 0 2024-09-20T18:36:01.448 INFO:tasks.workunit.client.0.smithi017.stdout:3/654: truncate da/de/d13/d2f/d26/d31/d5a/f6d 6637868 0 2024-09-20T18:36:01.449 INFO:tasks.workunit.client.0.smithi017.stdout:0/441: symlink d4/d20/d63/l97 0 2024-09-20T18:36:01.451 INFO:tasks.workunit.client.0.smithi017.stdout:8/423: write d0/d6/d28/d3d/d4e/f51 [1707185,80072] 0 2024-09-20T18:36:01.451 INFO:tasks.workunit.client.0.smithi017.stdout:5/425: truncate d0/d14/d18/d57/f7d 1387943 0 2024-09-20T18:36:01.454 INFO:tasks.workunit.client.0.smithi017.stdout:5/426: dread d0/d14/d18/d2a/d39/d6c/d72/f16 [4194304,4194304] 0 2024-09-20T18:36:01.457 INFO:tasks.workunit.client.0.smithi017.stdout:7/489: symlink da/l97 0 2024-09-20T18:36:01.460 INFO:tasks.workunit.client.0.smithi017.stdout:0/442: creat d4/db/d18/d25/d36/f98 x:0 0 0 2024-09-20T18:36:01.460 INFO:tasks.workunit.client.0.smithi017.stdout:0/443: chown d4 31 1 2024-09-20T18:36:01.462 INFO:tasks.workunit.client.0.smithi017.stdout:8/424: mkdir d0/d6/d28/d3d/d4e/d55/d8a 0 2024-09-20T18:36:01.467 INFO:tasks.workunit.client.0.smithi017.stdout:0/444: fsync d4/db/f4e 0 2024-09-20T18:36:01.468 INFO:tasks.workunit.client.0.smithi017.stdout:4/427: link d4/de/c29 d4/d19/d37/c8c 0 2024-09-20T18:36:01.471 INFO:tasks.workunit.client.0.smithi017.stdout:5/427: unlink d0/d14/c4a 0 2024-09-20T18:36:01.473 INFO:tasks.workunit.client.0.smithi017.stdout:1/471: getdents df/d29/d2c 0 2024-09-20T18:36:01.475 INFO:tasks.workunit.client.0.smithi017.stdout:7/490: write da/d16/d1c/d40/d30/f87 [88742,43451] 0 2024-09-20T18:36:01.476 INFO:tasks.workunit.client.0.smithi017.stdout:4/428: dwrite d4/f6c [0,4194304] 0 2024-09-20T18:36:01.480 INFO:tasks.workunit.client.0.smithi017.stdout:6/458: truncate d4/df/d1f/d25/f7c 1197467 0 2024-09-20T18:36:01.482 INFO:tasks.workunit.client.0.smithi017.stdout:4/429: dread d4/f6c [0,4194304] 0 2024-09-20T18:36:01.484 INFO:tasks.workunit.client.0.smithi017.stdout:6/459: dread d4/f21 [0,4194304] 0 2024-09-20T18:36:01.484 INFO:tasks.workunit.client.0.smithi017.stdout:4/430: fdatasync d4/dc/d1e/d26/d4e/f6b 0 2024-09-20T18:36:01.485 INFO:tasks.workunit.client.0.smithi017.stdout:4/431: chown f3 109087721 1 2024-09-20T18:36:01.485 INFO:tasks.workunit.client.0.smithi017.stdout:5/428: rename d0/d14/d18/f7a to d0/d14/d18/d2a/d39/d42/f8c 0 2024-09-20T18:36:01.486 INFO:tasks.workunit.client.0.smithi017.stdout:0/445: symlink d4/db/d18/d78/l99 0 2024-09-20T18:36:01.487 INFO:tasks.workunit.client.0.smithi017.stdout:0/446: chown d4/db/d1e/d42/f61 430340 1 2024-09-20T18:36:01.488 INFO:tasks.workunit.client.0.smithi017.stdout:0/447: chown d4/db/d1e/d42/d95 191070 1 2024-09-20T18:36:01.489 INFO:tasks.workunit.client.0.smithi017.stdout:7/491: fdatasync da/d16/d1c/d40/d34/d3c/f88 0 2024-09-20T18:36:01.490 INFO:tasks.workunit.client.0.smithi017.stdout:7/492: readlink da/l19 0 2024-09-20T18:36:01.494 INFO:tasks.workunit.client.0.smithi017.stdout:2/691: dwrite d1/dc/d20/d2e/d30/d85/d46/d48/f5d [0,4194304] 0 2024-09-20T18:36:01.495 INFO:tasks.workunit.client.0.smithi017.stdout:1/472: mkdir df/d8f 0 2024-09-20T18:36:01.500 INFO:tasks.workunit.client.0.smithi017.stdout:6/460: rename d4/d37/d68/d8d/f90 to d4/df/d4a/f9b 0 2024-09-20T18:36:01.501 INFO:tasks.workunit.client.0.smithi017.stdout:6/461: fdatasync d4/df/d4a/f6f 0 2024-09-20T18:36:01.502 INFO:tasks.workunit.client.0.smithi017.stdout:4/432: creat d4/de/d1b/f8d x:0 0 0 2024-09-20T18:36:01.503 INFO:tasks.workunit.client.0.smithi017.stdout:3/655: write da/de/d13/d2f/d26/d41/f73 [2171711,51715] 0 2024-09-20T18:36:01.508 INFO:tasks.workunit.client.0.smithi017.stdout:8/425: getdents d0/d6/d28/d3b/d72 0 2024-09-20T18:36:01.509 INFO:tasks.workunit.client.0.smithi017.stdout:8/426: dread - d0/d6/d28/d3a/f86 zero size 2024-09-20T18:36:01.515 INFO:tasks.workunit.client.0.smithi017.stdout:1/473: creat df/d16/d50/d53/f90 x:0 0 0 2024-09-20T18:36:01.516 INFO:tasks.workunit.client.0.smithi017.stdout:8/427: dwrite d0/f5f [0,4194304] 0 2024-09-20T18:36:01.520 INFO:tasks.workunit.client.0.smithi017.stdout:5/429: rename d0/d14/d18/d2a/d39/d6c/d72/f25 to d0/d14/d18/d2a/d39/d42/d7e/f8d 0 2024-09-20T18:36:01.523 INFO:tasks.workunit.client.0.smithi017.stdout:6/462: creat d4/d37/d68/d8d/f9c x:0 0 0 2024-09-20T18:36:01.530 INFO:tasks.workunit.client.0.smithi017.stdout:7/493: mkdir da/d16/d1c/d40/d30/d98 0 2024-09-20T18:36:01.530 INFO:tasks.workunit.client.0.smithi017.stdout:0/448: write d4/d20/f32 [1192167,39057] 0 2024-09-20T18:36:01.531 INFO:tasks.workunit.client.0.smithi017.stdout:4/433: dwrite d4/f54 [0,4194304] 0 2024-09-20T18:36:01.531 INFO:tasks.workunit.client.0.smithi017.stdout:2/692: creat d1/d1f/d99/da6/fdb x:0 0 0 2024-09-20T18:36:01.535 INFO:tasks.workunit.client.0.smithi017.stdout:4/434: truncate d4/f54 4839573 0 2024-09-20T18:36:01.537 INFO:tasks.workunit.client.0.smithi017.stdout:8/428: mkdir d0/d65/d8b 0 2024-09-20T18:36:01.540 INFO:tasks.workunit.client.0.smithi017.stdout:3/656: mkdir da/de/d53/d88/db3/dd3 0 2024-09-20T18:36:01.543 INFO:tasks.workunit.client.0.smithi017.stdout:2/693: creat d1/dc/d20/d2e/d30/d85/d98/fdc x:0 0 0 2024-09-20T18:36:01.546 INFO:tasks.workunit.client.0.smithi017.stdout:1/474: symlink df/d8f/l91 0 2024-09-20T18:36:01.547 INFO:tasks.workunit.client.0.smithi017.stdout:4/435: write d4/f6c [813754,114827] 0 2024-09-20T18:36:01.548 INFO:tasks.workunit.client.0.smithi017.stdout:6/463: mknod d4/df/d4a/d8f/c9d 0 2024-09-20T18:36:01.552 INFO:tasks.workunit.client.0.smithi017.stdout:7/494: mknod da/d16/d1c/d40/d30/d98/c99 0 2024-09-20T18:36:01.553 INFO:tasks.workunit.client.0.smithi017.stdout:2/694: dread d1/dc/d20/d2e/d30/d85/d3d/fc0 [0,4194304] 0 2024-09-20T18:36:01.555 INFO:tasks.workunit.client.0.smithi017.stdout:1/475: creat df/d29/d2c/f92 x:0 0 0 2024-09-20T18:36:01.558 INFO:tasks.workunit.client.0.smithi017.stdout:4/436: unlink d4/dc/d1e/d26/d4e/f6b 0 2024-09-20T18:36:01.562 INFO:tasks.workunit.client.0.smithi017.stdout:5/430: dwrite d0/d14/d18/d1b/f26 [0,4194304] 0 2024-09-20T18:36:01.564 INFO:tasks.workunit.client.0.smithi017.stdout:4/437: truncate d4/d19/d37/d66/f6f 669066 0 2024-09-20T18:36:01.566 INFO:tasks.workunit.client.0.smithi017.stdout:4/438: truncate d4/de/d1b/f2f 2519414 0 2024-09-20T18:36:01.566 INFO:tasks.workunit.client.0.smithi017.stdout:5/431: write d0/d14/d18/d19/d4d/d6d/d78/f77 [834340,13651] 0 2024-09-20T18:36:01.569 INFO:tasks.workunit.client.0.smithi017.stdout:8/429: creat d0/d6/d28/f8c x:0 0 0 2024-09-20T18:36:01.569 INFO:tasks.workunit.client.0.smithi017.stdout:3/657: dread da/de/d13/d2f/d26/d31/d5a/f8f [0,4194304] 0 2024-09-20T18:36:01.574 INFO:tasks.workunit.client.0.smithi017.stdout:3/658: read da/de/d13/d16/d6e/d82/f8c [3892027,120801] 0 2024-09-20T18:36:01.575 INFO:tasks.workunit.client.0.smithi017.stdout:0/449: getdents d4/db/d1e/d24/d2f/d69 0 2024-09-20T18:36:01.575 INFO:tasks.workunit.client.0.smithi017.stdout:4/439: dwrite d4/d19/f42 [0,4194304] 0 2024-09-20T18:36:01.577 INFO:tasks.workunit.client.0.smithi017.stdout:6/464: write d4/d37/d41/d43/f78 [655563,25391] 0 2024-09-20T18:36:01.582 INFO:tasks.workunit.client.0.smithi017.stdout:4/440: write d4/de/d1b/d56/d67/f6e [3653975,23241] 0 2024-09-20T18:36:01.585 INFO:tasks.workunit.client.0.smithi017.stdout:8/430: write d0/d6/d28/d81/d82/f84 [931863,44418] 0 2024-09-20T18:36:01.588 INFO:tasks.workunit.client.0.smithi017.stdout:3/659: dwrite da/de/d53/f44 [0,4194304] 0 2024-09-20T18:36:01.596 INFO:tasks.workunit.client.0.smithi017.stdout:1/476: creat df/d1c/f93 x:0 0 0 2024-09-20T18:36:01.597 INFO:tasks.workunit.client.0.smithi017.stdout:5/432: symlink d0/l8e 0 2024-09-20T18:36:01.597 INFO:tasks.workunit.client.0.smithi017.stdout:2/695: dwrite d1/d67/d8f/d9e/f9f [0,4194304] 0 2024-09-20T18:36:01.598 INFO:tasks.workunit.client.0.smithi017.stdout:4/441: mkdir d4/dc/d1e/d8e 0 2024-09-20T18:36:01.605 INFO:tasks.workunit.client.0.smithi017.stdout:7/495: dwrite da/f49 [0,4194304] 0 2024-09-20T18:36:01.607 INFO:tasks.workunit.client.0.smithi017.stdout:5/433: mknod d0/d14/d18/d19/d4d/c8f 0 2024-09-20T18:36:01.608 INFO:tasks.workunit.client.0.smithi017.stdout:0/450: dwrite d4/fa [0,4194304] 0 2024-09-20T18:36:01.612 INFO:tasks.workunit.client.0.smithi017.stdout:3/660: symlink da/de/d13/d2f/d26/d62/da5/da9/dbb/ld4 0 2024-09-20T18:36:01.615 INFO:tasks.workunit.client.0.smithi017.stdout:9/698: sync 2024-09-20T18:36:01.621 INFO:tasks.workunit.client.0.smithi017.stdout:4/442: mkdir d4/d82/d88/d5c/d8f 0 2024-09-20T18:36:01.622 INFO:tasks.workunit.client.0.smithi017.stdout:9/699: chown d6/d11/lc3 6 1 2024-09-20T18:36:01.623 INFO:tasks.workunit.client.0.smithi017.stdout:2/696: creat d1/dc/d20/d2e/d30/d8a/fdd x:0 0 0 2024-09-20T18:36:01.631 INFO:tasks.workunit.client.0.smithi017.stdout:7/496: mknod da/c9a 0 2024-09-20T18:36:01.632 INFO:tasks.workunit.client.0.smithi017.stdout:0/451: mknod d4/db/d18/d25/d36/d47/d81/c9a 0 2024-09-20T18:36:01.633 INFO:tasks.workunit.client.0.smithi017.stdout:8/431: dread d0/d6/f56 [0,4194304] 0 2024-09-20T18:36:01.634 INFO:tasks.workunit.client.0.smithi017.stdout:4/443: fdatasync d4/de/f27 0 2024-09-20T18:36:01.635 INFO:tasks.workunit.client.0.smithi017.stdout:6/465: dwrite d4/fd [0,4194304] 0 2024-09-20T18:36:01.636 INFO:tasks.workunit.client.0.smithi017.stdout:1/477: getdents df/d29/d2c/d5b 0 2024-09-20T18:36:01.636 INFO:tasks.workunit.client.0.smithi017.stdout:9/700: write d6/f7 [2660918,80518] 0 2024-09-20T18:36:01.642 INFO:tasks.workunit.client.0.smithi017.stdout:3/661: dwrite da/de/d13/d2f/d26/d31/d5a/d76/f6a [0,4194304] 0 2024-09-20T18:36:01.646 INFO:tasks.workunit.client.0.smithi017.stdout:6/466: chown d4/df/d1f/d25/d2b/c60 24137289 1 2024-09-20T18:36:01.648 INFO:tasks.workunit.client.0.smithi017.stdout:5/434: dread d0/f10 [4194304,4194304] 0 2024-09-20T18:36:01.652 INFO:tasks.workunit.client.0.smithi017.stdout:8/432: dwrite d0/d6/f25 [0,4194304] 0 2024-09-20T18:36:01.653 INFO:tasks.workunit.client.0.smithi017.stdout:6/467: chown d4/df/d1f/d25/d2b/c60 14740 1 2024-09-20T18:36:01.655 INFO:tasks.workunit.client.0.smithi017.stdout:0/452: dwrite d4/db/d18/d25/d36/f76 [0,4194304] 0 2024-09-20T18:36:01.657 INFO:tasks.workunit.client.0.smithi017.stdout:0/453: chown d4/db/d1e/d24/d2f 20377 1 2024-09-20T18:36:01.659 INFO:tasks.workunit.client.0.smithi017.stdout:2/697: mknod d1/dc/d20/d2e/d30/d85/d3d/d77/d7a/cde 0 2024-09-20T18:36:01.663 INFO:tasks.workunit.client.0.smithi017.stdout:7/497: creat da/d16/d92/f9b x:0 0 0 2024-09-20T18:36:01.664 INFO:tasks.workunit.client.0.smithi017.stdout:6/468: unlink d4/df/d1f/d25/d3f/d5c/f7e 0 2024-09-20T18:36:01.666 INFO:tasks.workunit.client.0.smithi017.stdout:8/433: rename d0/d65/c77 to d0/d65/d8b/c8d 0 2024-09-20T18:36:01.667 INFO:tasks.workunit.client.0.smithi017.stdout:1/478: symlink df/d35/l94 0 2024-09-20T18:36:01.668 INFO:tasks.workunit.client.0.smithi017.stdout:9/701: mkdir d6/d23/d58/d3f/d70/dfe 0 2024-09-20T18:36:01.671 INFO:tasks.workunit.client.0.smithi017.stdout:5/435: symlink d0/d14/d18/d19/d4d/d6d/d78/l90 0 2024-09-20T18:36:01.673 INFO:tasks.workunit.client.0.smithi017.stdout:7/498: creat da/d16/f9c x:0 0 0 2024-09-20T18:36:01.679 INFO:tasks.workunit.client.0.smithi017.stdout:6/469: fdatasync d4/f21 0 2024-09-20T18:36:01.680 INFO:tasks.workunit.client.0.smithi017.stdout:0/454: dread d4/db/d18/f19 [0,4194304] 0 2024-09-20T18:36:01.681 INFO:tasks.workunit.client.0.smithi017.stdout:2/698: dread d1/dc/d20/d2e/d30/d85/fd8 [0,4194304] 0 2024-09-20T18:36:01.682 INFO:tasks.workunit.client.0.smithi017.stdout:9/702: readlink d6/d23/lef 0 2024-09-20T18:36:01.682 INFO:tasks.workunit.client.0.smithi017.stdout:0/455: truncate d4/d20/f6f 508267 0 2024-09-20T18:36:01.689 INFO:tasks.workunit.client.0.smithi017.stdout:0/456: dwrite d4/db/d1e/f35 [0,4194304] 0 2024-09-20T18:36:01.691 INFO:tasks.workunit.client.0.smithi017.stdout:7/499: creat da/d16/d1c/d40/d5d/f9d x:0 0 0 2024-09-20T18:36:01.696 INFO:tasks.workunit.client.0.smithi017.stdout:1/479: symlink df/d1c/d80/l95 0 2024-09-20T18:36:01.697 INFO:tasks.workunit.client.0.smithi017.stdout:6/470: mkdir d4/df/d1f/d70/d9e 0 2024-09-20T18:36:01.698 INFO:tasks.workunit.client.0.smithi017.stdout:6/471: write d4/df/d4a/f6f [8708254,114932] 0 2024-09-20T18:36:01.702 INFO:tasks.workunit.client.0.smithi017.stdout:2/699: mkdir d1/dc/d20/d2e/d30/d8a/ddf 0 2024-09-20T18:36:01.703 INFO:tasks.workunit.client.0.smithi017.stdout:4/444: getdents d4/de/d1b 0 2024-09-20T18:36:01.706 INFO:tasks.workunit.client.0.smithi017.stdout:0/457: creat d4/db/d18/d25/d36/d47/d81/f9b x:0 0 0 2024-09-20T18:36:01.715 INFO:tasks.workunit.client.0.smithi017.stdout:0/458: readlink d4/db/d1e/d24/d2f/l5d 0 2024-09-20T18:36:01.718 INFO:tasks.workunit.client.0.smithi017.stdout:7/500: symlink da/d16/d1c/d40/d3a/d8a/l9e 0 2024-09-20T18:36:01.722 INFO:tasks.workunit.client.0.smithi017.stdout:7/501: read - da/d16/d1c/d40/d34/f6e zero size 2024-09-20T18:36:01.722 INFO:tasks.workunit.client.0.smithi017.stdout:9/703: write d6/d23/f71 [230950,17299] 0 2024-09-20T18:36:01.726 INFO:tasks.workunit.client.0.smithi017.stdout:0/459: dread d4/db/d1e/f35 [0,4194304] 0 2024-09-20T18:36:01.726 INFO:tasks.workunit.client.0.smithi017.stdout:4/445: mknod d4/d82/d88/d5c/d8f/c90 0 2024-09-20T18:36:01.730 INFO:tasks.workunit.client.0.smithi017.stdout:5/436: dwrite d0/d14/d18/f38 [0,4194304] 0 2024-09-20T18:36:01.730 INFO:tasks.workunit.client.0.smithi017.stdout:4/446: chown d4/d19/d37 87 1 2024-09-20T18:36:01.730 INFO:tasks.workunit.client.0.smithi017.stdout:7/502: dread - da/d16/d1c/d40/d5d/f9d zero size 2024-09-20T18:36:01.730 INFO:tasks.workunit.client.0.smithi017.stdout:6/472: write d4/f9 [551976,32965] 0 2024-09-20T18:36:01.731 INFO:tasks.workunit.client.0.smithi017.stdout:2/700: link d1/d1f/c2b d1/dc/d20/d2e/d30/d85/d53/d6b/ce0 0 2024-09-20T18:36:01.731 INFO:tasks.workunit.client.0.smithi017.stdout:1/480: dwrite df/d16/f21 [0,4194304] 0 2024-09-20T18:36:01.739 INFO:tasks.workunit.client.0.smithi017.stdout:0/460: stat d4/db/c13 0 2024-09-20T18:36:01.739 INFO:tasks.workunit.client.0.smithi017.stdout:5/437: rmdir d0/d14/d18/d19 39 2024-09-20T18:36:01.744 INFO:tasks.workunit.client.0.smithi017.stdout:6/473: unlink d4/d29/f39 0 2024-09-20T18:36:01.745 INFO:tasks.workunit.client.0.smithi017.stdout:0/461: read d4/db/d1e/d24/d2f/f6b [2165818,105977] 0 2024-09-20T18:36:01.746 INFO:tasks.workunit.client.0.smithi017.stdout:4/447: dwrite d4/de/d1b/f58 [0,4194304] 0 2024-09-20T18:36:01.747 INFO:tasks.workunit.client.0.smithi017.stdout:7/503: creat da/d16/d1c/d40/d5d/f9f x:0 0 0 2024-09-20T18:36:01.750 INFO:tasks.workunit.client.0.smithi017.stdout:0/462: chown d4/db/d1e/d24/f4b 3506 1 2024-09-20T18:36:01.761 INFO:tasks.workunit.client.0.smithi017.stdout:5/438: dread d0/d14/d18/d19/d4d/d6d/d78/f66 [0,4194304] 0 2024-09-20T18:36:01.762 INFO:tasks.workunit.client.0.smithi017.stdout:7/504: creat da/d16/d1c/d40/d30/d98/fa0 x:0 0 0 2024-09-20T18:36:01.762 INFO:tasks.workunit.client.0.smithi017.stdout:4/448: dwrite d4/d19/f5e [0,4194304] 0 2024-09-20T18:36:01.764 INFO:tasks.workunit.client.0.smithi017.stdout:9/704: link d6/d23/d3a/db8/lf2 d6/d23/d58/d3f/d4d/d73/d7d/dbd/lff 0 2024-09-20T18:36:01.767 INFO:tasks.workunit.client.0.smithi017.stdout:0/463: dwrite d4/db/d1e/d42/f61 [0,4194304] 0 2024-09-20T18:36:01.768 INFO:tasks.workunit.client.0.smithi017.stdout:5/439: read d0/fe [1090763,57711] 0 2024-09-20T18:36:01.769 INFO:tasks.workunit.client.0.smithi017.stdout:6/474: creat d4/df/d1f/d70/d9e/f9f x:0 0 0 2024-09-20T18:36:01.771 INFO:tasks.workunit.client.0.smithi017.stdout:1/481: getdents df/d35 0 2024-09-20T18:36:01.773 INFO:tasks.workunit.client.0.smithi017.stdout:2/701: dwrite d1/dc/d20/d2e/f62 [0,4194304] 0 2024-09-20T18:36:01.773 INFO:tasks.workunit.client.0.smithi017.stdout:6/475: chown d4/df/d1f/f22 398048 1 2024-09-20T18:36:01.773 INFO:tasks.workunit.client.0.smithi017.stdout:0/464: fsync d4/db/d18/f79 0 2024-09-20T18:36:01.775 INFO:tasks.workunit.client.0.smithi017.stdout:9/705: write d6/d23/d3a/d61/de7/faf [1476508,25987] 0 2024-09-20T18:36:01.775 INFO:tasks.workunit.client.0.smithi017.stdout:4/449: mkdir d4/d7f/d91 0 2024-09-20T18:36:01.776 INFO:tasks.workunit.client.0.smithi017.stdout:7/505: mknod da/d16/d1c/d40/d3a/d8a/ca1 0 2024-09-20T18:36:01.777 INFO:tasks.workunit.client.0.smithi017.stdout:6/476: dread - d4/d37/d41/d43/d7d/f88 zero size 2024-09-20T18:36:01.779 INFO:tasks.workunit.client.0.smithi017.stdout:1/482: unlink df/d16/d50/d53/l6d 0 2024-09-20T18:36:01.784 INFO:tasks.workunit.client.0.smithi017.stdout:9/706: mkdir d6/d23/d58/d3f/d4d/d100 0 2024-09-20T18:36:01.786 INFO:tasks.workunit.client.0.smithi017.stdout:0/465: mkdir d4/db/d18/d25/d36/d47/d81/d9c 0 2024-09-20T18:36:01.787 INFO:tasks.workunit.client.0.smithi017.stdout:5/440: dwrite d0/d14/d18/d1b/f5c [0,4194304] 0 2024-09-20T18:36:01.788 INFO:tasks.workunit.client.0.smithi017.stdout:5/441: stat d0/d14/d18/d2a/f37 0 2024-09-20T18:36:01.790 INFO:tasks.workunit.client.0.smithi017.stdout:4/450: mkdir d4/d82/d88/d5c/d8f/d92 0 2024-09-20T18:36:01.790 INFO:tasks.workunit.client.0.smithi017.stdout:6/477: fdatasync d4/df/d4a/f9b 0 2024-09-20T18:36:01.791 INFO:tasks.workunit.client.0.smithi017.stdout:2/702: dwrite d1/dc/d20/d2e/d30/f79 [0,4194304] 0 2024-09-20T18:36:01.792 INFO:tasks.workunit.client.0.smithi017.stdout:4/451: chown d4/de/l50 36 1 2024-09-20T18:36:01.794 INFO:tasks.workunit.client.0.smithi017.stdout:7/506: fdatasync da/d16/f4a 0 2024-09-20T18:36:01.796 INFO:tasks.workunit.client.0.smithi017.stdout:9/707: unlink d6/d23/f6d 0 2024-09-20T18:36:01.797 INFO:tasks.workunit.client.0.smithi017.stdout:7/507: chown da/d16/d1c/f1f 7 1 2024-09-20T18:36:01.799 INFO:tasks.workunit.client.0.smithi017.stdout:2/703: creat d1/d1f/fe1 x:0 0 0 2024-09-20T18:36:01.801 INFO:tasks.workunit.client.0.smithi017.stdout:2/704: chown d1/dc/d20/d2e/d30/c80 0 1 2024-09-20T18:36:01.802 INFO:tasks.workunit.client.0.smithi017.stdout:7/508: unlink da/d16/d1c/f61 0 2024-09-20T18:36:01.805 INFO:tasks.workunit.client.0.smithi017.stdout:5/442: symlink d0/d14/l91 0 2024-09-20T18:36:01.807 INFO:tasks.workunit.client.0.smithi017.stdout:2/705: creat d1/dc/d20/d2e/db5/fe2 x:0 0 0 2024-09-20T18:36:01.949 INFO:tasks.workunit.client.0.smithi017.stdout:7/509: mknod da/d16/d1c/d40/d30/ca2 0 2024-09-20T18:36:01.950 INFO:tasks.workunit.client.0.smithi017.stdout:7/510: fdatasync da/f8d 0 2024-09-20T18:36:01.951 INFO:tasks.workunit.client.0.smithi017.stdout:7/511: chown da/d16/d8e/d75/c39 95185168 1 2024-09-20T18:36:01.953 INFO:tasks.workunit.client.0.smithi017.stdout:0/466: write d4/d37/f3a [882204,63235] 0 2024-09-20T18:36:01.956 INFO:tasks.workunit.client.0.smithi017.stdout:2/706: creat d1/dc/d20/d2e/d30/d8a/ddf/fe3 x:0 0 0 2024-09-20T18:36:01.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:01 smithi172 ceph-mon[35456]: pgmap v35: 65 pgs: 65 active+clean; 3.1 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 72 MiB/s rd, 205 MiB/s wr, 406 op/s 2024-09-20T18:36:01.959 INFO:tasks.workunit.client.0.smithi017.stdout:9/708: write d6/d23/d58/d3f/d4d/f67 [1577954,51632] 0 2024-09-20T18:36:01.961 INFO:tasks.workunit.client.0.smithi017.stdout:9/709: read - d6/d23/d3a/fc4 zero size 2024-09-20T18:36:01.961 INFO:tasks.workunit.client.0.smithi017.stdout:0/467: unlink d4/db/d18/d25/f31 0 2024-09-20T18:36:01.966 INFO:tasks.workunit.client.0.smithi017.stdout:2/707: dwrite d1/dc/d20/d2e/d30/d85/d46/d48/f5d [0,4194304] 0 2024-09-20T18:36:01.967 INFO:tasks.workunit.client.0.smithi017.stdout:2/708: dread - d1/d67/d8f/fa4 zero size 2024-09-20T18:36:01.968 INFO:tasks.workunit.client.0.smithi017.stdout:5/443: truncate d0/d14/d18/f38 200673 0 2024-09-20T18:36:01.972 INFO:tasks.workunit.client.0.smithi017.stdout:9/710: dwrite d6/d23/d58/f94 [0,4194304] 0 2024-09-20T18:36:01.979 INFO:tasks.workunit.client.0.smithi017.stdout:9/711: creat d6/d23/d58/d3f/d4d/d73/d8f/f101 x:0 0 0 2024-09-20T18:36:01.980 INFO:tasks.workunit.client.0.smithi017.stdout:7/512: link da/d16/d1c/d40/d30/f78 da/d16/d92/fa3 0 2024-09-20T18:36:01.983 INFO:tasks.workunit.client.0.smithi017.stdout:2/709: creat d1/dc/d20/d2e/d30/db0/dc2/fe4 x:0 0 0 2024-09-20T18:36:01.985 INFO:tasks.workunit.client.0.smithi017.stdout:5/444: truncate d0/d14/d18/d2a/d39/d42/f62 1986460 0 2024-09-20T18:36:01.990 INFO:tasks.workunit.client.0.smithi017.stdout:7/513: symlink da/d16/d1c/la4 0 2024-09-20T18:36:01.992 INFO:tasks.workunit.client.0.smithi017.stdout:9/712: dread d6/d23/d40/db4/dba/f84 [0,4194304] 0 2024-09-20T18:36:01.992 INFO:tasks.workunit.client.0.smithi017.stdout:7/514: chown da/d16/d1c/d40 53 1 2024-09-20T18:36:01.994 INFO:tasks.workunit.client.0.smithi017.stdout:5/445: dwrite d0/d14/d18/d57/f5d [0,4194304] 0 2024-09-20T18:36:01.997 INFO:tasks.workunit.client.0.smithi017.stdout:0/468: write d4/db/f4e [1733865,92986] 0 2024-09-20T18:36:02.000 INFO:tasks.workunit.client.0.smithi017.stdout:9/713: mkdir d6/d23/d40/db4/d102 0 2024-09-20T18:36:02.004 INFO:tasks.workunit.client.0.smithi017.stdout:7/515: dwrite da/d54/f71 [0,4194304] 0 2024-09-20T18:36:02.012 INFO:tasks.workunit.client.0.smithi017.stdout:0/469: symlink d4/db/d1e/d24/d2f/d51/d52/l9d 0 2024-09-20T18:36:02.029 INFO:tasks.workunit.client.0.smithi017.stdout:9/714: rename d6/d23/d58/d3f/f76 to d6/d23/d58/d3f/d4d/d73/d7d/dbd/f103 0 2024-09-20T18:36:02.030 INFO:tasks.workunit.client.0.smithi017.stdout:0/470: mknod d4/db/d1e/d24/d2f/c9e 0 2024-09-20T18:36:02.031 INFO:tasks.workunit.client.0.smithi017.stdout:0/471: write d4/db/d18/f8d [648513,5573] 0 2024-09-20T18:36:02.032 INFO:tasks.workunit.client.0.smithi017.stdout:5/446: write d0/d14/d18/f38 [881457,31022] 0 2024-09-20T18:36:02.035 INFO:tasks.workunit.client.0.smithi017.stdout:5/447: truncate d0/d14/d18/d19/d4d/d6d/d78/f77 1421826 0 2024-09-20T18:36:02.040 INFO:tasks.workunit.client.0.smithi017.stdout:7/516: getdents da/d16/d1c/d40/d3a 0 2024-09-20T18:36:02.041 INFO:tasks.workunit.client.0.smithi017.stdout:0/472: creat d4/d20/d63/d86/f9f x:0 0 0 2024-09-20T18:36:02.041 INFO:tasks.workunit.client.0.smithi017.stdout:0/473: read d4/db/f5b [649876,66837] 0 2024-09-20T18:36:02.049 INFO:tasks.workunit.client.0.smithi017.stdout:5/448: link d0/d14/d18/d57/c44 d0/d14/d18/d2a/d39/d42/c92 0 2024-09-20T18:36:02.051 INFO:tasks.workunit.client.0.smithi017.stdout:5/449: creat d0/d6e/f93 x:0 0 0 2024-09-20T18:36:02.052 INFO:tasks.workunit.client.0.smithi017.stdout:9/715: link d6/d23/d40/db4/dba/l6b d6/d23/d58/d3f/d70/dfe/l104 0 2024-09-20T18:36:02.053 INFO:tasks.workunit.client.0.smithi017.stdout:7/517: rename da/f81 to da/d16/d1c/d40/d5d/fa5 0 2024-09-20T18:36:02.056 INFO:tasks.workunit.client.0.smithi017.stdout:9/716: chown d6/d23/d58/d3f/d4d/d73/d7d/dbd/f103 4 1 2024-09-20T18:36:02.103 INFO:tasks.workunit.client.0.smithi017.stdout:5/450: creat d0/d14/d18/f94 x:0 0 0 2024-09-20T18:36:02.103 INFO:tasks.workunit.client.0.smithi017.stdout:7/518: chown da/d16/d1c/d40/l5b 609 1 2024-09-20T18:36:02.103 INFO:tasks.workunit.client.0.smithi017.stdout:9/717: readlink d6/d23/d40/l83 0 2024-09-20T18:36:02.108 INFO:tasks.workunit.client.0.smithi017.stdout:7/519: rename da/d16/d1c/d40/d34/d3c/f4e to da/d54/fa6 0 2024-09-20T18:36:02.109 INFO:tasks.workunit.client.0.smithi017.stdout:7/520: fdatasync da/d16/d8e/d75/f89 0 2024-09-20T18:36:02.117 INFO:tasks.workunit.client.0.smithi017.stdout:9/718: getdents d6/d23/d58 0 2024-09-20T18:36:02.120 INFO:tasks.workunit.client.0.smithi017.stdout:5/451: write d0/d14/d18/d2a/d39/d42/f62 [645500,21651] 0 2024-09-20T18:36:02.122 INFO:tasks.workunit.client.0.smithi017.stdout:5/452: read d0/d14/d18/d57/f4e [4003350,94786] 0 2024-09-20T18:36:02.124 INFO:tasks.workunit.client.0.smithi017.stdout:7/521: mkdir da/d16/d1c/d40/d5d/da7 0 2024-09-20T18:36:02.128 INFO:tasks.workunit.client.0.smithi017.stdout:9/719: link d6/fec d6/d23/d58/d3f/d4d/f105 0 2024-09-20T18:36:02.129 INFO:tasks.workunit.client.0.smithi017.stdout:5/453: rename d0/d14/d18/d2a/d39/d6c/d72/f74 to d0/d6e/f95 0 2024-09-20T18:36:02.131 INFO:tasks.workunit.client.0.smithi017.stdout:7/522: symlink da/d16/d1c/d40/d3a/la8 0 2024-09-20T18:36:02.133 INFO:tasks.workunit.client.0.smithi017.stdout:7/523: mkdir da/d16/d1c/d40/d3a/da9 0 2024-09-20T18:36:02.134 INFO:tasks.workunit.client.0.smithi017.stdout:5/454: write d0/d14/f28 [3013804,80474] 0 2024-09-20T18:36:02.135 INFO:tasks.workunit.client.0.smithi017.stdout:5/455: write d0/d6e/f93 [91080,116642] 0 2024-09-20T18:36:02.135 INFO:tasks.workunit.client.0.smithi017.stdout:7/524: mknod da/d54/caa 0 2024-09-20T18:36:02.138 INFO:tasks.workunit.client.0.smithi017.stdout:5/456: mkdir d0/d14/d18/d19/d4d/d96 0 2024-09-20T18:36:02.143 INFO:tasks.workunit.client.0.smithi017.stdout:7/525: rename da/d16/d1c/f4c to da/d16/d92/fab 0 2024-09-20T18:36:02.148 INFO:tasks.workunit.client.0.smithi017.stdout:5/457: creat d0/d14/d18/f97 x:0 0 0 2024-09-20T18:36:02.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:01 smithi017 ceph-mon[28058]: pgmap v35: 65 pgs: 65 active+clean; 3.1 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 72 MiB/s rd, 205 MiB/s wr, 406 op/s 2024-09-20T18:36:02.151 INFO:tasks.workunit.client.0.smithi017.stdout:7/526: write da/d16/d1c/d40/d5d/f60 [2785963,53677] 0 2024-09-20T18:36:02.187 INFO:tasks.workunit.client.0.smithi017.stdout:3/662: sync 2024-09-20T18:36:02.187 INFO:tasks.workunit.client.0.smithi017.stdout:8/434: sync 2024-09-20T18:36:02.188 INFO:tasks.workunit.client.0.smithi017.stdout:8/435: read d0/d6/f67 [4122029,6853] 0 2024-09-20T18:36:02.190 INFO:tasks.workunit.client.0.smithi017.stdout:3/663: truncate da/de/d13/d16/f77 2279436 0 2024-09-20T18:36:02.192 INFO:tasks.workunit.client.0.smithi017.stdout:8/436: creat d0/d6/d73/f8e x:0 0 0 2024-09-20T18:36:02.197 INFO:tasks.workunit.client.0.smithi017.stdout:8/437: creat d0/d6/d73/f8f x:0 0 0 2024-09-20T18:36:02.200 INFO:tasks.workunit.client.0.smithi017.stdout:3/664: rename da/de/d53/c4b to da/de/d13/d2f/cd5 0 2024-09-20T18:36:02.203 INFO:tasks.workunit.client.0.smithi017.stdout:8/438: getdents d0/d6/d28/d3d 0 2024-09-20T18:36:02.204 INFO:tasks.workunit.client.0.smithi017.stdout:8/439: mknod d0/d65/c90 0 2024-09-20T18:36:02.207 INFO:tasks.workunit.client.0.smithi017.stdout:8/440: mkdir d0/d65/d8b/d91 0 2024-09-20T18:36:02.208 INFO:tasks.workunit.client.0.smithi017.stdout:3/665: dwrite da/de/d13/d2f/d26/d31/faf [0,4194304] 0 2024-09-20T18:36:02.212 INFO:tasks.workunit.client.0.smithi017.stdout:8/441: mknod d0/d6/d28/d3b/d72/c92 0 2024-09-20T18:36:02.218 INFO:tasks.workunit.client.0.smithi017.stdout:3/666: link da/de/d53/fa4 da/de/d13/d2f/d26/fd6 0 2024-09-20T18:36:02.219 INFO:tasks.workunit.client.0.smithi017.stdout:3/667: write da/de/f8e [3982908,58335] 0 2024-09-20T18:36:02.219 INFO:tasks.workunit.client.0.smithi017.stdout:3/668: stat da/fbc 0 2024-09-20T18:36:02.220 INFO:tasks.workunit.client.0.smithi017.stdout:3/669: chown da/de/d53/d88/db3 1876903 1 2024-09-20T18:36:02.223 INFO:tasks.workunit.client.0.smithi017.stdout:3/670: creat da/de/d53/d52/fd7 x:0 0 0 2024-09-20T18:36:02.272 INFO:tasks.workunit.client.0.smithi017.stdout:1/483: sync 2024-09-20T18:36:02.272 INFO:tasks.workunit.client.0.smithi017.stdout:6/478: sync 2024-09-20T18:36:02.277 INFO:tasks.workunit.client.0.smithi017.stdout:1/484: dwrite df/d16/f2e [0,4194304] 0 2024-09-20T18:36:02.282 INFO:tasks.workunit.client.0.smithi017.stdout:1/485: rename df/d3b/d7c/c8a to df/d29/d7e/c96 0 2024-09-20T18:36:02.285 INFO:tasks.workunit.client.0.smithi017.stdout:1/486: mkdir df/d16/d50/d69/d97 0 2024-09-20T18:36:02.287 INFO:tasks.workunit.client.0.smithi017.stdout:1/487: creat df/d16/d50/d69/f98 x:0 0 0 2024-09-20T18:36:02.304 INFO:tasks.workunit.client.0.smithi017.stdout:6/479: dwrite d4/d37/d41/f77 [0,4194304] 0 2024-09-20T18:36:02.310 INFO:tasks.workunit.client.0.smithi017.stdout:6/480: creat d4/df/fa0 x:0 0 0 2024-09-20T18:36:02.311 INFO:tasks.workunit.client.0.smithi017.stdout:6/481: chown d4/df/d1f/d25/f27 3 1 2024-09-20T18:36:02.314 INFO:tasks.workunit.client.0.smithi017.stdout:6/482: creat d4/df/d1f/d25/d3f/fa1 x:0 0 0 2024-09-20T18:36:02.316 INFO:tasks.workunit.client.0.smithi017.stdout:6/483: mkdir d4/d37/d68/d8d/da2 0 2024-09-20T18:36:02.319 INFO:tasks.workunit.client.0.smithi017.stdout:6/484: getdents d4/df/d1f/d25 0 2024-09-20T18:36:02.320 INFO:tasks.workunit.client.0.smithi017.stdout:6/485: mknod d4/df/d4a/ca3 0 2024-09-20T18:36:02.335 INFO:tasks.workunit.client.0.smithi017.stdout:6/486: dread d4/df/d4a/f4b [0,4194304] 0 2024-09-20T18:36:02.336 INFO:tasks.workunit.client.0.smithi017.stdout:6/487: truncate d4/d37/d41/f77 5139499 0 2024-09-20T18:36:02.338 INFO:tasks.workunit.client.0.smithi017.stdout:6/488: rename d4/df/d1f/d70 to d4/d37/d68/da4 0 2024-09-20T18:36:02.341 INFO:tasks.workunit.client.0.smithi017.stdout:6/489: rename d4/df/d1f/f38 to d4/df/d1f/d25/fa5 0 2024-09-20T18:36:02.341 INFO:tasks.workunit.client.0.smithi017.stdout:6/490: chown d4/d37/d41 216195 1 2024-09-20T18:36:02.347 INFO:tasks.workunit.client.0.smithi017.stdout:6/491: dwrite d4/d37/d68/da4/d9e/f9f [0,4194304] 0 2024-09-20T18:36:02.375 INFO:tasks.workunit.client.0.smithi017.stdout:6/492: dwrite d4/df/d1f/d25/d3f/d5c/f6d [0,4194304] 0 2024-09-20T18:36:02.376 INFO:tasks.workunit.client.0.smithi017.stdout:6/493: chown l0 27 1 2024-09-20T18:36:02.383 INFO:tasks.workunit.client.0.smithi017.stdout:6/494: dwrite d4/df/d4a/f8c [0,4194304] 0 2024-09-20T18:36:02.388 INFO:tasks.workunit.client.0.smithi017.stdout:6/495: dread d4/d37/d41/d43/f78 [0,4194304] 0 2024-09-20T18:36:02.416 INFO:tasks.workunit.client.0.smithi017.stdout:4/452: sync 2024-09-20T18:36:02.462 INFO:tasks.workunit.client.0.smithi017.stdout:6/496: dread d4/df/d4a/f6c [0,4194304] 0 2024-09-20T18:36:02.463 INFO:tasks.workunit.client.0.smithi017.stdout:4/453: symlink d4/d7f/l93 0 2024-09-20T18:36:02.464 INFO:tasks.workunit.client.0.smithi017.stdout:4/454: write d4/de/f4f [5206878,95620] 0 2024-09-20T18:36:02.466 INFO:tasks.workunit.client.0.smithi017.stdout:4/455: rmdir d4/dc/d1e/d69 39 2024-09-20T18:36:02.467 INFO:tasks.workunit.client.0.smithi017.stdout:6/497: truncate d4/df/d4a/f5d 186634 0 2024-09-20T18:36:02.470 INFO:tasks.workunit.client.0.smithi017.stdout:6/498: unlink d4/d37/d41/d43/d7d/l33 0 2024-09-20T18:36:02.472 INFO:tasks.workunit.client.0.smithi017.stdout:6/499: chown d4/d37/d41/d43/f92 655 1 2024-09-20T18:36:02.476 INFO:tasks.workunit.client.0.smithi017.stdout:6/500: getdents d4/df/d1f/d25/d2b 0 2024-09-20T18:36:02.488 INFO:tasks.workunit.client.0.smithi017.stdout:6/501: dwrite d4/df/f9a [0,4194304] 0 2024-09-20T18:36:02.492 INFO:tasks.workunit.client.0.smithi017.stdout:6/502: symlink d4/d37/d68/da4/d72/la6 0 2024-09-20T18:36:02.493 INFO:tasks.workunit.client.0.smithi017.stdout:6/503: readlink d4/df/d1f/d25/l83 0 2024-09-20T18:36:02.506 INFO:tasks.workunit.client.0.smithi017.stdout:6/504: dwrite d4/df/f15 [0,4194304] 0 2024-09-20T18:36:02.507 INFO:tasks.workunit.client.0.smithi017.stdout:6/505: read d4/df/d4a/f6c [459733,7636] 0 2024-09-20T18:36:02.515 INFO:tasks.workunit.client.0.smithi017.stdout:6/506: truncate d4/d37/d41/f77 2019364 0 2024-09-20T18:36:02.516 INFO:tasks.workunit.client.0.smithi017.stdout:6/507: dread - d4/d37/d41/d43/d7d/f79 zero size 2024-09-20T18:36:02.523 INFO:tasks.workunit.client.0.smithi017.stdout:6/508: dwrite d4/df/d1f/d25/f58 [0,4194304] 0 2024-09-20T18:36:02.526 INFO:tasks.workunit.client.0.smithi017.stdout:6/509: unlink d4/df/l1d 0 2024-09-20T18:36:02.528 INFO:tasks.workunit.client.0.smithi017.stdout:6/510: rmdir d4/df/d1f/d25 39 2024-09-20T18:36:02.548 INFO:tasks.workunit.client.0.smithi017.stdout:6/511: dwrite d4/d37/d41/d43/d7d/f2f [4194304,4194304] 0 2024-09-20T18:36:02.555 INFO:tasks.workunit.client.0.smithi017.stdout:6/512: creat d4/df/d1f/d25/d2b/fa7 x:0 0 0 2024-09-20T18:36:02.557 INFO:tasks.workunit.client.0.smithi017.stdout:6/513: rename d4/d37/d41/l69 to d4/d37/d41/d43/la8 0 2024-09-20T18:36:02.562 INFO:tasks.workunit.client.0.smithi017.stdout:6/514: rename d4/df/d1f/d25/c40 to d4/df/d4a/ca9 0 2024-09-20T18:36:02.567 INFO:tasks.workunit.client.0.smithi017.stdout:6/515: rename d4/df/d4a/ca3 to d4/df/caa 0 2024-09-20T18:36:02.568 INFO:tasks.workunit.client.0.smithi017.stdout:6/516: mkdir d4/d37/d41/d43/dab 0 2024-09-20T18:36:02.570 INFO:tasks.workunit.client.0.smithi017.stdout:2/710: sync 2024-09-20T18:36:02.573 INFO:tasks.workunit.client.0.smithi017.stdout:6/517: dread d4/d37/d68/da4/d9e/f9f [0,4194304] 0 2024-09-20T18:36:02.583 INFO:tasks.workunit.client.0.smithi017.stdout:2/711: getdents d1/dc/d20/d2e/d30/d85/d53/d6b 0 2024-09-20T18:36:02.584 INFO:tasks.workunit.client.0.smithi017.stdout:6/518: link d4/df/d1f/d25/d3f/d5c/f61 d4/df/d1f/d25/d3f/fac 0 2024-09-20T18:36:02.585 INFO:tasks.workunit.client.0.smithi017.stdout:2/712: chown d1/dc/d20/d2e/d30/d85/d46/fd6 18414387 1 2024-09-20T18:36:02.586 INFO:tasks.workunit.client.0.smithi017.stdout:6/519: creat d4/d37/d68/d8d/fad x:0 0 0 2024-09-20T18:36:02.587 INFO:tasks.workunit.client.0.smithi017.stdout:2/713: unlink d1/dc/d20/l29 0 2024-09-20T18:36:02.589 INFO:tasks.workunit.client.0.smithi017.stdout:6/520: symlink d4/df/d4a/d8f/lae 0 2024-09-20T18:36:02.591 INFO:tasks.workunit.client.0.smithi017.stdout:2/714: creat d1/dc/d20/daa/fe5 x:0 0 0 2024-09-20T18:36:02.594 INFO:tasks.workunit.client.0.smithi017.stdout:6/521: creat d4/df/d1f/faf x:0 0 0 2024-09-20T18:36:02.594 INFO:tasks.workunit.client.0.smithi017.stdout:2/715: rmdir d1/dc/d20/d2e/d30/d85/d98 39 2024-09-20T18:36:02.600 INFO:tasks.workunit.client.0.smithi017.stdout:2/716: dwrite d1/d67/d8f/dcd/fd4 [0,4194304] 0 2024-09-20T18:36:02.687 INFO:tasks.workunit.client.0.smithi017.stdout:2/717: rmdir d1/dc/d20/d2e/d30/d85/d53 39 2024-09-20T18:36:02.697 INFO:tasks.workunit.client.0.smithi017.stdout:6/522: dwrite d4/f1e [0,4194304] 0 2024-09-20T18:36:02.705 INFO:tasks.workunit.client.0.smithi017.stdout:2/718: dread d1/f92 [0,4194304] 0 2024-09-20T18:36:02.707 INFO:tasks.workunit.client.0.smithi017.stdout:6/523: dwrite d4/d37/d68/d8d/f9c [0,4194304] 0 2024-09-20T18:36:02.708 INFO:tasks.workunit.client.0.smithi017.stdout:2/719: write d1/dc/d20/d2e/d30/d85/d46/f65 [1582248,93689] 0 2024-09-20T18:36:02.715 INFO:tasks.workunit.client.0.smithi017.stdout:6/524: symlink d4/d37/d41/d43/lb0 0 2024-09-20T18:36:02.719 INFO:tasks.workunit.client.0.smithi017.stdout:6/525: symlink d4/df/d1f/d25/d2b/lb1 0 2024-09-20T18:36:02.721 INFO:tasks.workunit.client.0.smithi017.stdout:0/474: sync 2024-09-20T18:36:02.721 INFO:tasks.workunit.client.0.smithi017.stdout:9/720: sync 2024-09-20T18:36:02.722 INFO:tasks.workunit.client.0.smithi017.stdout:5/458: sync 2024-09-20T18:36:02.722 INFO:tasks.workunit.client.0.smithi017.stdout:6/526: stat d4/df/d4a/f5d 0 2024-09-20T18:36:02.728 INFO:tasks.workunit.client.0.smithi017.stdout:2/720: link d1/dc/d20/d2e/d30/d85/d98/cd7 d1/dc/d20/d2e/d30/d85/d98/ce6 0 2024-09-20T18:36:02.729 INFO:tasks.workunit.client.0.smithi017.stdout:2/721: fsync d1/dc/d20/d2e/d30/f4b 0 2024-09-20T18:36:02.731 INFO:tasks.workunit.client.0.smithi017.stdout:6/527: rename d4/d37/d68/d8d/da2 to d4/d37/d68/d8d/db2 0 2024-09-20T18:36:02.733 INFO:tasks.workunit.client.0.smithi017.stdout:0/475: truncate d4/db/d1e/d24/d2f/f6b 4384154 0 2024-09-20T18:36:02.735 INFO:tasks.workunit.client.0.smithi017.stdout:5/459: mkdir d0/d14/d18/d19/d4d/d6d/d78/d98 0 2024-09-20T18:36:02.741 INFO:tasks.workunit.client.0.smithi017.stdout:5/460: dwrite d0/d14/d18/d19/d4d/d6d/d78/f77 [0,4194304] 0 2024-09-20T18:36:02.744 INFO:tasks.workunit.client.0.smithi017.stdout:0/476: mknod d4/db/d18/d55/ca0 0 2024-09-20T18:36:02.745 INFO:tasks.workunit.client.0.smithi017.stdout:6/528: creat d4/df/d4a/fb3 x:0 0 0 2024-09-20T18:36:02.749 INFO:tasks.workunit.client.0.smithi017.stdout:9/721: rename d6/d23/d58/d3f/d4d/d73/d93/ff9 to d6/f106 0 2024-09-20T18:36:02.751 INFO:tasks.workunit.client.0.smithi017.stdout:2/722: mknod d1/df/ce7 0 2024-09-20T18:36:02.753 INFO:tasks.workunit.client.0.smithi017.stdout:2/723: fdatasync d1/dc/d20/daa/fda 0 2024-09-20T18:36:02.753 INFO:tasks.workunit.client.0.smithi017.stdout:6/529: rmdir d4/d37/d68/da4/d72 39 2024-09-20T18:36:02.755 INFO:tasks.workunit.client.0.smithi017.stdout:6/530: write d4/fd [4338089,103887] 0 2024-09-20T18:36:02.757 INFO:tasks.workunit.client.0.smithi017.stdout:0/477: link d4/db/d18/f8d d4/db/d18/d25/d36/d47/d81/fa1 0 2024-09-20T18:36:02.758 INFO:tasks.workunit.client.0.smithi017.stdout:9/722: mkdir d6/d23/d58/d3f/d70/db0/dca/d107 0 2024-09-20T18:36:02.760 INFO:tasks.workunit.client.0.smithi017.stdout:5/461: dwrite d0/f10 [4194304,4194304] 0 2024-09-20T18:36:02.761 INFO:tasks.workunit.client.0.smithi017.stdout:0/478: write d4/db/d1e/d24/d2f/d51/d52/d77/f8a [980463,20511] 0 2024-09-20T18:36:02.765 INFO:tasks.workunit.client.0.smithi017.stdout:6/531: rename d4/df/d1f/d25/d2b/c56 to d4/df/d1f/cb4 0 2024-09-20T18:36:02.769 INFO:tasks.workunit.client.0.smithi017.stdout:0/479: symlink d4/db/d1e/d24/d2f/d51/d52/la2 0 2024-09-20T18:36:02.772 INFO:tasks.workunit.client.0.smithi017.stdout:5/462: dwrite d0/d14/d18/f38 [0,4194304] 0 2024-09-20T18:36:02.774 INFO:tasks.workunit.client.0.smithi017.stdout:0/480: symlink d4/d37/la3 0 2024-09-20T18:36:02.779 INFO:tasks.workunit.client.0.smithi017.stdout:6/532: dwrite d4/df/d1f/d25/d3f/fa1 [0,4194304] 0 2024-09-20T18:36:02.781 INFO:tasks.workunit.client.0.smithi017.stdout:0/481: mknod d4/db/d18/ca4 0 2024-09-20T18:36:02.782 INFO:tasks.workunit.client.0.smithi017.stdout:5/463: mkdir d0/d14/d18/d19/d4d/d6d/d78/d99 0 2024-09-20T18:36:02.784 INFO:tasks.workunit.client.0.smithi017.stdout:0/482: symlink d4/db/d18/d25/d36/d47/d81/la5 0 2024-09-20T18:36:02.785 INFO:tasks.workunit.client.0.smithi017.stdout:6/533: creat d4/d37/d41/d43/dab/fb5 x:0 0 0 2024-09-20T18:36:02.786 INFO:tasks.workunit.client.0.smithi017.stdout:6/534: write d4/d37/d41/d43/dab/fb5 [687748,108066] 0 2024-09-20T18:36:02.787 INFO:tasks.workunit.client.0.smithi017.stdout:6/535: chown c1 364672251 1 2024-09-20T18:36:02.788 INFO:tasks.workunit.client.0.smithi017.stdout:6/536: stat d4/d37/d41/d43/f92 0 2024-09-20T18:36:02.788 INFO:tasks.workunit.client.0.smithi017.stdout:0/483: creat d4/d20/d63/d86/fa6 x:0 0 0 2024-09-20T18:36:02.790 INFO:tasks.workunit.client.0.smithi017.stdout:5/464: getdents d0/d14/d18/d1b 0 2024-09-20T18:36:02.792 INFO:tasks.workunit.client.0.smithi017.stdout:6/537: creat d4/d37/d41/d43/dab/fb6 x:0 0 0 2024-09-20T18:36:02.794 INFO:tasks.workunit.client.0.smithi017.stdout:5/465: rmdir d0/d14/d40 39 2024-09-20T18:36:02.794 INFO:tasks.workunit.client.0.smithi017.stdout:9/723: dread d6/d23/d58/d3f/fb9 [0,4194304] 0 2024-09-20T18:36:02.795 INFO:tasks.workunit.client.0.smithi017.stdout:5/466: stat d0/d14/d18/d19/d4d/f7c 0 2024-09-20T18:36:02.796 INFO:tasks.workunit.client.0.smithi017.stdout:6/538: creat d4/df/d1f/d25/d2b/fb7 x:0 0 0 2024-09-20T18:36:02.796 INFO:tasks.workunit.client.0.smithi017.stdout:5/467: dread - d0/d14/d18/f97 zero size 2024-09-20T18:36:02.798 INFO:tasks.workunit.client.0.smithi017.stdout:6/539: dread - d4/d37/d41/d43/d7d/f88 zero size 2024-09-20T18:36:02.803 INFO:tasks.workunit.client.0.smithi017.stdout:6/540: dread d4/df/d4a/f6c [0,4194304] 0 2024-09-20T18:36:02.804 INFO:tasks.workunit.client.0.smithi017.stdout:9/724: dwrite d6/fbf [0,4194304] 0 2024-09-20T18:36:02.805 INFO:tasks.workunit.client.0.smithi017.stdout:6/541: write d4/d37/d68/da4/f97 [3307654,123051] 0 2024-09-20T18:36:02.807 INFO:tasks.workunit.client.0.smithi017.stdout:6/542: readlink d4/df/d1f/d25/l3b 0 2024-09-20T18:36:02.814 INFO:tasks.workunit.client.0.smithi017.stdout:9/725: link d6/fe3 d6/d23/d40/db4/dba/dd7/f108 0 2024-09-20T18:36:02.816 INFO:tasks.workunit.client.0.smithi017.stdout:6/543: dwrite d4/d37/d41/d43/d7d/f2f [0,4194304] 0 2024-09-20T18:36:02.821 INFO:tasks.workunit.client.0.smithi017.stdout:6/544: creat d4/df/d4a/d8f/fb8 x:0 0 0 2024-09-20T18:36:02.823 INFO:tasks.workunit.client.0.smithi017.stdout:5/468: dwrite d0/d14/d18/f5a [0,4194304] 0 2024-09-20T18:36:02.824 INFO:tasks.workunit.client.0.smithi017.stdout:6/545: write d4/d37/d41/d43/d7d/f88 [787831,127550] 0 2024-09-20T18:36:02.826 INFO:tasks.workunit.client.0.smithi017.stdout:9/726: link d6/d23/d58/d3f/d82/f20 d6/dc1/f109 0 2024-09-20T18:36:02.830 INFO:tasks.workunit.client.0.smithi017.stdout:0/484: dread d4/db/d1e/d24/d2f/f5f [0,4194304] 0 2024-09-20T18:36:02.830 INFO:tasks.workunit.client.0.smithi017.stdout:9/727: dread - d6/fc2 zero size 2024-09-20T18:36:02.835 INFO:tasks.workunit.client.0.smithi017.stdout:0/485: creat d4/d20/d63/d86/fa7 x:0 0 0 2024-09-20T18:36:02.835 INFO:tasks.workunit.client.0.smithi017.stdout:5/469: read d0/d14/d18/d2a/d39/d42/d7e/f8d [4011895,20062] 0 2024-09-20T18:36:02.836 INFO:tasks.workunit.client.0.smithi017.stdout:0/486: chown d4/d20/f43 53870 1 2024-09-20T18:36:02.839 INFO:tasks.workunit.client.0.smithi017.stdout:9/728: creat d6/d23/d58/d3f/d70/dd9/f10a x:0 0 0 2024-09-20T18:36:02.840 INFO:tasks.workunit.client.0.smithi017.stdout:0/487: read - d4/d20/d63/d86/fa7 zero size 2024-09-20T18:36:02.842 INFO:tasks.workunit.client.0.smithi017.stdout:6/546: dwrite d4/df/d1f/d25/d3f/d5c/f7b [0,4194304] 0 2024-09-20T18:36:02.845 INFO:tasks.workunit.client.0.smithi017.stdout:6/547: write d4/d37/d41/d43/dab/fb6 [46492,58980] 0 2024-09-20T18:36:02.845 INFO:tasks.workunit.client.0.smithi017.stdout:5/470: rename d0/d14/d18/d1b/f3d to d0/d14/d40/f9a 0 2024-09-20T18:36:02.848 INFO:tasks.workunit.client.0.smithi017.stdout:0/488: creat d4/db/d1e/d24/d2f/d94/fa8 x:0 0 0 2024-09-20T18:36:02.850 INFO:tasks.workunit.client.0.smithi017.stdout:0/489: write d4/db/d1e/d42/f67 [651954,35823] 0 2024-09-20T18:36:02.850 INFO:tasks.workunit.client.0.smithi017.stdout:9/729: rename d6/d23/d58/d3f/d82 to d6/d23/d58/d3f/d70/dfe/d10b 0 2024-09-20T18:36:02.853 INFO:tasks.workunit.client.0.smithi017.stdout:6/548: chown d4/df/d8a/l98 44033 1 2024-09-20T18:36:02.854 INFO:tasks.workunit.client.0.smithi017.stdout:5/471: read d0/d14/d40/f63 [77190,41877] 0 2024-09-20T18:36:02.855 INFO:tasks.workunit.client.0.smithi017.stdout:0/490: mknod d4/db/d1e/d42/ca9 0 2024-09-20T18:36:02.856 INFO:tasks.workunit.client.0.smithi017.stdout:0/491: fsync f2 0 2024-09-20T18:36:02.862 INFO:tasks.workunit.client.0.smithi017.stdout:0/492: mkdir d4/db/d18/d25/d36/d47/d8c/daa 0 2024-09-20T18:36:02.863 INFO:tasks.workunit.client.0.smithi017.stdout:6/549: getdents d4/d37/d41 0 2024-09-20T18:36:02.865 INFO:tasks.workunit.client.0.smithi017.stdout:7/527: sync 2024-09-20T18:36:02.865 INFO:tasks.workunit.client.0.smithi017.stdout:8/442: sync 2024-09-20T18:36:02.865 INFO:tasks.workunit.client.0.smithi017.stdout:7/528: chown da/f14 13 1 2024-09-20T18:36:02.866 INFO:tasks.workunit.client.0.smithi017.stdout:8/443: truncate d0/f14 4718593 0 2024-09-20T18:36:02.869 INFO:tasks.workunit.client.0.smithi017.stdout:0/493: link d4/db/d18/d25/f7c d4/db/d18/d55/fab 0 2024-09-20T18:36:02.871 INFO:tasks.workunit.client.0.smithi017.stdout:0/494: read d4/f17 [193815,60462] 0 2024-09-20T18:36:02.871 INFO:tasks.workunit.client.0.smithi017.stdout:8/444: mkdir d0/d6/d93 0 2024-09-20T18:36:02.872 INFO:tasks.workunit.client.0.smithi017.stdout:0/495: write d4/db/d1e/d24/d2f/f5e [1411237,55885] 0 2024-09-20T18:36:02.879 INFO:tasks.workunit.client.0.smithi017.stdout:8/445: dread d0/d6/d28/f4f [0,4194304] 0 2024-09-20T18:36:02.880 INFO:tasks.workunit.client.0.smithi017.stdout:9/730: mkdir d6/d23/d58/d3f/d2f/d98/d10c 0 2024-09-20T18:36:02.882 INFO:tasks.workunit.client.0.smithi017.stdout:9/731: write d6/d23/d3a/d61/de7/faf [329261,115798] 0 2024-09-20T18:36:02.882 INFO:tasks.workunit.client.0.smithi017.stdout:8/446: mknod d0/d65/c94 0 2024-09-20T18:36:02.883 INFO:tasks.workunit.client.0.smithi017.stdout:0/496: link d4/db/d1e/l4a d4/db/d18/d25/d36/d47/d81/d9c/lac 0 2024-09-20T18:36:02.885 INFO:tasks.workunit.client.0.smithi017.stdout:8/447: rmdir d0/d6/d28 39 2024-09-20T18:36:02.887 INFO:tasks.workunit.client.0.smithi017.stdout:0/497: symlink d4/db/d1e/d24/d2f/d51/lad 0 2024-09-20T18:36:02.889 INFO:tasks.workunit.client.0.smithi017.stdout:9/732: read d6/d23/d58/d3f/d4d/d73/d7d/dbd/de6/ff0 [160883,34578] 0 2024-09-20T18:36:02.892 INFO:tasks.workunit.client.0.smithi017.stdout:9/733: creat d6/d42/f10d x:0 0 0 2024-09-20T18:36:02.896 INFO:tasks.workunit.client.0.smithi017.stdout:0/498: truncate f2 866497 0 2024-09-20T18:36:02.897 INFO:tasks.workunit.client.0.smithi017.stdout:9/734: mknod d6/d23/d40/c10e 0 2024-09-20T18:36:02.899 INFO:tasks.workunit.client.0.smithi017.stdout:8/448: link d0/d6/d28/c35 d0/d6/d28/d3d/d4e/d55/d83/c95 0 2024-09-20T18:36:02.900 INFO:tasks.workunit.client.0.smithi017.stdout:8/449: stat d0/d6/d28/d3d/l78 0 2024-09-20T18:36:02.902 INFO:tasks.workunit.client.0.smithi017.stdout:0/499: unlink d4/d68/f85 0 2024-09-20T18:36:02.905 INFO:tasks.workunit.client.0.smithi017.stdout:9/735: mkdir d6/d23/d58/d3f/d4d/d73/d7d/d10f 0 2024-09-20T18:36:02.909 INFO:tasks.workunit.client.0.smithi017.stdout:8/450: creat d0/d6/d28/d81/d82/f96 x:0 0 0 2024-09-20T18:36:02.909 INFO:tasks.workunit.client.0.smithi017.stdout:8/451: stat d0/d6/f20 0 2024-09-20T18:36:02.912 INFO:tasks.workunit.client.0.smithi017.stdout:0/500: creat d4/d37/fae x:0 0 0 2024-09-20T18:36:02.915 INFO:tasks.workunit.client.0.smithi017.stdout:9/736: readlink d6/d23/d58/d3f/d70/dfe/d10b/ld2 0 2024-09-20T18:36:02.919 INFO:tasks.workunit.client.0.smithi017.stdout:0/501: mkdir d4/db/d1e/d24/d2f/d51/d52/d77/daf 0 2024-09-20T18:36:02.920 INFO:tasks.workunit.client.0.smithi017.stdout:9/737: mkdir d6/d23/d58/d3f/d4d/d110 0 2024-09-20T18:36:02.920 INFO:tasks.workunit.client.0.smithi017.stdout:0/502: chown d4/db/d1e/d24/f30 17861561 1 2024-09-20T18:36:02.923 INFO:tasks.workunit.client.0.smithi017.stdout:0/503: symlink d4/db/d18/d78/lb0 0 2024-09-20T18:36:02.928 INFO:tasks.workunit.client.0.smithi017.stdout:9/738: dwrite d6/d23/d58/d3f/d2f/d98/fa5 [0,4194304] 0 2024-09-20T18:36:02.933 INFO:tasks.workunit.client.0.smithi017.stdout:0/504: mkdir d4/db/d1e/db1 0 2024-09-20T18:36:02.941 INFO:tasks.workunit.client.0.smithi017.stdout:0/505: dwrite d4/db/d18/d25/d36/d47/d81/f9b [0,4194304] 0 2024-09-20T18:36:02.943 INFO:tasks.workunit.client.0.smithi017.stdout:9/739: link d6/d23/d58/d3f/d4d/c4e d6/d23/d58/d3f/d4d/d73/d7d/d10f/c111 0 2024-09-20T18:36:02.947 INFO:tasks.workunit.client.0.smithi017.stdout:0/506: symlink d4/db/d18/d25/d36/d47/lb2 0 2024-09-20T18:36:02.948 INFO:tasks.workunit.client.0.smithi017.stdout:8/452: dwrite d0/d6/d28/d3d/f4a [0,4194304] 0 2024-09-20T18:36:02.953 INFO:tasks.workunit.client.0.smithi017.stdout:9/740: readlink d6/d23/d58/d3f/d70/dfe/d10b/lfb 0 2024-09-20T18:36:02.958 INFO:tasks.workunit.client.0.smithi017.stdout:0/507: dwrite d4/d20/f2a [0,4194304] 0 2024-09-20T18:36:02.960 INFO:tasks.workunit.client.0.smithi017.stdout:9/741: mknod d6/d23/d58/d3f/d4d/c112 0 2024-09-20T18:36:02.963 INFO:tasks.workunit.client.0.smithi017.stdout:9/742: dread - d6/d23/d58/d3f/d70/dfe/d10b/fe4 zero size 2024-09-20T18:36:02.963 INFO:tasks.workunit.client.0.smithi017.stdout:9/743: dread - d6/dc1/ff3 zero size 2024-09-20T18:36:02.965 INFO:tasks.workunit.client.0.smithi017.stdout:0/508: creat d4/db/d1e/d24/d2f/d51/d52/fb3 x:0 0 0 2024-09-20T18:36:02.969 INFO:tasks.workunit.client.0.smithi017.stdout:8/453: truncate d0/d6/d28/f68 1248008 0 2024-09-20T18:36:02.969 INFO:tasks.workunit.client.0.smithi017.stdout:0/509: symlink d4/db/d1e/d24/d2f/d69/lb4 0 2024-09-20T18:36:02.971 INFO:tasks.workunit.client.0.smithi017.stdout:0/510: write d4/db/d1e/d24/f4b [4467954,109222] 0 2024-09-20T18:36:02.972 INFO:tasks.workunit.client.0.smithi017.stdout:9/744: write d6/fec [466515,82536] 0 2024-09-20T18:36:02.974 INFO:tasks.workunit.client.0.smithi017.stdout:0/511: write d4/d20/f2a [3487950,98063] 0 2024-09-20T18:36:02.975 INFO:tasks.workunit.client.0.smithi017.stdout:8/454: rename d0/d6/d73/l76 to d0/d6/d28/d81/l97 0 2024-09-20T18:36:02.976 INFO:tasks.workunit.client.0.smithi017.stdout:0/512: readlink d4/db/d1e/d24/d2f/d51/l5c 0 2024-09-20T18:36:02.978 INFO:tasks.workunit.client.0.smithi017.stdout:0/513: read d4/db/f2c [3890044,2607] 0 2024-09-20T18:36:02.979 INFO:tasks.workunit.client.0.smithi017.stdout:0/514: chown d4/db/f12 249727 1 2024-09-20T18:36:02.980 INFO:tasks.workunit.client.0.smithi017.stdout:0/515: write d4/db/fc [1973182,22168] 0 2024-09-20T18:36:02.981 INFO:tasks.workunit.client.0.smithi017.stdout:0/516: readlink d4/db/d18/d25/d36/d47/d81/la5 0 2024-09-20T18:36:02.991 INFO:tasks.workunit.client.0.smithi017.stdout:9/745: getdents d6/d23/d3a/d61 0 2024-09-20T18:36:02.996 INFO:tasks.workunit.client.0.smithi017.stdout:9/746: write d6/d23/d3a/d61/de7/f56 [4711374,31153] 0 2024-09-20T18:36:02.998 INFO:tasks.workunit.client.0.smithi017.stdout:9/747: readlink d6/d23/d58/d3f/d2f/l74 0 2024-09-20T18:36:02.998 INFO:tasks.workunit.client.0.smithi017.stdout:9/748: stat d6/d11/dbb 0 2024-09-20T18:36:03.000 INFO:tasks.workunit.client.0.smithi017.stdout:8/455: dread d0/d6/d28/f68 [0,4194304] 0 2024-09-20T18:36:03.001 INFO:tasks.workunit.client.0.smithi017.stdout:9/749: mkdir d6/d23/d3a/db8/d113 0 2024-09-20T18:36:03.002 INFO:tasks.workunit.client.0.smithi017.stdout:8/456: read d0/d6/d28/d3d/d4e/f89 [179704,119307] 0 2024-09-20T18:36:03.006 INFO:tasks.workunit.client.0.smithi017.stdout:8/457: rmdir d0/d6/d28/d3d/d4e 39 2024-09-20T18:36:03.009 INFO:tasks.workunit.client.0.smithi017.stdout:8/458: mkdir d0/d6/d28/d3b/d72/d98 0 2024-09-20T18:36:03.014 INFO:tasks.workunit.client.0.smithi017.stdout:9/750: dread d6/d11/f3e [0,4194304] 0 2024-09-20T18:36:03.016 INFO:tasks.workunit.client.0.smithi017.stdout:8/459: dwrite d0/f22 [4194304,4194304] 0 2024-09-20T18:36:03.018 INFO:tasks.workunit.client.0.smithi017.stdout:8/460: readlink d0/d6/l26 0 2024-09-20T18:36:03.020 INFO:tasks.workunit.client.0.smithi017.stdout:8/461: chown d0/d6/d28/f5a 5 1 2024-09-20T18:36:03.020 INFO:tasks.workunit.client.0.smithi017.stdout:3/671: sync 2024-09-20T18:36:03.020 INFO:tasks.workunit.client.0.smithi017.stdout:4/456: sync 2024-09-20T18:36:03.020 INFO:tasks.workunit.client.0.smithi017.stdout:1/488: sync 2024-09-20T18:36:03.025 INFO:tasks.workunit.client.0.smithi017.stdout:4/457: chown d4/f6c 675480024 1 2024-09-20T18:36:03.028 INFO:tasks.workunit.client.0.smithi017.stdout:9/751: dwrite d6/d23/d58/f94 [0,4194304] 0 2024-09-20T18:36:03.029 INFO:tasks.workunit.client.0.smithi017.stdout:1/489: write df/d1c/d45/f6e [608921,37877] 0 2024-09-20T18:36:03.031 INFO:tasks.workunit.client.0.smithi017.stdout:4/458: readlink d4/de/l60 0 2024-09-20T18:36:03.091 INFO:tasks.workunit.client.0.smithi017.stdout:8/462: fdatasync d0/d6/f67 0 2024-09-20T18:36:03.105 INFO:tasks.workunit.client.0.smithi017.stdout:3/672: dwrite da/de/d13/d2f/d26/d31/f9a [0,4194304] 0 2024-09-20T18:36:03.116 INFO:tasks.workunit.client.0.smithi017.stdout:8/463: rmdir d0/d6/d28/d3b/d72 39 2024-09-20T18:36:03.128 INFO:tasks.workunit.client.0.smithi017.stdout:3/673: fdatasync da/de/d13/d2f/d26/d62/f8a 0 2024-09-20T18:36:03.134 INFO:tasks.workunit.client.0.smithi017.stdout:8/464: write d0/d6/d28/d3d/f4a [3845493,113263] 0 2024-09-20T18:36:03.140 INFO:tasks.workunit.client.0.smithi017.stdout:8/465: dwrite d0/d6/d28/d81/d82/f84 [0,4194304] 0 2024-09-20T18:36:03.142 INFO:tasks.workunit.client.0.smithi017.stdout:8/466: chown d0/d6/f54 11797345 1 2024-09-20T18:36:03.147 INFO:tasks.workunit.client.0.smithi017.stdout:8/467: dread d0/d6/f25 [0,4194304] 0 2024-09-20T18:36:03.152 INFO:tasks.workunit.client.0.smithi017.stdout:8/468: read d0/d6/d28/d3d/f60 [901703,63459] 0 2024-09-20T18:36:03.158 INFO:tasks.workunit.client.0.smithi017.stdout:8/469: symlink d0/d6/d93/l99 0 2024-09-20T18:36:03.164 INFO:tasks.workunit.client.0.smithi017.stdout:8/470: creat d0/d6/d28/d3d/d4e/d55/f9a x:0 0 0 2024-09-20T18:36:03.165 INFO:tasks.workunit.client.0.smithi017.stdout:8/471: write d0/d6/f54 [1276351,46276] 0 2024-09-20T18:36:03.171 INFO:tasks.workunit.client.0.smithi017.stdout:8/472: creat d0/d6/d28/f9b x:0 0 0 2024-09-20T18:36:03.179 INFO:tasks.workunit.client.0.smithi017.stdout:8/473: dwrite d0/d6/f23 [0,4194304] 0 2024-09-20T18:36:03.188 INFO:tasks.workunit.client.0.smithi017.stdout:8/474: dwrite d0/d6/f54 [0,4194304] 0 2024-09-20T18:36:03.189 INFO:tasks.workunit.client.0.smithi017.stdout:8/475: chown d0/d6/d28/l50 890553806 1 2024-09-20T18:36:03.198 INFO:tasks.workunit.client.0.smithi017.stdout:8/476: dwrite d0/f22 [4194304,4194304] 0 2024-09-20T18:36:03.268 INFO:tasks.workunit.client.0.smithi017.stdout:2/724: sync 2024-09-20T18:36:03.269 INFO:tasks.workunit.client.0.smithi017.stdout:5/472: sync 2024-09-20T18:36:03.269 INFO:tasks.workunit.client.0.smithi017.stdout:5/473: fsync d0/d14/d18/d2a/d39/d42/f62 0 2024-09-20T18:36:03.279 INFO:tasks.workunit.client.0.smithi017.stdout:2/725: symlink d1/dc/d20/d2e/d30/db0/le8 0 2024-09-20T18:36:03.285 INFO:tasks.workunit.client.0.smithi017.stdout:5/474: unlink d0/d14/d18/d2a/d39/d42/c92 0 2024-09-20T18:36:03.287 INFO:tasks.workunit.client.0.smithi017.stdout:5/475: dread - d0/d14/d18/f97 zero size 2024-09-20T18:36:03.300 INFO:tasks.workunit.client.0.smithi017.stdout:1/490: truncate f2 5309160 0 2024-09-20T18:36:03.301 INFO:tasks.workunit.client.0.smithi017.stdout:5/476: dwrite d0/d14/d18/d19/d4d/d6d/d78/f66 [4194304,4194304] 0 2024-09-20T18:36:03.301 INFO:tasks.workunit.client.0.smithi017.stdout:3/674: write da/de/d13/d2f/d26/d31/f7e [2514949,18622] 0 2024-09-20T18:36:03.304 INFO:tasks.workunit.client.0.smithi017.stdout:5/477: fsync d0/f10 0 2024-09-20T18:36:03.311 INFO:tasks.workunit.client.0.smithi017.stdout:3/675: creat da/de/d53/d52/fd8 x:0 0 0 2024-09-20T18:36:03.313 INFO:tasks.workunit.client.0.smithi017.stdout:1/491: dwrite df/d16/d50/d69/f4c [0,4194304] 0 2024-09-20T18:36:03.315 INFO:tasks.workunit.client.0.smithi017.stdout:1/492: write df/d1c/f1e [1778063,105259] 0 2024-09-20T18:36:03.317 INFO:tasks.workunit.client.0.smithi017.stdout:3/676: creat da/de/d13/d16/d6e/d97/dc1/fd9 x:0 0 0 2024-09-20T18:36:03.323 INFO:tasks.workunit.client.0.smithi017.stdout:1/493: creat df/d35/d4f/d82/f99 x:0 0 0 2024-09-20T18:36:03.328 INFO:tasks.workunit.client.0.smithi017.stdout:3/677: creat da/fda x:0 0 0 2024-09-20T18:36:03.331 INFO:tasks.workunit.client.0.smithi017.stdout:3/678: readlink da/de/d13/d2f/l3c 0 2024-09-20T18:36:03.331 INFO:tasks.workunit.client.0.smithi017.stdout:1/494: dread df/d1c/d45/f6e [0,4194304] 0 2024-09-20T18:36:03.332 INFO:tasks.workunit.client.0.smithi017.stdout:1/495: write df/d29/f61 [127370,89503] 0 2024-09-20T18:36:03.334 INFO:tasks.workunit.client.0.smithi017.stdout:3/679: creat da/de/d53/d88/fdb x:0 0 0 2024-09-20T18:36:03.336 INFO:tasks.workunit.client.0.smithi017.stdout:3/680: write da/fda [617146,33387] 0 2024-09-20T18:36:03.336 INFO:tasks.workunit.client.0.smithi017.stdout:1/496: creat df/d3b/f9a x:0 0 0 2024-09-20T18:36:03.336 INFO:tasks.workunit.client.0.smithi017.stdout:1/497: readlink df/d1c/l2a 0 2024-09-20T18:36:03.337 INFO:tasks.workunit.client.0.smithi017.stdout:3/681: readlink da/de/d13/d2f/d26/d31/l4a 0 2024-09-20T18:36:03.340 INFO:tasks.workunit.client.0.smithi017.stdout:3/682: stat da/de/d13/d16/f77 0 2024-09-20T18:36:03.343 INFO:tasks.workunit.client.0.smithi017.stdout:3/683: truncate da/de/d13/d2f/d26/d31/d5a/d76/f9d 432145 0 2024-09-20T18:36:03.343 INFO:tasks.workunit.client.0.smithi017.stdout:1/498: rename df/d29/l4a to df/d35/d4f/l9b 0 2024-09-20T18:36:03.345 INFO:tasks.workunit.client.0.smithi017.stdout:3/684: mknod da/de/d13/d16/cdc 0 2024-09-20T18:36:03.360 INFO:tasks.workunit.client.0.smithi017.stdout:9/752: creat d6/d23/d58/d3f/d4d/f114 x:0 0 0 2024-09-20T18:36:03.364 INFO:tasks.workunit.client.0.smithi017.stdout:9/753: getdents d6/d11 0 2024-09-20T18:36:03.364 INFO:tasks.workunit.client.0.smithi017.stdout:3/685: creat da/de/d13/d2f/d26/d31/fdd x:0 0 0 2024-09-20T18:36:03.365 INFO:tasks.workunit.client.0.smithi017.stdout:3/686: dread - da/de/d13/fb9 zero size 2024-09-20T18:36:03.367 INFO:tasks.workunit.client.0.smithi017.stdout:3/687: truncate da/de/d53/d52/fd8 896215 0 2024-09-20T18:36:03.368 INFO:tasks.workunit.client.0.smithi017.stdout:3/688: fdatasync da/de/f8e 0 2024-09-20T18:36:03.370 INFO:tasks.workunit.client.0.smithi017.stdout:3/689: symlink da/de/d13/d2f/d26/lde 0 2024-09-20T18:36:03.373 INFO:tasks.workunit.client.0.smithi017.stdout:3/690: mkdir da/de/d13/d16/d6e/ddf 0 2024-09-20T18:36:03.376 INFO:tasks.workunit.client.0.smithi017.stdout:3/691: mknod da/de/d13/d16/d50/ce0 0 2024-09-20T18:36:03.376 INFO:tasks.workunit.client.0.smithi017.stdout:3/692: readlink da/de/d53/la3 0 2024-09-20T18:36:03.379 INFO:tasks.workunit.client.0.smithi017.stdout:3/693: symlink da/de/d13/d2f/d26/d62/le1 0 2024-09-20T18:36:03.380 INFO:tasks.workunit.client.0.smithi017.stdout:5/478: dwrite d0/f45 [0,4194304] 0 2024-09-20T18:36:03.382 INFO:tasks.workunit.client.0.smithi017.stdout:9/754: dread d6/f37 [0,4194304] 0 2024-09-20T18:36:03.382 INFO:tasks.workunit.client.0.smithi017.stdout:3/694: chown da/de/d13/d2f/d26/d31/d5a/d76/d19/f4c 238569099 1 2024-09-20T18:36:03.384 INFO:tasks.workunit.client.0.smithi017.stdout:3/695: readlink da/de/d53/la3 0 2024-09-20T18:36:03.388 INFO:tasks.workunit.client.0.smithi017.stdout:5/479: dread d0/d14/d18/d2a/d39/f53 [0,4194304] 0 2024-09-20T18:36:03.391 INFO:tasks.workunit.client.0.smithi017.stdout:3/696: creat da/de/d13/d16/d50/fe2 x:0 0 0 2024-09-20T18:36:03.392 INFO:tasks.workunit.client.0.smithi017.stdout:1/499: dwrite df/f5d [0,4194304] 0 2024-09-20T18:36:03.400 INFO:tasks.workunit.client.0.smithi017.stdout:3/697: mknod da/de/d13/d2f/d26/d31/d5a/d76/d19/ce3 0 2024-09-20T18:36:03.404 INFO:tasks.workunit.client.0.smithi017.stdout:3/698: creat da/de/d13/d2f/d26/d62/fe4 x:0 0 0 2024-09-20T18:36:03.408 INFO:tasks.workunit.client.0.smithi017.stdout:5/480: rename d0/d14/d18/d2a/d39/d42/f62 to d0/d14/d18/d2a/d39/f9b 0 2024-09-20T18:36:03.409 INFO:tasks.workunit.client.0.smithi017.stdout:5/481: write d0/f45 [1765508,94602] 0 2024-09-20T18:36:03.412 INFO:tasks.workunit.client.0.smithi017.stdout:9/755: write d6/d23/d58/d3f/d70/dfe/d10b/f88 [687471,45840] 0 2024-09-20T18:36:03.416 INFO:tasks.workunit.client.0.smithi017.stdout:1/500: link df/d29/d2c/l7b df/d29/l9c 0 2024-09-20T18:36:03.416 INFO:tasks.workunit.client.0.smithi017.stdout:5/482: symlink d0/d14/d18/d19/d4d/l9c 0 2024-09-20T18:36:03.417 INFO:tasks.workunit.client.0.smithi017.stdout:5/483: readlink d0/l8e 0 2024-09-20T18:36:03.418 INFO:tasks.workunit.client.0.smithi017.stdout:9/756: rmdir d6/d23/d58/d3f/d2f/d98 39 2024-09-20T18:36:03.425 INFO:tasks.workunit.client.0.smithi017.stdout:5/484: fsync d0/d14/d40/f63 0 2024-09-20T18:36:03.431 INFO:tasks.workunit.client.0.smithi017.stdout:3/699: link da/de/d13/d2f/f2e da/de/d13/d2f/d26/d31/d5a/fe5 0 2024-09-20T18:36:03.431 INFO:tasks.workunit.client.0.smithi017.stdout:1/501: dread df/f24 [0,4194304] 0 2024-09-20T18:36:03.435 INFO:tasks.workunit.client.0.smithi017.stdout:3/700: truncate da/de/d13/d2f/d26/d31/d5a/fbd 534308 0 2024-09-20T18:36:03.438 INFO:tasks.workunit.client.0.smithi017.stdout:5/485: dread d0/d14/d18/d19/d4d/d6d/d78/f66 [0,4194304] 0 2024-09-20T18:36:03.439 INFO:tasks.workunit.client.0.smithi017.stdout:9/757: write d6/d23/d40/db4/dba/f8c [369638,36129] 0 2024-09-20T18:36:03.443 INFO:tasks.workunit.client.0.smithi017.stdout:3/701: rename da/de/d13/d2f/d26/d62/da5/da9/dbb/dc0 to da/de/d13/d2f/d26/d31/d5a/d76/de6 0 2024-09-20T18:36:03.444 INFO:tasks.workunit.client.0.smithi017.stdout:3/702: write da/de/d13/d16/d50/f78 [499564,49103] 0 2024-09-20T18:36:03.447 INFO:tasks.workunit.client.0.smithi017.stdout:5/486: chown d0/d14/d40/l6b 11841 1 2024-09-20T18:36:03.447 INFO:tasks.workunit.client.0.smithi017.stdout:1/502: truncate df/d16/d50/d69/d62/f81 237420 0 2024-09-20T18:36:03.448 INFO:tasks.workunit.client.0.smithi017.stdout:9/758: unlink d6/d23/d3a/f3c 0 2024-09-20T18:36:03.449 INFO:tasks.workunit.client.0.smithi017.stdout:9/759: chown d6/d23/d3a 4 1 2024-09-20T18:36:03.450 INFO:tasks.workunit.client.0.smithi017.stdout:9/760: chown d6/d23/d3a/c64 3809 1 2024-09-20T18:36:03.451 INFO:tasks.workunit.client.0.smithi017.stdout:3/703: creat da/de/d13/d2f/d26/d31/d5a/d76/d19/fe7 x:0 0 0 2024-09-20T18:36:03.451 INFO:tasks.workunit.client.0.smithi017.stdout:5/487: dread d0/f45 [0,4194304] 0 2024-09-20T18:36:03.454 INFO:tasks.workunit.client.0.smithi017.stdout:3/704: write da/de/d13/d2f/d26/d62/fe4 [329100,95924] 0 2024-09-20T18:36:03.458 INFO:tasks.workunit.client.0.smithi017.stdout:9/761: rename d6/d23/d58/d3f/d70/dfe/d10b/f88 to d6/d23/d58/d3f/d4d/d100/f115 0 2024-09-20T18:36:03.460 INFO:tasks.workunit.client.0.smithi017.stdout:9/762: fsync d6/d23/d40/db4/dba/fc5 0 2024-09-20T18:36:03.462 INFO:tasks.workunit.client.0.smithi017.stdout:3/705: write da/de/d13/d2f/d26/d31/d5a/d76/d19/fe7 [933570,57767] 0 2024-09-20T18:36:03.464 INFO:tasks.workunit.client.0.smithi017.stdout:1/503: dread df/d16/d50/f86 [0,4194304] 0 2024-09-20T18:36:03.465 INFO:tasks.workunit.client.0.smithi017.stdout:5/488: dwrite d0/d14/d18/d1b/f5c [0,4194304] 0 2024-09-20T18:36:03.465 INFO:tasks.workunit.client.0.smithi017.stdout:3/706: dread - da/de/d13/d16/d6e/d97/fc2 zero size 2024-09-20T18:36:03.475 INFO:tasks.workunit.client.0.smithi017.stdout:5/489: unlink d0/d14/d18/d57/f5e 0 2024-09-20T18:36:03.477 INFO:tasks.workunit.client.0.smithi017.stdout:1/504: link df/d1c/d45/f6e df/d1c/d45/f9d 0 2024-09-20T18:36:03.483 INFO:tasks.workunit.client.0.smithi017.stdout:3/707: dread da/de/d13/d2f/d26/d31/d5a/d76/d19/f4c [0,4194304] 0 2024-09-20T18:36:03.484 INFO:tasks.workunit.client.0.smithi017.stdout:5/490: dread d0/d14/d18/d57/f7d [0,4194304] 0 2024-09-20T18:36:03.487 INFO:tasks.workunit.client.0.smithi017.stdout:3/708: chown da/de/d13/d2f/d26/d31/d5a/fbd 1417288 1 2024-09-20T18:36:03.488 INFO:tasks.workunit.client.0.smithi017.stdout:9/763: dwrite d6/d23/d58/d3f/fb9 [4194304,4194304] 0 2024-09-20T18:36:03.489 INFO:tasks.workunit.client.0.smithi017.stdout:3/709: dread - da/de/d13/d16/d6e/fd1 zero size 2024-09-20T18:36:03.492 INFO:tasks.workunit.client.0.smithi017.stdout:5/491: creat d0/d14/d18/d2a/d39/d42/d7e/f9d x:0 0 0 2024-09-20T18:36:03.495 INFO:tasks.workunit.client.0.smithi017.stdout:3/710: dread da/f4e [0,4194304] 0 2024-09-20T18:36:03.499 INFO:tasks.workunit.client.0.smithi017.stdout:5/492: mkdir d0/d14/d18/d79/d9e 0 2024-09-20T18:36:03.500 INFO:tasks.workunit.client.0.smithi017.stdout:9/764: dwrite d6/d42/f89 [0,4194304] 0 2024-09-20T18:36:03.501 INFO:tasks.workunit.client.0.smithi017.stdout:3/711: truncate da/de/d13/fb9 745040 0 2024-09-20T18:36:03.502 INFO:tasks.workunit.client.0.smithi017.stdout:5/493: chown d0/d14/d40/f6a 70 1 2024-09-20T18:36:03.507 INFO:tasks.workunit.client.0.smithi017.stdout:1/505: dwrite df/d29/f3a [4194304,4194304] 0 2024-09-20T18:36:03.508 INFO:tasks.workunit.client.0.smithi017.stdout:4/459: sync 2024-09-20T18:36:03.508 INFO:tasks.workunit.client.0.smithi017.stdout:6/550: sync 2024-09-20T18:36:03.508 INFO:tasks.workunit.client.0.smithi017.stdout:7/529: sync 2024-09-20T18:36:03.508 INFO:tasks.workunit.client.0.smithi017.stdout:0/517: sync 2024-09-20T18:36:03.547 INFO:tasks.workunit.client.0.smithi017.stdout:3/712: creat da/de/d13/d2f/d26/d31/d5a/d76/de6/fe8 x:0 0 0 2024-09-20T18:36:03.549 INFO:tasks.workunit.client.0.smithi017.stdout:1/506: chown df/d29/d2c/f65 270 1 2024-09-20T18:36:03.551 INFO:tasks.workunit.client.0.smithi017.stdout:4/460: chown d4/dc/d1e/f51 155534886 1 2024-09-20T18:36:03.551 INFO:tasks.workunit.client.0.smithi017.stdout:0/518: chown d4/db/d18/d25/d36/f82 1946991 1 2024-09-20T18:36:03.551 INFO:tasks.workunit.client.0.smithi017.stdout:3/713: readlink da/de/d53/d88/lb6 0 2024-09-20T18:36:03.553 INFO:tasks.workunit.client.0.smithi017.stdout:3/714: chown da/de/d13/d2f 907 1 2024-09-20T18:36:03.557 INFO:tasks.workunit.client.0.smithi017.stdout:6/551: rename d4/df/d4a/d8f/fb8 to d4/d37/d68/da4/d72/fb9 0 2024-09-20T18:36:03.558 INFO:tasks.workunit.client.0.smithi017.stdout:7/530: dwrite da/f14 [0,4194304] 0 2024-09-20T18:36:03.559 INFO:tasks.workunit.client.0.smithi017.stdout:0/519: dread d4/d37/f3a [0,4194304] 0 2024-09-20T18:36:03.559 INFO:tasks.workunit.client.0.smithi017.stdout:4/461: mkdir d4/dc/d1e/d69/d7a/d94 0 2024-09-20T18:36:03.560 INFO:tasks.workunit.client.0.smithi017.stdout:7/531: fdatasync da/d16/d1c/d40/d3a/f93 0 2024-09-20T18:36:03.562 INFO:tasks.workunit.client.0.smithi017.stdout:6/552: mkdir d4/d37/d68/d8d/dba 0 2024-09-20T18:36:03.562 INFO:tasks.workunit.client.0.smithi017.stdout:7/532: write da/d16/d1c/d40/d34/d3c/f48 [3259588,55791] 0 2024-09-20T18:36:03.563 INFO:tasks.workunit.client.0.smithi017.stdout:3/715: mkdir da/de/d13/d16/d6e/ddf/de9 0 2024-09-20T18:36:03.564 INFO:tasks.workunit.client.0.smithi017.stdout:4/462: mknod d4/dc/d41/c95 0 2024-09-20T18:36:03.565 INFO:tasks.workunit.client.0.smithi017.stdout:4/463: chown d4/f6c 19 1 2024-09-20T18:36:03.568 INFO:tasks.workunit.client.0.smithi017.stdout:6/553: rename d4/d37/d41/d43/dab to d4/d37/d68/dbb 0 2024-09-20T18:36:03.570 INFO:tasks.workunit.client.0.smithi017.stdout:7/533: mknod da/d16/d1c/d40/d30/cac 0 2024-09-20T18:36:03.572 INFO:tasks.workunit.client.0.smithi017.stdout:3/716: mknod da/de/d13/d2f/cea 0 2024-09-20T18:36:03.575 INFO:tasks.workunit.client.0.smithi017.stdout:7/534: mknod da/d16/d1c/d40/d3a/d8a/cad 0 2024-09-20T18:36:03.575 INFO:tasks.workunit.client.0.smithi017.stdout:6/554: dwrite d4/df/d1f/faf [0,4194304] 0 2024-09-20T18:36:03.576 INFO:tasks.workunit.client.0.smithi017.stdout:6/555: stat d4/d29/f45 0 2024-09-20T18:36:03.581 INFO:tasks.workunit.client.0.smithi017.stdout:6/556: creat d4/d37/d68/da4/d9e/fbc x:0 0 0 2024-09-20T18:36:03.584 INFO:tasks.workunit.client.0.smithi017.stdout:3/717: link da/de/d13/d2f/d26/d62/da5/da9/cac da/de/d13/d16/d6e/d97/dc1/dcc/ceb 0 2024-09-20T18:36:03.585 INFO:tasks.workunit.client.0.smithi017.stdout:3/718: write da/de/d13/fc4 [784382,102471] 0 2024-09-20T18:36:03.586 INFO:tasks.workunit.client.0.smithi017.stdout:6/557: creat d4/d37/d68/da4/fbd x:0 0 0 2024-09-20T18:36:03.588 INFO:tasks.workunit.client.0.smithi017.stdout:3/719: creat da/de/d13/d2f/d26/d31/d5a/d76/de6/fec x:0 0 0 2024-09-20T18:36:03.591 INFO:tasks.workunit.client.0.smithi017.stdout:6/558: unlink d4/d37/d41/d43/d7d/f2f 0 2024-09-20T18:36:03.591 INFO:tasks.workunit.client.0.smithi017.stdout:3/720: fdatasync da/de/f85 0 2024-09-20T18:36:03.593 INFO:tasks.workunit.client.0.smithi017.stdout:3/721: readlink da/de/d13/d2f/d26/d31/l57 0 2024-09-20T18:36:03.594 INFO:tasks.workunit.client.0.smithi017.stdout:6/559: creat d4/df/d8a/fbe x:0 0 0 2024-09-20T18:36:03.595 INFO:tasks.workunit.client.0.smithi017.stdout:6/560: readlink d4/df/d1f/d25/l83 0 2024-09-20T18:36:03.596 INFO:tasks.workunit.client.0.smithi017.stdout:6/561: write d4/df/d1f/d25/d2b/fb7 [1000477,105895] 0 2024-09-20T18:36:03.597 INFO:tasks.workunit.client.0.smithi017.stdout:3/722: dread - da/de/d13/d2f/d26/d31/fa0 zero size 2024-09-20T18:36:03.601 INFO:tasks.workunit.client.0.smithi017.stdout:3/723: creat da/de/d13/d2f/d26/d62/da5/da9/dbb/fed x:0 0 0 2024-09-20T18:36:03.603 INFO:tasks.workunit.client.0.smithi017.stdout:6/562: dwrite d4/df/d1f/d25/f71 [0,4194304] 0 2024-09-20T18:36:03.605 INFO:tasks.workunit.client.0.smithi017.stdout:4/464: dread d4/de/d1b/f33 [0,4194304] 0 2024-09-20T18:36:03.610 INFO:tasks.workunit.client.0.smithi017.stdout:3/724: rename da/de/f85 to da/de/d13/d2f/d26/d31/fee 0 2024-09-20T18:36:03.611 INFO:tasks.workunit.client.0.smithi017.stdout:4/465: mkdir d4/dc/d1e/d69/d96 0 2024-09-20T18:36:03.613 INFO:tasks.workunit.client.0.smithi017.stdout:4/466: chown d4/d19/f42 22 1 2024-09-20T18:36:03.613 INFO:tasks.workunit.client.0.smithi017.stdout:7/535: dwrite da/f11 [0,4194304] 0 2024-09-20T18:36:03.614 INFO:tasks.workunit.client.0.smithi017.stdout:4/467: chown d4/d19/d37 1053 1 2024-09-20T18:36:03.618 INFO:tasks.workunit.client.0.smithi017.stdout:6/563: creat d4/fbf x:0 0 0 2024-09-20T18:36:03.622 INFO:tasks.workunit.client.0.smithi017.stdout:6/564: dread - d4/d37/f6a zero size 2024-09-20T18:36:03.623 INFO:tasks.workunit.client.0.smithi017.stdout:4/468: dwrite d4/de/d1b/f8d [0,4194304] 0 2024-09-20T18:36:03.624 INFO:tasks.workunit.client.0.smithi017.stdout:4/469: chown d4/d7f/d91 184840570 1 2024-09-20T18:36:03.640 INFO:tasks.workunit.client.0.smithi017.stdout:3/725: dread da/de/d13/d2f/f2e [0,4194304] 0 2024-09-20T18:36:03.644 INFO:tasks.workunit.client.0.smithi017.stdout:4/470: write d4/de/d1b/f33 [2560253,39220] 0 2024-09-20T18:36:03.646 INFO:tasks.workunit.client.0.smithi017.stdout:4/471: read d4/d19/f7e [3238861,63543] 0 2024-09-20T18:36:03.647 INFO:tasks.workunit.client.0.smithi017.stdout:4/472: fsync d4/de/d1b/f8d 0 2024-09-20T18:36:03.650 INFO:tasks.workunit.client.0.smithi017.stdout:7/536: dread da/d16/f47 [0,4194304] 0 2024-09-20T18:36:03.660 INFO:tasks.workunit.client.0.smithi017.stdout:4/473: read f3 [15486,72729] 0 2024-09-20T18:36:03.661 INFO:tasks.workunit.client.0.smithi017.stdout:4/474: readlink d4/de/l50 0 2024-09-20T18:36:03.662 INFO:tasks.workunit.client.0.smithi017.stdout:7/537: unlink da/d16/d8e/d75/l35 0 2024-09-20T18:36:03.662 INFO:tasks.workunit.client.0.smithi017.stdout:7/538: chown da/c74 13053 1 2024-09-20T18:36:03.664 INFO:tasks.workunit.client.0.smithi017.stdout:3/726: mkdir da/def 0 2024-09-20T18:36:03.666 INFO:tasks.workunit.client.0.smithi017.stdout:4/475: mkdir d4/d82/d88/d5c/d97 0 2024-09-20T18:36:03.668 INFO:tasks.workunit.client.0.smithi017.stdout:7/539: unlink da/d16/d1c/d40/d5d/f60 0 2024-09-20T18:36:03.673 INFO:tasks.workunit.client.0.smithi017.stdout:3/727: truncate da/de/d13/d2f/d26/d41/f83 2307213 0 2024-09-20T18:36:03.678 INFO:tasks.workunit.client.0.smithi017.stdout:4/476: dread d4/d19/f42 [0,4194304] 0 2024-09-20T18:36:03.678 INFO:tasks.workunit.client.0.smithi017.stdout:3/728: symlink da/de/d13/d2f/d26/d62/da5/da9/lf0 0 2024-09-20T18:36:03.679 INFO:tasks.workunit.client.0.smithi017.stdout:4/477: readlink d4/d7f/l93 0 2024-09-20T18:36:03.679 INFO:tasks.workunit.client.0.smithi017.stdout:7/540: symlink da/d16/d1c/d40/d5d/da7/lae 0 2024-09-20T18:36:03.682 INFO:tasks.workunit.client.0.smithi017.stdout:3/729: mkdir da/de/d13/d16/d6e/d97/df1 0 2024-09-20T18:36:03.684 INFO:tasks.workunit.client.0.smithi017.stdout:7/541: rmdir da/d16/d8e/d75 39 2024-09-20T18:36:03.688 INFO:tasks.workunit.client.0.smithi017.stdout:7/542: chown da/d16/d1c/d40/d3a/c85 901240 1 2024-09-20T18:36:03.692 INFO:tasks.workunit.client.0.smithi017.stdout:7/543: rmdir da/d16/d1c/d40/d30 39 2024-09-20T18:36:03.692 INFO:tasks.workunit.client.0.smithi017.stdout:7/544: fsync da/f14 0 2024-09-20T18:36:03.694 INFO:tasks.workunit.client.0.smithi017.stdout:7/545: write da/d16/d1c/d40/d34/f6e [851722,5466] 0 2024-09-20T18:36:03.696 INFO:tasks.workunit.client.0.smithi017.stdout:3/730: link da/de/d13/d2f/d26/d62/le1 da/de/d13/d2f/d26/d31/lf2 0 2024-09-20T18:36:03.697 INFO:tasks.workunit.client.0.smithi017.stdout:3/731: chown da/de/d53/d88/fdb 6 1 2024-09-20T18:36:03.700 INFO:tasks.workunit.client.0.smithi017.stdout:4/478: link d4/d82/d88/c32 d4/d19/c98 0 2024-09-20T18:36:03.704 INFO:tasks.workunit.client.0.smithi017.stdout:3/732: rename da/de/d13/d16/f1e to da/de/d13/d16/d6e/ddf/de9/ff3 0 2024-09-20T18:36:03.705 INFO:tasks.workunit.client.0.smithi017.stdout:4/479: fdatasync d4/f2c 0 2024-09-20T18:36:03.709 INFO:tasks.workunit.client.0.smithi017.stdout:7/546: getdents da/d16/d1c/d40/d34/d96 0 2024-09-20T18:36:03.712 INFO:tasks.workunit.client.0.smithi017.stdout:3/733: mkdir da/de/d13/d2f/d26/d62/da5/da9/dbb/df4 0 2024-09-20T18:36:03.715 INFO:tasks.workunit.client.0.smithi017.stdout:4/480: creat d4/dc/d41/f99 x:0 0 0 2024-09-20T18:36:03.716 INFO:tasks.workunit.client.0.smithi017.stdout:7/547: dread - da/d16/d1c/d40/d5d/f9d zero size 2024-09-20T18:36:03.717 INFO:tasks.workunit.client.0.smithi017.stdout:4/481: dread d4/dc/d1e/d26/f6a [0,4194304] 0 2024-09-20T18:36:03.717 INFO:tasks.workunit.client.0.smithi017.stdout:7/548: chown da/d16/d1c/d40/d34/f6e 3759 1 2024-09-20T18:36:03.724 INFO:tasks.workunit.client.0.smithi017.stdout:4/482: creat d4/d82/d88/d5c/f9a x:0 0 0 2024-09-20T18:36:03.725 INFO:tasks.workunit.client.0.smithi017.stdout:4/483: write d4/d19/d37/f57 [1804316,50541] 0 2024-09-20T18:36:03.732 INFO:tasks.workunit.client.0.smithi017.stdout:7/549: mknod da/d16/d1c/d40/d34/d96/caf 0 2024-09-20T18:36:03.734 INFO:tasks.workunit.client.0.smithi017.stdout:4/484: rename d4/f5b to d4/d82/d88/f9b 0 2024-09-20T18:36:03.739 INFO:tasks.workunit.client.0.smithi017.stdout:3/734: write da/f29 [938821,65994] 0 2024-09-20T18:36:03.740 INFO:tasks.workunit.client.0.smithi017.stdout:3/735: dread - da/de/d13/d2f/d26/d62/f8a zero size 2024-09-20T18:36:03.746 INFO:tasks.workunit.client.0.smithi017.stdout:3/736: creat da/de/d13/d2f/d26/d62/da5/da9/ff5 x:0 0 0 2024-09-20T18:36:03.749 INFO:tasks.workunit.client.0.smithi017.stdout:4/485: dread d4/de/d1b/f58 [0,4194304] 0 2024-09-20T18:36:03.750 INFO:tasks.workunit.client.0.smithi017.stdout:3/737: truncate da/de/d53/d88/f91 1023466 0 2024-09-20T18:36:03.750 INFO:tasks.workunit.client.0.smithi017.stdout:4/486: chown d4/d19/f1f 2 1 2024-09-20T18:36:03.760 INFO:tasks.workunit.client.0.smithi017.stdout:3/738: write da/de/d13/d2f/d26/fd6 [61738,17309] 0 2024-09-20T18:36:03.760 INFO:tasks.workunit.client.0.smithi017.stdout:4/487: write d4/d19/f63 [5215860,128440] 0 2024-09-20T18:36:03.763 INFO:tasks.workunit.client.0.smithi017.stdout:3/739: creat da/de/d13/d2f/d26/d62/ff6 x:0 0 0 2024-09-20T18:36:03.766 INFO:tasks.workunit.client.0.smithi017.stdout:3/740: creat da/de/d13/d2f/d26/d62/da5/da9/ff7 x:0 0 0 2024-09-20T18:36:03.768 INFO:tasks.workunit.client.0.smithi017.stdout:4/488: link d4/dc/d1e/d26/f6a d4/dc/f9c 0 2024-09-20T18:36:03.768 INFO:tasks.workunit.client.0.smithi017.stdout:3/741: truncate da/de/d13/d2f/d26/fd6 208424 0 2024-09-20T18:36:03.769 INFO:tasks.workunit.client.0.smithi017.stdout:4/489: write d4/dc/d1e/d69/f72 [266217,77898] 0 2024-09-20T18:36:03.772 INFO:tasks.workunit.client.0.smithi017.stdout:4/490: mknod d4/dc/d1e/d69/d7a/d94/c9d 0 2024-09-20T18:36:03.774 INFO:tasks.workunit.client.0.smithi017.stdout:4/491: chown d4/dc/d1e/d26/l20 277033 1 2024-09-20T18:36:03.775 INFO:tasks.workunit.client.0.smithi017.stdout:3/742: dwrite da/de/d13/d2f/d26/d31/d5a/d76/d19/fe7 [0,4194304] 0 2024-09-20T18:36:03.777 INFO:tasks.workunit.client.0.smithi017.stdout:3/743: fdatasync da/fb 0 2024-09-20T18:36:03.780 INFO:tasks.workunit.client.0.smithi017.stdout:3/744: mkdir da/de/d13/d16/d6e/d82/df8 0 2024-09-20T18:36:03.783 INFO:tasks.workunit.client.0.smithi017.stdout:3/745: truncate da/de/d13/d2f/d26/d62/da5/da9/ff5 107231 0 2024-09-20T18:36:03.786 INFO:tasks.workunit.client.0.smithi017.stdout:3/746: creat da/de/d53/d88/db3/ff9 x:0 0 0 2024-09-20T18:36:03.793 INFO:tasks.workunit.client.0.smithi017.stdout:3/747: dwrite da/de/d13/d2f/d26/d41/f83 [0,4194304] 0 2024-09-20T18:36:03.798 INFO:tasks.workunit.client.0.smithi017.stdout:3/748: creat da/de/d13/d16/d6e/d97/dc1/dcc/ffa x:0 0 0 2024-09-20T18:36:03.800 INFO:tasks.workunit.client.0.smithi017.stdout:3/749: write da/de/d13/d2f/d26/d31/d5a/d76/de6/fec [12821,87899] 0 2024-09-20T18:36:03.803 INFO:tasks.workunit.client.0.smithi017.stdout:3/750: mkdir da/de/d53/d52/dfb 0 2024-09-20T18:36:03.805 INFO:tasks.workunit.client.0.smithi017.stdout:3/751: unlink da/de/d53/d88/cbf 0 2024-09-20T18:36:03.808 INFO:tasks.workunit.client.0.smithi017.stdout:3/752: creat da/de/d13/d16/d6e/d97/df1/ffc x:0 0 0 2024-09-20T18:36:03.810 INFO:tasks.workunit.client.0.smithi017.stdout:3/753: write da/de/d53/d52/fd7 [20326,105973] 0 2024-09-20T18:36:03.812 INFO:tasks.workunit.client.0.smithi017.stdout:3/754: creat da/de/ffd x:0 0 0 2024-09-20T18:36:03.813 INFO:tasks.workunit.client.0.smithi017.stdout:3/755: read da/f15 [2823587,89651] 0 2024-09-20T18:36:03.825 INFO:tasks.workunit.client.0.smithi017.stdout:3/756: dwrite da/de/d13/d2f/d26/d31/d5a/f8f [0,4194304] 0 2024-09-20T18:36:03.827 INFO:tasks.workunit.client.0.smithi017.stdout:3/757: dread - da/de/d13/d16/d6e/d97/fa6 zero size 2024-09-20T18:36:03.831 INFO:tasks.workunit.client.0.smithi017.stdout:3/758: symlink da/de/d13/d16/d6e/ddf/de9/lfe 0 2024-09-20T18:36:03.832 INFO:tasks.workunit.client.0.smithi017.stdout:3/759: fsync da/de/d13/d2f/d26/d31/d5a/d76/f9d 0 2024-09-20T18:36:03.837 INFO:tasks.workunit.client.0.smithi017.stdout:3/760: getdents da/de/d13/d16/d6e/ddf 0 2024-09-20T18:36:03.840 INFO:tasks.workunit.client.0.smithi017.stdout:3/761: dread da/de/d53/d88/f91 [0,4194304] 0 2024-09-20T18:36:03.844 INFO:tasks.workunit.client.0.smithi017.stdout:3/762: rmdir da/de/d53/dcf 0 2024-09-20T18:36:03.846 INFO:tasks.workunit.client.0.smithi017.stdout:3/763: unlink da/de/d13/d2f/d26/d31/lbe 0 2024-09-20T18:36:03.847 INFO:tasks.workunit.client.0.smithi017.stdout:3/764: dread - da/de/d13/d2f/d26/d62/da5/da9/dbb/fed zero size 2024-09-20T18:36:03.850 INFO:tasks.workunit.client.0.smithi017.stdout:3/765: mkdir da/de/d13/d16/d6e/dc9/dff 0 2024-09-20T18:36:03.863 INFO:tasks.workunit.client.0.smithi017.stdout:3/766: dwrite da/de/d13/d2f/d26/d31/d5a/f7f [0,4194304] 0 2024-09-20T18:36:03.866 INFO:tasks.workunit.client.0.smithi017.stdout:3/767: chown da/de/d13/d2f/d26/d62/da5/da9/cac 2 1 2024-09-20T18:36:03.867 INFO:tasks.workunit.client.0.smithi017.stdout:3/768: write da/de/d13/d2f/d26/d31/f45 [2908544,68555] 0 2024-09-20T18:36:03.869 INFO:tasks.workunit.client.0.smithi017.stdout:3/769: truncate da/de/d13/d2f/d26/d62/ff6 38453 0 2024-09-20T18:36:03.872 INFO:tasks.workunit.client.0.smithi017.stdout:3/770: creat da/de/d13/d16/d50/dd2/f100 x:0 0 0 2024-09-20T18:36:03.878 INFO:tasks.workunit.client.0.smithi017.stdout:3/771: dread da/de/d13/d2f/f6c [0,4194304] 0 2024-09-20T18:36:03.879 INFO:tasks.workunit.client.0.smithi017.stdout:3/772: chown da/de/d13/d2f/d92/dc8 2 1 2024-09-20T18:36:03.879 INFO:tasks.workunit.client.0.smithi017.stdout:3/773: readlink da/de/d53/la3 0 2024-09-20T18:36:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:03 smithi172 ceph-mon[35456]: pgmap v36: 65 pgs: 65 active+clean; 3.1 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 72 MiB/s rd, 205 MiB/s wr, 406 op/s 2024-09-20T18:36:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:03 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:03 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:03.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:03 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:36:03.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:03 smithi172 ceph-mon[35456]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:36:03.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:03 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:36:03.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:03 smithi172 ceph-mon[35456]: Upgrade: Need to upgrade myself (mgr.smithi172.jczphg) 2024-09-20T18:36:03.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:03 smithi172 ceph-mon[35456]: Upgrade: Need to upgrade myself (mgr.smithi172.jczphg) 2024-09-20T18:36:04.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:03 smithi017 ceph-mon[28058]: pgmap v36: 65 pgs: 65 active+clean; 3.1 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 72 MiB/s rd, 205 MiB/s wr, 406 op/s 2024-09-20T18:36:04.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:03 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:04.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:03 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:04.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:03 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:36:04.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:03 smithi017 ceph-mon[28058]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:36:04.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:03 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:36:04.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:03 smithi017 ceph-mon[28058]: Upgrade: Need to upgrade myself (mgr.smithi172.jczphg) 2024-09-20T18:36:04.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:03 smithi017 ceph-mon[28058]: Upgrade: Need to upgrade myself (mgr.smithi172.jczphg) 2024-09-20T18:36:04.517 INFO:tasks.workunit.client.0.smithi017.stdout:2/726: sync 2024-09-20T18:36:04.517 INFO:tasks.workunit.client.0.smithi017.stdout:8/477: sync 2024-09-20T18:36:04.519 INFO:tasks.workunit.client.0.smithi017.stdout:8/478: mkdir d0/d6/d28/d81/d9c 0 2024-09-20T18:36:04.521 INFO:tasks.workunit.client.0.smithi017.stdout:2/727: symlink d1/le9 0 2024-09-20T18:36:04.521 INFO:tasks.workunit.client.0.smithi017.stdout:8/479: chown d0/d6/d28/d3d/d4e/d55/l5d 10 1 2024-09-20T18:36:04.523 INFO:tasks.workunit.client.0.smithi017.stdout:2/728: creat d1/dc/d20/d2e/fea x:0 0 0 2024-09-20T18:36:04.524 INFO:tasks.workunit.client.0.smithi017.stdout:2/729: fdatasync d1/d67/d8f/fa4 0 2024-09-20T18:36:04.526 INFO:tasks.workunit.client.0.smithi017.stdout:2/730: symlink d1/dc/d20/d2e/leb 0 2024-09-20T18:36:04.531 INFO:tasks.workunit.client.0.smithi017.stdout:2/731: rename d1/dc/d20/d2e/d30/d85/d3d/lb6 to d1/d67/d8f/dcd/lec 0 2024-09-20T18:36:04.537 INFO:tasks.workunit.client.0.smithi017.stdout:2/732: link d1/dc/d20/d2e/d30/d85/d53/d6b/c89 d1/dc/d20/d2e/d30/d85/d3d/d77/ced 0 2024-09-20T18:36:04.539 INFO:tasks.workunit.client.0.smithi017.stdout:2/733: symlink d1/dc/d20/d2e/d30/d85/d46/d48/lee 0 2024-09-20T18:36:04.540 INFO:tasks.workunit.client.0.smithi017.stdout:8/480: write d0/d6/d28/d3d/d4e/f89 [2793735,17229] 0 2024-09-20T18:36:04.542 INFO:tasks.workunit.client.0.smithi017.stdout:2/734: creat d1/dc/d20/d2e/d30/d85/d53/fef x:0 0 0 2024-09-20T18:36:04.543 INFO:tasks.workunit.client.0.smithi017.stdout:2/735: chown d1/dc/d20/d2e/d30/db0/dc2 25602107 1 2024-09-20T18:36:04.545 INFO:tasks.workunit.client.0.smithi017.stdout:2/736: mkdir d1/dc/d20/d2e/df0 0 2024-09-20T18:36:04.548 INFO:tasks.workunit.client.0.smithi017.stdout:2/737: creat d1/dc/d20/d2e/d30/d85/d53/d6b/ff1 x:0 0 0 2024-09-20T18:36:04.550 INFO:tasks.workunit.client.0.smithi017.stdout:2/738: creat d1/dc/d20/d2e/ff2 x:0 0 0 2024-09-20T18:36:04.553 INFO:tasks.workunit.client.0.smithi017.stdout:2/739: mkdir d1/dc/d20/d2e/d30/d8a/ddf/df3 0 2024-09-20T18:36:04.554 INFO:tasks.workunit.client.0.smithi017.stdout:2/740: fdatasync d1/dc/d20/d2e/d30/d85/f87 0 2024-09-20T18:36:04.556 INFO:tasks.workunit.client.0.smithi017.stdout:2/741: mkdir d1/dc/d20/d2e/d30/db0/df4 0 2024-09-20T18:36:04.559 INFO:tasks.workunit.client.0.smithi017.stdout:2/742: mkdir d1/dc/d20/d2e/d30/d85/d3d/d77/d7a/df5 0 2024-09-20T18:36:04.559 INFO:tasks.workunit.client.0.smithi017.stdout:2/743: fdatasync d1/dc/d20/d2e/d30/d85/fd5 0 2024-09-20T18:36:04.560 INFO:tasks.workunit.client.0.smithi017.stdout:2/744: readlink d1/df/d17/l66 0 2024-09-20T18:36:04.562 INFO:tasks.workunit.client.0.smithi017.stdout:2/745: symlink d1/dc/d20/d2e/d30/d85/d53/d6b/lf6 0 2024-09-20T18:36:04.565 INFO:tasks.workunit.client.0.smithi017.stdout:2/746: creat d1/dc/d20/d2e/d30/d85/d98/ff7 x:0 0 0 2024-09-20T18:36:04.567 INFO:tasks.workunit.client.0.smithi017.stdout:2/747: creat d1/dc/d20/d2e/ff8 x:0 0 0 2024-09-20T18:36:04.580 INFO:tasks.workunit.client.0.smithi017.stdout:2/748: getdents d1/dc/d20/d2e/d30/d85/d3d/d77/d7a 0 2024-09-20T18:36:04.584 INFO:tasks.workunit.client.0.smithi017.stdout:2/749: symlink d1/lf9 0 2024-09-20T18:36:04.590 INFO:tasks.workunit.client.0.smithi017.stdout:2/750: dwrite d1/d67/d8f/dcd/fd0 [0,4194304] 0 2024-09-20T18:36:04.591 INFO:tasks.workunit.client.0.smithi017.stdout:2/751: dread - d1/dc/d20/d2e/d30/db0/dc2/fe4 zero size 2024-09-20T18:36:04.595 INFO:tasks.workunit.client.0.smithi017.stdout:2/752: creat d1/dc/d20/ffa x:0 0 0 2024-09-20T18:36:04.597 INFO:tasks.workunit.client.0.smithi017.stdout:2/753: symlink d1/dc/d20/d2e/lfb 0 2024-09-20T18:36:04.604 INFO:tasks.workunit.client.0.smithi017.stdout:2/754: dwrite d1/dc/d20/d2e/d30/d85/d53/fb7 [0,4194304] 0 2024-09-20T18:36:04.607 INFO:tasks.workunit.client.0.smithi017.stdout:2/755: symlink d1/dc/d20/d2e/d30/d85/d3d/d77/d7a/lfc 0 2024-09-20T18:36:04.609 INFO:tasks.workunit.client.0.smithi017.stdout:2/756: mknod d1/dc/d20/d2e/d30/db0/cfd 0 2024-09-20T18:36:04.614 INFO:tasks.workunit.client.0.smithi017.stdout:2/757: dread d1/dc/d20/d2e/d30/d85/f87 [0,4194304] 0 2024-09-20T18:36:04.616 INFO:tasks.workunit.client.0.smithi017.stdout:2/758: truncate d1/dc/d20/d2e/d30/d85/fd5 269313 0 2024-09-20T18:36:04.622 INFO:tasks.workunit.client.0.smithi017.stdout:2/759: link d1/dc/d20/d2e/lfb d1/dc/d20/d2e/d30/d85/d3d/d8d/lfe 0 2024-09-20T18:36:04.623 INFO:tasks.workunit.client.0.smithi017.stdout:2/760: readlink d1/dc/d20/d2e/d30/d85/l50 0 2024-09-20T18:36:04.623 INFO:tasks.workunit.client.0.smithi017.stdout:2/761: stat d1/d1f/f6e 0 2024-09-20T18:36:04.624 INFO:tasks.workunit.client.0.smithi017.stdout:2/762: fsync d1/dc/d20/d2e/db5/fe2 0 2024-09-20T18:36:04.627 INFO:tasks.workunit.client.0.smithi017.stdout:2/763: symlink d1/dc/d20/d2e/d30/d8a/lff 0 2024-09-20T18:36:04.627 INFO:tasks.workunit.client.0.smithi017.stdout:2/764: chown d1/dc/d20/d2e 173 1 2024-09-20T18:36:04.629 INFO:tasks.workunit.client.0.smithi017.stdout:2/765: readlink d1/d67/d8f/dcd/lec 0 2024-09-20T18:36:04.631 INFO:tasks.workunit.client.0.smithi017.stdout:2/766: dread d1/df/f71 [0,4194304] 0 2024-09-20T18:36:04.632 INFO:tasks.workunit.client.0.smithi017.stdout:2/767: chown d1/dc/d20/d2e/d30/d85/d53/fc4 6723991 1 2024-09-20T18:36:04.632 INFO:tasks.workunit.client.0.smithi017.stdout:2/768: dread - d1/dc/d20/ffa zero size 2024-09-20T18:36:04.635 INFO:tasks.workunit.client.0.smithi017.stdout:2/769: creat d1/d1f/d99/da6/f100 x:0 0 0 2024-09-20T18:36:04.637 INFO:tasks.workunit.client.0.smithi017.stdout:2/770: creat d1/d6c/f101 x:0 0 0 2024-09-20T18:36:04.645 INFO:tasks.workunit.client.0.smithi017.stdout:2/771: dwrite d1/d67/d8f/fa4 [0,4194304] 0 2024-09-20T18:36:04.705 INFO:tasks.workunit.client.0.smithi017.stdout:2/772: mknod d1/dc/d20/c102 0 2024-09-20T18:36:04.710 INFO:tasks.workunit.client.0.smithi017.stdout:2/773: dread d1/dc/d20/d2e/f5f [0,4194304] 0 2024-09-20T18:36:04.714 INFO:tasks.workunit.client.0.smithi017.stdout:2/774: rename d1/dc/d20/d2e/lfb to d1/dc/d20/d2e/d30/d8a/ddf/df3/l103 0 2024-09-20T18:36:04.719 INFO:tasks.workunit.client.0.smithi017.stdout:2/775: dread d1/df/fa8 [0,4194304] 0 2024-09-20T18:36:04.722 INFO:tasks.workunit.client.0.smithi017.stdout:2/776: truncate d1/dc/d20/d2e/d30/d85/d46/f51 1010641 0 2024-09-20T18:36:04.728 INFO:tasks.workunit.client.0.smithi017.stdout:2/777: dwrite d1/dc/d20/d2e/ff2 [0,4194304] 0 2024-09-20T18:36:04.733 INFO:tasks.workunit.client.0.smithi017.stdout:2/778: creat d1/dc/d20/d2e/d30/d85/d53/d6b/f104 x:0 0 0 2024-09-20T18:36:04.736 INFO:tasks.workunit.client.0.smithi017.stdout:2/779: creat d1/dc/d20/d2e/d30/d8a/ddf/f105 x:0 0 0 2024-09-20T18:36:04.739 INFO:tasks.workunit.client.0.smithi017.stdout:2/780: rmdir d1/dc/d20/d2e/d30/d85/d98 39 2024-09-20T18:36:04.741 INFO:tasks.workunit.client.0.smithi017.stdout:2/781: write d1/dc/d20/d2e/d30/d8a/fdd [503345,47892] 0 2024-09-20T18:36:04.741 INFO:tasks.workunit.client.0.smithi017.stdout:2/782: readlink d1/d67/l81 0 2024-09-20T18:36:04.745 INFO:tasks.workunit.client.0.smithi017.stdout:2/783: mkdir d1/d1f/d106 0 2024-09-20T18:36:04.767 INFO:tasks.workunit.client.0.smithi017.stdout:2/784: dwrite d1/dc/d20/d2e/f49 [0,4194304] 0 2024-09-20T18:36:04.775 INFO:tasks.workunit.client.0.smithi017.stdout:2/785: dwrite d1/dc/d20/d2e/d30/d85/d53/d6b/ff1 [0,4194304] 0 2024-09-20T18:36:04.775 INFO:tasks.workunit.client.0.smithi017.stdout:2/786: chown d1/dc/d20/d2e/d30/db0 492 1 2024-09-20T18:36:04.783 INFO:tasks.workunit.client.0.smithi017.stdout:2/787: dwrite d1/dc/d20/d2e/d30/d85/d53/d6b/ff1 [0,4194304] 0 2024-09-20T18:36:04.790 INFO:tasks.workunit.client.0.smithi017.stdout:5/494: sync 2024-09-20T18:36:04.791 INFO:tasks.workunit.client.0.smithi017.stdout:9/765: sync 2024-09-20T18:36:04.791 INFO:tasks.workunit.client.0.smithi017.stdout:2/788: dwrite d1/df/f1e [0,4194304] 0 2024-09-20T18:36:04.792 INFO:tasks.workunit.client.0.smithi017.stdout:5/495: chown d0/d6e/f93 298015 1 2024-09-20T18:36:04.792 INFO:tasks.workunit.client.0.smithi017.stdout:9/766: read - d6/d23/d3a/fc4 zero size 2024-09-20T18:36:04.802 INFO:tasks.workunit.client.0.smithi017.stdout:9/767: dwrite d6/d23/d3a/f5e [0,4194304] 0 2024-09-20T18:36:04.803 INFO:tasks.workunit.client.0.smithi017.stdout:2/789: mknod d1/d67/d8f/dcd/c107 0 2024-09-20T18:36:04.806 INFO:tasks.workunit.client.0.smithi017.stdout:9/768: symlink d6/d23/d58/d3f/d4d/l116 0 2024-09-20T18:36:04.819 INFO:tasks.workunit.client.0.smithi017.stdout:5/496: dwrite d0/d14/d18/d1b/f31 [0,4194304] 0 2024-09-20T18:36:04.830 INFO:tasks.workunit.client.0.smithi017.stdout:5/497: write d0/d14/d18/f3b [4520344,81564] 0 2024-09-20T18:36:04.834 INFO:tasks.workunit.client.0.smithi017.stdout:5/498: creat d0/d14/d18/d2a/d39/d6c/f9f x:0 0 0 2024-09-20T18:36:04.838 INFO:tasks.workunit.client.0.smithi017.stdout:5/499: rename d0/d14/d40/l6b to d0/d14/d18/la0 0 2024-09-20T18:36:04.843 INFO:tasks.workunit.client.0.smithi017.stdout:5/500: rename d0/d14/d18/d19/d4d/d6d/d78/d7b to d0/d14/d18/d2a/da1 0 2024-09-20T18:36:04.843 INFO:tasks.workunit.client.0.smithi017.stdout:5/501: stat d0/l54 0 2024-09-20T18:36:04.846 INFO:tasks.workunit.client.0.smithi017.stdout:5/502: creat d0/d14/d18/d19/d4d/d6d/fa2 x:0 0 0 2024-09-20T18:36:04.847 INFO:tasks.workunit.client.0.smithi017.stdout:5/503: write d0/d14/d18/d57/f5d [1495572,18798] 0 2024-09-20T18:36:04.862 INFO:tasks.workunit.client.0.smithi017.stdout:5/504: dread d0/d14/d18/d57/f5d [0,4194304] 0 2024-09-20T18:36:04.870 INFO:tasks.workunit.client.0.smithi017.stdout:5/505: dwrite d0/d14/d18/d57/f7d [0,4194304] 0 2024-09-20T18:36:04.876 INFO:tasks.workunit.client.0.smithi017.stdout:5/506: unlink d0/d14/d18/l1d 0 2024-09-20T18:36:04.879 INFO:tasks.workunit.client.0.smithi017.stdout:5/507: mknod d0/d14/d18/d57/ca3 0 2024-09-20T18:36:04.884 INFO:tasks.workunit.client.0.smithi017.stdout:5/508: truncate d0/d14/d18/d2a/d39/d42/d7e/f8d 3980269 0 2024-09-20T18:36:04.885 INFO:tasks.workunit.client.0.smithi017.stdout:5/509: read - d0/d14/d18/d2a/d39/d6c/f9f zero size 2024-09-20T18:36:04.887 INFO:tasks.workunit.client.0.smithi017.stdout:5/510: rmdir d0/d6e 39 2024-09-20T18:36:04.900 INFO:tasks.workunit.client.0.smithi017.stdout:0/520: sync 2024-09-20T18:36:04.900 INFO:tasks.workunit.client.0.smithi017.stdout:1/507: sync 2024-09-20T18:36:04.901 INFO:tasks.workunit.client.0.smithi017.stdout:0/521: write d4/fa [1883944,80394] 0 2024-09-20T18:36:04.922 INFO:tasks.workunit.client.0.smithi017.stdout:0/522: fsync d4/db/f2c 0 2024-09-20T18:36:04.923 INFO:tasks.workunit.client.0.smithi017.stdout:1/508: getdents df/d1c/d79 0 2024-09-20T18:36:04.924 INFO:tasks.workunit.client.0.smithi017.stdout:1/509: dread - df/d16/d50/d87/f8e zero size 2024-09-20T18:36:05.013 INFO:tasks.workunit.client.0.smithi017.stdout:0/523: rmdir d4/db/d18/d25/d36/d47/d81/d9c 39 2024-09-20T18:36:05.018 INFO:tasks.workunit.client.0.smithi017.stdout:0/524: creat d4/d20/d63/d86/fb5 x:0 0 0 2024-09-20T18:36:05.023 INFO:tasks.workunit.client.0.smithi017.stdout:1/510: truncate df/d16/d50/d69/f4c 1354472 0 2024-09-20T18:36:05.025 INFO:tasks.workunit.client.0.smithi017.stdout:0/525: write d4/db/f12 [1054674,10401] 0 2024-09-20T18:36:05.027 INFO:tasks.workunit.client.0.smithi017.stdout:0/526: read d4/db/d1e/d42/f67 [386384,62090] 0 2024-09-20T18:36:05.027 INFO:tasks.workunit.client.0.smithi017.stdout:1/511: truncate df/f2b 720271 0 2024-09-20T18:36:05.033 INFO:tasks.workunit.client.0.smithi017.stdout:0/527: symlink d4/d20/lb6 0 2024-09-20T18:36:05.035 INFO:tasks.workunit.client.0.smithi017.stdout:1/512: unlink df/d1c/f6f 0 2024-09-20T18:36:05.040 INFO:tasks.workunit.client.0.smithi017.stdout:0/528: rename d4/db/d1e/d24/d2f/f5e to d4/db/d18/d25/d36/d47/d81/d9c/fb7 0 2024-09-20T18:36:05.046 INFO:tasks.workunit.client.0.smithi017.stdout:0/529: dwrite d4/db/fc [0,4194304] 0 2024-09-20T18:36:05.046 INFO:tasks.workunit.client.0.smithi017.stdout:1/513: rename df/d29/d2c/l7b to df/d16/d50/d69/l9e 0 2024-09-20T18:36:05.047 INFO:tasks.workunit.client.0.smithi017.stdout:0/530: stat d4/db/d1e/d24/f4b 0 2024-09-20T18:36:05.051 INFO:tasks.workunit.client.0.smithi017.stdout:0/531: creat d4/db/d18/d25/fb8 x:0 0 0 2024-09-20T18:36:05.053 INFO:tasks.workunit.client.0.smithi017.stdout:1/514: creat df/d29/f9f x:0 0 0 2024-09-20T18:36:05.054 INFO:tasks.workunit.client.0.smithi017.stdout:0/532: creat d4/d20/fb9 x:0 0 0 2024-09-20T18:36:05.057 INFO:tasks.workunit.client.0.smithi017.stdout:6/565: sync 2024-09-20T18:36:05.058 INFO:tasks.workunit.client.0.smithi017.stdout:0/533: creat d4/db/fba x:0 0 0 2024-09-20T18:36:05.061 INFO:tasks.workunit.client.0.smithi017.stdout:0/534: write d4/db/d1e/d42/f67 [1271004,126377] 0 2024-09-20T18:36:05.063 INFO:tasks.workunit.client.0.smithi017.stdout:0/535: write d4/d20/d63/d86/fa7 [372434,122790] 0 2024-09-20T18:36:05.198 INFO:tasks.workunit.client.0.smithi017.stdout:7/550: sync 2024-09-20T18:36:05.198 INFO:tasks.workunit.client.0.smithi017.stdout:4/492: sync 2024-09-20T18:36:05.198 INFO:tasks.workunit.client.0.smithi017.stdout:7/551: stat da/d16/l62 0 2024-09-20T18:36:05.211 INFO:tasks.workunit.client.0.smithi017.stdout:7/552: mknod da/cb0 0 2024-09-20T18:36:05.212 INFO:tasks.workunit.client.0.smithi017.stdout:7/553: chown da/d16/d1c/d40/f7d 59761 1 2024-09-20T18:36:05.214 INFO:tasks.workunit.client.0.smithi017.stdout:4/493: rmdir d4/d7f/d91 0 2024-09-20T18:36:05.214 INFO:tasks.workunit.client.0.smithi017.stdout:4/494: fsync d4/de/f59 0 2024-09-20T18:36:05.219 INFO:tasks.workunit.client.0.smithi017.stdout:4/495: creat d4/d19/d62/f9e x:0 0 0 2024-09-20T18:36:05.226 INFO:tasks.workunit.client.0.smithi017.stdout:6/566: write d4/df/d4a/f6c [881578,116515] 0 2024-09-20T18:36:05.229 INFO:tasks.workunit.client.0.smithi017.stdout:1/515: dwrite df/d16/d50/d53/f67 [0,4194304] 0 2024-09-20T18:36:05.229 INFO:tasks.workunit.client.0.smithi017.stdout:4/496: dwrite d4/d19/d62/f9e [0,4194304] 0 2024-09-20T18:36:05.232 INFO:tasks.workunit.client.0.smithi017.stdout:1/516: read df/d35/f76 [1145450,37294] 0 2024-09-20T18:36:05.233 INFO:tasks.workunit.client.0.smithi017.stdout:1/517: stat df/f5a 0 2024-09-20T18:36:05.234 INFO:tasks.workunit.client.0.smithi017.stdout:7/554: dread da/d16/f67 [0,4194304] 0 2024-09-20T18:36:05.235 INFO:tasks.workunit.client.0.smithi017.stdout:4/497: read d4/de/d1b/f45 [1120323,126978] 0 2024-09-20T18:36:05.237 INFO:tasks.workunit.client.0.smithi017.stdout:4/498: dread d4/d19/f42 [0,4194304] 0 2024-09-20T18:36:05.242 INFO:tasks.workunit.client.0.smithi017.stdout:0/536: truncate d4/db/d1e/d24/d2f/d51/d52/d77/f8a 858418 0 2024-09-20T18:36:05.243 INFO:tasks.workunit.client.0.smithi017.stdout:1/518: unlink df/f5d 0 2024-09-20T18:36:05.244 INFO:tasks.workunit.client.0.smithi017.stdout:1/519: chown df/d16/l66 22941769 1 2024-09-20T18:36:05.247 INFO:tasks.workunit.client.0.smithi017.stdout:6/567: mkdir d4/d37/d68/d8d/dba/dc0 0 2024-09-20T18:36:05.248 INFO:tasks.workunit.client.0.smithi017.stdout:4/499: symlink d4/dc/d41/l9f 0 2024-09-20T18:36:05.255 INFO:tasks.workunit.client.0.smithi017.stdout:6/568: creat d4/df/d1f/d25/d3f/d5c/fc1 x:0 0 0 2024-09-20T18:36:05.256 INFO:tasks.workunit.client.0.smithi017.stdout:3/774: sync 2024-09-20T18:36:05.256 INFO:tasks.workunit.client.0.smithi017.stdout:8/481: sync 2024-09-20T18:36:05.256 INFO:tasks.workunit.client.0.smithi017.stdout:2/790: sync 2024-09-20T18:36:05.259 INFO:tasks.workunit.client.0.smithi017.stdout:7/555: creat da/d16/d1c/d40/fb1 x:0 0 0 2024-09-20T18:36:05.259 INFO:tasks.workunit.client.0.smithi017.stdout:4/500: mkdir d4/de/d65/da0 0 2024-09-20T18:36:05.262 INFO:tasks.workunit.client.0.smithi017.stdout:4/501: stat d4/d19/d37/d66/f6f 0 2024-09-20T18:36:05.263 INFO:tasks.workunit.client.0.smithi017.stdout:7/556: write da/d16/d1c/d40/f7d [3341252,30440] 0 2024-09-20T18:36:05.266 INFO:tasks.workunit.client.0.smithi017.stdout:7/557: stat da/cd 0 2024-09-20T18:36:05.267 INFO:tasks.workunit.client.0.smithi017.stdout:6/569: dwrite d4/df/d4a/fb3 [0,4194304] 0 2024-09-20T18:36:05.269 INFO:tasks.workunit.client.0.smithi017.stdout:2/791: dwrite d1/df/f1e [0,4194304] 0 2024-09-20T18:36:05.275 INFO:tasks.workunit.client.0.smithi017.stdout:8/482: mknod d0/d6/d28/d3b/d72/c9d 0 2024-09-20T18:36:05.278 INFO:tasks.workunit.client.0.smithi017.stdout:4/502: write d4/d19/f42 [2619440,60559] 0 2024-09-20T18:36:05.283 INFO:tasks.workunit.client.0.smithi017.stdout:4/503: stat d4/dc/l85 0 2024-09-20T18:36:05.286 INFO:tasks.workunit.client.0.smithi017.stdout:7/558: dwrite da/f22 [0,4194304] 0 2024-09-20T18:36:05.289 INFO:tasks.workunit.client.0.smithi017.stdout:1/520: dread df/f5a [0,4194304] 0 2024-09-20T18:36:05.289 INFO:tasks.workunit.client.0.smithi017.stdout:2/792: creat d1/d67/d8f/d9e/f108 x:0 0 0 2024-09-20T18:36:05.290 INFO:tasks.workunit.client.0.smithi017.stdout:7/559: chown da/d16/d1c/d40/d34/l57 152 1 2024-09-20T18:36:05.291 INFO:tasks.workunit.client.0.smithi017.stdout:4/504: truncate d4/d82/d88/f9b 806575 0 2024-09-20T18:36:05.292 INFO:tasks.workunit.client.0.smithi017.stdout:1/521: dread - df/d29/d2c/f65 zero size 2024-09-20T18:36:05.295 INFO:tasks.workunit.client.0.smithi017.stdout:6/570: dread d4/d37/d41/f77 [0,4194304] 0 2024-09-20T18:36:05.296 INFO:tasks.workunit.client.0.smithi017.stdout:4/505: write d4/d19/d37/d66/f6f [1422468,101404] 0 2024-09-20T18:36:05.297 INFO:tasks.workunit.client.0.smithi017.stdout:6/571: write d4/df/d4a/f9b [398793,127738] 0 2024-09-20T18:36:05.300 INFO:tasks.workunit.client.0.smithi017.stdout:1/522: readlink df/d35/d4f/l9b 0 2024-09-20T18:36:05.303 INFO:tasks.workunit.client.0.smithi017.stdout:1/523: write df/d29/d2c/f65 [709689,90196] 0 2024-09-20T18:36:05.303 INFO:tasks.workunit.client.0.smithi017.stdout:2/793: dread d1/dc/d20/d2e/d30/d8a/fdd [0,4194304] 0 2024-09-20T18:36:05.305 INFO:tasks.workunit.client.0.smithi017.stdout:1/524: readlink df/d1c/l7a 0 2024-09-20T18:36:05.307 INFO:tasks.workunit.client.0.smithi017.stdout:4/506: read - d4/de/d1b/d56/d67/f76 zero size 2024-09-20T18:36:05.309 INFO:tasks.workunit.client.0.smithi017.stdout:3/775: dread da/de/d13/d2f/d26/d31/d5a/f6d [4194304,4194304] 0 2024-09-20T18:36:05.311 INFO:tasks.workunit.client.0.smithi017.stdout:0/537: write d4/d20/f2e [475845,25084] 0 2024-09-20T18:36:05.312 INFO:tasks.workunit.client.0.smithi017.stdout:1/525: mkdir df/d1c/d80/da0 0 2024-09-20T18:36:05.313 INFO:tasks.workunit.client.0.smithi017.stdout:9/769: sync 2024-09-20T18:36:05.313 INFO:tasks.workunit.client.0.smithi017.stdout:5/511: sync 2024-09-20T18:36:05.330 INFO:tasks.workunit.client.0.smithi017.stdout:0/538: dread - d4/db/d1e/d42/f7b zero size 2024-09-20T18:36:05.338 INFO:tasks.workunit.client.0.smithi017.stdout:1/526: dread df/d16/d50/d53/f67 [0,4194304] 0 2024-09-20T18:36:05.345 INFO:tasks.workunit.client.0.smithi017.stdout:6/572: dwrite d4/d29/f81 [0,4194304] 0 2024-09-20T18:36:05.345 INFO:tasks.workunit.client.0.smithi017.stdout:2/794: dwrite d1/dc/d20/d2e/d30/d85/fd5 [0,4194304] 0 2024-09-20T18:36:05.349 INFO:tasks.workunit.client.0.smithi017.stdout:8/483: write d0/d6/f7e [2699769,23690] 0 2024-09-20T18:36:05.350 INFO:tasks.workunit.client.0.smithi017.stdout:0/539: write d4/d20/f6f [919913,86190] 0 2024-09-20T18:36:05.350 INFO:tasks.workunit.client.0.smithi017.stdout:9/770: symlink d6/d23/d58/d3f/d70/db0/dca/d107/l117 0 2024-09-20T18:36:05.350 INFO:tasks.workunit.client.0.smithi017.stdout:3/776: dwrite da/de/ffd [0,4194304] 0 2024-09-20T18:36:05.354 INFO:tasks.workunit.client.0.smithi017.stdout:7/560: dread da/d16/d1c/f1d [0,4194304] 0 2024-09-20T18:36:05.358 INFO:tasks.workunit.client.0.smithi017.stdout:5/512: rmdir d0/d14/d18/d2a 39 2024-09-20T18:36:05.360 INFO:tasks.workunit.client.0.smithi017.stdout:4/507: dread d4/d19/f30 [0,4194304] 0 2024-09-20T18:36:05.364 INFO:tasks.workunit.client.0.smithi017.stdout:9/771: unlink d6/d23/d58/ca1 0 2024-09-20T18:36:05.368 INFO:tasks.workunit.client.0.smithi017.stdout:8/484: rename d0/d6/d28/f68 to d0/d65/d8b/f9e 0 2024-09-20T18:36:05.372 INFO:tasks.workunit.client.0.smithi017.stdout:3/777: mkdir da/de/d53/d88/db3/d101 0 2024-09-20T18:36:05.377 INFO:tasks.workunit.client.0.smithi017.stdout:0/540: mknod d4/db/d18/d25/d36/d47/d8c/daa/cbb 0 2024-09-20T18:36:05.379 INFO:tasks.workunit.client.0.smithi017.stdout:1/527: dwrite df/f26 [0,4194304] 0 2024-09-20T18:36:05.382 INFO:tasks.workunit.client.0.smithi017.stdout:0/541: readlink d4/d20/lb6 0 2024-09-20T18:36:05.382 INFO:tasks.workunit.client.0.smithi017.stdout:8/485: unlink d0/d6/d73/f8f 0 2024-09-20T18:36:05.384 INFO:tasks.workunit.client.0.smithi017.stdout:7/561: getdents da/d94 0 2024-09-20T18:36:05.394 INFO:tasks.workunit.client.0.smithi017.stdout:3/778: mkdir da/de/d13/d16/d50/d102 0 2024-09-20T18:36:05.394 INFO:tasks.workunit.client.0.smithi017.stdout:1/528: dwrite df/d35/f76 [0,4194304] 0 2024-09-20T18:36:05.396 INFO:tasks.workunit.client.0.smithi017.stdout:3/779: chown da/de/d13/d2f/d26/d62/c8b 800433 1 2024-09-20T18:36:05.401 INFO:tasks.workunit.client.0.smithi017.stdout:2/795: rmdir d1/dc/d20/d2e/d30/d85/d3d/d77/d7a/df5 0 2024-09-20T18:36:05.404 INFO:tasks.workunit.client.0.smithi017.stdout:6/573: dwrite d4/df/d1f/d25/fa5 [0,4194304] 0 2024-09-20T18:36:05.404 INFO:tasks.workunit.client.0.smithi017.stdout:5/513: mknod d0/d14/d18/d2a/d39/ca4 0 2024-09-20T18:36:05.409 INFO:tasks.workunit.client.0.smithi017.stdout:9/772: dread d6/d23/d58/d3f/d2f/f95 [0,4194304] 0 2024-09-20T18:36:05.411 INFO:tasks.workunit.client.0.smithi017.stdout:9/773: chown d6/d23/d40/db4/dba/dd7/fdc 176 1 2024-09-20T18:36:05.415 INFO:tasks.workunit.client.0.smithi017.stdout:4/508: truncate d4/dc/f12 1031382 0 2024-09-20T18:36:05.416 INFO:tasks.workunit.client.0.smithi017.stdout:3/780: rename da/de/d53/d88/fdb to da/de/d53/d52/dfb/f103 0 2024-09-20T18:36:05.417 INFO:tasks.workunit.client.0.smithi017.stdout:3/781: chown da/de/d53/d88 1045333 1 2024-09-20T18:36:05.417 INFO:tasks.workunit.client.0.smithi017.stdout:4/509: write d4/de/d1b/f4c [885719,81876] 0 2024-09-20T18:36:05.417 INFO:tasks.workunit.client.0.smithi017.stdout:8/486: creat d0/d6/d28/d3d/d4e/d55/d83/f9f x:0 0 0 2024-09-20T18:36:05.422 INFO:tasks.workunit.client.0.smithi017.stdout:6/574: mkdir d4/d37/d41/d43/d7d/dc2 0 2024-09-20T18:36:05.422 INFO:tasks.workunit.client.0.smithi017.stdout:8/487: dread - d0/d6/d28/f9b zero size 2024-09-20T18:36:05.423 INFO:tasks.workunit.client.0.smithi017.stdout:2/796: read d1/dc/d20/d2e/d30/f97 [517236,82711] 0 2024-09-20T18:36:05.426 INFO:tasks.workunit.client.0.smithi017.stdout:5/514: stat d0/d14/d18/d19/d4d/d6d/d78/l90 0 2024-09-20T18:36:05.432 INFO:tasks.workunit.client.0.smithi017.stdout:7/562: dread da/d16/d1c/d40/d34/d3c/f48 [0,4194304] 0 2024-09-20T18:36:05.435 INFO:tasks.workunit.client.0.smithi017.stdout:2/797: dwrite d1/dc/d20/d2e/f49 [0,4194304] 0 2024-09-20T18:36:05.437 INFO:tasks.workunit.client.0.smithi017.stdout:0/542: link d4/db/d18/f22 d4/db/d18/d25/d36/d47/d8c/daa/fbc 0 2024-09-20T18:36:05.441 INFO:tasks.workunit.client.0.smithi017.stdout:4/510: rename d4/de to d4/d19/d37/da1 0 2024-09-20T18:36:05.442 INFO:tasks.workunit.client.0.smithi017.stdout:0/543: dread - d4/d20/d63/d86/fb5 zero size 2024-09-20T18:36:05.443 INFO:tasks.workunit.client.0.smithi017.stdout:6/575: chown d4/df/d1f/c89 0 1 2024-09-20T18:36:05.444 INFO:tasks.workunit.client.0.smithi017.stdout:9/774: dwrite d6/d23/d40/db4/dba/dd7/f108 [0,4194304] 0 2024-09-20T18:36:05.448 INFO:tasks.workunit.client.0.smithi017.stdout:5/515: mknod d0/d14/d18/d19/d85/ca5 0 2024-09-20T18:36:05.452 INFO:tasks.workunit.client.0.smithi017.stdout:2/798: mkdir d1/dc/d20/d2e/d30/d85/d3d/d77/d7a/d109 0 2024-09-20T18:36:05.455 INFO:tasks.workunit.client.0.smithi017.stdout:3/782: link da/de/d13/d16/d50/dd2/f100 da/de/d13/d16/d50/d102/f104 0 2024-09-20T18:36:05.456 INFO:tasks.workunit.client.0.smithi017.stdout:8/488: creat d0/d6/d28/d3d/d4e/d55/d8a/fa0 x:0 0 0 2024-09-20T18:36:05.457 INFO:tasks.workunit.client.0.smithi017.stdout:3/783: write da/de/d13/d2f/d26/d41/f83 [3252675,82076] 0 2024-09-20T18:36:05.458 INFO:tasks.workunit.client.0.smithi017.stdout:0/544: mkdir d4/d20/d63/dbd 0 2024-09-20T18:36:05.460 INFO:tasks.workunit.client.0.smithi017.stdout:1/529: link df/d3b/l47 df/la1 0 2024-09-20T18:36:05.463 INFO:tasks.workunit.client.0.smithi017.stdout:2/799: rmdir d1/dc/d20/d2e/d30/d85 39 2024-09-20T18:36:05.467 INFO:tasks.workunit.client.0.smithi017.stdout:4/511: dwrite d4/d19/d37/da1/d1b/f58 [0,4194304] 0 2024-09-20T18:36:05.469 INFO:tasks.workunit.client.0.smithi017.stdout:3/784: unlink da/fbc 0 2024-09-20T18:36:05.471 INFO:tasks.workunit.client.0.smithi017.stdout:0/545: fdatasync d4/db/f62 0 2024-09-20T18:36:05.474 INFO:tasks.workunit.client.0.smithi017.stdout:5/516: dwrite d0/d14/d18/d1b/f5c [0,4194304] 0 2024-09-20T18:36:05.480 INFO:tasks.workunit.client.0.smithi017.stdout:7/563: dwrite da/d16/f67 [0,4194304] 0 2024-09-20T18:36:05.481 INFO:tasks.workunit.client.0.smithi017.stdout:4/512: creat d4/d19/d37/d66/fa2 x:0 0 0 2024-09-20T18:36:05.485 INFO:tasks.workunit.client.0.smithi017.stdout:9/775: creat d6/d23/d58/d3f/d70/f118 x:0 0 0 2024-09-20T18:36:05.492 INFO:tasks.workunit.client.0.smithi017.stdout:5/517: creat d0/d14/d18/d1b/fa6 x:0 0 0 2024-09-20T18:36:05.493 INFO:tasks.workunit.client.0.smithi017.stdout:6/576: dwrite d4/d37/d41/d43/f92 [0,4194304] 0 2024-09-20T18:36:05.496 INFO:tasks.workunit.client.0.smithi017.stdout:8/489: dwrite d0/d6/d28/d3d/f60 [4194304,4194304] 0 2024-09-20T18:36:05.496 INFO:tasks.workunit.client.0.smithi017.stdout:1/530: rename df/d8f/l91 to df/d29/la2 0 2024-09-20T18:36:05.498 INFO:tasks.workunit.client.0.smithi017.stdout:1/531: dread - df/d1c/f93 zero size 2024-09-20T18:36:05.503 INFO:tasks.workunit.client.0.smithi017.stdout:3/785: creat da/de/d13/d16/d6e/dc9/dff/f105 x:0 0 0 2024-09-20T18:36:05.504 INFO:tasks.workunit.client.0.smithi017.stdout:5/518: dread d0/d14/d18/d1b/f31 [0,4194304] 0 2024-09-20T18:36:05.508 INFO:tasks.workunit.client.0.smithi017.stdout:6/577: dwrite d4/df/d8a/fbe [0,4194304] 0 2024-09-20T18:36:05.513 INFO:tasks.workunit.client.0.smithi017.stdout:9/776: mkdir d6/d23/d58/d3f/d70/db0/dca/d119 0 2024-09-20T18:36:05.513 INFO:tasks.workunit.client.0.smithi017.stdout:7/564: mknod da/d16/d1c/d40/d3a/d8a/d91/cb2 0 2024-09-20T18:36:05.513 INFO:tasks.workunit.client.0.smithi017.stdout:4/513: getdents d4/d82/d88/d5c/d8f/d92 0 2024-09-20T18:36:05.519 INFO:tasks.workunit.client.0.smithi017.stdout:9/777: write d6/d23/d3a/d61/de7/faf [1015685,101175] 0 2024-09-20T18:36:05.519 INFO:tasks.workunit.client.0.smithi017.stdout:1/532: rmdir df/d16/d50 39 2024-09-20T18:36:05.520 INFO:tasks.workunit.client.0.smithi017.stdout:8/490: symlink d0/d6/d28/d3d/d4e/d55/la1 0 2024-09-20T18:36:05.521 INFO:tasks.workunit.client.0.smithi017.stdout:2/800: dwrite d1/dc/d20/d2e/d30/d85/d53/fc4 [4194304,4194304] 0 2024-09-20T18:36:05.524 INFO:tasks.workunit.client.0.smithi017.stdout:8/491: dread - d0/d6/d28/d3a/f86 zero size 2024-09-20T18:36:05.525 INFO:tasks.workunit.client.0.smithi017.stdout:7/565: dwrite da/f22 [4194304,4194304] 0 2024-09-20T18:36:05.527 INFO:tasks.workunit.client.0.smithi017.stdout:3/786: unlink da/de/d13/d16/d50/c59 0 2024-09-20T18:36:05.528 INFO:tasks.workunit.client.0.smithi017.stdout:9/778: read d6/d23/f71 [240190,120478] 0 2024-09-20T18:36:05.531 INFO:tasks.workunit.client.0.smithi017.stdout:7/566: write da/f14 [381242,81312] 0 2024-09-20T18:36:05.533 INFO:tasks.workunit.client.0.smithi017.stdout:3/787: dread da/f4e [0,4194304] 0 2024-09-20T18:36:05.537 INFO:tasks.workunit.client.0.smithi017.stdout:4/514: dread d4/f38 [4194304,4194304] 0 2024-09-20T18:36:05.540 INFO:tasks.workunit.client.0.smithi017.stdout:5/519: mknod d0/d14/ca7 0 2024-09-20T18:36:05.540 INFO:tasks.workunit.client.0.smithi017.stdout:8/492: mkdir d0/d6/d28/d3d/d4e/d55/d83/da2 0 2024-09-20T18:36:05.541 INFO:tasks.workunit.client.0.smithi017.stdout:6/578: dwrite d4/d37/d68/da4/d9e/f9f [0,4194304] 0 2024-09-20T18:36:05.543 INFO:tasks.workunit.client.0.smithi017.stdout:8/493: fdatasync d0/d6/d28/d3d/d4e/f51 0 2024-09-20T18:36:05.545 INFO:tasks.workunit.client.0.smithi017.stdout:8/494: readlink d0/l24 0 2024-09-20T18:36:05.545 INFO:tasks.workunit.client.0.smithi017.stdout:9/779: creat d6/d23/d58/d3f/d70/db0/f11a x:0 0 0 2024-09-20T18:36:05.549 INFO:tasks.workunit.client.0.smithi017.stdout:0/546: rename d4/db/d1e/d24/d2f/d51/d52/la2 to d4/lbe 0 2024-09-20T18:36:05.550 INFO:tasks.workunit.client.0.smithi017.stdout:3/788: mknod da/de/d13/d16/d6e/ddf/de9/c106 0 2024-09-20T18:36:05.556 INFO:tasks.workunit.client.0.smithi017.stdout:1/533: unlink df/c15 0 2024-09-20T18:36:05.556 INFO:tasks.workunit.client.0.smithi017.stdout:1/534: chown df/d1c/d45 35 1 2024-09-20T18:36:05.557 INFO:tasks.workunit.client.0.smithi017.stdout:5/520: mkdir d0/d14/d18/d2a/d39/d42/d7e/da8 0 2024-09-20T18:36:05.560 INFO:tasks.workunit.client.0.smithi017.stdout:2/801: truncate d1/dc/d20/d2e/d30/f4b 200370 0 2024-09-20T18:36:05.561 INFO:tasks.workunit.client.0.smithi017.stdout:8/495: mknod d0/d6/d28/d3a/ca3 0 2024-09-20T18:36:05.564 INFO:tasks.workunit.client.0.smithi017.stdout:8/496: write d0/d6/d28/d3d/d4e/d55/f9a [75709,23813] 0 2024-09-20T18:36:05.564 INFO:tasks.workunit.client.0.smithi017.stdout:7/567: rename da/d16/d1c to da/d16/d1c/d40/db3 22 2024-09-20T18:36:05.565 INFO:tasks.workunit.client.0.smithi017.stdout:8/497: read - d0/d6/d73/f8e zero size 2024-09-20T18:36:05.566 INFO:tasks.workunit.client.0.smithi017.stdout:8/498: dread - d0/d6/d28/d3a/f86 zero size 2024-09-20T18:36:05.566 INFO:tasks.workunit.client.0.smithi017.stdout:3/789: creat da/de/d53/d52/f107 x:0 0 0 2024-09-20T18:36:05.568 INFO:tasks.workunit.client.0.smithi017.stdout:4/515: mknod d4/dc/d1e/ca3 0 2024-09-20T18:36:05.574 INFO:tasks.workunit.client.0.smithi017.stdout:8/499: dwrite d0/d6/d28/d3d/d4e/f51 [0,4194304] 0 2024-09-20T18:36:05.576 INFO:tasks.workunit.client.0.smithi017.stdout:2/802: creat d1/dc/d20/d2e/d30/d85/d46/d48/f10a x:0 0 0 2024-09-20T18:36:05.577 INFO:tasks.workunit.client.0.smithi017.stdout:5/521: dread d0/d14/d18/d57/f7d [0,4194304] 0 2024-09-20T18:36:05.580 INFO:tasks.workunit.client.0.smithi017.stdout:7/568: write da/d16/d1c/d40/d3a/f7b [503320,121315] 0 2024-09-20T18:36:05.589 INFO:tasks.workunit.client.0.smithi017.stdout:9/780: dwrite d6/d23/d58/d3f/d70/dfe/d10b/f33 [4194304,4194304] 0 2024-09-20T18:36:05.591 INFO:tasks.workunit.client.0.smithi017.stdout:4/516: dread d4/d19/d37/da1/d1b/d56/d67/f6e [0,4194304] 0 2024-09-20T18:36:05.594 INFO:tasks.workunit.client.0.smithi017.stdout:2/803: mkdir d1/dc/d20/d2e/d30/d85/d53/d96/d10b 0 2024-09-20T18:36:05.599 INFO:tasks.workunit.client.0.smithi017.stdout:7/569: dread da/d54/fa6 [0,4194304] 0 2024-09-20T18:36:05.600 INFO:tasks.workunit.client.0.smithi017.stdout:6/579: getdents d4/df/d1f/d25/d3f 0 2024-09-20T18:36:05.601 INFO:tasks.workunit.client.0.smithi017.stdout:6/580: write d4/df/d4a/f9b [256529,117580] 0 2024-09-20T18:36:05.606 INFO:tasks.workunit.client.0.smithi017.stdout:8/500: write d0/d6/d28/f29 [955993,27262] 0 2024-09-20T18:36:05.609 INFO:tasks.workunit.client.0.smithi017.stdout:9/781: truncate d6/d23/d40/db4/dba/f8d 1482217 0 2024-09-20T18:36:05.610 INFO:tasks.workunit.client.0.smithi017.stdout:3/790: link da/de/d13/d16/d6e/d97/l99 da/de/d13/l108 0 2024-09-20T18:36:05.612 INFO:tasks.workunit.client.0.smithi017.stdout:7/570: symlink da/d16/d1c/d40/d34/d96/lb4 0 2024-09-20T18:36:05.615 INFO:tasks.workunit.client.0.smithi017.stdout:6/581: unlink d4/df/d1f/d25/d3f/d5c/f85 0 2024-09-20T18:36:05.615 INFO:tasks.workunit.client.0.smithi017.stdout:7/571: read da/d54/f71 [2565679,84516] 0 2024-09-20T18:36:05.615 INFO:tasks.workunit.client.0.smithi017.stdout:1/535: dwrite df/d16/d50/d69/d62/f81 [0,4194304] 0 2024-09-20T18:36:05.615 INFO:tasks.workunit.client.0.smithi017.stdout:7/572: stat da/f65 0 2024-09-20T18:36:05.618 INFO:tasks.workunit.client.0.smithi017.stdout:5/522: creat d0/d14/d18/d79/d9e/fa9 x:0 0 0 2024-09-20T18:36:05.620 INFO:tasks.workunit.client.0.smithi017.stdout:5/523: chown d0/d14/d18/d2a/d39/d42/l48 369541369 1 2024-09-20T18:36:05.623 INFO:tasks.workunit.client.0.smithi017.stdout:3/791: creat da/de/d13/d2f/d26/d62/da5/da9/dbb/f109 x:0 0 0 2024-09-20T18:36:05.625 INFO:tasks.workunit.client.0.smithi017.stdout:4/517: link d4/l9 d4/dc/d1e/d69/d96/la4 0 2024-09-20T18:36:05.629 INFO:tasks.workunit.client.0.smithi017.stdout:8/501: mkdir d0/d6/d28/d3b/d72/d98/da4 0 2024-09-20T18:36:05.630 INFO:tasks.workunit.client.0.smithi017.stdout:7/573: read da/d16/d1c/f1f [2878000,13948] 0 2024-09-20T18:36:05.632 INFO:tasks.workunit.client.0.smithi017.stdout:7/574: write da/d16/d1c/f82 [499867,92814] 0 2024-09-20T18:36:05.635 INFO:tasks.workunit.client.0.smithi017.stdout:2/804: getdents d1/d67 0 2024-09-20T18:36:05.637 INFO:tasks.workunit.client.0.smithi017.stdout:5/524: creat d0/d14/d18/d19/faa x:0 0 0 2024-09-20T18:36:05.639 INFO:tasks.workunit.client.0.smithi017.stdout:7/575: dwrite da/d16/f67 [0,4194304] 0 2024-09-20T18:36:05.639 INFO:tasks.workunit.client.0.smithi017.stdout:3/792: creat da/de/d13/d16/f10a x:0 0 0 2024-09-20T18:36:05.640 INFO:tasks.workunit.client.0.smithi017.stdout:7/576: chown da/d16/d1c/d40/d3a/f7b 125 1 2024-09-20T18:36:05.641 INFO:tasks.workunit.client.0.smithi017.stdout:3/793: fsync da/de/d53/d88/db3/ff9 0 2024-09-20T18:36:05.646 INFO:tasks.workunit.client.0.smithi017.stdout:7/577: read da/d16/d8e/f73 [244307,23599] 0 2024-09-20T18:36:05.646 INFO:tasks.workunit.client.0.smithi017.stdout:4/518: unlink d4/d19/d37/d66/l7b 0 2024-09-20T18:36:05.660 INFO:tasks.workunit.client.0.smithi017.stdout:5/525: dwrite d0/d14/d18/f5a [4194304,4194304] 0 2024-09-20T18:36:05.666 INFO:tasks.workunit.client.0.smithi017.stdout:3/794: dread da/de/d13/d16/d50/f78 [0,4194304] 0 2024-09-20T18:36:05.693 INFO:tasks.workunit.client.0.smithi017.stdout:1/536: link df/c85 df/d16/d50/d69/d62/ca3 0 2024-09-20T18:36:05.695 INFO:tasks.workunit.client.0.smithi017.stdout:4/519: unlink d4/d19/d37/f7c 0 2024-09-20T18:36:05.698 INFO:tasks.workunit.client.0.smithi017.stdout:8/502: creat d0/d65/d8b/d91/fa5 x:0 0 0 2024-09-20T18:36:05.700 INFO:tasks.workunit.client.0.smithi017.stdout:6/582: rename d4/df/d1f/d25/d2b/fa7 to d4/d37/d68/da4/fc3 0 2024-09-20T18:36:05.701 INFO:tasks.workunit.client.0.smithi017.stdout:9/782: getdents d6/d23/d58/d3f/d70/db0/dca 0 2024-09-20T18:36:05.710 INFO:tasks.workunit.client.0.smithi017.stdout:4/520: creat d4/d82/fa5 x:0 0 0 2024-09-20T18:36:05.714 INFO:tasks.workunit.client.0.smithi017.stdout:8/503: mkdir d0/d6/d28/d81/da6 0 2024-09-20T18:36:05.715 INFO:tasks.workunit.client.0.smithi017.stdout:6/583: rmdir d4/df/d1f/d25/d2b 39 2024-09-20T18:36:05.717 INFO:tasks.workunit.client.0.smithi017.stdout:9/783: symlink d6/d23/d3a/l11b 0 2024-09-20T18:36:05.718 INFO:tasks.workunit.client.0.smithi017.stdout:1/537: mknod df/d16/d50/d69/d97/ca4 0 2024-09-20T18:36:05.722 INFO:tasks.workunit.client.0.smithi017.stdout:5/526: dread d0/d14/f20 [0,4194304] 0 2024-09-20T18:36:05.722 INFO:tasks.workunit.client.0.smithi017.stdout:8/504: creat d0/d6/d28/d3a/fa7 x:0 0 0 2024-09-20T18:36:05.724 INFO:tasks.workunit.client.0.smithi017.stdout:9/784: unlink d6/d23/d40/l83 0 2024-09-20T18:36:05.728 INFO:tasks.workunit.client.0.smithi017.stdout:7/578: dwrite da/d16/d1c/d40/d34/f6b [0,4194304] 0 2024-09-20T18:36:05.730 INFO:tasks.workunit.client.0.smithi017.stdout:2/805: truncate d1/df/fa8 237668 0 2024-09-20T18:36:05.730 INFO:tasks.workunit.client.0.smithi017.stdout:7/579: write da/d16/d1c/d40/d3a/f93 [971677,56350] 0 2024-09-20T18:36:05.731 INFO:tasks.workunit.client.0.smithi017.stdout:4/521: symlink d4/dc/la6 0 2024-09-20T18:36:05.732 INFO:tasks.workunit.client.0.smithi017.stdout:7/580: fsync da/f14 0 2024-09-20T18:36:05.733 INFO:tasks.workunit.client.0.smithi017.stdout:4/522: write d4/d82/d88/d5c/f9a [627807,74513] 0 2024-09-20T18:36:05.735 INFO:tasks.workunit.client.0.smithi017.stdout:7/581: chown da/d16/f90 562 1 2024-09-20T18:36:05.736 INFO:tasks.workunit.client.0.smithi017.stdout:8/505: mkdir d0/d6/d28/d3d/d4e/d55/da8 0 2024-09-20T18:36:05.737 INFO:tasks.workunit.client.0.smithi017.stdout:8/506: read - d0/d6/d28/d3d/d4e/d55/d83/f9f zero size 2024-09-20T18:36:05.738 INFO:tasks.workunit.client.0.smithi017.stdout:6/584: link d4/d37/d41/d43/d7d/f88 d4/df/d4a/d8f/fc4 0 2024-09-20T18:36:05.740 INFO:tasks.workunit.client.0.smithi017.stdout:9/785: dread d6/d23/d3a/d61/f78 [0,4194304] 0 2024-09-20T18:36:05.741 INFO:tasks.workunit.client.0.smithi017.stdout:8/507: truncate d0/d6/d28/d3a/fa7 1012804 0 2024-09-20T18:36:05.747 INFO:tasks.workunit.client.0.smithi017.stdout:1/538: write df/f5a [3396775,76731] 0 2024-09-20T18:36:05.749 INFO:tasks.workunit.client.0.smithi017.stdout:1/539: write df/d29/f9f [903539,67734] 0 2024-09-20T18:36:05.759 INFO:tasks.workunit.client.0.smithi017.stdout:8/508: creat d0/d6/d73/fa9 x:0 0 0 2024-09-20T18:36:05.762 INFO:tasks.workunit.client.0.smithi017.stdout:7/582: write da/d16/f5e [60240,98726] 0 2024-09-20T18:36:05.763 INFO:tasks.workunit.client.0.smithi017.stdout:6/585: write d4/d37/d41/d43/d7d/f88 [1661876,63865] 0 2024-09-20T18:36:05.763 INFO:tasks.workunit.client.0.smithi017.stdout:7/583: chown da/d16/d1c/d40/f7d 2118411314 1 2024-09-20T18:36:05.764 INFO:tasks.workunit.client.0.smithi017.stdout:1/540: mkdir df/d16/d50/d69/da5 0 2024-09-20T18:36:05.766 INFO:tasks.workunit.client.0.smithi017.stdout:6/586: truncate d4/df/d4a/f6c 1022081 0 2024-09-20T18:36:05.770 INFO:tasks.workunit.client.0.smithi017.stdout:5/527: link d0/d14/d18/f2f d0/d14/d18/d2a/d39/fab 0 2024-09-20T18:36:05.772 INFO:tasks.workunit.client.0.smithi017.stdout:6/587: dwrite d4/fbf [0,4194304] 0 2024-09-20T18:36:05.775 INFO:tasks.workunit.client.0.smithi017.stdout:1/541: mkdir df/d35/d4f/d82/da6 0 2024-09-20T18:36:05.776 INFO:tasks.workunit.client.0.smithi017.stdout:2/806: getdents d1/d67/d8f/dcd 0 2024-09-20T18:36:05.777 INFO:tasks.workunit.client.0.smithi017.stdout:1/542: write df/d3b/f9a [794475,18072] 0 2024-09-20T18:36:05.779 INFO:tasks.workunit.client.0.smithi017.stdout:1/543: write df/d3b/f9a [1468022,28582] 0 2024-09-20T18:36:05.784 INFO:tasks.workunit.client.0.smithi017.stdout:4/523: link d4/d19/d37/c8c d4/d19/d37/da1/d1b/ca7 0 2024-09-20T18:36:05.784 INFO:tasks.workunit.client.0.smithi017.stdout:5/528: dread d0/d14/d18/d2a/f37 [0,4194304] 0 2024-09-20T18:36:05.787 INFO:tasks.workunit.client.0.smithi017.stdout:6/588: creat d4/d37/d68/da4/d9e/fc5 x:0 0 0 2024-09-20T18:36:05.787 INFO:tasks.workunit.client.0.smithi017.stdout:8/509: link d0/c36 d0/d65/d8b/d91/caa 0 2024-09-20T18:36:05.793 INFO:tasks.workunit.client.0.smithi017.stdout:6/589: dwrite d4/d37/d41/d43/d7d/f79 [0,4194304] 0 2024-09-20T18:36:05.795 INFO:tasks.workunit.client.0.smithi017.stdout:6/590: write d4/df/d1f/d25/d3f/d5c/f7b [3816486,66117] 0 2024-09-20T18:36:05.849 INFO:tasks.workunit.client.0.smithi017.stdout:1/544: fsync df/d3b/d7c/f84 0 2024-09-20T18:36:05.849 INFO:tasks.workunit.client.0.smithi017.stdout:7/584: write da/d16/d92/fa3 [884368,39894] 0 2024-09-20T18:36:05.850 INFO:tasks.workunit.client.0.smithi017.stdout:4/524: dread d4/d19/f63 [0,4194304] 0 2024-09-20T18:36:05.851 INFO:tasks.workunit.client.0.smithi017.stdout:4/525: write d4/d19/f5e [393921,50883] 0 2024-09-20T18:36:05.852 INFO:tasks.workunit.client.0.smithi017.stdout:4/526: chown d4/d82 62331990 1 2024-09-20T18:36:05.855 INFO:tasks.workunit.client.0.smithi017.stdout:4/527: write d4/d82/d88/d5c/f9a [1491678,17673] 0 2024-09-20T18:36:05.856 INFO:tasks.workunit.client.0.smithi017.stdout:4/528: stat d4/d19/d37/d66 0 2024-09-20T18:36:05.858 INFO:tasks.workunit.client.0.smithi017.stdout:6/591: mkdir d4/d29/dc6 0 2024-09-20T18:36:05.859 INFO:tasks.workunit.client.0.smithi017.stdout:6/592: rename d4/d37/d68/dbb to d4/d37/d68/dbb/dc7 22 2024-09-20T18:36:05.864 INFO:tasks.workunit.client.0.smithi017.stdout:7/585: mkdir da/d16/db5 0 2024-09-20T18:36:05.866 INFO:tasks.workunit.client.0.smithi017.stdout:5/529: mknod d0/cac 0 2024-09-20T18:36:05.869 INFO:tasks.workunit.client.0.smithi017.stdout:2/807: dwrite d1/dc/d20/d2e/d30/fd3 [0,4194304] 0 2024-09-20T18:36:05.871 INFO:tasks.workunit.client.0.smithi017.stdout:6/593: dwrite d4/df/d1f/d25/d3f/d5c/f6d [0,4194304] 0 2024-09-20T18:36:05.874 INFO:tasks.workunit.client.0.smithi017.stdout:4/529: dread d4/d19/d37/f77 [0,4194304] 0 2024-09-20T18:36:05.878 INFO:tasks.workunit.client.0.smithi017.stdout:5/530: symlink d0/d14/d18/d57/lad 0 2024-09-20T18:36:05.879 INFO:tasks.workunit.client.0.smithi017.stdout:2/808: chown d1/df/d17/c7e 3119878 1 2024-09-20T18:36:05.882 INFO:tasks.workunit.client.0.smithi017.stdout:6/594: creat d4/d37/d68/dbb/fc8 x:0 0 0 2024-09-20T18:36:05.886 INFO:tasks.workunit.client.0.smithi017.stdout:4/530: symlink d4/la8 0 2024-09-20T18:36:05.888 INFO:tasks.workunit.client.0.smithi017.stdout:2/809: creat d1/d1f/f10c x:0 0 0 2024-09-20T18:36:05.892 INFO:tasks.workunit.client.0.smithi017.stdout:2/810: dread d1/df/f1e [0,4194304] 0 2024-09-20T18:36:05.894 INFO:tasks.workunit.client.0.smithi017.stdout:4/531: mkdir d4/d82/d88/d5c/d8f/da9 0 2024-09-20T18:36:05.900 INFO:tasks.workunit.client.0.smithi017.stdout:1/545: dwrite f2 [0,4194304] 0 2024-09-20T18:36:05.901 INFO:tasks.workunit.client.0.smithi017.stdout:7/586: dread da/d16/d1c/d40/d30/f7c [0,4194304] 0 2024-09-20T18:36:05.903 INFO:tasks.workunit.client.0.smithi017.stdout:5/531: write d0/f7 [400006,63964] 0 2024-09-20T18:36:05.906 INFO:tasks.workunit.client.0.smithi017.stdout:4/532: rename d4/dc/d1e/d69/d7a/d94 to d4/d19/d37/da1/d1b/daa 0 2024-09-20T18:36:05.915 INFO:tasks.workunit.client.0.smithi017.stdout:4/533: dwrite d4/d19/d37/da1/d1b/f33 [0,4194304] 0 2024-09-20T18:36:05.920 INFO:tasks.workunit.client.0.smithi017.stdout:1/546: write df/f51 [4177542,115623] 0 2024-09-20T18:36:05.920 INFO:tasks.workunit.client.0.smithi017.stdout:2/811: dread d1/d1f/f3f [0,4194304] 0 2024-09-20T18:36:05.921 INFO:tasks.workunit.client.0.smithi017.stdout:4/534: write d4/d19/d37/da1/f4f [4735900,87624] 0 2024-09-20T18:36:05.926 INFO:tasks.workunit.client.0.smithi017.stdout:6/595: dwrite d4/f8 [0,4194304] 0 2024-09-20T18:36:05.926 INFO:tasks.workunit.client.0.smithi017.stdout:1/547: truncate df/f36 1324086 0 2024-09-20T18:36:05.928 INFO:tasks.workunit.client.0.smithi017.stdout:5/532: dwrite d0/d14/d18/d57/f5d [4194304,4194304] 0 2024-09-20T18:36:05.933 INFO:tasks.workunit.client.0.smithi017.stdout:6/596: creat d4/df/d4a/fc9 x:0 0 0 2024-09-20T18:36:05.936 INFO:tasks.workunit.client.0.smithi017.stdout:1/548: mkdir df/d16/d50/d69/d62/da7 0 2024-09-20T18:36:05.941 INFO:tasks.workunit.client.0.smithi017.stdout:5/533: creat d0/d14/d18/fae x:0 0 0 2024-09-20T18:36:05.942 INFO:tasks.workunit.client.0.smithi017.stdout:6/597: mkdir d4/df/d1f/d25/dca 0 2024-09-20T18:36:05.943 INFO:tasks.workunit.client.0.smithi017.stdout:2/812: link d1/d1f/c24 d1/dc/d20/d2e/d30/d85/c10d 0 2024-09-20T18:36:05.945 INFO:tasks.workunit.client.0.smithi017.stdout:5/534: rename d0/d14/d18/d2a/d39/d42/c60 to d0/d14/d18/d19/d85/caf 0 2024-09-20T18:36:05.946 INFO:tasks.workunit.client.0.smithi017.stdout:6/598: rmdir d4/d37/d68/da4/d72 39 2024-09-20T18:36:05.946 INFO:tasks.workunit.client.0.smithi017.stdout:1/549: link df/d35/l94 df/d8f/la8 0 2024-09-20T18:36:05.947 INFO:tasks.workunit.client.0.smithi017.stdout:5/535: write d0/d14/d18/d19/d85/f87 [142390,33941] 0 2024-09-20T18:36:05.948 INFO:tasks.workunit.client.0.smithi017.stdout:6/599: creat d4/d29/fcb x:0 0 0 2024-09-20T18:36:05.950 INFO:tasks.workunit.client.0.smithi017.stdout:1/550: creat df/d35/d6b/fa9 x:0 0 0 2024-09-20T18:36:05.950 INFO:tasks.workunit.client.0.smithi017.stdout:5/536: symlink d0/d14/d18/d2a/lb0 0 2024-09-20T18:36:05.951 INFO:tasks.workunit.client.0.smithi017.stdout:6/600: unlink d4/df/d1f/l24 0 2024-09-20T18:36:05.953 INFO:tasks.workunit.client.0.smithi017.stdout:1/551: rename df/d16/d50/d87 to df/d35/daa 0 2024-09-20T18:36:05.953 INFO:tasks.workunit.client.0.smithi017.stdout:1/552: fdatasync df/d1c/d45/f57 0 2024-09-20T18:36:05.954 INFO:tasks.workunit.client.0.smithi017.stdout:5/537: creat d0/d14/d18/d2a/da1/fb1 x:0 0 0 2024-09-20T18:36:05.955 INFO:tasks.workunit.client.0.smithi017.stdout:1/553: write df/d16/f2e [3860881,109298] 0 2024-09-20T18:36:05.956 INFO:tasks.workunit.client.0.smithi017.stdout:5/538: chown d0/d14/d18/d1b/f26 1 1 2024-09-20T18:36:05.956 INFO:tasks.workunit.client.0.smithi017.stdout:6/601: mknod d4/df/ccc 0 2024-09-20T18:36:05.957 INFO:tasks.workunit.client.0.smithi017.stdout:5/539: dread - d0/d14/d18/fae zero size 2024-09-20T18:36:05.957 INFO:tasks.workunit.client.0.smithi017.stdout:1/554: chown df/d16/d50/d69/d97 3546186 1 2024-09-20T18:36:05.959 INFO:tasks.workunit.client.0.smithi017.stdout:6/602: symlink d4/df/d8a/lcd 0 2024-09-20T18:36:05.962 INFO:tasks.workunit.client.0.smithi017.stdout:1/555: dread df/d16/d50/f86 [0,4194304] 0 2024-09-20T18:36:05.969 INFO:tasks.workunit.client.0.smithi017.stdout:1/556: mkdir df/d16/d50/dab 0 2024-09-20T18:36:05.971 INFO:tasks.workunit.client.0.smithi017.stdout:6/603: truncate d4/fc 1040140 0 2024-09-20T18:36:05.974 INFO:tasks.workunit.client.0.smithi017.stdout:5/540: getdents d0/d14/d18/d2a 0 2024-09-20T18:36:05.977 INFO:tasks.workunit.client.0.smithi017.stdout:5/541: creat d0/d14/d18/d79/fb2 x:0 0 0 2024-09-20T18:36:05.978 INFO:tasks.workunit.client.0.smithi017.stdout:1/557: mkdir df/d35/d4f/d82/dac 0 2024-09-20T18:36:05.983 INFO:tasks.workunit.client.0.smithi017.stdout:1/558: creat df/d16/d50/d69/d97/fad x:0 0 0 2024-09-20T18:36:05.983 INFO:tasks.workunit.client.0.smithi017.stdout:6/604: getdents d4/d37 0 2024-09-20T18:36:05.984 INFO:tasks.workunit.client.0.smithi017.stdout:1/559: fdatasync df/d3b/f9a 0 2024-09-20T18:36:05.994 INFO:tasks.workunit.client.0.smithi017.stdout:6/605: dwrite d4/f9 [0,4194304] 0 2024-09-20T18:36:05.994 INFO:tasks.workunit.client.0.smithi017.stdout:5/542: dwrite d0/d14/d18/d2a/d39/fab [0,4194304] 0 2024-09-20T18:36:06.002 INFO:tasks.workunit.client.0.smithi017.stdout:1/560: link df/d35/d4f/l54 df/d1c/d80/lae 0 2024-09-20T18:36:06.006 INFO:tasks.workunit.client.0.smithi017.stdout:5/543: dwrite d0/d14/d18/d19/d4d/d6d/d78/f66 [4194304,4194304] 0 2024-09-20T18:36:06.018 INFO:tasks.workunit.client.0.smithi017.stdout:1/561: dread df/f5e [0,4194304] 0 2024-09-20T18:36:06.022 INFO:tasks.workunit.client.0.smithi017.stdout:1/562: mknod df/d16/d50/d69/da5/caf 0 2024-09-20T18:36:06.033 INFO:tasks.workunit.client.0.smithi017.stdout:1/563: write df/f26 [380696,78886] 0 2024-09-20T18:36:06.035 INFO:tasks.workunit.client.0.smithi017.stdout:1/564: truncate df/f5e 176082 0 2024-09-20T18:36:06.037 INFO:tasks.workunit.client.0.smithi017.stdout:1/565: creat df/d16/d50/d53/fb0 x:0 0 0 2024-09-20T18:36:06.039 INFO:tasks.workunit.client.0.smithi017.stdout:5/544: dread d0/d14/d18/d19/f82 [0,4194304] 0 2024-09-20T18:36:06.040 INFO:tasks.workunit.client.0.smithi017.stdout:5/545: chown d0/d14/d18/d19/d4d/d6d 1991 1 2024-09-20T18:36:06.041 INFO:tasks.workunit.client.0.smithi017.stdout:1/566: creat df/d35/fb1 x:0 0 0 2024-09-20T18:36:06.045 INFO:tasks.workunit.client.0.smithi017.stdout:1/567: mknod df/d1c/d80/da0/cb2 0 2024-09-20T18:36:06.046 INFO:tasks.workunit.client.0.smithi017.stdout:5/546: dread d0/d14/d18/f3b [4194304,4194304] 0 2024-09-20T18:36:06.052 INFO:tasks.workunit.client.0.smithi017.stdout:1/568: dwrite df/d16/d50/d69/f98 [0,4194304] 0 2024-09-20T18:36:06.054 INFO:tasks.workunit.client.0.smithi017.stdout:5/547: rename d0/d14/d18/d79/d9e/fa9 to d0/d14/d18/d19/d4d/d6d/d78/d99/fb3 0 2024-09-20T18:36:06.061 INFO:tasks.workunit.client.0.smithi017.stdout:5/548: creat d0/d6e/fb4 x:0 0 0 2024-09-20T18:36:06.066 INFO:tasks.workunit.client.0.smithi017.stdout:5/549: mkdir d0/d14/d18/d19/d4d/db5 0 2024-09-20T18:36:06.067 INFO:tasks.workunit.client.0.smithi017.stdout:5/550: fsync d0/d14/d18/d2a/d39/f50 0 2024-09-20T18:36:06.074 INFO:tasks.workunit.client.0.smithi017.stdout:5/551: dwrite d0/d14/d18/f3b [0,4194304] 0 2024-09-20T18:36:06.089 INFO:tasks.workunit.client.0.smithi017.stdout:5/552: dwrite d0/d14/d18/d1b/f31 [0,4194304] 0 2024-09-20T18:36:06.092 INFO:tasks.workunit.client.0.smithi017.stdout:5/553: mkdir d0/d14/d18/d57/db6 0 2024-09-20T18:36:06.098 INFO:tasks.workunit.client.0.smithi017.stdout:5/554: write d0/f45 [1548220,45978] 0 2024-09-20T18:36:06.099 INFO:tasks.workunit.client.0.smithi017.stdout:5/555: stat d0/d14/d18/d19/d4d/d6d/l70 0 2024-09-20T18:36:06.102 INFO:tasks.workunit.client.0.smithi017.stdout:5/556: dread d0/d14/f20 [0,4194304] 0 2024-09-20T18:36:06.107 INFO:tasks.workunit.client.0.smithi017.stdout:5/557: getdents d0/d14/d18/d19 0 2024-09-20T18:36:06.107 INFO:tasks.workunit.client.0.smithi017.stdout:5/558: fdatasync d0/d6e/fb4 0 2024-09-20T18:36:06.110 INFO:tasks.workunit.client.0.smithi017.stdout:5/559: mkdir d0/d14/d18/d19/d4d/d6d/db7 0 2024-09-20T18:36:06.112 INFO:tasks.workunit.client.0.smithi017.stdout:5/560: creat d0/d14/d18/d19/d4d/d6d/d78/d99/fb8 x:0 0 0 2024-09-20T18:36:06.112 INFO:tasks.workunit.client.0.smithi017.stdout:5/561: stat d0/d6e/f95 0 2024-09-20T18:36:06.115 INFO:tasks.workunit.client.0.smithi017.stdout:5/562: read - d0/d14/d18/f94 zero size 2024-09-20T18:36:06.115 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:05 smithi017 ceph-mon[28058]: pgmap v37: 65 pgs: 65 active+clean; 3.2 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 88 MiB/s rd, 263 MiB/s wr, 534 op/s 2024-09-20T18:36:06.117 INFO:tasks.workunit.client.0.smithi017.stdout:5/563: mknod d0/d14/d18/d1b/cb9 0 2024-09-20T18:36:06.120 INFO:tasks.workunit.client.0.smithi017.stdout:5/564: creat d0/d14/d18/d2a/fba x:0 0 0 2024-09-20T18:36:06.136 INFO:tasks.workunit.client.0.smithi017.stdout:5/565: write d0/d14/d18/d1b/f24 [263729,34917] 0 2024-09-20T18:36:06.140 INFO:tasks.workunit.client.0.smithi017.stdout:5/566: symlink d0/d14/d18/d19/d4d/d6d/d78/lbb 0 2024-09-20T18:36:06.144 INFO:tasks.workunit.client.0.smithi017.stdout:5/567: link d0/d14/d18/d2a/da1/fb1 d0/d14/d18/d1b/fbc 0 2024-09-20T18:36:06.145 INFO:tasks.workunit.client.0.smithi017.stdout:5/568: mkdir d0/d14/d40/dbd 0 2024-09-20T18:36:06.149 INFO:tasks.workunit.client.0.smithi017.stdout:5/569: mkdir d0/dbe 0 2024-09-20T18:36:06.150 INFO:tasks.workunit.client.0.smithi017.stdout:5/570: truncate d0/d14/d18/d19/faa 354460 0 2024-09-20T18:36:06.157 INFO:tasks.workunit.client.0.smithi017.stdout:5/571: dwrite d0/d14/f28 [0,4194304] 0 2024-09-20T18:36:06.160 INFO:tasks.workunit.client.0.smithi017.stdout:5/572: mkdir d0/d14/d18/d19/d4d/d6d/dbf 0 2024-09-20T18:36:06.163 INFO:tasks.workunit.client.0.smithi017.stdout:5/573: rename d0/d6e to d0/d14/d18/d19/d4d/db5/dc0 0 2024-09-20T18:36:06.167 INFO:tasks.workunit.client.0.smithi017.stdout:5/574: mkdir d0/d14/d18/d19/d4d/d6d/db7/dc1 0 2024-09-20T18:36:06.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:05 smithi172 ceph-mon[35456]: pgmap v37: 65 pgs: 65 active+clean; 3.2 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 88 MiB/s rd, 263 MiB/s wr, 534 op/s 2024-09-20T18:36:06.245 INFO:tasks.workunit.client.0.smithi017.stdout:5/575: mknod d0/d14/d18/d2a/d39/d6c/d72/cc2 0 2024-09-20T18:36:06.258 INFO:tasks.workunit.client.0.smithi017.stdout:5/576: write d0/d14/d18/d2a/d39/f9b [4900722,128371] 0 2024-09-20T18:36:06.260 INFO:tasks.workunit.client.0.smithi017.stdout:5/577: fsync d0/d14/d18/d19/d4d/f84 0 2024-09-20T18:36:06.270 INFO:tasks.workunit.client.0.smithi017.stdout:5/578: dwrite d0/d14/d18/d19/f82 [0,4194304] 0 2024-09-20T18:36:06.277 INFO:tasks.workunit.client.0.smithi017.stdout:5/579: rename d0/d14/d18/d2a/d39/d42/f8c to d0/dbe/fc3 0 2024-09-20T18:36:06.280 INFO:tasks.workunit.client.0.smithi017.stdout:5/580: mknod d0/d14/d18/d57/db6/cc4 0 2024-09-20T18:36:06.876 INFO:tasks.workunit.client.0.smithi017.stdout:0/547: sync 2024-09-20T18:36:06.876 INFO:tasks.workunit.client.0.smithi017.stdout:0/548: stat d4/c4c 0 2024-09-20T18:36:06.876 INFO:tasks.workunit.client.0.smithi017.stdout:0/549: stat d4/d20/f6c 0 2024-09-20T18:36:06.881 INFO:tasks.workunit.client.0.smithi017.stdout:0/550: getdents d4/db/d1e/d24/d2f/d69 0 2024-09-20T18:36:06.882 INFO:tasks.workunit.client.0.smithi017.stdout:0/551: stat d4/db/d18/d25 0 2024-09-20T18:36:06.886 INFO:tasks.workunit.client.0.smithi017.stdout:0/552: write d4/d20/f43 [30815,99361] 0 2024-09-20T18:36:06.887 INFO:tasks.workunit.client.0.smithi017.stdout:0/553: dread - d4/db/d1e/d24/d2f/d51/d52/fb3 zero size 2024-09-20T18:36:06.888 INFO:tasks.workunit.client.0.smithi017.stdout:0/554: write d4/d20/fb9 [195844,2241] 0 2024-09-20T18:36:06.892 INFO:tasks.workunit.client.0.smithi017.stdout:0/555: rename d4/d20/f6f to d4/db/d1e/fbf 0 2024-09-20T18:36:06.893 INFO:tasks.workunit.client.0.smithi017.stdout:0/556: truncate d4/db/d18/d55/fab 925539 0 2024-09-20T18:36:06.899 INFO:tasks.workunit.client.0.smithi017.stdout:0/557: creat d4/db/d1e/d24/d2f/d51/d52/d77/daf/fc0 x:0 0 0 2024-09-20T18:36:06.899 INFO:tasks.workunit.client.0.smithi017.stdout:0/558: stat d4/db/d18/d25/d36/f76 0 2024-09-20T18:36:06.905 INFO:tasks.workunit.client.0.smithi017.stdout:0/559: link d4/db/d1e/d24/d2f/d51/d52/l9d d4/db/d1e/d24/d2f/d51/lc1 0 2024-09-20T18:36:06.912 INFO:tasks.workunit.client.0.smithi017.stdout:0/560: write d4/f8 [1826255,104429] 0 2024-09-20T18:36:06.913 INFO:tasks.workunit.client.0.smithi017.stdout:0/561: write d4/db/d1e/d24/f4b [3315250,103780] 0 2024-09-20T18:36:06.916 INFO:tasks.workunit.client.0.smithi017.stdout:0/562: symlink d4/lc2 0 2024-09-20T18:36:06.919 INFO:tasks.workunit.client.0.smithi017.stdout:0/563: creat d4/db/d1e/d42/d95/fc3 x:0 0 0 2024-09-20T18:36:06.921 INFO:tasks.workunit.client.0.smithi017.stdout:0/564: creat d4/db/d18/d55/fc4 x:0 0 0 2024-09-20T18:36:06.936 INFO:tasks.workunit.client.0.smithi017.stdout:0/565: dwrite d4/f17 [0,4194304] 0 2024-09-20T18:36:06.941 INFO:tasks.workunit.client.0.smithi017.stdout:0/566: creat d4/db/d1e/d24/fc5 x:0 0 0 2024-09-20T18:36:06.942 INFO:tasks.workunit.client.0.smithi017.stdout:0/567: chown d4/db/c39 41 1 2024-09-20T18:36:06.950 INFO:tasks.workunit.client.0.smithi017.stdout:0/568: dwrite d4/db/d18/d25/d36/d47/d81/f9b [0,4194304] 0 2024-09-20T18:36:06.954 INFO:tasks.workunit.client.0.smithi017.stdout:0/569: symlink d4/db/d18/d25/d36/d47/d81/lc6 0 2024-09-20T18:36:06.954 INFO:tasks.workunit.client.0.smithi017.stdout:9/786: sync 2024-09-20T18:36:06.955 INFO:tasks.workunit.client.0.smithi017.stdout:3/795: sync 2024-09-20T18:36:06.957 INFO:tasks.workunit.client.0.smithi017.stdout:9/787: fdatasync d6/d23/f50 0 2024-09-20T18:36:06.959 INFO:tasks.workunit.client.0.smithi017.stdout:0/570: symlink d4/d68/d8e/lc7 0 2024-09-20T18:36:06.965 INFO:tasks.workunit.client.0.smithi017.stdout:0/571: fdatasync d4/db/f3b 0 2024-09-20T18:36:06.966 INFO:tasks.workunit.client.0.smithi017.stdout:0/572: fdatasync d4/d20/d63/d86/f9f 0 2024-09-20T18:36:06.967 INFO:tasks.workunit.client.0.smithi017.stdout:3/796: creat da/de/d13/d16/d6e/d82/df8/f10b x:0 0 0 2024-09-20T18:36:06.969 INFO:tasks.workunit.client.0.smithi017.stdout:3/797: dread - da/de/d13/d16/d6e/d97/df1/ffc zero size 2024-09-20T18:36:06.971 INFO:tasks.workunit.client.0.smithi017.stdout:9/788: write d6/d23/d58/d3f/d4d/d73/d93/fd5 [4809365,4817] 0 2024-09-20T18:36:06.973 INFO:tasks.workunit.client.0.smithi017.stdout:0/573: dwrite d4/d20/d63/d86/fa7 [0,4194304] 0 2024-09-20T18:36:06.976 INFO:tasks.workunit.client.0.smithi017.stdout:9/789: rmdir d6/d23/d40/db4/dba 39 2024-09-20T18:36:06.979 INFO:tasks.workunit.client.0.smithi017.stdout:0/574: write d4/db/d1e/d24/d2f/d94/fa8 [850520,43734] 0 2024-09-20T18:36:06.980 INFO:tasks.workunit.client.0.smithi017.stdout:3/798: dwrite da/de/d53/d52/fd8 [0,4194304] 0 2024-09-20T18:36:06.985 INFO:tasks.workunit.client.0.smithi017.stdout:3/799: readlink da/de/d13/d2f/l93 0 2024-09-20T18:36:06.991 INFO:tasks.workunit.client.0.smithi017.stdout:0/575: getdents d4/db/d1e/d24/d2f/d51/d52/d77/daf 0 2024-09-20T18:36:06.993 INFO:tasks.workunit.client.0.smithi017.stdout:0/576: fdatasync d4/db/d1e/d24/d2f/d69/f73 0 2024-09-20T18:36:06.994 INFO:tasks.workunit.client.0.smithi017.stdout:3/800: fsync da/de/d53/d52/fd8 0 2024-09-20T18:36:06.997 INFO:tasks.workunit.client.0.smithi017.stdout:0/577: write d4/d20/d63/d86/fa7 [3724432,58207] 0 2024-09-20T18:36:07.001 INFO:tasks.workunit.client.0.smithi017.stdout:9/790: dwrite d6/d23/d3a/d61/fe0 [0,4194304] 0 2024-09-20T18:36:07.002 INFO:tasks.workunit.client.0.smithi017.stdout:9/791: chown d6/d23/d58/d3f/d4d/d73/fb7 59 1 2024-09-20T18:36:07.008 INFO:tasks.workunit.client.0.smithi017.stdout:9/792: mkdir d6/d23/d58/d3f/d2f/d98/d10c/d11c 0 2024-09-20T18:36:07.010 INFO:tasks.workunit.client.0.smithi017.stdout:0/578: getdents d4/db/d18/d25/d36/d47/d8c/daa 0 2024-09-20T18:36:07.011 INFO:tasks.workunit.client.0.smithi017.stdout:3/801: dread da/de/d53/fa7 [0,4194304] 0 2024-09-20T18:36:07.015 INFO:tasks.workunit.client.0.smithi017.stdout:3/802: creat da/de/d13/d16/d6e/d97/df1/f10c x:0 0 0 2024-09-20T18:36:07.017 INFO:tasks.workunit.client.0.smithi017.stdout:3/803: dread - da/de/d13/d16/d6e/fd1 zero size 2024-09-20T18:36:07.018 INFO:tasks.workunit.client.0.smithi017.stdout:7/587: sync 2024-09-20T18:36:07.018 INFO:tasks.workunit.client.0.smithi017.stdout:2/813: sync 2024-09-20T18:36:07.018 INFO:tasks.workunit.client.0.smithi017.stdout:6/606: sync 2024-09-20T18:36:07.018 INFO:tasks.workunit.client.0.smithi017.stdout:5/581: sync 2024-09-20T18:36:07.018 INFO:tasks.workunit.client.0.smithi017.stdout:4/535: sync 2024-09-20T18:36:07.019 INFO:tasks.workunit.client.0.smithi017.stdout:8/510: sync 2024-09-20T18:36:07.019 INFO:tasks.workunit.client.0.smithi017.stdout:1/569: sync 2024-09-20T18:36:07.024 INFO:tasks.workunit.client.0.smithi017.stdout:9/793: write d6/d23/d40/db4/dba/f65 [1323158,75614] 0 2024-09-20T18:36:07.025 INFO:tasks.workunit.client.0.smithi017.stdout:5/582: chown d0/d14/d18/d19/d4d/f7c 1 1 2024-09-20T18:36:07.029 INFO:tasks.workunit.client.0.smithi017.stdout:7/588: write da/d16/d92/fab [2390903,110788] 0 2024-09-20T18:36:07.032 INFO:tasks.workunit.client.0.smithi017.stdout:3/804: rename da/de/d13/d2f/d26/d31/l57 to da/de/d13/d16/d6e/ddf/de9/l10d 0 2024-09-20T18:36:07.032 INFO:tasks.workunit.client.0.smithi017.stdout:5/583: read d0/d14/d18/f2f [3275504,127854] 0 2024-09-20T18:36:07.034 INFO:tasks.workunit.client.0.smithi017.stdout:6/607: dread d4/f9 [0,4194304] 0 2024-09-20T18:36:07.034 INFO:tasks.workunit.client.0.smithi017.stdout:0/579: dread d4/db/d18/f19 [0,4194304] 0 2024-09-20T18:36:07.038 INFO:tasks.workunit.client.0.smithi017.stdout:5/584: chown d0/d14/d18/d2a/fba 73502101 1 2024-09-20T18:36:07.039 INFO:tasks.workunit.client.0.smithi017.stdout:8/511: dwrite d0/d6/d28/d81/d82/f96 [0,4194304] 0 2024-09-20T18:36:07.043 INFO:tasks.workunit.client.0.smithi017.stdout:4/536: dread d4/d19/d37/da1/f4f [0,4194304] 0 2024-09-20T18:36:07.043 INFO:tasks.workunit.client.0.smithi017.stdout:9/794: mkdir d6/d23/d11d 0 2024-09-20T18:36:07.046 INFO:tasks.workunit.client.0.smithi017.stdout:9/795: truncate d6/d23/d58/d3f/d4d/d73/d8f/f101 883935 0 2024-09-20T18:36:07.051 INFO:tasks.workunit.client.0.smithi017.stdout:0/580: mkdir d4/dc8 0 2024-09-20T18:36:07.053 INFO:tasks.workunit.client.0.smithi017.stdout:5/585: rename d0/d14/d18/d2a/f37 to d0/d14/d18/d2a/d39/d6c/fc5 0 2024-09-20T18:36:07.053 INFO:tasks.workunit.client.0.smithi017.stdout:6/608: dwrite d4/d29/f45 [4194304,4194304] 0 2024-09-20T18:36:07.054 INFO:tasks.workunit.client.0.smithi017.stdout:0/581: dread d4/db/d18/d55/fab [0,4194304] 0 2024-09-20T18:36:07.058 INFO:tasks.workunit.client.0.smithi017.stdout:7/589: link da/f12 da/d16/d1c/d40/d5d/da7/fb6 0 2024-09-20T18:36:07.058 INFO:tasks.workunit.client.0.smithi017.stdout:0/582: chown d4/db/d1e/d24/d2f/d51/d52/d77/daf 1 1 2024-09-20T18:36:07.060 INFO:tasks.workunit.client.0.smithi017.stdout:2/814: getdents d1/dc/d20/d2e/d30/d85 0 2024-09-20T18:36:07.065 INFO:tasks.workunit.client.0.smithi017.stdout:3/805: dwrite da/de/d13/d16/d6e/d97/fa6 [0,4194304] 0 2024-09-20T18:36:07.066 INFO:tasks.workunit.client.0.smithi017.stdout:5/586: creat d0/d14/d18/d57/fc6 x:0 0 0 2024-09-20T18:36:07.069 INFO:tasks.workunit.client.0.smithi017.stdout:5/587: fsync d0/d14/d18/f94 0 2024-09-20T18:36:07.071 INFO:tasks.workunit.client.0.smithi017.stdout:3/806: chown da/de/d53/d88/lb6 17739 1 2024-09-20T18:36:07.072 INFO:tasks.workunit.client.0.smithi017.stdout:8/512: symlink d0/d6/d28/d3b/d72/d98/da4/lab 0 2024-09-20T18:36:07.074 INFO:tasks.workunit.client.0.smithi017.stdout:6/609: creat d4/d37/d68/d8d/fce x:0 0 0 2024-09-20T18:36:07.076 INFO:tasks.workunit.client.0.smithi017.stdout:0/583: dwrite d4/db/d1e/d24/d2f/d94/fa8 [0,4194304] 0 2024-09-20T18:36:07.077 INFO:tasks.workunit.client.0.smithi017.stdout:8/513: write d0/d6/d28/d81/d82/f96 [2128894,34409] 0 2024-09-20T18:36:07.084 INFO:tasks.workunit.client.0.smithi017.stdout:7/590: creat da/d16/d1c/d40/d5d/da7/fb7 x:0 0 0 2024-09-20T18:36:07.085 INFO:tasks.workunit.client.0.smithi017.stdout:2/815: truncate d1/df/f83 883470 0 2024-09-20T18:36:07.087 INFO:tasks.workunit.client.0.smithi017.stdout:8/514: dwrite d0/d6/d28/d3d/d4e/f51 [4194304,4194304] 0 2024-09-20T18:36:07.090 INFO:tasks.workunit.client.0.smithi017.stdout:5/588: mknod d0/d14/d18/d57/db6/cc7 0 2024-09-20T18:36:07.092 INFO:tasks.workunit.client.0.smithi017.stdout:3/807: symlink da/de/d13/d16/l10e 0 2024-09-20T18:36:07.096 INFO:tasks.workunit.client.0.smithi017.stdout:9/796: rmdir d6/d23/d58/d3f/d70/db0/dca/d119 0 2024-09-20T18:36:07.100 INFO:tasks.workunit.client.0.smithi017.stdout:4/537: rename d4/d19/d37/da1/d1b/c3f to d4/d19/cab 0 2024-09-20T18:36:07.104 INFO:tasks.workunit.client.0.smithi017.stdout:5/589: dread d0/d14/d18/d1b/f5c [0,4194304] 0 2024-09-20T18:36:07.105 INFO:tasks.workunit.client.0.smithi017.stdout:3/808: truncate da/fc6 993834 0 2024-09-20T18:36:07.107 INFO:tasks.workunit.client.0.smithi017.stdout:9/797: chown d6/d23/d58/d3f/f91 998 1 2024-09-20T18:36:07.107 INFO:tasks.workunit.client.0.smithi017.stdout:7/591: dread da/f65 [0,4194304] 0 2024-09-20T18:36:07.107 INFO:tasks.workunit.client.0.smithi017.stdout:0/584: symlink d4/db/d18/d25/d36/d47/d81/lc9 0 2024-09-20T18:36:07.107 INFO:tasks.workunit.client.0.smithi017.stdout:3/809: read da/de/d13/fb9 [663612,37951] 0 2024-09-20T18:36:07.109 INFO:tasks.workunit.client.0.smithi017.stdout:6/610: rename d4/d37/d41/d43/d7d/l99 to d4/df/d1f/d25/d3f/lcf 0 2024-09-20T18:36:07.118 INFO:tasks.workunit.client.0.smithi017.stdout:9/798: dwrite d6/d23/d3a/d61/fe0 [0,4194304] 0 2024-09-20T18:36:07.118 INFO:tasks.workunit.client.0.smithi017.stdout:7/592: dwrite da/d16/d1c/d40/d30/f78 [0,4194304] 0 2024-09-20T18:36:07.120 INFO:tasks.workunit.client.0.smithi017.stdout:9/799: read - d6/d23/d3a/d61/de7/f4c zero size 2024-09-20T18:36:07.128 INFO:tasks.workunit.client.0.smithi017.stdout:0/585: fsync d4/d20/f6c 0 2024-09-20T18:36:07.135 INFO:tasks.workunit.client.0.smithi017.stdout:3/810: mknod da/de/d13/d2f/d26/d62/c10f 0 2024-09-20T18:36:07.136 INFO:tasks.workunit.client.0.smithi017.stdout:8/515: dwrite d0/d6/f38 [0,4194304] 0 2024-09-20T18:36:07.138 INFO:tasks.workunit.client.0.smithi017.stdout:2/816: dwrite d1/dc/d20/d2e/d30/d85/d46/fd6 [0,4194304] 0 2024-09-20T18:36:07.140 INFO:tasks.workunit.client.0.smithi017.stdout:4/538: rename d4/dc/d41/c80 to d4/d19/d37/da1/cac 0 2024-09-20T18:36:07.143 INFO:tasks.workunit.client.0.smithi017.stdout:7/593: readlink da/d16/d8e/d75/l95 0 2024-09-20T18:36:07.150 INFO:tasks.workunit.client.0.smithi017.stdout:3/811: unlink da/de/d13/d2f/d26/d31/d5a/d76/c86 0 2024-09-20T18:36:07.151 INFO:tasks.workunit.client.0.smithi017.stdout:2/817: mknod d1/df/d17/c10e 0 2024-09-20T18:36:07.155 INFO:tasks.workunit.client.0.smithi017.stdout:4/539: creat d4/dc/d1e/d26/fad x:0 0 0 2024-09-20T18:36:07.156 INFO:tasks.workunit.client.0.smithi017.stdout:6/611: creat d4/df/d1f/d25/d2b/fd0 x:0 0 0 2024-09-20T18:36:07.160 INFO:tasks.workunit.client.0.smithi017.stdout:7/594: write da/d16/d1c/d40/d34/d3c/f48 [2397233,92921] 0 2024-09-20T18:36:07.161 INFO:tasks.workunit.client.0.smithi017.stdout:7/595: readlink da/d16/d1c/la4 0 2024-09-20T18:36:07.162 INFO:tasks.workunit.client.0.smithi017.stdout:0/586: dread d4/db/d1e/d24/d2f/f6b [0,4194304] 0 2024-09-20T18:36:07.162 INFO:tasks.workunit.client.0.smithi017.stdout:9/800: write d6/d23/f50 [794249,89313] 0 2024-09-20T18:36:07.165 INFO:tasks.workunit.client.0.smithi017.stdout:7/596: write da/d16/d1c/d40/d3a/f93 [398365,96031] 0 2024-09-20T18:36:07.170 INFO:tasks.workunit.client.0.smithi017.stdout:8/516: symlink d0/d6/d28/d3d/d4e/d55/d83/da2/lac 0 2024-09-20T18:36:07.170 INFO:tasks.workunit.client.0.smithi017.stdout:3/812: dread da/de/d13/d2f/d26/d31/f9a [0,4194304] 0 2024-09-20T18:36:07.173 INFO:tasks.workunit.client.0.smithi017.stdout:5/590: link d0/d14/l89 d0/d14/d18/d2a/d39/lc8 0 2024-09-20T18:36:07.173 INFO:tasks.workunit.client.0.smithi017.stdout:3/813: write da/de/d13/d2f/d26/d31/fdd [73684,36258] 0 2024-09-20T18:36:07.173 INFO:tasks.workunit.client.0.smithi017.stdout:9/801: mknod d6/d23/d58/d3f/d70/db0/c11e 0 2024-09-20T18:36:07.177 INFO:tasks.workunit.client.0.smithi017.stdout:0/587: rename d4/db/d1e to d4/db/d18/d25/d36/d47/d8c/daa/dca 0 2024-09-20T18:36:07.177 INFO:tasks.workunit.client.0.smithi017.stdout:3/814: truncate da/de/d13/d2f/d26/d62/da5/da9/dbb/f109 895067 0 2024-09-20T18:36:07.184 INFO:tasks.workunit.client.0.smithi017.stdout:9/802: symlink d6/d23/d58/d3f/d4d/d73/d8f/l11f 0 2024-09-20T18:36:07.184 INFO:tasks.workunit.client.0.smithi017.stdout:7/597: dread da/d16/f47 [0,4194304] 0 2024-09-20T18:36:07.187 INFO:tasks.workunit.client.0.smithi017.stdout:3/815: mknod da/de/d13/d16/d6e/d97/dc1/c110 0 2024-09-20T18:36:07.187 INFO:tasks.workunit.client.0.smithi017.stdout:6/612: dread d4/df/d1f/d25/f7c [0,4194304] 0 2024-09-20T18:36:07.187 INFO:tasks.workunit.client.0.smithi017.stdout:0/588: dwrite d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/f67 [0,4194304] 0 2024-09-20T18:36:07.190 INFO:tasks.workunit.client.0.smithi017.stdout:4/540: write d4/d19/f1f [1226243,51063] 0 2024-09-20T18:36:07.190 INFO:tasks.workunit.client.0.smithi017.stdout:3/816: dread da/de/d53/d88/f91 [0,4194304] 0 2024-09-20T18:36:07.196 INFO:tasks.workunit.client.0.smithi017.stdout:9/803: unlink d6/d11/f3e 0 2024-09-20T18:36:07.200 INFO:tasks.workunit.client.0.smithi017.stdout:3/817: dwrite da/de/d13/d2f/d26/d31/f7e [0,4194304] 0 2024-09-20T18:36:07.202 INFO:tasks.workunit.client.0.smithi017.stdout:8/517: write d0/d6/f56 [1206999,64643] 0 2024-09-20T18:36:07.203 INFO:tasks.workunit.client.0.smithi017.stdout:6/613: chown d4/df/d1f/d25/d3f/d5c/f61 2142346757 1 2024-09-20T18:36:07.203 INFO:tasks.workunit.client.0.smithi017.stdout:8/518: chown d0/f22 240 1 2024-09-20T18:36:07.203 INFO:tasks.workunit.client.0.smithi017.stdout:0/589: mkdir d4/db/d18/d25/d36/d47/d8c/dcb 0 2024-09-20T18:36:07.205 INFO:tasks.workunit.client.0.smithi017.stdout:8/519: chown d0/d6/d28/d3b/d72/d98/da4/lab 44117 1 2024-09-20T18:36:07.205 INFO:tasks.workunit.client.0.smithi017.stdout:4/541: chown d4/l46 1189946621 1 2024-09-20T18:36:07.211 INFO:tasks.workunit.client.0.smithi017.stdout:9/804: rename d6/d23/d58/d3f/d4d/lfa to d6/d23/d40/de2/l120 0 2024-09-20T18:36:07.212 INFO:tasks.workunit.client.0.smithi017.stdout:6/614: creat d4/d37/d68/fd1 x:0 0 0 2024-09-20T18:36:07.213 INFO:tasks.workunit.client.0.smithi017.stdout:7/598: dwrite da/d16/f3f [0,4194304] 0 2024-09-20T18:36:07.213 INFO:tasks.workunit.client.0.smithi017.stdout:6/615: fdatasync d4/d37/d41/d43/d7d/f88 0 2024-09-20T18:36:07.215 INFO:tasks.workunit.client.0.smithi017.stdout:6/616: stat d4/df/d1f/d25/d2b/fd0 0 2024-09-20T18:36:07.215 INFO:tasks.workunit.client.0.smithi017.stdout:5/591: getdents d0/d14/d18/d79 0 2024-09-20T18:36:07.220 INFO:tasks.workunit.client.0.smithi017.stdout:8/520: creat d0/d6/d28/d3d/d4e/d55/d83/da2/fad x:0 0 0 2024-09-20T18:36:07.220 INFO:tasks.workunit.client.0.smithi017.stdout:9/805: rmdir d6/d23/d58/d3f/d70 39 2024-09-20T18:36:07.221 INFO:tasks.workunit.client.0.smithi017.stdout:8/521: fdatasync d0/d6/d28/d3d/f4a 0 2024-09-20T18:36:07.228 INFO:tasks.workunit.client.0.smithi017.stdout:0/590: write d4/db/d18/d55/fab [678064,70936] 0 2024-09-20T18:36:07.229 INFO:tasks.workunit.client.0.smithi017.stdout:0/591: chown d4/db/d18/f8d 173739 1 2024-09-20T18:36:07.233 INFO:tasks.workunit.client.0.smithi017.stdout:7/599: write da/d54/f76 [260124,99571] 0 2024-09-20T18:36:07.233 INFO:tasks.workunit.client.0.smithi017.stdout:7/600: readlink da/l97 0 2024-09-20T18:36:07.235 INFO:tasks.workunit.client.0.smithi017.stdout:8/522: fdatasync d0/d6/f74 0 2024-09-20T18:36:07.237 INFO:tasks.workunit.client.0.smithi017.stdout:5/592: creat d0/d14/d18/d2a/d39/d42/d7e/da8/fc9 x:0 0 0 2024-09-20T18:36:07.239 INFO:tasks.workunit.client.0.smithi017.stdout:6/617: dwrite d4/df/d1f/f80 [0,4194304] 0 2024-09-20T18:36:07.244 INFO:tasks.workunit.client.0.smithi017.stdout:5/593: creat d0/d14/d18/d57/db6/fca x:0 0 0 2024-09-20T18:36:07.253 INFO:tasks.workunit.client.0.smithi017.stdout:0/592: truncate d4/f8 3193827 0 2024-09-20T18:36:07.254 INFO:tasks.workunit.client.0.smithi017.stdout:7/601: symlink da/d94/lb8 0 2024-09-20T18:36:07.255 INFO:tasks.workunit.client.0.smithi017.stdout:6/618: creat d4/d37/d41/d43/fd2 x:0 0 0 2024-09-20T18:36:07.258 INFO:tasks.workunit.client.0.smithi017.stdout:4/542: link d4/d19/c47 d4/d19/cae 0 2024-09-20T18:36:07.262 INFO:tasks.workunit.client.0.smithi017.stdout:0/593: mkdir d4/db/d18/d25/d36/d47/d8c/daa/dcc 0 2024-09-20T18:36:07.267 INFO:tasks.workunit.client.0.smithi017.stdout:6/619: rename d4/df/d1f/d25/d3f/d5c/f7b to d4/d37/d68/d8d/dba/dc0/fd3 0 2024-09-20T18:36:07.268 INFO:tasks.workunit.client.0.smithi017.stdout:6/620: chown d4/d37/d68/d8d/dba 361 1 2024-09-20T18:36:07.270 INFO:tasks.workunit.client.0.smithi017.stdout:5/594: creat d0/d14/d18/d19/d4d/d96/fcb x:0 0 0 2024-09-20T18:36:07.272 INFO:tasks.workunit.client.0.smithi017.stdout:9/806: creat d6/d23/d58/d3f/d2f/f121 x:0 0 0 2024-09-20T18:36:07.273 INFO:tasks.workunit.client.0.smithi017.stdout:8/523: truncate d0/d6/d28/d81/d82/f84 2665287 0 2024-09-20T18:36:07.273 INFO:tasks.workunit.client.0.smithi017.stdout:8/524: fdatasync d0/d6/d28/f29 0 2024-09-20T18:36:07.274 INFO:tasks.workunit.client.0.smithi017.stdout:0/594: truncate d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/f87 313407 0 2024-09-20T18:36:07.275 INFO:tasks.workunit.client.0.smithi017.stdout:0/595: chown d4/d37/la3 5397902 1 2024-09-20T18:36:07.278 INFO:tasks.workunit.client.0.smithi017.stdout:8/525: dread d0/d6/d28/d81/d82/f96 [0,4194304] 0 2024-09-20T18:36:07.278 INFO:tasks.workunit.client.0.smithi017.stdout:4/543: symlink d4/dc/laf 0 2024-09-20T18:36:07.278 INFO:tasks.workunit.client.0.smithi017.stdout:5/595: fsync d0/d14/d18/d19/d4d/d6d/d78/d99/fb3 0 2024-09-20T18:36:07.283 INFO:tasks.workunit.client.0.smithi017.stdout:5/596: dread d0/d14/f20 [0,4194304] 0 2024-09-20T18:36:07.283 INFO:tasks.workunit.client.0.smithi017.stdout:7/602: write da/f77 [683206,14679] 0 2024-09-20T18:36:07.284 INFO:tasks.workunit.client.0.smithi017.stdout:5/597: fdatasync d0/fe 0 2024-09-20T18:36:07.287 INFO:tasks.workunit.client.0.smithi017.stdout:8/526: mkdir d0/d6/d28/d3a/dae 0 2024-09-20T18:36:07.295 INFO:tasks.workunit.client.0.smithi017.stdout:6/621: getdents d4/df/d1f/d25 0 2024-09-20T18:36:07.296 INFO:tasks.workunit.client.0.smithi017.stdout:5/598: mkdir d0/d14/d18/dcc 0 2024-09-20T18:36:07.298 INFO:tasks.workunit.client.0.smithi017.stdout:5/599: write d0/d14/d18/d1b/fa6 [960268,44309] 0 2024-09-20T18:36:07.300 INFO:tasks.workunit.client.0.smithi017.stdout:0/596: rename d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d51 to d4/db/dcd 0 2024-09-20T18:36:07.303 INFO:tasks.workunit.client.0.smithi017.stdout:7/603: getdents da/d16/d1c/d40/d34/d96 0 2024-09-20T18:36:07.305 INFO:tasks.workunit.client.0.smithi017.stdout:8/527: dread d0/d6/d28/d3d/f4a [0,4194304] 0 2024-09-20T18:36:07.306 INFO:tasks.workunit.client.0.smithi017.stdout:9/807: dread d6/d23/d58/d3f/d4d/d73/fe5 [0,4194304] 0 2024-09-20T18:36:07.308 INFO:tasks.workunit.client.0.smithi017.stdout:5/600: dread d0/d14/d18/d1b/fa6 [0,4194304] 0 2024-09-20T18:36:07.308 INFO:tasks.workunit.client.0.smithi017.stdout:0/597: read - d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/f7b zero size 2024-09-20T18:36:07.310 INFO:tasks.workunit.client.0.smithi017.stdout:4/544: rename d4/d19/cab to d4/d19/d37/da1/cb0 0 2024-09-20T18:36:07.311 INFO:tasks.workunit.client.0.smithi017.stdout:8/528: creat d0/d6/d93/faf x:0 0 0 2024-09-20T18:36:07.313 INFO:tasks.workunit.client.0.smithi017.stdout:4/545: readlink d4/d19/d37/da1/l50 0 2024-09-20T18:36:07.313 INFO:tasks.workunit.client.0.smithi017.stdout:6/622: dwrite d4/d37/d41/d43/fd2 [0,4194304] 0 2024-09-20T18:36:07.317 INFO:tasks.workunit.client.0.smithi017.stdout:4/546: stat d4/dc/d1e/ca3 0 2024-09-20T18:36:07.320 INFO:tasks.workunit.client.0.smithi017.stdout:6/623: fdatasync d4/d37/f6a 0 2024-09-20T18:36:07.320 INFO:tasks.workunit.client.0.smithi017.stdout:8/529: chown d0/d6/d28/d3d/d4e/d55/d83/da2/fad 2717155 1 2024-09-20T18:36:07.322 INFO:tasks.workunit.client.0.smithi017.stdout:9/808: dwrite d6/d23/d3a/f5e [0,4194304] 0 2024-09-20T18:36:07.326 INFO:tasks.workunit.client.0.smithi017.stdout:6/624: mkdir d4/d37/d68/d8d/db2/dd4 0 2024-09-20T18:36:07.328 INFO:tasks.workunit.client.0.smithi017.stdout:8/530: mknod d0/d6/d28/d3d/d4e/cb0 0 2024-09-20T18:36:07.328 INFO:tasks.workunit.client.0.smithi017.stdout:5/601: dread d0/d14/d18/f5a [0,4194304] 0 2024-09-20T18:36:07.329 INFO:tasks.workunit.client.0.smithi017.stdout:8/531: dread - d0/d6/d93/faf zero size 2024-09-20T18:36:07.330 INFO:tasks.workunit.client.0.smithi017.stdout:4/547: rename d4/dc/d1e/d26/d4e to d4/d19/d37/da1/d1b/d56/db1 0 2024-09-20T18:36:07.333 INFO:tasks.workunit.client.0.smithi017.stdout:9/809: dread - d6/d23/d3a/d61/de7/f9f zero size 2024-09-20T18:36:07.333 INFO:tasks.workunit.client.0.smithi017.stdout:4/548: fdatasync d4/d19/d37/da1/d1b/f33 0 2024-09-20T18:36:07.333 INFO:tasks.workunit.client.0.smithi017.stdout:9/810: chown d6/d11/f17 65277039 1 2024-09-20T18:36:07.336 INFO:tasks.workunit.client.0.smithi017.stdout:5/602: read d0/d14/d18/d2a/d39/d6c/d72/f16 [939166,118042] 0 2024-09-20T18:36:07.338 INFO:tasks.workunit.client.0.smithi017.stdout:4/549: stat d4/d82/d88/c32 0 2024-09-20T18:36:07.340 INFO:tasks.workunit.client.0.smithi017.stdout:6/625: creat d4/d37/d41/d43/d7d/dc2/fd5 x:0 0 0 2024-09-20T18:36:07.343 INFO:tasks.workunit.client.0.smithi017.stdout:9/811: getdents d6/d23/d58/d3f/d9d/dfd 0 2024-09-20T18:36:07.344 INFO:tasks.workunit.client.0.smithi017.stdout:5/603: dwrite d0/fe [4194304,4194304] 0 2024-09-20T18:36:07.344 INFO:tasks.workunit.client.0.smithi017.stdout:6/626: write d4/df/d1f/d25/d3f/d5c/fc1 [388241,26361] 0 2024-09-20T18:36:07.345 INFO:tasks.workunit.client.0.smithi017.stdout:4/550: rename d4/dc/d1e/d69/d79/l8a to d4/d19/d37/da1/d1b/d56/d67/lb2 0 2024-09-20T18:36:07.346 INFO:tasks.workunit.client.0.smithi017.stdout:6/627: chown d4/d37/l73 59955 1 2024-09-20T18:36:07.352 INFO:tasks.workunit.client.0.smithi017.stdout:5/604: dread d0/d14/d18/d1b/f31 [0,4194304] 0 2024-09-20T18:36:07.352 INFO:tasks.workunit.client.0.smithi017.stdout:6/628: creat d4/df/d4a/d8f/fd6 x:0 0 0 2024-09-20T18:36:07.355 INFO:tasks.workunit.client.0.smithi017.stdout:9/812: mknod d6/d23/d58/d3f/d70/db0/dca/d107/c122 0 2024-09-20T18:36:07.356 INFO:tasks.workunit.client.0.smithi017.stdout:9/813: chown d6/d23/d58/d3f/d70/dd9 59 1 2024-09-20T18:36:07.360 INFO:tasks.workunit.client.0.smithi017.stdout:6/629: dwrite d4/d37/d41/d43/d7d/f88 [0,4194304] 0 2024-09-20T18:36:07.362 INFO:tasks.workunit.client.0.smithi017.stdout:9/814: creat d6/d23/d58/d3f/d4d/d73/d93/f123 x:0 0 0 2024-09-20T18:36:07.365 INFO:tasks.workunit.client.0.smithi017.stdout:9/815: rmdir d6/d23/d3a/db8 39 2024-09-20T18:36:07.367 INFO:tasks.workunit.client.0.smithi017.stdout:6/630: rename d4/d37/d68/da4/d72 to d4/df/d1f/d25/dd7 0 2024-09-20T18:36:07.369 INFO:tasks.workunit.client.0.smithi017.stdout:0/598: write d4/db/d18/d55/f72 [774449,44420] 0 2024-09-20T18:36:07.373 INFO:tasks.workunit.client.0.smithi017.stdout:0/599: symlink d4/db/d18/d25/d36/d47/d81/d9c/lce 0 2024-09-20T18:36:07.377 INFO:tasks.workunit.client.0.smithi017.stdout:6/631: link d4/d37/d41/d43/d7d/f88 d4/fd8 0 2024-09-20T18:36:07.379 INFO:tasks.workunit.client.0.smithi017.stdout:0/600: mknod d4/ccf 0 2024-09-20T18:36:07.383 INFO:tasks.workunit.client.0.smithi017.stdout:6/632: truncate d4/d37/d41/f54 1278023 0 2024-09-20T18:36:07.385 INFO:tasks.workunit.client.0.smithi017.stdout:0/601: dread d4/db/d18/d25/d36/d47/d81/f9b [0,4194304] 0 2024-09-20T18:36:07.393 INFO:tasks.workunit.client.0.smithi017.stdout:8/532: truncate d0/d6/d28/d3d/d4e/f89 4051226 0 2024-09-20T18:36:07.394 INFO:tasks.workunit.client.0.smithi017.stdout:6/633: dwrite d4/d37/d68/da4/f97 [0,4194304] 0 2024-09-20T18:36:07.395 INFO:tasks.workunit.client.0.smithi017.stdout:8/533: fdatasync d0/d6/f38 0 2024-09-20T18:36:07.399 INFO:tasks.workunit.client.0.smithi017.stdout:0/602: rmdir d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d69 39 2024-09-20T18:36:07.406 INFO:tasks.workunit.client.0.smithi017.stdout:8/534: creat d0/d6/d28/d3d/d4e/fb1 x:0 0 0 2024-09-20T18:36:07.406 INFO:tasks.workunit.client.0.smithi017.stdout:8/535: chown d0/d6 111397752 1 2024-09-20T18:36:07.407 INFO:tasks.workunit.client.0.smithi017.stdout:8/536: chown d0/d6/c15 77730157 1 2024-09-20T18:36:07.409 INFO:tasks.workunit.client.0.smithi017.stdout:8/537: write d0/d6/f23 [3459557,17919] 0 2024-09-20T18:36:07.412 INFO:tasks.workunit.client.0.smithi017.stdout:6/634: mkdir d4/d37/d68/d8d/db2/dd4/dd9 0 2024-09-20T18:36:07.413 INFO:tasks.workunit.client.0.smithi017.stdout:0/603: creat d4/db/d18/d25/d36/d47/d8c/daa/dca/db1/fd0 x:0 0 0 2024-09-20T18:36:07.413 INFO:tasks.workunit.client.0.smithi017.stdout:6/635: write d4/df/d1f/f80 [5006868,38529] 0 2024-09-20T18:36:07.427 INFO:tasks.workunit.client.0.smithi017.stdout:4/551: dwrite d4/d19/d37/da1/d1b/f81 [0,4194304] 0 2024-09-20T18:36:07.432 INFO:tasks.workunit.client.0.smithi017.stdout:4/552: read d4/f7 [1409713,59575] 0 2024-09-20T18:36:07.433 INFO:tasks.workunit.client.0.smithi017.stdout:9/816: write d6/d23/d58/d3f/f91 [4691125,60063] 0 2024-09-20T18:36:07.445 INFO:tasks.workunit.client.0.smithi017.stdout:1/570: sync 2024-09-20T18:36:07.449 INFO:tasks.workunit.client.0.smithi017.stdout:1/571: mknod df/d16/d50/d69/d62/da7/cb3 0 2024-09-20T18:36:07.452 INFO:tasks.workunit.client.0.smithi017.stdout:1/572: write df/d35/f76 [3590688,60375] 0 2024-09-20T18:36:07.460 INFO:tasks.workunit.client.0.smithi017.stdout:0/604: dwrite d4/d37/f6a [0,4194304] 0 2024-09-20T18:36:07.461 INFO:tasks.workunit.client.0.smithi017.stdout:6/636: write d4/df/d1f/d25/f27 [1725998,111970] 0 2024-09-20T18:36:07.463 INFO:tasks.workunit.client.0.smithi017.stdout:4/553: write d4/d82/d88/f36 [6803658,47181] 0 2024-09-20T18:36:07.463 INFO:tasks.workunit.client.0.smithi017.stdout:1/573: link df/d16/c41 df/d16/d50/cb4 0 2024-09-20T18:36:07.465 INFO:tasks.workunit.client.0.smithi017.stdout:0/605: fsync d4/db/f3b 0 2024-09-20T18:36:07.465 INFO:tasks.workunit.client.0.smithi017.stdout:8/538: write d0/d6/d28/f5a [391457,58008] 0 2024-09-20T18:36:07.470 INFO:tasks.workunit.client.0.smithi017.stdout:6/637: symlink d4/df/d1f/d25/d3f/d5c/lda 0 2024-09-20T18:36:07.473 INFO:tasks.workunit.client.0.smithi017.stdout:9/817: dwrite d6/d23/d3a/d61/de7/f86 [0,4194304] 0 2024-09-20T18:36:07.476 INFO:tasks.workunit.client.0.smithi017.stdout:4/554: mkdir d4/d19/d37/da1/d1b/d56/d67/db3 0 2024-09-20T18:36:07.477 INFO:tasks.workunit.client.0.smithi017.stdout:1/574: dwrite df/d1c/f75 [0,4194304] 0 2024-09-20T18:36:07.479 INFO:tasks.workunit.client.0.smithi017.stdout:8/539: symlink d0/d6/d28/d3d/d4e/d55/lb2 0 2024-09-20T18:36:07.480 INFO:tasks.workunit.client.0.smithi017.stdout:6/638: mknod d4/d37/d68/da4/d9e/cdb 0 2024-09-20T18:36:07.485 INFO:tasks.workunit.client.0.smithi017.stdout:8/540: rmdir d0/d6/d28 39 2024-09-20T18:36:07.491 INFO:tasks.workunit.client.0.smithi017.stdout:6/639: dwrite d4/df/d8a/fbe [4194304,4194304] 0 2024-09-20T18:36:07.498 INFO:tasks.workunit.client.0.smithi017.stdout:4/555: write d4/d19/f7e [4048417,27471] 0 2024-09-20T18:36:07.502 INFO:tasks.workunit.client.0.smithi017.stdout:6/640: dwrite d4/d37/d68/d8d/fce [0,4194304] 0 2024-09-20T18:36:07.504 INFO:tasks.workunit.client.0.smithi017.stdout:8/541: rename d0/d6/d28/d3d/d4e/cb0 to d0/d6/d28/d3d/d4e/d55/d83/cb3 0 2024-09-20T18:36:07.505 INFO:tasks.workunit.client.0.smithi017.stdout:9/818: truncate d6/d23/d58/d3f/fb9 3021678 0 2024-09-20T18:36:07.506 INFO:tasks.workunit.client.0.smithi017.stdout:8/542: chown d0/d6/d28/d3d/d4e/f75 95 1 2024-09-20T18:36:07.513 INFO:tasks.workunit.client.0.smithi017.stdout:8/543: unlink d0/d6/c1f 0 2024-09-20T18:36:07.515 INFO:tasks.workunit.client.0.smithi017.stdout:4/556: mkdir d4/d82/d88/d5c/d8f/da9/db4 0 2024-09-20T18:36:07.526 INFO:tasks.workunit.client.0.smithi017.stdout:6/641: link d4/df/d1f/d25/d3f/l42 d4/df/d8a/ldc 0 2024-09-20T18:36:07.528 INFO:tasks.workunit.client.0.smithi017.stdout:9/819: dread d6/f7 [0,4194304] 0 2024-09-20T18:36:07.528 INFO:tasks.workunit.client.0.smithi017.stdout:6/642: write d4/df/d4a/d8f/fd6 [504469,91021] 0 2024-09-20T18:36:07.531 INFO:tasks.workunit.client.0.smithi017.stdout:8/544: dread d0/d6/d28/d3d/d4e/f75 [0,4194304] 0 2024-09-20T18:36:07.533 INFO:tasks.workunit.client.0.smithi017.stdout:4/557: mkdir d4/d82/d88/d5c/d8f/da9/db4/db5 0 2024-09-20T18:36:07.536 INFO:tasks.workunit.client.0.smithi017.stdout:6/643: rmdir d4/d37/d68/d8d/db2/dd4 39 2024-09-20T18:36:07.538 INFO:tasks.workunit.client.0.smithi017.stdout:9/820: mknod d6/d23/d40/de2/df5/c124 0 2024-09-20T18:36:07.540 INFO:tasks.workunit.client.0.smithi017.stdout:4/558: unlink d4/d82/d88/c32 0 2024-09-20T18:36:07.541 INFO:tasks.workunit.client.0.smithi017.stdout:4/559: stat d4/dc/l85 0 2024-09-20T18:36:07.545 INFO:tasks.workunit.client.0.smithi017.stdout:9/821: unlink d6/c77 0 2024-09-20T18:36:07.547 INFO:tasks.workunit.client.0.smithi017.stdout:6/644: creat d4/df/fdd x:0 0 0 2024-09-20T18:36:07.550 INFO:tasks.workunit.client.0.smithi017.stdout:9/822: creat d6/d23/d58/d3f/d4d/d73/d7d/d10f/f125 x:0 0 0 2024-09-20T18:36:07.551 INFO:tasks.workunit.client.0.smithi017.stdout:6/645: rmdir d4/d37/d41 39 2024-09-20T18:36:07.561 INFO:tasks.workunit.client.0.smithi017.stdout:6/646: link d4/df/d4a/d8f/fc4 d4/df/d4a/fde 0 2024-09-20T18:36:07.567 INFO:tasks.workunit.client.0.smithi017.stdout:6/647: creat d4/d37/fdf x:0 0 0 2024-09-20T18:36:07.567 INFO:tasks.workunit.client.0.smithi017.stdout:9/823: write d6/d23/f54 [3906884,33900] 0 2024-09-20T18:36:07.569 INFO:tasks.workunit.client.0.smithi017.stdout:6/648: dread d4/df/d1f/f22 [0,4194304] 0 2024-09-20T18:36:07.574 INFO:tasks.workunit.client.0.smithi017.stdout:9/824: write d6/d23/f7a [138980,126859] 0 2024-09-20T18:36:07.576 INFO:tasks.workunit.client.0.smithi017.stdout:6/649: rename d4/c7 to d4/d37/d68/d8d/db2/dd4/dd9/ce0 0 2024-09-20T18:36:07.581 INFO:tasks.workunit.client.0.smithi017.stdout:6/650: mknod d4/df/d1f/ce1 0 2024-09-20T18:36:07.582 INFO:tasks.workunit.client.0.smithi017.stdout:9/825: write d6/d11/f17 [1134521,95282] 0 2024-09-20T18:36:07.584 INFO:tasks.workunit.client.0.smithi017.stdout:6/651: chown d4/d37/d41/d43/c49 81 1 2024-09-20T18:36:07.587 INFO:tasks.workunit.client.0.smithi017.stdout:6/652: creat d4/d29/fe2 x:0 0 0 2024-09-20T18:36:07.588 INFO:tasks.workunit.client.0.smithi017.stdout:6/653: readlink d4/l36 0 2024-09-20T18:36:07.592 INFO:tasks.workunit.client.0.smithi017.stdout:6/654: mknod d4/d37/d68/dbb/ce3 0 2024-09-20T18:36:07.592 INFO:tasks.workunit.client.0.smithi017.stdout:9/826: dwrite d6/d23/d58/d3f/d70/dfe/d10b/f4f [0,4194304] 0 2024-09-20T18:36:07.593 INFO:tasks.workunit.client.0.smithi017.stdout:6/655: stat d4/d37/d68/da4/d9e/cdb 0 2024-09-20T18:36:07.595 INFO:tasks.workunit.client.0.smithi017.stdout:9/827: mknod d6/d23/d58/d3f/d4d/d73/d93/c126 0 2024-09-20T18:36:07.596 INFO:tasks.workunit.client.0.smithi017.stdout:6/656: chown d4/df/d1f/d25/d2b/c60 509442 1 2024-09-20T18:36:07.599 INFO:tasks.workunit.client.0.smithi017.stdout:9/828: dread d6/d23/d58/d3f/d4d/ff1 [0,4194304] 0 2024-09-20T18:36:07.601 INFO:tasks.workunit.client.0.smithi017.stdout:9/829: fsync d6/d23/d3a/d61/fb3 0 2024-09-20T18:36:07.604 INFO:tasks.workunit.client.0.smithi017.stdout:6/657: dwrite d4/df/d1f/d25/d3f/fa1 [0,4194304] 0 2024-09-20T18:36:07.611 INFO:tasks.workunit.client.0.smithi017.stdout:9/830: rename d6/d23/d58/d3f/ce9 to d6/d23/d3a/d61/c127 0 2024-09-20T18:36:07.612 INFO:tasks.workunit.client.0.smithi017.stdout:9/831: fsync d6/d11/f17 0 2024-09-20T18:36:07.613 INFO:tasks.workunit.client.0.smithi017.stdout:6/658: dwrite d4/df/d1f/faf [0,4194304] 0 2024-09-20T18:36:07.618 INFO:tasks.workunit.client.0.smithi017.stdout:6/659: dread d4/d29/f45 [4194304,4194304] 0 2024-09-20T18:36:07.619 INFO:tasks.workunit.client.0.smithi017.stdout:9/832: creat d6/d23/d58/d3f/d4d/d73/d7d/dbd/f128 x:0 0 0 2024-09-20T18:36:07.621 INFO:tasks.workunit.client.0.smithi017.stdout:9/833: truncate d6/d23/d58/d3f/d2f/f121 434854 0 2024-09-20T18:36:07.621 INFO:tasks.workunit.client.0.smithi017.stdout:6/660: dread d4/d37/d41/d43/f78 [0,4194304] 0 2024-09-20T18:36:07.622 INFO:tasks.workunit.client.0.smithi017.stdout:9/834: readlink d6/d23/d58/d3f/d4d/d73/d93/leb 0 2024-09-20T18:36:07.624 INFO:tasks.workunit.client.0.smithi017.stdout:9/835: fdatasync d6/d23/d40/db4/fce 0 2024-09-20T18:36:07.627 INFO:tasks.workunit.client.0.smithi017.stdout:9/836: mknod d6/d23/d58/d3f/d4d/d73/c129 0 2024-09-20T18:36:07.631 INFO:tasks.workunit.client.0.smithi017.stdout:6/661: dwrite d4/df/d1f/d25/f7c [4194304,4194304] 0 2024-09-20T18:36:07.631 INFO:tasks.workunit.client.0.smithi017.stdout:9/837: mknod d6/d23/d58/d3f/d4d/d73/d93/c12a 0 2024-09-20T18:36:07.640 INFO:tasks.workunit.client.0.smithi017.stdout:9/838: rename d6/d23/d58/d3f/d44/c5a to d6/d23/d58/d3f/d4d/d73/d7d/dbd/c12b 0 2024-09-20T18:36:07.642 INFO:tasks.workunit.client.0.smithi017.stdout:9/839: write d6/d23/d58/d3f/d4d/d73/d8f/f101 [227500,44434] 0 2024-09-20T18:36:07.649 INFO:tasks.workunit.client.0.smithi017.stdout:6/662: dread d4/f12 [0,4194304] 0 2024-09-20T18:36:07.651 INFO:tasks.workunit.client.0.smithi017.stdout:6/663: mknod d4/d37/d68/d8d/db2/dd4/dd9/ce4 0 2024-09-20T18:36:07.661 INFO:tasks.workunit.client.0.smithi017.stdout:9/840: dwrite d6/d23/d40/db4/dba/dd7/fdc [0,4194304] 0 2024-09-20T18:36:07.668 INFO:tasks.workunit.client.0.smithi017.stdout:6/664: creat d4/d37/d41/d43/d7d/fe5 x:0 0 0 2024-09-20T18:36:07.671 INFO:tasks.workunit.client.0.smithi017.stdout:9/841: mkdir d6/d23/d58/d3f/d70/db0/dca/d12c 0 2024-09-20T18:36:07.677 INFO:tasks.workunit.client.0.smithi017.stdout:9/842: creat d6/d23/d58/d3f/d9d/dfd/f12d x:0 0 0 2024-09-20T18:36:07.680 INFO:tasks.workunit.client.0.smithi017.stdout:9/843: mkdir d6/d23/d58/d3f/d4d/d73/d7d/d12e 0 2024-09-20T18:36:07.681 INFO:tasks.workunit.client.0.smithi017.stdout:9/844: dread - d6/fc2 zero size 2024-09-20T18:36:07.681 INFO:tasks.workunit.client.0.smithi017.stdout:6/665: dread d4/f10 [0,4194304] 0 2024-09-20T18:36:07.683 INFO:tasks.workunit.client.0.smithi017.stdout:6/666: read d4/df/d4a/f6c [833591,42499] 0 2024-09-20T18:36:07.685 INFO:tasks.workunit.client.0.smithi017.stdout:9/845: mkdir d6/d23/d58/d3f/d70/dfe/d12f 0 2024-09-20T18:36:07.687 INFO:tasks.workunit.client.0.smithi017.stdout:6/667: rename d4/d37/d68/d8d/dba/dc0 to d4/df/d4a/de6 0 2024-09-20T18:36:07.688 INFO:tasks.workunit.client.0.smithi017.stdout:6/668: chown d4/df/d4a/d8f/lae 3 1 2024-09-20T18:36:07.690 INFO:tasks.workunit.client.0.smithi017.stdout:9/846: creat d6/d23/d3a/db8/d113/f130 x:0 0 0 2024-09-20T18:36:07.691 INFO:tasks.workunit.client.0.smithi017.stdout:9/847: stat d6/d23/d58/d3f/d2f/lfc 0 2024-09-20T18:36:07.694 INFO:tasks.workunit.client.0.smithi017.stdout:9/848: mkdir d6/d23/d58/d3f/d70/dfe/d131 0 2024-09-20T18:36:07.708 INFO:tasks.workunit.client.0.smithi017.stdout:6/669: write d4/f14 [1331386,56196] 0 2024-09-20T18:36:07.711 INFO:tasks.workunit.client.0.smithi017.stdout:9/849: write d6/d23/d58/d3f/d4d/d73/d8f/f99 [212444,45293] 0 2024-09-20T18:36:07.712 INFO:tasks.workunit.client.0.smithi017.stdout:6/670: readlink d4/df/d8a/ldc 0 2024-09-20T18:36:07.712 INFO:tasks.workunit.client.0.smithi017.stdout:9/850: chown d6/d23/d3a/d61/de7/f4c 112342675 1 2024-09-20T18:36:07.715 INFO:tasks.workunit.client.0.smithi017.stdout:9/851: mknod d6/d23/c132 0 2024-09-20T18:36:07.716 INFO:tasks.workunit.client.0.smithi017.stdout:9/852: readlink d6/ld 0 2024-09-20T18:36:07.722 INFO:tasks.workunit.client.0.smithi017.stdout:9/853: dwrite d6/fc2 [0,4194304] 0 2024-09-20T18:36:07.735 INFO:tasks.workunit.client.0.smithi017.stdout:9/854: write d6/fe [24727,41712] 0 2024-09-20T18:36:07.739 INFO:tasks.workunit.client.0.smithi017.stdout:9/855: truncate d6/d23/d58/d3f/d2f/f8e 2561776 0 2024-09-20T18:36:07.744 INFO:tasks.workunit.client.0.smithi017.stdout:9/856: rename d6/d23/d40/db4/d102 to d6/d23/d58/d3f/d133 0 2024-09-20T18:36:07.746 INFO:tasks.workunit.client.0.smithi017.stdout:9/857: creat d6/d23/d58/d3f/d2f/d98/d10c/f134 x:0 0 0 2024-09-20T18:36:07.748 INFO:tasks.workunit.client.0.smithi017.stdout:9/858: symlink d6/d23/d58/d3f/d4d/d73/d8f/l135 0 2024-09-20T18:36:07.750 INFO:tasks.workunit.client.0.smithi017.stdout:9/859: symlink d6/d23/d58/d3f/d4d/d73/d7d/d10f/l136 0 2024-09-20T18:36:07.769 INFO:tasks.workunit.client.0.smithi017.stdout:2/818: sync 2024-09-20T18:36:07.770 INFO:tasks.workunit.client.0.smithi017.stdout:2/819: dread - d1/dc/d20/d2e/d30/fcc zero size 2024-09-20T18:36:07.770 INFO:tasks.workunit.client.0.smithi017.stdout:2/820: creat d1/df/d17/f10f x:0 0 0 2024-09-20T18:36:07.771 INFO:tasks.workunit.client.0.smithi017.stdout:2/821: write d1/df/d17/f10f [792962,54614] 0 2024-09-20T18:36:07.772 INFO:tasks.workunit.client.0.smithi017.stdout:2/822: chown d1/dc/d20/d2e/f4f 63480249 1 2024-09-20T18:36:07.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:07 smithi172 ceph-mon[35456]: pgmap v38: 65 pgs: 65 active+clean; 3.2 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 52 MiB/s rd, 157 MiB/s wr, 327 op/s 2024-09-20T18:36:08.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:07 smithi017 ceph-mon[28058]: pgmap v38: 65 pgs: 65 active+clean; 3.2 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail; 52 MiB/s rd, 157 MiB/s wr, 327 op/s 2024-09-20T18:36:08.166 INFO:tasks.workunit.client.0.smithi017.stdout:3/818: sync 2024-09-20T18:36:08.174 INFO:tasks.workunit.client.0.smithi017.stdout:3/819: dwrite da/de/d13/d2f/d26/d62/da5/da9/ff7 [0,4194304] 0 2024-09-20T18:36:08.187 INFO:tasks.workunit.client.0.smithi017.stdout:3/820: truncate da/de/d13/d16/f3f 2096148 0 2024-09-20T18:36:08.190 INFO:tasks.workunit.client.0.smithi017.stdout:3/821: mknod da/de/d13/d2f/d26/d31/c111 0 2024-09-20T18:36:08.192 INFO:tasks.workunit.client.0.smithi017.stdout:3/822: fdatasync da/de/d13/d2f/d26/d62/da5/da9/dbb/fed 0 2024-09-20T18:36:08.339 INFO:tasks.workunit.client.0.smithi017.stdout:7/604: sync 2024-09-20T18:36:08.339 INFO:tasks.workunit.client.0.smithi017.stdout:5/605: sync 2024-09-20T18:36:08.339 INFO:tasks.workunit.client.0.smithi017.stdout:0/606: sync 2024-09-20T18:36:08.340 INFO:tasks.workunit.client.0.smithi017.stdout:7/605: readlink da/d16/d1c/d40/d34/d96/lb4 0 2024-09-20T18:36:08.341 INFO:tasks.workunit.client.0.smithi017.stdout:5/606: symlink d0/dbe/lcd 0 2024-09-20T18:36:08.341 INFO:tasks.workunit.client.0.smithi017.stdout:0/607: read d4/f11 [701031,36778] 0 2024-09-20T18:36:08.342 INFO:tasks.workunit.client.0.smithi017.stdout:7/606: symlink da/d54/lb9 0 2024-09-20T18:36:08.342 INFO:tasks.workunit.client.0.smithi017.stdout:0/608: dread - d4/db/d18/f54 zero size 2024-09-20T18:36:08.343 INFO:tasks.workunit.client.0.smithi017.stdout:5/607: rmdir d0/d14/d18/d2a/d39 39 2024-09-20T18:36:08.345 INFO:tasks.workunit.client.0.smithi017.stdout:5/608: mknod d0/d14/d18/dcc/cce 0 2024-09-20T18:36:08.348 INFO:tasks.workunit.client.0.smithi017.stdout:7/607: rename da/d16/d1c/d40/d3a/d8a/ca1 to da/d16/d1c/d40/d3a/d8a/cba 0 2024-09-20T18:36:08.353 INFO:tasks.workunit.client.0.smithi017.stdout:0/609: creat d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/fd1 x:0 0 0 2024-09-20T18:36:08.356 INFO:tasks.workunit.client.0.smithi017.stdout:5/609: mknod d0/d14/d18/d19/d4d/d6d/d78/d98/ccf 0 2024-09-20T18:36:08.357 INFO:tasks.workunit.client.0.smithi017.stdout:0/610: mkdir d4/d37/dd2 0 2024-09-20T18:36:08.372 INFO:tasks.workunit.client.0.smithi017.stdout:0/611: dread d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/f61 [0,4194304] 0 2024-09-20T18:36:08.375 INFO:tasks.workunit.client.0.smithi017.stdout:0/612: mkdir d4/dc8/dd3 0 2024-09-20T18:36:08.378 INFO:tasks.workunit.client.0.smithi017.stdout:5/610: dwrite d0/ff [0,4194304] 0 2024-09-20T18:36:08.380 INFO:tasks.workunit.client.0.smithi017.stdout:0/613: truncate d4/db/f3b 2669988 0 2024-09-20T18:36:08.385 INFO:tasks.workunit.client.0.smithi017.stdout:0/614: fdatasync d4/db/d18/d25/d36/d47/d81/f9b 0 2024-09-20T18:36:08.386 INFO:tasks.workunit.client.0.smithi017.stdout:5/611: dwrite d0/d14/d40/f63 [0,4194304] 0 2024-09-20T18:36:08.393 INFO:tasks.workunit.client.0.smithi017.stdout:5/612: symlink d0/d14/d18/ld0 0 2024-09-20T18:36:08.395 INFO:tasks.workunit.client.0.smithi017.stdout:5/613: chown d0/d14/d18/d19/d4d/d6d/d78/d99/fb8 79 1 2024-09-20T18:36:08.404 INFO:tasks.workunit.client.0.smithi017.stdout:5/614: rename d0/d14/d18/d19/d4d/d96 to d0/d14/d18/dd1 0 2024-09-20T18:36:08.410 INFO:tasks.workunit.client.0.smithi017.stdout:0/615: dwrite d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/f7b [0,4194304] 0 2024-09-20T18:36:08.414 INFO:tasks.workunit.client.0.smithi017.stdout:0/616: mknod d4/db/d18/d25/d36/d47/cd4 0 2024-09-20T18:36:08.423 INFO:tasks.workunit.client.0.smithi017.stdout:0/617: dwrite d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/f4b [0,4194304] 0 2024-09-20T18:36:08.424 INFO:tasks.workunit.client.0.smithi017.stdout:5/615: dread d0/d14/d18/d2a/d39/d42/d7e/f8d [0,4194304] 0 2024-09-20T18:36:08.428 INFO:tasks.workunit.client.0.smithi017.stdout:5/616: symlink d0/d14/d18/d19/d4d/d6d/db7/dc1/ld2 0 2024-09-20T18:36:08.430 INFO:tasks.workunit.client.0.smithi017.stdout:5/617: write d0/d14/d18/dd1/fcb [263012,19674] 0 2024-09-20T18:36:08.433 INFO:tasks.workunit.client.0.smithi017.stdout:0/618: write d4/db/d18/d25/d36/d47/f7e [815958,82878] 0 2024-09-20T18:36:08.434 INFO:tasks.workunit.client.0.smithi017.stdout:5/618: dread d0/d14/d18/d19/d4d/db5/dc0/f95 [0,4194304] 0 2024-09-20T18:36:08.436 INFO:tasks.workunit.client.0.smithi017.stdout:5/619: chown d0/d14/d18/d1b/l2d 117 1 2024-09-20T18:36:08.436 INFO:tasks.workunit.client.0.smithi017.stdout:0/619: rmdir d4/d20/d63/d86 39 2024-09-20T18:36:08.437 INFO:tasks.workunit.client.0.smithi017.stdout:0/620: write d4/d37/f6a [5203591,62180] 0 2024-09-20T18:36:08.440 INFO:tasks.workunit.client.0.smithi017.stdout:5/620: creat d0/d14/d18/d19/d4d/db5/fd3 x:0 0 0 2024-09-20T18:36:08.443 INFO:tasks.workunit.client.0.smithi017.stdout:0/621: mknod d4/db/d18/d78/cd5 0 2024-09-20T18:36:08.445 INFO:tasks.workunit.client.0.smithi017.stdout:5/621: mknod d0/d14/d18/dcc/cd4 0 2024-09-20T18:36:08.448 INFO:tasks.workunit.client.0.smithi017.stdout:5/622: symlink d0/d14/d18/d2a/d39/d42/d7e/ld5 0 2024-09-20T18:36:08.449 INFO:tasks.workunit.client.0.smithi017.stdout:0/622: truncate d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/f5f 27735 0 2024-09-20T18:36:08.450 INFO:tasks.workunit.client.0.smithi017.stdout:5/623: creat d0/d14/d18/dcc/fd6 x:0 0 0 2024-09-20T18:36:08.453 INFO:tasks.workunit.client.0.smithi017.stdout:5/624: fsync d0/d14/d18/d19/d4d/d6d/fa2 0 2024-09-20T18:36:08.457 INFO:tasks.workunit.client.0.smithi017.stdout:0/623: dwrite d4/db/dcd/d52/d77/daf/fc0 [0,4194304] 0 2024-09-20T18:36:08.460 INFO:tasks.workunit.client.0.smithi017.stdout:5/625: truncate d0/d14/d18/d2a/d39/f53 125190 0 2024-09-20T18:36:08.462 INFO:tasks.workunit.client.0.smithi017.stdout:5/626: truncate d0/d14/d18/f2f 5216967 0 2024-09-20T18:36:08.466 INFO:tasks.workunit.client.0.smithi017.stdout:5/627: mknod d0/d14/d18/d19/d4d/d6d/db7/dc1/cd7 0 2024-09-20T18:36:08.467 INFO:tasks.workunit.client.0.smithi017.stdout:5/628: fsync d0/d14/d18/d1b/f24 0 2024-09-20T18:36:08.530 INFO:tasks.workunit.client.0.smithi017.stdout:8/545: sync 2024-09-20T18:36:08.530 INFO:tasks.workunit.client.0.smithi017.stdout:1/575: sync 2024-09-20T18:36:08.578 INFO:tasks.workunit.client.0.smithi017.stdout:1/576: symlink df/d3b/lb5 0 2024-09-20T18:36:08.579 INFO:tasks.workunit.client.0.smithi017.stdout:1/577: chown df/d3b/d7c 3 1 2024-09-20T18:36:08.580 INFO:tasks.workunit.client.0.smithi017.stdout:1/578: fsync df/d35/d4f/d82/f99 0 2024-09-20T18:36:08.581 INFO:tasks.workunit.client.0.smithi017.stdout:8/546: mkdir d0/d65/d8b/db4 0 2024-09-20T18:36:08.589 INFO:tasks.workunit.client.0.smithi017.stdout:8/547: mkdir d0/d65/d8b/db5 0 2024-09-20T18:36:08.591 INFO:tasks.workunit.client.0.smithi017.stdout:5/629: truncate d0/d14/d18/d57/f7d 1474895 0 2024-09-20T18:36:08.595 INFO:tasks.workunit.client.0.smithi017.stdout:5/630: symlink d0/d14/d18/d2a/d39/d42/d7e/ld8 0 2024-09-20T18:36:08.600 INFO:tasks.workunit.client.0.smithi017.stdout:8/548: symlink d0/d6/d28/d3a/dae/lb6 0 2024-09-20T18:36:08.602 INFO:tasks.workunit.client.0.smithi017.stdout:5/631: dwrite d0/f7 [0,4194304] 0 2024-09-20T18:36:08.607 INFO:tasks.workunit.client.0.smithi017.stdout:8/549: chown d0/d6/l6b 12 1 2024-09-20T18:36:08.608 INFO:tasks.workunit.client.0.smithi017.stdout:5/632: write d0/d14/d18/d1b/fa6 [808835,90615] 0 2024-09-20T18:36:08.611 INFO:tasks.workunit.client.0.smithi017.stdout:1/579: dwrite df/d16/f63 [4194304,4194304] 0 2024-09-20T18:36:08.618 INFO:tasks.workunit.client.0.smithi017.stdout:8/550: dwrite d0/d6/d28/d3d/f60 [4194304,4194304] 0 2024-09-20T18:36:08.641 INFO:tasks.workunit.client.0.smithi017.stdout:5/633: truncate d0/d14/d18/d19/d4d/d6d/d78/f66 4098589 0 2024-09-20T18:36:08.641 INFO:tasks.workunit.client.0.smithi017.stdout:5/634: stat d0/l9 0 2024-09-20T18:36:08.643 INFO:tasks.workunit.client.0.smithi017.stdout:5/635: write d0/d14/d18/d19/d4d/db5/fd3 [103663,1382] 0 2024-09-20T18:36:08.646 INFO:tasks.workunit.client.0.smithi017.stdout:4/560: sync 2024-09-20T18:36:08.650 INFO:tasks.workunit.client.0.smithi017.stdout:5/636: rename d0/d14/d40 to d0/dd9 0 2024-09-20T18:36:08.653 INFO:tasks.workunit.client.0.smithi017.stdout:4/561: symlink d4/d19/d37/da1/lb6 0 2024-09-20T18:36:08.653 INFO:tasks.workunit.client.0.smithi017.stdout:8/551: dread d0/f5e [0,4194304] 0 2024-09-20T18:36:08.655 INFO:tasks.workunit.client.0.smithi017.stdout:5/637: mkdir d0/d14/d18/d19/dda 0 2024-09-20T18:36:08.657 INFO:tasks.workunit.client.0.smithi017.stdout:8/552: creat d0/d6/d28/d81/fb7 x:0 0 0 2024-09-20T18:36:08.664 INFO:tasks.workunit.client.0.smithi017.stdout:1/580: dread df/f11 [4194304,4194304] 0 2024-09-20T18:36:08.674 INFO:tasks.workunit.client.0.smithi017.stdout:4/562: write d4/d19/d37/da1/d1b/f45 [70624,52009] 0 2024-09-20T18:36:08.676 INFO:tasks.workunit.client.0.smithi017.stdout:5/638: write d0/d14/d18/d2a/d39/d6c/d72/f16 [249045,42256] 0 2024-09-20T18:36:08.705 INFO:tasks.workunit.client.0.smithi017.stdout:3/823: sync 2024-09-20T18:36:08.706 INFO:tasks.workunit.client.0.smithi017.stdout:7/608: sync 2024-09-20T18:36:08.706 INFO:tasks.workunit.client.0.smithi017.stdout:0/624: sync 2024-09-20T18:36:08.706 INFO:tasks.workunit.client.0.smithi017.stdout:9/860: sync 2024-09-20T18:36:08.706 INFO:tasks.workunit.client.0.smithi017.stdout:2/823: sync 2024-09-20T18:36:08.706 INFO:tasks.workunit.client.0.smithi017.stdout:6/671: sync 2024-09-20T18:36:08.709 INFO:tasks.workunit.client.0.smithi017.stdout:3/824: stat da/de/d13/d2f/d26/d62/da5/da9/cac 0 2024-09-20T18:36:08.711 INFO:tasks.workunit.client.0.smithi017.stdout:3/825: chown da/de/d13/d2f/d26/d31/d5a/d76/d19/ce3 0 1 2024-09-20T18:36:08.715 INFO:tasks.workunit.client.0.smithi017.stdout:9/861: dwrite d6/d23/d3a/d61/de7/f86 [0,4194304] 0 2024-09-20T18:36:08.733 INFO:tasks.workunit.client.0.smithi017.stdout:0/625: fsync d4/db/dcd/d52/f57 0 2024-09-20T18:36:08.735 INFO:tasks.workunit.client.0.smithi017.stdout:5/639: dwrite d0/d14/d18/d19/d4d/db5/dc0/f95 [0,4194304] 0 2024-09-20T18:36:08.737 INFO:tasks.workunit.client.0.smithi017.stdout:2/824: creat d1/dc/d20/d2e/d30/d85/d53/f110 x:0 0 0 2024-09-20T18:36:08.739 INFO:tasks.workunit.client.0.smithi017.stdout:3/826: creat da/de/d13/d2f/d26/d31/d5a/d76/de6/f112 x:0 0 0 2024-09-20T18:36:08.741 INFO:tasks.workunit.client.0.smithi017.stdout:9/862: read d6/d23/d58/d3f/d70/fb2 [656838,61970] 0 2024-09-20T18:36:08.753 INFO:tasks.workunit.client.0.smithi017.stdout:6/672: mkdir d4/d29/dc6/de7 0 2024-09-20T18:36:08.759 INFO:tasks.workunit.client.0.smithi017.stdout:9/863: dread d6/d23/d3a/f7b [0,4194304] 0 2024-09-20T18:36:08.761 INFO:tasks.workunit.client.0.smithi017.stdout:0/626: creat d4/db/d18/d78/fd6 x:0 0 0 2024-09-20T18:36:08.761 INFO:tasks.workunit.client.0.smithi017.stdout:0/627: fdatasync d4/db/f12 0 2024-09-20T18:36:08.763 INFO:tasks.workunit.client.0.smithi017.stdout:0/628: chown d4/db/d18/f8d 6 1 2024-09-20T18:36:08.763 INFO:tasks.workunit.client.0.smithi017.stdout:2/825: symlink d1/d67/d8f/d9e/l111 0 2024-09-20T18:36:08.765 INFO:tasks.workunit.client.0.smithi017.stdout:1/581: creat df/d16/fb6 x:0 0 0 2024-09-20T18:36:08.766 INFO:tasks.workunit.client.0.smithi017.stdout:1/582: fdatasync df/d1c/f75 0 2024-09-20T18:36:08.767 INFO:tasks.workunit.client.0.smithi017.stdout:9/864: mkdir d6/d23/d58/dda/d137 0 2024-09-20T18:36:08.768 INFO:tasks.workunit.client.0.smithi017.stdout:5/640: truncate d0/d14/d18/f38 4571410 0 2024-09-20T18:36:08.769 INFO:tasks.workunit.client.0.smithi017.stdout:3/827: mkdir da/def/d113 0 2024-09-20T18:36:08.770 INFO:tasks.workunit.client.0.smithi017.stdout:2/826: symlink d1/dc/d20/d2e/d30/d85/d98/l112 0 2024-09-20T18:36:08.773 INFO:tasks.workunit.client.0.smithi017.stdout:0/629: rename d4/db/d18/d25/d36/d47/d81/lc9 to d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/ld7 0 2024-09-20T18:36:08.774 INFO:tasks.workunit.client.0.smithi017.stdout:1/583: creat df/d8f/fb7 x:0 0 0 2024-09-20T18:36:08.775 INFO:tasks.workunit.client.0.smithi017.stdout:1/584: chown ce 3 1 2024-09-20T18:36:08.775 INFO:tasks.workunit.client.0.smithi017.stdout:9/865: fdatasync d6/d23/d3a/d61/de7/f56 0 2024-09-20T18:36:08.776 INFO:tasks.workunit.client.0.smithi017.stdout:1/585: stat df/d29/d2c 0 2024-09-20T18:36:08.778 INFO:tasks.workunit.client.0.smithi017.stdout:2/827: creat d1/dc/d20/d2e/d30/d85/d53/d96/f113 x:0 0 0 2024-09-20T18:36:08.779 INFO:tasks.workunit.client.0.smithi017.stdout:6/673: link d4/d37/d68/dbb/fb5 d4/df/d4a/d8f/fe8 0 2024-09-20T18:36:08.783 INFO:tasks.workunit.client.0.smithi017.stdout:5/641: mknod d0/d14/d18/d19/d4d/d6d/dbf/cdb 0 2024-09-20T18:36:08.783 INFO:tasks.workunit.client.0.smithi017.stdout:9/866: dwrite d6/d23/d58/d3f/d70/dfe/d10b/f4f [0,4194304] 0 2024-09-20T18:36:08.785 INFO:tasks.workunit.client.0.smithi017.stdout:3/828: creat da/de/d13/d2f/d92/dc8/f114 x:0 0 0 2024-09-20T18:36:08.785 INFO:tasks.workunit.client.0.smithi017.stdout:5/642: read d0/d14/d18/d1b/f24 [61159,19691] 0 2024-09-20T18:36:08.787 INFO:tasks.workunit.client.0.smithi017.stdout:6/674: rmdir d4/df/d4a/d8f 39 2024-09-20T18:36:08.787 INFO:tasks.workunit.client.0.smithi017.stdout:3/829: write da/de/d13/d2f/d26/fd6 [620323,73737] 0 2024-09-20T18:36:08.795 INFO:tasks.workunit.client.0.smithi017.stdout:3/830: mkdir da/de/d13/d2f/d26/d31/d5a/d76/de6/d115 0 2024-09-20T18:36:08.799 INFO:tasks.workunit.client.0.smithi017.stdout:8/553: write d0/d6/d28/f8c [972527,34327] 0 2024-09-20T18:36:08.799 INFO:tasks.workunit.client.0.smithi017.stdout:4/563: write d4/dc/d1e/f51 [967064,78255] 0 2024-09-20T18:36:08.800 INFO:tasks.workunit.client.0.smithi017.stdout:7/609: write da/d16/d8e/d75/f89 [740110,99467] 0 2024-09-20T18:36:08.805 INFO:tasks.workunit.client.0.smithi017.stdout:9/867: dread d6/d23/d40/db4/dba/f8c [0,4194304] 0 2024-09-20T18:36:08.809 INFO:tasks.workunit.client.0.smithi017.stdout:8/554: dwrite d0/d6/d28/d3d/d4e/f51 [4194304,4194304] 0 2024-09-20T18:36:08.812 INFO:tasks.workunit.client.0.smithi017.stdout:4/564: creat d4/d19/d62/fb7 x:0 0 0 2024-09-20T18:36:08.813 INFO:tasks.workunit.client.0.smithi017.stdout:4/565: stat d4/d82/d88/d5c/d8f/da9/db4/db5 0 2024-09-20T18:36:08.815 INFO:tasks.workunit.client.0.smithi017.stdout:1/586: dread df/d1c/f70 [4194304,4194304] 0 2024-09-20T18:36:08.819 INFO:tasks.workunit.client.0.smithi017.stdout:8/555: rename d0/d6/d28/l37 to d0/d6/d28/d81/d9c/lb8 0 2024-09-20T18:36:08.820 INFO:tasks.workunit.client.0.smithi017.stdout:4/566: creat d4/dc/d1e/d26/fb8 x:0 0 0 2024-09-20T18:36:08.823 INFO:tasks.workunit.client.0.smithi017.stdout:7/610: dread da/d16/d1c/f1d [0,4194304] 0 2024-09-20T18:36:08.828 INFO:tasks.workunit.client.0.smithi017.stdout:4/567: mkdir d4/d19/d37/da1/d1b/d56/d67/db9 0 2024-09-20T18:36:08.830 INFO:tasks.workunit.client.0.smithi017.stdout:8/556: mknod d0/d65/d8b/db5/cb9 0 2024-09-20T18:36:08.831 INFO:tasks.workunit.client.0.smithi017.stdout:1/587: dread df/d1c/f70 [0,4194304] 0 2024-09-20T18:36:08.832 INFO:tasks.workunit.client.0.smithi017.stdout:9/868: getdents d6/d23/d58/d3f/d4d/d100 0 2024-09-20T18:36:08.836 INFO:tasks.workunit.client.0.smithi017.stdout:0/630: dwrite d4/db/f2c [4194304,4194304] 0 2024-09-20T18:36:08.837 INFO:tasks.workunit.client.0.smithi017.stdout:6/675: truncate d4/df/d1f/f80 2261067 0 2024-09-20T18:36:08.838 INFO:tasks.workunit.client.0.smithi017.stdout:3/831: write da/de/d13/d2f/d26/d31/d5a/d76/f6a [1938075,127862] 0 2024-09-20T18:36:08.844 INFO:tasks.workunit.client.0.smithi017.stdout:4/568: rename d4/dc/d1e/c39 to d4/d82/d88/d5c/d8f/da9/db4/cba 0 2024-09-20T18:36:08.848 INFO:tasks.workunit.client.0.smithi017.stdout:6/676: write d4/df/d1f/d25/d3f/d5c/f6d [420554,16266] 0 2024-09-20T18:36:08.849 INFO:tasks.workunit.client.0.smithi017.stdout:0/631: fsync d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/fd1 0 2024-09-20T18:36:08.850 INFO:tasks.workunit.client.0.smithi017.stdout:5/643: dwrite d0/dd9/f6a [0,4194304] 0 2024-09-20T18:36:08.850 INFO:tasks.workunit.client.0.smithi017.stdout:4/569: fsync d4/d19/d37/da1/d1b/f58 0 2024-09-20T18:36:08.855 INFO:tasks.workunit.client.0.smithi017.stdout:0/632: chown d4/ccf 125835 1 2024-09-20T18:36:08.856 INFO:tasks.workunit.client.0.smithi017.stdout:9/869: dwrite d6/d23/f50 [0,4194304] 0 2024-09-20T18:36:08.856 INFO:tasks.workunit.client.0.smithi017.stdout:5/644: read d0/d14/d18/f5a [1109094,106408] 0 2024-09-20T18:36:08.857 INFO:tasks.workunit.client.0.smithi017.stdout:8/557: dwrite d0/d6/d28/d3d/d4e/d55/d83/f9f [0,4194304] 0 2024-09-20T18:36:08.860 INFO:tasks.workunit.client.0.smithi017.stdout:8/558: chown d0/d6/d93/faf 3128 1 2024-09-20T18:36:08.867 INFO:tasks.workunit.client.0.smithi017.stdout:1/588: truncate df/f26 278228 0 2024-09-20T18:36:08.868 INFO:tasks.workunit.client.0.smithi017.stdout:4/570: mknod d4/dc/d1e/d69/d79/cbb 0 2024-09-20T18:36:08.869 INFO:tasks.workunit.client.0.smithi017.stdout:3/832: mkdir da/def/d113/d116 0 2024-09-20T18:36:08.873 INFO:tasks.workunit.client.0.smithi017.stdout:5/645: mkdir d0/dbe/ddc 0 2024-09-20T18:36:08.873 INFO:tasks.workunit.client.0.smithi017.stdout:9/870: rmdir d6/d23/d40/de2 39 2024-09-20T18:36:08.873 INFO:tasks.workunit.client.0.smithi017.stdout:1/589: dread df/d29/d2c/f65 [0,4194304] 0 2024-09-20T18:36:08.874 INFO:tasks.workunit.client.0.smithi017.stdout:0/633: creat d4/db/d18/d25/fd8 x:0 0 0 2024-09-20T18:36:08.881 INFO:tasks.workunit.client.0.smithi017.stdout:3/833: rmdir da/de/d13/d2f/d26/d41 39 2024-09-20T18:36:08.885 INFO:tasks.workunit.client.0.smithi017.stdout:0/634: creat d4/db/d18/d55/fd9 x:0 0 0 2024-09-20T18:36:08.889 INFO:tasks.workunit.client.0.smithi017.stdout:9/871: mkdir d6/d23/d58/d3f/d2f/d138 0 2024-09-20T18:36:08.890 INFO:tasks.workunit.client.0.smithi017.stdout:8/559: creat d0/d6/fba x:0 0 0 2024-09-20T18:36:08.893 INFO:tasks.workunit.client.0.smithi017.stdout:4/571: rename d4/dc/d1e/d69 to d4/d19/d37/dbc 0 2024-09-20T18:36:08.895 INFO:tasks.workunit.client.0.smithi017.stdout:0/635: truncate d4/d20/f2a 4125531 0 2024-09-20T18:36:08.897 INFO:tasks.workunit.client.0.smithi017.stdout:0/636: fsync d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d94/fa8 0 2024-09-20T18:36:08.898 INFO:tasks.workunit.client.0.smithi017.stdout:0/637: chown d4/d37 9 1 2024-09-20T18:36:08.898 INFO:tasks.workunit.client.0.smithi017.stdout:8/560: fsync d0/f2 0 2024-09-20T18:36:08.900 INFO:tasks.workunit.client.0.smithi017.stdout:8/561: chown d0/d65/d8b/d91/fa5 61410919 1 2024-09-20T18:36:08.901 INFO:tasks.workunit.client.0.smithi017.stdout:5/646: rename d0/d14/d18/d2a/d39/d42/l58 to d0/d14/d18/d2a/da1/ldd 0 2024-09-20T18:36:08.903 INFO:tasks.workunit.client.0.smithi017.stdout:4/572: creat d4/dc/d41/fbd x:0 0 0 2024-09-20T18:36:08.906 INFO:tasks.workunit.client.0.smithi017.stdout:9/872: fsync d6/d23/d40/db4/dba/f8d 0 2024-09-20T18:36:08.906 INFO:tasks.workunit.client.0.smithi017.stdout:6/677: dwrite d4/fd8 [0,4194304] 0 2024-09-20T18:36:08.912 INFO:tasks.workunit.client.0.smithi017.stdout:9/873: readlink d6/d23/d3a/l11b 0 2024-09-20T18:36:08.913 INFO:tasks.workunit.client.0.smithi017.stdout:6/678: write d4/df/d4a/fde [3046616,99940] 0 2024-09-20T18:36:08.913 INFO:tasks.workunit.client.0.smithi017.stdout:3/834: rename da/de/d53/fa4 to da/de/d13/d16/d6e/d82/df8/f117 0 2024-09-20T18:36:08.915 INFO:tasks.workunit.client.0.smithi017.stdout:8/562: dwrite d0/d6/d28/f5a [0,4194304] 0 2024-09-20T18:36:08.919 INFO:tasks.workunit.client.0.smithi017.stdout:4/573: chown d4/dc/f9c 40 1 2024-09-20T18:36:08.920 INFO:tasks.workunit.client.0.smithi017.stdout:6/679: truncate d4/f8 4908489 0 2024-09-20T18:36:08.920 INFO:tasks.workunit.client.0.smithi017.stdout:1/590: dwrite df/d16/d50/f83 [4194304,4194304] 0 2024-09-20T18:36:08.923 INFO:tasks.workunit.client.0.smithi017.stdout:5/647: rmdir d0/d14/d18/d19/d4d/d6d/db7/dc1 39 2024-09-20T18:36:08.928 INFO:tasks.workunit.client.0.smithi017.stdout:9/874: truncate d6/dc1/ff3 109655 0 2024-09-20T18:36:08.928 INFO:tasks.workunit.client.0.smithi017.stdout:9/875: chown d6/d11/dbb 466 1 2024-09-20T18:36:08.930 INFO:tasks.workunit.client.0.smithi017.stdout:3/835: creat da/de/d53/d88/db3/f118 x:0 0 0 2024-09-20T18:36:08.931 INFO:tasks.workunit.client.0.smithi017.stdout:3/836: stat da/de/d13/fc4 0 2024-09-20T18:36:08.937 INFO:tasks.workunit.client.0.smithi017.stdout:9/876: dwrite d6/d23/d40/db4/dba/dd7/f108 [4194304,4194304] 0 2024-09-20T18:36:08.939 INFO:tasks.workunit.client.0.smithi017.stdout:8/563: write d0/d6/d28/d3d/d4e/f75 [3528669,121764] 0 2024-09-20T18:36:08.941 INFO:tasks.workunit.client.0.smithi017.stdout:6/680: fdatasync d4/d37/d68/dbb/fb6 0 2024-09-20T18:36:08.944 INFO:tasks.workunit.client.0.smithi017.stdout:1/591: mknod df/d1c/d80/da0/cb8 0 2024-09-20T18:36:08.944 INFO:tasks.workunit.client.0.smithi017.stdout:4/574: rmdir d4/d19/d37/da1/d1b/daa 39 2024-09-20T18:36:08.946 INFO:tasks.workunit.client.0.smithi017.stdout:4/575: dread d4/dc/d1e/d26/f6a [0,4194304] 0 2024-09-20T18:36:08.948 INFO:tasks.workunit.client.0.smithi017.stdout:8/564: dread d0/d6/d28/d3d/d4e/d55/d83/f9f [0,4194304] 0 2024-09-20T18:36:08.951 INFO:tasks.workunit.client.0.smithi017.stdout:9/877: mkdir d6/d23/d58/d3f/d4d/d73/d7d/d139 0 2024-09-20T18:36:08.954 INFO:tasks.workunit.client.0.smithi017.stdout:0/638: dwrite d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/f80 [0,4194304] 0 2024-09-20T18:36:08.956 INFO:tasks.workunit.client.0.smithi017.stdout:6/681: rmdir d4/d37/d68/d8d/db2/dd4 39 2024-09-20T18:36:08.957 INFO:tasks.workunit.client.0.smithi017.stdout:0/639: fsync d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/d95/fc3 0 2024-09-20T18:36:08.960 INFO:tasks.workunit.client.0.smithi017.stdout:1/592: creat df/d29/d2c/d5b/fb9 x:0 0 0 2024-09-20T18:36:08.961 INFO:tasks.workunit.client.0.smithi017.stdout:1/593: fdatasync df/f5a 0 2024-09-20T18:36:08.962 INFO:tasks.workunit.client.0.smithi017.stdout:4/576: symlink d4/d19/d37/lbe 0 2024-09-20T18:36:08.963 INFO:tasks.workunit.client.0.smithi017.stdout:4/577: read - d4/dc/d1e/d26/fad zero size 2024-09-20T18:36:08.965 INFO:tasks.workunit.client.0.smithi017.stdout:3/837: mknod da/de/c119 0 2024-09-20T18:36:08.966 INFO:tasks.workunit.client.0.smithi017.stdout:8/565: mknod d0/d6/d28/d81/d9c/cbb 0 2024-09-20T18:36:08.968 INFO:tasks.workunit.client.0.smithi017.stdout:5/648: dread d0/d14/d18/d57/f7d [0,4194304] 0 2024-09-20T18:36:08.971 INFO:tasks.workunit.client.0.smithi017.stdout:5/649: truncate d0/d14/f28 18595958 0 2024-09-20T18:36:08.971 INFO:tasks.workunit.client.0.smithi017.stdout:9/878: creat d6/d23/d3a/d61/de7/f13a x:0 0 0 2024-09-20T18:36:08.976 INFO:tasks.workunit.client.0.smithi017.stdout:5/650: dread d0/dd9/f63 [0,4194304] 0 2024-09-20T18:36:08.978 INFO:tasks.workunit.client.0.smithi017.stdout:5/651: dread - d0/d14/d18/d19/d4d/f84 zero size 2024-09-20T18:36:08.978 INFO:tasks.workunit.client.0.smithi017.stdout:1/594: fsync df/f24 0 2024-09-20T18:36:08.979 INFO:tasks.workunit.client.0.smithi017.stdout:4/578: dread - d4/d19/d37/dbc/f87 zero size 2024-09-20T18:36:08.980 INFO:tasks.workunit.client.0.smithi017.stdout:8/566: mkdir d0/d65/d8b/db5/dbc 0 2024-09-20T18:36:08.982 INFO:tasks.workunit.client.0.smithi017.stdout:4/579: chown d4/d19/d37/da1/d1b/d56/d67/f76 7705003 1 2024-09-20T18:36:08.984 INFO:tasks.workunit.client.0.smithi017.stdout:3/838: dread da/de/d13/d2f/d26/d31/fee [0,4194304] 0 2024-09-20T18:36:08.986 INFO:tasks.workunit.client.0.smithi017.stdout:6/682: symlink d4/le9 0 2024-09-20T18:36:08.987 INFO:tasks.workunit.client.0.smithi017.stdout:3/839: write da/de/d13/d2f/d26/d31/d5a/d76/f6a [5023765,123243] 0 2024-09-20T18:36:08.991 INFO:tasks.workunit.client.0.smithi017.stdout:3/840: truncate da/de/d13/d2f/d26/d62/ff6 709103 0 2024-09-20T18:36:08.991 INFO:tasks.workunit.client.0.smithi017.stdout:0/640: write d4/db/d18/d25/d36/d47/d8c/daa/fbc [1285340,57165] 0 2024-09-20T18:36:08.995 INFO:tasks.workunit.client.0.smithi017.stdout:6/683: dwrite d4/d37/d41/d43/d7d/f88 [4194304,4194304] 0 2024-09-20T18:36:08.995 INFO:tasks.workunit.client.0.smithi017.stdout:4/580: write d4/f38 [2126998,9117] 0 2024-09-20T18:36:08.997 INFO:tasks.workunit.client.0.smithi017.stdout:3/841: chown da/de/d13/d2f/d26/d31/d5a/d76/d19/f9c 1 1 2024-09-20T18:36:08.998 INFO:tasks.workunit.client.0.smithi017.stdout:0/641: read d4/d20/f2e [2004455,130337] 0 2024-09-20T18:36:08.998 INFO:tasks.workunit.client.0.smithi017.stdout:4/581: readlink d4/dc/d1e/l24 0 2024-09-20T18:36:09.002 INFO:tasks.workunit.client.0.smithi017.stdout:9/879: write d6/d23/d58/d3f/d70/dfe/d10b/fe4 [117988,63352] 0 2024-09-20T18:36:09.006 INFO:tasks.workunit.client.0.smithi017.stdout:6/684: creat d4/d37/d68/dbb/fea x:0 0 0 2024-09-20T18:36:09.008 INFO:tasks.workunit.client.0.smithi017.stdout:5/652: link d0/d14/l91 d0/d14/d18/d79/d9e/lde 0 2024-09-20T18:36:09.010 INFO:tasks.workunit.client.0.smithi017.stdout:1/595: link df/d16/d50/d69/l8b df/d3b/lba 0 2024-09-20T18:36:09.014 INFO:tasks.workunit.client.0.smithi017.stdout:1/596: fdatasync df/d1c/f75 0 2024-09-20T18:36:09.015 INFO:tasks.workunit.client.0.smithi017.stdout:4/582: dwrite d4/d19/d37/da1/f59 [0,4194304] 0 2024-09-20T18:36:09.015 INFO:tasks.workunit.client.0.smithi017.stdout:3/842: getdents da/de/d53/d88/db3 0 2024-09-20T18:36:09.017 INFO:tasks.workunit.client.0.smithi017.stdout:0/642: dwrite d4/fa [0,4194304] 0 2024-09-20T18:36:09.019 INFO:tasks.workunit.client.0.smithi017.stdout:1/597: read df/d3b/f9a [408144,15193] 0 2024-09-20T18:36:09.027 INFO:tasks.workunit.client.0.smithi017.stdout:5/653: symlink d0/d14/d18/ldf 0 2024-09-20T18:36:09.029 INFO:tasks.workunit.client.0.smithi017.stdout:3/843: fsync da/de/d13/d16/d50/fe2 0 2024-09-20T18:36:09.030 INFO:tasks.workunit.client.0.smithi017.stdout:5/654: read d0/d14/d18/d1b/fa6 [142610,107596] 0 2024-09-20T18:36:09.032 INFO:tasks.workunit.client.0.smithi017.stdout:3/844: truncate da/de/d13/d16/d50/d102/f104 618548 0 2024-09-20T18:36:09.033 INFO:tasks.workunit.client.0.smithi017.stdout:5/655: chown d0/cac 282941535 1 2024-09-20T18:36:09.043 INFO:tasks.workunit.client.0.smithi017.stdout:6/685: dwrite d4/d37/d68/da4/d9e/fbc [0,4194304] 0 2024-09-20T18:36:09.051 INFO:tasks.workunit.client.0.smithi017.stdout:3/845: dread da/de/d13/d16/d6e/d97/fa6 [0,4194304] 0 2024-09-20T18:36:09.051 INFO:tasks.workunit.client.0.smithi017.stdout:0/643: dwrite d4/db/d18/d25/f7d [0,4194304] 0 2024-09-20T18:36:09.139 INFO:tasks.workunit.client.0.smithi017.stdout:5/656: unlink d0/d14/d18/d2a/d39/d42/l48 0 2024-09-20T18:36:09.140 INFO:tasks.workunit.client.0.smithi017.stdout:1/598: creat df/d16/d50/dab/fbb x:0 0 0 2024-09-20T18:36:09.141 INFO:tasks.workunit.client.0.smithi017.stdout:1/599: write df/d3b/f9a [2398466,32062] 0 2024-09-20T18:36:09.142 INFO:tasks.workunit.client.0.smithi017.stdout:9/880: link d6/d23/d58/d3f/d4d/d73/d7d/cdf d6/d23/d58/d3f/d4d/d73/d7d/d12e/c13b 0 2024-09-20T18:36:09.147 INFO:tasks.workunit.client.0.smithi017.stdout:1/600: dwrite df/d35/d4f/d82/f99 [0,4194304] 0 2024-09-20T18:36:09.149 INFO:tasks.workunit.client.0.smithi017.stdout:4/583: link d4/d19/d37/da1/d1b/f45 d4/d19/d37/da1/d1b/fbf 0 2024-09-20T18:36:09.156 INFO:tasks.workunit.client.0.smithi017.stdout:1/601: dwrite df/d16/f63 [8388608,4194304] 0 2024-09-20T18:36:09.165 INFO:tasks.workunit.client.0.smithi017.stdout:5/657: write d0/d14/d18/d1b/f5c [926563,60068] 0 2024-09-20T18:36:09.167 INFO:tasks.workunit.client.0.smithi017.stdout:9/881: write d6/d23/d58/d3f/d70/fb2 [2894991,19677] 0 2024-09-20T18:36:09.170 INFO:tasks.workunit.client.0.smithi017.stdout:1/602: creat df/d8f/fbc x:0 0 0 2024-09-20T18:36:09.171 INFO:tasks.workunit.client.0.smithi017.stdout:1/603: write df/d16/d50/d69/d97/fad [486904,111594] 0 2024-09-20T18:36:09.172 INFO:tasks.workunit.client.0.smithi017.stdout:1/604: truncate df/d1c/f93 823554 0 2024-09-20T18:36:09.172 INFO:tasks.workunit.client.0.smithi017.stdout:0/644: write d4/db/dcd/d52/d77/f8a [963005,73320] 0 2024-09-20T18:36:09.175 INFO:tasks.workunit.client.0.smithi017.stdout:5/658: creat d0/d14/d18/dcc/fe0 x:0 0 0 2024-09-20T18:36:09.176 INFO:tasks.workunit.client.0.smithi017.stdout:3/846: rename da/de/d13/d2f/d26/d62/da5/da9/dbb/ld4 to da/de/d53/l11a 0 2024-09-20T18:36:09.178 INFO:tasks.workunit.client.0.smithi017.stdout:3/847: stat da/de/d13/d2f/d26/d62/da5/da9/dbb/df4 0 2024-09-20T18:36:09.179 INFO:tasks.workunit.client.0.smithi017.stdout:9/882: creat d6/d23/d58/d3f/d4d/d100/f13c x:0 0 0 2024-09-20T18:36:09.182 INFO:tasks.workunit.client.0.smithi017.stdout:1/605: chown df/d35/d6b/fa9 19546 1 2024-09-20T18:36:09.184 INFO:tasks.workunit.client.0.smithi017.stdout:3/848: write da/de/d13/d2f/d26/d31/f9a [490586,53514] 0 2024-09-20T18:36:09.184 INFO:tasks.workunit.client.0.smithi017.stdout:4/584: getdents d4/d82 0 2024-09-20T18:36:09.187 INFO:tasks.workunit.client.0.smithi017.stdout:9/883: truncate d6/fbf 2856410 0 2024-09-20T18:36:09.188 INFO:tasks.workunit.client.0.smithi017.stdout:5/659: mkdir d0/d14/d18/d2a/d39/de1 0 2024-09-20T18:36:09.190 INFO:tasks.workunit.client.0.smithi017.stdout:1/606: write df/d16/d50/d53/f67 [3749530,89730] 0 2024-09-20T18:36:09.190 INFO:tasks.workunit.client.0.smithi017.stdout:4/585: mknod d4/d19/d37/dbc/d7a/cc0 0 2024-09-20T18:36:09.191 INFO:tasks.workunit.client.0.smithi017.stdout:1/607: chown c7 736612 1 2024-09-20T18:36:09.193 INFO:tasks.workunit.client.0.smithi017.stdout:3/849: readlink da/de/d13/d2f/d26/d41/l90 0 2024-09-20T18:36:09.194 INFO:tasks.workunit.client.0.smithi017.stdout:1/608: write df/d16/d50/d53/fb0 [1012160,45652] 0 2024-09-20T18:36:09.197 INFO:tasks.workunit.client.0.smithi017.stdout:3/850: fdatasync da/de/d53/d52/f107 0 2024-09-20T18:36:09.198 INFO:tasks.workunit.client.0.smithi017.stdout:5/660: symlink d0/d14/d18/d2a/d39/le2 0 2024-09-20T18:36:09.202 INFO:tasks.workunit.client.0.smithi017.stdout:4/586: dwrite d4/d19/d62/f9e [0,4194304] 0 2024-09-20T18:36:09.202 INFO:tasks.workunit.client.0.smithi017.stdout:1/609: unlink df/d16/d50/d69/d97/fad 0 2024-09-20T18:36:09.205 INFO:tasks.workunit.client.0.smithi017.stdout:9/884: dwrite d6/d23/d58/d3f/f7f [0,4194304] 0 2024-09-20T18:36:09.207 INFO:tasks.workunit.client.0.smithi017.stdout:4/587: read d4/d19/d37/da1/d1b/fbf [2742539,110276] 0 2024-09-20T18:36:09.218 INFO:tasks.workunit.client.0.smithi017.stdout:4/588: creat d4/d82/d88/d5c/d8f/fc1 x:0 0 0 2024-09-20T18:36:09.221 INFO:tasks.workunit.client.0.smithi017.stdout:9/885: unlink d6/d23/d58/d3f/d70/db0/dca/d107/c122 0 2024-09-20T18:36:09.225 INFO:tasks.workunit.client.0.smithi017.stdout:3/851: write da/de/d13/d2f/d26/d31/d5a/fbd [66764,53986] 0 2024-09-20T18:36:09.226 INFO:tasks.workunit.client.0.smithi017.stdout:4/589: mkdir d4/d7f/dc2 0 2024-09-20T18:36:09.229 INFO:tasks.workunit.client.0.smithi017.stdout:5/661: write d0/d14/d18/d19/d4d/d6d/d78/f77 [1406303,121672] 0 2024-09-20T18:36:09.231 INFO:tasks.workunit.client.0.smithi017.stdout:9/886: unlink d6/d23/d58/d3f/d2f/d98/lae 0 2024-09-20T18:36:09.235 INFO:tasks.workunit.client.0.smithi017.stdout:5/662: chown d0/d14/d18/d19/d4d/d6d/d78/d99/fb3 0 1 2024-09-20T18:36:09.237 INFO:tasks.workunit.client.0.smithi017.stdout:4/590: link d4/d19/d37/dbc/d7a/cc0 d4/d82/d88/d5c/d8f/da9/db4/cc3 0 2024-09-20T18:36:09.237 INFO:tasks.workunit.client.0.smithi017.stdout:3/852: dwrite da/de/d13/d16/d6e/d97/df1/f10c [0,4194304] 0 2024-09-20T18:36:09.242 INFO:tasks.workunit.client.0.smithi017.stdout:3/853: write da/de/d13/d16/d6e/fd1 [379696,64750] 0 2024-09-20T18:36:09.243 INFO:tasks.workunit.client.0.smithi017.stdout:1/610: dwrite df/d1c/f1e [0,4194304] 0 2024-09-20T18:36:09.247 INFO:tasks.workunit.client.0.smithi017.stdout:4/591: creat d4/d19/d37/d66/fc4 x:0 0 0 2024-09-20T18:36:09.250 INFO:tasks.workunit.client.0.smithi017.stdout:9/887: rename d6/d23/d58/d3f/d2f/f95 to d6/d23/d40/de2/f13d 0 2024-09-20T18:36:09.252 INFO:tasks.workunit.client.0.smithi017.stdout:3/854: read - da/de/d13/d2f/d26/d31/d5a/d76/de6/fe8 zero size 2024-09-20T18:36:09.256 INFO:tasks.workunit.client.0.smithi017.stdout:4/592: symlink d4/d19/d37/dbc/d7a/lc5 0 2024-09-20T18:36:09.256 INFO:tasks.workunit.client.0.smithi017.stdout:1/611: dread df/d1c/f3c [0,4194304] 0 2024-09-20T18:36:09.274 INFO:tasks.workunit.client.0.smithi017.stdout:5/663: dwrite d0/d14/d18/d1b/f26 [0,4194304] 0 2024-09-20T18:36:09.278 INFO:tasks.workunit.client.0.smithi017.stdout:1/612: symlink df/d29/d7e/lbd 0 2024-09-20T18:36:09.280 INFO:tasks.workunit.client.0.smithi017.stdout:9/888: mknod d6/d23/d58/d3f/d70/c13e 0 2024-09-20T18:36:09.281 INFO:tasks.workunit.client.0.smithi017.stdout:9/889: dread - d6/d23/d3a/d61/de7/f4c zero size 2024-09-20T18:36:09.285 INFO:tasks.workunit.client.0.smithi017.stdout:5/664: creat d0/d14/d18/d19/d4d/d6d/dbf/fe3 x:0 0 0 2024-09-20T18:36:09.285 INFO:tasks.workunit.client.0.smithi017.stdout:4/593: mknod d4/dc/d1e/d8e/cc6 0 2024-09-20T18:36:09.288 INFO:tasks.workunit.client.0.smithi017.stdout:9/890: rmdir d6/d23/d40/de2/df5 39 2024-09-20T18:36:09.292 INFO:tasks.workunit.client.0.smithi017.stdout:3/855: dwrite da/de/d13/f67 [0,4194304] 0 2024-09-20T18:36:09.292 INFO:tasks.workunit.client.0.smithi017.stdout:1/613: rename df/d35/d4f/l54 to df/d8f/lbe 0 2024-09-20T18:36:09.295 INFO:tasks.workunit.client.0.smithi017.stdout:5/665: truncate d0/d14/d18/d57/f4e 5505635 0 2024-09-20T18:36:09.296 INFO:tasks.workunit.client.0.smithi017.stdout:1/614: dread - df/d8f/fbc zero size 2024-09-20T18:36:09.299 INFO:tasks.workunit.client.0.smithi017.stdout:1/615: readlink df/d3b/lba 0 2024-09-20T18:36:09.299 INFO:tasks.workunit.client.0.smithi017.stdout:4/594: dwrite d4/d82/d88/f36 [0,4194304] 0 2024-09-20T18:36:09.303 INFO:tasks.workunit.client.0.smithi017.stdout:3/856: creat da/de/d13/d2f/d26/d31/d5a/f11b x:0 0 0 2024-09-20T18:36:09.305 INFO:tasks.workunit.client.0.smithi017.stdout:5/666: rmdir d0/d14/d18/d19/d4d/d6d/dbf 39 2024-09-20T18:36:09.306 INFO:tasks.workunit.client.0.smithi017.stdout:3/857: chown da/de/d53/d52/f63 50512311 1 2024-09-20T18:36:09.311 INFO:tasks.workunit.client.0.smithi017.stdout:1/616: dread df/d16/f63 [4194304,4194304] 0 2024-09-20T18:36:09.311 INFO:tasks.workunit.client.0.smithi017.stdout:4/595: dwrite d4/d82/d88/f9b [4194304,4194304] 0 2024-09-20T18:36:09.318 INFO:tasks.workunit.client.0.smithi017.stdout:3/858: mkdir da/de/d13/d2f/d26/d31/d5a/d76/d11c 0 2024-09-20T18:36:09.322 INFO:tasks.workunit.client.0.smithi017.stdout:1/617: dread f2 [4194304,4194304] 0 2024-09-20T18:36:09.323 INFO:tasks.workunit.client.0.smithi017.stdout:3/859: mkdir da/de/d13/d16/d6e/d97/df1/d11d 0 2024-09-20T18:36:09.326 INFO:tasks.workunit.client.0.smithi017.stdout:3/860: creat da/de/d13/d16/d6e/dc9/dff/f11e x:0 0 0 2024-09-20T18:36:09.330 INFO:tasks.workunit.client.0.smithi017.stdout:3/861: rename da/de/d13/f54 to da/def/d113/d116/f11f 0 2024-09-20T18:36:09.330 INFO:tasks.workunit.client.0.smithi017.stdout:3/862: dread - da/de/d53/d52/dfb/f103 zero size 2024-09-20T18:36:09.332 INFO:tasks.workunit.client.0.smithi017.stdout:1/618: dread df/f26 [0,4194304] 0 2024-09-20T18:36:09.332 INFO:tasks.workunit.client.0.smithi017.stdout:1/619: readlink df/d35/d4f/l9b 0 2024-09-20T18:36:09.337 INFO:tasks.workunit.client.0.smithi017.stdout:1/620: fdatasync df/d35/f38 0 2024-09-20T18:36:09.338 INFO:tasks.workunit.client.0.smithi017.stdout:9/891: write d6/d23/d58/d3f/d2f/d98/fa5 [4505677,52559] 0 2024-09-20T18:36:09.343 INFO:tasks.workunit.client.0.smithi017.stdout:1/621: mknod df/d16/d50/cbf 0 2024-09-20T18:36:09.347 INFO:tasks.workunit.client.0.smithi017.stdout:1/622: mknod df/d35/daa/cc0 0 2024-09-20T18:36:09.350 INFO:tasks.workunit.client.0.smithi017.stdout:9/892: link d6/d23/d3a/c64 d6/d23/d58/d3f/c13f 0 2024-09-20T18:36:09.351 INFO:tasks.workunit.client.0.smithi017.stdout:9/893: fdatasync d6/fc2 0 2024-09-20T18:36:09.358 INFO:tasks.workunit.client.0.smithi017.stdout:9/894: rename d6/d23/d3a/d61/ca0 to d6/d23/d58/d3f/d70/db0/c140 0 2024-09-20T18:36:09.359 INFO:tasks.workunit.client.0.smithi017.stdout:1/623: dread f2 [0,4194304] 0 2024-09-20T18:36:09.359 INFO:tasks.workunit.client.0.smithi017.stdout:9/895: stat d6/d23/d58/d3f/d2f/d98/fa5 0 2024-09-20T18:36:09.360 INFO:tasks.workunit.client.0.smithi017.stdout:1/624: write df/d3b/f9a [1545689,44034] 0 2024-09-20T18:36:09.361 INFO:tasks.workunit.client.0.smithi017.stdout:1/625: readlink df/d3b/lba 0 2024-09-20T18:36:09.364 INFO:tasks.workunit.client.0.smithi017.stdout:9/896: mknod d6/d23/d40/db4/dba/c141 0 2024-09-20T18:36:09.366 INFO:tasks.workunit.client.0.smithi017.stdout:1/626: mknod df/d16/d50/d69/cc1 0 2024-09-20T18:36:09.366 INFO:tasks.workunit.client.0.smithi017.stdout:9/897: chown d6/d23/d58/d3f/d70/dd9/f10a 1 1 2024-09-20T18:36:09.368 INFO:tasks.workunit.client.0.smithi017.stdout:4/596: write f3 [2163590,38930] 0 2024-09-20T18:36:09.369 INFO:tasks.workunit.client.0.smithi017.stdout:1/627: mkdir df/d35/d6b/dc2 0 2024-09-20T18:36:09.371 INFO:tasks.workunit.client.0.smithi017.stdout:5/667: dwrite d0/d14/d18/d1b/fa6 [0,4194304] 0 2024-09-20T18:36:09.372 INFO:tasks.workunit.client.0.smithi017.stdout:9/898: dread - d6/d23/d3a/fac zero size 2024-09-20T18:36:09.374 INFO:tasks.workunit.client.0.smithi017.stdout:4/597: write d4/d19/d37/da1/f4f [3398581,21657] 0 2024-09-20T18:36:09.375 INFO:tasks.workunit.client.0.smithi017.stdout:1/628: creat df/d16/d50/dab/fc3 x:0 0 0 2024-09-20T18:36:09.379 INFO:tasks.workunit.client.0.smithi017.stdout:3/863: getdents da/de/d13/d16/d6e/dc9/dff 0 2024-09-20T18:36:09.382 INFO:tasks.workunit.client.0.smithi017.stdout:2/828: sync 2024-09-20T18:36:09.382 INFO:tasks.workunit.client.0.smithi017.stdout:4/598: creat d4/d19/d37/da1/d1b/d56/fc7 x:0 0 0 2024-09-20T18:36:09.382 INFO:tasks.workunit.client.0.smithi017.stdout:7/611: sync 2024-09-20T18:36:09.385 INFO:tasks.workunit.client.0.smithi017.stdout:5/668: creat d0/d14/d18/d19/d4d/d6d/dbf/fe4 x:0 0 0 2024-09-20T18:36:09.387 INFO:tasks.workunit.client.0.smithi017.stdout:9/899: rename d6/d23/d40/c52 to d6/d23/d58/d3f/d133/c142 0 2024-09-20T18:36:09.390 INFO:tasks.workunit.client.0.smithi017.stdout:7/612: rmdir da/d16/d1c/d40/d34/d96 39 2024-09-20T18:36:09.395 INFO:tasks.workunit.client.0.smithi017.stdout:2/829: creat d1/d1f/d106/f114 x:0 0 0 2024-09-20T18:36:09.397 INFO:tasks.workunit.client.0.smithi017.stdout:1/629: rename df/d3b/f9a to df/d16/d50/d69/fc4 0 2024-09-20T18:36:09.398 INFO:tasks.workunit.client.0.smithi017.stdout:2/830: write d1/dc/d20/d2e/d30/d85/f87 [1163326,69776] 0 2024-09-20T18:36:09.400 INFO:tasks.workunit.client.0.smithi017.stdout:7/613: dwrite da/d16/d1c/d40/f7d [0,4194304] 0 2024-09-20T18:36:09.404 INFO:tasks.workunit.client.0.smithi017.stdout:2/831: write d1/dc/d20/d2e/d30/d85/f87 [561507,49909] 0 2024-09-20T18:36:09.404 INFO:tasks.workunit.client.0.smithi017.stdout:9/900: mkdir d6/d23/d58/dda/d137/d143 0 2024-09-20T18:36:09.406 INFO:tasks.workunit.client.0.smithi017.stdout:3/864: rename da/de/d13/d2f/d26/d31/f7e to da/de/d13/d16/d6e/d97/df1/f120 0 2024-09-20T18:36:09.410 INFO:tasks.workunit.client.0.smithi017.stdout:1/630: unlink df/d3b/c43 0 2024-09-20T18:36:09.410 INFO:tasks.workunit.client.0.smithi017.stdout:5/669: creat d0/d14/d18/d19/d4d/d6d/d78/fe5 x:0 0 0 2024-09-20T18:36:09.414 INFO:tasks.workunit.client.0.smithi017.stdout:5/670: truncate d0/d14/d18/d19/d4d/db5/fd3 1089413 0 2024-09-20T18:36:09.415 INFO:tasks.workunit.client.0.smithi017.stdout:1/631: read df/d16/d50/d69/f98 [1901928,16074] 0 2024-09-20T18:36:09.417 INFO:tasks.workunit.client.0.smithi017.stdout:1/632: readlink df/d29/d2c/l7d 0 2024-09-20T18:36:09.418 INFO:tasks.workunit.client.0.smithi017.stdout:1/633: readlink df/l12 0 2024-09-20T18:36:09.419 INFO:tasks.workunit.client.0.smithi017.stdout:2/832: creat d1/d1f/d99/da6/f115 x:0 0 0 2024-09-20T18:36:09.423 INFO:tasks.workunit.client.0.smithi017.stdout:7/614: rmdir da/d16/d1c/d40/d34/d96 39 2024-09-20T18:36:09.428 INFO:tasks.workunit.client.0.smithi017.stdout:5/671: creat d0/d14/d18/d57/db6/fe6 x:0 0 0 2024-09-20T18:36:09.428 INFO:tasks.workunit.client.0.smithi017.stdout:1/634: mknod df/d16/d50/d53/cc5 0 2024-09-20T18:36:09.429 INFO:tasks.workunit.client.0.smithi017.stdout:9/901: dread d6/d23/d58/d3f/d44/f47 [0,4194304] 0 2024-09-20T18:36:09.431 INFO:tasks.workunit.client.0.smithi017.stdout:5/672: chown d0/ff 13659 1 2024-09-20T18:36:09.433 INFO:tasks.workunit.client.0.smithi017.stdout:2/833: symlink d1/dc/d20/d2e/d30/d85/d53/d96/d10b/l116 0 2024-09-20T18:36:09.436 INFO:tasks.workunit.client.0.smithi017.stdout:9/902: mkdir d6/d23/d58/dda/d144 0 2024-09-20T18:36:09.436 INFO:tasks.workunit.client.0.smithi017.stdout:8/567: sync 2024-09-20T18:36:09.445 INFO:tasks.workunit.client.0.smithi017.stdout:7/615: creat da/fbb x:0 0 0 2024-09-20T18:36:09.447 INFO:tasks.workunit.client.0.smithi017.stdout:3/865: dread da/de/ffd [0,4194304] 0 2024-09-20T18:36:09.448 INFO:tasks.workunit.client.0.smithi017.stdout:2/834: dwrite d1/d67/d8f/d9e/f108 [0,4194304] 0 2024-09-20T18:36:09.450 INFO:tasks.workunit.client.0.smithi017.stdout:5/673: mknod d0/d14/d18/d2a/d39/de1/ce7 0 2024-09-20T18:36:09.453 INFO:tasks.workunit.client.0.smithi017.stdout:8/568: creat d0/d6/d28/d3d/d4e/fbd x:0 0 0 2024-09-20T18:36:09.455 INFO:tasks.workunit.client.0.smithi017.stdout:3/866: mkdir da/de/d13/d16/d6e/d82/df8/d121 0 2024-09-20T18:36:09.458 INFO:tasks.workunit.client.0.smithi017.stdout:7/616: symlink da/d16/d1c/d40/d3a/d8a/lbc 0 2024-09-20T18:36:09.459 INFO:tasks.workunit.client.0.smithi017.stdout:1/635: dread df/d1c/d45/f57 [0,4194304] 0 2024-09-20T18:36:09.463 INFO:tasks.workunit.client.0.smithi017.stdout:1/636: truncate df/d1c/f1e 4323183 0 2024-09-20T18:36:09.465 INFO:tasks.workunit.client.0.smithi017.stdout:9/903: dread d6/d23/d3a/d61/fb3 [0,4194304] 0 2024-09-20T18:36:09.469 INFO:tasks.workunit.client.0.smithi017.stdout:5/674: creat d0/d14/d18/d2a/d39/d42/fe8 x:0 0 0 2024-09-20T18:36:09.472 INFO:tasks.workunit.client.0.smithi017.stdout:4/599: dwrite d4/dc/d1e/f55 [0,4194304] 0 2024-09-20T18:36:09.475 INFO:tasks.workunit.client.0.smithi017.stdout:8/569: creat d0/d6/d28/d3d/d4e/d55/d83/da2/fbe x:0 0 0 2024-09-20T18:36:09.476 INFO:tasks.workunit.client.0.smithi017.stdout:7/617: creat da/d16/d1c/d40/d3a/fbd x:0 0 0 2024-09-20T18:36:09.479 INFO:tasks.workunit.client.0.smithi017.stdout:7/618: readlink da/d16/d1c/la4 0 2024-09-20T18:36:09.481 INFO:tasks.workunit.client.0.smithi017.stdout:9/904: dwrite d6/d23/d3a/d61/fe0 [0,4194304] 0 2024-09-20T18:36:09.485 INFO:tasks.workunit.client.0.smithi017.stdout:8/570: truncate d0/d6/d28/d3d/d4e/fb1 754068 0 2024-09-20T18:36:09.486 INFO:tasks.workunit.client.0.smithi017.stdout:8/571: chown d0/l5 215000 1 2024-09-20T18:36:09.490 INFO:tasks.workunit.client.0.smithi017.stdout:3/867: mknod da/de/d53/d88/db3/dd3/c122 0 2024-09-20T18:36:09.491 INFO:tasks.workunit.client.0.smithi017.stdout:6/686: sync 2024-09-20T18:36:09.491 INFO:tasks.workunit.client.0.smithi017.stdout:0/645: sync 2024-09-20T18:36:09.494 INFO:tasks.workunit.client.0.smithi017.stdout:4/600: mkdir d4/d82/d88/d5c/dc8 0 2024-09-20T18:36:09.495 INFO:tasks.workunit.client.0.smithi017.stdout:4/601: readlink d4/l46 0 2024-09-20T18:36:09.508 INFO:tasks.workunit.client.0.smithi017.stdout:1/637: write df/d16/d50/d69/f8c [266086,128666] 0 2024-09-20T18:36:09.509 INFO:tasks.workunit.client.0.smithi017.stdout:6/687: truncate d4/df/d1f/f22 652603 0 2024-09-20T18:36:09.511 INFO:tasks.workunit.client.0.smithi017.stdout:5/675: symlink d0/d14/d18/d19/d4d/d6d/d78/le9 0 2024-09-20T18:36:09.511 INFO:tasks.workunit.client.0.smithi017.stdout:6/688: write d4/df/d1f/faf [2040363,124400] 0 2024-09-20T18:36:09.513 INFO:tasks.workunit.client.0.smithi017.stdout:4/602: truncate d4/f4b 4726133 0 2024-09-20T18:36:09.514 INFO:tasks.workunit.client.0.smithi017.stdout:2/835: dwrite d1/dc/d20/d2e/d30/f4b [0,4194304] 0 2024-09-20T18:36:09.518 INFO:tasks.workunit.client.0.smithi017.stdout:9/905: symlink d6/d23/d58/d3f/d2f/l145 0 2024-09-20T18:36:09.519 INFO:tasks.workunit.client.0.smithi017.stdout:3/868: symlink da/de/d53/d88/db3/d101/l123 0 2024-09-20T18:36:09.523 INFO:tasks.workunit.client.0.smithi017.stdout:0/646: creat d4/db/d18/d25/d36/d47/d8c/daa/dcc/fda x:0 0 0 2024-09-20T18:36:09.527 INFO:tasks.workunit.client.0.smithi017.stdout:4/603: creat d4/d19/d37/dbc/d7a/fc9 x:0 0 0 2024-09-20T18:36:09.528 INFO:tasks.workunit.client.0.smithi017.stdout:7/619: rename da/f11 to da/d16/d1c/d40/d34/fbe 0 2024-09-20T18:36:09.531 INFO:tasks.workunit.client.0.smithi017.stdout:5/676: mkdir d0/dbe/ddc/dea 0 2024-09-20T18:36:09.533 INFO:tasks.workunit.client.0.smithi017.stdout:6/689: symlink d4/d37/d68/d8d/db2/leb 0 2024-09-20T18:36:09.537 INFO:tasks.workunit.client.0.smithi017.stdout:4/604: mkdir d4/d7f/dca 0 2024-09-20T18:36:09.539 INFO:tasks.workunit.client.0.smithi017.stdout:7/620: dread - da/d16/d92/f9b zero size 2024-09-20T18:36:09.543 INFO:tasks.workunit.client.0.smithi017.stdout:8/572: rename d0/d6/f56 to d0/d6/d28/d81/fbf 0 2024-09-20T18:36:09.547 INFO:tasks.workunit.client.0.smithi017.stdout:0/647: write d4/db/d18/f79 [871181,30964] 0 2024-09-20T18:36:09.550 INFO:tasks.workunit.client.0.smithi017.stdout:7/621: creat da/d16/d1c/d40/d3a/fbf x:0 0 0 2024-09-20T18:36:09.552 INFO:tasks.workunit.client.0.smithi017.stdout:8/573: mknod d0/d6/d28/d3d/d4e/d55/d83/cc0 0 2024-09-20T18:36:09.553 INFO:tasks.workunit.client.0.smithi017.stdout:3/869: dwrite da/de/d13/d2f/d26/d31/d5a/fe5 [0,4194304] 0 2024-09-20T18:36:09.554 INFO:tasks.workunit.client.0.smithi017.stdout:4/605: dread d4/d19/d37/da1/d1b/f45 [0,4194304] 0 2024-09-20T18:36:09.556 INFO:tasks.workunit.client.0.smithi017.stdout:1/638: rename df/d16/d50/cb4 to df/d29/d7e/cc6 0 2024-09-20T18:36:09.558 INFO:tasks.workunit.client.0.smithi017.stdout:1/639: readlink df/d16/d50/l64 0 2024-09-20T18:36:09.558 INFO:tasks.workunit.client.0.smithi017.stdout:7/622: dread - da/d16/f9c zero size 2024-09-20T18:36:09.562 INFO:tasks.workunit.client.0.smithi017.stdout:3/870: fdatasync da/de/d13/d16/f22 0 2024-09-20T18:36:09.563 INFO:tasks.workunit.client.0.smithi017.stdout:6/690: link c1 d4/d29/dc6/de7/cec 0 2024-09-20T18:36:09.566 INFO:tasks.workunit.client.0.smithi017.stdout:4/606: rmdir d4/d19/d37/dbc/d7a 39 2024-09-20T18:36:09.567 INFO:tasks.workunit.client.0.smithi017.stdout:8/574: creat d0/d6/d28/d81/d9c/fc1 x:0 0 0 2024-09-20T18:36:09.568 INFO:tasks.workunit.client.0.smithi017.stdout:8/575: dread - d0/d6/d93/faf zero size 2024-09-20T18:36:09.569 INFO:tasks.workunit.client.0.smithi017.stdout:8/576: dread - d0/d6/d28/f9b zero size 2024-09-20T18:36:09.571 INFO:tasks.workunit.client.0.smithi017.stdout:7/623: creat da/d16/d1c/d40/d30/d98/fc0 x:0 0 0 2024-09-20T18:36:09.575 INFO:tasks.workunit.client.0.smithi017.stdout:0/648: write d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/f87 [1217667,51765] 0 2024-09-20T18:36:09.577 INFO:tasks.workunit.client.0.smithi017.stdout:1/640: mkdir df/d35/d4f/d82/dac/dc7 0 2024-09-20T18:36:09.579 INFO:tasks.workunit.client.0.smithi017.stdout:7/624: unlink da/d16/d1c/d40/d5d/da7/lae 0 2024-09-20T18:36:09.582 INFO:tasks.workunit.client.0.smithi017.stdout:2/836: rename d1/l27 to d1/df/l117 0 2024-09-20T18:36:09.588 INFO:tasks.workunit.client.0.smithi017.stdout:4/607: creat d4/d19/d37/da1/d1b/fcb x:0 0 0 2024-09-20T18:36:09.591 INFO:tasks.workunit.client.0.smithi017.stdout:5/677: rename d0/d14/d18/d1b/f76 to d0/d14/d18/d2a/d39/d6c/feb 0 2024-09-20T18:36:09.593 INFO:tasks.workunit.client.0.smithi017.stdout:5/678: chown d0/d14/d18/d2a/lb0 38013657 1 2024-09-20T18:36:09.593 INFO:tasks.workunit.client.0.smithi017.stdout:7/625: dread da/d16/d1c/d40/d30/f78 [0,4194304] 0 2024-09-20T18:36:09.594 INFO:tasks.workunit.client.0.smithi017.stdout:1/641: symlink df/d16/d50/d53/d60/lc8 0 2024-09-20T18:36:09.596 INFO:tasks.workunit.client.0.smithi017.stdout:2/837: unlink d1/dc/d20/d2e/d30/fcc 0 2024-09-20T18:36:09.598 INFO:tasks.workunit.client.0.smithi017.stdout:3/871: getdents da/de/d53/d88/db3/d101 0 2024-09-20T18:36:09.603 INFO:tasks.workunit.client.0.smithi017.stdout:8/577: rename d0/l5 to d0/d65/d8b/lc2 0 2024-09-20T18:36:09.605 INFO:tasks.workunit.client.0.smithi017.stdout:8/578: fdatasync d0/d6/d28/f5a 0 2024-09-20T18:36:09.605 INFO:tasks.workunit.client.0.smithi017.stdout:7/626: creat da/d16/fc1 x:0 0 0 2024-09-20T18:36:09.606 INFO:tasks.workunit.client.0.smithi017.stdout:5/679: mknod d0/d14/d18/d57/db6/cec 0 2024-09-20T18:36:09.608 INFO:tasks.workunit.client.0.smithi017.stdout:8/579: chown d0/d6/d28/d3b/f53 4 1 2024-09-20T18:36:09.609 INFO:tasks.workunit.client.0.smithi017.stdout:8/580: readlink d0/d6/d73/l7b 0 2024-09-20T18:36:09.609 INFO:tasks.workunit.client.0.smithi017.stdout:3/872: fsync da/de/d13/d2f/d26/d41/fad 0 2024-09-20T18:36:09.611 INFO:tasks.workunit.client.0.smithi017.stdout:8/581: write d0/d6/f38 [3120518,101496] 0 2024-09-20T18:36:09.612 INFO:tasks.workunit.client.0.smithi017.stdout:8/582: chown d0/d6/d28/d3a/ca3 6739023 1 2024-09-20T18:36:09.613 INFO:tasks.workunit.client.0.smithi017.stdout:6/691: rename d4/df/f16 to d4/d37/d68/d8d/db2/dd4/dd9/fed 0 2024-09-20T18:36:09.615 INFO:tasks.workunit.client.0.smithi017.stdout:4/608: dread d4/f6c [0,4194304] 0 2024-09-20T18:36:09.630 INFO:tasks.workunit.client.0.smithi017.stdout:6/692: rmdir d4/df/d4a/de6 39 2024-09-20T18:36:09.634 INFO:tasks.workunit.client.0.smithi017.stdout:1/642: dwrite df/f2b [0,4194304] 0 2024-09-20T18:36:09.635 INFO:tasks.workunit.client.0.smithi017.stdout:2/838: rmdir d1/dc/d20/d2e/df0 0 2024-09-20T18:36:09.637 INFO:tasks.workunit.client.0.smithi017.stdout:7/627: dread da/d16/d1c/d40/d34/fbe [0,4194304] 0 2024-09-20T18:36:09.638 INFO:tasks.workunit.client.0.smithi017.stdout:3/873: mknod da/de/d13/d2f/d26/d62/da5/da9/dbb/df4/c124 0 2024-09-20T18:36:09.640 INFO:tasks.workunit.client.0.smithi017.stdout:8/583: mknod d0/d6/d28/d3d/cc3 0 2024-09-20T18:36:09.642 INFO:tasks.workunit.client.0.smithi017.stdout:6/693: dwrite d4/df/d4a/f9b [0,4194304] 0 2024-09-20T18:36:09.643 INFO:tasks.workunit.client.0.smithi017.stdout:8/584: stat d0/d6/d28/d3b/d72/d98 0 2024-09-20T18:36:09.645 INFO:tasks.workunit.client.0.smithi017.stdout:7/628: chown da/d16/d1c/d40/d5d/f9d 24 1 2024-09-20T18:36:09.645 INFO:tasks.workunit.client.0.smithi017.stdout:5/680: truncate d0/d14/d18/d57/f5d 3368864 0 2024-09-20T18:36:09.654 INFO:tasks.workunit.client.0.smithi017.stdout:2/839: fsync d1/dc/d20/d2e/d30/d85/d46/d48/f90 0 2024-09-20T18:36:09.654 INFO:tasks.workunit.client.0.smithi017.stdout:7/629: dread da/d16/d1c/d40/d34/d3c/f53 [0,4194304] 0 2024-09-20T18:36:09.659 INFO:tasks.workunit.client.0.smithi017.stdout:5/681: unlink d0/d14/f28 0 2024-09-20T18:36:09.667 INFO:tasks.workunit.client.0.smithi017.stdout:1/643: mknod df/d16/cc9 0 2024-09-20T18:36:09.668 INFO:tasks.workunit.client.0.smithi017.stdout:7/630: rmdir da/d16/d8e/d75 39 2024-09-20T18:36:09.668 INFO:tasks.workunit.client.0.smithi017.stdout:6/694: write d4/df/d4a/f4b [4203909,128242] 0 2024-09-20T18:36:09.671 INFO:tasks.workunit.client.0.smithi017.stdout:1/644: dread df/d1c/f93 [0,4194304] 0 2024-09-20T18:36:09.672 INFO:tasks.workunit.client.0.smithi017.stdout:7/631: write da/d16/d1c/d40/d34/d3c/f48 [1449901,26493] 0 2024-09-20T18:36:09.672 INFO:tasks.workunit.client.0.smithi017.stdout:2/840: read d1/dc/d20/d2e/d30/d85/d3d/d77/fac [277375,106256] 0 2024-09-20T18:36:09.675 INFO:tasks.workunit.client.0.smithi017.stdout:7/632: write da/d16/d1c/d40/d3a/fbf [141449,78374] 0 2024-09-20T18:36:09.675 INFO:tasks.workunit.client.0.smithi017.stdout:4/609: getdents d4/d19 0 2024-09-20T18:36:09.677 INFO:tasks.workunit.client.0.smithi017.stdout:7/633: dread - da/d16/d1c/d40/d5d/da7/fb7 zero size 2024-09-20T18:36:09.678 INFO:tasks.workunit.client.0.smithi017.stdout:8/585: creat d0/d6/d28/d3d/d4e/d55/da8/fc4 x:0 0 0 2024-09-20T18:36:09.681 INFO:tasks.workunit.client.0.smithi017.stdout:7/634: read da/d16/d1c/d40/d3a/f7b [420472,81666] 0 2024-09-20T18:36:09.682 INFO:tasks.workunit.client.0.smithi017.stdout:7/635: fsync da/f77 0 2024-09-20T18:36:09.719 INFO:tasks.workunit.client.0.smithi017.stdout:6/695: truncate d4/df/d1f/d25/dd7/fb9 1008549 0 2024-09-20T18:36:09.721 INFO:tasks.workunit.client.0.smithi017.stdout:6/696: read d4/df/d4a/f4b [586572,124866] 0 2024-09-20T18:36:09.721 INFO:tasks.workunit.client.0.smithi017.stdout:1/645: read fc [1502976,39786] 0 2024-09-20T18:36:09.723 INFO:tasks.workunit.client.0.smithi017.stdout:2/841: unlink d1/d67/d8f/dcd/lec 0 2024-09-20T18:36:09.723 INFO:tasks.workunit.client.0.smithi017.stdout:2/842: stat d1/dc/d20/c102 0 2024-09-20T18:36:09.724 INFO:tasks.workunit.client.0.smithi017.stdout:4/610: unlink d4/dc/f9c 0 2024-09-20T18:36:09.726 INFO:tasks.workunit.client.0.smithi017.stdout:5/682: mkdir d0/d14/ded 0 2024-09-20T18:36:09.727 INFO:tasks.workunit.client.0.smithi017.stdout:5/683: chown d0/d14/d18/d2a/d39/d6c/d72/l35 2765 1 2024-09-20T18:36:09.728 INFO:tasks.workunit.client.0.smithi017.stdout:7/636: creat da/d16/d1c/d40/d30/d98/fc2 x:0 0 0 2024-09-20T18:36:09.729 INFO:tasks.workunit.client.0.smithi017.stdout:3/874: link da/de/d53/d88/la1 da/de/l125 0 2024-09-20T18:36:09.731 INFO:tasks.workunit.client.0.smithi017.stdout:3/875: truncate da/de/d53/d52/f107 447702 0 2024-09-20T18:36:09.732 INFO:tasks.workunit.client.0.smithi017.stdout:6/697: chown d4/d37/d68/d8d/db2/dd4/dd9/ce0 3420128 1 2024-09-20T18:36:09.733 INFO:tasks.workunit.client.0.smithi017.stdout:1/646: mkdir df/d16/d50/dab/dca 0 2024-09-20T18:36:09.736 INFO:tasks.workunit.client.0.smithi017.stdout:4/611: symlink d4/d19/d37/d66/lcc 0 2024-09-20T18:36:09.741 INFO:tasks.workunit.client.0.smithi017.stdout:6/698: write d4/d29/f45 [2441470,60175] 0 2024-09-20T18:36:09.742 INFO:tasks.workunit.client.0.smithi017.stdout:6/699: read - d4/d37/f6a zero size 2024-09-20T18:36:09.747 INFO:tasks.workunit.client.0.smithi017.stdout:4/612: creat d4/d19/d37/da1/d1b/d56/d67/fcd x:0 0 0 2024-09-20T18:36:09.750 INFO:tasks.workunit.client.0.smithi017.stdout:5/684: mknod d0/dd9/dbd/cee 0 2024-09-20T18:36:09.751 INFO:tasks.workunit.client.0.smithi017.stdout:3/876: symlink da/l126 0 2024-09-20T18:36:09.753 INFO:tasks.workunit.client.0.smithi017.stdout:7/637: dread f4 [4194304,4194304] 0 2024-09-20T18:36:09.754 INFO:tasks.workunit.client.0.smithi017.stdout:1/647: creat df/d35/d4f/d82/da6/fcb x:0 0 0 2024-09-20T18:36:09.755 INFO:tasks.workunit.client.0.smithi017.stdout:4/613: symlink d4/d19/d37/dbc/d79/lce 0 2024-09-20T18:36:09.756 INFO:tasks.workunit.client.0.smithi017.stdout:4/614: truncate d4/d19/f30 4966038 0 2024-09-20T18:36:09.758 INFO:tasks.workunit.client.0.smithi017.stdout:3/877: mkdir da/de/d13/d16/d6e/ddf/de9/d127 0 2024-09-20T18:36:09.761 INFO:tasks.workunit.client.0.smithi017.stdout:7/638: symlink da/d16/d1c/d40/d5d/da7/lc3 0 2024-09-20T18:36:09.761 INFO:tasks.workunit.client.0.smithi017.stdout:1/648: mkdir df/d1c/d45/dcc 0 2024-09-20T18:36:09.762 INFO:tasks.workunit.client.0.smithi017.stdout:1/649: fsync df/d35/d6b/fa9 0 2024-09-20T18:36:09.763 INFO:tasks.workunit.client.0.smithi017.stdout:4/615: unlink d4/d19/f64 0 2024-09-20T18:36:09.767 INFO:tasks.workunit.client.0.smithi017.stdout:7/639: dread da/d16/d8e/d75/f2c [0,4194304] 0 2024-09-20T18:36:09.769 INFO:tasks.workunit.client.0.smithi017.stdout:1/650: link l8 df/d16/lcd 0 2024-09-20T18:36:09.770 INFO:tasks.workunit.client.0.smithi017.stdout:1/651: write df/d16/d50/f83 [83915,50629] 0 2024-09-20T18:36:09.775 INFO:tasks.workunit.client.0.smithi017.stdout:1/652: rename df/d16/c41 to df/d35/d6b/cce 0 2024-09-20T18:36:09.779 INFO:tasks.workunit.client.0.smithi017.stdout:1/653: dread df/d1c/d45/f6e [0,4194304] 0 2024-09-20T18:36:09.782 INFO:tasks.workunit.client.0.smithi017.stdout:1/654: symlink df/d3b/lcf 0 2024-09-20T18:36:09.787 INFO:tasks.workunit.client.0.smithi017.stdout:1/655: getdents df 0 2024-09-20T18:36:09.788 INFO:tasks.workunit.client.0.smithi017.stdout:2/843: write d1/dc/d20/d2e/d30/d85/d98/fbd [936761,103413] 0 2024-09-20T18:36:09.789 INFO:tasks.workunit.client.0.smithi017.stdout:1/656: fsync df/d16/d50/dab/fc3 0 2024-09-20T18:36:09.792 INFO:tasks.workunit.client.0.smithi017.stdout:2/844: symlink d1/dc/d20/d2e/d30/d85/d53/d96/d10b/l118 0 2024-09-20T18:36:09.793 INFO:tasks.workunit.client.0.smithi017.stdout:2/845: chown d1/dc/d20/d2e/leb 200546298 1 2024-09-20T18:36:09.793 INFO:tasks.workunit.client.0.smithi017.stdout:1/657: rmdir df/d1c/d80/da0 39 2024-09-20T18:36:09.794 INFO:tasks.workunit.client.0.smithi017.stdout:2/846: chown d1/dc/d20/d2e/d30/d85/d53/fc4 82854 1 2024-09-20T18:36:09.797 INFO:tasks.workunit.client.0.smithi017.stdout:2/847: unlink d1/dc/d20/d2e/lae 0 2024-09-20T18:36:09.803 INFO:tasks.workunit.client.0.smithi017.stdout:1/658: dread df/d16/d50/d69/f4c [0,4194304] 0 2024-09-20T18:36:09.803 INFO:tasks.workunit.client.0.smithi017.stdout:2/848: mkdir d1/dc/d20/d2e/d30/d85/d3d/d8d/d119 0 2024-09-20T18:36:09.804 INFO:tasks.workunit.client.0.smithi017.stdout:2/849: readlink d1/df/d17/l2c 0 2024-09-20T18:36:09.805 INFO:tasks.workunit.client.0.smithi017.stdout:2/850: chown d1/dc/d20/d2e/f5f 2220 1 2024-09-20T18:36:09.808 INFO:tasks.workunit.client.0.smithi017.stdout:1/659: rename df/d1c/d45/c6c to df/d16/d50/d69/da5/cd0 0 2024-09-20T18:36:09.808 INFO:tasks.workunit.client.0.smithi017.stdout:1/660: chown df/f11 719846 1 2024-09-20T18:36:09.810 INFO:tasks.workunit.client.0.smithi017.stdout:7/640: write da/d16/d1c/d40/f7a [787887,28008] 0 2024-09-20T18:36:09.811 INFO:tasks.workunit.client.0.smithi017.stdout:2/851: rmdir d1/dc/d20/d2e/d30/d85/d53/d96 39 2024-09-20T18:36:09.811 INFO:tasks.workunit.client.0.smithi017.stdout:7/641: chown da/d16/fc1 2261527 1 2024-09-20T18:36:09.817 INFO:tasks.workunit.client.0.smithi017.stdout:7/642: truncate da/f8d 1009807 0 2024-09-20T18:36:09.818 INFO:tasks.workunit.client.0.smithi017.stdout:4/616: dread d4/d19/d37/da1/d1b/f81 [4194304,4194304] 0 2024-09-20T18:36:09.820 INFO:tasks.workunit.client.0.smithi017.stdout:1/661: creat df/d1c/d79/fd1 x:0 0 0 2024-09-20T18:36:09.821 INFO:tasks.workunit.client.0.smithi017.stdout:7/643: dread - da/d16/d1c/d40/d30/d98/fc2 zero size 2024-09-20T18:36:09.822 INFO:tasks.workunit.client.0.smithi017.stdout:5/685: dwrite d0/d14/d18/d57/f5d [0,4194304] 0 2024-09-20T18:36:09.823 INFO:tasks.workunit.client.0.smithi017.stdout:5/686: chown d0/ff 57119 1 2024-09-20T18:36:09.828 INFO:tasks.workunit.client.0.smithi017.stdout:4/617: symlink d4/d82/d88/d5c/lcf 0 2024-09-20T18:36:09.829 INFO:tasks.workunit.client.0.smithi017.stdout:7/644: symlink da/d54/lc4 0 2024-09-20T18:36:09.830 INFO:tasks.workunit.client.0.smithi017.stdout:7/645: stat da/d16/d1c/d40/d5d/da7 0 2024-09-20T18:36:09.831 INFO:tasks.workunit.client.0.smithi017.stdout:5/687: chown d0/d14/d18/f3b 727601 1 2024-09-20T18:36:09.832 INFO:tasks.workunit.client.0.smithi017.stdout:7/646: write da/d16/d1c/d40/f7a [1596778,59390] 0 2024-09-20T18:36:09.835 INFO:tasks.workunit.client.0.smithi017.stdout:4/618: write d4/d19/f5e [2745131,56258] 0 2024-09-20T18:36:09.839 INFO:tasks.workunit.client.0.smithi017.stdout:2/852: dread d1/dc/d20/d2e/d30/d85/f7d [0,4194304] 0 2024-09-20T18:36:09.846 INFO:tasks.workunit.client.0.smithi017.stdout:7/647: symlink da/d16/d8e/lc5 0 2024-09-20T18:36:09.848 INFO:tasks.workunit.client.0.smithi017.stdout:1/662: dwrite df/d29/f61 [0,4194304] 0 2024-09-20T18:36:09.850 INFO:tasks.workunit.client.0.smithi017.stdout:1/663: write df/d16/d50/d53/f67 [845427,19851] 0 2024-09-20T18:36:09.851 INFO:tasks.workunit.client.0.smithi017.stdout:2/853: write d1/dc/d20/f84 [944312,76560] 0 2024-09-20T18:36:09.852 INFO:tasks.workunit.client.0.smithi017.stdout:7/648: fdatasync da/d16/d1c/d40/d5d/da7/fb6 0 2024-09-20T18:36:09.853 INFO:tasks.workunit.client.0.smithi017.stdout:2/854: chown d1/dc/d20/d2e/d30/d85/c61 2847550 1 2024-09-20T18:36:09.860 INFO:tasks.workunit.client.0.smithi017.stdout:7/649: symlink da/d16/d1c/lc6 0 2024-09-20T18:36:09.861 INFO:tasks.workunit.client.0.smithi017.stdout:2/855: fsync d1/dc/d20/d2e/d30/d85/d46/f63 0 2024-09-20T18:36:09.863 INFO:tasks.workunit.client.0.smithi017.stdout:7/650: chown da/d16/d1c/d40/d5d/f70 12528 1 2024-09-20T18:36:09.864 INFO:tasks.workunit.client.0.smithi017.stdout:7/651: chown da/d16/d1c/f82 522690053 1 2024-09-20T18:36:09.865 INFO:tasks.workunit.client.0.smithi017.stdout:1/664: creat df/d35/fd2 x:0 0 0 2024-09-20T18:36:09.868 INFO:tasks.workunit.client.0.smithi017.stdout:1/665: truncate df/d16/f21 5103005 0 2024-09-20T18:36:09.869 INFO:tasks.workunit.client.0.smithi017.stdout:2/856: dwrite d1/d67/d8f/d9e/f108 [0,4194304] 0 2024-09-20T18:36:09.869 INFO:tasks.workunit.client.0.smithi017.stdout:7/652: unlink da/d16/d1c/d40/d3a/la8 0 2024-09-20T18:36:09.871 INFO:tasks.workunit.client.0.smithi017.stdout:7/653: chown da/d16/d1c/d40/d30/d98/fa0 7790970 1 2024-09-20T18:36:09.873 INFO:tasks.workunit.client.0.smithi017.stdout:1/666: dread df/d16/d50/d53/fb0 [0,4194304] 0 2024-09-20T18:36:09.883 INFO:tasks.workunit.client.0.smithi017.stdout:1/667: link fc df/d35/fd3 0 2024-09-20T18:36:09.884 INFO:tasks.workunit.client.0.smithi017.stdout:7/654: write da/d16/d1c/d40/d5d/f70 [440163,57997] 0 2024-09-20T18:36:09.884 INFO:tasks.workunit.client.0.smithi017.stdout:1/668: dread - df/d35/fb1 zero size 2024-09-20T18:36:09.888 INFO:tasks.workunit.client.0.smithi017.stdout:1/669: truncate df/d16/d50/d69/f98 1729333 0 2024-09-20T18:36:09.975 INFO:tasks.workunit.client.0.smithi017.stdout:1/670: truncate df/d29/f9f 1043181 0 2024-09-20T18:36:09.976 INFO:tasks.workunit.client.0.smithi017.stdout:7/655: dwrite da/d16/d1c/d40/d5d/f70 [0,4194304] 0 2024-09-20T18:36:09.977 INFO:tasks.workunit.client.0.smithi017.stdout:1/671: chown df/d16/d50/d69/cc1 51 1 2024-09-20T18:36:09.978 INFO:tasks.workunit.client.0.smithi017.stdout:1/672: truncate df/d35/fd2 828286 0 2024-09-20T18:36:09.984 INFO:tasks.workunit.client.0.smithi017.stdout:1/673: creat df/d1c/d45/dcc/fd4 x:0 0 0 2024-09-20T18:36:09.986 INFO:tasks.workunit.client.0.smithi017.stdout:7/656: dwrite da/d16/d92/fa3 [0,4194304] 0 2024-09-20T18:36:09.988 INFO:tasks.workunit.client.0.smithi017.stdout:1/674: write df/d16/d50/d53/fb0 [737208,65993] 0 2024-09-20T18:36:09.992 INFO:tasks.workunit.client.0.smithi017.stdout:1/675: creat df/d29/fd5 x:0 0 0 2024-09-20T18:36:09.996 INFO:tasks.workunit.client.0.smithi017.stdout:1/676: dread df/d1c/d45/f57 [0,4194304] 0 2024-09-20T18:36:09.997 INFO:tasks.workunit.client.0.smithi017.stdout:7/657: write da/d16/d8e/d75/f2c [316984,57649] 0 2024-09-20T18:36:09.998 INFO:tasks.workunit.client.0.smithi017.stdout:1/677: chown df/d29/l2d 177 1 2024-09-20T18:36:10.003 INFO:tasks.workunit.client.0.smithi017.stdout:7/658: rename da/d54/lb9 to da/d16/d1c/d40/d34/d96/lc7 0 2024-09-20T18:36:10.003 INFO:tasks.workunit.client.0.smithi017.stdout:1/678: dread df/d16/f63 [4194304,4194304] 0 2024-09-20T18:36:10.007 INFO:tasks.workunit.client.0.smithi017.stdout:1/679: creat df/d35/d6b/fd6 x:0 0 0 2024-09-20T18:36:10.009 INFO:tasks.workunit.client.0.smithi017.stdout:7/659: write da/d16/d1c/d40/d3a/f7b [496707,57196] 0 2024-09-20T18:36:10.013 INFO:tasks.workunit.client.0.smithi017.stdout:1/680: creat df/d29/d7e/fd7 x:0 0 0 2024-09-20T18:36:10.013 INFO:tasks.workunit.client.0.smithi017.stdout:1/681: fsync df/d35/fb1 0 2024-09-20T18:36:10.019 INFO:tasks.workunit.client.0.smithi017.stdout:1/682: creat df/d1c/d45/fd8 x:0 0 0 2024-09-20T18:36:10.021 INFO:tasks.workunit.client.0.smithi017.stdout:7/660: creat da/d16/d1c/d40/d3a/da9/fc8 x:0 0 0 2024-09-20T18:36:10.024 INFO:tasks.workunit.client.0.smithi017.stdout:1/683: mkdir df/d1c/d45/dd9 0 2024-09-20T18:36:10.024 INFO:tasks.workunit.client.0.smithi017.stdout:1/684: stat df/d16/d50/dab/fbb 0 2024-09-20T18:36:10.024 INFO:tasks.workunit.client.0.smithi017.stdout:7/661: mkdir da/d16/d1c/dc9 0 2024-09-20T18:36:10.025 INFO:tasks.workunit.client.0.smithi017.stdout:1/685: mkdir df/d16/d50/d69/dda 0 2024-09-20T18:36:10.026 INFO:tasks.workunit.client.0.smithi017.stdout:1/686: write df/d8f/fb7 [1033255,79197] 0 2024-09-20T18:36:10.028 INFO:tasks.workunit.client.0.smithi017.stdout:7/662: symlink da/d16/d1c/d40/lca 0 2024-09-20T18:36:10.029 INFO:tasks.workunit.client.0.smithi017.stdout:1/687: write df/d1c/d45/f57 [2381033,125119] 0 2024-09-20T18:36:10.031 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:09 smithi017 ceph-mon[28058]: pgmap v39: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 70 MiB/s rd, 201 MiB/s wr, 455 op/s 2024-09-20T18:36:10.032 INFO:tasks.workunit.client.0.smithi017.stdout:7/663: mknod da/d16/d1c/d40/d34/d96/ccb 0 2024-09-20T18:36:10.034 INFO:tasks.workunit.client.0.smithi017.stdout:7/664: mknod da/d16/d1c/d40/d3a/d8a/d91/ccc 0 2024-09-20T18:36:10.045 INFO:tasks.workunit.client.0.smithi017.stdout:1/688: dwrite df/d1c/f3c [0,4194304] 0 2024-09-20T18:36:10.050 INFO:tasks.workunit.client.0.smithi017.stdout:1/689: unlink df/d29/f61 0 2024-09-20T18:36:10.057 INFO:tasks.workunit.client.0.smithi017.stdout:1/690: link df/d16/d50/d53/f90 df/d1c/fdb 0 2024-09-20T18:36:10.064 INFO:tasks.workunit.client.0.smithi017.stdout:1/691: rename df/d16/d50/f83 to df/d35/d4f/d82/dac/fdc 0 2024-09-20T18:36:10.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:09 smithi172 ceph-mon[35456]: pgmap v39: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 70 MiB/s rd, 201 MiB/s wr, 455 op/s 2024-09-20T18:36:10.401 INFO:tasks.workunit.client.0.smithi017.stdout:9/906: sync 2024-09-20T18:36:10.588 INFO:tasks.workunit.client.0.smithi017.stdout:7/665: sync 2024-09-20T18:36:10.588 INFO:tasks.workunit.client.0.smithi017.stdout:5/688: sync 2024-09-20T18:36:10.588 INFO:tasks.workunit.client.0.smithi017.stdout:6/700: sync 2024-09-20T18:36:10.588 INFO:tasks.workunit.client.0.smithi017.stdout:1/692: sync 2024-09-20T18:36:10.589 INFO:tasks.workunit.client.0.smithi017.stdout:3/878: sync 2024-09-20T18:36:10.589 INFO:tasks.workunit.client.0.smithi017.stdout:2/857: sync 2024-09-20T18:36:10.589 INFO:tasks.workunit.client.0.smithi017.stdout:0/649: sync 2024-09-20T18:36:10.589 INFO:tasks.workunit.client.0.smithi017.stdout:4/619: sync 2024-09-20T18:36:10.589 INFO:tasks.workunit.client.0.smithi017.stdout:8/586: sync 2024-09-20T18:36:10.590 INFO:tasks.workunit.client.0.smithi017.stdout:6/701: readlink l0 0 2024-09-20T18:36:10.590 INFO:tasks.workunit.client.0.smithi017.stdout:5/689: readlink d0/d14/l89 0 2024-09-20T18:36:10.591 INFO:tasks.workunit.client.0.smithi017.stdout:8/587: stat d0/d6/d28/d3d/d4e/f75 0 2024-09-20T18:36:10.592 INFO:tasks.workunit.client.0.smithi017.stdout:4/620: dread - d4/dc/d1e/d26/fad zero size 2024-09-20T18:36:10.595 INFO:tasks.workunit.client.0.smithi017.stdout:3/879: symlink da/de/d13/d16/d50/l128 0 2024-09-20T18:36:10.595 INFO:tasks.workunit.client.0.smithi017.stdout:8/588: write d0/d6/f7e [594247,45178] 0 2024-09-20T18:36:10.595 INFO:tasks.workunit.client.0.smithi017.stdout:6/702: creat d4/d37/d68/fee x:0 0 0 2024-09-20T18:36:10.600 INFO:tasks.workunit.client.0.smithi017.stdout:5/690: unlink d0/dbe/fc3 0 2024-09-20T18:36:10.604 INFO:tasks.workunit.client.0.smithi017.stdout:2/858: write d1/df/d17/f8b [585443,60207] 0 2024-09-20T18:36:10.608 INFO:tasks.workunit.client.0.smithi017.stdout:0/650: mkdir d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/ddb 0 2024-09-20T18:36:10.609 INFO:tasks.workunit.client.0.smithi017.stdout:0/651: write d4/db/f2c [723038,40226] 0 2024-09-20T18:36:10.611 INFO:tasks.workunit.client.0.smithi017.stdout:0/652: dread - d4/db/d18/d25/fd8 zero size 2024-09-20T18:36:10.612 INFO:tasks.workunit.client.0.smithi017.stdout:3/880: mknod da/de/d53/d88/db3/d101/c129 0 2024-09-20T18:36:10.613 INFO:tasks.workunit.client.0.smithi017.stdout:8/589: dread d0/d6/d28/d3d/f60 [4194304,4194304] 0 2024-09-20T18:36:10.613 INFO:tasks.workunit.client.0.smithi017.stdout:3/881: readlink da/de/d13/d16/l10e 0 2024-09-20T18:36:10.614 INFO:tasks.workunit.client.0.smithi017.stdout:1/693: getdents df/d35/d4f 0 2024-09-20T18:36:10.614 INFO:tasks.workunit.client.0.smithi017.stdout:0/653: fdatasync d4/db/d18/d25/d36/d47/d8c/daa/dca/db1/fd0 0 2024-09-20T18:36:10.616 INFO:tasks.workunit.client.0.smithi017.stdout:2/859: mknod d1/d67/d8f/dcd/c11a 0 2024-09-20T18:36:10.618 INFO:tasks.workunit.client.0.smithi017.stdout:0/654: write d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/f87 [561100,63676] 0 2024-09-20T18:36:10.623 INFO:tasks.workunit.client.0.smithi017.stdout:4/621: fsync d4/d19/f35 0 2024-09-20T18:36:10.627 INFO:tasks.workunit.client.0.smithi017.stdout:7/666: write da/d16/d1c/d40/d30/f56 [1884795,577] 0 2024-09-20T18:36:10.628 INFO:tasks.workunit.client.0.smithi017.stdout:7/667: stat da/d16/l41 0 2024-09-20T18:36:10.630 INFO:tasks.workunit.client.0.smithi017.stdout:1/694: creat df/d35/daa/fdd x:0 0 0 2024-09-20T18:36:10.632 INFO:tasks.workunit.client.0.smithi017.stdout:3/882: creat da/de/d13/d16/d6e/dc9/f12a x:0 0 0 2024-09-20T18:36:10.633 INFO:tasks.workunit.client.0.smithi017.stdout:2/860: symlink d1/dc/d20/d2e/d30/d8a/ddf/l11b 0 2024-09-20T18:36:10.637 INFO:tasks.workunit.client.0.smithi017.stdout:8/590: symlink d0/d6/d28/lc5 0 2024-09-20T18:36:10.638 INFO:tasks.workunit.client.0.smithi017.stdout:8/591: write d0/d6/d28/d3d/d4e/d55/d83/da2/fad [1029238,81751] 0 2024-09-20T18:36:10.639 INFO:tasks.workunit.client.0.smithi017.stdout:8/592: fdatasync d0/d6/d28/d3d/d4e/f51 0 2024-09-20T18:36:10.639 INFO:tasks.workunit.client.0.smithi017.stdout:5/691: link d0/d14/d18/d19/d4d/d6d/d78/lbb d0/d14/d18/d57/db6/lef 0 2024-09-20T18:36:10.642 INFO:tasks.workunit.client.0.smithi017.stdout:1/695: fsync df/f33 0 2024-09-20T18:36:10.642 INFO:tasks.workunit.client.0.smithi017.stdout:9/907: sync 2024-09-20T18:36:10.642 INFO:tasks.workunit.client.0.smithi017.stdout:5/692: dread d0/d14/d18/dd1/fcb [0,4194304] 0 2024-09-20T18:36:10.643 INFO:tasks.workunit.client.0.smithi017.stdout:3/883: truncate da/de/d53/d52/fd7 370245 0 2024-09-20T18:36:10.644 INFO:tasks.workunit.client.0.smithi017.stdout:9/908: read - d6/d23/d58/d3f/d4d/d73/d7d/d10f/f125 zero size 2024-09-20T18:36:10.646 INFO:tasks.workunit.client.0.smithi017.stdout:2/861: read d1/f28 [3994768,3892] 0 2024-09-20T18:36:10.647 INFO:tasks.workunit.client.0.smithi017.stdout:5/693: dread d0/d14/d18/d1b/f24 [0,4194304] 0 2024-09-20T18:36:10.648 INFO:tasks.workunit.client.0.smithi017.stdout:0/655: symlink d4/d37/dd2/ldc 0 2024-09-20T18:36:10.648 INFO:tasks.workunit.client.0.smithi017.stdout:5/694: read d0/d14/d18/d57/f5d [1378449,89555] 0 2024-09-20T18:36:10.651 INFO:tasks.workunit.client.0.smithi017.stdout:4/622: mkdir d4/d19/dd0 0 2024-09-20T18:36:10.652 INFO:tasks.workunit.client.0.smithi017.stdout:6/703: link d4/d37/c59 d4/df/d4a/d8f/cef 0 2024-09-20T18:36:10.658 INFO:tasks.workunit.client.0.smithi017.stdout:8/593: symlink d0/d6/d28/d3b/d72/d98/lc6 0 2024-09-20T18:36:10.663 INFO:tasks.workunit.client.0.smithi017.stdout:1/696: mkdir df/d29/d7e/dde 0 2024-09-20T18:36:10.664 INFO:tasks.workunit.client.0.smithi017.stdout:7/668: truncate da/d16/d92/fab 1063798 0 2024-09-20T18:36:10.664 INFO:tasks.workunit.client.0.smithi017.stdout:1/697: readlink df/d29/d2c/d5b/l4b 0 2024-09-20T18:36:10.665 INFO:tasks.workunit.client.0.smithi017.stdout:5/695: dread d0/d14/d18/d2a/d39/f61 [0,4194304] 0 2024-09-20T18:36:10.667 INFO:tasks.workunit.client.0.smithi017.stdout:7/669: chown da/d16/d8e/f52 25396 1 2024-09-20T18:36:10.667 INFO:tasks.workunit.client.0.smithi017.stdout:9/909: truncate d6/d23/d3a/d61/de7/fc7 420550 0 2024-09-20T18:36:10.674 INFO:tasks.workunit.client.0.smithi017.stdout:5/696: chown d0/d14/d18/d2a/d39/d42/d7e/da8 3 1 2024-09-20T18:36:10.676 INFO:tasks.workunit.client.0.smithi017.stdout:7/670: stat da/d16/d1c/d40/d3a 0 2024-09-20T18:36:10.677 INFO:tasks.workunit.client.0.smithi017.stdout:5/697: stat d0/d14/d18/d79/d9e 0 2024-09-20T18:36:10.679 INFO:tasks.workunit.client.0.smithi017.stdout:3/884: dwrite da/de/d13/d2f/d26/d31/fee [0,4194304] 0 2024-09-20T18:36:10.680 INFO:tasks.workunit.client.0.smithi017.stdout:6/704: write d4/d37/d68/d8d/f9c [4249941,128588] 0 2024-09-20T18:36:10.685 INFO:tasks.workunit.client.0.smithi017.stdout:8/594: dread d0/d6/d28/d3d/d4e/f89 [0,4194304] 0 2024-09-20T18:36:10.691 INFO:tasks.workunit.client.0.smithi017.stdout:8/595: stat d0/c31 0 2024-09-20T18:36:10.722 INFO:tasks.workunit.client.0.smithi017.stdout:1/698: creat df/d1c/d45/dd9/fdf x:0 0 0 2024-09-20T18:36:10.726 INFO:tasks.workunit.client.0.smithi017.stdout:8/596: symlink d0/d65/d8b/db5/lc7 0 2024-09-20T18:36:10.728 INFO:tasks.workunit.client.0.smithi017.stdout:2/862: rename d1/dc/ld to d1/dc/d20/d2e/d30/d85/d3d/l11c 0 2024-09-20T18:36:10.729 INFO:tasks.workunit.client.0.smithi017.stdout:2/863: fsync d1/d67/d8f/d9e/f108 0 2024-09-20T18:36:10.733 INFO:tasks.workunit.client.0.smithi017.stdout:8/597: truncate d0/d6/d28/f2d 3040423 0 2024-09-20T18:36:10.735 INFO:tasks.workunit.client.0.smithi017.stdout:0/656: rename d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/c9e to d4/d20/d63/d86/cdd 0 2024-09-20T18:36:10.738 INFO:tasks.workunit.client.0.smithi017.stdout:6/705: creat d4/ff0 x:0 0 0 2024-09-20T18:36:10.742 INFO:tasks.workunit.client.0.smithi017.stdout:5/698: rename d0/c21 to d0/d14/d18/d19/d4d/d6d/dbf/cf0 0 2024-09-20T18:36:10.744 INFO:tasks.workunit.client.0.smithi017.stdout:4/623: dwrite d4/d19/d37/d66/f6f [0,4194304] 0 2024-09-20T18:36:10.752 INFO:tasks.workunit.client.0.smithi017.stdout:3/885: getdents da/de/d13/d2f/d26/d31/d5a/d76 0 2024-09-20T18:36:10.759 INFO:tasks.workunit.client.0.smithi017.stdout:4/624: fdatasync d4/d19/f63 0 2024-09-20T18:36:10.762 INFO:tasks.workunit.client.0.smithi017.stdout:5/699: rename d0/fe to d0/d14/d18/d2a/d39/d6c/ff1 0 2024-09-20T18:36:10.766 INFO:tasks.workunit.client.0.smithi017.stdout:1/699: dwrite fc [4194304,4194304] 0 2024-09-20T18:36:10.766 INFO:tasks.workunit.client.0.smithi017.stdout:0/657: dread d4/f8 [0,4194304] 0 2024-09-20T18:36:10.767 INFO:tasks.workunit.client.0.smithi017.stdout:2/864: write d1/dc/d20/d2e/d30/d85/d3d/f36 [518221,130162] 0 2024-09-20T18:36:10.768 INFO:tasks.workunit.client.0.smithi017.stdout:6/706: write d4/df/d1f/d25/d3f/fac [371262,103726] 0 2024-09-20T18:36:10.769 INFO:tasks.workunit.client.0.smithi017.stdout:6/707: stat d4/df/d1f 0 2024-09-20T18:36:10.771 INFO:tasks.workunit.client.0.smithi017.stdout:3/886: unlink da/de/d13/d2f/d26/d41/f73 0 2024-09-20T18:36:10.773 INFO:tasks.workunit.client.0.smithi017.stdout:3/887: fdatasync da/de/d13/d16/d6e/d97/df1/f10c 0 2024-09-20T18:36:10.780 INFO:tasks.workunit.client.0.smithi017.stdout:1/700: unlink df/d29/d2c/f3f 0 2024-09-20T18:36:10.780 INFO:tasks.workunit.client.0.smithi017.stdout:1/701: readlink df/d3b/lba 0 2024-09-20T18:36:10.781 INFO:tasks.workunit.client.0.smithi017.stdout:1/702: chown df/d16/d50/d69/f8c 16171 1 2024-09-20T18:36:10.781 INFO:tasks.workunit.client.0.smithi017.stdout:0/658: unlink d4/db/d18/f79 0 2024-09-20T18:36:10.789 INFO:tasks.workunit.client.0.smithi017.stdout:1/703: creat df/fe0 x:0 0 0 2024-09-20T18:36:10.793 INFO:tasks.workunit.client.0.smithi017.stdout:3/888: mknod da/de/c12b 0 2024-09-20T18:36:10.795 INFO:tasks.workunit.client.0.smithi017.stdout:5/700: creat d0/d14/d18/ff2 x:0 0 0 2024-09-20T18:36:10.796 INFO:tasks.workunit.client.0.smithi017.stdout:4/625: write d4/d19/d37/f5a [193096,104227] 0 2024-09-20T18:36:10.798 INFO:tasks.workunit.client.0.smithi017.stdout:4/626: chown d4/d19/d37/da1/l3e 287 1 2024-09-20T18:36:10.801 INFO:tasks.workunit.client.0.smithi017.stdout:2/865: creat d1/dc/d20/d2e/d30/d85/d3d/f11d x:0 0 0 2024-09-20T18:36:10.802 INFO:tasks.workunit.client.0.smithi017.stdout:6/708: truncate d4/df/d8a/fbe 3931662 0 2024-09-20T18:36:10.805 INFO:tasks.workunit.client.0.smithi017.stdout:3/889: dread da/de/d13/d2f/d26/d62/da5/da9/ff7 [0,4194304] 0 2024-09-20T18:36:10.811 INFO:tasks.workunit.client.0.smithi017.stdout:4/627: fsync d4/d19/d37/da1/d1b/d56/d67/f6e 0 2024-09-20T18:36:10.815 INFO:tasks.workunit.client.0.smithi017.stdout:2/866: creat d1/dc/d20/d2e/d30/db0/dc2/f11e x:0 0 0 2024-09-20T18:36:10.816 INFO:tasks.workunit.client.0.smithi017.stdout:6/709: symlink d4/d37/d68/d8d/lf1 0 2024-09-20T18:36:10.818 INFO:tasks.workunit.client.0.smithi017.stdout:5/701: creat d0/dbe/ddc/dea/ff3 x:0 0 0 2024-09-20T18:36:10.818 INFO:tasks.workunit.client.0.smithi017.stdout:3/890: truncate da/de/d13/d2f/d26/d31/faf 369434 0 2024-09-20T18:36:10.819 INFO:tasks.workunit.client.0.smithi017.stdout:1/704: mkdir df/d35/d4f/de1 0 2024-09-20T18:36:10.822 INFO:tasks.workunit.client.0.smithi017.stdout:2/867: rename d1/df/f1e to d1/dc/d20/d2e/d30/d8a/f11f 0 2024-09-20T18:36:10.823 INFO:tasks.workunit.client.0.smithi017.stdout:3/891: read da/de/d13/fb9 [503440,102916] 0 2024-09-20T18:36:10.826 INFO:tasks.workunit.client.0.smithi017.stdout:4/628: symlink d4/d19/d37/da1/d65/da0/ld1 0 2024-09-20T18:36:10.826 INFO:tasks.workunit.client.0.smithi017.stdout:6/710: symlink d4/d37/d68/da4/lf2 0 2024-09-20T18:36:10.834 INFO:tasks.workunit.client.0.smithi017.stdout:1/705: dread df/d29/d2c/f65 [0,4194304] 0 2024-09-20T18:36:10.834 INFO:tasks.workunit.client.0.smithi017.stdout:6/711: creat d4/d37/d68/dbb/ff3 x:0 0 0 2024-09-20T18:36:10.835 INFO:tasks.workunit.client.0.smithi017.stdout:5/702: creat d0/d14/ff4 x:0 0 0 2024-09-20T18:36:10.837 INFO:tasks.workunit.client.0.smithi017.stdout:5/703: truncate d0/d14/d18/ff2 341896 0 2024-09-20T18:36:10.842 INFO:tasks.workunit.client.0.smithi017.stdout:4/629: symlink d4/d82/d88/d5c/d8f/da9/db4/db5/ld2 0 2024-09-20T18:36:10.843 INFO:tasks.workunit.client.0.smithi017.stdout:5/704: dwrite d0/ff [0,4194304] 0 2024-09-20T18:36:10.843 INFO:tasks.workunit.client.0.smithi017.stdout:2/868: dread d1/dc/d20/d2e/d30/d85/d53/d6b/ff1 [0,4194304] 0 2024-09-20T18:36:10.849 INFO:tasks.workunit.client.0.smithi017.stdout:5/705: fsync d0/d14/d18/d19/d4d/f7c 0 2024-09-20T18:36:10.851 INFO:tasks.workunit.client.0.smithi017.stdout:6/712: mkdir d4/d37/df4 0 2024-09-20T18:36:10.855 INFO:tasks.workunit.client.0.smithi017.stdout:6/713: write d4/df/d4a/fde [8710472,69908] 0 2024-09-20T18:36:10.858 INFO:tasks.workunit.client.0.smithi017.stdout:3/892: dwrite da/de/d13/f72 [0,4194304] 0 2024-09-20T18:36:10.860 INFO:tasks.workunit.client.0.smithi017.stdout:3/893: chown da/de/d13/d2f/d26/d31/d5a/fbd 3410542 1 2024-09-20T18:36:10.863 INFO:tasks.workunit.client.0.smithi017.stdout:5/706: creat d0/d14/d18/d19/d4d/db5/dc0/ff5 x:0 0 0 2024-09-20T18:36:10.866 INFO:tasks.workunit.client.0.smithi017.stdout:1/706: symlink df/d16/le2 0 2024-09-20T18:36:10.867 INFO:tasks.workunit.client.0.smithi017.stdout:1/707: chown df/d35/daa/f8e 6367256 1 2024-09-20T18:36:10.868 INFO:tasks.workunit.client.0.smithi017.stdout:3/894: dwrite da/de/d13/d2f/d26/d31/f9a [0,4194304] 0 2024-09-20T18:36:10.871 INFO:tasks.workunit.client.0.smithi017.stdout:2/869: creat d1/dc/d20/d2e/d30/db0/df4/f120 x:0 0 0 2024-09-20T18:36:10.873 INFO:tasks.workunit.client.0.smithi017.stdout:4/630: dread d4/d19/f1f [4194304,4194304] 0 2024-09-20T18:36:10.874 INFO:tasks.workunit.client.0.smithi017.stdout:4/631: readlink l2 0 2024-09-20T18:36:10.876 INFO:tasks.workunit.client.0.smithi017.stdout:5/707: dwrite d0/d14/d18/d19/f82 [0,4194304] 0 2024-09-20T18:36:10.881 INFO:tasks.workunit.client.0.smithi017.stdout:6/714: rename d4/d37/d41 to d4/d29/df5 0 2024-09-20T18:36:10.889 INFO:tasks.workunit.client.0.smithi017.stdout:1/708: dread df/d1c/f75 [4194304,4194304] 0 2024-09-20T18:36:10.890 INFO:tasks.workunit.client.0.smithi017.stdout:3/895: creat da/de/d13/d2f/d26/d41/f12c x:0 0 0 2024-09-20T18:36:10.892 INFO:tasks.workunit.client.0.smithi017.stdout:3/896: chown da/de/d13/d2f/d26/d31/d5a/d76/d19/f9c 51 1 2024-09-20T18:36:10.894 INFO:tasks.workunit.client.0.smithi017.stdout:2/870: truncate d1/dc/d20/daa/fda 1949720 0 2024-09-20T18:36:10.894 INFO:tasks.workunit.client.0.smithi017.stdout:3/897: write da/de/d13/d2f/d26/d31/d5a/d76/de6/f112 [774053,64794] 0 2024-09-20T18:36:10.898 INFO:tasks.workunit.client.0.smithi017.stdout:5/708: mknod d0/d14/d18/cf6 0 2024-09-20T18:36:10.900 INFO:tasks.workunit.client.0.smithi017.stdout:5/709: write d0/d14/d18/d1b/f24 [797592,15767] 0 2024-09-20T18:36:10.901 INFO:tasks.workunit.client.0.smithi017.stdout:5/710: chown d0/d14/d18/dcc 0 1 2024-09-20T18:36:10.901 INFO:tasks.workunit.client.0.smithi017.stdout:3/898: rmdir da/def/d113/d116 39 2024-09-20T18:36:10.902 INFO:tasks.workunit.client.0.smithi017.stdout:5/711: write d0/d14/d18/d1b/f5c [3000986,75779] 0 2024-09-20T18:36:10.904 INFO:tasks.workunit.client.0.smithi017.stdout:6/715: mkdir d4/df/d1f/df6 0 2024-09-20T18:36:10.905 INFO:tasks.workunit.client.0.smithi017.stdout:6/716: write d4/df/d4a/fc9 [26338,91427] 0 2024-09-20T18:36:10.908 INFO:tasks.workunit.client.0.smithi017.stdout:4/632: write d4/d19/d37/da1/d1b/f2f [967880,43917] 0 2024-09-20T18:36:10.917 INFO:tasks.workunit.client.0.smithi017.stdout:1/709: dwrite df/d35/f38 [0,4194304] 0 2024-09-20T18:36:10.921 INFO:tasks.workunit.client.0.smithi017.stdout:2/871: write d1/dc/d20/d2e/d30/d85/d3d/dad/fd1 [695728,26177] 0 2024-09-20T18:36:10.923 INFO:tasks.workunit.client.0.smithi017.stdout:1/710: truncate df/d1c/f75 3982449 0 2024-09-20T18:36:10.931 INFO:tasks.workunit.client.0.smithi017.stdout:5/712: write d0/d14/d18/d2a/d39/f53 [631826,123024] 0 2024-09-20T18:36:10.931 INFO:tasks.workunit.client.0.smithi017.stdout:4/633: symlink d4/d19/d37/dbc/d96/ld3 0 2024-09-20T18:36:10.932 INFO:tasks.workunit.client.0.smithi017.stdout:6/717: dread d4/d29/f45 [4194304,4194304] 0 2024-09-20T18:36:10.935 INFO:tasks.workunit.client.0.smithi017.stdout:2/872: dwrite d1/dc/d20/d2e/d30/d85/d3d/dad/fd1 [0,4194304] 0 2024-09-20T18:36:10.936 INFO:tasks.workunit.client.0.smithi017.stdout:4/634: symlink d4/d82/d88/ld4 0 2024-09-20T18:36:10.938 INFO:tasks.workunit.client.0.smithi017.stdout:6/718: stat d4/d37/fdf 0 2024-09-20T18:36:10.939 INFO:tasks.workunit.client.0.smithi017.stdout:5/713: creat d0/d14/d18/d19/d4d/db5/ff7 x:0 0 0 2024-09-20T18:36:10.941 INFO:tasks.workunit.client.0.smithi017.stdout:5/714: chown d0/c64 181930 1 2024-09-20T18:36:10.941 INFO:tasks.workunit.client.0.smithi017.stdout:4/635: creat d4/d82/d88/d5c/d8f/fd5 x:0 0 0 2024-09-20T18:36:10.941 INFO:tasks.workunit.client.0.smithi017.stdout:1/711: dread df/d35/d4f/d82/f99 [0,4194304] 0 2024-09-20T18:36:10.942 INFO:tasks.workunit.client.0.smithi017.stdout:5/715: stat d0/d14/c80 0 2024-09-20T18:36:10.946 INFO:tasks.workunit.client.0.smithi017.stdout:6/719: fsync d4/df/d1f/d25/dd7/f82 0 2024-09-20T18:36:10.946 INFO:tasks.workunit.client.0.smithi017.stdout:4/636: truncate d4/dc/d1e/d26/fb8 800419 0 2024-09-20T18:36:10.946 INFO:tasks.workunit.client.0.smithi017.stdout:5/716: write d0/d14/d18/d19/d4d/d6d/dbf/fe3 [29335,68649] 0 2024-09-20T18:36:10.948 INFO:tasks.workunit.client.0.smithi017.stdout:2/873: truncate d1/dc/d20/d2e/d30/d85/d3d/f44 4500763 0 2024-09-20T18:36:10.951 INFO:tasks.workunit.client.0.smithi017.stdout:1/712: rmdir df/d8f 39 2024-09-20T18:36:10.952 INFO:tasks.workunit.client.0.smithi017.stdout:6/720: mknod d4/d37/d68/dbb/cf7 0 2024-09-20T18:36:10.953 INFO:tasks.workunit.client.0.smithi017.stdout:5/717: write d0/f10 [2662321,8871] 0 2024-09-20T18:36:10.955 INFO:tasks.workunit.client.0.smithi017.stdout:5/718: fdatasync d0/d14/d18/d2a/fba 0 2024-09-20T18:36:10.956 INFO:tasks.workunit.client.0.smithi017.stdout:2/874: dread - d1/dc/d20/d2e/d30/d85/d53/d96/fcb zero size 2024-09-20T18:36:10.958 INFO:tasks.workunit.client.0.smithi017.stdout:5/719: symlink d0/d14/d18/d79/d9e/lf8 0 2024-09-20T18:36:10.958 INFO:tasks.workunit.client.0.smithi017.stdout:1/713: write df/d29/d2c/d5b/fb9 [1028634,111747] 0 2024-09-20T18:36:10.964 INFO:tasks.workunit.client.0.smithi017.stdout:6/721: link d4/df/d1f/f80 d4/d37/d68/d8d/ff8 0 2024-09-20T18:36:10.966 INFO:tasks.workunit.client.0.smithi017.stdout:1/714: creat df/d16/d50/d69/da5/fe3 x:0 0 0 2024-09-20T18:36:10.970 INFO:tasks.workunit.client.0.smithi017.stdout:4/637: link d4/d82/d88/d5c/d8f/da9/db4/cba d4/d19/d37/da1/d1b/cd6 0 2024-09-20T18:36:10.970 INFO:tasks.workunit.client.0.smithi017.stdout:6/722: rmdir d4/d29/df5/d43/d7d/dc2 39 2024-09-20T18:36:10.970 INFO:tasks.workunit.client.0.smithi017.stdout:4/638: dread - d4/d19/d37/d66/fc4 zero size 2024-09-20T18:36:10.973 INFO:tasks.workunit.client.0.smithi017.stdout:2/875: link d1/dc/l39 d1/dc/d20/d2e/d30/db0/dc2/l121 0 2024-09-20T18:36:10.977 INFO:tasks.workunit.client.0.smithi017.stdout:6/723: creat d4/d29/dc6/de7/ff9 x:0 0 0 2024-09-20T18:36:10.979 INFO:tasks.workunit.client.0.smithi017.stdout:4/639: dwrite d4/dc/d1e/d26/fad [0,4194304] 0 2024-09-20T18:36:10.981 INFO:tasks.workunit.client.0.smithi017.stdout:5/720: dwrite d0/d14/f20 [0,4194304] 0 2024-09-20T18:36:10.989 INFO:tasks.workunit.client.0.smithi017.stdout:6/724: dwrite d4/d29/fcb [0,4194304] 0 2024-09-20T18:36:10.991 INFO:tasks.workunit.client.0.smithi017.stdout:2/876: rename d1/dc/d20/d2e/d30/db0/dc2/f11e to d1/dc/d20/d2e/d30/f122 0 2024-09-20T18:36:10.994 INFO:tasks.workunit.client.0.smithi017.stdout:5/721: write d0/d14/d18/d2a/d39/d6c/f9f [976178,63647] 0 2024-09-20T18:36:10.996 INFO:tasks.workunit.client.0.smithi017.stdout:5/722: stat d0/d14/d18/d19/d4d/d6d/d78/d99/fb3 0 2024-09-20T18:36:10.999 INFO:tasks.workunit.client.0.smithi017.stdout:6/725: link d4/f8 d4/df/d1f/d25/d3f/ffa 0 2024-09-20T18:36:11.004 INFO:tasks.workunit.client.0.smithi017.stdout:5/723: dwrite d0/d14/d18/d19/d4d/db5/ff7 [0,4194304] 0 2024-09-20T18:36:11.006 INFO:tasks.workunit.client.0.smithi017.stdout:6/726: creat d4/df/ffb x:0 0 0 2024-09-20T18:36:11.007 INFO:tasks.workunit.client.0.smithi017.stdout:5/724: mkdir d0/dbe/df9 0 2024-09-20T18:36:11.009 INFO:tasks.workunit.client.0.smithi017.stdout:5/725: chown d0/d14/d18/d1b/fbc 286794 1 2024-09-20T18:36:11.021 INFO:tasks.workunit.client.0.smithi017.stdout:6/727: dread d4/d29/f45 [0,4194304] 0 2024-09-20T18:36:11.022 INFO:tasks.workunit.client.0.smithi017.stdout:6/728: readlink d4/le9 0 2024-09-20T18:36:11.025 INFO:tasks.workunit.client.0.smithi017.stdout:2/877: dread d1/dc/d20/d2e/d30/d85/d3d/d77/fac [0,4194304] 0 2024-09-20T18:36:11.025 INFO:tasks.workunit.client.0.smithi017.stdout:2/878: chown d1/fb 1 1 2024-09-20T18:36:11.030 INFO:tasks.workunit.client.0.smithi017.stdout:2/879: rename d1/df/c18 to d1/dc/d20/d2e/d30/d85/d3d/c123 0 2024-09-20T18:36:11.036 INFO:tasks.workunit.client.0.smithi017.stdout:2/880: write d1/dc/d20/ffa [965570,468] 0 2024-09-20T18:36:11.038 INFO:tasks.workunit.client.0.smithi017.stdout:2/881: mkdir d1/dc/d20/d2e/d30/d85/d3d/d77/d124 0 2024-09-20T18:36:11.042 INFO:tasks.workunit.client.0.smithi017.stdout:2/882: link d1/dc/d20/d2e/f42 d1/dc/d20/d2e/d30/d85/d3d/d77/d124/f125 0 2024-09-20T18:36:11.043 INFO:tasks.workunit.client.0.smithi017.stdout:2/883: dread - d1/dc/d20/d2e/d30/db0/df4/f120 zero size 2024-09-20T18:36:11.044 INFO:tasks.workunit.client.0.smithi017.stdout:2/884: chown d1/dc/d20/d2e/c8c 4763112 1 2024-09-20T18:36:11.045 INFO:tasks.workunit.client.0.smithi017.stdout:2/885: chown d1/dc/d20/d2e/d30/d85/f93 23 1 2024-09-20T18:36:11.057 INFO:tasks.workunit.client.0.smithi017.stdout:2/886: dwrite d1/df/f83 [0,4194304] 0 2024-09-20T18:36:11.092 INFO:tasks.workunit.client.0.smithi017.stdout:9/910: sync 2024-09-20T18:36:11.095 INFO:tasks.workunit.client.0.smithi017.stdout:2/887: write d1/dc/d20/d2e/db5/fe2 [634320,2172] 0 2024-09-20T18:36:11.099 INFO:tasks.workunit.client.0.smithi017.stdout:9/911: dread d6/f34 [4194304,4194304] 0 2024-09-20T18:36:11.099 INFO:tasks.workunit.client.0.smithi017.stdout:2/888: truncate d1/dc/d20/d2e/d30/d85/d53/fc4 4382919 0 2024-09-20T18:36:11.103 INFO:tasks.workunit.client.0.smithi017.stdout:2/889: dread d1/dc/d20/d2e/db5/fe2 [0,4194304] 0 2024-09-20T18:36:11.105 INFO:tasks.workunit.client.0.smithi017.stdout:2/890: truncate d1/dc/d20/d2e/d30/d85/f87 1735634 0 2024-09-20T18:36:11.107 INFO:tasks.workunit.client.0.smithi017.stdout:2/891: truncate d1/d67/d8f/d9e/f9f 2658877 0 2024-09-20T18:36:11.110 INFO:tasks.workunit.client.0.smithi017.stdout:2/892: mkdir d1/dc/d20/d2e/d30/d85/d126 0 2024-09-20T18:36:11.111 INFO:tasks.workunit.client.0.smithi017.stdout:2/893: mkdir d1/d1f/d127 0 2024-09-20T18:36:11.113 INFO:tasks.workunit.client.0.smithi017.stdout:2/894: write d1/d1f/d99/da6/f115 [225025,15464] 0 2024-09-20T18:36:11.123 INFO:tasks.workunit.client.0.smithi017.stdout:2/895: rmdir d1/dc/d20/d2e/d30/d85/d53/d96/d10b 39 2024-09-20T18:36:11.128 INFO:tasks.workunit.client.0.smithi017.stdout:2/896: symlink d1/dc/d20/d2e/d30/d85/d3d/d8d/d119/l128 0 2024-09-20T18:36:11.142 INFO:tasks.workunit.client.0.smithi017.stdout:2/897: dwrite d1/d67/d8f/fa4 [0,4194304] 0 2024-09-20T18:36:11.144 INFO:tasks.workunit.client.0.smithi017.stdout:2/898: dread - d1/dc/d20/d2e/d30/d85/d53/d96/f113 zero size 2024-09-20T18:36:11.147 INFO:tasks.workunit.client.0.smithi017.stdout:2/899: mkdir d1/dc/d20/d2e/d30/d85/d3d/d77/d7a/d109/d129 0 2024-09-20T18:36:11.148 INFO:tasks.workunit.client.0.smithi017.stdout:2/900: stat d1/dc/d20/d2e/d30/d8a 0 2024-09-20T18:36:11.155 INFO:tasks.workunit.client.0.smithi017.stdout:2/901: dwrite d1/d1f/f10c [0,4194304] 0 2024-09-20T18:36:11.161 INFO:tasks.workunit.client.0.smithi017.stdout:2/902: rmdir d1/dc/d20/d2e/d30/d85/d3d/d8d 39 2024-09-20T18:36:11.175 INFO:tasks.workunit.client.0.smithi017.stdout:2/903: dread d1/dc/d20/d2e/d30/d85/d46/d48/f90 [0,4194304] 0 2024-09-20T18:36:11.180 INFO:tasks.workunit.client.0.smithi017.stdout:2/904: getdents d1/d67/d8f 0 2024-09-20T18:36:11.185 INFO:tasks.workunit.client.0.smithi017.stdout:2/905: link d1/dc/d20/d2e/d30/d85/d3d/cce d1/d1f/d127/c12a 0 2024-09-20T18:36:11.191 INFO:tasks.workunit.client.0.smithi017.stdout:2/906: write d1/dc/d20/d2e/d30/d85/d53/d96/fb2 [3530471,39072] 0 2024-09-20T18:36:11.207 INFO:tasks.workunit.client.0.smithi017.stdout:2/907: dread d1/dc/d20/d2e/d30/d85/fd5 [0,4194304] 0 2024-09-20T18:36:11.210 INFO:tasks.workunit.client.0.smithi017.stdout:2/908: rmdir d1/dc/d20/d2e/db5 39 2024-09-20T18:36:11.211 INFO:tasks.workunit.client.0.smithi017.stdout:2/909: dread - d1/d1f/d99/da6/f100 zero size 2024-09-20T18:36:11.213 INFO:tasks.workunit.client.0.smithi017.stdout:2/910: fdatasync d1/dc/d20/d2e/d30/d85/f87 0 2024-09-20T18:36:11.216 INFO:tasks.workunit.client.0.smithi017.stdout:2/911: rename d1/f92 to d1/dc/d20/d2e/d30/d8a/ddf/f12b 0 2024-09-20T18:36:11.217 INFO:tasks.workunit.client.0.smithi017.stdout:2/912: fdatasync d1/dc/d20/d2e/d30/f4b 0 2024-09-20T18:36:11.220 INFO:tasks.workunit.client.0.smithi017.stdout:2/913: rename d1/d6c/cd2 to d1/dc/d20/d2e/d30/d85/d3d/d77/d7a/d109/c12c 0 2024-09-20T18:36:11.634 INFO:tasks.workunit.client.0.smithi017.stdout:7/671: sync 2024-09-20T18:36:11.665 INFO:tasks.workunit.client.0.smithi017.stdout:7/672: mkdir da/d16/d1c/d40/d34/dcd 0 2024-09-20T18:36:11.670 INFO:tasks.workunit.client.0.smithi017.stdout:7/673: dwrite da/d16/d1c/d40/d30/f56 [0,4194304] 0 2024-09-20T18:36:11.686 INFO:tasks.workunit.client.0.smithi017.stdout:7/674: dwrite da/f8d [0,4194304] 0 2024-09-20T18:36:11.700 INFO:tasks.workunit.client.0.smithi017.stdout:7/675: rename da/d16/d1c/d40/d34/f6e to da/d16/d1c/d40/d34/d3c/fce 0 2024-09-20T18:36:11.703 INFO:tasks.workunit.client.0.smithi017.stdout:7/676: truncate da/d16/d8e/d75/f28 2617972 0 2024-09-20T18:36:11.705 INFO:tasks.workunit.client.0.smithi017.stdout:7/677: mknod da/d16/d1c/d40/ccf 0 2024-09-20T18:36:11.706 INFO:tasks.workunit.client.0.smithi017.stdout:7/678: stat da/d16/d1c/d40/d34/d3c/c6a 0 2024-09-20T18:36:11.710 INFO:tasks.workunit.client.0.smithi017.stdout:7/679: mknod da/d16/d1c/d40/d34/dcd/cd0 0 2024-09-20T18:36:11.713 INFO:tasks.workunit.client.0.smithi017.stdout:7/680: fdatasync da/d16/d1c/d40/d5d/f9f 0 2024-09-20T18:36:11.727 INFO:tasks.workunit.client.0.smithi017.stdout:7/681: write da/d16/d1c/f1f [3021682,48622] 0 2024-09-20T18:36:11.730 INFO:tasks.workunit.client.0.smithi017.stdout:7/682: creat da/d94/fd1 x:0 0 0 2024-09-20T18:36:11.732 INFO:tasks.workunit.client.0.smithi017.stdout:7/683: mkdir da/dd2 0 2024-09-20T18:36:11.746 INFO:tasks.workunit.client.0.smithi017.stdout:7/684: dread da/d16/d1c/d40/f7d [0,4194304] 0 2024-09-20T18:36:11.747 INFO:tasks.workunit.client.0.smithi017.stdout:7/685: symlink da/d94/ld3 0 2024-09-20T18:36:11.749 INFO:tasks.workunit.client.0.smithi017.stdout:7/686: mknod da/d94/cd4 0 2024-09-20T18:36:11.749 INFO:tasks.workunit.client.0.smithi017.stdout:7/687: stat da/d16/d1c/d40/d34/d96/caf 0 2024-09-20T18:36:11.750 INFO:tasks.workunit.client.0.smithi017.stdout:7/688: chown da/d16/d1c/d40/d3a/da9/fc8 18888 1 2024-09-20T18:36:11.752 INFO:tasks.workunit.client.0.smithi017.stdout:7/689: creat da/d16/d92/fd5 x:0 0 0 2024-09-20T18:36:11.753 INFO:tasks.workunit.client.0.smithi017.stdout:7/690: read - da/d16/f9c zero size 2024-09-20T18:36:11.757 INFO:tasks.workunit.client.0.smithi017.stdout:7/691: getdents da/d16/d8e 0 2024-09-20T18:36:11.760 INFO:tasks.workunit.client.0.smithi017.stdout:7/692: dread da/f8d [0,4194304] 0 2024-09-20T18:36:11.764 INFO:tasks.workunit.client.0.smithi017.stdout:7/693: rename da/d16/f4a to da/d16/d1c/d40/d34/d96/fd6 0 2024-09-20T18:36:11.765 INFO:tasks.workunit.client.0.smithi017.stdout:7/694: chown da/d16/d1c/d40/d34/dcd 486185407 1 2024-09-20T18:36:11.766 INFO:tasks.workunit.client.0.smithi017.stdout:7/695: symlink da/d16/ld7 0 2024-09-20T18:36:11.768 INFO:tasks.workunit.client.0.smithi017.stdout:7/696: write da/d16/d1c/d40/d3a/f93 [743104,128314] 0 2024-09-20T18:36:11.769 INFO:tasks.workunit.client.0.smithi017.stdout:1/715: sync 2024-09-20T18:36:11.769 INFO:tasks.workunit.client.0.smithi017.stdout:0/659: sync 2024-09-20T18:36:11.769 INFO:tasks.workunit.client.0.smithi017.stdout:8/598: sync 2024-09-20T18:36:11.769 INFO:tasks.workunit.client.0.smithi017.stdout:3/899: sync 2024-09-20T18:36:11.770 INFO:tasks.workunit.client.0.smithi017.stdout:0/660: chown d4/d37/la3 559329 1 2024-09-20T18:36:11.774 INFO:tasks.workunit.client.0.smithi017.stdout:7/697: creat da/d16/d1c/d40/d34/d3c/fd8 x:0 0 0 2024-09-20T18:36:11.779 INFO:tasks.workunit.client.0.smithi017.stdout:3/900: symlink da/de/d13/d16/l12d 0 2024-09-20T18:36:11.782 INFO:tasks.workunit.client.0.smithi017.stdout:0/661: symlink d4/db/d18/d55/lde 0 2024-09-20T18:36:11.784 INFO:tasks.workunit.client.0.smithi017.stdout:7/698: read da/d16/d1c/d40/d30/f87 [35425,89284] 0 2024-09-20T18:36:11.787 INFO:tasks.workunit.client.0.smithi017.stdout:1/716: rename df/d35/f38 to df/d35/d6b/fe4 0 2024-09-20T18:36:11.788 INFO:tasks.workunit.client.0.smithi017.stdout:3/901: creat da/de/d13/d2f/d26/d62/da5/da9/dbb/f12e x:0 0 0 2024-09-20T18:36:11.790 INFO:tasks.workunit.client.0.smithi017.stdout:0/662: rmdir d4/db/dcd/d52/d77 39 2024-09-20T18:36:11.792 INFO:tasks.workunit.client.0.smithi017.stdout:8/599: creat d0/fc8 x:0 0 0 2024-09-20T18:36:11.793 INFO:tasks.workunit.client.0.smithi017.stdout:7/699: symlink da/d16/d1c/d40/d34/d96/ld9 0 2024-09-20T18:36:11.797 INFO:tasks.workunit.client.0.smithi017.stdout:3/902: fsync da/f58 0 2024-09-20T18:36:11.807 INFO:tasks.workunit.client.0.smithi017.stdout:0/663: fdatasync d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/f5f 0 2024-09-20T18:36:11.809 INFO:tasks.workunit.client.0.smithi017.stdout:8/600: creat d0/d65/d8b/db4/fc9 x:0 0 0 2024-09-20T18:36:11.811 INFO:tasks.workunit.client.0.smithi017.stdout:7/700: rename da/d16/d1c/d40/d30/c6c to da/d16/d1c/dc9/cda 0 2024-09-20T18:36:11.815 INFO:tasks.workunit.client.0.smithi017.stdout:0/664: symlink d4/db/d18/d25/d36/d47/d81/d9c/ldf 0 2024-09-20T18:36:11.818 INFO:tasks.workunit.client.0.smithi017.stdout:0/665: write d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/fc5 [193780,13162] 0 2024-09-20T18:36:11.820 INFO:tasks.workunit.client.0.smithi017.stdout:5/726: sync 2024-09-20T18:36:11.820 INFO:tasks.workunit.client.0.smithi017.stdout:6/729: sync 2024-09-20T18:36:11.820 INFO:tasks.workunit.client.0.smithi017.stdout:2/914: sync 2024-09-20T18:36:11.820 INFO:tasks.workunit.client.0.smithi017.stdout:9/912: sync 2024-09-20T18:36:11.821 INFO:tasks.workunit.client.0.smithi017.stdout:4/640: sync 2024-09-20T18:36:11.821 INFO:tasks.workunit.client.0.smithi017.stdout:8/601: mknod d0/d6/d28/d3b/cca 0 2024-09-20T18:36:11.823 INFO:tasks.workunit.client.0.smithi017.stdout:3/903: getdents da/de/d13/d16/d6e/d82/df8 0 2024-09-20T18:36:11.823 INFO:tasks.workunit.client.0.smithi017.stdout:1/717: getdents df/d1c 0 2024-09-20T18:36:11.824 INFO:tasks.workunit.client.0.smithi017.stdout:5/727: dread - d0/d14/d18/dcc/fd6 zero size 2024-09-20T18:36:11.826 INFO:tasks.workunit.client.0.smithi017.stdout:6/730: mkdir d4/d29/df5/d43/dfc 0 2024-09-20T18:36:11.827 INFO:tasks.workunit.client.0.smithi017.stdout:7/701: dread da/d54/f71 [0,4194304] 0 2024-09-20T18:36:11.827 INFO:tasks.workunit.client.0.smithi017.stdout:4/641: write d4/d19/f7e [51203,64267] 0 2024-09-20T18:36:11.828 INFO:tasks.workunit.client.0.smithi017.stdout:1/718: read df/d1c/f70 [331784,52755] 0 2024-09-20T18:36:11.828 INFO:tasks.workunit.client.0.smithi017.stdout:8/602: creat d0/d65/d8b/db5/fcb x:0 0 0 2024-09-20T18:36:11.829 INFO:tasks.workunit.client.0.smithi017.stdout:0/666: rename d4/db/d18/d25/d36/d47/d8c/daa/dca to d4/db/d18/d25/d36/d47/d8c/daa/dca/de0 22 2024-09-20T18:36:11.830 INFO:tasks.workunit.client.0.smithi017.stdout:3/904: dread - da/de/d13/d2f/d26/d31/d5a/d76/de6/fe8 zero size 2024-09-20T18:36:11.833 INFO:tasks.workunit.client.0.smithi017.stdout:0/667: write d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/f80 [4183754,16153] 0 2024-09-20T18:36:11.834 INFO:tasks.workunit.client.0.smithi017.stdout:9/913: truncate d6/d23/f51 1791825 0 2024-09-20T18:36:11.842 INFO:tasks.workunit.client.0.smithi017.stdout:8/603: creat d0/d6/d28/d3d/d4e/d55/fcc x:0 0 0 2024-09-20T18:36:11.842 INFO:tasks.workunit.client.0.smithi017.stdout:2/915: dwrite d1/dc/d20/d2e/f5f [0,4194304] 0 2024-09-20T18:36:11.848 INFO:tasks.workunit.client.0.smithi017.stdout:4/642: rename d4/d19/f63 to d4/d19/d37/dbc/d96/fd7 0 2024-09-20T18:36:11.851 INFO:tasks.workunit.client.0.smithi017.stdout:7/702: dwrite da/d54/fa6 [0,4194304] 0 2024-09-20T18:36:11.852 INFO:tasks.workunit.client.0.smithi017.stdout:7/703: readlink da/d16/d1c/d40/l5b 0 2024-09-20T18:36:11.855 INFO:tasks.workunit.client.0.smithi017.stdout:0/668: symlink d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/le1 0 2024-09-20T18:36:11.856 INFO:tasks.workunit.client.0.smithi017.stdout:1/719: fsync df/f33 0 2024-09-20T18:36:11.857 INFO:tasks.workunit.client.0.smithi017.stdout:0/669: truncate d4/db/d18/d25/fd8 895070 0 2024-09-20T18:36:11.858 INFO:tasks.workunit.client.0.smithi017.stdout:1/720: truncate df/d29/d7e/fd7 753419 0 2024-09-20T18:36:11.861 INFO:tasks.workunit.client.0.smithi017.stdout:8/604: creat d0/d6/d28/d3a/fcd x:0 0 0 2024-09-20T18:36:11.866 INFO:tasks.workunit.client.0.smithi017.stdout:1/721: dread df/d16/d50/d69/f8c [0,4194304] 0 2024-09-20T18:36:11.866 INFO:tasks.workunit.client.0.smithi017.stdout:3/905: creat da/de/d13/d16/d6e/ddf/de9/d127/f12f x:0 0 0 2024-09-20T18:36:11.867 INFO:tasks.workunit.client.0.smithi017.stdout:3/906: chown da/de/d13/d16/l3a 15628917 1 2024-09-20T18:36:11.869 INFO:tasks.workunit.client.0.smithi017.stdout:7/704: truncate da/d16/d1c/d40/d5d/da7/fb6 2807446 0 2024-09-20T18:36:11.870 INFO:tasks.workunit.client.0.smithi017.stdout:6/731: creat d4/df/d1f/d25/dca/ffd x:0 0 0 2024-09-20T18:36:11.872 INFO:tasks.workunit.client.0.smithi017.stdout:0/670: creat d4/db/dcd/fe2 x:0 0 0 2024-09-20T18:36:11.876 INFO:tasks.workunit.client.0.smithi017.stdout:5/728: getdents d0 0 2024-09-20T18:36:11.876 INFO:tasks.workunit.client.0.smithi017.stdout:2/916: creat d1/dc/d20/d2e/d30/d85/d3d/d77/d7a/d109/d129/f12d x:0 0 0 2024-09-20T18:36:11.884 INFO:tasks.workunit.client.0.smithi017.stdout:2/917: chown d1/dc/d20/d2e/d30/d85/d53/d6b 0 1 2024-09-20T18:36:11.884 INFO:tasks.workunit.client.0.smithi017.stdout:1/722: fsync df/d29/f3a 0 2024-09-20T18:36:11.884 INFO:tasks.workunit.client.0.smithi017.stdout:7/705: mknod da/d16/d1c/d40/d34/dcd/cdb 0 2024-09-20T18:36:11.884 INFO:tasks.workunit.client.0.smithi017.stdout:2/918: write d1/d67/d8f/d9e/f108 [1553802,34695] 0 2024-09-20T18:36:11.884 INFO:tasks.workunit.client.0.smithi017.stdout:5/729: dread d0/d14/d18/d19/d4d/db5/dc0/f95 [0,4194304] 0 2024-09-20T18:36:11.886 INFO:tasks.workunit.client.0.smithi017.stdout:3/907: truncate da/de/d13/d2f/d26/d31/d5a/d76/d19/f9c 2023038 0 2024-09-20T18:36:11.886 INFO:tasks.workunit.client.0.smithi017.stdout:5/730: chown d0/d14/d18/ld0 2672133 1 2024-09-20T18:36:11.889 INFO:tasks.workunit.client.0.smithi017.stdout:1/723: dwrite df/d1c/f3c [0,4194304] 0 2024-09-20T18:36:11.891 INFO:tasks.workunit.client.0.smithi017.stdout:5/731: truncate d0/d14/d18/d2a/da1/fb1 649357 0 2024-09-20T18:36:11.897 INFO:tasks.workunit.client.0.smithi017.stdout:6/732: dread d4/df/d8a/fbe [0,4194304] 0 2024-09-20T18:36:11.898 INFO:tasks.workunit.client.0.smithi017.stdout:2/919: write d1/fc3 [144577,36169] 0 2024-09-20T18:36:11.900 INFO:tasks.workunit.client.0.smithi017.stdout:0/671: creat d4/db/dcd/d52/d77/daf/fe3 x:0 0 0 2024-09-20T18:36:11.902 INFO:tasks.workunit.client.0.smithi017.stdout:9/914: dread d6/d23/f51 [0,4194304] 0 2024-09-20T18:36:11.903 INFO:tasks.workunit.client.0.smithi017.stdout:8/605: creat d0/d6/d28/d3d/fce x:0 0 0 2024-09-20T18:36:11.905 INFO:tasks.workunit.client.0.smithi017.stdout:4/643: getdents d4/d7f 0 2024-09-20T18:36:11.907 INFO:tasks.workunit.client.0.smithi017.stdout:1/724: creat df/d16/d50/fe5 x:0 0 0 2024-09-20T18:36:11.907 INFO:tasks.workunit.client.0.smithi017.stdout:5/732: mknod d0/d14/d18/d57/db6/cfa 0 2024-09-20T18:36:11.911 INFO:tasks.workunit.client.0.smithi017.stdout:0/672: truncate d4/db/fba 174456 0 2024-09-20T18:36:11.914 INFO:tasks.workunit.client.0.smithi017.stdout:9/915: readlink d6/d23/d58/d3f/l6a 0 2024-09-20T18:36:11.915 INFO:tasks.workunit.client.0.smithi017.stdout:8/606: creat d0/d6/d28/d3a/dae/fcf x:0 0 0 2024-09-20T18:36:11.919 INFO:tasks.workunit.client.0.smithi017.stdout:1/725: chown df/f1a 201 1 2024-09-20T18:36:11.920 INFO:tasks.workunit.client.0.smithi017.stdout:1/726: write df/d16/d50/d53/f67 [3201207,104148] 0 2024-09-20T18:36:11.921 INFO:tasks.workunit.client.0.smithi017.stdout:5/733: creat d0/d14/d18/d19/d4d/d6d/dbf/ffb x:0 0 0 2024-09-20T18:36:11.922 INFO:tasks.workunit.client.0.smithi017.stdout:7/706: link da/d16/d1c/d40/d30/d98/c99 da/d16/d1c/d40/d34/d3c/cdc 0 2024-09-20T18:36:11.923 INFO:tasks.workunit.client.0.smithi017.stdout:4/644: dread d4/d19/d37/f57 [0,4194304] 0 2024-09-20T18:36:11.924 INFO:tasks.workunit.client.0.smithi017.stdout:6/733: symlink d4/d29/df5/d43/dfc/lfe 0 2024-09-20T18:36:11.924 INFO:tasks.workunit.client.0.smithi017.stdout:4/645: chown d4/dc/l85 3110056 1 2024-09-20T18:36:11.929 INFO:tasks.workunit.client.0.smithi017.stdout:8/607: rename d0/d6/f3e to d0/d6/d28/d81/d82/fd0 0 2024-09-20T18:36:11.929 INFO:tasks.workunit.client.0.smithi017.stdout:2/920: dwrite d1/dc/d20/d2e/d30/d85/d53/fb7 [0,4194304] 0 2024-09-20T18:36:11.937 INFO:tasks.workunit.client.0.smithi017.stdout:8/608: dwrite d0/d6/d28/d3d/f4a [0,4194304] 0 2024-09-20T18:36:11.938 INFO:tasks.workunit.client.0.smithi017.stdout:8/609: chown d0/d65/c94 4456411 1 2024-09-20T18:36:11.939 INFO:tasks.workunit.client.0.smithi017.stdout:0/673: symlink d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/le4 0 2024-09-20T18:36:11.944 INFO:tasks.workunit.client.0.smithi017.stdout:1/727: creat df/d3b/d7c/fe6 x:0 0 0 2024-09-20T18:36:11.948 INFO:tasks.workunit.client.0.smithi017.stdout:8/610: rmdir d0/d6 39 2024-09-20T18:36:11.951 INFO:tasks.workunit.client.0.smithi017.stdout:9/916: creat d6/d23/d40/de2/f146 x:0 0 0 2024-09-20T18:36:11.952 INFO:tasks.workunit.client.0.smithi017.stdout:0/674: rmdir d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f 39 2024-09-20T18:36:11.955 INFO:tasks.workunit.client.0.smithi017.stdout:2/921: symlink d1/dc/d20/l12e 0 2024-09-20T18:36:11.956 INFO:tasks.workunit.client.0.smithi017.stdout:9/917: truncate d6/d23/d58/d3f/d4d/d73/d8f/f99 1854798 0 2024-09-20T18:36:11.957 INFO:tasks.workunit.client.0.smithi017.stdout:1/728: creat df/d35/d4f/d82/da6/fe7 x:0 0 0 2024-09-20T18:36:11.962 INFO:tasks.workunit.client.0.smithi017.stdout:4/646: rename d4/d19/d37/da1/d1b/f33 to d4/d19/fd8 0 2024-09-20T18:36:11.963 INFO:tasks.workunit.client.0.smithi017.stdout:0/675: dwrite d4/db/d18/d55/fc4 [0,4194304] 0 2024-09-20T18:36:11.963 INFO:tasks.workunit.client.0.smithi017.stdout:8/611: chown d0/d6/d28/d3d/f4a 147352485 1 2024-09-20T18:36:11.965 INFO:tasks.workunit.client.0.smithi017.stdout:1/729: truncate df/d1c/d45/fd8 179499 0 2024-09-20T18:36:11.967 INFO:tasks.workunit.client.0.smithi017.stdout:5/734: getdents d0/d14/d18/d19/d4d/d6d/db7 0 2024-09-20T18:36:11.973 INFO:tasks.workunit.client.0.smithi017.stdout:2/922: dwrite d1/dc/d20/d2e/d30/d85/f87 [0,4194304] 0 2024-09-20T18:36:11.976 INFO:tasks.workunit.client.0.smithi017.stdout:5/735: read d0/d14/d18/d2a/d39/d6c/d72/f16 [1770864,33447] 0 2024-09-20T18:36:11.976 INFO:tasks.workunit.client.0.smithi017.stdout:4/647: readlink d4/l5 0 2024-09-20T18:36:11.979 INFO:tasks.workunit.client.0.smithi017.stdout:9/918: truncate d6/d23/d58/d3f/d4d/d73/fe5 2274624 0 2024-09-20T18:36:11.980 INFO:tasks.workunit.client.0.smithi017.stdout:1/730: dwrite df/d1c/f1e [4194304,4194304] 0 2024-09-20T18:36:11.981 INFO:tasks.workunit.client.0.smithi017.stdout:7/707: truncate da/d16/f47 361995 0 2024-09-20T18:36:11.983 INFO:tasks.workunit.client.0.smithi017.stdout:4/648: truncate d4/dc/d41/fbd 66739 0 2024-09-20T18:36:11.987 INFO:tasks.workunit.client.0.smithi017.stdout:5/736: mknod d0/d14/d18/d2a/d39/de1/cfc 0 2024-09-20T18:36:11.990 INFO:tasks.workunit.client.0.smithi017.stdout:9/919: symlink d6/d23/d58/d3f/d44/l147 0 2024-09-20T18:36:11.991 INFO:tasks.workunit.client.0.smithi017.stdout:9/920: stat d6/d23/f54 0 2024-09-20T18:36:11.993 INFO:tasks.workunit.client.0.smithi017.stdout:2/923: creat d1/dc/d20/d2e/d30/d85/d3d/d77/d7a/d109/d129/f12f x:0 0 0 2024-09-20T18:36:11.994 INFO:tasks.workunit.client.0.smithi017.stdout:1/731: creat df/d16/d50/d69/d62/da7/fe8 x:0 0 0 2024-09-20T18:36:11.995 INFO:tasks.workunit.client.0.smithi017.stdout:1/732: dread - df/d1c/d45/dcc/fd4 zero size 2024-09-20T18:36:11.995 INFO:tasks.workunit.client.0.smithi017.stdout:7/708: mknod da/d16/d92/cdd 0 2024-09-20T18:36:11.997 INFO:tasks.workunit.client.0.smithi017.stdout:4/649: mkdir d4/d19/d37/dd9 0 2024-09-20T18:36:11.999 INFO:tasks.workunit.client.0.smithi017.stdout:5/737: truncate d0/d14/d18/d2a/d39/d42/f49 8355933 0 2024-09-20T18:36:12.000 INFO:tasks.workunit.client.0.smithi017.stdout:9/921: rmdir d6/d23/d58/d3f/d70/dd9 39 2024-09-20T18:36:12.001 INFO:tasks.workunit.client.0.smithi017.stdout:8/612: dread d0/d6/f38 [0,4194304] 0 2024-09-20T18:36:12.001 INFO:tasks.workunit.client.0.smithi017.stdout:2/924: fsync d1/df/f71 0 2024-09-20T18:36:12.004 INFO:tasks.workunit.client.0.smithi017.stdout:7/709: truncate da/d16/d1c/d40/f80 856788 0 2024-09-20T18:36:12.007 INFO:tasks.workunit.client.0.smithi017.stdout:8/613: mkdir d0/d6/d93/dd1 0 2024-09-20T18:36:12.011 INFO:tasks.workunit.client.0.smithi017.stdout:1/733: creat df/d35/d6b/dc2/fe9 x:0 0 0 2024-09-20T18:36:12.013 INFO:tasks.workunit.client.0.smithi017.stdout:1/734: stat df/d35/d4f/d82/da6/fe7 0 2024-09-20T18:36:12.013 INFO:tasks.workunit.client.0.smithi017.stdout:2/925: read - d1/dc/d20/d2e/d30/db0/dc2/fe4 zero size 2024-09-20T18:36:12.015 INFO:tasks.workunit.client.0.smithi017.stdout:7/710: truncate da/d16/d92/f9b 965005 0 2024-09-20T18:36:12.017 INFO:tasks.workunit.client.0.smithi017.stdout:5/738: mkdir d0/d14/d18/dfd 0 2024-09-20T18:36:12.019 INFO:tasks.workunit.client.0.smithi017.stdout:8/614: rename d0/d6/d28/d3d/d4e/d55/d83/cc0 to d0/d6/d28/d3b/d72/cd2 0 2024-09-20T18:36:12.021 INFO:tasks.workunit.client.0.smithi017.stdout:1/735: dwrite df/d1c/d45/fd8 [0,4194304] 0 2024-09-20T18:36:12.023 INFO:tasks.workunit.client.0.smithi017.stdout:2/926: unlink d1/df/f83 0 2024-09-20T18:36:12.025 INFO:tasks.workunit.client.0.smithi017.stdout:5/739: fdatasync d0/d14/d18/d2a/d39/d6c/fc5 0 2024-09-20T18:36:12.026 INFO:tasks.workunit.client.0.smithi017.stdout:8/615: unlink d0/l2e 0 2024-09-20T18:36:12.033 INFO:tasks.workunit.client.0.smithi017.stdout:5/740: rmdir d0/d14/d18/dd1 39 2024-09-20T18:36:12.035 INFO:tasks.workunit.client.0.smithi017.stdout:5/741: dread - d0/d14/d18/d2a/d39/d42/fe8 zero size 2024-09-20T18:36:12.036 INFO:tasks.workunit.client.0.smithi017.stdout:4/650: dwrite d4/d19/d37/da1/d1b/f8d [4194304,4194304] 0 2024-09-20T18:36:12.042 INFO:tasks.workunit.client.0.smithi017.stdout:1/736: rename df/d35/d4f/d82/c78 to df/d29/cea 0 2024-09-20T18:36:12.048 INFO:tasks.workunit.client.0.smithi017.stdout:5/742: mknod d0/d14/d18/d2a/d39/d6c/cfe 0 2024-09-20T18:36:12.051 INFO:tasks.workunit.client.0.smithi017.stdout:7/711: link da/d16/d1c/d40/d34/dcd/cdb da/d16/d1c/d40/d34/cde 0 2024-09-20T18:36:12.057 INFO:tasks.workunit.client.0.smithi017.stdout:8/616: write d0/d6/f20 [408725,82552] 0 2024-09-20T18:36:12.059 INFO:tasks.workunit.client.0.smithi017.stdout:4/651: rename d4/d19/d37/da1/c29 to d4/d19/d37/dd9/cda 0 2024-09-20T18:36:12.060 INFO:tasks.workunit.client.0.smithi017.stdout:1/737: symlink df/d35/leb 0 2024-09-20T18:36:12.061 INFO:tasks.workunit.client.0.smithi017.stdout:1/738: chown c6 189 1 2024-09-20T18:36:12.061 INFO:tasks.workunit.client.0.smithi017.stdout:2/927: getdents d1/dc/d20/d2e/db5 0 2024-09-20T18:36:12.062 INFO:tasks.workunit.client.0.smithi017.stdout:1/739: write df/d16/d50/dab/fbb [800697,50121] 0 2024-09-20T18:36:12.067 INFO:tasks.workunit.client.0.smithi017.stdout:5/743: creat d0/d14/d18/d2a/fff x:0 0 0 2024-09-20T18:36:12.068 INFO:tasks.workunit.client.0.smithi017.stdout:2/928: dwrite d1/dc/d20/d2e/d30/f4b [0,4194304] 0 2024-09-20T18:36:12.069 INFO:tasks.workunit.client.0.smithi017.stdout:1/740: unlink df/d16/d50/d69/d62/f81 0 2024-09-20T18:36:12.070 INFO:tasks.workunit.client.0.smithi017.stdout:5/744: write d0/d14/d18/d19/d4d/d6d/dbf/ffb [970985,850] 0 2024-09-20T18:36:12.071 INFO:tasks.workunit.client.0.smithi017.stdout:8/617: unlink d0/d6/d28/d3b/c4b 0 2024-09-20T18:36:12.072 INFO:tasks.workunit.client.0.smithi017.stdout:2/929: chown d1/dc/d20/d2e/d30/db0/cc5 2076659 1 2024-09-20T18:36:12.075 INFO:tasks.workunit.client.0.smithi017.stdout:4/652: unlink d4/c52 0 2024-09-20T18:36:12.077 INFO:tasks.workunit.client.0.smithi017.stdout:8/618: rmdir d0/d6/d28/d3d 39 2024-09-20T18:36:12.078 INFO:tasks.workunit.client.0.smithi017.stdout:5/745: truncate d0/d14/d18/d19/d4d/db5/dc0/f93 1197873 0 2024-09-20T18:36:12.081 INFO:tasks.workunit.client.0.smithi017.stdout:5/746: chown d0/d14/c69 64109329 1 2024-09-20T18:36:12.081 INFO:tasks.workunit.client.0.smithi017.stdout:2/930: mknod d1/dc/d20/d2e/d30/d85/d53/d6b/c130 0 2024-09-20T18:36:12.081 INFO:tasks.workunit.client.0.smithi017.stdout:7/712: dwrite da/d16/d1c/f1d [0,4194304] 0 2024-09-20T18:36:12.085 INFO:tasks.workunit.client.0.smithi017.stdout:8/619: mkdir d0/d6/d28/d3b/d72/dd3 0 2024-09-20T18:36:12.089 INFO:tasks.workunit.client.0.smithi017.stdout:4/653: mknod d4/d7f/dc2/cdb 0 2024-09-20T18:36:12.090 INFO:tasks.workunit.client.0.smithi017.stdout:7/713: dread da/d16/d1c/d40/f7a [0,4194304] 0 2024-09-20T18:36:12.092 INFO:tasks.workunit.client.0.smithi017.stdout:5/747: dwrite d0/d14/d18/d19/d4d/d6d/dbf/fe4 [0,4194304] 0 2024-09-20T18:36:12.092 INFO:tasks.workunit.client.0.smithi017.stdout:1/741: getdents df/d29/d2c 0 2024-09-20T18:36:12.099 INFO:tasks.workunit.client.0.smithi017.stdout:7/714: mkdir da/d16/d8e/ddf 0 2024-09-20T18:36:12.101 INFO:tasks.workunit.client.0.smithi017.stdout:1/742: dwrite df/d16/d50/dab/fc3 [0,4194304] 0 2024-09-20T18:36:12.111 INFO:tasks.workunit.client.0.smithi017.stdout:2/931: link d1/df/fa8 d1/dc/d20/d2e/d30/d85/d3d/d77/d7a/d109/f131 0 2024-09-20T18:36:12.114 INFO:tasks.workunit.client.0.smithi017.stdout:1/743: symlink df/lec 0 2024-09-20T18:36:12.115 INFO:tasks.workunit.client.0.smithi017.stdout:1/744: dread - df/d16/d50/fe5 zero size 2024-09-20T18:36:12.118 INFO:tasks.workunit.client.0.smithi017.stdout:7/715: link da/d94/fd1 da/d16/d1c/d40/fe0 0 2024-09-20T18:36:12.121 INFO:tasks.workunit.client.0.smithi017.stdout:8/620: write d0/d6/f74 [370325,103615] 0 2024-09-20T18:36:12.122 INFO:tasks.workunit.client.0.smithi017.stdout:8/621: chown d0/d6/d28/d81/d9c 11 1 2024-09-20T18:36:12.124 INFO:tasks.workunit.client.0.smithi017.stdout:8/622: read d0/d6/d28/f29 [1162948,37452] 0 2024-09-20T18:36:12.125 INFO:tasks.workunit.client.0.smithi017.stdout:7/716: dwrite da/d16/d1c/d40/d34/d3c/f48 [0,4194304] 0 2024-09-20T18:36:12.131 INFO:tasks.workunit.client.0.smithi017.stdout:5/748: dwrite d0/d14/d18/d2a/d39/d6c/fc5 [4194304,4194304] 0 2024-09-20T18:36:12.132 INFO:tasks.workunit.client.0.smithi017.stdout:7/717: symlink da/d16/d1c/d40/d34/dcd/le1 0 2024-09-20T18:36:12.136 INFO:tasks.workunit.client.0.smithi017.stdout:4/654: dwrite d4/f4b [0,4194304] 0 2024-09-20T18:36:12.137 INFO:tasks.workunit.client.0.smithi017.stdout:2/932: write d1/dc/d20/d2e/d30/d85/fd8 [1853255,61634] 0 2024-09-20T18:36:12.140 INFO:tasks.workunit.client.0.smithi017.stdout:2/933: dread - d1/dc/d20/d2e/d30/d85/d53/d96/fcb zero size 2024-09-20T18:36:12.144 INFO:tasks.workunit.client.0.smithi017.stdout:2/934: fsync d1/d67/d8f/dcd/fd4 0 2024-09-20T18:36:12.145 INFO:tasks.workunit.client.0.smithi017.stdout:7/718: dwrite da/d16/d92/fd5 [0,4194304] 0 2024-09-20T18:36:12.145 INFO:tasks.workunit.client.0.smithi017.stdout:2/935: stat d1/dc/d20/d2e/d30/fd3 0 2024-09-20T18:36:12.147 INFO:tasks.workunit.client.0.smithi017.stdout:2/936: fsync d1/dc/d20/d2e/d30/d85/d3d/dad/fd1 0 2024-09-20T18:36:12.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:11 smithi017 ceph-mon[28058]: pgmap v40: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 34 MiB/s rd, 102 MiB/s wr, 255 op/s 2024-09-20T18:36:12.151 INFO:tasks.workunit.client.0.smithi017.stdout:7/719: mkdir da/d16/de2 0 2024-09-20T18:36:12.152 INFO:tasks.workunit.client.0.smithi017.stdout:4/655: write d4/dc/f12 [202104,77878] 0 2024-09-20T18:36:12.154 INFO:tasks.workunit.client.0.smithi017.stdout:4/656: stat d4/d82/d88/d5c/dc8 0 2024-09-20T18:36:12.155 INFO:tasks.workunit.client.0.smithi017.stdout:2/937: rename d1/dc/d20/d2e/d30/d85/d53/c69 to d1/dc/d20/d2e/d30/d85/d53/d6b/c132 0 2024-09-20T18:36:12.156 INFO:tasks.workunit.client.0.smithi017.stdout:5/749: dread d0/d14/d18/d57/f7d [0,4194304] 0 2024-09-20T18:36:12.161 INFO:tasks.workunit.client.0.smithi017.stdout:5/750: creat d0/d14/d18/d1b/f100 x:0 0 0 2024-09-20T18:36:12.163 INFO:tasks.workunit.client.0.smithi017.stdout:7/720: truncate da/d16/d1c/d40/d30/f66 716931 0 2024-09-20T18:36:12.166 INFO:tasks.workunit.client.0.smithi017.stdout:4/657: link d4/dc/la6 d4/d19/d37/da1/d1b/d56/db1/ldc 0 2024-09-20T18:36:12.167 INFO:tasks.workunit.client.0.smithi017.stdout:5/751: dwrite d0/d14/d18/d2a/d39/f53 [0,4194304] 0 2024-09-20T18:36:12.172 INFO:tasks.workunit.client.0.smithi017.stdout:2/938: write d1/dc/d20/d2e/d30/f97 [135129,71191] 0 2024-09-20T18:36:12.172 INFO:tasks.workunit.client.0.smithi017.stdout:4/658: dread - d4/dc/d1e/f73 zero size 2024-09-20T18:36:12.175 INFO:tasks.workunit.client.0.smithi017.stdout:5/752: rename d0/d14/d18/d2a/d39/f50 to d0/d14/d18/d19/d4d/d6d/d78/d98/f101 0 2024-09-20T18:36:12.179 INFO:tasks.workunit.client.0.smithi017.stdout:7/721: symlink da/d16/d8e/le3 0 2024-09-20T18:36:12.180 INFO:tasks.workunit.client.0.smithi017.stdout:7/722: write da/d16/d1c/d40/d3a/fbf [807226,46984] 0 2024-09-20T18:36:12.182 INFO:tasks.workunit.client.0.smithi017.stdout:5/753: rename d0/d14/d18/d57/db6/cec to d0/c102 0 2024-09-20T18:36:12.189 INFO:tasks.workunit.client.0.smithi017.stdout:7/723: mkdir da/d16/d1c/d40/d34/dcd/de4 0 2024-09-20T18:36:12.191 INFO:tasks.workunit.client.0.smithi017.stdout:4/659: write d4/dc/d41/f99 [66916,60966] 0 2024-09-20T18:36:12.195 INFO:tasks.workunit.client.0.smithi017.stdout:2/939: getdents d1/dc/d20/d2e/d30 0 2024-09-20T18:36:12.197 INFO:tasks.workunit.client.0.smithi017.stdout:2/940: chown d1/dc/d20/d2e/d30/d85/d53/d96/cbf 162 1 2024-09-20T18:36:12.201 INFO:tasks.workunit.client.0.smithi017.stdout:7/724: dread f4 [4194304,4194304] 0 2024-09-20T18:36:12.203 INFO:tasks.workunit.client.0.smithi017.stdout:2/941: dread d1/dc/d20/d2e/d30/d85/d3d/dad/fd1 [0,4194304] 0 2024-09-20T18:36:12.204 INFO:tasks.workunit.client.0.smithi017.stdout:7/725: mkdir da/d16/d1c/d40/d5d/da7/de5 0 2024-09-20T18:36:12.206 INFO:tasks.workunit.client.0.smithi017.stdout:5/754: fsync d0/d14/d18/dd1/fcb 0 2024-09-20T18:36:12.209 INFO:tasks.workunit.client.0.smithi017.stdout:2/942: write d1/dc/d20/d2e/d30/d85/d98/fbd [4305059,83991] 0 2024-09-20T18:36:12.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:11 smithi172 ceph-mon[35456]: pgmap v40: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 34 MiB/s rd, 102 MiB/s wr, 255 op/s 2024-09-20T18:36:12.210 INFO:tasks.workunit.client.0.smithi017.stdout:4/660: dread d4/d19/d37/da1/d1b/f58 [0,4194304] 0 2024-09-20T18:36:12.212 INFO:tasks.workunit.client.0.smithi017.stdout:5/755: creat d0/d14/d18/d19/d4d/d6d/d78/d99/f103 x:0 0 0 2024-09-20T18:36:12.215 INFO:tasks.workunit.client.0.smithi017.stdout:7/726: creat da/d16/d1c/d40/d30/fe6 x:0 0 0 2024-09-20T18:36:12.217 INFO:tasks.workunit.client.0.smithi017.stdout:2/943: dwrite d1/dc/d20/d2e/d30/d85/d98/fbd [0,4194304] 0 2024-09-20T18:36:12.221 INFO:tasks.workunit.client.0.smithi017.stdout:4/661: rename d4/d19/d37/da1/d1b/f8d to d4/d19/d37/da1/d1b/fdd 0 2024-09-20T18:36:12.224 INFO:tasks.workunit.client.0.smithi017.stdout:7/727: creat da/d16/de2/fe7 x:0 0 0 2024-09-20T18:36:12.227 INFO:tasks.workunit.client.0.smithi017.stdout:5/756: dread d0/d14/d18/d1b/fa6 [0,4194304] 0 2024-09-20T18:36:12.228 INFO:tasks.workunit.client.0.smithi017.stdout:4/662: mkdir d4/d82/d88/d5c/d8f/da9/db4/dde 0 2024-09-20T18:36:12.232 INFO:tasks.workunit.client.0.smithi017.stdout:5/757: dread - d0/d14/d18/d2a/d39/d6c/feb zero size 2024-09-20T18:36:12.232 INFO:tasks.workunit.client.0.smithi017.stdout:5/758: chown d0/d14/d18/d79 61 1 2024-09-20T18:36:12.234 INFO:tasks.workunit.client.0.smithi017.stdout:7/728: truncate da/f77 2353159 0 2024-09-20T18:36:12.234 INFO:tasks.workunit.client.0.smithi017.stdout:7/729: fsync da/d54/fa6 0 2024-09-20T18:36:12.235 INFO:tasks.workunit.client.0.smithi017.stdout:7/730: dread - da/d94/fd1 zero size 2024-09-20T18:36:12.235 INFO:tasks.workunit.client.0.smithi017.stdout:7/731: chown da 2 1 2024-09-20T18:36:12.236 INFO:tasks.workunit.client.0.smithi017.stdout:7/732: write da/d16/de2/fe7 [195350,108930] 0 2024-09-20T18:36:12.242 INFO:tasks.workunit.client.0.smithi017.stdout:2/944: dwrite d1/dc/d20/d2e/d30/d85/d3d/d77/d124/f125 [0,4194304] 0 2024-09-20T18:36:12.247 INFO:tasks.workunit.client.0.smithi017.stdout:7/733: rmdir da/d16/d1c/d40/d34 39 2024-09-20T18:36:12.249 INFO:tasks.workunit.client.0.smithi017.stdout:5/759: creat d0/dbe/ddc/f104 x:0 0 0 2024-09-20T18:36:12.253 INFO:tasks.workunit.client.0.smithi017.stdout:7/734: unlink f4 0 2024-09-20T18:36:12.257 INFO:tasks.workunit.client.0.smithi017.stdout:5/760: mknod d0/d14/d18/d19/d4d/d6d/c105 0 2024-09-20T18:36:12.260 INFO:tasks.workunit.client.0.smithi017.stdout:7/735: rename da/d16/d1c/d40/d3a/da9 to da/d16/d1c/d40/d34/dcd/de4/de8 0 2024-09-20T18:36:12.260 INFO:tasks.workunit.client.0.smithi017.stdout:7/736: chown da/d16/d1c/d40/d34/d96/caf 521169 1 2024-09-20T18:36:12.261 INFO:tasks.workunit.client.0.smithi017.stdout:5/761: creat d0/d14/d18/d79/d9e/f106 x:0 0 0 2024-09-20T18:36:12.270 INFO:tasks.workunit.client.0.smithi017.stdout:7/737: fdatasync da/f65 0 2024-09-20T18:36:12.272 INFO:tasks.workunit.client.0.smithi017.stdout:2/945: dread d1/d67/d8f/d9e/f9f [0,4194304] 0 2024-09-20T18:36:12.274 INFO:tasks.workunit.client.0.smithi017.stdout:7/738: dread da/d16/d92/fd5 [0,4194304] 0 2024-09-20T18:36:12.295 INFO:tasks.workunit.client.0.smithi017.stdout:5/762: rename d0/d14/d18/d19/d4d/d6d/dbf to d0/d14/d18/d19/d4d/d6d/d78/d98/d107 0 2024-09-20T18:36:12.297 INFO:tasks.workunit.client.0.smithi017.stdout:7/739: link da/d16/f9c da/fe9 0 2024-09-20T18:36:12.297 INFO:tasks.workunit.client.0.smithi017.stdout:5/763: getdents d0/d14/d18/d19/d4d/d6d/db7/dc1 0 2024-09-20T18:36:12.298 INFO:tasks.workunit.client.0.smithi017.stdout:7/740: fsync da/d16/d1c/d40/d34/d3c/fd8 0 2024-09-20T18:36:12.299 INFO:tasks.workunit.client.0.smithi017.stdout:5/764: read d0/d14/d18/ff2 [242170,74007] 0 2024-09-20T18:36:12.301 INFO:tasks.workunit.client.0.smithi017.stdout:7/741: symlink da/d16/d1c/dc9/lea 0 2024-09-20T18:36:12.306 INFO:tasks.workunit.client.0.smithi017.stdout:7/742: fsync da/d16/d1c/d40/d34/d96/fd6 0 2024-09-20T18:36:12.309 INFO:tasks.workunit.client.0.smithi017.stdout:7/743: rename da/d54/f71 to da/d16/d1c/d40/d3a/feb 0 2024-09-20T18:36:12.309 INFO:tasks.workunit.client.0.smithi017.stdout:7/744: chown da/d16/d1c/d40/d34/d96 633 1 2024-09-20T18:36:12.326 INFO:tasks.workunit.client.0.smithi017.stdout:5/765: dwrite d0/d14/d18/d2a/d39/f9b [0,4194304] 0 2024-09-20T18:36:12.330 INFO:tasks.workunit.client.0.smithi017.stdout:5/766: fsync d0/d14/d18/d2a/d39/d42/f49 0 2024-09-20T18:36:12.336 INFO:tasks.workunit.client.0.smithi017.stdout:5/767: link d0/d14/d18/d2a/d39/d6c/d72/l35 d0/d14/d18/d79/d9e/l108 0 2024-09-20T18:36:12.340 INFO:tasks.workunit.client.0.smithi017.stdout:5/768: unlink d0/d14/d18/d1b/f26 0 2024-09-20T18:36:12.342 INFO:tasks.workunit.client.0.smithi017.stdout:5/769: mkdir d0/d14/d18/d19/d4d/d6d/db7/d109 0 2024-09-20T18:36:12.343 INFO:tasks.workunit.client.0.smithi017.stdout:5/770: chown d0/d14/d18/d57/f4e 8661 1 2024-09-20T18:36:12.345 INFO:tasks.workunit.client.0.smithi017.stdout:5/771: dread - d0/d14/d18/d19/d4d/d6d/d78/d99/fb8 zero size 2024-09-20T18:36:12.361 INFO:tasks.workunit.client.0.smithi017.stdout:5/772: dread d0/d14/d18/d19/d4d/d6d/d78/f77 [0,4194304] 0 2024-09-20T18:36:12.362 INFO:tasks.workunit.client.0.smithi017.stdout:5/773: readlink d0/d14/d18/d19/d4d/d6d/db7/dc1/ld2 0 2024-09-20T18:36:12.385 INFO:tasks.workunit.client.0.smithi017.stdout:5/774: dwrite d0/d14/d18/d2a/d39/d42/f49 [4194304,4194304] 0 2024-09-20T18:36:12.388 INFO:tasks.workunit.client.0.smithi017.stdout:5/775: write d0/d14/d18/d57/f7d [4991988,57345] 0 2024-09-20T18:36:12.393 INFO:tasks.workunit.client.0.smithi017.stdout:5/776: dread d0/d14/d18/d1b/fa6 [0,4194304] 0 2024-09-20T18:36:12.394 INFO:tasks.workunit.client.0.smithi017.stdout:5/777: chown d0 4180 1 2024-09-20T18:36:12.399 INFO:tasks.workunit.client.0.smithi017.stdout:5/778: rename d0/d14/d18/d19/d4d/d6d/d78/d98/d107 to d0/d14/d18/dfd/d10a 0 2024-09-20T18:36:12.403 INFO:tasks.workunit.client.0.smithi017.stdout:5/779: unlink d0/d14/d18/d2a/d39/d42/d7e/ld8 0 2024-09-20T18:36:12.404 INFO:tasks.workunit.client.0.smithi017.stdout:5/780: dread - d0/d14/d18/d57/fc6 zero size 2024-09-20T18:36:12.409 INFO:tasks.workunit.client.0.smithi017.stdout:5/781: mknod d0/d14/d18/d19/d4d/db5/c10b 0 2024-09-20T18:36:12.410 INFO:tasks.workunit.client.0.smithi017.stdout:5/782: stat d0/d14/d18/d19/d4d/db5/fd3 0 2024-09-20T18:36:12.411 INFO:tasks.workunit.client.0.smithi017.stdout:5/783: stat d0/d14/d18/d79/fb2 0 2024-09-20T18:36:12.413 INFO:tasks.workunit.client.0.smithi017.stdout:5/784: symlink d0/d14/d18/d79/d9e/l10c 0 2024-09-20T18:36:12.419 INFO:tasks.workunit.client.0.smithi017.stdout:5/785: getdents d0/d14/d18/d57 0 2024-09-20T18:36:12.424 INFO:tasks.workunit.client.0.smithi017.stdout:5/786: rename d0/d14/d18/d19/d4d/d6d/l70 to d0/d14/d18/d79/d9e/l10d 0 2024-09-20T18:36:12.425 INFO:tasks.workunit.client.0.smithi017.stdout:5/787: readlink d0/d14/d18/d19/l5f 0 2024-09-20T18:36:12.428 INFO:tasks.workunit.client.0.smithi017.stdout:5/788: mkdir d0/d14/d18/d2a/d39/d42/d7e/d10e 0 2024-09-20T18:36:12.431 INFO:tasks.workunit.client.0.smithi017.stdout:5/789: rmdir d0/d14/d18/d2a/d39/d6c 39 2024-09-20T18:36:12.438 INFO:tasks.workunit.client.0.smithi017.stdout:5/790: dwrite d0/d14/d18/d1b/f5c [0,4194304] 0 2024-09-20T18:36:12.454 INFO:tasks.workunit.client.0.smithi017.stdout:5/791: dread d0/d14/d18/d19/d85/f87 [0,4194304] 0 2024-09-20T18:36:12.455 INFO:tasks.workunit.client.0.smithi017.stdout:5/792: chown d0/d14/d18/d2a/da1/ldd 463028 1 2024-09-20T18:36:12.456 INFO:tasks.workunit.client.0.smithi017.stdout:5/793: dread - d0/d14/d18/d19/d4d/db5/dc0/fb4 zero size 2024-09-20T18:36:12.459 INFO:tasks.workunit.client.0.smithi017.stdout:5/794: mknod d0/d14/d18/d2a/d39/d42/d7e/da8/c10f 0 2024-09-20T18:36:12.471 INFO:tasks.workunit.client.0.smithi017.stdout:5/795: getdents d0/d14/d18/d2a/d39/d42/d7e/da8 0 2024-09-20T18:36:12.474 INFO:tasks.workunit.client.0.smithi017.stdout:5/796: creat d0/d14/d18/d79/d9e/f110 x:0 0 0 2024-09-20T18:36:12.474 INFO:tasks.workunit.client.0.smithi017.stdout:5/797: chown d0/d14/d18/d19 768002 1 2024-09-20T18:36:12.481 INFO:tasks.workunit.client.0.smithi017.stdout:5/798: dwrite d0/f7 [0,4194304] 0 2024-09-20T18:36:12.487 INFO:tasks.workunit.client.0.smithi017.stdout:5/799: rmdir d0/d14/ded 0 2024-09-20T18:36:12.487 INFO:tasks.workunit.client.0.smithi017.stdout:5/800: chown d0/d14/d18/d19/d85 0 1 2024-09-20T18:36:12.489 INFO:tasks.workunit.client.0.smithi017.stdout:5/801: rmdir d0/d14/d18/d57 39 2024-09-20T18:36:12.494 INFO:tasks.workunit.client.0.smithi017.stdout:5/802: rename d0/d14/d18/d2a/lb0 to d0/d14/d18/d2a/d39/d42/d7e/da8/l111 0 2024-09-20T18:36:12.496 INFO:tasks.workunit.client.0.smithi017.stdout:5/803: rmdir d0/d14/d18/d2a/d39/d42/d7e/da8 39 2024-09-20T18:36:12.500 INFO:tasks.workunit.client.0.smithi017.stdout:5/804: unlink d0/d14/d18/d2a/d39/d42/d7e/ld5 0 2024-09-20T18:36:12.503 INFO:tasks.workunit.client.0.smithi017.stdout:5/805: creat d0/d14/d18/d57/db6/f112 x:0 0 0 2024-09-20T18:36:12.521 INFO:tasks.workunit.client.0.smithi017.stdout:5/806: dwrite d0/d14/d18/d19/d4d/d6d/d78/d99/fb8 [0,4194304] 0 2024-09-20T18:36:12.523 INFO:tasks.workunit.client.0.smithi017.stdout:5/807: read - d0/d14/d18/dcc/fe0 zero size 2024-09-20T18:36:12.534 INFO:tasks.workunit.client.0.smithi017.stdout:5/808: dwrite d0/d14/d18/d1b/f31 [4194304,4194304] 0 2024-09-20T18:36:12.541 INFO:tasks.workunit.client.0.smithi017.stdout:5/809: creat d0/d14/d18/d19/d4d/d6d/d78/f113 x:0 0 0 2024-09-20T18:36:12.547 INFO:tasks.workunit.client.0.smithi017.stdout:5/810: dwrite d0/d14/d18/dcc/fe0 [0,4194304] 0 2024-09-20T18:36:12.555 INFO:tasks.workunit.client.0.smithi017.stdout:5/811: dwrite d0/d14/d18/dcc/fe0 [0,4194304] 0 2024-09-20T18:36:12.560 INFO:tasks.workunit.client.0.smithi017.stdout:5/812: dread d0/d14/d18/d1b/fa6 [0,4194304] 0 2024-09-20T18:36:12.570 INFO:tasks.workunit.client.0.smithi017.stdout:5/813: write d0/d14/d18/d19/d4d/f84 [682739,92026] 0 2024-09-20T18:36:12.571 INFO:tasks.workunit.client.0.smithi017.stdout:5/814: chown d0/dd9/f9a 1738 1 2024-09-20T18:36:12.573 INFO:tasks.workunit.client.0.smithi017.stdout:5/815: dread - d0/d14/d18/d2a/d39/d6c/feb zero size 2024-09-20T18:36:12.574 INFO:tasks.workunit.client.0.smithi017.stdout:5/816: chown d0/d14/d18/d19/d4d/l9c 927398628 1 2024-09-20T18:36:12.577 INFO:tasks.workunit.client.0.smithi017.stdout:5/817: link d0/d14/l89 d0/d14/d18/d2a/d39/d42/d7e/d10e/l114 0 2024-09-20T18:36:12.579 INFO:tasks.workunit.client.0.smithi017.stdout:5/818: truncate d0/d14/d18/d2a/d39/f61 4231802 0 2024-09-20T18:36:12.580 INFO:tasks.workunit.client.0.smithi017.stdout:5/819: symlink d0/d14/d18/dd1/l115 0 2024-09-20T18:36:12.581 INFO:tasks.workunit.client.0.smithi017.stdout:5/820: write d0/dbe/ddc/dea/ff3 [649806,98512] 0 2024-09-20T18:36:12.732 INFO:tasks.workunit.client.0.smithi017.stdout:5/821: mkdir d0/d14/d116 0 2024-09-20T18:36:12.744 INFO:tasks.workunit.client.0.smithi017.stdout:5/822: symlink d0/d14/d18/d19/dda/l117 0 2024-09-20T18:36:12.745 INFO:tasks.workunit.client.0.smithi017.stdout:5/823: dread - d0/d14/d18/d19/d4d/db5/dc0/fb4 zero size 2024-09-20T18:36:12.748 INFO:tasks.workunit.client.0.smithi017.stdout:5/824: creat d0/d14/d18/d19/d4d/d6d/db7/d109/f118 x:0 0 0 2024-09-20T18:36:12.750 INFO:tasks.workunit.client.0.smithi017.stdout:5/825: rmdir d0/d14/d18/d2a/d39/d6c 39 2024-09-20T18:36:12.752 INFO:tasks.workunit.client.0.smithi017.stdout:5/826: rmdir d0/d14/d18/d19/d4d/d6d/db7/d109 39 2024-09-20T18:36:12.754 INFO:tasks.workunit.client.0.smithi017.stdout:5/827: dread d0/d14/d18/d19/faa [0,4194304] 0 2024-09-20T18:36:12.755 INFO:tasks.workunit.client.0.smithi017.stdout:5/828: stat d0/d14/d18/d1b/f100 0 2024-09-20T18:36:12.757 INFO:tasks.workunit.client.0.smithi017.stdout:5/829: chown d0/d14/d18/d19/d4d/db5/dc0/f93 95984 1 2024-09-20T18:36:12.760 INFO:tasks.workunit.client.0.smithi017.stdout:5/830: unlink d0/d14/d18/d1b/f5c 0 2024-09-20T18:36:12.764 INFO:tasks.workunit.client.0.smithi017.stdout:5/831: creat d0/d14/d18/d19/d4d/d6d/d78/f119 x:0 0 0 2024-09-20T18:36:12.766 INFO:tasks.workunit.client.0.smithi017.stdout:5/832: mknod d0/d14/d18/d19/d4d/d6d/d78/d98/c11a 0 2024-09-20T18:36:12.768 INFO:tasks.workunit.client.0.smithi017.stdout:5/833: symlink d0/d14/d18/dd1/l11b 0 2024-09-20T18:36:12.771 INFO:tasks.workunit.client.0.smithi017.stdout:5/834: mkdir d0/d11c 0 2024-09-20T18:36:12.773 INFO:tasks.workunit.client.0.smithi017.stdout:5/835: dread - d0/d14/d18/d19/d4d/db5/dc0/fb4 zero size 2024-09-20T18:36:12.779 INFO:tasks.workunit.client.0.smithi017.stdout:5/836: getdents d0/d14/d18/d19/d4d 0 2024-09-20T18:36:12.783 INFO:tasks.workunit.client.0.smithi017.stdout:5/837: creat d0/d14/d18/d2a/d39/d6c/d72/f11d x:0 0 0 2024-09-20T18:36:12.786 INFO:tasks.workunit.client.0.smithi017.stdout:5/838: mknod d0/d14/d18/d19/d4d/d6d/d78/c11e 0 2024-09-20T18:36:12.792 INFO:tasks.workunit.client.0.smithi017.stdout:5/839: dwrite d0/d14/d18/d19/d4d/db5/fd3 [0,4194304] 0 2024-09-20T18:36:12.792 INFO:tasks.workunit.client.0.smithi017.stdout:5/840: chown d0/d14/d18/d1b 519470 1 2024-09-20T18:36:12.797 INFO:tasks.workunit.client.0.smithi017.stdout:5/841: mkdir d0/d14/d18/d19/d4d/d6d/d78/d99/d11f 0 2024-09-20T18:36:12.799 INFO:tasks.workunit.client.0.smithi017.stdout:5/842: write d0/d14/ff4 [791765,97018] 0 2024-09-20T18:36:12.816 INFO:tasks.workunit.client.0.smithi017.stdout:5/843: dwrite d0/d14/d18/d19/d85/f87 [0,4194304] 0 2024-09-20T18:36:12.827 INFO:tasks.workunit.client.0.smithi017.stdout:5/844: rename d0/d14/d18/d2a/d39/fab to d0/d14/d18/d2a/d39/d42/d7e/da8/f120 0 2024-09-20T18:36:12.830 INFO:tasks.workunit.client.0.smithi017.stdout:5/845: creat d0/d14/d18/d2a/d39/d42/f121 x:0 0 0 2024-09-20T18:36:12.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.814+0000 7f4e5c97e640 1 -- 172.21.15.17:0/3856221429 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e48031740 con 0x7f4e580fffa0 2024-09-20T18:36:12.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.815+0000 7f4e5fbe4640 1 -- 172.21.15.17:0/3856221429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e580fffa0 msgr2=0x7f4e58107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:12.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.815+0000 7f4e5fbe4640 1 --2- 172.21.15.17:0/3856221429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e580fffa0 0x7f4e58107110 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4e480098b0 tx=0x7f4e4802a4d0 comp rx=0 tx=0).stop 2024-09-20T18:36:12.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.815+0000 7f4e5fbe4640 1 -- 172.21.15.17:0/3856221429 shutdown_connections 2024-09-20T18:36:12.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.815+0000 7f4e5fbe4640 1 --2- 172.21.15.17:0/3856221429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e580fffa0 0x7f4e58107110 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:12.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.815+0000 7f4e5fbe4640 1 --2- 172.21.15.17:0/3856221429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e580ff5d0 0x7f4e580ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:12.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.815+0000 7f4e5fbe4640 1 -- 172.21.15.17:0/3856221429 >> 172.21.15.17:0/3856221429 conn(0x7f4e580fb350 msgr2=0x7f4e580fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:12.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.816+0000 7f4e5fbe4640 1 -- 172.21.15.17:0/3856221429 shutdown_connections 2024-09-20T18:36:12.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.816+0000 7f4e5fbe4640 1 -- 172.21.15.17:0/3856221429 wait complete. 2024-09-20T18:36:12.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.816+0000 7f4e5fbe4640 1 Processor -- start 2024-09-20T18:36:12.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.816+0000 7f4e5fbe4640 1 -- start start 2024-09-20T18:36:12.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.817+0000 7f4e5fbe4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e580ff5d0 0x7f4e581950e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:12.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.817+0000 7f4e5fbe4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e580fffa0 0x7f4e58195620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:12.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.817+0000 7f4e5fbe4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4e58102ba0 con 0x7f4e580ff5d0 2024-09-20T18:36:12.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.817+0000 7f4e5fbe4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4e58102a20 con 0x7f4e580fffa0 2024-09-20T18:36:12.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.817+0000 7f4e5d980640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e580ff5d0 0x7f4e581950e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:12.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.817+0000 7f4e5d980640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e580ff5d0 0x7f4e581950e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37252/0 (socket says 172.21.15.17:37252) 2024-09-20T18:36:12.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.817+0000 7f4e5d980640 1 -- 172.21.15.17:0/628171527 learned_addr learned my addr 172.21.15.17:0/628171527 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:36:12.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.817+0000 7f4e5d17f640 1 --2- 172.21.15.17:0/628171527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e580fffa0 0x7f4e58195620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:12.834 INFO:tasks.workunit.client.0.smithi017.stdout:5/846: mkdir d0/d14/d18/dcc/d122 0 2024-09-20T18:36:12.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.817+0000 7f4e5d980640 1 -- 172.21.15.17:0/628171527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e580fffa0 msgr2=0x7f4e58195620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:12.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.817+0000 7f4e5d980640 1 --2- 172.21.15.17:0/628171527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e580fffa0 0x7f4e58195620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:12.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.817+0000 7f4e5d980640 1 -- 172.21.15.17:0/628171527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e58195ca0 con 0x7f4e580ff5d0 2024-09-20T18:36:12.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.818+0000 7f4e5d980640 1 --2- 172.21.15.17:0/628171527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e580ff5d0 0x7f4e581950e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4e5400e970 tx=0x7f4e5400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:12.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.818+0000 7f4e4effd640 1 -- 172.21.15.17:0/628171527 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e5400cac0 con 0x7f4e580ff5d0 2024-09-20T18:36:12.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.818+0000 7f4e4effd640 1 -- 172.21.15.17:0/628171527 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4e540054e0 con 0x7f4e580ff5d0 2024-09-20T18:36:12.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.818+0000 7f4e4effd640 1 -- 172.21.15.17:0/628171527 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e54010430 con 0x7f4e580ff5d0 2024-09-20T18:36:12.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.818+0000 7f4e5fbe4640 1 -- 172.21.15.17:0/628171527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e5819a6e0 con 0x7f4e580ff5d0 2024-09-20T18:36:12.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.818+0000 7f4e5fbe4640 1 -- 172.21.15.17:0/628171527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e5819ac70 con 0x7f4e580ff5d0 2024-09-20T18:36:12.835 INFO:tasks.workunit.client.0.smithi017.stdout:5/847: mkdir d0/d14/d18/d2a/d39/d6c/d123 0 2024-09-20T18:36:12.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.820+0000 7f4e5fbe4640 1 -- 172.21.15.17:0/628171527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e5819af20 con 0x7f4e580ff5d0 2024-09-20T18:36:12.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.821+0000 7f4e4effd640 1 -- 172.21.15.17:0/628171527 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f4e54004f00 con 0x7f4e580ff5d0 2024-09-20T18:36:12.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.821+0000 7f4e4effd640 1 --2- 172.21.15.17:0/628171527 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f4e44085a70 0x7f4e44087f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:12.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.821+0000 7f4e4effd640 1 -- 172.21.15.17:0/628171527 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7f4e54096940 con 0x7f4e580ff5d0 2024-09-20T18:36:12.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.821+0000 7f4e5d17f640 1 --2- 172.21.15.17:0/628171527 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f4e44085a70 0x7f4e44087f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:12.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.822+0000 7f4e5d17f640 1 --2- 172.21.15.17:0/628171527 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f4e44085a70 0x7f4e44087f30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4e480096c0 tx=0x7f4e48000bc0 comp rx=0 tx=0).ready entity=mgr.24405 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:12.840 INFO:tasks.workunit.client.0.smithi017.stdout:5/848: mkdir d0/d14/d18/d19/d4d/d6d/d78/d124 0 2024-09-20T18:36:12.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:12.827+0000 7f4e4effd640 1 -- 172.21.15.17:0/628171527 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f4e54061eb0 con 0x7f4e580ff5d0 2024-09-20T18:36:12.844 INFO:tasks.workunit.client.0.smithi017.stdout:5/849: mkdir d0/dbe/ddc/d125 0 2024-09-20T18:36:12.845 INFO:tasks.workunit.client.0.smithi017.stdout:5/850: dread - d0/d14/d18/d79/d9e/f110 zero size 2024-09-20T18:36:12.848 INFO:tasks.workunit.client.0.smithi017.stdout:5/851: fsync d0/d14/d18/f94 0 2024-09-20T18:36:12.855 INFO:tasks.workunit.client.0.smithi017.stdout:5/852: creat d0/dbe/ddc/d125/f126 x:0 0 0 2024-09-20T18:36:12.858 INFO:tasks.workunit.client.0.smithi017.stdout:5/853: symlink d0/d14/d18/dd1/l127 0 2024-09-20T18:36:12.862 INFO:tasks.workunit.client.0.smithi017.stdout:5/854: creat d0/d14/d18/dcc/d122/f128 x:0 0 0 2024-09-20T18:36:12.863 INFO:tasks.workunit.client.0.smithi017.stdout:5/855: write d0/d14/d18/d2a/d39/d6c/f9f [622636,126840] 0 2024-09-20T18:36:12.918 INFO:tasks.workunit.client.0.smithi017.stdout:6/734: sync 2024-09-20T18:36:12.918 INFO:tasks.workunit.client.0.smithi017.stdout:3/908: sync 2024-09-20T18:36:12.923 INFO:tasks.workunit.client.0.smithi017.stdout:6/735: mknod d4/d37/d68/d8d/cff 0 2024-09-20T18:36:12.924 INFO:tasks.workunit.client.0.smithi017.stdout:5/856: dwrite d0/d14/ff4 [0,4194304] 0 2024-09-20T18:36:12.998 INFO:tasks.workunit.client.0.smithi017.stdout:3/909: link da/f29 da/de/d13/d2f/d26/d41/f130 0 2024-09-20T18:36:12.999 INFO:tasks.workunit.client.0.smithi017.stdout:5/857: dread - d0/d14/d18/f97 zero size 2024-09-20T18:36:13.002 INFO:tasks.workunit.client.0.smithi017.stdout:5/858: creat d0/d14/d18/d19/d4d/db5/dc0/f129 x:0 0 0 2024-09-20T18:36:13.003 INFO:tasks.workunit.client.0.smithi017.stdout:5/859: chown d0/d14/d18/d19/d4d/f84 21 1 2024-09-20T18:36:13.003 INFO:tasks.workunit.client.0.smithi017.stdout:6/736: getdents d4/d37/d68/da4/d9e 0 2024-09-20T18:36:13.004 INFO:tasks.workunit.client.0.smithi017.stdout:5/860: fdatasync d0/d14/d18/d2a/d39/d42/fe8 0 2024-09-20T18:36:13.007 INFO:tasks.workunit.client.0.smithi017.stdout:6/737: creat d4/d37/d68/d8d/db2/dd4/dd9/f100 x:0 0 0 2024-09-20T18:36:13.010 INFO:tasks.workunit.client.0.smithi017.stdout:5/861: symlink d0/d14/d18/d19/d4d/d6d/db7/dc1/l12a 0 2024-09-20T18:36:13.011 INFO:tasks.workunit.client.0.smithi017.stdout:5/862: chown d0/d14/d18/d19/d4d/d6d/db7 3721187 1 2024-09-20T18:36:13.012 INFO:tasks.workunit.client.0.smithi017.stdout:6/738: unlink d4/df/d1f/d25/d3f/l62 0 2024-09-20T18:36:13.021 INFO:tasks.workunit.client.0.smithi017.stdout:5/863: link d0/d14/d18/d19/c32 d0/d14/d18/dcc/d122/c12b 0 2024-09-20T18:36:13.022 INFO:tasks.workunit.client.0.smithi017.stdout:5/864: fdatasync d0/d14/d18/dfd/d10a/fe3 0 2024-09-20T18:36:13.027 INFO:tasks.workunit.client.0.smithi017.stdout:6/739: write d4/df/d4a/f8c [3761691,81665] 0 2024-09-20T18:36:13.028 INFO:tasks.workunit.client.0.smithi017.stdout:6/740: chown d4/fbf 5744 1 2024-09-20T18:36:13.028 INFO:tasks.workunit.client.0.smithi017.stdout:5/865: dread d0/d14/d18/d19/d4d/d6d/d78/f77 [0,4194304] 0 2024-09-20T18:36:13.034 INFO:tasks.workunit.client.0.smithi017.stdout:5/866: symlink d0/d14/d18/d19/d4d/d6d/d78/l12c 0 2024-09-20T18:36:13.036 INFO:tasks.workunit.client.0.smithi017.stdout:6/741: creat d4/df/f101 x:0 0 0 2024-09-20T18:36:13.041 INFO:tasks.workunit.client.0.smithi017.stdout:5/867: dwrite d0/d14/d18/dfd/d10a/fe3 [0,4194304] 0 2024-09-20T18:36:13.044 INFO:tasks.workunit.client.0.smithi017.stdout:5/868: creat d0/d14/d18/dcc/d122/f12d x:0 0 0 2024-09-20T18:36:13.060 INFO:tasks.workunit.client.0.smithi017.stdout:6/742: dwrite d4/fc [0,4194304] 0 2024-09-20T18:36:13.062 INFO:tasks.workunit.client.0.smithi017.stdout:5/869: dwrite d0/d14/d18/d19/d4d/d6d/fa2 [0,4194304] 0 2024-09-20T18:36:13.062 INFO:tasks.workunit.client.0.smithi017.stdout:6/743: truncate d4/df/d1f/d25/dca/ffd 842959 0 2024-09-20T18:36:13.070 INFO:tasks.workunit.client.0.smithi017.stdout:5/870: rename d0/d14/d18/d2a/d39/d42/d7e/d10e to d0/dbe/ddc/dea/d12e 0 2024-09-20T18:36:13.080 INFO:tasks.workunit.client.0.smithi017.stdout:6/744: write d4/df/d1f/d25/d3f/f5b [259157,74678] 0 2024-09-20T18:36:13.081 INFO:tasks.workunit.client.0.smithi017.stdout:5/871: dwrite d0/ff [0,4194304] 0 2024-09-20T18:36:13.090 INFO:tasks.workunit.client.0.smithi017.stdout:5/872: creat d0/d14/d18/d19/d4d/db5/dc0/f12f x:0 0 0 2024-09-20T18:36:13.093 INFO:tasks.workunit.client.0.smithi017.stdout:6/745: dwrite d4/df/f9a [0,4194304] 0 2024-09-20T18:36:13.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.128+0000 7f4e5fbe4640 1 -- 172.21.15.17:0/628171527 --> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4e58106800 con 0x7f4e44085a70 2024-09-20T18:36:13.144 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:12 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:36:13.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.130+0000 7f4e4effd640 1 -- 172.21.15.17:0/628171527 <== mgr.24405 v2:172.21.15.172:6828/3016443347 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f4e58106800 con 0x7f4e44085a70 2024-09-20T18:36:13.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.133+0000 7f4e5fbe4640 1 -- 172.21.15.17:0/628171527 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f4e44085a70 msgr2=0x7f4e44087f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:13.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.133+0000 7f4e5fbe4640 1 --2- 172.21.15.17:0/628171527 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f4e44085a70 0x7f4e44087f30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4e480096c0 tx=0x7f4e48000bc0 comp rx=0 tx=0).stop 2024-09-20T18:36:13.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.133+0000 7f4e5fbe4640 1 -- 172.21.15.17:0/628171527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e580ff5d0 msgr2=0x7f4e581950e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:13.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.133+0000 7f4e5fbe4640 1 --2- 172.21.15.17:0/628171527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e580ff5d0 0x7f4e581950e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4e5400e970 tx=0x7f4e5400ed70 comp rx=0 tx=0).stop 2024-09-20T18:36:13.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.133+0000 7f4e5fbe4640 1 -- 172.21.15.17:0/628171527 shutdown_connections 2024-09-20T18:36:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.133+0000 7f4e5fbe4640 1 --2- 172.21.15.17:0/628171527 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f4e44085a70 0x7f4e44087f30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.133+0000 7f4e5fbe4640 1 --2- 172.21.15.17:0/628171527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e580fffa0 0x7f4e58195620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.133+0000 7f4e5fbe4640 1 --2- 172.21.15.17:0/628171527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e580ff5d0 0x7f4e581950e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.133+0000 7f4e5fbe4640 1 -- 172.21.15.17:0/628171527 >> 172.21.15.17:0/628171527 conn(0x7f4e580fb350 msgr2=0x7f4e581050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.133+0000 7f4e5fbe4640 1 -- 172.21.15.17:0/628171527 shutdown_connections 2024-09-20T18:36:13.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.133+0000 7f4e5fbe4640 1 -- 172.21.15.17:0/628171527 wait complete. 2024-09-20T18:36:13.160 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:36:13.178 INFO:tasks.workunit.client.0.smithi017.stdout:5/873: rename d0/d14/d18/d57/lad to d0/d14/d18/d19/d4d/d6d/db7/l130 0 2024-09-20T18:36:13.180 INFO:tasks.workunit.client.0.smithi017.stdout:5/874: write d0/d14/d18/d19/d4d/db5/dc0/f12f [337747,117024] 0 2024-09-20T18:36:13.180 INFO:tasks.workunit.client.0.smithi017.stdout:6/746: creat d4/d29/df5/d43/d7d/f102 x:0 0 0 2024-09-20T18:36:13.183 INFO:tasks.workunit.client.0.smithi017.stdout:6/747: creat d4/d37/d68/f103 x:0 0 0 2024-09-20T18:36:13.184 INFO:tasks.workunit.client.0.smithi017.stdout:5/875: getdents d0/d14/d116 0 2024-09-20T18:36:13.187 INFO:tasks.workunit.client.0.smithi017.stdout:5/876: mkdir d0/d14/d18/d1b/d131 0 2024-09-20T18:36:13.188 INFO:tasks.workunit.client.0.smithi017.stdout:6/748: creat d4/df/d1f/df6/f104 x:0 0 0 2024-09-20T18:36:13.188 INFO:tasks.workunit.client.0.smithi017.stdout:5/877: write d0/d14/d18/d2a/fff [890323,55511] 0 2024-09-20T18:36:13.190 INFO:tasks.workunit.client.0.smithi017.stdout:5/878: fdatasync d0/d14/d18/d2a/d39/d42/f49 0 2024-09-20T18:36:13.191 INFO:tasks.workunit.client.0.smithi017.stdout:9/922: sync 2024-09-20T18:36:13.191 INFO:tasks.workunit.client.0.smithi017.stdout:0/676: sync 2024-09-20T18:36:13.194 INFO:tasks.workunit.client.0.smithi017.stdout:6/749: read d4/df/d1f/d25/d2b/fb7 [1018020,9140] 0 2024-09-20T18:36:13.194 INFO:tasks.workunit.client.0.smithi017.stdout:6/750: chown d4/df 15 1 2024-09-20T18:36:13.195 INFO:tasks.workunit.client.0.smithi017.stdout:5/879: mkdir d0/dbe/ddc/d132 0 2024-09-20T18:36:13.196 INFO:tasks.workunit.client.0.smithi017.stdout:5/880: write d0/d14/d18/d2a/d39/d6c/d72/f11d [469531,56299] 0 2024-09-20T18:36:13.198 INFO:tasks.workunit.client.0.smithi017.stdout:0/677: creat d4/db/d18/d25/fe5 x:0 0 0 2024-09-20T18:36:13.202 INFO:tasks.workunit.client.0.smithi017.stdout:5/881: dread d0/d14/d18/d2a/d39/f61 [0,4194304] 0 2024-09-20T18:36:13.204 INFO:tasks.workunit.client.0.smithi017.stdout:0/678: mknod d4/db/d18/d25/d36/d47/d8c/daa/dca/db1/ce6 0 2024-09-20T18:36:13.206 INFO:tasks.workunit.client.0.smithi017.stdout:5/882: creat d0/d14/d18/dd1/f133 x:0 0 0 2024-09-20T18:36:13.208 INFO:tasks.workunit.client.0.smithi017.stdout:5/883: write d0/d14/d18/d2a/d39/d42/f49 [6263121,126283] 0 2024-09-20T18:36:13.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:12 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:36:13.211 INFO:tasks.workunit.client.0.smithi017.stdout:5/884: getdents d0/d14/d18/d1b/d131 0 2024-09-20T18:36:13.221 INFO:tasks.workunit.client.0.smithi017.stdout:0/679: dread d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/f61 [0,4194304] 0 2024-09-20T18:36:13.223 INFO:tasks.workunit.client.0.smithi017.stdout:0/680: mknod d4/db/d18/d78/ce7 0 2024-09-20T18:36:13.224 INFO:tasks.workunit.client.0.smithi017.stdout:5/885: dread d0/d14/d18/d2a/d39/d6c/ff1 [4194304,4194304] 0 2024-09-20T18:36:13.227 INFO:tasks.workunit.client.0.smithi017.stdout:0/681: truncate d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/fc5 656921 0 2024-09-20T18:36:13.227 INFO:tasks.workunit.client.0.smithi017.stdout:5/886: mkdir d0/d14/d18/d19/d4d/d6d/d78/d98/d134 0 2024-09-20T18:36:13.228 INFO:tasks.workunit.client.0.smithi017.stdout:0/682: chown d4/db/dcd 1127538 1 2024-09-20T18:36:13.228 INFO:tasks.workunit.client.0.smithi017.stdout:9/923: write d6/d23/d58/f94 [4077329,113373] 0 2024-09-20T18:36:13.229 INFO:tasks.workunit.client.0.smithi017.stdout:0/683: dread - d4/db/dcd/d52/f57 zero size 2024-09-20T18:36:13.231 INFO:tasks.workunit.client.0.smithi017.stdout:5/887: truncate d0/d14/d18/d1b/f100 737833 0 2024-09-20T18:36:13.235 INFO:tasks.workunit.client.0.smithi017.stdout:6/751: dwrite d4/f1e [0,4194304] 0 2024-09-20T18:36:13.242 INFO:tasks.workunit.client.0.smithi017.stdout:9/924: rename d6/d23/d58/d3f/d4d/d73/d8f/l11f to d6/d23/d3a/db8/l148 0 2024-09-20T18:36:13.244 INFO:tasks.workunit.client.0.smithi017.stdout:1/745: sync 2024-09-20T18:36:13.245 INFO:tasks.workunit.client.0.smithi017.stdout:5/888: mkdir d0/d14/d18/d1b/d131/d135 0 2024-09-20T18:36:13.245 INFO:tasks.workunit.client.0.smithi017.stdout:0/684: write d4/db/f3b [2924625,32217] 0 2024-09-20T18:36:13.248 INFO:tasks.workunit.client.0.smithi017.stdout:6/752: fsync d4/d37/d68/da4/d9e/f9f 0 2024-09-20T18:36:13.249 INFO:tasks.workunit.client.0.smithi017.stdout:1/746: symlink df/d1c/d45/led 0 2024-09-20T18:36:13.256 INFO:tasks.workunit.client.0.smithi017.stdout:1/747: mkdir df/d35/d6b/dee 0 2024-09-20T18:36:13.258 INFO:tasks.workunit.client.0.smithi017.stdout:5/889: mknod d0/c136 0 2024-09-20T18:36:13.264 INFO:tasks.workunit.client.0.smithi017.stdout:6/753: creat d4/df/d1f/d25/f105 x:0 0 0 2024-09-20T18:36:13.265 INFO:tasks.workunit.client.0.smithi017.stdout:0/685: dwrite d4/db/d18/d25/d36/f82 [0,4194304] 0 2024-09-20T18:36:13.268 INFO:tasks.workunit.client.0.smithi017.stdout:1/748: dwrite df/d16/d50/dab/fc3 [0,4194304] 0 2024-09-20T18:36:13.271 INFO:tasks.workunit.client.0.smithi017.stdout:9/925: dread d6/d23/d58/f9b [0,4194304] 0 2024-09-20T18:36:13.277 INFO:tasks.workunit.client.0.smithi017.stdout:0/686: truncate d4/d37/f3a 1114510 0 2024-09-20T18:36:13.279 INFO:tasks.workunit.client.0.smithi017.stdout:1/749: mknod df/d29/d7e/cef 0 2024-09-20T18:36:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.266+0000 7f60da061640 1 -- 172.21.15.17:0/584481227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d4100200 msgr2=0x7f60d4102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.266+0000 7f60da061640 1 --2- 172.21.15.17:0/584481227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d4100200 0x7f60d4102610 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009880 tx=0x7f60bc02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:36:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.267+0000 7f60da061640 1 -- 172.21.15.17:0/584481227 shutdown_connections 2024-09-20T18:36:13.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.267+0000 7f60da061640 1 --2- 172.21.15.17:0/584481227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d4102b50 0x7f60d4104fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:13.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.267+0000 7f60da061640 1 --2- 172.21.15.17:0/584481227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d4100200 0x7f60d4102610 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:13.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.267+0000 7f60da061640 1 -- 172.21.15.17:0/584481227 >> 172.21.15.17:0/584481227 conn(0x7f60d40fc010 msgr2=0x7f60d40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:13.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.267+0000 7f60da061640 1 -- 172.21.15.17:0/584481227 shutdown_connections 2024-09-20T18:36:13.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.267+0000 7f60da061640 1 -- 172.21.15.17:0/584481227 wait complete. 2024-09-20T18:36:13.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.267+0000 7f60da061640 1 Processor -- start 2024-09-20T18:36:13.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.268+0000 7f60da061640 1 -- start start 2024-09-20T18:36:13.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.268+0000 7f60da061640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d4100200 0x7f60d419da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:13.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.268+0000 7f60da061640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d4102b50 0x7f60d419dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:13.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.268+0000 7f60da061640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f60d4110d90 con 0x7f60d4102b50 2024-09-20T18:36:13.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.268+0000 7f60da061640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f60d4110c10 con 0x7f60d4100200 2024-09-20T18:36:13.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.268+0000 7f60d2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d4102b50 0x7f60d419dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:13.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.268+0000 7f60d2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d4102b50 0x7f60d419dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37272/0 (socket says 172.21.15.17:37272) 2024-09-20T18:36:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.268+0000 7f60d2ffd640 1 -- 172.21.15.17:0/2193470219 learned_addr learned my addr 172.21.15.17:0/2193470219 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:36:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.268+0000 7f60d37fe640 1 --2- 172.21.15.17:0/2193470219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d4100200 0x7f60d419da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.269+0000 7f60d2ffd640 1 -- 172.21.15.17:0/2193470219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d4100200 msgr2=0x7f60d419da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.269+0000 7f60d2ffd640 1 --2- 172.21.15.17:0/2193470219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d4100200 0x7f60d419da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.269+0000 7f60d2ffd640 1 -- 172.21.15.17:0/2193470219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d419e650 con 0x7f60d4102b50 2024-09-20T18:36:13.285 INFO:tasks.workunit.client.0.smithi017.stdout:6/754: rename d4/df/d4a/d8f/cef to d4/df/d4a/d8f/c106 0 2024-09-20T18:36:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.269+0000 7f60d2ffd640 1 --2- 172.21.15.17:0/2193470219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d4102b50 0x7f60d419dfd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f60c400e970 tx=0x7f60c400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.270+0000 7f60d0ff9640 1 -- 172.21.15.17:0/2193470219 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60c400cac0 con 0x7f60d4102b50 2024-09-20T18:36:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.270+0000 7f60da061640 1 -- 172.21.15.17:0/2193470219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60d41a3090 con 0x7f60d4102b50 2024-09-20T18:36:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.270+0000 7f60d0ff9640 1 -- 172.21.15.17:0/2193470219 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f60c400cc60 con 0x7f60d4102b50 2024-09-20T18:36:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.270+0000 7f60d0ff9640 1 -- 172.21.15.17:0/2193470219 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60c4018720 con 0x7f60d4102b50 2024-09-20T18:36:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.270+0000 7f60da061640 1 -- 172.21.15.17:0/2193470219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60d41a3620 con 0x7f60d4102b50 2024-09-20T18:36:13.287 INFO:tasks.workunit.client.0.smithi017.stdout:5/890: link d0/d14/d18/d2a/l46 d0/d14/d18/d19/d4d/d6d/db7/d109/l137 0 2024-09-20T18:36:13.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.272+0000 7f60da061640 1 -- 172.21.15.17:0/2193470219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60d4100600 con 0x7f60d4102b50 2024-09-20T18:36:13.288 INFO:tasks.workunit.client.0.smithi017.stdout:1/750: readlink df/d16/lcd 0 2024-09-20T18:36:13.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.272+0000 7f60d0ff9640 1 -- 172.21.15.17:0/2193470219 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f60c4018a00 con 0x7f60d4102b50 2024-09-20T18:36:13.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.273+0000 7f60d0ff9640 1 --2- 172.21.15.17:0/2193470219 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f60c0074a80 0x7f60c0076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:13.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.273+0000 7f60d0ff9640 1 -- 172.21.15.17:0/2193470219 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7f60c40967b0 con 0x7f60d4102b50 2024-09-20T18:36:13.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.274+0000 7f60d37fe640 1 --2- 172.21.15.17:0/2193470219 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f60c0074a80 0x7f60c0076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:13.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.274+0000 7f60d37fe640 1 --2- 172.21.15.17:0/2193470219 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f60c0074a80 0x7f60c0076f40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f60bc000c00 tx=0x7f60bc005a20 comp rx=0 tx=0).ready entity=mgr.24405 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:13.290 INFO:tasks.workunit.client.0.smithi017.stdout:0/687: link d4/db/f12 d4/db/d18/d25/d36/d47/d81/d9c/fe8 0 2024-09-20T18:36:13.294 INFO:tasks.workunit.client.0.smithi017.stdout:6/755: read d4/df/d1f/d25/d3f/ffa [2831194,108872] 0 2024-09-20T18:36:13.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.280+0000 7f60d0ff9640 1 -- 172.21.15.17:0/2193470219 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f60c4061dc0 con 0x7f60d4102b50 2024-09-20T18:36:13.300 INFO:tasks.workunit.client.0.smithi017.stdout:1/751: chown df/f18 5051455 1 2024-09-20T18:36:13.303 INFO:tasks.workunit.client.0.smithi017.stdout:6/756: symlink d4/df/d4a/d8f/l107 0 2024-09-20T18:36:13.304 INFO:tasks.workunit.client.0.smithi017.stdout:1/752: write df/d35/fd2 [988223,73496] 0 2024-09-20T18:36:13.304 INFO:tasks.workunit.client.0.smithi017.stdout:9/926: dread d6/d11/f21 [0,4194304] 0 2024-09-20T18:36:13.306 INFO:tasks.workunit.client.0.smithi017.stdout:5/891: dread d0/f10 [4194304,4194304] 0 2024-09-20T18:36:13.307 INFO:tasks.workunit.client.0.smithi017.stdout:9/927: stat d6/d23/d3a/d61/l9a 0 2024-09-20T18:36:13.307 INFO:tasks.workunit.client.0.smithi017.stdout:1/753: stat df/d29/d2c/d5b 0 2024-09-20T18:36:13.307 INFO:tasks.workunit.client.0.smithi017.stdout:1/754: readlink df/d16/l31 0 2024-09-20T18:36:13.308 INFO:tasks.workunit.client.0.smithi017.stdout:6/757: readlink l3 0 2024-09-20T18:36:13.310 INFO:tasks.workunit.client.0.smithi017.stdout:1/755: chown df/d35/fb1 25 1 2024-09-20T18:36:13.310 INFO:tasks.workunit.client.0.smithi017.stdout:6/758: dread - d4/d37/d68/f103 zero size 2024-09-20T18:36:13.311 INFO:tasks.workunit.client.0.smithi017.stdout:1/756: stat df/d35/d6b/fe4 0 2024-09-20T18:36:13.314 INFO:tasks.workunit.client.0.smithi017.stdout:6/759: creat d4/d29/dc6/f108 x:0 0 0 2024-09-20T18:36:13.316 INFO:tasks.workunit.client.0.smithi017.stdout:5/892: unlink d0/d14/d18/dfd/d10a/cf0 0 2024-09-20T18:36:13.317 INFO:tasks.workunit.client.0.smithi017.stdout:0/688: dread d4/d20/f2a [0,4194304] 0 2024-09-20T18:36:13.319 INFO:tasks.workunit.client.0.smithi017.stdout:5/893: creat d0/d14/d18/dd1/f138 x:0 0 0 2024-09-20T18:36:13.321 INFO:tasks.workunit.client.0.smithi017.stdout:9/928: getdents d6/d23/d40/db4 0 2024-09-20T18:36:13.322 INFO:tasks.workunit.client.0.smithi017.stdout:0/689: creat d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/d95/fe9 x:0 0 0 2024-09-20T18:36:13.323 INFO:tasks.workunit.client.0.smithi017.stdout:9/929: write d6/d23/d3a/d61/de7/f13a [396949,55077] 0 2024-09-20T18:36:13.323 INFO:tasks.workunit.client.0.smithi017.stdout:6/760: rename d4/d37/d68/d8d/cff to d4/df/d1f/c109 0 2024-09-20T18:36:13.324 INFO:tasks.workunit.client.0.smithi017.stdout:5/894: mknod d0/d14/d18/d2a/da1/c139 0 2024-09-20T18:36:13.326 INFO:tasks.workunit.client.0.smithi017.stdout:5/895: chown d0/dbe/ddc/d125/f126 1579195 1 2024-09-20T18:36:13.327 INFO:tasks.workunit.client.0.smithi017.stdout:1/757: rename df/d1c/d80/l95 to df/d8f/lf0 0 2024-09-20T18:36:13.327 INFO:tasks.workunit.client.0.smithi017.stdout:9/930: dread - d6/d23/d3a/fc4 zero size 2024-09-20T18:36:13.328 INFO:tasks.workunit.client.0.smithi017.stdout:1/758: stat df/d16/d50/d53/d60 0 2024-09-20T18:36:13.332 INFO:tasks.workunit.client.0.smithi017.stdout:0/690: link d4/db/d18/d78/cd5 d4/cea 0 2024-09-20T18:36:13.333 INFO:tasks.workunit.client.0.smithi017.stdout:4/663: sync 2024-09-20T18:36:13.334 INFO:tasks.workunit.client.0.smithi017.stdout:8/623: sync 2024-09-20T18:36:13.335 INFO:tasks.workunit.client.0.smithi017.stdout:9/931: rename d6/d23/d58/d3f/d4d/d73/d7d/d10f to d6/d23/d58/d3f/d4d/d73/d7d/dbd/d149 0 2024-09-20T18:36:13.336 INFO:tasks.workunit.client.0.smithi017.stdout:5/896: getdents d0/d14/d18/d19/d85 0 2024-09-20T18:36:13.338 INFO:tasks.workunit.client.0.smithi017.stdout:0/691: fdatasync d4/db/d18/f54 0 2024-09-20T18:36:13.339 INFO:tasks.workunit.client.0.smithi017.stdout:1/759: link df/d1c/l4e df/d1c/d45/dd9/lf1 0 2024-09-20T18:36:13.343 INFO:tasks.workunit.client.0.smithi017.stdout:6/761: dread d4/d29/df5/d43/fd2 [0,4194304] 0 2024-09-20T18:36:13.345 INFO:tasks.workunit.client.0.smithi017.stdout:5/897: creat d0/d14/d18/d19/d4d/db5/f13a x:0 0 0 2024-09-20T18:36:13.349 INFO:tasks.workunit.client.0.smithi017.stdout:1/760: symlink df/d29/d7e/lf2 0 2024-09-20T18:36:13.354 INFO:tasks.workunit.client.0.smithi017.stdout:5/898: dwrite d0/d14/d18/d2a/d39/d42/f121 [0,4194304] 0 2024-09-20T18:36:13.356 INFO:tasks.workunit.client.0.smithi017.stdout:0/692: mkdir d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d94/deb 0 2024-09-20T18:36:13.359 INFO:tasks.workunit.client.0.smithi017.stdout:1/761: dwrite df/d16/fb6 [0,4194304] 0 2024-09-20T18:36:13.360 INFO:tasks.workunit.client.0.smithi017.stdout:8/624: dread d0/f1e [0,4194304] 0 2024-09-20T18:36:13.360 INFO:tasks.workunit.client.0.smithi017.stdout:6/762: mknod d4/df/d1f/d25/d2b/c10a 0 2024-09-20T18:36:13.365 INFO:tasks.workunit.client.0.smithi017.stdout:0/693: mknod d4/d20/cec 0 2024-09-20T18:36:13.366 INFO:tasks.workunit.client.0.smithi017.stdout:8/625: readlink d0/l3 0 2024-09-20T18:36:13.366 INFO:tasks.workunit.client.0.smithi017.stdout:8/626: read d0/d6/f21 [473342,10006] 0 2024-09-20T18:36:13.369 INFO:tasks.workunit.client.0.smithi017.stdout:6/763: creat d4/d37/d68/d8d/dba/f10b x:0 0 0 2024-09-20T18:36:13.372 INFO:tasks.workunit.client.0.smithi017.stdout:1/762: rmdir df/d16/d50/d53/d60 39 2024-09-20T18:36:13.373 INFO:tasks.workunit.client.0.smithi017.stdout:1/763: chown df/d16/c27 236681195 1 2024-09-20T18:36:13.374 INFO:tasks.workunit.client.0.smithi017.stdout:5/899: creat d0/dbe/df9/f13b x:0 0 0 2024-09-20T18:36:13.375 INFO:tasks.workunit.client.0.smithi017.stdout:0/694: creat d4/db/dcd/fed x:0 0 0 2024-09-20T18:36:13.385 INFO:tasks.workunit.client.0.smithi017.stdout:0/695: dwrite d4/db/dcd/d52/d77/daf/fe3 [0,4194304] 0 2024-09-20T18:36:13.387 INFO:tasks.workunit.client.0.smithi017.stdout:1/764: mkdir df/d35/d6b/df3 0 2024-09-20T18:36:13.400 INFO:tasks.workunit.client.0.smithi017.stdout:6/764: rmdir d4/df/d4a/de6 39 2024-09-20T18:36:13.406 INFO:tasks.workunit.client.0.smithi017.stdout:5/900: rename d0/c64 to d0/d14/d18/d19/d4d/db5/dc0/c13c 0 2024-09-20T18:36:13.409 INFO:tasks.workunit.client.0.smithi017.stdout:8/627: mknod d0/d6/d28/d3d/cd4 0 2024-09-20T18:36:13.411 INFO:tasks.workunit.client.0.smithi017.stdout:6/765: chown d4/d29/c34 225 1 2024-09-20T18:36:13.414 INFO:tasks.workunit.client.0.smithi017.stdout:1/765: rename df/d16/d50/d53/d60/lc8 to df/d35/d4f/d82/lf4 0 2024-09-20T18:36:13.416 INFO:tasks.workunit.client.0.smithi017.stdout:4/664: write d4/d82/fa5 [885282,106065] 0 2024-09-20T18:36:13.422 INFO:tasks.workunit.client.0.smithi017.stdout:9/932: write d6/d23/d3a/d61/de7/fc7 [737995,45402] 0 2024-09-20T18:36:13.425 INFO:tasks.workunit.client.0.smithi017.stdout:8/628: rmdir d0/d6/d28/d3b/d72/d98/da4 39 2024-09-20T18:36:13.438 INFO:tasks.workunit.client.0.smithi017.stdout:3/910: sync 2024-09-20T18:36:13.438 INFO:tasks.workunit.client.0.smithi017.stdout:2/946: sync 2024-09-20T18:36:13.438 INFO:tasks.workunit.client.0.smithi017.stdout:7/745: sync 2024-09-20T18:36:13.439 INFO:tasks.workunit.client.0.smithi017.stdout:4/665: creat d4/d19/d37/d66/fdf x:0 0 0 2024-09-20T18:36:13.445 INFO:tasks.workunit.client.0.smithi017.stdout:0/696: write d4/db/d18/d25/f7f [1597358,46129] 0 2024-09-20T18:36:13.446 INFO:tasks.workunit.client.0.smithi017.stdout:8/629: creat d0/d6/d28/d3d/d4e/d55/d83/fd5 x:0 0 0 2024-09-20T18:36:13.451 INFO:tasks.workunit.client.0.smithi017.stdout:5/901: link d0/d14/d18/d19/d4d/d6d/db7/dc1/l12a d0/d14/d18/dfd/l13d 0 2024-09-20T18:36:13.452 INFO:tasks.workunit.client.0.smithi017.stdout:5/902: stat d0/d14/c69 0 2024-09-20T18:36:13.453 INFO:tasks.workunit.client.0.smithi017.stdout:2/947: fsync d1/dc/d20/d2e/f62 0 2024-09-20T18:36:13.457 INFO:tasks.workunit.client.0.smithi017.stdout:7/746: creat da/d16/d92/fec x:0 0 0 2024-09-20T18:36:13.459 INFO:tasks.workunit.client.0.smithi017.stdout:9/933: creat d6/d23/d58/d3f/d4d/d73/d7d/dbd/de6/f14a x:0 0 0 2024-09-20T18:36:13.463 INFO:tasks.workunit.client.0.smithi017.stdout:8/630: read d0/d6/f20 [331874,55241] 0 2024-09-20T18:36:13.464 INFO:tasks.workunit.client.0.smithi017.stdout:8/631: dread - d0/d6/d93/faf zero size 2024-09-20T18:36:13.466 INFO:tasks.workunit.client.0.smithi017.stdout:9/934: dread d6/d23/d40/db4/fce [0,4194304] 0 2024-09-20T18:36:13.468 INFO:tasks.workunit.client.0.smithi017.stdout:1/766: rename df/lec to df/d16/lf5 0 2024-09-20T18:36:13.470 INFO:tasks.workunit.client.0.smithi017.stdout:1/767: dread df/d1c/f93 [0,4194304] 0 2024-09-20T18:36:13.471 INFO:tasks.workunit.client.0.smithi017.stdout:4/666: rmdir d4/d19/d37/da1/d1b/daa 39 2024-09-20T18:36:13.473 INFO:tasks.workunit.client.0.smithi017.stdout:4/667: chown d4/d19/d37/da1/d1b/d56/d67 91166025 1 2024-09-20T18:36:13.473 INFO:tasks.workunit.client.0.smithi017.stdout:4/668: chown d4/d19/d37/d66/lcc 0 1 2024-09-20T18:36:13.474 INFO:tasks.workunit.client.0.smithi017.stdout:2/948: mkdir d1/dc/d20/d2e/d30/db0/dc2/d133 0 2024-09-20T18:36:13.478 INFO:tasks.workunit.client.0.smithi017.stdout:9/935: rmdir d6/d23/d58/d3f/d70/dfe 39 2024-09-20T18:36:13.479 INFO:tasks.workunit.client.0.smithi017.stdout:6/766: getdents d4/df/d1f/d25/d3f/d5c 0 2024-09-20T18:36:13.479 INFO:tasks.workunit.client.0.smithi017.stdout:9/936: write d6/fe [2375469,49293] 0 2024-09-20T18:36:13.488 INFO:tasks.workunit.client.0.smithi017.stdout:4/669: symlink d4/dc/d1e/d8e/le0 0 2024-09-20T18:36:13.494 INFO:tasks.workunit.client.0.smithi017.stdout:0/697: truncate d4/db/f2c 7193489 0 2024-09-20T18:36:13.498 INFO:tasks.workunit.client.0.smithi017.stdout:6/767: mkdir d4/df/d1f/df6/d10c 0 2024-09-20T18:36:13.501 INFO:tasks.workunit.client.0.smithi017.stdout:9/937: rmdir d6/d23/d58/d3f/d70 39 2024-09-20T18:36:13.501 INFO:tasks.workunit.client.0.smithi017.stdout:8/632: dwrite d0/d6/f20 [0,4194304] 0 2024-09-20T18:36:13.504 INFO:tasks.workunit.client.0.smithi017.stdout:3/911: rename da/de/d13/d2f/d26/l34 to da/de/d53/d88/db3/l131 0 2024-09-20T18:36:13.508 INFO:tasks.workunit.client.0.smithi017.stdout:1/768: mknod df/d29/cf6 0 2024-09-20T18:36:13.508 INFO:tasks.workunit.client.0.smithi017.stdout:6/768: dwrite d4/df/d4a/fde [0,4194304] 0 2024-09-20T18:36:13.515 INFO:tasks.workunit.client.0.smithi017.stdout:2/949: symlink d1/dc/d20/d2e/l134 0 2024-09-20T18:36:13.519 INFO:tasks.workunit.client.0.smithi017.stdout:4/670: truncate d4/d19/d37/dbc/d7a/fc9 813408 0 2024-09-20T18:36:13.520 INFO:tasks.workunit.client.0.smithi017.stdout:7/747: dwrite da/fe9 [0,4194304] 0 2024-09-20T18:36:13.526 INFO:tasks.workunit.client.0.smithi017.stdout:1/769: dwrite df/d35/d6b/fd6 [0,4194304] 0 2024-09-20T18:36:13.527 INFO:tasks.workunit.client.0.smithi017.stdout:9/938: creat d6/d42/f14b x:0 0 0 2024-09-20T18:36:13.527 INFO:tasks.workunit.client.0.smithi017.stdout:8/633: creat d0/d6/d28/d3d/d4e/d55/d83/da2/fd6 x:0 0 0 2024-09-20T18:36:13.527 INFO:tasks.workunit.client.0.smithi017.stdout:0/698: rename d4/db/d18/d25/d36/f76 to d4/d68/d8e/fee 0 2024-09-20T18:36:13.529 INFO:tasks.workunit.client.0.smithi017.stdout:3/912: creat da/de/d53/d52/dfb/f132 x:0 0 0 2024-09-20T18:36:13.529 INFO:tasks.workunit.client.0.smithi017.stdout:5/903: getdents d0/d14/d18/dcc/d122 0 2024-09-20T18:36:13.531 INFO:tasks.workunit.client.0.smithi017.stdout:4/671: chown d4/dc/d1e/d26/fad 275548 1 2024-09-20T18:36:13.534 INFO:tasks.workunit.client.0.smithi017.stdout:1/770: truncate df/d29/f56 9079546 0 2024-09-20T18:36:13.535 INFO:tasks.workunit.client.0.smithi017.stdout:6/769: mknod d4/c10d 0 2024-09-20T18:36:13.536 INFO:tasks.workunit.client.0.smithi017.stdout:8/634: symlink d0/d6/d28/d3a/dae/ld7 0 2024-09-20T18:36:13.537 INFO:tasks.workunit.client.0.smithi017.stdout:7/748: dread da/d16/d1c/d40/d30/f66 [0,4194304] 0 2024-09-20T18:36:13.539 INFO:tasks.workunit.client.0.smithi017.stdout:9/939: rename d6/d23/d3a/d61/fe0 to d6/d23/d58/d3f/d4d/d73/d8f/f14c 0 2024-09-20T18:36:13.539 INFO:tasks.workunit.client.0.smithi017.stdout:7/749: write da/fbb [68752,22685] 0 2024-09-20T18:36:13.540 INFO:tasks.workunit.client.0.smithi017.stdout:4/672: unlink d4/dc/l6d 0 2024-09-20T18:36:13.543 INFO:tasks.workunit.client.0.smithi017.stdout:5/904: dread - d0/d14/d18/d19/d4d/d6d/d78/d99/fb3 zero size 2024-09-20T18:36:13.545 INFO:tasks.workunit.client.0.smithi017.stdout:5/905: write d0/d14/d18/d19/d4d/f84 [1290724,127183] 0 2024-09-20T18:36:13.548 INFO:tasks.workunit.client.0.smithi017.stdout:6/770: write d4/fd [1776279,49091] 0 2024-09-20T18:36:13.551 INFO:tasks.workunit.client.0.smithi017.stdout:0/699: creat d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/fef x:0 0 0 2024-09-20T18:36:13.552 INFO:tasks.workunit.client.0.smithi017.stdout:7/750: mkdir da/d16/de2/ded 0 2024-09-20T18:36:13.555 INFO:tasks.workunit.client.0.smithi017.stdout:5/906: chown d0/dd9/dbd/cee 0 1 2024-09-20T18:36:13.556 INFO:tasks.workunit.client.0.smithi017.stdout:5/907: fdatasync d0/d14/d18/d19/d85/f87 0 2024-09-20T18:36:13.559 INFO:tasks.workunit.client.0.smithi017.stdout:1/771: mkdir df/d29/d7e/dde/df7 0 2024-09-20T18:36:13.559 INFO:tasks.workunit.client.0.smithi017.stdout:2/950: write d1/dc/d20/d2e/d30/d8a/ddf/f12b [2640876,42099] 0 2024-09-20T18:36:13.560 INFO:tasks.workunit.client.0.smithi017.stdout:6/771: fdatasync d4/df/f15 0 2024-09-20T18:36:13.561 INFO:tasks.workunit.client.0.smithi017.stdout:6/772: dread - d4/d29/dc6/de7/ff9 zero size 2024-09-20T18:36:13.565 INFO:tasks.workunit.client.0.smithi017.stdout:4/673: mkdir d4/d19/dd0/de1 0 2024-09-20T18:36:13.567 INFO:tasks.workunit.client.0.smithi017.stdout:4/674: write d4/dc/d1e/d26/fad [946734,13032] 0 2024-09-20T18:36:13.569 INFO:tasks.workunit.client.0.smithi017.stdout:4/675: chown d4/d82/d88/d5c/f9a 15 1 2024-09-20T18:36:13.574 INFO:tasks.workunit.client.0.smithi017.stdout:9/940: write d6/dc1/ff3 [346760,94722] 0 2024-09-20T18:36:13.575 INFO:tasks.workunit.client.0.smithi017.stdout:3/913: rename da/de/d13/d2f/d26/d31/d5a/d76/d19/f1c to da/de/d13/d2f/d26/f133 0 2024-09-20T18:36:13.576 INFO:tasks.workunit.client.0.smithi017.stdout:1/772: write df/f2b [3693497,81236] 0 2024-09-20T18:36:13.576 INFO:tasks.workunit.client.0.smithi017.stdout:0/700: dread d4/d20/d63/d86/fa7 [0,4194304] 0 2024-09-20T18:36:13.580 INFO:tasks.workunit.client.0.smithi017.stdout:7/751: fsync da/d16/d1c/d40/d5d/fa5 0 2024-09-20T18:36:13.580 INFO:tasks.workunit.client.0.smithi017.stdout:4/676: dwrite d4/d19/d37/f57 [0,4194304] 0 2024-09-20T18:36:13.580 INFO:tasks.workunit.client.0.smithi017.stdout:0/701: chown d4/d20 5 1 2024-09-20T18:36:13.581 INFO:tasks.workunit.client.0.smithi017.stdout:1/773: chown df/d16/d50 375543127 1 2024-09-20T18:36:13.586 INFO:tasks.workunit.client.0.smithi017.stdout:0/702: truncate d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/f87 1643068 0 2024-09-20T18:36:13.587 INFO:tasks.workunit.client.0.smithi017.stdout:2/951: write d1/dc/d20/d2e/d30/d85/d46/fd6 [3450155,69748] 0 2024-09-20T18:36:13.588 INFO:tasks.workunit.client.0.smithi017.stdout:3/914: symlink da/de/d13/d16/d6e/d97/dc1/l134 0 2024-09-20T18:36:13.591 INFO:tasks.workunit.client.0.smithi017.stdout:9/941: mknod d6/d23/d58/d3f/d4d/d100/c14d 0 2024-09-20T18:36:13.591 INFO:tasks.workunit.client.0.smithi017.stdout:7/752: dread - da/d16/f90 zero size 2024-09-20T18:36:13.594 INFO:tasks.workunit.client.0.smithi017.stdout:5/908: link d0/dbe/ddc/d125/f126 d0/d14/d18/d2a/d39/d42/d7e/f13e 0 2024-09-20T18:36:13.596 INFO:tasks.workunit.client.0.smithi017.stdout:1/774: rename df/d35/d4f/d82/dac/dc7 to df/d16/d50/d69/d62/df8 0 2024-09-20T18:36:13.598 INFO:tasks.workunit.client.0.smithi017.stdout:4/677: mknod d4/d82/d88/d5c/d8f/ce2 0 2024-09-20T18:36:13.598 INFO:tasks.workunit.client.0.smithi017.stdout:4/678: chown d4/f54 126959 1 2024-09-20T18:36:13.604 INFO:tasks.workunit.client.0.smithi017.stdout:7/753: creat da/d16/d1c/d40/d3a/d8a/fee x:0 0 0 2024-09-20T18:36:13.610 INFO:tasks.workunit.client.0.smithi017.stdout:4/679: symlink d4/d82/d88/d5c/d8f/da9/db4/le3 0 2024-09-20T18:36:13.613 INFO:tasks.workunit.client.0.smithi017.stdout:2/952: unlink d1/dc/d20/d2e/d30/d85/f7d 0 2024-09-20T18:36:13.614 INFO:tasks.workunit.client.0.smithi017.stdout:7/754: truncate da/d16/d1c/d40/d30/f87 400162 0 2024-09-20T18:36:13.616 INFO:tasks.workunit.client.0.smithi017.stdout:0/703: dwrite d4/db/d18/d25/f7c [0,4194304] 0 2024-09-20T18:36:13.616 INFO:tasks.workunit.client.0.smithi017.stdout:2/953: fsync d1/dc/d20/d2e/f5f 0 2024-09-20T18:36:13.617 INFO:tasks.workunit.client.0.smithi017.stdout:1/775: creat df/d29/d7e/dde/df7/ff9 x:0 0 0 2024-09-20T18:36:13.617 INFO:tasks.workunit.client.0.smithi017.stdout:4/680: mkdir d4/d19/d37/da1/de4 0 2024-09-20T18:36:13.618 INFO:tasks.workunit.client.0.smithi017.stdout:7/755: chown da/d16/d1c/d40/d30/d98 373 1 2024-09-20T18:36:13.623 INFO:tasks.workunit.client.0.smithi017.stdout:9/942: dread d6/d23/d58/d3f/d4d/d73/d93/fd5 [0,4194304] 0 2024-09-20T18:36:13.627 INFO:tasks.workunit.client.0.smithi017.stdout:1/776: dread df/d16/d50/f86 [0,4194304] 0 2024-09-20T18:36:13.629 INFO:tasks.workunit.client.0.smithi017.stdout:2/954: read d1/d67/d8f/dcd/fd0 [2695594,28667] 0 2024-09-20T18:36:13.630 INFO:tasks.workunit.client.0.smithi017.stdout:4/681: dwrite d4/d19/d37/da1/d1b/d56/d67/fcd [0,4194304] 0 2024-09-20T18:36:13.630 INFO:tasks.workunit.client.0.smithi017.stdout:2/955: fsync d1/df/d17/f8b 0 2024-09-20T18:36:13.632 INFO:tasks.workunit.client.0.smithi017.stdout:4/682: chown d4/d19/d37/da1 225 1 2024-09-20T18:36:13.633 INFO:tasks.workunit.client.0.smithi017.stdout:4/683: readlink d4/d19/d37/da1/d65/da0/ld1 0 2024-09-20T18:36:13.636 INFO:tasks.workunit.client.0.smithi017.stdout:4/684: dread - d4/dc/d1e/f73 zero size 2024-09-20T18:36:13.637 INFO:tasks.workunit.client.0.smithi017.stdout:1/777: creat df/d8f/ffa x:0 0 0 2024-09-20T18:36:13.640 INFO:tasks.workunit.client.0.smithi017.stdout:0/704: write d4/d20/fb9 [148174,6094] 0 2024-09-20T18:36:13.641 INFO:tasks.workunit.client.0.smithi017.stdout:1/778: chown df/d35/d4f/d82/dac 31 1 2024-09-20T18:36:13.642 INFO:tasks.workunit.client.0.smithi017.stdout:2/956: mknod d1/d1f/d99/c135 0 2024-09-20T18:36:13.643 INFO:tasks.workunit.client.0.smithi017.stdout:9/943: dwrite d6/f34 [0,4194304] 0 2024-09-20T18:36:13.645 INFO:tasks.workunit.client.0.smithi017.stdout:7/756: getdents da 0 2024-09-20T18:36:13.647 INFO:tasks.workunit.client.0.smithi017.stdout:0/705: creat d4/db/dcd/ff0 x:0 0 0 2024-09-20T18:36:13.648 INFO:tasks.workunit.client.0.smithi017.stdout:7/757: truncate da/d16/d1c/d40/d30/d98/fc2 704951 0 2024-09-20T18:36:13.648 INFO:tasks.workunit.client.0.smithi017.stdout:7/758: chown da/d16/d1c 395 1 2024-09-20T18:36:13.651 INFO:tasks.workunit.client.0.smithi017.stdout:4/685: mkdir d4/d19/d37/da1/d1b/d56/d67/db9/de5 0 2024-09-20T18:36:13.654 INFO:tasks.workunit.client.0.smithi017.stdout:7/759: symlink da/d16/d1c/d40/d34/dcd/de4/lef 0 2024-09-20T18:36:13.655 INFO:tasks.workunit.client.0.smithi017.stdout:2/957: mkdir d1/dc/d20/d2e/d30/d85/d46/d48/d136 0 2024-09-20T18:36:13.656 INFO:tasks.workunit.client.0.smithi017.stdout:1/779: link df/d16/f2e df/d35/d6b/ffb 0 2024-09-20T18:36:13.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.647+0000 7f60da061640 1 -- 172.21.15.17:0/2193470219 --> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f60d4103470 con 0x7f60c0074a80 2024-09-20T18:36:13.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.648+0000 7f60d0ff9640 1 -- 172.21.15.17:0/2193470219 <== mgr.24405 v2:172.21.15.172:6828/3016443347 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f60d4103470 con 0x7f60c0074a80 2024-09-20T18:36:13.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.650+0000 7f60da061640 1 -- 172.21.15.17:0/2193470219 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f60c0074a80 msgr2=0x7f60c0076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:13.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.650+0000 7f60da061640 1 --2- 172.21.15.17:0/2193470219 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f60c0074a80 0x7f60c0076f40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f60bc000c00 tx=0x7f60bc005a20 comp rx=0 tx=0).stop 2024-09-20T18:36:13.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.650+0000 7f60da061640 1 -- 172.21.15.17:0/2193470219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d4102b50 msgr2=0x7f60d419dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:13.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.650+0000 7f60da061640 1 --2- 172.21.15.17:0/2193470219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d4102b50 0x7f60d419dfd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f60c400e970 tx=0x7f60c400ee30 comp rx=0 tx=0).stop 2024-09-20T18:36:13.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.650+0000 7f60da061640 1 -- 172.21.15.17:0/2193470219 shutdown_connections 2024-09-20T18:36:13.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.650+0000 7f60da061640 1 --2- 172.21.15.17:0/2193470219 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f60c0074a80 0x7f60c0076f40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:13.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.650+0000 7f60da061640 1 --2- 172.21.15.17:0/2193470219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d4102b50 0x7f60d419dfd0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:13.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.650+0000 7f60da061640 1 --2- 172.21.15.17:0/2193470219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d4100200 0x7f60d419da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:13.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.650+0000 7f60da061640 1 -- 172.21.15.17:0/2193470219 >> 172.21.15.17:0/2193470219 conn(0x7f60d40fc010 msgr2=0x7f60d40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:13.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.651+0000 7f60da061640 1 -- 172.21.15.17:0/2193470219 shutdown_connections 2024-09-20T18:36:13.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.651+0000 7f60da061640 1 -- 172.21.15.17:0/2193470219 wait complete. 2024-09-20T18:36:13.686 INFO:tasks.workunit.client.0.smithi017.stdout:0/706: link d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/fd1 d4/db/dcd/d52/ff1 0 2024-09-20T18:36:13.692 INFO:tasks.workunit.client.0.smithi017.stdout:7/760: creat da/d16/d8e/ddf/ff0 x:0 0 0 2024-09-20T18:36:13.693 INFO:tasks.workunit.client.0.smithi017.stdout:7/761: chown da/d16/d1c/d40/d30/d98 180195 1 2024-09-20T18:36:13.695 INFO:tasks.workunit.client.0.smithi017.stdout:0/707: creat d4/d68/d8e/ff2 x:0 0 0 2024-09-20T18:36:13.696 INFO:tasks.workunit.client.0.smithi017.stdout:0/708: fdatasync d4/db/d18/f22 0 2024-09-20T18:36:13.697 INFO:tasks.workunit.client.0.smithi017.stdout:0/709: dread - d4/db/dcd/ff0 zero size 2024-09-20T18:36:13.698 INFO:tasks.workunit.client.0.smithi017.stdout:2/958: symlink d1/dc/d20/d2e/d30/d85/d3d/d8d/d119/l137 0 2024-09-20T18:36:13.699 INFO:tasks.workunit.client.0.smithi017.stdout:4/686: dwrite d4/d19/f42 [0,4194304] 0 2024-09-20T18:36:13.703 INFO:tasks.workunit.client.0.smithi017.stdout:2/959: mknod d1/d67/c138 0 2024-09-20T18:36:13.707 INFO:tasks.workunit.client.0.smithi017.stdout:4/687: fsync d4/f2c 0 2024-09-20T18:36:13.708 INFO:tasks.workunit.client.0.smithi017.stdout:1/780: truncate df/d16/d50/d53/fb0 781691 0 2024-09-20T18:36:13.716 INFO:tasks.workunit.client.0.smithi017.stdout:4/688: rename d4/d19/d37/da1/d1b/d56/fc7 to d4/d19/d37/da1/d1b/d56/d67/fe6 0 2024-09-20T18:36:13.716 INFO:tasks.workunit.client.0.smithi017.stdout:1/781: truncate df/d29/d2c/f65 54325 0 2024-09-20T18:36:13.718 INFO:tasks.workunit.client.0.smithi017.stdout:7/762: dwrite da/d16/d92/f9b [0,4194304] 0 2024-09-20T18:36:13.719 INFO:tasks.workunit.client.0.smithi017.stdout:2/960: creat d1/df/f139 x:0 0 0 2024-09-20T18:36:13.721 INFO:tasks.workunit.client.0.smithi017.stdout:7/763: write da/d16/d1c/d40/d3a/fbd [1033021,26566] 0 2024-09-20T18:36:13.723 INFO:tasks.workunit.client.0.smithi017.stdout:7/764: stat da/d16/d1c/d40/d5d/f9d 0 2024-09-20T18:36:13.726 INFO:tasks.workunit.client.0.smithi017.stdout:7/765: write da/d16/d1c/d40/d5d/da7/fb7 [339256,43877] 0 2024-09-20T18:36:13.738 INFO:tasks.workunit.client.0.smithi017.stdout:4/689: write d4/d19/d37/da1/d1b/f4c [2220698,59042] 0 2024-09-20T18:36:13.739 INFO:tasks.workunit.client.0.smithi017.stdout:4/690: readlink d4/dc/d1e/d8e/le0 0 2024-09-20T18:36:13.741 INFO:tasks.workunit.client.0.smithi017.stdout:1/782: write df/d16/d50/d53/fb0 [533128,73213] 0 2024-09-20T18:36:13.742 INFO:tasks.workunit.client.0.smithi017.stdout:7/766: write da/f77 [785870,96013] 0 2024-09-20T18:36:13.751 INFO:tasks.workunit.client.0.smithi017.stdout:4/691: chown d4/d19/d37/dbc/d7a/cc0 3486525 1 2024-09-20T18:36:13.752 INFO:tasks.workunit.client.0.smithi017.stdout:1/783: creat df/d29/d7e/ffc x:0 0 0 2024-09-20T18:36:13.753 INFO:tasks.workunit.client.0.smithi017.stdout:1/784: fsync df/d1c/d45/dcc/fd4 0 2024-09-20T18:36:13.754 INFO:tasks.workunit.client.0.smithi017.stdout:7/767: rmdir da/d16/d1c/d40 39 2024-09-20T18:36:13.757 INFO:tasks.workunit.client.0.smithi017.stdout:1/785: creat df/d35/d6b/dc2/ffd x:0 0 0 2024-09-20T18:36:13.760 INFO:tasks.workunit.client.0.smithi017.stdout:4/692: unlink d4/d19/c47 0 2024-09-20T18:36:13.764 INFO:tasks.workunit.client.0.smithi017.stdout:1/786: mkdir df/d16/dfe 0 2024-09-20T18:36:13.770 INFO:tasks.workunit.client.0.smithi017.stdout:1/787: readlink df/d16/lf5 0 2024-09-20T18:36:13.771 INFO:tasks.workunit.client.0.smithi017.stdout:4/693: creat d4/d19/d37/da1/d1b/d56/d67/db9/de5/fe7 x:0 0 0 2024-09-20T18:36:13.772 INFO:tasks.workunit.client.0.smithi017.stdout:4/694: write d4/d19/d37/d66/fc4 [663682,121789] 0 2024-09-20T18:36:13.777 INFO:tasks.workunit.client.0.smithi017.stdout:7/768: truncate da/d16/d1c/d40/d30/f56 2677514 0 2024-09-20T18:36:13.781 INFO:tasks.workunit.client.0.smithi017.stdout:1/788: write df/d16/f21 [1300725,55719] 0 2024-09-20T18:36:13.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.766+0000 7fb696493640 1 -- 172.21.15.17:0/3488832748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb690104d80 msgr2=0x7fb690107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:13.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.766+0000 7fb696493640 1 --2- 172.21.15.17:0/3488832748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb690104d80 0x7fb690107170 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb684009880 tx=0x7fb68402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:36:13.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.766+0000 7fb696493640 1 -- 172.21.15.17:0/3488832748 shutdown_connections 2024-09-20T18:36:13.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.766+0000 7fb696493640 1 --2- 172.21.15.17:0/3488832748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb690104d80 0x7fb690107170 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:13.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.766+0000 7fb696493640 1 --2- 172.21.15.17:0/3488832748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb690102450 0x7fb690104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:13.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.766+0000 7fb696493640 1 -- 172.21.15.17:0/3488832748 >> 172.21.15.17:0/3488832748 conn(0x7fb6900fc010 msgr2=0x7fb6900fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:13.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.766+0000 7fb696493640 1 -- 172.21.15.17:0/3488832748 shutdown_connections 2024-09-20T18:36:13.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.766+0000 7fb696493640 1 -- 172.21.15.17:0/3488832748 wait complete. 2024-09-20T18:36:13.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.767+0000 7fb696493640 1 Processor -- start 2024-09-20T18:36:13.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.767+0000 7fb696493640 1 -- start start 2024-09-20T18:36:13.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.767+0000 7fb696493640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb690102450 0x7fb6901996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:13.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.768+0000 7fb696493640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb690104d80 0x7fb690199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:13.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.768+0000 7fb68ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb690102450 0x7fb6901996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:13.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.768+0000 7fb68ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb690102450 0x7fb6901996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:52208/0 (socket says 172.21.15.17:52208) 2024-09-20T18:36:13.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.768+0000 7fb68ffff640 1 -- 172.21.15.17:0/222245743 learned_addr learned my addr 172.21.15.17:0/222245743 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:36:13.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.768+0000 7fb696493640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb69010a740 con 0x7fb690104d80 2024-09-20T18:36:13.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.768+0000 7fb696493640 1 -- 172.21.15.17:0/222245743 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb69010a5c0 con 0x7fb690102450 2024-09-20T18:36:13.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.768+0000 7fb68f7fe640 1 --2- 172.21.15.17:0/222245743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb690104d80 0x7fb690199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:13.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.768+0000 7fb68ffff640 1 -- 172.21.15.17:0/222245743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb690104d80 msgr2=0x7fb690199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:13.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.768+0000 7fb68ffff640 1 --2- 172.21.15.17:0/222245743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb690104d80 0x7fb690199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:13.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.768+0000 7fb68ffff640 1 -- 172.21.15.17:0/222245743 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69019a280 con 0x7fb690102450 2024-09-20T18:36:13.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.769+0000 7fb68ffff640 1 --2- 172.21.15.17:0/222245743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb690102450 0x7fb6901996c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb68000e970 tx=0x7fb68000ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:13.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.769+0000 7fb68d7fa640 1 -- 172.21.15.17:0/222245743 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb68000cac0 con 0x7fb690102450 2024-09-20T18:36:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.769+0000 7fb68d7fa640 1 -- 172.21.15.17:0/222245743 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb6800054e0 con 0x7fb690102450 2024-09-20T18:36:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.769+0000 7fb68d7fa640 1 -- 172.21.15.17:0/222245743 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb680010430 con 0x7fb690102450 2024-09-20T18:36:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.769+0000 7fb696493640 1 -- 172.21.15.17:0/222245743 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb69019ecc0 con 0x7fb690102450 2024-09-20T18:36:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.769+0000 7fb696493640 1 -- 172.21.15.17:0/222245743 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb69019f170 con 0x7fb690102450 2024-09-20T18:36:13.786 INFO:tasks.workunit.client.0.smithi017.stdout:7/769: read da/d16/d1c/d40/d30/f87 [95625,123773] 0 2024-09-20T18:36:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.770+0000 7fb696493640 1 -- 172.21.15.17:0/222245743 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb690102830 con 0x7fb690102450 2024-09-20T18:36:13.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.772+0000 7fb68d7fa640 1 -- 172.21.15.17:0/222245743 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fb680004ec0 con 0x7fb690102450 2024-09-20T18:36:13.789 INFO:tasks.workunit.client.0.smithi017.stdout:7/770: write da/d16/d1c/d40/d30/d98/fc0 [565342,58639] 0 2024-09-20T18:36:13.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.773+0000 7fb68d7fa640 1 --2- 172.21.15.17:0/222245743 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fb678074ad0 0x7fb678076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:13.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.773+0000 7fb68d7fa640 1 -- 172.21.15.17:0/222245743 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7fb680096b50 con 0x7fb690102450 2024-09-20T18:36:13.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.773+0000 7fb68f7fe640 1 --2- 172.21.15.17:0/222245743 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fb678074ad0 0x7fb678076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:13.790 INFO:tasks.workunit.client.0.smithi017.stdout:1/789: mkdir df/d3b/dff 0 2024-09-20T18:36:13.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.774+0000 7fb68f7fe640 1 --2- 172.21.15.17:0/222245743 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fb678074ad0 0x7fb678076f90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb684009230 tx=0x7fb6840058d0 comp rx=0 tx=0).ready entity=mgr.24405 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:13.791 INFO:tasks.workunit.client.0.smithi017.stdout:1/790: write df/d1c/f3c [2827452,110647] 0 2024-09-20T18:36:13.792 INFO:tasks.workunit.client.0.smithi017.stdout:4/695: truncate d4/d19/d37/da1/f27 3870364 0 2024-09-20T18:36:13.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:13.777+0000 7fb68d7fa640 1 -- 172.21.15.17:0/222245743 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fb680056180 con 0x7fb690102450 2024-09-20T18:36:13.794 INFO:tasks.workunit.client.0.smithi017.stdout:4/696: stat d4/d82/d88/d5c/lcf 0 2024-09-20T18:36:13.798 INFO:tasks.workunit.client.0.smithi017.stdout:7/771: dwrite da/d16/d1c/d40/d30/fe6 [0,4194304] 0 2024-09-20T18:36:13.803 INFO:tasks.workunit.client.0.smithi017.stdout:1/791: dwrite df/d1c/f75 [4194304,4194304] 0 2024-09-20T18:36:13.809 INFO:tasks.workunit.client.0.smithi017.stdout:7/772: creat da/d16/de2/ded/ff1 x:0 0 0 2024-09-20T18:36:13.813 INFO:tasks.workunit.client.0.smithi017.stdout:4/697: truncate d4/d19/d37/da1/d1b/f45 2393209 0 2024-09-20T18:36:13.814 INFO:tasks.workunit.client.0.smithi017.stdout:1/792: link df/d29/d7e/ffc df/d35/d6b/dee/f100 0 2024-09-20T18:36:13.816 INFO:tasks.workunit.client.0.smithi017.stdout:1/793: rmdir df 39 2024-09-20T18:36:13.819 INFO:tasks.workunit.client.0.smithi017.stdout:1/794: stat df/f1a 0 2024-09-20T18:36:13.827 INFO:tasks.workunit.client.0.smithi017.stdout:1/795: mknod df/d16/d50/d53/d60/c101 0 2024-09-20T18:36:13.830 INFO:tasks.workunit.client.0.smithi017.stdout:4/698: dread d4/d19/d37/da1/f4f [0,4194304] 0 2024-09-20T18:36:13.831 INFO:tasks.workunit.client.0.smithi017.stdout:1/796: truncate df/d29/d2c/f92 50017 0 2024-09-20T18:36:13.833 INFO:tasks.workunit.client.0.smithi017.stdout:7/773: dwrite da/d16/d1c/d40/d34/d3c/f53 [4194304,4194304] 0 2024-09-20T18:36:13.841 INFO:tasks.workunit.client.0.smithi017.stdout:4/699: creat d4/d19/d62/fe8 x:0 0 0 2024-09-20T18:36:13.843 INFO:tasks.workunit.client.0.smithi017.stdout:1/797: mkdir df/d35/d102 0 2024-09-20T18:36:13.844 INFO:tasks.workunit.client.0.smithi017.stdout:4/700: read d4/d19/d37/da1/d1b/f2f [37771,106037] 0 2024-09-20T18:36:13.848 INFO:tasks.workunit.client.0.smithi017.stdout:4/701: rmdir d4/d82 39 2024-09-20T18:36:13.850 INFO:tasks.workunit.client.0.smithi017.stdout:7/774: dread da/d16/d1c/d40/d30/f7c [0,4194304] 0 2024-09-20T18:36:13.854 INFO:tasks.workunit.client.0.smithi017.stdout:7/775: dread da/f65 [0,4194304] 0 2024-09-20T18:36:13.855 INFO:tasks.workunit.client.0.smithi017.stdout:7/776: stat da/d16/d1c/d40/d30/fe6 0 2024-09-20T18:36:13.856 INFO:tasks.workunit.client.0.smithi017.stdout:1/798: truncate df/d35/fd3 5674024 0 2024-09-20T18:36:13.858 INFO:tasks.workunit.client.0.smithi017.stdout:1/799: stat df/d35/l48 0 2024-09-20T18:36:13.859 INFO:tasks.workunit.client.0.smithi017.stdout:7/777: fdatasync da/d16/d92/fab 0 2024-09-20T18:36:13.860 INFO:tasks.workunit.client.0.smithi017.stdout:7/778: fdatasync da/d16/d1c/f1d 0 2024-09-20T18:36:13.860 INFO:tasks.workunit.client.0.smithi017.stdout:1/800: read df/d16/f63 [726483,63239] 0 2024-09-20T18:36:13.867 INFO:tasks.workunit.client.0.smithi017.stdout:7/779: symlink da/d16/d1c/d40/d30/d98/lf2 0 2024-09-20T18:36:13.868 INFO:tasks.workunit.client.0.smithi017.stdout:7/780: chown da/d16/d1c/d40/d30/f66 908046 1 2024-09-20T18:36:13.869 INFO:tasks.workunit.client.0.smithi017.stdout:1/801: creat df/d16/f103 x:0 0 0 2024-09-20T18:36:13.871 INFO:tasks.workunit.client.0.smithi017.stdout:1/802: write df/d16/d50/d69/da5/fe3 [575940,83617] 0 2024-09-20T18:36:13.872 INFO:tasks.workunit.client.0.smithi017.stdout:1/803: dread - df/d35/d6b/dc2/ffd zero size 2024-09-20T18:36:13.878 INFO:tasks.workunit.client.0.smithi017.stdout:1/804: mkdir df/d1c/d80/d104 0 2024-09-20T18:36:13.881 INFO:tasks.workunit.client.0.smithi017.stdout:7/781: rename da/d16/d1c/d40/d30 to da/d16/d1c/d40/df3 0 2024-09-20T18:36:13.885 INFO:tasks.workunit.client.0.smithi017.stdout:7/782: rmdir da/d16/de2/ded 39 2024-09-20T18:36:13.889 INFO:tasks.workunit.client.0.smithi017.stdout:1/805: write df/d29/d2c/f65 [982932,121679] 0 2024-09-20T18:36:13.889 INFO:tasks.workunit.client.0.smithi017.stdout:7/783: symlink da/d16/db5/lf4 0 2024-09-20T18:36:13.894 INFO:tasks.workunit.client.0.smithi017.stdout:7/784: rename da/d16/d1c/d40/d3a/d8a/cba to da/d16/cf5 0 2024-09-20T18:36:13.904 INFO:tasks.workunit.client.0.smithi017.stdout:7/785: dwrite da/d54/f8c [4194304,4194304] 0 2024-09-20T18:36:13.906 INFO:tasks.workunit.client.0.smithi017.stdout:1/806: dread df/d1c/f1e [0,4194304] 0 2024-09-20T18:36:13.913 INFO:tasks.workunit.client.0.smithi017.stdout:7/786: unlink da/d16/d8e/d75/c3b 0 2024-09-20T18:36:13.914 INFO:tasks.workunit.client.0.smithi017.stdout:1/807: read df/d16/d50/d69/f98 [558357,109889] 0 2024-09-20T18:36:13.916 INFO:tasks.workunit.client.0.smithi017.stdout:7/787: symlink da/d16/d1c/d40/d34/d3c/lf6 0 2024-09-20T18:36:13.921 INFO:tasks.workunit.client.0.smithi017.stdout:1/808: symlink df/d1c/d80/d104/l105 0 2024-09-20T18:36:13.921 INFO:tasks.workunit.client.0.smithi017.stdout:1/809: readlink df/d29/d2c/d5b/l4b 0 2024-09-20T18:36:13.924 INFO:tasks.workunit.client.0.smithi017.stdout:7/788: mknod da/d16/de2/ded/cf7 0 2024-09-20T18:36:13.929 INFO:tasks.workunit.client.0.smithi017.stdout:7/789: rename da/d16/d1c/d40/df3 to da/dd2/df8 0 2024-09-20T18:36:13.930 INFO:tasks.workunit.client.0.smithi017.stdout:1/810: creat df/d29/f106 x:0 0 0 2024-09-20T18:36:13.931 INFO:tasks.workunit.client.0.smithi017.stdout:1/811: chown df/d29/d2c/d5b/l44 294135044 1 2024-09-20T18:36:13.935 INFO:tasks.workunit.client.0.smithi017.stdout:1/812: symlink df/d1c/d79/l107 0 2024-09-20T18:36:13.936 INFO:tasks.workunit.client.0.smithi017.stdout:1/813: dread - df/d35/d6b/dc2/fe9 zero size 2024-09-20T18:36:13.937 INFO:tasks.workunit.client.0.smithi017.stdout:7/790: dwrite da/d16/d1c/d40/d34/fbe [8388608,4194304] 0 2024-09-20T18:36:13.938 INFO:tasks.workunit.client.0.smithi017.stdout:1/814: read - df/d29/f106 zero size 2024-09-20T18:36:13.942 INFO:tasks.workunit.client.0.smithi017.stdout:1/815: creat df/d1c/d79/f108 x:0 0 0 2024-09-20T18:36:13.946 INFO:tasks.workunit.client.0.smithi017.stdout:1/816: unlink df/d16/d50/cbf 0 2024-09-20T18:36:13.946 INFO:tasks.workunit.client.0.smithi017.stdout:7/791: link da/d16/d1c/lc6 da/lf9 0 2024-09-20T18:36:13.947 INFO:tasks.workunit.client.0.smithi017.stdout:1/817: chown df/d16/d50/d53/fb0 2 1 2024-09-20T18:36:13.950 INFO:tasks.workunit.client.0.smithi017.stdout:1/818: mknod df/d35/d4f/d82/c109 0 2024-09-20T18:36:13.954 INFO:tasks.workunit.client.0.smithi017.stdout:7/792: creat da/d16/d1c/d40/d5d/ffa x:0 0 0 2024-09-20T18:36:13.956 INFO:tasks.workunit.client.0.smithi017.stdout:7/793: creat da/d16/d1c/d40/d34/dcd/ffb x:0 0 0 2024-09-20T18:36:13.958 INFO:tasks.workunit.client.0.smithi017.stdout:7/794: truncate da/d16/d1c/f1f 4552518 0 2024-09-20T18:36:13.960 INFO:tasks.workunit.client.0.smithi017.stdout:7/795: truncate da/d16/d1c/d40/d34/dcd/de4/de8/fc8 320360 0 2024-09-20T18:36:13.961 INFO:tasks.workunit.client.0.smithi017.stdout:7/796: dread - da/d16/d1c/d40/d3a/d8a/fee zero size 2024-09-20T18:36:13.966 INFO:tasks.workunit.client.0.smithi017.stdout:7/797: dread da/d16/f9c [0,4194304] 0 2024-09-20T18:36:13.967 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:13 smithi017 ceph-mon[28058]: pgmap v41: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 34 MiB/s rd, 102 MiB/s wr, 255 op/s 2024-09-20T18:36:13.967 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:13 smithi017 ceph-mon[28058]: Upgrade: Updating mgr.smithi017.xusjwd 2024-09-20T18:36:13.967 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:13 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:13.967 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:13 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi017.xusjwd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:36:13.967 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:13 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi017.xusjwd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:36:13.967 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:13 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T18:36:13.967 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:13 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:36:13.967 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:13 smithi017 ceph-mon[28058]: Deploying daemon mgr.smithi017.xusjwd on smithi017 2024-09-20T18:36:13.967 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:13 smithi017 ceph-mon[28058]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:36:13.972 INFO:tasks.workunit.client.0.smithi017.stdout:7/798: mknod da/cfc 0 2024-09-20T18:36:13.974 INFO:tasks.workunit.client.0.smithi017.stdout:7/799: read da/d16/d1c/d40/f7a [1312350,123686] 0 2024-09-20T18:36:13.977 INFO:tasks.workunit.client.0.smithi017.stdout:7/800: rename da/c1e to da/d16/d1c/dc9/cfd 0 2024-09-20T18:36:13.978 INFO:tasks.workunit.client.0.smithi017.stdout:7/801: stat da/d54/fa6 0 2024-09-20T18:36:13.980 INFO:tasks.workunit.client.0.smithi017.stdout:1/819: getdents df/d35/d4f/d82 0 2024-09-20T18:36:13.981 INFO:tasks.workunit.client.0.smithi017.stdout:7/802: symlink da/d16/d1c/d40/d5d/da7/lfe 0 2024-09-20T18:36:13.982 INFO:tasks.workunit.client.0.smithi017.stdout:7/803: chown da/d16/d1c/d40/d3a/l51 1928 1 2024-09-20T18:36:13.988 INFO:tasks.workunit.client.0.smithi017.stdout:1/820: getdents df/d16/d50/d69/d62 0 2024-09-20T18:36:13.994 INFO:tasks.workunit.client.0.smithi017.stdout:7/804: truncate da/d16/d1c/d40/d34/fbe 2263727 0 2024-09-20T18:36:13.997 INFO:tasks.workunit.client.0.smithi017.stdout:1/821: rename df/d3b/lba to df/d16/d50/d53/l10a 0 2024-09-20T18:36:13.999 INFO:tasks.workunit.client.0.smithi017.stdout:1/822: symlink df/d1c/d79/l10b 0 2024-09-20T18:36:14.005 INFO:tasks.workunit.client.0.smithi017.stdout:7/805: dread da/f8d [0,4194304] 0 2024-09-20T18:36:14.007 INFO:tasks.workunit.client.0.smithi017.stdout:7/806: chown da/d16/d8e/f73 4 1 2024-09-20T18:36:14.008 INFO:tasks.workunit.client.0.smithi017.stdout:7/807: write da/d16/d92/fec [662628,104706] 0 2024-09-20T18:36:14.035 INFO:tasks.workunit.client.0.smithi017.stdout:7/808: dwrite da/d16/d1c/d40/d34/d3c/f53 [0,4194304] 0 2024-09-20T18:36:14.040 INFO:tasks.workunit.client.0.smithi017.stdout:7/809: symlink da/d16/d8e/lff 0 2024-09-20T18:36:14.043 INFO:tasks.workunit.client.0.smithi017.stdout:7/810: dread da/f8d [0,4194304] 0 2024-09-20T18:36:14.047 INFO:tasks.workunit.client.0.smithi017.stdout:7/811: mknod da/d16/de2/c100 0 2024-09-20T18:36:14.050 INFO:tasks.workunit.client.0.smithi017.stdout:7/812: creat da/d16/de2/ded/f101 x:0 0 0 2024-09-20T18:36:14.051 INFO:tasks.workunit.client.0.smithi017.stdout:7/813: fdatasync da/d16/d1c/d40/d5d/da7/fb7 0 2024-09-20T18:36:14.060 INFO:tasks.workunit.client.0.smithi017.stdout:7/814: write da/d16/f3f [4417211,100836] 0 2024-09-20T18:36:14.062 INFO:tasks.workunit.client.0.smithi017.stdout:7/815: rmdir da/d16/d1c/d40/d34/dcd/de4/de8 39 2024-09-20T18:36:14.063 INFO:tasks.workunit.client.0.smithi017.stdout:7/816: read - da/d16/de2/ded/f101 zero size 2024-09-20T18:36:14.067 INFO:tasks.workunit.client.0.smithi017.stdout:7/817: mkdir da/d16/d1c/d40/d5d/da7/de5/d102 0 2024-09-20T18:36:14.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.086+0000 7fb696493640 1 -- 172.21.15.17:0/222245743 --> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb6900626f0 con 0x7fb678074ad0 2024-09-20T18:36:14.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.097+0000 7fb68d7fa640 1 -- 172.21.15.17:0/222245743 <== mgr.24405 v2:172.21.15.172:6828/3016443347 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb6900626f0 con 0x7fb678074ad0 2024-09-20T18:36:14.112 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:36:14.112 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (7m) 53s ago 8m 25.0M - 0.25.0 c8568f914cd2 8954ab699be3 2024-09-20T18:36:14.113 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 starting - - - - 2024-09-20T18:36:14.113 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 starting - - - - 2024-09-20T18:36:14.113 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (8m) 53s ago 8m 6895k - 19.1.1-369-ged8ee0f2 6acb0a031eab 725c8bcc6ec8 2024-09-20T18:36:14.113 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (7m) 67s ago 7m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab e10dd613dbe2 2024-09-20T18:36:14.113 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (6m) 53s ago 8m 80.8M - 9.4.12 2bacad6d85d8 d8c886b98eae 2024-09-20T18:36:14.113 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (3m) 53s ago 3m 120M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:36:14.113 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (3m) 53s ago 3m 112M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:36:14.113 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (3m) 67s ago 3m 19.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:36:14.113 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (3m) 67s ago 3m 19.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:36:14.113 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:9283,8765,8443 running (9m) 53s ago 9m 210M - 19.1.1-369-ged8ee0f2 6acb0a031eab 28eeab491beb 2024-09-20T18:36:14.113 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (93s) 67s ago 7m 497M - 19.3.0-5099-g88deadb8 441f9a3fe515 84c6ec0abc34 2024-09-20T18:36:14.113 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (9m) 53s ago 9m 53.7M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab ab1f988c4cb2 2024-09-20T18:36:14.113 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (7m) 67s ago 7m 39.4M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 9eea40352787 2024-09-20T18:36:14.113 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (8m) 53s ago 8m 13.7M - 1.5.0 0da6a335fe13 1584915999b1 2024-09-20T18:36:14.113 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (7m) 67s ago 7m 15.4M - 1.5.0 0da6a335fe13 880d938148e8 2024-09-20T18:36:14.114 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (6m) 53s ago 6m 79.4M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab c1207e514216 2024-09-20T18:36:14.114 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (6m) 53s ago 6m 83.1M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 73f2fd77590f 2024-09-20T18:36:14.114 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (5m) 53s ago 5m 73.5M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 6f0b9405dc18 2024-09-20T18:36:14.114 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (5m) 67s ago 5m 85.8M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:36:14.114 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (4m) 67s ago 4m 75.5M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:36:14.114 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (4m) 67s ago 4m 65.4M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:36:14.114 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 starting - - - - 2024-09-20T18:36:14.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.100+0000 7fb696493640 1 -- 172.21.15.17:0/222245743 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fb678074ad0 msgr2=0x7fb678076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:14.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.100+0000 7fb696493640 1 --2- 172.21.15.17:0/222245743 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fb678074ad0 0x7fb678076f90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb684009230 tx=0x7fb6840058d0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.100+0000 7fb696493640 1 -- 172.21.15.17:0/222245743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb690102450 msgr2=0x7fb6901996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:14.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.100+0000 7fb696493640 1 --2- 172.21.15.17:0/222245743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb690102450 0x7fb6901996c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb68000e970 tx=0x7fb68000ed70 comp rx=0 tx=0).stop 2024-09-20T18:36:14.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.100+0000 7fb696493640 1 -- 172.21.15.17:0/222245743 shutdown_connections 2024-09-20T18:36:14.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.100+0000 7fb696493640 1 --2- 172.21.15.17:0/222245743 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7fb678074ad0 0x7fb678076f90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.100+0000 7fb696493640 1 --2- 172.21.15.17:0/222245743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb690104d80 0x7fb690199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.100+0000 7fb696493640 1 --2- 172.21.15.17:0/222245743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb690102450 0x7fb6901996c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.100+0000 7fb696493640 1 -- 172.21.15.17:0/222245743 >> 172.21.15.17:0/222245743 conn(0x7fb6900fc010 msgr2=0x7fb690101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:14.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.100+0000 7fb696493640 1 -- 172.21.15.17:0/222245743 shutdown_connections 2024-09-20T18:36:14.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.100+0000 7fb696493640 1 -- 172.21.15.17:0/222245743 wait complete. 2024-09-20T18:36:14.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:13 smithi172 ceph-mon[35456]: pgmap v41: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 34 MiB/s rd, 102 MiB/s wr, 255 op/s 2024-09-20T18:36:14.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:13 smithi172 ceph-mon[35456]: Upgrade: Updating mgr.smithi017.xusjwd 2024-09-20T18:36:14.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:13 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:14.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:13 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi017.xusjwd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:36:14.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:13 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi017.xusjwd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:36:14.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:13 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T18:36:14.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:13 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:36:14.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:13 smithi172 ceph-mon[35456]: Deploying daemon mgr.smithi017.xusjwd on smithi017 2024-09-20T18:36:14.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:13 smithi172 ceph-mon[35456]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:36:14.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.214+0000 7f6ef0249640 1 -- 172.21.15.17:0/988698383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee81023f0 msgr2=0x7f6ee81047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:14.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.214+0000 7f6ef0249640 1 --2- 172.21.15.17:0/988698383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee81023f0 0x7f6ee81047e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40098b0 tx=0x7f6ee402a4d0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.214+0000 7f6ef0249640 1 -- 172.21.15.17:0/988698383 shutdown_connections 2024-09-20T18:36:14.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.214+0000 7f6ef0249640 1 --2- 172.21.15.17:0/988698383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ee8104d20 0x7f6ee8107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.214+0000 7f6ef0249640 1 --2- 172.21.15.17:0/988698383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee81023f0 0x7f6ee81047e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.214+0000 7f6ef0249640 1 -- 172.21.15.17:0/988698383 >> 172.21.15.17:0/988698383 conn(0x7f6ee80fc010 msgr2=0x7f6ee80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:14.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.214+0000 7f6ef0249640 1 -- 172.21.15.17:0/988698383 shutdown_connections 2024-09-20T18:36:14.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.214+0000 7f6ef0249640 1 -- 172.21.15.17:0/988698383 wait complete. 2024-09-20T18:36:14.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.215+0000 7f6ef0249640 1 Processor -- start 2024-09-20T18:36:14.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.215+0000 7f6ef0249640 1 -- start start 2024-09-20T18:36:14.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.215+0000 7f6ef0249640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee81023f0 0x7f6ee8199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:14.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.215+0000 7f6ef0249640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ee8104d20 0x7f6ee8199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:14.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.215+0000 7f6ef0249640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee810a7e0 con 0x7f6ee81023f0 2024-09-20T18:36:14.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.215+0000 7f6ef0249640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee810a660 con 0x7f6ee8104d20 2024-09-20T18:36:14.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.215+0000 7f6eedfe5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee81023f0 0x7f6ee8199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:14.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.215+0000 7f6eedfe5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee81023f0 0x7f6ee8199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37308/0 (socket says 172.21.15.17:37308) 2024-09-20T18:36:14.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.215+0000 7f6eedfe5640 1 -- 172.21.15.17:0/3569007997 learned_addr learned my addr 172.21.15.17:0/3569007997 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:36:14.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.215+0000 7f6eed7e4640 1 --2- 172.21.15.17:0/3569007997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ee8104d20 0x7f6ee8199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:14.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.215+0000 7f6eedfe5640 1 -- 172.21.15.17:0/3569007997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ee8104d20 msgr2=0x7f6ee8199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:14.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.215+0000 7f6eedfe5640 1 --2- 172.21.15.17:0/3569007997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ee8104d20 0x7f6ee8199c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.215+0000 7f6eedfe5640 1 -- 172.21.15.17:0/3569007997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee819a300 con 0x7f6ee81023f0 2024-09-20T18:36:14.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.216+0000 7f6eedfe5640 1 --2- 172.21.15.17:0/3569007997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee81023f0 0x7f6ee8199740 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40099d0 tx=0x7f6ee40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:14.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.216+0000 7f6edeffd640 1 -- 172.21.15.17:0/3569007997 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ee403f070 con 0x7f6ee81023f0 2024-09-20T18:36:14.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.216+0000 7f6ef0249640 1 -- 172.21.15.17:0/3569007997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee819ece0 con 0x7f6ee81023f0 2024-09-20T18:36:14.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.216+0000 7f6edeffd640 1 -- 172.21.15.17:0/3569007997 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ee40049d0 con 0x7f6ee81023f0 2024-09-20T18:36:14.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.216+0000 7f6edeffd640 1 -- 172.21.15.17:0/3569007997 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ee4035030 con 0x7f6ee81023f0 2024-09-20T18:36:14.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.216+0000 7f6ef0249640 1 -- 172.21.15.17:0/3569007997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee819f1c0 con 0x7f6ee81023f0 2024-09-20T18:36:14.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.217+0000 7f6ef0249640 1 -- 172.21.15.17:0/3569007997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee81027d0 con 0x7f6ee81023f0 2024-09-20T18:36:14.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.218+0000 7f6edeffd640 1 -- 172.21.15.17:0/3569007997 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f6ee4042070 con 0x7f6ee81023f0 2024-09-20T18:36:14.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.219+0000 7f6edeffd640 1 --2- 172.21.15.17:0/3569007997 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6ed4074a80 0x7f6ed4076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:14.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.219+0000 7f6edeffd640 1 -- 172.21.15.17:0/3569007997 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7f6ee40b6d40 con 0x7f6ee81023f0 2024-09-20T18:36:14.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.219+0000 7f6eed7e4640 1 --2- 172.21.15.17:0/3569007997 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6ed4074a80 0x7f6ed4076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:14.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.219+0000 7f6eed7e4640 1 --2- 172.21.15.17:0/3569007997 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6ed4074a80 0x7f6ed4076f40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6ee819abf0 tx=0x7f6ed8005f90 comp rx=0 tx=0).ready entity=mgr.24405 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:14.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.223+0000 7f6edeffd640 1 -- 172.21.15.17:0/3569007997 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f6ee4082350 con 0x7f6ee81023f0 2024-09-20T18:36:14.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.608+0000 7f6ef0249640 1 -- 172.21.15.17:0/3569007997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6ee8062df0 con 0x7f6ee81023f0 2024-09-20T18:36:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.608+0000 7f6edeffd640 1 -- 172.21.15.17:0/3569007997 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f6ee4087200 con 0x7f6ee81023f0 2024-09-20T18:36:14.624 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:36:14.624 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:36:14.624 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T18:36:14.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:36:14.624 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:36:14.624 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:36:14.624 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 1 2024-09-20T18:36:14.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:36:14.624 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:36:14.625 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T18:36:14.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:36:14.625 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:36:14.625 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:36:14.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:36:14.625 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:36:14.625 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 13, 2024-09-20T18:36:14.625 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 1 2024-09-20T18:36:14.625 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:36:14.625 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:36:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.611+0000 7f6ef0249640 1 -- 172.21.15.17:0/3569007997 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6ed4074a80 msgr2=0x7f6ed4076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.611+0000 7f6ef0249640 1 --2- 172.21.15.17:0/3569007997 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6ed4074a80 0x7f6ed4076f40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6ee819abf0 tx=0x7f6ed8005f90 comp rx=0 tx=0).stop 2024-09-20T18:36:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.611+0000 7f6ef0249640 1 -- 172.21.15.17:0/3569007997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee81023f0 msgr2=0x7f6ee8199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.611+0000 7f6ef0249640 1 --2- 172.21.15.17:0/3569007997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee81023f0 0x7f6ee8199740 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40099d0 tx=0x7f6ee40045e0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.611+0000 7f6ef0249640 1 -- 172.21.15.17:0/3569007997 shutdown_connections 2024-09-20T18:36:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.611+0000 7f6ef0249640 1 --2- 172.21.15.17:0/3569007997 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7f6ed4074a80 0x7f6ed4076f40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.611+0000 7f6ef0249640 1 --2- 172.21.15.17:0/3569007997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ee8104d20 0x7f6ee8199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.611+0000 7f6ef0249640 1 --2- 172.21.15.17:0/3569007997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee81023f0 0x7f6ee8199740 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.611+0000 7f6ef0249640 1 -- 172.21.15.17:0/3569007997 >> 172.21.15.17:0/3569007997 conn(0x7f6ee80fc010 msgr2=0x7f6ee8101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.611+0000 7f6ef0249640 1 -- 172.21.15.17:0/3569007997 shutdown_connections 2024-09-20T18:36:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.611+0000 7f6ef0249640 1 -- 172.21.15.17:0/3569007997 wait complete. 2024-09-20T18:36:14.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.696+0000 7f0002f52640 1 -- 172.21.15.17:0/23812787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efffc1023f0 msgr2=0x7efffc1047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:14.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.696+0000 7f0002f52640 1 --2- 172.21.15.17:0/23812787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efffc1023f0 0x7efffc1047e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7efff00098b0 tx=0x7efff002a4d0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.696+0000 7f0002f52640 1 -- 172.21.15.17:0/23812787 shutdown_connections 2024-09-20T18:36:14.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.696+0000 7f0002f52640 1 --2- 172.21.15.17:0/23812787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efffc104d20 0x7efffc107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.696+0000 7f0002f52640 1 --2- 172.21.15.17:0/23812787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efffc1023f0 0x7efffc1047e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.696+0000 7f0002f52640 1 -- 172.21.15.17:0/23812787 >> 172.21.15.17:0/23812787 conn(0x7efffc0fc010 msgr2=0x7efffc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:14.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.696+0000 7f0002f52640 1 -- 172.21.15.17:0/23812787 shutdown_connections 2024-09-20T18:36:14.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.696+0000 7f0002f52640 1 -- 172.21.15.17:0/23812787 wait complete. 2024-09-20T18:36:14.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.697+0000 7f0002f52640 1 Processor -- start 2024-09-20T18:36:14.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.697+0000 7f0002f52640 1 -- start start 2024-09-20T18:36:14.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.697+0000 7f0002f52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efffc1023f0 0x7efffc101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:14.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.697+0000 7f0002f52640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efffc104d20 0x7efffc1003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:14.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.697+0000 7f0002f52640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efffc10a7c0 con 0x7efffc1023f0 2024-09-20T18:36:14.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.697+0000 7f0002f52640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efffc10a640 con 0x7efffc104d20 2024-09-20T18:36:14.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.697+0000 7f0000cee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efffc1023f0 0x7efffc101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.697+0000 7f0000cee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efffc1023f0 0x7efffc101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37322/0 (socket says 172.21.15.17:37322) 2024-09-20T18:36:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.697+0000 7f0000cee640 1 -- 172.21.15.17:0/3898692329 learned_addr learned my addr 172.21.15.17:0/3898692329 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:36:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.697+0000 7efffbfff640 1 --2- 172.21.15.17:0/3898692329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efffc104d20 0x7efffc1003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.698+0000 7f0000cee640 1 -- 172.21.15.17:0/3898692329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efffc104d20 msgr2=0x7efffc1003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.698+0000 7f0000cee640 1 --2- 172.21.15.17:0/3898692329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efffc104d20 0x7efffc1003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.698+0000 7f0000cee640 1 -- 172.21.15.17:0/3898692329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efffc1008e0 con 0x7efffc1023f0 2024-09-20T18:36:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.698+0000 7efffbfff640 1 --2- 172.21.15.17:0/3898692329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efffc104d20 0x7efffc1003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T18:36:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.698+0000 7f0000cee640 1 --2- 172.21.15.17:0/3898692329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efffc1023f0 0x7efffc101ce0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efff00099d0 tx=0x7efff00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.698+0000 7efff9ffb640 1 -- 172.21.15.17:0/3898692329 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efff003f070 con 0x7efffc1023f0 2024-09-20T18:36:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.698+0000 7efff9ffb640 1 -- 172.21.15.17:0/3898692329 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efff00049d0 con 0x7efffc1023f0 2024-09-20T18:36:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.698+0000 7efff9ffb640 1 -- 172.21.15.17:0/3898692329 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efff0035030 con 0x7efffc1023f0 2024-09-20T18:36:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.698+0000 7f0002f52640 1 -- 172.21.15.17:0/3898692329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efffc100b70 con 0x7efffc1023f0 2024-09-20T18:36:14.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.699+0000 7f0002f52640 1 -- 172.21.15.17:0/3898692329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efffc1010a0 con 0x7efffc1023f0 2024-09-20T18:36:14.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.700+0000 7f0002f52640 1 -- 172.21.15.17:0/3898692329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efffc1027d0 con 0x7efffc1023f0 2024-09-20T18:36:14.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.700+0000 7efff9ffb640 1 -- 172.21.15.17:0/3898692329 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7efff0042070 con 0x7efffc1023f0 2024-09-20T18:36:14.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.701+0000 7efff9ffb640 1 --2- 172.21.15.17:0/3898692329 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7effec074a30 0x7effec076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:14.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.701+0000 7efff9ffb640 1 -- 172.21.15.17:0/3898692329 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5726+0+0 (secure 0 0 0) 0x7efff00b6df0 con 0x7efffc1023f0 2024-09-20T18:36:14.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.701+0000 7efffbfff640 1 --2- 172.21.15.17:0/3898692329 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7effec074a30 0x7effec076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:14.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.702+0000 7efffbfff640 1 --2- 172.21.15.17:0/3898692329 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7effec074a30 0x7effec076ef0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efffc101a60 tx=0x7effe8005f90 comp rx=0 tx=0).ready entity=mgr.24405 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:14.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.707+0000 7efff9ffb640 1 -- 172.21.15.17:0/3898692329 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7efff0082380 con 0x7efffc1023f0 2024-09-20T18:36:14.858 INFO:tasks.workunit.client.0.smithi017.stdout:8/635: sync 2024-09-20T18:36:14.859 INFO:tasks.workunit.client.0.smithi017.stdout:8/636: fdatasync d0/d6/f7e 0 2024-09-20T18:36:14.861 INFO:tasks.workunit.client.0.smithi017.stdout:8/637: rmdir d0/d65/d8b 39 2024-09-20T18:36:14.868 INFO:tasks.workunit.client.0.smithi017.stdout:8/638: link d0/d65/d8b/db5/lc7 d0/d6/d93/ld8 0 2024-09-20T18:36:14.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:14 smithi017 ceph-mon[28058]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:36:14.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:14 smithi017 ceph-mon[28058]: from='client.24483 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:36:14.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:14 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3569007997' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:36:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.951+0000 7f0002f52640 1 -- 172.21.15.17:0/3898692329 --> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efffc105680 con 0x7effec074a30 2024-09-20T18:36:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.952+0000 7efff9ffb640 1 -- 172.21.15.17:0/3898692329 <== mgr.24405 v2:172.21.15.172:6828/3016443347 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7efffc105680 con 0x7effec074a30 2024-09-20T18:36:14.968 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:36:14.968 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:36:14.968 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:36:14.968 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T18:36:14.968 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [], 2024-09-20T18:36:14.968 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "1/2 daemons upgraded", 2024-09-20T18:36:14.968 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mgr daemons", 2024-09-20T18:36:14.968 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:36:14.968 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:36:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.955+0000 7f0002f52640 1 -- 172.21.15.17:0/3898692329 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7effec074a30 msgr2=0x7effec076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.955+0000 7f0002f52640 1 --2- 172.21.15.17:0/3898692329 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7effec074a30 0x7effec076ef0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efffc101a60 tx=0x7effe8005f90 comp rx=0 tx=0).stop 2024-09-20T18:36:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.955+0000 7f0002f52640 1 -- 172.21.15.17:0/3898692329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efffc1023f0 msgr2=0x7efffc101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.955+0000 7f0002f52640 1 --2- 172.21.15.17:0/3898692329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efffc1023f0 0x7efffc101ce0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efff00099d0 tx=0x7efff00045e0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.955+0000 7f0002f52640 1 -- 172.21.15.17:0/3898692329 shutdown_connections 2024-09-20T18:36:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.955+0000 7f0002f52640 1 --2- 172.21.15.17:0/3898692329 >> [v2:172.21.15.172:6828/3016443347,v1:172.21.15.172:6829/3016443347] conn(0x7effec074a30 0x7effec076ef0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.955+0000 7f0002f52640 1 --2- 172.21.15.17:0/3898692329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efffc104d20 0x7efffc1003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.955+0000 7f0002f52640 1 --2- 172.21.15.17:0/3898692329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efffc1023f0 0x7efffc101ce0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.955+0000 7f0002f52640 1 -- 172.21.15.17:0/3898692329 >> 172.21.15.17:0/3898692329 conn(0x7efffc0fc010 msgr2=0x7efffc0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.955+0000 7f0002f52640 1 -- 172.21.15.17:0/3898692329 shutdown_connections 2024-09-20T18:36:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:14.955+0000 7f0002f52640 1 -- 172.21.15.17:0/3898692329 wait complete. 2024-09-20T18:36:15.047 INFO:tasks.workunit.client.0.smithi017.stdout:6/773: sync 2024-09-20T18:36:15.049 INFO:tasks.workunit.client.0.smithi017.stdout:6/774: write d4/df/d1f/d25/f105 [508285,80715] 0 2024-09-20T18:36:15.055 INFO:tasks.workunit.client.0.smithi017.stdout:6/775: write d4/d29/df5/f54 [859298,41632] 0 2024-09-20T18:36:15.059 INFO:tasks.workunit.client.0.smithi017.stdout:6/776: symlink d4/df/d4a/de6/l10e 0 2024-09-20T18:36:15.062 INFO:tasks.workunit.client.0.smithi017.stdout:6/777: creat d4/d37/d68/d8d/db2/dd4/dd9/f10f x:0 0 0 2024-09-20T18:36:15.071 INFO:tasks.workunit.client.0.smithi017.stdout:6/778: truncate d4/df/d4a/d8f/fc4 6029880 0 2024-09-20T18:36:15.072 INFO:tasks.workunit.client.0.smithi017.stdout:6/779: rename d4/df/d4a/d8f to d4/df/d4a/d8f/d110 22 2024-09-20T18:36:15.076 INFO:tasks.workunit.client.0.smithi017.stdout:6/780: truncate d4/df/d4a/d8f/fe8 964717 0 2024-09-20T18:36:15.078 INFO:tasks.workunit.client.0.smithi017.stdout:6/781: dread d4/df/d1f/d25/dd7/fb9 [0,4194304] 0 2024-09-20T18:36:15.090 INFO:tasks.workunit.client.0.smithi017.stdout:6/782: dwrite d4/d37/d68/da4/fbd [0,4194304] 0 2024-09-20T18:36:15.098 INFO:tasks.workunit.client.0.smithi017.stdout:6/783: dwrite d4/d37/d68/d8d/db2/dd4/dd9/f100 [0,4194304] 0 2024-09-20T18:36:15.099 INFO:tasks.workunit.client.0.smithi017.stdout:6/784: read - d4/d29/df5/d43/d7d/f102 zero size 2024-09-20T18:36:15.100 INFO:tasks.workunit.client.0.smithi017.stdout:6/785: fsync d4/df/ffb 0 2024-09-20T18:36:15.104 INFO:tasks.workunit.client.0.smithi017.stdout:6/786: creat d4/d29/df5/d43/dfc/f111 x:0 0 0 2024-09-20T18:36:15.115 INFO:tasks.workunit.client.0.smithi017.stdout:6/787: dwrite d4/df/d4a/d8f/fe8 [0,4194304] 0 2024-09-20T18:36:15.119 INFO:tasks.workunit.client.0.smithi017.stdout:6/788: read d4/d29/df5/f54 [854767,8930] 0 2024-09-20T18:36:15.121 INFO:tasks.workunit.client.0.smithi017.stdout:3/915: sync 2024-09-20T18:36:15.121 INFO:tasks.workunit.client.0.smithi017.stdout:5/909: sync 2024-09-20T18:36:15.122 INFO:tasks.workunit.client.0.smithi017.stdout:6/789: read d4/df/d1f/d25/f7c [686711,28847] 0 2024-09-20T18:36:15.132 INFO:tasks.workunit.client.0.smithi017.stdout:5/910: write d0/d14/d18/d57/f4e [1618381,72365] 0 2024-09-20T18:36:15.133 INFO:tasks.workunit.client.0.smithi017.stdout:6/790: write d4/f8 [4536458,99491] 0 2024-09-20T18:36:15.136 INFO:tasks.workunit.client.0.smithi017.stdout:5/911: chown d0/d14/d18/l71 3379 1 2024-09-20T18:36:15.136 INFO:tasks.workunit.client.0.smithi017.stdout:6/791: write d4/d37/d68/f103 [801376,78719] 0 2024-09-20T18:36:15.139 INFO:tasks.workunit.client.0.smithi017.stdout:3/916: dwrite da/fb [0,4194304] 0 2024-09-20T18:36:15.140 INFO:tasks.workunit.client.0.smithi017.stdout:5/912: mkdir d0/d11c/d13f 0 2024-09-20T18:36:15.141 INFO:tasks.workunit.client.0.smithi017.stdout:6/792: truncate d4/d37/d68/d8d/db2/dd4/dd9/f10f 886983 0 2024-09-20T18:36:15.142 INFO:tasks.workunit.client.0.smithi017.stdout:5/913: write d0/d14/d18/d19/d4d/d6d/db7/d109/f118 [209477,32873] 0 2024-09-20T18:36:15.143 INFO:tasks.workunit.client.0.smithi017.stdout:3/917: mkdir da/de/d13/d2f/d26/d31/d5a/d135 0 2024-09-20T18:36:15.145 INFO:tasks.workunit.client.0.smithi017.stdout:6/793: rmdir d4/df/d8a 39 2024-09-20T18:36:15.147 INFO:tasks.workunit.client.0.smithi017.stdout:5/914: write d0/d14/d18/d19/d4d/d6d/db7/d109/f118 [883202,101483] 0 2024-09-20T18:36:15.151 INFO:tasks.workunit.client.0.smithi017.stdout:6/794: mknod d4/df/d1f/d25/d3f/d5c/c112 0 2024-09-20T18:36:15.153 INFO:tasks.workunit.client.0.smithi017.stdout:3/918: truncate da/def/d113/d116/f11f 2787884 0 2024-09-20T18:36:15.159 INFO:tasks.workunit.client.0.smithi017.stdout:3/919: dwrite da/de/d13/d16/d6e/d82/df8/f117 [0,4194304] 0 2024-09-20T18:36:15.160 INFO:tasks.workunit.client.0.smithi017.stdout:5/915: write d0/d14/d18/d2a/d39/d6c/d72/f16 [3948783,10053] 0 2024-09-20T18:36:15.161 INFO:tasks.workunit.client.0.smithi017.stdout:3/920: chown da/de/d13/l108 522 1 2024-09-20T18:36:15.168 INFO:tasks.workunit.client.0.smithi017.stdout:5/916: rename d0/d14/d18/d1b/l2d to d0/d14/d18/d19/d4d/d6d/d78/d99/l140 0 2024-09-20T18:36:15.169 INFO:tasks.workunit.client.0.smithi017.stdout:6/795: dwrite d4/df/d1f/d25/d2b/fb7 [0,4194304] 0 2024-09-20T18:36:15.170 INFO:tasks.workunit.client.0.smithi017.stdout:3/921: write da/de/f1a [1084291,31855] 0 2024-09-20T18:36:15.174 INFO:tasks.workunit.client.0.smithi017.stdout:3/922: mkdir da/de/d53/d88/d136 0 2024-09-20T18:36:15.177 INFO:tasks.workunit.client.0.smithi017.stdout:5/917: getdents d0/d14/d18/d19/d4d/d6d/d78/d98 0 2024-09-20T18:36:15.177 INFO:tasks.workunit.client.0.smithi017.stdout:6/796: getdents d4/d37/d68/d8d/db2/dd4 0 2024-09-20T18:36:15.179 INFO:tasks.workunit.client.0.smithi017.stdout:3/923: creat da/de/d13/d16/d6e/dc9/f137 x:0 0 0 2024-09-20T18:36:15.183 INFO:tasks.workunit.client.0.smithi017.stdout:3/924: mknod da/de/d13/d16/d6e/d97/dc1/c138 0 2024-09-20T18:36:15.184 INFO:tasks.workunit.client.0.smithi017.stdout:5/918: link d0/d14/d18/d57/db6/fe6 d0/d14/d18/d1b/d131/d135/f141 0 2024-09-20T18:36:15.184 INFO:tasks.workunit.client.0.smithi017.stdout:3/925: write da/de/f1a [490476,113266] 0 2024-09-20T18:36:15.186 INFO:tasks.workunit.client.0.smithi017.stdout:5/919: symlink d0/d14/d18/dd1/l142 0 2024-09-20T18:36:15.190 INFO:tasks.workunit.client.0.smithi017.stdout:3/926: unlink da/de/d13/d2f/d26/d31/d5a/d76/d19/l2b 0 2024-09-20T18:36:15.191 INFO:tasks.workunit.client.0.smithi017.stdout:5/920: mknod d0/d14/d18/d2a/d39/de1/c143 0 2024-09-20T18:36:15.192 INFO:tasks.workunit.client.0.smithi017.stdout:3/927: rmdir da/de/d13/d2f/d26/d62 39 2024-09-20T18:36:15.198 INFO:tasks.workunit.client.0.smithi017.stdout:5/921: link d0/d14/d18/d1b/f24 d0/d14/d18/dcc/f144 0 2024-09-20T18:36:15.200 INFO:tasks.workunit.client.0.smithi017.stdout:6/797: write d4/d29/df5/d43/d7d/dc2/fd5 [89238,105363] 0 2024-09-20T18:36:15.202 INFO:tasks.workunit.client.0.smithi017.stdout:5/922: creat d0/d14/d18/d2a/d39/d6c/d123/f145 x:0 0 0 2024-09-20T18:36:15.203 INFO:tasks.workunit.client.0.smithi017.stdout:6/798: symlink d4/d37/d68/d8d/dba/l113 0 2024-09-20T18:36:15.205 INFO:tasks.workunit.client.0.smithi017.stdout:6/799: fsync d4/fbf 0 2024-09-20T18:36:15.206 INFO:tasks.workunit.client.0.smithi017.stdout:5/923: mknod d0/d14/d18/d19/d4d/d6d/d78/d99/c146 0 2024-09-20T18:36:15.208 INFO:tasks.workunit.client.0.smithi017.stdout:5/924: write d0/d14/d18/d2a/fba [380753,23618] 0 2024-09-20T18:36:15.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:14 smithi172 ceph-mon[35456]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:36:15.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:14 smithi172 ceph-mon[35456]: from='client.24483 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:36:15.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:14 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3569007997' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:36:15.213 INFO:tasks.workunit.client.0.smithi017.stdout:3/928: dread da/de/d13/d16/d50/f96 [0,4194304] 0 2024-09-20T18:36:15.213 INFO:tasks.workunit.client.0.smithi017.stdout:5/925: mknod d0/d14/d18/d2a/d39/de1/c147 0 2024-09-20T18:36:15.216 INFO:tasks.workunit.client.0.smithi017.stdout:5/926: write d0/d14/d18/d2a/d39/d42/fe8 [599906,94376] 0 2024-09-20T18:36:15.220 INFO:tasks.workunit.client.0.smithi017.stdout:3/929: creat da/de/d13/d2f/d26/d31/d5a/d76/d11c/f139 x:0 0 0 2024-09-20T18:36:15.221 INFO:tasks.workunit.client.0.smithi017.stdout:3/930: chown da/de/d13/d2f/d26/d31/d5a/d76/d19/c3b 0 1 2024-09-20T18:36:15.223 INFO:tasks.workunit.client.0.smithi017.stdout:6/800: write d4/d37/d68/da4/d9e/fc5 [26019,97147] 0 2024-09-20T18:36:15.238 INFO:tasks.workunit.client.0.smithi017.stdout:3/931: dwrite da/de/d13/d16/d6e/d82/f8c [4194304,4194304] 0 2024-09-20T18:36:15.246 INFO:tasks.workunit.client.0.smithi017.stdout:6/801: dwrite d4/df/d1f/d25/f27 [0,4194304] 0 2024-09-20T18:36:15.250 INFO:tasks.workunit.client.0.smithi017.stdout:6/802: symlink d4/df/d1f/df6/d10c/l114 0 2024-09-20T18:36:15.254 INFO:tasks.workunit.client.0.smithi017.stdout:6/803: unlink d4/df/d1f/d25/dd7/f82 0 2024-09-20T18:36:15.257 INFO:tasks.workunit.client.0.smithi017.stdout:6/804: mkdir d4/df/d1f/d25/d2b/d115 0 2024-09-20T18:36:15.635 INFO:tasks.workunit.client.0.smithi017.stdout:9/944: sync 2024-09-20T18:36:15.635 INFO:tasks.workunit.client.0.smithi017.stdout:0/710: sync 2024-09-20T18:36:15.636 INFO:tasks.workunit.client.0.smithi017.stdout:9/945: chown d6/fe 52 1 2024-09-20T18:36:15.637 INFO:tasks.workunit.client.0.smithi017.stdout:0/711: dread - d4/db/dcd/d52/fb3 zero size 2024-09-20T18:36:15.638 INFO:tasks.workunit.client.0.smithi017.stdout:9/946: dread d6/d23/d40/db4/fce [0,4194304] 0 2024-09-20T18:36:15.641 INFO:tasks.workunit.client.0.smithi017.stdout:9/947: write d6/f106 [237619,51218] 0 2024-09-20T18:36:15.648 INFO:tasks.workunit.client.0.smithi017.stdout:9/948: rename d6/d23/d40/db4/dba/l6b to d6/dc1/l14e 0 2024-09-20T18:36:15.649 INFO:tasks.workunit.client.0.smithi017.stdout:9/949: write d6/d23/d58/d3f/d4d/d73/d7d/dbd/d149/f125 [1002934,125974] 0 2024-09-20T18:36:15.650 INFO:tasks.workunit.client.0.smithi017.stdout:0/712: write d4/db/d18/d55/f72 [12424,128801] 0 2024-09-20T18:36:15.657 INFO:tasks.workunit.client.0.smithi017.stdout:0/713: dwrite f2 [0,4194304] 0 2024-09-20T18:36:15.667 INFO:tasks.workunit.client.0.smithi017.stdout:0/714: write d4/db/d18/d25/d36/d47/d8c/daa/dca/d66/f93 [954423,47603] 0 2024-09-20T18:36:15.668 INFO:tasks.workunit.client.0.smithi017.stdout:0/715: fsync d4/d37/f6a 0 2024-09-20T18:36:15.670 INFO:tasks.workunit.client.0.smithi017.stdout:0/716: mknod d4/db/dcd/cf3 0 2024-09-20T18:36:15.672 INFO:tasks.workunit.client.0.smithi017.stdout:0/717: mknod d4/d68/d8e/cf4 0 2024-09-20T18:36:15.677 INFO:tasks.workunit.client.0.smithi017.stdout:0/718: rmdir d4/dc8/dd3 0 2024-09-20T18:36:15.678 INFO:tasks.workunit.client.0.smithi017.stdout:0/719: chown d4/db/d18/c1a 173 1 2024-09-20T18:36:15.679 INFO:tasks.workunit.client.0.smithi017.stdout:0/720: mknod d4/db/dcd/cf5 0 2024-09-20T18:36:15.681 INFO:tasks.workunit.client.0.smithi017.stdout:0/721: rmdir d4/db/d18/d25/d36/d47/d81 39 2024-09-20T18:36:15.684 INFO:tasks.workunit.client.0.smithi017.stdout:0/722: symlink d4/d20/d63/dbd/lf6 0 2024-09-20T18:36:15.687 INFO:tasks.workunit.client.0.smithi017.stdout:0/723: dread d4/db/dcd/d52/f56 [0,4194304] 0 2024-09-20T18:36:15.688 INFO:tasks.workunit.client.0.smithi017.stdout:0/724: truncate d4/db/d18/d25/fd8 1870921 0 2024-09-20T18:36:15.692 INFO:tasks.workunit.client.0.smithi017.stdout:0/725: truncate d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d69/f73 1063196 0 2024-09-20T18:36:15.695 INFO:tasks.workunit.client.0.smithi017.stdout:0/726: mknod d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d69/cf7 0 2024-09-20T18:36:15.696 INFO:tasks.workunit.client.0.smithi017.stdout:0/727: truncate d4/d20/d63/d86/f9f 709623 0 2024-09-20T18:36:15.698 INFO:tasks.workunit.client.0.smithi017.stdout:0/728: symlink d4/db/d18/d55/lf8 0 2024-09-20T18:36:15.817 INFO:tasks.workunit.client.0.smithi017.stdout:0/729: write d4/d37/f88 [217143,20400] 0 2024-09-20T18:36:15.849 INFO:tasks.workunit.client.0.smithi017.stdout:0/730: dwrite d4/d37/f6a [0,4194304] 0 2024-09-20T18:36:15.854 INFO:tasks.workunit.client.0.smithi017.stdout:0/731: mkdir d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/df9 0 2024-09-20T18:36:15.856 INFO:tasks.workunit.client.0.smithi017.stdout:0/732: symlink d4/db/d18/d55/lfa 0 2024-09-20T18:36:15.859 INFO:tasks.workunit.client.0.smithi017.stdout:0/733: creat d4/db/d18/d25/d36/d47/d8c/daa/dca/db1/ffb x:0 0 0 2024-09-20T18:36:15.862 INFO:tasks.workunit.client.0.smithi017.stdout:0/734: fdatasync d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d94/fa8 0 2024-09-20T18:36:15.863 INFO:tasks.workunit.client.0.smithi017.stdout:0/735: dread - d4/db/d18/d25/fe5 zero size 2024-09-20T18:36:15.875 INFO:tasks.workunit.client.0.smithi017.stdout:0/736: write d4/db/d18/f54 [984238,84922] 0 2024-09-20T18:36:15.881 INFO:tasks.workunit.client.0.smithi017.stdout:0/737: write d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/d95/fc3 [423413,103356] 0 2024-09-20T18:36:15.884 INFO:tasks.workunit.client.0.smithi017.stdout:0/738: rmdir d4/db/d18/d25/d36/d47/d8c/daa/dca/d42 39 2024-09-20T18:36:15.889 INFO:tasks.workunit.client.0.smithi017.stdout:0/739: write d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/fef [820410,54843] 0 2024-09-20T18:36:15.893 INFO:tasks.workunit.client.0.smithi017.stdout:0/740: creat d4/db/d18/d25/ffc x:0 0 0 2024-09-20T18:36:15.899 INFO:tasks.workunit.client.0.smithi017.stdout:0/741: dwrite d4/db/dcd/fed [0,4194304] 0 2024-09-20T18:36:15.903 INFO:tasks.workunit.client.0.smithi017.stdout:0/742: mkdir d4/db/d18/d25/d36/d47/d8c/daa/dfd 0 2024-09-20T18:36:15.906 INFO:tasks.workunit.client.0.smithi017.stdout:0/743: mkdir d4/d37/dfe 0 2024-09-20T18:36:15.908 INFO:tasks.workunit.client.0.smithi017.stdout:0/744: fsync d4/db/dcd/d52/fb3 0 2024-09-20T18:36:15.912 INFO:tasks.workunit.client.0.smithi017.stdout:0/745: dread d4/db/d18/d55/fab [0,4194304] 0 2024-09-20T18:36:15.918 INFO:tasks.workunit.client.0.smithi017.stdout:0/746: dread d4/db/d18/d25/d36/d47/d81/fa1 [0,4194304] 0 2024-09-20T18:36:15.925 INFO:tasks.workunit.client.0.smithi017.stdout:0/747: link d4/fa d4/db/d18/d25/d36/d47/d8c/dcb/fff 0 2024-09-20T18:36:15.928 INFO:tasks.workunit.client.0.smithi017.stdout:0/748: getdents d4/d37/dd2 0 2024-09-20T18:36:15.931 INFO:tasks.workunit.client.0.smithi017.stdout:0/749: rename d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/fc5 to d4/db/dcd/f100 0 2024-09-20T18:36:15.934 INFO:tasks.workunit.client.0.smithi017.stdout:0/750: truncate d4/db/d18/f19 460525 0 2024-09-20T18:36:15.937 INFO:tasks.workunit.client.0.smithi017.stdout:0/751: dread d4/d20/d63/d86/fa7 [0,4194304] 0 2024-09-20T18:36:15.942 INFO:tasks.workunit.client.0.smithi017.stdout:0/752: fsync d4/db/d18/d25/d36/d47/d8c/dcb/fff 0 2024-09-20T18:36:15.944 INFO:tasks.workunit.client.0.smithi017.stdout:0/753: write d4/db/d18/f54 [112387,16856] 0 2024-09-20T18:36:15.987 INFO:tasks.workunit.client.0.smithi017.stdout:1/823: sync 2024-09-20T18:36:15.988 INFO:tasks.workunit.client.0.smithi017.stdout:2/961: sync 2024-09-20T18:36:15.988 INFO:tasks.workunit.client.0.smithi017.stdout:4/702: sync 2024-09-20T18:36:15.989 INFO:tasks.workunit.client.0.smithi017.stdout:1/824: dread - df/d29/d7e/ffc zero size 2024-09-20T18:36:15.989 INFO:tasks.workunit.client.0.smithi017.stdout:2/962: chown d1/dc/d20/d2e/db5/fe2 14 1 2024-09-20T18:36:15.991 INFO:tasks.workunit.client.0.smithi017.stdout:1/825: write df/d29/d7e/fd7 [1447804,6990] 0 2024-09-20T18:36:15.991 INFO:tasks.workunit.client.0.smithi017.stdout:2/963: dread - d1/dc/d20/d2e/d30/db0/df4/f120 zero size 2024-09-20T18:36:15.993 INFO:tasks.workunit.client.0.smithi017.stdout:2/964: chown d1/dc/d20/d2e/d30/d85/d3d/d77/ced 0 1 2024-09-20T18:36:15.993 INFO:tasks.workunit.client.0.smithi017.stdout:4/703: creat d4/d19/d37/da1/d65/fe9 x:0 0 0 2024-09-20T18:36:15.996 INFO:tasks.workunit.client.0.smithi017.stdout:1/826: write df/d16/f63 [10688464,12679] 0 2024-09-20T18:36:15.996 INFO:tasks.workunit.client.0.smithi017.stdout:2/965: mkdir d1/d1f/d13a 0 2024-09-20T18:36:15.997 INFO:tasks.workunit.client.0.smithi017.stdout:1/827: stat df/d29/f106 0 2024-09-20T18:36:16.001 INFO:tasks.workunit.client.0.smithi017.stdout:1/828: chown df/d8f/la8 13 1 2024-09-20T18:36:16.006 INFO:tasks.workunit.client.0.smithi017.stdout:4/704: dwrite d4/d19/fd8 [0,4194304] 0 2024-09-20T18:36:16.010 INFO:tasks.workunit.client.0.smithi017.stdout:1/829: dwrite df/d35/d6b/fe4 [0,4194304] 0 2024-09-20T18:36:16.011 INFO:tasks.workunit.client.0.smithi017.stdout:2/966: dread d1/dc/d20/d2e/d30/d85/d46/f63 [0,4194304] 0 2024-09-20T18:36:16.012 INFO:tasks.workunit.client.0.smithi017.stdout:1/830: mknod df/d16/d50/dab/c10c 0 2024-09-20T18:36:16.012 INFO:tasks.workunit.client.0.smithi017.stdout:2/967: write d1/df/f139 [621118,33907] 0 2024-09-20T18:36:16.017 INFO:tasks.workunit.client.0.smithi017.stdout:2/968: rename d1/dc/d20/d2e/d30 to d1/d1f/d127/d13b 0 2024-09-20T18:36:16.020 INFO:tasks.workunit.client.0.smithi017.stdout:2/969: dread d1/d1f/d99/da6/f115 [0,4194304] 0 2024-09-20T18:36:16.021 INFO:tasks.workunit.client.0.smithi017.stdout:2/970: chown d1/d1f/c86 815 1 2024-09-20T18:36:16.029 INFO:tasks.workunit.client.0.smithi017.stdout:2/971: creat d1/d1f/d127/d13b/d85/d46/f13c x:0 0 0 2024-09-20T18:36:16.031 INFO:tasks.workunit.client.0.smithi017.stdout:1/831: write df/d35/f76 [1270485,78625] 0 2024-09-20T18:36:16.034 INFO:tasks.workunit.client.0.smithi017.stdout:1/832: rmdir df/d35/d4f/d82 39 2024-09-20T18:36:16.035 INFO:tasks.workunit.client.0.smithi017.stdout:1/833: symlink df/d1c/d80/d104/l10d 0 2024-09-20T18:36:16.041 INFO:tasks.workunit.client.0.smithi017.stdout:2/972: write d1/d1f/d127/d13b/db0/fbe [375804,115785] 0 2024-09-20T18:36:16.041 INFO:tasks.workunit.client.0.smithi017.stdout:4/705: dread d4/d19/d37/da1/d1b/fdd [0,4194304] 0 2024-09-20T18:36:16.043 INFO:tasks.workunit.client.0.smithi017.stdout:1/834: creat df/d16/d50/d53/f10e x:0 0 0 2024-09-20T18:36:16.044 INFO:tasks.workunit.client.0.smithi017.stdout:2/973: chown d1/d1f/c2b 73276920 1 2024-09-20T18:36:16.046 INFO:tasks.workunit.client.0.smithi017.stdout:1/835: read - df/d8f/fbc zero size 2024-09-20T18:36:16.050 INFO:tasks.workunit.client.0.smithi017.stdout:1/836: mkdir df/d29/d7e/dde/df7/d10f 0 2024-09-20T18:36:16.054 INFO:tasks.workunit.client.0.smithi017.stdout:1/837: rmdir df/d1c/d80/da0 39 2024-09-20T18:36:16.054 INFO:tasks.workunit.client.0.smithi017.stdout:1/838: chown df/d16 0 1 2024-09-20T18:36:16.055 INFO:tasks.workunit.client.0.smithi017.stdout:4/706: write d4/f7 [888304,65812] 0 2024-09-20T18:36:16.057 INFO:tasks.workunit.client.0.smithi017.stdout:1/839: creat df/d3b/dff/f110 x:0 0 0 2024-09-20T18:36:16.057 INFO:tasks.workunit.client.0.smithi017.stdout:1/840: chown df/d35 12913 1 2024-09-20T18:36:16.058 INFO:tasks.workunit.client.0.smithi017.stdout:1/841: readlink df/d1c/d79/l107 0 2024-09-20T18:36:16.060 INFO:tasks.workunit.client.0.smithi017.stdout:1/842: mknod df/d29/d7e/dde/c111 0 2024-09-20T18:36:16.062 INFO:tasks.workunit.client.0.smithi017.stdout:4/707: link d4/d19/d37/da1/f27 d4/d19/d37/fea 0 2024-09-20T18:36:16.065 INFO:tasks.workunit.client.0.smithi017.stdout:1/843: dread df/d29/f9f [0,4194304] 0 2024-09-20T18:36:16.068 INFO:tasks.workunit.client.0.smithi017.stdout:1/844: write df/d16/d50/d69/da5/fe3 [525701,127785] 0 2024-09-20T18:36:16.069 INFO:tasks.workunit.client.0.smithi017.stdout:4/708: dwrite d4/d19/d37/d66/fdf [0,4194304] 0 2024-09-20T18:36:16.071 INFO:tasks.workunit.client.0.smithi017.stdout:4/709: chown d4/f6c 61358 1 2024-09-20T18:36:16.075 INFO:tasks.workunit.client.0.smithi017.stdout:1/845: fsync df/f11 0 2024-09-20T18:36:16.078 INFO:tasks.workunit.client.0.smithi017.stdout:4/710: symlink d4/d82/leb 0 2024-09-20T18:36:16.084 INFO:tasks.workunit.client.0.smithi017.stdout:8/639: sync 2024-09-20T18:36:16.084 INFO:tasks.workunit.client.0.smithi017.stdout:7/818: sync 2024-09-20T18:36:16.085 INFO:tasks.workunit.client.0.smithi017.stdout:5/927: sync 2024-09-20T18:36:16.085 INFO:tasks.workunit.client.0.smithi017.stdout:4/711: rename d4/d82/d88/d5c/d8f/fc1 to d4/d19/d37/da1/d65/fec 0 2024-09-20T18:36:16.086 INFO:tasks.workunit.client.0.smithi017.stdout:5/928: read - d0/d14/d18/d19/d4d/db5/dc0/fb4 zero size 2024-09-20T18:36:16.087 INFO:tasks.workunit.client.0.smithi017.stdout:5/929: dread - d0/d14/d18/d19/d4d/db5/dc0/f129 zero size 2024-09-20T18:36:16.088 INFO:tasks.workunit.client.0.smithi017.stdout:7/819: rmdir da/d16/d8e/ddf 39 2024-09-20T18:36:16.092 INFO:tasks.workunit.client.0.smithi017.stdout:4/712: rename d4/d19/d37/f77 to d4/d19/d37/dbc/d7a/fed 0 2024-09-20T18:36:16.093 INFO:tasks.workunit.client.0.smithi017.stdout:1/846: dwrite df/f18 [4194304,4194304] 0 2024-09-20T18:36:16.093 INFO:tasks.workunit.client.0.smithi017.stdout:4/713: write d4/dc/d41/fbd [657141,130840] 0 2024-09-20T18:36:16.096 INFO:tasks.workunit.client.0.smithi017.stdout:8/640: creat d0/d6/d93/dd1/fd9 x:0 0 0 2024-09-20T18:36:16.100 INFO:tasks.workunit.client.0.smithi017.stdout:4/714: unlink d4/d82/d88/d5c/d8f/c90 0 2024-09-20T18:36:16.101 INFO:tasks.workunit.client.0.smithi017.stdout:4/715: chown d4/d19/d37/da1/c4d 567718809 1 2024-09-20T18:36:16.104 INFO:tasks.workunit.client.0.smithi017.stdout:7/820: link da/d16/d1c/d40/d34/d96/ld9 da/l103 0 2024-09-20T18:36:16.107 INFO:tasks.workunit.client.0.smithi017.stdout:4/716: unlink d4/d19/d62/fe8 0 2024-09-20T18:36:16.109 INFO:tasks.workunit.client.0.smithi017.stdout:5/930: getdents d0/dbe/ddc/dea 0 2024-09-20T18:36:16.109 INFO:tasks.workunit.client.0.smithi017.stdout:4/717: read d4/d19/d37/da1/d1b/f58 [1229636,85202] 0 2024-09-20T18:36:16.113 INFO:tasks.workunit.client.0.smithi017.stdout:1/847: link df/d3b/l47 df/d1c/d45/dcc/l112 0 2024-09-20T18:36:16.114 INFO:tasks.workunit.client.0.smithi017.stdout:1/848: dread - df/d29/f106 zero size 2024-09-20T18:36:16.115 INFO:tasks.workunit.client.0.smithi017.stdout:1/849: read df/d16/f63 [9636024,106452] 0 2024-09-20T18:36:16.117 INFO:tasks.workunit.client.0.smithi017.stdout:5/931: rmdir d0/d14/d18/d19/dda 39 2024-09-20T18:36:16.118 INFO:tasks.workunit.client.0.smithi017.stdout:8/641: write d0/d65/d8b/f9e [373059,81896] 0 2024-09-20T18:36:16.127 INFO:tasks.workunit.client.0.smithi017.stdout:4/718: dread d4/f38 [0,4194304] 0 2024-09-20T18:36:16.128 INFO:tasks.workunit.client.0.smithi017.stdout:7/821: truncate da/d16/d1c/f1f 1774188 0 2024-09-20T18:36:16.129 INFO:tasks.workunit.client.0.smithi017.stdout:7/822: chown da/d16/d1c/d40/d5d/ffa 640330132 1 2024-09-20T18:36:16.130 INFO:tasks.workunit.client.0.smithi017.stdout:7/823: fdatasync da/dd2/df8/d98/fc2 0 2024-09-20T18:36:16.136 INFO:tasks.workunit.client.0.smithi017.stdout:8/642: mknod d0/d6/d28/cda 0 2024-09-20T18:36:16.139 INFO:tasks.workunit.client.0.smithi017.stdout:7/824: symlink da/d16/de2/ded/l104 0 2024-09-20T18:36:16.141 INFO:tasks.workunit.client.0.smithi017.stdout:5/932: dwrite d0/d14/d18/d19/d4d/db5/dc0/f93 [0,4194304] 0 2024-09-20T18:36:16.142 INFO:tasks.workunit.client.0.smithi017.stdout:7/825: stat da/d16/d92 0 2024-09-20T18:36:16.143 INFO:tasks.workunit.client.0.smithi017.stdout:8/643: rename d0/c63 to d0/d6/d28/d81/cdb 0 2024-09-20T18:36:16.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:15 smithi017 ceph-mon[28058]: pgmap v42: 65 pgs: 65 active+clean; 2.6 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 50 MiB/s rd, 136 MiB/s wr, 378 op/s 2024-09-20T18:36:16.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:15 smithi017 ceph-mon[28058]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:36:16.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:15 smithi172 ceph-mon[35456]: pgmap v42: 65 pgs: 65 active+clean; 2.6 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 50 MiB/s rd, 136 MiB/s wr, 378 op/s 2024-09-20T18:36:16.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:15 smithi172 ceph-mon[35456]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:36:16.234 INFO:tasks.workunit.client.0.smithi017.stdout:1/850: getdents df/d29 0 2024-09-20T18:36:16.234 INFO:tasks.workunit.client.0.smithi017.stdout:8/644: dread d0/d6/d28/f4f [0,4194304] 0 2024-09-20T18:36:16.234 INFO:tasks.workunit.client.0.smithi017.stdout:5/933: symlink d0/dd9/dbd/l148 0 2024-09-20T18:36:16.236 INFO:tasks.workunit.client.0.smithi017.stdout:8/645: fdatasync d0/d65/d8b/db5/fcb 0 2024-09-20T18:36:16.236 INFO:tasks.workunit.client.0.smithi017.stdout:5/934: fdatasync d0/d14/d18/d57/f7d 0 2024-09-20T18:36:16.237 INFO:tasks.workunit.client.0.smithi017.stdout:5/935: chown d0/dbe/df9 41 1 2024-09-20T18:36:16.238 INFO:tasks.workunit.client.0.smithi017.stdout:1/851: mkdir df/d16/d50/d69/d97/d113 0 2024-09-20T18:36:16.241 INFO:tasks.workunit.client.0.smithi017.stdout:4/719: dread d4/d82/d88/f9b [0,4194304] 0 2024-09-20T18:36:16.242 INFO:tasks.workunit.client.0.smithi017.stdout:8/646: creat d0/d65/d8b/d91/fdc x:0 0 0 2024-09-20T18:36:16.243 INFO:tasks.workunit.client.0.smithi017.stdout:5/936: mknod d0/d14/d18/d2a/d39/d6c/d123/c149 0 2024-09-20T18:36:16.244 INFO:tasks.workunit.client.0.smithi017.stdout:1/852: truncate df/d29/d7e/ffc 500553 0 2024-09-20T18:36:16.246 INFO:tasks.workunit.client.0.smithi017.stdout:8/647: rmdir d0/d6/d28/d3a/dae 39 2024-09-20T18:36:16.248 INFO:tasks.workunit.client.0.smithi017.stdout:4/720: fdatasync d4/d19/f30 0 2024-09-20T18:36:16.252 INFO:tasks.workunit.client.0.smithi017.stdout:4/721: creat d4/d19/d62/fee x:0 0 0 2024-09-20T18:36:16.253 INFO:tasks.workunit.client.0.smithi017.stdout:1/853: rmdir df/d1c/d80/da0 39 2024-09-20T18:36:16.254 INFO:tasks.workunit.client.0.smithi017.stdout:1/854: fsync df/d29/f106 0 2024-09-20T18:36:16.255 INFO:tasks.workunit.client.0.smithi017.stdout:8/648: dwrite d0/d6/d28/d81/fbf [0,4194304] 0 2024-09-20T18:36:16.260 INFO:tasks.workunit.client.0.smithi017.stdout:1/855: symlink df/d1c/l114 0 2024-09-20T18:36:16.265 INFO:tasks.workunit.client.0.smithi017.stdout:8/649: symlink d0/d6/d28/d3b/d72/d98/ldd 0 2024-09-20T18:36:16.268 INFO:tasks.workunit.client.0.smithi017.stdout:4/722: dwrite d4/d19/f42 [0,4194304] 0 2024-09-20T18:36:16.272 INFO:tasks.workunit.client.0.smithi017.stdout:5/937: dwrite d0/d14/d18/d19/d4d/db5/dc0/fb4 [0,4194304] 0 2024-09-20T18:36:16.278 INFO:tasks.workunit.client.0.smithi017.stdout:5/938: chown d0/d14/d18/d2a/d39/f9b 94628683 1 2024-09-20T18:36:16.279 INFO:tasks.workunit.client.0.smithi017.stdout:1/856: dread df/d16/d50/d69/da5/fe3 [0,4194304] 0 2024-09-20T18:36:16.280 INFO:tasks.workunit.client.0.smithi017.stdout:4/723: dwrite d4/d82/fa5 [0,4194304] 0 2024-09-20T18:36:16.289 INFO:tasks.workunit.client.0.smithi017.stdout:5/939: creat d0/dbe/ddc/f14a x:0 0 0 2024-09-20T18:36:16.292 INFO:tasks.workunit.client.0.smithi017.stdout:5/940: chown d0/d14/d18/dd1/l142 170454 1 2024-09-20T18:36:16.293 INFO:tasks.workunit.client.0.smithi017.stdout:1/857: chown df/d1c/d45/f6e 124 1 2024-09-20T18:36:16.294 INFO:tasks.workunit.client.0.smithi017.stdout:8/650: write d0/d6/d28/d81/d82/fd0 [1231786,112243] 0 2024-09-20T18:36:16.299 INFO:tasks.workunit.client.0.smithi017.stdout:5/941: dread d0/d14/d18/d19/d4d/d6d/db7/d109/f118 [0,4194304] 0 2024-09-20T18:36:16.304 INFO:tasks.workunit.client.0.smithi017.stdout:8/651: creat d0/d6/d28/d3b/fde x:0 0 0 2024-09-20T18:36:16.305 INFO:tasks.workunit.client.0.smithi017.stdout:5/942: dread - d0/d14/d18/d19/d4d/db5/dc0/f129 zero size 2024-09-20T18:36:16.305 INFO:tasks.workunit.client.0.smithi017.stdout:1/858: dwrite df/d3b/dff/f110 [0,4194304] 0 2024-09-20T18:36:16.308 INFO:tasks.workunit.client.0.smithi017.stdout:8/652: stat d0/d6/d28/d3d/d4e/l7a 0 2024-09-20T18:36:16.309 INFO:tasks.workunit.client.0.smithi017.stdout:8/653: chown d0/d6/d28/d3b/cca 338170 1 2024-09-20T18:36:16.316 INFO:tasks.workunit.client.0.smithi017.stdout:4/724: dread d4/d19/d37/dbc/d7a/fed [0,4194304] 0 2024-09-20T18:36:16.322 INFO:tasks.workunit.client.0.smithi017.stdout:1/859: creat df/d3b/f115 x:0 0 0 2024-09-20T18:36:16.325 INFO:tasks.workunit.client.0.smithi017.stdout:8/654: fdatasync d0/f5f 0 2024-09-20T18:36:16.326 INFO:tasks.workunit.client.0.smithi017.stdout:5/943: write d0/dd9/f6a [487931,16957] 0 2024-09-20T18:36:16.326 INFO:tasks.workunit.client.0.smithi017.stdout:8/655: chown d0/d65/d8b/f9e 179 1 2024-09-20T18:36:16.335 INFO:tasks.workunit.client.0.smithi017.stdout:8/656: unlink d0/d6/c12 0 2024-09-20T18:36:16.340 INFO:tasks.workunit.client.0.smithi017.stdout:1/860: rmdir df/d35/d4f/d82/da6 39 2024-09-20T18:36:16.341 INFO:tasks.workunit.client.0.smithi017.stdout:4/725: dwrite d4/f2c [4194304,4194304] 0 2024-09-20T18:36:16.342 INFO:tasks.workunit.client.0.smithi017.stdout:4/726: chown d4/d82/leb 10240 1 2024-09-20T18:36:16.344 INFO:tasks.workunit.client.0.smithi017.stdout:5/944: link d0/d14/d18/dcc/d122/f12d d0/dbe/ddc/dea/f14b 0 2024-09-20T18:36:16.347 INFO:tasks.workunit.client.0.smithi017.stdout:8/657: rename d0/d65/c94 to d0/d65/d8b/db5/dbc/cdf 0 2024-09-20T18:36:16.350 INFO:tasks.workunit.client.0.smithi017.stdout:1/861: mknod df/d29/c116 0 2024-09-20T18:36:16.351 INFO:tasks.workunit.client.0.smithi017.stdout:4/727: fdatasync d4/dc/d1e/f51 0 2024-09-20T18:36:16.352 INFO:tasks.workunit.client.0.smithi017.stdout:5/945: mknod d0/d14/d18/d19/d85/c14c 0 2024-09-20T18:36:16.353 INFO:tasks.workunit.client.0.smithi017.stdout:5/946: readlink d0/d14/l56 0 2024-09-20T18:36:16.354 INFO:tasks.workunit.client.0.smithi017.stdout:5/947: dread - d0/d14/d18/dcc/d122/f128 zero size 2024-09-20T18:36:16.359 INFO:tasks.workunit.client.0.smithi017.stdout:4/728: mkdir d4/dc/def 0 2024-09-20T18:36:16.360 INFO:tasks.workunit.client.0.smithi017.stdout:8/658: link d0/d6/d28/d3a/c70 d0/d6/d28/d3d/d4e/d55/d8a/ce0 0 2024-09-20T18:36:16.361 INFO:tasks.workunit.client.0.smithi017.stdout:5/948: creat d0/d14/d18/d19/d4d/d6d/d78/d98/d134/f14d x:0 0 0 2024-09-20T18:36:16.363 INFO:tasks.workunit.client.0.smithi017.stdout:4/729: unlink d4/l46 0 2024-09-20T18:36:16.364 INFO:tasks.workunit.client.0.smithi017.stdout:6/805: sync 2024-09-20T18:36:16.364 INFO:tasks.workunit.client.0.smithi017.stdout:3/932: sync 2024-09-20T18:36:16.366 INFO:tasks.workunit.client.0.smithi017.stdout:4/730: dread - d4/d19/d37/da1/d1b/d56/d67/db9/de5/fe7 zero size 2024-09-20T18:36:16.369 INFO:tasks.workunit.client.0.smithi017.stdout:5/949: dwrite d0/d14/d18/d19/d4d/d6d/d78/d99/fb8 [0,4194304] 0 2024-09-20T18:36:16.369 INFO:tasks.workunit.client.0.smithi017.stdout:6/806: fsync d4/d37/d68/fd1 0 2024-09-20T18:36:16.484 INFO:tasks.workunit.client.0.smithi017.stdout:3/933: mkdir da/de/d13a 0 2024-09-20T18:36:16.485 INFO:tasks.workunit.client.0.smithi017.stdout:4/731: fdatasync d4/d19/d37/da1/d1b/fdd 0 2024-09-20T18:36:16.489 INFO:tasks.workunit.client.0.smithi017.stdout:6/807: mknod d4/d29/dc6/de7/c116 0 2024-09-20T18:36:16.494 INFO:tasks.workunit.client.0.smithi017.stdout:4/732: creat d4/d82/d88/d5c/d8f/da9/db4/db5/ff0 x:0 0 0 2024-09-20T18:36:16.498 INFO:tasks.workunit.client.0.smithi017.stdout:3/934: read da/de/d13/d2f/d26/d62/ff6 [572243,127602] 0 2024-09-20T18:36:16.501 INFO:tasks.workunit.client.0.smithi017.stdout:4/733: unlink d4/d19/d37/da1/d1b/d56/d67/f76 0 2024-09-20T18:36:16.502 INFO:tasks.workunit.client.0.smithi017.stdout:4/734: chown d4/dc/def 20417 1 2024-09-20T18:36:16.502 INFO:tasks.workunit.client.0.smithi017.stdout:6/808: symlink d4/df/d4a/l117 0 2024-09-20T18:36:16.505 INFO:tasks.workunit.client.0.smithi017.stdout:3/935: rename da/de/d13/d16/d6e/dc9/dff to da/de/d13/d16/d6e/d82/df8/d121/d13b 0 2024-09-20T18:36:16.508 INFO:tasks.workunit.client.0.smithi017.stdout:6/809: mknod d4/d37/d68/da4/d9e/c118 0 2024-09-20T18:36:16.510 INFO:tasks.workunit.client.0.smithi017.stdout:4/735: fdatasync d4/dc/d1e/d26/f6a 0 2024-09-20T18:36:16.515 INFO:tasks.workunit.client.0.smithi017.stdout:3/936: dread da/de/d13/d2f/d26/d62/da5/da9/dbb/f109 [0,4194304] 0 2024-09-20T18:36:16.516 INFO:tasks.workunit.client.0.smithi017.stdout:3/937: chown da/de/d53/fa7 0 1 2024-09-20T18:36:16.521 INFO:tasks.workunit.client.0.smithi017.stdout:3/938: dread - da/fc3 zero size 2024-09-20T18:36:16.522 INFO:tasks.workunit.client.0.smithi017.stdout:6/810: mknod d4/c119 0 2024-09-20T18:36:16.523 INFO:tasks.workunit.client.0.smithi017.stdout:6/811: stat d4/df/d4a 0 2024-09-20T18:36:16.528 INFO:tasks.workunit.client.0.smithi017.stdout:6/812: symlink d4/df/d1f/d25/dd7/l11a 0 2024-09-20T18:36:16.529 INFO:tasks.workunit.client.0.smithi017.stdout:3/939: mknod da/de/d13a/c13c 0 2024-09-20T18:36:16.532 INFO:tasks.workunit.client.0.smithi017.stdout:6/813: mknod d4/d29/dc6/de7/c11b 0 2024-09-20T18:36:16.534 INFO:tasks.workunit.client.0.smithi017.stdout:1/862: mknod df/d29/d7e/dde/df7/d10f/c117 0 2024-09-20T18:36:16.537 INFO:tasks.workunit.client.0.smithi017.stdout:3/940: creat da/de/d13/d2f/d26/d62/da5/da9/dbb/f13d x:0 0 0 2024-09-20T18:36:16.541 INFO:tasks.workunit.client.0.smithi017.stdout:1/863: creat df/d16/d50/dab/f118 x:0 0 0 2024-09-20T18:36:16.545 INFO:tasks.workunit.client.0.smithi017.stdout:3/941: unlink da/de/d53/d52/f80 0 2024-09-20T18:36:16.549 INFO:tasks.workunit.client.0.smithi017.stdout:6/814: dread d4/df/d1f/d25/d3f/ffa [0,4194304] 0 2024-09-20T18:36:16.550 INFO:tasks.workunit.client.0.smithi017.stdout:3/942: read da/de/d53/f44 [619506,66809] 0 2024-09-20T18:36:16.554 INFO:tasks.workunit.client.0.smithi017.stdout:3/943: chown da/de/d13/d16/d50/l128 15270923 1 2024-09-20T18:36:16.556 INFO:tasks.workunit.client.0.smithi017.stdout:8/659: dwrite d0/d6/d28/d3d/d4e/d55/da8/fc4 [0,4194304] 0 2024-09-20T18:36:16.559 INFO:tasks.workunit.client.0.smithi017.stdout:6/815: symlink d4/d29/df5/d43/l11c 0 2024-09-20T18:36:16.561 INFO:tasks.workunit.client.0.smithi017.stdout:3/944: stat da/de/d13/d16/d6e/ddf/de9/ff3 0 2024-09-20T18:36:16.562 INFO:tasks.workunit.client.0.smithi017.stdout:8/660: truncate d0/d6/d28/d3d/f60 4785193 0 2024-09-20T18:36:16.565 INFO:tasks.workunit.client.0.smithi017.stdout:6/816: unlink d4/d37/d68/dbb/fc8 0 2024-09-20T18:36:16.568 INFO:tasks.workunit.client.0.smithi017.stdout:8/661: creat d0/d6/d28/d81/d82/fe1 x:0 0 0 2024-09-20T18:36:16.571 INFO:tasks.workunit.client.0.smithi017.stdout:3/945: fdatasync da/de/d13/d16/d6e/d97/fc2 0 2024-09-20T18:36:16.579 INFO:tasks.workunit.client.0.smithi017.stdout:8/662: rename d0/d6/d28/d3d/d4e/c6d to d0/ce2 0 2024-09-20T18:36:16.585 INFO:tasks.workunit.client.0.smithi017.stdout:8/663: symlink d0/d6/d28/d81/le3 0 2024-09-20T18:36:16.589 INFO:tasks.workunit.client.0.smithi017.stdout:8/664: unlink d0/d6/d28/d3d/d4e/d55/l5d 0 2024-09-20T18:36:16.596 INFO:tasks.workunit.client.0.smithi017.stdout:8/665: unlink d0/d6/d28/d3a/dae/ld7 0 2024-09-20T18:36:16.598 INFO:tasks.workunit.client.0.smithi017.stdout:8/666: dread d0/d6/d28/d3d/d4e/fb1 [0,4194304] 0 2024-09-20T18:36:16.600 INFO:tasks.workunit.client.0.smithi017.stdout:8/667: read d0/d6/d28/d3d/d4e/fb1 [590569,108808] 0 2024-09-20T18:36:16.601 INFO:tasks.workunit.client.0.smithi017.stdout:6/817: dread d4/df/d1f/faf [0,4194304] 0 2024-09-20T18:36:16.604 INFO:tasks.workunit.client.0.smithi017.stdout:3/946: dread da/de/d13/d2f/d26/d31/f45 [0,4194304] 0 2024-09-20T18:36:16.608 INFO:tasks.workunit.client.0.smithi017.stdout:8/668: symlink d0/d6/d28/d81/da6/le4 0 2024-09-20T18:36:16.610 INFO:tasks.workunit.client.0.smithi017.stdout:6/818: creat d4/d37/df4/f11d x:0 0 0 2024-09-20T18:36:16.614 INFO:tasks.workunit.client.0.smithi017.stdout:3/947: rename da/de/c64 to da/de/d13/d16/d6e/d82/df8/d121/d13b/c13e 0 2024-09-20T18:36:16.616 INFO:tasks.workunit.client.0.smithi017.stdout:5/950: truncate d0/d14/d18/d1b/f31 6365895 0 2024-09-20T18:36:16.618 INFO:tasks.workunit.client.0.smithi017.stdout:5/951: write d0/d14/d18/d57/db6/f112 [684926,109998] 0 2024-09-20T18:36:16.633 INFO:tasks.workunit.client.0.smithi017.stdout:9/950: sync 2024-09-20T18:36:16.635 INFO:tasks.workunit.client.0.smithi017.stdout:3/948: creat da/def/d113/f13f x:0 0 0 2024-09-20T18:36:16.635 INFO:tasks.workunit.client.0.smithi017.stdout:5/952: getdents d0/d11c/d13f 0 2024-09-20T18:36:16.640 INFO:tasks.workunit.client.0.smithi017.stdout:3/949: truncate da/de/d13/d2f/d26/d62/da5/da9/dbb/f13d 410033 0 2024-09-20T18:36:16.640 INFO:tasks.workunit.client.0.smithi017.stdout:8/669: getdents d0/d65/d8b/db5 0 2024-09-20T18:36:16.641 INFO:tasks.workunit.client.0.smithi017.stdout:6/819: getdents d4/d29/dc6 0 2024-09-20T18:36:16.642 INFO:tasks.workunit.client.0.smithi017.stdout:8/670: read d0/d6/f38 [1438500,55480] 0 2024-09-20T18:36:16.643 INFO:tasks.workunit.client.0.smithi017.stdout:9/951: fsync d6/d23/d58/d3f/d4d/f67 0 2024-09-20T18:36:16.646 INFO:tasks.workunit.client.0.smithi017.stdout:6/820: dread - d4/df/fa0 zero size 2024-09-20T18:36:16.653 INFO:tasks.workunit.client.0.smithi017.stdout:4/736: write d4/dc/d1e/f73 [585084,24264] 0 2024-09-20T18:36:16.656 INFO:tasks.workunit.client.0.smithi017.stdout:5/953: creat d0/d14/d18/d19/d4d/d6d/d78/d124/f14e x:0 0 0 2024-09-20T18:36:16.656 INFO:tasks.workunit.client.0.smithi017.stdout:6/821: rmdir d4/df/d1f/d25/d2b 39 2024-09-20T18:36:16.662 INFO:tasks.workunit.client.0.smithi017.stdout:9/952: symlink d6/d23/d58/d3f/d70/l14f 0 2024-09-20T18:36:16.665 INFO:tasks.workunit.client.0.smithi017.stdout:6/822: fdatasync d4/d29/df5/d43/f51 0 2024-09-20T18:36:16.666 INFO:tasks.workunit.client.0.smithi017.stdout:5/954: dwrite d0/dd9/f9a [0,4194304] 0 2024-09-20T18:36:16.668 INFO:tasks.workunit.client.0.smithi017.stdout:5/955: stat d0/d14/d18/d57/f5d 0 2024-09-20T18:36:16.674 INFO:tasks.workunit.client.0.smithi017.stdout:8/671: getdents d0/d6/d28/d3b/d72/d98/da4 0 2024-09-20T18:36:16.675 INFO:tasks.workunit.client.0.smithi017.stdout:5/956: dwrite d0/d14/d18/d2a/d39/d6c/d123/f145 [0,4194304] 0 2024-09-20T18:36:16.678 INFO:tasks.workunit.client.0.smithi017.stdout:8/672: write d0/d6/d28/d81/d82/fe1 [717959,34126] 0 2024-09-20T18:36:16.680 INFO:tasks.workunit.client.0.smithi017.stdout:6/823: creat d4/d29/df5/d43/d7d/dc2/f11e x:0 0 0 2024-09-20T18:36:16.683 INFO:tasks.workunit.client.0.smithi017.stdout:5/957: fsync d0/d14/d18/d79/fb2 0 2024-09-20T18:36:16.685 INFO:tasks.workunit.client.0.smithi017.stdout:5/958: write d0/d14/d18/d19/d85/f87 [181152,4078] 0 2024-09-20T18:36:16.685 INFO:tasks.workunit.client.0.smithi017.stdout:8/673: mknod d0/d6/d28/d81/d9c/ce5 0 2024-09-20T18:36:16.687 INFO:tasks.workunit.client.0.smithi017.stdout:5/959: dread - d0/d14/d18/d79/d9e/f110 zero size 2024-09-20T18:36:16.687 INFO:tasks.workunit.client.0.smithi017.stdout:8/674: chown d0/d6/f20 29882 1 2024-09-20T18:36:16.690 INFO:tasks.workunit.client.0.smithi017.stdout:8/675: rmdir d0/d6/d28/d3b 39 2024-09-20T18:36:16.692 INFO:tasks.workunit.client.0.smithi017.stdout:5/960: rmdir d0/d14/d18/d19/d4d/db5 39 2024-09-20T18:36:16.694 INFO:tasks.workunit.client.0.smithi017.stdout:1/864: write df/d29/d2c/f92 [99740,11585] 0 2024-09-20T18:36:16.695 INFO:tasks.workunit.client.0.smithi017.stdout:5/961: truncate d0/d14/d18/d19/d4d/d6d/d78/f113 857065 0 2024-09-20T18:36:16.698 INFO:tasks.workunit.client.0.smithi017.stdout:1/865: read df/d29/f3a [4673562,53911] 0 2024-09-20T18:36:16.702 INFO:tasks.workunit.client.0.smithi017.stdout:5/962: unlink d0/d14/d18/d2a/d39/ca4 0 2024-09-20T18:36:16.708 INFO:tasks.workunit.client.0.smithi017.stdout:1/866: link df/d1c/f75 df/d16/d50/d69/d97/d113/f119 0 2024-09-20T18:36:16.712 INFO:tasks.workunit.client.0.smithi017.stdout:1/867: rename df/d16/d50/d53/f10e to df/d35/d6b/dc2/f11a 0 2024-09-20T18:36:16.713 INFO:tasks.workunit.client.0.smithi017.stdout:1/868: chown df/d16/fb6 991191439 1 2024-09-20T18:36:16.714 INFO:tasks.workunit.client.0.smithi017.stdout:5/963: dread d0/d14/d18/d2a/d39/d6c/ff1 [4194304,4194304] 0 2024-09-20T18:36:16.717 INFO:tasks.workunit.client.0.smithi017.stdout:1/869: truncate df/d8f/fbc 215792 0 2024-09-20T18:36:16.717 INFO:tasks.workunit.client.0.smithi017.stdout:1/870: stat df/d16/f103 0 2024-09-20T18:36:16.720 INFO:tasks.workunit.client.0.smithi017.stdout:5/964: dwrite d0/d14/d18/d79/d9e/f110 [0,4194304] 0 2024-09-20T18:36:16.725 INFO:tasks.workunit.client.0.smithi017.stdout:5/965: write d0/d14/d18/d19/d4d/d6d/d78/f119 [964543,102734] 0 2024-09-20T18:36:16.725 INFO:tasks.workunit.client.0.smithi017.stdout:1/871: dwrite df/d29/d2c/f65 [0,4194304] 0 2024-09-20T18:36:16.735 INFO:tasks.workunit.client.0.smithi017.stdout:5/966: rename d0/d14/d18/d2a/d39/d6c/d72/cc2 to d0/d14/d18/d19/d4d/d6d/d78/d124/c14f 0 2024-09-20T18:36:16.737 INFO:tasks.workunit.client.0.smithi017.stdout:1/872: unlink df/d29/f56 0 2024-09-20T18:36:16.741 INFO:tasks.workunit.client.0.smithi017.stdout:1/873: mkdir df/d35/d4f/d82/da6/d11b 0 2024-09-20T18:36:16.742 INFO:tasks.workunit.client.0.smithi017.stdout:5/967: getdents d0/d14/d18/d1b/d131/d135 0 2024-09-20T18:36:16.748 INFO:tasks.workunit.client.0.smithi017.stdout:1/874: creat df/d16/d50/d69/d62/f11c x:0 0 0 2024-09-20T18:36:16.755 INFO:tasks.workunit.client.0.smithi017.stdout:9/953: dwrite d6/d23/d40/db4/fce [0,4194304] 0 2024-09-20T18:36:16.758 INFO:tasks.workunit.client.0.smithi017.stdout:1/875: dwrite df/d3b/dff/f110 [0,4194304] 0 2024-09-20T18:36:16.759 INFO:tasks.workunit.client.0.smithi017.stdout:6/824: dwrite d4/df/d1f/d25/f71 [0,4194304] 0 2024-09-20T18:36:16.778 INFO:tasks.workunit.client.0.smithi017.stdout:5/968: write d0/d14/d18/d19/d4d/d6d/d78/fe5 [977038,114941] 0 2024-09-20T18:36:16.787 INFO:tasks.workunit.client.0.smithi017.stdout:6/825: creat d4/df/d1f/d25/dd7/f11f x:0 0 0 2024-09-20T18:36:16.789 INFO:tasks.workunit.client.0.smithi017.stdout:5/969: mknod d0/d14/d18/d19/d4d/d6d/d78/d98/c150 0 2024-09-20T18:36:16.791 INFO:tasks.workunit.client.0.smithi017.stdout:1/876: truncate df/f5e 304886 0 2024-09-20T18:36:16.793 INFO:tasks.workunit.client.0.smithi017.stdout:6/826: dwrite d4/df/d1f/d25/f71 [0,4194304] 0 2024-09-20T18:36:16.794 INFO:tasks.workunit.client.0.smithi017.stdout:1/877: rmdir df/d16 39 2024-09-20T18:36:16.807 INFO:tasks.workunit.client.0.smithi017.stdout:9/954: write d6/d23/d40/db4/dba/f8c [529554,49736] 0 2024-09-20T18:36:16.808 INFO:tasks.workunit.client.0.smithi017.stdout:9/955: chown d6/d11/f29 3 1 2024-09-20T18:36:16.809 INFO:tasks.workunit.client.0.smithi017.stdout:9/956: chown d6/d23/d58/d3f/d4d/d73/d8f/f99 2086390 1 2024-09-20T18:36:16.814 INFO:tasks.workunit.client.0.smithi017.stdout:9/957: creat d6/d23/d58/d3f/d70/db0/dca/d12c/f150 x:0 0 0 2024-09-20T18:36:16.817 INFO:tasks.workunit.client.0.smithi017.stdout:6/827: dwrite d4/df/d1f/f80 [0,4194304] 0 2024-09-20T18:36:16.818 INFO:tasks.workunit.client.0.smithi017.stdout:1/878: dwrite df/d16/f21 [4194304,4194304] 0 2024-09-20T18:36:16.820 INFO:tasks.workunit.client.0.smithi017.stdout:6/828: stat d4/df/d1f/d25/d2b/c48 0 2024-09-20T18:36:16.826 INFO:tasks.workunit.client.0.smithi017.stdout:1/879: mknod df/d29/d7e/dde/df7/d10f/c11d 0 2024-09-20T18:36:16.833 INFO:tasks.workunit.client.0.smithi017.stdout:6/829: link d4/d37/c47 d4/d37/d68/da4/d9e/c120 0 2024-09-20T18:36:16.847 INFO:tasks.workunit.client.0.smithi017.stdout:1/880: write df/d35/d6b/dee/f100 [1457307,110165] 0 2024-09-20T18:36:16.852 INFO:tasks.workunit.client.0.smithi017.stdout:6/830: dwrite d4/f12 [0,4194304] 0 2024-09-20T18:36:16.852 INFO:tasks.workunit.client.0.smithi017.stdout:6/831: readlink d4/le9 0 2024-09-20T18:36:16.854 INFO:tasks.workunit.client.0.smithi017.stdout:1/881: rmdir df/d35/d4f/de1 0 2024-09-20T18:36:16.856 INFO:tasks.workunit.client.0.smithi017.stdout:1/882: fsync df/d16/d50/d69/d62/da7/fe8 0 2024-09-20T18:36:16.864 INFO:tasks.workunit.client.0.smithi017.stdout:1/883: creat df/d35/d4f/d82/f11e x:0 0 0 2024-09-20T18:36:16.871 INFO:tasks.workunit.client.0.smithi017.stdout:1/884: dwrite df/d1c/d45/dcc/fd4 [0,4194304] 0 2024-09-20T18:36:16.873 INFO:tasks.workunit.client.0.smithi017.stdout:6/832: write d4/df/d1f/f22 [786636,4723] 0 2024-09-20T18:36:16.874 INFO:tasks.workunit.client.0.smithi017.stdout:1/885: stat df/d1c/l7a 0 2024-09-20T18:36:16.883 INFO:tasks.workunit.client.0.smithi017.stdout:6/833: getdents d4/d29/df5/d43 0 2024-09-20T18:36:16.883 INFO:tasks.workunit.client.0.smithi017.stdout:1/886: dwrite df/d1c/f3c [0,4194304] 0 2024-09-20T18:36:16.889 INFO:tasks.workunit.client.0.smithi017.stdout:6/834: mkdir d4/df/d121 0 2024-09-20T18:36:16.889 INFO:tasks.workunit.client.0.smithi017.stdout:1/887: dread df/d3b/dff/f110 [0,4194304] 0 2024-09-20T18:36:16.895 INFO:tasks.workunit.client.0.smithi017.stdout:6/835: mknod d4/d37/d68/d8d/db2/c122 0 2024-09-20T18:36:16.953 INFO:tasks.workunit.client.0.smithi017.stdout:2/974: sync 2024-09-20T18:36:16.953 INFO:tasks.workunit.client.0.smithi017.stdout:7/826: sync 2024-09-20T18:36:16.953 INFO:tasks.workunit.client.0.smithi017.stdout:3/950: sync 2024-09-20T18:36:16.953 INFO:tasks.workunit.client.0.smithi017.stdout:0/754: sync 2024-09-20T18:36:16.954 INFO:tasks.workunit.client.0.smithi017.stdout:0/755: stat d4/db/d18/d25/d36/d47/lb2 0 2024-09-20T18:36:16.954 INFO:tasks.workunit.client.0.smithi017.stdout:2/975: chown d1/d1f/d127/d13b/d85/d46/d48/lca 311188522 1 2024-09-20T18:36:16.956 INFO:tasks.workunit.client.0.smithi017.stdout:2/976: truncate d1/d1f/d127/d13b/d85/d46/f13c 301331 0 2024-09-20T18:36:16.998 INFO:tasks.workunit.client.0.smithi017.stdout:6/836: mkdir d4/d37/d68/d8d/d123 0 2024-09-20T18:36:16.999 INFO:tasks.workunit.client.0.smithi017.stdout:7/827: rename da/d16/d1c/d40/d34/d3c/c6a to da/d54/c105 0 2024-09-20T18:36:17.000 INFO:tasks.workunit.client.0.smithi017.stdout:6/837: truncate d4/d29/df5/d43/d7d/dc2/fd5 873116 0 2024-09-20T18:36:17.001 INFO:tasks.workunit.client.0.smithi017.stdout:7/828: dread da/fbb [0,4194304] 0 2024-09-20T18:36:17.003 INFO:tasks.workunit.client.0.smithi017.stdout:3/951: truncate da/de/d13/d2f/d92/dc8/f114 357770 0 2024-09-20T18:36:17.006 INFO:tasks.workunit.client.0.smithi017.stdout:1/888: write df/f5a [3528913,68371] 0 2024-09-20T18:36:17.007 INFO:tasks.workunit.client.0.smithi017.stdout:2/977: rmdir d1/d67/d8f 39 2024-09-20T18:36:17.008 INFO:tasks.workunit.client.0.smithi017.stdout:1/889: fsync df/d29/d7e/fd7 0 2024-09-20T18:36:17.010 INFO:tasks.workunit.client.0.smithi017.stdout:7/829: unlink da/d16/db5/lf4 0 2024-09-20T18:36:17.013 INFO:tasks.workunit.client.0.smithi017.stdout:0/756: mkdir d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d101 0 2024-09-20T18:36:17.015 INFO:tasks.workunit.client.0.smithi017.stdout:3/952: rename da/de/d13/d2f/cea to da/def/d113/d116/c140 0 2024-09-20T18:36:17.020 INFO:tasks.workunit.client.0.smithi017.stdout:1/890: fdatasync df/d29/d2c/f92 0 2024-09-20T18:36:17.024 INFO:tasks.workunit.client.0.smithi017.stdout:7/830: readlink da/d16/d1c/lc6 0 2024-09-20T18:36:17.027 INFO:tasks.workunit.client.0.smithi017.stdout:2/978: write d1/d1f/f3f [5051611,75173] 0 2024-09-20T18:36:17.028 INFO:tasks.workunit.client.0.smithi017.stdout:3/953: rmdir da/de/d13/d2f/d26/d31/d5a/d76/d19 39 2024-09-20T18:36:17.029 INFO:tasks.workunit.client.0.smithi017.stdout:3/954: chown da/de/d13/d2f/f2e 872 1 2024-09-20T18:36:17.036 INFO:tasks.workunit.client.0.smithi017.stdout:7/831: dread da/d16/d1c/d40/d34/d96/fd6 [0,4194304] 0 2024-09-20T18:36:17.036 INFO:tasks.workunit.client.0.smithi017.stdout:6/838: link d4/df/d4a/d8f/fc4 d4/d29/df5/f124 0 2024-09-20T18:36:17.039 INFO:tasks.workunit.client.0.smithi017.stdout:2/979: read - d1/d1f/d127/d13b/d85/d98/fdc zero size 2024-09-20T18:36:17.039 INFO:tasks.workunit.client.0.smithi017.stdout:0/757: dwrite d4/d37/fae [0,4194304] 0 2024-09-20T18:36:17.041 INFO:tasks.workunit.client.0.smithi017.stdout:7/832: write da/d16/d1c/d40/d34/fbe [4344983,58949] 0 2024-09-20T18:36:17.044 INFO:tasks.workunit.client.0.smithi017.stdout:0/758: truncate d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/d95/fe9 502375 0 2024-09-20T18:36:17.046 INFO:tasks.workunit.client.0.smithi017.stdout:6/839: truncate d4/df/fa0 294983 0 2024-09-20T18:36:17.054 INFO:tasks.workunit.client.0.smithi017.stdout:0/759: dwrite d4/db/d18/d25/f7f [0,4194304] 0 2024-09-20T18:36:17.057 INFO:tasks.workunit.client.0.smithi017.stdout:6/840: dwrite d4/df/d1f/d25/d3f/f5b [4194304,4194304] 0 2024-09-20T18:36:17.062 INFO:tasks.workunit.client.0.smithi017.stdout:2/980: dread d1/d1f/f6e [0,4194304] 0 2024-09-20T18:36:17.063 INFO:tasks.workunit.client.0.smithi017.stdout:0/760: mkdir d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d101/d102 0 2024-09-20T18:36:17.063 INFO:tasks.workunit.client.0.smithi017.stdout:6/841: write d4/df/d1f/d25/dd7/f11f [271652,1365] 0 2024-09-20T18:36:17.066 INFO:tasks.workunit.client.0.smithi017.stdout:7/833: dwrite da/d16/f67 [0,4194304] 0 2024-09-20T18:36:17.067 INFO:tasks.workunit.client.0.smithi017.stdout:2/981: readlink d1/d1f/d127/d13b/d85/d3d/d8d/d119/l128 0 2024-09-20T18:36:17.070 INFO:tasks.workunit.client.0.smithi017.stdout:6/842: write d4/f14 [1524044,118078] 0 2024-09-20T18:36:17.071 INFO:tasks.workunit.client.0.smithi017.stdout:6/843: readlink d4/d37/d68/da4/lf2 0 2024-09-20T18:36:17.071 INFO:tasks.workunit.client.0.smithi017.stdout:7/834: dread - da/d16/d8e/f52 zero size 2024-09-20T18:36:17.072 INFO:tasks.workunit.client.0.smithi017.stdout:2/982: symlink d1/d1f/d127/d13b/d8a/ddf/l13d 0 2024-09-20T18:36:17.074 INFO:tasks.workunit.client.0.smithi017.stdout:7/835: truncate da/dd2/df8/d98/fc0 1627709 0 2024-09-20T18:36:17.075 INFO:tasks.workunit.client.0.smithi017.stdout:6/844: creat d4/d37/d68/d8d/d123/f125 x:0 0 0 2024-09-20T18:36:17.077 INFO:tasks.workunit.client.0.smithi017.stdout:2/983: rmdir d1/d1f/d127/d13b/d85/d3d/d77/d7a/d109 39 2024-09-20T18:36:17.079 INFO:tasks.workunit.client.0.smithi017.stdout:7/836: mkdir da/d16/d1c/d40/d34/d106 0 2024-09-20T18:36:17.083 INFO:tasks.workunit.client.0.smithi017.stdout:2/984: truncate d1/dc/d20/d2e/f4f 1331872 0 2024-09-20T18:36:17.085 INFO:tasks.workunit.client.0.smithi017.stdout:0/761: truncate d4/db/fc 2516342 0 2024-09-20T18:36:17.088 INFO:tasks.workunit.client.0.smithi017.stdout:6/845: fsync d4/f14 0 2024-09-20T18:36:17.089 INFO:tasks.workunit.client.0.smithi017.stdout:2/985: fdatasync d1/d1f/d127/d13b/d85/d98/ff7 0 2024-09-20T18:36:17.090 INFO:tasks.workunit.client.0.smithi017.stdout:0/762: mkdir d4/db/d18/d25/d36/d103 0 2024-09-20T18:36:17.092 INFO:tasks.workunit.client.0.smithi017.stdout:0/763: fdatasync d4/d20/fb9 0 2024-09-20T18:36:17.093 INFO:tasks.workunit.client.0.smithi017.stdout:7/837: dwrite da/d16/d8e/ddf/ff0 [0,4194304] 0 2024-09-20T18:36:17.094 INFO:tasks.workunit.client.0.smithi017.stdout:2/986: creat d1/d1f/d106/f13e x:0 0 0 2024-09-20T18:36:17.094 INFO:tasks.workunit.client.0.smithi017.stdout:6/846: write d4/d37/d68/d8d/db2/dd4/dd9/f100 [2706744,54892] 0 2024-09-20T18:36:17.096 INFO:tasks.workunit.client.0.smithi017.stdout:7/838: truncate da/d16/f67 4729340 0 2024-09-20T18:36:17.101 INFO:tasks.workunit.client.0.smithi017.stdout:0/764: dread d4/db/dcd/d52/d77/f8a [0,4194304] 0 2024-09-20T18:36:17.102 INFO:tasks.workunit.client.0.smithi017.stdout:6/847: write d4/d29/df5/f54 [1646787,85404] 0 2024-09-20T18:36:17.104 INFO:tasks.workunit.client.0.smithi017.stdout:7/839: fdatasync da/d16/d1c/d40/d34/d3c/f88 0 2024-09-20T18:36:17.105 INFO:tasks.workunit.client.0.smithi017.stdout:7/840: readlink da/d94/ld3 0 2024-09-20T18:36:17.110 INFO:tasks.workunit.client.0.smithi017.stdout:6/848: fdatasync d4/d29/df5/d43/f78 0 2024-09-20T18:36:17.114 INFO:tasks.workunit.client.0.smithi017.stdout:7/841: mkdir da/d16/d1c/d40/d5d/da7/de5/d107 0 2024-09-20T18:36:17.123 INFO:tasks.workunit.client.0.smithi017.stdout:2/987: dwrite d1/d67/d8f/dcd/fcf [0,4194304] 0 2024-09-20T18:36:17.125 INFO:tasks.workunit.client.0.smithi017.stdout:0/765: dwrite d4/db/dcd/d52/fb3 [0,4194304] 0 2024-09-20T18:36:17.127 INFO:tasks.workunit.client.0.smithi017.stdout:0/766: chown d4/db/c1b 1450728 1 2024-09-20T18:36:17.128 INFO:tasks.workunit.client.0.smithi017.stdout:7/842: mkdir da/d16/d1c/d40/d34/dcd/de4/de8/d108 0 2024-09-20T18:36:17.130 INFO:tasks.workunit.client.0.smithi017.stdout:7/843: dread - da/d16/d1c/d40/d5d/f9f zero size 2024-09-20T18:36:17.131 INFO:tasks.workunit.client.0.smithi017.stdout:2/988: dread - d1/d1f/d127/d13b/d8a/ddf/fe3 zero size 2024-09-20T18:36:17.136 INFO:tasks.workunit.client.0.smithi017.stdout:6/849: dwrite d4/fd8 [0,4194304] 0 2024-09-20T18:36:17.139 INFO:tasks.workunit.client.0.smithi017.stdout:2/989: creat d1/d1f/d127/d13b/d85/d3d/d8d/f13f x:0 0 0 2024-09-20T18:36:17.141 INFO:tasks.workunit.client.0.smithi017.stdout:7/844: rename da/dd2/df8/c36 to da/d16/d1c/d40/d3a/d8a/c109 0 2024-09-20T18:36:17.142 INFO:tasks.workunit.client.0.smithi017.stdout:0/767: write d4/fa [3564973,98633] 0 2024-09-20T18:36:17.144 INFO:tasks.workunit.client.0.smithi017.stdout:7/845: rmdir da/d54 39 2024-09-20T18:36:17.146 INFO:tasks.workunit.client.0.smithi017.stdout:2/990: mknod d1/d1f/d127/d13b/d85/c140 0 2024-09-20T18:36:17.147 INFO:tasks.workunit.client.0.smithi017.stdout:0/768: symlink d4/db/d18/d55/l104 0 2024-09-20T18:36:17.149 INFO:tasks.workunit.client.0.smithi017.stdout:2/991: dread - d1/d6c/f101 zero size 2024-09-20T18:36:17.150 INFO:tasks.workunit.client.0.smithi017.stdout:6/850: getdents d4/d37/d68/da4 0 2024-09-20T18:36:17.150 INFO:tasks.workunit.client.0.smithi017.stdout:0/769: dread d4/db/dcd/d52/d77/f8a [0,4194304] 0 2024-09-20T18:36:17.152 INFO:tasks.workunit.client.0.smithi017.stdout:6/851: fsync d4/f10 0 2024-09-20T18:36:17.152 INFO:tasks.workunit.client.0.smithi017.stdout:2/992: symlink d1/df/l141 0 2024-09-20T18:36:17.153 INFO:tasks.workunit.client.0.smithi017.stdout:6/852: chown d4/d37/d68/d8d/d123/f125 30 1 2024-09-20T18:36:17.154 INFO:tasks.workunit.client.0.smithi017.stdout:0/770: creat d4/db/d18/d25/d36/d47/d8c/daa/f105 x:0 0 0 2024-09-20T18:36:17.157 INFO:tasks.workunit.client.0.smithi017.stdout:6/853: mknod d4/d29/df5/d43/d7d/c126 0 2024-09-20T18:36:17.159 INFO:tasks.workunit.client.0.smithi017.stdout:0/771: rmdir d4/dc8 0 2024-09-20T18:36:17.160 INFO:tasks.workunit.client.0.smithi017.stdout:6/854: fsync d4/df/d1f/d25/d3f/ffa 0 2024-09-20T18:36:17.161 INFO:tasks.workunit.client.0.smithi017.stdout:0/772: fsync d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/f80 0 2024-09-20T18:36:17.164 INFO:tasks.workunit.client.0.smithi017.stdout:7/846: write da/d16/fc1 [966831,130399] 0 2024-09-20T18:36:17.166 INFO:tasks.workunit.client.0.smithi017.stdout:7/847: write da/d16/d1c/d40/d3a/f93 [887821,43379] 0 2024-09-20T18:36:17.166 INFO:tasks.workunit.client.0.smithi017.stdout:7/848: stat da/f49 0 2024-09-20T18:36:17.168 INFO:tasks.workunit.client.0.smithi017.stdout:0/773: truncate d4/db/fc 349730 0 2024-09-20T18:36:17.168 INFO:tasks.workunit.client.0.smithi017.stdout:7/849: write da/d16/d1c/d40/d34/d3c/fd8 [310894,51907] 0 2024-09-20T18:36:17.171 INFO:tasks.workunit.client.0.smithi017.stdout:6/855: rename d4/d29/df5/d43/d7d to d4/df/d1f/d25/dca/d127 0 2024-09-20T18:36:17.171 INFO:tasks.workunit.client.0.smithi017.stdout:0/774: readlink d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/le4 0 2024-09-20T18:36:17.175 INFO:tasks.workunit.client.0.smithi017.stdout:2/993: dwrite d1/dc/d20/f84 [0,4194304] 0 2024-09-20T18:36:17.177 INFO:tasks.workunit.client.0.smithi017.stdout:6/856: write d4/df/d1f/d25/dca/ffd [1269764,62560] 0 2024-09-20T18:36:17.177 INFO:tasks.workunit.client.0.smithi017.stdout:2/994: stat d1/d6c 0 2024-09-20T18:36:17.180 INFO:tasks.workunit.client.0.smithi017.stdout:0/775: write d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/d95/fe9 [111019,2892] 0 2024-09-20T18:36:17.185 INFO:tasks.workunit.client.0.smithi017.stdout:7/850: dwrite da/d16/d1c/d40/d3a/feb [4194304,4194304] 0 2024-09-20T18:36:17.185 INFO:tasks.workunit.client.0.smithi017.stdout:6/857: unlink d4/d37/d68/da4/d9e/c118 0 2024-09-20T18:36:17.187 INFO:tasks.workunit.client.0.smithi017.stdout:6/858: chown d4/d37/d68/da4/lf2 0 1 2024-09-20T18:36:17.188 INFO:tasks.workunit.client.0.smithi017.stdout:0/776: mkdir d4/db/d18/d55/d106 0 2024-09-20T18:36:17.189 INFO:tasks.workunit.client.0.smithi017.stdout:6/859: read d4/df/d1f/faf [2819840,125032] 0 2024-09-20T18:36:17.195 INFO:tasks.workunit.client.0.smithi017.stdout:6/860: creat d4/df/d1f/d25/dca/d127/dc2/f128 x:0 0 0 2024-09-20T18:36:17.197 INFO:tasks.workunit.client.0.smithi017.stdout:7/851: getdents da/d16/d1c/d40/d3a/d8a 0 2024-09-20T18:36:17.199 INFO:tasks.workunit.client.0.smithi017.stdout:0/777: rename d4/db/d18/d25/d36/d47/cd4 to d4/db/d18/d25/d36/d103/c107 0 2024-09-20T18:36:17.199 INFO:tasks.workunit.client.0.smithi017.stdout:2/995: dread d1/d1f/d127/d13b/d85/d53/d6b/f95 [0,4194304] 0 2024-09-20T18:36:17.200 INFO:tasks.workunit.client.0.smithi017.stdout:6/861: fdatasync d4/d37/fdf 0 2024-09-20T18:36:17.201 INFO:tasks.workunit.client.0.smithi017.stdout:7/852: rmdir da/d16/d1c/d40/d3a 39 2024-09-20T18:36:17.203 INFO:tasks.workunit.client.0.smithi017.stdout:7/853: fdatasync da/f77 0 2024-09-20T18:36:17.204 INFO:tasks.workunit.client.0.smithi017.stdout:6/862: symlink d4/df/d4a/d8f/l129 0 2024-09-20T18:36:17.206 INFO:tasks.workunit.client.0.smithi017.stdout:0/778: dread d4/d20/d63/d86/fa7 [0,4194304] 0 2024-09-20T18:36:17.207 INFO:tasks.workunit.client.0.smithi017.stdout:2/996: dwrite d1/d1f/d127/d13b/d85/d46/f13c [0,4194304] 0 2024-09-20T18:36:17.224 INFO:tasks.workunit.client.0.smithi017.stdout:6/863: dread d4/fbf [0,4194304] 0 2024-09-20T18:36:17.228 INFO:tasks.workunit.client.0.smithi017.stdout:2/997: fdatasync d1/d1f/d127/d13b/d85/d46/f13c 0 2024-09-20T18:36:17.229 INFO:tasks.workunit.client.0.smithi017.stdout:2/998: write d1/d1f/d127/d13b/d85/d98/fbd [2095952,122438] 0 2024-09-20T18:36:17.346 INFO:tasks.workunit.client.0.smithi017.stdout:7/854: chown da/l103 463659 1 2024-09-20T18:36:17.361 INFO:tasks.workunit.client.0.smithi017.stdout:4/737: sync 2024-09-20T18:36:17.363 INFO:tasks.workunit.client.0.smithi017.stdout:2/999: link d1/d1f/d127/d13b/d85/d3d/f36 d1/d1f/d99/f142 0 2024-09-20T18:36:17.366 INFO:tasks.workunit.client.0.smithi017.stdout:7/855: dwrite da/d16/d1c/d40/d3a/d8a/fee [0,4194304] 0 2024-09-20T18:36:17.369 INFO:tasks.workunit.client.0.smithi017.stdout:0/779: dwrite d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/f67 [0,4194304] 0 2024-09-20T18:36:17.369 INFO:tasks.workunit.client.0.smithi017.stdout:4/738: creat d4/d82/d88/d5c/d8f/ff1 x:0 0 0 2024-09-20T18:36:17.371 INFO:tasks.workunit.client.0.smithi017.stdout:6/864: dread d4/d29/f81 [0,4194304] 0 2024-09-20T18:36:17.374 INFO:tasks.workunit.client.0.smithi017.stdout:7/856: creat da/d16/d1c/d40/d34/d3c/f10a x:0 0 0 2024-09-20T18:36:17.384 INFO:tasks.workunit.client.0.smithi017.stdout:0/780: symlink d4/db/d18/d55/d106/l108 0 2024-09-20T18:36:17.385 INFO:tasks.workunit.client.0.smithi017.stdout:6/865: symlink d4/d37/l12a 0 2024-09-20T18:36:17.388 INFO:tasks.workunit.client.0.smithi017.stdout:0/781: unlink d4/db/d18/f8d 0 2024-09-20T18:36:17.392 INFO:tasks.workunit.client.0.smithi017.stdout:4/739: getdents d4/dc/d1e 0 2024-09-20T18:36:17.395 INFO:tasks.workunit.client.0.smithi017.stdout:4/740: truncate d4/d19/d37/da1/d1b/d56/d67/fe6 189973 0 2024-09-20T18:36:17.397 INFO:tasks.workunit.client.0.smithi017.stdout:7/857: dread da/d54/fa6 [0,4194304] 0 2024-09-20T18:36:17.401 INFO:tasks.workunit.client.0.smithi017.stdout:4/741: mknod d4/d19/d37/dbc/d7a/cf2 0 2024-09-20T18:36:17.408 INFO:tasks.workunit.client.0.smithi017.stdout:0/782: getdents d4/db/d18/d25 0 2024-09-20T18:36:17.409 INFO:tasks.workunit.client.0.smithi017.stdout:4/742: mknod d4/d82/d88/d5c/d8f/da9/db4/dde/cf3 0 2024-09-20T18:36:17.411 INFO:tasks.workunit.client.0.smithi017.stdout:6/866: dwrite d4/df/d1f/d25/d3f/fac [0,4194304] 0 2024-09-20T18:36:17.417 INFO:tasks.workunit.client.0.smithi017.stdout:7/858: link da/d16/d1c/d40/f80 da/d16/d1c/d40/d34/d96/f10b 0 2024-09-20T18:36:17.418 INFO:tasks.workunit.client.0.smithi017.stdout:0/783: rmdir d4/db/d18/d25/d36/d47/d8c/daa/dca/d24 39 2024-09-20T18:36:17.418 INFO:tasks.workunit.client.0.smithi017.stdout:7/859: chown da/d94/lb8 1921 1 2024-09-20T18:36:17.419 INFO:tasks.workunit.client.0.smithi017.stdout:4/743: read d4/d19/f35 [1122263,117449] 0 2024-09-20T18:36:17.422 INFO:tasks.workunit.client.0.smithi017.stdout:6/867: mkdir d4/d37/d68/d8d/db2/dd4/dd9/d12b 0 2024-09-20T18:36:17.429 INFO:tasks.workunit.client.0.smithi017.stdout:6/868: dread d4/d29/df5/f77 [0,4194304] 0 2024-09-20T18:36:17.431 INFO:tasks.workunit.client.0.smithi017.stdout:4/744: creat d4/dc/d41/ff4 x:0 0 0 2024-09-20T18:36:17.435 INFO:tasks.workunit.client.0.smithi017.stdout:0/784: write d4/d37/f8b [1180590,22043] 0 2024-09-20T18:36:17.437 INFO:tasks.workunit.client.0.smithi017.stdout:7/860: write da/f22 [3192341,95512] 0 2024-09-20T18:36:17.438 INFO:tasks.workunit.client.0.smithi017.stdout:6/869: creat d4/d37/d68/d8d/d123/f12c x:0 0 0 2024-09-20T18:36:17.445 INFO:tasks.workunit.client.0.smithi017.stdout:7/861: dwrite da/d16/d1c/d40/d3a/d8a/fee [0,4194304] 0 2024-09-20T18:36:17.448 INFO:tasks.workunit.client.0.smithi017.stdout:6/870: fdatasync d4/d29/df5/d43/fd2 0 2024-09-20T18:36:17.452 INFO:tasks.workunit.client.0.smithi017.stdout:0/785: mkdir d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d69/d109 0 2024-09-20T18:36:17.455 INFO:tasks.workunit.client.0.smithi017.stdout:7/862: rename da/d16/d1c/d40/d34/d3c/f10a to da/d16/d1c/d40/d3a/d8a/f10c 0 2024-09-20T18:36:17.457 INFO:tasks.workunit.client.0.smithi017.stdout:4/745: link d4/d19/d37/lbe d4/dc/d1e/d8e/lf5 0 2024-09-20T18:36:17.457 INFO:tasks.workunit.client.0.smithi017.stdout:0/786: write d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/f80 [1266412,21833] 0 2024-09-20T18:36:17.458 INFO:tasks.workunit.client.0.smithi017.stdout:6/871: dwrite d4/d37/d68/da4/d9e/fc5 [0,4194304] 0 2024-09-20T18:36:17.462 INFO:tasks.workunit.client.0.smithi017.stdout:4/746: truncate d4/d19/d37/da1/f4f 5678703 0 2024-09-20T18:36:17.465 INFO:tasks.workunit.client.0.smithi017.stdout:7/863: rename da/d16/d1c/d40/d34/dcd/de4 to da/d16/d1c/d40/d34/d106/d10d 0 2024-09-20T18:36:17.468 INFO:tasks.workunit.client.0.smithi017.stdout:6/872: dwrite d4/d37/d68/d8d/ff8 [0,4194304] 0 2024-09-20T18:36:17.470 INFO:tasks.workunit.client.0.smithi017.stdout:4/747: rmdir d4/d82/d88/d5c/d8f/da9/db4/db5 39 2024-09-20T18:36:17.473 INFO:tasks.workunit.client.0.smithi017.stdout:0/787: getdents d4/db/d18/d25 0 2024-09-20T18:36:17.476 INFO:tasks.workunit.client.0.smithi017.stdout:0/788: truncate d4/db/d18/d25/fe5 265265 0 2024-09-20T18:36:17.478 INFO:tasks.workunit.client.0.smithi017.stdout:6/873: unlink d4/df/d1f/d25/f105 0 2024-09-20T18:36:17.479 INFO:tasks.workunit.client.0.smithi017.stdout:6/874: fsync d4/df/d1f/df6/f104 0 2024-09-20T18:36:17.484 INFO:tasks.workunit.client.0.smithi017.stdout:6/875: dread d4/df/d1f/d25/d3f/d5c/fc1 [0,4194304] 0 2024-09-20T18:36:17.486 INFO:tasks.workunit.client.0.smithi017.stdout:0/789: unlink d4/db/l1f 0 2024-09-20T18:36:17.490 INFO:tasks.workunit.client.0.smithi017.stdout:0/790: read d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/f80 [2964388,117743] 0 2024-09-20T18:36:17.492 INFO:tasks.workunit.client.0.smithi017.stdout:4/748: write d4/d19/d37/d66/fa2 [683506,84271] 0 2024-09-20T18:36:17.494 INFO:tasks.workunit.client.0.smithi017.stdout:6/876: dread - d4/d29/fe2 zero size 2024-09-20T18:36:17.496 INFO:tasks.workunit.client.0.smithi017.stdout:7/864: dwrite da/d16/d1c/d40/d34/d3c/f88 [0,4194304] 0 2024-09-20T18:36:17.497 INFO:tasks.workunit.client.0.smithi017.stdout:6/877: chown d4/d37/d68/dbb/fb6 231 1 2024-09-20T18:36:17.501 INFO:tasks.workunit.client.0.smithi017.stdout:8/676: sync 2024-09-20T18:36:17.503 INFO:tasks.workunit.client.0.smithi017.stdout:4/749: creat d4/d7f/dc2/ff6 x:0 0 0 2024-09-20T18:36:17.510 INFO:tasks.workunit.client.0.smithi017.stdout:4/750: mknod d4/d19/d62/cf7 0 2024-09-20T18:36:17.519 INFO:tasks.workunit.client.0.smithi017.stdout:0/791: link d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/l64 d4/db/d18/d25/d36/d47/d8c/dcb/l10a 0 2024-09-20T18:36:17.520 INFO:tasks.workunit.client.0.smithi017.stdout:7/865: link da/lf9 da/d16/d1c/dc9/l10e 0 2024-09-20T18:36:17.520 INFO:tasks.workunit.client.0.smithi017.stdout:8/677: dwrite d0/d6/d28/d81/fb7 [0,4194304] 0 2024-09-20T18:36:17.522 INFO:tasks.workunit.client.0.smithi017.stdout:6/878: creat d4/df/d1f/d25/f12d x:0 0 0 2024-09-20T18:36:17.522 INFO:tasks.workunit.client.0.smithi017.stdout:7/866: write da/f77 [662267,100762] 0 2024-09-20T18:36:17.522 INFO:tasks.workunit.client.0.smithi017.stdout:8/678: chown d0/d6/d28/l4d 3809 1 2024-09-20T18:36:17.527 INFO:tasks.workunit.client.0.smithi017.stdout:0/792: truncate d4/d20/f2a 3516554 0 2024-09-20T18:36:17.529 INFO:tasks.workunit.client.0.smithi017.stdout:6/879: fdatasync d4/d29/f45 0 2024-09-20T18:36:17.529 INFO:tasks.workunit.client.0.smithi017.stdout:0/793: stat d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d94 0 2024-09-20T18:36:17.530 INFO:tasks.workunit.client.0.smithi017.stdout:7/867: creat da/d16/d1c/dc9/f10f x:0 0 0 2024-09-20T18:36:17.531 INFO:tasks.workunit.client.0.smithi017.stdout:6/880: readlink d4/df/d1f/d25/d3f/d5c/lda 0 2024-09-20T18:36:17.535 INFO:tasks.workunit.client.0.smithi017.stdout:7/868: read da/d16/d1c/d40/d34/d3c/f48 [516900,54795] 0 2024-09-20T18:36:17.538 INFO:tasks.workunit.client.0.smithi017.stdout:8/679: rename d0/d6/d28/d81/l97 to d0/d6/d28/d3d/d4e/le6 0 2024-09-20T18:36:17.542 INFO:tasks.workunit.client.0.smithi017.stdout:7/869: dwrite da/d16/d1c/d40/d34/d3c/f53 [4194304,4194304] 0 2024-09-20T18:36:17.549 INFO:tasks.workunit.client.0.smithi017.stdout:0/794: write d4/d68/d8e/fee [4033804,58778] 0 2024-09-20T18:36:17.549 INFO:tasks.workunit.client.0.smithi017.stdout:8/680: dread d0/d6/d28/d3a/fa7 [0,4194304] 0 2024-09-20T18:36:17.558 INFO:tasks.workunit.client.0.smithi017.stdout:0/795: dwrite d4/db/dcd/d52/d77/daf/fe3 [0,4194304] 0 2024-09-20T18:36:17.562 INFO:tasks.workunit.client.0.smithi017.stdout:8/681: rename d0/d6/d28/d3d/d4e/f89 to d0/d6/d28/d3d/d4e/d55/d83/fe7 0 2024-09-20T18:36:17.563 INFO:tasks.workunit.client.0.smithi017.stdout:6/881: link d4/d37/d68/dbb/ce3 d4/df/d8a/c12e 0 2024-09-20T18:36:17.565 INFO:tasks.workunit.client.0.smithi017.stdout:0/796: truncate d4/d20/f6c 1773559 0 2024-09-20T18:36:17.567 INFO:tasks.workunit.client.0.smithi017.stdout:8/682: truncate d0/d6/d28/d3a/f49 1134917 0 2024-09-20T18:36:17.570 INFO:tasks.workunit.client.0.smithi017.stdout:7/870: dwrite da/d16/d1c/d40/d34/d96/f10b [0,4194304] 0 2024-09-20T18:36:17.575 INFO:tasks.workunit.client.0.smithi017.stdout:8/683: creat d0/d6/d28/d81/fe8 x:0 0 0 2024-09-20T18:36:17.582 INFO:tasks.workunit.client.0.smithi017.stdout:6/882: creat d4/df/d4a/f12f x:0 0 0 2024-09-20T18:36:17.592 INFO:tasks.workunit.client.0.smithi017.stdout:0/797: dwrite d4/db/fba [0,4194304] 0 2024-09-20T18:36:17.592 INFO:tasks.workunit.client.0.smithi017.stdout:6/883: unlink d4/df/d1f/d25/d3f/f5b 0 2024-09-20T18:36:17.601 INFO:tasks.workunit.client.0.smithi017.stdout:8/684: dread d0/d6/d28/d3b/f53 [0,4194304] 0 2024-09-20T18:36:17.603 INFO:tasks.workunit.client.0.smithi017.stdout:7/871: write da/f12 [2846409,90028] 0 2024-09-20T18:36:17.604 INFO:tasks.workunit.client.0.smithi017.stdout:6/884: mkdir d4/d37/d130 0 2024-09-20T18:36:17.605 INFO:tasks.workunit.client.0.smithi017.stdout:7/872: write da/dd2/df8/d98/fc0 [711828,43260] 0 2024-09-20T18:36:17.606 INFO:tasks.workunit.client.0.smithi017.stdout:7/873: write da/d16/d1c/dc9/f10f [16411,2381] 0 2024-09-20T18:36:17.608 INFO:tasks.workunit.client.0.smithi017.stdout:7/874: dread - da/d16/d1c/d40/d3a/d8a/f10c zero size 2024-09-20T18:36:17.616 INFO:tasks.workunit.client.0.smithi017.stdout:8/685: creat d0/d6/d28/d3b/fe9 x:0 0 0 2024-09-20T18:36:17.616 INFO:tasks.workunit.client.0.smithi017.stdout:0/798: dwrite d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d94/fa8 [0,4194304] 0 2024-09-20T18:36:17.621 INFO:tasks.workunit.client.0.smithi017.stdout:6/885: dread d4/df/d4a/f6f [0,4194304] 0 2024-09-20T18:36:17.621 INFO:tasks.workunit.client.0.smithi017.stdout:0/799: dread d4/d20/d63/d86/fa7 [0,4194304] 0 2024-09-20T18:36:17.622 INFO:tasks.workunit.client.0.smithi017.stdout:6/886: fsync d4/df/d1f/d25/dca/d127/dc2/f128 0 2024-09-20T18:36:17.624 INFO:tasks.workunit.client.0.smithi017.stdout:7/875: write da/d16/d8e/d75/f2c [82967,75260] 0 2024-09-20T18:36:17.626 INFO:tasks.workunit.client.0.smithi017.stdout:7/876: fdatasync da/d16/d1c/d40/d5d/fa5 0 2024-09-20T18:36:17.633 INFO:tasks.workunit.client.0.smithi017.stdout:0/800: rename d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/l64 to d4/db/dcd/d52/d77/daf/l10b 0 2024-09-20T18:36:17.634 INFO:tasks.workunit.client.0.smithi017.stdout:7/877: dwrite da/d54/fa6 [4194304,4194304] 0 2024-09-20T18:36:17.640 INFO:tasks.workunit.client.0.smithi017.stdout:7/878: rmdir da/d16/d1c/d40/d5d 39 2024-09-20T18:36:17.643 INFO:tasks.workunit.client.0.smithi017.stdout:8/686: truncate d0/d6/f21 1558277 0 2024-09-20T18:36:17.645 INFO:tasks.workunit.client.0.smithi017.stdout:6/887: write d4/df/d4a/f4b [2254384,70363] 0 2024-09-20T18:36:17.646 INFO:tasks.workunit.client.0.smithi017.stdout:8/687: symlink d0/d6/d28/d3b/d72/lea 0 2024-09-20T18:36:17.646 INFO:tasks.workunit.client.0.smithi017.stdout:6/888: chown d4/df/d121 15281089 1 2024-09-20T18:36:17.651 INFO:tasks.workunit.client.0.smithi017.stdout:6/889: chown d4/df/d4a/d8f/c106 626 1 2024-09-20T18:36:17.652 INFO:tasks.workunit.client.0.smithi017.stdout:8/688: creat d0/d65/d8b/db4/feb x:0 0 0 2024-09-20T18:36:17.654 INFO:tasks.workunit.client.0.smithi017.stdout:7/879: creat da/d16/d1c/d40/d5d/da7/de5/d102/f110 x:0 0 0 2024-09-20T18:36:17.655 INFO:tasks.workunit.client.0.smithi017.stdout:7/880: fsync da/d16/fc1 0 2024-09-20T18:36:17.661 INFO:tasks.workunit.client.0.smithi017.stdout:7/881: dread da/f65 [0,4194304] 0 2024-09-20T18:36:17.661 INFO:tasks.workunit.client.0.smithi017.stdout:8/689: dwrite d0/fc8 [0,4194304] 0 2024-09-20T18:36:17.663 INFO:tasks.workunit.client.0.smithi017.stdout:6/890: dread d4/d29/df5/d43/f51 [0,4194304] 0 2024-09-20T18:36:17.664 INFO:tasks.workunit.client.0.smithi017.stdout:6/891: dread - d4/d37/f94 zero size 2024-09-20T18:36:17.667 INFO:tasks.workunit.client.0.smithi017.stdout:7/882: chown da/d16/d1c/d40/d34/cde 220245445 1 2024-09-20T18:36:17.670 INFO:tasks.workunit.client.0.smithi017.stdout:5/970: sync 2024-09-20T18:36:17.671 INFO:tasks.workunit.client.0.smithi017.stdout:6/892: dwrite d4/d29/dc6/de7/ff9 [0,4194304] 0 2024-09-20T18:36:17.678 INFO:tasks.workunit.client.0.smithi017.stdout:5/971: dwrite d0/dbe/ddc/f14a [0,4194304] 0 2024-09-20T18:36:17.685 INFO:tasks.workunit.client.0.smithi017.stdout:5/972: write d0/d14/d18/d2a/d39/f61 [3333658,57359] 0 2024-09-20T18:36:17.689 INFO:tasks.workunit.client.0.smithi017.stdout:8/690: getdents d0/d6/d28/d3a/dae 0 2024-09-20T18:36:17.695 INFO:tasks.workunit.client.0.smithi017.stdout:8/691: readlink d0/d6/d28/d3d/d4e/le6 0 2024-09-20T18:36:17.695 INFO:tasks.workunit.client.0.smithi017.stdout:7/883: getdents da/d16/d8e/ddf 0 2024-09-20T18:36:17.696 INFO:tasks.workunit.client.0.smithi017.stdout:8/692: creat d0/d6/d93/fec x:0 0 0 2024-09-20T18:36:17.699 INFO:tasks.workunit.client.0.smithi017.stdout:5/973: write d0/d14/d18/d1b/d131/d135/f141 [683707,40605] 0 2024-09-20T18:36:17.701 INFO:tasks.workunit.client.0.smithi017.stdout:5/974: chown d0/d14/l89 0 1 2024-09-20T18:36:17.705 INFO:tasks.workunit.client.0.smithi017.stdout:5/975: dread d0/d14/d18/dcc/f144 [0,4194304] 0 2024-09-20T18:36:17.753 INFO:tasks.workunit.client.0.smithi017.stdout:5/976: dread d0/d14/f20 [0,4194304] 0 2024-09-20T18:36:17.796 INFO:tasks.workunit.client.0.smithi017.stdout:5/977: link d0/d14/d18/dfd/d10a/ffb d0/d14/d18/d2a/d39/d6c/d123/f151 0 2024-09-20T18:36:17.798 INFO:tasks.workunit.client.0.smithi017.stdout:5/978: mkdir d0/d14/d18/d2a/d39/d42/d152 0 2024-09-20T18:36:17.817 INFO:tasks.workunit.client.0.smithi017.stdout:5/979: write d0/d14/d18/d2a/d39/d42/d7e/da8/f120 [4829329,82841] 0 2024-09-20T18:36:17.820 INFO:tasks.workunit.client.0.smithi017.stdout:5/980: creat d0/d14/d18/d19/d4d/d6d/db7/d109/f153 x:0 0 0 2024-09-20T18:36:17.826 INFO:tasks.workunit.client.0.smithi017.stdout:5/981: dwrite d0/d14/d18/d1b/f100 [0,4194304] 0 2024-09-20T18:36:17.830 INFO:tasks.workunit.client.0.smithi017.stdout:5/982: truncate d0/d14/d18/dd1/fcb 1044091 0 2024-09-20T18:36:17.833 INFO:tasks.workunit.client.0.smithi017.stdout:5/983: write d0/d14/d18/d19/d4d/db5/dc0/f95 [4267186,126489] 0 2024-09-20T18:36:17.834 INFO:tasks.workunit.client.0.smithi017.stdout:5/984: write d0/d14/d18/dd1/f138 [790691,84606] 0 2024-09-20T18:36:17.838 INFO:tasks.workunit.client.0.smithi017.stdout:5/985: rename d0/d14/f20 to d0/d14/d18/dcc/d122/f154 0 2024-09-20T18:36:17.847 INFO:tasks.workunit.client.0.smithi017.stdout:5/986: truncate d0/d14/d18/d2a/d39/d42/d7e/da8/f120 830006 0 2024-09-20T18:36:17.858 INFO:tasks.workunit.client.0.smithi017.stdout:5/987: dread d0/d14/d18/f5a [4194304,4194304] 0 2024-09-20T18:36:17.864 INFO:tasks.workunit.client.0.smithi017.stdout:5/988: dread d0/d14/d18/d2a/d39/d6c/f9f [0,4194304] 0 2024-09-20T18:36:17.865 INFO:tasks.workunit.client.0.smithi017.stdout:5/989: mkdir d0/d14/d18/d19/d4d/db5/dc0/d155 0 2024-09-20T18:36:17.866 INFO:tasks.workunit.client.0.smithi017.stdout:5/990: stat d0/d14/d18/d2a/d39/d6c/d72/f16 0 2024-09-20T18:36:17.883 INFO:tasks.workunit.client.0.smithi017.stdout:5/991: dread d0/d14/d18/d2a/d39/f9b [0,4194304] 0 2024-09-20T18:36:17.885 INFO:tasks.workunit.client.0.smithi017.stdout:5/992: chown d0/d14/d18/d1b/f31 44986 1 2024-09-20T18:36:17.888 INFO:tasks.workunit.client.0.smithi017.stdout:5/993: creat d0/d14/d18/d19/d4d/d6d/db7/f156 x:0 0 0 2024-09-20T18:36:17.889 INFO:tasks.workunit.client.0.smithi017.stdout:5/994: fsync d0/d14/d18/d19/d4d/db5/dc0/f12f 0 2024-09-20T18:36:17.892 INFO:tasks.workunit.client.0.smithi017.stdout:5/995: creat d0/d14/d18/d57/db6/f157 x:0 0 0 2024-09-20T18:36:17.900 INFO:tasks.workunit.client.0.smithi017.stdout:5/996: write d0/d14/d18/dfd/d10a/ffb [597231,121366] 0 2024-09-20T18:36:17.901 INFO:tasks.workunit.client.0.smithi017.stdout:5/997: write d0/d14/ff4 [3085616,60957] 0 2024-09-20T18:36:17.904 INFO:tasks.workunit.client.0.smithi017.stdout:5/998: unlink d0/d14/d18/d19/d4d/d6d/d78/c11e 0 2024-09-20T18:36:17.912 INFO:tasks.workunit.client.0.smithi017.stdout:5/999: rename d0/d14/d18/d2a/da1/l83 to d0/l158 0 2024-09-20T18:36:18.019 INFO:tasks.workunit.client.0.smithi017.stdout:3/955: sync 2024-09-20T18:36:18.019 INFO:tasks.workunit.client.0.smithi017.stdout:4/751: sync 2024-09-20T18:36:18.019 INFO:tasks.workunit.client.0.smithi017.stdout:1/891: sync 2024-09-20T18:36:18.020 INFO:tasks.workunit.client.0.smithi017.stdout:9/958: sync 2024-09-20T18:36:18.020 INFO:tasks.workunit.client.0.smithi017.stdout:4/752: creat d4/d82/d88/d5c/ff8 x:0 0 0 2024-09-20T18:36:18.020 INFO:tasks.workunit.client.0.smithi017.stdout:1/892: truncate df/d16/d50/d69/d62/da7/fe8 122717 0 2024-09-20T18:36:18.020 INFO:tasks.workunit.client.0.smithi017.stdout:9/959: mkdir d6/d23/d58/d3f/d151 0 2024-09-20T18:36:18.020 INFO:tasks.workunit.client.0.smithi017.stdout:4/753: creat d4/d7f/ff9 x:0 0 0 2024-09-20T18:36:18.020 INFO:tasks.workunit.client.0.smithi017.stdout:0/801: sync 2024-09-20T18:36:18.022 INFO:tasks.workunit.client.0.smithi017.stdout:9/960: getdents d6/d23/d58/dda/d144 0 2024-09-20T18:36:18.023 INFO:tasks.workunit.client.0.smithi017.stdout:1/893: write df/d35/daa/f8e [269956,126546] 0 2024-09-20T18:36:18.024 INFO:tasks.workunit.client.0.smithi017.stdout:9/961: chown d6/d23/d40/de2 0 1 2024-09-20T18:36:18.026 INFO:tasks.workunit.client.0.smithi017.stdout:1/894: chown df/d35/d6b/fe4 9240 1 2024-09-20T18:36:18.027 INFO:tasks.workunit.client.0.smithi017.stdout:3/956: dwrite da/de/d13/d2f/d26/d62/fe4 [0,4194304] 0 2024-09-20T18:36:18.029 INFO:tasks.workunit.client.0.smithi017.stdout:9/962: write d6/d23/d40/db4/fce [460462,104434] 0 2024-09-20T18:36:18.031 INFO:tasks.workunit.client.0.smithi017.stdout:1/895: write df/d16/d50/d69/d97/d113/f119 [2988384,55106] 0 2024-09-20T18:36:18.034 INFO:tasks.workunit.client.0.smithi017.stdout:4/754: dwrite d4/d19/f35 [0,4194304] 0 2024-09-20T18:36:18.045 INFO:tasks.workunit.client.0.smithi017.stdout:0/802: link d4/db/d18/d25/d36/d47/d8c/daa/f105 d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/f10c 0 2024-09-20T18:36:18.045 INFO:tasks.workunit.client.0.smithi017.stdout:0/803: dread - d4/db/dcd/ff0 zero size 2024-09-20T18:36:18.047 INFO:tasks.workunit.client.0.smithi017.stdout:4/755: link d4/dc/d1e/d26/f6a d4/d7f/dc2/ffa 0 2024-09-20T18:36:18.048 INFO:tasks.workunit.client.0.smithi017.stdout:4/756: write d4/d7f/dc2/ff6 [939995,9253] 0 2024-09-20T18:36:18.050 INFO:tasks.workunit.client.0.smithi017.stdout:0/804: mknod d4/db/d18/d25/d36/d47/d81/d9c/c10d 0 2024-09-20T18:36:18.051 INFO:tasks.workunit.client.0.smithi017.stdout:4/757: unlink d4/d82/d88/d5c/d8f/da9/db4/cc3 0 2024-09-20T18:36:18.052 INFO:tasks.workunit.client.0.smithi017.stdout:0/805: chown d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/f30 12157434 1 2024-09-20T18:36:18.054 INFO:tasks.workunit.client.0.smithi017.stdout:0/806: write d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/d95/fe9 [686536,98488] 0 2024-09-20T18:36:18.054 INFO:tasks.workunit.client.0.smithi017.stdout:4/758: mkdir d4/d19/d37/da1/d1b/d56/dfb 0 2024-09-20T18:36:18.058 INFO:tasks.workunit.client.0.smithi017.stdout:9/963: write d6/fc2 [4987080,77561] 0 2024-09-20T18:36:18.059 INFO:tasks.workunit.client.0.smithi017.stdout:0/807: dread d4/d20/d63/d86/f9f [0,4194304] 0 2024-09-20T18:36:18.059 INFO:tasks.workunit.client.0.smithi017.stdout:3/957: write da/de/d13/d2f/d26/d62/da5/fa8 [947236,57829] 0 2024-09-20T18:36:18.062 INFO:tasks.workunit.client.0.smithi017.stdout:1/896: write df/d29/d2c/d5b/fb9 [250887,94378] 0 2024-09-20T18:36:18.064 INFO:tasks.workunit.client.0.smithi017.stdout:0/808: dread - d4/db/d18/d55/fd9 zero size 2024-09-20T18:36:18.067 INFO:tasks.workunit.client.0.smithi017.stdout:9/964: mkdir d6/d23/d58/d3f/d70/d152 0 2024-09-20T18:36:18.069 INFO:tasks.workunit.client.0.smithi017.stdout:1/897: dwrite df/d16/d50/dab/fc3 [0,4194304] 0 2024-09-20T18:36:18.069 INFO:tasks.workunit.client.0.smithi017.stdout:9/965: readlink d6/d23/d58/d3f/d4d/le1 0 2024-09-20T18:36:18.070 INFO:tasks.workunit.client.0.smithi017.stdout:1/898: readlink df/d1c/l114 0 2024-09-20T18:36:18.071 INFO:tasks.workunit.client.0.smithi017.stdout:3/958: rename da/de/d13/d2f/d26/d31/d5a/d76/d19/ce3 to da/def/c141 0 2024-09-20T18:36:18.075 INFO:tasks.workunit.client.0.smithi017.stdout:1/899: symlink df/d35/d4f/d82/da6/l11f 0 2024-09-20T18:36:18.077 INFO:tasks.workunit.client.0.smithi017.stdout:1/900: write df/d35/d6b/fe4 [3591449,129729] 0 2024-09-20T18:36:18.081 INFO:tasks.workunit.client.0.smithi017.stdout:0/809: rename d4/db/d18/d25/f7c to d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/f10e 0 2024-09-20T18:36:18.085 INFO:tasks.workunit.client.0.smithi017.stdout:9/966: rename d6/d23/d58/d3f/d70/db0/ldb to d6/d23/d58/d3f/d4d/d73/d7d/l153 0 2024-09-20T18:36:18.087 INFO:tasks.workunit.client.0.smithi017.stdout:0/810: creat d4/db/d18/d25/d36/d47/d8c/daa/dca/db1/f10f x:0 0 0 2024-09-20T18:36:18.089 INFO:tasks.workunit.client.0.smithi017.stdout:9/967: unlink d6/d23/l30 0 2024-09-20T18:36:18.131 INFO:tasks.workunit.client.0.smithi017.stdout:9/968: unlink d6/d23/d58/d3f/d4d/c112 0 2024-09-20T18:36:18.135 INFO:tasks.workunit.client.0.smithi017.stdout:3/959: write da/de/d13/d16/d6e/dc9/f12a [593636,48617] 0 2024-09-20T18:36:18.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:17 smithi017 ceph-mon[28058]: pgmap v43: 65 pgs: 65 active+clean; 2.6 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 34 MiB/s rd, 78 MiB/s wr, 250 op/s 2024-09-20T18:36:18.197 INFO:tasks.workunit.client.0.smithi017.stdout:9/969: write d6/d23/d3a/d61/fa3 [904254,2062] 0 2024-09-20T18:36:18.205 INFO:tasks.workunit.client.0.smithi017.stdout:9/970: link d6/d23/d58/f9b d6/d23/d58/d3f/d70/db0/dca/d12c/f154 0 2024-09-20T18:36:18.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:17 smithi172 ceph-mon[35456]: pgmap v43: 65 pgs: 65 active+clean; 2.6 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 34 MiB/s rd, 78 MiB/s wr, 250 op/s 2024-09-20T18:36:18.210 INFO:tasks.workunit.client.0.smithi017.stdout:3/960: dwrite da/def/d113/d116/f11f [0,4194304] 0 2024-09-20T18:36:18.222 INFO:tasks.workunit.client.0.smithi017.stdout:0/811: link d4/d20/lb6 d4/l110 0 2024-09-20T18:36:18.225 INFO:tasks.workunit.client.0.smithi017.stdout:9/971: dread d6/fe3 [0,4194304] 0 2024-09-20T18:36:18.243 INFO:tasks.workunit.client.0.smithi017.stdout:6/893: sync 2024-09-20T18:36:18.243 INFO:tasks.workunit.client.0.smithi017.stdout:8/693: sync 2024-09-20T18:36:18.243 INFO:tasks.workunit.client.0.smithi017.stdout:7/884: sync 2024-09-20T18:36:18.246 INFO:tasks.workunit.client.0.smithi017.stdout:8/694: readlink d0/d6/d28/l33 0 2024-09-20T18:36:18.249 INFO:tasks.workunit.client.0.smithi017.stdout:7/885: getdents da/d16/d1c/d40 0 2024-09-20T18:36:18.250 INFO:tasks.workunit.client.0.smithi017.stdout:7/886: readlink da/d16/d1c/d40/d3a/d8a/lbc 0 2024-09-20T18:36:18.252 INFO:tasks.workunit.client.0.smithi017.stdout:8/695: link d0/d6/d28/d81/d82/fe1 d0/d6/d28/d3d/d4e/d55/d83/da2/fed 0 2024-09-20T18:36:18.252 INFO:tasks.workunit.client.0.smithi017.stdout:3/961: write da/de/d13/d2f/d26/d31/f36 [1298752,78234] 0 2024-09-20T18:36:18.253 INFO:tasks.workunit.client.0.smithi017.stdout:7/887: unlink da/d16/d1c/d40/d34/d96/caf 0 2024-09-20T18:36:18.256 INFO:tasks.workunit.client.0.smithi017.stdout:3/962: rename da/de/d13/d2f/d26/d41/l51 to da/de/d13/d16/d6e/dc9/l142 0 2024-09-20T18:36:18.257 INFO:tasks.workunit.client.0.smithi017.stdout:0/812: write d4/db/dcd/d52/ff1 [916940,113426] 0 2024-09-20T18:36:18.258 INFO:tasks.workunit.client.0.smithi017.stdout:7/888: symlink da/d16/de2/l111 0 2024-09-20T18:36:18.258 INFO:tasks.workunit.client.0.smithi017.stdout:9/972: write d6/d23/d3a/f62 [5166853,102517] 0 2024-09-20T18:36:18.259 INFO:tasks.workunit.client.0.smithi017.stdout:0/813: stat d4/db/dcd/fed 0 2024-09-20T18:36:18.260 INFO:tasks.workunit.client.0.smithi017.stdout:7/889: chown da/d16/d92/fa3 530 1 2024-09-20T18:36:18.263 INFO:tasks.workunit.client.0.smithi017.stdout:7/890: rmdir da/dd2 39 2024-09-20T18:36:18.265 INFO:tasks.workunit.client.0.smithi017.stdout:0/814: rmdir d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d69 39 2024-09-20T18:36:18.267 INFO:tasks.workunit.client.0.smithi017.stdout:6/894: write d4/d29/f45 [727797,36817] 0 2024-09-20T18:36:18.267 INFO:tasks.workunit.client.0.smithi017.stdout:8/696: dread d0/f1e [0,4194304] 0 2024-09-20T18:36:18.270 INFO:tasks.workunit.client.0.smithi017.stdout:7/891: unlink da/d16/d8e/d75/f89 0 2024-09-20T18:36:18.270 INFO:tasks.workunit.client.0.smithi017.stdout:7/892: readlink da/d16/l4f 0 2024-09-20T18:36:18.271 INFO:tasks.workunit.client.0.smithi017.stdout:3/963: rename da/f29 to da/def/d113/f143 0 2024-09-20T18:36:18.273 INFO:tasks.workunit.client.0.smithi017.stdout:0/815: fdatasync d4/d20/d63/d86/fa6 0 2024-09-20T18:36:18.279 INFO:tasks.workunit.client.0.smithi017.stdout:3/964: mknod da/de/d53/d88/db3/dd3/c144 0 2024-09-20T18:36:18.279 INFO:tasks.workunit.client.0.smithi017.stdout:9/973: dread d6/fb [4194304,4194304] 0 2024-09-20T18:36:18.279 INFO:tasks.workunit.client.0.smithi017.stdout:6/895: dread d4/df/d4a/f6c [0,4194304] 0 2024-09-20T18:36:18.284 INFO:tasks.workunit.client.0.smithi017.stdout:8/697: dread d0/d6/d28/d81/d82/fd0 [0,4194304] 0 2024-09-20T18:36:18.284 INFO:tasks.workunit.client.0.smithi017.stdout:3/965: mknod da/de/d13/d2f/d26/d31/c145 0 2024-09-20T18:36:18.284 INFO:tasks.workunit.client.0.smithi017.stdout:8/698: chown d0/d65/d8b/db5 1 1 2024-09-20T18:36:18.289 INFO:tasks.workunit.client.0.smithi017.stdout:0/816: creat d4/db/d18/d25/d36/d47/d81/f111 x:0 0 0 2024-09-20T18:36:18.293 INFO:tasks.workunit.client.0.smithi017.stdout:3/966: unlink da/de/d53/d88/lb6 0 2024-09-20T18:36:18.295 INFO:tasks.workunit.client.0.smithi017.stdout:7/893: write da/d16/d1c/d40/d5d/f9f [359378,86961] 0 2024-09-20T18:36:18.301 INFO:tasks.workunit.client.0.smithi017.stdout:8/699: rename d0/d6/f20 to d0/d6/d28/d81/fee 0 2024-09-20T18:36:18.305 INFO:tasks.workunit.client.0.smithi017.stdout:6/896: dwrite d4/d37/d68/da4/d9e/fbc [4194304,4194304] 0 2024-09-20T18:36:18.305 INFO:tasks.workunit.client.0.smithi017.stdout:6/897: readlink d4/d29/df5/d43/l63 0 2024-09-20T18:36:18.312 INFO:tasks.workunit.client.0.smithi017.stdout:8/700: fdatasync d0/d6/f1b 0 2024-09-20T18:36:18.313 INFO:tasks.workunit.client.0.smithi017.stdout:7/894: write da/d16/d1c/d40/fe0 [846866,57513] 0 2024-09-20T18:36:18.318 INFO:tasks.workunit.client.0.smithi017.stdout:6/898: mknod d4/d37/d68/d8d/c131 0 2024-09-20T18:36:18.322 INFO:tasks.workunit.client.0.smithi017.stdout:3/967: write da/de/d13/d2f/d26/d31/faf [1021496,91993] 0 2024-09-20T18:36:18.323 INFO:tasks.workunit.client.0.smithi017.stdout:0/817: link d4/d20/d63/d86/fa7 d4/f112 0 2024-09-20T18:36:18.337 INFO:tasks.workunit.client.0.smithi017.stdout:6/899: dwrite d4/df/d1f/d25/dca/d127/f79 [0,4194304] 0 2024-09-20T18:36:18.337 INFO:tasks.workunit.client.0.smithi017.stdout:8/701: dwrite d0/d6/d28/f2d [0,4194304] 0 2024-09-20T18:36:18.339 INFO:tasks.workunit.client.0.smithi017.stdout:8/702: chown d0/d6/d28/d3d/d4e/d55/c6a 0 1 2024-09-20T18:36:18.341 INFO:tasks.workunit.client.0.smithi017.stdout:7/895: rename da/d16/d1c/d40/d34/d96/lc7 to da/dd2/df8/l112 0 2024-09-20T18:36:18.345 INFO:tasks.workunit.client.0.smithi017.stdout:8/703: unlink d0/d6/d28/d3d/d4e/d55/la1 0 2024-09-20T18:36:18.347 INFO:tasks.workunit.client.0.smithi017.stdout:8/704: readlink d0/d6/d28/d3a/dae/lb6 0 2024-09-20T18:36:18.348 INFO:tasks.workunit.client.0.smithi017.stdout:7/896: dwrite da/f8f [0,4194304] 0 2024-09-20T18:36:18.363 INFO:tasks.workunit.client.0.smithi017.stdout:0/818: rename d4/db/f3b to d4/d37/f113 0 2024-09-20T18:36:18.367 INFO:tasks.workunit.client.0.smithi017.stdout:6/900: write d4/d29/df5/d43/f92 [1071193,73559] 0 2024-09-20T18:36:18.369 INFO:tasks.workunit.client.0.smithi017.stdout:8/705: fsync d0/d6/d28/d3d/d4e/d55/d83/da2/fad 0 2024-09-20T18:36:18.375 INFO:tasks.workunit.client.0.smithi017.stdout:0/819: chown d4/db/d18/d25/d36/d47/d81/d9c/lac 0 1 2024-09-20T18:36:18.382 INFO:tasks.workunit.client.0.smithi017.stdout:8/706: symlink d0/d6/d28/d3b/d72/d98/da4/lef 0 2024-09-20T18:36:18.384 INFO:tasks.workunit.client.0.smithi017.stdout:7/897: dwrite da/d16/d1c/d40/d34/d96/fd6 [0,4194304] 0 2024-09-20T18:36:18.385 INFO:tasks.workunit.client.0.smithi017.stdout:0/820: unlink d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/f10e 0 2024-09-20T18:36:18.386 INFO:tasks.workunit.client.0.smithi017.stdout:0/821: stat d4/db/dcd/d52/f57 0 2024-09-20T18:36:18.386 INFO:tasks.workunit.client.0.smithi017.stdout:0/822: fsync d4/db/d18/d25/fe5 0 2024-09-20T18:36:18.390 INFO:tasks.workunit.client.0.smithi017.stdout:3/968: rename da/de/d13/d2f/d26/d31/d5a/fe5 to da/de/f146 0 2024-09-20T18:36:18.399 INFO:tasks.workunit.client.0.smithi017.stdout:0/823: mknod d4/db/d18/c114 0 2024-09-20T18:36:18.400 INFO:tasks.workunit.client.0.smithi017.stdout:3/969: mknod da/de/d13/d16/d6e/d82/df8/d121/c147 0 2024-09-20T18:36:18.402 INFO:tasks.workunit.client.0.smithi017.stdout:3/970: chown da/de/d13/d2f/d26/fd6 184053406 1 2024-09-20T18:36:18.404 INFO:tasks.workunit.client.0.smithi017.stdout:0/824: truncate d4/db/f2c 6493748 0 2024-09-20T18:36:18.406 INFO:tasks.workunit.client.0.smithi017.stdout:6/901: dwrite d4/d37/d68/d8d/f9c [0,4194304] 0 2024-09-20T18:36:18.408 INFO:tasks.workunit.client.0.smithi017.stdout:3/971: mknod da/de/d13/d16/d50/dd2/c148 0 2024-09-20T18:36:18.413 INFO:tasks.workunit.client.0.smithi017.stdout:3/972: mkdir da/de/d13/d16/d6e/d97/dc1/dcc/d149 0 2024-09-20T18:36:18.414 INFO:tasks.workunit.client.0.smithi017.stdout:6/902: creat d4/d37/d68/d8d/db2/dd4/dd9/d12b/f132 x:0 0 0 2024-09-20T18:36:18.417 INFO:tasks.workunit.client.0.smithi017.stdout:0/825: rename d4/db/d18/l90 to d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/l115 0 2024-09-20T18:36:18.420 INFO:tasks.workunit.client.0.smithi017.stdout:3/973: rmdir da/de/d13/d16/d6e/ddf/de9 39 2024-09-20T18:36:18.424 INFO:tasks.workunit.client.0.smithi017.stdout:0/826: chown d4/cea 28829 1 2024-09-20T18:36:18.424 INFO:tasks.workunit.client.0.smithi017.stdout:8/707: dwrite d0/f2 [0,4194304] 0 2024-09-20T18:36:18.431 INFO:tasks.workunit.client.0.smithi017.stdout:7/898: dwrite da/d16/d8e/f52 [0,4194304] 0 2024-09-20T18:36:18.432 INFO:tasks.workunit.client.0.smithi017.stdout:7/899: readlink da/d16/d1c/la4 0 2024-09-20T18:36:18.458 INFO:tasks.workunit.client.0.smithi017.stdout:6/903: truncate d4/df/d1f/d25/dca/d127/f79 3206134 0 2024-09-20T18:36:18.459 INFO:tasks.workunit.client.0.smithi017.stdout:6/904: truncate d4/df/ffb 429094 0 2024-09-20T18:36:18.463 INFO:tasks.workunit.client.0.smithi017.stdout:7/900: dread da/d16/d1c/d40/d34/d3c/f48 [0,4194304] 0 2024-09-20T18:36:18.465 INFO:tasks.workunit.client.0.smithi017.stdout:7/901: readlink da/d16/d1c/d40/d5d/da7/lc3 0 2024-09-20T18:36:18.465 INFO:tasks.workunit.client.0.smithi017.stdout:3/974: dwrite da/f15 [8388608,4194304] 0 2024-09-20T18:36:18.470 INFO:tasks.workunit.client.0.smithi017.stdout:8/708: write d0/d6/d28/d3d/d4e/d55/f9a [1095707,130844] 0 2024-09-20T18:36:18.470 INFO:tasks.workunit.client.0.smithi017.stdout:7/902: symlink da/dd2/l113 0 2024-09-20T18:36:18.471 INFO:tasks.workunit.client.0.smithi017.stdout:0/827: dwrite d4/d37/f4d [0,4194304] 0 2024-09-20T18:36:18.474 INFO:tasks.workunit.client.0.smithi017.stdout:3/975: creat da/de/d13/d2f/d26/d31/d5a/d76/d11c/f14a x:0 0 0 2024-09-20T18:36:18.474 INFO:tasks.workunit.client.0.smithi017.stdout:6/905: link d4/df/d4a/l117 d4/d37/d68/d8d/l133 0 2024-09-20T18:36:18.479 INFO:tasks.workunit.client.0.smithi017.stdout:0/828: mkdir d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/d95/d116 0 2024-09-20T18:36:18.480 INFO:tasks.workunit.client.0.smithi017.stdout:3/976: mkdir da/de/d13/d16/d6e/d97/d14b 0 2024-09-20T18:36:18.482 INFO:tasks.workunit.client.0.smithi017.stdout:8/709: dwrite d0/d6/d28/d3b/fe9 [0,4194304] 0 2024-09-20T18:36:18.485 INFO:tasks.workunit.client.0.smithi017.stdout:8/710: write d0/d6/d28/d3d/d4e/d55/d83/fd5 [718721,96688] 0 2024-09-20T18:36:18.489 INFO:tasks.workunit.client.0.smithi017.stdout:3/977: fdatasync da/de/d13/d2f/d26/d31/d5a/d76/f9d 0 2024-09-20T18:36:18.493 INFO:tasks.workunit.client.0.smithi017.stdout:8/711: mknod d0/d65/d8b/db5/dbc/cf0 0 2024-09-20T18:36:18.498 INFO:tasks.workunit.client.0.smithi017.stdout:6/906: link d4/d29/df5/d43/la8 d4/df/d1f/d25/dca/d127/dc2/l134 0 2024-09-20T18:36:18.500 INFO:tasks.workunit.client.0.smithi017.stdout:0/829: rename d4/db/dcd/d52/d77/daf/fc0 to d4/db/d18/d55/d106/f117 0 2024-09-20T18:36:18.501 INFO:tasks.workunit.client.0.smithi017.stdout:3/978: symlink da/de/d13/d16/d6e/d97/dc1/dcc/d149/l14c 0 2024-09-20T18:36:18.502 INFO:tasks.workunit.client.0.smithi017.stdout:0/830: fdatasync d4/db/d18/d25/d36/f65 0 2024-09-20T18:36:18.505 INFO:tasks.workunit.client.0.smithi017.stdout:3/979: readlink da/de/d53/d88/la1 0 2024-09-20T18:36:18.508 INFO:tasks.workunit.client.0.smithi017.stdout:6/907: mkdir d4/d37/d130/d135 0 2024-09-20T18:36:18.509 INFO:tasks.workunit.client.0.smithi017.stdout:3/980: readlink da/de/d13/d2f/d26/l49 0 2024-09-20T18:36:18.510 INFO:tasks.workunit.client.0.smithi017.stdout:3/981: readlink da/de/d13/d2f/d26/l49 0 2024-09-20T18:36:18.513 INFO:tasks.workunit.client.0.smithi017.stdout:3/982: truncate da/de/f8e 2531218 0 2024-09-20T18:36:18.516 INFO:tasks.workunit.client.0.smithi017.stdout:3/983: dread da/de/d13/d2f/d26/d62/da5/da9/dbb/f109 [0,4194304] 0 2024-09-20T18:36:18.526 INFO:tasks.workunit.client.0.smithi017.stdout:6/908: dread d4/df/d4a/fb3 [0,4194304] 0 2024-09-20T18:36:18.541 INFO:tasks.workunit.client.0.smithi017.stdout:6/909: dread d4/d37/d68/da4/d9e/fbc [0,4194304] 0 2024-09-20T18:36:18.546 INFO:tasks.workunit.client.0.smithi017.stdout:6/910: symlink d4/df/l136 0 2024-09-20T18:36:18.547 INFO:tasks.workunit.client.0.smithi017.stdout:6/911: readlink d4/df/l136 0 2024-09-20T18:36:18.548 INFO:tasks.workunit.client.0.smithi017.stdout:7/903: write da/d16/d1c/d40/d3a/f7b [1595645,18392] 0 2024-09-20T18:36:18.550 INFO:tasks.workunit.client.0.smithi017.stdout:7/904: write da/f14 [3918497,5276] 0 2024-09-20T18:36:18.550 INFO:tasks.workunit.client.0.smithi017.stdout:6/912: unlink d4/df/d1f/df6/f104 0 2024-09-20T18:36:18.552 INFO:tasks.workunit.client.0.smithi017.stdout:6/913: fdatasync d4/df/d1f/d25/dca/ffd 0 2024-09-20T18:36:18.553 INFO:tasks.workunit.client.0.smithi017.stdout:6/914: truncate d4/d37/d68/da4/fc3 686423 0 2024-09-20T18:36:18.561 INFO:tasks.workunit.client.0.smithi017.stdout:6/915: dread d4/df/d4a/d8f/fc4 [4194304,4194304] 0 2024-09-20T18:36:18.565 INFO:tasks.workunit.client.0.smithi017.stdout:6/916: creat d4/df/d4a/de6/f137 x:0 0 0 2024-09-20T18:36:18.567 INFO:tasks.workunit.client.0.smithi017.stdout:6/917: chown d4/d37/d68/da4/d9e/cdb 1064 1 2024-09-20T18:36:18.572 INFO:tasks.workunit.client.0.smithi017.stdout:6/918: getdents d4/df/d1f/d25/dca/d127 0 2024-09-20T18:36:18.579 INFO:tasks.workunit.client.0.smithi017.stdout:6/919: link d4/df/d8a/fbe d4/d37/d68/d8d/db2/dd4/dd9/f138 0 2024-09-20T18:36:18.580 INFO:tasks.workunit.client.0.smithi017.stdout:6/920: fsync d4/df/d1f/d25/d3f/d5c/f61 0 2024-09-20T18:36:18.583 INFO:tasks.workunit.client.0.smithi017.stdout:6/921: getdents d4/df/d121 0 2024-09-20T18:36:18.585 INFO:tasks.workunit.client.0.smithi017.stdout:6/922: creat d4/d37/d68/f139 x:0 0 0 2024-09-20T18:36:18.587 INFO:tasks.workunit.client.0.smithi017.stdout:0/831: write d4/db/d18/d25/d36/d47/d8c/daa/dca/db1/fd0 [67311,9322] 0 2024-09-20T18:36:18.588 INFO:tasks.workunit.client.0.smithi017.stdout:6/923: read d4/d29/df5/d43/f78 [83083,104734] 0 2024-09-20T18:36:18.593 INFO:tasks.workunit.client.0.smithi017.stdout:0/832: mknod d4/db/dcd/d52/c118 0 2024-09-20T18:36:18.595 INFO:tasks.workunit.client.0.smithi017.stdout:0/833: chown d4/db/d18/d25/d36/d47/d8c/daa/dca/d66 14526 1 2024-09-20T18:36:18.605 INFO:tasks.workunit.client.0.smithi017.stdout:3/984: dwrite da/de/d13/d16/f10a [0,4194304] 0 2024-09-20T18:36:18.615 INFO:tasks.workunit.client.0.smithi017.stdout:3/985: unlink da/de/d13/fc4 0 2024-09-20T18:36:18.617 INFO:tasks.workunit.client.0.smithi017.stdout:3/986: truncate da/de/d13/d16/f10a 4773542 0 2024-09-20T18:36:18.644 INFO:tasks.workunit.client.0.smithi017.stdout:0/834: truncate d4/db/d18/d55/f72 1919405 0 2024-09-20T18:36:18.647 INFO:tasks.workunit.client.0.smithi017.stdout:6/924: dwrite d4/d37/f6a [0,4194304] 0 2024-09-20T18:36:18.661 INFO:tasks.workunit.client.0.smithi017.stdout:6/925: dwrite d4/d37/d68/da4/fc3 [0,4194304] 0 2024-09-20T18:36:18.666 INFO:tasks.workunit.client.0.smithi017.stdout:0/835: dwrite d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/f7b [0,4194304] 0 2024-09-20T18:36:18.669 INFO:tasks.workunit.client.0.smithi017.stdout:6/926: symlink d4/df/d1f/d25/d3f/l13a 0 2024-09-20T18:36:18.670 INFO:tasks.workunit.client.0.smithi017.stdout:6/927: dread - d4/d37/df4/f11d zero size 2024-09-20T18:36:18.671 INFO:tasks.workunit.client.0.smithi017.stdout:0/836: truncate d4/d20/d63/d86/fb5 934181 0 2024-09-20T18:36:18.673 INFO:tasks.workunit.client.0.smithi017.stdout:0/837: symlink d4/d20/l119 0 2024-09-20T18:36:18.676 INFO:tasks.workunit.client.0.smithi017.stdout:6/928: creat d4/d37/d68/d8d/db2/dd4/f13b x:0 0 0 2024-09-20T18:36:18.679 INFO:tasks.workunit.client.0.smithi017.stdout:0/838: chown d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/l115 13 1 2024-09-20T18:36:18.680 INFO:tasks.workunit.client.0.smithi017.stdout:6/929: truncate d4/d37/d68/fd1 958308 0 2024-09-20T18:36:18.682 INFO:tasks.workunit.client.0.smithi017.stdout:0/839: read d4/db/d18/d25/d36/d47/d81/d9c/fb7 [28314,17834] 0 2024-09-20T18:36:18.683 INFO:tasks.workunit.client.0.smithi017.stdout:6/930: dread - d4/ff0 zero size 2024-09-20T18:36:18.684 INFO:tasks.workunit.client.0.smithi017.stdout:0/840: dread - d4/db/d18/d25/d36/d47/d81/f111 zero size 2024-09-20T18:36:18.684 INFO:tasks.workunit.client.0.smithi017.stdout:0/841: chown d4/c2d 87719 1 2024-09-20T18:36:18.687 INFO:tasks.workunit.client.0.smithi017.stdout:0/842: dread - d4/db/d18/d55/fd9 zero size 2024-09-20T18:36:18.689 INFO:tasks.workunit.client.0.smithi017.stdout:0/843: write d4/db/d18/d25/d36/d47/d8c/daa/dca/db1/fd0 [1104807,68388] 0 2024-09-20T18:36:18.692 INFO:tasks.workunit.client.0.smithi017.stdout:0/844: truncate d4/d20/f2e 217895 0 2024-09-20T18:36:18.702 INFO:tasks.workunit.client.0.smithi017.stdout:0/845: dwrite d4/db/d18/d25/d36/d47/d81/d9c/fb7 [0,4194304] 0 2024-09-20T18:36:18.705 INFO:tasks.workunit.client.0.smithi017.stdout:0/846: write d4/db/d18/d25/d36/d47/d81/d9c/fb7 [1363885,48118] 0 2024-09-20T18:36:18.712 INFO:tasks.workunit.client.0.smithi017.stdout:0/847: creat d4/db/dcd/f11a x:0 0 0 2024-09-20T18:36:18.716 INFO:tasks.workunit.client.0.smithi017.stdout:0/848: symlink d4/db/d18/d25/d36/d47/d8c/daa/dca/d66/l11b 0 2024-09-20T18:36:18.718 INFO:tasks.workunit.client.0.smithi017.stdout:0/849: write d4/d37/f88 [1249279,79516] 0 2024-09-20T18:36:18.737 INFO:tasks.workunit.client.0.smithi017.stdout:0/850: write d4/db/d18/d55/d106/f117 [2014443,123234] 0 2024-09-20T18:36:18.762 INFO:tasks.workunit.client.0.smithi017.stdout:0/851: dwrite d4/f11 [0,4194304] 0 2024-09-20T18:36:18.799 INFO:tasks.workunit.client.0.smithi017.stdout:0/852: getdents d4/db/dcd 0 2024-09-20T18:36:18.812 INFO:tasks.workunit.client.0.smithi017.stdout:0/853: dwrite d4/d20/d63/d86/f9f [0,4194304] 0 2024-09-20T18:36:18.818 INFO:tasks.workunit.client.0.smithi017.stdout:0/854: symlink d4/d37/dfe/l11c 0 2024-09-20T18:36:18.830 INFO:tasks.workunit.client.0.smithi017.stdout:0/855: dwrite d4/db/d18/d25/d36/d47/d8c/daa/dcc/fda [0,4194304] 0 2024-09-20T18:36:18.831 INFO:tasks.workunit.client.0.smithi017.stdout:0/856: chown d4/db/d18/d78/l99 71 1 2024-09-20T18:36:18.837 INFO:tasks.workunit.client.0.smithi017.stdout:0/857: creat d4/db/d18/d25/d36/d47/d81/f11d x:0 0 0 2024-09-20T18:36:18.841 INFO:tasks.workunit.client.0.smithi017.stdout:0/858: link d4/d20/d63/d86/f9f d4/db/d18/d25/d36/d103/f11e 0 2024-09-20T18:36:18.843 INFO:tasks.workunit.client.0.smithi017.stdout:0/859: truncate d4/db/d18/d25/d36/d47/d8c/daa/dca/db1/f10f 408498 0 2024-09-20T18:36:18.846 INFO:tasks.workunit.client.0.smithi017.stdout:0/860: symlink d4/db/dcd/d52/d77/daf/l11f 0 2024-09-20T18:36:18.847 INFO:tasks.workunit.client.0.smithi017.stdout:0/861: write d4/d20/d63/d86/f9f [3814347,8434] 0 2024-09-20T18:36:18.848 INFO:tasks.workunit.client.0.smithi017.stdout:0/862: chown d4/db/d18 104 1 2024-09-20T18:36:18.853 INFO:tasks.workunit.client.0.smithi017.stdout:0/863: dwrite d4/db/dcd/d52/ff1 [0,4194304] 0 2024-09-20T18:36:18.856 INFO:tasks.workunit.client.0.smithi017.stdout:0/864: unlink d4/db/d18/l75 0 2024-09-20T18:36:18.860 INFO:tasks.workunit.client.0.smithi017.stdout:0/865: mknod d4/db/d18/d55/d106/c120 0 2024-09-20T18:36:18.864 INFO:tasks.workunit.client.0.smithi017.stdout:0/866: creat d4/db/d18/d25/d36/d47/d8c/dcb/f121 x:0 0 0 2024-09-20T18:36:18.866 INFO:tasks.workunit.client.0.smithi017.stdout:0/867: chown d4/db/d18/d25/d36/d47/d81/f9b 1 1 2024-09-20T18:36:18.867 INFO:tasks.workunit.client.0.smithi017.stdout:0/868: dread - d4/db/d18/d25/d36/d47/d8c/daa/dca/db1/ffb zero size 2024-09-20T18:36:18.873 INFO:tasks.workunit.client.0.smithi017.stdout:0/869: dwrite d4/db/d18/d25/d36/d47/d8c/dcb/fff [0,4194304] 0 2024-09-20T18:36:18.877 INFO:tasks.workunit.client.0.smithi017.stdout:0/870: symlink d4/l122 0 2024-09-20T18:36:18.882 INFO:tasks.workunit.client.0.smithi017.stdout:0/871: symlink d4/db/d18/d25/d36/d47/d8c/daa/dfd/l123 0 2024-09-20T18:36:18.890 INFO:tasks.workunit.client.0.smithi017.stdout:0/872: write d4/d37/f3a [551272,60182] 0 2024-09-20T18:36:18.894 INFO:tasks.workunit.client.0.smithi017.stdout:0/873: creat d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/ddb/f124 x:0 0 0 2024-09-20T18:36:18.900 INFO:tasks.workunit.client.0.smithi017.stdout:0/874: write d4/db/f62 [2851296,123944] 0 2024-09-20T18:36:18.901 INFO:tasks.workunit.client.0.smithi017.stdout:0/875: fsync d4/db/d18/d25/d36/d103/f11e 0 2024-09-20T18:36:18.902 INFO:tasks.workunit.client.0.smithi017.stdout:0/876: dread - d4/db/dcd/f11a zero size 2024-09-20T18:36:18.903 INFO:tasks.workunit.client.0.smithi017.stdout:0/877: write d4/d68/d8e/fee [263909,47174] 0 2024-09-20T18:36:18.905 INFO:tasks.workunit.client.0.smithi017.stdout:0/878: write d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/fef [719298,39958] 0 2024-09-20T18:36:18.908 INFO:tasks.workunit.client.0.smithi017.stdout:0/879: rename d4/d20/fb9 to d4/d37/f125 0 2024-09-20T18:36:18.909 INFO:tasks.workunit.client.0.smithi017.stdout:0/880: chown d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/l48 12790 1 2024-09-20T18:36:18.911 INFO:tasks.workunit.client.0.smithi017.stdout:0/881: chown d4/db/d18/d25/d36/d47/d81/d9c/lac 36 1 2024-09-20T18:36:18.913 INFO:tasks.workunit.client.0.smithi017.stdout:0/882: read d4/db/d18/d25/d36/d47/d8c/daa/dca/db1/fd0 [824766,63897] 0 2024-09-20T18:36:18.928 INFO:tasks.workunit.client.0.smithi017.stdout:0/883: dread d4/db/d18/d25/d36/d47/d8c/daa/dca/f35 [0,4194304] 0 2024-09-20T18:36:18.931 INFO:tasks.workunit.client.0.smithi017.stdout:0/884: creat d4/db/d18/d25/d36/d47/d8c/f126 x:0 0 0 2024-09-20T18:36:18.932 INFO:tasks.workunit.client.0.smithi017.stdout:0/885: chown d4/db/d18/d25/d36/f65 2 1 2024-09-20T18:36:18.933 INFO:tasks.workunit.client.0.smithi017.stdout:0/886: symlink d4/db/d18/d25/d36/d47/d81/d9c/l127 0 2024-09-20T18:36:18.935 INFO:tasks.workunit.client.0.smithi017.stdout:0/887: creat d4/db/d18/d78/f128 x:0 0 0 2024-09-20T18:36:18.937 INFO:tasks.workunit.client.0.smithi017.stdout:0/888: mknod d4/db/dcd/d52/d77/daf/c129 0 2024-09-20T18:36:18.940 INFO:tasks.workunit.client.0.smithi017.stdout:0/889: dread d4/d20/d63/d86/f9f [0,4194304] 0 2024-09-20T18:36:18.941 INFO:tasks.workunit.client.0.smithi017.stdout:0/890: readlink d4/d20/l89 0 2024-09-20T18:36:18.943 INFO:tasks.workunit.client.0.smithi017.stdout:0/891: fdatasync d4/d20/f2a 0 2024-09-20T18:36:18.947 INFO:tasks.workunit.client.0.smithi017.stdout:0/892: dread d4/db/d18/d25/d36/d47/d8c/daa/dca/f35 [0,4194304] 0 2024-09-20T18:36:19.408 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-20T18:36:19.408 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-20T18:36:19.419 INFO:tasks.workunit.client.0.smithi017.stdout:4/759: sync 2024-09-20T18:36:19.427 INFO:tasks.workunit.client.0.smithi017.stdout:4/760: dwrite d4/d19/d37/d66/fa2 [0,4194304] 0 2024-09-20T18:36:19.433 INFO:tasks.workunit.client.0.smithi017.stdout:4/761: symlink d4/d82/d88/d5c/d8f/da9/db4/db5/lfc 0 2024-09-20T18:36:19.436 INFO:tasks.workunit.client.0.smithi017.stdout:4/762: mknod d4/d82/d88/d5c/cfd 0 2024-09-20T18:36:19.444 INFO:tasks.workunit.client.0.smithi017.stdout:4/763: dread d4/d19/d37/f5a [0,4194304] 0 2024-09-20T18:36:19.445 INFO:tasks.workunit.client.0.smithi017.stdout:4/764: chown d4/d19/d37/da1/d1b/l89 15747 1 2024-09-20T18:36:19.445 INFO:tasks.workunit.client.0.smithi017.stdout:4/765: chown d4/d7f/dc2 969962318 1 2024-09-20T18:36:19.447 INFO:tasks.workunit.client.0.smithi017.stdout:4/766: creat d4/d82/ffe x:0 0 0 2024-09-20T18:36:19.448 INFO:tasks.workunit.client.0.smithi017.stdout:4/767: write d4/d19/f42 [4243379,106435] 0 2024-09-20T18:36:19.460 INFO:tasks.workunit.client.0.smithi017.stdout:4/768: dwrite d4/dc/d1e/f51 [0,4194304] 0 2024-09-20T18:36:19.464 INFO:tasks.workunit.client.0.smithi017.stdout:4/769: link d4/d19/d37/dbc/d7a/fc9 d4/d19/d37/da1/fff 0 2024-09-20T18:36:19.465 INFO:tasks.workunit.client.0.smithi017.stdout:4/770: mknod d4/dc/d1e/d8e/c100 0 2024-09-20T18:36:19.466 INFO:tasks.workunit.client.0.smithi017.stdout:4/771: write d4/f2c [5566566,67675] 0 2024-09-20T18:36:19.468 INFO:tasks.workunit.client.0.smithi017.stdout:4/772: symlink d4/d82/l101 0 2024-09-20T18:36:19.470 INFO:tasks.workunit.client.0.smithi017.stdout:4/773: mkdir d4/d82/d88/d5c/d8f/d102 0 2024-09-20T18:36:19.473 INFO:tasks.workunit.client.0.smithi017.stdout:4/774: truncate d4/d82/d88/d5c/d8f/fd5 606241 0 2024-09-20T18:36:19.483 INFO:tasks.workunit.client.0.smithi017.stdout:4/775: dread d4/d82/fa5 [0,4194304] 0 2024-09-20T18:36:19.498 INFO:tasks.workunit.client.0.smithi017.stdout:9/974: sync 2024-09-20T18:36:19.498 INFO:tasks.workunit.client.0.smithi017.stdout:8/712: sync 2024-09-20T18:36:19.498 INFO:tasks.workunit.client.0.smithi017.stdout:1/901: sync 2024-09-20T18:36:19.498 INFO:tasks.workunit.client.0.smithi017.stdout:4/776: dread d4/d19/d37/da1/d1b/fdd [0,4194304] 0 2024-09-20T18:36:19.500 INFO:tasks.workunit.client.0.smithi017.stdout:8/713: write d0/d65/d8b/db5/fcb [777105,7721] 0 2024-09-20T18:36:19.502 INFO:tasks.workunit.client.0.smithi017.stdout:9/975: creat d6/d11/f155 x:0 0 0 2024-09-20T18:36:19.507 INFO:tasks.workunit.client.0.smithi017.stdout:1/902: dwrite df/d35/f76 [0,4194304] 0 2024-09-20T18:36:19.508 INFO:tasks.workunit.client.0.smithi017.stdout:4/777: rename d4/d19/d37/da1/f4f to d4/d19/d37/da1/d1b/f103 0 2024-09-20T18:36:19.514 INFO:tasks.workunit.client.0.smithi017.stdout:1/903: mkdir df/d16/d50/d53/d120 0 2024-09-20T18:36:19.515 INFO:tasks.workunit.client.0.smithi017.stdout:1/904: dread - df/d3b/f115 zero size 2024-09-20T18:36:19.515 INFO:tasks.workunit.client.0.smithi017.stdout:8/714: truncate d0/d6/d28/d81/fbf 1528796 0 2024-09-20T18:36:19.520 INFO:tasks.workunit.client.0.smithi017.stdout:1/905: mkdir df/d35/d6b/d121 0 2024-09-20T18:36:19.520 INFO:tasks.workunit.client.0.smithi017.stdout:9/976: dwrite d6/d23/d58/d3f/d4d/fed [0,4194304] 0 2024-09-20T18:36:19.522 INFO:tasks.workunit.client.0.smithi017.stdout:4/778: link d4/dc/d1e/d8e/le0 d4/d19/d37/da1/d1b/d56/dfb/l104 0 2024-09-20T18:36:19.525 INFO:tasks.workunit.client.0.smithi017.stdout:9/977: read d6/fec [63040,54335] 0 2024-09-20T18:36:19.526 INFO:tasks.workunit.client.0.smithi017.stdout:8/715: mkdir d0/d6/d28/d3b/df1 0 2024-09-20T18:36:19.530 INFO:tasks.workunit.client.0.smithi017.stdout:8/716: fsync d0/d6/d28/d3d/f4a 0 2024-09-20T18:36:19.534 INFO:tasks.workunit.client.0.smithi017.stdout:9/978: rename d6/d23/d58/d3f/d2f/d98/lb5 to d6/d23/d40/de2/l156 0 2024-09-20T18:36:19.535 INFO:tasks.workunit.client.0.smithi017.stdout:1/906: getdents df/d29/d7e/dde/df7/d10f 0 2024-09-20T18:36:19.537 INFO:tasks.workunit.client.0.smithi017.stdout:8/717: rename d0/d6/d28/d3a/c70 to d0/d6/d28/d3b/d72/cf2 0 2024-09-20T18:36:19.540 INFO:tasks.workunit.client.0.smithi017.stdout:8/718: mknod d0/d6/d28/d3d/d4e/d55/d8a/cf3 0 2024-09-20T18:36:19.542 INFO:tasks.workunit.client.0.smithi017.stdout:1/907: rename df/d35/l88 to df/d35/d6b/dee/l122 0 2024-09-20T18:36:19.543 INFO:tasks.workunit.client.0.smithi017.stdout:1/908: fsync df/d1c/f75 0 2024-09-20T18:36:19.545 INFO:tasks.workunit.client.0.smithi017.stdout:9/979: link d6/d23/d58/d3f/d44/f47 d6/d23/d3a/f157 0 2024-09-20T18:36:19.547 INFO:tasks.workunit.client.0.smithi017.stdout:8/719: dwrite d0/d65/d8b/db5/fcb [0,4194304] 0 2024-09-20T18:36:19.557 INFO:tasks.workunit.client.0.smithi017.stdout:9/980: write d6/d42/f89 [1696551,22480] 0 2024-09-20T18:36:19.557 INFO:tasks.workunit.client.0.smithi017.stdout:8/720: write d0/d6/d28/f29 [1695072,102057] 0 2024-09-20T18:36:19.562 INFO:tasks.workunit.client.0.smithi017.stdout:1/909: dwrite df/d29/f40 [0,4194304] 0 2024-09-20T18:36:19.566 INFO:tasks.workunit.client.0.smithi017.stdout:1/910: mknod df/d29/d7e/dde/c123 0 2024-09-20T18:36:19.566 INFO:tasks.workunit.client.0.smithi017.stdout:8/721: rmdir d0/d6/d28/d3b/d72/dd3 0 2024-09-20T18:36:19.566 INFO:tasks.workunit.client.0.smithi017.stdout:9/981: dread d6/d23/d3a/d61/de7/f13a [0,4194304] 0 2024-09-20T18:36:19.567 INFO:tasks.workunit.client.0.smithi017.stdout:8/722: chown d0/d6/d28/d3b/f53 268 1 2024-09-20T18:36:19.569 INFO:tasks.workunit.client.0.smithi017.stdout:9/982: symlink d6/d23/d3a/d61/l158 0 2024-09-20T18:36:19.577 INFO:tasks.workunit.client.0.smithi017.stdout:1/911: rename df/d35/d6b/dc2 to df/d1c/d80/d124 0 2024-09-20T18:36:19.580 INFO:tasks.workunit.client.0.smithi017.stdout:9/983: rename d6/d23/d3a/f5e to d6/d23/d40/db4/dba/dd7/f159 0 2024-09-20T18:36:19.580 INFO:tasks.workunit.client.0.smithi017.stdout:1/912: write df/d16/d50/d69/fc4 [3275282,39003] 0 2024-09-20T18:36:19.582 INFO:tasks.workunit.client.0.smithi017.stdout:8/723: getdents d0/d6/d28/d3b/d72/d98/da4 0 2024-09-20T18:36:19.584 INFO:tasks.workunit.client.0.smithi017.stdout:1/913: mknod df/d16/d50/d53/d120/c125 0 2024-09-20T18:36:19.592 INFO:tasks.workunit.client.0.smithi017.stdout:9/984: write d6/d23/d58/d3f/d4d/d73/d7d/f85 [2294920,20479] 0 2024-09-20T18:36:19.596 INFO:tasks.workunit.client.0.smithi017.stdout:9/985: creat d6/d23/d58/dda/d137/f15a x:0 0 0 2024-09-20T18:36:19.596 INFO:tasks.workunit.client.0.smithi017.stdout:1/914: write df/d16/d50/d69/f98 [573797,77878] 0 2024-09-20T18:36:19.597 INFO:tasks.workunit.client.0.smithi017.stdout:1/915: chown df/d29/d7e 11057 1 2024-09-20T18:36:19.599 INFO:tasks.workunit.client.0.smithi017.stdout:1/916: write df/d1c/f75 [7620276,82311] 0 2024-09-20T18:36:19.600 INFO:tasks.workunit.client.0.smithi017.stdout:8/724: dwrite d0/d6/d28/d3a/fcd [0,4194304] 0 2024-09-20T18:36:19.601 INFO:tasks.workunit.client.0.smithi017.stdout:1/917: chown df/d16/l89 204 1 2024-09-20T18:36:19.603 INFO:tasks.workunit.client.0.smithi017.stdout:8/725: mkdir d0/d6/d28/d3d/d4e/d55/df4 0 2024-09-20T18:36:19.604 INFO:tasks.workunit.client.0.smithi017.stdout:1/918: chown df/d35/d6b/ffb 5 1 2024-09-20T18:36:19.607 INFO:tasks.workunit.client.0.smithi017.stdout:8/726: rename d0/d6/d28/d3d/d4e/d55/d8a to d0/d6/d28/d3d/d4e/d55/d8a/df5 22 2024-09-20T18:36:19.609 INFO:tasks.workunit.client.0.smithi017.stdout:9/986: dwrite d6/d23/d58/d3f/d70/fb2 [0,4194304] 0 2024-09-20T18:36:19.610 INFO:tasks.workunit.client.0.smithi017.stdout:8/727: dread - d0/d6/fba zero size 2024-09-20T18:36:19.613 INFO:tasks.workunit.client.0.smithi017.stdout:8/728: truncate d0/d6/f54 3319317 0 2024-09-20T18:36:19.617 INFO:tasks.workunit.client.0.smithi017.stdout:9/987: symlink d6/d23/d40/l15b 0 2024-09-20T18:36:19.618 INFO:tasks.workunit.client.0.smithi017.stdout:8/729: dread - d0/d6/d28/d3d/d4e/d55/d83/da2/fd6 zero size 2024-09-20T18:36:19.621 INFO:tasks.workunit.client.0.smithi017.stdout:9/988: mkdir d6/d23/d3a/db8/d15c 0 2024-09-20T18:36:19.621 INFO:tasks.workunit.client.0.smithi017.stdout:1/919: write df/d35/fd3 [5494540,58538] 0 2024-09-20T18:36:19.630 INFO:tasks.workunit.client.0.smithi017.stdout:8/730: write d0/f1e [2021763,88018] 0 2024-09-20T18:36:19.639 INFO:tasks.workunit.client.0.smithi017.stdout:8/731: dread d0/d6/d28/f29 [0,4194304] 0 2024-09-20T18:36:19.640 INFO:tasks.workunit.client.0.smithi017.stdout:9/989: dwrite d6/d23/d40/db4/dba/dd7/f108 [8388608,4194304] 0 2024-09-20T18:36:19.642 INFO:tasks.workunit.client.0.smithi017.stdout:8/732: chown d0/d6/d28/d3d/d4e/fb1 6025150 1 2024-09-20T18:36:19.645 INFO:tasks.workunit.client.0.smithi017.stdout:9/990: mknod d6/d23/d58/d3f/d4d/d100/c15d 0 2024-09-20T18:36:19.645 INFO:tasks.workunit.client.0.smithi017.stdout:8/733: stat d0/d65/d8b/d91/caa 0 2024-09-20T18:36:19.646 INFO:tasks.workunit.client.0.smithi017.stdout:1/920: dread df/d16/f58 [0,4194304] 0 2024-09-20T18:36:19.649 INFO:tasks.workunit.client.0.smithi017.stdout:1/921: mknod df/d16/d50/d69/c126 0 2024-09-20T18:36:19.653 INFO:tasks.workunit.client.0.smithi017.stdout:1/922: symlink df/d1c/l127 0 2024-09-20T18:36:19.655 INFO:tasks.workunit.client.0.smithi017.stdout:1/923: symlink df/d3b/dff/l128 0 2024-09-20T18:36:19.657 INFO:tasks.workunit.client.0.smithi017.stdout:8/734: dread d0/d6/d28/d3a/f49 [0,4194304] 0 2024-09-20T18:36:19.658 INFO:tasks.workunit.client.0.smithi017.stdout:8/735: readlink d0/d6/d28/d3d/d4e/l7a 0 2024-09-20T18:36:19.662 INFO:tasks.workunit.client.0.smithi017.stdout:8/736: mknod d0/d65/d8b/db5/cf6 0 2024-09-20T18:36:19.665 INFO:tasks.workunit.client.0.smithi017.stdout:3/987: sync 2024-09-20T18:36:19.666 INFO:tasks.workunit.client.0.smithi017.stdout:0/893: sync 2024-09-20T18:36:19.666 INFO:tasks.workunit.client.0.smithi017.stdout:6/931: sync 2024-09-20T18:36:19.666 INFO:tasks.workunit.client.0.smithi017.stdout:7/905: sync 2024-09-20T18:36:19.667 INFO:tasks.workunit.client.0.smithi017.stdout:6/932: write d4/f12 [2474648,120879] 0 2024-09-20T18:36:19.668 INFO:tasks.workunit.client.0.smithi017.stdout:8/737: creat d0/d6/d73/ff7 x:0 0 0 2024-09-20T18:36:19.668 INFO:tasks.workunit.client.0.smithi017.stdout:9/991: write d6/d23/d58/d3f/d4d/d73/d93/f123 [167478,32962] 0 2024-09-20T18:36:19.671 INFO:tasks.workunit.client.0.smithi017.stdout:7/906: fsync da/d16/d1c/d40/d3a/f93 0 2024-09-20T18:36:19.674 INFO:tasks.workunit.client.0.smithi017.stdout:6/933: chown d4/d37/l12a 100 1 2024-09-20T18:36:19.675 INFO:tasks.workunit.client.0.smithi017.stdout:3/988: creat da/de/d13/d2f/d26/d41/f14d x:0 0 0 2024-09-20T18:36:19.680 INFO:tasks.workunit.client.0.smithi017.stdout:8/738: dwrite d0/d6/d28/d3b/fe9 [0,4194304] 0 2024-09-20T18:36:19.684 INFO:tasks.workunit.client.0.smithi017.stdout:4/779: sync 2024-09-20T18:36:19.686 INFO:tasks.workunit.client.0.smithi017.stdout:6/934: read d4/df/d4a/d8f/fc4 [1897268,11671] 0 2024-09-20T18:36:19.687 INFO:tasks.workunit.client.0.smithi017.stdout:7/907: mknod da/d16/d8e/c114 0 2024-09-20T18:36:19.688 INFO:tasks.workunit.client.0.smithi017.stdout:1/924: dwrite df/d16/f58 [0,4194304] 0 2024-09-20T18:36:19.691 INFO:tasks.workunit.client.0.smithi017.stdout:1/925: fsync df/d35/d6b/fe4 0 2024-09-20T18:36:19.691 INFO:tasks.workunit.client.0.smithi017.stdout:7/908: fsync da/d16/d1c/d40/d3a/f93 0 2024-09-20T18:36:19.692 INFO:tasks.workunit.client.0.smithi017.stdout:9/992: link d6/d23/lef d6/d23/d58/d3f/d4d/l15e 0 2024-09-20T18:36:19.693 INFO:tasks.workunit.client.0.smithi017.stdout:0/894: getdents d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d69/d109 0 2024-09-20T18:36:19.693 INFO:tasks.workunit.client.0.smithi017.stdout:4/780: mknod d4/d7f/c105 0 2024-09-20T18:36:19.694 INFO:tasks.workunit.client.0.smithi017.stdout:1/926: readlink df/d35/d4f/d82/lf4 0 2024-09-20T18:36:19.695 INFO:tasks.workunit.client.0.smithi017.stdout:3/989: creat da/de/f14e x:0 0 0 2024-09-20T18:36:19.695 INFO:tasks.workunit.client.0.smithi017.stdout:4/781: rename d4 to d4/dc/d1e/d106 22 2024-09-20T18:36:19.698 INFO:tasks.workunit.client.0.smithi017.stdout:0/895: write d4/db/d18/d25/d36/d103/f11e [2489798,51734] 0 2024-09-20T18:36:19.699 INFO:tasks.workunit.client.0.smithi017.stdout:6/935: mkdir d4/df/d1f/d25/dca/d13c 0 2024-09-20T18:36:19.703 INFO:tasks.workunit.client.0.smithi017.stdout:1/927: dread - df/d8f/ffa zero size 2024-09-20T18:36:19.707 INFO:tasks.workunit.client.0.smithi017.stdout:0/896: dwrite d4/d20/d63/d86/f9f [0,4194304] 0 2024-09-20T18:36:19.712 INFO:tasks.workunit.client.0.smithi017.stdout:0/897: truncate d4/db/dcd/f100 1262643 0 2024-09-20T18:36:19.714 INFO:tasks.workunit.client.0.smithi017.stdout:7/909: dwrite da/d16/d92/fab [0,4194304] 0 2024-09-20T18:36:19.716 INFO:tasks.workunit.client.0.smithi017.stdout:9/993: write d6/d23/f2a [764717,119710] 0 2024-09-20T18:36:19.719 INFO:tasks.workunit.client.0.smithi017.stdout:8/739: link d0/d6/d28/d3b/d72/d98/da4/lab d0/d6/d28/d3d/d4e/d55/df4/lf8 0 2024-09-20T18:36:19.722 INFO:tasks.workunit.client.0.smithi017.stdout:8/740: write d0/d6/d28/d3d/d4e/f75 [5094230,32686] 0 2024-09-20T18:36:19.726 INFO:tasks.workunit.client.0.smithi017.stdout:3/990: dwrite da/de/d13/fb9 [0,4194304] 0 2024-09-20T18:36:19.728 INFO:tasks.workunit.client.0.smithi017.stdout:6/936: write d4/d29/df5/d43/fd2 [2980861,65967] 0 2024-09-20T18:36:19.729 INFO:tasks.workunit.client.0.smithi017.stdout:9/994: mkdir d6/d23/d3a/d61/de7/d15f 0 2024-09-20T18:36:19.732 INFO:tasks.workunit.client.0.smithi017.stdout:0/898: mkdir d4/db/d12a 0 2024-09-20T18:36:19.733 INFO:tasks.workunit.client.0.smithi017.stdout:4/782: link d4/d19/d37/da1/d1b/d56/d67/f6e d4/d82/d88/d5c/d8f/da9/db4/db5/f107 0 2024-09-20T18:36:19.740 INFO:tasks.workunit.client.0.smithi017.stdout:1/928: creat df/d16/f129 x:0 0 0 2024-09-20T18:36:19.743 INFO:tasks.workunit.client.0.smithi017.stdout:4/783: symlink d4/d19/d37/da1/d1b/d56/d67/db9/de5/l108 0 2024-09-20T18:36:19.747 INFO:tasks.workunit.client.0.smithi017.stdout:6/937: creat d4/df/d1f/d25/d2b/d115/f13d x:0 0 0 2024-09-20T18:36:19.748 INFO:tasks.workunit.client.0.smithi017.stdout:6/938: read - d4/df/d1f/d25/dca/d127/f102 zero size 2024-09-20T18:36:19.748 INFO:tasks.workunit.client.0.smithi017.stdout:3/991: write da/de/d13/d16/f77 [276766,125192] 0 2024-09-20T18:36:19.749 INFO:tasks.workunit.client.0.smithi017.stdout:1/929: mknod df/d1c/d45/dd9/c12a 0 2024-09-20T18:36:19.750 INFO:tasks.workunit.client.0.smithi017.stdout:6/939: write d4/d37/d68/d8d/db2/dd4/dd9/d12b/f132 [628258,128301] 0 2024-09-20T18:36:19.756 INFO:tasks.workunit.client.0.smithi017.stdout:8/741: getdents d0/d6/d28/d3d/d4e/d55/d8a 0 2024-09-20T18:36:19.757 INFO:tasks.workunit.client.0.smithi017.stdout:1/930: mknod df/d3b/dff/c12b 0 2024-09-20T18:36:19.757 INFO:tasks.workunit.client.0.smithi017.stdout:7/910: dwrite da/dd2/df8/f56 [0,4194304] 0 2024-09-20T18:36:19.764 INFO:tasks.workunit.client.0.smithi017.stdout:3/992: truncate da/de/d13/d2f/d26/d31/d5a/d76/de6/fe8 817467 0 2024-09-20T18:36:19.765 INFO:tasks.workunit.client.0.smithi017.stdout:0/899: truncate d4/db/d18/d25/d36/d47/d8c/daa/dca/db1/fd0 730766 0 2024-09-20T18:36:19.767 INFO:tasks.workunit.client.0.smithi017.stdout:0/900: chown d4/d20/cec 257603 1 2024-09-20T18:36:19.768 INFO:tasks.workunit.client.0.smithi017.stdout:9/995: dwrite d6/d23/d58/dda/ff4 [0,4194304] 0 2024-09-20T18:36:19.782 INFO:tasks.workunit.client.0.smithi017.stdout:6/940: dread d4/df/d1f/d25/d3f/ffa [0,4194304] 0 2024-09-20T18:36:19.786 INFO:tasks.workunit.client.0.smithi017.stdout:8/742: symlink d0/d6/d28/d81/da6/lf9 0 2024-09-20T18:36:19.787 INFO:tasks.workunit.client.0.smithi017.stdout:7/911: truncate da/d16/d1c/d40/d3a/fbf 404307 0 2024-09-20T18:36:19.788 INFO:tasks.workunit.client.0.smithi017.stdout:9/996: chown d6/d23/d3a/db8/l148 1147528 1 2024-09-20T18:36:19.789 INFO:tasks.workunit.client.0.smithi017.stdout:9/997: chown d6/d23/f54 45812 1 2024-09-20T18:36:19.790 INFO:tasks.workunit.client.0.smithi017.stdout:0/901: unlink d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/f6b 0 2024-09-20T18:36:19.793 INFO:tasks.workunit.client.0.smithi017.stdout:6/941: rmdir d4/d29/dc6/de7 39 2024-09-20T18:36:19.793 INFO:tasks.workunit.client.0.smithi017.stdout:6/942: chown d4/d29/df5/d43/f51 13175919 1 2024-09-20T18:36:19.794 INFO:tasks.workunit.client.0.smithi017.stdout:6/943: chown d4/df/d4a/f5d 1356 1 2024-09-20T18:36:19.795 INFO:tasks.workunit.client.0.smithi017.stdout:6/944: write d4/d37/d68/f139 [692058,14427] 0 2024-09-20T18:36:19.796 INFO:tasks.workunit.client.0.smithi017.stdout:3/993: fdatasync da/de/f146 0 2024-09-20T18:36:19.798 INFO:tasks.workunit.client.0.smithi017.stdout:8/743: mkdir d0/d6/d28/d3d/d4e/d55/d8a/dfa 0 2024-09-20T18:36:19.800 INFO:tasks.workunit.client.0.smithi017.stdout:7/912: creat da/d94/f115 x:0 0 0 2024-09-20T18:36:19.801 INFO:tasks.workunit.client.0.smithi017.stdout:6/945: dread d4/d29/df5/f77 [0,4194304] 0 2024-09-20T18:36:19.803 INFO:tasks.workunit.client.0.smithi017.stdout:6/946: chown d4/d37/d68/dbb/fea 0 1 2024-09-20T18:36:19.804 INFO:tasks.workunit.client.0.smithi017.stdout:1/931: write df/d35/d6b/fa9 [1886,84658] 0 2024-09-20T18:36:19.805 INFO:tasks.workunit.client.0.smithi017.stdout:1/932: chown df/d1c/d45/dcc 0 1 2024-09-20T18:36:19.818 INFO:tasks.workunit.client.0.smithi017.stdout:0/902: mkdir d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/d95/d116/d12b 0 2024-09-20T18:36:19.819 INFO:tasks.workunit.client.0.smithi017.stdout:6/947: mkdir d4/d29/df5/d13e 0 2024-09-20T18:36:19.828 INFO:tasks.workunit.client.0.smithi017.stdout:3/994: dwrite da/de/d13/d2f/d26/d62/da5/da9/dbb/f109 [0,4194304] 0 2024-09-20T18:36:19.829 INFO:tasks.workunit.client.0.smithi017.stdout:8/744: dwrite d0/d6/d28/d81/d82/fe1 [0,4194304] 0 2024-09-20T18:36:19.831 INFO:tasks.workunit.client.0.smithi017.stdout:7/913: link da/d16/f3f da/d16/db5/f116 0 2024-09-20T18:36:19.833 INFO:tasks.workunit.client.0.smithi017.stdout:7/914: fsync da/d16/d1c/d40/d5d/f9f 0 2024-09-20T18:36:19.833 INFO:tasks.workunit.client.0.smithi017.stdout:0/903: write d4/db/d18/d25/f7d [1777248,111714] 0 2024-09-20T18:36:19.835 INFO:tasks.workunit.client.0.smithi017.stdout:9/998: dwrite d6/d23/d58/d3f/d70/dfe/d10b/f4f [0,4194304] 0 2024-09-20T18:36:19.836 INFO:tasks.workunit.client.0.smithi017.stdout:7/915: chown da/d16/d1c/d40/d34/dcd 58 1 2024-09-20T18:36:19.836 INFO:tasks.workunit.client.0.smithi017.stdout:9/999: chown d6/d23/d40/fb1 230183 1 2024-09-20T18:36:19.837 INFO:tasks.workunit.client.0.smithi017.stdout:6/948: write d4/df/d4a/f6f [9444006,71074] 0 2024-09-20T18:36:19.838 INFO:tasks.workunit.client.0.smithi017.stdout:1/933: creat df/d29/f12c x:0 0 0 2024-09-20T18:36:19.838 INFO:tasks.workunit.client.0.smithi017.stdout:3/995: mknod da/de/d13/d16/d50/c14f 0 2024-09-20T18:36:19.841 INFO:tasks.workunit.client.0.smithi017.stdout:8/745: creat d0/d6/d28/d3d/d4e/d55/da8/ffb x:0 0 0 2024-09-20T18:36:19.843 INFO:tasks.workunit.client.0.smithi017.stdout:0/904: readlink d4/db/d18/d25/d36/d47/d8c/daa/dca/l34 0 2024-09-20T18:36:19.845 INFO:tasks.workunit.client.0.smithi017.stdout:7/916: creat da/d16/d8e/d75/f117 x:0 0 0 2024-09-20T18:36:19.850 INFO:tasks.workunit.client.0.smithi017.stdout:0/905: mkdir d4/db/d18/d25/d36/d47/d81/d9c/d12c 0 2024-09-20T18:36:19.850 INFO:tasks.workunit.client.0.smithi017.stdout:8/746: read d0/d6/f21 [627729,59464] 0 2024-09-20T18:36:19.857 INFO:tasks.workunit.client.0.smithi017.stdout:7/917: mknod da/d16/d1c/d40/d34/c118 0 2024-09-20T18:36:19.863 INFO:tasks.workunit.client.0.smithi017.stdout:3/996: link da/de/d53/d52/f107 da/de/d53/d88/db3/f150 0 2024-09-20T18:36:19.866 INFO:tasks.workunit.client.0.smithi017.stdout:7/918: unlink da/d16/de2/fe7 0 2024-09-20T18:36:19.868 INFO:tasks.workunit.client.0.smithi017.stdout:1/934: dwrite df/d16/d50/d53/f67 [0,4194304] 0 2024-09-20T18:36:19.873 INFO:tasks.workunit.client.0.smithi017.stdout:1/935: chown df/d1c/d80/lae 1235572 1 2024-09-20T18:36:19.877 INFO:tasks.workunit.client.0.smithi017.stdout:1/936: write df/d16/d50/d69/d62/da7/fe8 [265670,57998] 0 2024-09-20T18:36:19.877 INFO:tasks.workunit.client.0.smithi017.stdout:8/747: dwrite d0/d6/d73/f8e [0,4194304] 0 2024-09-20T18:36:19.878 INFO:tasks.workunit.client.0.smithi017.stdout:0/906: rename d4/db/d18/d55/fc4 to d4/db/d18/d25/d36/d47/f12d 0 2024-09-20T18:36:19.884 INFO:tasks.workunit.client.0.smithi017.stdout:1/937: creat df/d1c/d80/d124/f12d x:0 0 0 2024-09-20T18:36:19.885 INFO:tasks.workunit.client.0.smithi017.stdout:0/907: rmdir d4/db/dcd 39 2024-09-20T18:36:19.885 INFO:tasks.workunit.client.0.smithi017.stdout:3/997: dwrite da/de/d13/d2f/d26/d41/f130 [0,4194304] 0 2024-09-20T18:36:19.887 INFO:tasks.workunit.client.0.smithi017.stdout:3/998: stat da/de/d53/d88/db3/dd3/c122 0 2024-09-20T18:36:19.887 INFO:tasks.workunit.client.0.smithi017.stdout:8/748: creat d0/d6/d28/d3d/d4e/ffc x:0 0 0 2024-09-20T18:36:19.889 INFO:tasks.workunit.client.0.smithi017.stdout:7/919: link da/d16/d8e/d75/l2f da/l119 0 2024-09-20T18:36:19.895 INFO:tasks.workunit.client.0.smithi017.stdout:1/938: mkdir df/d35/d6b/dee/d12e 0 2024-09-20T18:36:19.896 INFO:tasks.workunit.client.0.smithi017.stdout:8/749: mknod d0/d65/d8b/db5/dbc/cfd 0 2024-09-20T18:36:19.897 INFO:tasks.workunit.client.0.smithi017.stdout:7/920: symlink da/d16/d1c/d40/d34/d3c/l11a 0 2024-09-20T18:36:19.897 INFO:tasks.workunit.client.0.smithi017.stdout:8/750: chown d0/d6/d28/d3a/ca3 8 1 2024-09-20T18:36:20.013 INFO:tasks.workunit.client.0.smithi017.stdout:3/999: getdents da/de/d53/d52/dfb 0 2024-09-20T18:36:20.016 INFO:tasks.workunit.client.0.smithi017.stdout:0/908: dwrite d4/f8 [0,4194304] 0 2024-09-20T18:36:20.069 INFO:tasks.workunit.client.0.smithi017.stdout:8/751: creat d0/d6/d28/d3d/d4e/d55/ffe x:0 0 0 2024-09-20T18:36:20.071 INFO:tasks.workunit.client.0.smithi017.stdout:1/939: rmdir df/d16/dfe 0 2024-09-20T18:36:20.073 INFO:tasks.workunit.client.0.smithi017.stdout:0/909: truncate d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/f4b 387177 0 2024-09-20T18:36:20.074 INFO:tasks.workunit.client.0.smithi017.stdout:8/752: chown d0/d6/d28/d3d/d4e/d55/d83/cb3 2980812 1 2024-09-20T18:36:20.078 INFO:tasks.workunit.client.0.smithi017.stdout:7/921: dwrite da/d16/d1c/d40/d3a/f45 [0,4194304] 0 2024-09-20T18:36:20.080 INFO:tasks.workunit.client.0.smithi017.stdout:0/910: mknod d4/db/dcd/d52/c12e 0 2024-09-20T18:36:20.084 INFO:tasks.workunit.client.0.smithi017.stdout:7/922: creat da/d16/d1c/d40/d3a/d8a/f11b x:0 0 0 2024-09-20T18:36:20.087 INFO:tasks.workunit.client.0.smithi017.stdout:0/911: creat d4/d37/dfe/f12f x:0 0 0 2024-09-20T18:36:20.089 INFO:tasks.workunit.client.0.smithi017.stdout:1/940: dwrite df/d8f/fbc [0,4194304] 0 2024-09-20T18:36:20.089 INFO:tasks.workunit.client.0.smithi017.stdout:0/912: chown d4/db/d18/d25/d36/d47/d8c/dcb/l10a 0 1 2024-09-20T18:36:20.090 INFO:tasks.workunit.client.0.smithi017.stdout:1/941: dread - df/d16/f129 zero size 2024-09-20T18:36:20.095 INFO:tasks.workunit.client.0.smithi017.stdout:1/942: symlink df/d35/l12f 0 2024-09-20T18:36:20.095 INFO:tasks.workunit.client.0.smithi017.stdout:1/943: stat c7 0 2024-09-20T18:36:20.096 INFO:tasks.workunit.client.0.smithi017.stdout:0/913: truncate d4/d20/f6c 524047 0 2024-09-20T18:36:20.098 INFO:tasks.workunit.client.0.smithi017.stdout:7/923: creat da/d16/d1c/f11c x:0 0 0 2024-09-20T18:36:20.101 INFO:tasks.workunit.client.0.smithi017.stdout:8/753: truncate d0/d6/d28/d3d/d4e/d55/f9a 510490 0 2024-09-20T18:36:20.103 INFO:tasks.workunit.client.0.smithi017.stdout:7/924: chown da/lf9 1520403 1 2024-09-20T18:36:20.105 INFO:tasks.workunit.client.0.smithi017.stdout:8/754: mknod d0/d6/d28/d3b/d72/d98/da4/cff 0 2024-09-20T18:36:20.106 INFO:tasks.workunit.client.0.smithi017.stdout:0/914: truncate d4/db/d18/f19 1109722 0 2024-09-20T18:36:20.106 INFO:tasks.workunit.client.0.smithi017.stdout:7/925: rmdir da 39 2024-09-20T18:36:20.108 INFO:tasks.workunit.client.0.smithi017.stdout:8/755: dread - d0/d65/d8b/db4/fc9 zero size 2024-09-20T18:36:20.109 INFO:tasks.workunit.client.0.smithi017.stdout:7/926: readlink da/d16/d1c/dc9/l10e 0 2024-09-20T18:36:20.113 INFO:tasks.workunit.client.0.smithi017.stdout:8/756: creat d0/d65/d8b/d91/f100 x:0 0 0 2024-09-20T18:36:20.115 INFO:tasks.workunit.client.0.smithi017.stdout:7/927: rmdir da/d16/d8e 39 2024-09-20T18:36:20.117 INFO:tasks.workunit.client.0.smithi017.stdout:1/944: dwrite df/d1c/d80/d124/fe9 [0,4194304] 0 2024-09-20T18:36:20.117 INFO:tasks.workunit.client.0.smithi017.stdout:7/928: chown da/d16/d1c/d40/d5d/da7 2 1 2024-09-20T18:36:20.125 INFO:tasks.workunit.client.0.smithi017.stdout:1/945: creat df/d35/d4f/d82/dac/f130 x:0 0 0 2024-09-20T18:36:20.125 INFO:tasks.workunit.client.0.smithi017.stdout:0/915: dwrite d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/f30 [0,4194304] 0 2024-09-20T18:36:20.129 INFO:tasks.workunit.client.0.smithi017.stdout:8/757: write d0/d6/d28/f4f [202953,87732] 0 2024-09-20T18:36:20.130 INFO:tasks.workunit.client.0.smithi017.stdout:8/758: read d0/d6/d28/d3a/f49 [152703,76076] 0 2024-09-20T18:36:20.133 INFO:tasks.workunit.client.0.smithi017.stdout:8/759: dread d0/d6/d28/d3a/fa7 [0,4194304] 0 2024-09-20T18:36:20.134 INFO:tasks.workunit.client.0.smithi017.stdout:7/929: getdents da/d16/d1c/d40/d34/d106/d10d/de8/d108 0 2024-09-20T18:36:20.139 INFO:tasks.workunit.client.0.smithi017.stdout:0/916: symlink d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/d95/d116/d12b/l130 0 2024-09-20T18:36:20.141 INFO:tasks.workunit.client.0.smithi017.stdout:0/917: chown d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/f4b 3 1 2024-09-20T18:36:20.142 INFO:tasks.workunit.client.0.smithi017.stdout:7/930: dread da/d16/d1c/d40/d3a/fbf [0,4194304] 0 2024-09-20T18:36:20.143 INFO:tasks.workunit.client.0.smithi017.stdout:7/931: write da/d16/d1c/d40/d3a/d8a/f11b [730445,32797] 0 2024-09-20T18:36:20.146 INFO:tasks.workunit.client.0.smithi017.stdout:8/760: write d0/d6/d28/d3d/fce [270137,13395] 0 2024-09-20T18:36:20.147 INFO:tasks.workunit.client.0.smithi017.stdout:7/932: fdatasync da/d16/d1c/d40/d5d/da7/de5/d102/f110 0 2024-09-20T18:36:20.149 INFO:tasks.workunit.client.0.smithi017.stdout:0/918: write d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/f84 [39049,85158] 0 2024-09-20T18:36:20.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:19 smithi017 ceph-mon[28058]: pgmap v44: 65 pgs: 65 active+clean; 2.4 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 47 MiB/s rd, 111 MiB/s wr, 353 op/s 2024-09-20T18:36:20.150 INFO:tasks.workunit.client.0.smithi017.stdout:8/761: dread - d0/d6/d28/d3d/d4e/d55/da8/ffb zero size 2024-09-20T18:36:20.151 INFO:tasks.workunit.client.0.smithi017.stdout:1/946: dwrite df/d1c/d79/fd1 [0,4194304] 0 2024-09-20T18:36:20.151 INFO:tasks.workunit.client.0.smithi017.stdout:7/933: fsync da/d16/d1c/d40/d3a/d8a/fee 0 2024-09-20T18:36:20.159 INFO:tasks.workunit.client.0.smithi017.stdout:1/947: dread df/d1c/d45/f6e [0,4194304] 0 2024-09-20T18:36:20.160 INFO:tasks.workunit.client.0.smithi017.stdout:0/919: symlink d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/d95/d116/l131 0 2024-09-20T18:36:20.161 INFO:tasks.workunit.client.0.smithi017.stdout:8/762: mkdir d0/d6/d28/d3d/d4e/d55/df4/d101 0 2024-09-20T18:36:20.161 INFO:tasks.workunit.client.0.smithi017.stdout:0/920: write d4/db/dcd/fed [4176931,126357] 0 2024-09-20T18:36:20.162 INFO:tasks.workunit.client.0.smithi017.stdout:0/921: dread - d4/db/dcd/ff0 zero size 2024-09-20T18:36:20.165 INFO:tasks.workunit.client.0.smithi017.stdout:7/934: getdents da/d16/d8e 0 2024-09-20T18:36:20.166 INFO:tasks.workunit.client.0.smithi017.stdout:1/948: read df/d1c/d45/fd8 [1929302,113788] 0 2024-09-20T18:36:20.170 INFO:tasks.workunit.client.0.smithi017.stdout:8/763: dwrite d0/d65/d8b/db4/feb [0,4194304] 0 2024-09-20T18:36:20.171 INFO:tasks.workunit.client.0.smithi017.stdout:8/764: dread - d0/d6/d28/d3d/d4e/d55/ffe zero size 2024-09-20T18:36:20.178 INFO:tasks.workunit.client.0.smithi017.stdout:8/765: fdatasync d0/d6/d28/d3d/d4e/fb1 0 2024-09-20T18:36:20.181 INFO:tasks.workunit.client.0.smithi017.stdout:1/949: creat df/d35/d4f/f131 x:0 0 0 2024-09-20T18:36:20.182 INFO:tasks.workunit.client.0.smithi017.stdout:7/935: link da/d16/de2/ded/f101 da/d16/db5/f11d 0 2024-09-20T18:36:20.185 INFO:tasks.workunit.client.0.smithi017.stdout:8/766: truncate d0/d6/d28/d3d/d4e/f51 3766575 0 2024-09-20T18:36:20.185 INFO:tasks.workunit.client.0.smithi017.stdout:0/922: getdents d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/d95/d116 0 2024-09-20T18:36:20.188 INFO:tasks.workunit.client.0.smithi017.stdout:7/936: creat da/d16/d8e/f11e x:0 0 0 2024-09-20T18:36:20.189 INFO:tasks.workunit.client.0.smithi017.stdout:8/767: unlink d0/d6/fba 0 2024-09-20T18:36:20.190 INFO:tasks.workunit.client.0.smithi017.stdout:8/768: fsync d0/d65/d8b/db5/fcb 0 2024-09-20T18:36:20.191 INFO:tasks.workunit.client.0.smithi017.stdout:0/923: creat d4/db/d18/d55/d106/f132 x:0 0 0 2024-09-20T18:36:20.192 INFO:tasks.workunit.client.0.smithi017.stdout:1/950: creat df/d1c/d80/da0/f132 x:0 0 0 2024-09-20T18:36:20.194 INFO:tasks.workunit.client.0.smithi017.stdout:7/937: fdatasync da/d16/d1c/d40/d3a/d8a/f10c 0 2024-09-20T18:36:20.199 INFO:tasks.workunit.client.0.smithi017.stdout:7/938: fsync da/d16/d1c/f82 0 2024-09-20T18:36:20.201 INFO:tasks.workunit.client.0.smithi017.stdout:6/949: sync 2024-09-20T18:36:20.201 INFO:tasks.workunit.client.0.smithi017.stdout:4/784: sync 2024-09-20T18:36:20.203 INFO:tasks.workunit.client.0.smithi017.stdout:8/769: dwrite d0/d6/d28/d3d/d4e/d55/d83/fd5 [0,4194304] 0 2024-09-20T18:36:20.205 INFO:tasks.workunit.client.0.smithi017.stdout:4/785: chown d4/dc/def 9517 1 2024-09-20T18:36:20.205 INFO:tasks.workunit.client.0.smithi017.stdout:7/939: chown da/d16/d1c/dc9/f10f 215 1 2024-09-20T18:36:20.208 INFO:tasks.workunit.client.0.smithi017.stdout:0/924: dwrite d4/db/d18/d25/f7d [4194304,4194304] 0 2024-09-20T18:36:20.208 INFO:tasks.workunit.client.0.smithi017.stdout:6/950: creat d4/df/d4a/d8f/f13f x:0 0 0 2024-09-20T18:36:20.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:19 smithi172 ceph-mon[35456]: pgmap v44: 65 pgs: 65 active+clean; 2.4 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 47 MiB/s rd, 111 MiB/s wr, 353 op/s 2024-09-20T18:36:20.211 INFO:tasks.workunit.client.0.smithi017.stdout:7/940: stat da/d16/d1c/d40/d34/l57 0 2024-09-20T18:36:20.211 INFO:tasks.workunit.client.0.smithi017.stdout:6/951: stat d4/fd 0 2024-09-20T18:36:20.217 INFO:tasks.workunit.client.0.smithi017.stdout:0/925: dwrite d4/f11 [0,4194304] 0 2024-09-20T18:36:20.224 INFO:tasks.workunit.client.0.smithi017.stdout:4/786: creat d4/d19/d37/da1/d1b/daa/f109 x:0 0 0 2024-09-20T18:36:20.225 INFO:tasks.workunit.client.0.smithi017.stdout:1/951: dread df/d35/fd3 [0,4194304] 0 2024-09-20T18:36:20.230 INFO:tasks.workunit.client.0.smithi017.stdout:0/926: symlink d4/d20/l133 0 2024-09-20T18:36:20.232 INFO:tasks.workunit.client.0.smithi017.stdout:8/770: write d0/d6/d28/d3d/d4e/d55/fcc [92562,81054] 0 2024-09-20T18:36:20.233 INFO:tasks.workunit.client.0.smithi017.stdout:0/927: fdatasync d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/ddb/f124 0 2024-09-20T18:36:20.234 INFO:tasks.workunit.client.0.smithi017.stdout:0/928: dread - d4/d20/d63/d86/fa6 zero size 2024-09-20T18:36:20.237 INFO:tasks.workunit.client.0.smithi017.stdout:4/787: mkdir d4/dc/def/d10a 0 2024-09-20T18:36:20.237 INFO:tasks.workunit.client.0.smithi017.stdout:4/788: chown f3 856638841 1 2024-09-20T18:36:20.238 INFO:tasks.workunit.client.0.smithi017.stdout:8/771: rmdir d0/d6/d28/d3d/d4e/d55 39 2024-09-20T18:36:20.239 INFO:tasks.workunit.client.0.smithi017.stdout:8/772: chown d0/d6/d73/l7b 309152 1 2024-09-20T18:36:20.240 INFO:tasks.workunit.client.0.smithi017.stdout:1/952: rename df/f24 to df/d1c/d45/dd9/f133 0 2024-09-20T18:36:20.240 INFO:tasks.workunit.client.0.smithi017.stdout:4/789: stat d4/d19/d37/da1/d1b/d56/d67/db9/de5/l108 0 2024-09-20T18:36:20.240 INFO:tasks.workunit.client.0.smithi017.stdout:0/929: truncate d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/fd1 5142607 0 2024-09-20T18:36:20.243 INFO:tasks.workunit.client.0.smithi017.stdout:4/790: read d4/dc/d41/fbd [595610,45573] 0 2024-09-20T18:36:20.246 INFO:tasks.workunit.client.0.smithi017.stdout:6/952: dread d4/d29/dc6/de7/ff9 [0,4194304] 0 2024-09-20T18:36:20.246 INFO:tasks.workunit.client.0.smithi017.stdout:1/953: creat df/d29/f134 x:0 0 0 2024-09-20T18:36:20.246 INFO:tasks.workunit.client.0.smithi017.stdout:0/930: mknod d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d101/c134 0 2024-09-20T18:36:20.247 INFO:tasks.workunit.client.0.smithi017.stdout:4/791: mknod d4/dc/d1e/d26/c10b 0 2024-09-20T18:36:20.248 INFO:tasks.workunit.client.0.smithi017.stdout:0/931: dread - d4/db/d18/d25/d36/d47/d8c/f126 zero size 2024-09-20T18:36:20.249 INFO:tasks.workunit.client.0.smithi017.stdout:6/953: creat d4/d37/d130/f140 x:0 0 0 2024-09-20T18:36:20.249 INFO:tasks.workunit.client.0.smithi017.stdout:1/954: creat df/d16/d50/d69/d62/df8/f135 x:0 0 0 2024-09-20T18:36:20.253 INFO:tasks.workunit.client.0.smithi017.stdout:1/955: symlink df/d16/d50/d69/da5/l136 0 2024-09-20T18:36:20.254 INFO:tasks.workunit.client.0.smithi017.stdout:4/792: creat d4/d19/d37/da1/d1b/f10c x:0 0 0 2024-09-20T18:36:20.256 INFO:tasks.workunit.client.0.smithi017.stdout:1/956: truncate df/d29/f106 666893 0 2024-09-20T18:36:20.260 INFO:tasks.workunit.client.0.smithi017.stdout:1/957: unlink c7 0 2024-09-20T18:36:20.262 INFO:tasks.workunit.client.0.smithi017.stdout:1/958: dread - df/d16/d50/fe5 zero size 2024-09-20T18:36:20.266 INFO:tasks.workunit.client.0.smithi017.stdout:1/959: rename df/d16/d50/d69/da5/fe3 to df/d35/d6b/f137 0 2024-09-20T18:36:20.268 INFO:tasks.workunit.client.0.smithi017.stdout:1/960: mknod df/d29/d7e/dde/df7/d10f/c138 0 2024-09-20T18:36:20.271 INFO:tasks.workunit.client.0.smithi017.stdout:0/932: dwrite d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/f87 [0,4194304] 0 2024-09-20T18:36:20.276 INFO:tasks.workunit.client.0.smithi017.stdout:1/961: dread df/d35/d6b/f137 [0,4194304] 0 2024-09-20T18:36:20.278 INFO:tasks.workunit.client.0.smithi017.stdout:1/962: write df/d1c/d80/d124/f12d [991812,64681] 0 2024-09-20T18:36:20.285 INFO:tasks.workunit.client.0.smithi017.stdout:1/963: rename df/d16/l19 to df/d35/daa/l139 0 2024-09-20T18:36:20.290 INFO:tasks.workunit.client.0.smithi017.stdout:1/964: mkdir df/d1c/d80/d13a 0 2024-09-20T18:36:20.290 INFO:tasks.workunit.client.0.smithi017.stdout:0/933: truncate d4/db/d18/d25/f7f 1907 0 2024-09-20T18:36:20.292 INFO:tasks.workunit.client.0.smithi017.stdout:1/965: mknod df/d29/d2c/d5b/c13b 0 2024-09-20T18:36:20.295 INFO:tasks.workunit.client.0.smithi017.stdout:0/934: unlink d4/db/d18/d25/f7d 0 2024-09-20T18:36:20.296 INFO:tasks.workunit.client.0.smithi017.stdout:1/966: truncate df/d29/d7e/dde/df7/ff9 792622 0 2024-09-20T18:36:20.297 INFO:tasks.workunit.client.0.smithi017.stdout:1/967: chown df/d35/d4f/d82/lf4 505157460 1 2024-09-20T18:36:20.298 INFO:tasks.workunit.client.0.smithi017.stdout:0/935: rmdir d4/db/d18/d55/d106 39 2024-09-20T18:36:20.298 INFO:tasks.workunit.client.0.smithi017.stdout:1/968: write df/d16/d50/dab/fc3 [3930109,52040] 0 2024-09-20T18:36:20.301 INFO:tasks.workunit.client.0.smithi017.stdout:0/936: rename d4/d37/dd2 to d4/d68/d135 0 2024-09-20T18:36:20.302 INFO:tasks.workunit.client.0.smithi017.stdout:1/969: truncate df/d16/fb6 3163901 0 2024-09-20T18:36:20.304 INFO:tasks.workunit.client.0.smithi017.stdout:0/937: creat d4/db/d18/d25/d36/d103/f136 x:0 0 0 2024-09-20T18:36:20.309 INFO:tasks.workunit.client.0.smithi017.stdout:1/970: creat df/d1c/d80/f13c x:0 0 0 2024-09-20T18:36:20.310 INFO:tasks.workunit.client.0.smithi017.stdout:1/971: chown df/d16/d50/d69/d97 82 1 2024-09-20T18:36:20.310 INFO:tasks.workunit.client.0.smithi017.stdout:1/972: chown df/d1c/d45/f57 3 1 2024-09-20T18:36:20.312 INFO:tasks.workunit.client.0.smithi017.stdout:1/973: dread - df/d3b/d7c/fe6 zero size 2024-09-20T18:36:20.321 INFO:tasks.workunit.client.0.smithi017.stdout:0/938: dwrite d4/db/d18/d25/d36/f98 [0,4194304] 0 2024-09-20T18:36:20.325 INFO:tasks.workunit.client.0.smithi017.stdout:0/939: rmdir d4/db/d18/d25/d36/d47/d8c/daa/dca/d42 39 2024-09-20T18:36:20.327 INFO:tasks.workunit.client.0.smithi017.stdout:1/974: dwrite df/d16/f63 [8388608,4194304] 0 2024-09-20T18:36:20.331 INFO:tasks.workunit.client.0.smithi017.stdout:0/940: truncate d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/fef 1061455 0 2024-09-20T18:36:20.333 INFO:tasks.workunit.client.0.smithi017.stdout:1/975: rename df/d1c/fdb to df/d1c/d80/d124/f13d 0 2024-09-20T18:36:20.334 INFO:tasks.workunit.client.0.smithi017.stdout:1/976: fsync f2 0 2024-09-20T18:36:20.338 INFO:tasks.workunit.client.0.smithi017.stdout:1/977: dread df/d8f/fbc [0,4194304] 0 2024-09-20T18:36:20.340 INFO:tasks.workunit.client.0.smithi017.stdout:0/941: creat d4/db/d18/d25/d36/d47/d8c/daa/dca/f137 x:0 0 0 2024-09-20T18:36:20.341 INFO:tasks.workunit.client.0.smithi017.stdout:0/942: write d4/d37/f88 [2086077,55857] 0 2024-09-20T18:36:20.348 INFO:tasks.workunit.client.0.smithi017.stdout:0/943: dwrite d4/db/d18/d25/d36/d47/d8c/daa/dca/f137 [0,4194304] 0 2024-09-20T18:36:20.350 INFO:tasks.workunit.client.0.smithi017.stdout:0/944: readlink d4/db/d18/d25/d36/d47/d81/la5 0 2024-09-20T18:36:20.354 INFO:tasks.workunit.client.0.smithi017.stdout:1/978: write df/d35/fb1 [423695,58235] 0 2024-09-20T18:36:20.362 INFO:tasks.workunit.client.0.smithi017.stdout:1/979: creat df/f13e x:0 0 0 2024-09-20T18:36:20.364 INFO:tasks.workunit.client.0.smithi017.stdout:0/945: dread d4/d68/d8e/fee [0,4194304] 0 2024-09-20T18:36:20.374 INFO:tasks.workunit.client.0.smithi017.stdout:0/946: link d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/f87 d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/d95/d116/f138 0 2024-09-20T18:36:20.376 INFO:tasks.workunit.client.0.smithi017.stdout:0/947: chown d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/d95/fe9 664 1 2024-09-20T18:36:20.377 INFO:tasks.workunit.client.0.smithi017.stdout:0/948: readlink d4/d68/d135/ldc 0 2024-09-20T18:36:20.377 INFO:tasks.workunit.client.0.smithi017.stdout:1/980: dread df/d3b/dff/f110 [0,4194304] 0 2024-09-20T18:36:20.382 INFO:tasks.workunit.client.0.smithi017.stdout:0/949: rename d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/f4b to d4/db/d18/d25/d36/d47/d81/d9c/f139 0 2024-09-20T18:36:20.382 INFO:tasks.workunit.client.0.smithi017.stdout:0/950: stat d4/db/dcd/d52/f56 0 2024-09-20T18:36:20.383 INFO:tasks.workunit.client.0.smithi017.stdout:1/981: dread df/d16/d50/dab/fbb [0,4194304] 0 2024-09-20T18:36:20.383 INFO:tasks.workunit.client.0.smithi017.stdout:1/982: chown df/d16/d50/d69/d97/d113 154362201 1 2024-09-20T18:36:20.389 INFO:tasks.workunit.client.0.smithi017.stdout:0/951: getdents d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/ddb 0 2024-09-20T18:36:20.390 INFO:tasks.workunit.client.0.smithi017.stdout:1/983: dwrite df/d16/d50/dab/fc3 [0,4194304] 0 2024-09-20T18:36:20.392 INFO:tasks.workunit.client.0.smithi017.stdout:1/984: truncate df/d29/d2c/d5b/fb9 2000120 0 2024-09-20T18:36:20.397 INFO:tasks.workunit.client.0.smithi017.stdout:0/952: rename d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/f67 to d4/db/d18/d25/d36/f13a 0 2024-09-20T18:36:20.400 INFO:tasks.workunit.client.0.smithi017.stdout:0/953: rmdir d4/d68/d8e 39 2024-09-20T18:36:20.405 INFO:tasks.workunit.client.0.smithi017.stdout:1/985: dread df/d35/fd2 [0,4194304] 0 2024-09-20T18:36:20.410 INFO:tasks.workunit.client.0.smithi017.stdout:1/986: mkdir df/d16/d50/d53/d120/d13f 0 2024-09-20T18:36:20.429 INFO:tasks.workunit.client.0.smithi017.stdout:0/954: dread d4/d37/fae [0,4194304] 0 2024-09-20T18:36:20.429 INFO:tasks.workunit.client.0.smithi017.stdout:1/987: dread df/d1c/d45/f57 [0,4194304] 0 2024-09-20T18:36:20.434 INFO:tasks.workunit.client.0.smithi017.stdout:0/955: mknod d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d69/c13b 0 2024-09-20T18:36:20.436 INFO:tasks.workunit.client.0.smithi017.stdout:0/956: truncate d4/db/d18/d55/d106/f117 4668490 0 2024-09-20T18:36:20.438 INFO:tasks.workunit.client.0.smithi017.stdout:0/957: dread - d4/db/d18/d78/fd6 zero size 2024-09-20T18:36:20.449 INFO:tasks.workunit.client.0.smithi017.stdout:1/988: dread df/f1a [0,4194304] 0 2024-09-20T18:36:20.487 INFO:tasks.workunit.client.0.smithi017.stdout:0/958: chown d4/d20/d63/d86/fb5 554 1 2024-09-20T18:36:20.490 INFO:tasks.workunit.client.0.smithi017.stdout:1/989: unlink df/d1c/f1e 0 2024-09-20T18:36:20.491 INFO:tasks.workunit.client.0.smithi017.stdout:1/990: fsync df/d35/d6b/fe4 0 2024-09-20T18:36:20.492 INFO:tasks.workunit.client.0.smithi017.stdout:1/991: stat df/d16/d50/d69/d62/df8/f135 0 2024-09-20T18:36:20.500 INFO:tasks.workunit.client.0.smithi017.stdout:1/992: dwrite df/d1c/f3c [4194304,4194304] 0 2024-09-20T18:36:20.501 INFO:tasks.workunit.client.0.smithi017.stdout:1/993: readlink df/d29/d7e/lbd 0 2024-09-20T18:36:20.504 INFO:tasks.workunit.client.0.smithi017.stdout:1/994: dread - df/d35/daa/fdd zero size 2024-09-20T18:36:20.506 INFO:tasks.workunit.client.0.smithi017.stdout:1/995: truncate df/d29/d2c/f92 1091561 0 2024-09-20T18:36:20.509 INFO:tasks.workunit.client.0.smithi017.stdout:0/959: dwrite d4/db/f2c [0,4194304] 0 2024-09-20T18:36:20.511 INFO:tasks.workunit.client.0.smithi017.stdout:1/996: fdatasync fc 0 2024-09-20T18:36:20.511 INFO:tasks.workunit.client.0.smithi017.stdout:0/960: readlink d4/lc2 0 2024-09-20T18:36:20.518 INFO:tasks.workunit.client.0.smithi017.stdout:0/961: getdents d4/db/d18/d25/d36/d47/d81 0 2024-09-20T18:36:20.521 INFO:tasks.workunit.client.0.smithi017.stdout:1/997: truncate df/d29/f106 436666 0 2024-09-20T18:36:20.522 INFO:tasks.workunit.client.0.smithi017.stdout:0/962: unlink d4/db/d18/d25/d36/d47/d81/d9c/c10d 0 2024-09-20T18:36:20.530 INFO:tasks.workunit.client.0.smithi017.stdout:0/963: link d4/db/d18/d25/d36/d47/d8c/dcb/l10a d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/d95/l13c 0 2024-09-20T18:36:20.531 INFO:tasks.workunit.client.0.smithi017.stdout:0/964: stat d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/d95/d116/l131 0 2024-09-20T18:36:20.534 INFO:tasks.workunit.client.0.smithi017.stdout:1/998: dread df/d35/d4f/d82/f99 [0,4194304] 0 2024-09-20T18:36:20.538 INFO:tasks.workunit.client.0.smithi017.stdout:0/965: link d4/db/dcd/d52/f56 d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/df9/f13d 0 2024-09-20T18:36:20.540 INFO:tasks.workunit.client.0.smithi017.stdout:0/966: symlink d4/db/d18/d25/d36/d47/d81/d9c/l13e 0 2024-09-20T18:36:20.552 INFO:tasks.workunit.client.0.smithi017.stdout:1/999: dread df/d1c/d45/dcc/fd4 [0,4194304] 0 2024-09-20T18:36:20.552 INFO:tasks.workunit.client.0.smithi017.stdout:0/967: dwrite d4/db/d18/d25/f7f [0,4194304] 0 2024-09-20T18:36:20.561 INFO:tasks.workunit.client.0.smithi017.stdout:0/968: link d4/d20/l119 d4/db/d18/d25/d36/d47/d81/l13f 0 2024-09-20T18:36:20.562 INFO:tasks.workunit.client.0.smithi017.stdout:0/969: chown d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d94 0 1 2024-09-20T18:36:20.577 INFO:tasks.workunit.client.0.smithi017.stdout:0/970: dwrite d4/f17 [0,4194304] 0 2024-09-20T18:36:20.589 INFO:tasks.workunit.client.0.smithi017.stdout:0/971: truncate d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/f7b 3619834 0 2024-09-20T18:36:20.593 INFO:tasks.workunit.client.0.smithi017.stdout:0/972: fsync d4/d68/d8e/ff2 0 2024-09-20T18:36:20.598 INFO:tasks.workunit.client.0.smithi017.stdout:0/973: symlink d4/db/d18/d55/l140 0 2024-09-20T18:36:20.600 INFO:tasks.workunit.client.0.smithi017.stdout:0/974: creat d4/db/d18/d25/f141 x:0 0 0 2024-09-20T18:36:20.609 INFO:tasks.workunit.client.0.smithi017.stdout:0/975: truncate d4/d37/f8b 203737 0 2024-09-20T18:36:20.638 INFO:tasks.workunit.client.0.smithi017.stdout:7/941: sync 2024-09-20T18:36:20.639 INFO:tasks.workunit.client.0.smithi017.stdout:7/942: read da/d16/d1c/d40/d3a/f45 [2606717,24996] 0 2024-09-20T18:36:20.643 INFO:tasks.workunit.client.0.smithi017.stdout:7/943: truncate da/dd2/df8/f78 3357490 0 2024-09-20T18:36:20.651 INFO:tasks.workunit.client.0.smithi017.stdout:7/944: link da/d16/fc1 da/d16/db5/f11f 0 2024-09-20T18:36:20.651 INFO:tasks.workunit.client.0.smithi017.stdout:7/945: readlink da/d94/lb8 0 2024-09-20T18:36:20.652 INFO:tasks.workunit.client.0.smithi017.stdout:7/946: read - da/d16/d1c/d40/fb1 zero size 2024-09-20T18:36:20.653 INFO:tasks.workunit.client.0.smithi017.stdout:7/947: write da/d16/d1c/d40/d34/d3c/fd8 [482470,61095] 0 2024-09-20T18:36:20.660 INFO:tasks.workunit.client.0.smithi017.stdout:7/948: rename da/d16/d1c/d40/d3a/fbf to da/d16/d8e/d75/f120 0 2024-09-20T18:36:20.666 INFO:tasks.workunit.client.0.smithi017.stdout:7/949: rename da/cd to da/d16/d1c/d40/d34/d106/d10d/c121 0 2024-09-20T18:36:20.667 INFO:tasks.workunit.client.0.smithi017.stdout:7/950: creat da/d16/d1c/dc9/f122 x:0 0 0 2024-09-20T18:36:20.668 INFO:tasks.workunit.client.0.smithi017.stdout:7/951: mknod da/d16/d1c/d40/d34/dcd/c123 0 2024-09-20T18:36:20.671 INFO:tasks.workunit.client.0.smithi017.stdout:7/952: truncate da/d16/d1c/f1f 2375978 0 2024-09-20T18:36:20.672 INFO:tasks.workunit.client.0.smithi017.stdout:7/953: stat da/dd2/df8/f56 0 2024-09-20T18:36:20.674 INFO:tasks.workunit.client.0.smithi017.stdout:7/954: truncate da/d16/d1c/d40/f7d 2654384 0 2024-09-20T18:36:20.680 INFO:tasks.workunit.client.0.smithi017.stdout:7/955: dwrite da/dd2/df8/f7c [0,4194304] 0 2024-09-20T18:36:20.685 INFO:tasks.workunit.client.0.smithi017.stdout:7/956: creat da/d16/d1c/d40/d5d/da7/de5/d107/f124 x:0 0 0 2024-09-20T18:36:20.688 INFO:tasks.workunit.client.0.smithi017.stdout:7/957: rename da/d16/d8e/le3 to da/d16/d1c/d40/d34/d106/l125 0 2024-09-20T18:36:20.691 INFO:tasks.workunit.client.0.smithi017.stdout:7/958: truncate da/d16/db5/f11d 811527 0 2024-09-20T18:36:20.695 INFO:tasks.workunit.client.0.smithi017.stdout:7/959: creat da/d16/d1c/d40/d5d/f126 x:0 0 0 2024-09-20T18:36:20.866 INFO:tasks.workunit.client.0.smithi017.stdout:8/773: sync 2024-09-20T18:36:20.869 INFO:tasks.workunit.client.0.smithi017.stdout:8/774: dread - d0/d6/d28/d3b/fde zero size 2024-09-20T18:36:20.873 INFO:tasks.workunit.client.0.smithi017.stdout:8/775: link d0/d6/d28/c35 d0/d6/d28/d3b/df1/c102 0 2024-09-20T18:36:20.883 INFO:tasks.workunit.client.0.smithi017.stdout:8/776: dwrite d0/d6/d28/f8c [0,4194304] 0 2024-09-20T18:36:20.886 INFO:tasks.workunit.client.0.smithi017.stdout:8/777: creat d0/d65/d8b/f103 x:0 0 0 2024-09-20T18:36:20.888 INFO:tasks.workunit.client.0.smithi017.stdout:4/793: sync 2024-09-20T18:36:20.888 INFO:tasks.workunit.client.0.smithi017.stdout:6/954: sync 2024-09-20T18:36:20.888 INFO:tasks.workunit.client.0.smithi017.stdout:7/960: sync 2024-09-20T18:36:20.888 INFO:tasks.workunit.client.0.smithi017.stdout:0/976: sync 2024-09-20T18:36:20.891 INFO:tasks.workunit.client.0.smithi017.stdout:0/977: symlink d4/db/d18/l142 0 2024-09-20T18:36:20.892 INFO:tasks.workunit.client.0.smithi017.stdout:7/961: write da/d16/d1c/d40/d5d/f126 [628928,5371] 0 2024-09-20T18:36:20.893 INFO:tasks.workunit.client.0.smithi017.stdout:8/778: dread d0/d65/d8b/f9e [0,4194304] 0 2024-09-20T18:36:20.895 INFO:tasks.workunit.client.0.smithi017.stdout:6/955: creat d4/df/d1f/d25/dd7/f141 x:0 0 0 2024-09-20T18:36:20.897 INFO:tasks.workunit.client.0.smithi017.stdout:4/794: mkdir d4/d82/d88/d5c/d8f/da9/db4/dde/d10d 0 2024-09-20T18:36:20.901 INFO:tasks.workunit.client.0.smithi017.stdout:6/956: dread - d4/d37/d68/dbb/ff3 zero size 2024-09-20T18:36:20.902 INFO:tasks.workunit.client.0.smithi017.stdout:0/978: stat d4/db/d18/d25/d36/d47/d81/fa1 0 2024-09-20T18:36:20.905 INFO:tasks.workunit.client.0.smithi017.stdout:8/779: dread d0/d65/d8b/db5/fcb [0,4194304] 0 2024-09-20T18:36:20.913 INFO:tasks.workunit.client.0.smithi017.stdout:7/962: write da/dd2/df8/f78 [2437729,104048] 0 2024-09-20T18:36:20.915 INFO:tasks.workunit.client.0.smithi017.stdout:6/957: write d4/d37/d68/dbb/fea [623332,60352] 0 2024-09-20T18:36:20.920 INFO:tasks.workunit.client.0.smithi017.stdout:4/795: dwrite d4/f4b [0,4194304] 0 2024-09-20T18:36:20.920 INFO:tasks.workunit.client.0.smithi017.stdout:8/780: dread d0/d6/d28/d81/fb7 [0,4194304] 0 2024-09-20T18:36:20.921 INFO:tasks.workunit.client.0.smithi017.stdout:6/958: dread d4/df/ffb [0,4194304] 0 2024-09-20T18:36:20.924 INFO:tasks.workunit.client.0.smithi017.stdout:7/963: rename da/d16/d8e/lff to da/dd2/df8/l127 0 2024-09-20T18:36:20.924 INFO:tasks.workunit.client.0.smithi017.stdout:0/979: dwrite d4/d20/f43 [0,4194304] 0 2024-09-20T18:36:20.934 INFO:tasks.workunit.client.0.smithi017.stdout:7/964: symlink da/d16/d1c/d40/d3a/d8a/l128 0 2024-09-20T18:36:20.935 INFO:tasks.workunit.client.0.smithi017.stdout:7/965: chown da/d54/f8c 337755201 1 2024-09-20T18:36:20.935 INFO:tasks.workunit.client.0.smithi017.stdout:7/966: readlink da/d16/d1c/d40/d5d/da7/lc3 0 2024-09-20T18:36:20.937 INFO:tasks.workunit.client.0.smithi017.stdout:7/967: write da/d16/d1c/d40/fe0 [1920631,80762] 0 2024-09-20T18:36:20.940 INFO:tasks.workunit.client.0.smithi017.stdout:6/959: dread d4/df/d4a/d8f/fd6 [0,4194304] 0 2024-09-20T18:36:20.941 INFO:tasks.workunit.client.0.smithi017.stdout:8/781: write d0/d6/f1b [4863803,36859] 0 2024-09-20T18:36:20.941 INFO:tasks.workunit.client.0.smithi017.stdout:4/796: write d4/d19/d37/d66/fc4 [1626953,81443] 0 2024-09-20T18:36:20.943 INFO:tasks.workunit.client.0.smithi017.stdout:0/980: write d4/db/d18/d78/fd6 [228875,98163] 0 2024-09-20T18:36:20.944 INFO:tasks.workunit.client.0.smithi017.stdout:8/782: fsync d0/d6/d93/faf 0 2024-09-20T18:36:20.946 INFO:tasks.workunit.client.0.smithi017.stdout:6/960: creat d4/d37/d68/da4/d9e/f142 x:0 0 0 2024-09-20T18:36:20.950 INFO:tasks.workunit.client.0.smithi017.stdout:0/981: dread d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/f87 [0,4194304] 0 2024-09-20T18:36:20.952 INFO:tasks.workunit.client.0.smithi017.stdout:4/797: write d4/d82/d88/d5c/f9a [2380332,25280] 0 2024-09-20T18:36:20.953 INFO:tasks.workunit.client.0.smithi017.stdout:6/961: truncate d4/df/d1f/d25/f27 5056904 0 2024-09-20T18:36:20.956 INFO:tasks.workunit.client.0.smithi017.stdout:0/982: rename d4/db/d18/d25/d36 to d4/db/d18/d25/d36/d47/d8c/daa/dca/db1/d143 22 2024-09-20T18:36:20.956 INFO:tasks.workunit.client.0.smithi017.stdout:7/968: dwrite da/d16/d1c/f1f [0,4194304] 0 2024-09-20T18:36:20.958 INFO:tasks.workunit.client.0.smithi017.stdout:8/783: link d0/d6/d73/fa9 d0/d6/d28/d3b/df1/f104 0 2024-09-20T18:36:20.959 INFO:tasks.workunit.client.0.smithi017.stdout:6/962: creat d4/d37/d68/da4/f143 x:0 0 0 2024-09-20T18:36:20.961 INFO:tasks.workunit.client.0.smithi017.stdout:4/798: mkdir d4/d19/d37/da1/d1b/d56/dfb/d10e 0 2024-09-20T18:36:20.963 INFO:tasks.workunit.client.0.smithi017.stdout:7/969: read da/d16/f67 [2365261,70476] 0 2024-09-20T18:36:20.964 INFO:tasks.workunit.client.0.smithi017.stdout:8/784: chown d0/d6/d28/d3d/d4e/d55/l85 916170242 1 2024-09-20T18:36:20.967 INFO:tasks.workunit.client.0.smithi017.stdout:6/963: dwrite d4/df/d1f/d25/dca/d127/dc2/f11e [0,4194304] 0 2024-09-20T18:36:20.967 INFO:tasks.workunit.client.0.smithi017.stdout:7/970: write da/d16/d1c/d40/fe0 [271020,118642] 0 2024-09-20T18:36:20.970 INFO:tasks.workunit.client.0.smithi017.stdout:0/983: link d4/d20/l133 d4/d68/d135/l144 0 2024-09-20T18:36:20.974 INFO:tasks.workunit.client.0.smithi017.stdout:6/964: creat d4/d29/dc6/de7/f144 x:0 0 0 2024-09-20T18:36:20.976 INFO:tasks.workunit.client.0.smithi017.stdout:7/971: chown da/dd2/df8/l112 117904758 1 2024-09-20T18:36:20.980 INFO:tasks.workunit.client.0.smithi017.stdout:8/785: mkdir d0/d6/d28/d105 0 2024-09-20T18:36:20.981 INFO:tasks.workunit.client.0.smithi017.stdout:8/786: stat d0/d6/d28/d3a/c58 0 2024-09-20T18:36:20.982 INFO:tasks.workunit.client.0.smithi017.stdout:6/965: mknod d4/d37/d68/d8d/dba/c145 0 2024-09-20T18:36:20.982 INFO:tasks.workunit.client.0.smithi017.stdout:8/787: chown d0/d6/d28/d3a/l47 6355446 1 2024-09-20T18:36:20.984 INFO:tasks.workunit.client.0.smithi017.stdout:7/972: mkdir da/dd2/d129 0 2024-09-20T18:36:20.989 INFO:tasks.workunit.client.0.smithi017.stdout:4/799: dwrite d4/d19/d37/da1/d1b/f81 [0,4194304] 0 2024-09-20T18:36:20.990 INFO:tasks.workunit.client.0.smithi017.stdout:7/973: readlink da/d16/d1c/d40/d34/d106/l125 0 2024-09-20T18:36:20.991 INFO:tasks.workunit.client.0.smithi017.stdout:7/974: chown da/d16/d1c/d40/d5d/da7/de5 0 1 2024-09-20T18:36:20.995 INFO:tasks.workunit.client.0.smithi017.stdout:8/788: mkdir d0/d6/d28/d105/d106 0 2024-09-20T18:36:20.998 INFO:tasks.workunit.client.0.smithi017.stdout:0/984: getdents d4/d20/d63 0 2024-09-20T18:36:21.000 INFO:tasks.workunit.client.0.smithi017.stdout:4/800: dread d4/f38 [4194304,4194304] 0 2024-09-20T18:36:21.002 INFO:tasks.workunit.client.0.smithi017.stdout:8/789: symlink d0/d6/d28/d81/da6/l107 0 2024-09-20T18:36:21.002 INFO:tasks.workunit.client.0.smithi017.stdout:4/801: readlink d4/d19/d37/dbc/d7a/lc5 0 2024-09-20T18:36:21.002 INFO:tasks.workunit.client.0.smithi017.stdout:0/985: rmdir d4/db/dcd/d52/d77/daf 39 2024-09-20T18:36:21.004 INFO:tasks.workunit.client.0.smithi017.stdout:7/975: getdents da/d16/de2 0 2024-09-20T18:36:21.007 INFO:tasks.workunit.client.0.smithi017.stdout:8/790: rename d0/d6/d28/d3a to d0/d6/d28/d3b/d72/d108 0 2024-09-20T18:36:21.007 INFO:tasks.workunit.client.0.smithi017.stdout:4/802: mkdir d4/d19/d37/da1/d1b/d56/dfb/d10e/d10f 0 2024-09-20T18:36:21.010 INFO:tasks.workunit.client.0.smithi017.stdout:0/986: dwrite d4/d37/dfe/f12f [0,4194304] 0 2024-09-20T18:36:21.012 INFO:tasks.workunit.client.0.smithi017.stdout:0/987: dread d4/d20/d63/d86/fb5 [0,4194304] 0 2024-09-20T18:36:21.017 INFO:tasks.workunit.client.0.smithi017.stdout:4/803: dread d4/d82/d88/d5c/d8f/fd5 [0,4194304] 0 2024-09-20T18:36:21.018 INFO:tasks.workunit.client.0.smithi017.stdout:4/804: chown d4/d82/leb 89981 1 2024-09-20T18:36:21.020 INFO:tasks.workunit.client.0.smithi017.stdout:6/966: dwrite d4/d37/d68/da4/fbd [0,4194304] 0 2024-09-20T18:36:21.020 INFO:tasks.workunit.client.0.smithi017.stdout:8/791: mkdir d0/d6/d28/d3b/d72/d98/d109 0 2024-09-20T18:36:21.022 INFO:tasks.workunit.client.0.smithi017.stdout:6/967: fsync d4/d29/f45 0 2024-09-20T18:36:21.028 INFO:tasks.workunit.client.0.smithi017.stdout:8/792: creat d0/d6/d28/d3b/d72/f10a x:0 0 0 2024-09-20T18:36:21.029 INFO:tasks.workunit.client.0.smithi017.stdout:7/976: dwrite da/d16/d1c/d40/fb1 [0,4194304] 0 2024-09-20T18:36:21.038 INFO:tasks.workunit.client.0.smithi017.stdout:0/988: fsync d4/db/dcd/f100 0 2024-09-20T18:36:21.041 INFO:tasks.workunit.client.0.smithi017.stdout:7/977: creat da/d94/f12a x:0 0 0 2024-09-20T18:36:21.042 INFO:tasks.workunit.client.0.smithi017.stdout:4/805: getdents d4/d19/d37/da1/d1b/d56/d67/db9/de5 0 2024-09-20T18:36:21.043 INFO:tasks.workunit.client.0.smithi017.stdout:4/806: chown d4/d19/d37/d66/fa2 5037100 1 2024-09-20T18:36:21.048 INFO:tasks.workunit.client.0.smithi017.stdout:7/978: mknod da/d16/d1c/d40/d34/d106/c12b 0 2024-09-20T18:36:21.052 INFO:tasks.workunit.client.0.smithi017.stdout:8/793: creat d0/d6/d28/d3b/f10b x:0 0 0 2024-09-20T18:36:21.052 INFO:tasks.workunit.client.0.smithi017.stdout:6/968: dread d4/d37/d68/da4/d9e/f9f [0,4194304] 0 2024-09-20T18:36:21.054 INFO:tasks.workunit.client.0.smithi017.stdout:4/807: mkdir d4/dc/def/d10a/d110 0 2024-09-20T18:36:21.054 INFO:tasks.workunit.client.0.smithi017.stdout:7/979: stat da/d16/db5/f116 0 2024-09-20T18:36:21.055 INFO:tasks.workunit.client.0.smithi017.stdout:8/794: chown d0/d65/d8b/db5/dbc/cdf 3 1 2024-09-20T18:36:21.056 INFO:tasks.workunit.client.0.smithi017.stdout:0/989: dread d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d94/fa8 [0,4194304] 0 2024-09-20T18:36:21.057 INFO:tasks.workunit.client.0.smithi017.stdout:6/969: creat d4/df/d1f/d25/d3f/d5c/f146 x:0 0 0 2024-09-20T18:36:21.058 INFO:tasks.workunit.client.0.smithi017.stdout:0/990: chown d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/d95/d116/d12b 6 1 2024-09-20T18:36:21.060 INFO:tasks.workunit.client.0.smithi017.stdout:8/795: rmdir d0/d6/d28/d105 39 2024-09-20T18:36:21.062 INFO:tasks.workunit.client.0.smithi017.stdout:6/970: symlink d4/d37/d68/da4/d9e/l147 0 2024-09-20T18:36:21.064 INFO:tasks.workunit.client.0.smithi017.stdout:0/991: mknod d4/d20/d63/c145 0 2024-09-20T18:36:21.065 INFO:tasks.workunit.client.0.smithi017.stdout:0/992: dread d4/db/d18/d25/fe5 [0,4194304] 0 2024-09-20T18:36:21.070 INFO:tasks.workunit.client.0.smithi017.stdout:7/980: dread da/fe9 [0,4194304] 0 2024-09-20T18:36:21.072 INFO:tasks.workunit.client.0.smithi017.stdout:0/993: rename d4/d68/d8e/ff2 to d4/db/d18/d25/d36/d47/d81/d9c/f146 0 2024-09-20T18:36:21.074 INFO:tasks.workunit.client.0.smithi017.stdout:0/994: chown d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d94 317411 1 2024-09-20T18:36:21.076 INFO:tasks.workunit.client.0.smithi017.stdout:4/808: write d4/d19/d37/dbc/f87 [523264,107882] 0 2024-09-20T18:36:21.077 INFO:tasks.workunit.client.0.smithi017.stdout:8/796: dread d0/d6/d28/d3d/f60 [0,4194304] 0 2024-09-20T18:36:21.078 INFO:tasks.workunit.client.0.smithi017.stdout:8/797: chown d0/d6/f67 540508439 1 2024-09-20T18:36:21.080 INFO:tasks.workunit.client.0.smithi017.stdout:8/798: write d0/d6/d28/d3d/d4e/f75 [357318,25416] 0 2024-09-20T18:36:21.080 INFO:tasks.workunit.client.0.smithi017.stdout:0/995: creat d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d94/deb/f147 x:0 0 0 2024-09-20T18:36:21.081 INFO:tasks.workunit.client.0.smithi017.stdout:4/809: fdatasync d4/d19/d62/f9e 0 2024-09-20T18:36:21.082 INFO:tasks.workunit.client.0.smithi017.stdout:8/799: stat d0/d6/d28/d3d/d4e/f75 0 2024-09-20T18:36:21.084 INFO:tasks.workunit.client.0.smithi017.stdout:4/810: readlink d4/d19/d37/dbc/d96/la4 0 2024-09-20T18:36:21.085 INFO:tasks.workunit.client.0.smithi017.stdout:4/811: chown d4/d19/d37/da1/l50 77312601 1 2024-09-20T18:36:21.086 INFO:tasks.workunit.client.0.smithi017.stdout:0/996: stat d4/db/d18/d25/d36/d47/d8c/daa/dca/d42/f61 0 2024-09-20T18:36:21.087 INFO:tasks.workunit.client.0.smithi017.stdout:8/800: mknod d0/d6/d93/c10c 0 2024-09-20T18:36:21.090 INFO:tasks.workunit.client.0.smithi017.stdout:0/997: rename d4/db/d18/d25/d36/d47/d8c/daa/dca/d24 to d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d148 22 2024-09-20T18:36:21.091 INFO:tasks.workunit.client.0.smithi017.stdout:8/801: mknod d0/d6/d28/d3b/d72/d98/c10d 0 2024-09-20T18:36:21.094 INFO:tasks.workunit.client.0.smithi017.stdout:0/998: mknod d4/db/dcd/d52/d77/c149 0 2024-09-20T18:36:21.098 INFO:tasks.workunit.client.0.smithi017.stdout:4/812: dwrite d4/d82/d88/f21 [4194304,4194304] 0 2024-09-20T18:36:21.101 INFO:tasks.workunit.client.0.smithi017.stdout:0/999: creat d4/db/d18/d25/d36/d47/d8c/daa/dca/d24/d2f/d101/d102/f14a x:0 0 0 2024-09-20T18:36:21.107 INFO:tasks.workunit.client.0.smithi017.stdout:8/802: dread d0/d6/d28/f2d [0,4194304] 0 2024-09-20T18:36:21.109 INFO:tasks.workunit.client.0.smithi017.stdout:8/803: fdatasync d0/d6/d28/d3d/d4e/d55/ffe 0 2024-09-20T18:36:21.114 INFO:tasks.workunit.client.0.smithi017.stdout:8/804: dwrite d0/d6/d28/d3d/d4e/d55/d83/da2/fed [0,4194304] 0 2024-09-20T18:36:21.119 INFO:tasks.workunit.client.0.smithi017.stdout:8/805: chown d0/d6/l17 35 1 2024-09-20T18:36:21.120 INFO:tasks.workunit.client.0.smithi017.stdout:4/813: dwrite d4/d19/d37/da1/fff [0,4194304] 0 2024-09-20T18:36:21.127 INFO:tasks.workunit.client.0.smithi017.stdout:8/806: rename d0/d6/d28/d81/fbf to d0/d6/d28/d3b/df1/f10e 0 2024-09-20T18:36:21.131 INFO:tasks.workunit.client.0.smithi017.stdout:4/814: rename d4/dc/laf to d4/d19/d37/da1/d1b/d56/d67/db3/l111 0 2024-09-20T18:36:21.132 INFO:tasks.workunit.client.0.smithi017.stdout:8/807: creat d0/d65/d8b/f10f x:0 0 0 2024-09-20T18:36:21.134 INFO:tasks.workunit.client.0.smithi017.stdout:4/815: write d4/d19/d37/da1/d1b/d56/d67/fe6 [934564,89033] 0 2024-09-20T18:36:21.137 INFO:tasks.workunit.client.0.smithi017.stdout:8/808: mknod d0/d6/d28/d3d/c110 0 2024-09-20T18:36:21.137 INFO:tasks.workunit.client.0.smithi017.stdout:4/816: truncate d4/dc/d1e/d26/fb8 587474 0 2024-09-20T18:36:21.138 INFO:tasks.workunit.client.0.smithi017.stdout:8/809: chown d0/d6/d28/f4f 3851 1 2024-09-20T18:36:21.139 INFO:tasks.workunit.client.0.smithi017.stdout:8/810: rmdir d0/d6/d28/d81/d82 39 2024-09-20T18:36:21.143 INFO:tasks.workunit.client.0.smithi017.stdout:8/811: fdatasync d0/d6/d28/d81/d82/fd0 0 2024-09-20T18:36:21.143 INFO:tasks.workunit.client.0.smithi017.stdout:8/812: chown d0/f22 1984714 1 2024-09-20T18:36:21.144 INFO:tasks.workunit.client.0.smithi017.stdout:8/813: chown d0/d6/d28/d3d/d4e/fbd 54570504 1 2024-09-20T18:36:21.148 INFO:tasks.workunit.client.0.smithi017.stdout:4/817: write d4/dc/f12 [3699525,127450] 0 2024-09-20T18:36:21.149 INFO:tasks.workunit.client.0.smithi017.stdout:8/814: write d0/f5f [2103485,96586] 0 2024-09-20T18:36:21.151 INFO:tasks.workunit.client.0.smithi017.stdout:4/818: mkdir d4/d19/d37/dbc/d96/d112 0 2024-09-20T18:36:21.152 INFO:tasks.workunit.client.0.smithi017.stdout:4/819: chown d4/d82/fa5 1799061 1 2024-09-20T18:36:21.154 INFO:tasks.workunit.client.0.smithi017.stdout:8/815: truncate d0/d65/d8b/db4/fc9 409544 0 2024-09-20T18:36:21.155 INFO:tasks.workunit.client.0.smithi017.stdout:4/820: dread d4/d19/d37/da1/fff [0,4194304] 0 2024-09-20T18:36:21.161 INFO:tasks.workunit.client.0.smithi017.stdout:4/821: mkdir d4/d19/d37/da1/d113 0 2024-09-20T18:36:21.165 INFO:tasks.workunit.client.0.smithi017.stdout:4/822: mknod d4/d19/d37/da1/c114 0 2024-09-20T18:36:21.169 INFO:tasks.workunit.client.0.smithi017.stdout:4/823: unlink d4/dc/d1e/d26/c10b 0 2024-09-20T18:36:21.170 INFO:tasks.workunit.client.0.smithi017.stdout:8/816: dwrite d0/d6/d28/f5a [0,4194304] 0 2024-09-20T18:36:21.172 INFO:tasks.workunit.client.0.smithi017.stdout:4/824: symlink d4/d19/d37/da1/d65/l115 0 2024-09-20T18:36:21.174 INFO:tasks.workunit.client.0.smithi017.stdout:8/817: mknod d0/d6/d28/d3d/d4e/d55/df4/c111 0 2024-09-20T18:36:21.174 INFO:tasks.workunit.client.0.smithi017.stdout:4/825: unlink d4/d19/d37/d66/lcc 0 2024-09-20T18:36:21.175 INFO:tasks.workunit.client.0.smithi017.stdout:8/818: write d0/d65/d8b/d91/f100 [961743,68788] 0 2024-09-20T18:36:21.177 INFO:tasks.workunit.client.0.smithi017.stdout:4/826: mkdir d4/d19/d37/dbc/d96/d116 0 2024-09-20T18:36:21.178 INFO:tasks.workunit.client.0.smithi017.stdout:8/819: mknod d0/d6/d28/d81/d82/c112 0 2024-09-20T18:36:21.179 INFO:tasks.workunit.client.0.smithi017.stdout:8/820: write d0/d65/d8b/db5/fcb [1405862,45150] 0 2024-09-20T18:36:21.180 INFO:tasks.workunit.client.0.smithi017.stdout:4/827: creat d4/d19/d37/da1/d1b/d56/d67/db9/f117 x:0 0 0 2024-09-20T18:36:21.184 INFO:tasks.workunit.client.0.smithi017.stdout:4/828: rename d4/dc/c3c to d4/d82/d88/d5c/d8f/da9/db4/dde/c118 0 2024-09-20T18:36:21.185 INFO:tasks.workunit.client.0.smithi017.stdout:8/821: truncate d0/d6/d28/d3d/d4e/f51 3002662 0 2024-09-20T18:36:21.187 INFO:tasks.workunit.client.0.smithi017.stdout:8/822: symlink d0/d6/l113 0 2024-09-20T18:36:21.189 INFO:tasks.workunit.client.0.smithi017.stdout:4/829: rename d4/d82/d88/f36 to d4/d19/d37/da1/d1b/d56/f119 0 2024-09-20T18:36:21.190 INFO:tasks.workunit.client.0.smithi017.stdout:8/823: symlink d0/d6/d28/d3d/d4e/d55/df4/l114 0 2024-09-20T18:36:21.193 INFO:tasks.workunit.client.0.smithi017.stdout:8/824: mknod d0/d6/d28/d3d/d4e/d55/df4/c115 0 2024-09-20T18:36:21.194 INFO:tasks.workunit.client.0.smithi017.stdout:8/825: readlink d0/d6/d28/d3b/d72/d98/lc6 0 2024-09-20T18:36:21.196 INFO:tasks.workunit.client.0.smithi017.stdout:8/826: creat d0/d6/d93/dd1/f116 x:0 0 0 2024-09-20T18:36:21.199 INFO:tasks.workunit.client.0.smithi017.stdout:8/827: mkdir d0/d6/d28/d3b/d72/d98/d117 0 2024-09-20T18:36:21.199 INFO:tasks.workunit.client.0.smithi017.stdout:8/828: chown d0/fc8 441 1 2024-09-20T18:36:21.205 INFO:tasks.workunit.client.0.smithi017.stdout:4/830: write d4/dc/d1e/d26/fb8 [608834,22583] 0 2024-09-20T18:36:21.207 INFO:tasks.workunit.client.0.smithi017.stdout:8/829: link d0/d6/d28/d3d/l78 d0/d6/d28/l118 0 2024-09-20T18:36:21.208 INFO:tasks.workunit.client.0.smithi017.stdout:8/830: chown d0/d6/d28/d3b/d72/c92 22223243 1 2024-09-20T18:36:21.208 INFO:tasks.workunit.client.0.smithi017.stdout:4/831: mkdir d4/d19/d37/d11a 0 2024-09-20T18:36:21.209 INFO:tasks.workunit.client.0.smithi017.stdout:4/832: write d4/f7 [4413050,85754] 0 2024-09-20T18:36:21.210 INFO:tasks.workunit.client.0.smithi017.stdout:8/831: write d0/d6/d28/d3d/fce [346370,37220] 0 2024-09-20T18:36:21.216 INFO:tasks.workunit.client.0.smithi017.stdout:8/832: dread d0/d65/d8b/db4/fc9 [0,4194304] 0 2024-09-20T18:36:21.217 INFO:tasks.workunit.client.0.smithi017.stdout:4/833: dwrite d4/dc/d1e/d26/fb8 [0,4194304] 0 2024-09-20T18:36:21.221 INFO:tasks.workunit.client.0.smithi017.stdout:8/833: creat d0/d6/d28/d3d/d4e/d55/df4/d101/f119 x:0 0 0 2024-09-20T18:36:21.245 INFO:tasks.workunit.client.0.smithi017.stdout:4/834: dwrite d4/d19/d37/da1/d1b/f45 [0,4194304] 0 2024-09-20T18:36:21.245 INFO:tasks.workunit.client.0.smithi017.stdout:8/834: dwrite d0/d6/d28/d3d/d4e/d55/f7f [0,4194304] 0 2024-09-20T18:36:21.246 INFO:tasks.workunit.client.0.smithi017.stdout:4/835: fsync d4/d19/d37/d66/fdf 0 2024-09-20T18:36:21.250 INFO:tasks.workunit.client.0.smithi017.stdout:4/836: truncate d4/d19/d37/da1/d1b/f81 8706600 0 2024-09-20T18:36:21.251 INFO:tasks.workunit.client.0.smithi017.stdout:8/835: symlink d0/d6/d28/d3b/d72/d108/dae/l11a 0 2024-09-20T18:36:21.254 INFO:tasks.workunit.client.0.smithi017.stdout:4/837: mkdir d4/dc/def/d10a/d11b 0 2024-09-20T18:36:21.256 INFO:tasks.workunit.client.0.smithi017.stdout:4/838: fdatasync d4/dc/d41/f99 0 2024-09-20T18:36:21.257 INFO:tasks.workunit.client.0.smithi017.stdout:4/839: fsync d4/d82/d88/f9b 0 2024-09-20T18:36:21.257 INFO:tasks.workunit.client.0.smithi017.stdout:8/836: truncate d0/d6/f54 4233914 0 2024-09-20T18:36:21.259 INFO:tasks.workunit.client.0.smithi017.stdout:4/840: write d4/dc/d1e/f73 [739008,100045] 0 2024-09-20T18:36:21.274 INFO:tasks.workunit.client.0.smithi017.stdout:8/837: write d0/d6/d28/d3d/d4e/fbd [352485,34158] 0 2024-09-20T18:36:21.277 INFO:tasks.workunit.client.0.smithi017.stdout:8/838: creat d0/d6/d28/d81/d9c/f11b x:0 0 0 2024-09-20T18:36:21.279 INFO:tasks.workunit.client.0.smithi017.stdout:8/839: dread - d0/d6/d93/fec zero size 2024-09-20T18:36:21.279 INFO:tasks.workunit.client.0.smithi017.stdout:4/841: dwrite d4/d7f/dc2/ffa [0,4194304] 0 2024-09-20T18:36:21.280 INFO:tasks.workunit.client.0.smithi017.stdout:4/842: dread - d4/d19/d37/da1/d65/fe9 zero size 2024-09-20T18:36:21.285 INFO:tasks.workunit.client.0.smithi017.stdout:4/843: fdatasync d4/dc/d1e/f55 0 2024-09-20T18:36:21.290 INFO:tasks.workunit.client.0.smithi017.stdout:4/844: dwrite d4/dc/d1e/d26/fb8 [0,4194304] 0 2024-09-20T18:36:21.296 INFO:tasks.workunit.client.0.smithi017.stdout:8/840: write d0/d6/d28/d3b/df1/f104 [385750,103785] 0 2024-09-20T18:36:21.298 INFO:tasks.workunit.client.0.smithi017.stdout:4/845: mkdir d4/d19/dd0/de1/d11c 0 2024-09-20T18:36:21.303 INFO:tasks.workunit.client.0.smithi017.stdout:8/841: read d0/d6/d28/d3d/d4e/d55/d83/f9f [143699,68324] 0 2024-09-20T18:36:21.305 INFO:tasks.workunit.client.0.smithi017.stdout:4/846: dwrite d4/d7f/dc2/ffa [0,4194304] 0 2024-09-20T18:36:21.306 INFO:tasks.workunit.client.0.smithi017.stdout:4/847: fdatasync d4/dc/d1e/f51 0 2024-09-20T18:36:21.320 INFO:tasks.workunit.client.0.smithi017.stdout:4/848: dwrite d4/d19/d37/f5a [0,4194304] 0 2024-09-20T18:36:21.340 INFO:tasks.workunit.client.0.smithi017.stdout:8/842: dread d0/d6/f25 [0,4194304] 0 2024-09-20T18:36:21.344 INFO:tasks.workunit.client.0.smithi017.stdout:4/849: dread d4/d19/d37/d66/fdf [0,4194304] 0 2024-09-20T18:36:21.349 INFO:tasks.workunit.client.0.smithi017.stdout:4/850: getdents d4/d19/dd0/de1 0 2024-09-20T18:36:21.351 INFO:tasks.workunit.client.0.smithi017.stdout:4/851: write d4/d19/d37/da1/d1b/daa/f109 [1014254,86749] 0 2024-09-20T18:36:21.352 INFO:tasks.workunit.client.0.smithi017.stdout:4/852: chown d4/d19/d37/d66 3 1 2024-09-20T18:36:21.353 INFO:tasks.workunit.client.0.smithi017.stdout:8/843: dread d0/d6/d28/d3d/d4e/d55/da8/fc4 [0,4194304] 0 2024-09-20T18:36:21.359 INFO:tasks.workunit.client.0.smithi017.stdout:4/853: dwrite d4/d19/d37/dbc/d7a/fc9 [0,4194304] 0 2024-09-20T18:36:21.364 INFO:tasks.workunit.client.0.smithi017.stdout:4/854: chown d4/d19/d37/da1/d1b/d56/dfb/l104 1 1 2024-09-20T18:36:21.365 INFO:tasks.workunit.client.0.smithi017.stdout:8/844: dwrite d0/d6/d28/d3d/f4a [4194304,4194304] 0 2024-09-20T18:36:21.369 INFO:tasks.workunit.client.0.smithi017.stdout:4/855: symlink d4/dc/def/l11d 0 2024-09-20T18:36:21.378 INFO:tasks.workunit.client.0.smithi017.stdout:8/845: link d0/d6/d28/d3b/df1/f104 d0/d6/d28/d3d/d4e/d55/df4/f11c 0 2024-09-20T18:36:21.379 INFO:tasks.workunit.client.0.smithi017.stdout:4/856: symlink d4/d19/d37/da1/d1b/d56/l11e 0 2024-09-20T18:36:21.380 INFO:tasks.workunit.client.0.smithi017.stdout:4/857: write d4/d82/ffe [517445,48230] 0 2024-09-20T18:36:21.382 INFO:tasks.workunit.client.0.smithi017.stdout:8/846: rmdir d0 39 2024-09-20T18:36:21.386 INFO:tasks.workunit.client.0.smithi017.stdout:4/858: rename d4/d19/d37/c8c to d4/d82/d88/d5c/dc8/c11f 0 2024-09-20T18:36:21.387 INFO:tasks.workunit.client.0.smithi017.stdout:4/859: chown d4/d19/d37/da1/d1b/f2f 647 1 2024-09-20T18:36:21.394 INFO:tasks.workunit.client.0.smithi017.stdout:4/860: creat d4/d82/d88/d5c/d97/f120 x:0 0 0 2024-09-20T18:36:21.400 INFO:tasks.workunit.client.0.smithi017.stdout:4/861: mkdir d4/dc/def/d10a/d110/d121 0 2024-09-20T18:36:21.403 INFO:tasks.workunit.client.0.smithi017.stdout:4/862: mkdir d4/d19/d37/da1/d65/da0/d122 0 2024-09-20T18:36:21.408 INFO:tasks.workunit.client.0.smithi017.stdout:8/847: write d0/d6/f74 [1311627,77641] 0 2024-09-20T18:36:21.410 INFO:tasks.workunit.client.0.smithi017.stdout:8/848: rmdir d0/d6/d28/d3d/d4e/d55/d83/da2 39 2024-09-20T18:36:21.415 INFO:tasks.workunit.client.0.smithi017.stdout:8/849: rename d0/d6/d28/d3d/d4e/d55/df4/l114 to d0/d6/d28/d3d/d4e/d55/d83/l11d 0 2024-09-20T18:36:21.416 INFO:tasks.workunit.client.0.smithi017.stdout:8/850: dread - d0/d65/d8b/f103 zero size 2024-09-20T18:36:21.421 INFO:tasks.workunit.client.0.smithi017.stdout:4/863: write d4/d19/d37/da1/d1b/d56/d67/f6e [1243733,30007] 0 2024-09-20T18:36:21.425 INFO:tasks.workunit.client.0.smithi017.stdout:4/864: creat d4/d19/d37/dbc/d96/d116/f123 x:0 0 0 2024-09-20T18:36:21.447 INFO:tasks.workunit.client.0.smithi017.stdout:8/851: truncate d0/d6/d28/f2d 385782 0 2024-09-20T18:36:21.449 INFO:tasks.workunit.client.0.smithi017.stdout:8/852: write d0/d6/d28/d3b/fde [910838,4221] 0 2024-09-20T18:36:21.450 INFO:tasks.workunit.client.0.smithi017.stdout:8/853: stat d0/d65/d8b/d91 0 2024-09-20T18:36:21.454 INFO:tasks.workunit.client.0.smithi017.stdout:4/865: truncate d4/d19/d37/dbc/d96/fd7 2034223 0 2024-09-20T18:36:21.457 INFO:tasks.workunit.client.0.smithi017.stdout:4/866: unlink d4/d7f/dc2/cdb 0 2024-09-20T18:36:21.464 INFO:tasks.workunit.client.0.smithi017.stdout:8/854: dread d0/d6/f67 [0,4194304] 0 2024-09-20T18:36:21.466 INFO:tasks.workunit.client.0.smithi017.stdout:8/855: fsync d0/f2 0 2024-09-20T18:36:21.466 INFO:tasks.workunit.client.0.smithi017.stdout:4/867: dwrite d4/d82/fa5 [4194304,4194304] 0 2024-09-20T18:36:21.473 INFO:tasks.workunit.client.0.smithi017.stdout:8/856: dwrite d0/f22 [0,4194304] 0 2024-09-20T18:36:21.475 INFO:tasks.workunit.client.0.smithi017.stdout:4/868: dread - d4/d19/d37/da1/d1b/fcb zero size 2024-09-20T18:36:21.478 INFO:tasks.workunit.client.0.smithi017.stdout:8/857: creat d0/d6/d28/d3d/d4e/d55/d8a/f11e x:0 0 0 2024-09-20T18:36:21.479 INFO:tasks.workunit.client.0.smithi017.stdout:4/869: getdents d4/d19/dd0/de1/d11c 0 2024-09-20T18:36:21.480 INFO:tasks.workunit.client.0.smithi017.stdout:8/858: chown d0/d6/d28/d3b/d72/cd2 405047 1 2024-09-20T18:36:21.480 INFO:tasks.workunit.client.0.smithi017.stdout:4/870: chown d4/d19/d37/da1/c4d 10691 1 2024-09-20T18:36:21.488 INFO:tasks.workunit.client.0.smithi017.stdout:8/859: write d0/d6/d28/d3d/d4e/d55/d8a/fa0 [278175,41966] 0 2024-09-20T18:36:21.494 INFO:tasks.workunit.client.0.smithi017.stdout:8/860: dwrite d0/d65/d8b/d91/f100 [0,4194304] 0 2024-09-20T18:36:21.497 INFO:tasks.workunit.client.0.smithi017.stdout:8/861: unlink d0/f14 0 2024-09-20T18:36:21.498 INFO:tasks.workunit.client.0.smithi017.stdout:8/862: chown d0/d6/d28/d3b/d72/d108 1 1 2024-09-20T18:36:21.502 INFO:tasks.workunit.client.0.smithi017.stdout:8/863: creat d0/d6/d28/d3d/d4e/d55/df4/d101/f11f x:0 0 0 2024-09-20T18:36:21.509 INFO:tasks.workunit.client.0.smithi017.stdout:8/864: dwrite d0/d6/d73/ff7 [0,4194304] 0 2024-09-20T18:36:21.512 INFO:tasks.workunit.client.0.smithi017.stdout:8/865: write d0/d6/d28/d81/d9c/f11b [681037,74603] 0 2024-09-20T18:36:21.575 INFO:tasks.workunit.client.0.smithi017.stdout:8/866: dwrite d0/d6/f74 [0,4194304] 0 2024-09-20T18:36:21.582 INFO:tasks.workunit.client.0.smithi017.stdout:8/867: dwrite d0/d6/d28/d3d/d4e/d55/da8/fc4 [0,4194304] 0 2024-09-20T18:36:21.587 INFO:tasks.workunit.client.0.smithi017.stdout:8/868: creat d0/d6/d28/d3d/f120 x:0 0 0 2024-09-20T18:36:21.597 INFO:tasks.workunit.client.0.smithi017.stdout:8/869: write d0/d6/d28/f9b [577059,85055] 0 2024-09-20T18:36:21.601 INFO:tasks.workunit.client.0.smithi017.stdout:8/870: read d0/d6/d28/d81/d82/f84 [1892072,293] 0 2024-09-20T18:36:21.606 INFO:tasks.workunit.client.0.smithi017.stdout:8/871: dwrite d0/d6/d73/ff7 [0,4194304] 0 2024-09-20T18:36:21.608 INFO:tasks.workunit.client.0.smithi017.stdout:8/872: chown d0/d6/d28/d81/d82/fd0 0 1 2024-09-20T18:36:21.608 INFO:tasks.workunit.client.0.smithi017.stdout:8/873: dread - d0/d6/d28/d3b/f10b zero size 2024-09-20T18:36:21.618 INFO:tasks.workunit.client.0.smithi017.stdout:8/874: dwrite d0/d6/d28/d3d/d4e/d55/d83/f9f [0,4194304] 0 2024-09-20T18:36:21.619 INFO:tasks.workunit.client.0.smithi017.stdout:8/875: readlink d0/d6/d73/l7b 0 2024-09-20T18:36:21.648 INFO:tasks.workunit.client.0.smithi017.stdout:8/876: dread d0/d6/d28/d81/d82/fd0 [4194304,4194304] 0 2024-09-20T18:36:21.649 INFO:tasks.workunit.client.0.smithi017.stdout:8/877: chown d0/d6/d28/d3b/d72/c9d 113 1 2024-09-20T18:36:21.656 INFO:tasks.workunit.client.0.smithi017.stdout:8/878: dwrite d0/d6/d28/d81/d82/fd0 [4194304,4194304] 0 2024-09-20T18:36:21.658 INFO:tasks.workunit.client.0.smithi017.stdout:8/879: readlink d0/l24 0 2024-09-20T18:36:21.665 INFO:tasks.workunit.client.0.smithi017.stdout:8/880: rmdir d0/d6/d28/d105/d106 0 2024-09-20T18:36:21.669 INFO:tasks.workunit.client.0.smithi017.stdout:8/881: dread d0/d6/d28/d3d/d4e/d55/f7f [0,4194304] 0 2024-09-20T18:36:21.683 INFO:tasks.workunit.client.0.smithi017.stdout:8/882: dwrite d0/d6/d28/d81/d9c/fc1 [0,4194304] 0 2024-09-20T18:36:21.689 INFO:tasks.workunit.client.0.smithi017.stdout:8/883: mkdir d0/d6/d28/d3d/d4e/d55/d83/d121 0 2024-09-20T18:36:21.692 INFO:tasks.workunit.client.0.smithi017.stdout:8/884: creat d0/d6/d28/d3b/d72/d108/dae/f122 x:0 0 0 2024-09-20T18:36:21.695 INFO:tasks.workunit.client.0.smithi017.stdout:8/885: mknod d0/d6/d28/d81/d82/c123 0 2024-09-20T18:36:21.702 INFO:tasks.workunit.client.0.smithi017.stdout:8/886: link d0/d6/d28/d3d/d4e/d55/f9a d0/d6/d28/d81/f124 0 2024-09-20T18:36:21.707 INFO:tasks.workunit.client.0.smithi017.stdout:8/887: truncate d0/d6/d28/d3d/d4e/d55/d83/da2/fd6 539089 0 2024-09-20T18:36:21.715 INFO:tasks.workunit.client.0.smithi017.stdout:8/888: write d0/d6/d28/d81/d82/f96 [3879841,37025] 0 2024-09-20T18:36:21.719 INFO:tasks.workunit.client.0.smithi017.stdout:8/889: rename d0/d6/d73/fa9 to d0/d6/d28/d3d/d4e/d55/d8a/f125 0 2024-09-20T18:36:21.720 INFO:tasks.workunit.client.0.smithi017.stdout:8/890: truncate d0/d6/d28/d3d/d4e/d55/fcc 1074455 0 2024-09-20T18:36:21.774 INFO:tasks.workunit.client.0.smithi017.stdout:6/971: sync 2024-09-20T18:36:21.775 INFO:tasks.workunit.client.0.smithi017.stdout:6/972: truncate d4/df/d1f/d25/dd7/f141 829360 0 2024-09-20T18:36:21.776 INFO:tasks.workunit.client.0.smithi017.stdout:6/973: chown d4/df/d1f/d25/dd7/f11f 16736723 1 2024-09-20T18:36:21.805 INFO:tasks.workunit.client.0.smithi017.stdout:6/974: chown d4/df/d1f/cb4 6079 1 2024-09-20T18:36:21.808 INFO:tasks.workunit.client.0.smithi017.stdout:6/975: symlink d4/d37/d68/d8d/dba/l148 0 2024-09-20T18:36:21.809 INFO:tasks.workunit.client.0.smithi017.stdout:6/976: rmdir d4/d37/df4 39 2024-09-20T18:36:21.812 INFO:tasks.workunit.client.0.smithi017.stdout:6/977: read d4/d37/d68/d8d/fce [3128906,87687] 0 2024-09-20T18:36:21.813 INFO:tasks.workunit.client.0.smithi017.stdout:6/978: chown d4/df/d1f/c89 0 1 2024-09-20T18:36:21.814 INFO:tasks.workunit.client.0.smithi017.stdout:6/979: mknod d4/c149 0 2024-09-20T18:36:21.833 INFO:tasks.workunit.client.0.smithi017.stdout:6/980: write d4/f1e [5037191,78798] 0 2024-09-20T18:36:21.835 INFO:tasks.workunit.client.0.smithi017.stdout:6/981: mkdir d4/df/d14a 0 2024-09-20T18:36:21.837 INFO:tasks.workunit.client.0.smithi017.stdout:6/982: creat d4/d37/d130/f14b x:0 0 0 2024-09-20T18:36:21.838 INFO:tasks.workunit.client.0.smithi017.stdout:6/983: rmdir d4/df/d1f/df6 39 2024-09-20T18:36:21.839 INFO:tasks.workunit.client.0.smithi017.stdout:6/984: fdatasync d4/df/d1f/d25/f7c 0 2024-09-20T18:36:21.839 INFO:tasks.workunit.client.0.smithi017.stdout:6/985: chown l3 1199575246 1 2024-09-20T18:36:21.839 INFO:tasks.workunit.client.0.smithi017.stdout:6/986: readlink d4/le9 0 2024-09-20T18:36:21.845 INFO:tasks.workunit.client.0.smithi017.stdout:6/987: write d4/df/d1f/d25/d2b/fb7 [762283,68294] 0 2024-09-20T18:36:21.847 INFO:tasks.workunit.client.0.smithi017.stdout:6/988: write d4/d29/dc6/de7/ff9 [2134232,21237] 0 2024-09-20T18:36:21.856 INFO:tasks.workunit.client.0.smithi017.stdout:6/989: write d4/d37/d68/d8d/db2/dd4/dd9/f138 [158580,66801] 0 2024-09-20T18:36:21.859 INFO:tasks.workunit.client.0.smithi017.stdout:6/990: creat d4/df/d1f/d25/dd7/f14c x:0 0 0 2024-09-20T18:36:21.861 INFO:tasks.workunit.client.0.smithi017.stdout:6/991: creat d4/d37/d68/d8d/db2/dd4/dd9/f14d x:0 0 0 2024-09-20T18:36:21.868 INFO:tasks.workunit.client.0.smithi017.stdout:6/992: dwrite d4/d29/df5/f124 [0,4194304] 0 2024-09-20T18:36:21.872 INFO:tasks.workunit.client.0.smithi017.stdout:6/993: symlink d4/d37/d68/d8d/dba/l14e 0 2024-09-20T18:36:21.875 INFO:tasks.workunit.client.0.smithi017.stdout:6/994: creat d4/d37/d68/d8d/dba/f14f x:0 0 0 2024-09-20T18:36:21.877 INFO:tasks.workunit.client.0.smithi017.stdout:6/995: creat d4/df/d8a/f150 x:0 0 0 2024-09-20T18:36:21.883 INFO:tasks.workunit.client.0.smithi017.stdout:6/996: link d4/df/d4a/f6f d4/d37/d68/da4/d9e/f151 0 2024-09-20T18:36:21.887 INFO:tasks.workunit.client.0.smithi017.stdout:6/997: rename d4/d29/df5/d43/fd2 to d4/df/d1f/df6/f152 0 2024-09-20T18:36:21.892 INFO:tasks.workunit.client.0.smithi017.stdout:6/998: unlink d4/df/d4a/l117 0 2024-09-20T18:36:21.892 INFO:tasks.workunit.client.0.smithi017.stdout:6/999: chown d4/df/d1f/d25/dca/d13c 25 1 2024-09-20T18:36:21.895 INFO:tasks.workunit.client.0.smithi017.stdout:7/981: sync 2024-09-20T18:36:21.896 INFO:tasks.workunit.client.0.smithi017.stdout:7/982: unlink da/cfc 0 2024-09-20T18:36:21.898 INFO:tasks.workunit.client.0.smithi017.stdout:7/983: fdatasync da/d16/d1c/d40/d34/d3c/f53 0 2024-09-20T18:36:21.900 INFO:tasks.workunit.client.0.smithi017.stdout:7/984: dread - da/d16/d1c/d40/d5d/ffa zero size 2024-09-20T18:36:21.914 INFO:tasks.workunit.client.0.smithi017.stdout:7/985: dwrite da/d16/d92/fec [0,4194304] 0 2024-09-20T18:36:21.916 INFO:tasks.workunit.client.0.smithi017.stdout:7/986: truncate da/d16/d1c/dc9/f10f 927098 0 2024-09-20T18:36:22.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:21 smithi017 ceph-mon[28058]: pgmap v45: 65 pgs: 65 active+clean; 2.4 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 29 MiB/s rd, 67 MiB/s wr, 226 op/s 2024-09-20T18:36:22.193 INFO:tasks.workunit.client.0.smithi017.stdout:8/891: sync 2024-09-20T18:36:22.193 INFO:tasks.workunit.client.0.smithi017.stdout:4/871: sync 2024-09-20T18:36:22.196 INFO:tasks.workunit.client.0.smithi017.stdout:8/892: creat d0/d6/d28/d3b/d72/d98/da4/f126 x:0 0 0 2024-09-20T18:36:22.200 INFO:tasks.workunit.client.0.smithi017.stdout:8/893: mknod d0/d65/d8b/c127 0 2024-09-20T18:36:22.202 INFO:tasks.workunit.client.0.smithi017.stdout:8/894: fsync d0/d6/d28/d81/fb7 0 2024-09-20T18:36:22.203 INFO:tasks.workunit.client.0.smithi017.stdout:8/895: stat d0/d6/d28/d81/d9c/f11b 0 2024-09-20T18:36:22.205 INFO:tasks.workunit.client.0.smithi017.stdout:4/872: dread d4/d82/d88/d5c/d8f/da9/db4/db5/f107 [0,4194304] 0 2024-09-20T18:36:22.206 INFO:tasks.workunit.client.0.smithi017.stdout:4/873: write d4/d19/d37/d66/fdf [3305051,56766] 0 2024-09-20T18:36:22.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:21 smithi172 ceph-mon[35456]: pgmap v45: 65 pgs: 65 active+clean; 2.4 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 29 MiB/s rd, 67 MiB/s wr, 226 op/s 2024-09-20T18:36:22.210 INFO:tasks.workunit.client.0.smithi017.stdout:4/874: creat d4/d19/d37/da1/d113/f124 x:0 0 0 2024-09-20T18:36:22.214 INFO:tasks.workunit.client.0.smithi017.stdout:8/896: dread d0/d6/d28/d81/fee [0,4194304] 0 2024-09-20T18:36:22.224 INFO:tasks.workunit.client.0.smithi017.stdout:4/875: dwrite d4/d19/d37/dbc/d7a/f84 [0,4194304] 0 2024-09-20T18:36:22.227 INFO:tasks.workunit.client.0.smithi017.stdout:8/897: write d0/d6/d28/d3d/d4e/f75 [2021182,93540] 0 2024-09-20T18:36:22.234 INFO:tasks.workunit.client.0.smithi017.stdout:8/898: mkdir d0/d6/d93/d128 0 2024-09-20T18:36:22.236 INFO:tasks.workunit.client.0.smithi017.stdout:8/899: mkdir d0/d6/d28/d81/d9c/d129 0 2024-09-20T18:36:22.249 INFO:tasks.workunit.client.0.smithi017.stdout:8/900: dwrite d0/d6/d28/d3d/d4e/d55/d83/da2/fd6 [0,4194304] 0 2024-09-20T18:36:22.252 INFO:tasks.workunit.client.0.smithi017.stdout:8/901: read d0/f1e [1220618,512] 0 2024-09-20T18:36:22.258 INFO:tasks.workunit.client.0.smithi017.stdout:8/902: rename d0/d6/d28/d3d/d4e/d55/lb2 to d0/d6/d28/d81/d9c/l12a 0 2024-09-20T18:36:22.258 INFO:tasks.workunit.client.0.smithi017.stdout:8/903: creat d0/f12b x:0 0 0 2024-09-20T18:36:22.260 INFO:tasks.workunit.client.0.smithi017.stdout:8/904: dread d0/d65/d8b/db4/fc9 [0,4194304] 0 2024-09-20T18:36:22.263 INFO:tasks.workunit.client.0.smithi017.stdout:8/905: fsync d0/d6/d28/d3b/df1/f104 0 2024-09-20T18:36:22.265 INFO:tasks.workunit.client.0.smithi017.stdout:8/906: truncate d0/d6/d28/d81/d9c/f11b 973288 0 2024-09-20T18:36:22.266 INFO:tasks.workunit.client.0.smithi017.stdout:8/907: symlink d0/d6/d28/l12c 0 2024-09-20T18:36:22.270 INFO:tasks.workunit.client.0.smithi017.stdout:8/908: dread d0/d6/d28/f8c [0,4194304] 0 2024-09-20T18:36:22.277 INFO:tasks.workunit.client.0.smithi017.stdout:8/909: dwrite d0/d6/f1b [0,4194304] 0 2024-09-20T18:36:22.280 INFO:tasks.workunit.client.0.smithi017.stdout:8/910: mkdir d0/d6/d28/d3b/df1/d12d 0 2024-09-20T18:36:22.281 INFO:tasks.workunit.client.0.smithi017.stdout:8/911: chown d0/d6/d28/d3b/df1/f104 678 1 2024-09-20T18:36:22.283 INFO:tasks.workunit.client.0.smithi017.stdout:8/912: read d0/d6/d28/d3d/d4e/fbd [99040,59172] 0 2024-09-20T18:36:22.288 INFO:tasks.workunit.client.0.smithi017.stdout:8/913: rmdir d0/d6/d28/d3d/d4e/d55/d83/d121 0 2024-09-20T18:36:22.291 INFO:tasks.workunit.client.0.smithi017.stdout:8/914: unlink d0/d6/d28/d3b/d72/d98/c10d 0 2024-09-20T18:36:22.296 INFO:tasks.workunit.client.0.smithi017.stdout:8/915: dwrite d0/d6/d28/d81/fb7 [0,4194304] 0 2024-09-20T18:36:22.303 INFO:tasks.workunit.client.0.smithi017.stdout:8/916: mknod d0/d6/d28/d3b/c12e 0 2024-09-20T18:36:22.304 INFO:tasks.workunit.client.0.smithi017.stdout:7/987: sync 2024-09-20T18:36:22.306 INFO:tasks.workunit.client.0.smithi017.stdout:7/988: write da/d16/d8e/f52 [1097291,33910] 0 2024-09-20T18:36:22.309 INFO:tasks.workunit.client.0.smithi017.stdout:8/917: getdents d0 0 2024-09-20T18:36:22.310 INFO:tasks.workunit.client.0.smithi017.stdout:7/989: creat da/d16/d1c/d40/d34/f12c x:0 0 0 2024-09-20T18:36:22.312 INFO:tasks.workunit.client.0.smithi017.stdout:8/918: rmdir d0/d6/d28/d3d/d4e/d55/da8 39 2024-09-20T18:36:22.316 INFO:tasks.workunit.client.0.smithi017.stdout:7/990: write da/d16/d1c/f1d [3889415,88725] 0 2024-09-20T18:36:22.319 INFO:tasks.workunit.client.0.smithi017.stdout:7/991: symlink da/d16/d1c/d40/d34/d96/l12d 0 2024-09-20T18:36:22.322 INFO:tasks.workunit.client.0.smithi017.stdout:8/919: dwrite d0/d6/d28/d3b/df1/f104 [0,4194304] 0 2024-09-20T18:36:22.327 INFO:tasks.workunit.client.0.smithi017.stdout:8/920: mknod d0/d6/d28/d81/d9c/d129/c12f 0 2024-09-20T18:36:22.331 INFO:tasks.workunit.client.0.smithi017.stdout:8/921: rename d0/d6/d28/d3d/f120 to d0/d6/d93/d128/f130 0 2024-09-20T18:36:22.337 INFO:tasks.workunit.client.0.smithi017.stdout:7/992: dwrite da/d16/d1c/d40/d5d/ffa [0,4194304] 0 2024-09-20T18:36:22.342 INFO:tasks.workunit.client.0.smithi017.stdout:8/922: link d0/d6/f74 d0/d6/d28/d3d/d4e/f131 0 2024-09-20T18:36:22.348 INFO:tasks.workunit.client.0.smithi017.stdout:8/923: dwrite d0/f22 [0,4194304] 0 2024-09-20T18:36:22.353 INFO:tasks.workunit.client.0.smithi017.stdout:8/924: mkdir d0/d6/d28/d3b/d72/d132 0 2024-09-20T18:36:22.357 INFO:tasks.workunit.client.0.smithi017.stdout:8/925: creat d0/d6/d28/d3d/d4e/d55/d8a/f133 x:0 0 0 2024-09-20T18:36:22.362 INFO:tasks.workunit.client.0.smithi017.stdout:8/926: link d0/d6/d28/d3d/d4e/d55/f7f d0/d65/d8b/f134 0 2024-09-20T18:36:22.366 INFO:tasks.workunit.client.0.smithi017.stdout:7/993: dwrite da/d16/d1c/d40/d34/d3c/fce [0,4194304] 0 2024-09-20T18:36:22.366 INFO:tasks.workunit.client.0.smithi017.stdout:8/927: symlink d0/d6/d93/l135 0 2024-09-20T18:36:22.372 INFO:tasks.workunit.client.0.smithi017.stdout:7/994: mkdir da/d16/d1c/d40/d34/d106/d10d/d12e 0 2024-09-20T18:36:22.377 INFO:tasks.workunit.client.0.smithi017.stdout:7/995: creat da/d16/d1c/d40/d5d/da7/de5/d107/f12f x:0 0 0 2024-09-20T18:36:22.387 INFO:tasks.workunit.client.0.smithi017.stdout:8/928: link d0/d6/d28/d3d/d4e/d55/d83/da2/lac d0/d65/l136 0 2024-09-20T18:36:22.390 INFO:tasks.workunit.client.0.smithi017.stdout:8/929: mknod d0/d6/d93/dd1/c137 0 2024-09-20T18:36:22.392 INFO:tasks.workunit.client.0.smithi017.stdout:8/930: fdatasync d0/d6/d28/d81/d82/f84 0 2024-09-20T18:36:22.394 INFO:tasks.workunit.client.0.smithi017.stdout:8/931: truncate d0/d6/d28/d3d/d4e/d55/d8a/fa0 517710 0 2024-09-20T18:36:22.400 INFO:tasks.workunit.client.0.smithi017.stdout:8/932: creat d0/d6/d28/d3b/f138 x:0 0 0 2024-09-20T18:36:22.404 INFO:tasks.workunit.client.0.smithi017.stdout:7/996: dwrite da/d16/db5/f11d [0,4194304] 0 2024-09-20T18:36:22.411 INFO:tasks.workunit.client.0.smithi017.stdout:8/933: rename d0/d6/d28/d3d/d4e/l7a to d0/d6/d28/d3b/d72/d98/l139 0 2024-09-20T18:36:22.416 INFO:tasks.workunit.client.0.smithi017.stdout:8/934: rename d0/d6/d28/d3d/d4e/d55/d8a/f11e to d0/d65/d8b/db5/dbc/f13a 0 2024-09-20T18:36:22.419 INFO:tasks.workunit.client.0.smithi017.stdout:8/935: fsync d0/d65/d8b/db4/fc9 0 2024-09-20T18:36:22.422 INFO:tasks.workunit.client.0.smithi017.stdout:8/936: creat d0/d6/d28/d3d/d4e/d55/d83/da2/f13b x:0 0 0 2024-09-20T18:36:22.437 INFO:tasks.workunit.client.0.smithi017.stdout:7/997: dwrite da/d16/f3f [0,4194304] 0 2024-09-20T18:36:22.441 INFO:tasks.workunit.client.0.smithi017.stdout:7/998: mknod da/d16/d1c/d40/d34/dcd/c130 0 2024-09-20T18:36:22.442 INFO:tasks.workunit.client.0.smithi017.stdout:7/999: dread - da/d94/f12a zero size 2024-09-20T18:36:22.487 INFO:tasks.workunit.client.0.smithi017.stdout:4/876: sync 2024-09-20T18:36:22.495 INFO:tasks.workunit.client.0.smithi017.stdout:4/877: rename d4/d19/d37/da1/d1b/d56/l7d to d4/d19/d37/da1/d1b/d56/dfb/d10e/l125 0 2024-09-20T18:36:22.502 INFO:tasks.workunit.client.0.smithi017.stdout:4/878: dread d4/d19/d37/da1/d1b/d56/d67/f6e [0,4194304] 0 2024-09-20T18:36:22.502 INFO:tasks.workunit.client.0.smithi017.stdout:4/879: creat d4/d7f/f126 x:0 0 0 2024-09-20T18:36:22.514 INFO:tasks.workunit.client.0.smithi017.stdout:4/880: rename d4/d19 to d4/dc/def/d10a/d127 0 2024-09-20T18:36:22.514 INFO:tasks.workunit.client.0.smithi017.stdout:4/881: stat d4/f38 0 2024-09-20T18:36:22.515 INFO:tasks.workunit.client.0.smithi017.stdout:4/882: chown d4/dc/def/d10a/d127/d37/da1/fff 1012146 1 2024-09-20T18:36:22.523 INFO:tasks.workunit.client.0.smithi017.stdout:4/883: truncate d4/dc/def/d10a/d127/f42 2530402 0 2024-09-20T18:36:22.526 INFO:tasks.workunit.client.0.smithi017.stdout:4/884: write d4/d82/d88/d5c/d8f/da9/db4/db5/f107 [610890,127420] 0 2024-09-20T18:36:22.531 INFO:tasks.workunit.client.0.smithi017.stdout:4/885: link d4/dc/def/d10a/d127/d37/dbc/d7a/fc9 d4/dc/def/d10a/f128 0 2024-09-20T18:36:22.533 INFO:tasks.workunit.client.0.smithi017.stdout:4/886: creat d4/d82/d88/d5c/d8f/f129 x:0 0 0 2024-09-20T18:36:22.536 INFO:tasks.workunit.client.0.smithi017.stdout:4/887: creat d4/dc/def/f12a x:0 0 0 2024-09-20T18:36:22.536 INFO:tasks.workunit.client.0.smithi017.stdout:4/888: chown d4/f2c 2637 1 2024-09-20T18:36:22.538 INFO:tasks.workunit.client.0.smithi017.stdout:4/889: chown d4/dc/def/d10a/d127/d37/da1/d1b/f4c 0 1 2024-09-20T18:36:22.541 INFO:tasks.workunit.client.0.smithi017.stdout:4/890: truncate d4/dc/def/d10a/d127/f30 3704252 0 2024-09-20T18:36:22.542 INFO:tasks.workunit.client.0.smithi017.stdout:4/891: readlink d4/dc/def/d10a/d127/d37/da1/d1b/l89 0 2024-09-20T18:36:22.552 INFO:tasks.workunit.client.0.smithi017.stdout:4/892: write d4/dc/def/d10a/d127/d62/fb7 [613527,97520] 0 2024-09-20T18:36:22.568 INFO:tasks.workunit.client.0.smithi017.stdout:4/893: dread d4/f7 [0,4194304] 0 2024-09-20T18:36:22.579 INFO:tasks.workunit.client.0.smithi017.stdout:4/894: dwrite d4/dc/def/d10a/d127/d37/da1/f59 [0,4194304] 0 2024-09-20T18:36:22.580 INFO:tasks.workunit.client.0.smithi017.stdout:4/895: chown d4/dc/def/d10a/d127/d37/dbc/d79/lce 34596650 1 2024-09-20T18:36:22.581 INFO:tasks.workunit.client.0.smithi017.stdout:4/896: fsync d4/d7f/dc2/ffa 0 2024-09-20T18:36:22.582 INFO:tasks.workunit.client.0.smithi017.stdout:4/897: stat d4/dc/def/d10a/d127/dd0/de1/d11c 0 2024-09-20T18:36:22.585 INFO:tasks.workunit.client.0.smithi017.stdout:4/898: mknod d4/dc/def/d10a/d127/d37/da1/d1b/d56/dfb/c12b 0 2024-09-20T18:36:22.588 INFO:tasks.workunit.client.0.smithi017.stdout:4/899: rename d4/la8 to d4/dc/def/d10a/d110/l12c 0 2024-09-20T18:36:22.589 INFO:tasks.workunit.client.0.smithi017.stdout:4/900: write d4/d82/d88/f9b [3244901,17238] 0 2024-09-20T18:36:22.593 INFO:tasks.workunit.client.0.smithi017.stdout:4/901: dread d4/dc/def/d10a/d127/d37/da1/f59 [0,4194304] 0 2024-09-20T18:36:22.594 INFO:tasks.workunit.client.0.smithi017.stdout:4/902: chown d4/dc/def/d10a 12 1 2024-09-20T18:36:22.597 INFO:tasks.workunit.client.0.smithi017.stdout:4/903: unlink d4/dc/d1e/d26/fb8 0 2024-09-20T18:36:22.599 INFO:tasks.workunit.client.0.smithi017.stdout:4/904: mknod d4/d82/d88/c12d 0 2024-09-20T18:36:22.601 INFO:tasks.workunit.client.0.smithi017.stdout:4/905: mknod d4/dc/def/d10a/d127/c12e 0 2024-09-20T18:36:22.602 INFO:tasks.workunit.client.0.smithi017.stdout:4/906: truncate d4/dc/d1e/f73 1068042 0 2024-09-20T18:36:22.602 INFO:tasks.workunit.client.0.smithi017.stdout:4/907: dread - d4/d82/d88/d5c/d8f/ff1 zero size 2024-09-20T18:36:22.603 INFO:tasks.workunit.client.0.smithi017.stdout:4/908: fdatasync d4/f2c 0 2024-09-20T18:36:22.604 INFO:tasks.workunit.client.0.smithi017.stdout:4/909: dread - d4/dc/def/f12a zero size 2024-09-20T18:36:22.638 INFO:tasks.workunit.client.0.smithi017.stdout:4/910: write d4/dc/def/d10a/d127/d62/fee [92233,51111] 0 2024-09-20T18:36:22.650 INFO:tasks.workunit.client.0.smithi017.stdout:4/911: dread f3 [0,4194304] 0 2024-09-20T18:36:22.653 INFO:tasks.workunit.client.0.smithi017.stdout:4/912: mkdir d4/d82/d88/d5c/d97/d12f 0 2024-09-20T18:36:22.654 INFO:tasks.workunit.client.0.smithi017.stdout:4/913: chown d4/dc/def/d10a/d127/d37/da1/f59 105560779 1 2024-09-20T18:36:22.654 INFO:tasks.workunit.client.0.smithi017.stdout:4/914: chown d4/f6c 242506472 1 2024-09-20T18:36:22.668 INFO:tasks.workunit.client.0.smithi017.stdout:4/915: dread d4/dc/def/d10a/d127/f30 [0,4194304] 0 2024-09-20T18:36:22.671 INFO:tasks.workunit.client.0.smithi017.stdout:4/916: creat d4/dc/def/d10a/d127/d37/da1/d1b/d56/f130 x:0 0 0 2024-09-20T18:36:22.674 INFO:tasks.workunit.client.0.smithi017.stdout:4/917: write d4/dc/def/d10a/d127/f1f [13584026,40295] 0 2024-09-20T18:36:22.680 INFO:tasks.workunit.client.0.smithi017.stdout:4/918: rename d4/dc/def/d10a/d127/d37/da1/d1b/d56/d67/lb2 to d4/dc/def/d10a/d127/d37/d66/l131 0 2024-09-20T18:36:22.682 INFO:tasks.workunit.client.0.smithi017.stdout:8/937: sync 2024-09-20T18:36:22.684 INFO:tasks.workunit.client.0.smithi017.stdout:4/919: dread d4/d82/d88/f21 [4194304,4194304] 0 2024-09-20T18:36:22.686 INFO:tasks.workunit.client.0.smithi017.stdout:4/920: write d4/dc/def/d10a/d127/d37/f57 [879819,18749] 0 2024-09-20T18:36:22.687 INFO:tasks.workunit.client.0.smithi017.stdout:8/938: truncate d0/d65/d8b/f134 2374000 0 2024-09-20T18:36:22.693 INFO:tasks.workunit.client.0.smithi017.stdout:8/939: mknod d0/d6/d28/d3b/d72/d98/da4/c13c 0 2024-09-20T18:36:22.699 INFO:tasks.workunit.client.0.smithi017.stdout:8/940: symlink d0/d6/d28/d3d/d4e/l13d 0 2024-09-20T18:36:22.701 INFO:tasks.workunit.client.0.smithi017.stdout:4/921: dread d4/dc/def/d10a/d127/d37/fea [0,4194304] 0 2024-09-20T18:36:22.705 INFO:tasks.workunit.client.0.smithi017.stdout:4/922: symlink d4/dc/def/d10a/d127/dd0/de1/l132 0 2024-09-20T18:36:22.711 INFO:tasks.workunit.client.0.smithi017.stdout:4/923: dwrite d4/d82/d88/d5c/d8f/ff1 [0,4194304] 0 2024-09-20T18:36:22.757 INFO:tasks.workunit.client.0.smithi017.stdout:4/924: dread d4/f4b [0,4194304] 0 2024-09-20T18:36:22.766 INFO:tasks.workunit.client.0.smithi017.stdout:4/925: creat d4/dc/def/d10a/d127/d37/dbc/f133 x:0 0 0 2024-09-20T18:36:22.767 INFO:tasks.workunit.client.0.smithi017.stdout:4/926: fsync d4/dc/def/d10a/d127/d62/fee 0 2024-09-20T18:36:22.770 INFO:tasks.workunit.client.0.smithi017.stdout:4/927: mknod d4/d82/d88/c134 0 2024-09-20T18:36:22.771 INFO:tasks.workunit.client.0.smithi017.stdout:4/928: chown d4/l5 85671 1 2024-09-20T18:36:22.772 INFO:tasks.workunit.client.0.smithi017.stdout:4/929: chown d4/dc/def/d10a/d127/d37/f5a 189678 1 2024-09-20T18:36:22.782 INFO:tasks.workunit.client.0.smithi017.stdout:8/941: dwrite d0/d65/d8b/d91/fa5 [0,4194304] 0 2024-09-20T18:36:22.784 INFO:tasks.workunit.client.0.smithi017.stdout:8/942: dread - d0/d6/d28/d3b/d72/f10a zero size 2024-09-20T18:36:22.787 INFO:tasks.workunit.client.0.smithi017.stdout:4/930: dwrite d4/dc/def/d10a/d127/d37/da1/d1b/d56/d67/f6e [0,4194304] 0 2024-09-20T18:36:22.787 INFO:tasks.workunit.client.0.smithi017.stdout:8/943: write d0/d6/d28/d3d/d4e/ffc [657885,46999] 0 2024-09-20T18:36:22.792 INFO:tasks.workunit.client.0.smithi017.stdout:8/944: dread d0/d6/d28/d81/fb7 [0,4194304] 0 2024-09-20T18:36:22.829 INFO:tasks.workunit.client.0.smithi017.stdout:4/931: creat d4/dc/def/d10a/d110/f135 x:0 0 0 2024-09-20T18:36:22.841 INFO:tasks.workunit.client.0.smithi017.stdout:4/932: creat d4/dc/def/d10a/d127/d37/dbc/f136 x:0 0 0 2024-09-20T18:36:22.845 INFO:tasks.workunit.client.0.smithi017.stdout:4/933: mkdir d4/d82/d88/d5c/d8f/da9/db4/dde/d10d/d137 0 2024-09-20T18:36:22.846 INFO:tasks.workunit.client.0.smithi017.stdout:4/934: read d4/dc/def/d10a/f128 [2448202,14162] 0 2024-09-20T18:36:22.854 INFO:tasks.workunit.client.0.smithi017.stdout:4/935: rmdir d4/d82/d88/d5c/d8f/da9/db4/dde 39 2024-09-20T18:36:22.891 INFO:tasks.workunit.client.0.smithi017.stdout:8/945: write d0/d6/f54 [2413630,97407] 0 2024-09-20T18:36:22.892 INFO:tasks.workunit.client.0.smithi017.stdout:8/946: fdatasync d0/d6/d28/d3d/fce 0 2024-09-20T18:36:22.906 INFO:tasks.workunit.client.0.smithi017.stdout:4/936: write d4/dc/def/d10a/d127/d37/d66/fa2 [4948980,1643] 0 2024-09-20T18:36:22.910 INFO:tasks.workunit.client.0.smithi017.stdout:8/947: creat d0/d6/d28/f13e x:0 0 0 2024-09-20T18:36:22.913 INFO:tasks.workunit.client.0.smithi017.stdout:4/937: dwrite d4/d82/d88/d5c/d8f/f129 [0,4194304] 0 2024-09-20T18:36:22.915 INFO:tasks.workunit.client.0.smithi017.stdout:4/938: fsync d4/d7f/f126 0 2024-09-20T18:36:22.916 INFO:tasks.workunit.client.0.smithi017.stdout:8/948: mkdir d0/d6/d28/d3b/d72/d98/d117/d13f 0 2024-09-20T18:36:22.919 INFO:tasks.workunit.client.0.smithi017.stdout:4/939: creat d4/dc/def/d10a/d127/d37/da1/d1b/daa/f138 x:0 0 0 2024-09-20T18:36:22.921 INFO:tasks.workunit.client.0.smithi017.stdout:4/940: chown d4/dc/def/d10a/d127/d37/da1/d1b/d56/d67 3974 1 2024-09-20T18:36:22.930 INFO:tasks.workunit.client.0.smithi017.stdout:4/941: rename d4/dc/def/d10a/d127/d37/da1/c4d to d4/dc/def/d10a/d127/d37/da1/d1b/d56/d67/db9/de5/c139 0 2024-09-20T18:36:22.932 INFO:tasks.workunit.client.0.smithi017.stdout:8/949: link d0/d6/d28/d3b/d72/d98/da4/c13c d0/d6/d28/d3b/df1/c140 0 2024-09-20T18:36:22.967 INFO:tasks.workunit.client.0.smithi017.stdout:4/942: dwrite d4/dc/def/d10a/d127/d37/da1/fff [0,4194304] 0 2024-09-20T18:36:22.969 INFO:tasks.workunit.client.0.smithi017.stdout:4/943: rmdir d4/d82/d88/d5c 39 2024-09-20T18:36:22.977 INFO:tasks.workunit.client.0.smithi017.stdout:4/944: dwrite d4/dc/f12 [0,4194304] 0 2024-09-20T18:36:22.980 INFO:tasks.workunit.client.0.smithi017.stdout:4/945: creat d4/d82/d88/d5c/d8f/d92/f13a x:0 0 0 2024-09-20T18:36:22.983 INFO:tasks.workunit.client.0.smithi017.stdout:4/946: mkdir d4/dc/def/d10a/d127/d37/da1/d1b/d56/dfb/d10e/d10f/d13b 0 2024-09-20T18:36:22.984 INFO:tasks.workunit.client.0.smithi017.stdout:4/947: mknod d4/d7f/c13c 0 2024-09-20T18:36:22.987 INFO:tasks.workunit.client.0.smithi017.stdout:4/948: mkdir d4/d82/d88/d5c/d97/d12f/d13d 0 2024-09-20T18:36:22.993 INFO:tasks.workunit.client.0.smithi017.stdout:4/949: dwrite d4/dc/f12 [4194304,4194304] 0 2024-09-20T18:36:22.998 INFO:tasks.workunit.client.0.smithi017.stdout:4/950: creat d4/dc/def/d10a/d127/d37/da1/de4/f13e x:0 0 0 2024-09-20T18:36:23.002 INFO:tasks.workunit.client.0.smithi017.stdout:4/951: creat d4/d82/d88/d5c/d8f/da9/f13f x:0 0 0 2024-09-20T18:36:23.006 INFO:tasks.workunit.client.0.smithi017.stdout:4/952: dread d4/dc/def/d10a/d127/d37/d66/fdf [0,4194304] 0 2024-09-20T18:36:23.010 INFO:tasks.workunit.client.0.smithi017.stdout:4/953: fsync d4/dc/def/d10a/d127/d37/da1/d1b/f103 0 2024-09-20T18:36:23.012 INFO:tasks.workunit.client.0.smithi017.stdout:4/954: mknod d4/dc/def/d10a/d127/d37/d66/c140 0 2024-09-20T18:36:23.014 INFO:tasks.workunit.client.0.smithi017.stdout:4/955: dread - d4/dc/def/d10a/d127/d37/da1/de4/f13e zero size 2024-09-20T18:36:23.036 INFO:tasks.workunit.client.0.smithi017.stdout:4/956: write d4/f38 [8153084,102924] 0 2024-09-20T18:36:23.039 INFO:tasks.workunit.client.0.smithi017.stdout:4/957: rmdir d4/dc/def/d10a/d127/d37/da1/d1b/d56/dfb/d10e/d10f 39 2024-09-20T18:36:23.041 INFO:tasks.workunit.client.0.smithi017.stdout:4/958: chown d4/dc/def/d10a/d127/d37/da1/d1b/d56/dfb/d10e/l125 0 1 2024-09-20T18:36:23.042 INFO:tasks.workunit.client.0.smithi017.stdout:4/959: readlink d4/dc/def/d10a/d127/d37/dbc/d96/ld3 0 2024-09-20T18:36:23.043 INFO:tasks.workunit.client.0.smithi017.stdout:4/960: write d4/d82/d88/d5c/d8f/da9/db4/db5/f107 [2835759,60682] 0 2024-09-20T18:36:23.058 INFO:tasks.workunit.client.0.smithi017.stdout:4/961: dread d4/dc/def/d10a/d127/fd8 [0,4194304] 0 2024-09-20T18:36:23.061 INFO:tasks.workunit.client.0.smithi017.stdout:4/962: creat d4/dc/def/d10a/f141 x:0 0 0 2024-09-20T18:36:23.064 INFO:tasks.workunit.client.0.smithi017.stdout:4/963: stat d4/dc/def/d10a/d127/d37/da1/d1b/d56/dfb/d10e/d10f 0 2024-09-20T18:36:23.066 INFO:tasks.workunit.client.0.smithi017.stdout:4/964: fsync d4/dc/def/d10a/d127/d37/da1/d1b/fcb 0 2024-09-20T18:36:23.070 INFO:tasks.workunit.client.0.smithi017.stdout:4/965: creat d4/dc/def/d10a/d127/d37/da1/d65/da0/f142 x:0 0 0 2024-09-20T18:36:23.073 INFO:tasks.workunit.client.0.smithi017.stdout:4/966: link d4/f4b d4/dc/def/d10a/d11b/f143 0 2024-09-20T18:36:23.074 INFO:tasks.workunit.client.0.smithi017.stdout:4/967: dread - d4/dc/def/d10a/d127/d37/da1/d1b/f10c zero size 2024-09-20T18:36:23.077 INFO:tasks.workunit.client.0.smithi017.stdout:4/968: rmdir d4/dc/def/d10a/d127/d37/dbc/d96/d116 39 2024-09-20T18:36:23.086 INFO:tasks.workunit.client.0.smithi017.stdout:4/969: dread d4/dc/def/d10a/d127/d37/da1/d1b/f4c [0,4194304] 0 2024-09-20T18:36:23.090 INFO:tasks.workunit.client.0.smithi017.stdout:4/970: creat d4/dc/def/d10a/d127/d37/dbc/d96/d116/f144 x:0 0 0 2024-09-20T18:36:23.095 INFO:tasks.workunit.client.0.smithi017.stdout:4/971: dread d4/dc/def/d10a/d127/d37/da1/fff [0,4194304] 0 2024-09-20T18:36:23.133 INFO:tasks.workunit.client.0.smithi017.stdout:4/972: unlink d4/d82/d88/d5c/ff8 0 2024-09-20T18:36:23.141 INFO:tasks.workunit.client.0.smithi017.stdout:4/973: unlink l2 0 2024-09-20T18:36:23.143 INFO:tasks.workunit.client.0.smithi017.stdout:4/974: chown d4/dc/def/d10a/d127/d37/da1/d1b/f81 110468739 1 2024-09-20T18:36:23.148 INFO:tasks.workunit.client.0.smithi017.stdout:4/975: unlink d4/dc/d41/fbd 0 2024-09-20T18:36:23.799 INFO:tasks.workunit.client.0.smithi017.stdout:8/950: sync 2024-09-20T18:36:23.799 INFO:tasks.workunit.client.0.smithi017.stdout:4/976: sync 2024-09-20T18:36:23.800 INFO:tasks.workunit.client.0.smithi017.stdout:4/977: readlink d4/d82/d88/ld4 0 2024-09-20T18:36:23.808 INFO:tasks.workunit.client.0.smithi017.stdout:8/951: mkdir d0/d6/d93/d141 0 2024-09-20T18:36:23.809 INFO:tasks.workunit.client.0.smithi017.stdout:4/978: rename d4/dc/d1e/c8b to d4/dc/def/d10a/d127/d37/dd9/c145 0 2024-09-20T18:36:23.812 INFO:tasks.workunit.client.0.smithi017.stdout:8/952: symlink d0/d6/d28/d3b/d72/d98/d117/d13f/l142 0 2024-09-20T18:36:23.812 INFO:tasks.workunit.client.0.smithi017.stdout:8/953: stat d0/d6/l26 0 2024-09-20T18:36:23.814 INFO:tasks.workunit.client.0.smithi017.stdout:8/954: truncate d0/d6/d28/d3d/d4e/d55/d83/fd5 5175950 0 2024-09-20T18:36:23.814 INFO:tasks.workunit.client.0.smithi017.stdout:4/979: creat d4/d82/d88/d5c/d8f/da9/db4/dde/d10d/f146 x:0 0 0 2024-09-20T18:36:23.815 INFO:tasks.workunit.client.0.smithi017.stdout:4/980: write d4/d82/d88/d5c/d8f/da9/f13f [548598,60094] 0 2024-09-20T18:36:23.817 INFO:tasks.workunit.client.0.smithi017.stdout:4/981: write d4/dc/def/d10a/d127/d37/dbc/d96/d116/f144 [705445,47007] 0 2024-09-20T18:36:23.818 INFO:tasks.workunit.client.0.smithi017.stdout:8/955: creat d0/d6/d28/d3b/d72/d108/f143 x:0 0 0 2024-09-20T18:36:23.820 INFO:tasks.workunit.client.0.smithi017.stdout:8/956: write d0/d6/d28/d81/d9c/fc1 [917888,91253] 0 2024-09-20T18:36:23.823 INFO:tasks.workunit.client.0.smithi017.stdout:8/957: creat d0/d6/d28/d81/d82/f144 x:0 0 0 2024-09-20T18:36:23.825 INFO:tasks.workunit.client.0.smithi017.stdout:8/958: mkdir d0/d6/d28/d3b/d72/d98/d117/d145 0 2024-09-20T18:36:23.828 INFO:tasks.workunit.client.0.smithi017.stdout:8/959: unlink d0/d6/d28/d3d/d4e/d55/fcc 0 2024-09-20T18:36:23.835 INFO:tasks.workunit.client.0.smithi017.stdout:8/960: dwrite d0/d6/d28/d81/d82/f144 [0,4194304] 0 2024-09-20T18:36:23.856 INFO:tasks.workunit.client.0.smithi017.stdout:8/961: write d0/d6/d93/dd1/fd9 [137737,30818] 0 2024-09-20T18:36:23.857 INFO:tasks.workunit.client.0.smithi017.stdout:4/982: write d4/dc/d1e/d26/fad [50518,60382] 0 2024-09-20T18:36:23.857 INFO:tasks.workunit.client.0.smithi017.stdout:8/962: stat d0/d6/d28/d3b/fde 0 2024-09-20T18:36:23.858 INFO:tasks.workunit.client.0.smithi017.stdout:8/963: stat d0/d6/d28/d3b/df1/d12d 0 2024-09-20T18:36:23.861 INFO:tasks.workunit.client.0.smithi017.stdout:4/983: truncate d4/dc/def/d10a/d127/d37/dbc/f72 105309 0 2024-09-20T18:36:23.863 INFO:tasks.workunit.client.0.smithi017.stdout:8/964: write d0/d6/f7e [9489475,110819] 0 2024-09-20T18:36:23.863 INFO:tasks.workunit.client.0.smithi017.stdout:4/984: truncate d4/dc/def/d10a/d110/f135 364412 0 2024-09-20T18:36:23.867 INFO:tasks.workunit.client.0.smithi017.stdout:8/965: truncate d0/d6/d28/d81/fee 835374 0 2024-09-20T18:36:23.869 INFO:tasks.workunit.client.0.smithi017.stdout:8/966: write d0/d65/d8b/d91/fa5 [3375748,85320] 0 2024-09-20T18:36:23.871 INFO:tasks.workunit.client.0.smithi017.stdout:8/967: truncate d0/d6/d28/d3d/d4e/fbd 1404435 0 2024-09-20T18:36:23.877 INFO:tasks.workunit.client.0.smithi017.stdout:8/968: creat d0/d6/d28/d3d/d4e/d55/df4/f146 x:0 0 0 2024-09-20T18:36:23.882 INFO:tasks.workunit.client.0.smithi017.stdout:4/985: dwrite d4/dc/def/d10a/d127/fd8 [0,4194304] 0 2024-09-20T18:36:23.887 INFO:tasks.workunit.client.0.smithi017.stdout:4/986: write d4/f7 [5268536,58997] 0 2024-09-20T18:36:23.889 INFO:tasks.workunit.client.0.smithi017.stdout:8/969: link d0/d6/d93/faf d0/d6/d28/d3d/d4e/d55/da8/f147 0 2024-09-20T18:36:23.893 INFO:tasks.workunit.client.0.smithi017.stdout:4/987: mkdir d4/dc/def/d10a/d127/d37/da1/d1b/d56/d67/db9/de5/d147 0 2024-09-20T18:36:23.894 INFO:tasks.workunit.client.0.smithi017.stdout:8/970: stat d0/d6/d28/d3b/d72/d98/da4/lab 0 2024-09-20T18:36:23.895 INFO:tasks.workunit.client.0.smithi017.stdout:8/971: readlink d0/d6/d28/l12c 0 2024-09-20T18:36:23.897 INFO:tasks.workunit.client.0.smithi017.stdout:4/988: mknod d4/dc/def/d10a/d127/d37/da1/d1b/d56/d67/c148 0 2024-09-20T18:36:23.899 INFO:tasks.workunit.client.0.smithi017.stdout:8/972: rename d0/d6/d93/l135 to d0/d6/d28/d3b/d72/d132/l148 0 2024-09-20T18:36:23.903 INFO:tasks.workunit.client.0.smithi017.stdout:4/989: dread d4/dc/def/d10a/d127/d37/da1/fff [0,4194304] 0 2024-09-20T18:36:23.903 INFO:tasks.workunit.client.0.smithi017.stdout:8/973: rename d0/d6/d73/l7b to d0/d6/d28/d3b/d72/d98/da4/l149 0 2024-09-20T18:36:23.906 INFO:tasks.workunit.client.0.smithi017.stdout:8/974: symlink d0/d6/d28/d3b/d72/d98/d117/d145/l14a 0 2024-09-20T18:36:23.907 INFO:tasks.workunit.client.0.smithi017.stdout:4/990: truncate d4/dc/def/d10a/d127/d37/da1/d1b/daa/f138 999727 0 2024-09-20T18:36:23.909 INFO:tasks.workunit.client.0.smithi017.stdout:4/991: creat d4/d7f/f149 x:0 0 0 2024-09-20T18:36:23.909 INFO:tasks.workunit.client.0.smithi017.stdout:8/975: mknod d0/d65/c14b 0 2024-09-20T18:36:23.914 INFO:tasks.workunit.client.0.smithi017.stdout:4/992: dread d4/dc/def/d10a/d127/d37/dbc/f87 [0,4194304] 0 2024-09-20T18:36:23.915 INFO:tasks.workunit.client.0.smithi017.stdout:4/993: chown d4/c74 951 1 2024-09-20T18:36:23.921 INFO:tasks.workunit.client.0.smithi017.stdout:4/994: rmdir d4/dc/def/d10a/d127/d37/da1/d1b/d56/dfb/d10e/d10f 39 2024-09-20T18:36:23.922 INFO:tasks.workunit.client.0.smithi017.stdout:4/995: dread - d4/dc/def/d10a/d127/d37/da1/d65/fe9 zero size 2024-09-20T18:36:23.926 INFO:tasks.workunit.client.0.smithi017.stdout:4/996: symlink d4/d82/d88/d5c/d8f/da9/db4/dde/d10d/l14a 0 2024-09-20T18:36:23.937 INFO:tasks.workunit.client.0.smithi017.stdout:8/976: chown d0/d6/d28/d3b/d72/d132/l148 1904052 1 2024-09-20T18:36:23.938 INFO:tasks.workunit.client.0.smithi017.stdout:8/977: write d0/d6/d28/d3d/d4e/d55/d83/fe7 [1169034,65001] 0 2024-09-20T18:36:23.949 INFO:tasks.workunit.client.0.smithi017.stdout:8/978: rename d0/d6/d28/d3d/d4e/d55/da8/fc4 to d0/d6/d28/f14c 0 2024-09-20T18:36:23.950 INFO:tasks.workunit.client.0.smithi017.stdout:8/979: symlink d0/d6/d28/d81/d9c/d129/l14d 2 2024-09-20T18:36:23.953 INFO:tasks.workunit.client.0.smithi017.stdout:8/980: creat d0/d6/d28/d3b/d72/f14e x:0 0 0 2024-09-20T18:36:23.959 INFO:tasks.workunit.client.0.smithi017.stdout:4/997: write d4/dc/d1e/f55 [381199,125472] 0 2024-09-20T18:36:23.966 INFO:tasks.workunit.client.0.smithi017.stdout:8/981: dread d0/d6/d28/d3d/d4e/f75 [0,4194304] 0 2024-09-20T18:36:23.970 INFO:tasks.workunit.client.0.smithi017.stdout:4/998: write d4/f4b [962433,39959] 0 2024-09-20T18:36:23.974 INFO:tasks.workunit.client.0.smithi017.stdout:8/982: rename d0/d6/d28/d81/d82/c123 to d0/d6/d28/d3b/d72/d108/c14f 0 2024-09-20T18:36:23.977 INFO:tasks.workunit.client.0.smithi017.stdout:4/999: dwrite d4/dc/def/d10a/d127/d37/d66/fc4 [0,4194304] 0 2024-09-20T18:36:23.981 INFO:tasks.workunit.client.0.smithi017.stdout:8/983: creat d0/d6/d28/d3d/f150 x:0 0 0 2024-09-20T18:36:23.983 INFO:tasks.workunit.client.0.smithi017.stdout:8/984: creat d0/d6/d28/d3b/d72/d108/dae/f151 x:0 0 0 2024-09-20T18:36:24.004 INFO:tasks.workunit.client.0.smithi017.stdout:8/985: dwrite d0/d6/d28/d3d/d4e/f131 [0,4194304] 0 2024-09-20T18:36:24.005 INFO:tasks.workunit.client.0.smithi017.stdout:8/986: read d0/d6/d28/d3d/d4e/d55/d83/f9f [2421722,18557] 0 2024-09-20T18:36:24.008 INFO:tasks.workunit.client.0.smithi017.stdout:8/987: mkdir d0/d6/d28/d3d/d4e/d152 0 2024-09-20T18:36:24.010 INFO:tasks.workunit.client.0.smithi017.stdout:8/988: getdents d0/d6/d28/d3d/d4e/d55/d8a/dfa 0 2024-09-20T18:36:24.014 INFO:tasks.workunit.client.0.smithi017.stdout:8/989: rename d0/d65/d8b/d91 to d0/d6/d28/d3b/d72/d108/dae/d153 0 2024-09-20T18:36:24.016 INFO:tasks.workunit.client.0.smithi017.stdout:8/990: mkdir d0/d6/d93/d154 0 2024-09-20T18:36:24.041 INFO:tasks.workunit.client.0.smithi017.stdout:8/991: dwrite d0/d6/d28/d81/fb7 [0,4194304] 0 2024-09-20T18:36:24.042 INFO:tasks.workunit.client.0.smithi017.stdout:8/992: dread - d0/d6/d28/d3b/d72/f14e zero size 2024-09-20T18:36:24.046 INFO:tasks.workunit.client.0.smithi017.stdout:8/993: mknod d0/d6/d28/d3b/c155 0 2024-09-20T18:36:24.047 INFO:tasks.workunit.client.0.smithi017.stdout:8/994: chown d0/d6/d28/d3b/c44 31822 1 2024-09-20T18:36:24.051 INFO:tasks.workunit.client.0.smithi017.stdout:8/995: rename d0/d6/d28/f14c to d0/d6/d28/d3d/d4e/d55/d8a/dfa/f156 0 2024-09-20T18:36:24.064 INFO:tasks.workunit.client.0.smithi017.stdout:8/996: dread d0/d6/d28/d3b/fe9 [0,4194304] 0 2024-09-20T18:36:24.067 INFO:tasks.workunit.client.0.smithi017.stdout:8/997: unlink d0/fc8 0 2024-09-20T18:36:24.084 INFO:tasks.workunit.client.0.smithi017.stdout:8/998: getdents d0/d65/d8b/db4 0 2024-09-20T18:36:24.086 INFO:tasks.workunit.client.0.smithi017.stdout:8/999: write d0/d65/d8b/db5/fcb [1166306,110245] 0 2024-09-20T18:36:24.090 INFO:tasks.workunit.client.0.smithi017.stderr:+ rm -rf -- ./tmp.WInPXSzCyU 2024-09-20T18:36:24.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:23 smithi017 ceph-mon[28058]: pgmap v46: 65 pgs: 65 active+clean; 2.4 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 29 MiB/s rd, 67 MiB/s wr, 226 op/s 2024-09-20T18:36:24.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:23 smithi172 ceph-mon[35456]: pgmap v46: 65 pgs: 65 active+clean; 2.4 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 29 MiB/s rd, 67 MiB/s wr, 226 op/s 2024-09-20T18:36:26.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:25 smithi017 ceph-mon[28058]: pgmap v47: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 47 MiB/s rd, 106 MiB/s wr, 350 op/s 2024-09-20T18:36:26.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:25 smithi172 ceph-mon[35456]: pgmap v47: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 47 MiB/s rd, 106 MiB/s wr, 350 op/s 2024-09-20T18:36:26.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:26 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:26.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:26 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:26.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:26 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:36:27.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:26 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:27.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:26 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:27.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:26 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:36:28.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:27 smithi017 ceph-mon[28058]: pgmap v48: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 31 MiB/s rd, 72 MiB/s wr, 227 op/s 2024-09-20T18:36:28.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:27 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:36:28.159 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:27 smithi172 ceph-mon[35456]: pgmap v48: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 31 MiB/s rd, 72 MiB/s wr, 227 op/s 2024-09-20T18:36:28.159 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:27 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:36:30.094 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:29 smithi017 ceph-mon[28058]: pgmap v49: 65 pgs: 65 active+clean; 2.0 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 33 MiB/s rd, 76 MiB/s wr, 283 op/s 2024-09-20T18:36:30.095 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:29 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:30.095 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:29 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:30.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:29 smithi172 ceph-mon[35456]: pgmap v49: 65 pgs: 65 active+clean; 2.0 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 33 MiB/s rd, 76 MiB/s wr, 283 op/s 2024-09-20T18:36:30.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:29 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:30.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:29 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:30.969 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:30 smithi017 ceph-mon[28058]: mgrmap e26: smithi172.jczphg(active, since 93s), standbys: smithi017.xusjwd 2024-09-20T18:36:31.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:30 smithi172 ceph-mon[35456]: mgrmap e26: smithi172.jczphg(active, since 93s), standbys: smithi017.xusjwd 2024-09-20T18:36:32.847 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:32 smithi017 ceph-mon[28058]: pgmap v50: 65 pgs: 65 active+clean; 2.0 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 20 MiB/s rd, 44 MiB/s wr, 180 op/s 2024-09-20T18:36:32.848 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:32 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:32.848 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:32 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:32.848 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:32 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:32.848 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:32 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:32.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:32 smithi172 ceph-mon[35456]: pgmap v50: 65 pgs: 65 active+clean; 2.0 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 20 MiB/s rd, 44 MiB/s wr, 180 op/s 2024-09-20T18:36:32.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:32 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:32.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:32 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:32.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:32 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:32.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:32 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:33.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:33 smithi017 ceph-mon[28058]: Standby manager daemon smithi017.xusjwd restarted 2024-09-20T18:36:33.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:33 smithi017 ceph-mon[28058]: Standby manager daemon smithi017.xusjwd started 2024-09-20T18:36:33.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:33 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi017.xusjwd/crt"}]: dispatch 2024-09-20T18:36:33.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:33 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T18:36:33.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:33 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi017.xusjwd/key"}]: dispatch 2024-09-20T18:36:33.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:33 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T18:36:33.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:33 smithi172 ceph-mon[35456]: Standby manager daemon smithi017.xusjwd restarted 2024-09-20T18:36:33.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:33 smithi172 ceph-mon[35456]: Standby manager daemon smithi017.xusjwd started 2024-09-20T18:36:33.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:33 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi017.xusjwd/crt"}]: dispatch 2024-09-20T18:36:33.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:33 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T18:36:33.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:33 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi017.xusjwd/key"}]: dispatch 2024-09-20T18:36:33.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:33 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T18:36:34.551 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:34 smithi017 ceph-mon[28058]: pgmap v51: 65 pgs: 65 active+clean; 2.0 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 20 MiB/s rd, 44 MiB/s wr, 180 op/s 2024-09-20T18:36:34.551 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:34 smithi017 ceph-mon[28058]: mgrmap e27: smithi172.jczphg(active, since 96s), standbys: smithi017.xusjwd 2024-09-20T18:36:34.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:34 smithi172 ceph-mon[35456]: pgmap v51: 65 pgs: 65 active+clean; 2.0 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 20 MiB/s rd, 44 MiB/s wr, 180 op/s 2024-09-20T18:36:34.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:34 smithi172 ceph-mon[35456]: mgrmap e27: smithi172.jczphg(active, since 96s), standbys: smithi017.xusjwd 2024-09-20T18:36:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: pgmap v52: 65 pgs: 65 active+clean; 1.5 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 20 MiB/s rd, 45 MiB/s wr, 238 op/s 2024-09-20T18:36:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:36:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:36:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:36:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mgr fail", "who": "smithi172.jczphg"}]: dispatch 2024-09-20T18:36:36.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mgr fail", "who": "smithi172.jczphg"}]: dispatch 2024-09-20T18:36:36.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: Activating manager daemon smithi017.xusjwd 2024-09-20T18:36:36.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd='[{"prefix": "mgr fail", "who": "smithi172.jczphg"}]': finished 2024-09-20T18:36:36.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: osdmap e46: 6 total, 6 up, 6 in 2024-09-20T18:36:36.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: mgrmap e28: smithi017.xusjwd(active, starting, since 0.00647333s) 2024-09-20T18:36:36.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-09-20T18:36:36.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:36:36.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.puqizo"}]: dispatch 2024-09-20T18:36:36.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.xhlvpy"}]: dispatch 2024-09-20T18:36:36.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.mugtlk"}]: dispatch 2024-09-20T18:36:36.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.liatxm"}]: dispatch 2024-09-20T18:36:36.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr metadata", "who": "smithi017.xusjwd", "id": "smithi017.xusjwd"}]: dispatch 2024-09-20T18:36:36.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:36:36.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T18:36:36.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T18:36:36.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:36:36.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T18:36:36.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T18:36:36.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T18:36:36.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T18:36:36.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T18:36:36.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:36 smithi172 ceph-mon[35456]: Manager daemon smithi017.xusjwd is now available 2024-09-20T18:36:36.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: pgmap v52: 65 pgs: 65 active+clean; 1.5 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 20 MiB/s rd, 45 MiB/s wr, 238 op/s 2024-09-20T18:36:36.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:36.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:36.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:36:36.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:36:36.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' 2024-09-20T18:36:36.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:36:36.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.24405 172.21.15.172:0/4232829091' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mgr fail", "who": "smithi172.jczphg"}]: dispatch 2024-09-20T18:36:36.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "mgr fail", "who": "smithi172.jczphg"}]: dispatch 2024-09-20T18:36:36.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: Activating manager daemon smithi017.xusjwd 2024-09-20T18:36:36.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.24405 ' entity='mgr.smithi172.jczphg' cmd='[{"prefix": "mgr fail", "who": "smithi172.jczphg"}]': finished 2024-09-20T18:36:36.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: osdmap e46: 6 total, 6 up, 6 in 2024-09-20T18:36:36.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: mgrmap e28: smithi017.xusjwd(active, starting, since 0.00647333s) 2024-09-20T18:36:36.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-09-20T18:36:36.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2024-09-20T18:36:36.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.puqizo"}]: dispatch 2024-09-20T18:36:36.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.xhlvpy"}]: dispatch 2024-09-20T18:36:36.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.mugtlk"}]: dispatch 2024-09-20T18:36:36.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi172.liatxm"}]: dispatch 2024-09-20T18:36:36.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr metadata", "who": "smithi017.xusjwd", "id": "smithi017.xusjwd"}]: dispatch 2024-09-20T18:36:36.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-20T18:36:36.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-20T18:36:36.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-20T18:36:36.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-20T18:36:36.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-20T18:36:36.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-20T18:36:36.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-20T18:36:36.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-20T18:36:36.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-20T18:36:36.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:36 smithi017 ceph-mon[28058]: Manager daemon smithi017.xusjwd is now available 2024-09-20T18:36:37.577 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:37 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:36:37.578 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:37 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:36:37.578 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:37 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T18:36:37.578 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:37 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/mirror_snapshot_schedule"}]: dispatch 2024-09-20T18:36:37.578 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:37 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/mirror_snapshot_schedule"}]: dispatch 2024-09-20T18:36:37.578 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:37 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/trash_purge_schedule"}]: dispatch 2024-09-20T18:36:37.578 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:37 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/trash_purge_schedule"}]: dispatch 2024-09-20T18:36:37.578 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:37 smithi017 ceph-mon[28058]: mgrmap e29: smithi017.xusjwd(active, since 1.01714s) 2024-09-20T18:36:37.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:37 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:36:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:37 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:36:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:37 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T18:36:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:37 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/mirror_snapshot_schedule"}]: dispatch 2024-09-20T18:36:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:37 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/mirror_snapshot_schedule"}]: dispatch 2024-09-20T18:36:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:37 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/trash_purge_schedule"}]: dispatch 2024-09-20T18:36:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:37 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.xusjwd/trash_purge_schedule"}]: dispatch 2024-09-20T18:36:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:37 smithi172 ceph-mon[35456]: mgrmap e29: smithi017.xusjwd(active, since 1.01714s) 2024-09-20T18:36:38.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:38 smithi017 ceph-mon[28058]: pgmap v3: 65 pgs: 65 active+clean; 1.2 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail 2024-09-20T18:36:38.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:38 smithi017 ceph-mon[28058]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T18:36:38.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:38 smithi172 ceph-mon[35456]: pgmap v3: 65 pgs: 65 active+clean; 1.2 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail 2024-09-20T18:36:38.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:38 smithi172 ceph-mon[35456]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T18:36:39.792 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:39 smithi017 ceph-mon[28058]: [20/Sep/2024:18:36:38] ENGINE Bus STARTING 2024-09-20T18:36:39.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:39 smithi172 ceph-mon[35456]: [20/Sep/2024:18:36:38] ENGINE Bus STARTING 2024-09-20T18:36:40.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:40 smithi017 ceph-mon[28058]: [20/Sep/2024:18:36:38] ENGINE Serving on https://172.21.15.17:7150 2024-09-20T18:36:40.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:40 smithi017 ceph-mon[28058]: [20/Sep/2024:18:36:38] ENGINE Error in HTTPServer.serve 2024-09-20T18:36:40.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Traceback (most recent call last): 2024-09-20T18:36:40.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T18:36:40.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-09-20T18:36:40.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T18:36:40.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._run(expiration_interval) 2024-09-20T18:36:40.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T18:36:40.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T18:36:40.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T18:36:40.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T18:36:40.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T18:36:40.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s = self.context.wrap_socket( 2024-09-20T18:36:40.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T18:36:40.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: return self.sslsocket_class._create( 2024-09-20T18:36:40.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T18:36:40.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self.do_handshake() 2024-09-20T18:36:40.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T18:36:40.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._sslobj.do_handshake() 2024-09-20T18:36:40.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T18:36:40.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:40 smithi017 ceph-mon[28058]: [20/Sep/2024:18:36:38] ENGINE Serving on http://172.21.15.17:8765 2024-09-20T18:36:40.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:40 smithi017 ceph-mon[28058]: [20/Sep/2024:18:36:38] ENGINE Bus STARTED 2024-09-20T18:36:40.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:40 smithi017 ceph-mon[28058]: mgrmap e30: smithi017.xusjwd(active, since 3s) 2024-09-20T18:36:40.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:40 smithi172 ceph-mon[35456]: [20/Sep/2024:18:36:38] ENGINE Serving on https://172.21.15.17:7150 2024-09-20T18:36:40.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:40 smithi172 ceph-mon[35456]: [20/Sep/2024:18:36:38] ENGINE Error in HTTPServer.serve 2024-09-20T18:36:40.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Traceback (most recent call last): 2024-09-20T18:36:40.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-20T18:36:40.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: self._connections.run(self.expiration_interval) 2024-09-20T18:36:40.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-20T18:36:40.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: self._run(expiration_interval) 2024-09-20T18:36:40.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-20T18:36:40.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-20T18:36:40.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-20T18:36:40.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-20T18:36:40.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-20T18:36:40.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: s = self.context.wrap_socket( 2024-09-20T18:36:40.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-20T18:36:40.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: return self.sslsocket_class._create( 2024-09-20T18:36:40.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-20T18:36:40.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: self.do_handshake() 2024-09-20T18:36:40.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-20T18:36:40.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: self._sslobj.do_handshake() 2024-09-20T18:36:40.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-20T18:36:40.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:40 smithi172 ceph-mon[35456]: [20/Sep/2024:18:36:38] ENGINE Serving on http://172.21.15.17:8765 2024-09-20T18:36:40.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:40 smithi172 ceph-mon[35456]: [20/Sep/2024:18:36:38] ENGINE Bus STARTED 2024-09-20T18:36:40.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:40 smithi172 ceph-mon[35456]: mgrmap e30: smithi017.xusjwd(active, since 3s) 2024-09-20T18:36:41.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:41 smithi017 ceph-mon[28058]: pgmap v5: 65 pgs: 65 active+clean; 1.2 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail 2024-09-20T18:36:41.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:36:41.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:36:41.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:36:41.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:36:41.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:41 smithi172 ceph-mon[35456]: pgmap v5: 65 pgs: 65 active+clean; 1.2 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail 2024-09-20T18:36:41.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:36:41.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:36:41.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:36:41.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:36:42.815 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:42 smithi017 ceph-mon[28058]: Standby manager daemon smithi172.jczphg started 2024-09-20T18:36:42.815 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:42 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.172:0/2572023368' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.jczphg/crt"}]: dispatch 2024-09-20T18:36:42.815 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:42 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.172:0/2572023368' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T18:36:42.816 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:42 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.172:0/2572023368' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.jczphg/key"}]: dispatch 2024-09-20T18:36:42.816 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:42 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.172:0/2572023368' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T18:36:42.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:42 smithi172 ceph-mon[35456]: Standby manager daemon smithi172.jczphg started 2024-09-20T18:36:42.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:42 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.172:0/2572023368' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.jczphg/crt"}]: dispatch 2024-09-20T18:36:42.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:42 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.172:0/2572023368' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T18:36:42.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:42 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.172:0/2572023368' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.jczphg/key"}]: dispatch 2024-09-20T18:36:42.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:42 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.172:0/2572023368' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T18:36:43.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:43 smithi172 ceph-mon[35456]: pgmap v6: 65 pgs: 65 active+clean; 1.1 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 0 B/s wr, 12 op/s 2024-09-20T18:36:43.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:43 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr metadata", "who": "smithi172.jczphg", "id": "smithi172.jczphg"}]: dispatch 2024-09-20T18:36:43.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:43 smithi172 ceph-mon[35456]: mgrmap e31: smithi017.xusjwd(active, since 6s), standbys: smithi172.jczphg 2024-09-20T18:36:43.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:43 smithi017 ceph-mon[28058]: pgmap v6: 65 pgs: 65 active+clean; 1.1 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 0 B/s wr, 12 op/s 2024-09-20T18:36:43.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:43 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr metadata", "who": "smithi172.jczphg", "id": "smithi172.jczphg"}]: dispatch 2024-09-20T18:36:43.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:43 smithi017 ceph-mon[28058]: mgrmap e31: smithi017.xusjwd(active, since 6s), standbys: smithi172.jczphg 2024-09-20T18:36:44.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:44 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:36:44.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:44 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:36:44.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:44 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:36:44.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:44 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:36:44.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:44 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:36:44.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:44 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:36:44.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:44 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:36:44.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:44 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:36:45.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.068+0000 7f063599b640 1 -- 172.21.15.17:0/1443943390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0630102470 msgr2=0x7f0630104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:45.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.068+0000 7f063599b640 1 --2- 172.21.15.17:0/1443943390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0630102470 0x7f0630104860 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0620009880 tx=0x7f062002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.068+0000 7f063599b640 1 -- 172.21.15.17:0/1443943390 shutdown_connections 2024-09-20T18:36:45.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.068+0000 7f063599b640 1 --2- 172.21.15.17:0/1443943390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0630104da0 0x7f0630107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.068+0000 7f063599b640 1 --2- 172.21.15.17:0/1443943390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0630102470 0x7f0630104860 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.068+0000 7f063599b640 1 -- 172.21.15.17:0/1443943390 >> 172.21.15.17:0/1443943390 conn(0x7f06300fc010 msgr2=0x7f06300fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:45.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.068+0000 7f063599b640 1 -- 172.21.15.17:0/1443943390 shutdown_connections 2024-09-20T18:36:45.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.068+0000 7f063599b640 1 -- 172.21.15.17:0/1443943390 wait complete. 2024-09-20T18:36:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.069+0000 7f063599b640 1 Processor -- start 2024-09-20T18:36:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.069+0000 7f063599b640 1 -- start start 2024-09-20T18:36:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.069+0000 7f063599b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0630102470 0x7f0630197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.069+0000 7f063599b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0630104da0 0x7f0630197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.069+0000 7f063599b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f063010a7d0 con 0x7f0630104da0 2024-09-20T18:36:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.069+0000 7f063599b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f063010a650 con 0x7f0630102470 2024-09-20T18:36:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.070+0000 7f0627fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0630104da0 0x7f0630197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.070+0000 7f0627fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0630104da0 0x7f0630197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40548/0 (socket says 172.21.15.17:40548) 2024-09-20T18:36:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.070+0000 7f0627fff640 1 -- 172.21.15.17:0/1356974782 learned_addr learned my addr 172.21.15.17:0/1356974782 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:36:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.070+0000 7f062effd640 1 --2- 172.21.15.17:0/1356974782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0630102470 0x7f0630197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.070+0000 7f0627fff640 1 -- 172.21.15.17:0/1356974782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0630102470 msgr2=0x7f0630197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.070+0000 7f0627fff640 1 --2- 172.21.15.17:0/1356974782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0630102470 0x7f0630197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.070+0000 7f0627fff640 1 -- 172.21.15.17:0/1356974782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06301980e0 con 0x7f0630104da0 2024-09-20T18:36:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.070+0000 7f0627fff640 1 --2- 172.21.15.17:0/1356974782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0630104da0 0x7f0630197a60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f061800e970 tx=0x7f061800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.070+0000 7f0634999640 1 -- 172.21.15.17:0/1356974782 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f061800cac0 con 0x7f0630104da0 2024-09-20T18:36:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.070+0000 7f0634999640 1 -- 172.21.15.17:0/1356974782 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06180054e0 con 0x7f0630104da0 2024-09-20T18:36:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.070+0000 7f063599b640 1 -- 172.21.15.17:0/1356974782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063019cb20 con 0x7f0630104da0 2024-09-20T18:36:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.071+0000 7f063599b640 1 -- 172.21.15.17:0/1356974782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f063019d0b0 con 0x7f0630104da0 2024-09-20T18:36:45.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.071+0000 7f0634999640 1 -- 172.21.15.17:0/1356974782 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0618010430 con 0x7f0630104da0 2024-09-20T18:36:45.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.072+0000 7f063599b640 1 -- 172.21.15.17:0/1356974782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0630102850 con 0x7f0630104da0 2024-09-20T18:36:45.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.073+0000 7f0634999640 1 -- 172.21.15.17:0/1356974782 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f0618004ec0 con 0x7f0630104da0 2024-09-20T18:36:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.073+0000 7f0634999640 1 --2- 172.21.15.17:0/1356974782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f061c07b0b0 0x7f061c07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.074+0000 7f0634999640 1 -- 172.21.15.17:0/1356974782 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f061809eaa0 con 0x7f0630104da0 2024-09-20T18:36:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.074+0000 7f062effd640 1 --2- 172.21.15.17:0/1356974782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f061c07b0b0 0x7f061c07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.074+0000 7f062effd640 1 --2- 172.21.15.17:0/1356974782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f061c07b0b0 0x7f061c07d570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0620000c00 tx=0x7f06200058d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:45.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.078+0000 7f0634999640 1 -- 172.21.15.17:0/1356974782 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f0618069f30 con 0x7f0630104da0 2024-09-20T18:36:45.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.306+0000 7f063599b640 1 -- 172.21.15.17:0/1356974782 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0630105720 con 0x7f061c07b0b0 2024-09-20T18:36:45.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.308+0000 7f0634999640 1 -- 172.21.15.17:0/1356974782 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f0630105720 con 0x7f061c07b0b0 2024-09-20T18:36:45.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.311+0000 7f063599b640 1 -- 172.21.15.17:0/1356974782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f061c07b0b0 msgr2=0x7f061c07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:45.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.311+0000 7f063599b640 1 --2- 172.21.15.17:0/1356974782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f061c07b0b0 0x7f061c07d570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0620000c00 tx=0x7f06200058d0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.311+0000 7f063599b640 1 -- 172.21.15.17:0/1356974782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0630104da0 msgr2=0x7f0630197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:45.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.311+0000 7f063599b640 1 --2- 172.21.15.17:0/1356974782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0630104da0 0x7f0630197a60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f061800e970 tx=0x7f061800ee30 comp rx=0 tx=0).stop 2024-09-20T18:36:45.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.311+0000 7f063599b640 1 -- 172.21.15.17:0/1356974782 shutdown_connections 2024-09-20T18:36:45.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.311+0000 7f063599b640 1 --2- 172.21.15.17:0/1356974782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f061c07b0b0 0x7f061c07d570 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.311+0000 7f063599b640 1 --2- 172.21.15.17:0/1356974782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0630104da0 0x7f0630197a60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.311+0000 7f063599b640 1 --2- 172.21.15.17:0/1356974782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0630102470 0x7f0630197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.311+0000 7f063599b640 1 -- 172.21.15.17:0/1356974782 >> 172.21.15.17:0/1356974782 conn(0x7f06300fc010 msgr2=0x7f06300fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:45.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.311+0000 7f063599b640 1 -- 172.21.15.17:0/1356974782 shutdown_connections 2024-09-20T18:36:45.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.311+0000 7f063599b640 1 -- 172.21.15.17:0/1356974782 wait complete. 2024-09-20T18:36:45.335 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:36:45.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.425+0000 7f4967cde640 1 -- 172.21.15.17:0/1562311492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4960104d80 msgr2=0x7f4960107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:45.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.425+0000 7f4967cde640 1 --2- 172.21.15.17:0/1562311492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4960104d80 0x7f4960107170 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4950009880 tx=0x7f495002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.425+0000 7f4967cde640 1 -- 172.21.15.17:0/1562311492 shutdown_connections 2024-09-20T18:36:45.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.425+0000 7f4967cde640 1 --2- 172.21.15.17:0/1562311492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4960104d80 0x7f4960107170 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.425+0000 7f4967cde640 1 --2- 172.21.15.17:0/1562311492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4960102450 0x7f4960104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.425+0000 7f4967cde640 1 -- 172.21.15.17:0/1562311492 >> 172.21.15.17:0/1562311492 conn(0x7f49600fc010 msgr2=0x7f49600fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:45.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.426+0000 7f4967cde640 1 -- 172.21.15.17:0/1562311492 shutdown_connections 2024-09-20T18:36:45.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.426+0000 7f4967cde640 1 -- 172.21.15.17:0/1562311492 wait complete. 2024-09-20T18:36:45.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.426+0000 7f4967cde640 1 Processor -- start 2024-09-20T18:36:45.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.426+0000 7f4967cde640 1 -- start start 2024-09-20T18:36:45.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.426+0000 7f4967cde640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4960102450 0x7f49601974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:45.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.427+0000 7f4967cde640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4960104d80 0x7f49601979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:45.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.427+0000 7f4967cde640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f496010a740 con 0x7f4960102450 2024-09-20T18:36:45.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.427+0000 7f4967cde640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f496010a5c0 con 0x7f4960104d80 2024-09-20T18:36:45.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.427+0000 7f4965a7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4960102450 0x7f49601974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:45.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.427+0000 7f4965279640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4960104d80 0x7f49601979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:45.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.427+0000 7f4965a7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4960102450 0x7f49601974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40572/0 (socket says 172.21.15.17:40572) 2024-09-20T18:36:45.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.427+0000 7f4965a7a640 1 -- 172.21.15.17:0/4230552532 learned_addr learned my addr 172.21.15.17:0/4230552532 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:36:45.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.427+0000 7f4965279640 1 -- 172.21.15.17:0/4230552532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4960102450 msgr2=0x7f49601974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:45.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.427+0000 7f4965279640 1 --2- 172.21.15.17:0/4230552532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4960102450 0x7f49601974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.427+0000 7f4965279640 1 -- 172.21.15.17:0/4230552532 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4960198060 con 0x7f4960104d80 2024-09-20T18:36:45.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.427+0000 7f4965a7a640 1 --2- 172.21.15.17:0/4230552532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4960102450 0x7f49601974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T18:36:45.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.427+0000 7f4965279640 1 --2- 172.21.15.17:0/4230552532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4960104d80 0x7f49601979e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4950009230 tx=0x7f49500045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:45.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.428+0000 7f4956ffd640 1 -- 172.21.15.17:0/4230552532 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f495003f070 con 0x7f4960104d80 2024-09-20T18:36:45.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.428+0000 7f4956ffd640 1 -- 172.21.15.17:0/4230552532 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f49500049d0 con 0x7f4960104d80 2024-09-20T18:36:45.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.428+0000 7f4967cde640 1 -- 172.21.15.17:0/4230552532 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f496019caa0 con 0x7f4960104d80 2024-09-20T18:36:45.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.428+0000 7f4956ffd640 1 -- 172.21.15.17:0/4230552532 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4950035030 con 0x7f4960104d80 2024-09-20T18:36:45.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.428+0000 7f4967cde640 1 -- 172.21.15.17:0/4230552532 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f496019d030 con 0x7f4960104d80 2024-09-20T18:36:45.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.429+0000 7f4967cde640 1 -- 172.21.15.17:0/4230552532 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4960102830 con 0x7f4960104d80 2024-09-20T18:36:45.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.430+0000 7f4956ffd640 1 -- 172.21.15.17:0/4230552532 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f4950042070 con 0x7f4960104d80 2024-09-20T18:36:45.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.431+0000 7f4956ffd640 1 --2- 172.21.15.17:0/4230552532 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f494c07b050 0x7f494c07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:45.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.431+0000 7f4965a7a640 1 --2- 172.21.15.17:0/4230552532 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f494c07b050 0x7f494c07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:45.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.431+0000 7f4956ffd640 1 -- 172.21.15.17:0/4230552532 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f49500beb20 con 0x7f4960104d80 2024-09-20T18:36:45.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.431+0000 7f4965a7a640 1 --2- 172.21.15.17:0/4230552532 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f494c07b050 0x7f494c07d510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f495c011500 tx=0x7f495c005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:45.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.436+0000 7f4956ffd640 1 -- 172.21.15.17:0/4230552532 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f4950089fb0 con 0x7f4960104d80 2024-09-20T18:36:45.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.678+0000 7f4967cde640 1 -- 172.21.15.17:0/4230552532 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4960105700 con 0x7f494c07b050 2024-09-20T18:36:45.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.679+0000 7f4956ffd640 1 -- 172.21.15.17:0/4230552532 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f4960105700 con 0x7f494c07b050 2024-09-20T18:36:45.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.681+0000 7f4967cde640 1 -- 172.21.15.17:0/4230552532 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f494c07b050 msgr2=0x7f494c07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:45.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.682+0000 7f4967cde640 1 --2- 172.21.15.17:0/4230552532 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f494c07b050 0x7f494c07d510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f495c011500 tx=0x7f495c005f90 comp rx=0 tx=0).stop 2024-09-20T18:36:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.682+0000 7f4967cde640 1 -- 172.21.15.17:0/4230552532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4960104d80 msgr2=0x7f49601979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.682+0000 7f4967cde640 1 --2- 172.21.15.17:0/4230552532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4960104d80 0x7f49601979e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4950009230 tx=0x7f49500045e0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.682+0000 7f4967cde640 1 -- 172.21.15.17:0/4230552532 shutdown_connections 2024-09-20T18:36:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.682+0000 7f4967cde640 1 --2- 172.21.15.17:0/4230552532 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f494c07b050 0x7f494c07d510 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.682+0000 7f4967cde640 1 --2- 172.21.15.17:0/4230552532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4960104d80 0x7f49601979e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.682+0000 7f4967cde640 1 --2- 172.21.15.17:0/4230552532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4960102450 0x7f49601974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.682+0000 7f4967cde640 1 -- 172.21.15.17:0/4230552532 >> 172.21.15.17:0/4230552532 conn(0x7f49600fc010 msgr2=0x7f49600fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.682+0000 7f4967cde640 1 -- 172.21.15.17:0/4230552532 shutdown_connections 2024-09-20T18:36:45.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.682+0000 7f4967cde640 1 -- 172.21.15.17:0/4230552532 wait complete. 2024-09-20T18:36:45.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.797+0000 7f0ce1440640 1 -- 172.21.15.17:0/3573066375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc073380 msgr2=0x7f0cdc073780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:45.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.797+0000 7f0ce1440640 1 --2- 172.21.15.17:0/3573066375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc073380 0x7f0cdc073780 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000dbf0 tx=0x7f0cd002e400 comp rx=0 tx=0).stop 2024-09-20T18:36:45.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.797+0000 7f0ce1440640 1 -- 172.21.15.17:0/3573066375 shutdown_connections 2024-09-20T18:36:45.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.797+0000 7f0ce1440640 1 --2- 172.21.15.17:0/3573066375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cdc073d50 0x7f0cdc109250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.797+0000 7f0ce1440640 1 --2- 172.21.15.17:0/3573066375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc073380 0x7f0cdc073780 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.797+0000 7f0ce1440640 1 -- 172.21.15.17:0/3573066375 >> 172.21.15.17:0/3573066375 conn(0x7f0cdc06e8b0 msgr2=0x7f0cdc070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:45.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.797+0000 7f0ce1440640 1 -- 172.21.15.17:0/3573066375 shutdown_connections 2024-09-20T18:36:45.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.797+0000 7f0ce1440640 1 -- 172.21.15.17:0/3573066375 wait complete. 2024-09-20T18:36:45.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.798+0000 7f0ce1440640 1 Processor -- start 2024-09-20T18:36:45.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.799+0000 7f0ce1440640 1 -- start start 2024-09-20T18:36:45.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.799+0000 7f0ce1440640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cdc073380 0x7f0cdc1a60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:45.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.799+0000 7f0ce1440640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc073d50 0x7f0cdc1a6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:45.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.799+0000 7f0ce1440640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0cdc110b90 con 0x7f0cdc073d50 2024-09-20T18:36:45.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.799+0000 7f0ce1440640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0cdc110a10 con 0x7f0cdc073380 2024-09-20T18:36:45.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.799+0000 7f0cdaffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cdc073380 0x7f0cdc1a60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:45.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.799+0000 7f0cdaffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cdc073380 0x7f0cdc1a60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:48428/0 (socket says 172.21.15.17:48428) 2024-09-20T18:36:45.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.799+0000 7f0cda7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc073d50 0x7f0cdc1a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:45.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.799+0000 7f0cdaffd640 1 -- 172.21.15.17:0/369441467 learned_addr learned my addr 172.21.15.17:0/369441467 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:36:45.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.800+0000 7f0cda7fc640 1 -- 172.21.15.17:0/369441467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cdc073380 msgr2=0x7f0cdc1a60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:45.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.800+0000 7f0cda7fc640 1 --2- 172.21.15.17:0/369441467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cdc073380 0x7f0cdc1a60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:45.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.800+0000 7f0cda7fc640 1 -- 172.21.15.17:0/369441467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cdc1a6c90 con 0x7f0cdc073d50 2024-09-20T18:36:45.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.800+0000 7f0cda7fc640 1 --2- 172.21.15.17:0/369441467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc073d50 0x7f0cdc1a6610 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400eee0 tx=0x7f0cd400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:45.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.800+0000 7f0cc3fff640 1 -- 172.21.15.17:0/369441467 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0cd401b070 con 0x7f0cdc073d50 2024-09-20T18:36:45.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.800+0000 7f0cc3fff640 1 -- 172.21.15.17:0/369441467 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0cd400ba30 con 0x7f0cdc073d50 2024-09-20T18:36:45.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.800+0000 7f0cc3fff640 1 -- 172.21.15.17:0/369441467 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0cd4016bc0 con 0x7f0cdc073d50 2024-09-20T18:36:45.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.800+0000 7f0ce1440640 1 -- 172.21.15.17:0/369441467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cdc1ab6d0 con 0x7f0cdc073d50 2024-09-20T18:36:45.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.801+0000 7f0ce1440640 1 -- 172.21.15.17:0/369441467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cdc1abc60 con 0x7f0cdc073d50 2024-09-20T18:36:45.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.802+0000 7f0ce1440640 1 -- 172.21.15.17:0/369441467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc80052c0 con 0x7f0cdc073d50 2024-09-20T18:36:45.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.803+0000 7f0cc3fff640 1 -- 172.21.15.17:0/369441467 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f0cd401e070 con 0x7f0cdc073d50 2024-09-20T18:36:45.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.804+0000 7f0cc3fff640 1 --2- 172.21.15.17:0/369441467 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0cc407b0a0 0x7f0cc407d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:45.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.804+0000 7f0cc3fff640 1 -- 172.21.15.17:0/369441467 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f0cd4013070 con 0x7f0cdc073d50 2024-09-20T18:36:45.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.805+0000 7f0cdaffd640 1 --2- 172.21.15.17:0/369441467 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0cc407b0a0 0x7f0cc407d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:45.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.806+0000 7f0cdaffd640 1 --2- 172.21.15.17:0/369441467 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0cc407b0a0 0x7f0cc407d560 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0036530 tx=0x7f0cd0030040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:45.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:45.813+0000 7f0cc3fff640 1 -- 172.21.15.17:0/369441467 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f0cd4069910 con 0x7f0cdc073d50 2024-09-20T18:36:45.827 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:45 smithi017 ceph-mon[28058]: pgmap v7: 65 pgs: 65 active+clean; 807 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 930 KiB/s rd, 1.1 MiB/s wr, 100 op/s 2024-09-20T18:36:45.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:45 smithi172 ceph-mon[35456]: pgmap v7: 65 pgs: 65 active+clean; 807 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 930 KiB/s rd, 1.1 MiB/s wr, 100 op/s 2024-09-20T18:36:46.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.121+0000 7f0ce1440640 1 -- 172.21.15.17:0/369441467 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0cc8000bf0 con 0x7f0cc407b0a0 2024-09-20T18:36:46.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.131+0000 7f0cc3fff640 1 -- 172.21.15.17:0/369441467 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f0cc8000bf0 con 0x7f0cc407b0a0 2024-09-20T18:36:46.146 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:36:46.146 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (7m) 2s ago 9m 25.1M - 0.25.0 c8568f914cd2 8954ab699be3 2024-09-20T18:36:46.146 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (74s) 2s ago 9m 8438k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:36:46.146 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (44s) 5s ago 8m 8292k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:36:46.146 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (9m) 2s ago 9m 6895k - 19.1.1-369-ged8ee0f2 6acb0a031eab 725c8bcc6ec8 2024-09-20T18:36:46.146 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (8m) 5s ago 8m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab e10dd613dbe2 2024-09-20T18:36:46.147 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (7m) 2s ago 8m 81.0M - 9.4.12 2bacad6d85d8 d8c886b98eae 2024-09-20T18:36:46.147 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (3m) 2s ago 3m 240M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:36:46.147 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (3m) 2s ago 3m 282M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:36:46.147 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (3m) 5s ago 3m 26.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:36:46.147 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (3m) 5s ago 3m 25.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:36:46.147 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (20s) 2s ago 10m 489M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:36:46.147 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (2m) 5s ago 8m 141M - 19.3.0-5099-g88deadb8 441f9a3fe515 84c6ec0abc34 2024-09-20T18:36:46.147 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (10m) 2s ago 10m 56.3M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab ab1f988c4cb2 2024-09-20T18:36:46.147 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (8m) 5s ago 8m 44.3M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 9eea40352787 2024-09-20T18:36:46.147 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (9m) 2s ago 9m 14.0M - 1.5.0 0da6a335fe13 1584915999b1 2024-09-20T18:36:46.147 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (8m) 5s ago 8m 15.4M - 1.5.0 0da6a335fe13 880d938148e8 2024-09-20T18:36:46.147 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (7m) 2s ago 7m 181M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab c1207e514216 2024-09-20T18:36:46.147 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (6m) 2s ago 6m 190M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 73f2fd77590f 2024-09-20T18:36:46.147 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (6m) 2s ago 6m 162M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 6f0b9405dc18 2024-09-20T18:36:46.148 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (5m) 5s ago 5m 217M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:36:46.148 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (5m) 5s ago 5m 185M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:36:46.148 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (4m) 5s ago 4m 166M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:36:46.148 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (51s) 2s ago 8m 54.0M - 2.43.0 a07b618ecd1d ff7f415776b1 2024-09-20T18:36:46.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.135+0000 7f0ce1440640 1 -- 172.21.15.17:0/369441467 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0cc407b0a0 msgr2=0x7f0cc407d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:46.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.135+0000 7f0ce1440640 1 --2- 172.21.15.17:0/369441467 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0cc407b0a0 0x7f0cc407d560 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0036530 tx=0x7f0cd0030040 comp rx=0 tx=0).stop 2024-09-20T18:36:46.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.135+0000 7f0ce1440640 1 -- 172.21.15.17:0/369441467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc073d50 msgr2=0x7f0cdc1a6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:46.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.135+0000 7f0ce1440640 1 --2- 172.21.15.17:0/369441467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc073d50 0x7f0cdc1a6610 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400eee0 tx=0x7f0cd400c740 comp rx=0 tx=0).stop 2024-09-20T18:36:46.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.135+0000 7f0ce1440640 1 -- 172.21.15.17:0/369441467 shutdown_connections 2024-09-20T18:36:46.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.135+0000 7f0ce1440640 1 --2- 172.21.15.17:0/369441467 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0cc407b0a0 0x7f0cc407d560 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.135+0000 7f0ce1440640 1 --2- 172.21.15.17:0/369441467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc073d50 0x7f0cdc1a6610 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.135+0000 7f0ce1440640 1 --2- 172.21.15.17:0/369441467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cdc073380 0x7f0cdc1a60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.135+0000 7f0ce1440640 1 -- 172.21.15.17:0/369441467 >> 172.21.15.17:0/369441467 conn(0x7f0cdc06e8b0 msgr2=0x7f0cdc10e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:46.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.135+0000 7f0ce1440640 1 -- 172.21.15.17:0/369441467 shutdown_connections 2024-09-20T18:36:46.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.136+0000 7f0ce1440640 1 -- 172.21.15.17:0/369441467 wait complete. 2024-09-20T18:36:46.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.225+0000 7f5525606640 1 -- 172.21.15.17:0/3002633305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5520102bf0 msgr2=0x7f5520103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:46.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.225+0000 7f5525606640 1 --2- 172.21.15.17:0/3002633305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5520102bf0 0x7f5520103070 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5508009880 tx=0x7f550802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.226+0000 7f5525606640 1 -- 172.21.15.17:0/3002633305 shutdown_connections 2024-09-20T18:36:46.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.226+0000 7f5525606640 1 --2- 172.21.15.17:0/3002633305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5520102bf0 0x7f5520103070 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.226+0000 7f5525606640 1 --2- 172.21.15.17:0/3002633305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55200ffc10 0x7f5520100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.226+0000 7f5525606640 1 -- 172.21.15.17:0/3002633305 >> 172.21.15.17:0/3002633305 conn(0x7f55200fb760 msgr2=0x7f55200fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:46.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.226+0000 7f5525606640 1 -- 172.21.15.17:0/3002633305 shutdown_connections 2024-09-20T18:36:46.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.226+0000 7f5525606640 1 -- 172.21.15.17:0/3002633305 wait complete. 2024-09-20T18:36:46.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.227+0000 7f5525606640 1 Processor -- start 2024-09-20T18:36:46.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.227+0000 7f5525606640 1 -- start start 2024-09-20T18:36:46.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.227+0000 7f5525606640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55200ffc10 0x7f5520197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:46.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.227+0000 7f5525606640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5520102bf0 0x7f5520197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:46.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.227+0000 7f5525606640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f552010a770 con 0x7f5520102bf0 2024-09-20T18:36:46.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.227+0000 7f5525606640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f552010a5f0 con 0x7f55200ffc10 2024-09-20T18:36:46.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.227+0000 7f5517fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5520102bf0 0x7f5520197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:46.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.227+0000 7f5517fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5520102bf0 0x7f5520197990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40594/0 (socket says 172.21.15.17:40594) 2024-09-20T18:36:46.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.227+0000 7f5517fff640 1 -- 172.21.15.17:0/3320877165 learned_addr learned my addr 172.21.15.17:0/3320877165 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:36:46.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.227+0000 7f551effd640 1 --2- 172.21.15.17:0/3320877165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55200ffc10 0x7f5520197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:46.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.228+0000 7f5517fff640 1 -- 172.21.15.17:0/3320877165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55200ffc10 msgr2=0x7f5520197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:46.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.228+0000 7f5517fff640 1 --2- 172.21.15.17:0/3320877165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55200ffc10 0x7f5520197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.228+0000 7f5517fff640 1 -- 172.21.15.17:0/3320877165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5520198010 con 0x7f5520102bf0 2024-09-20T18:36:46.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.228+0000 7f5517fff640 1 --2- 172.21.15.17:0/3320877165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5520102bf0 0x7f5520197990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5508006010 tx=0x7f5508032a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:46.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.228+0000 7f551cff9640 1 -- 172.21.15.17:0/3320877165 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f550803f030 con 0x7f5520102bf0 2024-09-20T18:36:46.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.228+0000 7f551cff9640 1 -- 172.21.15.17:0/3320877165 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f55080046c0 con 0x7f5520102bf0 2024-09-20T18:36:46.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.228+0000 7f5525606640 1 -- 172.21.15.17:0/3320877165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f552019c9f0 con 0x7f5520102bf0 2024-09-20T18:36:46.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.228+0000 7f551cff9640 1 -- 172.21.15.17:0/3320877165 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5508035070 con 0x7f5520102bf0 2024-09-20T18:36:46.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.228+0000 7f5525606640 1 -- 172.21.15.17:0/3320877165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f552019cf80 con 0x7f5520102bf0 2024-09-20T18:36:46.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.230+0000 7f5525606640 1 -- 172.21.15.17:0/3320877165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5520100010 con 0x7f5520102bf0 2024-09-20T18:36:46.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.230+0000 7f551cff9640 1 -- 172.21.15.17:0/3320877165 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f5508042030 con 0x7f5520102bf0 2024-09-20T18:36:46.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.231+0000 7f551cff9640 1 --2- 172.21.15.17:0/3320877165 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f550c07b050 0x7f550c07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:46.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.231+0000 7f551cff9640 1 -- 172.21.15.17:0/3320877165 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f5508040070 con 0x7f5520102bf0 2024-09-20T18:36:46.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.231+0000 7f551effd640 1 --2- 172.21.15.17:0/3320877165 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f550c07b050 0x7f550c07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:46.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.232+0000 7f551effd640 1 --2- 172.21.15.17:0/3320877165 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f550c07b050 0x7f550c07d510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5520069aa0 tx=0x7f5510005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:46.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.236+0000 7f551cff9640 1 -- 172.21.15.17:0/3320877165 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f550808a0b0 con 0x7f5520102bf0 2024-09-20T18:36:46.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.535+0000 7f5525606640 1 -- 172.21.15.17:0/3320877165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5520062df0 con 0x7f5520102bf0 2024-09-20T18:36:46.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.535+0000 7f551cff9640 1 -- 172.21.15.17:0/3320877165 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f550808ef60 con 0x7f5520102bf0 2024-09-20T18:36:46.550 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:36:46.550 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:36:46.550 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T18:36:46.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:36:46.550 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:36:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:36:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:36:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:36:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T18:36:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:36:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:36:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:36:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:36:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:36:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 12, 2024-09-20T18:36:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:36:46.551 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:36:46.551 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:36:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.538+0000 7f5525606640 1 -- 172.21.15.17:0/3320877165 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f550c07b050 msgr2=0x7f550c07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.538+0000 7f5525606640 1 --2- 172.21.15.17:0/3320877165 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f550c07b050 0x7f550c07d510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5520069aa0 tx=0x7f5510005f90 comp rx=0 tx=0).stop 2024-09-20T18:36:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.538+0000 7f5525606640 1 -- 172.21.15.17:0/3320877165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5520102bf0 msgr2=0x7f5520197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.538+0000 7f5525606640 1 --2- 172.21.15.17:0/3320877165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5520102bf0 0x7f5520197990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5508006010 tx=0x7f5508032a50 comp rx=0 tx=0).stop 2024-09-20T18:36:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.538+0000 7f5525606640 1 -- 172.21.15.17:0/3320877165 shutdown_connections 2024-09-20T18:36:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.538+0000 7f5525606640 1 --2- 172.21.15.17:0/3320877165 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f550c07b050 0x7f550c07d510 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.538+0000 7f5525606640 1 --2- 172.21.15.17:0/3320877165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5520102bf0 0x7f5520197990 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.538+0000 7f5525606640 1 --2- 172.21.15.17:0/3320877165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55200ffc10 0x7f5520197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.538+0000 7f5525606640 1 -- 172.21.15.17:0/3320877165 >> 172.21.15.17:0/3320877165 conn(0x7f55200fb760 msgr2=0x7f55201060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.538+0000 7f5525606640 1 -- 172.21.15.17:0/3320877165 shutdown_connections 2024-09-20T18:36:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.538+0000 7f5525606640 1 -- 172.21.15.17:0/3320877165 wait complete. 2024-09-20T18:36:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.634+0000 7f060bf8c640 1 -- 172.21.15.17:0/3687089329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06041023f0 msgr2=0x7f06041047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.634+0000 7f060bf8c640 1 --2- 172.21.15.17:0/3687089329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06041023f0 0x7f06041047e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f06000098b0 tx=0x7f060002a4d0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.635+0000 7f060bf8c640 1 -- 172.21.15.17:0/3687089329 shutdown_connections 2024-09-20T18:36:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.635+0000 7f060bf8c640 1 --2- 172.21.15.17:0/3687089329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0604104d20 0x7f0604107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.635+0000 7f060bf8c640 1 --2- 172.21.15.17:0/3687089329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06041023f0 0x7f06041047e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.635+0000 7f060bf8c640 1 -- 172.21.15.17:0/3687089329 >> 172.21.15.17:0/3687089329 conn(0x7f06040fc010 msgr2=0x7f06040fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.635+0000 7f060bf8c640 1 -- 172.21.15.17:0/3687089329 shutdown_connections 2024-09-20T18:36:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.635+0000 7f060bf8c640 1 -- 172.21.15.17:0/3687089329 wait complete. 2024-09-20T18:36:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.635+0000 7f060bf8c640 1 Processor -- start 2024-09-20T18:36:46.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.635+0000 7f060bf8c640 1 -- start start 2024-09-20T18:36:46.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.636+0000 7f060bf8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06041023f0 0x7f0604197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:46.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.636+0000 7f060bf8c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0604104d20 0x7f0604197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:46.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.636+0000 7f060bf8c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f060410a7e0 con 0x7f06041023f0 2024-09-20T18:36:46.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.636+0000 7f060bf8c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f060410a660 con 0x7f0604104d20 2024-09-20T18:36:46.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.636+0000 7f0609d28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06041023f0 0x7f0604197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:46.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.636+0000 7f0609d28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06041023f0 0x7f0604197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40612/0 (socket says 172.21.15.17:40612) 2024-09-20T18:36:46.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.636+0000 7f0609d28640 1 -- 172.21.15.17:0/143525000 learned_addr learned my addr 172.21.15.17:0/143525000 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:36:46.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.636+0000 7f0609527640 1 --2- 172.21.15.17:0/143525000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0604104d20 0x7f0604197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:46.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.636+0000 7f0609d28640 1 -- 172.21.15.17:0/143525000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0604104d20 msgr2=0x7f0604197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:46.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.636+0000 7f0609d28640 1 --2- 172.21.15.17:0/143525000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0604104d20 0x7f0604197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.636+0000 7f0609d28640 1 -- 172.21.15.17:0/143525000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06041980c0 con 0x7f06041023f0 2024-09-20T18:36:46.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.636+0000 7f0609d28640 1 --2- 172.21.15.17:0/143525000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06041023f0 0x7f0604197500 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f06000099d0 tx=0x7f06000045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:46.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.637+0000 7f05faffd640 1 -- 172.21.15.17:0/143525000 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f060003f070 con 0x7f06041023f0 2024-09-20T18:36:46.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.637+0000 7f05faffd640 1 -- 172.21.15.17:0/143525000 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06000049d0 con 0x7f06041023f0 2024-09-20T18:36:46.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.637+0000 7f060bf8c640 1 -- 172.21.15.17:0/143525000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f060419caa0 con 0x7f06041023f0 2024-09-20T18:36:46.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.637+0000 7f05faffd640 1 -- 172.21.15.17:0/143525000 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0600035030 con 0x7f06041023f0 2024-09-20T18:36:46.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.637+0000 7f060bf8c640 1 -- 172.21.15.17:0/143525000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f060419d030 con 0x7f06041023f0 2024-09-20T18:36:46.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.638+0000 7f060bf8c640 1 -- 172.21.15.17:0/143525000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06041027d0 con 0x7f06041023f0 2024-09-20T18:36:46.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.639+0000 7f05faffd640 1 -- 172.21.15.17:0/143525000 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f0600042070 con 0x7f06041023f0 2024-09-20T18:36:46.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.640+0000 7f05faffd640 1 --2- 172.21.15.17:0/143525000 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05f007b050 0x7f05f007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:36:46.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.640+0000 7f05faffd640 1 -- 172.21.15.17:0/143525000 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f06000beca0 con 0x7f06041023f0 2024-09-20T18:36:46.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.640+0000 7f0609527640 1 --2- 172.21.15.17:0/143525000 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05f007b050 0x7f05f007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:36:46.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.641+0000 7f0609527640 1 --2- 172.21.15.17:0/143525000 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05f007b050 0x7f05f007d510 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f06041989b0 tx=0x7f05f4005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:36:46.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.645+0000 7f05faffd640 1 -- 172.21.15.17:0/143525000 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f060008a130 con 0x7f06041023f0 2024-09-20T18:36:46.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.871+0000 7f060bf8c640 1 -- 172.21.15.17:0/143525000 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0604105680 con 0x7f05f007b050 2024-09-20T18:36:46.887 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:46 smithi017 ceph-mon[28058]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:36:46.887 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:46 smithi017 ceph-mon[28058]: from='client.24531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:36:46.887 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:46 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3320877165' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:36:46.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.873+0000 7f05faffd640 1 -- 172.21.15.17:0/143525000 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f0604105680 con 0x7f05f007b050 2024-09-20T18:36:46.888 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:36:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:36:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:36:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T18:36:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:36:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-09-20T18:36:46.888 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:36:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "2/2 daemons upgraded", 2024-09-20T18:36:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-20T18:36:46.889 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:36:46.889 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:36:46.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.876+0000 7f060bf8c640 1 -- 172.21.15.17:0/143525000 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05f007b050 msgr2=0x7f05f007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:46.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.876+0000 7f060bf8c640 1 --2- 172.21.15.17:0/143525000 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05f007b050 0x7f05f007d510 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f06041989b0 tx=0x7f05f4005f90 comp rx=0 tx=0).stop 2024-09-20T18:36:46.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.876+0000 7f060bf8c640 1 -- 172.21.15.17:0/143525000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06041023f0 msgr2=0x7f0604197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:36:46.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.876+0000 7f060bf8c640 1 --2- 172.21.15.17:0/143525000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06041023f0 0x7f0604197500 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f06000099d0 tx=0x7f06000045e0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.876+0000 7f060bf8c640 1 -- 172.21.15.17:0/143525000 shutdown_connections 2024-09-20T18:36:46.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.876+0000 7f060bf8c640 1 --2- 172.21.15.17:0/143525000 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05f007b050 0x7f05f007d510 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.876+0000 7f060bf8c640 1 --2- 172.21.15.17:0/143525000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0604104d20 0x7f0604197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.876+0000 7f060bf8c640 1 --2- 172.21.15.17:0/143525000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06041023f0 0x7f0604197500 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:36:46.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.876+0000 7f060bf8c640 1 -- 172.21.15.17:0/143525000 >> 172.21.15.17:0/143525000 conn(0x7f06040fc010 msgr2=0x7f06040fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:36:46.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.876+0000 7f060bf8c640 1 -- 172.21.15.17:0/143525000 shutdown_connections 2024-09-20T18:36:46.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:36:46.876+0000 7f060bf8c640 1 -- 172.21.15.17:0/143525000 wait complete. 2024-09-20T18:36:46.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:46 smithi172 ceph-mon[35456]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:36:46.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:46 smithi172 ceph-mon[35456]: from='client.24531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:36:46.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:46 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3320877165' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:36:47.185 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-20T18:36:47.185 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-20T18:36:47.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:47 smithi017 ceph-mon[28058]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:36:47.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:47 smithi017 ceph-mon[28058]: pgmap v8: 65 pgs: 65 active+clean; 807 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 723 KiB/s rd, 842 KiB/s wr, 77 op/s 2024-09-20T18:36:47.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:47 smithi172 ceph-mon[35456]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:36:47.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:47 smithi172 ceph-mon[35456]: pgmap v8: 65 pgs: 65 active+clean; 807 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 723 KiB/s rd, 842 KiB/s wr, 77 op/s 2024-09-20T18:36:48.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:48 smithi017 ceph-mon[28058]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:36:48.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:48 smithi172 ceph-mon[35456]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:36:49.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:49 smithi017 ceph-mon[28058]: pgmap v9: 65 pgs: 65 active+clean; 385 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 127 op/s 2024-09-20T18:36:49.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:49 smithi172 ceph-mon[35456]: pgmap v9: 65 pgs: 65 active+clean; 385 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 127 op/s 2024-09-20T18:36:51.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:51 smithi017 ceph-mon[28058]: pgmap v10: 65 pgs: 65 active+clean; 385 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 117 op/s 2024-09-20T18:36:51.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:51 smithi172 ceph-mon[35456]: pgmap v10: 65 pgs: 65 active+clean; 385 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 117 op/s 2024-09-20T18:36:52.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:52 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:36:52.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:52 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:36:53.735 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:53 smithi172 ceph-mon[35456]: pgmap v11: 65 pgs: 65 active+clean; 367 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 122 op/s 2024-09-20T18:36:53.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:53 smithi017 ceph-mon[28058]: pgmap v11: 65 pgs: 65 active+clean; 367 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 122 op/s 2024-09-20T18:36:55.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:55 smithi017 ceph-mon[28058]: pgmap v12: 65 pgs: 65 active+clean; 290 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 152 op/s 2024-09-20T18:36:55.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:55 smithi172 ceph-mon[35456]: pgmap v12: 65 pgs: 65 active+clean; 290 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 152 op/s 2024-09-20T18:36:57.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:57 smithi017 ceph-mon[28058]: pgmap v13: 65 pgs: 65 active+clean; 290 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 99 op/s 2024-09-20T18:36:57.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:57 smithi172 ceph-mon[35456]: pgmap v13: 65 pgs: 65 active+clean; 290 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 99 op/s 2024-09-20T18:36:59.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:36:59 smithi017 ceph-mon[28058]: pgmap v14: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 138 op/s 2024-09-20T18:36:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:36:59 smithi172 ceph-mon[35456]: pgmap v14: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 138 op/s 2024-09-20T18:37:01.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:01 smithi017 ceph-mon[28058]: pgmap v15: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 79 op/s 2024-09-20T18:37:01.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:01 smithi172 ceph-mon[35456]: pgmap v15: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 79 op/s 2024-09-20T18:37:03.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:03 smithi017 ceph-mon[28058]: pgmap v16: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 87 op/s 2024-09-20T18:37:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:03 smithi172 ceph-mon[35456]: pgmap v16: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 87 op/s 2024-09-20T18:37:05.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:05 smithi017 ceph-mon[28058]: pgmap v17: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 111 op/s 2024-09-20T18:37:05.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:05 smithi172 ceph-mon[35456]: pgmap v17: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 111 op/s 2024-09-20T18:37:07.744 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:07 smithi017 ceph-mon[28058]: pgmap v18: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 76 op/s 2024-09-20T18:37:07.744 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:07 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:37:07.744 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:07 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:07.744 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:07 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:07.744 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:07 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:37:07.744 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:07 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:37:07.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:07 smithi172 ceph-mon[35456]: pgmap v18: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 76 op/s 2024-09-20T18:37:07.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:07 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:37:07.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:07 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:07.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:07 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:07.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:07 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:37:07.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:07 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:37:08.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:08 smithi017 ceph-mon[28058]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-20T18:37:08.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:08 smithi017 ceph-mon[28058]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-20T18:37:08.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:08 smithi017 ceph-mon[28058]: Updating smithi172:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:37:08.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:08 smithi017 ceph-mon[28058]: Updating smithi017:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:37:08.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:08 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:08.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:08 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:08.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:08 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:08.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:08 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:08.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:08 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:08.906 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:08 smithi172 ceph-mon[35456]: Updating smithi017:/etc/ceph/ceph.conf 2024-09-20T18:37:08.907 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:08 smithi172 ceph-mon[35456]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-20T18:37:08.907 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:08 smithi172 ceph-mon[35456]: Updating smithi172:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:37:08.907 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:08 smithi172 ceph-mon[35456]: Updating smithi017:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-20T18:37:08.907 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:08 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:08.907 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:08 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:08.907 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:08 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:08.907 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:08 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:08.907 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:08 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:09.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:09 smithi017 ceph-mon[28058]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:37:09.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:09 smithi017 ceph-mon[28058]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:37:09.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:09 smithi017 ceph-mon[28058]: Updating smithi172:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T18:37:09.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:09 smithi017 ceph-mon[28058]: Updating smithi017:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T18:37:09.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:09 smithi017 ceph-mon[28058]: Reconfiguring prometheus.smithi017 (dependencies changed)... 2024-09-20T18:37:09.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:09 smithi017 ceph-mon[28058]: pgmap v19: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 201 op/s 2024-09-20T18:37:09.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:09 smithi017 ceph-mon[28058]: Reconfiguring daemon prometheus.smithi017 on smithi017 2024-09-20T18:37:09.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:09 smithi172 ceph-mon[35456]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:37:09.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:09 smithi172 ceph-mon[35456]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-09-20T18:37:09.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:09 smithi172 ceph-mon[35456]: Updating smithi172:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T18:37:09.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:09 smithi172 ceph-mon[35456]: Updating smithi017:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-20T18:37:09.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:09 smithi172 ceph-mon[35456]: Reconfiguring prometheus.smithi017 (dependencies changed)... 2024-09-20T18:37:09.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:09 smithi172 ceph-mon[35456]: pgmap v19: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 201 op/s 2024-09-20T18:37:09.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:09 smithi172 ceph-mon[35456]: Reconfiguring daemon prometheus.smithi017 on smithi017 2024-09-20T18:37:11.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:11 smithi017 ceph-mon[28058]: pgmap v20: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 161 op/s 2024-09-20T18:37:11.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:11 smithi172 ceph-mon[35456]: pgmap v20: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 161 op/s 2024-09-20T18:37:13.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:13 smithi017 ceph-mon[28058]: pgmap v21: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 277 op/s 2024-09-20T18:37:13.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:13 smithi172 ceph-mon[35456]: pgmap v21: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 277 op/s 2024-09-20T18:37:15.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:15 smithi017 ceph-mon[28058]: pgmap v22: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 391 op/s 2024-09-20T18:37:15.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:15 smithi172 ceph-mon[35456]: pgmap v22: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 391 op/s 2024-09-20T18:37:17.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.996+0000 7f4eefd71640 1 -- 172.21.15.17:0/2952844295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ee8100860 msgr2=0x7f4ee8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:17.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.996+0000 7f4eefd71640 1 --2- 172.21.15.17:0/2952844295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ee8100860 0x7f4ee8100c60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4009880 tx=0x7f4ee402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.996+0000 7f4eefd71640 1 -- 172.21.15.17:0/2952844295 shutdown_connections 2024-09-20T18:37:17.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.996+0000 7f4eefd71640 1 --2- 172.21.15.17:0/2952844295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ee8101a60 0x7f4ee8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.996+0000 7f4eefd71640 1 --2- 172.21.15.17:0/2952844295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ee8100860 0x7f4ee8100c60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.996+0000 7f4eefd71640 1 -- 172.21.15.17:0/2952844295 >> 172.21.15.17:0/2952844295 conn(0x7f4ee80fc010 msgr2=0x7f4ee80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:17.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.996+0000 7f4eefd71640 1 -- 172.21.15.17:0/2952844295 shutdown_connections 2024-09-20T18:37:17.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.996+0000 7f4eefd71640 1 -- 172.21.15.17:0/2952844295 wait complete. 2024-09-20T18:37:17.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.997+0000 7f4eefd71640 1 Processor -- start 2024-09-20T18:37:17.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.997+0000 7f4eefd71640 1 -- start start 2024-09-20T18:37:17.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.997+0000 7f4eefd71640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ee8100860 0x7f4ee81974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:17.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.997+0000 7f4eefd71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ee8101a60 0x7f4ee81979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:17.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.997+0000 7f4eefd71640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee8109680 con 0x7f4ee8101a60 2024-09-20T18:37:17.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.997+0000 7f4eefd71640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee8109500 con 0x7f4ee8100860 2024-09-20T18:37:17.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.998+0000 7f4eedb0d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ee8100860 0x7f4ee81974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:17.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.998+0000 7f4eedb0d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ee8100860 0x7f4ee81974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:48208/0 (socket says 172.21.15.17:48208) 2024-09-20T18:37:17.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.998+0000 7f4eedb0d640 1 -- 172.21.15.17:0/3491815909 learned_addr learned my addr 172.21.15.17:0/3491815909 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:37:17.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.998+0000 7f4eed30c640 1 --2- 172.21.15.17:0/3491815909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ee8101a60 0x7f4ee81979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:17.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.998+0000 7f4eedb0d640 1 -- 172.21.15.17:0/3491815909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ee8101a60 msgr2=0x7f4ee81979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:17.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.998+0000 7f4eedb0d640 1 --2- 172.21.15.17:0/3491815909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ee8101a60 0x7f4ee81979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.998+0000 7f4eedb0d640 1 -- 172.21.15.17:0/3491815909 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee8198060 con 0x7f4ee8100860 2024-09-20T18:37:17.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.998+0000 7f4eed30c640 1 --2- 172.21.15.17:0/3491815909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ee8101a60 0x7f4ee81979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:37:17.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.999+0000 7f4eedb0d640 1 --2- 172.21.15.17:0/3491815909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ee8100860 0x7f4ee81974a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4006010 tx=0x7f4ee40045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:17.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.999+0000 7f4edeffd640 1 -- 172.21.15.17:0/3491815909 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ee403f070 con 0x7f4ee8100860 2024-09-20T18:37:17.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.999+0000 7f4edeffd640 1 -- 172.21.15.17:0/3491815909 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4ee4004a50 con 0x7f4ee8100860 2024-09-20T18:37:17.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.999+0000 7f4eefd71640 1 -- 172.21.15.17:0/3491815909 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee8102fb0 con 0x7f4ee8100860 2024-09-20T18:37:17.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.999+0000 7f4edeffd640 1 -- 172.21.15.17:0/3491815909 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ee4035030 con 0x7f4ee8100860 2024-09-20T18:37:17.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:16.999+0000 7f4eefd71640 1 -- 172.21.15.17:0/3491815909 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee8103540 con 0x7f4ee8100860 2024-09-20T18:37:17.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.000+0000 7f4eefd71640 1 -- 172.21.15.17:0/3491815909 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ee8100c60 con 0x7f4ee8100860 2024-09-20T18:37:17.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.001+0000 7f4edeffd640 1 -- 172.21.15.17:0/3491815909 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f4ee4042070 con 0x7f4ee8100860 2024-09-20T18:37:17.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.001+0000 7f4edeffd640 1 --2- 172.21.15.17:0/3491815909 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ed407b0b0 0x7f4ed407d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:17.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.002+0000 7f4edeffd640 1 -- 172.21.15.17:0/3491815909 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f4ee40becc0 con 0x7f4ee8100860 2024-09-20T18:37:17.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.002+0000 7f4eed30c640 1 --2- 172.21.15.17:0/3491815909 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ed407b0b0 0x7f4ed407d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:17.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.002+0000 7f4eed30c640 1 --2- 172.21.15.17:0/3491815909 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ed407b0b0 0x7f4ed407d570 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8005d00 tx=0x7f4ed8005ed0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:17.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.006+0000 7f4edeffd640 1 -- 172.21.15.17:0/3491815909 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f4ee4004c00 con 0x7f4ee8100860 2024-09-20T18:37:17.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.260+0000 7f4eefd71640 1 -- 172.21.15.17:0/3491815909 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4ee81061b0 con 0x7f4ed407b0b0 2024-09-20T18:37:17.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.261+0000 7f4edeffd640 1 -- 172.21.15.17:0/3491815909 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f4ee81061b0 con 0x7f4ed407b0b0 2024-09-20T18:37:17.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.264+0000 7f4eefd71640 1 -- 172.21.15.17:0/3491815909 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ed407b0b0 msgr2=0x7f4ed407d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:17.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.264+0000 7f4eefd71640 1 --2- 172.21.15.17:0/3491815909 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ed407b0b0 0x7f4ed407d570 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8005d00 tx=0x7f4ed8005ed0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.264+0000 7f4eefd71640 1 -- 172.21.15.17:0/3491815909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ee8100860 msgr2=0x7f4ee81974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:17.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.264+0000 7f4eefd71640 1 --2- 172.21.15.17:0/3491815909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ee8100860 0x7f4ee81974a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4006010 tx=0x7f4ee40045e0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.264+0000 7f4eefd71640 1 -- 172.21.15.17:0/3491815909 shutdown_connections 2024-09-20T18:37:17.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.264+0000 7f4eefd71640 1 --2- 172.21.15.17:0/3491815909 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ed407b0b0 0x7f4ed407d570 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.264+0000 7f4eefd71640 1 --2- 172.21.15.17:0/3491815909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ee8101a60 0x7f4ee81979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.264+0000 7f4eefd71640 1 --2- 172.21.15.17:0/3491815909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ee8100860 0x7f4ee81974a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.264+0000 7f4eefd71640 1 -- 172.21.15.17:0/3491815909 >> 172.21.15.17:0/3491815909 conn(0x7f4ee80fc010 msgr2=0x7f4ee80fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:17.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.264+0000 7f4eefd71640 1 -- 172.21.15.17:0/3491815909 shutdown_connections 2024-09-20T18:37:17.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.264+0000 7f4eefd71640 1 -- 172.21.15.17:0/3491815909 wait complete. 2024-09-20T18:37:17.290 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:37:17.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.368+0000 7f9dd7824640 1 -- 172.21.15.17:0/999548415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0101960 msgr2=0x7f9dd0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:17.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.368+0000 7f9dd7824640 1 --2- 172.21.15.17:0/999548415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0101960 0x7f9dd0101d60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009880 tx=0x7f9dcc02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.368+0000 7f9dd7824640 1 -- 172.21.15.17:0/999548415 shutdown_connections 2024-09-20T18:37:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.368+0000 7f9dd7824640 1 --2- 172.21.15.17:0/999548415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dd0102b60 0x7f9dd0102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.368+0000 7f9dd7824640 1 --2- 172.21.15.17:0/999548415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0101960 0x7f9dd0101d60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.368+0000 7f9dd7824640 1 -- 172.21.15.17:0/999548415 >> 172.21.15.17:0/999548415 conn(0x7f9dd00fd0f0 msgr2=0x7f9dd00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.368+0000 7f9dd7824640 1 -- 172.21.15.17:0/999548415 shutdown_connections 2024-09-20T18:37:17.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.368+0000 7f9dd7824640 1 -- 172.21.15.17:0/999548415 wait complete. 2024-09-20T18:37:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.369+0000 7f9dd7824640 1 Processor -- start 2024-09-20T18:37:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.369+0000 7f9dd7824640 1 -- start start 2024-09-20T18:37:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.369+0000 7f9dd7824640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dd0101960 0x7f9dd0197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:17.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.369+0000 7f9dd7824640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0102b60 0x7f9dd0197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:17.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.369+0000 7f9dd7824640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd010a7a0 con 0x7f9dd0102b60 2024-09-20T18:37:17.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.369+0000 7f9dd7824640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd010a620 con 0x7f9dd0101960 2024-09-20T18:37:17.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.369+0000 7f9dd4dbf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0102b60 0x7f9dd0197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:17.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.369+0000 7f9dd4dbf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0102b60 0x7f9dd0197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42064/0 (socket says 172.21.15.17:42064) 2024-09-20T18:37:17.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.369+0000 7f9dd4dbf640 1 -- 172.21.15.17:0/840933289 learned_addr learned my addr 172.21.15.17:0/840933289 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:37:17.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.370+0000 7f9dd55c0640 1 --2- 172.21.15.17:0/840933289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dd0101960 0x7f9dd0197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:17.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.370+0000 7f9dd55c0640 1 -- 172.21.15.17:0/840933289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0102b60 msgr2=0x7f9dd0197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:17.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.370+0000 7f9dd55c0640 1 --2- 172.21.15.17:0/840933289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0102b60 0x7f9dd0197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.370+0000 7f9dd55c0640 1 -- 172.21.15.17:0/840933289 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd01980c0 con 0x7f9dd0101960 2024-09-20T18:37:17.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.370+0000 7f9dd55c0640 1 --2- 172.21.15.17:0/840933289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dd0101960 0x7f9dd0197500 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc006010 tx=0x7f9dcc0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:17.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.370+0000 7f9dc67fc640 1 -- 172.21.15.17:0/840933289 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9dcc03f070 con 0x7f9dd0101960 2024-09-20T18:37:17.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.370+0000 7f9dc67fc640 1 -- 172.21.15.17:0/840933289 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9dcc0049d0 con 0x7f9dd0101960 2024-09-20T18:37:17.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.370+0000 7f9dd7824640 1 -- 172.21.15.17:0/840933289 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd019caa0 con 0x7f9dd0101960 2024-09-20T18:37:17.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.371+0000 7f9dc67fc640 1 -- 172.21.15.17:0/840933289 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9dcc035030 con 0x7f9dd0101960 2024-09-20T18:37:17.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.371+0000 7f9dd7824640 1 -- 172.21.15.17:0/840933289 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd019d030 con 0x7f9dd0101960 2024-09-20T18:37:17.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.372+0000 7f9dd7824640 1 -- 172.21.15.17:0/840933289 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd0101d60 con 0x7f9dd0101960 2024-09-20T18:37:17.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.373+0000 7f9dc67fc640 1 -- 172.21.15.17:0/840933289 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f9dcc042070 con 0x7f9dd0101960 2024-09-20T18:37:17.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.374+0000 7f9dc67fc640 1 --2- 172.21.15.17:0/840933289 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9dbc07b050 0x7f9dbc07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:17.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.374+0000 7f9dd4dbf640 1 --2- 172.21.15.17:0/840933289 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9dbc07b050 0x7f9dbc07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:17.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.374+0000 7f9dc67fc640 1 -- 172.21.15.17:0/840933289 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f9dcc0beb50 con 0x7f9dd0101960 2024-09-20T18:37:17.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.374+0000 7f9dd4dbf640 1 --2- 172.21.15.17:0/840933289 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9dbc07b050 0x7f9dbc07d510 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9dd01989b0 tx=0x7f9dc0005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.378+0000 7f9dc67fc640 1 -- 172.21.15.17:0/840933289 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f9dcc089fe0 con 0x7f9dd0101960 2024-09-20T18:37:17.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.655+0000 7f9dd7824640 1 -- 172.21.15.17:0/840933289 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9dd0062630 con 0x7f9dbc07b050 2024-09-20T18:37:17.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.656+0000 7f9dc67fc640 1 -- 172.21.15.17:0/840933289 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f9dd0062630 con 0x7f9dbc07b050 2024-09-20T18:37:17.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.659+0000 7f9dd7824640 1 -- 172.21.15.17:0/840933289 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9dbc07b050 msgr2=0x7f9dbc07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:17.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.659+0000 7f9dd7824640 1 --2- 172.21.15.17:0/840933289 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9dbc07b050 0x7f9dbc07d510 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9dd01989b0 tx=0x7f9dc0005f90 comp rx=0 tx=0).stop 2024-09-20T18:37:17.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.659+0000 7f9dd7824640 1 -- 172.21.15.17:0/840933289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dd0101960 msgr2=0x7f9dd0197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:17.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.659+0000 7f9dd7824640 1 --2- 172.21.15.17:0/840933289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dd0101960 0x7f9dd0197500 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc006010 tx=0x7f9dcc0045e0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.659+0000 7f9dd7824640 1 -- 172.21.15.17:0/840933289 shutdown_connections 2024-09-20T18:37:17.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.659+0000 7f9dd7824640 1 --2- 172.21.15.17:0/840933289 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9dbc07b050 0x7f9dbc07d510 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.659+0000 7f9dd7824640 1 --2- 172.21.15.17:0/840933289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd0102b60 0x7f9dd0197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.659+0000 7f9dd7824640 1 --2- 172.21.15.17:0/840933289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dd0101960 0x7f9dd0197500 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.659+0000 7f9dd7824640 1 -- 172.21.15.17:0/840933289 >> 172.21.15.17:0/840933289 conn(0x7f9dd00fd0f0 msgr2=0x7f9dd0106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:17.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.659+0000 7f9dd7824640 1 -- 172.21.15.17:0/840933289 shutdown_connections 2024-09-20T18:37:17.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.659+0000 7f9dd7824640 1 -- 172.21.15.17:0/840933289 wait complete. 2024-09-20T18:37:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.758+0000 7f374e47d640 1 -- 172.21.15.17:0/4073903969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3748101e30 msgr2=0x7f3748102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.758+0000 7f374e47d640 1 --2- 172.21.15.17:0/4073903969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3748101e30 0x7f3748102230 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3738009880 tx=0x7f373802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.758+0000 7f374e47d640 1 -- 172.21.15.17:0/4073903969 shutdown_connections 2024-09-20T18:37:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.758+0000 7f374e47d640 1 --2- 172.21.15.17:0/4073903969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3748100ae0 0x7f3748100f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.758+0000 7f374e47d640 1 --2- 172.21.15.17:0/4073903969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3748101e30 0x7f3748102230 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.758+0000 7f374e47d640 1 -- 172.21.15.17:0/4073903969 >> 172.21.15.17:0/4073903969 conn(0x7f37480fb760 msgr2=0x7f37480fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.758+0000 7f374e47d640 1 -- 172.21.15.17:0/4073903969 shutdown_connections 2024-09-20T18:37:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.758+0000 7f374e47d640 1 -- 172.21.15.17:0/4073903969 wait complete. 2024-09-20T18:37:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.759+0000 7f374e47d640 1 Processor -- start 2024-09-20T18:37:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.759+0000 7f374e47d640 1 -- start start 2024-09-20T18:37:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.760+0000 7f374e47d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3748100ae0 0x7f3748100500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.760+0000 7f374e47d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3748101e30 0x7f374819e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.760+0000 7f374e47d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3748109670 con 0x7f3748101e30 2024-09-20T18:37:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.760+0000 7f374e47d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f37481094f0 con 0x7f3748100ae0 2024-09-20T18:37:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.760+0000 7f37477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3748101e30 0x7f374819e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.760+0000 7f37477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3748101e30 0x7f374819e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42078/0 (socket says 172.21.15.17:42078) 2024-09-20T18:37:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.760+0000 7f37477fe640 1 -- 172.21.15.17:0/2828731650 learned_addr learned my addr 172.21.15.17:0/2828731650 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:37:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.760+0000 7f3747fff640 1 --2- 172.21.15.17:0/2828731650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3748100ae0 0x7f3748100500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.761+0000 7f3747fff640 1 -- 172.21.15.17:0/2828731650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3748101e30 msgr2=0x7f374819e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.761+0000 7f3747fff640 1 --2- 172.21.15.17:0/2828731650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3748101e30 0x7f374819e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.761+0000 7f3747fff640 1 -- 172.21.15.17:0/2828731650 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374819eb10 con 0x7f3748100ae0 2024-09-20T18:37:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.761+0000 7f3747fff640 1 --2- 172.21.15.17:0/2828731650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3748100ae0 0x7f3748100500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3738009230 tx=0x7f37380045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.761+0000 7f37457fa640 1 -- 172.21.15.17:0/2828731650 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f373803f070 con 0x7f3748100ae0 2024-09-20T18:37:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.761+0000 7f37457fa640 1 -- 172.21.15.17:0/2828731650 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f37380049d0 con 0x7f3748100ae0 2024-09-20T18:37:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.761+0000 7f374e47d640 1 -- 172.21.15.17:0/2828731650 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f374819ece0 con 0x7f3748100ae0 2024-09-20T18:37:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.761+0000 7f37457fa640 1 -- 172.21.15.17:0/2828731650 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3738035030 con 0x7f3748100ae0 2024-09-20T18:37:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.762+0000 7f374e47d640 1 -- 172.21.15.17:0/2828731650 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f374819f190 con 0x7f3748100ae0 2024-09-20T18:37:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.763+0000 7f374e47d640 1 -- 172.21.15.17:0/2828731650 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3748100f60 con 0x7f3748100ae0 2024-09-20T18:37:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.764+0000 7f37457fa640 1 -- 172.21.15.17:0/2828731650 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f3738042070 con 0x7f3748100ae0 2024-09-20T18:37:17.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.765+0000 7f37457fa640 1 --2- 172.21.15.17:0/2828731650 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f373007b0a0 0x7f373007d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:17.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.765+0000 7f37457fa640 1 -- 172.21.15.17:0/2828731650 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f37380beb60 con 0x7f3748100ae0 2024-09-20T18:37:17.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.766+0000 7f37477fe640 1 --2- 172.21.15.17:0/2828731650 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f373007b0a0 0x7f373007d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:17.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.767+0000 7f37477fe640 1 --2- 172.21.15.17:0/2828731650 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f373007b0a0 0x7f373007d560 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3748100280 tx=0x7f373c005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:17.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:17.770+0000 7f37457fa640 1 -- 172.21.15.17:0/2828731650 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f3738089fa0 con 0x7f3748100ae0 2024-09-20T18:37:17.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:17 smithi017 ceph-mon[28058]: pgmap v23: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 362 op/s 2024-09-20T18:37:17.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:17 smithi172 ceph-mon[35456]: pgmap v23: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 362 op/s 2024-09-20T18:37:18.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.085+0000 7f374e47d640 1 -- 172.21.15.17:0/2828731650 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3748062630 con 0x7f373007b0a0 2024-09-20T18:37:18.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.097+0000 7f37457fa640 1 -- 172.21.15.17:0/2828731650 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f3748062630 con 0x7f373007b0a0 2024-09-20T18:37:18.112 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:37:18.112 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (8m) 34s ago 9m 25.1M - 0.25.0 c8568f914cd2 8954ab699be3 2024-09-20T18:37:18.112 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (106s) 34s ago 9m 8438k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:37:18.112 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (75s) 37s ago 9m 8292k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:37:18.112 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (9m) 34s ago 9m 6895k - 19.1.1-369-ged8ee0f2 6acb0a031eab 725c8bcc6ec8 2024-09-20T18:37:18.113 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (8m) 37s ago 8m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab e10dd613dbe2 2024-09-20T18:37:18.113 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (8m) 34s ago 9m 81.0M - 9.4.12 2bacad6d85d8 d8c886b98eae 2024-09-20T18:37:18.113 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (4m) 34s ago 4m 240M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:37:18.113 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (4m) 34s ago 4m 282M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:37:18.113 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (4m) 37s ago 4m 26.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:37:18.113 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (4m) 37s ago 4m 25.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:37:18.113 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (52s) 34s ago 10m 489M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:37:18.113 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (2m) 37s ago 8m 141M - 19.3.0-5099-g88deadb8 441f9a3fe515 84c6ec0abc34 2024-09-20T18:37:18.113 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (10m) 34s ago 11m 56.3M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab ab1f988c4cb2 2024-09-20T18:37:18.113 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (8m) 37s ago 8m 44.3M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 9eea40352787 2024-09-20T18:37:18.113 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (9m) 34s ago 9m 14.0M - 1.5.0 0da6a335fe13 1584915999b1 2024-09-20T18:37:18.114 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (8m) 37s ago 8m 15.4M - 1.5.0 0da6a335fe13 880d938148e8 2024-09-20T18:37:18.114 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (7m) 34s ago 7m 181M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab c1207e514216 2024-09-20T18:37:18.114 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (7m) 34s ago 7m 190M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 73f2fd77590f 2024-09-20T18:37:18.114 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (6m) 34s ago 6m 162M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 6f0b9405dc18 2024-09-20T18:37:18.114 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (6m) 37s ago 6m 217M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:37:18.114 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (5m) 37s ago 5m 185M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:37:18.114 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (5m) 37s ago 5m 166M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:37:18.114 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (83s) 34s ago 9m 54.0M - 2.43.0 a07b618ecd1d ff7f415776b1 2024-09-20T18:37:18.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.099+0000 7f374e47d640 1 -- 172.21.15.17:0/2828731650 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f373007b0a0 msgr2=0x7f373007d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:18.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.099+0000 7f374e47d640 1 --2- 172.21.15.17:0/2828731650 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f373007b0a0 0x7f373007d560 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3748100280 tx=0x7f373c005f90 comp rx=0 tx=0).stop 2024-09-20T18:37:18.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.099+0000 7f374e47d640 1 -- 172.21.15.17:0/2828731650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3748100ae0 msgr2=0x7f3748100500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.099+0000 7f374e47d640 1 --2- 172.21.15.17:0/2828731650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3748100ae0 0x7f3748100500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3738009230 tx=0x7f37380045e0 comp rx=0 tx=0).stop 2024-09-20T18:37:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.099+0000 7f374e47d640 1 -- 172.21.15.17:0/2828731650 shutdown_connections 2024-09-20T18:37:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.099+0000 7f374e47d640 1 --2- 172.21.15.17:0/2828731650 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f373007b0a0 0x7f373007d560 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.099+0000 7f374e47d640 1 --2- 172.21.15.17:0/2828731650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3748101e30 0x7f374819e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.099+0000 7f374e47d640 1 --2- 172.21.15.17:0/2828731650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3748100ae0 0x7f3748100500 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.099+0000 7f374e47d640 1 -- 172.21.15.17:0/2828731650 >> 172.21.15.17:0/2828731650 conn(0x7f37480fb760 msgr2=0x7f3748104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.100+0000 7f374e47d640 1 -- 172.21.15.17:0/2828731650 shutdown_connections 2024-09-20T18:37:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.100+0000 7f374e47d640 1 -- 172.21.15.17:0/2828731650 wait complete. 2024-09-20T18:37:18.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.203+0000 7f2126d94640 1 -- 172.21.15.17:0/4108590697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120100860 msgr2=0x7f2120100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:18.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.203+0000 7f2126d94640 1 --2- 172.21.15.17:0/4108590697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120100860 0x7f2120100c60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2114009880 tx=0x7f211402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:37:18.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.203+0000 7f2126d94640 1 -- 172.21.15.17:0/4108590697 shutdown_connections 2024-09-20T18:37:18.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.203+0000 7f2126d94640 1 --2- 172.21.15.17:0/4108590697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120101a60 0x7f2120101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:18.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.203+0000 7f2126d94640 1 --2- 172.21.15.17:0/4108590697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120100860 0x7f2120100c60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:18.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.203+0000 7f2126d94640 1 -- 172.21.15.17:0/4108590697 >> 172.21.15.17:0/4108590697 conn(0x7f21200fc010 msgr2=0x7f21200fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:18.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.203+0000 7f2126d94640 1 -- 172.21.15.17:0/4108590697 shutdown_connections 2024-09-20T18:37:18.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.203+0000 7f2126d94640 1 -- 172.21.15.17:0/4108590697 wait complete. 2024-09-20T18:37:18.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.204+0000 7f2126d94640 1 Processor -- start 2024-09-20T18:37:18.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.204+0000 7f2126d94640 1 -- start start 2024-09-20T18:37:18.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.204+0000 7f2126d94640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120100860 0x7f212006a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:18.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.204+0000 7f2126d94640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120101a60 0x7f212019c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:18.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.204+0000 7f2126d94640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2120109680 con 0x7f2120101a60 2024-09-20T18:37:18.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.204+0000 7f2126d94640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2120109500 con 0x7f2120100860 2024-09-20T18:37:18.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.204+0000 7f211ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120101a60 0x7f212019c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:18.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.204+0000 7f2124b30640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120100860 0x7f212006a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:18.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.204+0000 7f2124b30640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120100860 0x7f212006a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:48270/0 (socket says 172.21.15.17:48270) 2024-09-20T18:37:18.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.204+0000 7f2124b30640 1 -- 172.21.15.17:0/1502652515 learned_addr learned my addr 172.21.15.17:0/1502652515 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:37:18.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.205+0000 7f2124b30640 1 -- 172.21.15.17:0/1502652515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120101a60 msgr2=0x7f212019c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:18.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.205+0000 7f2124b30640 1 --2- 172.21.15.17:0/1502652515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120101a60 0x7f212019c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:18.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.205+0000 7f2124b30640 1 -- 172.21.15.17:0/1502652515 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212019c7c0 con 0x7f2120100860 2024-09-20T18:37:18.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.205+0000 7f211ffff640 1 --2- 172.21.15.17:0/1502652515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120101a60 0x7f212019c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T18:37:18.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.205+0000 7f2124b30640 1 --2- 172.21.15.17:0/1502652515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120100860 0x7f212006a790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2114006010 tx=0x7f21140045c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:18.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.205+0000 7f211dffb640 1 -- 172.21.15.17:0/1502652515 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f211403f070 con 0x7f2120100860 2024-09-20T18:37:18.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.205+0000 7f211dffb640 1 -- 172.21.15.17:0/1502652515 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2114004a50 con 0x7f2120100860 2024-09-20T18:37:18.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.205+0000 7f2126d94640 1 -- 172.21.15.17:0/1502652515 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f212019ca50 con 0x7f2120100860 2024-09-20T18:37:18.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.205+0000 7f211dffb640 1 -- 172.21.15.17:0/1502652515 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2114035030 con 0x7f2120100860 2024-09-20T18:37:18.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.206+0000 7f2126d94640 1 -- 172.21.15.17:0/1502652515 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f212019cf80 con 0x7f2120100860 2024-09-20T18:37:18.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.207+0000 7f2126d94640 1 -- 172.21.15.17:0/1502652515 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2120100c60 con 0x7f2120100860 2024-09-20T18:37:18.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.208+0000 7f211dffb640 1 -- 172.21.15.17:0/1502652515 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f2114042070 con 0x7f2120100860 2024-09-20T18:37:18.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.209+0000 7f211dffb640 1 --2- 172.21.15.17:0/1502652515 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f211007b0a0 0x7f211007d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:18.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.209+0000 7f211dffb640 1 -- 172.21.15.17:0/1502652515 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f21140bedf0 con 0x7f2120100860 2024-09-20T18:37:18.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.209+0000 7f211ffff640 1 --2- 172.21.15.17:0/1502652515 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f211007b0a0 0x7f211007d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:18.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.209+0000 7f211ffff640 1 --2- 172.21.15.17:0/1502652515 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f211007b0a0 0x7f211007d560 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f212006a510 tx=0x7f210c00b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:18.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.213+0000 7f211dffb640 1 -- 172.21.15.17:0/1502652515 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f2114004c00 con 0x7f2120100860 2024-09-20T18:37:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.664+0000 7f2126d94640 1 -- 172.21.15.17:0/1502652515 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f212019d410 con 0x7f2120100860 2024-09-20T18:37:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.665+0000 7f211dffb640 1 -- 172.21.15.17:0/1502652515 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f211408a170 con 0x7f2120100860 2024-09-20T18:37:18.680 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:37:18.680 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:37:18.680 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T18:37:18.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:37:18.681 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:37:18.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:37:18.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:37:18.681 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:37:18.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T18:37:18.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:37:18.681 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:37:18.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:37:18.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:37:18.681 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:37:18.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 12, 2024-09-20T18:37:18.681 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:37:18.681 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:37:18.681 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:37:18.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.667+0000 7f2126d94640 1 -- 172.21.15.17:0/1502652515 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f211007b0a0 msgr2=0x7f211007d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:18.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.667+0000 7f2126d94640 1 --2- 172.21.15.17:0/1502652515 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f211007b0a0 0x7f211007d560 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f212006a510 tx=0x7f210c00b390 comp rx=0 tx=0).stop 2024-09-20T18:37:18.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.667+0000 7f2126d94640 1 -- 172.21.15.17:0/1502652515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120100860 msgr2=0x7f212006a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:18.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.667+0000 7f2126d94640 1 --2- 172.21.15.17:0/1502652515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120100860 0x7f212006a790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2114006010 tx=0x7f21140045c0 comp rx=0 tx=0).stop 2024-09-20T18:37:18.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.668+0000 7f2126d94640 1 -- 172.21.15.17:0/1502652515 shutdown_connections 2024-09-20T18:37:18.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.668+0000 7f2126d94640 1 --2- 172.21.15.17:0/1502652515 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f211007b0a0 0x7f211007d560 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:18.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.668+0000 7f2126d94640 1 --2- 172.21.15.17:0/1502652515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120101a60 0x7f212019c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:18.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.668+0000 7f2126d94640 1 --2- 172.21.15.17:0/1502652515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120100860 0x7f212006a790 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:18.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.668+0000 7f2126d94640 1 -- 172.21.15.17:0/1502652515 >> 172.21.15.17:0/1502652515 conn(0x7f21200fc010 msgr2=0x7f21200fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:18.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.668+0000 7f2126d94640 1 -- 172.21.15.17:0/1502652515 shutdown_connections 2024-09-20T18:37:18.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.668+0000 7f2126d94640 1 -- 172.21.15.17:0/1502652515 wait complete. 2024-09-20T18:37:18.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.772+0000 7feb7731d640 1 -- 172.21.15.17:0/1571684508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb70100860 msgr2=0x7feb70100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:18.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.772+0000 7feb7731d640 1 --2- 172.21.15.17:0/1571684508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb70100860 0x7feb70100c60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7feb6c009880 tx=0x7feb6c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:37:18.787 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:18 smithi017 ceph-mon[28058]: from='client.24547 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:37:18.788 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:18 smithi017 ceph-mon[28058]: from='client.24551 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:37:18.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.772+0000 7feb7731d640 1 -- 172.21.15.17:0/1571684508 shutdown_connections 2024-09-20T18:37:18.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.772+0000 7feb7731d640 1 --2- 172.21.15.17:0/1571684508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb70101a60 0x7feb70101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:18.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.772+0000 7feb7731d640 1 --2- 172.21.15.17:0/1571684508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb70100860 0x7feb70100c60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:18.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.772+0000 7feb7731d640 1 -- 172.21.15.17:0/1571684508 >> 172.21.15.17:0/1571684508 conn(0x7feb700fc010 msgr2=0x7feb700fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:18.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.772+0000 7feb7731d640 1 -- 172.21.15.17:0/1571684508 shutdown_connections 2024-09-20T18:37:18.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.773+0000 7feb7731d640 1 -- 172.21.15.17:0/1571684508 wait complete. 2024-09-20T18:37:18.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.773+0000 7feb7731d640 1 Processor -- start 2024-09-20T18:37:18.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.773+0000 7feb7731d640 1 -- start start 2024-09-20T18:37:18.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.773+0000 7feb7731d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb70100860 0x7feb70104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:18.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.773+0000 7feb7731d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb70101a60 0x7feb70102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.773+0000 7feb7731d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7feb70109680 con 0x7feb70101a60 2024-09-20T18:37:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.773+0000 7feb7731d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feb70109500 con 0x7feb70100860 2024-09-20T18:37:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.774+0000 7feb748b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb70101a60 0x7feb70102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.774+0000 7feb748b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb70101a60 0x7feb70102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42126/0 (socket says 172.21.15.17:42126) 2024-09-20T18:37:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.774+0000 7feb748b8640 1 -- 172.21.15.17:0/1026084375 learned_addr learned my addr 172.21.15.17:0/1026084375 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:37:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.774+0000 7feb750b9640 1 --2- 172.21.15.17:0/1026084375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb70100860 0x7feb70104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.774+0000 7feb748b8640 1 -- 172.21.15.17:0/1026084375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb70100860 msgr2=0x7feb70104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.774+0000 7feb748b8640 1 --2- 172.21.15.17:0/1026084375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb70100860 0x7feb70104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.774+0000 7feb748b8640 1 -- 172.21.15.17:0/1026084375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb70103380 con 0x7feb70101a60 2024-09-20T18:37:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.774+0000 7feb748b8640 1 --2- 172.21.15.17:0/1026084375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb70101a60 0x7feb70102e40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7feb6000d8d0 tx=0x7feb6000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:18.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.774+0000 7feb667fc640 1 -- 172.21.15.17:0/1026084375 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb60017070 con 0x7feb70101a60 2024-09-20T18:37:18.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.775+0000 7feb7731d640 1 -- 172.21.15.17:0/1026084375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb70103670 con 0x7feb70101a60 2024-09-20T18:37:18.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.775+0000 7feb7731d640 1 -- 172.21.15.17:0/1026084375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb70103c00 con 0x7feb70101a60 2024-09-20T18:37:18.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.775+0000 7feb667fc640 1 -- 172.21.15.17:0/1026084375 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feb60010460 con 0x7feb70101a60 2024-09-20T18:37:18.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.775+0000 7feb667fc640 1 -- 172.21.15.17:0/1026084375 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb6000f5f0 con 0x7feb70101a60 2024-09-20T18:37:18.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.776+0000 7feb7731d640 1 -- 172.21.15.17:0/1026084375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb70100c60 con 0x7feb70101a60 2024-09-20T18:37:18.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.777+0000 7feb667fc640 1 -- 172.21.15.17:0/1026084375 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7feb60009a30 con 0x7feb70101a60 2024-09-20T18:37:18.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.777+0000 7feb667fc640 1 --2- 172.21.15.17:0/1026084375 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb5c07b0b0 0x7feb5c07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:18.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.778+0000 7feb667fc640 1 -- 172.21.15.17:0/1026084375 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7feb6009df30 con 0x7feb70101a60 2024-09-20T18:37:18.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.778+0000 7feb750b9640 1 --2- 172.21.15.17:0/1026084375 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb5c07b0b0 0x7feb5c07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:18.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.778+0000 7feb750b9640 1 --2- 172.21.15.17:0/1026084375 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb5c07b0b0 0x7feb5c07d570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feb6c009230 tx=0x7feb6c0058d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:18.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:18.782+0000 7feb667fc640 1 -- 172.21.15.17:0/1026084375 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7feb60069440 con 0x7feb70101a60 2024-09-20T18:37:18.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:18 smithi172 ceph-mon[35456]: from='client.24547 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:37:18.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:18 smithi172 ceph-mon[35456]: from='client.24551 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:37:19.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:19.034+0000 7feb7731d640 1 -- 172.21.15.17:0/1026084375 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7feb7006a3e0 con 0x7feb5c07b0b0 2024-09-20T18:37:19.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:19.036+0000 7feb667fc640 1 -- 172.21.15.17:0/1026084375 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7feb7006a3e0 con 0x7feb5c07b0b0 2024-09-20T18:37:19.051 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:37:19.051 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:37:19.051 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:37:19.051 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T18:37:19.051 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:37:19.051 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-09-20T18:37:19.051 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:37:19.051 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "2/2 daemons upgraded", 2024-09-20T18:37:19.051 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-20T18:37:19.051 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:37:19.051 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:37:19.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:19.039+0000 7feb7731d640 1 -- 172.21.15.17:0/1026084375 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb5c07b0b0 msgr2=0x7feb5c07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:19.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:19.039+0000 7feb7731d640 1 --2- 172.21.15.17:0/1026084375 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb5c07b0b0 0x7feb5c07d570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feb6c009230 tx=0x7feb6c0058d0 comp rx=0 tx=0).stop 2024-09-20T18:37:19.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:19.039+0000 7feb7731d640 1 -- 172.21.15.17:0/1026084375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb70101a60 msgr2=0x7feb70102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:19.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:19.039+0000 7feb7731d640 1 --2- 172.21.15.17:0/1026084375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb70101a60 0x7feb70102e40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7feb6000d8d0 tx=0x7feb6000dd90 comp rx=0 tx=0).stop 2024-09-20T18:37:19.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:19.039+0000 7feb7731d640 1 -- 172.21.15.17:0/1026084375 shutdown_connections 2024-09-20T18:37:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:19.039+0000 7feb7731d640 1 --2- 172.21.15.17:0/1026084375 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb5c07b0b0 0x7feb5c07d570 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:19.039+0000 7feb7731d640 1 --2- 172.21.15.17:0/1026084375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb70101a60 0x7feb70102e40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:19.039+0000 7feb7731d640 1 --2- 172.21.15.17:0/1026084375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb70100860 0x7feb70104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:19.039+0000 7feb7731d640 1 -- 172.21.15.17:0/1026084375 >> 172.21.15.17:0/1026084375 conn(0x7feb700fc010 msgr2=0x7feb70069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:19.039+0000 7feb7731d640 1 -- 172.21.15.17:0/1026084375 shutdown_connections 2024-09-20T18:37:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:19.039+0000 7feb7731d640 1 -- 172.21.15.17:0/1026084375 wait complete. 2024-09-20T18:37:19.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:19 smithi017 ceph-mon[28058]: from='client.24555 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:37:19.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:19 smithi017 ceph-mon[28058]: pgmap v24: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 539 op/s 2024-09-20T18:37:19.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:19 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1502652515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:19.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:19 smithi172 ceph-mon[35456]: from='client.24555 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:37:19.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:19 smithi172 ceph-mon[35456]: pgmap v24: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 539 op/s 2024-09-20T18:37:19.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:19 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/1502652515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:20.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:20 smithi017 ceph-mon[28058]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:37:20.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:20 smithi172 ceph-mon[35456]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:37:21.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:21 smithi017 ceph-mon[28058]: pgmap v25: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 414 op/s 2024-09-20T18:37:21.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:21 smithi172 ceph-mon[35456]: pgmap v25: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 414 op/s 2024-09-20T18:37:22.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:22 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:37:22.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:22 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:37:23.898 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:23 smithi172 ceph-mon[35456]: pgmap v26: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 477 op/s 2024-09-20T18:37:23.898 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:23 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:23.898 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:23 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:23.898 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:23 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:37:23.898 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:23 smithi172 ceph-mon[35456]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:37:23.898 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:23 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:37:23.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:23 smithi017 ceph-mon[28058]: pgmap v26: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 477 op/s 2024-09-20T18:37:23.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:23 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:23.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:23 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:23.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:23 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:37:23.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:23 smithi017 ceph-mon[28058]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:37:23.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:23 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:37:24.847 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:24 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.jczphg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:37:24.847 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:24 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.jczphg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:37:24.848 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:24 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T18:37:24.848 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:24 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:37:25.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:24 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.jczphg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:37:25.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:24 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.jczphg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-20T18:37:25.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:24 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-20T18:37:25.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:24 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:37:25.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:25 smithi172 ceph-mon[35456]: Upgrade: Updating mgr.smithi172.jczphg 2024-09-20T18:37:25.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:25 smithi172 ceph-mon[35456]: Deploying daemon mgr.smithi172.jczphg on smithi172 2024-09-20T18:37:25.904 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:25 smithi172 ceph-mon[35456]: pgmap v27: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 435 op/s 2024-09-20T18:37:26.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:25 smithi017 ceph-mon[28058]: Upgrade: Updating mgr.smithi172.jczphg 2024-09-20T18:37:26.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:25 smithi017 ceph-mon[28058]: Deploying daemon mgr.smithi172.jczphg on smithi172 2024-09-20T18:37:26.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:25 smithi017 ceph-mon[28058]: pgmap v27: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 435 op/s 2024-09-20T18:37:27.814 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:27 smithi172 ceph-mon[35456]: pgmap v28: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 313 op/s 2024-09-20T18:37:27.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:27 smithi017 ceph-mon[28058]: pgmap v28: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 313 op/s 2024-09-20T18:37:29.294 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:28 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:29.294 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:28 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:29.294 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:28 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:37:29.294 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:28 smithi172 ceph-mon[35456]: pgmap v29: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 459 op/s 2024-09-20T18:37:29.294 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:28 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:29.294 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:28 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:29.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:28 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:29.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:28 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:29.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:28 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:37:29.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:28 smithi017 ceph-mon[28058]: pgmap v29: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 459 op/s 2024-09-20T18:37:29.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:28 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:29.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:28 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:31.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:31 smithi017 ceph-mon[28058]: pgmap v30: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 282 op/s 2024-09-20T18:37:31.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:31 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:31.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:31 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:31.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:31 smithi172 ceph-mon[35456]: pgmap v30: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 282 op/s 2024-09-20T18:37:31.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:31 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:31.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:31 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:32.747 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:32 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:32.747 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:32 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:32.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:32 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:32.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:32 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:33.144 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-20T18:37:33.144 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-20T18:37:33.453 DEBUG:teuthology.parallel:result is None 2024-09-20T18:37:33.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:33 smithi172 ceph-mon[35456]: pgmap v31: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 328 op/s 2024-09-20T18:37:33.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:33 smithi017 ceph-mon[28058]: pgmap v31: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 328 op/s 2024-09-20T18:37:34.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:34 smithi172 ceph-mon[35456]: Standby manager daemon smithi172.jczphg restarted 2024-09-20T18:37:34.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:34 smithi172 ceph-mon[35456]: Standby manager daemon smithi172.jczphg started 2024-09-20T18:37:34.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:34 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.172:0/3499140069' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.jczphg/crt"}]: dispatch 2024-09-20T18:37:34.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:34 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.172:0/3499140069' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T18:37:34.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:34 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.172:0/3499140069' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.jczphg/key"}]: dispatch 2024-09-20T18:37:34.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:34 smithi172 ceph-mon[35456]: from='mgr.? 172.21.15.172:0/3499140069' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T18:37:34.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:34 smithi017 ceph-mon[28058]: Standby manager daemon smithi172.jczphg restarted 2024-09-20T18:37:34.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:34 smithi017 ceph-mon[28058]: Standby manager daemon smithi172.jczphg started 2024-09-20T18:37:34.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:34 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.172:0/3499140069' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.jczphg/crt"}]: dispatch 2024-09-20T18:37:34.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:34 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.172:0/3499140069' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-20T18:37:34.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:34 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.172:0/3499140069' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi172.jczphg/key"}]: dispatch 2024-09-20T18:37:34.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:34 smithi017 ceph-mon[28058]: from='mgr.? 172.21.15.172:0/3499140069' entity='mgr.smithi172.jczphg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-20T18:37:35.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:35 smithi017 ceph-mon[28058]: pgmap v32: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 334 op/s 2024-09-20T18:37:35.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:35 smithi017 ceph-mon[28058]: mgrmap e32: smithi017.xusjwd(active, since 58s), standbys: smithi172.jczphg 2024-09-20T18:37:35.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:35 smithi172 ceph-mon[35456]: pgmap v32: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 334 op/s 2024-09-20T18:37:35.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:35 smithi172 ceph-mon[35456]: mgrmap e32: smithi017.xusjwd(active, since 58s), standbys: smithi172.jczphg 2024-09-20T18:37:36.647 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:36 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:36.647 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:36 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:36.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:36 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:36.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:36 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:37.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:37 smithi017 ceph-mon[28058]: pgmap v33: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 260 op/s 2024-09-20T18:37:37.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:37 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:37:37.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:37 smithi172 ceph-mon[35456]: pgmap v33: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 260 op/s 2024-09-20T18:37:37.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:37 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:37:39.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:39 smithi172 ceph-mon[35456]: pgmap v34: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 326 op/s 2024-09-20T18:37:40.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:39 smithi017 ceph-mon[28058]: pgmap v34: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 326 op/s 2024-09-20T18:37:41.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:37:41.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:37:41.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:37:41.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:41.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: Upgrade: Setting container_image for all mgr 2024-09-20T18:37:41.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi017.xusjwd"}]: dispatch 2024-09-20T18:37:41.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi017.xusjwd"}]: dispatch 2024-09-20T18:37:41.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi017.xusjwd"}]': finished 2024-09-20T18:37:41.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi172.jczphg"}]: dispatch 2024-09-20T18:37:41.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi172.jczphg"}]: dispatch 2024-09-20T18:37:41.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi172.jczphg"}]': finished 2024-09-20T18:37:41.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:41.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: Upgrade: Setting container_image for all rgw 2024-09-20T18:37:41.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:41.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: Upgrade: Setting container_image for all rbd-mirror 2024-09-20T18:37:41.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:41.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-20T18:37:41.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:41.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: Upgrade: Setting container_image for all iscsi 2024-09-20T18:37:41.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:41.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: Upgrade: Setting container_image for all nfs 2024-09-20T18:37:41.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:41.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: Upgrade: Setting container_image for all nvmeof 2024-09-20T18:37:41.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:41 smithi017 ceph-mon[28058]: pgmap v35: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 180 op/s 2024-09-20T18:37:41.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:37:41.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:37:41.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:37:41.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:41.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: Upgrade: Setting container_image for all mgr 2024-09-20T18:37:41.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi017.xusjwd"}]: dispatch 2024-09-20T18:37:41.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi017.xusjwd"}]: dispatch 2024-09-20T18:37:41.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi017.xusjwd"}]': finished 2024-09-20T18:37:41.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi172.jczphg"}]: dispatch 2024-09-20T18:37:41.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi172.jczphg"}]: dispatch 2024-09-20T18:37:41.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi172.jczphg"}]': finished 2024-09-20T18:37:41.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:41.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: Upgrade: Setting container_image for all rgw 2024-09-20T18:37:41.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:41.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: Upgrade: Setting container_image for all rbd-mirror 2024-09-20T18:37:41.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:41.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-20T18:37:41.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:41.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: Upgrade: Setting container_image for all iscsi 2024-09-20T18:37:41.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:41.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: Upgrade: Setting container_image for all nfs 2024-09-20T18:37:41.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:41.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: Upgrade: Setting container_image for all nvmeof 2024-09-20T18:37:41.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:41.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:41 smithi172 ceph-mon[35456]: pgmap v35: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 180 op/s 2024-09-20T18:37:43.603 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:43 smithi017 ceph-mon[28058]: Upgrade: Updating node-exporter.smithi017 (1/2) 2024-09-20T18:37:43.603 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:43 smithi017 ceph-mon[28058]: Deploying daemon node-exporter.smithi017 on smithi017 2024-09-20T18:37:43.603 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:43 smithi017 ceph-mon[28058]: pgmap v36: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 203 op/s 2024-09-20T18:37:43.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:43 smithi172 ceph-mon[35456]: Upgrade: Updating node-exporter.smithi017 (1/2) 2024-09-20T18:37:43.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:43 smithi172 ceph-mon[35456]: Deploying daemon node-exporter.smithi017 on smithi017 2024-09-20T18:37:43.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:43 smithi172 ceph-mon[35456]: pgmap v36: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 203 op/s 2024-09-20T18:37:45.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:45 smithi017 ceph-mon[28058]: pgmap v37: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 198 op/s 2024-09-20T18:37:45.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:45 smithi172 ceph-mon[35456]: pgmap v37: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 198 op/s 2024-09-20T18:37:46.987 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-20T18:37:46.987 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-20T18:37:47.368 DEBUG:teuthology.parallel:result is None 2024-09-20T18:37:47.369 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-20T18:37:47.405 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-20T18:37:47.405 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-20T18:37:47.439 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-20T18:37:47.440 DEBUG:teuthology.parallel:result is None 2024-09-20T18:37:47.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:47 smithi017 ceph-mon[28058]: pgmap v38: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 971 KiB/s rd, 1009 KiB/s wr, 129 op/s 2024-09-20T18:37:47.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:47 smithi172 ceph-mon[35456]: pgmap v38: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 971 KiB/s rd, 1009 KiB/s wr, 129 op/s 2024-09-20T18:37:49.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.129+0000 7f8e9c5d0640 1 -- 172.21.15.17:0/876002383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e94102b60 msgr2=0x7f8e94102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:49.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.129+0000 7f8e9c5d0640 1 --2- 172.21.15.17:0/876002383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e94102b60 0x7f8e94102fe0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009880 tx=0x7f8e8402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.129+0000 7f8e9c5d0640 1 -- 172.21.15.17:0/876002383 shutdown_connections 2024-09-20T18:37:49.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.129+0000 7f8e9c5d0640 1 --2- 172.21.15.17:0/876002383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e94102b60 0x7f8e94102fe0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.129+0000 7f8e9c5d0640 1 --2- 172.21.15.17:0/876002383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e94101960 0x7f8e94101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.129+0000 7f8e9c5d0640 1 -- 172.21.15.17:0/876002383 >> 172.21.15.17:0/876002383 conn(0x7f8e940fd0f0 msgr2=0x7f8e940ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.129+0000 7f8e9c5d0640 1 -- 172.21.15.17:0/876002383 shutdown_connections 2024-09-20T18:37:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.129+0000 7f8e9c5d0640 1 -- 172.21.15.17:0/876002383 wait complete. 2024-09-20T18:37:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.130+0000 7f8e9c5d0640 1 Processor -- start 2024-09-20T18:37:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.130+0000 7f8e9c5d0640 1 -- start start 2024-09-20T18:37:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.130+0000 7f8e9c5d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e94101960 0x7f8e941974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.130+0000 7f8e9c5d0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e94102b60 0x7f8e941979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.130+0000 7f8e9c5d0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9410a7a0 con 0x7f8e94101960 2024-09-20T18:37:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.130+0000 7f8e9c5d0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9410a620 con 0x7f8e94102b60 2024-09-20T18:37:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.130+0000 7f8e9a36c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e94101960 0x7f8e941974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.130+0000 7f8e9a36c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e94101960 0x7f8e941974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45772/0 (socket says 172.21.15.17:45772) 2024-09-20T18:37:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.130+0000 7f8e9a36c640 1 -- 172.21.15.17:0/203423782 learned_addr learned my addr 172.21.15.17:0/203423782 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:37:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.130+0000 7f8e9a36c640 1 -- 172.21.15.17:0/203423782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e94102b60 msgr2=0x7f8e941979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.130+0000 7f8e9a36c640 1 --2- 172.21.15.17:0/203423782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e94102b60 0x7f8e941979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.130+0000 7f8e9a36c640 1 -- 172.21.15.17:0/203423782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e94198060 con 0x7f8e94101960 2024-09-20T18:37:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.131+0000 7f8e9a36c640 1 --2- 172.21.15.17:0/203423782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e94101960 0x7f8e941974a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000d8d0 tx=0x7f8e9000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.131+0000 7f8e8b7fe640 1 -- 172.21.15.17:0/203423782 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e90017070 con 0x7f8e94101960 2024-09-20T18:37:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.131+0000 7f8e8b7fe640 1 -- 172.21.15.17:0/203423782 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e9000be10 con 0x7f8e94101960 2024-09-20T18:37:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.131+0000 7f8e9c5d0640 1 -- 172.21.15.17:0/203423782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e9419caa0 con 0x7f8e94101960 2024-09-20T18:37:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.131+0000 7f8e9c5d0640 1 -- 172.21.15.17:0/203423782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e9419d030 con 0x7f8e94101960 2024-09-20T18:37:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.131+0000 7f8e8b7fe640 1 -- 172.21.15.17:0/203423782 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e9000f3c0 con 0x7f8e94101960 2024-09-20T18:37:49.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.132+0000 7f8e9c5d0640 1 -- 172.21.15.17:0/203423782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e94101d60 con 0x7f8e94101960 2024-09-20T18:37:49.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.133+0000 7f8e8b7fe640 1 -- 172.21.15.17:0/203423782 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f8e9001a070 con 0x7f8e94101960 2024-09-20T18:37:49.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.133+0000 7f8e8b7fe640 1 --2- 172.21.15.17:0/203423782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e8007b0b0 0x7f8e8007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:49.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.134+0000 7f8e99b6b640 1 --2- 172.21.15.17:0/203423782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e8007b0b0 0x7f8e8007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:49.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.134+0000 7f8e8b7fe640 1 -- 172.21.15.17:0/203423782 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f8e9009dd10 con 0x7f8e94101960 2024-09-20T18:37:49.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.134+0000 7f8e99b6b640 1 --2- 172.21.15.17:0/203423782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e8007b0b0 0x7f8e8007d570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8e840096c0 tx=0x7f8e84000bc0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:49.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.138+0000 7f8e8b7fe640 1 -- 172.21.15.17:0/203423782 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f8e90069220 con 0x7f8e94101960 2024-09-20T18:37:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.344+0000 7f8e9c5d0640 1 -- 172.21.15.17:0/203423782 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8e940626f0 con 0x7f8e8007b0b0 2024-09-20T18:37:49.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.345+0000 7f8e8b7fe640 1 -- 172.21.15.17:0/203423782 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f8e940626f0 con 0x7f8e8007b0b0 2024-09-20T18:37:49.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.347+0000 7f8e9c5d0640 1 -- 172.21.15.17:0/203423782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e8007b0b0 msgr2=0x7f8e8007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:49.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.347+0000 7f8e9c5d0640 1 --2- 172.21.15.17:0/203423782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e8007b0b0 0x7f8e8007d570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8e840096c0 tx=0x7f8e84000bc0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.347+0000 7f8e9c5d0640 1 -- 172.21.15.17:0/203423782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e94101960 msgr2=0x7f8e941974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:49.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.347+0000 7f8e9c5d0640 1 --2- 172.21.15.17:0/203423782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e94101960 0x7f8e941974a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000d8d0 tx=0x7f8e9000dd90 comp rx=0 tx=0).stop 2024-09-20T18:37:49.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.347+0000 7f8e9c5d0640 1 -- 172.21.15.17:0/203423782 shutdown_connections 2024-09-20T18:37:49.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.347+0000 7f8e9c5d0640 1 --2- 172.21.15.17:0/203423782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e8007b0b0 0x7f8e8007d570 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.347+0000 7f8e9c5d0640 1 --2- 172.21.15.17:0/203423782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e94102b60 0x7f8e941979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.347+0000 7f8e9c5d0640 1 --2- 172.21.15.17:0/203423782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e94101960 0x7f8e941974a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.347+0000 7f8e9c5d0640 1 -- 172.21.15.17:0/203423782 >> 172.21.15.17:0/203423782 conn(0x7f8e940fd0f0 msgr2=0x7f8e94106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:49.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.347+0000 7f8e9c5d0640 1 -- 172.21.15.17:0/203423782 shutdown_connections 2024-09-20T18:37:49.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.347+0000 7f8e9c5d0640 1 -- 172.21.15.17:0/203423782 wait complete. 2024-09-20T18:37:49.373 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:37:49.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:49 smithi017 ceph-mon[28058]: pgmap v39: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 201 op/s 2024-09-20T18:37:49.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.437+0000 7fa628abe640 1 -- 172.21.15.17:0/1135885814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624101a60 msgr2=0x7fa624101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:49.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.437+0000 7fa628abe640 1 --2- 172.21.15.17:0/1135885814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624101a60 0x7fa624101ee0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009880 tx=0x7fa60c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.437+0000 7fa628abe640 1 -- 172.21.15.17:0/1135885814 shutdown_connections 2024-09-20T18:37:49.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.437+0000 7fa628abe640 1 --2- 172.21.15.17:0/1135885814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624101a60 0x7fa624101ee0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.437+0000 7fa628abe640 1 --2- 172.21.15.17:0/1135885814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa624100860 0x7fa624100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.437+0000 7fa628abe640 1 -- 172.21.15.17:0/1135885814 >> 172.21.15.17:0/1135885814 conn(0x7fa6240fc010 msgr2=0x7fa6240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:49.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.437+0000 7fa628abe640 1 -- 172.21.15.17:0/1135885814 shutdown_connections 2024-09-20T18:37:49.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.437+0000 7fa628abe640 1 -- 172.21.15.17:0/1135885814 wait complete. 2024-09-20T18:37:49.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.437+0000 7fa628abe640 1 Processor -- start 2024-09-20T18:37:49.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.437+0000 7fa628abe640 1 -- start start 2024-09-20T18:37:49.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.438+0000 7fa628abe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624100860 0x7fa624197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:49.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.438+0000 7fa628abe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa624101a60 0x7fa624197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:49.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.438+0000 7fa628abe640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa6241096a0 con 0x7fa624100860 2024-09-20T18:37:49.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.438+0000 7fa628abe640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa624109520 con 0x7fa624101a60 2024-09-20T18:37:49.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.438+0000 7fa62259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624100860 0x7fa624197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:49.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.438+0000 7fa62259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624100860 0x7fa624197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45798/0 (socket says 172.21.15.17:45798) 2024-09-20T18:37:49.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.438+0000 7fa62259c640 1 -- 172.21.15.17:0/3524811799 learned_addr learned my addr 172.21.15.17:0/3524811799 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:37:49.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.438+0000 7fa61bfff640 1 --2- 172.21.15.17:0/3524811799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa624101a60 0x7fa624197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:49.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.438+0000 7fa62259c640 1 -- 172.21.15.17:0/3524811799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa624101a60 msgr2=0x7fa624197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:49.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.438+0000 7fa62259c640 1 --2- 172.21.15.17:0/3524811799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa624101a60 0x7fa624197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.438+0000 7fa62259c640 1 -- 172.21.15.17:0/3524811799 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6241980d0 con 0x7fa624100860 2024-09-20T18:37:49.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.438+0000 7fa62259c640 1 --2- 172.21.15.17:0/3524811799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624100860 0x7fa624197510 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa61400d8d0 tx=0x7fa61400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:49.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.438+0000 7fa61b7fe640 1 -- 172.21.15.17:0/3524811799 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa614017070 con 0x7fa624100860 2024-09-20T18:37:49.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.438+0000 7fa61b7fe640 1 -- 172.21.15.17:0/3524811799 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa61400be10 con 0x7fa624100860 2024-09-20T18:37:49.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.438+0000 7fa628abe640 1 -- 172.21.15.17:0/3524811799 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa62419cb10 con 0x7fa624100860 2024-09-20T18:37:49.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.438+0000 7fa61b7fe640 1 -- 172.21.15.17:0/3524811799 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa61400f3c0 con 0x7fa624100860 2024-09-20T18:37:49.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.439+0000 7fa628abe640 1 -- 172.21.15.17:0/3524811799 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa62419d0a0 con 0x7fa624100860 2024-09-20T18:37:49.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.440+0000 7fa628abe640 1 -- 172.21.15.17:0/3524811799 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa624100c60 con 0x7fa624100860 2024-09-20T18:37:49.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.441+0000 7fa61b7fe640 1 -- 172.21.15.17:0/3524811799 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7fa61401a070 con 0x7fa624100860 2024-09-20T18:37:49.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.441+0000 7fa61b7fe640 1 --2- 172.21.15.17:0/3524811799 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa61007b0b0 0x7fa61007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:49.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.441+0000 7fa61b7fe640 1 -- 172.21.15.17:0/3524811799 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7fa61409dd20 con 0x7fa624100860 2024-09-20T18:37:49.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.441+0000 7fa61bfff640 1 --2- 172.21.15.17:0/3524811799 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa61007b0b0 0x7fa61007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:49.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.442+0000 7fa61bfff640 1 --2- 172.21.15.17:0/3524811799 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa61007b0b0 0x7fa61007d570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa6241989c0 tx=0x7fa60c005a20 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:49.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.446+0000 7fa61b7fe640 1 -- 172.21.15.17:0/3524811799 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fa614069230 con 0x7fa624100860 2024-09-20T18:37:49.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.650+0000 7fa628abe640 1 -- 172.21.15.17:0/3524811799 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa62406a3e0 con 0x7fa61007b0b0 2024-09-20T18:37:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.652+0000 7fa61b7fe640 1 -- 172.21.15.17:0/3524811799 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7fa62406a3e0 con 0x7fa61007b0b0 2024-09-20T18:37:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.654+0000 7fa628abe640 1 -- 172.21.15.17:0/3524811799 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa61007b0b0 msgr2=0x7fa61007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.654+0000 7fa628abe640 1 --2- 172.21.15.17:0/3524811799 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa61007b0b0 0x7fa61007d570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa6241989c0 tx=0x7fa60c005a20 comp rx=0 tx=0).stop 2024-09-20T18:37:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.654+0000 7fa628abe640 1 -- 172.21.15.17:0/3524811799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624100860 msgr2=0x7fa624197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.654+0000 7fa628abe640 1 --2- 172.21.15.17:0/3524811799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624100860 0x7fa624197510 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa61400d8d0 tx=0x7fa61400dd90 comp rx=0 tx=0).stop 2024-09-20T18:37:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.654+0000 7fa628abe640 1 -- 172.21.15.17:0/3524811799 shutdown_connections 2024-09-20T18:37:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.654+0000 7fa628abe640 1 --2- 172.21.15.17:0/3524811799 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa61007b0b0 0x7fa61007d570 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.654+0000 7fa628abe640 1 --2- 172.21.15.17:0/3524811799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa624101a60 0x7fa624197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.654+0000 7fa628abe640 1 --2- 172.21.15.17:0/3524811799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa624100860 0x7fa624197510 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.654+0000 7fa628abe640 1 -- 172.21.15.17:0/3524811799 >> 172.21.15.17:0/3524811799 conn(0x7fa6240fc010 msgr2=0x7fa624069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.654+0000 7fa628abe640 1 -- 172.21.15.17:0/3524811799 shutdown_connections 2024-09-20T18:37:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.654+0000 7fa628abe640 1 -- 172.21.15.17:0/3524811799 wait complete. 2024-09-20T18:37:49.679 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:49 smithi172 ceph-mon[35456]: pgmap v39: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 201 op/s 2024-09-20T18:37:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.741+0000 7ff73019a640 1 -- 172.21.15.17:0/3834597778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff728100860 msgr2=0x7ff728100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.741+0000 7ff73019a640 1 --2- 172.21.15.17:0/3834597778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff728100860 0x7ff728100c60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff724009880 tx=0x7ff72402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.741+0000 7ff73019a640 1 -- 172.21.15.17:0/3834597778 shutdown_connections 2024-09-20T18:37:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.741+0000 7ff73019a640 1 --2- 172.21.15.17:0/3834597778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff728101a60 0x7ff728101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.741+0000 7ff73019a640 1 --2- 172.21.15.17:0/3834597778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff728100860 0x7ff728100c60 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.741+0000 7ff73019a640 1 -- 172.21.15.17:0/3834597778 >> 172.21.15.17:0/3834597778 conn(0x7ff7280fc010 msgr2=0x7ff7280fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.741+0000 7ff73019a640 1 -- 172.21.15.17:0/3834597778 shutdown_connections 2024-09-20T18:37:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.741+0000 7ff73019a640 1 -- 172.21.15.17:0/3834597778 wait complete. 2024-09-20T18:37:49.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.741+0000 7ff73019a640 1 Processor -- start 2024-09-20T18:37:49.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.741+0000 7ff73019a640 1 -- start start 2024-09-20T18:37:49.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.742+0000 7ff73019a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff728100860 0x7ff728104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:49.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.742+0000 7ff73019a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff728101a60 0x7ff728102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:49.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.742+0000 7ff73019a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff728109680 con 0x7ff728100860 2024-09-20T18:37:49.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.742+0000 7ff73019a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff728109500 con 0x7ff728101a60 2024-09-20T18:37:49.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.742+0000 7ff72df36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff728100860 0x7ff728104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:49.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.742+0000 7ff72df36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff728100860 0x7ff728104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45830/0 (socket says 172.21.15.17:45830) 2024-09-20T18:37:49.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.742+0000 7ff72df36640 1 -- 172.21.15.17:0/2673211790 learned_addr learned my addr 172.21.15.17:0/2673211790 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:37:49.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.742+0000 7ff72d735640 1 --2- 172.21.15.17:0/2673211790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff728101a60 0x7ff728102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:49.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.742+0000 7ff72df36640 1 -- 172.21.15.17:0/2673211790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff728101a60 msgr2=0x7ff728102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:49.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.742+0000 7ff72df36640 1 --2- 172.21.15.17:0/2673211790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff728101a60 0x7ff728102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.742+0000 7ff72df36640 1 -- 172.21.15.17:0/2673211790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff728103380 con 0x7ff728100860 2024-09-20T18:37:49.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.742+0000 7ff72df36640 1 --2- 172.21.15.17:0/2673211790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff728100860 0x7ff728104780 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff724006010 tx=0x7ff7240045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:49.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.742+0000 7ff71effd640 1 -- 172.21.15.17:0/2673211790 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff72403f070 con 0x7ff728100860 2024-09-20T18:37:49.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.742+0000 7ff71effd640 1 -- 172.21.15.17:0/2673211790 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff724004a50 con 0x7ff728100860 2024-09-20T18:37:49.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.742+0000 7ff73019a640 1 -- 172.21.15.17:0/2673211790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff728103610 con 0x7ff728100860 2024-09-20T18:37:49.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.742+0000 7ff71effd640 1 -- 172.21.15.17:0/2673211790 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff724035030 con 0x7ff728100860 2024-09-20T18:37:49.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.743+0000 7ff73019a640 1 -- 172.21.15.17:0/2673211790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff728103b40 con 0x7ff728100860 2024-09-20T18:37:49.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.744+0000 7ff73019a640 1 -- 172.21.15.17:0/2673211790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff728100c60 con 0x7ff728100860 2024-09-20T18:37:49.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.744+0000 7ff71effd640 1 -- 172.21.15.17:0/2673211790 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7ff724042070 con 0x7ff728100860 2024-09-20T18:37:49.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.745+0000 7ff71effd640 1 --2- 172.21.15.17:0/2673211790 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff71407b050 0x7ff71407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:49.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.745+0000 7ff71effd640 1 -- 172.21.15.17:0/2673211790 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7ff7240becc0 con 0x7ff728100860 2024-09-20T18:37:49.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.745+0000 7ff72d735640 1 --2- 172.21.15.17:0/2673211790 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff71407b050 0x7ff71407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:49.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.746+0000 7ff72d735640 1 --2- 172.21.15.17:0/2673211790 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff71407b050 0x7ff71407d510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff728104500 tx=0x7ff71800b410 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:49.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.750+0000 7ff71effd640 1 -- 172.21.15.17:0/2673211790 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ff724004c00 con 0x7ff728100860 2024-09-20T18:37:49.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.952+0000 7ff73019a640 1 -- 172.21.15.17:0/2673211790 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff72819f550 con 0x7ff71407b050 2024-09-20T18:37:49.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.962+0000 7ff71effd640 1 -- 172.21.15.17:0/2673211790 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7ff72819f550 con 0x7ff71407b050 2024-09-20T18:37:49.978 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:37:49.978 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (8m) 9s ago 10m 24.9M - 0.25.0 c8568f914cd2 8954ab699be3 2024-09-20T18:37:49.978 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (2m) 9s ago 10m 8690k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:37:49.978 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (107s) 19s ago 9m 8409k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:37:49.978 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (10m) 9s ago 10m 6895k - 19.1.1-369-ged8ee0f2 6acb0a031eab 725c8bcc6ec8 2024-09-20T18:37:49.978 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (9m) 19s ago 9m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab e10dd613dbe2 2024-09-20T18:37:49.978 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (8m) 9s ago 9m 81.4M - 9.4.12 2bacad6d85d8 d8c886b98eae 2024-09-20T18:37:49.978 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (4m) 9s ago 4m 194M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:37:49.978 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (4m) 9s ago 4m 211M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:37:49.978 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (4m) 19s ago 4m 26.6M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:37:49.978 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (4m) 19s ago 4m 26.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:37:49.978 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (84s) 9s ago 11m 508M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:37:49.978 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (22s) 19s ago 9m 67.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:37:49.978 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (11m) 9s ago 11m 56.8M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab ab1f988c4cb2 2024-09-20T18:37:49.979 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (9m) 19s ago 9m 47.5M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 9eea40352787 2024-09-20T18:37:49.979 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (10m) 9s ago 10m 14.4M - 1.5.0 0da6a335fe13 1584915999b1 2024-09-20T18:37:49.979 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (9m) 19s ago 9m 15.9M - 1.5.0 0da6a335fe13 880d938148e8 2024-09-20T18:37:49.979 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (8m) 9s ago 8m 201M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab c1207e514216 2024-09-20T18:37:49.979 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (7m) 9s ago 7m 216M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 73f2fd77590f 2024-09-20T18:37:49.979 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (7m) 9s ago 7m 199M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 6f0b9405dc18 2024-09-20T18:37:49.979 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (6m) 19s ago 6m 257M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:37:49.979 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (6m) 19s ago 6m 204M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:37:49.979 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (5m) 19s ago 5m 182M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:37:49.979 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (27s) 9s ago 9m 44.2M - 2.43.0 a07b618ecd1d 40fcb8bbcacf 2024-09-20T18:37:49.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.964+0000 7ff73019a640 1 -- 172.21.15.17:0/2673211790 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff71407b050 msgr2=0x7ff71407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:49.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.964+0000 7ff73019a640 1 --2- 172.21.15.17:0/2673211790 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff71407b050 0x7ff71407d510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff728104500 tx=0x7ff71800b410 comp rx=0 tx=0).stop 2024-09-20T18:37:49.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.964+0000 7ff73019a640 1 -- 172.21.15.17:0/2673211790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff728100860 msgr2=0x7ff728104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:49.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.964+0000 7ff73019a640 1 --2- 172.21.15.17:0/2673211790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff728100860 0x7ff728104780 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff724006010 tx=0x7ff7240045e0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.964+0000 7ff73019a640 1 -- 172.21.15.17:0/2673211790 shutdown_connections 2024-09-20T18:37:49.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.964+0000 7ff73019a640 1 --2- 172.21.15.17:0/2673211790 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff71407b050 0x7ff71407d510 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.964+0000 7ff73019a640 1 --2- 172.21.15.17:0/2673211790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff728101a60 0x7ff728102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.964+0000 7ff73019a640 1 --2- 172.21.15.17:0/2673211790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff728100860 0x7ff728104780 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:49.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.964+0000 7ff73019a640 1 -- 172.21.15.17:0/2673211790 >> 172.21.15.17:0/2673211790 conn(0x7ff7280fc010 msgr2=0x7ff72806a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:49.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.964+0000 7ff73019a640 1 -- 172.21.15.17:0/2673211790 shutdown_connections 2024-09-20T18:37:49.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:49.964+0000 7ff73019a640 1 -- 172.21.15.17:0/2673211790 wait complete. 2024-09-20T18:37:50.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.052+0000 7fb30040b640 1 -- 172.21.15.17:0/554886600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2f8100b80 msgr2=0x7fb2f8100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:50.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.052+0000 7fb30040b640 1 --2- 172.21.15.17:0/554886600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2f8100b80 0x7fb2f8100fe0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009880 tx=0x7fb2ec02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:37:50.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.052+0000 7fb30040b640 1 -- 172.21.15.17:0/554886600 shutdown_connections 2024-09-20T18:37:50.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.052+0000 7fb30040b640 1 --2- 172.21.15.17:0/554886600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2f8100b80 0x7fb2f8100fe0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:50.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.052+0000 7fb30040b640 1 --2- 172.21.15.17:0/554886600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2f8100240 0x7fb2f8100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:50.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.052+0000 7fb30040b640 1 -- 172.21.15.17:0/554886600 >> 172.21.15.17:0/554886600 conn(0x7fb2f80fc010 msgr2=0x7fb2f80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:50.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.053+0000 7fb30040b640 1 -- 172.21.15.17:0/554886600 shutdown_connections 2024-09-20T18:37:50.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.053+0000 7fb30040b640 1 -- 172.21.15.17:0/554886600 wait complete. 2024-09-20T18:37:50.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.053+0000 7fb30040b640 1 Processor -- start 2024-09-20T18:37:50.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.053+0000 7fb30040b640 1 -- start start 2024-09-20T18:37:50.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.054+0000 7fb30040b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2f8100240 0x7fb2f8199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:50.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.054+0000 7fb30040b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2f8100b80 0x7fb2f8199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:50.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.054+0000 7fb30040b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f810c990 con 0x7fb2f8100240 2024-09-20T18:37:50.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.054+0000 7fb30040b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f810c810 con 0x7fb2f8100b80 2024-09-20T18:37:50.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.054+0000 7fb2fe1a7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2f8100240 0x7fb2f8199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:50.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.054+0000 7fb2fe1a7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2f8100240 0x7fb2f8199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45850/0 (socket says 172.21.15.17:45850) 2024-09-20T18:37:50.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.054+0000 7fb2fd9a6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2f8100b80 0x7fb2f8199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:50.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.054+0000 7fb2fe1a7640 1 -- 172.21.15.17:0/1355833148 learned_addr learned my addr 172.21.15.17:0/1355833148 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:37:50.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.054+0000 7fb2fe1a7640 1 -- 172.21.15.17:0/1355833148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2f8100b80 msgr2=0x7fb2f8199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:50.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.054+0000 7fb2fe1a7640 1 --2- 172.21.15.17:0/1355833148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2f8100b80 0x7fb2f8199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:50.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.054+0000 7fb2fe1a7640 1 -- 172.21.15.17:0/1355833148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f819a250 con 0x7fb2f8100240 2024-09-20T18:37:50.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.055+0000 7fb2fe1a7640 1 --2- 172.21.15.17:0/1355833148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2f8100240 0x7fb2f8199690 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800d6f0 tx=0x7fb2e800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:50.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.055+0000 7fb2f77fe640 1 -- 172.21.15.17:0/1355833148 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb2e8017070 con 0x7fb2f8100240 2024-09-20T18:37:50.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.055+0000 7fb30040b640 1 -- 172.21.15.17:0/1355833148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f819ec90 con 0x7fb2f8100240 2024-09-20T18:37:50.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.055+0000 7fb2f77fe640 1 -- 172.21.15.17:0/1355833148 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb2e800de00 con 0x7fb2f8100240 2024-09-20T18:37:50.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.055+0000 7fb2f77fe640 1 -- 172.21.15.17:0/1355833148 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb2e8004bb0 con 0x7fb2f8100240 2024-09-20T18:37:50.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.055+0000 7fb30040b640 1 -- 172.21.15.17:0/1355833148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f819f1a0 con 0x7fb2f8100240 2024-09-20T18:37:50.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.056+0000 7fb30040b640 1 -- 172.21.15.17:0/1355833148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f8100640 con 0x7fb2f8100240 2024-09-20T18:37:50.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.057+0000 7fb2f77fe640 1 -- 172.21.15.17:0/1355833148 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7fb2e8010460 con 0x7fb2f8100240 2024-09-20T18:37:50.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.057+0000 7fb2f77fe640 1 --2- 172.21.15.17:0/1355833148 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb2e007b0b0 0x7fb2e007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:50.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.057+0000 7fb2f77fe640 1 -- 172.21.15.17:0/1355833148 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7fb2e809dd00 con 0x7fb2f8100240 2024-09-20T18:37:50.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.058+0000 7fb2fd9a6640 1 --2- 172.21.15.17:0/1355833148 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb2e007b0b0 0x7fb2e007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:50.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.058+0000 7fb2fd9a6640 1 --2- 172.21.15.17:0/1355833148 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb2e007b0b0 0x7fb2e007d570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec000c00 tx=0x7fb2ec0058d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:50.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.062+0000 7fb2f77fe640 1 -- 172.21.15.17:0/1355833148 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fb2e8069210 con 0x7fb2f8100240 2024-09-20T18:37:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.326+0000 7fb30040b640 1 -- 172.21.15.17:0/1355833148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb2f8062df0 con 0x7fb2f8100240 2024-09-20T18:37:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.327+0000 7fb2f77fe640 1 -- 172.21.15.17:0/1355833148 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fb2e806e0c0 con 0x7fb2f8100240 2024-09-20T18:37:50.343 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:37:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:37:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T18:37:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:37:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:37:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:37:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:37:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:37:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T18:37:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:37:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:37:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:37:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:37:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:37:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 12, 2024-09-20T18:37:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:37:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:37:50.344 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:37:50.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.329+0000 7fb30040b640 1 -- 172.21.15.17:0/1355833148 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb2e007b0b0 msgr2=0x7fb2e007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:50.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.329+0000 7fb30040b640 1 --2- 172.21.15.17:0/1355833148 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb2e007b0b0 0x7fb2e007d570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec000c00 tx=0x7fb2ec0058d0 comp rx=0 tx=0).stop 2024-09-20T18:37:50.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.329+0000 7fb30040b640 1 -- 172.21.15.17:0/1355833148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2f8100240 msgr2=0x7fb2f8199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:50.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.329+0000 7fb30040b640 1 --2- 172.21.15.17:0/1355833148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2f8100240 0x7fb2f8199690 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800d6f0 tx=0x7fb2e800dbb0 comp rx=0 tx=0).stop 2024-09-20T18:37:50.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.329+0000 7fb30040b640 1 -- 172.21.15.17:0/1355833148 shutdown_connections 2024-09-20T18:37:50.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.329+0000 7fb30040b640 1 --2- 172.21.15.17:0/1355833148 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb2e007b0b0 0x7fb2e007d570 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.329+0000 7fb30040b640 1 --2- 172.21.15.17:0/1355833148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2f8100b80 0x7fb2f8199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.329+0000 7fb30040b640 1 --2- 172.21.15.17:0/1355833148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2f8100240 0x7fb2f8199690 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.329+0000 7fb30040b640 1 -- 172.21.15.17:0/1355833148 >> 172.21.15.17:0/1355833148 conn(0x7fb2f80fc010 msgr2=0x7fb2f8108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.329+0000 7fb30040b640 1 -- 172.21.15.17:0/1355833148 shutdown_connections 2024-09-20T18:37:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.329+0000 7fb30040b640 1 -- 172.21.15.17:0/1355833148 wait complete. 2024-09-20T18:37:50.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.415+0000 7fcc3ffd6640 1 -- 172.21.15.17:0/4062113012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc38101a60 msgr2=0x7fcc38101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:50.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.415+0000 7fcc3ffd6640 1 --2- 172.21.15.17:0/4062113012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc38101a60 0x7fcc38101ee0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009880 tx=0x7fcc2802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:37:50.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.415+0000 7fcc3ffd6640 1 -- 172.21.15.17:0/4062113012 shutdown_connections 2024-09-20T18:37:50.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.415+0000 7fcc3ffd6640 1 --2- 172.21.15.17:0/4062113012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc38101a60 0x7fcc38101ee0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:50.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.415+0000 7fcc3ffd6640 1 --2- 172.21.15.17:0/4062113012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc38100860 0x7fcc38100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:50.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.415+0000 7fcc3ffd6640 1 -- 172.21.15.17:0/4062113012 >> 172.21.15.17:0/4062113012 conn(0x7fcc380fbff0 msgr2=0x7fcc380fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:50.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.415+0000 7fcc3ffd6640 1 -- 172.21.15.17:0/4062113012 shutdown_connections 2024-09-20T18:37:50.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.415+0000 7fcc3ffd6640 1 -- 172.21.15.17:0/4062113012 wait complete. 2024-09-20T18:37:50.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.416+0000 7fcc3ffd6640 1 Processor -- start 2024-09-20T18:37:50.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.416+0000 7fcc3ffd6640 1 -- start start 2024-09-20T18:37:50.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.416+0000 7fcc3ffd6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc38100860 0x7fcc38197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:50.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.416+0000 7fcc3ffd6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc38101a60 0x7fcc38197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:50.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.416+0000 7fcc3ffd6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcc381096a0 con 0x7fcc38101a60 2024-09-20T18:37:50.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.416+0000 7fcc3ffd6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcc38109520 con 0x7fcc38100860 2024-09-20T18:37:50.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.416+0000 7fcc3d571640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc38101a60 0x7fcc38197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:50.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.417+0000 7fcc3d571640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc38101a60 0x7fcc38197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45854/0 (socket says 172.21.15.17:45854) 2024-09-20T18:37:50.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.417+0000 7fcc3d571640 1 -- 172.21.15.17:0/3996389958 learned_addr learned my addr 172.21.15.17:0/3996389958 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:37:50.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.417+0000 7fcc3dd72640 1 --2- 172.21.15.17:0/3996389958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc38100860 0x7fcc38197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:50.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.417+0000 7fcc3d571640 1 -- 172.21.15.17:0/3996389958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc38100860 msgr2=0x7fcc38197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:50.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.417+0000 7fcc3d571640 1 --2- 172.21.15.17:0/3996389958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc38100860 0x7fcc38197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:50.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.417+0000 7fcc3d571640 1 -- 172.21.15.17:0/3996389958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc38198100 con 0x7fcc38101a60 2024-09-20T18:37:50.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.417+0000 7fcc3dd72640 1 --2- 172.21.15.17:0/3996389958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc38100860 0x7fcc38197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T18:37:50.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.417+0000 7fcc3d571640 1 --2- 172.21.15.17:0/3996389958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc38101a60 0x7fcc38197a80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009230 tx=0x7fcc280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:50.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.417+0000 7fcc2effd640 1 -- 172.21.15.17:0/3996389958 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc2803f070 con 0x7fcc38101a60 2024-09-20T18:37:50.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.417+0000 7fcc3ffd6640 1 -- 172.21.15.17:0/3996389958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3819cae0 con 0x7fcc38101a60 2024-09-20T18:37:50.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.417+0000 7fcc2effd640 1 -- 172.21.15.17:0/3996389958 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc28004b80 con 0x7fcc38101a60 2024-09-20T18:37:50.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.417+0000 7fcc3ffd6640 1 -- 172.21.15.17:0/3996389958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc3819d070 con 0x7fcc38101a60 2024-09-20T18:37:50.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.418+0000 7fcc2effd640 1 -- 172.21.15.17:0/3996389958 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc28049060 con 0x7fcc38101a60 2024-09-20T18:37:50.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.419+0000 7fcc3ffd6640 1 -- 172.21.15.17:0/3996389958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc38100c60 con 0x7fcc38101a60 2024-09-20T18:37:50.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.419+0000 7fcc2effd640 1 -- 172.21.15.17:0/3996389958 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7fcc28042070 con 0x7fcc38101a60 2024-09-20T18:37:50.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.420+0000 7fcc2effd640 1 --2- 172.21.15.17:0/3996389958 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcc2407b050 0x7fcc2407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:37:50.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.420+0000 7fcc2effd640 1 -- 172.21.15.17:0/3996389958 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7fcc280bec20 con 0x7fcc38101a60 2024-09-20T18:37:50.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.420+0000 7fcc3dd72640 1 --2- 172.21.15.17:0/3996389958 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcc2407b050 0x7fcc2407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:37:50.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.421+0000 7fcc3dd72640 1 --2- 172.21.15.17:0/3996389958 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcc2407b050 0x7fcc2407d510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcc34005fd0 tx=0x7fcc3400b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:37:50.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.425+0000 7fcc2effd640 1 -- 172.21.15.17:0/3996389958 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fcc2808a0b0 con 0x7fcc38101a60 2024-09-20T18:37:50.600 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:50 smithi172 ceph-mon[35456]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:37:50.600 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:50 smithi172 ceph-mon[35456]: from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:37:50.600 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:50 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:50.600 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:50 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:50.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:50 smithi017 ceph-mon[28058]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:37:50.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:50 smithi017 ceph-mon[28058]: from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:37:50.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:50 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:50.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:50 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.644+0000 7fcc3ffd6640 1 -- 172.21.15.17:0/3996389958 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcc3806ac20 con 0x7fcc2407b050 2024-09-20T18:37:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.646+0000 7fcc2effd640 1 -- 172.21.15.17:0/3996389958 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7fcc3806ac20 con 0x7fcc2407b050 2024-09-20T18:37:50.662 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:37:50.662 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:37:50.662 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:37:50.662 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T18:37:50.662 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:37:50.662 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-09-20T18:37:50.662 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:37:50.662 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "2/2 daemons upgraded", 2024-09-20T18:37:50.662 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-20T18:37:50.662 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:37:50.662 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:37:50.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.649+0000 7fcc3ffd6640 1 -- 172.21.15.17:0/3996389958 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcc2407b050 msgr2=0x7fcc2407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:50.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.649+0000 7fcc3ffd6640 1 --2- 172.21.15.17:0/3996389958 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcc2407b050 0x7fcc2407d510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcc34005fd0 tx=0x7fcc3400b390 comp rx=0 tx=0).stop 2024-09-20T18:37:50.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.650+0000 7fcc3ffd6640 1 -- 172.21.15.17:0/3996389958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc38101a60 msgr2=0x7fcc38197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:37:50.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.650+0000 7fcc3ffd6640 1 --2- 172.21.15.17:0/3996389958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc38101a60 0x7fcc38197a80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009230 tx=0x7fcc280046c0 comp rx=0 tx=0).stop 2024-09-20T18:37:50.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.650+0000 7fcc3ffd6640 1 -- 172.21.15.17:0/3996389958 shutdown_connections 2024-09-20T18:37:50.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.650+0000 7fcc3ffd6640 1 --2- 172.21.15.17:0/3996389958 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcc2407b050 0x7fcc2407d510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:50.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.650+0000 7fcc3ffd6640 1 --2- 172.21.15.17:0/3996389958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc38101a60 0x7fcc38197a80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:50.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.650+0000 7fcc3ffd6640 1 --2- 172.21.15.17:0/3996389958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc38100860 0x7fcc38197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:37:50.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.650+0000 7fcc3ffd6640 1 -- 172.21.15.17:0/3996389958 >> 172.21.15.17:0/3996389958 conn(0x7fcc380fbff0 msgr2=0x7fcc3806a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:37:50.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.650+0000 7fcc3ffd6640 1 -- 172.21.15.17:0/3996389958 shutdown_connections 2024-09-20T18:37:50.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:37:50.650+0000 7fcc3ffd6640 1 -- 172.21.15.17:0/3996389958 wait complete. 2024-09-20T18:37:51.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:51 smithi017 ceph-mon[28058]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:37:51.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:51 smithi017 ceph-mon[28058]: pgmap v40: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 958 KiB/s rd, 879 KiB/s wr, 135 op/s 2024-09-20T18:37:51.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:51 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1355833148' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:51.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:51 smithi017 ceph-mon[28058]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:37:51.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:51 smithi172 ceph-mon[35456]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:37:51.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:51 smithi172 ceph-mon[35456]: pgmap v40: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 958 KiB/s rd, 879 KiB/s wr, 135 op/s 2024-09-20T18:37:51.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:51 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/1355833148' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:37:51.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:51 smithi172 ceph-mon[35456]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:37:52.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:52 smithi172 ceph-mon[35456]: Upgrade: Updating node-exporter.smithi172 (2/2) 2024-09-20T18:37:52.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:52 smithi172 ceph-mon[35456]: Deploying daemon node-exporter.smithi172 on smithi172 2024-09-20T18:37:52.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:52 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:37:52.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:52 smithi017 ceph-mon[28058]: Upgrade: Updating node-exporter.smithi172 (2/2) 2024-09-20T18:37:52.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:52 smithi017 ceph-mon[28058]: Deploying daemon node-exporter.smithi172 on smithi172 2024-09-20T18:37:52.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:52 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:37:53.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:53 smithi017 ceph-mon[28058]: pgmap v41: 65 pgs: 65 active+clean; 263 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 958 KiB/s rd, 879 KiB/s wr, 144 op/s 2024-09-20T18:37:53.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:53 smithi172 ceph-mon[35456]: pgmap v41: 65 pgs: 65 active+clean; 263 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 958 KiB/s rd, 879 KiB/s wr, 144 op/s 2024-09-20T18:37:55.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:55 smithi017 ceph-mon[28058]: pgmap v42: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 847 KiB/s rd, 865 KiB/s wr, 134 op/s 2024-09-20T18:37:55.672 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:55 smithi172 ceph-mon[35456]: pgmap v42: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 847 KiB/s rd, 865 KiB/s wr, 134 op/s 2024-09-20T18:37:57.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:57 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:57.459 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:57 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:57.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:57 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:37:57.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:57 smithi172 ceph-mon[35456]: pgmap v43: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 505 KiB/s rd, 481 KiB/s wr, 92 op/s 2024-09-20T18:37:57.481 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:57 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:57.482 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:57 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:57.482 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:57 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:37:57.482 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:57 smithi017 ceph-mon[28058]: pgmap v43: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 505 KiB/s rd, 481 KiB/s wr, 92 op/s 2024-09-20T18:37:59.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:59 smithi017 ceph-mon[28058]: pgmap v44: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 506 KiB/s rd, 481 KiB/s wr, 94 op/s 2024-09-20T18:37:59.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:59 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:59.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:37:59 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:59.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:59 smithi172 ceph-mon[35456]: pgmap v44: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 506 KiB/s rd, 481 KiB/s wr, 94 op/s 2024-09-20T18:37:59.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:59 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:37:59.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:37:59 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:00.588 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:00 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:00.588 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:00 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:00.748 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:00 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:00.748 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:00 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:01.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:01 smithi172 ceph-mon[35456]: pgmap v45: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 30 KiB/s wr, 23 op/s 2024-09-20T18:38:01.740 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:01 smithi017 ceph-mon[28058]: pgmap v45: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 30 KiB/s wr, 23 op/s 2024-09-20T18:38:02.811 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:02 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:02.811 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:02 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:02.811 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:02 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:02.811 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:02 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:02.922 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:02 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:02.922 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:02 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:02.922 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:02 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:02.922 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:02 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:03.806 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:03 smithi017 ceph-mon[28058]: pgmap v46: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 30 KiB/s wr, 23 op/s 2024-09-20T18:38:03.806 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:03 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:03.807 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:03 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:03 smithi172 ceph-mon[35456]: pgmap v46: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 30 KiB/s wr, 23 op/s 2024-09-20T18:38:03.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:03 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:03.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:03 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:05.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:05 smithi017 ceph-mon[28058]: pgmap v47: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-20T18:38:05.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:05 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:05.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:05 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:05.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:05 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:38:05.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:05 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:38:05.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:05 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:05.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:05 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:38:05.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:05 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:05.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:05 smithi172 ceph-mon[35456]: pgmap v47: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 30 KiB/s wr, 16 op/s 2024-09-20T18:38:05.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:05 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:05.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:05 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:05.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:05 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:38:05.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:05 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:38:05.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:05 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:05.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:05 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:38:05.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:05 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:06.832 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:06 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:06.832 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:06 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:06.832 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:06 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:06.832 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:06 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:06.832 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:06 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:06.832 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:06 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:06.832 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:06 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:06.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:06 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:06.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:06 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:06.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:06 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:06.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:06 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:06.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:06 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:06.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:06 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:06.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:06 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:07.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:07 smithi017 ceph-mon[28058]: pgmap v48: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 341 B/s wr, 3 op/s 2024-09-20T18:38:07.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:07 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:38:07.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:07 smithi172 ceph-mon[35456]: pgmap v48: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 341 B/s wr, 3 op/s 2024-09-20T18:38:07.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:07 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:38:08.773 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:08 smithi017 ceph-mon[28058]: Upgrade: Updating prometheus.smithi017 2024-09-20T18:38:08.773 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:08 smithi017 ceph-mon[28058]: Deploying daemon prometheus.smithi017 on smithi017 2024-09-20T18:38:08.773 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:08 smithi017 ceph-mon[28058]: mgrmap e33: smithi017.xusjwd(active, since 91s), standbys: smithi172.jczphg 2024-09-20T18:38:08.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:08 smithi172 ceph-mon[35456]: Upgrade: Updating prometheus.smithi017 2024-09-20T18:38:08.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:08 smithi172 ceph-mon[35456]: Deploying daemon prometheus.smithi017 on smithi017 2024-09-20T18:38:08.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:08 smithi172 ceph-mon[35456]: mgrmap e33: smithi017.xusjwd(active, since 91s), standbys: smithi172.jczphg 2024-09-20T18:38:09.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:09 smithi017 ceph-mon[28058]: pgmap v49: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-20T18:38:09.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:09 smithi172 ceph-mon[35456]: pgmap v49: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-20T18:38:11.771 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:11 smithi017 ceph-mon[28058]: pgmap v50: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-20T18:38:11.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:11 smithi172 ceph-mon[35456]: pgmap v50: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-20T18:38:13.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:13 smithi017 ceph-mon[28058]: pgmap v51: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-20T18:38:13.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:13 smithi172 ceph-mon[35456]: pgmap v51: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-20T18:38:15.770 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:15 smithi017 ceph-mon[28058]: pgmap v52: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-20T18:38:15.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:15 smithi172 ceph-mon[35456]: pgmap v52: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-20T18:38:17.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:17 smithi017 ceph-mon[28058]: pgmap v53: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-20T18:38:18.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:17 smithi172 ceph-mon[35456]: pgmap v53: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-20T18:38:20.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:19 smithi017 ceph-mon[28058]: pgmap v54: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-20T18:38:20.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:19 smithi172 ceph-mon[35456]: pgmap v54: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-20T18:38:20.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.749+0000 7f9417266640 1 -- 172.21.15.17:0/2870630178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9410101960 msgr2=0x7f9410101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:20.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.749+0000 7f9417266640 1 --2- 172.21.15.17:0/2870630178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9410101960 0x7f9410101d60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f940c009880 tx=0x7f940c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:38:20.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.749+0000 7f9417266640 1 -- 172.21.15.17:0/2870630178 shutdown_connections 2024-09-20T18:38:20.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.749+0000 7f9417266640 1 --2- 172.21.15.17:0/2870630178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9410102b60 0x7f9410102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:20.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.749+0000 7f9417266640 1 --2- 172.21.15.17:0/2870630178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9410101960 0x7f9410101d60 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:20.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.749+0000 7f9417266640 1 -- 172.21.15.17:0/2870630178 >> 172.21.15.17:0/2870630178 conn(0x7f94100fd0f0 msgr2=0x7f94100ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:20.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.749+0000 7f9417266640 1 -- 172.21.15.17:0/2870630178 shutdown_connections 2024-09-20T18:38:20.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.749+0000 7f9417266640 1 -- 172.21.15.17:0/2870630178 wait complete. 2024-09-20T18:38:20.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.750+0000 7f9417266640 1 Processor -- start 2024-09-20T18:38:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.750+0000 7f9417266640 1 -- start start 2024-09-20T18:38:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.750+0000 7f9417266640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9410101960 0x7f9410197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.750+0000 7f9417266640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9410102b60 0x7f94101979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.750+0000 7f9417266640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f941010a780 con 0x7f9410101960 2024-09-20T18:38:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.750+0000 7f9417266640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f941010a600 con 0x7f9410102b60 2024-09-20T18:38:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.751+0000 7f9415002640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9410101960 0x7f9410197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.751+0000 7f9415002640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9410101960 0x7f9410197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60644/0 (socket says 172.21.15.17:60644) 2024-09-20T18:38:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.751+0000 7f9415002640 1 -- 172.21.15.17:0/2708488696 learned_addr learned my addr 172.21.15.17:0/2708488696 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:38:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.751+0000 7f9414801640 1 --2- 172.21.15.17:0/2708488696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9410102b60 0x7f94101979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.751+0000 7f9415002640 1 -- 172.21.15.17:0/2708488696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9410102b60 msgr2=0x7f94101979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.751+0000 7f9415002640 1 --2- 172.21.15.17:0/2708488696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9410102b60 0x7f94101979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.751+0000 7f9415002640 1 -- 172.21.15.17:0/2708488696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9410197fc0 con 0x7f9410101960 2024-09-20T18:38:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.751+0000 7f9414801640 1 --2- 172.21.15.17:0/2708488696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9410102b60 0x7f94101979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:38:20.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.751+0000 7f9415002640 1 --2- 172.21.15.17:0/2708488696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9410101960 0x7f9410197490 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f940c006010 tx=0x7f940c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:20.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.751+0000 7f94067fc640 1 -- 172.21.15.17:0/2708488696 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f940c03f070 con 0x7f9410101960 2024-09-20T18:38:20.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.751+0000 7f9417266640 1 -- 172.21.15.17:0/2708488696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f941019c9d0 con 0x7f9410101960 2024-09-20T18:38:20.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.751+0000 7f94067fc640 1 -- 172.21.15.17:0/2708488696 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f940c0044d0 con 0x7f9410101960 2024-09-20T18:38:20.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.752+0000 7f94067fc640 1 -- 172.21.15.17:0/2708488696 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f940c035030 con 0x7f9410101960 2024-09-20T18:38:20.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.752+0000 7f9417266640 1 -- 172.21.15.17:0/2708488696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f941019ced0 con 0x7f9410101960 2024-09-20T18:38:20.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.753+0000 7f9417266640 1 -- 172.21.15.17:0/2708488696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9410101d60 con 0x7f9410101960 2024-09-20T18:38:20.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.753+0000 7f94067fc640 1 -- 172.21.15.17:0/2708488696 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f940c042070 con 0x7f9410101960 2024-09-20T18:38:20.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.754+0000 7f94067fc640 1 --2- 172.21.15.17:0/2708488696 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93fc07af30 0x7f93fc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:20.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.754+0000 7f94067fc640 1 -- 172.21.15.17:0/2708488696 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f940c0bec30 con 0x7f9410101960 2024-09-20T18:38:20.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.754+0000 7f9414801640 1 --2- 172.21.15.17:0/2708488696 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93fc07af30 0x7f93fc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:20.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.756+0000 7f9414801640 1 --2- 172.21.15.17:0/2708488696 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93fc07af30 0x7f93fc07d3f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9410198940 tx=0x7f940000a5c0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:20.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.759+0000 7f94067fc640 1 -- 172.21.15.17:0/2708488696 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f940c08a2e0 con 0x7f9410101960 2024-09-20T18:38:20.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.968+0000 7f9417266640 1 -- 172.21.15.17:0/2708488696 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f941002c640 con 0x7f93fc07af30 2024-09-20T18:38:20.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.969+0000 7f94067fc640 1 -- 172.21.15.17:0/2708488696 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+367 (secure 0 0 0) 0x7f941002c640 con 0x7f93fc07af30 2024-09-20T18:38:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.972+0000 7f9417266640 1 -- 172.21.15.17:0/2708488696 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93fc07af30 msgr2=0x7f93fc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.972+0000 7f9417266640 1 --2- 172.21.15.17:0/2708488696 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93fc07af30 0x7f93fc07d3f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9410198940 tx=0x7f940000a5c0 comp rx=0 tx=0).stop 2024-09-20T18:38:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.972+0000 7f9417266640 1 -- 172.21.15.17:0/2708488696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9410101960 msgr2=0x7f9410197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.972+0000 7f9417266640 1 --2- 172.21.15.17:0/2708488696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9410101960 0x7f9410197490 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f940c006010 tx=0x7f940c0048f0 comp rx=0 tx=0).stop 2024-09-20T18:38:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.972+0000 7f9417266640 1 -- 172.21.15.17:0/2708488696 shutdown_connections 2024-09-20T18:38:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.972+0000 7f9417266640 1 --2- 172.21.15.17:0/2708488696 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93fc07af30 0x7f93fc07d3f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.972+0000 7f9417266640 1 --2- 172.21.15.17:0/2708488696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9410102b60 0x7f94101979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.972+0000 7f9417266640 1 --2- 172.21.15.17:0/2708488696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9410101960 0x7f9410197490 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.972+0000 7f9417266640 1 -- 172.21.15.17:0/2708488696 >> 172.21.15.17:0/2708488696 conn(0x7f94100fd0f0 msgr2=0x7f9410105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.972+0000 7f9417266640 1 -- 172.21.15.17:0/2708488696 shutdown_connections 2024-09-20T18:38:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:20.972+0000 7f9417266640 1 -- 172.21.15.17:0/2708488696 wait complete. 2024-09-20T18:38:20.997 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:38:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.057+0000 7fad2f1c8640 1 -- 172.21.15.17:0/2101064760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad28102450 msgr2=0x7fad28104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.057+0000 7fad2f1c8640 1 --2- 172.21.15.17:0/2101064760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad28102450 0x7fad28104840 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009880 tx=0x7fad1c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.057+0000 7fad2f1c8640 1 -- 172.21.15.17:0/2101064760 shutdown_connections 2024-09-20T18:38:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.057+0000 7fad2f1c8640 1 --2- 172.21.15.17:0/2101064760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad28104d80 0x7fad28107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.057+0000 7fad2f1c8640 1 --2- 172.21.15.17:0/2101064760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad28102450 0x7fad28104840 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.057+0000 7fad2f1c8640 1 -- 172.21.15.17:0/2101064760 >> 172.21.15.17:0/2101064760 conn(0x7fad280fc010 msgr2=0x7fad280fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.057+0000 7fad2f1c8640 1 -- 172.21.15.17:0/2101064760 shutdown_connections 2024-09-20T18:38:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.057+0000 7fad2f1c8640 1 -- 172.21.15.17:0/2101064760 wait complete. 2024-09-20T18:38:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.058+0000 7fad2f1c8640 1 Processor -- start 2024-09-20T18:38:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.058+0000 7fad2f1c8640 1 -- start start 2024-09-20T18:38:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.058+0000 7fad2f1c8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad28102450 0x7fad281974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.058+0000 7fad2f1c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad28104d80 0x7fad281979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.058+0000 7fad2f1c8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fad2810a750 con 0x7fad28102450 2024-09-20T18:38:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.058+0000 7fad2f1c8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad2810a5d0 con 0x7fad28104d80 2024-09-20T18:38:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.058+0000 7fad2cf64640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad28102450 0x7fad281974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.058+0000 7fad2cf64640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad28102450 0x7fad281974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60664/0 (socket says 172.21.15.17:60664) 2024-09-20T18:38:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.058+0000 7fad2cf64640 1 -- 172.21.15.17:0/1429395600 learned_addr learned my addr 172.21.15.17:0/1429395600 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:38:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.058+0000 7fad27fff640 1 --2- 172.21.15.17:0/1429395600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad28104d80 0x7fad281979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.059+0000 7fad2cf64640 1 -- 172.21.15.17:0/1429395600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad28104d80 msgr2=0x7fad281979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.059+0000 7fad2cf64640 1 --2- 172.21.15.17:0/1429395600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad28104d80 0x7fad281979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.059+0000 7fad2cf64640 1 -- 172.21.15.17:0/1429395600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad28197fe0 con 0x7fad28102450 2024-09-20T18:38:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.059+0000 7fad2cf64640 1 --2- 172.21.15.17:0/1429395600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad28102450 0x7fad281974b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fad1c006010 tx=0x7fad1c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.059+0000 7fad25ffb640 1 -- 172.21.15.17:0/1429395600 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad1c03f070 con 0x7fad28102450 2024-09-20T18:38:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.059+0000 7fad25ffb640 1 -- 172.21.15.17:0/1429395600 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad1c0044d0 con 0x7fad28102450 2024-09-20T18:38:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.059+0000 7fad2f1c8640 1 -- 172.21.15.17:0/1429395600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad2819ca50 con 0x7fad28102450 2024-09-20T18:38:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.059+0000 7fad25ffb640 1 -- 172.21.15.17:0/1429395600 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad1c035030 con 0x7fad28102450 2024-09-20T18:38:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.059+0000 7fad2f1c8640 1 -- 172.21.15.17:0/1429395600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad2819cfb0 con 0x7fad28102450 2024-09-20T18:38:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.060+0000 7fad2f1c8640 1 -- 172.21.15.17:0/1429395600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad28102830 con 0x7fad28102450 2024-09-20T18:38:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.061+0000 7fad25ffb640 1 -- 172.21.15.17:0/1429395600 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fad1c042070 con 0x7fad28102450 2024-09-20T18:38:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.062+0000 7fad25ffb640 1 --2- 172.21.15.17:0/1429395600 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fad1807af30 0x7fad1807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.062+0000 7fad27fff640 1 --2- 172.21.15.17:0/1429395600 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fad1807af30 0x7fad1807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.062+0000 7fad25ffb640 1 -- 172.21.15.17:0/1429395600 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7fad1c0bec50 con 0x7fad28102450 2024-09-20T18:38:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.062+0000 7fad27fff640 1 --2- 172.21.15.17:0/1429395600 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fad1807af30 0x7fad1807d3f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad14005e10 tx=0x7fad14005da0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.066+0000 7fad25ffb640 1 -- 172.21.15.17:0/1429395600 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fad1c08a300 con 0x7fad28102450 2024-09-20T18:38:21.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.272+0000 7fad2f1c8640 1 -- 172.21.15.17:0/1429395600 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fad28105700 con 0x7fad1807af30 2024-09-20T18:38:21.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.273+0000 7fad25ffb640 1 -- 172.21.15.17:0/1429395600 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+367 (secure 0 0 0) 0x7fad28105700 con 0x7fad1807af30 2024-09-20T18:38:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.276+0000 7fad2f1c8640 1 -- 172.21.15.17:0/1429395600 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fad1807af30 msgr2=0x7fad1807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.276+0000 7fad2f1c8640 1 --2- 172.21.15.17:0/1429395600 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fad1807af30 0x7fad1807d3f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad14005e10 tx=0x7fad14005da0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.276+0000 7fad2f1c8640 1 -- 172.21.15.17:0/1429395600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad28102450 msgr2=0x7fad281974b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.276+0000 7fad2f1c8640 1 --2- 172.21.15.17:0/1429395600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad28102450 0x7fad281974b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fad1c006010 tx=0x7fad1c0048f0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.276+0000 7fad2f1c8640 1 -- 172.21.15.17:0/1429395600 shutdown_connections 2024-09-20T18:38:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.276+0000 7fad2f1c8640 1 --2- 172.21.15.17:0/1429395600 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fad1807af30 0x7fad1807d3f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.276+0000 7fad2f1c8640 1 --2- 172.21.15.17:0/1429395600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad28104d80 0x7fad281979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.276+0000 7fad2f1c8640 1 --2- 172.21.15.17:0/1429395600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad28102450 0x7fad281974b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.276+0000 7fad2f1c8640 1 -- 172.21.15.17:0/1429395600 >> 172.21.15.17:0/1429395600 conn(0x7fad280fc010 msgr2=0x7fad280fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:21.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.276+0000 7fad2f1c8640 1 -- 172.21.15.17:0/1429395600 shutdown_connections 2024-09-20T18:38:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.276+0000 7fad2f1c8640 1 -- 172.21.15.17:0/1429395600 wait complete. 2024-09-20T18:38:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.376+0000 7efefc8b0640 1 -- 172.21.15.17:0/2124736796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efef8104d20 msgr2=0x7efef8107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.376+0000 7efefc8b0640 1 --2- 172.21.15.17:0/2124736796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efef8104d20 0x7efef8107110 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efeec0098b0 tx=0x7efeec02a4d0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.376+0000 7efefc8b0640 1 -- 172.21.15.17:0/2124736796 shutdown_connections 2024-09-20T18:38:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.376+0000 7efefc8b0640 1 --2- 172.21.15.17:0/2124736796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efef8104d20 0x7efef8107110 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.376+0000 7efefc8b0640 1 --2- 172.21.15.17:0/2124736796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efef81023f0 0x7efef81047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.376+0000 7efefc8b0640 1 -- 172.21.15.17:0/2124736796 >> 172.21.15.17:0/2124736796 conn(0x7efef80fc010 msgr2=0x7efef80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.376+0000 7efefc8b0640 1 -- 172.21.15.17:0/2124736796 shutdown_connections 2024-09-20T18:38:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.376+0000 7efefc8b0640 1 -- 172.21.15.17:0/2124736796 wait complete. 2024-09-20T18:38:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.377+0000 7efefc8b0640 1 Processor -- start 2024-09-20T18:38:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.377+0000 7efefc8b0640 1 -- start start 2024-09-20T18:38:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.377+0000 7efefc8b0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efef81023f0 0x7efef8101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.377+0000 7efefc8b0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efef8104d20 0x7efef81003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.377+0000 7efefc8b0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efef810a790 con 0x7efef81023f0 2024-09-20T18:38:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.377+0000 7efefc8b0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efef810a610 con 0x7efef8104d20 2024-09-20T18:38:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.378+0000 7efef659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efef81023f0 0x7efef8101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.378+0000 7efef659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efef81023f0 0x7efef8101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60678/0 (socket says 172.21.15.17:60678) 2024-09-20T18:38:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.378+0000 7efef659c640 1 -- 172.21.15.17:0/2264320980 learned_addr learned my addr 172.21.15.17:0/2264320980 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:38:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.378+0000 7efef5d9b640 1 --2- 172.21.15.17:0/2264320980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efef8104d20 0x7efef81003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.378+0000 7efef659c640 1 -- 172.21.15.17:0/2264320980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efef8104d20 msgr2=0x7efef81003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.378+0000 7efef659c640 1 --2- 172.21.15.17:0/2264320980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efef8104d20 0x7efef81003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.378+0000 7efef659c640 1 -- 172.21.15.17:0/2264320980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef81008e0 con 0x7efef81023f0 2024-09-20T18:38:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.378+0000 7efef659c640 1 --2- 172.21.15.17:0/2264320980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efef81023f0 0x7efef8101ce0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efee800c8a0 tx=0x7efee800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:21.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.378+0000 7efee77fe640 1 -- 172.21.15.17:0/2264320980 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efee80079b0 con 0x7efef81023f0 2024-09-20T18:38:21.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.378+0000 7efee77fe640 1 -- 172.21.15.17:0/2264320980 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efee8007b50 con 0x7efef81023f0 2024-09-20T18:38:21.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.378+0000 7efefc8b0640 1 -- 172.21.15.17:0/2264320980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efef8100bd0 con 0x7efef81023f0 2024-09-20T18:38:21.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.378+0000 7efee77fe640 1 -- 172.21.15.17:0/2264320980 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efee8018700 con 0x7efef81023f0 2024-09-20T18:38:21.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.378+0000 7efefc8b0640 1 -- 172.21.15.17:0/2264320980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efef8101130 con 0x7efef81023f0 2024-09-20T18:38:21.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.379+0000 7efefc8b0640 1 -- 172.21.15.17:0/2264320980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efef81027d0 con 0x7efef81023f0 2024-09-20T18:38:21.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.380+0000 7efee77fe640 1 -- 172.21.15.17:0/2264320980 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7efee8007d00 con 0x7efef81023f0 2024-09-20T18:38:21.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.381+0000 7efee77fe640 1 --2- 172.21.15.17:0/2264320980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efee007af30 0x7efee007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:21.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.381+0000 7efee77fe640 1 -- 172.21.15.17:0/2264320980 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7efee809e260 con 0x7efef81023f0 2024-09-20T18:38:21.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.381+0000 7efef5d9b640 1 --2- 172.21.15.17:0/2264320980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efee007af30 0x7efee007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:21.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.381+0000 7efef5d9b640 1 --2- 172.21.15.17:0/2264320980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efee007af30 0x7efee007d3f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efeec006010 tx=0x7efeec009580 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:21.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.385+0000 7efee77fe640 1 -- 172.21.15.17:0/2264320980 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7efee8014030 con 0x7efef81023f0 2024-09-20T18:38:21.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.586+0000 7efefc8b0640 1 -- 172.21.15.17:0/2264320980 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7efef819f570 con 0x7efee007af30 2024-09-20T18:38:21.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.598+0000 7efee77fe640 1 -- 172.21.15.17:0/2264320980 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7efef819f570 con 0x7efee007af30 2024-09-20T18:38:21.614 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:38:21.614 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (9m) 20s ago 10m 24.9M - 0.25.0 c8568f914cd2 8954ab699be3 2024-09-20T18:38:21.614 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (2m) 20s ago 10m 8724k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:38:21.614 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (2m) 22s ago 10m 8451k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:38:21.614 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (10m) 20s ago 10m 6895k - 19.1.1-369-ged8ee0f2 6acb0a031eab 725c8bcc6ec8 2024-09-20T18:38:21.614 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (10m) 22s ago 10m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab e10dd613dbe2 2024-09-20T18:38:21.614 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (9m) 20s ago 10m 79.9M - 9.4.12 2bacad6d85d8 d8c886b98eae 2024-09-20T18:38:21.615 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (5m) 20s ago 5m 149M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:38:21.615 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (5m) 20s ago 5m 100M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:38:21.615 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (5m) 22s ago 5m 26.7M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:38:21.615 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (5m) 22s ago 5m 26.5M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:38:21.615 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (116s) 20s ago 11m 510M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:38:21.615 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (54s) 22s ago 9m 455M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:38:21.615 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (12m) 20s ago 12m 58.6M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab ab1f988c4cb2 2024-09-20T18:38:21.615 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (9m) 22s ago 9m 48.8M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 9eea40352787 2024-09-20T18:38:21.615 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (32s) 20s ago 10m 7922k - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:38:21.615 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (25s) 22s ago 9m 3301k - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:38:21.615 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (8m) 20s ago 8m 204M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab c1207e514216 2024-09-20T18:38:21.615 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (8m) 20s ago 8m 223M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 73f2fd77590f 2024-09-20T18:38:21.615 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (7m) 20s ago 7m 206M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 6f0b9405dc18 2024-09-20T18:38:21.615 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (7m) 22s ago 7m 260M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:38:21.616 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (6m) 22s ago 6m 206M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:38:21.616 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (6m) 22s ago 6m 188M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:38:21.616 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 starting - - - - 2024-09-20T18:38:21.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.600+0000 7efefc8b0640 1 -- 172.21.15.17:0/2264320980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efee007af30 msgr2=0x7efee007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:21.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.600+0000 7efefc8b0640 1 --2- 172.21.15.17:0/2264320980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efee007af30 0x7efee007d3f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efeec006010 tx=0x7efeec009580 comp rx=0 tx=0).stop 2024-09-20T18:38:21.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.600+0000 7efefc8b0640 1 -- 172.21.15.17:0/2264320980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efef81023f0 msgr2=0x7efef8101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:21.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.600+0000 7efefc8b0640 1 --2- 172.21.15.17:0/2264320980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efef81023f0 0x7efef8101ce0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efee800c8a0 tx=0x7efee800cd60 comp rx=0 tx=0).stop 2024-09-20T18:38:21.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.600+0000 7efefc8b0640 1 -- 172.21.15.17:0/2264320980 shutdown_connections 2024-09-20T18:38:21.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.600+0000 7efefc8b0640 1 --2- 172.21.15.17:0/2264320980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efee007af30 0x7efee007d3f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.600+0000 7efefc8b0640 1 --2- 172.21.15.17:0/2264320980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efef8104d20 0x7efef81003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.600+0000 7efefc8b0640 1 --2- 172.21.15.17:0/2264320980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efef81023f0 0x7efef8101ce0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.600+0000 7efefc8b0640 1 -- 172.21.15.17:0/2264320980 >> 172.21.15.17:0/2264320980 conn(0x7efef80fc010 msgr2=0x7efef80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:21.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.600+0000 7efefc8b0640 1 -- 172.21.15.17:0/2264320980 shutdown_connections 2024-09-20T18:38:21.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.600+0000 7efefc8b0640 1 -- 172.21.15.17:0/2264320980 wait complete. 2024-09-20T18:38:21.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.686+0000 7f549a09f640 1 -- 172.21.15.17:0/1331317735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5494100860 msgr2=0x7f5494100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:21.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.686+0000 7f549a09f640 1 --2- 172.21.15.17:0/1331317735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5494100860 0x7f5494100c60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5484009880 tx=0x7f548402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.686+0000 7f549a09f640 1 -- 172.21.15.17:0/1331317735 shutdown_connections 2024-09-20T18:38:21.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.686+0000 7f549a09f640 1 --2- 172.21.15.17:0/1331317735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5494101a60 0x7f5494101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.686+0000 7f549a09f640 1 --2- 172.21.15.17:0/1331317735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5494100860 0x7f5494100c60 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.686+0000 7f549a09f640 1 -- 172.21.15.17:0/1331317735 >> 172.21.15.17:0/1331317735 conn(0x7f54940fc010 msgr2=0x7f54940fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:21.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.687+0000 7f549a09f640 1 -- 172.21.15.17:0/1331317735 shutdown_connections 2024-09-20T18:38:21.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.687+0000 7f549a09f640 1 -- 172.21.15.17:0/1331317735 wait complete. 2024-09-20T18:38:21.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.687+0000 7f549a09f640 1 Processor -- start 2024-09-20T18:38:21.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.687+0000 7f549a09f640 1 -- start start 2024-09-20T18:38:21.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.687+0000 7f549a09f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5494100860 0x7f5494109af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:21.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.687+0000 7f549a09f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5494101a60 0x7f54941081b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:21.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.688+0000 7f549a09f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f549410a7a0 con 0x7f5494101a60 2024-09-20T18:38:21.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.688+0000 7f549a09f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f549410a620 con 0x7f5494100860 2024-09-20T18:38:21.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.688+0000 7f548bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5494101a60 0x7f54941081b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:21.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.688+0000 7f548bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5494101a60 0x7f54941081b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60692/0 (socket says 172.21.15.17:60692) 2024-09-20T18:38:21.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.688+0000 7f548bfff640 1 -- 172.21.15.17:0/3789357377 learned_addr learned my addr 172.21.15.17:0/3789357377 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:38:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.688+0000 7f54937fe640 1 --2- 172.21.15.17:0/3789357377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5494100860 0x7f5494109af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.688+0000 7f548bfff640 1 -- 172.21.15.17:0/3789357377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5494100860 msgr2=0x7f5494109af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.688+0000 7f548bfff640 1 --2- 172.21.15.17:0/3789357377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5494100860 0x7f5494109af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.688+0000 7f548bfff640 1 -- 172.21.15.17:0/3789357377 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54941086f0 con 0x7f5494101a60 2024-09-20T18:38:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.688+0000 7f548bfff640 1 --2- 172.21.15.17:0/3789357377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5494101a60 0x7f54941081b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f547c00e970 tx=0x7f547c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.688+0000 7f54917fa640 1 -- 172.21.15.17:0/3789357377 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f547c00cac0 con 0x7f5494101a60 2024-09-20T18:38:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.689+0000 7f54917fa640 1 -- 172.21.15.17:0/3789357377 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f547c0054e0 con 0x7f5494101a60 2024-09-20T18:38:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.689+0000 7f549a09f640 1 -- 172.21.15.17:0/3789357377 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54941089e0 con 0x7f5494101a60 2024-09-20T18:38:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.689+0000 7f54917fa640 1 -- 172.21.15.17:0/3789357377 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f547c010430 con 0x7f5494101a60 2024-09-20T18:38:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.689+0000 7f549a09f640 1 -- 172.21.15.17:0/3789357377 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5494108f70 con 0x7f5494101a60 2024-09-20T18:38:21.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.690+0000 7f549a09f640 1 -- 172.21.15.17:0/3789357377 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5494100c60 con 0x7f5494101a60 2024-09-20T18:38:21.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.691+0000 7f54917fa640 1 -- 172.21.15.17:0/3789357377 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f547c004e80 con 0x7f5494101a60 2024-09-20T18:38:21.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.692+0000 7f54917fa640 1 --2- 172.21.15.17:0/3789357377 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f548007af30 0x7f548007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:21.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.693+0000 7f54917fa640 1 -- 172.21.15.17:0/3789357377 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f547c09e5a0 con 0x7f5494101a60 2024-09-20T18:38:21.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.693+0000 7f54937fe640 1 --2- 172.21.15.17:0/3789357377 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f548007af30 0x7f548007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:21.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.693+0000 7f54937fe640 1 --2- 172.21.15.17:0/3789357377 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f548007af30 0x7f548007d3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5484009230 tx=0x7f54840058d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:21.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:21.697+0000 7f54917fa640 1 -- 172.21.15.17:0/3789357377 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f547c069c50 con 0x7f5494101a60 2024-09-20T18:38:21.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:21 smithi017 ceph-mon[28058]: pgmap v55: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:38:21.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:21 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:21.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:21 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:21.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:21 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:38:22.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.023+0000 7f549a09f640 1 -- 172.21.15.17:0/3789357377 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5494062df0 con 0x7f5494101a60 2024-09-20T18:38:22.039 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:38:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:38:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T18:38:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:38:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:38:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:38:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:38:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:38:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T18:38:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:38:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:38:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:38:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:38:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:38:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 12, 2024-09-20T18:38:22.041 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:38:22.041 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:38:22.041 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:38:22.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.023+0000 7f54917fa640 1 -- 172.21.15.17:0/3789357377 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f547c06eb00 con 0x7f5494101a60 2024-09-20T18:38:22.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.026+0000 7f549a09f640 1 -- 172.21.15.17:0/3789357377 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f548007af30 msgr2=0x7f548007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.026+0000 7f549a09f640 1 --2- 172.21.15.17:0/3789357377 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f548007af30 0x7f548007d3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5484009230 tx=0x7f54840058d0 comp rx=0 tx=0).stop 2024-09-20T18:38:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.026+0000 7f549a09f640 1 -- 172.21.15.17:0/3789357377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5494101a60 msgr2=0x7f54941081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.026+0000 7f549a09f640 1 --2- 172.21.15.17:0/3789357377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5494101a60 0x7f54941081b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f547c00e970 tx=0x7f547c00ed70 comp rx=0 tx=0).stop 2024-09-20T18:38:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.026+0000 7f549a09f640 1 -- 172.21.15.17:0/3789357377 shutdown_connections 2024-09-20T18:38:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.026+0000 7f549a09f640 1 --2- 172.21.15.17:0/3789357377 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f548007af30 0x7f548007d3f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.026+0000 7f549a09f640 1 --2- 172.21.15.17:0/3789357377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5494101a60 0x7f54941081b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.026+0000 7f549a09f640 1 --2- 172.21.15.17:0/3789357377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5494100860 0x7f5494109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.026+0000 7f549a09f640 1 -- 172.21.15.17:0/3789357377 >> 172.21.15.17:0/3789357377 conn(0x7f54940fc010 msgr2=0x7f5494104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.026+0000 7f549a09f640 1 -- 172.21.15.17:0/3789357377 shutdown_connections 2024-09-20T18:38:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.026+0000 7f549a09f640 1 -- 172.21.15.17:0/3789357377 wait complete. 2024-09-20T18:38:22.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.114+0000 7faea2c2b640 1 -- 172.21.15.17:0/3796792818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae9c100b80 msgr2=0x7fae9c100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:22.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.114+0000 7faea2c2b640 1 --2- 172.21.15.17:0/3796792818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae9c100b80 0x7fae9c100fe0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fae90009880 tx=0x7fae9002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:38:22.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.114+0000 7faea2c2b640 1 -- 172.21.15.17:0/3796792818 shutdown_connections 2024-09-20T18:38:22.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.114+0000 7faea2c2b640 1 --2- 172.21.15.17:0/3796792818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae9c100b80 0x7fae9c100fe0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:22.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.114+0000 7faea2c2b640 1 --2- 172.21.15.17:0/3796792818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae9c100240 0x7fae9c100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:22.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.114+0000 7faea2c2b640 1 -- 172.21.15.17:0/3796792818 >> 172.21.15.17:0/3796792818 conn(0x7fae9c0fc010 msgr2=0x7fae9c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:22.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.114+0000 7faea2c2b640 1 -- 172.21.15.17:0/3796792818 shutdown_connections 2024-09-20T18:38:22.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.114+0000 7faea2c2b640 1 -- 172.21.15.17:0/3796792818 wait complete. 2024-09-20T18:38:22.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.115+0000 7faea2c2b640 1 Processor -- start 2024-09-20T18:38:22.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.115+0000 7faea2c2b640 1 -- start start 2024-09-20T18:38:22.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.115+0000 7faea2c2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae9c100240 0x7fae9c199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:22.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.115+0000 7faea2c2b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae9c100b80 0x7fae9c199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:22.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.115+0000 7faea2c2b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fae9c10c990 con 0x7fae9c100240 2024-09-20T18:38:22.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.115+0000 7faea2c2b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae9c10c810 con 0x7fae9c100b80 2024-09-20T18:38:22.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.115+0000 7faea09c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae9c100240 0x7fae9c199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:22.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.115+0000 7faea09c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae9c100240 0x7fae9c199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60710/0 (socket says 172.21.15.17:60710) 2024-09-20T18:38:22.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.115+0000 7faea09c7640 1 -- 172.21.15.17:0/3141753540 learned_addr learned my addr 172.21.15.17:0/3141753540 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:38:22.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.115+0000 7fae9bfff640 1 --2- 172.21.15.17:0/3141753540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae9c100b80 0x7fae9c199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:22.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.115+0000 7faea09c7640 1 -- 172.21.15.17:0/3141753540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae9c100b80 msgr2=0x7fae9c199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:22.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.115+0000 7faea09c7640 1 --2- 172.21.15.17:0/3141753540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae9c100b80 0x7fae9c199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:22.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.116+0000 7faea09c7640 1 -- 172.21.15.17:0/3141753540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae9c19a250 con 0x7fae9c100240 2024-09-20T18:38:22.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.116+0000 7faea09c7640 1 --2- 172.21.15.17:0/3141753540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae9c100240 0x7fae9c199690 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00cc60 tx=0x7fae8c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:22.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.116+0000 7fae99ffb640 1 -- 172.21.15.17:0/3141753540 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae8c00ad30 con 0x7fae9c100240 2024-09-20T18:38:22.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.116+0000 7faea2c2b640 1 -- 172.21.15.17:0/3141753540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae9c19ec90 con 0x7fae9c100240 2024-09-20T18:38:22.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.116+0000 7fae99ffb640 1 -- 172.21.15.17:0/3141753540 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fae8c005020 con 0x7fae9c100240 2024-09-20T18:38:22.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.116+0000 7fae99ffb640 1 -- 172.21.15.17:0/3141753540 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae8c00f640 con 0x7fae9c100240 2024-09-20T18:38:22.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.116+0000 7faea2c2b640 1 -- 172.21.15.17:0/3141753540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae9c19f1a0 con 0x7fae9c100240 2024-09-20T18:38:22.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.117+0000 7faea2c2b640 1 -- 172.21.15.17:0/3141753540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae9c100640 con 0x7fae9c100240 2024-09-20T18:38:22.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.118+0000 7fae99ffb640 1 -- 172.21.15.17:0/3141753540 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fae8c0051d0 con 0x7fae9c100240 2024-09-20T18:38:22.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.119+0000 7fae99ffb640 1 --2- 172.21.15.17:0/3141753540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae8407af80 0x7fae8407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:22.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.120+0000 7fae99ffb640 1 -- 172.21.15.17:0/3141753540 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7fae8c09e4f0 con 0x7fae9c100240 2024-09-20T18:38:22.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.120+0000 7fae9bfff640 1 --2- 172.21.15.17:0/3141753540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae8407af80 0x7fae8407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:22.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.121+0000 7fae9bfff640 1 --2- 172.21.15.17:0/3141753540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae8407af80 0x7fae8407d440 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fae90000c00 tx=0x7fae900058d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.128+0000 7fae99ffb640 1 -- 172.21.15.17:0/3141753540 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fae8c014030 con 0x7fae9c100240 2024-09-20T18:38:22.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:21 smithi172 ceph-mon[35456]: pgmap v55: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:38:22.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:21 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:22.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:21 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:22.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:21 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:38:22.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.355+0000 7faea2c2b640 1 -- 172.21.15.17:0/3141753540 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fae9c062740 con 0x7fae8407af80 2024-09-20T18:38:22.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.357+0000 7fae99ffb640 1 -- 172.21.15.17:0/3141753540 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+367 (secure 0 0 0) 0x7fae9c062740 con 0x7fae8407af80 2024-09-20T18:38:22.372 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:38:22.372 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:38:22.372 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:38:22.372 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T18:38:22.372 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:38:22.372 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-09-20T18:38:22.372 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:38:22.372 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "2/2 daemons upgraded", 2024-09-20T18:38:22.372 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-20T18:38:22.372 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:38:22.372 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:38:22.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.359+0000 7faea2c2b640 1 -- 172.21.15.17:0/3141753540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae8407af80 msgr2=0x7fae8407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:22.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.359+0000 7faea2c2b640 1 --2- 172.21.15.17:0/3141753540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae8407af80 0x7fae8407d440 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fae90000c00 tx=0x7fae900058d0 comp rx=0 tx=0).stop 2024-09-20T18:38:22.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.359+0000 7faea2c2b640 1 -- 172.21.15.17:0/3141753540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae9c100240 msgr2=0x7fae9c199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:22.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.359+0000 7faea2c2b640 1 --2- 172.21.15.17:0/3141753540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae9c100240 0x7fae9c199690 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00cc60 tx=0x7fae8c00a620 comp rx=0 tx=0).stop 2024-09-20T18:38:22.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.359+0000 7faea2c2b640 1 -- 172.21.15.17:0/3141753540 shutdown_connections 2024-09-20T18:38:22.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.359+0000 7faea2c2b640 1 --2- 172.21.15.17:0/3141753540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae8407af80 0x7fae8407d440 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:22.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.359+0000 7faea2c2b640 1 --2- 172.21.15.17:0/3141753540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae9c100b80 0x7fae9c199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:22.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.359+0000 7faea2c2b640 1 --2- 172.21.15.17:0/3141753540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae9c100240 0x7fae9c199690 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:22.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.359+0000 7faea2c2b640 1 -- 172.21.15.17:0/3141753540 >> 172.21.15.17:0/3141753540 conn(0x7fae9c0fc010 msgr2=0x7fae9c108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:22.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.359+0000 7faea2c2b640 1 -- 172.21.15.17:0/3141753540 shutdown_connections 2024-09-20T18:38:22.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:22.359+0000 7faea2c2b640 1 -- 172.21.15.17:0/3141753540 wait complete. 2024-09-20T18:38:23.035 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:22 smithi017 ceph-mon[28058]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:38:23.036 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:22 smithi017 ceph-mon[28058]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:38:23.036 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:22 smithi017 ceph-mon[28058]: from='client.14854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:38:23.036 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:22 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:23.036 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:22 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:23.036 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:22 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:38:23.036 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:22 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/3789357377' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:23.111 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:22 smithi172 ceph-mon[35456]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:38:23.111 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:22 smithi172 ceph-mon[35456]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:38:23.111 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:22 smithi172 ceph-mon[35456]: from='client.14854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:38:23.111 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:22 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:23.111 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:22 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:23.111 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:22 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:38:23.112 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:22 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/3789357377' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:24.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:23 smithi017 ceph-mon[28058]: pgmap v56: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-20T18:38:24.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:23 smithi017 ceph-mon[28058]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:38:24.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:23 smithi172 ceph-mon[35456]: pgmap v56: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-20T18:38:24.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:23 smithi172 ceph-mon[35456]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:38:26.054 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:25 smithi017 ceph-mon[28058]: pgmap v57: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-20T18:38:26.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:25 smithi172 ceph-mon[35456]: pgmap v57: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-20T18:38:27.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:27 smithi017 ceph-mon[28058]: pgmap v58: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:38:27.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:27 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:27.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:27 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:27.649 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:27 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:27.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:27 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:27.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:27 smithi172 ceph-mon[35456]: pgmap v58: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:38:27.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:27 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:27.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:27 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:27.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:27 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:27.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:27 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:29.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:29 smithi017 ceph-mon[28058]: pgmap v59: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:38:29.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:29 smithi172 ceph-mon[35456]: pgmap v59: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:38:31.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: pgmap v60: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:38:31.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:31.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:31.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:38:31.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:38:31.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:31.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:38:31.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:38:31.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:38:31.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:31.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:31.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:31.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:31.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:31.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:31.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:31.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:31.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:31 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:31.837 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: pgmap v60: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:38:31.838 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:31.838 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:31.838 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:38:31.838 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:38:31.838 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:31.838 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:38:31.838 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-20T18:38:31.838 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:38:31.838 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:31.838 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:31.838 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:31.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:31.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:31.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:31.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:31.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:31.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:31 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:33.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:33 smithi172 ceph-mon[35456]: Upgrade: Updating alertmanager.smithi017 2024-09-20T18:38:33.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:33 smithi172 ceph-mon[35456]: Deploying daemon alertmanager.smithi017 on smithi017 2024-09-20T18:38:33.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:33 smithi172 ceph-mon[35456]: pgmap v61: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-20T18:38:33.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:33 smithi017 ceph-mon[28058]: Upgrade: Updating alertmanager.smithi017 2024-09-20T18:38:33.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:33 smithi017 ceph-mon[28058]: Deploying daemon alertmanager.smithi017 on smithi017 2024-09-20T18:38:33.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:33 smithi017 ceph-mon[28058]: pgmap v61: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-20T18:38:35.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:35 smithi172 ceph-mon[35456]: pgmap v62: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:38:35.825 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:35 smithi017 ceph-mon[28058]: pgmap v62: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:38:37.563 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:37 smithi017 ceph-mon[28058]: pgmap v63: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-20T18:38:37.563 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:37 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:38:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:37 smithi172 ceph-mon[35456]: pgmap v63: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-20T18:38:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:37 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:38:39.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:39 smithi017 ceph-mon[28058]: pgmap v64: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-20T18:38:39.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:39 smithi172 ceph-mon[35456]: pgmap v64: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-20T18:38:41.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:41 smithi172 ceph-mon[35456]: pgmap v65: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-20T18:38:41.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:41.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:41 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:41.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:41 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:38:41.732 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:41 smithi017 ceph-mon[28058]: pgmap v65: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-20T18:38:41.732 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:41.732 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:41 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:41.732 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:41 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:38:43.483 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:43 smithi017 ceph-mon[28058]: pgmap v66: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-20T18:38:43.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:43 smithi172 ceph-mon[35456]: pgmap v66: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-20T18:38:45.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:45 smithi172 ceph-mon[35456]: pgmap v67: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:38:45.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:45 smithi017 ceph-mon[28058]: pgmap v67: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:38:47.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:47 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:47.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:47 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:47.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:47 smithi172 ceph-mon[35456]: pgmap v68: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:38:47.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:47 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:47.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:47 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:47.483 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:47 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:47.483 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:47 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:47.483 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:47 smithi017 ceph-mon[28058]: pgmap v68: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:38:47.483 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:47 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:47.483 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:47 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:49.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:49 smithi017 ceph-mon[28058]: pgmap v69: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:38:49.709 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:49 smithi172 ceph-mon[35456]: pgmap v69: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:38:51.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:51.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:51.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:38:51.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:38:51.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:51.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T18:38:51.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T18:38:51.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:38:51.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:51 smithi017 ceph-mon[28058]: pgmap v70: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:38:51.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:51.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:51.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:38:51.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:38:51.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:38:51.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T18:38:51.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-20T18:38:51.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:38:51.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:51.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:51 smithi172 ceph-mon[35456]: pgmap v70: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:38:52.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:52 smithi017 ceph-mon[28058]: Upgrade: Updating grafana.smithi017 2024-09-20T18:38:52.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:52 smithi017 ceph-mon[28058]: Deploying daemon grafana.smithi017 on smithi017 2024-09-20T18:38:52.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:52 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:38:52.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:52 smithi172 ceph-mon[35456]: Upgrade: Updating grafana.smithi017 2024-09-20T18:38:52.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:52 smithi172 ceph-mon[35456]: Deploying daemon grafana.smithi017 on smithi017 2024-09-20T18:38:52.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:52 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:38:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.447+0000 7f999470c640 1 -- 172.21.15.17:0/3804738386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998c102b60 msgr2=0x7f998c102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.447+0000 7f999470c640 1 --2- 172.21.15.17:0/3804738386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998c102b60 0x7f998c102fe0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f997c009880 tx=0x7f997c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:38:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.447+0000 7f999470c640 1 -- 172.21.15.17:0/3804738386 shutdown_connections 2024-09-20T18:38:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.447+0000 7f999470c640 1 --2- 172.21.15.17:0/3804738386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998c102b60 0x7f998c102fe0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.447+0000 7f999470c640 1 --2- 172.21.15.17:0/3804738386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f998c101960 0x7f998c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:52.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.447+0000 7f999470c640 1 -- 172.21.15.17:0/3804738386 >> 172.21.15.17:0/3804738386 conn(0x7f998c0fd0f0 msgr2=0x7f998c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:52.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.447+0000 7f999470c640 1 -- 172.21.15.17:0/3804738386 shutdown_connections 2024-09-20T18:38:52.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.447+0000 7f999470c640 1 -- 172.21.15.17:0/3804738386 wait complete. 2024-09-20T18:38:52.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.448+0000 7f999470c640 1 Processor -- start 2024-09-20T18:38:52.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.448+0000 7f999470c640 1 -- start start 2024-09-20T18:38:52.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.448+0000 7f999470c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f998c101960 0x7f998c1974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:52.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.448+0000 7f999470c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998c102b60 0x7f998c197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:52.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.448+0000 7f999470c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f998c10a7a0 con 0x7f998c102b60 2024-09-20T18:38:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.448+0000 7f999470c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f998c10a620 con 0x7f998c101960 2024-09-20T18:38:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.448+0000 7f9991ca7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998c102b60 0x7f998c197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.448+0000 7f9991ca7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998c102b60 0x7f998c197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38750/0 (socket says 172.21.15.17:38750) 2024-09-20T18:38:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.448+0000 7f9991ca7640 1 -- 172.21.15.17:0/4196348056 learned_addr learned my addr 172.21.15.17:0/4196348056 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:38:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.448+0000 7f9991ca7640 1 -- 172.21.15.17:0/4196348056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f998c101960 msgr2=0x7f998c1974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.448+0000 7f99924a8640 1 --2- 172.21.15.17:0/4196348056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f998c101960 0x7f998c1974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.448+0000 7f9991ca7640 1 --2- 172.21.15.17:0/4196348056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f998c101960 0x7f998c1974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.448+0000 7f9991ca7640 1 -- 172.21.15.17:0/4196348056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998c198080 con 0x7f998c102b60 2024-09-20T18:38:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.448+0000 7f9991ca7640 1 --2- 172.21.15.17:0/4196348056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998c102b60 0x7f998c197a00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f997c006010 tx=0x7f997c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.449+0000 7f99837fe640 1 -- 172.21.15.17:0/4196348056 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f997c03f070 con 0x7f998c102b60 2024-09-20T18:38:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.449+0000 7f99837fe640 1 -- 172.21.15.17:0/4196348056 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f997c004ac0 con 0x7f998c102b60 2024-09-20T18:38:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.449+0000 7f999470c640 1 -- 172.21.15.17:0/4196348056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f998c19ca60 con 0x7f998c102b60 2024-09-20T18:38:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.449+0000 7f99837fe640 1 -- 172.21.15.17:0/4196348056 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f997c035030 con 0x7f998c102b60 2024-09-20T18:38:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.449+0000 7f999470c640 1 -- 172.21.15.17:0/4196348056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f998c19cff0 con 0x7f998c102b60 2024-09-20T18:38:52.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.450+0000 7f999470c640 1 -- 172.21.15.17:0/4196348056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f998c101d60 con 0x7f998c102b60 2024-09-20T18:38:52.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.450+0000 7f99837fe640 1 -- 172.21.15.17:0/4196348056 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f997c042070 con 0x7f998c102b60 2024-09-20T18:38:52.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.451+0000 7f99837fe640 1 --2- 172.21.15.17:0/4196348056 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f997807afd0 0x7f997807d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:52.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.451+0000 7f99837fe640 1 -- 172.21.15.17:0/4196348056 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f997c0bebb0 con 0x7f998c102b60 2024-09-20T18:38:52.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.451+0000 7f99924a8640 1 --2- 172.21.15.17:0/4196348056 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f997807afd0 0x7f997807d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:52.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.452+0000 7f99924a8640 1 --2- 172.21.15.17:0/4196348056 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f997807afd0 0x7f997807d490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9988005fd0 tx=0x7f9988005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:52.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.456+0000 7f99837fe640 1 -- 172.21.15.17:0/4196348056 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f997c08a260 con 0x7f998c102b60 2024-09-20T18:38:52.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.665+0000 7f999470c640 1 -- 172.21.15.17:0/4196348056 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f998c062630 con 0x7f997807afd0 2024-09-20T18:38:52.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.666+0000 7f99837fe640 1 -- 172.21.15.17:0/4196348056 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f998c062630 con 0x7f997807afd0 2024-09-20T18:38:52.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.668+0000 7f999470c640 1 -- 172.21.15.17:0/4196348056 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f997807afd0 msgr2=0x7f997807d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:52.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.668+0000 7f999470c640 1 --2- 172.21.15.17:0/4196348056 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f997807afd0 0x7f997807d490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9988005fd0 tx=0x7f9988005850 comp rx=0 tx=0).stop 2024-09-20T18:38:52.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.668+0000 7f999470c640 1 -- 172.21.15.17:0/4196348056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998c102b60 msgr2=0x7f998c197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:52.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.668+0000 7f999470c640 1 --2- 172.21.15.17:0/4196348056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998c102b60 0x7f998c197a00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f997c006010 tx=0x7f997c0046c0 comp rx=0 tx=0).stop 2024-09-20T18:38:52.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.668+0000 7f999470c640 1 -- 172.21.15.17:0/4196348056 shutdown_connections 2024-09-20T18:38:52.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.668+0000 7f999470c640 1 --2- 172.21.15.17:0/4196348056 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f997807afd0 0x7f997807d490 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:52.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.668+0000 7f999470c640 1 --2- 172.21.15.17:0/4196348056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f998c102b60 0x7f998c197a00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:52.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.668+0000 7f999470c640 1 --2- 172.21.15.17:0/4196348056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f998c101960 0x7f998c1974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:52.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.668+0000 7f999470c640 1 -- 172.21.15.17:0/4196348056 >> 172.21.15.17:0/4196348056 conn(0x7f998c0fd0f0 msgr2=0x7f998c106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:52.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.668+0000 7f999470c640 1 -- 172.21.15.17:0/4196348056 shutdown_connections 2024-09-20T18:38:52.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.669+0000 7f999470c640 1 -- 172.21.15.17:0/4196348056 wait complete. 2024-09-20T18:38:52.693 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:38:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.756+0000 7f111512f640 1 -- 172.21.15.17:0/4079845028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11101023f0 msgr2=0x7f11101047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.756+0000 7f111512f640 1 --2- 172.21.15.17:0/4079845028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11101023f0 0x7f11101047e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f11000098b0 tx=0x7f110002a4d0 comp rx=0 tx=0).stop 2024-09-20T18:38:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.756+0000 7f111512f640 1 -- 172.21.15.17:0/4079845028 shutdown_connections 2024-09-20T18:38:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.756+0000 7f111512f640 1 --2- 172.21.15.17:0/4079845028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1110104d20 0x7f1110107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.756+0000 7f111512f640 1 --2- 172.21.15.17:0/4079845028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11101023f0 0x7f11101047e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.756+0000 7f111512f640 1 -- 172.21.15.17:0/4079845028 >> 172.21.15.17:0/4079845028 conn(0x7f11100fc010 msgr2=0x7f11100fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.757+0000 7f111512f640 1 -- 172.21.15.17:0/4079845028 shutdown_connections 2024-09-20T18:38:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.757+0000 7f111512f640 1 -- 172.21.15.17:0/4079845028 wait complete. 2024-09-20T18:38:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.757+0000 7f111512f640 1 Processor -- start 2024-09-20T18:38:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.757+0000 7f111512f640 1 -- start start 2024-09-20T18:38:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.758+0000 7f111512f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11101023f0 0x7f1110199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.758+0000 7f111512f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1110104d20 0x7f1110199cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.758+0000 7f111512f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f111010a830 con 0x7f11101023f0 2024-09-20T18:38:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.758+0000 7f111512f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f111010a6b0 con 0x7f1110104d20 2024-09-20T18:38:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.758+0000 7f110ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11101023f0 0x7f1110199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.758+0000 7f110ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11101023f0 0x7f1110199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38772/0 (socket says 172.21.15.17:38772) 2024-09-20T18:38:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.758+0000 7f110ed9d640 1 -- 172.21.15.17:0/2671743112 learned_addr learned my addr 172.21.15.17:0/2671743112 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:38:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.758+0000 7f110e59c640 1 --2- 172.21.15.17:0/2671743112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1110104d20 0x7f1110199cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.758+0000 7f110ed9d640 1 -- 172.21.15.17:0/2671743112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1110104d20 msgr2=0x7f1110199cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.758+0000 7f110ed9d640 1 --2- 172.21.15.17:0/2671743112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1110104d20 0x7f1110199cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.758+0000 7f110ed9d640 1 -- 172.21.15.17:0/2671743112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111019a350 con 0x7f11101023f0 2024-09-20T18:38:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.758+0000 7f110ed9d640 1 --2- 172.21.15.17:0/2671743112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11101023f0 0x7f1110199790 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f11000099d0 tx=0x7f11000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.759+0000 7f10f7fff640 1 -- 172.21.15.17:0/2671743112 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f110003f070 con 0x7f11101023f0 2024-09-20T18:38:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.759+0000 7f10f7fff640 1 -- 172.21.15.17:0/2671743112 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1100004c70 con 0x7f11101023f0 2024-09-20T18:38:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.759+0000 7f111512f640 1 -- 172.21.15.17:0/2671743112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111019ed30 con 0x7f11101023f0 2024-09-20T18:38:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.759+0000 7f10f7fff640 1 -- 172.21.15.17:0/2671743112 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1100035030 con 0x7f11101023f0 2024-09-20T18:38:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.759+0000 7f111512f640 1 -- 172.21.15.17:0/2671743112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f111019f280 con 0x7f11101023f0 2024-09-20T18:38:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.760+0000 7f111512f640 1 -- 172.21.15.17:0/2671743112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11101027d0 con 0x7f11101023f0 2024-09-20T18:38:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.761+0000 7f10f7fff640 1 -- 172.21.15.17:0/2671743112 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1100042070 con 0x7f11101023f0 2024-09-20T18:38:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.761+0000 7f10f7fff640 1 --2- 172.21.15.17:0/2671743112 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f10f807af30 0x7f10f807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.761+0000 7f10f7fff640 1 -- 172.21.15.17:0/2671743112 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f11000bec00 con 0x7f11101023f0 2024-09-20T18:38:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.761+0000 7f110e59c640 1 --2- 172.21.15.17:0/2671743112 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f10f807af30 0x7f10f807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:52.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.762+0000 7f110e59c640 1 --2- 172.21.15.17:0/2671743112 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f10f807af30 0x7f10f807d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f111019ac40 tx=0x7f1104008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:52.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.766+0000 7f10f7fff640 1 -- 172.21.15.17:0/2671743112 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f110008a2b0 con 0x7f11101023f0 2024-09-20T18:38:53.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.993+0000 7f111512f640 1 -- 172.21.15.17:0/2671743112 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f11100626f0 con 0x7f10f807af30 2024-09-20T18:38:53.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.995+0000 7f10f7fff640 1 -- 172.21.15.17:0/2671743112 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f11100626f0 con 0x7f10f807af30 2024-09-20T18:38:53.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.997+0000 7f111512f640 1 -- 172.21.15.17:0/2671743112 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f10f807af30 msgr2=0x7f10f807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:53.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.997+0000 7f111512f640 1 --2- 172.21.15.17:0/2671743112 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f10f807af30 0x7f10f807d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f111019ac40 tx=0x7f1104008040 comp rx=0 tx=0).stop 2024-09-20T18:38:53.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.997+0000 7f111512f640 1 -- 172.21.15.17:0/2671743112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11101023f0 msgr2=0x7f1110199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:53.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.997+0000 7f111512f640 1 --2- 172.21.15.17:0/2671743112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11101023f0 0x7f1110199790 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f11000099d0 tx=0x7f11000048f0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.997+0000 7f111512f640 1 -- 172.21.15.17:0/2671743112 shutdown_connections 2024-09-20T18:38:53.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.997+0000 7f111512f640 1 --2- 172.21.15.17:0/2671743112 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f10f807af30 0x7f10f807d3f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.997+0000 7f111512f640 1 --2- 172.21.15.17:0/2671743112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1110104d20 0x7f1110199cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.997+0000 7f111512f640 1 --2- 172.21.15.17:0/2671743112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11101023f0 0x7f1110199790 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.997+0000 7f111512f640 1 -- 172.21.15.17:0/2671743112 >> 172.21.15.17:0/2671743112 conn(0x7f11100fc010 msgr2=0x7f1110101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:53.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.998+0000 7f111512f640 1 -- 172.21.15.17:0/2671743112 shutdown_connections 2024-09-20T18:38:53.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:52.998+0000 7f111512f640 1 -- 172.21.15.17:0/2671743112 wait complete. 2024-09-20T18:38:53.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.087+0000 7f81a02d6640 1 -- 172.21.15.17:0/2053997419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8198100860 msgr2=0x7f8198100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:53.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.087+0000 7f81a02d6640 1 --2- 172.21.15.17:0/2053997419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8198100860 0x7f8198100c60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8194009880 tx=0x7f819402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.087+0000 7f81a02d6640 1 -- 172.21.15.17:0/2053997419 shutdown_connections 2024-09-20T18:38:53.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.087+0000 7f81a02d6640 1 --2- 172.21.15.17:0/2053997419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8198101a60 0x7f8198101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.087+0000 7f81a02d6640 1 --2- 172.21.15.17:0/2053997419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8198100860 0x7f8198100c60 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.087+0000 7f81a02d6640 1 -- 172.21.15.17:0/2053997419 >> 172.21.15.17:0/2053997419 conn(0x7f81980fc010 msgr2=0x7f81980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:53.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.087+0000 7f81a02d6640 1 -- 172.21.15.17:0/2053997419 shutdown_connections 2024-09-20T18:38:53.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.087+0000 7f81a02d6640 1 -- 172.21.15.17:0/2053997419 wait complete. 2024-09-20T18:38:53.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.088+0000 7f81a02d6640 1 Processor -- start 2024-09-20T18:38:53.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.088+0000 7f81a02d6640 1 -- start start 2024-09-20T18:38:53.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.088+0000 7f81a02d6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8198100860 0x7f8198104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:53.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.088+0000 7f81a02d6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8198101a60 0x7f8198102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:53.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.088+0000 7f81a02d6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8198109680 con 0x7f8198101a60 2024-09-20T18:38:53.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.088+0000 7f81a02d6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8198109500 con 0x7f8198100860 2024-09-20T18:38:53.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.088+0000 7f819d871640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8198101a60 0x7f8198102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:53.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.088+0000 7f819d871640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8198101a60 0x7f8198102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38788/0 (socket says 172.21.15.17:38788) 2024-09-20T18:38:53.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.088+0000 7f819d871640 1 -- 172.21.15.17:0/2180143540 learned_addr learned my addr 172.21.15.17:0/2180143540 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:38:53.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.088+0000 7f819e072640 1 --2- 172.21.15.17:0/2180143540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8198100860 0x7f8198104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:53.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.089+0000 7f819d871640 1 -- 172.21.15.17:0/2180143540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8198100860 msgr2=0x7f8198104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:53.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.089+0000 7f819d871640 1 --2- 172.21.15.17:0/2180143540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8198100860 0x7f8198104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.089+0000 7f819d871640 1 -- 172.21.15.17:0/2180143540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819819b0f0 con 0x7f8198101a60 2024-09-20T18:38:53.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.089+0000 7f819d871640 1 --2- 172.21.15.17:0/2180143540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8198101a60 0x7f8198102e40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f818800d8d0 tx=0x7f818800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:53.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.089+0000 7f818f7fe640 1 -- 172.21.15.17:0/2180143540 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8188017030 con 0x7f8198101a60 2024-09-20T18:38:53.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.089+0000 7f81a02d6640 1 -- 172.21.15.17:0/2180143540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8198103380 con 0x7f8198101a60 2024-09-20T18:38:53.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.089+0000 7f818f7fe640 1 -- 172.21.15.17:0/2180143540 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8188004020 con 0x7f8198101a60 2024-09-20T18:38:53.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.089+0000 7f818f7fe640 1 -- 172.21.15.17:0/2180143540 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f81880047a0 con 0x7f8198101a60 2024-09-20T18:38:53.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.089+0000 7f81a02d6640 1 -- 172.21.15.17:0/2180143540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8198103910 con 0x7f8198101a60 2024-09-20T18:38:53.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.090+0000 7f81a02d6640 1 -- 172.21.15.17:0/2180143540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8198109e60 con 0x7f8198101a60 2024-09-20T18:38:53.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.091+0000 7f818f7fe640 1 -- 172.21.15.17:0/2180143540 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f81880041d0 con 0x7f8198101a60 2024-09-20T18:38:53.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.091+0000 7f818f7fe640 1 --2- 172.21.15.17:0/2180143540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f818407af80 0x7f818407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:53.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.092+0000 7f818f7fe640 1 -- 172.21.15.17:0/2180143540 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f8188018070 con 0x7f8198101a60 2024-09-20T18:38:53.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.092+0000 7f819e072640 1 --2- 172.21.15.17:0/2180143540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f818407af80 0x7f818407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:53.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.092+0000 7f819e072640 1 --2- 172.21.15.17:0/2180143540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f818407af80 0x7f818407d440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8194000c00 tx=0x7f8194005a20 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:53.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.097+0000 7f818f7fe640 1 -- 172.21.15.17:0/2180143540 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f8188069440 con 0x7f8198101a60 2024-09-20T18:38:53.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.300+0000 7f81a02d6640 1 -- 172.21.15.17:0/2180143540 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f819806a3b0 con 0x7f818407af80 2024-09-20T18:38:53.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.310+0000 7f818f7fe640 1 -- 172.21.15.17:0/2180143540 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f819806a3b0 con 0x7f818407af80 2024-09-20T18:38:53.325 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:38:53.325 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (12s) 7s ago 11m 15.2M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:38:53.325 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (3m) 7s ago 11m 8782k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:38:53.325 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (2m) 54s ago 10m 8451k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:38:53.325 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (11m) 7s ago 11m 6895k - 19.1.1-369-ged8ee0f2 6acb0a031eab 725c8bcc6ec8 2024-09-20T18:38:53.325 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (10m) 54s ago 10m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab e10dd613dbe2 2024-09-20T18:38:53.325 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (9m) 7s ago 11m 80.1M - 9.4.12 2bacad6d85d8 d8c886b98eae 2024-09-20T18:38:53.325 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (6m) 7s ago 6m 149M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:38:53.325 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (5m) 7s ago 5m 95.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:38:53.325 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (5m) 54s ago 5m 26.7M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:38:53.325 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (5m) 54s ago 5m 26.5M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:38:53.326 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (2m) 7s ago 12m 513M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:38:53.326 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (85s) 54s ago 10m 455M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:38:53.326 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (12m) 7s ago 12m 59.0M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab ab1f988c4cb2 2024-09-20T18:38:53.326 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (10m) 54s ago 10m 48.8M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 9eea40352787 2024-09-20T18:38:53.326 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (63s) 7s ago 11m 11.9M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:38:53.326 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (57s) 54s ago 10m 3301k - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:38:53.326 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (9m) 7s ago 9m 205M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab c1207e514216 2024-09-20T18:38:53.326 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (8m) 7s ago 8m 223M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 73f2fd77590f 2024-09-20T18:38:53.326 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (8m) 7s ago 8m 207M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 6f0b9405dc18 2024-09-20T18:38:53.326 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (7m) 54s ago 7m 260M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:38:53.326 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (7m) 54s ago 7m 206M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:38:53.326 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (6m) 54s ago 6m 188M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:38:53.326 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (33s) 7s ago 10m 45.3M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:38:53.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.312+0000 7f81a02d6640 1 -- 172.21.15.17:0/2180143540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f818407af80 msgr2=0x7f818407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:53.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.312+0000 7f81a02d6640 1 --2- 172.21.15.17:0/2180143540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f818407af80 0x7f818407d440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8194000c00 tx=0x7f8194005a20 comp rx=0 tx=0).stop 2024-09-20T18:38:53.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.312+0000 7f81a02d6640 1 -- 172.21.15.17:0/2180143540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8198101a60 msgr2=0x7f8198102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:53.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.312+0000 7f81a02d6640 1 --2- 172.21.15.17:0/2180143540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8198101a60 0x7f8198102e40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f818800d8d0 tx=0x7f818800dd90 comp rx=0 tx=0).stop 2024-09-20T18:38:53.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.312+0000 7f81a02d6640 1 -- 172.21.15.17:0/2180143540 shutdown_connections 2024-09-20T18:38:53.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.312+0000 7f81a02d6640 1 --2- 172.21.15.17:0/2180143540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f818407af80 0x7f818407d440 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.312+0000 7f81a02d6640 1 --2- 172.21.15.17:0/2180143540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8198101a60 0x7f8198102e40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.312+0000 7f81a02d6640 1 --2- 172.21.15.17:0/2180143540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8198100860 0x7f8198104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.312+0000 7f81a02d6640 1 -- 172.21.15.17:0/2180143540 >> 172.21.15.17:0/2180143540 conn(0x7f81980fc010 msgr2=0x7f8198069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:53.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.312+0000 7f81a02d6640 1 -- 172.21.15.17:0/2180143540 shutdown_connections 2024-09-20T18:38:53.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.312+0000 7f81a02d6640 1 -- 172.21.15.17:0/2180143540 wait complete. 2024-09-20T18:38:53.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:53 smithi017 ceph-mon[28058]: pgmap v71: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:38:53.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:53 smithi017 ceph-mon[28058]: from='client.14866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:38:53.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.395+0000 7f77ef300640 1 -- 172.21.15.17:0/4077765985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8102b60 msgr2=0x7f77e8102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:53.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.395+0000 7f77ef300640 1 --2- 172.21.15.17:0/4077765985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8102b60 0x7f77e8102fe0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f77dc009880 tx=0x7f77dc02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.395+0000 7f77ef300640 1 -- 172.21.15.17:0/4077765985 shutdown_connections 2024-09-20T18:38:53.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.395+0000 7f77ef300640 1 --2- 172.21.15.17:0/4077765985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8102b60 0x7f77e8102fe0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.395+0000 7f77ef300640 1 --2- 172.21.15.17:0/4077765985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8101960 0x7f77e8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.395+0000 7f77ef300640 1 -- 172.21.15.17:0/4077765985 >> 172.21.15.17:0/4077765985 conn(0x7f77e80fd110 msgr2=0x7f77e80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:53.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.395+0000 7f77ef300640 1 -- 172.21.15.17:0/4077765985 shutdown_connections 2024-09-20T18:38:53.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.395+0000 7f77ef300640 1 -- 172.21.15.17:0/4077765985 wait complete. 2024-09-20T18:38:53.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.396+0000 7f77ef300640 1 Processor -- start 2024-09-20T18:38:53.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.396+0000 7f77ef300640 1 -- start start 2024-09-20T18:38:53.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.396+0000 7f77ef300640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8101960 0x7f77e8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:53.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.396+0000 7f77ef300640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8102b60 0x7f77e80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:53.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.396+0000 7f77ef300640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f77e810a820 con 0x7f77e8101960 2024-09-20T18:38:53.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.396+0000 7f77ef300640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f77e810a6a0 con 0x7f77e8102b60 2024-09-20T18:38:53.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.396+0000 7f77ed09c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8101960 0x7f77e8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:53.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.396+0000 7f77ed09c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8101960 0x7f77e8075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38808/0 (socket says 172.21.15.17:38808) 2024-09-20T18:38:53.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.396+0000 7f77ed09c640 1 -- 172.21.15.17:0/4052364901 learned_addr learned my addr 172.21.15.17:0/4052364901 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:38:53.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.396+0000 7f77ec89b640 1 --2- 172.21.15.17:0/4052364901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8102b60 0x7f77e80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.396+0000 7f77ed09c640 1 -- 172.21.15.17:0/4052364901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8102b60 msgr2=0x7f77e80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.396+0000 7f77ed09c640 1 --2- 172.21.15.17:0/4052364901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8102b60 0x7f77e80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.396+0000 7f77ed09c640 1 -- 172.21.15.17:0/4052364901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e8074b20 con 0x7f77e8101960 2024-09-20T18:38:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.397+0000 7f77ec89b640 1 --2- 172.21.15.17:0/4052364901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8102b60 0x7f77e80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:38:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.397+0000 7f77ed09c640 1 --2- 172.21.15.17:0/4052364901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8101960 0x7f77e8075f20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f77d800b9c0 tx=0x7f77d800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.397+0000 7f77e67fc640 1 -- 172.21.15.17:0/4052364901 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77d8019070 con 0x7f77e8101960 2024-09-20T18:38:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.397+0000 7f77e67fc640 1 -- 172.21.15.17:0/4052364901 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f77d800cde0 con 0x7f77e8101960 2024-09-20T18:38:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.397+0000 7f77ef300640 1 -- 172.21.15.17:0/4052364901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e8074e10 con 0x7f77e8101960 2024-09-20T18:38:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.397+0000 7f77e67fc640 1 -- 172.21.15.17:0/4052364901 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77d8012570 con 0x7f77e8101960 2024-09-20T18:38:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.397+0000 7f77ef300640 1 -- 172.21.15.17:0/4052364901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e8075420 con 0x7f77e8101960 2024-09-20T18:38:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.398+0000 7f77ef300640 1 -- 172.21.15.17:0/4052364901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e8101d60 con 0x7f77e8101960 2024-09-20T18:38:53.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.399+0000 7f77e67fc640 1 -- 172.21.15.17:0/4052364901 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f77d801c070 con 0x7f77e8101960 2024-09-20T18:38:53.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.399+0000 7f77e67fc640 1 --2- 172.21.15.17:0/4052364901 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f77d007af80 0x7f77d007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:53.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.399+0000 7f77e67fc640 1 -- 172.21.15.17:0/4052364901 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f77d809d7c0 con 0x7f77e8101960 2024-09-20T18:38:53.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.399+0000 7f77ec89b640 1 --2- 172.21.15.17:0/4052364901 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f77d007af80 0x7f77d007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:53.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.400+0000 7f77ec89b640 1 --2- 172.21.15.17:0/4052364901 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f77d007af80 0x7f77d007d440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0096c0 tx=0x7f77dc009650 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:53.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.404+0000 7f77e67fc640 1 -- 172.21.15.17:0/4052364901 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f77d8068e70 con 0x7f77e8101960 2024-09-20T18:38:53.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:53 smithi172 ceph-mon[35456]: pgmap v71: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:38:53.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:53 smithi172 ceph-mon[35456]: from='client.14866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:38:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.759+0000 7f77ef300640 1 -- 172.21.15.17:0/4052364901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f77e819f860 con 0x7f77e8101960 2024-09-20T18:38:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.760+0000 7f77e67fc640 1 -- 172.21.15.17:0/4052364901 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f77d806dd20 con 0x7f77e8101960 2024-09-20T18:38:53.775 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:38:53.776 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:38:53.776 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T18:38:53.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:38:53.776 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:38:53.776 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:38:53.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:38:53.776 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:38:53.776 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T18:38:53.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:38:53.776 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:38:53.776 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:38:53.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:38:53.776 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:38:53.776 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 12, 2024-09-20T18:38:53.776 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:38:53.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:38:53.777 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:38:53.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.763+0000 7f77ef300640 1 -- 172.21.15.17:0/4052364901 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f77d007af80 msgr2=0x7f77d007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:53.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.763+0000 7f77ef300640 1 --2- 172.21.15.17:0/4052364901 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f77d007af80 0x7f77d007d440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0096c0 tx=0x7f77dc009650 comp rx=0 tx=0).stop 2024-09-20T18:38:53.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.763+0000 7f77ef300640 1 -- 172.21.15.17:0/4052364901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8101960 msgr2=0x7f77e8075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:53.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.763+0000 7f77ef300640 1 --2- 172.21.15.17:0/4052364901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8101960 0x7f77e8075f20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f77d800b9c0 tx=0x7f77d800be80 comp rx=0 tx=0).stop 2024-09-20T18:38:53.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.763+0000 7f77ef300640 1 -- 172.21.15.17:0/4052364901 shutdown_connections 2024-09-20T18:38:53.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.763+0000 7f77ef300640 1 --2- 172.21.15.17:0/4052364901 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f77d007af80 0x7f77d007d440 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.763+0000 7f77ef300640 1 --2- 172.21.15.17:0/4052364901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8102b60 0x7f77e80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.763+0000 7f77ef300640 1 --2- 172.21.15.17:0/4052364901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77e8101960 0x7f77e8075f20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.763+0000 7f77ef300640 1 -- 172.21.15.17:0/4052364901 >> 172.21.15.17:0/4052364901 conn(0x7f77e80fd110 msgr2=0x7f77e80ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:53.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.763+0000 7f77ef300640 1 -- 172.21.15.17:0/4052364901 shutdown_connections 2024-09-20T18:38:53.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.763+0000 7f77ef300640 1 -- 172.21.15.17:0/4052364901 wait complete. 2024-09-20T18:38:53.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.874+0000 7f3eceffd640 1 -- 172.21.15.17:0/1727469830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec8104d20 msgr2=0x7f3ec8107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:53.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.874+0000 7f3eceffd640 1 --2- 172.21.15.17:0/1727469830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec8104d20 0x7f3ec8107110 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40098b0 tx=0x7f3eb402a4d0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.874+0000 7f3eceffd640 1 -- 172.21.15.17:0/1727469830 shutdown_connections 2024-09-20T18:38:53.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.874+0000 7f3eceffd640 1 --2- 172.21.15.17:0/1727469830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec8104d20 0x7f3ec8107110 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.874+0000 7f3eceffd640 1 --2- 172.21.15.17:0/1727469830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec81023f0 0x7f3ec81047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.874+0000 7f3eceffd640 1 -- 172.21.15.17:0/1727469830 >> 172.21.15.17:0/1727469830 conn(0x7f3ec80fbff0 msgr2=0x7f3ec80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:53.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.874+0000 7f3eceffd640 1 -- 172.21.15.17:0/1727469830 shutdown_connections 2024-09-20T18:38:53.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.874+0000 7f3eceffd640 1 -- 172.21.15.17:0/1727469830 wait complete. 2024-09-20T18:38:53.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.875+0000 7f3eceffd640 1 Processor -- start 2024-09-20T18:38:53.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.875+0000 7f3eceffd640 1 -- start start 2024-09-20T18:38:53.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.875+0000 7f3eceffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec81023f0 0x7f3ec8197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:53.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.875+0000 7f3eceffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec8104d20 0x7f3ec8197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:53.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.875+0000 7f3eceffd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec810a790 con 0x7f3ec81023f0 2024-09-20T18:38:53.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.875+0000 7f3eceffd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec810a610 con 0x7f3ec8104d20 2024-09-20T18:38:53.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.875+0000 7f3eccd99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec81023f0 0x7f3ec8197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:53.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.875+0000 7f3eccd99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec81023f0 0x7f3ec8197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38820/0 (socket says 172.21.15.17:38820) 2024-09-20T18:38:53.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.875+0000 7f3eccd99640 1 -- 172.21.15.17:0/4178396191 learned_addr learned my addr 172.21.15.17:0/4178396191 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:38:53.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.876+0000 7f3ec7fff640 1 --2- 172.21.15.17:0/4178396191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec8104d20 0x7f3ec8197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:53.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.876+0000 7f3eccd99640 1 -- 172.21.15.17:0/4178396191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec8104d20 msgr2=0x7f3ec8197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:53.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.876+0000 7f3eccd99640 1 --2- 172.21.15.17:0/4178396191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec8104d20 0x7f3ec8197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:53.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.876+0000 7f3eccd99640 1 -- 172.21.15.17:0/4178396191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec81980f0 con 0x7f3ec81023f0 2024-09-20T18:38:53.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.876+0000 7f3eccd99640 1 --2- 172.21.15.17:0/4178396191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec81023f0 0x7f3ec8197530 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00d8d0 tx=0x7f3ebc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:53.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.876+0000 7f3ec5ffb640 1 -- 172.21.15.17:0/4178396191 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ebc017070 con 0x7f3ec81023f0 2024-09-20T18:38:53.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.876+0000 7f3ec5ffb640 1 -- 172.21.15.17:0/4178396191 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3ebc010460 con 0x7f3ec81023f0 2024-09-20T18:38:53.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.876+0000 7f3eceffd640 1 -- 172.21.15.17:0/4178396191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec819cb30 con 0x7f3ec81023f0 2024-09-20T18:38:53.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.876+0000 7f3ec5ffb640 1 -- 172.21.15.17:0/4178396191 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ebc00f5f0 con 0x7f3ec81023f0 2024-09-20T18:38:53.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.876+0000 7f3eceffd640 1 -- 172.21.15.17:0/4178396191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec819d090 con 0x7f3ec81023f0 2024-09-20T18:38:53.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.878+0000 7f3eceffd640 1 -- 172.21.15.17:0/4178396191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec81027d0 con 0x7f3ec81023f0 2024-09-20T18:38:53.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.878+0000 7f3ec5ffb640 1 -- 172.21.15.17:0/4178396191 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3ebc009a30 con 0x7f3ec81023f0 2024-09-20T18:38:53.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.879+0000 7f3ec5ffb640 1 --2- 172.21.15.17:0/4178396191 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3eb807af80 0x7f3eb807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:38:53.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.879+0000 7f3ec5ffb640 1 -- 172.21.15.17:0/4178396191 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f3ebc09dd60 con 0x7f3ec81023f0 2024-09-20T18:38:53.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.879+0000 7f3ec7fff640 1 --2- 172.21.15.17:0/4178396191 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3eb807af80 0x7f3eb807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:38:53.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.880+0000 7f3ec7fff640 1 --2- 172.21.15.17:0/4178396191 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3eb807af80 0x7f3eb807d440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4006010 tx=0x7f3eb4009580 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:38:53.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:53.885+0000 7f3ec5ffb640 1 -- 172.21.15.17:0/4178396191 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f3ebc069490 con 0x7f3ec81023f0 2024-09-20T18:38:54.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:54.236+0000 7f3eceffd640 1 -- 172.21.15.17:0/4178396191 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3ec8105720 con 0x7f3eb807af80 2024-09-20T18:38:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:54.237+0000 7f3ec5ffb640 1 -- 172.21.15.17:0/4178396191 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f3ec8105720 con 0x7f3eb807af80 2024-09-20T18:38:54.252 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:38:54.252 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:38:54.252 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:38:54.252 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-20T18:38:54.252 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:38:54.252 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-09-20T18:38:54.252 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:38:54.252 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "2/2 daemons upgraded", 2024-09-20T18:38:54.252 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading grafana daemons", 2024-09-20T18:38:54.253 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:38:54.253 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:38:54.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:54.239+0000 7f3eceffd640 1 -- 172.21.15.17:0/4178396191 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3eb807af80 msgr2=0x7f3eb807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:54.239+0000 7f3eceffd640 1 --2- 172.21.15.17:0/4178396191 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3eb807af80 0x7f3eb807d440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4006010 tx=0x7f3eb4009580 comp rx=0 tx=0).stop 2024-09-20T18:38:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:54.239+0000 7f3eceffd640 1 -- 172.21.15.17:0/4178396191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec81023f0 msgr2=0x7f3ec8197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:38:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:54.239+0000 7f3eceffd640 1 --2- 172.21.15.17:0/4178396191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec81023f0 0x7f3ec8197530 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00d8d0 tx=0x7f3ebc00dd90 comp rx=0 tx=0).stop 2024-09-20T18:38:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:54.239+0000 7f3eceffd640 1 -- 172.21.15.17:0/4178396191 shutdown_connections 2024-09-20T18:38:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:54.239+0000 7f3eceffd640 1 --2- 172.21.15.17:0/4178396191 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3eb807af80 0x7f3eb807d440 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:54.239+0000 7f3eceffd640 1 --2- 172.21.15.17:0/4178396191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ec8104d20 0x7f3ec8197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:54.239+0000 7f3eceffd640 1 --2- 172.21.15.17:0/4178396191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ec81023f0 0x7f3ec8197530 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:38:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:54.239+0000 7f3eceffd640 1 -- 172.21.15.17:0/4178396191 >> 172.21.15.17:0/4178396191 conn(0x7f3ec80fbff0 msgr2=0x7f3ec80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:38:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:54.240+0000 7f3eceffd640 1 -- 172.21.15.17:0/4178396191 shutdown_connections 2024-09-20T18:38:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:38:54.240+0000 7f3eceffd640 1 -- 172.21.15.17:0/4178396191 wait complete. 2024-09-20T18:38:54.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:54 smithi017 ceph-mon[28058]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:38:54.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:54 smithi017 ceph-mon[28058]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:38:54.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:54 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/4052364901' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:54.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:54 smithi172 ceph-mon[35456]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:38:54.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:54 smithi172 ceph-mon[35456]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:38:54.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:54 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/4052364901' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:38:55.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:55 smithi017 ceph-mon[28058]: from='client.14882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:38:55.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:55 smithi017 ceph-mon[28058]: pgmap v72: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:38:55.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:55 smithi172 ceph-mon[35456]: from='client.14882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:38:55.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:55 smithi172 ceph-mon[35456]: pgmap v72: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:38:57.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:57 smithi017 ceph-mon[28058]: pgmap v73: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:38:57.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:57 smithi172 ceph-mon[35456]: pgmap v73: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:38:59.639 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:38:59 smithi017 ceph-mon[28058]: pgmap v74: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:38:59.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:38:59 smithi172 ceph-mon[35456]: pgmap v74: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:01.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:01 smithi017 ceph-mon[28058]: pgmap v75: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:01.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:01 smithi172 ceph-mon[35456]: pgmap v75: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:03.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:03 smithi017 ceph-mon[28058]: pgmap v76: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:03.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:03 smithi172 ceph-mon[35456]: pgmap v76: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:05.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:05 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:05.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:05 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:05.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:05 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:39:05.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:05 smithi172 ceph-mon[35456]: pgmap v77: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:05.517 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:05 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:05.517 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:05 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:05.517 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:05 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:39:05.517 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:05 smithi017 ceph-mon[28058]: pgmap v77: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:07.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:07 smithi017 ceph-mon[28058]: pgmap v78: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:07.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:07 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:39:07.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:07 smithi172 ceph-mon[35456]: pgmap v78: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:07.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:07 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:39:09.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:09 smithi017 ceph-mon[28058]: pgmap v79: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:09.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:09 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:09.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:09 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:09.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:09 smithi172 ceph-mon[35456]: pgmap v79: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:09.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:09 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:09.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:09 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:11.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:10 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:11.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:10 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:11.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:10 smithi172 ceph-mon[35456]: pgmap v80: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:11.285 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:10 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:11.285 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:10 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:11.285 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:10 smithi017 ceph-mon[28058]: pgmap v80: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:13.584 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:13 smithi017 ceph-mon[28058]: pgmap v81: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:13.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:13 smithi172 ceph-mon[35456]: pgmap v81: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:15.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:15 smithi017 ceph-mon[28058]: pgmap v82: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:15.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:15 smithi172 ceph-mon[35456]: pgmap v82: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:17.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:17.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:17.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:39:17.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:39:17.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:17.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T18:39:17.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T18:39:17.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:39:17.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: Upgrade: Finalizing container_image settings 2024-09-20T18:39:17.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:17.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-20T18:39:17.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-20T18:39:17.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-20T18:39:17.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-20T18:39:17.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-20T18:39:17.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-20T18:39:17.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-20T18:39:17.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-20T18:39:17.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-20T18:39:17.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-20T18:39:17.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-20T18:39:17.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-20T18:39:17.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-20T18:39:17.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-20T18:39:17.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-20T18:39:17.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-20T18:39:17.405 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.405 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.405 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-20T18:39:17.405 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-20T18:39:17.405 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-20T18:39:17.405 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-20T18:39:17.405 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-20T18:39:17.405 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-20T18:39:17.405 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-20T18:39:17.405 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-20T18:39:17.405 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-20T18:39:17.405 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-20T18:39:17.405 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-20T18:39:17.406 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.406 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.406 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.406 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.406 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.406 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.406 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.406 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.406 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.406 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.406 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.406 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.406 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: Upgrade: Complete! 2024-09-20T18:39:17.407 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-20T18:39:17.407 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-20T18:39:17.407 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-20T18:39:17.407 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:39:17.407 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:39:17.407 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:39:17.407 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:17.407 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: pgmap v83: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:17.407 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:39:17.407 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:39:17.407 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:39:17.407 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:17.407 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:17 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:17.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:17.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:17.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:39:17.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:39:17.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:17.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T18:39:17.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-20T18:39:17.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:39:17.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:17.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: Upgrade: Finalizing container_image settings 2024-09-20T18:39:17.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:17.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-20T18:39:17.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-20T18:39:17.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-20T18:39:17.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-20T18:39:17.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-20T18:39:17.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-20T18:39:17.464 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-20T18:39:17.464 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-20T18:39:17.464 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-20T18:39:17.464 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-20T18:39:17.464 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-20T18:39:17.464 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-20T18:39:17.464 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-20T18:39:17.464 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-20T18:39:17.464 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-20T18:39:17.464 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-20T18:39:17.464 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-20T18:39:17.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-20T18:39:17.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-20T18:39:17.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-20T18:39:17.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-20T18:39:17.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-20T18:39:17.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-20T18:39:17.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-20T18:39:17.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-20T18:39:17.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-20T18:39:17.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-20T18:39:17.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-20T18:39:17.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: Upgrade: Complete! 2024-09-20T18:39:17.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-20T18:39:17.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-20T18:39:17.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-20T18:39:17.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:39:17.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:39:17.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:39:17.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:17.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: pgmap v83: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:17.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:39:17.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:39:17.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:39:17.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:17.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:17 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:19.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:19 smithi017 ceph-mon[28058]: pgmap v84: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:19.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:19 smithi172 ceph-mon[35456]: pgmap v84: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:21.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:21 smithi017 ceph-mon[28058]: pgmap v85: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:21.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:21 smithi172 ceph-mon[35456]: pgmap v85: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:22.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:22 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:39:22.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:22 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:39:23.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:23 smithi017 ceph-mon[28058]: pgmap v86: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:23.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:23 smithi172 ceph-mon[35456]: pgmap v86: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:24.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.339+0000 7f46b68d8640 1 -- 172.21.15.17:0/2828295458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b0101a60 msgr2=0x7f46b0101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:24.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.339+0000 7f46b68d8640 1 --2- 172.21.15.17:0/2828295458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b0101a60 0x7f46b0101ee0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009880 tx=0x7f46a402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:39:24.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.339+0000 7f46b68d8640 1 -- 172.21.15.17:0/2828295458 shutdown_connections 2024-09-20T18:39:24.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.339+0000 7f46b68d8640 1 --2- 172.21.15.17:0/2828295458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b0101a60 0x7f46b0101ee0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:24.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.339+0000 7f46b68d8640 1 --2- 172.21.15.17:0/2828295458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46b0100860 0x7f46b0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:24.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.339+0000 7f46b68d8640 1 -- 172.21.15.17:0/2828295458 >> 172.21.15.17:0/2828295458 conn(0x7f46b00fc010 msgr2=0x7f46b00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:24.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.339+0000 7f46b68d8640 1 -- 172.21.15.17:0/2828295458 shutdown_connections 2024-09-20T18:39:24.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.339+0000 7f46b68d8640 1 -- 172.21.15.17:0/2828295458 wait complete. 2024-09-20T18:39:24.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.339+0000 7f46b68d8640 1 Processor -- start 2024-09-20T18:39:24.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.340+0000 7f46b68d8640 1 -- start start 2024-09-20T18:39:24.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.340+0000 7f46b68d8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b0100860 0x7f46b01975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:24.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.340+0000 7f46b68d8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46b0101a60 0x7f46b0197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:24.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.340+0000 7f46b68d8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f46b0109720 con 0x7f46b0100860 2024-09-20T18:39:24.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.340+0000 7f46b68d8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f46b01095a0 con 0x7f46b0101a60 2024-09-20T18:39:24.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.340+0000 7f46affff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b0100860 0x7f46b01975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:24.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.340+0000 7f46affff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b0100860 0x7f46b01975a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54588/0 (socket says 172.21.15.17:54588) 2024-09-20T18:39:24.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.340+0000 7f46affff640 1 -- 172.21.15.17:0/534263540 learned_addr learned my addr 172.21.15.17:0/534263540 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:24.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.340+0000 7f46af7fe640 1 --2- 172.21.15.17:0/534263540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46b0101a60 0x7f46b0197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:24.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.341+0000 7f46affff640 1 -- 172.21.15.17:0/534263540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46b0101a60 msgr2=0x7f46b0197ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:24.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.341+0000 7f46affff640 1 --2- 172.21.15.17:0/534263540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46b0101a60 0x7f46b0197ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:24.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.341+0000 7f46affff640 1 -- 172.21.15.17:0/534263540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b0198160 con 0x7f46b0100860 2024-09-20T18:39:24.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.341+0000 7f46affff640 1 --2- 172.21.15.17:0/534263540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b0100860 0x7f46b01975a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f46a000b3d0 tx=0x7f46a000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:24.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.341+0000 7f46ad7fa640 1 -- 172.21.15.17:0/534263540 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46a0015020 con 0x7f46b0100860 2024-09-20T18:39:24.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.341+0000 7f46ad7fa640 1 -- 172.21.15.17:0/534263540 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f46a0011af0 con 0x7f46b0100860 2024-09-20T18:39:24.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.341+0000 7f46ad7fa640 1 -- 172.21.15.17:0/534263540 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46a0010da0 con 0x7f46b0100860 2024-09-20T18:39:24.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.341+0000 7f46b68d8640 1 -- 172.21.15.17:0/534263540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b019cba0 con 0x7f46b0100860 2024-09-20T18:39:24.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.341+0000 7f46b68d8640 1 -- 172.21.15.17:0/534263540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b019d1b0 con 0x7f46b0100860 2024-09-20T18:39:24.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.342+0000 7f46b68d8640 1 -- 172.21.15.17:0/534263540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b0100c60 con 0x7f46b0100860 2024-09-20T18:39:24.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.343+0000 7f46ad7fa640 1 -- 172.21.15.17:0/534263540 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f46a0018020 con 0x7f46b0100860 2024-09-20T18:39:24.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.343+0000 7f46ad7fa640 1 --2- 172.21.15.17:0/534263540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f469807af80 0x7f469807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:24.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.344+0000 7f46ad7fa640 1 -- 172.21.15.17:0/534263540 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f46a009d950 con 0x7f46b0100860 2024-09-20T18:39:24.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.344+0000 7f46af7fe640 1 --2- 172.21.15.17:0/534263540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f469807af80 0x7f469807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:24.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.344+0000 7f46af7fe640 1 --2- 172.21.15.17:0/534263540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f469807af80 0x7f469807d440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46b0198a50 tx=0x7f46a4005a20 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:24.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.348+0000 7f46ad7fa640 1 -- 172.21.15.17:0/534263540 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f46a001f020 con 0x7f46b0100860 2024-09-20T18:39:24.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.556+0000 7f46b68d8640 1 -- 172.21.15.17:0/534263540 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f46b006a970 con 0x7f469807af80 2024-09-20T18:39:24.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.557+0000 7f46ad7fa640 1 -- 172.21.15.17:0/534263540 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f46b006a970 con 0x7f469807af80 2024-09-20T18:39:24.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.559+0000 7f46b68d8640 1 -- 172.21.15.17:0/534263540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f469807af80 msgr2=0x7f469807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:24.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.559+0000 7f46b68d8640 1 --2- 172.21.15.17:0/534263540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f469807af80 0x7f469807d440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46b0198a50 tx=0x7f46a4005a20 comp rx=0 tx=0).stop 2024-09-20T18:39:24.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.559+0000 7f46b68d8640 1 -- 172.21.15.17:0/534263540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b0100860 msgr2=0x7f46b01975a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:24.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.559+0000 7f46b68d8640 1 --2- 172.21.15.17:0/534263540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b0100860 0x7f46b01975a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f46a000b3d0 tx=0x7f46a000b890 comp rx=0 tx=0).stop 2024-09-20T18:39:24.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.559+0000 7f46b68d8640 1 -- 172.21.15.17:0/534263540 shutdown_connections 2024-09-20T18:39:24.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.559+0000 7f46b68d8640 1 --2- 172.21.15.17:0/534263540 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f469807af80 0x7f469807d440 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:24.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.559+0000 7f46b68d8640 1 --2- 172.21.15.17:0/534263540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46b0101a60 0x7f46b0197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:24.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.559+0000 7f46b68d8640 1 --2- 172.21.15.17:0/534263540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b0100860 0x7f46b01975a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:24.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.559+0000 7f46b68d8640 1 -- 172.21.15.17:0/534263540 >> 172.21.15.17:0/534263540 conn(0x7f46b00fc010 msgr2=0x7f46b006a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:24.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.559+0000 7f46b68d8640 1 -- 172.21.15.17:0/534263540 shutdown_connections 2024-09-20T18:39:24.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:24.559+0000 7f46b68d8640 1 -- 172.21.15.17:0/534263540 wait complete. 2024-09-20T18:39:25.187 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-20T18:39:25.493 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:39:25.583 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:25 smithi017 ceph-mon[28058]: pgmap v87: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:25.583 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:25 smithi017 ceph-mon[28058]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:39:25.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:25 smithi172 ceph-mon[35456]: pgmap v87: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:25.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:25 smithi172 ceph-mon[35456]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:39:25.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.961+0000 7f0415d05640 1 -- 172.21.15.17:0/2030404482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0410107900 msgr2=0x7f0410107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:25.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.961+0000 7f0415d05640 1 --2- 172.21.15.17:0/2030404482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0410107900 0x7f0410107ce0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0400009880 tx=0x7f040002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:39:25.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.961+0000 7f0415d05640 1 -- 172.21.15.17:0/2030404482 shutdown_connections 2024-09-20T18:39:25.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.961+0000 7f0415d05640 1 --2- 172.21.15.17:0/2030404482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0410101900 0x7f0410101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:25.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.961+0000 7f0415d05640 1 --2- 172.21.15.17:0/2030404482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0410107900 0x7f0410107ce0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:25.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.961+0000 7f0415d05640 1 -- 172.21.15.17:0/2030404482 >> 172.21.15.17:0/2030404482 conn(0x7f04100fd600 msgr2=0x7f04100ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:25.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.961+0000 7f0415d05640 1 -- 172.21.15.17:0/2030404482 shutdown_connections 2024-09-20T18:39:25.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.961+0000 7f0415d05640 1 -- 172.21.15.17:0/2030404482 wait complete. 2024-09-20T18:39:25.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.961+0000 7f0415d05640 1 Processor -- start 2024-09-20T18:39:25.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.962+0000 7f0415d05640 1 -- start start 2024-09-20T18:39:25.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.962+0000 7f0415d05640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0410101900 0x7f04100744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:25.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.962+0000 7f0415d05640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0410107900 0x7f0410074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:25.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.962+0000 7f0415d05640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f041010ee30 con 0x7f0410101900 2024-09-20T18:39:25.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.962+0000 7f0415d05640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f041010ecb0 con 0x7f0410107900 2024-09-20T18:39:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.962+0000 7f040f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0410101900 0x7f04100744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.962+0000 7f040f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0410101900 0x7f04100744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54606/0 (socket says 172.21.15.17:54606) 2024-09-20T18:39:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.962+0000 7f040f7fe640 1 -- 172.21.15.17:0/637027198 learned_addr learned my addr 172.21.15.17:0/637027198 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.962+0000 7f040f7fe640 1 -- 172.21.15.17:0/637027198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0410107900 msgr2=0x7f0410074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.962+0000 7f040f7fe640 1 --2- 172.21.15.17:0/637027198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0410107900 0x7f0410074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.962+0000 7f040f7fe640 1 -- 172.21.15.17:0/637027198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0410074f70 con 0x7f0410101900 2024-09-20T18:39:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.963+0000 7f040f7fe640 1 --2- 172.21.15.17:0/637027198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0410101900 0x7f04100744f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0400031460 tx=0x7f04000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.963+0000 7f040cff9640 1 -- 172.21.15.17:0/637027198 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f040003f070 con 0x7f0410101900 2024-09-20T18:39:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.963+0000 7f0415d05640 1 -- 172.21.15.17:0/637027198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0410075200 con 0x7f0410101900 2024-09-20T18:39:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.963+0000 7f040cff9640 1 -- 172.21.15.17:0/637027198 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0400004cf0 con 0x7f0410101900 2024-09-20T18:39:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.963+0000 7f040cff9640 1 -- 172.21.15.17:0/637027198 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0400035030 con 0x7f0410101900 2024-09-20T18:39:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.963+0000 7f0415d05640 1 -- 172.21.15.17:0/637027198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04101a3e20 con 0x7f0410101900 2024-09-20T18:39:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.964+0000 7f0415d05640 1 -- 172.21.15.17:0/637027198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0410103040 con 0x7f0410101900 2024-09-20T18:39:25.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.964+0000 7f040cff9640 1 -- 172.21.15.17:0/637027198 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0400042070 con 0x7f0410101900 2024-09-20T18:39:25.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.965+0000 7f040cff9640 1 --2- 172.21.15.17:0/637027198 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f03f807af30 0x7f03f807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:25.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.965+0000 7f040cff9640 1 -- 172.21.15.17:0/637027198 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f04000bea90 con 0x7f0410101900 2024-09-20T18:39:25.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.965+0000 7f040effd640 1 --2- 172.21.15.17:0/637027198 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f03f807af30 0x7f03f807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:25.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.965+0000 7f040effd640 1 --2- 172.21.15.17:0/637027198 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f03f807af30 0x7f03f807d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0410075f80 tx=0x7f0404006c90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:25.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:25.969+0000 7f040cff9640 1 -- 172.21.15.17:0/637027198 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f040008a140 con 0x7f0410101900 2024-09-20T18:39:26.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:26.234+0000 7f0415d05640 1 -- 172.21.15.17:0/637027198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0410109e70 con 0x7f0410101900 2024-09-20T18:39:26.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:26.235+0000 7f040cff9640 1 -- 172.21.15.17:0/637027198 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f040008eff0 con 0x7f0410101900 2024-09-20T18:39:26.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:26.237+0000 7f0415d05640 1 -- 172.21.15.17:0/637027198 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f03f807af30 msgr2=0x7f03f807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:26.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:26.237+0000 7f0415d05640 1 --2- 172.21.15.17:0/637027198 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f03f807af30 0x7f03f807d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0410075f80 tx=0x7f0404006c90 comp rx=0 tx=0).stop 2024-09-20T18:39:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:26.237+0000 7f0415d05640 1 -- 172.21.15.17:0/637027198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0410101900 msgr2=0x7f04100744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:26.237+0000 7f0415d05640 1 --2- 172.21.15.17:0/637027198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0410101900 0x7f04100744f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0400031460 tx=0x7f04000048f0 comp rx=0 tx=0).stop 2024-09-20T18:39:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:26.237+0000 7f0415d05640 1 -- 172.21.15.17:0/637027198 shutdown_connections 2024-09-20T18:39:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:26.237+0000 7f0415d05640 1 --2- 172.21.15.17:0/637027198 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f03f807af30 0x7f03f807d3f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:26.237+0000 7f0415d05640 1 --2- 172.21.15.17:0/637027198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0410107900 0x7f0410074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:26.237+0000 7f0415d05640 1 --2- 172.21.15.17:0/637027198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0410101900 0x7f04100744f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:26.237+0000 7f0415d05640 1 -- 172.21.15.17:0/637027198 >> 172.21.15.17:0/637027198 conn(0x7f04100fd600 msgr2=0x7f04100fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:26.237+0000 7f0415d05640 1 -- 172.21.15.17:0/637027198 shutdown_connections 2024-09-20T18:39:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:26.237+0000 7f0415d05640 1 -- 172.21.15.17:0/637027198 wait complete. 2024-09-20T18:39:26.261 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:39:26.622 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:26 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/637027198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:26.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:26 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/637027198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:26.990 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-20T18:39:27.251 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:39:27.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:27 smithi017 ceph-mon[28058]: pgmap v88: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:27.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:27 smithi172 ceph-mon[35456]: pgmap v88: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:27.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.743+0000 7ff52f7f8640 1 -- 172.21.15.17:0/434700517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff528100250 msgr2=0x7ff528100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:27.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.743+0000 7ff52f7f8640 1 --2- 172.21.15.17:0/434700517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff528100250 0x7ff528100630 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff524009880 tx=0x7ff52402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:39:27.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.743+0000 7ff52f7f8640 1 -- 172.21.15.17:0/434700517 shutdown_connections 2024-09-20T18:39:27.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.743+0000 7ff52f7f8640 1 --2- 172.21.15.17:0/434700517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff528100c00 0x7ff528104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.743+0000 7ff52f7f8640 1 --2- 172.21.15.17:0/434700517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff528100250 0x7ff528100630 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.743+0000 7ff52f7f8640 1 -- 172.21.15.17:0/434700517 >> 172.21.15.17:0/434700517 conn(0x7ff5280fbc90 msgr2=0x7ff5280fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.743+0000 7ff52f7f8640 1 -- 172.21.15.17:0/434700517 shutdown_connections 2024-09-20T18:39:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.743+0000 7ff52f7f8640 1 -- 172.21.15.17:0/434700517 wait complete. 2024-09-20T18:39:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.744+0000 7ff52f7f8640 1 Processor -- start 2024-09-20T18:39:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.744+0000 7ff52f7f8640 1 -- start start 2024-09-20T18:39:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.744+0000 7ff52f7f8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff528100250 0x7ff52819c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.744+0000 7ff52f7f8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff528100c00 0x7ff52819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.744+0000 7ff52f7f8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff52810d4d0 con 0x7ff528100c00 2024-09-20T18:39:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.744+0000 7ff52f7f8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff52810d350 con 0x7ff528100250 2024-09-20T18:39:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.744+0000 7ff52cd93640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff528100c00 0x7ff52819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.744+0000 7ff52cd93640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff528100c00 0x7ff52819cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54632/0 (socket says 172.21.15.17:54632) 2024-09-20T18:39:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.744+0000 7ff52cd93640 1 -- 172.21.15.17:0/871201095 learned_addr learned my addr 172.21.15.17:0/871201095 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.744+0000 7ff52d594640 1 --2- 172.21.15.17:0/871201095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff528100250 0x7ff52819c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.745+0000 7ff52cd93640 1 -- 172.21.15.17:0/871201095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff528100250 msgr2=0x7ff52819c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.745+0000 7ff52cd93640 1 --2- 172.21.15.17:0/871201095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff528100250 0x7ff52819c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.745+0000 7ff52cd93640 1 -- 172.21.15.17:0/871201095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff528196770 con 0x7ff528100c00 2024-09-20T18:39:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.745+0000 7ff52cd93640 1 --2- 172.21.15.17:0/871201095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff528100c00 0x7ff52819cbe0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00c8f0 tx=0x7ff51c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.745+0000 7ff51a7fc640 1 -- 172.21.15.17:0/871201095 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff51c0079b0 con 0x7ff528100c00 2024-09-20T18:39:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.745+0000 7ff52f7f8640 1 -- 172.21.15.17:0/871201095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff528196a60 con 0x7ff528100c00 2024-09-20T18:39:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.745+0000 7ff51a7fc640 1 -- 172.21.15.17:0/871201095 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff51c0054e0 con 0x7ff528100c00 2024-09-20T18:39:27.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.745+0000 7ff51a7fc640 1 -- 172.21.15.17:0/871201095 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff51c004dd0 con 0x7ff528100c00 2024-09-20T18:39:27.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.745+0000 7ff52f7f8640 1 -- 172.21.15.17:0/871201095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff528196fc0 con 0x7ff528100c00 2024-09-20T18:39:27.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.746+0000 7ff52f7f8640 1 -- 172.21.15.17:0/871201095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff528101730 con 0x7ff528100c00 2024-09-20T18:39:27.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.747+0000 7ff51a7fc640 1 -- 172.21.15.17:0/871201095 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff51c005020 con 0x7ff528100c00 2024-09-20T18:39:27.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.747+0000 7ff51a7fc640 1 --2- 172.21.15.17:0/871201095 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff51407aed0 0x7ff51407d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:27.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.748+0000 7ff51a7fc640 1 -- 172.21.15.17:0/871201095 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7ff51c09df20 con 0x7ff528100c00 2024-09-20T18:39:27.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.748+0000 7ff52d594640 1 --2- 172.21.15.17:0/871201095 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff51407aed0 0x7ff51407d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:27.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.748+0000 7ff52d594640 1 --2- 172.21.15.17:0/871201095 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff51407aed0 0x7ff51407d390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff524031460 tx=0x7ff524005bd0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:27.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:27.752+0000 7ff51a7fc640 1 -- 172.21.15.17:0/871201095 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ff51c014030 con 0x7ff528100c00 2024-09-20T18:39:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:28.011+0000 7ff52f7f8640 1 -- 172.21.15.17:0/871201095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff5281972d0 con 0x7ff528100c00 2024-09-20T18:39:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:28.012+0000 7ff51a7fc640 1 -- 172.21.15.17:0/871201095 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7ff51c0695d0 con 0x7ff528100c00 2024-09-20T18:39:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:28.014+0000 7ff52f7f8640 1 -- 172.21.15.17:0/871201095 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff51407aed0 msgr2=0x7ff51407d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:28.014+0000 7ff52f7f8640 1 --2- 172.21.15.17:0/871201095 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff51407aed0 0x7ff51407d390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff524031460 tx=0x7ff524005bd0 comp rx=0 tx=0).stop 2024-09-20T18:39:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:28.014+0000 7ff52f7f8640 1 -- 172.21.15.17:0/871201095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff528100c00 msgr2=0x7ff52819cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:28.014+0000 7ff52f7f8640 1 --2- 172.21.15.17:0/871201095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff528100c00 0x7ff52819cbe0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00c8f0 tx=0x7ff51c00cdb0 comp rx=0 tx=0).stop 2024-09-20T18:39:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:28.015+0000 7ff52f7f8640 1 -- 172.21.15.17:0/871201095 shutdown_connections 2024-09-20T18:39:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:28.015+0000 7ff52f7f8640 1 --2- 172.21.15.17:0/871201095 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff51407aed0 0x7ff51407d390 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:28.015+0000 7ff52f7f8640 1 --2- 172.21.15.17:0/871201095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff528100c00 0x7ff52819cbe0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:28.015+0000 7ff52f7f8640 1 --2- 172.21.15.17:0/871201095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff528100250 0x7ff52819c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:28.015+0000 7ff52f7f8640 1 -- 172.21.15.17:0/871201095 >> 172.21.15.17:0/871201095 conn(0x7ff5280fbc90 msgr2=0x7ff528103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:28.015+0000 7ff52f7f8640 1 -- 172.21.15.17:0/871201095 shutdown_connections 2024-09-20T18:39:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:28.015+0000 7ff52f7f8640 1 -- 172.21.15.17:0/871201095 wait complete. 2024-09-20T18:39:28.039 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)" 2024-09-20T18:39:28.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:28 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/871201095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:28.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:28 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/871201095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:28.716 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-20T18:39:28.972 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:39:29.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.435+0000 7f35a066b640 1 -- 172.21.15.17:0/333294826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598101900 msgr2=0x7f3598101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:29.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.435+0000 7f35a066b640 1 --2- 172.21.15.17:0/333294826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598101900 0x7f3598101d60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f358c009880 tx=0x7f358c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:39:29.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.435+0000 7f35a066b640 1 -- 172.21.15.17:0/333294826 shutdown_connections 2024-09-20T18:39:29.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.435+0000 7f35a066b640 1 --2- 172.21.15.17:0/333294826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598101900 0x7f3598101d60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:29.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.435+0000 7f35a066b640 1 --2- 172.21.15.17:0/333294826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3598107900 0x7f3598107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:29.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.435+0000 7f35a066b640 1 -- 172.21.15.17:0/333294826 >> 172.21.15.17:0/333294826 conn(0x7f35980fd600 msgr2=0x7f35980ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:29.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.435+0000 7f35a066b640 1 -- 172.21.15.17:0/333294826 shutdown_connections 2024-09-20T18:39:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.435+0000 7f35a066b640 1 -- 172.21.15.17:0/333294826 wait complete. 2024-09-20T18:39:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.435+0000 7f35a066b640 1 Processor -- start 2024-09-20T18:39:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.435+0000 7f35a066b640 1 -- start start 2024-09-20T18:39:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.436+0000 7f35a066b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3598101900 0x7f359819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.436+0000 7f35a066b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598107900 0x7f359819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.436+0000 7f35a066b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f359810ee30 con 0x7f3598107900 2024-09-20T18:39:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.436+0000 7f35a066b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f359810ecb0 con 0x7f3598101900 2024-09-20T18:39:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.436+0000 7f359dc06640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598107900 0x7f359819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.436+0000 7f359dc06640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598107900 0x7f359819dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54648/0 (socket says 172.21.15.17:54648) 2024-09-20T18:39:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.436+0000 7f359dc06640 1 -- 172.21.15.17:0/110783766 learned_addr learned my addr 172.21.15.17:0/110783766 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.436+0000 7f359e407640 1 --2- 172.21.15.17:0/110783766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3598101900 0x7f359819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.436+0000 7f359dc06640 1 -- 172.21.15.17:0/110783766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3598101900 msgr2=0x7f359819d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.436+0000 7f359dc06640 1 --2- 172.21.15.17:0/110783766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3598101900 0x7f359819d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.436+0000 7f359dc06640 1 -- 172.21.15.17:0/110783766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3598197840 con 0x7f3598107900 2024-09-20T18:39:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.436+0000 7f359dc06640 1 --2- 172.21.15.17:0/110783766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598107900 0x7f359819dc00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f358c031460 tx=0x7f358c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.436+0000 7f35977fe640 1 -- 172.21.15.17:0/110783766 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f358c03f070 con 0x7f3598107900 2024-09-20T18:39:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.437+0000 7f35a066b640 1 -- 172.21.15.17:0/110783766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3598197ad0 con 0x7f3598107900 2024-09-20T18:39:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.437+0000 7f35977fe640 1 -- 172.21.15.17:0/110783766 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f358c004cf0 con 0x7f3598107900 2024-09-20T18:39:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.437+0000 7f35977fe640 1 -- 172.21.15.17:0/110783766 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f358c035030 con 0x7f3598107900 2024-09-20T18:39:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.437+0000 7f35a066b640 1 -- 172.21.15.17:0/110783766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3598198000 con 0x7f3598107900 2024-09-20T18:39:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.438+0000 7f35a066b640 1 -- 172.21.15.17:0/110783766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3598103040 con 0x7f3598107900 2024-09-20T18:39:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.438+0000 7f35977fe640 1 -- 172.21.15.17:0/110783766 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f358c042070 con 0x7f3598107900 2024-09-20T18:39:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.439+0000 7f35977fe640 1 --2- 172.21.15.17:0/110783766 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f358007af30 0x7f358007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.439+0000 7f35977fe640 1 -- 172.21.15.17:0/110783766 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f358c0bea50 con 0x7f3598107900 2024-09-20T18:39:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.439+0000 7f359e407640 1 --2- 172.21.15.17:0/110783766 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f358007af30 0x7f358007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:29.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.439+0000 7f359e407640 1 --2- 172.21.15.17:0/110783766 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f358007af30 0x7f358007d3f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3588009f20 tx=0x7f35880094f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:29.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.444+0000 7f35977fe640 1 -- 172.21.15.17:0/110783766 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f358c08a100 con 0x7f3598107900 2024-09-20T18:39:29.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:29 smithi017 ceph-mon[28058]: pgmap v89: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:29.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:29 smithi172 ceph-mon[35456]: pgmap v89: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:29.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.711+0000 7f35a066b640 1 -- 172.21.15.17:0/110783766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3598109e90 con 0x7f3598107900 2024-09-20T18:39:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.712+0000 7f35977fe640 1 -- 172.21.15.17:0/110783766 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f358c08efb0 con 0x7f3598107900 2024-09-20T18:39:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.714+0000 7f35a066b640 1 -- 172.21.15.17:0/110783766 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f358007af30 msgr2=0x7f358007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.714+0000 7f35a066b640 1 --2- 172.21.15.17:0/110783766 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f358007af30 0x7f358007d3f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3588009f20 tx=0x7f35880094f0 comp rx=0 tx=0).stop 2024-09-20T18:39:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.714+0000 7f35a066b640 1 -- 172.21.15.17:0/110783766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598107900 msgr2=0x7f359819dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.714+0000 7f35a066b640 1 --2- 172.21.15.17:0/110783766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598107900 0x7f359819dc00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f358c031460 tx=0x7f358c0048f0 comp rx=0 tx=0).stop 2024-09-20T18:39:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.714+0000 7f35a066b640 1 -- 172.21.15.17:0/110783766 shutdown_connections 2024-09-20T18:39:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.714+0000 7f35a066b640 1 --2- 172.21.15.17:0/110783766 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f358007af30 0x7f358007d3f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.714+0000 7f35a066b640 1 --2- 172.21.15.17:0/110783766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3598107900 0x7f359819dc00 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.714+0000 7f35a066b640 1 --2- 172.21.15.17:0/110783766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3598101900 0x7f359819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.714+0000 7f35a066b640 1 -- 172.21.15.17:0/110783766 >> 172.21.15.17:0/110783766 conn(0x7f35980fd600 msgr2=0x7f35980fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.714+0000 7f35a066b640 1 -- 172.21.15.17:0/110783766 shutdown_connections 2024-09-20T18:39:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:29.714+0000 7f35a066b640 1 -- 172.21.15.17:0/110783766 wait complete. 2024-09-20T18:39:29.739 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:39:30.450 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-20T18:39:30.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:30 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/110783766' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:30.709 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:39:30.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:30 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/110783766' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:31.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.153+0000 7fa983331640 1 -- 172.21.15.17:0/2091883686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa97c107900 msgr2=0x7fa97c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:31.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.153+0000 7fa983331640 1 --2- 172.21.15.17:0/2091883686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa97c107900 0x7fa97c107ce0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa970009880 tx=0x7fa97002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:39:31.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.153+0000 7fa983331640 1 -- 172.21.15.17:0/2091883686 shutdown_connections 2024-09-20T18:39:31.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.153+0000 7fa983331640 1 --2- 172.21.15.17:0/2091883686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa97c101900 0x7fa97c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:31.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.153+0000 7fa983331640 1 --2- 172.21.15.17:0/2091883686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa97c107900 0x7fa97c107ce0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:31.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.153+0000 7fa983331640 1 -- 172.21.15.17:0/2091883686 >> 172.21.15.17:0/2091883686 conn(0x7fa97c0fd600 msgr2=0x7fa97c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.154+0000 7fa983331640 1 -- 172.21.15.17:0/2091883686 shutdown_connections 2024-09-20T18:39:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.154+0000 7fa983331640 1 -- 172.21.15.17:0/2091883686 wait complete. 2024-09-20T18:39:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.154+0000 7fa983331640 1 Processor -- start 2024-09-20T18:39:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.154+0000 7fa983331640 1 -- start start 2024-09-20T18:39:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.154+0000 7fa983331640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa97c101900 0x7fa97c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.154+0000 7fa983331640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa97c107900 0x7fa97c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.154+0000 7fa983331640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa97c10ee30 con 0x7fa97c101900 2024-09-20T18:39:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.154+0000 7fa983331640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa97c10ecb0 con 0x7fa97c107900 2024-09-20T18:39:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.155+0000 7fa9810cd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa97c101900 0x7fa97c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.155+0000 7fa9810cd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa97c101900 0x7fa97c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46860/0 (socket says 172.21.15.17:46860) 2024-09-20T18:39:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.155+0000 7fa9810cd640 1 -- 172.21.15.17:0/2240583675 learned_addr learned my addr 172.21.15.17:0/2240583675 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.155+0000 7fa9808cc640 1 --2- 172.21.15.17:0/2240583675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa97c107900 0x7fa97c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.155+0000 7fa9810cd640 1 -- 172.21.15.17:0/2240583675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa97c107900 msgr2=0x7fa97c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:31.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.155+0000 7fa9810cd640 1 --2- 172.21.15.17:0/2240583675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa97c107900 0x7fa97c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:31.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.155+0000 7fa9810cd640 1 -- 172.21.15.17:0/2240583675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97c074f70 con 0x7fa97c101900 2024-09-20T18:39:31.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.155+0000 7fa9810cd640 1 --2- 172.21.15.17:0/2240583675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa97c101900 0x7fa97c0744f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa970031460 tx=0x7fa9700048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:31.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.155+0000 7fa96e7fc640 1 -- 172.21.15.17:0/2240583675 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa97003f070 con 0x7fa97c101900 2024-09-20T18:39:31.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.155+0000 7fa96e7fc640 1 -- 172.21.15.17:0/2240583675 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa970004cf0 con 0x7fa97c101900 2024-09-20T18:39:31.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.155+0000 7fa983331640 1 -- 172.21.15.17:0/2240583675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa97c075200 con 0x7fa97c101900 2024-09-20T18:39:31.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.155+0000 7fa96e7fc640 1 -- 172.21.15.17:0/2240583675 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa970035030 con 0x7fa97c101900 2024-09-20T18:39:31.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.155+0000 7fa983331640 1 -- 172.21.15.17:0/2240583675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa97c1a3e20 con 0x7fa97c101900 2024-09-20T18:39:31.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.156+0000 7fa983331640 1 -- 172.21.15.17:0/2240583675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa97c103040 con 0x7fa97c101900 2024-09-20T18:39:31.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.157+0000 7fa96e7fc640 1 -- 172.21.15.17:0/2240583675 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa970042070 con 0x7fa97c101900 2024-09-20T18:39:31.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.158+0000 7fa96e7fc640 1 --2- 172.21.15.17:0/2240583675 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa96807af30 0x7fa96807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:31.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.158+0000 7fa96e7fc640 1 -- 172.21.15.17:0/2240583675 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7fa9700be9e0 con 0x7fa97c101900 2024-09-20T18:39:31.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.158+0000 7fa9808cc640 1 --2- 172.21.15.17:0/2240583675 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa96807af30 0x7fa96807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:31.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.158+0000 7fa9808cc640 1 --2- 172.21.15.17:0/2240583675 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa96807af30 0x7fa96807d3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa97c075f80 tx=0x7fa978009110 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:31.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.162+0000 7fa96e7fc640 1 -- 172.21.15.17:0/2240583675 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fa97008a090 con 0x7fa97c101900 2024-09-20T18:39:31.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:31.367+0000 7fa983331640 1 -- 172.21.15.17:0/2240583675 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "target": ["mon-mgr", ""]}) -- 0x7fa97c062630 con 0x7fa96807af30 2024-09-20T18:39:31.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:31 smithi017 ceph-mon[28058]: pgmap v90: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:31.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:31 smithi172 ceph-mon[35456]: pgmap v90: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:32.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:32 smithi017 ceph-mon[28058]: from='client.14902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:39:32.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:32 smithi172 ceph-mon[35456]: from='client.14902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:39:33.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:33 smithi017 ceph-mon[28058]: pgmap v91: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:33.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:33 smithi172 ceph-mon[35456]: pgmap v91: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:34.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:34.267+0000 7fa96e7fc640 1 -- 172.21.15.17:0/2240583675 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+5741 (secure 0 0 0) 0x7fa97c062630 con 0x7fa96807af30 2024-09-20T18:39:34.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:34.269+0000 7fa983331640 1 -- 172.21.15.17:0/2240583675 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa96807af30 msgr2=0x7fa96807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:34.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:34.269+0000 7fa983331640 1 --2- 172.21.15.17:0/2240583675 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa96807af30 0x7fa96807d3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa97c075f80 tx=0x7fa978009110 comp rx=0 tx=0).stop 2024-09-20T18:39:34.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:34.269+0000 7fa983331640 1 -- 172.21.15.17:0/2240583675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa97c101900 msgr2=0x7fa97c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:34.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:34.269+0000 7fa983331640 1 --2- 172.21.15.17:0/2240583675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa97c101900 0x7fa97c0744f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa970031460 tx=0x7fa9700048f0 comp rx=0 tx=0).stop 2024-09-20T18:39:34.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:34.269+0000 7fa983331640 1 -- 172.21.15.17:0/2240583675 shutdown_connections 2024-09-20T18:39:34.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:34.269+0000 7fa983331640 1 --2- 172.21.15.17:0/2240583675 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa96807af30 0x7fa96807d3f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:34.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:34.269+0000 7fa983331640 1 --2- 172.21.15.17:0/2240583675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa97c107900 0x7fa97c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:34.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:34.269+0000 7fa983331640 1 --2- 172.21.15.17:0/2240583675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa97c101900 0x7fa97c0744f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:34.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:34.269+0000 7fa983331640 1 -- 172.21.15.17:0/2240583675 >> 172.21.15.17:0/2240583675 conn(0x7fa97c0fd600 msgr2=0x7fa97c0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:34.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:34.270+0000 7fa983331640 1 -- 172.21.15.17:0/2240583675 shutdown_connections 2024-09-20T18:39:34.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:34.270+0000 7fa983331640 1 -- 172.21.15.17:0/2240583675 wait complete. 2024-09-20T18:39:34.295 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:39:34.929 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph orch ps' 2024-09-20T18:39:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:39:35.643 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:35 smithi017 ceph-mon[28058]: pgmap v92: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:35.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.626+0000 7f550c6a3640 1 -- 172.21.15.17:0/1519487140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55041033e0 msgr2=0x7f550410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:35.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.626+0000 7f550c6a3640 1 --2- 172.21.15.17:0/1519487140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55041033e0 0x7f550410b8d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009880 tx=0x7f54f402a530 comp rx=0 tx=0).stop 2024-09-20T18:39:35.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.627+0000 7f550c6a3640 1 -- 172.21.15.17:0/1519487140 shutdown_connections 2024-09-20T18:39:35.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.627+0000 7f550c6a3640 1 --2- 172.21.15.17:0/1519487140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55041033e0 0x7f550410b8d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:35.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.627+0000 7f550c6a3640 1 --2- 172.21.15.17:0/1519487140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5504102ac0 0x7f5504102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.627+0000 7f550c6a3640 1 -- 172.21.15.17:0/1519487140 >> 172.21.15.17:0/1519487140 conn(0x7f55040fc520 msgr2=0x7f55040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.627+0000 7f550c6a3640 1 -- 172.21.15.17:0/1519487140 shutdown_connections 2024-09-20T18:39:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.627+0000 7f550c6a3640 1 -- 172.21.15.17:0/1519487140 wait complete. 2024-09-20T18:39:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.627+0000 7f550c6a3640 1 Processor -- start 2024-09-20T18:39:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.627+0000 7f550c6a3640 1 -- start start 2024-09-20T18:39:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.628+0000 7f550c6a3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5504102ac0 0x7f550419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.628+0000 7f550c6a3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55041033e0 0x7f550419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.628+0000 7f550c6a3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f550410ee50 con 0x7f5504102ac0 2024-09-20T18:39:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.628+0000 7f550c6a3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f550410ecd0 con 0x7f55041033e0 2024-09-20T18:39:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.628+0000 7f550a43f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5504102ac0 0x7f550419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.628+0000 7f550a43f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5504102ac0 0x7f550419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46878/0 (socket says 172.21.15.17:46878) 2024-09-20T18:39:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.628+0000 7f550a43f640 1 -- 172.21.15.17:0/3293049431 learned_addr learned my addr 172.21.15.17:0/3293049431 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.628+0000 7f5509c3e640 1 --2- 172.21.15.17:0/3293049431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55041033e0 0x7f550419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.628+0000 7f550a43f640 1 -- 172.21.15.17:0/3293049431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55041033e0 msgr2=0x7f550419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.628+0000 7f550a43f640 1 --2- 172.21.15.17:0/3293049431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55041033e0 0x7f550419dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.628+0000 7f550a43f640 1 -- 172.21.15.17:0/3293049431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5504197840 con 0x7f5504102ac0 2024-09-20T18:39:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.628+0000 7f5509c3e640 1 --2- 172.21.15.17:0/3293049431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55041033e0 0x7f550419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:39:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.628+0000 7f550a43f640 1 --2- 172.21.15.17:0/3293049431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5504102ac0 0x7f550419d6c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f550000b420 tx=0x7f550000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.629+0000 7f54fb7fe640 1 -- 172.21.15.17:0/3293049431 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5500011630 con 0x7f5504102ac0 2024-09-20T18:39:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.629+0000 7f550c6a3640 1 -- 172.21.15.17:0/3293049431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5504197b30 con 0x7f5504102ac0 2024-09-20T18:39:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.629+0000 7f54fb7fe640 1 -- 172.21.15.17:0/3293049431 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5500016070 con 0x7f5504102ac0 2024-09-20T18:39:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.629+0000 7f54fb7fe640 1 -- 172.21.15.17:0/3293049431 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5500010d40 con 0x7f5504102ac0 2024-09-20T18:39:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.629+0000 7f550c6a3640 1 -- 172.21.15.17:0/3293049431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5504198090 con 0x7f5504102ac0 2024-09-20T18:39:35.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.630+0000 7f550c6a3640 1 -- 172.21.15.17:0/3293049431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f550406aa90 con 0x7f5504102ac0 2024-09-20T18:39:35.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.631+0000 7f54fb7fe640 1 -- 172.21.15.17:0/3293049431 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f550001b460 con 0x7f5504102ac0 2024-09-20T18:39:35.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.631+0000 7f54fb7fe640 1 --2- 172.21.15.17:0/3293049431 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f54f007af30 0x7f54f007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:35.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.631+0000 7f54fb7fe640 1 -- 172.21.15.17:0/3293049431 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f550009d690 con 0x7f5504102ac0 2024-09-20T18:39:35.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.631+0000 7f5509c3e640 1 --2- 172.21.15.17:0/3293049431 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f54f007af30 0x7f54f007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:35.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.632+0000 7f5509c3e640 1 --2- 172.21.15.17:0/3293049431 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f54f007af30 0x7f54f007d3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5504198b90 tx=0x7f54f4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:35.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.636+0000 7f54fb7fe640 1 -- 172.21.15.17:0/3293049431 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f5500021250 con 0x7f5504102ac0 2024-09-20T18:39:35.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:35 smithi172 ceph-mon[35456]: pgmap v92: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:35.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.830+0000 7f550c6a3640 1 -- 172.21.15.17:0/3293049431 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f55041983a0 con 0x7f54f007af30 2024-09-20T18:39:35.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.840+0000 7f54fb7fe640 1 -- 172.21.15.17:0/3293049431 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f55041983a0 con 0x7f54f007af30 2024-09-20T18:39:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:39:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (55s) 26s ago 11m 18.4M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:39:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (4m) 26s ago 12m 8816k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:39:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (3m) 97s ago 11m 8451k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:39:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (12m) 26s ago 12m 6895k - 19.1.1-369-ged8ee0f2 6acb0a031eab 725c8bcc6ec8 2024-09-20T18:39:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (11m) 97s ago 11m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab e10dd613dbe2 2024-09-20T18:39:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (32s) 26s ago 11m 48.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:39:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (6m) 26s ago 6m 150M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:39:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (6m) 26s ago 6m 95.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:39:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (6m) 97s ago 6m 26.7M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:39:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (6m) 97s ago 6m 26.5M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:39:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (3m) 26s ago 13m 521M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:39:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (2m) 97s ago 11m 455M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:39:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (13m) 26s ago 13m 59.2M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab ab1f988c4cb2 2024-09-20T18:39:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (11m) 97s ago 11m 48.8M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 9eea40352787 2024-09-20T18:39:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (106s) 26s ago 12m 11.9M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:39:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (100s) 97s ago 11m 3301k - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:39:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (9m) 26s ago 9m 204M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab c1207e514216 2024-09-20T18:39:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (9m) 26s ago 9m 224M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 73f2fd77590f 2024-09-20T18:39:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (8m) 26s ago 8m 208M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 6f0b9405dc18 2024-09-20T18:39:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (8m) 97s ago 8m 260M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:39:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (8m) 97s ago 8m 206M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:39:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (7m) 97s ago 7m 188M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:39:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (76s) 26s ago 11m 46.5M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:39:35.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.842+0000 7f550c6a3640 1 -- 172.21.15.17:0/3293049431 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f54f007af30 msgr2=0x7f54f007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:35.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.842+0000 7f550c6a3640 1 --2- 172.21.15.17:0/3293049431 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f54f007af30 0x7f54f007d3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5504198b90 tx=0x7f54f4031400 comp rx=0 tx=0).stop 2024-09-20T18:39:35.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.842+0000 7f550c6a3640 1 -- 172.21.15.17:0/3293049431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5504102ac0 msgr2=0x7f550419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:35.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.842+0000 7f550c6a3640 1 --2- 172.21.15.17:0/3293049431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5504102ac0 0x7f550419d6c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f550000b420 tx=0x7f550000b8e0 comp rx=0 tx=0).stop 2024-09-20T18:39:35.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.842+0000 7f550c6a3640 1 -- 172.21.15.17:0/3293049431 shutdown_connections 2024-09-20T18:39:35.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.842+0000 7f550c6a3640 1 --2- 172.21.15.17:0/3293049431 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f54f007af30 0x7f54f007d3f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:35.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.842+0000 7f550c6a3640 1 --2- 172.21.15.17:0/3293049431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55041033e0 0x7f550419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:35.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.842+0000 7f550c6a3640 1 --2- 172.21.15.17:0/3293049431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5504102ac0 0x7f550419d6c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:35.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.842+0000 7f550c6a3640 1 -- 172.21.15.17:0/3293049431 >> 172.21.15.17:0/3293049431 conn(0x7f55040fc520 msgr2=0x7f5504108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:35.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.842+0000 7f550c6a3640 1 -- 172.21.15.17:0/3293049431 shutdown_connections 2024-09-20T18:39:35.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:35.842+0000 7f550c6a3640 1 -- 172.21.15.17:0/3293049431 wait complete. 2024-09-20T18:39:36.541 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-20T18:39:36.542 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-20T18:39:36.543 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-20T18:39:36.814 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:39:37.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.272+0000 7f377d213640 1 -- 172.21.15.17:0/2697563691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37781033d0 msgr2=0x7f377810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:37.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.272+0000 7f377d213640 1 --2- 172.21.15.17:0/2697563691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37781033d0 0x7f377810b8c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f376c009880 tx=0x7f376c02a530 comp rx=0 tx=0).stop 2024-09-20T18:39:37.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.272+0000 7f377d213640 1 -- 172.21.15.17:0/2697563691 shutdown_connections 2024-09-20T18:39:37.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.272+0000 7f377d213640 1 --2- 172.21.15.17:0/2697563691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37781033d0 0x7f377810b8c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:37.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.272+0000 7f377d213640 1 --2- 172.21.15.17:0/2697563691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3778102ab0 0x7f3778102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:37.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.272+0000 7f377d213640 1 -- 172.21.15.17:0/2697563691 >> 172.21.15.17:0/2697563691 conn(0x7f37780fc4d0 msgr2=0x7f37780fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:37.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.272+0000 7f377d213640 1 -- 172.21.15.17:0/2697563691 shutdown_connections 2024-09-20T18:39:37.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.272+0000 7f377d213640 1 -- 172.21.15.17:0/2697563691 wait complete. 2024-09-20T18:39:37.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.273+0000 7f377d213640 1 Processor -- start 2024-09-20T18:39:37.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.273+0000 7f377d213640 1 -- start start 2024-09-20T18:39:37.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.273+0000 7f377d213640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3778102ab0 0x7f377819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:37.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.273+0000 7f377d213640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37781033d0 0x7f377819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:37.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.273+0000 7f377d213640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f377810ee40 con 0x7f3778102ab0 2024-09-20T18:39:37.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.273+0000 7f377d213640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f377810ecc0 con 0x7f37781033d0 2024-09-20T18:39:37.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.274+0000 7f3776d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3778102ab0 0x7f377819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:37.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.274+0000 7f3776d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3778102ab0 0x7f377819d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46884/0 (socket says 172.21.15.17:46884) 2024-09-20T18:39:37.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.274+0000 7f3776d9d640 1 -- 172.21.15.17:0/1316111322 learned_addr learned my addr 172.21.15.17:0/1316111322 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:37.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.274+0000 7f377659c640 1 --2- 172.21.15.17:0/1316111322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37781033d0 0x7f377819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:37.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.274+0000 7f3776d9d640 1 -- 172.21.15.17:0/1316111322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37781033d0 msgr2=0x7f377819dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:37.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.274+0000 7f3776d9d640 1 --2- 172.21.15.17:0/1316111322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37781033d0 0x7f377819dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:37.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.274+0000 7f3776d9d640 1 -- 172.21.15.17:0/1316111322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3778197850 con 0x7f3778102ab0 2024-09-20T18:39:37.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.274+0000 7f377659c640 1 --2- 172.21.15.17:0/1316111322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37781033d0 0x7f377819dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:39:37.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.274+0000 7f3776d9d640 1 --2- 172.21.15.17:0/1316111322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3778102ab0 0x7f377819d6d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f376800b420 tx=0x7f376800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:37.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.274+0000 7f375ffff640 1 -- 172.21.15.17:0/1316111322 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3768011630 con 0x7f3778102ab0 2024-09-20T18:39:37.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.274+0000 7f375ffff640 1 -- 172.21.15.17:0/1316111322 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3768016070 con 0x7f3778102ab0 2024-09-20T18:39:37.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.274+0000 7f375ffff640 1 -- 172.21.15.17:0/1316111322 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3768010d40 con 0x7f3778102ab0 2024-09-20T18:39:37.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.274+0000 7f377d213640 1 -- 172.21.15.17:0/1316111322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3778197b40 con 0x7f3778102ab0 2024-09-20T18:39:37.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.275+0000 7f377d213640 1 -- 172.21.15.17:0/1316111322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37781980d0 con 0x7f3778102ab0 2024-09-20T18:39:37.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.276+0000 7f377d213640 1 -- 172.21.15.17:0/1316111322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f377806ada0 con 0x7f3778102ab0 2024-09-20T18:39:37.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.277+0000 7f375ffff640 1 -- 172.21.15.17:0/1316111322 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f376801b460 con 0x7f3778102ab0 2024-09-20T18:39:37.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.277+0000 7f375ffff640 1 --2- 172.21.15.17:0/1316111322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f376007f340 0x7f3760081800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:37.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.277+0000 7f377659c640 1 --2- 172.21.15.17:0/1316111322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f376007f340 0x7f3760081800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:37.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.277+0000 7f375ffff640 1 -- 172.21.15.17:0/1316111322 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f376809d700 con 0x7f3778102ab0 2024-09-20T18:39:37.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.278+0000 7f377659c640 1 --2- 172.21.15.17:0/1316111322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f376007f340 0x7f3760081800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f376c031460 tx=0x7f376c0095f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:37.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.282+0000 7f375ffff640 1 -- 172.21.15.17:0/1316111322 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f3768021250 con 0x7f3778102ab0 2024-09-20T18:39:37.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.474+0000 7f377d213640 1 -- 172.21.15.17:0/1316111322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) -- 0x7f3778105f50 con 0x7f3778102ab0 2024-09-20T18:39:37.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.478+0000 7f375ffff640 1 -- 172.21.15.17:0/1316111322 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v66)=0 v66) ==== 125+0+0 (secure 0 0 0) 0x7f3768068db0 con 0x7f3778102ab0 2024-09-20T18:39:37.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.481+0000 7f377d213640 1 -- 172.21.15.17:0/1316111322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f376007f340 msgr2=0x7f3760081800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:37.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.481+0000 7f377d213640 1 --2- 172.21.15.17:0/1316111322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f376007f340 0x7f3760081800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f376c031460 tx=0x7f376c0095f0 comp rx=0 tx=0).stop 2024-09-20T18:39:37.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.481+0000 7f377d213640 1 -- 172.21.15.17:0/1316111322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3778102ab0 msgr2=0x7f377819d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:37.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.481+0000 7f377d213640 1 --2- 172.21.15.17:0/1316111322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3778102ab0 0x7f377819d6d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f376800b420 tx=0x7f376800b8e0 comp rx=0 tx=0).stop 2024-09-20T18:39:37.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.481+0000 7f377d213640 1 -- 172.21.15.17:0/1316111322 shutdown_connections 2024-09-20T18:39:37.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.481+0000 7f377d213640 1 --2- 172.21.15.17:0/1316111322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f376007f340 0x7f3760081800 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:37.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.481+0000 7f377d213640 1 --2- 172.21.15.17:0/1316111322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37781033d0 0x7f377819dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:37.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.481+0000 7f377d213640 1 --2- 172.21.15.17:0/1316111322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3778102ab0 0x7f377819d6d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:37.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.481+0000 7f377d213640 1 -- 172.21.15.17:0/1316111322 >> 172.21.15.17:0/1316111322 conn(0x7f37780fc4d0 msgr2=0x7f3778108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:37.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.481+0000 7f377d213640 1 -- 172.21.15.17:0/1316111322 shutdown_connections 2024-09-20T18:39:37.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:37.481+0000 7f377d213640 1 -- 172.21.15.17:0/1316111322 wait complete. 2024-09-20T18:39:37.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:37 smithi017 ceph-mon[28058]: from='client.14906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:39:37.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:37 smithi017 ceph-mon[28058]: pgmap v93: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:37.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:37 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:39:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:37 smithi172 ceph-mon[35456]: from='client.14906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:39:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:37 smithi172 ceph-mon[35456]: pgmap v93: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:37.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:37 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:39:38.191 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-20T18:39:38.191 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-20T18:39:38.191 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-20T18:39:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:39:38.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:38 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/1316111322' entity='client.admin' 2024-09-20T18:39:38.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:38 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:39:38.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:38 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:39:38.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:38 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:39:38.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:38 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:38.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:38 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T18:39:38.842 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:38 smithi017 ceph-mon[28058]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T18:39:38.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.913+0000 7fd189007640 1 -- 172.21.15.17:0/3456964952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd184107900 msgr2=0x7fd184107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:38.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.913+0000 7fd189007640 1 --2- 172.21.15.17:0/3456964952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd184107900 0x7fd184107ce0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd174009880 tx=0x7fd17402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:39:38.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.913+0000 7fd189007640 1 -- 172.21.15.17:0/3456964952 shutdown_connections 2024-09-20T18:39:38.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.913+0000 7fd189007640 1 --2- 172.21.15.17:0/3456964952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd184101900 0x7fd184101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:38.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.913+0000 7fd189007640 1 --2- 172.21.15.17:0/3456964952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd184107900 0x7fd184107ce0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:38.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.913+0000 7fd189007640 1 -- 172.21.15.17:0/3456964952 >> 172.21.15.17:0/3456964952 conn(0x7fd1840fd600 msgr2=0x7fd1840ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:38.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.913+0000 7fd189007640 1 -- 172.21.15.17:0/3456964952 shutdown_connections 2024-09-20T18:39:38.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.913+0000 7fd189007640 1 -- 172.21.15.17:0/3456964952 wait complete. 2024-09-20T18:39:38.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.914+0000 7fd189007640 1 Processor -- start 2024-09-20T18:39:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.914+0000 7fd189007640 1 -- start start 2024-09-20T18:39:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.915+0000 7fd189007640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd184101900 0x7fd18419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.915+0000 7fd189007640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd184107900 0x7fd18419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.915+0000 7fd189007640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd18410edb0 con 0x7fd184107900 2024-09-20T18:39:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.915+0000 7fd189007640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd18410ec30 con 0x7fd184101900 2024-09-20T18:39:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.915+0000 7fd18259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd184107900 0x7fd18419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.915+0000 7fd18259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd184107900 0x7fd18419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46908/0 (socket says 172.21.15.17:46908) 2024-09-20T18:39:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.915+0000 7fd18259c640 1 -- 172.21.15.17:0/2851976404 learned_addr learned my addr 172.21.15.17:0/2851976404 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.915+0000 7fd182d9d640 1 --2- 172.21.15.17:0/2851976404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd184101900 0x7fd18419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.915+0000 7fd18259c640 1 -- 172.21.15.17:0/2851976404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd184101900 msgr2=0x7fd18419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:38.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.915+0000 7fd18259c640 1 --2- 172.21.15.17:0/2851976404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd184101900 0x7fd18419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:38.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.915+0000 7fd18259c640 1 -- 172.21.15.17:0/2851976404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1841977d0 con 0x7fd184107900 2024-09-20T18:39:38.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.915+0000 7fd18259c640 1 --2- 172.21.15.17:0/2851976404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd184107900 0x7fd18419db90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00c810 tx=0x7fd16c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:38.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.915+0000 7fd17bfff640 1 -- 172.21.15.17:0/2851976404 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd16c004020 con 0x7fd184107900 2024-09-20T18:39:38.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.916+0000 7fd17bfff640 1 -- 172.21.15.17:0/2851976404 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd16c0041c0 con 0x7fd184107900 2024-09-20T18:39:38.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.916+0000 7fd189007640 1 -- 172.21.15.17:0/2851976404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd184197ac0 con 0x7fd184107900 2024-09-20T18:39:38.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.916+0000 7fd17bfff640 1 -- 172.21.15.17:0/2851976404 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd16c0047a0 con 0x7fd184107900 2024-09-20T18:39:38.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.916+0000 7fd189007640 1 -- 172.21.15.17:0/2851976404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd184198050 con 0x7fd184107900 2024-09-20T18:39:38.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.917+0000 7fd189007640 1 -- 172.21.15.17:0/2851976404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd184103040 con 0x7fd184107900 2024-09-20T18:39:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.917+0000 7fd17bfff640 1 -- 172.21.15.17:0/2851976404 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd16c0079b0 con 0x7fd184107900 2024-09-20T18:39:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.918+0000 7fd17bfff640 1 --2- 172.21.15.17:0/2851976404 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd17007af80 0x7fd17007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.918+0000 7fd17bfff640 1 -- 172.21.15.17:0/2851976404 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7fd16c09dda0 con 0x7fd184107900 2024-09-20T18:39:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.918+0000 7fd182d9d640 1 --2- 172.21.15.17:0/2851976404 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd17007af80 0x7fd17007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:38.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.919+0000 7fd182d9d640 1 --2- 172.21.15.17:0/2851976404 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd17007af80 0x7fd17007d440 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd174000c00 tx=0x7fd174031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:38.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:38.923+0000 7fd17bfff640 1 -- 172.21.15.17:0/2851976404 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fd16c014030 con 0x7fd184107900 2024-09-20T18:39:38.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:38 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/1316111322' entity='client.admin' 2024-09-20T18:39:38.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:38 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:39:38.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:38 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:39:38.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:38 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:39:38.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:38 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:38.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:38 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T18:39:38.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:38 smithi172 ceph-mon[35456]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T18:39:39.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:39.108+0000 7fd189007640 1 -- 172.21.15.17:0/2851976404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7fd184104b10 con 0x7fd184107900 2024-09-20T18:39:39.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:39.108+0000 7fd17bfff640 1 -- 172.21.15.17:0/2851976404 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v66)=0 v66) ==== 155+0+0 (secure 0 0 0) 0x7fd16c069450 con 0x7fd184107900 2024-09-20T18:39:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:39.110+0000 7fd189007640 1 -- 172.21.15.17:0/2851976404 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd17007af80 msgr2=0x7fd17007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:39.110+0000 7fd189007640 1 --2- 172.21.15.17:0/2851976404 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd17007af80 0x7fd17007d440 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd174000c00 tx=0x7fd174031400 comp rx=0 tx=0).stop 2024-09-20T18:39:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:39.110+0000 7fd189007640 1 -- 172.21.15.17:0/2851976404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd184107900 msgr2=0x7fd18419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:39.110+0000 7fd189007640 1 --2- 172.21.15.17:0/2851976404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd184107900 0x7fd18419db90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00c810 tx=0x7fd16c00ccd0 comp rx=0 tx=0).stop 2024-09-20T18:39:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:39.110+0000 7fd189007640 1 -- 172.21.15.17:0/2851976404 shutdown_connections 2024-09-20T18:39:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:39.110+0000 7fd189007640 1 --2- 172.21.15.17:0/2851976404 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd17007af80 0x7fd17007d440 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:39.110+0000 7fd189007640 1 --2- 172.21.15.17:0/2851976404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd184107900 0x7fd18419db90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:39.110+0000 7fd189007640 1 --2- 172.21.15.17:0/2851976404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd184101900 0x7fd18419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:39.110+0000 7fd189007640 1 -- 172.21.15.17:0/2851976404 >> 172.21.15.17:0/2851976404 conn(0x7fd1840fd600 msgr2=0x7fd1840feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:39.111+0000 7fd189007640 1 -- 172.21.15.17:0/2851976404 shutdown_connections 2024-09-20T18:39:39.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:39.111+0000 7fd189007640 1 -- 172.21.15.17:0/2851976404 wait complete. 2024-09-20T18:39:39.845 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:39 smithi017 ceph-mon[28058]: pgmap v94: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:39.880 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-20T18:39:39.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:39 smithi172 ceph-mon[35456]: pgmap v94: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:39:40.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.639+0000 7f9c67dca640 1 -- 172.21.15.17:0/2201724917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c60107900 msgr2=0x7f9c60107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:40.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.639+0000 7f9c67dca640 1 --2- 172.21.15.17:0/2201724917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c60107900 0x7f9c60107ce0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009880 tx=0x7f9c5c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:39:40.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.639+0000 7f9c67dca640 1 -- 172.21.15.17:0/2201724917 shutdown_connections 2024-09-20T18:39:40.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.639+0000 7f9c67dca640 1 --2- 172.21.15.17:0/2201724917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c60101900 0x7f9c60101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:40.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.639+0000 7f9c67dca640 1 --2- 172.21.15.17:0/2201724917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c60107900 0x7f9c60107ce0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:40.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.639+0000 7f9c67dca640 1 -- 172.21.15.17:0/2201724917 >> 172.21.15.17:0/2201724917 conn(0x7f9c600fd600 msgr2=0x7f9c600ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:40.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.639+0000 7f9c67dca640 1 -- 172.21.15.17:0/2201724917 shutdown_connections 2024-09-20T18:39:40.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.639+0000 7f9c67dca640 1 -- 172.21.15.17:0/2201724917 wait complete. 2024-09-20T18:39:40.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.640+0000 7f9c67dca640 1 Processor -- start 2024-09-20T18:39:40.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.640+0000 7f9c67dca640 1 -- start start 2024-09-20T18:39:40.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.640+0000 7f9c67dca640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c60101900 0x7f9c600744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:40.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.640+0000 7f9c67dca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c60107900 0x7f9c60074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:40.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.640+0000 7f9c67dca640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6010ee30 con 0x7f9c60107900 2024-09-20T18:39:40.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.640+0000 7f9c67dca640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6010ecb0 con 0x7f9c60101900 2024-09-20T18:39:40.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.640+0000 7f9c65365640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c60107900 0x7f9c60074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:40.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.640+0000 7f9c65365640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c60107900 0x7f9c60074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34684/0 (socket says 172.21.15.17:34684) 2024-09-20T18:39:40.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.640+0000 7f9c65365640 1 -- 172.21.15.17:0/2952841882 learned_addr learned my addr 172.21.15.17:0/2952841882 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:40.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.640+0000 7f9c65365640 1 -- 172.21.15.17:0/2952841882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c60101900 msgr2=0x7f9c600744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:40.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.640+0000 7f9c65b66640 1 --2- 172.21.15.17:0/2952841882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c60101900 0x7f9c600744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:40.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.640+0000 7f9c65365640 1 --2- 172.21.15.17:0/2952841882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c60101900 0x7f9c600744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:40.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.640+0000 7f9c65365640 1 -- 172.21.15.17:0/2952841882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c60074f70 con 0x7f9c60107900 2024-09-20T18:39:40.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.640+0000 7f9c65b66640 1 --2- 172.21.15.17:0/2952841882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c60101900 0x7f9c600744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:39:40.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.641+0000 7f9c65365640 1 --2- 172.21.15.17:0/2952841882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c60107900 0x7f9c60074a30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000b420 tx=0x7f9c5000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:40.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.641+0000 7f9c56ffd640 1 -- 172.21.15.17:0/2952841882 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c50011630 con 0x7f9c60107900 2024-09-20T18:39:40.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.641+0000 7f9c67dca640 1 -- 172.21.15.17:0/2952841882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c60075260 con 0x7f9c60107900 2024-09-20T18:39:40.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.641+0000 7f9c56ffd640 1 -- 172.21.15.17:0/2952841882 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9c50016070 con 0x7f9c60107900 2024-09-20T18:39:40.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.641+0000 7f9c56ffd640 1 -- 172.21.15.17:0/2952841882 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c50010d40 con 0x7f9c60107900 2024-09-20T18:39:40.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.641+0000 7f9c67dca640 1 -- 172.21.15.17:0/2952841882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c601a3ec0 con 0x7f9c60107900 2024-09-20T18:39:40.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.642+0000 7f9c67dca640 1 -- 172.21.15.17:0/2952841882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c60103040 con 0x7f9c60107900 2024-09-20T18:39:40.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.643+0000 7f9c56ffd640 1 -- 172.21.15.17:0/2952841882 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9c5001b460 con 0x7f9c60107900 2024-09-20T18:39:40.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.643+0000 7f9c56ffd640 1 --2- 172.21.15.17:0/2952841882 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9c4c07af30 0x7f9c4c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:40.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.643+0000 7f9c56ffd640 1 -- 172.21.15.17:0/2952841882 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f9c5009d720 con 0x7f9c60107900 2024-09-20T18:39:40.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.643+0000 7f9c65b66640 1 --2- 172.21.15.17:0/2952841882 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9c4c07af30 0x7f9c4c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:40.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.644+0000 7f9c65b66640 1 --2- 172.21.15.17:0/2952841882 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9c4c07af30 0x7f9c4c07d3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c006010 tx=0x7f9c5c0095f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:40.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.648+0000 7f9c56ffd640 1 -- 172.21.15.17:0/2952841882 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f9c50021250 con 0x7f9c60107900 2024-09-20T18:39:40.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.834+0000 7f9c67dca640 1 -- 172.21.15.17:0/2952841882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7f9c60109e70 con 0x7f9c60107900 2024-09-20T18:39:40.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.834+0000 7f9c56ffd640 1 -- 172.21.15.17:0/2952841882 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v66)=0 v66) ==== 163+0+0 (secure 0 0 0) 0x7f9c50068dd0 con 0x7f9c60107900 2024-09-20T18:39:40.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.837+0000 7f9c67dca640 1 -- 172.21.15.17:0/2952841882 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9c4c07af30 msgr2=0x7f9c4c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:40.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.837+0000 7f9c67dca640 1 --2- 172.21.15.17:0/2952841882 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9c4c07af30 0x7f9c4c07d3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c006010 tx=0x7f9c5c0095f0 comp rx=0 tx=0).stop 2024-09-20T18:39:40.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.837+0000 7f9c67dca640 1 -- 172.21.15.17:0/2952841882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c60107900 msgr2=0x7f9c60074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:40.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.837+0000 7f9c67dca640 1 --2- 172.21.15.17:0/2952841882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c60107900 0x7f9c60074a30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000b420 tx=0x7f9c5000b8e0 comp rx=0 tx=0).stop 2024-09-20T18:39:40.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.837+0000 7f9c67dca640 1 -- 172.21.15.17:0/2952841882 shutdown_connections 2024-09-20T18:39:40.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.837+0000 7f9c67dca640 1 --2- 172.21.15.17:0/2952841882 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9c4c07af30 0x7f9c4c07d3f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:40.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.837+0000 7f9c67dca640 1 --2- 172.21.15.17:0/2952841882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c60107900 0x7f9c60074a30 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:40.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.837+0000 7f9c67dca640 1 --2- 172.21.15.17:0/2952841882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c60101900 0x7f9c600744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:40.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.837+0000 7f9c67dca640 1 -- 172.21.15.17:0/2952841882 >> 172.21.15.17:0/2952841882 conn(0x7f9c600fd600 msgr2=0x7f9c600fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:40.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.837+0000 7f9c67dca640 1 -- 172.21.15.17:0/2952841882 shutdown_connections 2024-09-20T18:39:40.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:40.837+0000 7f9c67dca640 1 -- 172.21.15.17:0/2952841882 wait complete. 2024-09-20T18:39:41.508 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-20T18:39:41.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:41 smithi017 ceph-mon[28058]: pgmap v95: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:41.769 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:39:41.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:41 smithi172 ceph-mon[35456]: pgmap v95: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:42.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.226+0000 7f2726146640 1 -- 172.21.15.17:0/1813555080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2720107900 msgr2=0x7f2720107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:42.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.226+0000 7f2726146640 1 --2- 172.21.15.17:0/1813555080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2720107900 0x7f2720107ce0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2710009880 tx=0x7f271002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:39:42.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.226+0000 7f2726146640 1 -- 172.21.15.17:0/1813555080 shutdown_connections 2024-09-20T18:39:42.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.226+0000 7f2726146640 1 --2- 172.21.15.17:0/1813555080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2720101900 0x7f2720101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:42.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.226+0000 7f2726146640 1 --2- 172.21.15.17:0/1813555080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2720107900 0x7f2720107ce0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:42.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.226+0000 7f2726146640 1 -- 172.21.15.17:0/1813555080 >> 172.21.15.17:0/1813555080 conn(0x7f27200fd600 msgr2=0x7f27200ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:42.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.227+0000 7f2726146640 1 -- 172.21.15.17:0/1813555080 shutdown_connections 2024-09-20T18:39:42.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.227+0000 7f2726146640 1 -- 172.21.15.17:0/1813555080 wait complete. 2024-09-20T18:39:42.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.227+0000 7f2726146640 1 Processor -- start 2024-09-20T18:39:42.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.227+0000 7f2726146640 1 -- start start 2024-09-20T18:39:42.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.227+0000 7f2726146640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2720101900 0x7f272019f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:42.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.228+0000 7f2726146640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2720107900 0x7f272019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:42.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.228+0000 7f2726146640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f272010edb0 con 0x7f2720101900 2024-09-20T18:39:42.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.228+0000 7f2726146640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f272010ec30 con 0x7f2720107900 2024-09-20T18:39:42.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.228+0000 7f271f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2720101900 0x7f272019f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:42.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.228+0000 7f271f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2720101900 0x7f272019f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34712/0 (socket says 172.21.15.17:34712) 2024-09-20T18:39:42.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.228+0000 7f271f7fe640 1 -- 172.21.15.17:0/17625114 learned_addr learned my addr 172.21.15.17:0/17625114 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:42.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.228+0000 7f271effd640 1 --2- 172.21.15.17:0/17625114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2720107900 0x7f272019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:42.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.228+0000 7f271f7fe640 1 -- 172.21.15.17:0/17625114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2720107900 msgr2=0x7f272019fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:42.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.228+0000 7f271f7fe640 1 --2- 172.21.15.17:0/17625114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2720107900 0x7f272019fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:42.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.228+0000 7f271f7fe640 1 -- 172.21.15.17:0/17625114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2720199a10 con 0x7f2720101900 2024-09-20T18:39:42.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.228+0000 7f271f7fe640 1 --2- 172.21.15.17:0/17625114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2720101900 0x7f272019f850 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2710031460 tx=0x7f27100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:42.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.228+0000 7f271cff9640 1 -- 172.21.15.17:0/17625114 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f271003f070 con 0x7f2720101900 2024-09-20T18:39:42.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.228+0000 7f271cff9640 1 -- 172.21.15.17:0/17625114 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2710004cf0 con 0x7f2720101900 2024-09-20T18:39:42.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.228+0000 7f2726146640 1 -- 172.21.15.17:0/17625114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2720199ca0 con 0x7f2720101900 2024-09-20T18:39:42.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.228+0000 7f271cff9640 1 -- 172.21.15.17:0/17625114 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2710035030 con 0x7f2720101900 2024-09-20T18:39:42.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.228+0000 7f2726146640 1 -- 172.21.15.17:0/17625114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f272019a1d0 con 0x7f2720101900 2024-09-20T18:39:42.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.229+0000 7f2726146640 1 -- 172.21.15.17:0/17625114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2720103040 con 0x7f2720101900 2024-09-20T18:39:42.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.230+0000 7f271cff9640 1 -- 172.21.15.17:0/17625114 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2710042070 con 0x7f2720101900 2024-09-20T18:39:42.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.231+0000 7f271cff9640 1 --2- 172.21.15.17:0/17625114 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f270807af80 0x7f270807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:42.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.231+0000 7f271cff9640 1 -- 172.21.15.17:0/17625114 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f27100be880 con 0x7f2720101900 2024-09-20T18:39:42.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.231+0000 7f271effd640 1 --2- 172.21.15.17:0/17625114 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f270807af80 0x7f270807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:42.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.231+0000 7f271effd640 1 --2- 172.21.15.17:0/17625114 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f270807af80 0x7f270807d440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2720100bf0 tx=0x7f271400a2d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:42.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.235+0000 7f271cff9640 1 -- 172.21.15.17:0/17625114 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f2710089fb0 con 0x7f2720101900 2024-09-20T18:39:42.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.422+0000 7f2726146640 1 -- 172.21.15.17:0/17625114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7f272019a480 con 0x7f2720101900 2024-09-20T18:39:42.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.423+0000 7f271cff9640 1 -- 172.21.15.17:0/17625114 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v66)=0 v66) ==== 135+0+0 (secure 0 0 0) 0x7f271008ee60 con 0x7f2720101900 2024-09-20T18:39:42.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.425+0000 7f2726146640 1 -- 172.21.15.17:0/17625114 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f270807af80 msgr2=0x7f270807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:42.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.425+0000 7f2726146640 1 --2- 172.21.15.17:0/17625114 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f270807af80 0x7f270807d440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2720100bf0 tx=0x7f271400a2d0 comp rx=0 tx=0).stop 2024-09-20T18:39:42.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.425+0000 7f2726146640 1 -- 172.21.15.17:0/17625114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2720101900 msgr2=0x7f272019f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:42.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.425+0000 7f2726146640 1 --2- 172.21.15.17:0/17625114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2720101900 0x7f272019f850 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2710031460 tx=0x7f27100048f0 comp rx=0 tx=0).stop 2024-09-20T18:39:42.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.425+0000 7f2726146640 1 -- 172.21.15.17:0/17625114 shutdown_connections 2024-09-20T18:39:42.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.425+0000 7f2726146640 1 --2- 172.21.15.17:0/17625114 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f270807af80 0x7f270807d440 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:42.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.425+0000 7f2726146640 1 --2- 172.21.15.17:0/17625114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2720107900 0x7f272019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:42.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.425+0000 7f2726146640 1 --2- 172.21.15.17:0/17625114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2720101900 0x7f272019f850 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:42.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.425+0000 7f2726146640 1 -- 172.21.15.17:0/17625114 >> 172.21.15.17:0/17625114 conn(0x7f27200fd600 msgr2=0x7f2720074940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:42.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.425+0000 7f2726146640 1 -- 172.21.15.17:0/17625114 shutdown_connections 2024-09-20T18:39:42.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:42.425+0000 7f2726146640 1 -- 172.21.15.17:0/17625114 wait complete. 2024-09-20T18:39:43.176 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-20T18:39:43.441 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:39:43.798 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:43 smithi017 ceph-mon[28058]: pgmap v96: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:43.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.880+0000 7f2251cbf640 1 -- 172.21.15.17:0/268837984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224c102b10 msgr2=0x7f224c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:43.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.880+0000 7f2251cbf640 1 --2- 172.21.15.17:0/268837984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224c102b10 0x7f224c102ef0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f223c009c50 tx=0x7f223c02aa30 comp rx=0 tx=0).stop 2024-09-20T18:39:43.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.880+0000 7f2251cbf640 1 -- 172.21.15.17:0/268837984 shutdown_connections 2024-09-20T18:39:43.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.880+0000 7f2251cbf640 1 --2- 172.21.15.17:0/268837984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f224c103430 0x7f224c10b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:43.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.880+0000 7f2251cbf640 1 --2- 172.21.15.17:0/268837984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224c102b10 0x7f224c102ef0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:43.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.880+0000 7f2251cbf640 1 -- 172.21.15.17:0/268837984 >> 172.21.15.17:0/268837984 conn(0x7f224c0fc550 msgr2=0x7f224c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:43.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.880+0000 7f2251cbf640 1 -- 172.21.15.17:0/268837984 shutdown_connections 2024-09-20T18:39:43.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.880+0000 7f2251cbf640 1 -- 172.21.15.17:0/268837984 wait complete. 2024-09-20T18:39:43.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.880+0000 7f2251cbf640 1 Processor -- start 2024-09-20T18:39:43.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.881+0000 7f2251cbf640 1 -- start start 2024-09-20T18:39:43.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.881+0000 7f2251cbf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224c102b10 0x7f224c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:43.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.881+0000 7f2251cbf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f224c103430 0x7f224c19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.881+0000 7f2251cbf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f224c10ede0 con 0x7f224c102b10 2024-09-20T18:39:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.881+0000 7f2251cbf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f224c10ec60 con 0x7f224c103430 2024-09-20T18:39:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.881+0000 7f224b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224c102b10 0x7f224c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.881+0000 7f224b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224c102b10 0x7f224c19d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34732/0 (socket says 172.21.15.17:34732) 2024-09-20T18:39:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.881+0000 7f224b7fe640 1 -- 172.21.15.17:0/3641518090 learned_addr learned my addr 172.21.15.17:0/3641518090 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.881+0000 7f224affd640 1 --2- 172.21.15.17:0/3641518090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f224c103430 0x7f224c19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.881+0000 7f224b7fe640 1 -- 172.21.15.17:0/3641518090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f224c103430 msgr2=0x7f224c19dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.881+0000 7f224b7fe640 1 --2- 172.21.15.17:0/3641518090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f224c103430 0x7f224c19dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.881+0000 7f224b7fe640 1 -- 172.21.15.17:0/3641518090 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f224c197870 con 0x7f224c102b10 2024-09-20T18:39:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.881+0000 7f224affd640 1 --2- 172.21.15.17:0/3641518090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f224c103430 0x7f224c19dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:39:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.881+0000 7f224b7fe640 1 --2- 172.21.15.17:0/3641518090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224c102b10 0x7f224c19d6b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f223c006010 tx=0x7f223c02ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.882+0000 7f2248ff9640 1 -- 172.21.15.17:0/3641518090 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f223c047070 con 0x7f224c102b10 2024-09-20T18:39:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.882+0000 7f2248ff9640 1 -- 172.21.15.17:0/3641518090 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f223c003e30 con 0x7f224c102b10 2024-09-20T18:39:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.882+0000 7f2251cbf640 1 -- 172.21.15.17:0/3641518090 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f224c197b00 con 0x7f224c102b10 2024-09-20T18:39:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.882+0000 7f2248ff9640 1 -- 172.21.15.17:0/3641518090 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f223c033050 con 0x7f224c102b10 2024-09-20T18:39:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.882+0000 7f2251cbf640 1 -- 172.21.15.17:0/3641518090 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f224c198030 con 0x7f224c102b10 2024-09-20T18:39:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.883+0000 7f2251cbf640 1 -- 172.21.15.17:0/3641518090 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f224c06a520 con 0x7f224c102b10 2024-09-20T18:39:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.883+0000 7f2248ff9640 1 -- 172.21.15.17:0/3641518090 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f223c04a070 con 0x7f224c102b10 2024-09-20T18:39:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.884+0000 7f2248ff9640 1 --2- 172.21.15.17:0/3641518090 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f223407af30 0x7f223407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.884+0000 7f224affd640 1 --2- 172.21.15.17:0/3641518090 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f223407af30 0x7f223407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.884+0000 7f2248ff9640 1 -- 172.21.15.17:0/3641518090 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f223c03e030 con 0x7f224c102b10 2024-09-20T18:39:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.885+0000 7f224affd640 1 --2- 172.21.15.17:0/3641518090 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f223407af30 0x7f223407d3f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2240005fd0 tx=0x7f2240005ea0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:43.889+0000 7f2248ff9640 1 -- 172.21.15.17:0/3641518090 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f223c08a7f0 con 0x7f224c102b10 2024-09-20T18:39:43.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:43 smithi172 ceph-mon[35456]: pgmap v96: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:44.094+0000 7f2251cbf640 1 -- 172.21.15.17:0/3641518090 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "target": ["mon-mgr", ""]}) -- 0x7f224c198da0 con 0x7f223407af30 2024-09-20T18:39:44.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:44.102+0000 7f2248ff9640 1 -- 172.21.15.17:0/3641518090 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f224c198da0 con 0x7f223407af30 2024-09-20T18:39:44.118 INFO:teuthology.orchestra.run.smithi017.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:39:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:44.104+0000 7f2251cbf640 1 -- 172.21.15.17:0/3641518090 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f223407af30 msgr2=0x7f223407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:44.104+0000 7f2251cbf640 1 --2- 172.21.15.17:0/3641518090 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f223407af30 0x7f223407d3f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2240005fd0 tx=0x7f2240005ea0 comp rx=0 tx=0).stop 2024-09-20T18:39:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:44.104+0000 7f2251cbf640 1 -- 172.21.15.17:0/3641518090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224c102b10 msgr2=0x7f224c19d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:44.104+0000 7f2251cbf640 1 --2- 172.21.15.17:0/3641518090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224c102b10 0x7f224c19d6b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f223c006010 tx=0x7f223c02ed90 comp rx=0 tx=0).stop 2024-09-20T18:39:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:44.104+0000 7f2251cbf640 1 -- 172.21.15.17:0/3641518090 shutdown_connections 2024-09-20T18:39:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:44.104+0000 7f2251cbf640 1 --2- 172.21.15.17:0/3641518090 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f223407af30 0x7f223407d3f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:44.104+0000 7f2251cbf640 1 --2- 172.21.15.17:0/3641518090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f224c103430 0x7f224c19dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:44.104+0000 7f2251cbf640 1 --2- 172.21.15.17:0/3641518090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224c102b10 0x7f224c19d6b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:44.104+0000 7f2251cbf640 1 -- 172.21.15.17:0/3641518090 >> 172.21.15.17:0/3641518090 conn(0x7f224c0fc550 msgr2=0x7f224c107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:44.104+0000 7f2251cbf640 1 -- 172.21.15.17:0/3641518090 shutdown_connections 2024-09-20T18:39:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:44.104+0000 7f2251cbf640 1 -- 172.21.15.17:0/3641518090 wait complete. 2024-09-20T18:39:45.165 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-20T18:39:45.165 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-20T18:39:45.166 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-20T18:39:45.398 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:45 smithi017 ceph-mon[28058]: from='client.14926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:39:45.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:45 smithi017 ceph-mon[28058]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:39:45.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:45 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:45.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:45 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:39:45.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:45 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:39:45.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:45 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:39:45.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:45 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:45.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:45 smithi017 ceph-mon[28058]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:39:45.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:45 smithi017 ceph-mon[28058]: pgmap v97: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:45.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:45 smithi172 ceph-mon[35456]: from='client.14926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:39:45.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:45 smithi172 ceph-mon[35456]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:39:45.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:45 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:45.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:45 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:39:45.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:45 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:39:45.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:45 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:39:45.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:45 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:45.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:45 smithi172 ceph-mon[35456]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:88deadb8082f4a33832e228ccefc59cedba158a5 2024-09-20T18:39:45.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:45 smithi172 ceph-mon[35456]: pgmap v97: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:46.446 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T18:39:46.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.930+0000 7efcb2ac7640 1 -- 172.21.15.17:0/3997885608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac107900 msgr2=0x7efcac107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:46.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.930+0000 7efcb2ac7640 1 --2- 172.21.15.17:0/3997885608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac107900 0x7efcac107ce0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efca4009c20 tx=0x7efca402a970 comp rx=0 tx=0).stop 2024-09-20T18:39:46.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.930+0000 7efcb2ac7640 1 -- 172.21.15.17:0/3997885608 shutdown_connections 2024-09-20T18:39:46.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.930+0000 7efcb2ac7640 1 --2- 172.21.15.17:0/3997885608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcac101900 0x7efcac101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:46.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.930+0000 7efcb2ac7640 1 --2- 172.21.15.17:0/3997885608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac107900 0x7efcac107ce0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:46.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.930+0000 7efcb2ac7640 1 -- 172.21.15.17:0/3997885608 >> 172.21.15.17:0/3997885608 conn(0x7efcac0fd600 msgr2=0x7efcac0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:46.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.930+0000 7efcb2ac7640 1 -- 172.21.15.17:0/3997885608 shutdown_connections 2024-09-20T18:39:46.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.930+0000 7efcb2ac7640 1 -- 172.21.15.17:0/3997885608 wait complete. 2024-09-20T18:39:46.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.930+0000 7efcb2ac7640 1 Processor -- start 2024-09-20T18:39:46.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.931+0000 7efcb2ac7640 1 -- start start 2024-09-20T18:39:46.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.931+0000 7efcb2ac7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcac101900 0x7efcac19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:46.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.931+0000 7efcb2ac7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac107900 0x7efcac19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:46.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.931+0000 7efcb2ac7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efcac10edd0 con 0x7efcac107900 2024-09-20T18:39:46.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.931+0000 7efcb2ac7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efcac10ec50 con 0x7efcac101900 2024-09-20T18:39:46.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.931+0000 7efcabfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac107900 0x7efcac19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:46.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.931+0000 7efcabfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac107900 0x7efcac19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34752/0 (socket says 172.21.15.17:34752) 2024-09-20T18:39:46.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.931+0000 7efcabfff640 1 -- 172.21.15.17:0/1904568318 learned_addr learned my addr 172.21.15.17:0/1904568318 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:46.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.931+0000 7efcb0863640 1 --2- 172.21.15.17:0/1904568318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcac101900 0x7efcac19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:46.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.931+0000 7efcabfff640 1 -- 172.21.15.17:0/1904568318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcac101900 msgr2=0x7efcac19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:46.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.931+0000 7efcabfff640 1 --2- 172.21.15.17:0/1904568318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcac101900 0x7efcac19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:46.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.931+0000 7efcabfff640 1 -- 172.21.15.17:0/1904568318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcac197800 con 0x7efcac107900 2024-09-20T18:39:46.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.932+0000 7efcabfff640 1 --2- 172.21.15.17:0/1904568318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac107900 0x7efcac19dbc0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00d6f0 tx=0x7efc9c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:46.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.932+0000 7efca9ffb640 1 -- 172.21.15.17:0/1904568318 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc9c017070 con 0x7efcac107900 2024-09-20T18:39:46.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.932+0000 7efcb2ac7640 1 -- 172.21.15.17:0/1904568318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcac197af0 con 0x7efcac107900 2024-09-20T18:39:46.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.932+0000 7efca9ffb640 1 -- 172.21.15.17:0/1904568318 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efc9c00de00 con 0x7efcac107900 2024-09-20T18:39:46.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.932+0000 7efca9ffb640 1 -- 172.21.15.17:0/1904568318 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc9c004bb0 con 0x7efcac107900 2024-09-20T18:39:46.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.932+0000 7efcb2ac7640 1 -- 172.21.15.17:0/1904568318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcac198080 con 0x7efcac107900 2024-09-20T18:39:46.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.933+0000 7efcb2ac7640 1 -- 172.21.15.17:0/1904568318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcac103040 con 0x7efcac107900 2024-09-20T18:39:46.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.933+0000 7efca9ffb640 1 -- 172.21.15.17:0/1904568318 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7efc9c009a30 con 0x7efcac107900 2024-09-20T18:39:46.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.934+0000 7efca9ffb640 1 --2- 172.21.15.17:0/1904568318 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efc9807af80 0x7efc9807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:46.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.934+0000 7efca9ffb640 1 -- 172.21.15.17:0/1904568318 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7efc9c09da10 con 0x7efcac107900 2024-09-20T18:39:46.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.934+0000 7efcb0863640 1 --2- 172.21.15.17:0/1904568318 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efc9807af80 0x7efc9807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:46.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.935+0000 7efcb0863640 1 --2- 172.21.15.17:0/1904568318 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efc9807af80 0x7efc9807d440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efca4009430 tx=0x7efca403c040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:46.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:46.939+0000 7efca9ffb640 1 -- 172.21.15.17:0/1904568318 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7efc9c069140 con 0x7efcac107900 2024-09-20T18:39:47.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.145+0000 7efcb2ac7640 1 -- 172.21.15.17:0/1904568318 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efcac198330 con 0x7efc9807af80 2024-09-20T18:39:47.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.146+0000 7efca9ffb640 1 -- 172.21.15.17:0/1904568318 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7efcac198330 con 0x7efc9807af80 2024-09-20T18:39:47.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.148+0000 7efcb2ac7640 1 -- 172.21.15.17:0/1904568318 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efc9807af80 msgr2=0x7efc9807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:47.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.148+0000 7efcb2ac7640 1 --2- 172.21.15.17:0/1904568318 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efc9807af80 0x7efc9807d440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efca4009430 tx=0x7efca403c040 comp rx=0 tx=0).stop 2024-09-20T18:39:47.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.148+0000 7efcb2ac7640 1 -- 172.21.15.17:0/1904568318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac107900 msgr2=0x7efcac19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:47.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.148+0000 7efcb2ac7640 1 --2- 172.21.15.17:0/1904568318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac107900 0x7efcac19dbc0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00d6f0 tx=0x7efc9c00dbb0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.148+0000 7efcb2ac7640 1 -- 172.21.15.17:0/1904568318 shutdown_connections 2024-09-20T18:39:47.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.148+0000 7efcb2ac7640 1 --2- 172.21.15.17:0/1904568318 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efc9807af80 0x7efc9807d440 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.148+0000 7efcb2ac7640 1 --2- 172.21.15.17:0/1904568318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac107900 0x7efcac19dbc0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.148+0000 7efcb2ac7640 1 --2- 172.21.15.17:0/1904568318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcac101900 0x7efcac19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.148+0000 7efcb2ac7640 1 -- 172.21.15.17:0/1904568318 >> 172.21.15.17:0/1904568318 conn(0x7efcac0fd600 msgr2=0x7efcac0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:47.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.148+0000 7efcb2ac7640 1 -- 172.21.15.17:0/1904568318 shutdown_connections 2024-09-20T18:39:47.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.148+0000 7efcb2ac7640 1 -- 172.21.15.17:0/1904568318 wait complete. 2024-09-20T18:39:47.174 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:39:47.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.235+0000 7f33a7246640 1 -- 172.21.15.17:0/163655134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33a0107900 msgr2=0x7f33a0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:47.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.235+0000 7f33a7246640 1 --2- 172.21.15.17:0/163655134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33a0107900 0x7f33a0107ce0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3390009880 tx=0x7f339002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.235+0000 7f33a7246640 1 -- 172.21.15.17:0/163655134 shutdown_connections 2024-09-20T18:39:47.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.235+0000 7f33a7246640 1 --2- 172.21.15.17:0/163655134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33a0101900 0x7f33a0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.235+0000 7f33a7246640 1 --2- 172.21.15.17:0/163655134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33a0107900 0x7f33a0107ce0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.235+0000 7f33a7246640 1 -- 172.21.15.17:0/163655134 >> 172.21.15.17:0/163655134 conn(0x7f33a00fd600 msgr2=0x7f33a00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:47.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.235+0000 7f33a7246640 1 -- 172.21.15.17:0/163655134 shutdown_connections 2024-09-20T18:39:47.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.235+0000 7f33a7246640 1 -- 172.21.15.17:0/163655134 wait complete. 2024-09-20T18:39:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.236+0000 7f33a7246640 1 Processor -- start 2024-09-20T18:39:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.236+0000 7f33a7246640 1 -- start start 2024-09-20T18:39:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.236+0000 7f33a7246640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33a0101900 0x7f33a019f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.236+0000 7f33a7246640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33a0107900 0x7f33a019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.236+0000 7f33a7246640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f33a010edb0 con 0x7f33a0101900 2024-09-20T18:39:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.236+0000 7f33a7246640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33a010ec30 con 0x7f33a0107900 2024-09-20T18:39:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.237+0000 7f33a4fe2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33a0101900 0x7f33a019f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.237+0000 7f33a4fe2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33a0101900 0x7f33a019f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34772/0 (socket says 172.21.15.17:34772) 2024-09-20T18:39:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.237+0000 7f33a4fe2640 1 -- 172.21.15.17:0/3600185098 learned_addr learned my addr 172.21.15.17:0/3600185098 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.237+0000 7f339ffff640 1 --2- 172.21.15.17:0/3600185098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33a0107900 0x7f33a019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.237+0000 7f33a4fe2640 1 -- 172.21.15.17:0/3600185098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33a0107900 msgr2=0x7f33a019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.237+0000 7f33a4fe2640 1 --2- 172.21.15.17:0/3600185098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33a0107900 0x7f33a019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.237+0000 7f33a4fe2640 1 -- 172.21.15.17:0/3600185098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a01999b0 con 0x7f33a0101900 2024-09-20T18:39:47.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.237+0000 7f33a4fe2640 1 --2- 172.21.15.17:0/3600185098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33a0101900 0x7f33a019f7f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3390031460 tx=0x7f33900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:47.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.237+0000 7f339dffb640 1 -- 172.21.15.17:0/3600185098 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f339003f070 con 0x7f33a0101900 2024-09-20T18:39:47.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.237+0000 7f33a7246640 1 -- 172.21.15.17:0/3600185098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a0199c40 con 0x7f33a0101900 2024-09-20T18:39:47.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.237+0000 7f339dffb640 1 -- 172.21.15.17:0/3600185098 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3390004cf0 con 0x7f33a0101900 2024-09-20T18:39:47.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.237+0000 7f339dffb640 1 -- 172.21.15.17:0/3600185098 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3390035030 con 0x7f33a0101900 2024-09-20T18:39:47.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.238+0000 7f33a7246640 1 -- 172.21.15.17:0/3600185098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a019a170 con 0x7f33a0101900 2024-09-20T18:39:47.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.239+0000 7f33a7246640 1 -- 172.21.15.17:0/3600185098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a0103040 con 0x7f33a0101900 2024-09-20T18:39:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.240+0000 7f339dffb640 1 -- 172.21.15.17:0/3600185098 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3390042070 con 0x7f33a0101900 2024-09-20T18:39:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.240+0000 7f339dffb640 1 --2- 172.21.15.17:0/3600185098 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f338807af30 0x7f338807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.240+0000 7f339ffff640 1 --2- 172.21.15.17:0/3600185098 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f338807af30 0x7f338807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.240+0000 7f339dffb640 1 -- 172.21.15.17:0/3600185098 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f33900bea10 con 0x7f33a0101900 2024-09-20T18:39:47.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.241+0000 7f339ffff640 1 --2- 172.21.15.17:0/3600185098 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f338807af30 0x7f338807d3f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f33a0100b50 tx=0x7f339400a4c0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:47.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.245+0000 7f339dffb640 1 -- 172.21.15.17:0/3600185098 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f339008a0c0 con 0x7f33a0101900 2024-09-20T18:39:47.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.454+0000 7f33a7246640 1 -- 172.21.15.17:0/3600185098 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f33a019a420 con 0x7f338807af30 2024-09-20T18:39:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.455+0000 7f339dffb640 1 -- 172.21.15.17:0/3600185098 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7f33a019a420 con 0x7f338807af30 2024-09-20T18:39:47.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.457+0000 7f33a7246640 1 -- 172.21.15.17:0/3600185098 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f338807af30 msgr2=0x7f338807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:47.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.457+0000 7f33a7246640 1 --2- 172.21.15.17:0/3600185098 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f338807af30 0x7f338807d3f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f33a0100b50 tx=0x7f339400a4c0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.457+0000 7f33a7246640 1 -- 172.21.15.17:0/3600185098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33a0101900 msgr2=0x7f33a019f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:47.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.457+0000 7f33a7246640 1 --2- 172.21.15.17:0/3600185098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33a0101900 0x7f33a019f7f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3390031460 tx=0x7f33900048f0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.457+0000 7f33a7246640 1 -- 172.21.15.17:0/3600185098 shutdown_connections 2024-09-20T18:39:47.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.457+0000 7f33a7246640 1 --2- 172.21.15.17:0/3600185098 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f338807af30 0x7f338807d3f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.457+0000 7f33a7246640 1 --2- 172.21.15.17:0/3600185098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33a0107900 0x7f33a019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.457+0000 7f33a7246640 1 --2- 172.21.15.17:0/3600185098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33a0101900 0x7f33a019f7f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.457+0000 7f33a7246640 1 -- 172.21.15.17:0/3600185098 >> 172.21.15.17:0/3600185098 conn(0x7f33a00fd600 msgr2=0x7f33a00fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:47.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.457+0000 7f33a7246640 1 -- 172.21.15.17:0/3600185098 shutdown_connections 2024-09-20T18:39:47.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.457+0000 7f33a7246640 1 -- 172.21.15.17:0/3600185098 wait complete. 2024-09-20T18:39:47.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.541+0000 7f598bcc5640 1 -- 172.21.15.17:0/196474754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5984100800 msgr2=0x7f5984100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:47.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.541+0000 7f598bcc5640 1 --2- 172.21.15.17:0/196474754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5984100800 0x7f5984100c60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5974009880 tx=0x7f597402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.541+0000 7f598bcc5640 1 -- 172.21.15.17:0/196474754 shutdown_connections 2024-09-20T18:39:47.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.541+0000 7f598bcc5640 1 --2- 172.21.15.17:0/196474754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5984100800 0x7f5984100c60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.541+0000 7f598bcc5640 1 --2- 172.21.15.17:0/196474754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5984106800 0x7f5984106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.541+0000 7f598bcc5640 1 -- 172.21.15.17:0/196474754 >> 172.21.15.17:0/196474754 conn(0x7f59840fc520 msgr2=0x7f59840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:47.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.541+0000 7f598bcc5640 1 -- 172.21.15.17:0/196474754 shutdown_connections 2024-09-20T18:39:47.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.541+0000 7f598bcc5640 1 -- 172.21.15.17:0/196474754 wait complete. 2024-09-20T18:39:47.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.542+0000 7f598bcc5640 1 Processor -- start 2024-09-20T18:39:47.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.542+0000 7f598bcc5640 1 -- start start 2024-09-20T18:39:47.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.542+0000 7f598bcc5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5984100800 0x7f59840fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:47.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.542+0000 7f598bcc5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5984106800 0x7f59840fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:47.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.542+0000 7f598bcc5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f598410dd30 con 0x7f5984106800 2024-09-20T18:39:47.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.542+0000 7f598bcc5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f598410dbb0 con 0x7f5984100800 2024-09-20T18:39:47.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.542+0000 7f5989260640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5984106800 0x7f59840fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:47.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.542+0000 7f5989260640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5984106800 0x7f59840fd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34788/0 (socket says 172.21.15.17:34788) 2024-09-20T18:39:47.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.542+0000 7f5989260640 1 -- 172.21.15.17:0/618795802 learned_addr learned my addr 172.21.15.17:0/618795802 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:47.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.542+0000 7f5989260640 1 -- 172.21.15.17:0/618795802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5984100800 msgr2=0x7f59840fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:47.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.542+0000 7f5989a61640 1 --2- 172.21.15.17:0/618795802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5984100800 0x7f59840fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:47.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.542+0000 7f5989260640 1 --2- 172.21.15.17:0/618795802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5984100800 0x7f59840fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.542+0000 7f5989260640 1 -- 172.21.15.17:0/618795802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59840fd650 con 0x7f5984106800 2024-09-20T18:39:47.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.543+0000 7f5989260640 1 --2- 172.21.15.17:0/618795802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5984106800 0x7f59840fd110 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5974031460 tx=0x7f59740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:47.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.543+0000 7f597affd640 1 -- 172.21.15.17:0/618795802 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f597403f070 con 0x7f5984106800 2024-09-20T18:39:47.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.543+0000 7f597affd640 1 -- 172.21.15.17:0/618795802 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5974004cf0 con 0x7f5984106800 2024-09-20T18:39:47.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.543+0000 7f598bcc5640 1 -- 172.21.15.17:0/618795802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59840fd8e0 con 0x7f5984106800 2024-09-20T18:39:47.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.543+0000 7f597affd640 1 -- 172.21.15.17:0/618795802 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5974035030 con 0x7f5984106800 2024-09-20T18:39:47.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.543+0000 7f598bcc5640 1 -- 172.21.15.17:0/618795802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59841a3e30 con 0x7f5984106800 2024-09-20T18:39:47.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.544+0000 7f598bcc5640 1 -- 172.21.15.17:0/618795802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5984101f40 con 0x7f5984106800 2024-09-20T18:39:47.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.545+0000 7f597affd640 1 -- 172.21.15.17:0/618795802 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5974042070 con 0x7f5984106800 2024-09-20T18:39:47.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.545+0000 7f597affd640 1 --2- 172.21.15.17:0/618795802 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f597007af80 0x7f597007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:47.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.545+0000 7f597affd640 1 -- 172.21.15.17:0/618795802 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f59740be970 con 0x7f5984106800 2024-09-20T18:39:47.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.545+0000 7f5989a61640 1 --2- 172.21.15.17:0/618795802 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f597007af80 0x7f597007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:47.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.546+0000 7f5989a61640 1 --2- 172.21.15.17:0/618795802 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f597007af80 0x7f597007d440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f598000a810 tx=0x7f5980008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:47.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.550+0000 7f597affd640 1 -- 172.21.15.17:0/618795802 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f597408a060 con 0x7f5984106800 2024-09-20T18:39:47.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:47 smithi017 ceph-mon[28058]: pgmap v98: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:47.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:47 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:47.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:47 smithi017 ceph-mon[28058]: Upgrade: Target is version 19.3.0-5099-g88deadb8 (squid) 2024-09-20T18:39:47.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:47 smithi017 ceph-mon[28058]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2'] 2024-09-20T18:39:47.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:47 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:39:47.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:47 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:47.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:47 smithi017 ceph-mon[28058]: Upgrade: Setting container_image for all mgr 2024-09-20T18:39:47.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:47 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:47.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:47 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T18:39:47.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:47 smithi172 ceph-mon[35456]: pgmap v98: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:47.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:47 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:47.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:47 smithi172 ceph-mon[35456]: Upgrade: Target is version 19.3.0-5099-g88deadb8 (squid) 2024-09-20T18:39:47.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:47 smithi172 ceph-mon[35456]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2'] 2024-09-20T18:39:47.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:47 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:39:47.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:47 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:47.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:47 smithi172 ceph-mon[35456]: Upgrade: Setting container_image for all mgr 2024-09-20T18:39:47.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:47 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:47.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:47 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T18:39:47.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.747+0000 7f598bcc5640 1 -- 172.21.15.17:0/618795802 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5984062630 con 0x7f597007af80 2024-09-20T18:39:47.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.756+0000 7f597affd640 1 -- 172.21.15.17:0/618795802 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f5984062630 con 0x7f597007af80 2024-09-20T18:39:47.773 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:39:47.773 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (67s) 38s ago 12m 18.4M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:39:47.773 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (4m) 38s ago 12m 8816k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:39:47.773 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (3m) 108s ago 11m 8451k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:39:47.773 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (12m) 38s ago 12m 6895k - 19.1.1-369-ged8ee0f2 6acb0a031eab 725c8bcc6ec8 2024-09-20T18:39:47.773 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (11m) 108s ago 11m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab e10dd613dbe2 2024-09-20T18:39:47.773 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (44s) 38s ago 11m 48.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:39:47.773 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (6m) 38s ago 6m 150M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:39:47.773 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (6m) 38s ago 6m 95.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:39:47.773 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (6m) 108s ago 6m 26.7M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:39:47.773 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (6m) 108s ago 6m 26.5M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:39:47.773 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (3m) 38s ago 13m 521M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:39:47.773 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (2m) 108s ago 11m 455M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:39:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (13m) 38s ago 13m 59.2M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab ab1f988c4cb2 2024-09-20T18:39:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (11m) 108s ago 11m 48.8M 2048M 19.1.1-369-ged8ee0f2 6acb0a031eab 9eea40352787 2024-09-20T18:39:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (118s) 38s ago 12m 11.9M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:39:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (112s) 108s ago 11m 3301k - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:39:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (10m) 38s ago 10m 204M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab c1207e514216 2024-09-20T18:39:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (9m) 38s ago 9m 224M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 73f2fd77590f 2024-09-20T18:39:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (9m) 38s ago 9m 208M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 6f0b9405dc18 2024-09-20T18:39:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (8m) 108s ago 8m 260M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:39:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (8m) 108s ago 8m 206M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:39:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (7m) 108s ago 7m 188M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:39:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (88s) 38s ago 11m 46.5M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:39:47.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.758+0000 7f598bcc5640 1 -- 172.21.15.17:0/618795802 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f597007af80 msgr2=0x7f597007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:47.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.758+0000 7f598bcc5640 1 --2- 172.21.15.17:0/618795802 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f597007af80 0x7f597007d440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f598000a810 tx=0x7f5980008040 comp rx=0 tx=0).stop 2024-09-20T18:39:47.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.758+0000 7f598bcc5640 1 -- 172.21.15.17:0/618795802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5984106800 msgr2=0x7f59840fd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:47.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.758+0000 7f598bcc5640 1 --2- 172.21.15.17:0/618795802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5984106800 0x7f59840fd110 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5974031460 tx=0x7f59740048f0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.758+0000 7f598bcc5640 1 -- 172.21.15.17:0/618795802 shutdown_connections 2024-09-20T18:39:47.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.758+0000 7f598bcc5640 1 --2- 172.21.15.17:0/618795802 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f597007af80 0x7f597007d440 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.758+0000 7f598bcc5640 1 --2- 172.21.15.17:0/618795802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5984106800 0x7f59840fd110 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.758+0000 7f598bcc5640 1 --2- 172.21.15.17:0/618795802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5984100800 0x7f59840fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.759+0000 7f598bcc5640 1 -- 172.21.15.17:0/618795802 >> 172.21.15.17:0/618795802 conn(0x7f59840fc520 msgr2=0x7f598406a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:47.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.759+0000 7f598bcc5640 1 -- 172.21.15.17:0/618795802 shutdown_connections 2024-09-20T18:39:47.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.759+0000 7f598bcc5640 1 -- 172.21.15.17:0/618795802 wait complete. 2024-09-20T18:39:47.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.842+0000 7fe783df5640 1 -- 172.21.15.17:0/1153209502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe77c1007f0 msgr2=0x7fe77c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:47.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.842+0000 7fe783df5640 1 --2- 172.21.15.17:0/1153209502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe77c1007f0 0x7fe77c100c50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009880 tx=0x7fe76c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.842+0000 7fe783df5640 1 -- 172.21.15.17:0/1153209502 shutdown_connections 2024-09-20T18:39:47.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.842+0000 7fe783df5640 1 --2- 172.21.15.17:0/1153209502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe77c1007f0 0x7fe77c100c50 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.842+0000 7fe783df5640 1 --2- 172.21.15.17:0/1153209502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe77c1067f0 0x7fe77c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.842+0000 7fe783df5640 1 -- 172.21.15.17:0/1153209502 >> 172.21.15.17:0/1153209502 conn(0x7fe77c0fc550 msgr2=0x7fe77c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:47.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.842+0000 7fe783df5640 1 -- 172.21.15.17:0/1153209502 shutdown_connections 2024-09-20T18:39:47.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.842+0000 7fe783df5640 1 -- 172.21.15.17:0/1153209502 wait complete. 2024-09-20T18:39:47.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.843+0000 7fe783df5640 1 Processor -- start 2024-09-20T18:39:47.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.843+0000 7fe783df5640 1 -- start start 2024-09-20T18:39:47.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.843+0000 7fe783df5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe77c1007f0 0x7fe77c1987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:47.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.843+0000 7fe783df5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe77c1067f0 0x7fe77c198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:47.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.843+0000 7fe783df5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c10dca0 con 0x7fe77c1007f0 2024-09-20T18:39:47.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.843+0000 7fe783df5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c10db20 con 0x7fe77c1067f0 2024-09-20T18:39:47.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.843+0000 7fe781b91640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe77c1007f0 0x7fe77c1987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:47.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.843+0000 7fe781b91640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe77c1007f0 0x7fe77c1987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34800/0 (socket says 172.21.15.17:34800) 2024-09-20T18:39:47.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.843+0000 7fe781b91640 1 -- 172.21.15.17:0/59800045 learned_addr learned my addr 172.21.15.17:0/59800045 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:47.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.844+0000 7fe781b91640 1 -- 172.21.15.17:0/59800045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe77c1067f0 msgr2=0x7fe77c198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:47.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.844+0000 7fe781b91640 1 --2- 172.21.15.17:0/59800045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe77c1067f0 0x7fe77c198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:47.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.844+0000 7fe781b91640 1 -- 172.21.15.17:0/59800045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77c199260 con 0x7fe77c1007f0 2024-09-20T18:39:47.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.844+0000 7fe781b91640 1 --2- 172.21.15.17:0/59800045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe77c1007f0 0x7fe77c1987b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe77800c8a0 tx=0x7fe77800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:47.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.844+0000 7fe772ffd640 1 -- 172.21.15.17:0/59800045 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe7780079b0 con 0x7fe77c1007f0 2024-09-20T18:39:47.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.844+0000 7fe772ffd640 1 -- 172.21.15.17:0/59800045 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe778007b50 con 0x7fe77c1007f0 2024-09-20T18:39:47.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.844+0000 7fe783df5640 1 -- 172.21.15.17:0/59800045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe77c199550 con 0x7fe77c1007f0 2024-09-20T18:39:47.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.844+0000 7fe772ffd640 1 -- 172.21.15.17:0/59800045 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe778018700 con 0x7fe77c1007f0 2024-09-20T18:39:47.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.844+0000 7fe783df5640 1 -- 172.21.15.17:0/59800045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe77c1a1b50 con 0x7fe77c1007f0 2024-09-20T18:39:47.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.845+0000 7fe783df5640 1 -- 172.21.15.17:0/59800045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe77c101f30 con 0x7fe77c1007f0 2024-09-20T18:39:47.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.846+0000 7fe772ffd640 1 -- 172.21.15.17:0/59800045 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe778007d00 con 0x7fe77c1007f0 2024-09-20T18:39:47.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.846+0000 7fe772ffd640 1 --2- 172.21.15.17:0/59800045 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe76807af80 0x7fe76807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:47.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.846+0000 7fe772ffd640 1 -- 172.21.15.17:0/59800045 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7fe77809e100 con 0x7fe77c1007f0 2024-09-20T18:39:47.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.846+0000 7fe781390640 1 --2- 172.21.15.17:0/59800045 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe76807af80 0x7fe76807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:47.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.847+0000 7fe781390640 1 --2- 172.21.15.17:0/59800045 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe76807af80 0x7fe76807d440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0096c0 tx=0x7fe76c000bc0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:47.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:47.851+0000 7fe772ffd640 1 -- 172.21.15.17:0/59800045 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fe778014030 con 0x7fe77c1007f0 2024-09-20T18:39:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.117+0000 7fe783df5640 1 -- 172.21.15.17:0/59800045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe77c1a1ec0 con 0x7fe77c1007f0 2024-09-20T18:39:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.117+0000 7fe772ffd640 1 -- 172.21.15.17:0/59800045 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fe778069830 con 0x7fe77c1007f0 2024-09-20T18:39:48.134 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:39:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:39:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2 2024-09-20T18:39:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:39:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:39:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:39:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:39:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:39:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T18:39:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:39:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:39:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:39:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:39:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:39:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 12, 2024-09-20T18:39:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:39:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:39:48.135 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:39:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.120+0000 7fe783df5640 1 -- 172.21.15.17:0/59800045 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe76807af80 msgr2=0x7fe76807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.120+0000 7fe783df5640 1 --2- 172.21.15.17:0/59800045 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe76807af80 0x7fe76807d440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0096c0 tx=0x7fe76c000bc0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.120+0000 7fe783df5640 1 -- 172.21.15.17:0/59800045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe77c1007f0 msgr2=0x7fe77c1987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.120+0000 7fe783df5640 1 --2- 172.21.15.17:0/59800045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe77c1007f0 0x7fe77c1987b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe77800c8a0 tx=0x7fe77800cd60 comp rx=0 tx=0).stop 2024-09-20T18:39:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.120+0000 7fe783df5640 1 -- 172.21.15.17:0/59800045 shutdown_connections 2024-09-20T18:39:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.120+0000 7fe783df5640 1 --2- 172.21.15.17:0/59800045 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe76807af80 0x7fe76807d440 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.120+0000 7fe783df5640 1 --2- 172.21.15.17:0/59800045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe77c1067f0 0x7fe77c198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.120+0000 7fe783df5640 1 --2- 172.21.15.17:0/59800045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe77c1007f0 0x7fe77c1987b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.120+0000 7fe783df5640 1 -- 172.21.15.17:0/59800045 >> 172.21.15.17:0/59800045 conn(0x7fe77c0fc550 msgr2=0x7fe77c0fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.120+0000 7fe783df5640 1 -- 172.21.15.17:0/59800045 shutdown_connections 2024-09-20T18:39:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.120+0000 7fe783df5640 1 -- 172.21.15.17:0/59800045 wait complete. 2024-09-20T18:39:48.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.206+0000 7fb92b014640 1 -- 172.21.15.17:0/4186513143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9241007f0 msgr2=0x7fb924100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:48.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.206+0000 7fb92b014640 1 --2- 172.21.15.17:0/4186513143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9241007f0 0x7fb924100c50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb910009880 tx=0x7fb91002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.206+0000 7fb92b014640 1 -- 172.21.15.17:0/4186513143 shutdown_connections 2024-09-20T18:39:48.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.206+0000 7fb92b014640 1 --2- 172.21.15.17:0/4186513143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9241007f0 0x7fb924100c50 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.206+0000 7fb92b014640 1 --2- 172.21.15.17:0/4186513143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9241067f0 0x7fb924106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.206+0000 7fb92b014640 1 -- 172.21.15.17:0/4186513143 >> 172.21.15.17:0/4186513143 conn(0x7fb9240fc550 msgr2=0x7fb9240fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:48.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.207+0000 7fb92b014640 1 -- 172.21.15.17:0/4186513143 shutdown_connections 2024-09-20T18:39:48.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.207+0000 7fb92b014640 1 -- 172.21.15.17:0/4186513143 wait complete. 2024-09-20T18:39:48.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.207+0000 7fb92b014640 1 Processor -- start 2024-09-20T18:39:48.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.207+0000 7fb92b014640 1 -- start start 2024-09-20T18:39:48.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.208+0000 7fb92b014640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9241007f0 0x7fb9241987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:48.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.208+0000 7fb92b014640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9241067f0 0x7fb924198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:48.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.208+0000 7fb92b014640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb92410dcc0 con 0x7fb9241067f0 2024-09-20T18:39:48.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.208+0000 7fb92b014640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb92410db40 con 0x7fb9241007f0 2024-09-20T18:39:48.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.208+0000 7fb923fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9241067f0 0x7fb924198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:48.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.208+0000 7fb923fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9241067f0 0x7fb924198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34826/0 (socket says 172.21.15.17:34826) 2024-09-20T18:39:48.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.208+0000 7fb923fff640 1 -- 172.21.15.17:0/2053373155 learned_addr learned my addr 172.21.15.17:0/2053373155 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:48.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.208+0000 7fb928db0640 1 --2- 172.21.15.17:0/2053373155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9241007f0 0x7fb9241987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:48.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.208+0000 7fb923fff640 1 -- 172.21.15.17:0/2053373155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9241007f0 msgr2=0x7fb9241987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:48.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.208+0000 7fb923fff640 1 --2- 172.21.15.17:0/2053373155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9241007f0 0x7fb9241987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.208+0000 7fb923fff640 1 -- 172.21.15.17:0/2053373155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb924199330 con 0x7fb9241067f0 2024-09-20T18:39:48.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.208+0000 7fb923fff640 1 --2- 172.21.15.17:0/2053373155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9241067f0 0x7fb924198d30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb910031460 tx=0x7fb9100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:48.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.209+0000 7fb921ffb640 1 -- 172.21.15.17:0/2053373155 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb91003f070 con 0x7fb9241067f0 2024-09-20T18:39:48.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.209+0000 7fb92b014640 1 -- 172.21.15.17:0/2053373155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9241995c0 con 0x7fb9241067f0 2024-09-20T18:39:48.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.209+0000 7fb921ffb640 1 -- 172.21.15.17:0/2053373155 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb910004cf0 con 0x7fb9241067f0 2024-09-20T18:39:48.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.209+0000 7fb921ffb640 1 -- 172.21.15.17:0/2053373155 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb910035030 con 0x7fb9241067f0 2024-09-20T18:39:48.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.209+0000 7fb92b014640 1 -- 172.21.15.17:0/2053373155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9241a1b70 con 0x7fb9241067f0 2024-09-20T18:39:48.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.210+0000 7fb92b014640 1 -- 172.21.15.17:0/2053373155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb924101f30 con 0x7fb9241067f0 2024-09-20T18:39:48.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.211+0000 7fb921ffb640 1 -- 172.21.15.17:0/2053373155 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb910042070 con 0x7fb9241067f0 2024-09-20T18:39:48.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.211+0000 7fb921ffb640 1 --2- 172.21.15.17:0/2053373155 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb91407af80 0x7fb91407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:48.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.211+0000 7fb921ffb640 1 -- 172.21.15.17:0/2053373155 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7fb9100be930 con 0x7fb9241067f0 2024-09-20T18:39:48.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.211+0000 7fb928db0640 1 --2- 172.21.15.17:0/2053373155 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb91407af80 0x7fb91407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:48.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.212+0000 7fb928db0640 1 --2- 172.21.15.17:0/2053373155 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb91407af80 0x7fb91407d440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb918005fd0 tx=0x7fb918005e20 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:48.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.216+0000 7fb921ffb640 1 -- 172.21.15.17:0/2053373155 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fb91008a060 con 0x7fb9241067f0 2024-09-20T18:39:48.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.452+0000 7fb92b014640 1 -- 172.21.15.17:0/2053373155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb924108d60 con 0x7fb9241067f0 2024-09-20T18:39:48.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.452+0000 7fb921ffb640 1 -- 172.21.15.17:0/2053373155 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2043 (secure 0 0 0) 0x7fb91008ef10 con 0x7fb9241067f0 2024-09-20T18:39:48.469 INFO:teuthology.orchestra.run.smithi017.stdout:e15 2024-09-20T18:39:48.469 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:33:05:524203+0000 2024-09-20T18:39:48.469 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:39:48.469 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:39:48.469 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:39:48.469 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:39:48.469 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:39:48.469 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:39:48.469 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 15 2024-09-20T18:39:48.469 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T18:39:48.469 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:39:48.470 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:33:05.065474+0000 2024-09-20T18:39:48.470 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:39:48.470 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:39:48.470 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:39:48.470 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:39:48.470 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:39:48.470 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:39:48.470 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:39:48.470 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:39:48.470 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2024-09-20T18:39:48.470 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:39:48.470 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:39:48.471 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:39:48.471 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14552,1=24325} 2024-09-20T18:39:48.471 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-09-20T18:39:48.471 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:39:48.471 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:39:48.471 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:39:48.471 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:39:48.471 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:39:48.471 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:39:48.471 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:39:48.471 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:39:48.471 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 14552 members: 24325,14552 2024-09-20T18:39:48.471 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{0:14552} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.17:6826/3360305779,v1:172.21.15.17:6827/3360305779] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:39:48.471 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{0:14568} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.17:6828/53113052,v1:172.21.15.17:6829/53113052] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:39:48.472 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{1:24325} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.172:6824/1043027893,v1:172.21.15.172:6825/1043027893] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:39:48.472 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{1:24339} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/2975309540,v1:172.21.15.172:6827/2975309540] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:39:48.472 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:39:48.472 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:39:48.472 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 15 2024-09-20T18:39:48.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.454+0000 7fb92b014640 1 -- 172.21.15.17:0/2053373155 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb91407af80 msgr2=0x7fb91407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:48.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.454+0000 7fb92b014640 1 --2- 172.21.15.17:0/2053373155 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb91407af80 0x7fb91407d440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb918005fd0 tx=0x7fb918005e20 comp rx=0 tx=0).stop 2024-09-20T18:39:48.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.454+0000 7fb92b014640 1 -- 172.21.15.17:0/2053373155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9241067f0 msgr2=0x7fb924198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:48.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.454+0000 7fb92b014640 1 --2- 172.21.15.17:0/2053373155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9241067f0 0x7fb924198d30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb910031460 tx=0x7fb9100048f0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.454+0000 7fb92b014640 1 -- 172.21.15.17:0/2053373155 shutdown_connections 2024-09-20T18:39:48.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.454+0000 7fb92b014640 1 --2- 172.21.15.17:0/2053373155 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb91407af80 0x7fb91407d440 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.454+0000 7fb92b014640 1 --2- 172.21.15.17:0/2053373155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9241067f0 0x7fb924198d30 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.454+0000 7fb92b014640 1 --2- 172.21.15.17:0/2053373155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9241007f0 0x7fb9241987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.454+0000 7fb92b014640 1 -- 172.21.15.17:0/2053373155 >> 172.21.15.17:0/2053373155 conn(0x7fb9240fc550 msgr2=0x7fb9240fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:48.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.455+0000 7fb92b014640 1 -- 172.21.15.17:0/2053373155 shutdown_connections 2024-09-20T18:39:48.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.455+0000 7fb92b014640 1 -- 172.21.15.17:0/2053373155 wait complete. 2024-09-20T18:39:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.540+0000 7f54746b5640 1 -- 172.21.15.17:0/3220610483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c106800 msgr2=0x7f546c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.540+0000 7f54746b5640 1 --2- 172.21.15.17:0/3220610483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c106800 0x7f546c106be0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5468009880 tx=0x7f546802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.540+0000 7f54746b5640 1 -- 172.21.15.17:0/3220610483 shutdown_connections 2024-09-20T18:39:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.540+0000 7f54746b5640 1 --2- 172.21.15.17:0/3220610483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f546c100800 0x7f546c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.540+0000 7f54746b5640 1 --2- 172.21.15.17:0/3220610483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c106800 0x7f546c106be0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.540+0000 7f54746b5640 1 -- 172.21.15.17:0/3220610483 >> 172.21.15.17:0/3220610483 conn(0x7f546c0fc520 msgr2=0x7f546c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.540+0000 7f54746b5640 1 -- 172.21.15.17:0/3220610483 shutdown_connections 2024-09-20T18:39:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.540+0000 7f54746b5640 1 -- 172.21.15.17:0/3220610483 wait complete. 2024-09-20T18:39:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.541+0000 7f54746b5640 1 Processor -- start 2024-09-20T18:39:48.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.541+0000 7f54746b5640 1 -- start start 2024-09-20T18:39:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.541+0000 7f54746b5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c100800 0x7f546c0fcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.541+0000 7f54746b5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f546c106800 0x7f546c0fd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.541+0000 7f54746b5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f546c10dcd0 con 0x7f546c100800 2024-09-20T18:39:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.541+0000 7f54746b5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f546c10db50 con 0x7f546c106800 2024-09-20T18:39:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.541+0000 7f5472451640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c100800 0x7f546c0fcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.541+0000 7f5472451640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c100800 0x7f546c0fcc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34844/0 (socket says 172.21.15.17:34844) 2024-09-20T18:39:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.541+0000 7f5472451640 1 -- 172.21.15.17:0/3743166036 learned_addr learned my addr 172.21.15.17:0/3743166036 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.541+0000 7f5471c50640 1 --2- 172.21.15.17:0/3743166036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f546c106800 0x7f546c0fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.541+0000 7f5472451640 1 -- 172.21.15.17:0/3743166036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f546c106800 msgr2=0x7f546c0fd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.541+0000 7f5472451640 1 --2- 172.21.15.17:0/3743166036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f546c106800 0x7f546c0fd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.542+0000 7f5472451640 1 -- 172.21.15.17:0/3743166036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546c0fd680 con 0x7f546c100800 2024-09-20T18:39:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.542+0000 7f5472451640 1 --2- 172.21.15.17:0/3743166036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c100800 0x7f546c0fcc00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5468031460 tx=0x7f54680045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.542+0000 7f54637fe640 1 -- 172.21.15.17:0/3743166036 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f546803f070 con 0x7f546c100800 2024-09-20T18:39:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.542+0000 7f54637fe640 1 -- 172.21.15.17:0/3743166036 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f54680035f0 con 0x7f546c100800 2024-09-20T18:39:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.542+0000 7f54746b5640 1 -- 172.21.15.17:0/3743166036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f546c0fd910 con 0x7f546c100800 2024-09-20T18:39:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.542+0000 7f54637fe640 1 -- 172.21.15.17:0/3743166036 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5468035030 con 0x7f546c100800 2024-09-20T18:39:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.542+0000 7f54746b5640 1 -- 172.21.15.17:0/3743166036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f546c1a3d50 con 0x7f546c100800 2024-09-20T18:39:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.543+0000 7f54746b5640 1 -- 172.21.15.17:0/3743166036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f546c101f40 con 0x7f546c100800 2024-09-20T18:39:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.544+0000 7f54637fe640 1 -- 172.21.15.17:0/3743166036 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5468042070 con 0x7f546c100800 2024-09-20T18:39:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.544+0000 7f54637fe640 1 --2- 172.21.15.17:0/3743166036 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f545807af80 0x7f545807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.544+0000 7f54637fe640 1 -- 172.21.15.17:0/3743166036 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f54680be860 con 0x7f546c100800 2024-09-20T18:39:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.544+0000 7f5471c50640 1 --2- 172.21.15.17:0/3743166036 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f545807af80 0x7f545807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.545+0000 7f5471c50640 1 --2- 172.21.15.17:0/3743166036 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f545807af80 0x7f545807d440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f545c005fd0 tx=0x7f545c005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.549+0000 7f54637fe640 1 -- 172.21.15.17:0/3743166036 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f5468089f90 con 0x7f546c100800 2024-09-20T18:39:48.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:48 smithi017 ceph-mon[28058]: from='client.14930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:39:48.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:48 smithi017 ceph-mon[28058]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:39:48.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:48 smithi017 ceph-mon[28058]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:48.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:48 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T18:39:48.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:48 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T18:39:48.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:48 smithi017 ceph-mon[28058]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:39:48.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:48 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/59800045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:48.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:48 smithi172 ceph-mon[35456]: from='client.14930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:39:48.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:48 smithi172 ceph-mon[35456]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:39:48.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:48 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:48.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:48 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T18:39:48.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:48 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T18:39:48.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:48 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:39:48.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:48 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/59800045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:39:48.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.757+0000 7f54746b5640 1 -- 172.21.15.17:0/3743166036 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f546c062630 con 0x7f545807af80 2024-09-20T18:39:48.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.758+0000 7f54637fe640 1 -- 172.21.15.17:0/3743166036 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7f546c062630 con 0x7f545807af80 2024-09-20T18:39:48.774 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:39:48.774 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:39:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:39:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:39:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:39:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-09-20T18:39:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:39:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "2/23 daemons upgraded", 2024-09-20T18:39:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mon daemons", 2024-09-20T18:39:48.775 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:39:48.775 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:39:48.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.760+0000 7f54746b5640 1 -- 172.21.15.17:0/3743166036 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f545807af80 msgr2=0x7f545807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:48.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.760+0000 7f54746b5640 1 --2- 172.21.15.17:0/3743166036 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f545807af80 0x7f545807d440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f545c005fd0 tx=0x7f545c005850 comp rx=0 tx=0).stop 2024-09-20T18:39:48.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.760+0000 7f54746b5640 1 -- 172.21.15.17:0/3743166036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c100800 msgr2=0x7f546c0fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:48.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.760+0000 7f54746b5640 1 --2- 172.21.15.17:0/3743166036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c100800 0x7f546c0fcc00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5468031460 tx=0x7f54680045e0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.761+0000 7f54746b5640 1 -- 172.21.15.17:0/3743166036 shutdown_connections 2024-09-20T18:39:48.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.761+0000 7f54746b5640 1 --2- 172.21.15.17:0/3743166036 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f545807af80 0x7f545807d440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.761+0000 7f54746b5640 1 --2- 172.21.15.17:0/3743166036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f546c106800 0x7f546c0fd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.761+0000 7f54746b5640 1 --2- 172.21.15.17:0/3743166036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f546c100800 0x7f546c0fcc00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.761+0000 7f54746b5640 1 -- 172.21.15.17:0/3743166036 >> 172.21.15.17:0/3743166036 conn(0x7f546c0fc520 msgr2=0x7f546c06a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:48.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.761+0000 7f54746b5640 1 -- 172.21.15.17:0/3743166036 shutdown_connections 2024-09-20T18:39:48.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.761+0000 7f54746b5640 1 -- 172.21.15.17:0/3743166036 wait complete. 2024-09-20T18:39:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.848+0000 7f812c337640 1 -- 172.21.15.17:0/2838560744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8124107900 msgr2=0x7f8124107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.848+0000 7f812c337640 1 --2- 172.21.15.17:0/2838560744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8124107900 0x7f8124107ce0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8120009880 tx=0x7f812002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.848+0000 7f812c337640 1 -- 172.21.15.17:0/2838560744 shutdown_connections 2024-09-20T18:39:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.848+0000 7f812c337640 1 --2- 172.21.15.17:0/2838560744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8124101900 0x7f8124101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.848+0000 7f812c337640 1 --2- 172.21.15.17:0/2838560744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8124107900 0x7f8124107ce0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.848+0000 7f812c337640 1 -- 172.21.15.17:0/2838560744 >> 172.21.15.17:0/2838560744 conn(0x7f81240fd600 msgr2=0x7f81240ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.848+0000 7f812c337640 1 -- 172.21.15.17:0/2838560744 shutdown_connections 2024-09-20T18:39:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.848+0000 7f812c337640 1 -- 172.21.15.17:0/2838560744 wait complete. 2024-09-20T18:39:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.849+0000 7f812c337640 1 Processor -- start 2024-09-20T18:39:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.849+0000 7f812c337640 1 -- start start 2024-09-20T18:39:48.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.849+0000 7f812c337640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8124101900 0x7f812419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:48.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.849+0000 7f812c337640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8124107900 0x7f812419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:48.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.849+0000 7f812c337640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f812410ee30 con 0x7f8124101900 2024-09-20T18:39:48.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.849+0000 7f812c337640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f812410ecb0 con 0x7f8124107900 2024-09-20T18:39:48.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.849+0000 7f812a0d3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8124101900 0x7f812419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:48.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.849+0000 7f812a0d3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8124101900 0x7f812419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34854/0 (socket says 172.21.15.17:34854) 2024-09-20T18:39:48.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.849+0000 7f812a0d3640 1 -- 172.21.15.17:0/4181305471 learned_addr learned my addr 172.21.15.17:0/4181305471 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:39:48.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.849+0000 7f81298d2640 1 --2- 172.21.15.17:0/4181305471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8124107900 0x7f812419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:48.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.849+0000 7f812a0d3640 1 -- 172.21.15.17:0/4181305471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8124107900 msgr2=0x7f812419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:48.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.849+0000 7f812a0d3640 1 --2- 172.21.15.17:0/4181305471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8124107900 0x7f812419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:48.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.849+0000 7f812a0d3640 1 -- 172.21.15.17:0/4181305471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8124197860 con 0x7f8124101900 2024-09-20T18:39:48.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.849+0000 7f81298d2640 1 --2- 172.21.15.17:0/4181305471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8124107900 0x7f812419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:39:48.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.850+0000 7f812a0d3640 1 --2- 172.21.15.17:0/4181305471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8124101900 0x7f812419d6a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8120031460 tx=0x7f81200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:48.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.850+0000 7f811b7fe640 1 -- 172.21.15.17:0/4181305471 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f812003f070 con 0x7f8124101900 2024-09-20T18:39:48.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.850+0000 7f812c337640 1 -- 172.21.15.17:0/4181305471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8124197af0 con 0x7f8124101900 2024-09-20T18:39:48.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.850+0000 7f811b7fe640 1 -- 172.21.15.17:0/4181305471 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8120004cf0 con 0x7f8124101900 2024-09-20T18:39:48.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.850+0000 7f811b7fe640 1 -- 172.21.15.17:0/4181305471 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8120035030 con 0x7f8124101900 2024-09-20T18:39:48.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.850+0000 7f812c337640 1 -- 172.21.15.17:0/4181305471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8124198020 con 0x7f8124101900 2024-09-20T18:39:48.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.851+0000 7f812c337640 1 -- 172.21.15.17:0/4181305471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8124103040 con 0x7f8124101900 2024-09-20T18:39:48.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.852+0000 7f811b7fe640 1 -- 172.21.15.17:0/4181305471 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8120042070 con 0x7f8124101900 2024-09-20T18:39:48.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.852+0000 7f811b7fe640 1 --2- 172.21.15.17:0/4181305471 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f811007af30 0x7f811007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:39:48.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.852+0000 7f811b7fe640 1 -- 172.21.15.17:0/4181305471 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f81200be650 con 0x7f8124101900 2024-09-20T18:39:48.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.852+0000 7f81298d2640 1 --2- 172.21.15.17:0/4181305471 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f811007af30 0x7f811007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:39:48.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.853+0000 7f81298d2640 1 --2- 172.21.15.17:0/4181305471 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f811007af30 0x7f811007d3f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8114006fd0 tx=0x7f8114008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:39:48.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:48.857+0000 7f811b7fe640 1 -- 172.21.15.17:0/4181305471 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f8120089c80 con 0x7f8124101900 2024-09-20T18:39:49.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:49.125+0000 7f812c337640 1 -- 172.21.15.17:0/4181305471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f8124198d90 con 0x7f8124101900 2024-09-20T18:39:49.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:49.125+0000 7f811b7fe640 1 -- 172.21.15.17:0/4181305471 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f812008eb30 con 0x7f8124101900 2024-09-20T18:39:49.142 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T18:39:49.142 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:39:49.142 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:39:49.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:49.127+0000 7f812c337640 1 -- 172.21.15.17:0/4181305471 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f811007af30 msgr2=0x7f811007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:49.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:49.127+0000 7f812c337640 1 --2- 172.21.15.17:0/4181305471 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f811007af30 0x7f811007d3f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8114006fd0 tx=0x7f8114008040 comp rx=0 tx=0).stop 2024-09-20T18:39:49.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:49.127+0000 7f812c337640 1 -- 172.21.15.17:0/4181305471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8124101900 msgr2=0x7f812419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:39:49.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:49.127+0000 7f812c337640 1 --2- 172.21.15.17:0/4181305471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8124101900 0x7f812419d6a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8120031460 tx=0x7f81200048f0 comp rx=0 tx=0).stop 2024-09-20T18:39:49.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:49.127+0000 7f812c337640 1 -- 172.21.15.17:0/4181305471 shutdown_connections 2024-09-20T18:39:49.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:49.127+0000 7f812c337640 1 --2- 172.21.15.17:0/4181305471 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f811007af30 0x7f811007d3f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:49.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:49.127+0000 7f812c337640 1 --2- 172.21.15.17:0/4181305471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8124107900 0x7f812419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:49.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:49.127+0000 7f812c337640 1 --2- 172.21.15.17:0/4181305471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8124101900 0x7f812419d6a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:39:49.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:49.127+0000 7f812c337640 1 -- 172.21.15.17:0/4181305471 >> 172.21.15.17:0/4181305471 conn(0x7f81240fd600 msgr2=0x7f81240fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:39:49.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:49.127+0000 7f812c337640 1 -- 172.21.15.17:0/4181305471 shutdown_connections 2024-09-20T18:39:49.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:39:49.128+0000 7f812c337640 1 -- 172.21.15.17:0/4181305471 wait complete. 2024-09-20T18:39:49.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:49 smithi172 ceph-mon[35456]: from='client.14938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:39:49.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:49 smithi172 ceph-mon[35456]: Upgrade: Updating mon.smithi017 2024-09-20T18:39:49.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:49 smithi172 ceph-mon[35456]: Deploying daemon mon.smithi017 on smithi017 2024-09-20T18:39:49.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:49 smithi172 ceph-mon[35456]: pgmap v99: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:49.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:49 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/2053373155' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-20T18:39:49.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:49 smithi172 ceph-mon[35456]: from='client.? 172.21.15.17:0/4181305471' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T18:39:49.848 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:49 smithi017 ceph-mon[28058]: from='client.14938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:39:49.849 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:49 smithi017 ceph-mon[28058]: Upgrade: Updating mon.smithi017 2024-09-20T18:39:49.849 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:49 smithi017 ceph-mon[28058]: Deploying daemon mon.smithi017 on smithi017 2024-09-20T18:39:49.849 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:49 smithi017 ceph-mon[28058]: pgmap v99: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:49.849 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:49 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/2053373155' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-20T18:39:49.850 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:49 smithi017 ceph-mon[28058]: from='client.? 172.21.15.17:0/4181305471' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-20T18:39:50.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:49 smithi017 systemd[1]: Stopping Ceph mon.smithi017 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:39:50.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:50 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[28054]: 2024-09-20T18:39:50.078+0000 7ffbd4ef2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi017 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T18:39:50.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:50 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[28054]: 2024-09-20T18:39:50.078+0000 7ffbd4ef2640 -1 mon.smithi017@0(leader) e2 *** Got Signal Terminated *** 2024-09-20T18:39:50.620 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:50 smithi017 podman[108808]: 2024-09-20 18:39:50.243045357 +0000 UTC m=+0.259133357 container died ab1f988c4cb28560ec54adfa85258fc26c34d7f2242a4450d96ac799313719db (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-ed8ee0f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-20T18:39:50.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:50 smithi017 podman[108808]: 2024-09-20 18:39:50.679044704 +0000 UTC m=+0.695132706 container cleanup ab1f988c4cb28560ec54adfa85258fc26c34d7f2242a4450d96ac799313719db (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-ed8ee0f, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-20T18:39:50.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:50 smithi017 bash[108808]: ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017 2024-09-20T18:39:51.132 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:50 smithi017 podman[108819]: 2024-09-20 18:39:50.855647228 +0000 UTC m=+0.612214875 container remove ab1f988c4cb28560ec54adfa85258fc26c34d7f2242a4450d96ac799313719db (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-ed8ee0f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-20T18:39:51.132 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 systemd[1]: ceph-7a27d282-777d-11ef-baf5-efdc52797490@mon.smithi017.service: Deactivated successfully. 2024-09-20T18:39:51.132 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 systemd[1]: Stopped Ceph mon.smithi017 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:39:51.132 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 systemd[1]: ceph-7a27d282-777d-11ef-baf5-efdc52797490@mon.smithi017.service: Consumed 14.626s CPU time. 2024-09-20T18:39:51.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 systemd[1]: Starting Ceph mon.smithi017 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:39:51.808 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 podman[108951]: 2024-09-20 18:39:51.523634433 +0000 UTC m=+0.104185517 container create 27c3175c63570ca1308ace62eb1ddbb526742e40080f44340943727d5ac5ac1f (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-20T18:39:51.808 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 podman[108951]: 2024-09-20 18:39:51.436337603 +0000 UTC m=+0.016888704 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:39:51.809 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 podman[108951]: 2024-09-20 18:39:51.767827896 +0000 UTC m=+0.348378989 container init 27c3175c63570ca1308ace62eb1ddbb526742e40080f44340943727d5ac5ac1f (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-20T18:39:51.809 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 podman[108951]: 2024-09-20 18:39:51.771460311 +0000 UTC m=+0.352011399 container start 27c3175c63570ca1308ace62eb1ddbb526742e40080f44340943727d5ac5ac1f (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=) 2024-09-20T18:39:52.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: set uid:gid to 167:167 (ceph:ceph) 2024-09-20T18:39:52.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev), process ceph-mon, pid 2 2024-09-20T18:39:52.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: pidfile_write: ignore empty --pid-file 2024-09-20T18:39:52.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: load: jerasure load: lrc 2024-09-20T18:39:52.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: RocksDB version: 7.9.2 2024-09-20T18:39:52.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Git sha 0 2024-09-20T18:39:52.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Compile date 2024-09-20 10:48:39 2024-09-20T18:39:52.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: DB SUMMARY 2024-09-20T18:39:52.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: DB Session ID: B9B7IE3GGJ198PKFBW4X 2024-09-20T18:39:52.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: CURRENT file: CURRENT 2024-09-20T18:39:52.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: IDENTITY file: IDENTITY 2024-09-20T18:39:52.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1518 Bytes 2024-09-20T18:39:52.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi017/store.db dir, Total Num: 1, files: 000032.sst 2024-09-20T18:39:52.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi017/store.db: 000030.log size: 2301470 ; 2024-09-20T18:39:52.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.error_if_exists: 0 2024-09-20T18:39:52.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.create_if_missing: 0 2024-09-20T18:39:52.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.paranoid_checks: 1 2024-09-20T18:39:52.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-20T18:39:52.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T18:39:52.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-20T18:39:52.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.env: 0x5557af1ae120 2024-09-20T18:39:52.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.fs: PosixFileSystem 2024-09-20T18:39:52.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.info_log: 0x5557b02af8e0 2024-09-20T18:39:52.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_file_opening_threads: 16 2024-09-20T18:39:52.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.statistics: (nil) 2024-09-20T18:39:52.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.use_fsync: 0 2024-09-20T18:39:52.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_log_file_size: 0 2024-09-20T18:39:52.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T18:39:52.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T18:39:52.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.keep_log_file_num: 1000 2024-09-20T18:39:52.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.recycle_log_file_num: 0 2024-09-20T18:39:52.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.allow_fallocate: 1 2024-09-20T18:39:52.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.allow_mmap_reads: 0 2024-09-20T18:39:52.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.allow_mmap_writes: 0 2024-09-20T18:39:52.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.use_direct_reads: 0 2024-09-20T18:39:52.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T18:39:52.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.create_missing_column_families: 0 2024-09-20T18:39:52.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.db_log_dir: 2024-09-20T18:39:52.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.wal_dir: 2024-09-20T18:39:52.156 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T18:39:52.156 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T18:39:52.156 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T18:39:52.156 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T18:39:52.156 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T18:39:52.156 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T18:39:52.156 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.advise_random_on_open: 1 2024-09-20T18:39:52.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.db_write_buffer_size: 0 2024-09-20T18:39:52.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.write_buffer_manager: 0x5557b02b3b80 2024-09-20T18:39:52.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T18:39:52.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T18:39:52.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T18:39:52.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.rate_limiter: (nil) 2024-09-20T18:39:52.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T18:39:52.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.wal_recovery_mode: 2 2024-09-20T18:39:52.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.enable_thread_tracking: 0 2024-09-20T18:39:52.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.enable_pipelined_write: 0 2024-09-20T18:39:52.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.unordered_write: 0 2024-09-20T18:39:52.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T18:39:52.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T18:39:52.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T18:39:52.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T18:39:52.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.row_cache: None 2024-09-20T18:39:52.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.wal_filter: None 2024-09-20T18:39:52.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T18:39:52.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.allow_ingest_behind: 0 2024-09-20T18:39:52.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.two_write_queues: 0 2024-09-20T18:39:52.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.manual_wal_flush: 0 2024-09-20T18:39:52.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.wal_compression: 0 2024-09-20T18:39:52.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.atomic_flush: 0 2024-09-20T18:39:52.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T18:39:52.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T18:39:52.159 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T18:39:52.159 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.log_readahead_size: 0 2024-09-20T18:39:52.159 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T18:39:52.159 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.best_efforts_recovery: 0 2024-09-20T18:39:52.159 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T18:39:52.159 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T18:39:52.159 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.allow_data_in_errors: 0 2024-09-20T18:39:52.159 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.db_host_id: __hostname__ 2024-09-20T18:39:52.159 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-20T18:39:52.159 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_background_jobs: 2 2024-09-20T18:39:52.159 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_background_compactions: -1 2024-09-20T18:39:52.159 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_subcompactions: 1 2024-09-20T18:39:52.159 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T18:39:52.159 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T18:39:52.160 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T18:39:52.160 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_total_wal_size: 0 2024-09-20T18:39:52.160 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T18:39:52.160 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T18:39:52.160 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T18:39:52.160 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T18:39:52.160 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_open_files: -1 2024-09-20T18:39:52.160 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.bytes_per_sync: 0 2024-09-20T18:39:52.160 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T18:39:52.160 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T18:39:52.160 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compaction_readahead_size: 0 2024-09-20T18:39:52.160 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_background_flushes: -1 2024-09-20T18:39:52.160 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Compression algorithms supported: 2024-09-20T18:39:52.160 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: kZSTD supported: 0 2024-09-20T18:39:52.161 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: kXpressCompression supported: 0 2024-09-20T18:39:52.161 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: kBZip2Compression supported: 0 2024-09-20T18:39:52.161 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T18:39:52.161 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: kLZ4Compression supported: 1 2024-09-20T18:39:52.161 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: kZlibCompression supported: 1 2024-09-20T18:39:52.161 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: kLZ4HCCompression supported: 1 2024-09-20T18:39:52.161 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: kSnappyCompression supported: 1 2024-09-20T18:39:52.161 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T18:39:52.161 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-20T18:39:52.161 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi017/store.db/MANIFEST-000015 2024-09-20T18:39:52.161 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-20T18:39:52.161 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T18:39:52.161 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.merge_operator: 2024-09-20T18:39:52.161 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compaction_filter: None 2024-09-20T18:39:52.161 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compaction_filter_factory: None 2024-09-20T18:39:52.162 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.sst_partitioner_factory: None 2024-09-20T18:39:52.162 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T18:39:52.162 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T18:39:52.162 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5557b02af540) 2024-09-20T18:39:52.162 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: cache_index_and_filter_blocks: 1 2024-09-20T18:39:52.162 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T18:39:52.162 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T18:39:52.162 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: pin_top_level_index_and_filter: 1 2024-09-20T18:39:52.162 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: index_type: 0 2024-09-20T18:39:52.162 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: data_block_index_type: 0 2024-09-20T18:39:52.162 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: index_shortening: 1 2024-09-20T18:39:52.162 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-20T18:39:52.162 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: checksum: 4 2024-09-20T18:39:52.162 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: no_block_cache: 0 2024-09-20T18:39:52.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_cache: 0x5557b02a3610 2024-09-20T18:39:52.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_cache_name: BinnedLRUCache 2024-09-20T18:39:52.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_cache_options: 2024-09-20T18:39:52.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: capacity : 536870912 2024-09-20T18:39:52.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: num_shard_bits : 4 2024-09-20T18:39:52.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: strict_capacity_limit : 0 2024-09-20T18:39:52.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: high_pri_pool_ratio: 0.000 2024-09-20T18:39:52.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_cache_compressed: (nil) 2024-09-20T18:39:52.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: persistent_cache: (nil) 2024-09-20T18:39:52.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_size: 4096 2024-09-20T18:39:52.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_size_deviation: 10 2024-09-20T18:39:52.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_restart_interval: 16 2024-09-20T18:39:52.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: index_block_restart_interval: 1 2024-09-20T18:39:52.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: metadata_block_size: 4096 2024-09-20T18:39:52.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: partition_filters: 0 2024-09-20T18:39:52.164 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: use_delta_encoding: 1 2024-09-20T18:39:52.164 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: filter_policy: bloomfilter 2024-09-20T18:39:52.164 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: whole_key_filtering: 1 2024-09-20T18:39:52.164 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: verify_compression: 0 2024-09-20T18:39:52.164 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: read_amp_bytes_per_bit: 0 2024-09-20T18:39:52.164 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: format_version: 5 2024-09-20T18:39:52.164 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: enable_index_compression: 1 2024-09-20T18:39:52.164 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_align: 0 2024-09-20T18:39:52.164 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: max_auto_readahead_size: 262144 2024-09-20T18:39:52.164 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: prepopulate_block_cache: 0 2024-09-20T18:39:52.164 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: initial_auto_readahead_size: 8192 2024-09-20T18:39:52.164 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: num_file_reads_for_auto_readahead: 2 2024-09-20T18:39:52.164 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.write_buffer_size: 33554432 2024-09-20T18:39:52.164 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_write_buffer_number: 2 2024-09-20T18:39:52.165 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compression: NoCompression 2024-09-20T18:39:52.165 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.bottommost_compression: Disabled 2024-09-20T18:39:52.165 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.prefix_extractor: nullptr 2024-09-20T18:39:52.165 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T18:39:52.165 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.num_levels: 7 2024-09-20T18:39:52.165 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T18:39:52.165 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T18:39:52.165 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T18:39:52.165 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T18:39:52.165 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T18:39:52.165 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T18:39:52.165 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T18:39:52.165 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T18:39:52.165 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T18:39:52.166 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T18:39:52.166 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-20T18:39:52.166 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-20T18:39:52.166 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T18:39:52.166 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compression_opts.level: 32767 2024-09-20T18:39:52.166 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compression_opts.strategy: 0 2024-09-20T18:39:52.166 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T18:39:52.166 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T18:39:52.166 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-20T18:39:52.166 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T18:39:52.166 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compression_opts.enabled: false 2024-09-20T18:39:52.166 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-20T18:39:52.166 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T18:39:52.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T18:39:52.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T18:39:52.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.target_file_size_base: 67108864 2024-09-20T18:39:52.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T18:39:52.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T18:39:52.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T18:39:52.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T18:39:52.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T18:39:52.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T18:39:52.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T18:39:52.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T18:39:52.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T18:39:52.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T18:39:52.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T18:39:52.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T18:39:52.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T18:39:52.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-20T18:39:52.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.arena_block_size: 1048576 2024-09-20T18:39:52.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T18:39:52.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T18:39:52.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.disable_auto_compactions: 0 2024-09-20T18:39:52.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T18:39:52.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T18:39:52.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T18:39:52.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T18:39:52.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T18:39:52.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T18:39:52.169 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T18:39:52.169 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T18:39:52.169 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T18:39:52.169 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T18:39:52.169 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-20T18:39:52.169 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.inplace_update_support: 0 2024-09-20T18:39:52.169 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T18:39:52.169 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T18:39:52.169 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T18:39:52.169 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T18:39:52.169 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.bloom_locality: 0 2024-09-20T18:39:52.169 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.max_successive_merges: 0 2024-09-20T18:39:52.169 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T18:39:52.170 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.paranoid_file_checks: 0 2024-09-20T18:39:52.170 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.force_consistency_checks: 1 2024-09-20T18:39:52.170 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.report_bg_io_stats: 0 2024-09-20T18:39:52.170 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.ttl: 2592000 2024-09-20T18:39:52.170 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T18:39:52.170 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-20T18:39:52.170 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-20T18:39:52.170 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.enable_blob_files: false 2024-09-20T18:39:52.170 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.min_blob_size: 0 2024-09-20T18:39:52.170 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.blob_file_size: 268435456 2024-09-20T18:39:52.170 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T18:39:52.170 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T18:39:52.170 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T18:39:52.170 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-20T18:39:52.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-20T18:39:52.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.blob_file_starting_level: 0 2024-09-20T18:39:52.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-20T18:39:52.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T18:39:52.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi017/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12061, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-20T18:39:52.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-20T18:39:52.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d18da2d4-b303-45bd-aa85-26773614b9d1 2024-09-20T18:39:52.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726857591799796, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-20T18:39:52.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-20T18:39:52.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726857591810044, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 2009213, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12063, "largest_seqno": 13646, "table_properties": {"data_size": 2001582, "index_size": 4733, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1861, "raw_key_size": 16837, "raw_average_key_size": 23, "raw_value_size": 1986274, "raw_average_value_size": 2770, "num_data_blocks": 216, "num_entries": 717, "num_filter_entries": 717, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726857591, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d18da2d4-b303-45bd-aa85-26773614b9d1", "db_session_id": "B9B7IE3GGJ198PKFBW4X", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-20T18:39:52.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726857591810178, "job": 1, "event": "recovery_finished"} 2024-09-20T18:39:52.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-20T18:39:52.172 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T18:39:52.172 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi017/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T18:39:52.172 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5557b02d2e00 2024-09-20T18:39:52.172 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: DB pointer 0x5557b03d4000 2024-09-20T18:39:52.172 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-20T18:39:52.172 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-20T18:39:52.172 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ** DB Stats ** 2024-09-20T18:39:52.172 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T18:39:52.172 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T18:39:52.172 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T18:39:52.172 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T18:39:52.172 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T18:39:52.172 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T18:39:52.172 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T18:39:52.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-09-20T18:39:52.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ** Compaction Stats [default] ** 2024-09-20T18:39:52.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T18:39:52.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-20T18:39:52.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: L0 1/0 1.92 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 502.0 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T18:39:52.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: L6 1/0 7.41 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-20T18:39:52.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Sum 2/0 9.33 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 502.0 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T18:39:52.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 502.0 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T18:39:52.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-09-20T18:39:52.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ** Compaction Stats [default] ** 2024-09-20T18:39:52.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T18:39:52.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T18:39:52.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 502.0 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T18:39:52.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-09-20T18:39:52.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-20T18:39:52.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-09-20T18:39:52.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T18:39:52.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-20T18:39:52.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T18:39:52.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T18:39:52.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T18:39:52.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-20T18:39:52.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Cumulative compaction: 0.00 GB write, 144.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T18:39:52.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Interval compaction: 0.00 GB write, 144.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T18:39:52.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T18:39:52.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Block cache BinnedLRUCache@0x5557b02a3610#2 capacity: 512.00 MB usage: 7.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-20T18:39:52.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,5.08 KB,0.000968575%) Misc(1,0.00 KB,0%) 2024-09-20T18:39:52.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-09-20T18:39:52.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-20T18:39:52.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: starting mon.smithi017 rank 0 at public addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] at bind addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi017 fsid 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:39:52.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: mon.smithi017@-1(???) e2 preinit fsid 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:39:52.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: mon.smithi017@-1(???).mds e15 new map 2024-09-20T18:39:52.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: mon.smithi017@-1(???).mds e15 print_map 2024-09-20T18:39:52.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: e15 2024-09-20T18:39:52.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: btime 2024-09-20T18:33:05:524203+0000 2024-09-20T18:39:52.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:39:52.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:39:52.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: legacy client fscid: 1 2024-09-20T18:39:52.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-09-20T18:39:52.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Filesystem 'cephfs' (1) 2024-09-20T18:39:52.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: fs_name cephfs 2024-09-20T18:39:52.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: epoch 15 2024-09-20T18:39:52.176 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T18:39:52.176 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:39:52.176 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: modified 2024-09-20T18:33:05.065474+0000 2024-09-20T18:39:52.176 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: tableserver 0 2024-09-20T18:39:52.176 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: root 0 2024-09-20T18:39:52.176 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: session_timeout 60 2024-09-20T18:39:52.176 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: session_autoclose 300 2024-09-20T18:39:52.176 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: max_file_size 1099511627776 2024-09-20T18:39:52.176 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: max_xattr_size 65536 2024-09-20T18:39:52.176 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: required_client_features {} 2024-09-20T18:39:52.176 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: last_failure 0 2024-09-20T18:39:52.176 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: last_failure_osd_epoch 0 2024-09-20T18:39:52.176 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:39:52.176 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: max_mds 2 2024-09-20T18:39:52.176 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: in 0,1 2024-09-20T18:39:52.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: up {0=14552,1=24325} 2024-09-20T18:39:52.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: failed 2024-09-20T18:39:52.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: damaged 2024-09-20T18:39:52.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: stopped 2024-09-20T18:39:52.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: data_pools [3] 2024-09-20T18:39:52.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: metadata_pool 2 2024-09-20T18:39:52.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: inline_data enabled 2024-09-20T18:39:52.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: balancer 2024-09-20T18:39:52.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: bal_rank_mask -1 2024-09-20T18:39:52.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: standby_count_wanted 1 2024-09-20T18:39:52.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: qdb_cluster leader: 14552 members: 24325,14552 2024-09-20T18:39:52.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: [mds.cephfs.smithi017.puqizo{0:14552} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.17:6826/3360305779,v1:172.21.15.17:6827/3360305779] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:39:52.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: [mds.cephfs.smithi017.xhlvpy{0:14568} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.17:6828/53113052,v1:172.21.15.17:6829/53113052] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:39:52.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: [mds.cephfs.smithi172.mugtlk{1:24325} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.172:6824/1043027893,v1:172.21.15.172:6825/1043027893] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:39:52.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: [mds.cephfs.smithi172.liatxm{1:24339} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/2975309540,v1:172.21.15.172:6827/2975309540] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:39:52.178 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-09-20T18:39:52.178 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-09-20T18:39:52.178 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: mon.smithi017@-1(???).osd e46 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-20T18:39:52.178 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: mon.smithi017@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-20T18:39:52.178 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: mon.smithi017@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-20T18:39:52.178 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: mon.smithi017@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-20T18:39:52.178 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 ceph-mon[108970]: mon.smithi017@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-20T18:39:52.178 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 bash[108951]: 27c3175c63570ca1308ace62eb1ddbb526742e40080f44340943727d5ac5ac1f 2024-09-20T18:39:52.178 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:51 smithi017 systemd[1]: Started Ceph mon.smithi017 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:39:53.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: pgmap v100: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:53.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:39:53.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: pgmap v101: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:53.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: mon.smithi017 calling monitor election 2024-09-20T18:39:53.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: mon.smithi017 is new leader, mons smithi017,smithi172 in quorum (ranks 0,1) 2024-09-20T18:39:53.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: monmap epoch 2 2024-09-20T18:39:53.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: fsid 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:39:53.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: last_changed 2024-09-20T18:28:32.345344+0000 2024-09-20T18:39:53.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: created 2024-09-20T18:26:13.426622+0000 2024-09-20T18:39:53.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: min_mon_release 19 (squid) 2024-09-20T18:39:53.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: election_strategy: 1 2024-09-20T18:39:53.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.smithi017 2024-09-20T18:39:53.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.smithi172 2024-09-20T18:39:53.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 2 up:standby-replay 2024-09-20T18:39:53.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: osdmap e46: 6 total, 6 up, 6 in 2024-09-20T18:39:53.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: mgrmap e33: smithi017.xusjwd(active, since 3m), standbys: smithi172.jczphg 2024-09-20T18:39:53.653 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T18:39:53.653 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:39:53.653 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:39:53.653 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: from='mgr.14754 ' entity='' 2024-09-20T18:39:53.653 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:53.653 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:53 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:39:53.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: pgmap v100: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:53.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-20T18:39:53.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: pgmap v101: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:53.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: mon.smithi017 calling monitor election 2024-09-20T18:39:53.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: mon.smithi017 is new leader, mons smithi017,smithi172 in quorum (ranks 0,1) 2024-09-20T18:39:53.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: monmap epoch 2 2024-09-20T18:39:53.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: fsid 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:39:53.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: last_changed 2024-09-20T18:28:32.345344+0000 2024-09-20T18:39:53.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: created 2024-09-20T18:26:13.426622+0000 2024-09-20T18:39:53.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: min_mon_release 19 (squid) 2024-09-20T18:39:53.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: election_strategy: 1 2024-09-20T18:39:53.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.smithi017 2024-09-20T18:39:53.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.smithi172 2024-09-20T18:39:53.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 2 up:standby-replay 2024-09-20T18:39:53.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: osdmap e46: 6 total, 6 up, 6 in 2024-09-20T18:39:53.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: mgrmap e33: smithi017.xusjwd(active, since 3m), standbys: smithi172.jczphg 2024-09-20T18:39:53.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T18:39:53.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:39:53.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:39:53.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='' 2024-09-20T18:39:53.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:53.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:53 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:39:55.642 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:55 smithi017 ceph-mon[108970]: pgmap v102: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:55.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:55 smithi172 ceph-mon[35456]: pgmap v102: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:57.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:57 smithi017 ceph-mon[108970]: pgmap v103: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:57.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:57 smithi172 ceph-mon[35456]: pgmap v103: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:39:59.808 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:59 smithi017 ceph-mon[108970]: pgmap v104: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:59.808 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:59 smithi017 ceph-mon[108970]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:59.808 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:59 smithi017 ceph-mon[108970]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:59.808 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:59 smithi017 ceph-mon[108970]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:59.808 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:39:59 smithi017 ceph-mon[108970]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:59 smithi172 ceph-mon[35456]: pgmap v104: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:39:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:59 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:59 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:59 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:39:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:39:59 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:00.796 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:00 smithi017 ceph-mon[108970]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T18:40:00.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:00 smithi172 ceph-mon[35456]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T18:40:01.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:01 smithi017 ceph-mon[108970]: pgmap v105: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:01.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:01 smithi172 ceph-mon[35456]: pgmap v105: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:03.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:03 smithi017 ceph-mon[108970]: pgmap v106: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:40:03.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:03 smithi017 ceph-mon[108970]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:03.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:03 smithi017 ceph-mon[108970]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:03.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:03 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:40:03.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:03 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:40:03.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:03 smithi017 ceph-mon[108970]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:03.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:03 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:40:03.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:03 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:40:03.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:03 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T18:40:03.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:03 smithi172 ceph-mon[35456]: pgmap v106: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:40:03.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:03 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:03.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:03 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:03.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:03 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:40:03.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:03 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-20T18:40:03.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:03 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:03.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:03 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-20T18:40:03.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:03 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "versions"}]: dispatch 2024-09-20T18:40:03.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:03 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-20T18:40:05.274 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:04 smithi172 ceph-mon[35456]: Upgrade: Updating mon.smithi172 2024-09-20T18:40:05.275 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:04 smithi172 ceph-mon[35456]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:05.275 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:04 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T18:40:05.275 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:04 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T18:40:05.275 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:04 smithi172 ceph-mon[35456]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:40:05.275 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:04 smithi172 ceph-mon[35456]: Deploying daemon mon.smithi172 on smithi172 2024-09-20T18:40:05.275 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:04 smithi172 ceph-mon[35456]: pgmap v107: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:05.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:04 smithi017 ceph-mon[108970]: Upgrade: Updating mon.smithi172 2024-09-20T18:40:05.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:04 smithi017 ceph-mon[108970]: from='mgr.14754 ' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:05.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:04 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-20T18:40:05.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:04 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-20T18:40:05.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:04 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-20T18:40:05.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:04 smithi017 ceph-mon[108970]: Deploying daemon mon.smithi172 on smithi172 2024-09-20T18:40:05.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:04 smithi017 ceph-mon[108970]: pgmap v107: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:05.830 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:05 smithi172 systemd[1]: Stopping Ceph mon.smithi172 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:40:06.147 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:05 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi172[35452]: 2024-09-20T18:40:05.814+0000 7fbc38601640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi172 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T18:40:06.147 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:05 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi172[35452]: 2024-09-20T18:40:05.814+0000 7fbc38601640 -1 mon.smithi172@1(peon) e2 *** Got Signal Terminated *** 2024-09-20T18:40:06.147 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:05 smithi172 podman[80271]: 2024-09-20 18:40:05.835173706 +0000 UTC m=+0.146161000 container died 9eea40352787c0d17a0de868f0aa621e40223af1f0ee82b70d057842e3b9729b (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi172, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-ed8ee0f) 2024-09-20T18:40:06.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:06 smithi172 podman[80271]: 2024-09-20 18:40:06.222521937 +0000 UTC m=+0.533509221 container cleanup 9eea40352787c0d17a0de868f0aa621e40223af1f0ee82b70d057842e3b9729b (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi172, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-ed8ee0f, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-20T18:40:06.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:06 smithi172 bash[80271]: ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi172 2024-09-20T18:40:06.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:06 smithi172 podman[80286]: 2024-09-20 18:40:06.491156548 +0000 UTC m=+0.652705982 container remove 9eea40352787c0d17a0de868f0aa621e40223af1f0ee82b70d057842e3b9729b (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi172, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-ed8ee0f, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T18:40:06.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:06 smithi172 systemd[1]: ceph-7a27d282-777d-11ef-baf5-efdc52797490@mon.smithi172.service: Deactivated successfully. 2024-09-20T18:40:06.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:06 smithi172 systemd[1]: Stopped Ceph mon.smithi172 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:40:06.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:06 smithi172 systemd[1]: ceph-7a27d282-777d-11ef-baf5-efdc52797490@mon.smithi172.service: Consumed 7.502s CPU time. 2024-09-20T18:40:06.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:06 smithi172 systemd[1]: Starting Ceph mon.smithi172 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:40:07.204 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 podman[80413]: 2024-09-20 18:40:06.974799274 +0000 UTC m=+0.015898111 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:40:07.204 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 podman[80413]: 2024-09-20 18:40:07.083484628 +0000 UTC m=+0.124583456 container create 4be383715faa51bf34c490a931c31af9fd43681044cd95f26a6e0a6dd98e4ce6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi172, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T18:40:07.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 podman[80413]: 2024-09-20 18:40:07.32813716 +0000 UTC m=+0.369236003 container init 4be383715faa51bf34c490a931c31af9fd43681044cd95f26a6e0a6dd98e4ce6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi172, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-20T18:40:07.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 podman[80413]: 2024-09-20 18:40:07.331565683 +0000 UTC m=+0.372664514 container start 4be383715faa51bf34c490a931c31af9fd43681044cd95f26a6e0a6dd98e4ce6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi172, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-20T18:40:07.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: set uid:gid to 167:167 (ceph:ceph) 2024-09-20T18:40:07.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev), process ceph-mon, pid 2 2024-09-20T18:40:07.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: pidfile_write: ignore empty --pid-file 2024-09-20T18:40:07.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: load: jerasure load: lrc 2024-09-20T18:40:07.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: RocksDB version: 7.9.2 2024-09-20T18:40:07.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Git sha 0 2024-09-20T18:40:07.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Compile date 2024-09-20 10:48:39 2024-09-20T18:40:07.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: DB SUMMARY 2024-09-20T18:40:07.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: DB Session ID: O5FY2F1FAAB6WKIHODP7 2024-09-20T18:40:07.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: CURRENT file: CURRENT 2024-09-20T18:40:07.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: IDENTITY file: IDENTITY 2024-09-20T18:40:07.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1411 Bytes 2024-09-20T18:40:07.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi172/store.db dir, Total Num: 1, files: 000027.sst 2024-09-20T18:40:07.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi172/store.db: 000025.log size: 4027291 ; 2024-09-20T18:40:07.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.error_if_exists: 0 2024-09-20T18:40:07.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.create_if_missing: 0 2024-09-20T18:40:07.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.paranoid_checks: 1 2024-09-20T18:40:07.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-20T18:40:07.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-20T18:40:07.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-20T18:40:07.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.env: 0x55e26a66f120 2024-09-20T18:40:07.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.fs: PosixFileSystem 2024-09-20T18:40:07.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.info_log: 0x55e26b7e78e0 2024-09-20T18:40:07.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_file_opening_threads: 16 2024-09-20T18:40:07.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.statistics: (nil) 2024-09-20T18:40:07.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.use_fsync: 0 2024-09-20T18:40:07.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_log_file_size: 0 2024-09-20T18:40:07.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-20T18:40:07.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-20T18:40:07.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.keep_log_file_num: 1000 2024-09-20T18:40:07.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.recycle_log_file_num: 0 2024-09-20T18:40:07.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.allow_fallocate: 1 2024-09-20T18:40:07.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.allow_mmap_reads: 0 2024-09-20T18:40:07.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.allow_mmap_writes: 0 2024-09-20T18:40:07.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.use_direct_reads: 0 2024-09-20T18:40:07.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-20T18:40:07.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.create_missing_column_families: 0 2024-09-20T18:40:07.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.db_log_dir: 2024-09-20T18:40:07.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.wal_dir: 2024-09-20T18:40:07.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-20T18:40:07.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-20T18:40:07.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-20T18:40:07.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-20T18:40:07.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-20T18:40:07.466 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-20T18:40:07.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.advise_random_on_open: 1 2024-09-20T18:40:07.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.db_write_buffer_size: 0 2024-09-20T18:40:07.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.write_buffer_manager: 0x55e26b7ebb80 2024-09-20T18:40:07.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-20T18:40:07.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-20T18:40:07.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-20T18:40:07.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.rate_limiter: (nil) 2024-09-20T18:40:07.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-20T18:40:07.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.wal_recovery_mode: 2 2024-09-20T18:40:07.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.enable_thread_tracking: 0 2024-09-20T18:40:07.467 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.enable_pipelined_write: 0 2024-09-20T18:40:07.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.unordered_write: 0 2024-09-20T18:40:07.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-20T18:40:07.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-20T18:40:07.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-20T18:40:07.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-20T18:40:07.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.row_cache: None 2024-09-20T18:40:07.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.wal_filter: None 2024-09-20T18:40:07.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-20T18:40:07.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.allow_ingest_behind: 0 2024-09-20T18:40:07.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.two_write_queues: 0 2024-09-20T18:40:07.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.manual_wal_flush: 0 2024-09-20T18:40:07.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.wal_compression: 0 2024-09-20T18:40:07.469 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.atomic_flush: 0 2024-09-20T18:40:07.469 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-20T18:40:07.469 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-20T18:40:07.469 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-20T18:40:07.469 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.log_readahead_size: 0 2024-09-20T18:40:07.469 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-20T18:40:07.469 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.best_efforts_recovery: 0 2024-09-20T18:40:07.469 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-20T18:40:07.469 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-20T18:40:07.469 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.allow_data_in_errors: 0 2024-09-20T18:40:07.469 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.db_host_id: __hostname__ 2024-09-20T18:40:07.469 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-20T18:40:07.470 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_background_jobs: 2 2024-09-20T18:40:07.470 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_background_compactions: -1 2024-09-20T18:40:07.470 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_subcompactions: 1 2024-09-20T18:40:07.470 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-20T18:40:07.470 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-20T18:40:07.470 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-20T18:40:07.470 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_total_wal_size: 0 2024-09-20T18:40:07.470 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-20T18:40:07.470 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-20T18:40:07.470 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-20T18:40:07.470 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-20T18:40:07.470 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_open_files: -1 2024-09-20T18:40:07.471 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.bytes_per_sync: 0 2024-09-20T18:40:07.471 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-20T18:40:07.471 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-20T18:40:07.471 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compaction_readahead_size: 0 2024-09-20T18:40:07.471 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_background_flushes: -1 2024-09-20T18:40:07.471 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Compression algorithms supported: 2024-09-20T18:40:07.471 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: kZSTD supported: 0 2024-09-20T18:40:07.471 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: kXpressCompression supported: 0 2024-09-20T18:40:07.471 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: kBZip2Compression supported: 0 2024-09-20T18:40:07.471 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-20T18:40:07.471 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: kLZ4Compression supported: 1 2024-09-20T18:40:07.472 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: kZlibCompression supported: 1 2024-09-20T18:40:07.472 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: kLZ4HCCompression supported: 1 2024-09-20T18:40:07.472 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: kSnappyCompression supported: 1 2024-09-20T18:40:07.472 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-20T18:40:07.472 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-20T18:40:07.472 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi172/store.db/MANIFEST-000010 2024-09-20T18:40:07.472 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-20T18:40:07.472 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-20T18:40:07.472 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.merge_operator: 2024-09-20T18:40:07.472 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compaction_filter: None 2024-09-20T18:40:07.472 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compaction_filter_factory: None 2024-09-20T18:40:07.472 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.sst_partitioner_factory: None 2024-09-20T18:40:07.473 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-20T18:40:07.473 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-20T18:40:07.473 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e26b7e7540) 2024-09-20T18:40:07.473 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: cache_index_and_filter_blocks: 1 2024-09-20T18:40:07.473 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-20T18:40:07.473 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-20T18:40:07.473 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: pin_top_level_index_and_filter: 1 2024-09-20T18:40:07.473 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: index_type: 0 2024-09-20T18:40:07.473 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: data_block_index_type: 0 2024-09-20T18:40:07.473 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: index_shortening: 1 2024-09-20T18:40:07.473 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-20T18:40:07.474 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: checksum: 4 2024-09-20T18:40:07.474 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: no_block_cache: 0 2024-09-20T18:40:07.474 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_cache: 0x55e26b7db610 2024-09-20T18:40:07.474 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_cache_name: BinnedLRUCache 2024-09-20T18:40:07.474 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_cache_options: 2024-09-20T18:40:07.474 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: capacity : 536870912 2024-09-20T18:40:07.474 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: num_shard_bits : 4 2024-09-20T18:40:07.474 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: strict_capacity_limit : 0 2024-09-20T18:40:07.474 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: high_pri_pool_ratio: 0.000 2024-09-20T18:40:07.474 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_cache_compressed: (nil) 2024-09-20T18:40:07.474 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: persistent_cache: (nil) 2024-09-20T18:40:07.474 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_size: 4096 2024-09-20T18:40:07.475 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_size_deviation: 10 2024-09-20T18:40:07.475 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_restart_interval: 16 2024-09-20T18:40:07.475 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: index_block_restart_interval: 1 2024-09-20T18:40:07.475 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: metadata_block_size: 4096 2024-09-20T18:40:07.475 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: partition_filters: 0 2024-09-20T18:40:07.475 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: use_delta_encoding: 1 2024-09-20T18:40:07.475 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: filter_policy: bloomfilter 2024-09-20T18:40:07.475 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: whole_key_filtering: 1 2024-09-20T18:40:07.475 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: verify_compression: 0 2024-09-20T18:40:07.475 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: read_amp_bytes_per_bit: 0 2024-09-20T18:40:07.475 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: format_version: 5 2024-09-20T18:40:07.475 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: enable_index_compression: 1 2024-09-20T18:40:07.476 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: block_align: 0 2024-09-20T18:40:07.476 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: max_auto_readahead_size: 262144 2024-09-20T18:40:07.476 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: prepopulate_block_cache: 0 2024-09-20T18:40:07.476 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: initial_auto_readahead_size: 8192 2024-09-20T18:40:07.476 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: num_file_reads_for_auto_readahead: 2 2024-09-20T18:40:07.476 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.write_buffer_size: 33554432 2024-09-20T18:40:07.476 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_write_buffer_number: 2 2024-09-20T18:40:07.476 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compression: NoCompression 2024-09-20T18:40:07.476 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.bottommost_compression: Disabled 2024-09-20T18:40:07.476 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.prefix_extractor: nullptr 2024-09-20T18:40:07.476 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-20T18:40:07.476 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.num_levels: 7 2024-09-20T18:40:07.477 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-20T18:40:07.477 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-20T18:40:07.477 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-20T18:40:07.477 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-20T18:40:07.477 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-20T18:40:07.477 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-20T18:40:07.477 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-20T18:40:07.477 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-20T18:40:07.477 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-20T18:40:07.477 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-20T18:40:07.477 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-20T18:40:07.477 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-20T18:40:07.478 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-20T18:40:07.478 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compression_opts.level: 32767 2024-09-20T18:40:07.478 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compression_opts.strategy: 0 2024-09-20T18:40:07.478 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-20T18:40:07.478 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-20T18:40:07.478 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-20T18:40:07.478 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-20T18:40:07.478 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compression_opts.enabled: false 2024-09-20T18:40:07.478 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-20T18:40:07.478 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-20T18:40:07.478 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-20T18:40:07.478 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-20T18:40:07.479 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.target_file_size_base: 67108864 2024-09-20T18:40:07.479 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-20T18:40:07.479 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-20T18:40:07.479 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-20T18:40:07.479 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-20T18:40:07.479 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-20T18:40:07.479 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-20T18:40:07.479 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-20T18:40:07.479 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-20T18:40:07.479 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-20T18:40:07.479 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-20T18:40:07.479 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-20T18:40:07.480 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-20T18:40:07.480 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-20T18:40:07.480 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-20T18:40:07.480 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.arena_block_size: 1048576 2024-09-20T18:40:07.480 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-20T18:40:07.480 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-20T18:40:07.480 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.disable_auto_compactions: 0 2024-09-20T18:40:07.480 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-20T18:40:07.480 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-20T18:40:07.480 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-20T18:40:07.480 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-20T18:40:07.480 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-20T18:40:07.481 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-20T18:40:07.481 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-20T18:40:07.481 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-20T18:40:07.481 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-20T18:40:07.481 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-20T18:40:07.481 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-20T18:40:07.481 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.inplace_update_support: 0 2024-09-20T18:40:07.481 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-20T18:40:07.481 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-20T18:40:07.481 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-20T18:40:07.481 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-20T18:40:07.481 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.bloom_locality: 0 2024-09-20T18:40:07.482 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.max_successive_merges: 0 2024-09-20T18:40:07.482 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-20T18:40:07.482 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.paranoid_file_checks: 0 2024-09-20T18:40:07.482 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.force_consistency_checks: 1 2024-09-20T18:40:07.482 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.report_bg_io_stats: 0 2024-09-20T18:40:07.482 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.ttl: 2592000 2024-09-20T18:40:07.482 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-20T18:40:07.482 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-20T18:40:07.482 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-20T18:40:07.482 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.enable_blob_files: false 2024-09-20T18:40:07.482 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.min_blob_size: 0 2024-09-20T18:40:07.483 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.blob_file_size: 268435456 2024-09-20T18:40:07.483 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-20T18:40:07.483 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-20T18:40:07.483 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-20T18:40:07.483 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-20T18:40:07.483 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-20T18:40:07.483 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.blob_file_starting_level: 0 2024-09-20T18:40:07.483 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-20T18:40:07.483 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T18:40:07.483 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi172/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12272, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-20T18:40:07.483 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-20T18:40:07.483 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9b3c8b0e-985b-4980-ad30-66370ec6cb7b 2024-09-20T18:40:07.484 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726857607357454, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-20T18:40:07.484 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-20T18:40:07.484 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726857607367076, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2324909, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12277, "largest_seqno": 14306, "table_properties": {"data_size": 2316254, "index_size": 5497, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2117, "raw_key_size": 19386, "raw_average_key_size": 23, "raw_value_size": 2298568, "raw_average_value_size": 2786, "num_data_blocks": 251, "num_entries": 825, "num_filter_entries": 825, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726857607, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9b3c8b0e-985b-4980-ad30-66370ec6cb7b", "db_session_id": "O5FY2F1FAAB6WKIHODP7", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-20T18:40:07.484 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726857607367245, "job": 1, "event": "recovery_finished"} 2024-09-20T18:40:07.484 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-20T18:40:07.484 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-20T18:40:07.484 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi172/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-20T18:40:07.484 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e26b80ae00 2024-09-20T18:40:07.484 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: DB pointer 0x55e26b90c000 2024-09-20T18:40:07.484 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-20T18:40:07.484 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-20T18:40:07.484 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ** DB Stats ** 2024-09-20T18:40:07.485 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T18:40:07.485 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-20T18:40:07.485 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T18:40:07.485 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T18:40:07.485 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-20T18:40:07.485 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-20T18:40:07.485 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-20T18:40:07.485 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-09-20T18:40:07.485 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ** Compaction Stats [default] ** 2024-09-20T18:40:07.485 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T18:40:07.485 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-20T18:40:07.485 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: L0 1/0 2.22 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 580.0 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T18:40:07.485 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: L6 1/0 7.41 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-20T18:40:07.486 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Sum 2/0 9.63 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 580.0 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T18:40:07.486 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 580.0 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T18:40:07.486 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-09-20T18:40:07.486 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ** Compaction Stats [default] ** 2024-09-20T18:40:07.486 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-20T18:40:07.486 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-20T18:40:07.486 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 580.0 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-20T18:40:07.486 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-09-20T18:40:07.486 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-20T18:40:07.487 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-09-20T18:40:07.487 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-20T18:40:07.487 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-20T18:40:07.487 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-20T18:40:07.487 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-20T18:40:07.487 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-20T18:40:07.487 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-20T18:40:07.487 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Cumulative compaction: 0.00 GB write, 181.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T18:40:07.487 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Interval compaction: 0.00 GB write, 181.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-20T18:40:07.488 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-20T18:40:07.488 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Block cache BinnedLRUCache@0x55e26b7db610#2 capacity: 512.00 MB usage: 8.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-20T18:40:07.488 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.28 KB,0.000435114%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-09-20T18:40:07.488 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-09-20T18:40:07.488 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-20T18:40:07.488 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: starting mon.smithi172 rank 1 at public addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] at bind addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi172 fsid 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:40:07.488 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: mon.smithi172@-1(???) e2 preinit fsid 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:40:07.488 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: mon.smithi172@-1(???).mds e15 new map 2024-09-20T18:40:07.488 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: mon.smithi172@-1(???).mds e15 print_map 2024-09-20T18:40:07.488 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: e15 2024-09-20T18:40:07.488 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: btime 2024-09-20T18:33:05:524203+0000 2024-09-20T18:40:07.488 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:40:07.489 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:40:07.489 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: legacy client fscid: 1 2024-09-20T18:40:07.489 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-09-20T18:40:07.489 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: Filesystem 'cephfs' (1) 2024-09-20T18:40:07.489 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: fs_name cephfs 2024-09-20T18:40:07.489 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: epoch 15 2024-09-20T18:40:07.489 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T18:40:07.489 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:40:07.489 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: modified 2024-09-20T18:33:05.065474+0000 2024-09-20T18:40:07.489 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: tableserver 0 2024-09-20T18:40:07.489 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: root 0 2024-09-20T18:40:07.490 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: session_timeout 60 2024-09-20T18:40:07.490 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: session_autoclose 300 2024-09-20T18:40:07.490 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: max_file_size 1099511627776 2024-09-20T18:40:07.490 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: max_xattr_size 65536 2024-09-20T18:40:07.490 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: required_client_features {} 2024-09-20T18:40:07.490 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: last_failure 0 2024-09-20T18:40:07.490 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: last_failure_osd_epoch 0 2024-09-20T18:40:07.490 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:40:07.490 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: max_mds 2 2024-09-20T18:40:07.490 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: in 0,1 2024-09-20T18:40:07.490 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: up {0=14552,1=24325} 2024-09-20T18:40:07.490 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: failed 2024-09-20T18:40:07.491 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: damaged 2024-09-20T18:40:07.491 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: stopped 2024-09-20T18:40:07.491 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: data_pools [3] 2024-09-20T18:40:07.491 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: metadata_pool 2 2024-09-20T18:40:07.491 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: inline_data enabled 2024-09-20T18:40:07.491 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: balancer 2024-09-20T18:40:07.491 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: bal_rank_mask -1 2024-09-20T18:40:07.491 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: standby_count_wanted 1 2024-09-20T18:40:07.491 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: qdb_cluster leader: 14552 members: 24325,14552 2024-09-20T18:40:07.491 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: [mds.cephfs.smithi017.puqizo{0:14552} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.17:6826/3360305779,v1:172.21.15.17:6827/3360305779] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:40:07.491 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: [mds.cephfs.smithi017.xhlvpy{0:14568} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.17:6828/53113052,v1:172.21.15.17:6829/53113052] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:40:07.491 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: [mds.cephfs.smithi172.mugtlk{1:24325} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.172:6824/1043027893,v1:172.21.15.172:6825/1043027893] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:40:07.492 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: [mds.cephfs.smithi172.liatxm{1:24339} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/2975309540,v1:172.21.15.172:6827/2975309540] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:40:07.492 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-09-20T18:40:07.492 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout: 2024-09-20T18:40:07.492 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: mon.smithi172@-1(???).osd e46 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-20T18:40:07.492 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: mon.smithi172@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-20T18:40:07.492 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: mon.smithi172@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-20T18:40:07.492 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: mon.smithi172@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-20T18:40:07.492 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: mon.smithi172@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-20T18:40:07.492 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 bash[80413]: 4be383715faa51bf34c490a931c31af9fd43681044cd95f26a6e0a6dd98e4ce6 2024-09-20T18:40:07.492 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 systemd[1]: Started Ceph mon.smithi172 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:40:07.492 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mon metadata", "id": "smithi017"} : dispatch 2024-09-20T18:40:07.492 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mon metadata", "id": "smithi172"} : dispatch 2024-09-20T18:40:07.493 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-20T18:40:07.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mon metadata", "id": "smithi017"} : dispatch 2024-09-20T18:40:07.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mon metadata", "id": "smithi172"} : dispatch 2024-09-20T18:40:07.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-20T18:40:08.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T18:40:08.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: pgmap v108: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:08.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:40:08.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: mon.smithi172 calling monitor election 2024-09-20T18:40:08.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: mon.smithi017 calling monitor election 2024-09-20T18:40:08.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: mon.smithi017 is new leader, mons smithi017,smithi172 in quorum (ranks 0,1) 2024-09-20T18:40:08.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: monmap epoch 2 2024-09-20T18:40:08.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: fsid 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:40:08.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: last_changed 2024-09-20T18:28:32.345344+0000 2024-09-20T18:40:08.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: created 2024-09-20T18:26:13.426622+0000 2024-09-20T18:40:08.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: min_mon_release 19 (squid) 2024-09-20T18:40:08.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: election_strategy: 1 2024-09-20T18:40:08.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.smithi017 2024-09-20T18:40:08.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.smithi172 2024-09-20T18:40:08.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 2 up:standby-replay 2024-09-20T18:40:08.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: osdmap e46: 6 total, 6 up, 6 in 2024-09-20T18:40:08.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: mgrmap e33: smithi017.xusjwd(active, since 3m), standbys: smithi172.jczphg 2024-09-20T18:40:08.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T18:40:08.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:40:08.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:40:08.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:08.653 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:08.653 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:40:08.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-20T18:40:08.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: pgmap v108: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:08.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:40:08.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: mon.smithi172 calling monitor election 2024-09-20T18:40:08.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: mon.smithi017 calling monitor election 2024-09-20T18:40:08.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: mon.smithi017 is new leader, mons smithi017,smithi172 in quorum (ranks 0,1) 2024-09-20T18:40:08.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: monmap epoch 2 2024-09-20T18:40:08.713 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: fsid 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T18:40:08.713 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: last_changed 2024-09-20T18:28:32.345344+0000 2024-09-20T18:40:08.713 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: created 2024-09-20T18:26:13.426622+0000 2024-09-20T18:40:08.713 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: min_mon_release 19 (squid) 2024-09-20T18:40:08.713 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: election_strategy: 1 2024-09-20T18:40:08.713 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.smithi017 2024-09-20T18:40:08.713 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.smithi172 2024-09-20T18:40:08.713 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 2 up:standby-replay 2024-09-20T18:40:08.713 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: osdmap e46: 6 total, 6 up, 6 in 2024-09-20T18:40:08.713 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: mgrmap e33: smithi017.xusjwd(active, since 3m), standbys: smithi172.jczphg 2024-09-20T18:40:08.713 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T18:40:08.713 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:40:08.714 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:40:08.714 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:08.714 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:08.714 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:40:09.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:09 smithi172 ceph-mon[80431]: pgmap v109: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:40:09.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:09 smithi017 ceph-mon[108970]: pgmap v109: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:40:11.399 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:11.399 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:11.399 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:11 smithi172 ceph-mon[80431]: pgmap v110: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:11.399 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:11.399 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:11.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:11.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:11.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:11 smithi017 ceph-mon[108970]: pgmap v110: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:11.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:11.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:13.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:13 smithi172 ceph-mon[80431]: pgmap v111: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:40:13.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:13 smithi017 ceph-mon[108970]: pgmap v111: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:40:15.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:15.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:15.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:40:15.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:40:15.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:15.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:40:15.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:15.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:15.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:14 smithi017 ceph-mon[108970]: Upgrade: Setting container_image for all mon 2024-09-20T18:40:15.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:15.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi017"} : dispatch 2024-09-20T18:40:15.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi017"}]': finished 2024-09-20T18:40:15.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi172"} : dispatch 2024-09-20T18:40:15.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi172"}]': finished 2024-09-20T18:40:15.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:14 smithi017 ceph-mon[108970]: pgmap v112: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:15.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:15.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:15.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:40:15.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:40:15.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:15.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:40:15.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:15.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:15.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:14 smithi172 ceph-mon[80431]: Upgrade: Setting container_image for all mon 2024-09-20T18:40:15.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:15.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi017"} : dispatch 2024-09-20T18:40:15.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi017"}]': finished 2024-09-20T18:40:15.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi172"} : dispatch 2024-09-20T18:40:15.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi172"}]': finished 2024-09-20T18:40:15.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:14 smithi172 ceph-mon[80431]: pgmap v112: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:16.558 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:16 smithi017 ceph-mon[108970]: Upgrade: Updating crash.smithi017 (1/2) 2024-09-20T18:40:16.559 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:16 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:16.559 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:16 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi017", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-20T18:40:16.559 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:16 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:40:16.559 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:16 smithi017 ceph-mon[108970]: Deploying daemon crash.smithi017 on smithi017 2024-09-20T18:40:16.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:16 smithi172 ceph-mon[80431]: Upgrade: Updating crash.smithi017 (1/2) 2024-09-20T18:40:16.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:16 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:16.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:16 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi017", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-20T18:40:16.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:16 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:40:16.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:16 smithi172 ceph-mon[80431]: Deploying daemon crash.smithi017 on smithi017 2024-09-20T18:40:17.473 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:17 smithi017 ceph-mon[108970]: pgmap v113: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:17.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:17 smithi172 ceph-mon[80431]: pgmap v113: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:19.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.218+0000 7f57f0bb9640 1 -- 172.21.15.17:0/2076588310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57ec103470 msgr2=0x7f57ec10b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:19.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.218+0000 7f57f0bb9640 1 --2- 172.21.15.17:0/2076588310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57ec103470 0x7f57ec10b960 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009880 tx=0x7f57e002a530 comp rx=0 tx=0).stop 2024-09-20T18:40:19.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.218+0000 7f57f0bb9640 1 -- 172.21.15.17:0/2076588310 shutdown_connections 2024-09-20T18:40:19.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.218+0000 7f57f0bb9640 1 --2- 172.21.15.17:0/2076588310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57ec103470 0x7f57ec10b960 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:19.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.218+0000 7f57f0bb9640 1 --2- 172.21.15.17:0/2076588310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57ec102b50 0x7f57ec102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:19.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.218+0000 7f57f0bb9640 1 -- 172.21.15.17:0/2076588310 >> 172.21.15.17:0/2076588310 conn(0x7f57ec0fc550 msgr2=0x7f57ec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:19.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.218+0000 7f57f0bb9640 1 -- 172.21.15.17:0/2076588310 shutdown_connections 2024-09-20T18:40:19.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.218+0000 7f57f0bb9640 1 -- 172.21.15.17:0/2076588310 wait complete. 2024-09-20T18:40:19.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.219+0000 7f57f0bb9640 1 Processor -- start 2024-09-20T18:40:19.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.219+0000 7f57f0bb9640 1 -- start start 2024-09-20T18:40:19.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.219+0000 7f57f0bb9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57ec102b50 0x7f57ec1007b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:19.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.219+0000 7f57f0bb9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57ec103470 0x7f57ec100cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:19.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.219+0000 7f57f0bb9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f57ec10ede0 con 0x7f57ec102b50 2024-09-20T18:40:19.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.220+0000 7f57f0bb9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f57ec10ec60 con 0x7f57ec103470 2024-09-20T18:40:19.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.220+0000 7f57ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57ec102b50 0x7f57ec1007b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:19.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.220+0000 7f57ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57ec102b50 0x7f57ec1007b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41498/0 (socket says 172.21.15.17:41498) 2024-09-20T18:40:19.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.220+0000 7f57ea59c640 1 -- 172.21.15.17:0/999685926 learned_addr learned my addr 172.21.15.17:0/999685926 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:40:19.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.220+0000 7f57e9d9b640 1 --2- 172.21.15.17:0/999685926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57ec103470 0x7f57ec100cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:19.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.220+0000 7f57ea59c640 1 -- 172.21.15.17:0/999685926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57ec103470 msgr2=0x7f57ec100cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:19.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.220+0000 7f57ea59c640 1 --2- 172.21.15.17:0/999685926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57ec103470 0x7f57ec100cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:19.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.220+0000 7f57ea59c640 1 -- 172.21.15.17:0/999685926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57ec101230 con 0x7f57ec102b50 2024-09-20T18:40:19.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.220+0000 7f57e9d9b640 1 --2- 172.21.15.17:0/999685926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57ec103470 0x7f57ec100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T18:40:19.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.220+0000 7f57ea59c640 1 --2- 172.21.15.17:0/999685926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57ec102b50 0x7f57ec1007b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00e970 tx=0x7f57dc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:19.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.221+0000 7f57db7fe640 1 -- 172.21.15.17:0/999685926 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f57dc00cac0 con 0x7f57ec102b50 2024-09-20T18:40:19.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.221+0000 7f57f0bb9640 1 -- 172.21.15.17:0/999685926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57ec101520 con 0x7f57ec102b50 2024-09-20T18:40:19.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.221+0000 7f57db7fe640 1 -- 172.21.15.17:0/999685926 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f57dc0054e0 con 0x7f57ec102b50 2024-09-20T18:40:19.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.221+0000 7f57db7fe640 1 -- 172.21.15.17:0/999685926 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f57dc010430 con 0x7f57ec102b50 2024-09-20T18:40:19.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.221+0000 7f57f0bb9640 1 -- 172.21.15.17:0/999685926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57ec1a3e30 con 0x7f57ec102b50 2024-09-20T18:40:19.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.222+0000 7f57f0bb9640 1 -- 172.21.15.17:0/999685926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57ec06a4e0 con 0x7f57ec102b50 2024-09-20T18:40:19.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.223+0000 7f57db7fe640 1 -- 172.21.15.17:0/999685926 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f57dc004f00 con 0x7f57ec102b50 2024-09-20T18:40:19.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.223+0000 7f57db7fe640 1 --2- 172.21.15.17:0/999685926 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f57d407af80 0x7f57d407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:19.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.223+0000 7f57db7fe640 1 -- 172.21.15.17:0/999685926 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f57dc09e4c0 con 0x7f57ec102b50 2024-09-20T18:40:19.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.223+0000 7f57e9d9b640 1 --2- 172.21.15.17:0/999685926 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f57d407af80 0x7f57d407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:19.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.224+0000 7f57e9d9b640 1 --2- 172.21.15.17:0/999685926 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f57d407af80 0x7f57d407d440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f57ec102240 tx=0x7f57e0004f30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:19.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.228+0000 7f57db7fe640 1 -- 172.21.15.17:0/999685926 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57dc069bf0 con 0x7f57ec102b50 2024-09-20T18:40:19.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.435+0000 7f57f0bb9640 1 -- 172.21.15.17:0/999685926 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f57ec062630 con 0x7f57d407af80 2024-09-20T18:40:19.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.436+0000 7f57db7fe640 1 -- 172.21.15.17:0/999685926 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f57ec062630 con 0x7f57d407af80 2024-09-20T18:40:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.438+0000 7f57f0bb9640 1 -- 172.21.15.17:0/999685926 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f57d407af80 msgr2=0x7f57d407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.438+0000 7f57f0bb9640 1 --2- 172.21.15.17:0/999685926 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f57d407af80 0x7f57d407d440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f57ec102240 tx=0x7f57e0004f30 comp rx=0 tx=0).stop 2024-09-20T18:40:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.438+0000 7f57f0bb9640 1 -- 172.21.15.17:0/999685926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57ec102b50 msgr2=0x7f57ec1007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.438+0000 7f57f0bb9640 1 --2- 172.21.15.17:0/999685926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57ec102b50 0x7f57ec1007b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00e970 tx=0x7f57dc00ed70 comp rx=0 tx=0).stop 2024-09-20T18:40:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.438+0000 7f57f0bb9640 1 -- 172.21.15.17:0/999685926 shutdown_connections 2024-09-20T18:40:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.438+0000 7f57f0bb9640 1 --2- 172.21.15.17:0/999685926 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f57d407af80 0x7f57d407d440 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.438+0000 7f57f0bb9640 1 --2- 172.21.15.17:0/999685926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57ec103470 0x7f57ec100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.438+0000 7f57f0bb9640 1 --2- 172.21.15.17:0/999685926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57ec102b50 0x7f57ec1007b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.438+0000 7f57f0bb9640 1 -- 172.21.15.17:0/999685926 >> 172.21.15.17:0/999685926 conn(0x7f57ec0fc550 msgr2=0x7f57ec103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.438+0000 7f57f0bb9640 1 -- 172.21.15.17:0/999685926 shutdown_connections 2024-09-20T18:40:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.438+0000 7f57f0bb9640 1 -- 172.21.15.17:0/999685926 wait complete. 2024-09-20T18:40:19.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:19 smithi172 ceph-mon[80431]: pgmap v114: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:40:19.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:19 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:19.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:19 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:19.462 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:40:19.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.528+0000 7f107b364640 1 -- 172.21.15.17:0/4047458428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1074103430 msgr2=0x7f107410b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:19.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.528+0000 7f107b364640 1 --2- 172.21.15.17:0/4047458428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1074103430 0x7f107410b920 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f10640098b0 tx=0x7f106402a560 comp rx=0 tx=0).stop 2024-09-20T18:40:19.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.528+0000 7f107b364640 1 -- 172.21.15.17:0/4047458428 shutdown_connections 2024-09-20T18:40:19.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.528+0000 7f107b364640 1 --2- 172.21.15.17:0/4047458428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1074103430 0x7f107410b920 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:19.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.528+0000 7f107b364640 1 --2- 172.21.15.17:0/4047458428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1074102b10 0x7f1074102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:19.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.528+0000 7f107b364640 1 -- 172.21.15.17:0/4047458428 >> 172.21.15.17:0/4047458428 conn(0x7f10740fc550 msgr2=0x7f10740fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:19.544 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:19 smithi017 ceph-mon[108970]: pgmap v114: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:40:19.544 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:19 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:19.544 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:19 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:19.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.528+0000 7f107b364640 1 -- 172.21.15.17:0/4047458428 shutdown_connections 2024-09-20T18:40:19.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.528+0000 7f107b364640 1 -- 172.21.15.17:0/4047458428 wait complete. 2024-09-20T18:40:19.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.529+0000 7f107b364640 1 Processor -- start 2024-09-20T18:40:19.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.529+0000 7f107b364640 1 -- start start 2024-09-20T18:40:19.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.529+0000 7f107b364640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1074102b10 0x7f1074100770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:19.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.529+0000 7f107b364640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1074103430 0x7f1074100cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:19.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.529+0000 7f107b364640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f107410ede0 con 0x7f1074103430 2024-09-20T18:40:19.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.529+0000 7f107b364640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f107410ec60 con 0x7f1074102b10 2024-09-20T18:40:19.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.530+0000 7f10788ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1074103430 0x7f1074100cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:19.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.530+0000 7f1079100640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1074102b10 0x7f1074100770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:19.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.530+0000 7f10788ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1074103430 0x7f1074100cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41518/0 (socket says 172.21.15.17:41518) 2024-09-20T18:40:19.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.530+0000 7f10788ff640 1 -- 172.21.15.17:0/2776968505 learned_addr learned my addr 172.21.15.17:0/2776968505 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:40:19.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.530+0000 7f1079100640 1 -- 172.21.15.17:0/2776968505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1074103430 msgr2=0x7f1074100cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:19.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.530+0000 7f1079100640 1 --2- 172.21.15.17:0/2776968505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1074103430 0x7f1074100cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:19.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.530+0000 7f1079100640 1 -- 172.21.15.17:0/2776968505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10741011f0 con 0x7f1074102b10 2024-09-20T18:40:19.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.530+0000 7f10788ff640 1 --2- 172.21.15.17:0/2776968505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1074103430 0x7f1074100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T18:40:19.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.530+0000 7f1079100640 1 --2- 172.21.15.17:0/2776968505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1074102b10 0x7f1074100770 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f107000e970 tx=0x7f107000ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:19.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.530+0000 7f106a7fc640 1 -- 172.21.15.17:0/2776968505 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f107000cac0 con 0x7f1074102b10 2024-09-20T18:40:19.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.530+0000 7f106a7fc640 1 -- 172.21.15.17:0/2776968505 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f107000cc60 con 0x7f1074102b10 2024-09-20T18:40:19.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.530+0000 7f106a7fc640 1 -- 172.21.15.17:0/2776968505 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10700047a0 con 0x7f1074102b10 2024-09-20T18:40:19.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.530+0000 7f107b364640 1 -- 172.21.15.17:0/2776968505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10741014e0 con 0x7f1074102b10 2024-09-20T18:40:19.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.531+0000 7f107b364640 1 -- 172.21.15.17:0/2776968505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10741a3e70 con 0x7f1074102b10 2024-09-20T18:40:19.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.532+0000 7f107b364640 1 -- 172.21.15.17:0/2776968505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f107406a520 con 0x7f1074102b10 2024-09-20T18:40:19.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.532+0000 7f106a7fc640 1 -- 172.21.15.17:0/2776968505 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1070004030 con 0x7f1074102b10 2024-09-20T18:40:19.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.533+0000 7f106a7fc640 1 --2- 172.21.15.17:0/2776968505 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f106007af90 0x7f106007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:19.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.533+0000 7f106a7fc640 1 -- 172.21.15.17:0/2776968505 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f107009e2b0 con 0x7f1074102b10 2024-09-20T18:40:19.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.533+0000 7f10788ff640 1 --2- 172.21.15.17:0/2776968505 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f106007af90 0x7f106007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:19.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.533+0000 7f10788ff640 1 --2- 172.21.15.17:0/2776968505 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f106007af90 0x7f106007d450 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10640096c0 tx=0x7f1064031420 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:19.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.537+0000 7f106a7fc640 1 -- 172.21.15.17:0/2776968505 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f10700699e0 con 0x7f1074102b10 2024-09-20T18:40:19.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.748+0000 7f107b364640 1 -- 172.21.15.17:0/2776968505 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1074062630 con 0x7f106007af90 2024-09-20T18:40:19.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.749+0000 7f106a7fc640 1 -- 172.21.15.17:0/2776968505 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f1074062630 con 0x7f106007af90 2024-09-20T18:40:19.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.751+0000 7f107b364640 1 -- 172.21.15.17:0/2776968505 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f106007af90 msgr2=0x7f106007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:19.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.751+0000 7f107b364640 1 --2- 172.21.15.17:0/2776968505 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f106007af90 0x7f106007d450 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10640096c0 tx=0x7f1064031420 comp rx=0 tx=0).stop 2024-09-20T18:40:19.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.751+0000 7f107b364640 1 -- 172.21.15.17:0/2776968505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1074102b10 msgr2=0x7f1074100770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:19.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.751+0000 7f107b364640 1 --2- 172.21.15.17:0/2776968505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1074102b10 0x7f1074100770 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f107000e970 tx=0x7f107000ee30 comp rx=0 tx=0).stop 2024-09-20T18:40:19.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.751+0000 7f107b364640 1 -- 172.21.15.17:0/2776968505 shutdown_connections 2024-09-20T18:40:19.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.751+0000 7f107b364640 1 --2- 172.21.15.17:0/2776968505 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f106007af90 0x7f106007d450 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:19.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.751+0000 7f107b364640 1 --2- 172.21.15.17:0/2776968505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1074103430 0x7f1074100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:19.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.751+0000 7f107b364640 1 --2- 172.21.15.17:0/2776968505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1074102b10 0x7f1074100770 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:19.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.751+0000 7f107b364640 1 -- 172.21.15.17:0/2776968505 >> 172.21.15.17:0/2776968505 conn(0x7f10740fc550 msgr2=0x7f1074103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:19.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.751+0000 7f107b364640 1 -- 172.21.15.17:0/2776968505 shutdown_connections 2024-09-20T18:40:19.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.751+0000 7f107b364640 1 -- 172.21.15.17:0/2776968505 wait complete. 2024-09-20T18:40:19.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.836+0000 7f857759e640 1 -- 172.21.15.17:0/1835610666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85781009e0 msgr2=0x7f8578104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:19.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.836+0000 7f857759e640 1 --2- 172.21.15.17:0/1835610666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85781009e0 0x7f8578104a30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f856c009880 tx=0x7f856c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:40:19.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.836+0000 7f857759e640 1 -- 172.21.15.17:0/1835610666 shutdown_connections 2024-09-20T18:40:19.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.836+0000 7f857759e640 1 --2- 172.21.15.17:0/1835610666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85781009e0 0x7f8578104a30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:19.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.836+0000 7f857759e640 1 --2- 172.21.15.17:0/1835610666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8578100030 0x7f8578100410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:19.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.836+0000 7f857759e640 1 -- 172.21.15.17:0/1835610666 >> 172.21.15.17:0/1835610666 conn(0x7f85780fbad0 msgr2=0x7f85780fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:19.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.836+0000 7f857759e640 1 -- 172.21.15.17:0/1835610666 shutdown_connections 2024-09-20T18:40:19.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.836+0000 7f857759e640 1 -- 172.21.15.17:0/1835610666 wait complete. 2024-09-20T18:40:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.837+0000 7f857759e640 1 Processor -- start 2024-09-20T18:40:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.837+0000 7f857759e640 1 -- start start 2024-09-20T18:40:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.837+0000 7f857759e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8578100030 0x7f8578101ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.837+0000 7f857759e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85781009e0 0x7f8578102010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.838+0000 7f857759e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f857810d310 con 0x7f8578100030 2024-09-20T18:40:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.838+0000 7f857759e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f857810d190 con 0x7f85781009e0 2024-09-20T18:40:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.838+0000 7f857659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8578100030 0x7f8578101ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.838+0000 7f857659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8578100030 0x7f8578101ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41540/0 (socket says 172.21.15.17:41540) 2024-09-20T18:40:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.838+0000 7f857659c640 1 -- 172.21.15.17:0/421677488 learned_addr learned my addr 172.21.15.17:0/421677488 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:40:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.838+0000 7f8575d9b640 1 --2- 172.21.15.17:0/421677488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85781009e0 0x7f8578102010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.838+0000 7f857659c640 1 -- 172.21.15.17:0/421677488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85781009e0 msgr2=0x7f8578102010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.838+0000 7f857659c640 1 --2- 172.21.15.17:0/421677488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85781009e0 0x7f8578102010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.838+0000 7f857659c640 1 -- 172.21.15.17:0/421677488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8578102550 con 0x7f8578100030 2024-09-20T18:40:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.838+0000 7f8575d9b640 1 --2- 172.21.15.17:0/421677488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85781009e0 0x7f8578102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:40:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.838+0000 7f857659c640 1 --2- 172.21.15.17:0/421677488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8578100030 0x7f8578101ad0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f856800b420 tx=0x7f856800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.838+0000 7f85677fe640 1 -- 172.21.15.17:0/421677488 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8568011630 con 0x7f8578100030 2024-09-20T18:40:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.838+0000 7f857759e640 1 -- 172.21.15.17:0/421677488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8578102840 con 0x7f8578100030 2024-09-20T18:40:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.838+0000 7f85677fe640 1 -- 172.21.15.17:0/421677488 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8568016070 con 0x7f8578100030 2024-09-20T18:40:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.838+0000 7f85677fe640 1 -- 172.21.15.17:0/421677488 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8568010d40 con 0x7f8578100030 2024-09-20T18:40:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.838+0000 7f857759e640 1 -- 172.21.15.17:0/421677488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85781a3d00 con 0x7f8578100030 2024-09-20T18:40:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.840+0000 7f857759e640 1 -- 172.21.15.17:0/421677488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8578101510 con 0x7f8578100030 2024-09-20T18:40:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.840+0000 7f85677fe640 1 -- 172.21.15.17:0/421677488 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f856801b460 con 0x7f8578100030 2024-09-20T18:40:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.841+0000 7f85677fe640 1 --2- 172.21.15.17:0/421677488 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f856007af30 0x7f856007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.841+0000 7f85677fe640 1 -- 172.21.15.17:0/421677488 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f856809d690 con 0x7f8578100030 2024-09-20T18:40:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.841+0000 7f8575d9b640 1 --2- 172.21.15.17:0/421677488 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f856007af30 0x7f856007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:19.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.841+0000 7f8575d9b640 1 --2- 172.21.15.17:0/421677488 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f856007af30 0x7f856007d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8578103560 tx=0x7f856c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:19.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:19.845+0000 7f85677fe640 1 -- 172.21.15.17:0/421677488 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8568021250 con 0x7f8578100030 2024-09-20T18:40:20.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.042+0000 7f857759e640 1 -- 172.21.15.17:0/421677488 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f85780fd720 con 0x7f856007af30 2024-09-20T18:40:20.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.052+0000 7f85677fe640 1 -- 172.21.15.17:0/421677488 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f85780fd720 con 0x7f856007af30 2024-09-20T18:40:20.067 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:40:20.067 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (99s) 21s ago 12m 20.5M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:40:20.068 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (4m) 21s ago 12m 8875k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:40:20.068 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (4m) 9s ago 12m 8623k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:40:20.068 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 starting - - - - 2024-09-20T18:40:20.068 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (12m) 9s ago 11m 6891k - 19.1.1-369-ged8ee0f2 6acb0a031eab e10dd613dbe2 2024-09-20T18:40:20.068 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (76s) 21s ago 12m 75.7M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:40:20.068 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (7m) 21s ago 7m 149M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:40:20.068 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (7m) 21s ago 7m 95.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:40:20.068 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (7m) 9s ago 7m 27.1M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:40:20.068 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (7m) 9s ago 7m 27.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:40:20.068 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (3m) 21s ago 13m 523M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:40:20.068 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (2m) 9s ago 11m 457M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:40:20.068 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (28s) 21s ago 14m 22.7M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:40:20.068 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (13s) 9s ago 11m 21.2M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:40:20.068 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (2m) 21s ago 12m 11.6M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:40:20.069 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (2m) 9s ago 11m 12.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:40:20.069 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (10m) 21s ago 10m 205M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab c1207e514216 2024-09-20T18:40:20.069 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (10m) 21s ago 10m 226M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 73f2fd77590f 2024-09-20T18:40:20.069 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (9m) 21s ago 9m 209M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 6f0b9405dc18 2024-09-20T18:40:20.069 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (9m) 9s ago 9m 263M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:40:20.069 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (8m) 9s ago 8m 207M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:40:20.069 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (8m) 9s ago 8m 192M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:40:20.069 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (2m) 21s ago 12m 46.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:40:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.054+0000 7f857759e640 1 -- 172.21.15.17:0/421677488 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f856007af30 msgr2=0x7f856007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.054+0000 7f857759e640 1 --2- 172.21.15.17:0/421677488 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f856007af30 0x7f856007d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8578103560 tx=0x7f856c031400 comp rx=0 tx=0).stop 2024-09-20T18:40:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.054+0000 7f857759e640 1 -- 172.21.15.17:0/421677488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8578100030 msgr2=0x7f8578101ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.054+0000 7f857759e640 1 --2- 172.21.15.17:0/421677488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8578100030 0x7f8578101ad0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f856800b420 tx=0x7f856800b8e0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.054+0000 7f857759e640 1 -- 172.21.15.17:0/421677488 shutdown_connections 2024-09-20T18:40:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.054+0000 7f857759e640 1 --2- 172.21.15.17:0/421677488 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f856007af30 0x7f856007d3f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.054+0000 7f857759e640 1 --2- 172.21.15.17:0/421677488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85781009e0 0x7f8578102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.054+0000 7f857759e640 1 --2- 172.21.15.17:0/421677488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8578100030 0x7f8578101ad0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.054+0000 7f857759e640 1 -- 172.21.15.17:0/421677488 >> 172.21.15.17:0/421677488 conn(0x7f85780fbad0 msgr2=0x7f8578104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.054+0000 7f857759e640 1 -- 172.21.15.17:0/421677488 shutdown_connections 2024-09-20T18:40:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.054+0000 7f857759e640 1 -- 172.21.15.17:0/421677488 wait complete. 2024-09-20T18:40:20.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.137+0000 7f85f5605640 1 -- 172.21.15.17:0/625624431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f01007f0 msgr2=0x7f85f0100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:20.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.137+0000 7f85f5605640 1 --2- 172.21.15.17:0/625624431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f01007f0 0x7f85f0100c50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f85e4009880 tx=0x7f85e402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.137+0000 7f85f5605640 1 -- 172.21.15.17:0/625624431 shutdown_connections 2024-09-20T18:40:20.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.137+0000 7f85f5605640 1 --2- 172.21.15.17:0/625624431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f01007f0 0x7f85f0100c50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.137+0000 7f85f5605640 1 --2- 172.21.15.17:0/625624431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85f01067f0 0x7f85f0106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.137+0000 7f85f5605640 1 -- 172.21.15.17:0/625624431 >> 172.21.15.17:0/625624431 conn(0x7f85f00fc550 msgr2=0x7f85f00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:20.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.137+0000 7f85f5605640 1 -- 172.21.15.17:0/625624431 shutdown_connections 2024-09-20T18:40:20.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.137+0000 7f85f5605640 1 -- 172.21.15.17:0/625624431 wait complete. 2024-09-20T18:40:20.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.138+0000 7f85f5605640 1 Processor -- start 2024-09-20T18:40:20.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.138+0000 7f85f5605640 1 -- start start 2024-09-20T18:40:20.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.138+0000 7f85f5605640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f01007f0 0x7f85f01987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.138+0000 7f85f5605640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85f01067f0 0x7f85f0198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.138+0000 7f85f5605640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f85f010dcc0 con 0x7f85f01007f0 2024-09-20T18:40:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.138+0000 7f85f5605640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85f010db40 con 0x7f85f01067f0 2024-09-20T18:40:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.138+0000 7f85eeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f01007f0 0x7f85f01987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.138+0000 7f85eeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f01007f0 0x7f85f01987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41548/0 (socket says 172.21.15.17:41548) 2024-09-20T18:40:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.138+0000 7f85eeffd640 1 -- 172.21.15.17:0/2797503243 learned_addr learned my addr 172.21.15.17:0/2797503243 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:40:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.139+0000 7f85ee7fc640 1 --2- 172.21.15.17:0/2797503243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85f01067f0 0x7f85f0198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.139+0000 7f85eeffd640 1 -- 172.21.15.17:0/2797503243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85f01067f0 msgr2=0x7f85f0198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.139+0000 7f85eeffd640 1 --2- 172.21.15.17:0/2797503243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85f01067f0 0x7f85f0198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.139+0000 7f85eeffd640 1 -- 172.21.15.17:0/2797503243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f0199340 con 0x7f85f01007f0 2024-09-20T18:40:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.139+0000 7f85eeffd640 1 --2- 172.21.15.17:0/2797503243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f01007f0 0x7f85f01987b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f85e000e970 tx=0x7f85e000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:20.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.139+0000 7f85d7fff640 1 -- 172.21.15.17:0/2797503243 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85e000cac0 con 0x7f85f01007f0 2024-09-20T18:40:20.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.139+0000 7f85d7fff640 1 -- 172.21.15.17:0/2797503243 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f85e00054e0 con 0x7f85f01007f0 2024-09-20T18:40:20.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.139+0000 7f85f5605640 1 -- 172.21.15.17:0/2797503243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f01a1820 con 0x7f85f01007f0 2024-09-20T18:40:20.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.139+0000 7f85d7fff640 1 -- 172.21.15.17:0/2797503243 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85e0010430 con 0x7f85f01007f0 2024-09-20T18:40:20.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.139+0000 7f85f5605640 1 -- 172.21.15.17:0/2797503243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f01a1c20 con 0x7f85f01007f0 2024-09-20T18:40:20.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.140+0000 7f85f5605640 1 -- 172.21.15.17:0/2797503243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f0101f30 con 0x7f85f01007f0 2024-09-20T18:40:20.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.141+0000 7f85d7fff640 1 -- 172.21.15.17:0/2797503243 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f85e0004e80 con 0x7f85f01007f0 2024-09-20T18:40:20.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.142+0000 7f85d7fff640 1 --2- 172.21.15.17:0/2797503243 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f85d807af30 0x7f85d807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:20.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.142+0000 7f85d7fff640 1 -- 172.21.15.17:0/2797503243 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f85e009e640 con 0x7f85f01007f0 2024-09-20T18:40:20.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.142+0000 7f85ee7fc640 1 --2- 172.21.15.17:0/2797503243 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f85d807af30 0x7f85d807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:20.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.142+0000 7f85ee7fc640 1 --2- 172.21.15.17:0/2797503243 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f85d807af30 0x7f85d807d3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f85f006a830 tx=0x7f85e4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:20.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.146+0000 7f85d7fff640 1 -- 172.21.15.17:0/2797503243 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f85e0069cf0 con 0x7f85f01007f0 2024-09-20T18:40:20.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.409+0000 7f85f5605640 1 -- 172.21.15.17:0/2797503243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f85f002d7c0 con 0x7f85f01007f0 2024-09-20T18:40:20.424 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:20 smithi017 ceph-mon[108970]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:40:20.425 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:20 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:20.425 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:20 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-20T18:40:20.425 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:20 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:40:20.425 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:40:20.425 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:40:20.425 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:40:20.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:40:20.425 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:40:20.426 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:40:20.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:40:20.426 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:40:20.426 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6 2024-09-20T18:40:20.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:40:20.426 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:40:20.426 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:40:20.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:40:20.426 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:40:20.426 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 10, 2024-09-20T18:40:20.426 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T18:40:20.426 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:40:20.426 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:40:20.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.409+0000 7f85d7fff640 1 -- 172.21.15.17:0/2797503243 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+733 (secure 0 0 0) 0x7f85e006eba0 con 0x7f85f01007f0 2024-09-20T18:40:20.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.412+0000 7f85f5605640 1 -- 172.21.15.17:0/2797503243 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f85d807af30 msgr2=0x7f85d807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:20.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.412+0000 7f85f5605640 1 --2- 172.21.15.17:0/2797503243 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f85d807af30 0x7f85d807d3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f85f006a830 tx=0x7f85e4031400 comp rx=0 tx=0).stop 2024-09-20T18:40:20.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.412+0000 7f85f5605640 1 -- 172.21.15.17:0/2797503243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f01007f0 msgr2=0x7f85f01987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:20.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.412+0000 7f85f5605640 1 --2- 172.21.15.17:0/2797503243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f01007f0 0x7f85f01987b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f85e000e970 tx=0x7f85e000ed70 comp rx=0 tx=0).stop 2024-09-20T18:40:20.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.412+0000 7f85f5605640 1 -- 172.21.15.17:0/2797503243 shutdown_connections 2024-09-20T18:40:20.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.412+0000 7f85f5605640 1 --2- 172.21.15.17:0/2797503243 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f85d807af30 0x7f85d807d3f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.412+0000 7f85f5605640 1 --2- 172.21.15.17:0/2797503243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85f01067f0 0x7f85f0198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.412+0000 7f85f5605640 1 --2- 172.21.15.17:0/2797503243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f01007f0 0x7f85f01987b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.412+0000 7f85f5605640 1 -- 172.21.15.17:0/2797503243 >> 172.21.15.17:0/2797503243 conn(0x7f85f00fc550 msgr2=0x7f85f00fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:20.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.412+0000 7f85f5605640 1 -- 172.21.15.17:0/2797503243 shutdown_connections 2024-09-20T18:40:20.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.412+0000 7f85f5605640 1 -- 172.21.15.17:0/2797503243 wait complete. 2024-09-20T18:40:20.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:20 smithi172 ceph-mon[80431]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:40:20.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:20 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:20.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:20 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-20T18:40:20.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:20 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:40:20.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.498+0000 7fd386773640 1 -- 172.21.15.17:0/1485030254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3801007f0 msgr2=0x7fd380100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:20.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.498+0000 7fd386773640 1 --2- 172.21.15.17:0/1485030254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3801007f0 0x7fd380100c50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd374009880 tx=0x7fd37402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.498+0000 7fd386773640 1 -- 172.21.15.17:0/1485030254 shutdown_connections 2024-09-20T18:40:20.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.498+0000 7fd386773640 1 --2- 172.21.15.17:0/1485030254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3801007f0 0x7fd380100c50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.498+0000 7fd386773640 1 --2- 172.21.15.17:0/1485030254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3801067f0 0x7fd380106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.498+0000 7fd386773640 1 -- 172.21.15.17:0/1485030254 >> 172.21.15.17:0/1485030254 conn(0x7fd3800fc550 msgr2=0x7fd3800fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:20.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.498+0000 7fd386773640 1 -- 172.21.15.17:0/1485030254 shutdown_connections 2024-09-20T18:40:20.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.498+0000 7fd386773640 1 -- 172.21.15.17:0/1485030254 wait complete. 2024-09-20T18:40:20.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.499+0000 7fd386773640 1 Processor -- start 2024-09-20T18:40:20.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.499+0000 7fd386773640 1 -- start start 2024-09-20T18:40:20.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.499+0000 7fd386773640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3801007f0 0x7fd38019d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:20.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.499+0000 7fd386773640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3801067f0 0x7fd38019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:20.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.499+0000 7fd386773640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd38010dcc0 con 0x7fd3801007f0 2024-09-20T18:40:20.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.499+0000 7fd386773640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd38010db40 con 0x7fd3801067f0 2024-09-20T18:40:20.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.499+0000 7fd37ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3801007f0 0x7fd38019d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:20.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.500+0000 7fd37ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3801007f0 0x7fd38019d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46710/0 (socket says 172.21.15.17:46710) 2024-09-20T18:40:20.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.500+0000 7fd37ffff640 1 -- 172.21.15.17:0/2692525266 learned_addr learned my addr 172.21.15.17:0/2692525266 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:40:20.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.500+0000 7fd37f7fe640 1 --2- 172.21.15.17:0/2692525266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3801067f0 0x7fd38019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:20.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.500+0000 7fd37ffff640 1 -- 172.21.15.17:0/2692525266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3801067f0 msgr2=0x7fd38019db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:20.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.500+0000 7fd37ffff640 1 --2- 172.21.15.17:0/2692525266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3801067f0 0x7fd38019db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.500+0000 7fd37ffff640 1 -- 172.21.15.17:0/2692525266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd380197780 con 0x7fd3801007f0 2024-09-20T18:40:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.500+0000 7fd37ffff640 1 --2- 172.21.15.17:0/2692525266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3801007f0 0x7fd38019d600 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd37000d6f0 tx=0x7fd37000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.500+0000 7fd37d7fa640 1 -- 172.21.15.17:0/2692525266 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd370017070 con 0x7fd3801007f0 2024-09-20T18:40:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.500+0000 7fd386773640 1 -- 172.21.15.17:0/2692525266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd380197a70 con 0x7fd3801007f0 2024-09-20T18:40:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.500+0000 7fd37d7fa640 1 -- 172.21.15.17:0/2692525266 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd37000de00 con 0x7fd3801007f0 2024-09-20T18:40:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.500+0000 7fd37d7fa640 1 -- 172.21.15.17:0/2692525266 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd370004bb0 con 0x7fd3801007f0 2024-09-20T18:40:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.500+0000 7fd386773640 1 -- 172.21.15.17:0/2692525266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd380197fd0 con 0x7fd3801007f0 2024-09-20T18:40:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.501+0000 7fd386773640 1 -- 172.21.15.17:0/2692525266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd380101f30 con 0x7fd3801007f0 2024-09-20T18:40:20.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.503+0000 7fd37d7fa640 1 -- 172.21.15.17:0/2692525266 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd370009a30 con 0x7fd3801007f0 2024-09-20T18:40:20.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.503+0000 7fd37d7fa640 1 --2- 172.21.15.17:0/2692525266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd36807af80 0x7fd36807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:20.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.503+0000 7fd37d7fa640 1 -- 172.21.15.17:0/2692525266 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7fd37009dec0 con 0x7fd3801007f0 2024-09-20T18:40:20.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.503+0000 7fd37f7fe640 1 --2- 172.21.15.17:0/2692525266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd36807af80 0x7fd36807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:20.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.504+0000 7fd37f7fe640 1 --2- 172.21.15.17:0/2692525266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd36807af80 0x7fd36807d440 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd380198ad0 tx=0x7fd374031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:20.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.507+0000 7fd37d7fa640 1 -- 172.21.15.17:0/2692525266 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd3700696b0 con 0x7fd3801007f0 2024-09-20T18:40:20.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.751+0000 7fd386773640 1 -- 172.21.15.17:0/2692525266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd380198340 con 0x7fd3801007f0 2024-09-20T18:40:20.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.751+0000 7fd37d7fa640 1 -- 172.21.15.17:0/2692525266 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2043 (secure 0 0 0) 0x7fd37006e560 con 0x7fd3801007f0 2024-09-20T18:40:20.767 INFO:teuthology.orchestra.run.smithi017.stdout:e15 2024-09-20T18:40:20.767 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:33:05:524203+0000 2024-09-20T18:40:20.767 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:40:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:40:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:40:20.768 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:40:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:40:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:40:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 15 2024-09-20T18:40:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T18:40:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:40:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:33:05.065474+0000 2024-09-20T18:40:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:40:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:40:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:40:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:40:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:40:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:40:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:40:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:40:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2024-09-20T18:40:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:40:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:40:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:40:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14552,1=24325} 2024-09-20T18:40:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-09-20T18:40:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:40:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:40:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:40:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:40:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:40:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:40:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:40:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:40:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 14552 members: 24325,14552 2024-09-20T18:40:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{0:14552} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.17:6826/3360305779,v1:172.21.15.17:6827/3360305779] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:40:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{0:14568} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.17:6828/53113052,v1:172.21.15.17:6829/53113052] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:40:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{1:24325} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.172:6824/1043027893,v1:172.21.15.172:6825/1043027893] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:40:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{1:24339} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/2975309540,v1:172.21.15.172:6827/2975309540] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:40:20.770 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:40:20.770 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:40:20.771 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 15 2024-09-20T18:40:20.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.754+0000 7fd386773640 1 -- 172.21.15.17:0/2692525266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd36807af80 msgr2=0x7fd36807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:20.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.754+0000 7fd386773640 1 --2- 172.21.15.17:0/2692525266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd36807af80 0x7fd36807d440 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd380198ad0 tx=0x7fd374031400 comp rx=0 tx=0).stop 2024-09-20T18:40:20.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.754+0000 7fd386773640 1 -- 172.21.15.17:0/2692525266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3801007f0 msgr2=0x7fd38019d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:20.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.754+0000 7fd386773640 1 --2- 172.21.15.17:0/2692525266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3801007f0 0x7fd38019d600 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd37000d6f0 tx=0x7fd37000dbb0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.754+0000 7fd386773640 1 -- 172.21.15.17:0/2692525266 shutdown_connections 2024-09-20T18:40:20.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.754+0000 7fd386773640 1 --2- 172.21.15.17:0/2692525266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd36807af80 0x7fd36807d440 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.754+0000 7fd386773640 1 --2- 172.21.15.17:0/2692525266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3801067f0 0x7fd38019db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.754+0000 7fd386773640 1 --2- 172.21.15.17:0/2692525266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3801007f0 0x7fd38019d600 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.754+0000 7fd386773640 1 -- 172.21.15.17:0/2692525266 >> 172.21.15.17:0/2692525266 conn(0x7fd3800fc550 msgr2=0x7fd380104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:20.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.754+0000 7fd386773640 1 -- 172.21.15.17:0/2692525266 shutdown_connections 2024-09-20T18:40:20.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.755+0000 7fd386773640 1 -- 172.21.15.17:0/2692525266 wait complete. 2024-09-20T18:40:20.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.844+0000 7f9bbd3cc640 1 -- 172.21.15.17:0/1538233982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8103430 msgr2=0x7f9bb810b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:20.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.844+0000 7f9bbd3cc640 1 --2- 172.21.15.17:0/1538233982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8103430 0x7f9bb810b920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00098b0 tx=0x7f9ba002a560 comp rx=0 tx=0).stop 2024-09-20T18:40:20.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.844+0000 7f9bbd3cc640 1 -- 172.21.15.17:0/1538233982 shutdown_connections 2024-09-20T18:40:20.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.844+0000 7f9bbd3cc640 1 --2- 172.21.15.17:0/1538233982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8103430 0x7f9bb810b920 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.844+0000 7f9bbd3cc640 1 --2- 172.21.15.17:0/1538233982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8102b10 0x7f9bb8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.844+0000 7f9bbd3cc640 1 -- 172.21.15.17:0/1538233982 >> 172.21.15.17:0/1538233982 conn(0x7f9bb80fc550 msgr2=0x7f9bb80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:20.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.844+0000 7f9bbd3cc640 1 -- 172.21.15.17:0/1538233982 shutdown_connections 2024-09-20T18:40:20.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.844+0000 7f9bbd3cc640 1 -- 172.21.15.17:0/1538233982 wait complete. 2024-09-20T18:40:20.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.845+0000 7f9bbd3cc640 1 Processor -- start 2024-09-20T18:40:20.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.845+0000 7f9bbd3cc640 1 -- start start 2024-09-20T18:40:20.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.845+0000 7f9bbd3cc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8102b10 0x7f9bb819f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:20.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.845+0000 7f9bbd3cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8103430 0x7f9bb819fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:20.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.845+0000 7f9bbd3cc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb810ee40 con 0x7f9bb8103430 2024-09-20T18:40:20.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.845+0000 7f9bbd3cc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb810ecc0 con 0x7f9bb8102b10 2024-09-20T18:40:20.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.845+0000 7f9bb67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8103430 0x7f9bb819fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:20.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.845+0000 7f9bb67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8103430 0x7f9bb819fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46738/0 (socket says 172.21.15.17:46738) 2024-09-20T18:40:20.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.845+0000 7f9bb67fc640 1 -- 172.21.15.17:0/2296193239 learned_addr learned my addr 172.21.15.17:0/2296193239 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:40:20.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.845+0000 7f9bb6ffd640 1 --2- 172.21.15.17:0/2296193239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8102b10 0x7f9bb819f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:20.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.846+0000 7f9bb67fc640 1 -- 172.21.15.17:0/2296193239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8102b10 msgr2=0x7f9bb819f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:20.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.846+0000 7f9bb67fc640 1 --2- 172.21.15.17:0/2296193239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8102b10 0x7f9bb819f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:20.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.846+0000 7f9bb67fc640 1 -- 172.21.15.17:0/2296193239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb8199a70 con 0x7f9bb8103430 2024-09-20T18:40:20.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.846+0000 7f9bb67fc640 1 --2- 172.21.15.17:0/2296193239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8103430 0x7f9bb819fdf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0031460 tx=0x7f9ba00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:20.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.846+0000 7f9baffff640 1 -- 172.21.15.17:0/2296193239 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ba003f070 con 0x7f9bb8103430 2024-09-20T18:40:20.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.846+0000 7f9baffff640 1 -- 172.21.15.17:0/2296193239 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9ba00044d0 con 0x7f9bb8103430 2024-09-20T18:40:20.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.846+0000 7f9bbd3cc640 1 -- 172.21.15.17:0/2296193239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb8199d00 con 0x7f9bb8103430 2024-09-20T18:40:20.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.846+0000 7f9baffff640 1 -- 172.21.15.17:0/2296193239 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ba0035030 con 0x7f9bb8103430 2024-09-20T18:40:20.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.846+0000 7f9bbd3cc640 1 -- 172.21.15.17:0/2296193239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bb819a230 con 0x7f9bb8103430 2024-09-20T18:40:20.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.847+0000 7f9bbd3cc640 1 -- 172.21.15.17:0/2296193239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bb806a520 con 0x7f9bb8103430 2024-09-20T18:40:20.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.848+0000 7f9baffff640 1 -- 172.21.15.17:0/2296193239 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9ba0042070 con 0x7f9bb8103430 2024-09-20T18:40:20.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.848+0000 7f9baffff640 1 --2- 172.21.15.17:0/2296193239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9ba407af30 0x7f9ba407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:20.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.849+0000 7f9baffff640 1 -- 172.21.15.17:0/2296193239 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7f9ba00be950 con 0x7f9bb8103430 2024-09-20T18:40:20.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.849+0000 7f9bb6ffd640 1 --2- 172.21.15.17:0/2296193239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9ba407af30 0x7f9ba407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:20.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.849+0000 7f9bb6ffd640 1 --2- 172.21.15.17:0/2296193239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9ba407af30 0x7f9ba407d3f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9bb819abb0 tx=0x7f9ba8009110 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:20.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:20.853+0000 7f9baffff640 1 -- 172.21.15.17:0/2296193239 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9ba008a000 con 0x7f9bb8103430 2024-09-20T18:40:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.060+0000 7f9bbd3cc640 1 -- 172.21.15.17:0/2296193239 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9bb819afa0 con 0x7f9ba407af30 2024-09-20T18:40:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.061+0000 7f9baffff640 1 -- 172.21.15.17:0/2296193239 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f9bb819afa0 con 0x7f9ba407af30 2024-09-20T18:40:21.076 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:40:21.077 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:40:21.077 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:40:21.077 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:40:21.077 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:40:21.077 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:40:21.077 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:40:21.077 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:40:21.077 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "4/23 daemons upgraded", 2024-09-20T18:40:21.077 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading crash daemons", 2024-09-20T18:40:21.077 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:40:21.077 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:40:21.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.063+0000 7f9bbd3cc640 1 -- 172.21.15.17:0/2296193239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9ba407af30 msgr2=0x7f9ba407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:21.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.063+0000 7f9bbd3cc640 1 --2- 172.21.15.17:0/2296193239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9ba407af30 0x7f9ba407d3f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9bb819abb0 tx=0x7f9ba8009110 comp rx=0 tx=0).stop 2024-09-20T18:40:21.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.063+0000 7f9bbd3cc640 1 -- 172.21.15.17:0/2296193239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8103430 msgr2=0x7f9bb819fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:21.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.063+0000 7f9bbd3cc640 1 --2- 172.21.15.17:0/2296193239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8103430 0x7f9bb819fdf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0031460 tx=0x7f9ba00048f0 comp rx=0 tx=0).stop 2024-09-20T18:40:21.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.063+0000 7f9bbd3cc640 1 -- 172.21.15.17:0/2296193239 shutdown_connections 2024-09-20T18:40:21.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.063+0000 7f9bbd3cc640 1 --2- 172.21.15.17:0/2296193239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9ba407af30 0x7f9ba407d3f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:21.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.063+0000 7f9bbd3cc640 1 --2- 172.21.15.17:0/2296193239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8103430 0x7f9bb819fdf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:21.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.063+0000 7f9bbd3cc640 1 --2- 172.21.15.17:0/2296193239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8102b10 0x7f9bb819f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:21.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.063+0000 7f9bbd3cc640 1 -- 172.21.15.17:0/2296193239 >> 172.21.15.17:0/2296193239 conn(0x7f9bb80fc550 msgr2=0x7f9bb8100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:21.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.064+0000 7f9bbd3cc640 1 -- 172.21.15.17:0/2296193239 shutdown_connections 2024-09-20T18:40:21.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.064+0000 7f9bbd3cc640 1 -- 172.21.15.17:0/2296193239 wait complete. 2024-09-20T18:40:21.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.148+0000 7ff878bd8640 1 -- 172.21.15.17:0/4059157334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8741067f0 msgr2=0x7ff874106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:21.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.148+0000 7ff878bd8640 1 --2- 172.21.15.17:0/4059157334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8741067f0 0x7ff874106bd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff864009880 tx=0x7ff86402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:40:21.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.148+0000 7ff878bd8640 1 -- 172.21.15.17:0/4059157334 shutdown_connections 2024-09-20T18:40:21.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.148+0000 7ff878bd8640 1 --2- 172.21.15.17:0/4059157334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8741007f0 0x7ff874100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:21.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.148+0000 7ff878bd8640 1 --2- 172.21.15.17:0/4059157334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8741067f0 0x7ff874106bd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:21.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.148+0000 7ff878bd8640 1 -- 172.21.15.17:0/4059157334 >> 172.21.15.17:0/4059157334 conn(0x7ff8740fc550 msgr2=0x7ff8740fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:21.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.148+0000 7ff878bd8640 1 -- 172.21.15.17:0/4059157334 shutdown_connections 2024-09-20T18:40:21.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.148+0000 7ff878bd8640 1 -- 172.21.15.17:0/4059157334 wait complete. 2024-09-20T18:40:21.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.149+0000 7ff878bd8640 1 Processor -- start 2024-09-20T18:40:21.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.149+0000 7ff878bd8640 1 -- start start 2024-09-20T18:40:21.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.149+0000 7ff878bd8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8741007f0 0x7ff87419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:21.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.149+0000 7ff878bd8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8741067f0 0x7ff87419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:21.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.149+0000 7ff878bd8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff87410dca0 con 0x7ff8741067f0 2024-09-20T18:40:21.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.149+0000 7ff878bd8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff87410db20 con 0x7ff8741007f0 2024-09-20T18:40:21.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.149+0000 7ff86bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8741067f0 0x7ff87419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:21.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.149+0000 7ff86bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8741067f0 0x7ff87419db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46754/0 (socket says 172.21.15.17:46754) 2024-09-20T18:40:21.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.149+0000 7ff86bfff640 1 -- 172.21.15.17:0/1142998337 learned_addr learned my addr 172.21.15.17:0/1142998337 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:40:21.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.149+0000 7ff87259c640 1 --2- 172.21.15.17:0/1142998337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8741007f0 0x7ff87419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:21.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.150+0000 7ff86bfff640 1 -- 172.21.15.17:0/1142998337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8741007f0 msgr2=0x7ff87419d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:21.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.150+0000 7ff86bfff640 1 --2- 172.21.15.17:0/1142998337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8741007f0 0x7ff87419d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:21.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.150+0000 7ff86bfff640 1 -- 172.21.15.17:0/1142998337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff874197790 con 0x7ff8741067f0 2024-09-20T18:40:21.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.150+0000 7ff86bfff640 1 --2- 172.21.15.17:0/1142998337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8741067f0 0x7ff87419db50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00d8d0 tx=0x7ff85c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:21.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.150+0000 7ff86b7fe640 1 -- 172.21.15.17:0/1142998337 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff85c017070 con 0x7ff8741067f0 2024-09-20T18:40:21.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.150+0000 7ff86b7fe640 1 -- 172.21.15.17:0/1142998337 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff85c010460 con 0x7ff8741067f0 2024-09-20T18:40:21.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.150+0000 7ff878bd8640 1 -- 172.21.15.17:0/1142998337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff874197a80 con 0x7ff8741067f0 2024-09-20T18:40:21.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.150+0000 7ff86b7fe640 1 -- 172.21.15.17:0/1142998337 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff85c00f5f0 con 0x7ff8741067f0 2024-09-20T18:40:21.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.150+0000 7ff878bd8640 1 -- 172.21.15.17:0/1142998337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff874198010 con 0x7ff8741067f0 2024-09-20T18:40:21.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.151+0000 7ff878bd8640 1 -- 172.21.15.17:0/1142998337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff854005290 con 0x7ff8741067f0 2024-09-20T18:40:21.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.152+0000 7ff86b7fe640 1 -- 172.21.15.17:0/1142998337 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff85c00f860 con 0x7ff8741067f0 2024-09-20T18:40:21.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.152+0000 7ff86b7fe640 1 --2- 172.21.15.17:0/1142998337 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff86007af90 0x7ff86007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:21.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.152+0000 7ff86b7fe640 1 -- 172.21.15.17:0/1142998337 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5984+0+0 (secure 0 0 0) 0x7ff85c09dc00 con 0x7ff8741067f0 2024-09-20T18:40:21.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.152+0000 7ff87259c640 1 --2- 172.21.15.17:0/1142998337 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff86007af90 0x7ff86007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:21.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.153+0000 7ff87259c640 1 --2- 172.21.15.17:0/1142998337 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff86007af90 0x7ff86007d450 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff8640096c0 tx=0x7ff864031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:21.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.157+0000 7ff86b7fe640 1 -- 172.21.15.17:0/1142998337 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff85c069330 con 0x7ff8741067f0 2024-09-20T18:40:21.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.425+0000 7ff878bd8640 1 -- 172.21.15.17:0/1142998337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff854005580 con 0x7ff8741067f0 2024-09-20T18:40:21.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.425+0000 7ff86b7fe640 1 -- 172.21.15.17:0/1142998337 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7ff85c06e1e0 con 0x7ff8741067f0 2024-09-20T18:40:21.441 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T18:40:21.441 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:40:21.441 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:40:21.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.428+0000 7ff878bd8640 1 -- 172.21.15.17:0/1142998337 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff86007af90 msgr2=0x7ff86007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:21.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.428+0000 7ff878bd8640 1 --2- 172.21.15.17:0/1142998337 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff86007af90 0x7ff86007d450 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff8640096c0 tx=0x7ff864031400 comp rx=0 tx=0).stop 2024-09-20T18:40:21.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.428+0000 7ff878bd8640 1 -- 172.21.15.17:0/1142998337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8741067f0 msgr2=0x7ff87419db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:21.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.428+0000 7ff878bd8640 1 --2- 172.21.15.17:0/1142998337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8741067f0 0x7ff87419db50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00d8d0 tx=0x7ff85c00dd90 comp rx=0 tx=0).stop 2024-09-20T18:40:21.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.428+0000 7ff878bd8640 1 -- 172.21.15.17:0/1142998337 shutdown_connections 2024-09-20T18:40:21.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.428+0000 7ff878bd8640 1 --2- 172.21.15.17:0/1142998337 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff86007af90 0x7ff86007d450 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:21.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.428+0000 7ff878bd8640 1 --2- 172.21.15.17:0/1142998337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8741067f0 0x7ff87419db50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:21.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.428+0000 7ff878bd8640 1 --2- 172.21.15.17:0/1142998337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8741007f0 0x7ff87419d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:21.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.428+0000 7ff878bd8640 1 -- 172.21.15.17:0/1142998337 >> 172.21.15.17:0/1142998337 conn(0x7ff8740fc550 msgr2=0x7ff874069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:21.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.428+0000 7ff878bd8640 1 -- 172.21.15.17:0/1142998337 shutdown_connections 2024-09-20T18:40:21.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:21.428+0000 7ff878bd8640 1 -- 172.21.15.17:0/1142998337 wait complete. 2024-09-20T18:40:21.513 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:21 smithi172 ceph-mon[80431]: from='client.44105 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:40:21.513 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:21 smithi172 ceph-mon[80431]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:40:21.513 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:21 smithi172 ceph-mon[80431]: Upgrade: Updating crash.smithi172 (2/2) 2024-09-20T18:40:21.513 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:21 smithi172 ceph-mon[80431]: Deploying daemon crash.smithi172 on smithi172 2024-09-20T18:40:21.513 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:21 smithi172 ceph-mon[80431]: pgmap v115: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:21.513 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:21 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2797503243' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:21.513 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:21 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2692525266' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:40:21.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:21 smithi017 ceph-mon[108970]: from='client.44105 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:40:21.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:21 smithi017 ceph-mon[108970]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:40:21.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:21 smithi017 ceph-mon[108970]: Upgrade: Updating crash.smithi172 (2/2) 2024-09-20T18:40:21.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:21 smithi017 ceph-mon[108970]: Deploying daemon crash.smithi172 on smithi172 2024-09-20T18:40:21.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:21 smithi017 ceph-mon[108970]: pgmap v115: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:21.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:21 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2797503243' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:21.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:21 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2692525266' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:40:22.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:22 smithi017 ceph-mon[108970]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:40:22.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:22 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1142998337' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:40:22.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:40:22.674 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:22 smithi172 ceph-mon[80431]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:40:22.674 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:22 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1142998337' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:40:22.674 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:40:23.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:23 smithi017 ceph-mon[108970]: pgmap v116: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:40:23.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:23 smithi172 ceph-mon[80431]: pgmap v116: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:40:24.780 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:24 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:24.781 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:24 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:24.781 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:24 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:40:24.818 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:24 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:24.818 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:24 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:24.818 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:24 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:40:25.780 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:25 smithi017 ceph-mon[108970]: pgmap v117: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:25.799 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:25 smithi172 ceph-mon[80431]: pgmap v117: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:27.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:27 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:27.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:27 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:27.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:27 smithi017 ceph-mon[108970]: pgmap v118: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:27.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:27 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:27.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:27 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:27.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:27 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:27.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:27 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:27.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:27 smithi172 ceph-mon[80431]: pgmap v118: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:27.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:27 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:27.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:27 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:29.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:29 smithi017 ceph-mon[108970]: pgmap v119: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:40:29.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:29.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:29.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:29.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:29.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:29 smithi172 ceph-mon[80431]: pgmap v119: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:40:29.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:29.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:29.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:29.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:30.951 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:30 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:30.952 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:30 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:30.952 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:30 smithi017 ceph-mon[108970]: pgmap v120: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:31.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:30 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:31.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:30 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:31.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:30 smithi172 ceph-mon[80431]: pgmap v120: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:33.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:33.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:33.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:40:33.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:40:33.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:33.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: pgmap v121: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:40:33.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:40:33.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:33.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:33.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:33.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: Upgrade: Setting container_image for all crash 2024-09-20T18:40:33.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:33.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi017"} : dispatch 2024-09-20T18:40:33.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi017"}]': finished 2024-09-20T18:40:33.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi172"} : dispatch 2024-09-20T18:40:33.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi172"}]': finished 2024-09-20T18:40:33.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-20T18:40:33.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-20T18:40:33.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:33 smithi017 ceph-mon[108970]: Upgrade: osd.0 is safe to restart 2024-09-20T18:40:33.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:33.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:33.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:40:33.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:40:33.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:33.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: pgmap v121: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:40:33.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:40:33.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:33.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:33.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:33.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: Upgrade: Setting container_image for all crash 2024-09-20T18:40:33.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:33.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi017"} : dispatch 2024-09-20T18:40:33.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi017"}]': finished 2024-09-20T18:40:33.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi172"} : dispatch 2024-09-20T18:40:33.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi172"}]': finished 2024-09-20T18:40:33.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-20T18:40:33.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-20T18:40:33.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:33 smithi172 ceph-mon[80431]: Upgrade: osd.0 is safe to restart 2024-09-20T18:40:35.121 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:34 smithi017 ceph-mon[108970]: Upgrade: Updating osd.0 2024-09-20T18:40:35.121 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:34 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:35.121 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:34 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-20T18:40:35.122 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:34 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:40:35.122 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:34 smithi017 ceph-mon[108970]: Deploying daemon osd.0 on smithi017 2024-09-20T18:40:35.122 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:34 smithi017 ceph-mon[108970]: pgmap v122: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:35.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:34 smithi172 ceph-mon[80431]: Upgrade: Updating osd.0 2024-09-20T18:40:35.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:34 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:35.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:34 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-20T18:40:35.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:34 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:40:35.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:34 smithi172 ceph-mon[80431]: Deploying daemon osd.0 on smithi017 2024-09-20T18:40:35.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:34 smithi172 ceph-mon[80431]: pgmap v122: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:37.152 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:36 smithi017 systemd[1]: Stopping Ceph osd.0 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:40:37.152 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:37 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0[49249]: 2024-09-20T18:40:37.018+0000 7f06c26c6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T18:40:37.152 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:37 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0[49249]: 2024-09-20T18:40:37.018+0000 7f06c26c6640 -1 osd.0 46 *** Got signal Terminated *** 2024-09-20T18:40:37.152 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:37 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0[49249]: 2024-09-20T18:40:37.018+0000 7f06c26c6640 -1 osd.0 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T18:40:37.582 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:37 smithi017 ceph-mon[108970]: pgmap v123: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:37.582 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:37 smithi017 ceph-mon[108970]: osd.0 marked itself down and dead 2024-09-20T18:40:37.582 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:40:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:37 smithi172 ceph-mon[80431]: pgmap v123: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:37 smithi172 ceph-mon[80431]: osd.0 marked itself down and dead 2024-09-20T18:40:37.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:40:38.143 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:37 smithi017 podman[116659]: 2024-09-20 18:40:37.836449982 +0000 UTC m=+0.915713491 container died c1207e51421650d8e4f25d189995bc31a23545925fe4c555fa2d22b2879dde9e (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-ed8ee0f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T18:40:38.401 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:38 smithi017 podman[116659]: 2024-09-20 18:40:38.218221681 +0000 UTC m=+1.297485185 container cleanup c1207e51421650d8e4f25d189995bc31a23545925fe4c555fa2d22b2879dde9e (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-ed8ee0f, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-20T18:40:38.401 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:38 smithi017 bash[116659]: ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0 2024-09-20T18:40:38.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:38 smithi017 ceph-mon[108970]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T18:40:38.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:38 smithi017 ceph-mon[108970]: osdmap e47: 6 total, 5 up, 6 in 2024-09-20T18:40:38.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:38 smithi017 ceph-mon[108970]: osdmap e48: 6 total, 5 up, 6 in 2024-09-20T18:40:38.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:38 smithi172 ceph-mon[80431]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T18:40:38.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:38 smithi172 ceph-mon[80431]: osdmap e47: 6 total, 5 up, 6 in 2024-09-20T18:40:38.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:38 smithi172 ceph-mon[80431]: osdmap e48: 6 total, 5 up, 6 in 2024-09-20T18:40:38.899 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:38 smithi017 podman[116677]: 2024-09-20 18:40:38.50332443 +0000 UTC m=+0.663837085 container remove c1207e51421650d8e4f25d189995bc31a23545925fe4c555fa2d22b2879dde9e (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-ed8ee0f, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T18:40:39.151 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:38 smithi017 podman[116770]: 2024-09-20 18:40:38.78748058 +0000 UTC m=+0.017170677 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:40:39.151 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:38 smithi017 podman[116770]: 2024-09-20 18:40:38.895875207 +0000 UTC m=+0.125565287 container create fa5ae50bf4a9285a536eacc3bdfaef51896e0e0258bbc3398baac47df9837021 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-20T18:40:39.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:39 smithi017 ceph-mon[108970]: pgmap v125: 65 pgs: 9 stale+active+clean, 56 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:40:39.652 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:39 smithi017 podman[116770]: 2024-09-20 18:40:39.26554746 +0000 UTC m=+0.495237551 container init fa5ae50bf4a9285a536eacc3bdfaef51896e0e0258bbc3398baac47df9837021 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-20T18:40:39.652 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:39 smithi017 podman[116770]: 2024-09-20 18:40:39.269164493 +0000 UTC m=+0.498854577 container start fa5ae50bf4a9285a536eacc3bdfaef51896e0e0258bbc3398baac47df9837021 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-deactivate, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-20T18:40:39.652 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:39 smithi017 podman[116770]: 2024-09-20 18:40:39.340464102 +0000 UTC m=+0.570154210 container attach fa5ae50bf4a9285a536eacc3bdfaef51896e0e0258bbc3398baac47df9837021 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T18:40:39.652 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:39 smithi017 podman[116770]: 2024-09-20 18:40:39.470198107 +0000 UTC m=+0.699888200 container died fa5ae50bf4a9285a536eacc3bdfaef51896e0e0258bbc3398baac47df9837021 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-20T18:40:39.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:39 smithi172 ceph-mon[80431]: pgmap v125: 65 pgs: 9 stale+active+clean, 56 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:40:40.577 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:40 smithi017 podman[116796]: 2024-09-20 18:40:40.161368107 +0000 UTC m=+0.684911777 container remove fa5ae50bf4a9285a536eacc3bdfaef51896e0e0258bbc3398baac47df9837021 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T18:40:40.577 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:40 smithi017 systemd[1]: ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.0.service: Deactivated successfully. 2024-09-20T18:40:40.577 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:40 smithi017 systemd[1]: Stopped Ceph osd.0 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:40:40.577 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:40 smithi017 systemd[1]: ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.0.service: Consumed 57.453s CPU time. 2024-09-20T18:40:40.577 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:40 smithi017 systemd[1]: Starting Ceph osd.0 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:40:40.841 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:40 smithi017 podman[116896]: 2024-09-20 18:40:40.521013672 +0000 UTC m=+0.016593232 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:40:40.841 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:40 smithi017 podman[116896]: 2024-09-20 18:40:40.671313722 +0000 UTC m=+0.166893314 container create 1034b89a8ef21baa796274d6ce17a8ccac0e51c8ed79d5df8b053a61b485c2bd (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-20T18:40:41.392 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:40 smithi017 podman[116896]: 2024-09-20 18:40:40.915808088 +0000 UTC m=+0.411387639 container init 1034b89a8ef21baa796274d6ce17a8ccac0e51c8ed79d5df8b053a61b485c2bd (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-20T18:40:41.392 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:40 smithi017 podman[116896]: 2024-09-20 18:40:40.919330957 +0000 UTC m=+0.414910508 container start 1034b89a8ef21baa796274d6ce17a8ccac0e51c8ed79d5df8b053a61b485c2bd (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-20T18:40:41.392 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:41 smithi017 podman[116896]: 2024-09-20 18:40:41.0072425 +0000 UTC m=+0.502822052 container attach 1034b89a8ef21baa796274d6ce17a8ccac0e51c8ed79d5df8b053a61b485c2bd (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2) 2024-09-20T18:40:41.392 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:41 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate[116910]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:40:41.392 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:41 smithi017 bash[116896]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:40:41.392 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:41 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate[116910]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:40:41.392 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:41 smithi017 bash[116896]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:40:41.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:41 smithi017 ceph-mon[108970]: pgmap v127: 65 pgs: 9 stale+active+clean, 56 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T18:40:41.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:41 smithi172 ceph-mon[80431]: pgmap v127: 65 pgs: 9 stale+active+clean, 56 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-20T18:40:42.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:42 smithi172 ceph-mon[80431]: Health check failed: Degraded data redundancy: 59/318 objects degraded (18.553%), 20 pgs degraded (PG_DEGRADED) 2024-09-20T18:40:42.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:42 smithi017 ceph-mon[108970]: Health check failed: Degraded data redundancy: 59/318 objects degraded (18.553%), 20 pgs degraded (PG_DEGRADED) 2024-09-20T18:40:43.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:43 smithi172 ceph-mon[80431]: pgmap v128: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s; 59/318 objects degraded (18.553%) 2024-09-20T18:40:43.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:43 smithi017 ceph-mon[108970]: pgmap v128: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s; 59/318 objects degraded (18.553%) 2024-09-20T18:40:44.360 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:43 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate[116910]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T18:40:44.360 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:43 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate[116910]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:40:44.360 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:43 smithi017 bash[116896]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T18:40:44.360 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:43 smithi017 bash[116896]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:40:44.361 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:43 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate[116910]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:40:44.361 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:43 smithi017 bash[116896]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:40:44.361 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:44 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate[116910]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T18:40:44.361 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:44 smithi017 bash[116896]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T18:40:44.361 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:44 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate[116910]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-09-20T18:40:44.361 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:44 smithi017 bash[116896]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-09-20T18:40:44.361 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:44 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate[116910]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-20T18:40:44.361 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:44 smithi017 bash[116896]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-20T18:40:44.651 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:44 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate[116910]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-09-20T18:40:44.651 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:44 smithi017 bash[116896]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-09-20T18:40:44.651 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:44 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate[116910]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-20T18:40:44.652 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:44 smithi017 bash[116896]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-20T18:40:44.652 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:44 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate[116910]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T18:40:44.652 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:44 smithi017 bash[116896]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-20T18:40:44.652 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:44 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate[116910]: --> ceph-volume lvm activate successful for osd ID: 0 2024-09-20T18:40:44.652 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:44 smithi017 bash[116896]: --> ceph-volume lvm activate successful for osd ID: 0 2024-09-20T18:40:44.652 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:44 smithi017 podman[116896]: 2024-09-20 18:40:44.375026916 +0000 UTC m=+3.870606477 container died 1034b89a8ef21baa796274d6ce17a8ccac0e51c8ed79d5df8b053a61b485c2bd (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-20T18:40:45.401 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:45 smithi017 podman[117132]: 2024-09-20 18:40:45.102958742 +0000 UTC m=+0.717261899 container remove 1034b89a8ef21baa796274d6ce17a8ccac0e51c8ed79d5df8b053a61b485c2bd (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-activate, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-20T18:40:45.401 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:45 smithi017 podman[117191]: 2024-09-20 18:40:45.21674183 +0000 UTC m=+0.016643516 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:40:45.401 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:45 smithi017 podman[117191]: 2024-09-20 18:40:45.345516152 +0000 UTC m=+0.145417826 container create 86f4bf02274aa92605ac5d080bcb5b839502e9620204ef012e6d6b92a2f47fe6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-20T18:40:45.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:45 smithi172 ceph-mon[80431]: pgmap v129: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s; 59/318 objects degraded (18.553%) 2024-09-20T18:40:45.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:45 smithi017 ceph-mon[108970]: pgmap v129: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s; 59/318 objects degraded (18.553%) 2024-09-20T18:40:45.901 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:45 smithi017 podman[117191]: 2024-09-20 18:40:45.565136322 +0000 UTC m=+0.365038001 container init 86f4bf02274aa92605ac5d080bcb5b839502e9620204ef012e6d6b92a2f47fe6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-20T18:40:45.901 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:45 smithi017 podman[117191]: 2024-09-20 18:40:45.568505241 +0000 UTC m=+0.368406910 container start 86f4bf02274aa92605ac5d080bcb5b839502e9620204ef012e6d6b92a2f47fe6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T18:40:45.901 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:45 smithi017 ceph-osd[117210]: -- 172.21.15.17:0/1302044148 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562db853a1e0 con 0x562db84ca000 2024-09-20T18:40:45.901 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:45 smithi017 bash[117191]: 86f4bf02274aa92605ac5d080bcb5b839502e9620204ef012e6d6b92a2f47fe6 2024-09-20T18:40:45.901 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:45 smithi017 systemd[1]: Started Ceph osd.0 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:40:46.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:46 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:46.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:46 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:46.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:46 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:40:46.901 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:46 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0[117206]: 2024-09-20T18:40:46.720+0000 7f9bd73a6640 -1 Falling back to public interface 2024-09-20T18:40:47.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:46 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:47.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:46 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:47.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:46 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:40:48.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:47 smithi017 ceph-mon[108970]: pgmap v130: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 915 B/s rd, 1 op/s; 59/318 objects degraded (18.553%) 2024-09-20T18:40:48.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:47 smithi172 ceph-mon[80431]: pgmap v130: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 915 B/s rd, 1 op/s; 59/318 objects degraded (18.553%) 2024-09-20T18:40:50.001 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:49 smithi017 ceph-mon[108970]: pgmap v131: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s; 59/318 objects degraded (18.553%) 2024-09-20T18:40:50.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:49 smithi172 ceph-mon[80431]: pgmap v131: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s; 59/318 objects degraded (18.553%) 2024-09-20T18:40:51.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.519+0000 7f8ce1bbe640 1 -- 172.21.15.17:0/3221658287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cdc1007f0 msgr2=0x7f8cdc100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:51.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.519+0000 7f8ce1bbe640 1 --2- 172.21.15.17:0/3221658287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cdc1007f0 0x7f8cdc100c50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009880 tx=0x7f8cc402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:40:51.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.519+0000 7f8ce1bbe640 1 -- 172.21.15.17:0/3221658287 shutdown_connections 2024-09-20T18:40:51.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.519+0000 7f8ce1bbe640 1 --2- 172.21.15.17:0/3221658287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cdc1007f0 0x7f8cdc100c50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:51.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.519+0000 7f8ce1bbe640 1 --2- 172.21.15.17:0/3221658287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cdc1067f0 0x7f8cdc106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:51.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.519+0000 7f8ce1bbe640 1 -- 172.21.15.17:0/3221658287 >> 172.21.15.17:0/3221658287 conn(0x7f8cdc0fc550 msgr2=0x7f8cdc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:51.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.519+0000 7f8ce1bbe640 1 -- 172.21.15.17:0/3221658287 shutdown_connections 2024-09-20T18:40:51.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.519+0000 7f8ce1bbe640 1 -- 172.21.15.17:0/3221658287 wait complete. 2024-09-20T18:40:51.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.520+0000 7f8ce1bbe640 1 Processor -- start 2024-09-20T18:40:51.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.520+0000 7f8ce1bbe640 1 -- start start 2024-09-20T18:40:51.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.520+0000 7f8ce1bbe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cdc1007f0 0x7f8cdc19d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:51.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.520+0000 7f8ce1bbe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cdc1067f0 0x7f8cdc19db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:51.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.520+0000 7f8ce1bbe640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc10dcc0 con 0x7f8cdc1007f0 2024-09-20T18:40:51.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.520+0000 7f8ce1bbe640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc10db40 con 0x7f8cdc1067f0 2024-09-20T18:40:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.521+0000 7f8cdb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cdc1007f0 0x7f8cdc19d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.521+0000 7f8cdb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cdc1007f0 0x7f8cdc19d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43614/0 (socket says 172.21.15.17:43614) 2024-09-20T18:40:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.521+0000 7f8cdb7fe640 1 -- 172.21.15.17:0/3043632645 learned_addr learned my addr 172.21.15.17:0/3043632645 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:40:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.521+0000 7f8cdaffd640 1 --2- 172.21.15.17:0/3043632645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cdc1067f0 0x7f8cdc19db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.521+0000 7f8cdb7fe640 1 -- 172.21.15.17:0/3043632645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cdc1067f0 msgr2=0x7f8cdc19db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:51.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.521+0000 7f8cdb7fe640 1 --2- 172.21.15.17:0/3043632645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cdc1067f0 0x7f8cdc19db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:51.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.521+0000 7f8cdb7fe640 1 -- 172.21.15.17:0/3043632645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cdc197780 con 0x7f8cdc1007f0 2024-09-20T18:40:51.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.521+0000 7f8cdb7fe640 1 --2- 172.21.15.17:0/3043632645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cdc1007f0 0x7f8cdc19d600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00d6f0 tx=0x7f8ccc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:51.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.521+0000 7f8cd8ff9640 1 -- 172.21.15.17:0/3043632645 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ccc017070 con 0x7f8cdc1007f0 2024-09-20T18:40:51.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.521+0000 7f8ce1bbe640 1 -- 172.21.15.17:0/3043632645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cdc197a70 con 0x7f8cdc1007f0 2024-09-20T18:40:51.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.521+0000 7f8cd8ff9640 1 -- 172.21.15.17:0/3043632645 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ccc00de00 con 0x7f8cdc1007f0 2024-09-20T18:40:51.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.521+0000 7f8cd8ff9640 1 -- 172.21.15.17:0/3043632645 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ccc004bb0 con 0x7f8cdc1007f0 2024-09-20T18:40:51.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.522+0000 7f8ce1bbe640 1 -- 172.21.15.17:0/3043632645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cdc197fd0 con 0x7f8cdc1007f0 2024-09-20T18:40:51.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.522+0000 7f8ce1bbe640 1 -- 172.21.15.17:0/3043632645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cdc101f30 con 0x7f8cdc1007f0 2024-09-20T18:40:51.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.523+0000 7f8cd8ff9640 1 -- 172.21.15.17:0/3043632645 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8ccc004e60 con 0x7f8cdc1007f0 2024-09-20T18:40:51.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.524+0000 7f8cd8ff9640 1 --2- 172.21.15.17:0/3043632645 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8cc807af40 0x7f8cc807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:51.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.524+0000 7f8cd8ff9640 1 -- 172.21.15.17:0/3043632645 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5984+0+0 (secure 0 0 0) 0x7f8ccc09de90 con 0x7f8cdc1007f0 2024-09-20T18:40:51.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.524+0000 7f8cdaffd640 1 --2- 172.21.15.17:0/3043632645 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8cc807af40 0x7f8cc807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:51.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.525+0000 7f8cdaffd640 1 --2- 172.21.15.17:0/3043632645 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8cc807af40 0x7f8cc807d400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc198ad0 tx=0x7f8cc4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:51.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.532+0000 7f8cd8ff9640 1 -- 172.21.15.17:0/3043632645 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8ccc069680 con 0x7f8cdc1007f0 2024-09-20T18:40:51.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.770+0000 7f8ce1bbe640 1 -- 172.21.15.17:0/3043632645 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8cdc198280 con 0x7f8cc807af40 2024-09-20T18:40:51.786 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:51 smithi017 ceph-mon[108970]: pgmap v132: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 59/318 objects degraded (18.553%) 2024-09-20T18:40:51.786 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:51 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:51.786 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:51 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:51.786 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:51 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:51.786 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:51 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:51.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.771+0000 7f8cd8ff9640 1 -- 172.21.15.17:0/3043632645 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f8cdc198280 con 0x7f8cc807af40 2024-09-20T18:40:51.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.773+0000 7f8ce1bbe640 1 -- 172.21.15.17:0/3043632645 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8cc807af40 msgr2=0x7f8cc807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:51.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.773+0000 7f8ce1bbe640 1 --2- 172.21.15.17:0/3043632645 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8cc807af40 0x7f8cc807d400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc198ad0 tx=0x7f8cc4031400 comp rx=0 tx=0).stop 2024-09-20T18:40:51.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.773+0000 7f8ce1bbe640 1 -- 172.21.15.17:0/3043632645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cdc1007f0 msgr2=0x7f8cdc19d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:51.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.773+0000 7f8ce1bbe640 1 --2- 172.21.15.17:0/3043632645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cdc1007f0 0x7f8cdc19d600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00d6f0 tx=0x7f8ccc00dbb0 comp rx=0 tx=0).stop 2024-09-20T18:40:51.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.773+0000 7f8ce1bbe640 1 -- 172.21.15.17:0/3043632645 shutdown_connections 2024-09-20T18:40:51.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.773+0000 7f8ce1bbe640 1 --2- 172.21.15.17:0/3043632645 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8cc807af40 0x7f8cc807d400 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:51.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.773+0000 7f8ce1bbe640 1 --2- 172.21.15.17:0/3043632645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cdc1067f0 0x7f8cdc19db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:51.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.773+0000 7f8ce1bbe640 1 --2- 172.21.15.17:0/3043632645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cdc1007f0 0x7f8cdc19d600 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:51.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.773+0000 7f8ce1bbe640 1 -- 172.21.15.17:0/3043632645 >> 172.21.15.17:0/3043632645 conn(0x7f8cdc0fc550 msgr2=0x7f8cdc104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:51.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.773+0000 7f8ce1bbe640 1 -- 172.21.15.17:0/3043632645 shutdown_connections 2024-09-20T18:40:51.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.773+0000 7f8ce1bbe640 1 -- 172.21.15.17:0/3043632645 wait complete. 2024-09-20T18:40:51.800 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:40:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.894+0000 7f8d7a048640 1 -- 172.21.15.17:0/4186455660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d74102b10 msgr2=0x7f8d74102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.894+0000 7f8d7a048640 1 --2- 172.21.15.17:0/4186455660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d74102b10 0x7f8d74102ef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8d640098b0 tx=0x7f8d6402a560 comp rx=0 tx=0).stop 2024-09-20T18:40:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.894+0000 7f8d7a048640 1 -- 172.21.15.17:0/4186455660 shutdown_connections 2024-09-20T18:40:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.894+0000 7f8d7a048640 1 --2- 172.21.15.17:0/4186455660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d74103430 0x7f8d7410b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.894+0000 7f8d7a048640 1 --2- 172.21.15.17:0/4186455660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d74102b10 0x7f8d74102ef0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.894+0000 7f8d7a048640 1 -- 172.21.15.17:0/4186455660 >> 172.21.15.17:0/4186455660 conn(0x7f8d740fc550 msgr2=0x7f8d740fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.894+0000 7f8d7a048640 1 -- 172.21.15.17:0/4186455660 shutdown_connections 2024-09-20T18:40:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.894+0000 7f8d7a048640 1 -- 172.21.15.17:0/4186455660 wait complete. 2024-09-20T18:40:51.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.895+0000 7f8d7a048640 1 Processor -- start 2024-09-20T18:40:51.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.895+0000 7f8d7a048640 1 -- start start 2024-09-20T18:40:51.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.896+0000 7f8d7a048640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d74102b10 0x7f8d7419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:51.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.896+0000 7f8d7a048640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d74103430 0x7f8d7419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:51.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.896+0000 7f8d7a048640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7410edc0 con 0x7f8d74103430 2024-09-20T18:40:51.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.896+0000 7f8d7a048640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7410ec40 con 0x7f8d74102b10 2024-09-20T18:40:51.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.896+0000 7f8d6affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d74103430 0x7f8d7419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:51.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.896+0000 7f8d6affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d74103430 0x7f8d7419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43620/0 (socket says 172.21.15.17:43620) 2024-09-20T18:40:51.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.896+0000 7f8d6affd640 1 -- 172.21.15.17:0/539117122 learned_addr learned my addr 172.21.15.17:0/539117122 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:40:51.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.896+0000 7f8d737fe640 1 --2- 172.21.15.17:0/539117122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d74102b10 0x7f8d7419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:51.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.897+0000 7f8d737fe640 1 -- 172.21.15.17:0/539117122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d74103430 msgr2=0x7f8d7419db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:51.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.897+0000 7f8d737fe640 1 --2- 172.21.15.17:0/539117122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d74103430 0x7f8d7419db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:51.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.897+0000 7f8d737fe640 1 -- 172.21.15.17:0/539117122 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d741977d0 con 0x7f8d74102b10 2024-09-20T18:40:51.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.897+0000 7f8d737fe640 1 --2- 172.21.15.17:0/539117122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d74102b10 0x7f8d7419d650 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8d6402aa80 tx=0x7f8d640045c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:51.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.898+0000 7f8d717fa640 1 -- 172.21.15.17:0/539117122 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d6403f070 con 0x7f8d74102b10 2024-09-20T18:40:51.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.898+0000 7f8d717fa640 1 -- 172.21.15.17:0/539117122 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d640035f0 con 0x7f8d74102b10 2024-09-20T18:40:51.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.898+0000 7f8d7a048640 1 -- 172.21.15.17:0/539117122 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d74197a60 con 0x7f8d74102b10 2024-09-20T18:40:51.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.898+0000 7f8d717fa640 1 -- 172.21.15.17:0/539117122 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d64035030 con 0x7f8d74102b10 2024-09-20T18:40:51.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.898+0000 7f8d7a048640 1 -- 172.21.15.17:0/539117122 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d74197f90 con 0x7f8d74102b10 2024-09-20T18:40:51.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.900+0000 7f8d7a048640 1 -- 172.21.15.17:0/539117122 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d7406a520 con 0x7f8d74102b10 2024-09-20T18:40:51.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.900+0000 7f8d717fa640 1 -- 172.21.15.17:0/539117122 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8d64042070 con 0x7f8d74102b10 2024-09-20T18:40:51.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.902+0000 7f8d717fa640 1 --2- 172.21.15.17:0/539117122 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8d6007afd0 0x7f8d6007d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:51.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.902+0000 7f8d717fa640 1 -- 172.21.15.17:0/539117122 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5984+0+0 (secure 0 0 0) 0x7f8d640be880 con 0x7f8d74102b10 2024-09-20T18:40:51.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.902+0000 7f8d6affd640 1 --2- 172.21.15.17:0/539117122 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8d6007afd0 0x7f8d6007d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:51.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.902+0000 7f8d6affd640 1 --2- 172.21.15.17:0/539117122 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8d6007afd0 0x7f8d6007d490 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8d74108970 tx=0x7f8d5c00a5e0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:51.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:51.906+0000 7f8d717fa640 1 -- 172.21.15.17:0/539117122 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8d64089fb0 con 0x7f8d74102b10 2024-09-20T18:40:52.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.132+0000 7f8d7a048640 1 -- 172.21.15.17:0/539117122 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8d74198240 con 0x7f8d6007afd0 2024-09-20T18:40:52.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.134+0000 7f8d717fa640 1 -- 172.21.15.17:0/539117122 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f8d74198240 con 0x7f8d6007afd0 2024-09-20T18:40:52.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.136+0000 7f8d7a048640 1 -- 172.21.15.17:0/539117122 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8d6007afd0 msgr2=0x7f8d6007d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:52.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.136+0000 7f8d7a048640 1 --2- 172.21.15.17:0/539117122 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8d6007afd0 0x7f8d6007d490 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8d74108970 tx=0x7f8d5c00a5e0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.136+0000 7f8d7a048640 1 -- 172.21.15.17:0/539117122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d74102b10 msgr2=0x7f8d7419d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:52.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.136+0000 7f8d7a048640 1 --2- 172.21.15.17:0/539117122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d74102b10 0x7f8d7419d650 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8d6402aa80 tx=0x7f8d640045c0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.136+0000 7f8d7a048640 1 -- 172.21.15.17:0/539117122 shutdown_connections 2024-09-20T18:40:52.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.136+0000 7f8d7a048640 1 --2- 172.21.15.17:0/539117122 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8d6007afd0 0x7f8d6007d490 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.136+0000 7f8d7a048640 1 --2- 172.21.15.17:0/539117122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d74103430 0x7f8d7419db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.136+0000 7f8d7a048640 1 --2- 172.21.15.17:0/539117122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d74102b10 0x7f8d7419d650 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.136+0000 7f8d7a048640 1 -- 172.21.15.17:0/539117122 >> 172.21.15.17:0/539117122 conn(0x7f8d740fc550 msgr2=0x7f8d74107e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:52.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.136+0000 7f8d7a048640 1 -- 172.21.15.17:0/539117122 shutdown_connections 2024-09-20T18:40:52.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.136+0000 7f8d7a048640 1 -- 172.21.15.17:0/539117122 wait complete. 2024-09-20T18:40:52.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:51 smithi172 ceph-mon[80431]: pgmap v132: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 59/318 objects degraded (18.553%) 2024-09-20T18:40:52.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:51 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:52.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:51 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:52.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:51 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:52.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:51 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:52.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.220+0000 7ff0e0908640 1 -- 172.21.15.17:0/3691245916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc101900 msgr2=0x7ff0dc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:52.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.220+0000 7ff0e0908640 1 --2- 172.21.15.17:0/3691245916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc101900 0x7ff0dc101d60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009880 tx=0x7ff0d002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.220+0000 7ff0e0908640 1 -- 172.21.15.17:0/3691245916 shutdown_connections 2024-09-20T18:40:52.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.220+0000 7ff0e0908640 1 --2- 172.21.15.17:0/3691245916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc101900 0x7ff0dc101d60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.220+0000 7ff0e0908640 1 --2- 172.21.15.17:0/3691245916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0dc107900 0x7ff0dc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.220+0000 7ff0e0908640 1 -- 172.21.15.17:0/3691245916 >> 172.21.15.17:0/3691245916 conn(0x7ff0dc0fd600 msgr2=0x7ff0dc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:52.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.220+0000 7ff0e0908640 1 -- 172.21.15.17:0/3691245916 shutdown_connections 2024-09-20T18:40:52.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.220+0000 7ff0e0908640 1 -- 172.21.15.17:0/3691245916 wait complete. 2024-09-20T18:40:52.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.221+0000 7ff0e0908640 1 Processor -- start 2024-09-20T18:40:52.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.221+0000 7ff0e0908640 1 -- start start 2024-09-20T18:40:52.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.221+0000 7ff0e0908640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0dc101900 0x7ff0dc19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:52.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.221+0000 7ff0e0908640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc107900 0x7ff0dc19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:52.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.221+0000 7ff0e0908640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc10edb0 con 0x7ff0dc107900 2024-09-20T18:40:52.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.221+0000 7ff0e0908640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc10ec30 con 0x7ff0dc101900 2024-09-20T18:40:52.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.221+0000 7ff0d9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc107900 0x7ff0dc19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:52.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.221+0000 7ff0d9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc107900 0x7ff0dc19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43652/0 (socket says 172.21.15.17:43652) 2024-09-20T18:40:52.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.221+0000 7ff0d9d9b640 1 -- 172.21.15.17:0/2896143722 learned_addr learned my addr 172.21.15.17:0/2896143722 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:40:52.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.222+0000 7ff0da59c640 1 --2- 172.21.15.17:0/2896143722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0dc101900 0x7ff0dc19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:52.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.222+0000 7ff0d9d9b640 1 -- 172.21.15.17:0/2896143722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0dc101900 msgr2=0x7ff0dc19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:52.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.222+0000 7ff0d9d9b640 1 --2- 172.21.15.17:0/2896143722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0dc101900 0x7ff0dc19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.222+0000 7ff0d9d9b640 1 -- 172.21.15.17:0/2896143722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0dc197800 con 0x7ff0dc107900 2024-09-20T18:40:52.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.222+0000 7ff0d9d9b640 1 --2- 172.21.15.17:0/2896143722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc107900 0x7ff0dc19dbc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0031460 tx=0x7ff0d00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:52.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.222+0000 7ff0cb7fe640 1 -- 172.21.15.17:0/2896143722 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff0d003f070 con 0x7ff0dc107900 2024-09-20T18:40:52.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.222+0000 7ff0cb7fe640 1 -- 172.21.15.17:0/2896143722 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff0d00035f0 con 0x7ff0dc107900 2024-09-20T18:40:52.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.222+0000 7ff0cb7fe640 1 -- 172.21.15.17:0/2896143722 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff0d0035030 con 0x7ff0dc107900 2024-09-20T18:40:52.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.222+0000 7ff0e0908640 1 -- 172.21.15.17:0/2896143722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0dc197a90 con 0x7ff0dc107900 2024-09-20T18:40:52.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.222+0000 7ff0e0908640 1 -- 172.21.15.17:0/2896143722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0dc197fc0 con 0x7ff0dc107900 2024-09-20T18:40:52.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.223+0000 7ff0e0908640 1 -- 172.21.15.17:0/2896143722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0dc103040 con 0x7ff0dc107900 2024-09-20T18:40:52.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.224+0000 7ff0cb7fe640 1 -- 172.21.15.17:0/2896143722 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff0d0042070 con 0x7ff0dc107900 2024-09-20T18:40:52.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.224+0000 7ff0cb7fe640 1 --2- 172.21.15.17:0/2896143722 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff0c407af30 0x7ff0c407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:52.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.225+0000 7ff0cb7fe640 1 -- 172.21.15.17:0/2896143722 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5984+0+0 (secure 0 0 0) 0x7ff0d00be9f0 con 0x7ff0dc107900 2024-09-20T18:40:52.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.225+0000 7ff0da59c640 1 --2- 172.21.15.17:0/2896143722 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff0c407af30 0x7ff0c407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:52.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.225+0000 7ff0da59c640 1 --2- 172.21.15.17:0/2896143722 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff0c407af30 0x7ff0c407d3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc005fd0 tx=0x7ff0cc005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:52.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.229+0000 7ff0cb7fe640 1 -- 172.21.15.17:0/2896143722 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff0d008a020 con 0x7ff0dc107900 2024-09-20T18:40:52.401 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:52 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0[117206]: 2024-09-20T18:40:52.125+0000 7f9bd73a6640 -1 osd.0 46 log_to_monitors true 2024-09-20T18:40:52.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.434+0000 7ff0e0908640 1 -- 172.21.15.17:0/2896143722 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff0dc198270 con 0x7ff0c407af30 2024-09-20T18:40:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.444+0000 7ff0cb7fe640 1 -- 172.21.15.17:0/2896143722 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7ff0dc198270 con 0x7ff0c407af30 2024-09-20T18:40:52.459 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:40:52.459 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (2m) 1s ago 13m 20.5M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:40:52.460 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (5m) 1s ago 13m 8946k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:40:52.460 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (4m) 26s ago 12m 8644k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:40:52.460 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (34s) 1s ago 13m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:40:52.460 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (29s) 26s ago 12m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:40:52.460 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (108s) 1s ago 13m 76.6M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:40:52.460 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (7m) 1s ago 7m 150M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:40:52.460 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (7m) 1s ago 7m 95.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:40:52.460 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (7m) 26s ago 7m 26.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:40:52.461 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (7m) 26s ago 7m 26.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:40:52.461 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (4m) 1s ago 14m 524M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:40:52.461 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (3m) 26s ago 12m 457M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:40:52.461 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (60s) 1s ago 14m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:40:52.461 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (45s) 26s ago 12m 27.1M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:40:52.461 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (3m) 1s ago 13m 11.6M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:40:52.462 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (2m) 26s ago 12m 11.3M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:40:52.462 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (7s) 1s ago 11m 11.2M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:40:52.462 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (10m) 1s ago 10m 225M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 73f2fd77590f 2024-09-20T18:40:52.462 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (10m) 1s ago 10m 206M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 6f0b9405dc18 2024-09-20T18:40:52.462 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (9m) 26s ago 9m 262M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:40:52.462 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (9m) 26s ago 9m 208M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:40:52.462 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (8m) 26s ago 8m 190M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:40:52.463 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (2m) 1s ago 12m 49.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:40:52.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.446+0000 7ff0e0908640 1 -- 172.21.15.17:0/2896143722 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff0c407af30 msgr2=0x7ff0c407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:52.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.446+0000 7ff0e0908640 1 --2- 172.21.15.17:0/2896143722 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff0c407af30 0x7ff0c407d3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc005fd0 tx=0x7ff0cc005850 comp rx=0 tx=0).stop 2024-09-20T18:40:52.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.446+0000 7ff0e0908640 1 -- 172.21.15.17:0/2896143722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc107900 msgr2=0x7ff0dc19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:52.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.446+0000 7ff0e0908640 1 --2- 172.21.15.17:0/2896143722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc107900 0x7ff0dc19dbc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0031460 tx=0x7ff0d00045e0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.446+0000 7ff0e0908640 1 -- 172.21.15.17:0/2896143722 shutdown_connections 2024-09-20T18:40:52.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.446+0000 7ff0e0908640 1 --2- 172.21.15.17:0/2896143722 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff0c407af30 0x7ff0c407d3f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.446+0000 7ff0e0908640 1 --2- 172.21.15.17:0/2896143722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0dc107900 0x7ff0dc19dbc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.446+0000 7ff0e0908640 1 --2- 172.21.15.17:0/2896143722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0dc101900 0x7ff0dc19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.446+0000 7ff0e0908640 1 -- 172.21.15.17:0/2896143722 >> 172.21.15.17:0/2896143722 conn(0x7ff0dc0fd600 msgr2=0x7ff0dc0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.446+0000 7ff0e0908640 1 -- 172.21.15.17:0/2896143722 shutdown_connections 2024-09-20T18:40:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.446+0000 7ff0e0908640 1 -- 172.21.15.17:0/2896143722 wait complete. 2024-09-20T18:40:52.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.530+0000 7f41a4eba640 1 -- 172.21.15.17:0/3494668153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a01067f0 msgr2=0x7f41a0106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:52.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.530+0000 7f41a4eba640 1 --2- 172.21.15.17:0/3494668153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a01067f0 0x7f41a0106bd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4190009880 tx=0x7f419002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.530+0000 7f41a4eba640 1 -- 172.21.15.17:0/3494668153 shutdown_connections 2024-09-20T18:40:52.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.530+0000 7f41a4eba640 1 --2- 172.21.15.17:0/3494668153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41a01007f0 0x7f41a0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.530+0000 7f41a4eba640 1 --2- 172.21.15.17:0/3494668153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a01067f0 0x7f41a0106bd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.530+0000 7f41a4eba640 1 -- 172.21.15.17:0/3494668153 >> 172.21.15.17:0/3494668153 conn(0x7f41a00fc550 msgr2=0x7f41a00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:52.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.530+0000 7f41a4eba640 1 -- 172.21.15.17:0/3494668153 shutdown_connections 2024-09-20T18:40:52.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.530+0000 7f41a4eba640 1 -- 172.21.15.17:0/3494668153 wait complete. 2024-09-20T18:40:52.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.531+0000 7f41a4eba640 1 Processor -- start 2024-09-20T18:40:52.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.531+0000 7f41a4eba640 1 -- start start 2024-09-20T18:40:52.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.531+0000 7f41a4eba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a01007f0 0x7f41a0107720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:52.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.531+0000 7f41a4eba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41a01067f0 0x7f41a0107c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:52.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.531+0000 7f41a4eba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f41a010dca0 con 0x7f41a01007f0 2024-09-20T18:40:52.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.531+0000 7f41a4eba640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f41a010db20 con 0x7f41a01067f0 2024-09-20T18:40:52.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.531+0000 7f419e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a01007f0 0x7f41a0107720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:52.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.531+0000 7f419e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a01007f0 0x7f41a0107720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43668/0 (socket says 172.21.15.17:43668) 2024-09-20T18:40:52.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.531+0000 7f419e59c640 1 -- 172.21.15.17:0/469065271 learned_addr learned my addr 172.21.15.17:0/469065271 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:40:52.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.531+0000 7f4197fff640 1 --2- 172.21.15.17:0/469065271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41a01067f0 0x7f41a0107c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:52.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.532+0000 7f419e59c640 1 -- 172.21.15.17:0/469065271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41a01067f0 msgr2=0x7f41a0107c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:52.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.532+0000 7f419e59c640 1 --2- 172.21.15.17:0/469065271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41a01067f0 0x7f41a0107c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.532+0000 7f419e59c640 1 -- 172.21.15.17:0/469065271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a01081a0 con 0x7f41a01007f0 2024-09-20T18:40:52.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.532+0000 7f419e59c640 1 --2- 172.21.15.17:0/469065271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a01007f0 0x7f41a0107720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4190031460 tx=0x7f41900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:52.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.532+0000 7f41977fe640 1 -- 172.21.15.17:0/469065271 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f419003f070 con 0x7f41a01007f0 2024-09-20T18:40:52.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.532+0000 7f41977fe640 1 -- 172.21.15.17:0/469065271 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4190004cf0 con 0x7f41a01007f0 2024-09-20T18:40:52.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.532+0000 7f41a4eba640 1 -- 172.21.15.17:0/469065271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a0108430 con 0x7f41a01007f0 2024-09-20T18:40:52.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.532+0000 7f41977fe640 1 -- 172.21.15.17:0/469065271 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4190035030 con 0x7f41a01007f0 2024-09-20T18:40:52.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.532+0000 7f41a4eba640 1 -- 172.21.15.17:0/469065271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a01a3cc0 con 0x7f41a01007f0 2024-09-20T18:40:52.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.533+0000 7f41a4eba640 1 -- 172.21.15.17:0/469065271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a0101f30 con 0x7f41a01007f0 2024-09-20T18:40:52.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.534+0000 7f41977fe640 1 -- 172.21.15.17:0/469065271 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4190042070 con 0x7f41a01007f0 2024-09-20T18:40:52.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.534+0000 7f41977fe640 1 --2- 172.21.15.17:0/469065271 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f418c07af30 0x7f418c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:52.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.534+0000 7f41977fe640 1 -- 172.21.15.17:0/469065271 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5984+0+0 (secure 0 0 0) 0x7f41900bea50 con 0x7f41a01007f0 2024-09-20T18:40:52.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.534+0000 7f4197fff640 1 --2- 172.21.15.17:0/469065271 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f418c07af30 0x7f418c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:52.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.535+0000 7f4197fff640 1 --2- 172.21.15.17:0/469065271 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f418c07af30 0x7f418c07d3f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4188005e10 tx=0x7f4188005da0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:52.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.539+0000 7f41977fe640 1 -- 172.21.15.17:0/469065271 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f419008a100 con 0x7f41a01007f0 2024-09-20T18:40:52.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.805+0000 7f41a4eba640 1 -- 172.21.15.17:0/469065271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f41a01a3f20 con 0x7f41a01007f0 2024-09-20T18:40:52.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.806+0000 7f41977fe640 1 -- 172.21.15.17:0/469065271 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+732 (secure 0 0 0) 0x7f419008efb0 con 0x7f41a01007f0 2024-09-20T18:40:52.822 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:40:52.822 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:40:52.822 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:40:52.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:40:52.823 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:40:52.823 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:40:52.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:40:52.823 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:40:52.823 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 5 2024-09-20T18:40:52.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:40:52.823 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:40:52.823 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:40:52.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:40:52.824 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:40:52.824 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 9, 2024-09-20T18:40:52.824 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T18:40:52.824 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:40:52.824 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:40:52.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.808+0000 7f41a4eba640 1 -- 172.21.15.17:0/469065271 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f418c07af30 msgr2=0x7f418c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:52.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.808+0000 7f41a4eba640 1 --2- 172.21.15.17:0/469065271 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f418c07af30 0x7f418c07d3f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4188005e10 tx=0x7f4188005da0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.808+0000 7f41a4eba640 1 -- 172.21.15.17:0/469065271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a01007f0 msgr2=0x7f41a0107720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:52.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.808+0000 7f41a4eba640 1 --2- 172.21.15.17:0/469065271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a01007f0 0x7f41a0107720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4190031460 tx=0x7f41900048f0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.808+0000 7f41a4eba640 1 -- 172.21.15.17:0/469065271 shutdown_connections 2024-09-20T18:40:52.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.808+0000 7f41a4eba640 1 --2- 172.21.15.17:0/469065271 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f418c07af30 0x7f418c07d3f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.808+0000 7f41a4eba640 1 --2- 172.21.15.17:0/469065271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41a01067f0 0x7f41a0107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.808+0000 7f41a4eba640 1 --2- 172.21.15.17:0/469065271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a01007f0 0x7f41a0107720 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.808+0000 7f41a4eba640 1 -- 172.21.15.17:0/469065271 >> 172.21.15.17:0/469065271 conn(0x7f41a00fc550 msgr2=0x7f41a0069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:52.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.808+0000 7f41a4eba640 1 -- 172.21.15.17:0/469065271 shutdown_connections 2024-09-20T18:40:52.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.808+0000 7f41a4eba640 1 -- 172.21.15.17:0/469065271 wait complete. 2024-09-20T18:40:52.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.892+0000 7f77d4b9a640 1 -- 172.21.15.17:0/4091839844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77d0103440 msgr2=0x7f77d010b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:52.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.892+0000 7f77d4b9a640 1 --2- 172.21.15.17:0/4091839844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77d0103440 0x7f77d010b930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f77c40098b0 tx=0x7f77c402a560 comp rx=0 tx=0).stop 2024-09-20T18:40:52.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.893+0000 7f77d4b9a640 1 -- 172.21.15.17:0/4091839844 shutdown_connections 2024-09-20T18:40:52.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.893+0000 7f77d4b9a640 1 --2- 172.21.15.17:0/4091839844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77d0103440 0x7f77d010b930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.893+0000 7f77d4b9a640 1 --2- 172.21.15.17:0/4091839844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77d0102b20 0x7f77d0102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.893+0000 7f77d4b9a640 1 -- 172.21.15.17:0/4091839844 >> 172.21.15.17:0/4091839844 conn(0x7f77d00fc520 msgr2=0x7f77d00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.893+0000 7f77d4b9a640 1 -- 172.21.15.17:0/4091839844 shutdown_connections 2024-09-20T18:40:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.893+0000 7f77d4b9a640 1 -- 172.21.15.17:0/4091839844 wait complete. 2024-09-20T18:40:52.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.893+0000 7f77d4b9a640 1 Processor -- start 2024-09-20T18:40:52.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.894+0000 7f77d4b9a640 1 -- start start 2024-09-20T18:40:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.894+0000 7f77d4b9a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77d0102b20 0x7f77d019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.894+0000 7f77d4b9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77d0103440 0x7f77d019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.894+0000 7f77d4b9a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f77d010edd0 con 0x7f77d0103440 2024-09-20T18:40:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.894+0000 7f77d4b9a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f77d010ec50 con 0x7f77d0102b20 2024-09-20T18:40:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.894+0000 7f77cdd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77d0103440 0x7f77d019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.894+0000 7f77cdd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77d0103440 0x7f77d019dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43700/0 (socket says 172.21.15.17:43700) 2024-09-20T18:40:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.894+0000 7f77cdd9b640 1 -- 172.21.15.17:0/348885704 learned_addr learned my addr 172.21.15.17:0/348885704 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:40:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.894+0000 7f77ce59c640 1 --2- 172.21.15.17:0/348885704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77d0102b20 0x7f77d019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.894+0000 7f77cdd9b640 1 -- 172.21.15.17:0/348885704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77d0102b20 msgr2=0x7f77d019d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.894+0000 7f77cdd9b640 1 --2- 172.21.15.17:0/348885704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77d0102b20 0x7f77d019d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.894+0000 7f77cdd9b640 1 -- 172.21.15.17:0/348885704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d0197880 con 0x7f77d0103440 2024-09-20T18:40:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.894+0000 7f77ce59c640 1 --2- 172.21.15.17:0/348885704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77d0102b20 0x7f77d019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:40:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.894+0000 7f77cdd9b640 1 --2- 172.21.15.17:0/348885704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77d0103440 0x7f77d019dc00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f77c4031460 tx=0x7f77c40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.895+0000 7f77bf7fe640 1 -- 172.21.15.17:0/348885704 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77c403f070 con 0x7f77d0103440 2024-09-20T18:40:52.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.895+0000 7f77bf7fe640 1 -- 172.21.15.17:0/348885704 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f77c40035f0 con 0x7f77d0103440 2024-09-20T18:40:52.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.895+0000 7f77d4b9a640 1 -- 172.21.15.17:0/348885704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d0197b10 con 0x7f77d0103440 2024-09-20T18:40:52.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.895+0000 7f77bf7fe640 1 -- 172.21.15.17:0/348885704 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77c4035030 con 0x7f77d0103440 2024-09-20T18:40:52.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.895+0000 7f77d4b9a640 1 -- 172.21.15.17:0/348885704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d0198040 con 0x7f77d0103440 2024-09-20T18:40:52.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.896+0000 7f77d4b9a640 1 -- 172.21.15.17:0/348885704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d006aa30 con 0x7f77d0103440 2024-09-20T18:40:52.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.896+0000 7f77bf7fe640 1 -- 172.21.15.17:0/348885704 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f77c4042070 con 0x7f77d0103440 2024-09-20T18:40:52.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.897+0000 7f77bf7fe640 1 --2- 172.21.15.17:0/348885704 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f77b807af30 0x7f77b807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:52.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.897+0000 7f77ce59c640 1 --2- 172.21.15.17:0/348885704 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f77b807af30 0x7f77b807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:52.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.897+0000 7f77bf7fe640 1 -- 172.21.15.17:0/348885704 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5984+0+0 (secure 0 0 0) 0x7f77c40be8a0 con 0x7f77d0103440 2024-09-20T18:40:52.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.898+0000 7f77ce59c640 1 --2- 172.21.15.17:0/348885704 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f77b807af30 0x7f77b807d3f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f77d01989c0 tx=0x7f77c0005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:52.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:52.902+0000 7f77bf7fe640 1 -- 172.21.15.17:0/348885704 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f77c4089f50 con 0x7f77d0103440 2024-09-20T18:40:53.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.171+0000 7f77d4b9a640 1 -- 172.21.15.17:0/348885704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f77d0105fb0 con 0x7f77d0103440 2024-09-20T18:40:53.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.171+0000 7f77bf7fe640 1 -- 172.21.15.17:0/348885704 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2043 (secure 0 0 0) 0x7f77c408ee00 con 0x7f77d0103440 2024-09-20T18:40:53.188 INFO:teuthology.orchestra.run.smithi017.stdout:e15 2024-09-20T18:40:53.188 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:33:05:524203+0000 2024-09-20T18:40:53.188 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:40:53.188 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:40:53.188 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:40:53.189 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:40:53.189 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:40:53.189 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:40:53.189 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 15 2024-09-20T18:40:53.189 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T18:40:53.189 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:40:53.189 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:33:05.065474+0000 2024-09-20T18:40:53.189 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:40:53.189 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:40:53.190 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:40:53.190 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:40:53.190 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:40:53.190 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:40:53.190 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:40:53.190 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:40:53.190 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2024-09-20T18:40:53.190 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:40:53.190 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:40:53.190 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:40:53.190 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14552,1=24325} 2024-09-20T18:40:53.190 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-09-20T18:40:53.191 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:40:53.191 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:40:53.191 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:40:53.191 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:40:53.191 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:40:53.191 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:40:53.191 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:40:53.191 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:40:53.191 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 14552 members: 24325,14552 2024-09-20T18:40:53.191 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{0:14552} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.17:6826/3360305779,v1:172.21.15.17:6827/3360305779] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:40:53.191 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{0:14568} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.17:6828/53113052,v1:172.21.15.17:6829/53113052] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:40:53.191 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{1:24325} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.172:6824/1043027893,v1:172.21.15.172:6825/1043027893] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:40:53.191 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{1:24339} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/2975309540,v1:172.21.15.172:6827/2975309540] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:40:53.192 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:40:53.192 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:40:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 15 2024-09-20T18:40:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.173+0000 7f77d4b9a640 1 -- 172.21.15.17:0/348885704 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f77b807af30 msgr2=0x7f77b807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.173+0000 7f77d4b9a640 1 --2- 172.21.15.17:0/348885704 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f77b807af30 0x7f77b807d3f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f77d01989c0 tx=0x7f77c0005f90 comp rx=0 tx=0).stop 2024-09-20T18:40:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.173+0000 7f77d4b9a640 1 -- 172.21.15.17:0/348885704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77d0103440 msgr2=0x7f77d019dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.173+0000 7f77d4b9a640 1 --2- 172.21.15.17:0/348885704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77d0103440 0x7f77d019dc00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f77c4031460 tx=0x7f77c40045e0 comp rx=0 tx=0).stop 2024-09-20T18:40:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.174+0000 7f77d4b9a640 1 -- 172.21.15.17:0/348885704 shutdown_connections 2024-09-20T18:40:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.174+0000 7f77d4b9a640 1 --2- 172.21.15.17:0/348885704 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f77b807af30 0x7f77b807d3f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.174+0000 7f77d4b9a640 1 --2- 172.21.15.17:0/348885704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77d0103440 0x7f77d019dc00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.174+0000 7f77d4b9a640 1 --2- 172.21.15.17:0/348885704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77d0102b20 0x7f77d019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.174+0000 7f77d4b9a640 1 -- 172.21.15.17:0/348885704 >> 172.21.15.17:0/348885704 conn(0x7f77d00fc520 msgr2=0x7f77d0103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.174+0000 7f77d4b9a640 1 -- 172.21.15.17:0/348885704 shutdown_connections 2024-09-20T18:40:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.174+0000 7f77d4b9a640 1 -- 172.21.15.17:0/348885704 wait complete. 2024-09-20T18:40:53.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.260+0000 7f888f4e4640 1 -- 172.21.15.17:0/2342696203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8888101900 msgr2=0x7f8888101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:53.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.260+0000 7f888f4e4640 1 --2- 172.21.15.17:0/2342696203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8888101900 0x7f8888101d60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8878009880 tx=0x7f887802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:40:53.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.261+0000 7f888f4e4640 1 -- 172.21.15.17:0/2342696203 shutdown_connections 2024-09-20T18:40:53.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.261+0000 7f888f4e4640 1 --2- 172.21.15.17:0/2342696203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8888101900 0x7f8888101d60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:53.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.261+0000 7f888f4e4640 1 --2- 172.21.15.17:0/2342696203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8888107900 0x7f8888107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:53.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.261+0000 7f888f4e4640 1 -- 172.21.15.17:0/2342696203 >> 172.21.15.17:0/2342696203 conn(0x7f88880fd600 msgr2=0x7f88880ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:53.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.261+0000 7f888f4e4640 1 -- 172.21.15.17:0/2342696203 shutdown_connections 2024-09-20T18:40:53.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.261+0000 7f888f4e4640 1 -- 172.21.15.17:0/2342696203 wait complete. 2024-09-20T18:40:53.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.261+0000 7f888f4e4640 1 Processor -- start 2024-09-20T18:40:53.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.261+0000 7f888f4e4640 1 -- start start 2024-09-20T18:40:53.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.262+0000 7f888f4e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8888101900 0x7f88880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:53.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.262+0000 7f888f4e4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8888107900 0x7f8888074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:53.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.262+0000 7f888f4e4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f888810edd0 con 0x7f8888101900 2024-09-20T18:40:53.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.262+0000 7f888f4e4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f888810ec50 con 0x7f8888107900 2024-09-20T18:40:53.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.262+0000 7f888d280640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8888101900 0x7f88880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:53.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.262+0000 7f888d280640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8888101900 0x7f88880744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43730/0 (socket says 172.21.15.17:43730) 2024-09-20T18:40:53.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.262+0000 7f888d280640 1 -- 172.21.15.17:0/3638742383 learned_addr learned my addr 172.21.15.17:0/3638742383 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:40:53.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.262+0000 7f888ca7f640 1 --2- 172.21.15.17:0/3638742383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8888107900 0x7f8888074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:53.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.262+0000 7f888d280640 1 -- 172.21.15.17:0/3638742383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8888107900 msgr2=0x7f8888074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:53.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.262+0000 7f888d280640 1 --2- 172.21.15.17:0/3638742383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8888107900 0x7f8888074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:53.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.262+0000 7f888d280640 1 -- 172.21.15.17:0/3638742383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8888074f70 con 0x7f8888101900 2024-09-20T18:40:53.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.262+0000 7f888d280640 1 --2- 172.21.15.17:0/3638742383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8888101900 0x7f88880744f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f888400e970 tx=0x7f888400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:53.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.262+0000 7f887e7fc640 1 -- 172.21.15.17:0/3638742383 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f888400cac0 con 0x7f8888101900 2024-09-20T18:40:53.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.262+0000 7f887e7fc640 1 -- 172.21.15.17:0/3638742383 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f88840054e0 con 0x7f8888101900 2024-09-20T18:40:53.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.262+0000 7f888f4e4640 1 -- 172.21.15.17:0/3638742383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8888075260 con 0x7f8888101900 2024-09-20T18:40:53.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.262+0000 7f887e7fc640 1 -- 172.21.15.17:0/3638742383 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8884010430 con 0x7f8888101900 2024-09-20T18:40:53.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.262+0000 7f888f4e4640 1 -- 172.21.15.17:0/3638742383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88881a3e20 con 0x7f8888101900 2024-09-20T18:40:53.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.264+0000 7f888f4e4640 1 -- 172.21.15.17:0/3638742383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8888103040 con 0x7f8888101900 2024-09-20T18:40:53.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.264+0000 7f887e7fc640 1 -- 172.21.15.17:0/3638742383 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8884004ea0 con 0x7f8888101900 2024-09-20T18:40:53.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.265+0000 7f887e7fc640 1 --2- 172.21.15.17:0/3638742383 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f887407af30 0x7f887407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:53.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.265+0000 7f888ca7f640 1 --2- 172.21.15.17:0/3638742383 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f887407af30 0x7f887407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:53.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.265+0000 7f887e7fc640 1 -- 172.21.15.17:0/3638742383 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5984+0+0 (secure 0 0 0) 0x7f888409e5d0 con 0x7f8888101900 2024-09-20T18:40:53.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.265+0000 7f888ca7f640 1 --2- 172.21.15.17:0/3638742383 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f887407af30 0x7f887407d3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8888075f80 tx=0x7f8878031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:53.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.269+0000 7f887e7fc640 1 -- 172.21.15.17:0/3638742383 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8884069c80 con 0x7f8888101900 2024-09-20T18:40:53.345 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 18:40:53 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0[117206]: 2024-09-20T18:40:53.078+0000 7f9bcf150640 -1 osd.0 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T18:40:53.345 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:53 smithi017 ceph-mon[108970]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:40:53.345 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:53 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:53.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:53 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:40:53.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:53 smithi017 ceph-mon[108970]: from='osd.0 [v2:172.21.15.17:6802/3066747523,v1:172.21.15.17:6803/3066747523]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-20T18:40:53.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:53 smithi017 ceph-mon[108970]: from='client.44127 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:40:53.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:53 smithi017 ceph-mon[108970]: pgmap v133: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s; 59/318 objects degraded (18.553%) 2024-09-20T18:40:53.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:53 smithi017 ceph-mon[108970]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:40:53.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:53 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/469065271' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:53.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:53 smithi172 ceph-mon[80431]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:40:53.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:53 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:53.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:53 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:40:53.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:53 smithi172 ceph-mon[80431]: from='osd.0 [v2:172.21.15.17:6802/3066747523,v1:172.21.15.17:6803/3066747523]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-20T18:40:53.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:53 smithi172 ceph-mon[80431]: from='client.44127 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:40:53.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:53 smithi172 ceph-mon[80431]: pgmap v133: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s; 59/318 objects degraded (18.553%) 2024-09-20T18:40:53.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:53 smithi172 ceph-mon[80431]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:40:53.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:53 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/469065271' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:53.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.477+0000 7f888f4e4640 1 -- 172.21.15.17:0/3638742383 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8888062630 con 0x7f887407af30 2024-09-20T18:40:53.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.479+0000 7f887e7fc640 1 -- 172.21.15.17:0/3638742383 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f8888062630 con 0x7f887407af30 2024-09-20T18:40:53.494 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:40:53.494 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:40:53.494 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:40:53.494 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:40:53.494 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:40:53.494 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:40:53.495 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:40:53.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:40:53.495 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:40:53.495 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "7/23 daemons upgraded", 2024-09-20T18:40:53.495 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T18:40:53.495 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:40:53.495 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:40:53.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.481+0000 7f888f4e4640 1 -- 172.21.15.17:0/3638742383 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f887407af30 msgr2=0x7f887407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:53.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.481+0000 7f888f4e4640 1 --2- 172.21.15.17:0/3638742383 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f887407af30 0x7f887407d3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8888075f80 tx=0x7f8878031400 comp rx=0 tx=0).stop 2024-09-20T18:40:53.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.481+0000 7f888f4e4640 1 -- 172.21.15.17:0/3638742383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8888101900 msgr2=0x7f88880744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:53.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.481+0000 7f888f4e4640 1 --2- 172.21.15.17:0/3638742383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8888101900 0x7f88880744f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f888400e970 tx=0x7f888400ed70 comp rx=0 tx=0).stop 2024-09-20T18:40:53.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.481+0000 7f888f4e4640 1 -- 172.21.15.17:0/3638742383 shutdown_connections 2024-09-20T18:40:53.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.481+0000 7f888f4e4640 1 --2- 172.21.15.17:0/3638742383 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f887407af30 0x7f887407d3f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:53.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.481+0000 7f888f4e4640 1 --2- 172.21.15.17:0/3638742383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8888107900 0x7f8888074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:53.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.481+0000 7f888f4e4640 1 --2- 172.21.15.17:0/3638742383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8888101900 0x7f88880744f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:53.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.481+0000 7f888f4e4640 1 -- 172.21.15.17:0/3638742383 >> 172.21.15.17:0/3638742383 conn(0x7f88880fd600 msgr2=0x7f88880fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:53.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.481+0000 7f888f4e4640 1 -- 172.21.15.17:0/3638742383 shutdown_connections 2024-09-20T18:40:53.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.481+0000 7f888f4e4640 1 -- 172.21.15.17:0/3638742383 wait complete. 2024-09-20T18:40:53.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.567+0000 7f6c9f9b3640 1 -- 172.21.15.17:0/3290406755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c98100ff0 msgr2=0x7f6c9810dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:53.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.567+0000 7f6c9f9b3640 1 --2- 172.21.15.17:0/3290406755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c98100ff0 0x7f6c9810dcb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009880 tx=0x7f6c8802a490 comp rx=0 tx=0).stop 2024-09-20T18:40:53.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.567+0000 7f6c9f9b3640 1 -- 172.21.15.17:0/3290406755 shutdown_connections 2024-09-20T18:40:53.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.567+0000 7f6c9f9b3640 1 --2- 172.21.15.17:0/3290406755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c98100ff0 0x7f6c9810dcb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:53.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.567+0000 7f6c9f9b3640 1 --2- 172.21.15.17:0/3290406755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c98100640 0x7f6c98100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:53.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.567+0000 7f6c9f9b3640 1 -- 172.21.15.17:0/3290406755 >> 172.21.15.17:0/3290406755 conn(0x7f6c980fc550 msgr2=0x7f6c980fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:53.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.567+0000 7f6c9f9b3640 1 -- 172.21.15.17:0/3290406755 shutdown_connections 2024-09-20T18:40:53.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.567+0000 7f6c9f9b3640 1 -- 172.21.15.17:0/3290406755 wait complete. 2024-09-20T18:40:53.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.568+0000 7f6c9f9b3640 1 Processor -- start 2024-09-20T18:40:53.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.568+0000 7f6c9f9b3640 1 -- start start 2024-09-20T18:40:53.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.568+0000 7f6c9f9b3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c98100640 0x7f6c9819f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:53.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.568+0000 7f6c9f9b3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c98100ff0 0x7f6c9819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:53.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.568+0000 7f6c9f9b3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6c98110f90 con 0x7f6c98100ff0 2024-09-20T18:40:53.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.568+0000 7f6c9f9b3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6c98110e10 con 0x7f6c98100640 2024-09-20T18:40:53.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.568+0000 7f6c9cf4e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c98100ff0 0x7f6c9819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:53.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.568+0000 7f6c9cf4e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c98100ff0 0x7f6c9819fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43758/0 (socket says 172.21.15.17:43758) 2024-09-20T18:40:53.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.568+0000 7f6c9cf4e640 1 -- 172.21.15.17:0/519835933 learned_addr learned my addr 172.21.15.17:0/519835933 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:40:53.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.568+0000 7f6c9d74f640 1 --2- 172.21.15.17:0/519835933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c98100640 0x7f6c9819f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:53.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.569+0000 7f6c9cf4e640 1 -- 172.21.15.17:0/519835933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c98100640 msgr2=0x7f6c9819f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:53.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.569+0000 7f6c9cf4e640 1 --2- 172.21.15.17:0/519835933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c98100640 0x7f6c9819f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:53.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.569+0000 7f6c9cf4e640 1 -- 172.21.15.17:0/519835933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c981999c0 con 0x7f6c98100ff0 2024-09-20T18:40:53.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.569+0000 7f6c9cf4e640 1 --2- 172.21.15.17:0/519835933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c98100ff0 0x7f6c9819fd40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6c88031460 tx=0x7f6c88004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:53.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.569+0000 7f6c8e7fc640 1 -- 172.21.15.17:0/519835933 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c8803f070 con 0x7f6c98100ff0 2024-09-20T18:40:53.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.569+0000 7f6c8e7fc640 1 -- 172.21.15.17:0/519835933 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6c880035f0 con 0x7f6c98100ff0 2024-09-20T18:40:53.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.569+0000 7f6c9f9b3640 1 -- 172.21.15.17:0/519835933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c98199c50 con 0x7f6c98100ff0 2024-09-20T18:40:53.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.569+0000 7f6c8e7fc640 1 -- 172.21.15.17:0/519835933 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c88035030 con 0x7f6c98100ff0 2024-09-20T18:40:53.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.569+0000 7f6c9f9b3640 1 -- 172.21.15.17:0/519835933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c9819a1e0 con 0x7f6c98100ff0 2024-09-20T18:40:53.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.570+0000 7f6c9f9b3640 1 -- 172.21.15.17:0/519835933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c9806a580 con 0x7f6c98100ff0 2024-09-20T18:40:53.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.571+0000 7f6c8e7fc640 1 -- 172.21.15.17:0/519835933 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6c88042070 con 0x7f6c98100ff0 2024-09-20T18:40:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.571+0000 7f6c8e7fc640 1 --2- 172.21.15.17:0/519835933 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c8407af30 0x7f6c8407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:40:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.572+0000 7f6c8e7fc640 1 -- 172.21.15.17:0/519835933 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5984+0+0 (secure 0 0 0) 0x7f6c880be850 con 0x7f6c98100ff0 2024-09-20T18:40:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.572+0000 7f6c9d74f640 1 --2- 172.21.15.17:0/519835933 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c8407af30 0x7f6c8407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:40:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.572+0000 7f6c9d74f640 1 --2- 172.21.15.17:0/519835933 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c8407af30 0x7f6c8407d3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c9819ab00 tx=0x7f6c94005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:40:53.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.576+0000 7f6c8e7fc640 1 -- 172.21.15.17:0/519835933 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6c88089f00 con 0x7f6c98100ff0 2024-09-20T18:40:53.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.837+0000 7f6c9f9b3640 1 -- 172.21.15.17:0/519835933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6c9819aef0 con 0x7f6c98100ff0 2024-09-20T18:40:53.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.837+0000 7f6c8e7fc640 1 -- 172.21.15.17:0/519835933 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1573 (secure 0 0 0) 0x7f6c8808edb0 con 0x7f6c98100ff0 2024-09-20T18:40:53.853 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 59/318 objects degraded (18.553%), 20 pgs degraded 2024-09-20T18:40:53.853 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:40:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:40:53.853 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-20T18:40:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: osd.0 (root=default,host=smithi017) is down 2024-09-20T18:40:53.853 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 59/318 objects degraded (18.553%), 20 pgs degraded 2024-09-20T18:40:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-20T18:40:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-20T18:40:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-20T18:40:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-20T18:40:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-20T18:40:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-20T18:40:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-20T18:40:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-20T18:40:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-20T18:40:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-20T18:40:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-20T18:40:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-20T18:40:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-09-20T18:40:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-20T18:40:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-20T18:40:53.855 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-20T18:40:53.855 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-20T18:40:53.855 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-20T18:40:53.855 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-20T18:40:53.855 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-20T18:40:53.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.839+0000 7f6c9f9b3640 1 -- 172.21.15.17:0/519835933 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c8407af30 msgr2=0x7f6c8407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:53.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.839+0000 7f6c9f9b3640 1 --2- 172.21.15.17:0/519835933 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c8407af30 0x7f6c8407d3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c9819ab00 tx=0x7f6c94005f90 comp rx=0 tx=0).stop 2024-09-20T18:40:53.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.839+0000 7f6c9f9b3640 1 -- 172.21.15.17:0/519835933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c98100ff0 msgr2=0x7f6c9819fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:40:53.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.839+0000 7f6c9f9b3640 1 --2- 172.21.15.17:0/519835933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c98100ff0 0x7f6c9819fd40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6c88031460 tx=0x7f6c88004530 comp rx=0 tx=0).stop 2024-09-20T18:40:53.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.839+0000 7f6c9f9b3640 1 -- 172.21.15.17:0/519835933 shutdown_connections 2024-09-20T18:40:53.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.839+0000 7f6c9f9b3640 1 --2- 172.21.15.17:0/519835933 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c8407af30 0x7f6c8407d3f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:53.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.839+0000 7f6c9f9b3640 1 --2- 172.21.15.17:0/519835933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c98100ff0 0x7f6c9819fd40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:53.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.839+0000 7f6c9f9b3640 1 --2- 172.21.15.17:0/519835933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c98100640 0x7f6c9819f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:40:53.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.839+0000 7f6c9f9b3640 1 -- 172.21.15.17:0/519835933 >> 172.21.15.17:0/519835933 conn(0x7f6c980fc550 msgr2=0x7f6c980fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:40:53.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.840+0000 7f6c9f9b3640 1 -- 172.21.15.17:0/519835933 shutdown_connections 2024-09-20T18:40:53.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:40:53.840+0000 7f6c9f9b3640 1 -- 172.21.15.17:0/519835933 wait complete. 2024-09-20T18:40:54.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:54 smithi017 ceph-mon[108970]: from='osd.0 [v2:172.21.15.17:6802/3066747523,v1:172.21.15.17:6803/3066747523]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T18:40:54.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:54 smithi017 ceph-mon[108970]: osdmap e49: 6 total, 5 up, 6 in 2024-09-20T18:40:54.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:54 smithi017 ceph-mon[108970]: from='osd.0 [v2:172.21.15.17:6802/3066747523,v1:172.21.15.17:6803/3066747523]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-20T18:40:54.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:54 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/348885704' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:40:54.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:54 smithi017 ceph-mon[108970]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:40:54.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:54 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/519835933' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:40:54.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:54 smithi172 ceph-mon[80431]: from='osd.0 [v2:172.21.15.17:6802/3066747523,v1:172.21.15.17:6803/3066747523]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-20T18:40:54.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:54 smithi172 ceph-mon[80431]: osdmap e49: 6 total, 5 up, 6 in 2024-09-20T18:40:54.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:54 smithi172 ceph-mon[80431]: from='osd.0 [v2:172.21.15.17:6802/3066747523,v1:172.21.15.17:6803/3066747523]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-20T18:40:54.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:54 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/348885704' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:40:54.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:54 smithi172 ceph-mon[80431]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:40:54.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:54 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/519835933' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:40:55.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:55 smithi017 ceph-mon[108970]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T18:40:55.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:55 smithi017 ceph-mon[108970]: osd.0 [v2:172.21.15.17:6802/3066747523,v1:172.21.15.17:6803/3066747523] boot 2024-09-20T18:40:55.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:55 smithi017 ceph-mon[108970]: osdmap e50: 6 total, 6 up, 6 in 2024-09-20T18:40:55.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-20T18:40:55.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:55 smithi017 ceph-mon[108970]: pgmap v136: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 59/318 objects degraded (18.553%) 2024-09-20T18:40:55.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:55.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:55.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:40:55.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:40:55.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:55.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:40:55.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:55.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:55.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:55.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-20T18:40:55.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:55 smithi017 ceph-mon[108970]: osdmap e51: 6 total, 6 up, 6 in 2024-09-20T18:40:55.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:55 smithi172 ceph-mon[80431]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T18:40:55.462 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:55 smithi172 ceph-mon[80431]: osd.0 [v2:172.21.15.17:6802/3066747523,v1:172.21.15.17:6803/3066747523] boot 2024-09-20T18:40:55.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:55 smithi172 ceph-mon[80431]: osdmap e50: 6 total, 6 up, 6 in 2024-09-20T18:40:55.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-20T18:40:55.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:55 smithi172 ceph-mon[80431]: pgmap v136: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 59/318 objects degraded (18.553%) 2024-09-20T18:40:55.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:55.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:55.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:40:55.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:40:55.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:40:55.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:40:55.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:55.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:55.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:40:55.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-20T18:40:55.464 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:55 smithi172 ceph-mon[80431]: osdmap e51: 6 total, 6 up, 6 in 2024-09-20T18:40:56.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:56 smithi017 ceph-mon[108970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T18:40:56.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:56 smithi017 ceph-mon[108970]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-20T18:40:56.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:56 smithi172 ceph-mon[80431]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T18:40:56.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:56 smithi172 ceph-mon[80431]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-20T18:40:57.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:57 smithi017 ceph-mon[108970]: pgmap v138: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 59/318 objects degraded (18.553%) 2024-09-20T18:40:57.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:57 smithi172 ceph-mon[80431]: pgmap v138: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 59/318 objects degraded (18.553%) 2024-09-20T18:40:58.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:58 smithi172 ceph-mon[80431]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 59/318 objects degraded (18.553%), 20 pgs degraded) 2024-09-20T18:40:58.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:58 smithi017 ceph-mon[108970]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 59/318 objects degraded (18.553%), 20 pgs degraded) 2024-09-20T18:40:59.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:40:59 smithi172 ceph-mon[80431]: pgmap v139: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:40:59.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:40:59 smithi017 ceph-mon[108970]: pgmap v139: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:41:01.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:01 smithi172 ceph-mon[80431]: pgmap v140: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-20T18:41:01.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:01 smithi017 ceph-mon[108970]: pgmap v140: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-20T18:41:03.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:03 smithi172 ceph-mon[80431]: pgmap v141: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-20T18:41:03.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:03 smithi017 ceph-mon[108970]: pgmap v141: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-20T18:41:05.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:05 smithi017 ceph-mon[108970]: pgmap v142: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:41:05.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:05 smithi172 ceph-mon[80431]: pgmap v142: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:41:07.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:07 smithi172 ceph-mon[80431]: pgmap v143: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-20T18:41:07.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:07.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:41:07.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:07.751 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:07 smithi017 ceph-mon[108970]: pgmap v143: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-20T18:41:07.751 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:07.751 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:41:07.751 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:09.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:09 smithi172 ceph-mon[80431]: pgmap v144: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:41:09.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:09 smithi017 ceph-mon[108970]: pgmap v144: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:41:10.618 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:10 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-20T18:41:10.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:10 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-20T18:41:11.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:11 smithi172 ceph-mon[80431]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T18:41:11.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:11 smithi172 ceph-mon[80431]: Upgrade: osd.1 is safe to restart 2024-09-20T18:41:11.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:11 smithi172 ceph-mon[80431]: pgmap v145: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:41:11.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:11 smithi017 ceph-mon[108970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-20T18:41:11.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:11 smithi017 ceph-mon[108970]: Upgrade: osd.1 is safe to restart 2024-09-20T18:41:11.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:11 smithi017 ceph-mon[108970]: pgmap v145: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:41:12.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:12 smithi017 ceph-mon[108970]: Upgrade: Updating osd.1 2024-09-20T18:41:12.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:12 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:12.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:12 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-20T18:41:12.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:12 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:41:12.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:12 smithi017 ceph-mon[108970]: Deploying daemon osd.1 on smithi017 2024-09-20T18:41:12.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:12 smithi172 ceph-mon[80431]: Upgrade: Updating osd.1 2024-09-20T18:41:12.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:12 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:12.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:12 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-20T18:41:12.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:12 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:41:12.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:12 smithi172 ceph-mon[80431]: Deploying daemon osd.1 on smithi017 2024-09-20T18:41:13.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:13 smithi172 ceph-mon[80431]: pgmap v146: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:41:13.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:13 smithi017 ceph-mon[108970]: pgmap v146: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:41:14.928 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:14 smithi017 systemd[1]: Stopping Ceph osd.1 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:41:15.401 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:14 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1[57063]: 2024-09-20T18:41:14.910+0000 7fed4a9f4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T18:41:15.401 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:14 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1[57063]: 2024-09-20T18:41:14.910+0000 7fed4a9f4640 -1 osd.1 51 *** Got signal Terminated *** 2024-09-20T18:41:15.401 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:14 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1[57063]: 2024-09-20T18:41:14.910+0000 7fed4a9f4640 -1 osd.1 51 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T18:41:15.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:15 smithi017 ceph-mon[108970]: pgmap v147: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:41:15.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:15 smithi017 ceph-mon[108970]: osd.1 marked itself down and dead 2024-09-20T18:41:15.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:15 smithi172 ceph-mon[80431]: pgmap v147: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:41:15.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:15 smithi172 ceph-mon[80431]: osd.1 marked itself down and dead 2024-09-20T18:41:16.373 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:16 smithi017 podman[121907]: 2024-09-20 18:41:16.056348767 +0000 UTC m=+1.257408918 container died 73f2fd77590f6cb4466cb0eb22563d83dc3ee3f03294d330dc2fd7a0a38f2e39 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-ed8ee0f, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-20T18:41:16.628 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:16 smithi017 podman[121907]: 2024-09-20 18:41:16.465332158 +0000 UTC m=+1.666392313 container cleanup 73f2fd77590f6cb4466cb0eb22563d83dc3ee3f03294d330dc2fd7a0a38f2e39 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-ed8ee0f, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-20T18:41:16.628 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:16 smithi017 bash[121907]: ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1 2024-09-20T18:41:16.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:16 smithi017 ceph-mon[108970]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T18:41:16.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:16 smithi017 ceph-mon[108970]: osdmap e52: 6 total, 5 up, 6 in 2024-09-20T18:41:16.901 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:16 smithi017 podman[121925]: 2024-09-20 18:41:16.716823371 +0000 UTC m=+0.655232066 container remove 73f2fd77590f6cb4466cb0eb22563d83dc3ee3f03294d330dc2fd7a0a38f2e39 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1, RELEASE=squid-ed8ee0f, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-20T18:41:16.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:16 smithi172 ceph-mon[80431]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T18:41:16.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:16 smithi172 ceph-mon[80431]: osdmap e52: 6 total, 5 up, 6 in 2024-09-20T18:41:17.301 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:17 smithi017 podman[122011]: 2024-09-20 18:41:16.939271825 +0000 UTC m=+0.016842875 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:41:17.302 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:17 smithi017 podman[122011]: 2024-09-20 18:41:17.051153666 +0000 UTC m=+0.128724774 container create ffe7189b111b26a6e8ae153d03fd3da977559a1a733799fcc57b559e6d311235 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-20T18:41:17.302 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:17 smithi017 podman[122011]: 2024-09-20 18:41:17.286861695 +0000 UTC m=+0.364432744 container init ffe7189b111b26a6e8ae153d03fd3da977559a1a733799fcc57b559e6d311235 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-09-20T18:41:17.636 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:17 smithi017 podman[122011]: 2024-09-20 18:41:17.290704941 +0000 UTC m=+0.368275999 container start ffe7189b111b26a6e8ae153d03fd3da977559a1a733799fcc57b559e6d311235 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD) 2024-09-20T18:41:17.637 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:17 smithi017 podman[122011]: 2024-09-20 18:41:17.403886846 +0000 UTC m=+0.481457895 container attach ffe7189b111b26a6e8ae153d03fd3da977559a1a733799fcc57b559e6d311235 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-20T18:41:17.637 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:17 smithi017 podman[122011]: 2024-09-20 18:41:17.484067549 +0000 UTC m=+0.561638610 container died ffe7189b111b26a6e8ae153d03fd3da977559a1a733799fcc57b559e6d311235 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-20T18:41:17.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:17 smithi017 ceph-mon[108970]: pgmap v149: 65 pgs: 12 stale+active+clean, 53 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:41:17.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:17 smithi017 ceph-mon[108970]: osdmap e53: 6 total, 5 up, 6 in 2024-09-20T18:41:17.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:17 smithi172 ceph-mon[80431]: pgmap v149: 65 pgs: 12 stale+active+clean, 53 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:41:17.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:17 smithi172 ceph-mon[80431]: osdmap e53: 6 total, 5 up, 6 in 2024-09-20T18:41:18.503 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:18 smithi017 podman[122035]: 2024-09-20 18:41:18.23346002 +0000 UTC m=+0.743080933 container remove ffe7189b111b26a6e8ae153d03fd3da977559a1a733799fcc57b559e6d311235 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-20T18:41:18.503 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:18 smithi017 systemd[1]: ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.1.service: Deactivated successfully. 2024-09-20T18:41:18.503 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:18 smithi017 systemd[1]: Stopped Ceph osd.1 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:41:18.503 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:18 smithi017 systemd[1]: ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.1.service: Consumed 1min 4.116s CPU time. 2024-09-20T18:41:18.823 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:18 smithi017 ceph-mon[108970]: Health check failed: Degraded data redundancy: 47/318 objects degraded (14.780%), 15 pgs degraded (PG_DEGRADED) 2024-09-20T18:41:18.823 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:18 smithi017 systemd[1]: Starting Ceph osd.1 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:41:18.823 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:18 smithi017 podman[122134]: 2024-09-20 18:41:18.606016433 +0000 UTC m=+0.016493203 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:41:18.823 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:18 smithi017 podman[122134]: 2024-09-20 18:41:18.718234733 +0000 UTC m=+0.128711533 container create e2323fe261e9c172bfb34689c6181696e1d112ba44904a9ae0148360c5f1c4cd (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-20T18:41:18.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:18 smithi172 ceph-mon[80431]: Health check failed: Degraded data redundancy: 47/318 objects degraded (14.780%), 15 pgs degraded (PG_DEGRADED) 2024-09-20T18:41:19.101 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:18 smithi017 podman[122134]: 2024-09-20 18:41:18.946461134 +0000 UTC m=+0.356937896 container init e2323fe261e9c172bfb34689c6181696e1d112ba44904a9ae0148360c5f1c4cd (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T18:41:19.101 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:18 smithi017 podman[122134]: 2024-09-20 18:41:18.950761897 +0000 UTC m=+0.361238665 container start e2323fe261e9c172bfb34689c6181696e1d112ba44904a9ae0148360c5f1c4cd (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-09-20T18:41:19.101 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:19 smithi017 podman[122134]: 2024-09-20 18:41:19.054324135 +0000 UTC m=+0.464800906 container attach e2323fe261e9c172bfb34689c6181696e1d112ba44904a9ae0148360c5f1c4cd (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T18:41:19.401 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:19 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate[122148]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:41:19.401 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:19 smithi017 bash[122134]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:41:19.401 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:19 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate[122148]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:41:19.401 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:19 smithi017 bash[122134]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:41:19.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:19 smithi017 ceph-mon[108970]: pgmap v151: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/318 objects degraded (14.780%) 2024-09-20T18:41:19.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:19 smithi172 ceph-mon[80431]: pgmap v151: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/318 objects degraded (14.780%) 2024-09-20T18:41:21.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:21 smithi172 ceph-mon[80431]: pgmap v152: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/318 objects degraded (14.780%) 2024-09-20T18:41:21.966 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:21 smithi017 ceph-mon[108970]: pgmap v152: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/318 objects degraded (14.780%) 2024-09-20T18:41:22.388 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate[122148]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T18:41:22.388 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate[122148]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:41:22.388 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 bash[122134]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T18:41:22.389 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 bash[122134]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:41:22.389 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate[122148]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:41:22.389 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 bash[122134]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:41:22.389 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate[122148]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T18:41:22.389 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 bash[122134]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T18:41:22.389 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate[122148]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-09-20T18:41:22.389 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 bash[122134]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-09-20T18:41:22.389 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate[122148]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-20T18:41:22.389 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 bash[122134]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-20T18:41:22.651 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate[122148]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-09-20T18:41:22.651 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 bash[122134]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-09-20T18:41:22.652 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate[122148]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-20T18:41:22.652 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 bash[122134]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-20T18:41:22.652 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate[122148]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T18:41:22.652 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 bash[122134]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-20T18:41:22.652 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate[122148]: --> ceph-volume lvm activate successful for osd ID: 1 2024-09-20T18:41:22.652 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 bash[122134]: --> ceph-volume lvm activate successful for osd ID: 1 2024-09-20T18:41:22.652 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:22 smithi017 podman[122134]: 2024-09-20 18:41:22.403886704 +0000 UTC m=+3.814363475 container died e2323fe261e9c172bfb34689c6181696e1d112ba44904a9ae0148360c5f1c4cd (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-20T18:41:23.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:23 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:23.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:23 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:41:23.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:23 smithi017 ceph-mon[108970]: pgmap v153: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/318 objects degraded (14.780%) 2024-09-20T18:41:23.401 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:23 smithi017 podman[122361]: 2024-09-20 18:41:23.041404804 +0000 UTC m=+0.625953021 container remove e2323fe261e9c172bfb34689c6181696e1d112ba44904a9ae0148360c5f1c4cd (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-20T18:41:23.401 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:23 smithi017 podman[122422]: 2024-09-20 18:41:23.158568962 +0000 UTC m=+0.016942765 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:41:23.401 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:23 smithi017 podman[122422]: 2024-09-20 18:41:23.259028863 +0000 UTC m=+0.117402699 container create 9e34b5153d0a30363106f809c30abdb881d488a4514d9f1448b184f8ce8911dc (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T18:41:23.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:23 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:23.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:23 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:41:23.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:23 smithi172 ceph-mon[80431]: pgmap v153: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/318 objects degraded (14.780%) 2024-09-20T18:41:23.901 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:23 smithi017 podman[122422]: 2024-09-20 18:41:23.519862143 +0000 UTC m=+0.378235955 container init 9e34b5153d0a30363106f809c30abdb881d488a4514d9f1448b184f8ce8911dc (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1, ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-20T18:41:23.901 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:23 smithi017 podman[122422]: 2024-09-20 18:41:23.523147554 +0000 UTC m=+0.381521350 container start 9e34b5153d0a30363106f809c30abdb881d488a4514d9f1448b184f8ce8911dc (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-20T18:41:23.902 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:23 smithi017 ceph-osd[122440]: -- 172.21.15.17:0/772256563 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5561e45ba1e0 con 0x5561e454a000 2024-09-20T18:41:23.902 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:23 smithi017 bash[122422]: 9e34b5153d0a30363106f809c30abdb881d488a4514d9f1448b184f8ce8911dc 2024-09-20T18:41:23.902 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:23 smithi017 systemd[1]: Started Ceph osd.1 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:41:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.938+0000 7f5c8315f640 1 -- 172.21.15.17:0/2519624515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c7c1067f0 msgr2=0x7f5c7c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.938+0000 7f5c8315f640 1 --2- 172.21.15.17:0/2519624515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c7c1067f0 0x7f5c7c106bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009880 tx=0x7f5c7002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:41:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.938+0000 7f5c8315f640 1 -- 172.21.15.17:0/2519624515 shutdown_connections 2024-09-20T18:41:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.938+0000 7f5c8315f640 1 --2- 172.21.15.17:0/2519624515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c7c1007f0 0x7f5c7c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.938+0000 7f5c8315f640 1 --2- 172.21.15.17:0/2519624515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c7c1067f0 0x7f5c7c106bd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.938+0000 7f5c8315f640 1 -- 172.21.15.17:0/2519624515 >> 172.21.15.17:0/2519624515 conn(0x7f5c7c0fc550 msgr2=0x7f5c7c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.938+0000 7f5c8315f640 1 -- 172.21.15.17:0/2519624515 shutdown_connections 2024-09-20T18:41:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.938+0000 7f5c8315f640 1 -- 172.21.15.17:0/2519624515 wait complete. 2024-09-20T18:41:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.939+0000 7f5c8315f640 1 Processor -- start 2024-09-20T18:41:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.939+0000 7f5c8315f640 1 -- start start 2024-09-20T18:41:23.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.939+0000 7f5c8315f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c7c1007f0 0x7f5c7c198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:23.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.939+0000 7f5c8315f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c7c1067f0 0x7f5c7c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:23.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.939+0000 7f5c8315f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7c10dcc0 con 0x7f5c7c1067f0 2024-09-20T18:41:23.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.939+0000 7f5c8315f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7c10db40 con 0x7f5c7c1007f0 2024-09-20T18:41:23.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.939+0000 7f5c7bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c7c1067f0 0x7f5c7c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:23.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.939+0000 7f5c80efb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c7c1007f0 0x7f5c7c198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:23.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.939+0000 7f5c7bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c7c1067f0 0x7f5c7c198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55730/0 (socket says 172.21.15.17:55730) 2024-09-20T18:41:23.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.939+0000 7f5c80efb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c7c1007f0 0x7f5c7c198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:50208/0 (socket says 172.21.15.17:50208) 2024-09-20T18:41:23.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.939+0000 7f5c7bfff640 1 -- 172.21.15.17:0/1233138831 learned_addr learned my addr 172.21.15.17:0/1233138831 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:41:23.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.940+0000 7f5c80efb640 1 -- 172.21.15.17:0/1233138831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c7c1067f0 msgr2=0x7f5c7c198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:23.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.940+0000 7f5c80efb640 1 --2- 172.21.15.17:0/1233138831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c7c1067f0 0x7f5c7c198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:23.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.940+0000 7f5c80efb640 1 -- 172.21.15.17:0/1233138831 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7c199350 con 0x7f5c7c1007f0 2024-09-20T18:41:23.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.940+0000 7f5c80efb640 1 --2- 172.21.15.17:0/1233138831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c7c1007f0 0x7f5c7c198810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5c70006010 tx=0x7f5c700045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:23.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.940+0000 7f5c79ffb640 1 -- 172.21.15.17:0/1233138831 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c7003f070 con 0x7f5c7c1007f0 2024-09-20T18:41:23.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.940+0000 7f5c79ffb640 1 -- 172.21.15.17:0/1233138831 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c700035f0 con 0x7f5c7c1007f0 2024-09-20T18:41:23.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.940+0000 7f5c79ffb640 1 -- 172.21.15.17:0/1233138831 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c70035030 con 0x7f5c7c1007f0 2024-09-20T18:41:23.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.940+0000 7f5c8315f640 1 -- 172.21.15.17:0/1233138831 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c7c1995e0 con 0x7f5c7c1007f0 2024-09-20T18:41:23.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.940+0000 7f5c8315f640 1 -- 172.21.15.17:0/1233138831 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c7c1a1b90 con 0x7f5c7c1007f0 2024-09-20T18:41:23.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.942+0000 7f5c8315f640 1 -- 172.21.15.17:0/1233138831 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c7c101f30 con 0x7f5c7c1007f0 2024-09-20T18:41:23.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.942+0000 7f5c79ffb640 1 -- 172.21.15.17:0/1233138831 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5c70042070 con 0x7f5c7c1007f0 2024-09-20T18:41:23.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.943+0000 7f5c79ffb640 1 --2- 172.21.15.17:0/1233138831 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c6c07af80 0x7f5c6c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:23.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.943+0000 7f5c79ffb640 1 -- 172.21.15.17:0/1233138831 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5984+0+0 (secure 0 0 0) 0x7f5c700be6e0 con 0x7f5c7c1007f0 2024-09-20T18:41:23.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.943+0000 7f5c7bfff640 1 --2- 172.21.15.17:0/1233138831 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c6c07af80 0x7f5c6c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:23.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.943+0000 7f5c7bfff640 1 --2- 172.21.15.17:0/1233138831 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c6c07af80 0x7f5c6c07d440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c06a7f0 tx=0x7f5c68005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:23.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:23.947+0000 7f5c79ffb640 1 -- 172.21.15.17:0/1233138831 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5c70089e10 con 0x7f5c7c1007f0 2024-09-20T18:41:24.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.170+0000 7f5c8315f640 1 -- 172.21.15.17:0/1233138831 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5c7c062630 con 0x7f5c6c07af80 2024-09-20T18:41:24.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.171+0000 7f5c79ffb640 1 -- 172.21.15.17:0/1233138831 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f5c7c062630 con 0x7f5c6c07af80 2024-09-20T18:41:24.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.174+0000 7f5c8315f640 1 -- 172.21.15.17:0/1233138831 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c6c07af80 msgr2=0x7f5c6c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:24.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.174+0000 7f5c8315f640 1 --2- 172.21.15.17:0/1233138831 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c6c07af80 0x7f5c6c07d440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c06a7f0 tx=0x7f5c68005f90 comp rx=0 tx=0).stop 2024-09-20T18:41:24.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.174+0000 7f5c8315f640 1 -- 172.21.15.17:0/1233138831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c7c1007f0 msgr2=0x7f5c7c198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:24.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.174+0000 7f5c8315f640 1 --2- 172.21.15.17:0/1233138831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c7c1007f0 0x7f5c7c198810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5c70006010 tx=0x7f5c700045e0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.174+0000 7f5c8315f640 1 -- 172.21.15.17:0/1233138831 shutdown_connections 2024-09-20T18:41:24.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.174+0000 7f5c8315f640 1 --2- 172.21.15.17:0/1233138831 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c6c07af80 0x7f5c6c07d440 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.174+0000 7f5c8315f640 1 --2- 172.21.15.17:0/1233138831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c7c1067f0 0x7f5c7c198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.174+0000 7f5c8315f640 1 --2- 172.21.15.17:0/1233138831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c7c1007f0 0x7f5c7c198810 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.174+0000 7f5c8315f640 1 -- 172.21.15.17:0/1233138831 >> 172.21.15.17:0/1233138831 conn(0x7f5c7c0fc550 msgr2=0x7f5c7c0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:24.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.174+0000 7f5c8315f640 1 -- 172.21.15.17:0/1233138831 shutdown_connections 2024-09-20T18:41:24.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.174+0000 7f5c8315f640 1 -- 172.21.15.17:0/1233138831 wait complete. 2024-09-20T18:41:24.199 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:41:24.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.260+0000 7f4f56499640 1 -- 172.21.15.17:0/1748699008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f50106800 msgr2=0x7f4f50106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.260+0000 7f4f56499640 1 --2- 172.21.15.17:0/1748699008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f50106800 0x7f4f50106be0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009880 tx=0x7f4f4002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.260+0000 7f4f56499640 1 -- 172.21.15.17:0/1748699008 shutdown_connections 2024-09-20T18:41:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.260+0000 7f4f56499640 1 --2- 172.21.15.17:0/1748699008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f50100800 0x7f4f50100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.260+0000 7f4f56499640 1 --2- 172.21.15.17:0/1748699008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f50106800 0x7f4f50106be0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.260+0000 7f4f56499640 1 -- 172.21.15.17:0/1748699008 >> 172.21.15.17:0/1748699008 conn(0x7f4f500fc520 msgr2=0x7f4f500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.260+0000 7f4f56499640 1 -- 172.21.15.17:0/1748699008 shutdown_connections 2024-09-20T18:41:24.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.260+0000 7f4f56499640 1 -- 172.21.15.17:0/1748699008 wait complete. 2024-09-20T18:41:24.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.261+0000 7f4f56499640 1 Processor -- start 2024-09-20T18:41:24.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.261+0000 7f4f56499640 1 -- start start 2024-09-20T18:41:24.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.261+0000 7f4f56499640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f50100800 0x7f4f5019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:24.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.261+0000 7f4f56499640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f50106800 0x7f4f5019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:24.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.261+0000 7f4f56499640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5010dcd0 con 0x7f4f50106800 2024-09-20T18:41:24.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.261+0000 7f4f56499640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5010db50 con 0x7f4f50100800 2024-09-20T18:41:24.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.261+0000 7f4f4f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f50106800 0x7f4f5019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:24.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.261+0000 7f4f4f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f50106800 0x7f4f5019dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55756/0 (socket says 172.21.15.17:55756) 2024-09-20T18:41:24.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.261+0000 7f4f4f7fe640 1 -- 172.21.15.17:0/737363 learned_addr learned my addr 172.21.15.17:0/737363 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:41:24.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.261+0000 7f4f4ffff640 1 --2- 172.21.15.17:0/737363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f50100800 0x7f4f5019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:24.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.261+0000 7f4f4f7fe640 1 -- 172.21.15.17:0/737363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f50100800 msgr2=0x7f4f5019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:24.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.261+0000 7f4f4f7fe640 1 --2- 172.21.15.17:0/737363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f50100800 0x7f4f5019d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.262+0000 7f4f4f7fe640 1 -- 172.21.15.17:0/737363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f501977e0 con 0x7f4f50106800 2024-09-20T18:41:24.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.262+0000 7f4f4f7fe640 1 --2- 172.21.15.17:0/737363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f50106800 0x7f4f5019dba0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4f4400e970 tx=0x7f4f4400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:24.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.262+0000 7f4f4d7fa640 1 -- 172.21.15.17:0/737363 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f4400cac0 con 0x7f4f50106800 2024-09-20T18:41:24.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.262+0000 7f4f56499640 1 -- 172.21.15.17:0/737363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f50197ad0 con 0x7f4f50106800 2024-09-20T18:41:24.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.262+0000 7f4f4d7fa640 1 -- 172.21.15.17:0/737363 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f440054e0 con 0x7f4f50106800 2024-09-20T18:41:24.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.262+0000 7f4f4d7fa640 1 -- 172.21.15.17:0/737363 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f44010430 con 0x7f4f50106800 2024-09-20T18:41:24.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.262+0000 7f4f56499640 1 -- 172.21.15.17:0/737363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f50198060 con 0x7f4f50106800 2024-09-20T18:41:24.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.263+0000 7f4f56499640 1 -- 172.21.15.17:0/737363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f50101f40 con 0x7f4f50106800 2024-09-20T18:41:24.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.264+0000 7f4f4d7fa640 1 -- 172.21.15.17:0/737363 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4f44004ec0 con 0x7f4f50106800 2024-09-20T18:41:24.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.264+0000 7f4f4d7fa640 1 --2- 172.21.15.17:0/737363 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4f3807af40 0x7f4f3807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:24.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.265+0000 7f4f4ffff640 1 --2- 172.21.15.17:0/737363 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4f3807af40 0x7f4f3807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:24.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.265+0000 7f4f4d7fa640 1 -- 172.21.15.17:0/737363 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5984+0+0 (secure 0 0 0) 0x7f4f4409e610 con 0x7f4f50106800 2024-09-20T18:41:24.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.265+0000 7f4f4ffff640 1 --2- 172.21.15.17:0/737363 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4f3807af40 0x7f4f3807d400 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4f400096c0 tx=0x7f4f40031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:24.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.269+0000 7f4f4d7fa640 1 -- 172.21.15.17:0/737363 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f44069cc0 con 0x7f4f50106800 2024-09-20T18:41:24.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.482+0000 7f4f56499640 1 -- 172.21.15.17:0/737363 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4f50198370 con 0x7f4f3807af40 2024-09-20T18:41:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.483+0000 7f4f4d7fa640 1 -- 172.21.15.17:0/737363 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f4f50198370 con 0x7f4f3807af40 2024-09-20T18:41:24.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.486+0000 7f4f56499640 1 -- 172.21.15.17:0/737363 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4f3807af40 msgr2=0x7f4f3807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:24.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.486+0000 7f4f56499640 1 --2- 172.21.15.17:0/737363 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4f3807af40 0x7f4f3807d400 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4f400096c0 tx=0x7f4f40031400 comp rx=0 tx=0).stop 2024-09-20T18:41:24.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.486+0000 7f4f56499640 1 -- 172.21.15.17:0/737363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f50106800 msgr2=0x7f4f5019dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:24.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.486+0000 7f4f56499640 1 --2- 172.21.15.17:0/737363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f50106800 0x7f4f5019dba0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4f4400e970 tx=0x7f4f4400ed70 comp rx=0 tx=0).stop 2024-09-20T18:41:24.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.486+0000 7f4f56499640 1 -- 172.21.15.17:0/737363 shutdown_connections 2024-09-20T18:41:24.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.486+0000 7f4f56499640 1 --2- 172.21.15.17:0/737363 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4f3807af40 0x7f4f3807d400 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.486+0000 7f4f56499640 1 --2- 172.21.15.17:0/737363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f50106800 0x7f4f5019dba0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.486+0000 7f4f56499640 1 --2- 172.21.15.17:0/737363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f50100800 0x7f4f5019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.486+0000 7f4f56499640 1 -- 172.21.15.17:0/737363 >> 172.21.15.17:0/737363 conn(0x7f4f500fc520 msgr2=0x7f4f5006a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:24.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.486+0000 7f4f56499640 1 -- 172.21.15.17:0/737363 shutdown_connections 2024-09-20T18:41:24.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.486+0000 7f4f56499640 1 -- 172.21.15.17:0/737363 wait complete. 2024-09-20T18:41:24.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.571+0000 7f3c18f40640 1 -- 172.21.15.17:0/3926729929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c14102b30 msgr2=0x7f3c14102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.571+0000 7f3c18f40640 1 --2- 172.21.15.17:0/3926729929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c14102b30 0x7f3c14102f10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009880 tx=0x7f3c0402a530 comp rx=0 tx=0).stop 2024-09-20T18:41:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.571+0000 7f3c18f40640 1 -- 172.21.15.17:0/3926729929 shutdown_connections 2024-09-20T18:41:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.571+0000 7f3c18f40640 1 --2- 172.21.15.17:0/3926729929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c14103450 0x7f3c1410b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.571+0000 7f3c18f40640 1 --2- 172.21.15.17:0/3926729929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c14102b30 0x7f3c14102f10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.571+0000 7f3c18f40640 1 -- 172.21.15.17:0/3926729929 >> 172.21.15.17:0/3926729929 conn(0x7f3c140fc550 msgr2=0x7f3c140fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.571+0000 7f3c18f40640 1 -- 172.21.15.17:0/3926729929 shutdown_connections 2024-09-20T18:41:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.571+0000 7f3c18f40640 1 -- 172.21.15.17:0/3926729929 wait complete. 2024-09-20T18:41:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.572+0000 7f3c18f40640 1 Processor -- start 2024-09-20T18:41:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.572+0000 7f3c18f40640 1 -- start start 2024-09-20T18:41:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.572+0000 7f3c18f40640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c14102b30 0x7f3c1419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.572+0000 7f3c18f40640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c14103450 0x7f3c1419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.572+0000 7f3c18f40640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1410ede0 con 0x7f3c14103450 2024-09-20T18:41:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.572+0000 7f3c18f40640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1410ec60 con 0x7f3c14102b30 2024-09-20T18:41:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.572+0000 7f3c11d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c14103450 0x7f3c1419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.572+0000 7f3c11d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c14103450 0x7f3c1419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55778/0 (socket says 172.21.15.17:55778) 2024-09-20T18:41:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.572+0000 7f3c11d9b640 1 -- 172.21.15.17:0/3733854900 learned_addr learned my addr 172.21.15.17:0/3733854900 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:41:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.572+0000 7f3c1259c640 1 --2- 172.21.15.17:0/3733854900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c14102b30 0x7f3c1419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.572+0000 7f3c11d9b640 1 -- 172.21.15.17:0/3733854900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c14102b30 msgr2=0x7f3c1419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.572+0000 7f3c11d9b640 1 --2- 172.21.15.17:0/3733854900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c14102b30 0x7f3c1419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.572+0000 7f3c11d9b640 1 -- 172.21.15.17:0/3733854900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c141977d0 con 0x7f3c14103450 2024-09-20T18:41:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.573+0000 7f3c11d9b640 1 --2- 172.21.15.17:0/3733854900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c14103450 0x7f3c1419db90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800e970 tx=0x7f3c0800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.573+0000 7f3c037fe640 1 -- 172.21.15.17:0/3733854900 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c0800cac0 con 0x7f3c14103450 2024-09-20T18:41:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.573+0000 7f3c18f40640 1 -- 172.21.15.17:0/3733854900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c14197ac0 con 0x7f3c14103450 2024-09-20T18:41:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.573+0000 7f3c037fe640 1 -- 172.21.15.17:0/3733854900 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c080054e0 con 0x7f3c14103450 2024-09-20T18:41:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.573+0000 7f3c037fe640 1 -- 172.21.15.17:0/3733854900 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c08010430 con 0x7f3c14103450 2024-09-20T18:41:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.573+0000 7f3c18f40640 1 -- 172.21.15.17:0/3733854900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c14198050 con 0x7f3c14103450 2024-09-20T18:41:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.574+0000 7f3c18f40640 1 -- 172.21.15.17:0/3733854900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c1406a500 con 0x7f3c14103450 2024-09-20T18:41:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.574+0000 7f3c037fe640 1 -- 172.21.15.17:0/3733854900 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3c08004f00 con 0x7f3c14103450 2024-09-20T18:41:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.575+0000 7f3c037fe640 1 --2- 172.21.15.17:0/3733854900 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3bfc07af30 0x7f3bfc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.575+0000 7f3c037fe640 1 -- 172.21.15.17:0/3733854900 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5984+0+0 (secure 0 0 0) 0x7f3c0809e610 con 0x7f3c14103450 2024-09-20T18:41:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.575+0000 7f3c1259c640 1 --2- 172.21.15.17:0/3733854900 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3bfc07af30 0x7f3bfc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.576+0000 7f3c1259c640 1 --2- 172.21.15.17:0/3733854900 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3bfc07af30 0x7f3bfc07d3f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3c040096c0 tx=0x7f3c04004f30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:24.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.580+0000 7f3c037fe640 1 -- 172.21.15.17:0/3733854900 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c08069cc0 con 0x7f3c14103450 2024-09-20T18:41:24.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.777+0000 7f3c18f40640 1 -- 172.21.15.17:0/3733854900 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3c14198360 con 0x7f3bfc07af30 2024-09-20T18:41:24.794 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:24 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:24.794 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:24 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:24.794 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:24 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:41:24.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.787+0000 7f3c037fe640 1 -- 172.21.15.17:0/3733854900 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f3c14198360 con 0x7f3bfc07af30 2024-09-20T18:41:24.804 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:41:24.804 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (2m) 34s ago 13m 20.5M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:41:24.804 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (5m) 34s ago 13m 8946k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:41:24.804 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (5m) 58s ago 13m 8644k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:41:24.804 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (66s) 34s ago 13m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:41:24.804 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (61s) 58s ago 13m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:41:24.804 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (2m) 34s ago 13m 76.6M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:41:24.804 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (8m) 34s ago 8m 150M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:41:24.804 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (8m) 34s ago 8m 95.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:41:24.804 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (8m) 58s ago 8m 26.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:41:24.804 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (8m) 58s ago 8m 26.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:41:24.804 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (4m) 34s ago 15m 524M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:41:24.804 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (3m) 58s ago 12m 457M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:41:24.804 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (93s) 34s ago 15m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:41:24.805 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (77s) 58s ago 12m 27.1M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:41:24.805 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (3m) 34s ago 13m 11.6M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:41:24.805 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (3m) 58s ago 13m 11.3M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:41:24.805 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (39s) 34s ago 11m 11.2M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:41:24.805 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 starting - - - 1217M 2024-09-20T18:41:24.805 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (10m) 34s ago 10m 206M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 6f0b9405dc18 2024-09-20T18:41:24.805 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (10m) 58s ago 10m 262M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:41:24.805 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (9m) 58s ago 9m 208M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:41:24.805 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (9m) 58s ago 9m 190M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:41:24.805 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (3m) 34s ago 13m 49.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:41:24.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.789+0000 7f3c18f40640 1 -- 172.21.15.17:0/3733854900 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3bfc07af30 msgr2=0x7f3bfc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:24.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.789+0000 7f3c18f40640 1 --2- 172.21.15.17:0/3733854900 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3bfc07af30 0x7f3bfc07d3f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3c040096c0 tx=0x7f3c04004f30 comp rx=0 tx=0).stop 2024-09-20T18:41:24.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.789+0000 7f3c18f40640 1 -- 172.21.15.17:0/3733854900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c14103450 msgr2=0x7f3c1419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:24.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.789+0000 7f3c18f40640 1 --2- 172.21.15.17:0/3733854900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c14103450 0x7f3c1419db90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800e970 tx=0x7f3c0800ed70 comp rx=0 tx=0).stop 2024-09-20T18:41:24.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.789+0000 7f3c18f40640 1 -- 172.21.15.17:0/3733854900 shutdown_connections 2024-09-20T18:41:24.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.789+0000 7f3c18f40640 1 --2- 172.21.15.17:0/3733854900 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3bfc07af30 0x7f3bfc07d3f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.789+0000 7f3c18f40640 1 --2- 172.21.15.17:0/3733854900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c14103450 0x7f3c1419db90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.789+0000 7f3c18f40640 1 --2- 172.21.15.17:0/3733854900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c14102b30 0x7f3c1419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.789+0000 7f3c18f40640 1 -- 172.21.15.17:0/3733854900 >> 172.21.15.17:0/3733854900 conn(0x7f3c140fc550 msgr2=0x7f3c14108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:24.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.790+0000 7f3c18f40640 1 -- 172.21.15.17:0/3733854900 shutdown_connections 2024-09-20T18:41:24.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.790+0000 7f3c18f40640 1 -- 172.21.15.17:0/3733854900 wait complete. 2024-09-20T18:41:24.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.882+0000 7f03a68c2640 1 -- 172.21.15.17:0/3421757855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03a010c560 msgr2=0x7f03a010c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:24.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.882+0000 7f03a68c2640 1 --2- 172.21.15.17:0/3421757855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03a010c560 0x7f03a010c940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0390009880 tx=0x7f039002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.882+0000 7f03a68c2640 1 -- 172.21.15.17:0/3421757855 shutdown_connections 2024-09-20T18:41:24.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.882+0000 7f03a68c2640 1 --2- 172.21.15.17:0/3421757855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03a010cf10 0x7f03a0110f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.882+0000 7f03a68c2640 1 --2- 172.21.15.17:0/3421757855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03a010c560 0x7f03a010c940 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.882+0000 7f03a68c2640 1 -- 172.21.15.17:0/3421757855 >> 172.21.15.17:0/3421757855 conn(0x7f03a006c5b0 msgr2=0x7f03a006c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:24.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.882+0000 7f03a68c2640 1 -- 172.21.15.17:0/3421757855 shutdown_connections 2024-09-20T18:41:24.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.882+0000 7f03a68c2640 1 -- 172.21.15.17:0/3421757855 wait complete. 2024-09-20T18:41:24.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.883+0000 7f03a68c2640 1 Processor -- start 2024-09-20T18:41:24.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.883+0000 7f03a68c2640 1 -- start start 2024-09-20T18:41:24.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.883+0000 7f03a68c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03a010c560 0x7f03a01a23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:24.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.883+0000 7f03a68c2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03a010cf10 0x7f03a01a28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:24.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.884+0000 7f03a68c2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f03a01197c0 con 0x7f03a010c560 2024-09-20T18:41:24.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.884+0000 7f03a68c2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f03a0119640 con 0x7f03a010cf10 2024-09-20T18:41:24.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.884+0000 7f039ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03a010c560 0x7f03a01a23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:24.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.884+0000 7f039ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03a010c560 0x7f03a01a23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55808/0 (socket says 172.21.15.17:55808) 2024-09-20T18:41:24.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.884+0000 7f039ffff640 1 -- 172.21.15.17:0/2601512238 learned_addr learned my addr 172.21.15.17:0/2601512238 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:41:24.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.884+0000 7f039f7fe640 1 --2- 172.21.15.17:0/2601512238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03a010cf10 0x7f03a01a28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:24.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.884+0000 7f039ffff640 1 -- 172.21.15.17:0/2601512238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03a010cf10 msgr2=0x7f03a01a28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:24.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.884+0000 7f039ffff640 1 --2- 172.21.15.17:0/2601512238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03a010cf10 0x7f03a01a28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:24.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.884+0000 7f039ffff640 1 -- 172.21.15.17:0/2601512238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a01a6c70 con 0x7f03a010c560 2024-09-20T18:41:24.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.884+0000 7f039ffff640 1 --2- 172.21.15.17:0/2601512238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03a010c560 0x7f03a01a23a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0390031460 tx=0x7f03900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:24.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.885+0000 7f039d7fa640 1 -- 172.21.15.17:0/2601512238 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f039003f070 con 0x7f03a010c560 2024-09-20T18:41:24.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.885+0000 7f039d7fa640 1 -- 172.21.15.17:0/2601512238 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03900044d0 con 0x7f03a010c560 2024-09-20T18:41:24.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.885+0000 7f03a68c2640 1 -- 172.21.15.17:0/2601512238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a01a6f00 con 0x7f03a010c560 2024-09-20T18:41:24.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.885+0000 7f039d7fa640 1 -- 172.21.15.17:0/2601512238 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0390035030 con 0x7f03a010c560 2024-09-20T18:41:24.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.885+0000 7f03a68c2640 1 -- 172.21.15.17:0/2601512238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a01a7430 con 0x7f03a010c560 2024-09-20T18:41:24.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.886+0000 7f0386ffd640 1 -- 172.21.15.17:0/2601512238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0380005290 con 0x7f03a010c560 2024-09-20T18:41:24.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.886+0000 7f039d7fa640 1 -- 172.21.15.17:0/2601512238 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0390042070 con 0x7f03a010c560 2024-09-20T18:41:24.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.887+0000 7f039d7fa640 1 --2- 172.21.15.17:0/2601512238 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f038807af40 0x7f038807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:24.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.887+0000 7f039d7fa640 1 -- 172.21.15.17:0/2601512238 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5984+0+0 (secure 0 0 0) 0x7f03900be9f0 con 0x7f03a010c560 2024-09-20T18:41:24.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.887+0000 7f039f7fe640 1 --2- 172.21.15.17:0/2601512238 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f038807af40 0x7f038807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:24.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.888+0000 7f039f7fe640 1 --2- 172.21.15.17:0/2601512238 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f038807af40 0x7f038807d400 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f03a010bdf0 tx=0x7f039400a2d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:24.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:24.893+0000 7f039d7fa640 1 -- 172.21.15.17:0/2601512238 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0390004cf0 con 0x7f03a010c560 2024-09-20T18:41:24.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:24 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:24.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:24 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:24.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:24 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:41:25.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.171+0000 7f0386ffd640 1 -- 172.21.15.17:0/2601512238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0380005d90 con 0x7f03a010c560 2024-09-20T18:41:25.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.172+0000 7f039d7fa640 1 -- 172.21.15.17:0/2601512238 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f039008c5c0 con 0x7f03a010c560 2024-09-20T18:41:25.189 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:41:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:41:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:41:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:41:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:41:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:41:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:41:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:41:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4, 2024-09-20T18:41:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 1 2024-09-20T18:41:25.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:41:25.190 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:41:25.190 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:41:25.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:41:25.190 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:41:25.190 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 8, 2024-09-20T18:41:25.190 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 5 2024-09-20T18:41:25.190 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:41:25.190 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:41:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.174+0000 7f0386ffd640 1 -- 172.21.15.17:0/2601512238 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f038807af40 msgr2=0x7f038807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.174+0000 7f0386ffd640 1 --2- 172.21.15.17:0/2601512238 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f038807af40 0x7f038807d400 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f03a010bdf0 tx=0x7f039400a2d0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.174+0000 7f0386ffd640 1 -- 172.21.15.17:0/2601512238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03a010c560 msgr2=0x7f03a01a23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.174+0000 7f0386ffd640 1 --2- 172.21.15.17:0/2601512238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03a010c560 0x7f03a01a23a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0390031460 tx=0x7f03900048f0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.174+0000 7f0386ffd640 1 -- 172.21.15.17:0/2601512238 shutdown_connections 2024-09-20T18:41:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.174+0000 7f0386ffd640 1 --2- 172.21.15.17:0/2601512238 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f038807af40 0x7f038807d400 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.174+0000 7f0386ffd640 1 --2- 172.21.15.17:0/2601512238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03a010cf10 0x7f03a01a28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.174+0000 7f0386ffd640 1 --2- 172.21.15.17:0/2601512238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03a010c560 0x7f03a01a23a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.174+0000 7f0386ffd640 1 -- 172.21.15.17:0/2601512238 >> 172.21.15.17:0/2601512238 conn(0x7f03a006c5b0 msgr2=0x7f03a010a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:25.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.175+0000 7f0386ffd640 1 -- 172.21.15.17:0/2601512238 shutdown_connections 2024-09-20T18:41:25.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.175+0000 7f0386ffd640 1 -- 172.21.15.17:0/2601512238 wait complete. 2024-09-20T18:41:25.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.264+0000 7f358e517640 1 -- 172.21.15.17:0/2291970138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35881067f0 msgr2=0x7f3588106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:25.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.264+0000 7f358e517640 1 --2- 172.21.15.17:0/2291970138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35881067f0 0x7f3588106bd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3578009880 tx=0x7f357802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.264+0000 7f358e517640 1 -- 172.21.15.17:0/2291970138 shutdown_connections 2024-09-20T18:41:25.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.264+0000 7f358e517640 1 --2- 172.21.15.17:0/2291970138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35881007f0 0x7f3588100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.264+0000 7f358e517640 1 --2- 172.21.15.17:0/2291970138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35881067f0 0x7f3588106bd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.264+0000 7f358e517640 1 -- 172.21.15.17:0/2291970138 >> 172.21.15.17:0/2291970138 conn(0x7f35880fc550 msgr2=0x7f35880fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:25.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.264+0000 7f358e517640 1 -- 172.21.15.17:0/2291970138 shutdown_connections 2024-09-20T18:41:25.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.264+0000 7f358e517640 1 -- 172.21.15.17:0/2291970138 wait complete. 2024-09-20T18:41:25.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.265+0000 7f358e517640 1 Processor -- start 2024-09-20T18:41:25.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.265+0000 7f358e517640 1 -- start start 2024-09-20T18:41:25.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.265+0000 7f358e517640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35881007f0 0x7f358819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:25.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.265+0000 7f358e517640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35881067f0 0x7f358819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:25.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.265+0000 7f358e517640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f358810dca0 con 0x7f35881007f0 2024-09-20T18:41:25.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.265+0000 7f358e517640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f358810db20 con 0x7f35881067f0 2024-09-20T18:41:25.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.265+0000 7f3587fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35881007f0 0x7f358819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:25.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.265+0000 7f3587fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35881007f0 0x7f358819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55826/0 (socket says 172.21.15.17:55826) 2024-09-20T18:41:25.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.265+0000 7f3587fff640 1 -- 172.21.15.17:0/110064636 learned_addr learned my addr 172.21.15.17:0/110064636 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:41:25.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.265+0000 7f357ffff640 1 --2- 172.21.15.17:0/110064636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35881067f0 0x7f358819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:25.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.265+0000 7f3587fff640 1 -- 172.21.15.17:0/110064636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35881067f0 msgr2=0x7f358819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:25.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.265+0000 7f3587fff640 1 --2- 172.21.15.17:0/110064636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35881067f0 0x7f358819dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.265+0000 7f3587fff640 1 -- 172.21.15.17:0/110064636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3588197750 con 0x7f35881007f0 2024-09-20T18:41:25.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.266+0000 7f3587fff640 1 --2- 172.21.15.17:0/110064636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35881007f0 0x7f358819d680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3578031460 tx=0x7f35780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:25.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.266+0000 7f3585ffb640 1 -- 172.21.15.17:0/110064636 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f357803f070 con 0x7f35881007f0 2024-09-20T18:41:25.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.266+0000 7f3585ffb640 1 -- 172.21.15.17:0/110064636 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3578004cf0 con 0x7f35881007f0 2024-09-20T18:41:25.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.266+0000 7f358e517640 1 -- 172.21.15.17:0/110064636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35881979e0 con 0x7f35881007f0 2024-09-20T18:41:25.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.267+0000 7f3585ffb640 1 -- 172.21.15.17:0/110064636 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3578035030 con 0x7f35881007f0 2024-09-20T18:41:25.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.267+0000 7f358e517640 1 -- 172.21.15.17:0/110064636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3588197ee0 con 0x7f35881007f0 2024-09-20T18:41:25.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.268+0000 7f358e517640 1 -- 172.21.15.17:0/110064636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3588101f30 con 0x7f35881007f0 2024-09-20T18:41:25.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.268+0000 7f3585ffb640 1 -- 172.21.15.17:0/110064636 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3578042070 con 0x7f35881007f0 2024-09-20T18:41:25.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.268+0000 7f3585ffb640 1 --2- 172.21.15.17:0/110064636 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f357407af80 0x7f357407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:25.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.268+0000 7f3585ffb640 1 -- 172.21.15.17:0/110064636 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5984+0+0 (secure 0 0 0) 0x7f35780be930 con 0x7f35881007f0 2024-09-20T18:41:25.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.268+0000 7f357ffff640 1 --2- 172.21.15.17:0/110064636 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f357407af80 0x7f357407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:25.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.269+0000 7f357ffff640 1 --2- 172.21.15.17:0/110064636 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f357407af80 0x7f357407d440 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3588198fa0 tx=0x7f357000a4c0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:25.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.273+0000 7f3585ffb640 1 -- 172.21.15.17:0/110064636 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f357808a060 con 0x7f35881007f0 2024-09-20T18:41:25.393 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:25 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1[122436]: 2024-09-20T18:41:25.156+0000 7ff0eb79c640 -1 Falling back to public interface 2024-09-20T18:41:25.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.506+0000 7f358e517640 1 -- 172.21.15.17:0/110064636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3588198190 con 0x7f35881007f0 2024-09-20T18:41:25.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.507+0000 7f3585ffb640 1 -- 172.21.15.17:0/110064636 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2043 (secure 0 0 0) 0x7f357808ef10 con 0x7f35881007f0 2024-09-20T18:41:25.523 INFO:teuthology.orchestra.run.smithi017.stdout:e15 2024-09-20T18:41:25.524 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:33:05:524203+0000 2024-09-20T18:41:25.524 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:41:25.524 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:41:25.524 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:41:25.524 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:41:25.524 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:41:25.524 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:41:25.524 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 15 2024-09-20T18:41:25.524 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T18:41:25.524 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:41:25.524 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:33:05.065474+0000 2024-09-20T18:41:25.524 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:41:25.524 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:41:25.524 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:41:25.525 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:41:25.525 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:41:25.525 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:41:25.525 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:41:25.525 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:41:25.525 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2024-09-20T18:41:25.525 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:41:25.525 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:41:25.525 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:41:25.525 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14552,1=24325} 2024-09-20T18:41:25.525 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-09-20T18:41:25.525 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:41:25.525 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:41:25.526 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:41:25.526 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:41:25.526 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:41:25.526 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:41:25.526 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:41:25.526 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:41:25.526 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 14552 members: 24325,14552 2024-09-20T18:41:25.526 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{0:14552} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.17:6826/3360305779,v1:172.21.15.17:6827/3360305779] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:41:25.526 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{0:14568} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.17:6828/53113052,v1:172.21.15.17:6829/53113052] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:41:25.526 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{1:24325} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.172:6824/1043027893,v1:172.21.15.172:6825/1043027893] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:41:25.526 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{1:24339} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/2975309540,v1:172.21.15.172:6827/2975309540] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:41:25.526 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:41:25.526 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:41:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 15 2024-09-20T18:41:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.509+0000 7f358e517640 1 -- 172.21.15.17:0/110064636 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f357407af80 msgr2=0x7f357407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.509+0000 7f358e517640 1 --2- 172.21.15.17:0/110064636 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f357407af80 0x7f357407d440 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3588198fa0 tx=0x7f357000a4c0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.509+0000 7f358e517640 1 -- 172.21.15.17:0/110064636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35881007f0 msgr2=0x7f358819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.509+0000 7f358e517640 1 --2- 172.21.15.17:0/110064636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35881007f0 0x7f358819d680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3578031460 tx=0x7f35780048f0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.509+0000 7f358e517640 1 -- 172.21.15.17:0/110064636 shutdown_connections 2024-09-20T18:41:25.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.509+0000 7f358e517640 1 --2- 172.21.15.17:0/110064636 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f357407af80 0x7f357407d440 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.509+0000 7f358e517640 1 --2- 172.21.15.17:0/110064636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35881067f0 0x7f358819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.509+0000 7f358e517640 1 --2- 172.21.15.17:0/110064636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35881007f0 0x7f358819d680 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.509+0000 7f358e517640 1 -- 172.21.15.17:0/110064636 >> 172.21.15.17:0/110064636 conn(0x7f35880fc550 msgr2=0x7f3588069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:25.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.509+0000 7f358e517640 1 -- 172.21.15.17:0/110064636 shutdown_connections 2024-09-20T18:41:25.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.509+0000 7f358e517640 1 -- 172.21.15.17:0/110064636 wait complete. 2024-09-20T18:41:25.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.596+0000 7f1362751640 1 -- 172.21.15.17:0/135027011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c1007f0 msgr2=0x7f135c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:25.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.596+0000 7f1362751640 1 --2- 172.21.15.17:0/135027011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c1007f0 0x7f135c100c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1350009880 tx=0x7f135002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.596+0000 7f1362751640 1 -- 172.21.15.17:0/135027011 shutdown_connections 2024-09-20T18:41:25.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.596+0000 7f1362751640 1 --2- 172.21.15.17:0/135027011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c1007f0 0x7f135c100c50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.596+0000 7f1362751640 1 --2- 172.21.15.17:0/135027011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f135c1067f0 0x7f135c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.596+0000 7f1362751640 1 -- 172.21.15.17:0/135027011 >> 172.21.15.17:0/135027011 conn(0x7f135c0fc550 msgr2=0x7f135c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:25.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.596+0000 7f1362751640 1 -- 172.21.15.17:0/135027011 shutdown_connections 2024-09-20T18:41:25.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.596+0000 7f1362751640 1 -- 172.21.15.17:0/135027011 wait complete. 2024-09-20T18:41:25.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.597+0000 7f1362751640 1 Processor -- start 2024-09-20T18:41:25.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.597+0000 7f1362751640 1 -- start start 2024-09-20T18:41:25.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.598+0000 7f1362751640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f135c1007f0 0x7f135c19f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:25.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.598+0000 7f1362751640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c1067f0 0x7f135c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:25.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.598+0000 7f1362751640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f135c10dca0 con 0x7f135c1067f0 2024-09-20T18:41:25.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.598+0000 7f1362751640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f135c10db20 con 0x7f135c1007f0 2024-09-20T18:41:25.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.598+0000 7f135b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c1067f0 0x7f135c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:25.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.598+0000 7f135b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c1067f0 0x7f135c19fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55832/0 (socket says 172.21.15.17:55832) 2024-09-20T18:41:25.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.598+0000 7f135b7fe640 1 -- 172.21.15.17:0/1327263795 learned_addr learned my addr 172.21.15.17:0/1327263795 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:41:25.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.598+0000 7f135bfff640 1 --2- 172.21.15.17:0/1327263795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f135c1007f0 0x7f135c19f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:25.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.598+0000 7f135b7fe640 1 -- 172.21.15.17:0/1327263795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f135c1007f0 msgr2=0x7f135c19f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:25.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.598+0000 7f135b7fe640 1 --2- 172.21.15.17:0/1327263795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f135c1007f0 0x7f135c19f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.598+0000 7f135b7fe640 1 -- 172.21.15.17:0/1327263795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135c199930 con 0x7f135c1067f0 2024-09-20T18:41:25.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.598+0000 7f135bfff640 1 --2- 172.21.15.17:0/1327263795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f135c1007f0 0x7f135c19f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T18:41:25.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.598+0000 7f135b7fe640 1 --2- 172.21.15.17:0/1327263795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c1067f0 0x7f135c19fcb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1350031460 tx=0x7f1350004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:25.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.599+0000 7f13597fa640 1 -- 172.21.15.17:0/1327263795 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f135003f070 con 0x7f135c1067f0 2024-09-20T18:41:25.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.599+0000 7f13597fa640 1 -- 172.21.15.17:0/1327263795 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f13500035f0 con 0x7f135c1067f0 2024-09-20T18:41:25.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.599+0000 7f1362751640 1 -- 172.21.15.17:0/1327263795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f135c199bc0 con 0x7f135c1067f0 2024-09-20T18:41:25.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.599+0000 7f13597fa640 1 -- 172.21.15.17:0/1327263795 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1350035030 con 0x7f135c1067f0 2024-09-20T18:41:25.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.599+0000 7f1362751640 1 -- 172.21.15.17:0/1327263795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f135c19a0f0 con 0x7f135c1067f0 2024-09-20T18:41:25.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.600+0000 7f1362751640 1 -- 172.21.15.17:0/1327263795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f135c101f30 con 0x7f135c1067f0 2024-09-20T18:41:25.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.601+0000 7f13597fa640 1 -- 172.21.15.17:0/1327263795 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1350042070 con 0x7f135c1067f0 2024-09-20T18:41:25.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.601+0000 7f13597fa640 1 --2- 172.21.15.17:0/1327263795 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f134407af30 0x7f134407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:25.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.602+0000 7f13597fa640 1 -- 172.21.15.17:0/1327263795 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5984+0+0 (secure 0 0 0) 0x7f13500be8d0 con 0x7f135c1067f0 2024-09-20T18:41:25.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.602+0000 7f135bfff640 1 --2- 172.21.15.17:0/1327263795 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f134407af30 0x7f134407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:25.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.602+0000 7f135bfff640 1 --2- 172.21.15.17:0/1327263795 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f134407af30 0x7f134407d3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f135c19aa70 tx=0x7f134c005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:25.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.608+0000 7f13597fa640 1 -- 172.21.15.17:0/1327263795 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1350089f00 con 0x7f135c1067f0 2024-09-20T18:41:25.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.857+0000 7f1362751640 1 -- 172.21.15.17:0/1327263795 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f135c19af30 con 0x7f134407af30 2024-09-20T18:41:25.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.859+0000 7f13597fa640 1 -- 172.21.15.17:0/1327263795 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f135c19af30 con 0x7f134407af30 2024-09-20T18:41:25.875 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:41:25.875 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:41:25.875 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:41:25.875 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:41:25.875 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:41:25.875 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:41:25.875 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:41:25.876 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:41:25.876 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:41:25.876 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "7/23 daemons upgraded", 2024-09-20T18:41:25.876 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T18:41:25.876 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:41:25.876 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:41:25.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.861+0000 7f1362751640 1 -- 172.21.15.17:0/1327263795 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f134407af30 msgr2=0x7f134407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:25.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.861+0000 7f1362751640 1 --2- 172.21.15.17:0/1327263795 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f134407af30 0x7f134407d3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f135c19aa70 tx=0x7f134c005f90 comp rx=0 tx=0).stop 2024-09-20T18:41:25.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.861+0000 7f1362751640 1 -- 172.21.15.17:0/1327263795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c1067f0 msgr2=0x7f135c19fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:25.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.861+0000 7f1362751640 1 --2- 172.21.15.17:0/1327263795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c1067f0 0x7f135c19fcb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1350031460 tx=0x7f1350004530 comp rx=0 tx=0).stop 2024-09-20T18:41:25.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.861+0000 7f1362751640 1 -- 172.21.15.17:0/1327263795 shutdown_connections 2024-09-20T18:41:25.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.861+0000 7f1362751640 1 --2- 172.21.15.17:0/1327263795 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f134407af30 0x7f134407d3f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.861+0000 7f1362751640 1 --2- 172.21.15.17:0/1327263795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c1067f0 0x7f135c19fcb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.861+0000 7f1362751640 1 --2- 172.21.15.17:0/1327263795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f135c1007f0 0x7f135c19f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.861+0000 7f1362751640 1 -- 172.21.15.17:0/1327263795 >> 172.21.15.17:0/1327263795 conn(0x7f135c0fc550 msgr2=0x7f135c069c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:25.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.861+0000 7f1362751640 1 -- 172.21.15.17:0/1327263795 shutdown_connections 2024-09-20T18:41:25.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.861+0000 7f1362751640 1 -- 172.21.15.17:0/1327263795 wait complete. 2024-09-20T18:41:25.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:25 smithi172 ceph-mon[80431]: from='client.44153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:41:25.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:25 smithi172 ceph-mon[80431]: pgmap v154: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/318 objects degraded (14.780%) 2024-09-20T18:41:25.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:25 smithi172 ceph-mon[80431]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:41:25.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:25 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2601512238' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:41:25.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:25 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/110064636' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:41:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.946+0000 7fd35a76c640 1 -- 172.21.15.17:0/3887851816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd354102b30 msgr2=0x7fd354102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:25.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.946+0000 7fd35a76c640 1 --2- 172.21.15.17:0/3887851816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd354102b30 0x7fd354102f10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd344009880 tx=0x7fd34402a530 comp rx=0 tx=0).stop 2024-09-20T18:41:25.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.946+0000 7fd35a76c640 1 -- 172.21.15.17:0/3887851816 shutdown_connections 2024-09-20T18:41:25.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.946+0000 7fd35a76c640 1 --2- 172.21.15.17:0/3887851816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd354103450 0x7fd35410b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.946+0000 7fd35a76c640 1 --2- 172.21.15.17:0/3887851816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd354102b30 0x7fd354102f10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.946+0000 7fd35a76c640 1 -- 172.21.15.17:0/3887851816 >> 172.21.15.17:0/3887851816 conn(0x7fd3540fc550 msgr2=0x7fd3540fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:25.963 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:25 smithi017 ceph-mon[108970]: from='client.44153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:41:25.963 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:25 smithi017 ceph-mon[108970]: pgmap v154: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/318 objects degraded (14.780%) 2024-09-20T18:41:25.963 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:25 smithi017 ceph-mon[108970]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:41:25.963 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:25 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2601512238' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:41:25.963 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:25 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/110064636' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:41:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.946+0000 7fd35a76c640 1 -- 172.21.15.17:0/3887851816 shutdown_connections 2024-09-20T18:41:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.946+0000 7fd35a76c640 1 -- 172.21.15.17:0/3887851816 wait complete. 2024-09-20T18:41:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.947+0000 7fd35a76c640 1 Processor -- start 2024-09-20T18:41:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.947+0000 7fd35a76c640 1 -- start start 2024-09-20T18:41:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.948+0000 7fd35a76c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd354102b30 0x7fd35419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.948+0000 7fd35a76c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd354103450 0x7fd35419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.948+0000 7fd35a76c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd35410edc0 con 0x7fd354103450 2024-09-20T18:41:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.948+0000 7fd35a76c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd35410ec40 con 0x7fd354102b30 2024-09-20T18:41:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.948+0000 7fd3537fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd354103450 0x7fd35419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.948+0000 7fd3537fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd354103450 0x7fd35419db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55840/0 (socket says 172.21.15.17:55840) 2024-09-20T18:41:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.948+0000 7fd3537fe640 1 -- 172.21.15.17:0/3787230222 learned_addr learned my addr 172.21.15.17:0/3787230222 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:41:25.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.948+0000 7fd353fff640 1 --2- 172.21.15.17:0/3787230222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd354102b30 0x7fd35419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:25.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.948+0000 7fd3537fe640 1 -- 172.21.15.17:0/3787230222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd354102b30 msgr2=0x7fd35419d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:25.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.949+0000 7fd3537fe640 1 --2- 172.21.15.17:0/3787230222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd354102b30 0x7fd35419d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:25.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.949+0000 7fd3537fe640 1 -- 172.21.15.17:0/3787230222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3541977b0 con 0x7fd354103450 2024-09-20T18:41:25.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.949+0000 7fd353fff640 1 --2- 172.21.15.17:0/3787230222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd354102b30 0x7fd35419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T18:41:25.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.949+0000 7fd3537fe640 1 --2- 172.21.15.17:0/3787230222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd354103450 0x7fd35419db70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd34800d8d0 tx=0x7fd34800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:25.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.949+0000 7fd3517fa640 1 -- 172.21.15.17:0/3787230222 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd348017070 con 0x7fd354103450 2024-09-20T18:41:25.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.949+0000 7fd3517fa640 1 -- 172.21.15.17:0/3787230222 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd348010460 con 0x7fd354103450 2024-09-20T18:41:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.949+0000 7fd35a76c640 1 -- 172.21.15.17:0/3787230222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd354197aa0 con 0x7fd354103450 2024-09-20T18:41:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.949+0000 7fd35a76c640 1 -- 172.21.15.17:0/3787230222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd354197f70 con 0x7fd354103450 2024-09-20T18:41:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.949+0000 7fd3517fa640 1 -- 172.21.15.17:0/3787230222 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd34800f5f0 con 0x7fd354103450 2024-09-20T18:41:25.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.950+0000 7fd35a76c640 1 -- 172.21.15.17:0/3787230222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd340005290 con 0x7fd354103450 2024-09-20T18:41:25.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.952+0000 7fd3517fa640 1 -- 172.21.15.17:0/3787230222 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd348009a30 con 0x7fd354103450 2024-09-20T18:41:25.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.952+0000 7fd3517fa640 1 --2- 172.21.15.17:0/3787230222 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd33c07af90 0x7fd33c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:25.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.953+0000 7fd3517fa640 1 -- 172.21.15.17:0/3787230222 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5984+0+0 (secure 0 0 0) 0x7fd34809dc00 con 0x7fd354103450 2024-09-20T18:41:25.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.953+0000 7fd353fff640 1 --2- 172.21.15.17:0/3787230222 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd33c07af90 0x7fd33c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:25.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.953+0000 7fd353fff640 1 --2- 172.21.15.17:0/3787230222 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd33c07af90 0x7fd33c07d450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd3440096c0 tx=0x7fd344004f30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:25.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:25.957+0000 7fd3517fa640 1 -- 172.21.15.17:0/3787230222 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd348069330 con 0x7fd354103450 2024-09-20T18:41:26.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:26.225+0000 7fd35a76c640 1 -- 172.21.15.17:0/3787230222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fd340005580 con 0x7fd354103450 2024-09-20T18:41:26.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:26.226+0000 7fd3517fa640 1 -- 172.21.15.17:0/3787230222 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1294 (secure 0 0 0) 0x7fd34806e1e0 con 0x7fd354103450 2024-09-20T18:41:26.243 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 47/318 objects degraded (14.780%), 15 pgs degraded 2024-09-20T18:41:26.243 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:41:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:41:26.243 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-20T18:41:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: osd.1 (root=default,host=smithi017) is down 2024-09-20T18:41:26.243 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 47/318 objects degraded (14.780%), 15 pgs degraded 2024-09-20T18:41:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-20T18:41:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-20T18:41:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-20T18:41:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-20T18:41:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-20T18:41:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-20T18:41:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-20T18:41:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-20T18:41:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-20T18:41:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-20T18:41:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-20T18:41:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-09-20T18:41:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-20T18:41:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-09-20T18:41:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-20T18:41:26.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:26.228+0000 7fd35a76c640 1 -- 172.21.15.17:0/3787230222 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd33c07af90 msgr2=0x7fd33c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:26.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:26.228+0000 7fd35a76c640 1 --2- 172.21.15.17:0/3787230222 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd33c07af90 0x7fd33c07d450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd3440096c0 tx=0x7fd344004f30 comp rx=0 tx=0).stop 2024-09-20T18:41:26.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:26.228+0000 7fd35a76c640 1 -- 172.21.15.17:0/3787230222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd354103450 msgr2=0x7fd35419db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:26.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:26.228+0000 7fd35a76c640 1 --2- 172.21.15.17:0/3787230222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd354103450 0x7fd35419db70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd34800d8d0 tx=0x7fd34800dd90 comp rx=0 tx=0).stop 2024-09-20T18:41:26.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:26.228+0000 7fd35a76c640 1 -- 172.21.15.17:0/3787230222 shutdown_connections 2024-09-20T18:41:26.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:26.228+0000 7fd35a76c640 1 --2- 172.21.15.17:0/3787230222 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd33c07af90 0x7fd33c07d450 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:26.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:26.228+0000 7fd35a76c640 1 --2- 172.21.15.17:0/3787230222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd354103450 0x7fd35419db70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:26.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:26.228+0000 7fd35a76c640 1 --2- 172.21.15.17:0/3787230222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd354102b30 0x7fd35419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:26.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:26.228+0000 7fd35a76c640 1 -- 172.21.15.17:0/3787230222 >> 172.21.15.17:0/3787230222 conn(0x7fd3540fc550 msgr2=0x7fd354108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:26.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:26.229+0000 7fd35a76c640 1 -- 172.21.15.17:0/3787230222 shutdown_connections 2024-09-20T18:41:26.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:26.229+0000 7fd35a76c640 1 -- 172.21.15.17:0/3787230222 wait complete. 2024-09-20T18:41:26.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:26 smithi172 ceph-mon[80431]: from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:41:26.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:26 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3787230222' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:41:27.018 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:26 smithi017 ceph-mon[108970]: from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:41:27.019 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:26 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3787230222' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:41:27.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:27 smithi017 ceph-mon[108970]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:41:27.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:27 smithi017 ceph-mon[108970]: pgmap v155: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/318 objects degraded (14.780%) 2024-09-20T18:41:27.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:27 smithi172 ceph-mon[80431]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:41:27.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:27 smithi172 ceph-mon[80431]: pgmap v155: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/318 objects degraded (14.780%) 2024-09-20T18:41:29.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:29 smithi172 ceph-mon[80431]: pgmap v156: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/318 objects degraded (14.780%) 2024-09-20T18:41:29.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:29.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:29.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:29.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:30.020 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:29 smithi017 ceph-mon[108970]: pgmap v156: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/318 objects degraded (14.780%) 2024-09-20T18:41:30.020 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:30.020 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:30.020 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:30.020 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:30.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:30 smithi017 ceph-mon[108970]: from='osd.1 [v2:172.21.15.17:6810/745689332,v1:172.21.15.17:6811/745689332]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-20T18:41:30.901 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:30 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1[122436]: 2024-09-20T18:41:30.629+0000 7ff0eb79c640 -1 osd.1 51 log_to_monitors true 2024-09-20T18:41:30.901 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 18:41:30 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1[122436]: 2024-09-20T18:41:30.710+0000 7ff0e3546640 -1 osd.1 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T18:41:30.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:30 smithi172 ceph-mon[80431]: from='osd.1 [v2:172.21.15.17:6810/745689332,v1:172.21.15.17:6811/745689332]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-20T18:41:31.756 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:31 smithi017 ceph-mon[108970]: pgmap v157: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 47/318 objects degraded (14.780%) 2024-09-20T18:41:31.756 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:31 smithi017 ceph-mon[108970]: from='osd.1 [v2:172.21.15.17:6810/745689332,v1:172.21.15.17:6811/745689332]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T18:41:31.756 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:31 smithi017 ceph-mon[108970]: osdmap e54: 6 total, 5 up, 6 in 2024-09-20T18:41:31.756 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:31 smithi017 ceph-mon[108970]: from='osd.1 [v2:172.21.15.17:6810/745689332,v1:172.21.15.17:6811/745689332]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-20T18:41:32.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:31 smithi172 ceph-mon[80431]: pgmap v157: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 47/318 objects degraded (14.780%) 2024-09-20T18:41:32.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:31 smithi172 ceph-mon[80431]: from='osd.1 [v2:172.21.15.17:6810/745689332,v1:172.21.15.17:6811/745689332]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-20T18:41:32.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:31 smithi172 ceph-mon[80431]: osdmap e54: 6 total, 5 up, 6 in 2024-09-20T18:41:32.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:31 smithi172 ceph-mon[80431]: from='osd.1 [v2:172.21.15.17:6810/745689332,v1:172.21.15.17:6811/745689332]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-20T18:41:33.003 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:32 smithi017 ceph-mon[108970]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T18:41:33.003 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:32 smithi017 ceph-mon[108970]: osd.1 [v2:172.21.15.17:6810/745689332,v1:172.21.15.17:6811/745689332] boot 2024-09-20T18:41:33.003 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:32 smithi017 ceph-mon[108970]: osdmap e55: 6 total, 6 up, 6 in 2024-09-20T18:41:33.003 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:32 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-20T18:41:33.003 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:32 smithi017 ceph-mon[108970]: osdmap e56: 6 total, 6 up, 6 in 2024-09-20T18:41:33.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:32 smithi172 ceph-mon[80431]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T18:41:33.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:32 smithi172 ceph-mon[80431]: osd.1 [v2:172.21.15.17:6810/745689332,v1:172.21.15.17:6811/745689332] boot 2024-09-20T18:41:33.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:32 smithi172 ceph-mon[80431]: osdmap e55: 6 total, 6 up, 6 in 2024-09-20T18:41:33.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:32 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-20T18:41:33.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:32 smithi172 ceph-mon[80431]: osdmap e56: 6 total, 6 up, 6 in 2024-09-20T18:41:34.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:33 smithi017 ceph-mon[108970]: pgmap v160: 65 pgs: 20 peering, 7 active+undersized, 7 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 24/318 objects degraded (7.547%) 2024-09-20T18:41:34.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:33 smithi017 ceph-mon[108970]: Health check update: Degraded data redundancy: 24/318 objects degraded (7.547%), 7 pgs degraded (PG_DEGRADED) 2024-09-20T18:41:34.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:34.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:34.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:41:34.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:41:34.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:34.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:41:34.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:41:34.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:41:34.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:41:34.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:33 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-20T18:41:34.192 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:33 smithi172 ceph-mon[80431]: pgmap v160: 65 pgs: 20 peering, 7 active+undersized, 7 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 24/318 objects degraded (7.547%) 2024-09-20T18:41:34.193 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:33 smithi172 ceph-mon[80431]: Health check update: Degraded data redundancy: 24/318 objects degraded (7.547%), 7 pgs degraded (PG_DEGRADED) 2024-09-20T18:41:34.193 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:34.193 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:34.193 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:41:34.193 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:41:34.193 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:34.193 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:41:34.193 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:41:34.193 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:41:34.193 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:41:34.193 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:33 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-20T18:41:34.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:34 smithi017 ceph-mon[108970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T18:41:34.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:34 smithi017 ceph-mon[108970]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-20T18:41:35.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:34 smithi172 ceph-mon[80431]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T18:41:35.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:34 smithi172 ceph-mon[80431]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-20T18:41:36.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:35 smithi017 ceph-mon[108970]: pgmap v162: 65 pgs: 20 peering, 5 active+undersized, 7 active+undersized+degraded, 33 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 24/318 objects degraded (7.547%) 2024-09-20T18:41:36.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:35 smithi172 ceph-mon[80431]: pgmap v162: 65 pgs: 20 peering, 5 active+undersized, 7 active+undersized+degraded, 33 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 24/318 objects degraded (7.547%) 2024-09-20T18:41:37.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:36 smithi017 ceph-mon[108970]: pgmap v163: 65 pgs: 20 peering, 45 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-20T18:41:37.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:36 smithi017 ceph-mon[108970]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/318 objects degraded (7.547%), 7 pgs degraded) 2024-09-20T18:41:37.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:36 smithi172 ceph-mon[80431]: pgmap v163: 65 pgs: 20 peering, 45 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-20T18:41:37.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:36 smithi172 ceph-mon[80431]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/318 objects degraded (7.547%), 7 pgs degraded) 2024-09-20T18:41:38.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:38 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:38.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:38 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:41:38.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:38 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:38.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:38 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:41:39.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:39 smithi172 ceph-mon[80431]: pgmap v164: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:41:39.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:39 smithi017 ceph-mon[108970]: pgmap v164: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:41:41.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:41 smithi017 ceph-mon[108970]: pgmap v165: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-20T18:41:41.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:41 smithi172 ceph-mon[80431]: pgmap v165: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-20T18:41:43.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:43 smithi017 ceph-mon[108970]: pgmap v166: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-20T18:41:43.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:43 smithi172 ceph-mon[80431]: pgmap v166: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-20T18:41:45.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:45 smithi017 ceph-mon[108970]: pgmap v167: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:41:45.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:45 smithi172 ceph-mon[80431]: pgmap v167: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:41:47.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:47 smithi017 ceph-mon[108970]: pgmap v168: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:41:47.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:47 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:47.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:47 smithi172 ceph-mon[80431]: pgmap v168: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:41:47.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:47 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:48.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:48 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-20T18:41:48.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:48 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-20T18:41:49.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:49 smithi172 ceph-mon[80431]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T18:41:49.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:49 smithi172 ceph-mon[80431]: Upgrade: osd.2 is safe to restart 2024-09-20T18:41:49.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:49 smithi172 ceph-mon[80431]: pgmap v169: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:41:49.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:49 smithi017 ceph-mon[108970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-20T18:41:49.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:49 smithi017 ceph-mon[108970]: Upgrade: osd.2 is safe to restart 2024-09-20T18:41:49.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:49 smithi017 ceph-mon[108970]: pgmap v169: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:41:50.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:50 smithi017 ceph-mon[108970]: Upgrade: Updating osd.2 2024-09-20T18:41:50.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:50 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:50.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:50 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-20T18:41:50.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:50 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:41:50.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:50 smithi017 ceph-mon[108970]: Deploying daemon osd.2 on smithi017 2024-09-20T18:41:50.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:50 smithi172 ceph-mon[80431]: Upgrade: Updating osd.2 2024-09-20T18:41:50.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:50 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:41:50.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:50 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-20T18:41:50.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:50 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:41:50.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:50 smithi172 ceph-mon[80431]: Deploying daemon osd.2 on smithi017 2024-09-20T18:41:51.706 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:51 smithi017 ceph-mon[108970]: pgmap v170: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:41:51.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:51 smithi172 ceph-mon[80431]: pgmap v170: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:41:52.818 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:41:52.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:41:53.075 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:52 smithi017 systemd[1]: Stopping Ceph osd.2 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:41:53.401 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:53 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2[64378]: 2024-09-20T18:41:53.059+0000 7fbbc4350640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T18:41:53.401 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:53 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2[64378]: 2024-09-20T18:41:53.059+0000 7fbbc4350640 -1 osd.2 56 *** Got signal Terminated *** 2024-09-20T18:41:53.401 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:53 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2[64378]: 2024-09-20T18:41:53.059+0000 7fbbc4350640 -1 osd.2 56 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T18:41:53.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:53 smithi172 ceph-mon[80431]: pgmap v171: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:41:53.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:53 smithi172 ceph-mon[80431]: osd.2 marked itself down and dead 2024-09-20T18:41:54.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:53 smithi017 ceph-mon[108970]: pgmap v171: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:41:54.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:53 smithi017 ceph-mon[108970]: osd.2 marked itself down and dead 2024-09-20T18:41:54.401 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:54 smithi017 podman[127590]: 2024-09-20 18:41:54.132908596 +0000 UTC m=+1.179311312 container died 6f0b9405dc189a09bd074753a52fcd5b2e298b25e1694023cfe3ec3f2857ab48 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-ed8ee0f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-20T18:41:54.800 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:54 smithi017 ceph-mon[108970]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T18:41:54.800 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:54 smithi017 ceph-mon[108970]: osdmap e57: 6 total, 5 up, 6 in 2024-09-20T18:41:54.801 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:54 smithi017 podman[127590]: 2024-09-20 18:41:54.500380287 +0000 UTC m=+1.546783003 container cleanup 6f0b9405dc189a09bd074753a52fcd5b2e298b25e1694023cfe3ec3f2857ab48 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-ed8ee0f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T18:41:54.801 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:54 smithi017 bash[127590]: ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2 2024-09-20T18:41:54.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:54 smithi172 ceph-mon[80431]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T18:41:54.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:54 smithi172 ceph-mon[80431]: osdmap e57: 6 total, 5 up, 6 in 2024-09-20T18:41:55.143 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:54 smithi017 podman[127606]: 2024-09-20 18:41:54.785313532 +0000 UTC m=+0.648775808 container remove 6f0b9405dc189a09bd074753a52fcd5b2e298b25e1694023cfe3ec3f2857ab48 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-ed8ee0f, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T18:41:55.401 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:55 smithi017 podman[127692]: 2024-09-20 18:41:55.031963275 +0000 UTC m=+0.016643031 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:41:55.401 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:55 smithi017 podman[127692]: 2024-09-20 18:41:55.170022503 +0000 UTC m=+0.154702281 container create 6a68a0c40c010d742603cbbe3448d5e9cb9ccd43dbbf801ed7c9b7a83d5a221b (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-20T18:41:55.664 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:55 smithi017 podman[127692]: 2024-09-20 18:41:55.422430441 +0000 UTC m=+0.407110178 container init 6a68a0c40c010d742603cbbe3448d5e9cb9ccd43dbbf801ed7c9b7a83d5a221b (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-20T18:41:55.665 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:55 smithi017 podman[127692]: 2024-09-20 18:41:55.426021045 +0000 UTC m=+0.410700784 container start 6a68a0c40c010d742603cbbe3448d5e9cb9ccd43dbbf801ed7c9b7a83d5a221b (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True) 2024-09-20T18:41:55.665 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:55 smithi017 podman[127692]: 2024-09-20 18:41:55.52249428 +0000 UTC m=+0.507174035 container attach 6a68a0c40c010d742603cbbe3448d5e9cb9ccd43dbbf801ed7c9b7a83d5a221b (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=) 2024-09-20T18:41:55.665 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:55 smithi017 podman[127692]: 2024-09-20 18:41:55.630927437 +0000 UTC m=+0.615607181 container died 6a68a0c40c010d742603cbbe3448d5e9cb9ccd43dbbf801ed7c9b7a83d5a221b (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T18:41:55.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:55 smithi172 ceph-mon[80431]: pgmap v173: 65 pgs: 9 stale+active+clean, 56 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:41:55.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:55 smithi172 ceph-mon[80431]: osdmap e58: 6 total, 5 up, 6 in 2024-09-20T18:41:55.991 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:55 smithi017 ceph-mon[108970]: pgmap v173: 65 pgs: 9 stale+active+clean, 56 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:41:55.992 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:55 smithi017 ceph-mon[108970]: osdmap e58: 6 total, 5 up, 6 in 2024-09-20T18:41:56.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.343+0000 7fc1b3548640 1 -- 172.21.15.17:0/2676457300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1ac1007f0 msgr2=0x7fc1ac100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:56.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.343+0000 7fc1b3548640 1 --2- 172.21.15.17:0/2676457300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1ac1007f0 0x7fc1ac100c50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009880 tx=0x7fc19c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:41:56.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.343+0000 7fc1b3548640 1 -- 172.21.15.17:0/2676457300 shutdown_connections 2024-09-20T18:41:56.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.343+0000 7fc1b3548640 1 --2- 172.21.15.17:0/2676457300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1ac1007f0 0x7fc1ac100c50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:56.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.343+0000 7fc1b3548640 1 --2- 172.21.15.17:0/2676457300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1ac1067f0 0x7fc1ac106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:56.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.343+0000 7fc1b3548640 1 -- 172.21.15.17:0/2676457300 >> 172.21.15.17:0/2676457300 conn(0x7fc1ac0fc550 msgr2=0x7fc1ac0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:56.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.344+0000 7fc1b3548640 1 -- 172.21.15.17:0/2676457300 shutdown_connections 2024-09-20T18:41:56.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.344+0000 7fc1b3548640 1 -- 172.21.15.17:0/2676457300 wait complete. 2024-09-20T18:41:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.344+0000 7fc1b3548640 1 Processor -- start 2024-09-20T18:41:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.345+0000 7fc1b3548640 1 -- start start 2024-09-20T18:41:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.345+0000 7fc1b3548640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1ac1007f0 0x7fc1ac19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.345+0000 7fc1b3548640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1ac1067f0 0x7fc1ac19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.345+0000 7fc1b3548640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ac10dcc0 con 0x7fc1ac1007f0 2024-09-20T18:41:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.345+0000 7fc1b3548640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ac10db40 con 0x7fc1ac1067f0 2024-09-20T18:41:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.345+0000 7fc1b12e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1ac1007f0 0x7fc1ac19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.345+0000 7fc1b12e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1ac1007f0 0x7fc1ac19a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44030/0 (socket says 172.21.15.17:44030) 2024-09-20T18:41:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.345+0000 7fc1b12e4640 1 -- 172.21.15.17:0/2091899848 learned_addr learned my addr 172.21.15.17:0/2091899848 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:41:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.346+0000 7fc1b12e4640 1 -- 172.21.15.17:0/2091899848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1ac1067f0 msgr2=0x7fc1ac19a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-20T18:41:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.346+0000 7fc1b12e4640 1 --2- 172.21.15.17:0/2091899848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1ac1067f0 0x7fc1ac19a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.346+0000 7fc1b12e4640 1 -- 172.21.15.17:0/2091899848 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ac1955f0 con 0x7fc1ac1007f0 2024-09-20T18:41:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.346+0000 7fc1b12e4640 1 --2- 172.21.15.17:0/2091899848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1ac1007f0 0x7fc1ac19a4a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800d6f0 tx=0x7fc1a800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.349+0000 7fc1a27fc640 1 -- 172.21.15.17:0/2091899848 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1a8017070 con 0x7fc1ac1007f0 2024-09-20T18:41:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.349+0000 7fc1b3548640 1 -- 172.21.15.17:0/2091899848 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1ac1958e0 con 0x7fc1ac1007f0 2024-09-20T18:41:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.349+0000 7fc1b3548640 1 -- 172.21.15.17:0/2091899848 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1ac195e70 con 0x7fc1ac1007f0 2024-09-20T18:41:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.350+0000 7fc1a27fc640 1 -- 172.21.15.17:0/2091899848 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc1a800de00 con 0x7fc1ac1007f0 2024-09-20T18:41:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.350+0000 7fc1a27fc640 1 -- 172.21.15.17:0/2091899848 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1a8004b90 con 0x7fc1ac1007f0 2024-09-20T18:41:56.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.353+0000 7fc1a27fc640 1 -- 172.21.15.17:0/2091899848 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc1a8010460 con 0x7fc1ac1007f0 2024-09-20T18:41:56.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.354+0000 7fc1a27fc640 1 --2- 172.21.15.17:0/2091899848 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc19807b0b0 0x7fc19807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:56.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.354+0000 7fc1a27fc640 1 -- 172.21.15.17:0/2091899848 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5984+0+0 (secure 0 0 0) 0x7fc1a809eaf0 con 0x7fc1ac1007f0 2024-09-20T18:41:56.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.355+0000 7fc1b3548640 1 -- 172.21.15.17:0/2091899848 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc190005290 con 0x7fc1ac1007f0 2024-09-20T18:41:56.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.361+0000 7fc1b0ae3640 1 --2- 172.21.15.17:0/2091899848 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc19807b0b0 0x7fc19807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:56.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.362+0000 7fc1b0ae3640 1 --2- 172.21.15.17:0/2091899848 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc19807b0b0 0x7fc19807d570 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc19c02a9c0 tx=0x7fc19c000bc0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:56.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.365+0000 7fc1a27fc640 1 -- 172.21.15.17:0/2091899848 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc1a806a220 con 0x7fc1ac1007f0 2024-09-20T18:41:56.571 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:56 smithi017 podman[127715]: 2024-09-20 18:41:56.251430216 +0000 UTC m=+0.611933629 container remove 6a68a0c40c010d742603cbbe3448d5e9cb9ccd43dbbf801ed7c9b7a83d5a221b (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-20T18:41:56.572 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:56 smithi017 systemd[1]: ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.2.service: Deactivated successfully. 2024-09-20T18:41:56.572 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:56 smithi017 systemd[1]: Stopped Ceph osd.2 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:41:56.572 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:56 smithi017 systemd[1]: ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.2.service: Consumed 53.453s CPU time. 2024-09-20T18:41:56.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.605+0000 7fc1b3548640 1 -- 172.21.15.17:0/2091899848 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc190000bc0 con 0x7fc19807b0b0 2024-09-20T18:41:56.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.606+0000 7fc1a27fc640 1 -- 172.21.15.17:0/2091899848 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fc190000bc0 con 0x7fc19807b0b0 2024-09-20T18:41:56.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.609+0000 7fc1b3548640 1 -- 172.21.15.17:0/2091899848 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc19807b0b0 msgr2=0x7fc19807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:56.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.609+0000 7fc1b3548640 1 --2- 172.21.15.17:0/2091899848 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc19807b0b0 0x7fc19807d570 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc19c02a9c0 tx=0x7fc19c000bc0 comp rx=0 tx=0).stop 2024-09-20T18:41:56.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.609+0000 7fc1b3548640 1 -- 172.21.15.17:0/2091899848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1ac1007f0 msgr2=0x7fc1ac19a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:56.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.609+0000 7fc1b3548640 1 --2- 172.21.15.17:0/2091899848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1ac1007f0 0x7fc1ac19a4a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800d6f0 tx=0x7fc1a800dbb0 comp rx=0 tx=0).stop 2024-09-20T18:41:56.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.609+0000 7fc1b3548640 1 -- 172.21.15.17:0/2091899848 shutdown_connections 2024-09-20T18:41:56.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.609+0000 7fc1b3548640 1 --2- 172.21.15.17:0/2091899848 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc19807b0b0 0x7fc19807d570 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:56.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.609+0000 7fc1b3548640 1 --2- 172.21.15.17:0/2091899848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1ac1067f0 0x7fc1ac19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:56.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.609+0000 7fc1b3548640 1 --2- 172.21.15.17:0/2091899848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1ac1007f0 0x7fc1ac19a4a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:56.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.609+0000 7fc1b3548640 1 -- 172.21.15.17:0/2091899848 >> 172.21.15.17:0/2091899848 conn(0x7fc1ac0fc550 msgr2=0x7fc1ac069dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:56.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.609+0000 7fc1b3548640 1 -- 172.21.15.17:0/2091899848 shutdown_connections 2024-09-20T18:41:56.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.609+0000 7fc1b3548640 1 -- 172.21.15.17:0/2091899848 wait complete. 2024-09-20T18:41:56.636 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:41:56.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.706+0000 7fd9b7518640 1 -- 172.21.15.17:0/827074631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9b0100de0 msgr2=0x7fd9b01065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:56.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.706+0000 7fd9b7518640 1 --2- 172.21.15.17:0/827074631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9b0100de0 0x7fd9b01065c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009880 tx=0x7fd9a002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:41:56.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.707+0000 7fd9b7518640 1 -- 172.21.15.17:0/827074631 shutdown_connections 2024-09-20T18:41:56.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.707+0000 7fd9b7518640 1 --2- 172.21.15.17:0/827074631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9b0100de0 0x7fd9b01065c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:56.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.707+0000 7fd9b7518640 1 --2- 172.21.15.17:0/827074631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9b0100430 0x7fd9b0100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:56.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.707+0000 7fd9b7518640 1 -- 172.21.15.17:0/827074631 >> 172.21.15.17:0/827074631 conn(0x7fd9b00771e0 msgr2=0x7fd9b00775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:56.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.707+0000 7fd9b7518640 1 -- 172.21.15.17:0/827074631 shutdown_connections 2024-09-20T18:41:56.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.707+0000 7fd9b7518640 1 -- 172.21.15.17:0/827074631 wait complete. 2024-09-20T18:41:56.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.708+0000 7fd9b7518640 1 Processor -- start 2024-09-20T18:41:56.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.708+0000 7fd9b7518640 1 -- start start 2024-09-20T18:41:56.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.708+0000 7fd9b7518640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9b0100430 0x7fd9b019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:56.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.708+0000 7fd9b7518640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9b0100de0 0x7fd9b019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.708+0000 7fd9b7518640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b010edc0 con 0x7fd9b0100430 2024-09-20T18:41:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.708+0000 7fd9b7518640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b010ec40 con 0x7fd9b0100de0 2024-09-20T18:41:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.708+0000 7fd9b52b4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9b0100430 0x7fd9b019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.708+0000 7fd9b52b4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9b0100430 0x7fd9b019d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44048/0 (socket says 172.21.15.17:44048) 2024-09-20T18:41:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.708+0000 7fd9b52b4640 1 -- 172.21.15.17:0/1507562267 learned_addr learned my addr 172.21.15.17:0/1507562267 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:41:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.709+0000 7fd9b4ab3640 1 --2- 172.21.15.17:0/1507562267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9b0100de0 0x7fd9b019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.709+0000 7fd9b52b4640 1 -- 172.21.15.17:0/1507562267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9b0100de0 msgr2=0x7fd9b019dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.709+0000 7fd9b52b4640 1 --2- 172.21.15.17:0/1507562267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9b0100de0 0x7fd9b019dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.709+0000 7fd9b52b4640 1 -- 172.21.15.17:0/1507562267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b0197830 con 0x7fd9b0100430 2024-09-20T18:41:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.709+0000 7fd9b52b4640 1 --2- 172.21.15.17:0/1507562267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9b0100430 0x7fd9b019d6b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00e970 tx=0x7fd9ac00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:56.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.709+0000 7fd9a67fc640 1 -- 172.21.15.17:0/1507562267 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd9ac00cac0 con 0x7fd9b0100430 2024-09-20T18:41:56.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.709+0000 7fd9a67fc640 1 -- 172.21.15.17:0/1507562267 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd9ac0054e0 con 0x7fd9b0100430 2024-09-20T18:41:56.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.709+0000 7fd9a67fc640 1 -- 172.21.15.17:0/1507562267 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd9ac010430 con 0x7fd9b0100430 2024-09-20T18:41:56.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.709+0000 7fd9b7518640 1 -- 172.21.15.17:0/1507562267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9b0197b20 con 0x7fd9b0100430 2024-09-20T18:41:56.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.709+0000 7fd9b7518640 1 -- 172.21.15.17:0/1507562267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9b0198080 con 0x7fd9b0100430 2024-09-20T18:41:56.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.711+0000 7fd9b7518640 1 -- 172.21.15.17:0/1507562267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9b00697e0 con 0x7fd9b0100430 2024-09-20T18:41:56.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.712+0000 7fd9a67fc640 1 -- 172.21.15.17:0/1507562267 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd9ac004f00 con 0x7fd9b0100430 2024-09-20T18:41:56.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.713+0000 7fd9a67fc640 1 --2- 172.21.15.17:0/1507562267 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd99c07af80 0x7fd99c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:56.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.713+0000 7fd9a67fc640 1 -- 172.21.15.17:0/1507562267 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5984+0+0 (secure 0 0 0) 0x7fd9ac09e570 con 0x7fd9b0100430 2024-09-20T18:41:56.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.713+0000 7fd9b4ab3640 1 --2- 172.21.15.17:0/1507562267 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd99c07af80 0x7fd99c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:56.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.714+0000 7fd9b4ab3640 1 --2- 172.21.15.17:0/1507562267 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd99c07af80 0x7fd99c07d440 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0000c00 tx=0x7fd9a0031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:56.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.718+0000 7fd9a67fc640 1 -- 172.21.15.17:0/1507562267 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9ac069c20 con 0x7fd9b0100430 2024-09-20T18:41:56.840 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:56 smithi017 ceph-mon[108970]: Health check failed: Degraded data redundancy: 15/318 objects degraded (4.717%), 3 pgs degraded (PG_DEGRADED) 2024-09-20T18:41:56.841 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:56 smithi017 systemd[1]: Starting Ceph osd.2 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:41:56.841 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:56 smithi017 podman[127841]: 2024-09-20 18:41:56.693422245 +0000 UTC m=+0.017488833 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:41:56.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.928+0000 7fd9b7518640 1 -- 172.21.15.17:0/1507562267 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd9b0198360 con 0x7fd99c07af80 2024-09-20T18:41:56.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.930+0000 7fd9a67fc640 1 -- 172.21.15.17:0/1507562267 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fd9b0198360 con 0x7fd99c07af80 2024-09-20T18:41:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.932+0000 7fd9b7518640 1 -- 172.21.15.17:0/1507562267 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd99c07af80 msgr2=0x7fd99c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.932+0000 7fd9b7518640 1 --2- 172.21.15.17:0/1507562267 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd99c07af80 0x7fd99c07d440 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0000c00 tx=0x7fd9a0031400 comp rx=0 tx=0).stop 2024-09-20T18:41:56.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.932+0000 7fd9b7518640 1 -- 172.21.15.17:0/1507562267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9b0100430 msgr2=0x7fd9b019d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.932+0000 7fd9b7518640 1 --2- 172.21.15.17:0/1507562267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9b0100430 0x7fd9b019d6b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00e970 tx=0x7fd9ac00ed70 comp rx=0 tx=0).stop 2024-09-20T18:41:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.932+0000 7fd9b7518640 1 -- 172.21.15.17:0/1507562267 shutdown_connections 2024-09-20T18:41:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.932+0000 7fd9b7518640 1 --2- 172.21.15.17:0/1507562267 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd99c07af80 0x7fd99c07d440 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.932+0000 7fd9b7518640 1 --2- 172.21.15.17:0/1507562267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9b0100de0 0x7fd9b019dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.932+0000 7fd9b7518640 1 --2- 172.21.15.17:0/1507562267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9b0100430 0x7fd9b019d6b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.932+0000 7fd9b7518640 1 -- 172.21.15.17:0/1507562267 >> 172.21.15.17:0/1507562267 conn(0x7fd9b00771e0 msgr2=0x7fd9b00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.932+0000 7fd9b7518640 1 -- 172.21.15.17:0/1507562267 shutdown_connections 2024-09-20T18:41:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:56.932+0000 7fd9b7518640 1 -- 172.21.15.17:0/1507562267 wait complete. 2024-09-20T18:41:57.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.021+0000 7fe9f5bdd640 1 -- 172.21.15.17:0/4260055872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f01006a0 msgr2=0x7fe9f0100a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:57.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.021+0000 7fe9f5bdd640 1 --2- 172.21.15.17:0/4260055872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f01006a0 0x7fe9f0100a80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009880 tx=0x7fe9e002a490 comp rx=0 tx=0).stop 2024-09-20T18:41:57.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.021+0000 7fe9f5bdd640 1 -- 172.21.15.17:0/4260055872 shutdown_connections 2024-09-20T18:41:57.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.021+0000 7fe9f5bdd640 1 --2- 172.21.15.17:0/4260055872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9f0101050 0x7fe9f010dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.021+0000 7fe9f5bdd640 1 --2- 172.21.15.17:0/4260055872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f01006a0 0x7fe9f0100a80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.021+0000 7fe9f5bdd640 1 -- 172.21.15.17:0/4260055872 >> 172.21.15.17:0/4260055872 conn(0x7fe9f00fc550 msgr2=0x7fe9f00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:57.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.022+0000 7fe9f5bdd640 1 -- 172.21.15.17:0/4260055872 shutdown_connections 2024-09-20T18:41:57.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.022+0000 7fe9f5bdd640 1 -- 172.21.15.17:0/4260055872 wait complete. 2024-09-20T18:41:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.022+0000 7fe9f5bdd640 1 Processor -- start 2024-09-20T18:41:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.023+0000 7fe9f5bdd640 1 -- start start 2024-09-20T18:41:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.023+0000 7fe9f5bdd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9f01006a0 0x7fe9f019f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.023+0000 7fe9f5bdd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f0101050 0x7fe9f019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.023+0000 7fe9f5bdd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f0110f10 con 0x7fe9f0101050 2024-09-20T18:41:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.023+0000 7fe9f5bdd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f0110d90 con 0x7fe9f01006a0 2024-09-20T18:41:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.023+0000 7fe9eeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f0101050 0x7fe9f019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.023+0000 7fe9eeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f0101050 0x7fe9f019fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44066/0 (socket says 172.21.15.17:44066) 2024-09-20T18:41:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.023+0000 7fe9eeffd640 1 -- 172.21.15.17:0/949544208 learned_addr learned my addr 172.21.15.17:0/949544208 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:41:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.023+0000 7fe9ef7fe640 1 --2- 172.21.15.17:0/949544208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9f01006a0 0x7fe9f019f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.023+0000 7fe9eeffd640 1 -- 172.21.15.17:0/949544208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9f01006a0 msgr2=0x7fe9f019f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.023+0000 7fe9eeffd640 1 --2- 172.21.15.17:0/949544208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9f01006a0 0x7fe9f019f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.023+0000 7fe9eeffd640 1 -- 172.21.15.17:0/949544208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f01999a0 con 0x7fe9f0101050 2024-09-20T18:41:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.024+0000 7fe9eeffd640 1 --2- 172.21.15.17:0/949544208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f0101050 0x7fe9f019fd20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400d8d0 tx=0x7fe9e400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:57.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.024+0000 7fe9ecff9640 1 -- 172.21.15.17:0/949544208 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe9e4017030 con 0x7fe9f0101050 2024-09-20T18:41:57.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.024+0000 7fe9f5bdd640 1 -- 172.21.15.17:0/949544208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f0199c90 con 0x7fe9f0101050 2024-09-20T18:41:57.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.024+0000 7fe9ecff9640 1 -- 172.21.15.17:0/949544208 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe9e4004020 con 0x7fe9f0101050 2024-09-20T18:41:57.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.024+0000 7fe9ecff9640 1 -- 172.21.15.17:0/949544208 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe9e40047a0 con 0x7fe9f0101050 2024-09-20T18:41:57.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.024+0000 7fe9f5bdd640 1 -- 172.21.15.17:0/949544208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f019a220 con 0x7fe9f0101050 2024-09-20T18:41:57.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.025+0000 7fe9f5bdd640 1 -- 172.21.15.17:0/949544208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9f006a520 con 0x7fe9f0101050 2024-09-20T18:41:57.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.026+0000 7fe9ecff9640 1 -- 172.21.15.17:0/949544208 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe9e40041d0 con 0x7fe9f0101050 2024-09-20T18:41:57.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.026+0000 7fe9ecff9640 1 --2- 172.21.15.17:0/949544208 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe9d807af30 0x7fe9d807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:57.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.027+0000 7fe9ecff9640 1 -- 172.21.15.17:0/949544208 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5984+0+0 (secure 0 0 0) 0x7fe9e4018070 con 0x7fe9f0101050 2024-09-20T18:41:57.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.027+0000 7fe9ef7fe640 1 --2- 172.21.15.17:0/949544208 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe9d807af30 0x7fe9d807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:57.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.027+0000 7fe9ef7fe640 1 --2- 172.21.15.17:0/949544208 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe9d807af30 0x7fe9d807d3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0000c00 tx=0x7fe9e0031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:57.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.031+0000 7fe9ecff9640 1 -- 172.21.15.17:0/949544208 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe9e4069420 con 0x7fe9f0101050 2024-09-20T18:41:57.112 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:56 smithi017 podman[127841]: 2024-09-20 18:41:56.846400475 +0000 UTC m=+0.170467064 container create c554f275fb14f30b6512c01285fb9835807ad937fda0ee28a4cf33b87bc4d401 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-20T18:41:57.112 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:57 smithi017 podman[127841]: 2024-09-20 18:41:57.097615572 +0000 UTC m=+0.421682176 container init c554f275fb14f30b6512c01285fb9835807ad937fda0ee28a4cf33b87bc4d401 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-20T18:41:57.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:56 smithi172 ceph-mon[80431]: Health check failed: Degraded data redundancy: 15/318 objects degraded (4.717%), 3 pgs degraded (PG_DEGRADED) 2024-09-20T18:41:57.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.230+0000 7fe9f5bdd640 1 -- 172.21.15.17:0/949544208 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe9f019aed0 con 0x7fe9d807af30 2024-09-20T18:41:57.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.240+0000 7fe9ecff9640 1 -- 172.21.15.17:0/949544208 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fe9f019aed0 con 0x7fe9d807af30 2024-09-20T18:41:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:41:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (3m) 28s ago 14m 20.5M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:41:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (6m) 28s ago 14m 8992k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:41:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (5m) 91s ago 13m 8644k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:41:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (98s) 28s ago 14m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:41:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (94s) 91s ago 13m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:41:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (2m) 28s ago 14m 78.3M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:41:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (9m) 28s ago 9m 148M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:41:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (8m) 28s ago 8m 95.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:41:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (8m) 91s ago 8m 26.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:41:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (9m) 91s ago 9m 26.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:41:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (5m) 28s ago 15m 524M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:41:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (4m) 91s ago 13m 457M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:41:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (2m) 28s ago 15m 40.9M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:41:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (110s) 91s ago 13m 27.1M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:41:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (4m) 28s ago 14m 11.6M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:41:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (4m) 91s ago 13m 11.3M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:41:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (72s) 28s ago 12m 81.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:41:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (34s) 28s ago 11m 12.2M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:41:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (11m) 28s ago 11m 206M 1217M 19.1.1-369-ged8ee0f2 6acb0a031eab 6f0b9405dc18 2024-09-20T18:41:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (10m) 91s ago 10m 262M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:41:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (10m) 91s ago 10m 208M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:41:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (10m) 91s ago 10m 190M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:41:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (3m) 28s ago 13m 50.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:41:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.243+0000 7fe9f5bdd640 1 -- 172.21.15.17:0/949544208 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe9d807af30 msgr2=0x7fe9d807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.243+0000 7fe9f5bdd640 1 --2- 172.21.15.17:0/949544208 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe9d807af30 0x7fe9d807d3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0000c00 tx=0x7fe9e0031400 comp rx=0 tx=0).stop 2024-09-20T18:41:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.243+0000 7fe9f5bdd640 1 -- 172.21.15.17:0/949544208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f0101050 msgr2=0x7fe9f019fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.243+0000 7fe9f5bdd640 1 --2- 172.21.15.17:0/949544208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f0101050 0x7fe9f019fd20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400d8d0 tx=0x7fe9e400dd90 comp rx=0 tx=0).stop 2024-09-20T18:41:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.243+0000 7fe9f5bdd640 1 -- 172.21.15.17:0/949544208 shutdown_connections 2024-09-20T18:41:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.243+0000 7fe9f5bdd640 1 --2- 172.21.15.17:0/949544208 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe9d807af30 0x7fe9d807d3f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.243+0000 7fe9f5bdd640 1 --2- 172.21.15.17:0/949544208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f0101050 0x7fe9f019fd20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.243+0000 7fe9f5bdd640 1 --2- 172.21.15.17:0/949544208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9f01006a0 0x7fe9f019f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.243+0000 7fe9f5bdd640 1 -- 172.21.15.17:0/949544208 >> 172.21.15.17:0/949544208 conn(0x7fe9f00fc550 msgr2=0x7fe9f00fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.243+0000 7fe9f5bdd640 1 -- 172.21.15.17:0/949544208 shutdown_connections 2024-09-20T18:41:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.243+0000 7fe9f5bdd640 1 -- 172.21.15.17:0/949544208 wait complete. 2024-09-20T18:41:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.329+0000 7fcb9dba2640 1 -- 172.21.15.17:0/582226294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb98102ab0 msgr2=0x7fcb98102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.329+0000 7fcb9dba2640 1 --2- 172.21.15.17:0/582226294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb98102ab0 0x7fcb98102e90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009880 tx=0x7fcb8802a530 comp rx=0 tx=0).stop 2024-09-20T18:41:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.329+0000 7fcb9dba2640 1 -- 172.21.15.17:0/582226294 shutdown_connections 2024-09-20T18:41:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.329+0000 7fcb9dba2640 1 --2- 172.21.15.17:0/582226294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb981033d0 0x7fcb9810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.329+0000 7fcb9dba2640 1 --2- 172.21.15.17:0/582226294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb98102ab0 0x7fcb98102e90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.329+0000 7fcb9dba2640 1 -- 172.21.15.17:0/582226294 >> 172.21.15.17:0/582226294 conn(0x7fcb980fc550 msgr2=0x7fcb980fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.329+0000 7fcb9dba2640 1 -- 172.21.15.17:0/582226294 shutdown_connections 2024-09-20T18:41:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.329+0000 7fcb9dba2640 1 -- 172.21.15.17:0/582226294 wait complete. 2024-09-20T18:41:57.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.330+0000 7fcb9dba2640 1 Processor -- start 2024-09-20T18:41:57.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.330+0000 7fcb9dba2640 1 -- start start 2024-09-20T18:41:57.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.330+0000 7fcb9dba2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb98102ab0 0x7fcb9819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:57.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.330+0000 7fcb9dba2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb981033d0 0x7fcb9819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:57.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.330+0000 7fcb9dba2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9810edc0 con 0x7fcb981033d0 2024-09-20T18:41:57.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.330+0000 7fcb9dba2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9810ec40 con 0x7fcb98102ab0 2024-09-20T18:41:57.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.331+0000 7fcb96ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb981033d0 0x7fcb9819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:57.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.331+0000 7fcb96ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb981033d0 0x7fcb9819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44080/0 (socket says 172.21.15.17:44080) 2024-09-20T18:41:57.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.331+0000 7fcb96ffd640 1 -- 172.21.15.17:0/3061259876 learned_addr learned my addr 172.21.15.17:0/3061259876 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:41:57.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.331+0000 7fcb977fe640 1 --2- 172.21.15.17:0/3061259876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb98102ab0 0x7fcb9819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:57.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.331+0000 7fcb96ffd640 1 -- 172.21.15.17:0/3061259876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb98102ab0 msgr2=0x7fcb9819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:57.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.331+0000 7fcb96ffd640 1 --2- 172.21.15.17:0/3061259876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb98102ab0 0x7fcb9819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.331+0000 7fcb96ffd640 1 -- 172.21.15.17:0/3061259876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb981977b0 con 0x7fcb981033d0 2024-09-20T18:41:57.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.331+0000 7fcb96ffd640 1 --2- 172.21.15.17:0/3061259876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb981033d0 0x7fcb9819db70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00c8f0 tx=0x7fcb8c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:57.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.331+0000 7fcb94ff9640 1 -- 172.21.15.17:0/3061259876 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb8c0079b0 con 0x7fcb981033d0 2024-09-20T18:41:57.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.331+0000 7fcb94ff9640 1 -- 172.21.15.17:0/3061259876 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcb8c007b50 con 0x7fcb981033d0 2024-09-20T18:41:57.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.331+0000 7fcb94ff9640 1 -- 172.21.15.17:0/3061259876 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb8c018610 con 0x7fcb981033d0 2024-09-20T18:41:57.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.331+0000 7fcb9dba2640 1 -- 172.21.15.17:0/3061259876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb98197aa0 con 0x7fcb981033d0 2024-09-20T18:41:57.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.331+0000 7fcb9dba2640 1 -- 172.21.15.17:0/3061259876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb98198030 con 0x7fcb981033d0 2024-09-20T18:41:57.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.332+0000 7fcb9dba2640 1 -- 172.21.15.17:0/3061259876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb9806a580 con 0x7fcb981033d0 2024-09-20T18:41:57.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.333+0000 7fcb94ff9640 1 -- 172.21.15.17:0/3061259876 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fcb8c007d00 con 0x7fcb981033d0 2024-09-20T18:41:57.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.334+0000 7fcb94ff9640 1 --2- 172.21.15.17:0/3061259876 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb8007af80 0x7fcb8007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:57.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.334+0000 7fcb94ff9640 1 -- 172.21.15.17:0/3061259876 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5984+0+0 (secure 0 0 0) 0x7fcb8c09e0b0 con 0x7fcb981033d0 2024-09-20T18:41:57.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.334+0000 7fcb977fe640 1 --2- 172.21.15.17:0/3061259876 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb8007af80 0x7fcb8007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:57.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.334+0000 7fcb977fe640 1 --2- 172.21.15.17:0/3061259876 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb8007af80 0x7fcb8007d440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb88000c00 tx=0x7fcb88031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:57.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.338+0000 7fcb94ff9640 1 -- 172.21.15.17:0/3061259876 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb8c014030 con 0x7fcb981033d0 2024-09-20T18:41:57.401 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:57 smithi017 podman[127841]: 2024-09-20 18:41:57.102749327 +0000 UTC m=+0.426815926 container start c554f275fb14f30b6512c01285fb9835807ad937fda0ee28a4cf33b87bc4d401 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD) 2024-09-20T18:41:57.401 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:57 smithi017 podman[127841]: 2024-09-20 18:41:57.189042984 +0000 UTC m=+0.513109572 container attach c554f275fb14f30b6512c01285fb9835807ad937fda0ee28a4cf33b87bc4d401 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T18:41:57.401 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:57 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate[127885]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:41:57.401 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:57 smithi017 bash[127841]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:41:57.401 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:57 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate[127885]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:41:57.401 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:41:57 smithi017 bash[127841]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:41:57.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.607+0000 7fcb9dba2640 1 -- 172.21.15.17:0/3061259876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fcb98105f80 con 0x7fcb981033d0 2024-09-20T18:41:57.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.607+0000 7fcb94ff9640 1 -- 172.21.15.17:0/3061259876 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fcb8c069760 con 0x7fcb981033d0 2024-09-20T18:41:57.623 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:41:57.623 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:41:57.624 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:41:57.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:41:57.624 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:41:57.624 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:41:57.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:41:57.624 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:41:57.624 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 3, 2024-09-20T18:41:57.624 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:41:57.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:41:57.624 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:41:57.624 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:41:57.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:41:57.624 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:41:57.624 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 7, 2024-09-20T18:41:57.625 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:41:57.625 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:41:57.625 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:41:57.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.609+0000 7fcb9dba2640 1 -- 172.21.15.17:0/3061259876 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb8007af80 msgr2=0x7fcb8007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:57.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.609+0000 7fcb9dba2640 1 --2- 172.21.15.17:0/3061259876 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb8007af80 0x7fcb8007d440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb88000c00 tx=0x7fcb88031400 comp rx=0 tx=0).stop 2024-09-20T18:41:57.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.609+0000 7fcb9dba2640 1 -- 172.21.15.17:0/3061259876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb981033d0 msgr2=0x7fcb9819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:57.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.609+0000 7fcb9dba2640 1 --2- 172.21.15.17:0/3061259876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb981033d0 0x7fcb9819db70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00c8f0 tx=0x7fcb8c00cdb0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.609+0000 7fcb9dba2640 1 -- 172.21.15.17:0/3061259876 shutdown_connections 2024-09-20T18:41:57.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.609+0000 7fcb9dba2640 1 --2- 172.21.15.17:0/3061259876 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb8007af80 0x7fcb8007d440 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.609+0000 7fcb9dba2640 1 --2- 172.21.15.17:0/3061259876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb981033d0 0x7fcb9819db70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.609+0000 7fcb9dba2640 1 --2- 172.21.15.17:0/3061259876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb98102ab0 0x7fcb9819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.609+0000 7fcb9dba2640 1 -- 172.21.15.17:0/3061259876 >> 172.21.15.17:0/3061259876 conn(0x7fcb980fc550 msgr2=0x7fcb98108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:57.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.610+0000 7fcb9dba2640 1 -- 172.21.15.17:0/3061259876 shutdown_connections 2024-09-20T18:41:57.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.610+0000 7fcb9dba2640 1 -- 172.21.15.17:0/3061259876 wait complete. 2024-09-20T18:41:57.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.695+0000 7f712de17640 1 -- 172.21.15.17:0/1735011855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7128101900 msgr2=0x7f7128101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:57.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.695+0000 7f712de17640 1 --2- 172.21.15.17:0/1735011855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7128101900 0x7f7128101d60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f711c009880 tx=0x7f711c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.696+0000 7f712de17640 1 -- 172.21.15.17:0/1735011855 shutdown_connections 2024-09-20T18:41:57.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.696+0000 7f712de17640 1 --2- 172.21.15.17:0/1735011855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7128101900 0x7f7128101d60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.696+0000 7f712de17640 1 --2- 172.21.15.17:0/1735011855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7128107900 0x7f7128107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.696+0000 7f712de17640 1 -- 172.21.15.17:0/1735011855 >> 172.21.15.17:0/1735011855 conn(0x7f71280fd600 msgr2=0x7f71280ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:57.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.696+0000 7f712de17640 1 -- 172.21.15.17:0/1735011855 shutdown_connections 2024-09-20T18:41:57.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.696+0000 7f712de17640 1 -- 172.21.15.17:0/1735011855 wait complete. 2024-09-20T18:41:57.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.696+0000 7f712de17640 1 Processor -- start 2024-09-20T18:41:57.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.697+0000 7f712de17640 1 -- start start 2024-09-20T18:41:57.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.697+0000 7f712de17640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7128101900 0x7f71280744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:57.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.697+0000 7f712de17640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7128107900 0x7f7128074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:57.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.697+0000 7f712de17640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f712810edb0 con 0x7f7128107900 2024-09-20T18:41:57.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.697+0000 7f712de17640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f712810ec30 con 0x7f7128101900 2024-09-20T18:41:57.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.697+0000 7f7126ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7128107900 0x7f7128074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:57.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.697+0000 7f7126ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7128107900 0x7f7128074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44088/0 (socket says 172.21.15.17:44088) 2024-09-20T18:41:57.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.697+0000 7f7126ffd640 1 -- 172.21.15.17:0/854309220 learned_addr learned my addr 172.21.15.17:0/854309220 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:41:57.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.697+0000 7f71277fe640 1 --2- 172.21.15.17:0/854309220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7128101900 0x7f71280744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:57.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.697+0000 7f7126ffd640 1 -- 172.21.15.17:0/854309220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7128101900 msgr2=0x7f71280744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:57.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.697+0000 7f7126ffd640 1 --2- 172.21.15.17:0/854309220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7128101900 0x7f71280744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.697+0000 7f7126ffd640 1 -- 172.21.15.17:0/854309220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7128074f70 con 0x7f7128107900 2024-09-20T18:41:57.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.698+0000 7f7126ffd640 1 --2- 172.21.15.17:0/854309220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7128107900 0x7f7128074a30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f711c031460 tx=0x7f711c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:57.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.698+0000 7f7124ff9640 1 -- 172.21.15.17:0/854309220 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f711c03f070 con 0x7f7128107900 2024-09-20T18:41:57.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.698+0000 7f7124ff9640 1 -- 172.21.15.17:0/854309220 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f711c0035f0 con 0x7f7128107900 2024-09-20T18:41:57.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.698+0000 7f712de17640 1 -- 172.21.15.17:0/854309220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7128075200 con 0x7f7128107900 2024-09-20T18:41:57.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.698+0000 7f7124ff9640 1 -- 172.21.15.17:0/854309220 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f711c035030 con 0x7f7128107900 2024-09-20T18:41:57.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.698+0000 7f712de17640 1 -- 172.21.15.17:0/854309220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71281a3dc0 con 0x7f7128107900 2024-09-20T18:41:57.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.699+0000 7f712de17640 1 -- 172.21.15.17:0/854309220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7128103040 con 0x7f7128107900 2024-09-20T18:41:57.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.700+0000 7f7124ff9640 1 -- 172.21.15.17:0/854309220 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f711c042070 con 0x7f7128107900 2024-09-20T18:41:57.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.700+0000 7f7124ff9640 1 --2- 172.21.15.17:0/854309220 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f711007af80 0x7f711007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:57.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.700+0000 7f7124ff9640 1 -- 172.21.15.17:0/854309220 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5984+0+0 (secure 0 0 0) 0x7f711c0be7b0 con 0x7f7128107900 2024-09-20T18:41:57.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.700+0000 7f71277fe640 1 --2- 172.21.15.17:0/854309220 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f711007af80 0x7f711007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:57.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.701+0000 7f71277fe640 1 --2- 172.21.15.17:0/854309220 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f711007af80 0x7f711007d440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7118005d00 tx=0x7f711800b410 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:57.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.705+0000 7f7124ff9640 1 -- 172.21.15.17:0/854309220 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f711c089ee0 con 0x7f7128107900 2024-09-20T18:41:57.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:57 smithi017 ceph-mon[108970]: pgmap v175: 65 pgs: 4 active+undersized, 5 stale+active+clean, 3 active+undersized+degraded, 53 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 15/318 objects degraded (4.717%) 2024-09-20T18:41:57.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:57 smithi017 ceph-mon[108970]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:41:57.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:57 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3061259876' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:41:57.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.933+0000 7f712de17640 1 -- 172.21.15.17:0/854309220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7128109900 con 0x7f7128107900 2024-09-20T18:41:57.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.934+0000 7f7124ff9640 1 -- 172.21.15.17:0/854309220 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2043 (secure 0 0 0) 0x7f711c08ed90 con 0x7f7128107900 2024-09-20T18:41:57.949 INFO:teuthology.orchestra.run.smithi017.stdout:e15 2024-09-20T18:41:57.949 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:33:05:524203+0000 2024-09-20T18:41:57.950 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:41:57.950 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:41:57.950 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:41:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:41:57.950 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:41:57.950 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:41:57.950 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 15 2024-09-20T18:41:57.950 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T18:41:57.950 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:41:57.950 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:33:05.065474+0000 2024-09-20T18:41:57.950 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:41:57.951 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:41:57.951 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:41:57.951 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:41:57.951 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:41:57.951 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:41:57.951 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:41:57.951 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:41:57.951 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2024-09-20T18:41:57.951 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:41:57.951 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:41:57.951 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:41:57.951 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14552,1=24325} 2024-09-20T18:41:57.951 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-09-20T18:41:57.952 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:41:57.952 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:41:57.952 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:41:57.952 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:41:57.952 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:41:57.952 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:41:57.952 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:41:57.952 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:41:57.952 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 14552 members: 24325,14552 2024-09-20T18:41:57.952 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{0:14552} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.17:6826/3360305779,v1:172.21.15.17:6827/3360305779] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:41:57.952 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{0:14568} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.17:6828/53113052,v1:172.21.15.17:6829/53113052] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:41:57.952 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{1:24325} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.172:6824/1043027893,v1:172.21.15.172:6825/1043027893] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:41:57.952 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{1:24339} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/2975309540,v1:172.21.15.172:6827/2975309540] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:41:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:41:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:41:57.953 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 15 2024-09-20T18:41:57.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.936+0000 7f712de17640 1 -- 172.21.15.17:0/854309220 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f711007af80 msgr2=0x7f711007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:57.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.936+0000 7f712de17640 1 --2- 172.21.15.17:0/854309220 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f711007af80 0x7f711007d440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7118005d00 tx=0x7f711800b410 comp rx=0 tx=0).stop 2024-09-20T18:41:57.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.936+0000 7f712de17640 1 -- 172.21.15.17:0/854309220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7128107900 msgr2=0x7f7128074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:57.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.936+0000 7f712de17640 1 --2- 172.21.15.17:0/854309220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7128107900 0x7f7128074a30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f711c031460 tx=0x7f711c0045e0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.936+0000 7f712de17640 1 -- 172.21.15.17:0/854309220 shutdown_connections 2024-09-20T18:41:57.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.936+0000 7f712de17640 1 --2- 172.21.15.17:0/854309220 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f711007af80 0x7f711007d440 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.936+0000 7f712de17640 1 --2- 172.21.15.17:0/854309220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7128107900 0x7f7128074a30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.936+0000 7f712de17640 1 --2- 172.21.15.17:0/854309220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7128101900 0x7f71280744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:57.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.936+0000 7f712de17640 1 -- 172.21.15.17:0/854309220 >> 172.21.15.17:0/854309220 conn(0x7f71280fd600 msgr2=0x7f71280fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:57.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.936+0000 7f712de17640 1 -- 172.21.15.17:0/854309220 shutdown_connections 2024-09-20T18:41:57.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:57.936+0000 7f712de17640 1 -- 172.21.15.17:0/854309220 wait complete. 2024-09-20T18:41:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.021+0000 7fa87f874640 1 -- 172.21.15.17:0/635298623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa878107900 msgr2=0x7fa878107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.021+0000 7fa87f874640 1 --2- 172.21.15.17:0/635298623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa878107900 0x7fa878107ce0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa874009880 tx=0x7fa87402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:41:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.021+0000 7fa87f874640 1 -- 172.21.15.17:0/635298623 shutdown_connections 2024-09-20T18:41:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.021+0000 7fa87f874640 1 --2- 172.21.15.17:0/635298623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa878101900 0x7fa878101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.021+0000 7fa87f874640 1 --2- 172.21.15.17:0/635298623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa878107900 0x7fa878107ce0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.021+0000 7fa87f874640 1 -- 172.21.15.17:0/635298623 >> 172.21.15.17:0/635298623 conn(0x7fa8780fd600 msgr2=0x7fa8780ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.021+0000 7fa87f874640 1 -- 172.21.15.17:0/635298623 shutdown_connections 2024-09-20T18:41:58.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.021+0000 7fa87f874640 1 -- 172.21.15.17:0/635298623 wait complete. 2024-09-20T18:41:58.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.022+0000 7fa87f874640 1 Processor -- start 2024-09-20T18:41:58.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.022+0000 7fa87f874640 1 -- start start 2024-09-20T18:41:58.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.022+0000 7fa87f874640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa878101900 0x7fa87819f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:58.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.022+0000 7fa87f874640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa878107900 0x7fa87819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:58.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.022+0000 7fa87f874640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa87810edb0 con 0x7fa878107900 2024-09-20T18:41:58.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.022+0000 7fa87f874640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa87810ec30 con 0x7fa878101900 2024-09-20T18:41:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.022+0000 7fa87ce0f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa878107900 0x7fa87819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.022+0000 7fa87ce0f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa878107900 0x7fa87819fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44102/0 (socket says 172.21.15.17:44102) 2024-09-20T18:41:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.022+0000 7fa87ce0f640 1 -- 172.21.15.17:0/2503799992 learned_addr learned my addr 172.21.15.17:0/2503799992 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:41:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.022+0000 7fa87d610640 1 --2- 172.21.15.17:0/2503799992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa878101900 0x7fa87819f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.022+0000 7fa87ce0f640 1 -- 172.21.15.17:0/2503799992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa878101900 msgr2=0x7fa87819f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.022+0000 7fa87ce0f640 1 --2- 172.21.15.17:0/2503799992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa878101900 0x7fa87819f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.022+0000 7fa87ce0f640 1 -- 172.21.15.17:0/2503799992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8781999b0 con 0x7fa878107900 2024-09-20T18:41:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.023+0000 7fa87ce0f640 1 --2- 172.21.15.17:0/2503799992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa878107900 0x7fa87819fd30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa86800d8d0 tx=0x7fa86800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.023+0000 7fa86e7fc640 1 -- 172.21.15.17:0/2503799992 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa868017070 con 0x7fa878107900 2024-09-20T18:41:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.023+0000 7fa86e7fc640 1 -- 172.21.15.17:0/2503799992 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa868010460 con 0x7fa878107900 2024-09-20T18:41:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.023+0000 7fa86e7fc640 1 -- 172.21.15.17:0/2503799992 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa86800f5f0 con 0x7fa878107900 2024-09-20T18:41:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.023+0000 7fa87f874640 1 -- 172.21.15.17:0/2503799992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa878199ca0 con 0x7fa878107900 2024-09-20T18:41:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.023+0000 7fa87f874640 1 -- 172.21.15.17:0/2503799992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa87819a230 con 0x7fa878107900 2024-09-20T18:41:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.024+0000 7fa87f874640 1 -- 172.21.15.17:0/2503799992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa878103040 con 0x7fa878107900 2024-09-20T18:41:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.025+0000 7fa86e7fc640 1 -- 172.21.15.17:0/2503799992 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa868009a30 con 0x7fa878107900 2024-09-20T18:41:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.025+0000 7fa86e7fc640 1 --2- 172.21.15.17:0/2503799992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa86407af30 0x7fa86407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.025+0000 7fa86e7fc640 1 -- 172.21.15.17:0/2503799992 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5984+0+0 (secure 0 0 0) 0x7fa86809de30 con 0x7fa878107900 2024-09-20T18:41:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.025+0000 7fa87d610640 1 --2- 172.21.15.17:0/2503799992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa86407af30 0x7fa86407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.026+0000 7fa87d610640 1 --2- 172.21.15.17:0/2503799992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa86407af30 0x7fa86407d3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa874000c00 tx=0x7fa874031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:58.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.030+0000 7fa86e7fc640 1 -- 172.21.15.17:0/2503799992 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa8680694e0 con 0x7fa878107900 2024-09-20T18:41:58.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:57 smithi172 ceph-mon[80431]: pgmap v175: 65 pgs: 4 active+undersized, 5 stale+active+clean, 3 active+undersized+degraded, 53 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 15/318 objects degraded (4.717%) 2024-09-20T18:41:58.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:57 smithi172 ceph-mon[80431]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:41:58.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:57 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3061259876' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:41:58.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.236+0000 7fa87f874640 1 -- 172.21.15.17:0/2503799992 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa87819a4e0 con 0x7fa86407af30 2024-09-20T18:41:58.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.237+0000 7fa86e7fc640 1 -- 172.21.15.17:0/2503799992 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fa87819a4e0 con 0x7fa86407af30 2024-09-20T18:41:58.252 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:41:58.252 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:41:58.252 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:41:58.253 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:41:58.253 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:41:58.253 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:41:58.253 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:41:58.253 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:41:58.253 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:41:58.253 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "8/23 daemons upgraded", 2024-09-20T18:41:58.253 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T18:41:58.253 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:41:58.253 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:41:58.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.239+0000 7fa87f874640 1 -- 172.21.15.17:0/2503799992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa86407af30 msgr2=0x7fa86407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:58.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.239+0000 7fa87f874640 1 --2- 172.21.15.17:0/2503799992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa86407af30 0x7fa86407d3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa874000c00 tx=0x7fa874031400 comp rx=0 tx=0).stop 2024-09-20T18:41:58.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.239+0000 7fa87f874640 1 -- 172.21.15.17:0/2503799992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa878107900 msgr2=0x7fa87819fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:58.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.239+0000 7fa87f874640 1 --2- 172.21.15.17:0/2503799992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa878107900 0x7fa87819fd30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa86800d8d0 tx=0x7fa86800dd90 comp rx=0 tx=0).stop 2024-09-20T18:41:58.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.239+0000 7fa87f874640 1 -- 172.21.15.17:0/2503799992 shutdown_connections 2024-09-20T18:41:58.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.239+0000 7fa87f874640 1 --2- 172.21.15.17:0/2503799992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa86407af30 0x7fa86407d3f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:58.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.239+0000 7fa87f874640 1 --2- 172.21.15.17:0/2503799992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa878107900 0x7fa87819fd30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:58.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.239+0000 7fa87f874640 1 --2- 172.21.15.17:0/2503799992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa878101900 0x7fa87819f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:58.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.239+0000 7fa87f874640 1 -- 172.21.15.17:0/2503799992 >> 172.21.15.17:0/2503799992 conn(0x7fa8780fd600 msgr2=0x7fa8780fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:58.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.239+0000 7fa87f874640 1 -- 172.21.15.17:0/2503799992 shutdown_connections 2024-09-20T18:41:58.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.239+0000 7fa87f874640 1 -- 172.21.15.17:0/2503799992 wait complete. 2024-09-20T18:41:58.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.323+0000 7f4c8997c640 1 -- 172.21.15.17:0/1980589728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c841033e0 msgr2=0x7f4c8410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:58.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.323+0000 7f4c8997c640 1 --2- 172.21.15.17:0/1980589728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c841033e0 0x7f4c8410b8d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c009880 tx=0x7f4c6c02a530 comp rx=0 tx=0).stop 2024-09-20T18:41:58.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.323+0000 7f4c8997c640 1 -- 172.21.15.17:0/1980589728 shutdown_connections 2024-09-20T18:41:58.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.323+0000 7f4c8997c640 1 --2- 172.21.15.17:0/1980589728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c841033e0 0x7f4c8410b8d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:58.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.323+0000 7f4c8997c640 1 --2- 172.21.15.17:0/1980589728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c84102ac0 0x7f4c84102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:58.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.323+0000 7f4c8997c640 1 -- 172.21.15.17:0/1980589728 >> 172.21.15.17:0/1980589728 conn(0x7f4c840fc520 msgr2=0x7f4c840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:58.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.324+0000 7f4c8997c640 1 -- 172.21.15.17:0/1980589728 shutdown_connections 2024-09-20T18:41:58.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.324+0000 7f4c8997c640 1 -- 172.21.15.17:0/1980589728 wait complete. 2024-09-20T18:41:58.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.324+0000 7f4c8997c640 1 Processor -- start 2024-09-20T18:41:58.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.324+0000 7f4c8997c640 1 -- start start 2024-09-20T18:41:58.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.324+0000 7f4c8997c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c84102ac0 0x7f4c84100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:58.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.324+0000 7f4c8997c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c841033e0 0x7f4c84100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:58.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.324+0000 7f4c8997c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8410edf0 con 0x7f4c84102ac0 2024-09-20T18:41:58.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.324+0000 7f4c8997c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8410ec70 con 0x7f4c841033e0 2024-09-20T18:41:58.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.324+0000 7f4c82ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c84102ac0 0x7f4c84100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:58.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.325+0000 7f4c82ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c84102ac0 0x7f4c84100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44134/0 (socket says 172.21.15.17:44134) 2024-09-20T18:41:58.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.325+0000 7f4c82ffd640 1 -- 172.21.15.17:0/2207573018 learned_addr learned my addr 172.21.15.17:0/2207573018 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:41:58.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.325+0000 7f4c7bfff640 1 --2- 172.21.15.17:0/2207573018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c841033e0 0x7f4c84100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:58.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.325+0000 7f4c82ffd640 1 -- 172.21.15.17:0/2207573018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c841033e0 msgr2=0x7f4c84100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:58.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.325+0000 7f4c82ffd640 1 --2- 172.21.15.17:0/2207573018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c841033e0 0x7f4c84100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:58.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.325+0000 7f4c82ffd640 1 -- 172.21.15.17:0/2207573018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c841011a0 con 0x7f4c84102ac0 2024-09-20T18:41:58.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.325+0000 7f4c7bfff640 1 --2- 172.21.15.17:0/2207573018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c841033e0 0x7f4c84100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:41:58.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.325+0000 7f4c82ffd640 1 --2- 172.21.15.17:0/2207573018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c84102ac0 0x7f4c84100720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400d6f0 tx=0x7f4c7400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:58.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.325+0000 7f4c8897a640 1 -- 172.21.15.17:0/2207573018 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c74017070 con 0x7f4c84102ac0 2024-09-20T18:41:58.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.325+0000 7f4c8897a640 1 -- 172.21.15.17:0/2207573018 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4c7400de00 con 0x7f4c84102ac0 2024-09-20T18:41:58.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.325+0000 7f4c8897a640 1 -- 172.21.15.17:0/2207573018 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c74004bb0 con 0x7f4c84102ac0 2024-09-20T18:41:58.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.325+0000 7f4c8997c640 1 -- 172.21.15.17:0/2207573018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c84101490 con 0x7f4c84102ac0 2024-09-20T18:41:58.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.325+0000 7f4c8997c640 1 -- 172.21.15.17:0/2207573018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c841a3e60 con 0x7f4c84102ac0 2024-09-20T18:41:58.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.326+0000 7f4c8997c640 1 -- 172.21.15.17:0/2207573018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c8406aa90 con 0x7f4c84102ac0 2024-09-20T18:41:58.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.327+0000 7f4c8897a640 1 -- 172.21.15.17:0/2207573018 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4c74004e60 con 0x7f4c84102ac0 2024-09-20T18:41:58.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.328+0000 7f4c8897a640 1 --2- 172.21.15.17:0/2207573018 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c7007af30 0x7f4c7007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:41:58.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.328+0000 7f4c8897a640 1 -- 172.21.15.17:0/2207573018 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5984+0+0 (secure 0 0 0) 0x7f4c7409db80 con 0x7f4c84102ac0 2024-09-20T18:41:58.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.328+0000 7f4c7bfff640 1 --2- 172.21.15.17:0/2207573018 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c7007af30 0x7f4c7007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:41:58.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.328+0000 7f4c7bfff640 1 --2- 172.21.15.17:0/2207573018 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c7007af30 0x7f4c7007d3f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4c841021b0 tx=0x7f4c6c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:41:58.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.332+0000 7f4c8897a640 1 -- 172.21.15.17:0/2207573018 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c74069230 con 0x7f4c84102ac0 2024-09-20T18:41:58.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.598+0000 7f4c8997c640 1 -- 172.21.15.17:0/2207573018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f4c84102ea0 con 0x7f4c84102ac0 2024-09-20T18:41:58.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.598+0000 7f4c8897a640 1 -- 172.21.15.17:0/2207573018 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+626 (secure 0 0 0) 0x7f4c7406e0e0 con 0x7f4c84102ac0 2024-09-20T18:41:58.614 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 15/318 objects degraded (4.717%), 3 pgs degraded 2024-09-20T18:41:58.614 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:41:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:41:58.614 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-20T18:41:58.614 INFO:teuthology.orchestra.run.smithi017.stdout: osd.2 (root=default,host=smithi017) is down 2024-09-20T18:41:58.615 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 15/318 objects degraded (4.717%), 3 pgs degraded 2024-09-20T18:41:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-20T18:41:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-20T18:41:58.615 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-20T18:41:58.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.600+0000 7f4c8997c640 1 -- 172.21.15.17:0/2207573018 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c7007af30 msgr2=0x7f4c7007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:58.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.600+0000 7f4c8997c640 1 --2- 172.21.15.17:0/2207573018 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c7007af30 0x7f4c7007d3f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4c841021b0 tx=0x7f4c6c031400 comp rx=0 tx=0).stop 2024-09-20T18:41:58.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.600+0000 7f4c8997c640 1 -- 172.21.15.17:0/2207573018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c84102ac0 msgr2=0x7f4c84100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:41:58.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.600+0000 7f4c8997c640 1 --2- 172.21.15.17:0/2207573018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c84102ac0 0x7f4c84100720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400d6f0 tx=0x7f4c7400dbb0 comp rx=0 tx=0).stop 2024-09-20T18:41:58.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.600+0000 7f4c8997c640 1 -- 172.21.15.17:0/2207573018 shutdown_connections 2024-09-20T18:41:58.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.600+0000 7f4c8997c640 1 --2- 172.21.15.17:0/2207573018 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c7007af30 0x7f4c7007d3f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:58.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.600+0000 7f4c8997c640 1 --2- 172.21.15.17:0/2207573018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c841033e0 0x7f4c84100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:58.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.600+0000 7f4c8997c640 1 --2- 172.21.15.17:0/2207573018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c84102ac0 0x7f4c84100720 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:41:58.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.600+0000 7f4c8997c640 1 -- 172.21.15.17:0/2207573018 >> 172.21.15.17:0/2207573018 conn(0x7f4c840fc520 msgr2=0x7f4c84108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:41:58.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.601+0000 7f4c8997c640 1 -- 172.21.15.17:0/2207573018 shutdown_connections 2024-09-20T18:41:58.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:41:58.601+0000 7f4c8997c640 1 -- 172.21.15.17:0/2207573018 wait complete. 2024-09-20T18:41:58.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:58 smithi017 ceph-mon[108970]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:41:58.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:58 smithi017 ceph-mon[108970]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:41:58.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:58 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/854309220' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:41:58.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:58 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2207573018' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:41:59.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:58 smithi172 ceph-mon[80431]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:41:59.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:58 smithi172 ceph-mon[80431]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:41:59.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:58 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/854309220' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:41:59.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:58 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2207573018' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:42:00.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:59 smithi017 ceph-mon[108970]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:42:00.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:41:59 smithi017 ceph-mon[108970]: pgmap v176: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 42/318 objects degraded (13.208%) 2024-09-20T18:42:00.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:59 smithi172 ceph-mon[80431]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:42:00.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:41:59 smithi172 ceph-mon[80431]: pgmap v176: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 42/318 objects degraded (13.208%) 2024-09-20T18:42:00.550 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate[127885]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T18:42:00.550 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate[127885]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:42:00.550 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 bash[127841]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T18:42:00.550 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 bash[127841]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:42:00.550 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate[127885]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:42:00.550 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 bash[127841]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:42:00.550 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate[127885]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T18:42:00.551 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 bash[127841]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T18:42:00.551 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate[127885]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-09-20T18:42:00.551 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 bash[127841]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-09-20T18:42:00.551 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate[127885]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-20T18:42:00.551 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 bash[127841]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-20T18:42:00.901 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate[127885]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-09-20T18:42:00.902 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 bash[127841]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-09-20T18:42:00.902 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate[127885]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-20T18:42:00.902 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 bash[127841]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-20T18:42:00.902 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate[127885]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T18:42:00.902 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 bash[127841]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-20T18:42:00.902 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate[127885]: --> ceph-volume lvm activate successful for osd ID: 2 2024-09-20T18:42:00.902 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 bash[127841]: --> ceph-volume lvm activate successful for osd ID: 2 2024-09-20T18:42:00.902 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:00 smithi017 podman[127841]: 2024-09-20 18:42:00.567913019 +0000 UTC m=+3.891979609 container died c554f275fb14f30b6512c01285fb9835807ad937fda0ee28a4cf33b87bc4d401 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-20T18:42:01.542 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:01 smithi017 podman[128219]: 2024-09-20 18:42:01.276666273 +0000 UTC m=+0.697130236 container remove c554f275fb14f30b6512c01285fb9835807ad937fda0ee28a4cf33b87bc4d401 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-20T18:42:01.543 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:01 smithi017 podman[128278]: 2024-09-20 18:42:01.399642966 +0000 UTC m=+0.017156795 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:42:01.543 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:01 smithi017 podman[128278]: 2024-09-20 18:42:01.527793269 +0000 UTC m=+0.145307124 container create 608ec433a002c9f5834b880f999b9f2a6026d8cd58a59223e5e6e19e03ce13aa (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-20T18:42:01.804 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:01 smithi017 ceph-mon[108970]: pgmap v177: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 0 op/s; 42/318 objects degraded (13.208%) 2024-09-20T18:42:02.151 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:01 smithi017 podman[128278]: 2024-09-20 18:42:01.788991779 +0000 UTC m=+0.406505604 container init 608ec433a002c9f5834b880f999b9f2a6026d8cd58a59223e5e6e19e03ce13aa (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-20T18:42:02.151 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:01 smithi017 podman[128278]: 2024-09-20 18:42:01.792549878 +0000 UTC m=+0.410063691 container start 608ec433a002c9f5834b880f999b9f2a6026d8cd58a59223e5e6e19e03ce13aa (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD) 2024-09-20T18:42:02.151 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:01 smithi017 ceph-osd[128297]: -- 172.21.15.17:0/3530103985 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563263bbe1e0 con 0x563262d5dc00 2024-09-20T18:42:02.151 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:01 smithi017 bash[128278]: 608ec433a002c9f5834b880f999b9f2a6026d8cd58a59223e5e6e19e03ce13aa 2024-09-20T18:42:02.151 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:01 smithi017 systemd[1]: Started Ceph osd.2 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:42:02.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:01 smithi172 ceph-mon[80431]: pgmap v177: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 0 op/s; 42/318 objects degraded (13.208%) 2024-09-20T18:42:02.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:02 smithi017 ceph-mon[108970]: Health check update: Degraded data redundancy: 42/318 objects degraded (13.208%), 13 pgs degraded (PG_DEGRADED) 2024-09-20T18:42:02.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:02 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:02.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:02 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:02.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:02 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:42:03.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:02 smithi172 ceph-mon[80431]: Health check update: Degraded data redundancy: 42/318 objects degraded (13.208%), 13 pgs degraded (PG_DEGRADED) 2024-09-20T18:42:03.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:02 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:03.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:02 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:03.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:02 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:42:03.651 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:03 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2[128293]: 2024-09-20T18:42:03.426+0000 7fd48fad3640 -1 Falling back to public interface 2024-09-20T18:42:04.080 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:03 smithi017 ceph-mon[108970]: pgmap v178: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 42/318 objects degraded (13.208%) 2024-09-20T18:42:04.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:03 smithi172 ceph-mon[80431]: pgmap v178: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 42/318 objects degraded (13.208%) 2024-09-20T18:42:05.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:05 smithi017 ceph-mon[108970]: pgmap v179: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 42/318 objects degraded (13.208%) 2024-09-20T18:42:06.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:05 smithi172 ceph-mon[80431]: pgmap v179: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 42/318 objects degraded (13.208%) 2024-09-20T18:42:07.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:07 smithi017 ceph-mon[108970]: pgmap v180: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 964 B/s rd, 2 op/s; 42/318 objects degraded (13.208%) 2024-09-20T18:42:07.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:07.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:07.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:07.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:42:07.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:07.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:08.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:07 smithi172 ceph-mon[80431]: pgmap v180: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 964 B/s rd, 2 op/s; 42/318 objects degraded (13.208%) 2024-09-20T18:42:08.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:08.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:08.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:08.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:42:08.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:08.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:08.313 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:08 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2[128293]: 2024-09-20T18:42:08.047+0000 7fd48fad3640 -1 osd.2 56 log_to_monitors true 2024-09-20T18:42:09.067 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:08 smithi017 ceph-mon[108970]: from='osd.2 [v2:172.21.15.17:6818/3163099117,v1:172.21.15.17:6819/3163099117]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-20T18:42:09.067 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 18:42:08 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2[128293]: 2024-09-20T18:42:08.745+0000 7fd483875640 -1 osd.2 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T18:42:09.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:08 smithi172 ceph-mon[80431]: from='osd.2 [v2:172.21.15.17:6818/3163099117,v1:172.21.15.17:6819/3163099117]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-20T18:42:09.756 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:09 smithi017 ceph-mon[108970]: pgmap v181: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 42/318 objects degraded (13.208%) 2024-09-20T18:42:09.756 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:09 smithi017 ceph-mon[108970]: from='osd.2 [v2:172.21.15.17:6818/3163099117,v1:172.21.15.17:6819/3163099117]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T18:42:09.756 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:09 smithi017 ceph-mon[108970]: osdmap e59: 6 total, 5 up, 6 in 2024-09-20T18:42:09.757 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:09 smithi017 ceph-mon[108970]: from='osd.2 [v2:172.21.15.17:6818/3163099117,v1:172.21.15.17:6819/3163099117]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-20T18:42:10.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:09 smithi172 ceph-mon[80431]: pgmap v181: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 42/318 objects degraded (13.208%) 2024-09-20T18:42:10.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:09 smithi172 ceph-mon[80431]: from='osd.2 [v2:172.21.15.17:6818/3163099117,v1:172.21.15.17:6819/3163099117]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-20T18:42:10.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:09 smithi172 ceph-mon[80431]: osdmap e59: 6 total, 5 up, 6 in 2024-09-20T18:42:10.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:09 smithi172 ceph-mon[80431]: from='osd.2 [v2:172.21.15.17:6818/3163099117,v1:172.21.15.17:6819/3163099117]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi017", "root=default"]} : dispatch 2024-09-20T18:42:11.079 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:10 smithi017 ceph-mon[108970]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T18:42:11.079 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:10 smithi017 ceph-mon[108970]: osd.2 [v2:172.21.15.17:6818/3163099117,v1:172.21.15.17:6819/3163099117] boot 2024-09-20T18:42:11.079 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:10 smithi017 ceph-mon[108970]: osdmap e60: 6 total, 6 up, 6 in 2024-09-20T18:42:11.079 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:10 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-20T18:42:11.080 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:10 smithi017 ceph-mon[108970]: osdmap e61: 6 total, 6 up, 6 in 2024-09-20T18:42:11.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:10 smithi172 ceph-mon[80431]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T18:42:11.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:10 smithi172 ceph-mon[80431]: osd.2 [v2:172.21.15.17:6818/3163099117,v1:172.21.15.17:6819/3163099117] boot 2024-09-20T18:42:11.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:10 smithi172 ceph-mon[80431]: osdmap e60: 6 total, 6 up, 6 in 2024-09-20T18:42:11.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:10 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-20T18:42:11.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:10 smithi172 ceph-mon[80431]: osdmap e61: 6 total, 6 up, 6 in 2024-09-20T18:42:11.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:11 smithi017 ceph-mon[108970]: pgmap v184: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 42/318 objects degraded (13.208%) 2024-09-20T18:42:11.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:11.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:11.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:42:11.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:42:11.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:11.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:42:11.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:42:11.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:42:11.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:42:11.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-20T18:42:12.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:11 smithi172 ceph-mon[80431]: pgmap v184: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 42/318 objects degraded (13.208%) 2024-09-20T18:42:12.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:12.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:12.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:42:12.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:42:12.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:12.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:42:12.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:42:12.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:42:12.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:42:12.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-20T18:42:13.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:12 smithi017 ceph-mon[108970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T18:42:13.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:12 smithi017 ceph-mon[108970]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-20T18:42:13.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:12 smithi172 ceph-mon[80431]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T18:42:13.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:12 smithi172 ceph-mon[80431]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-20T18:42:13.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:13 smithi017 ceph-mon[108970]: pgmap v186: 65 pgs: 3 peering, 7 active+undersized, 7 active+undersized+degraded, 48 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 5 op/s; 22/318 objects degraded (6.918%) 2024-09-20T18:42:13.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:13 smithi017 ceph-mon[108970]: Health check update: Degraded data redundancy: 22/318 objects degraded (6.918%), 7 pgs degraded (PG_DEGRADED) 2024-09-20T18:42:14.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:13 smithi172 ceph-mon[80431]: pgmap v186: 65 pgs: 3 peering, 7 active+undersized, 7 active+undersized+degraded, 48 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 5 op/s; 22/318 objects degraded (6.918%) 2024-09-20T18:42:14.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:13 smithi172 ceph-mon[80431]: Health check update: Degraded data redundancy: 22/318 objects degraded (6.918%), 7 pgs degraded (PG_DEGRADED) 2024-09-20T18:42:14.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:14 smithi172 ceph-mon[80431]: pgmap v187: 65 pgs: 3 peering, 62 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-20T18:42:14.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:14 smithi172 ceph-mon[80431]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/318 objects degraded (6.918%), 7 pgs degraded) 2024-09-20T18:42:15.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:14 smithi017 ceph-mon[108970]: pgmap v187: 65 pgs: 3 peering, 62 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-20T18:42:15.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:14 smithi017 ceph-mon[108970]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/318 objects degraded (6.918%), 7 pgs degraded) 2024-09-20T18:42:17.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:17 smithi017 ceph-mon[108970]: pgmap v188: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-09-20T18:42:17.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:17 smithi172 ceph-mon[80431]: pgmap v188: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-09-20T18:42:19.578 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:19 smithi017 ceph-mon[108970]: pgmap v189: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-20T18:42:19.673 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:19 smithi172 ceph-mon[80431]: pgmap v189: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-20T18:42:21.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:21 smithi172 ceph-mon[80431]: pgmap v190: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-20T18:42:21.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:21 smithi017 ceph-mon[108970]: pgmap v190: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-20T18:42:23.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:23 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:23.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:23 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:42:23.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:23 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:23.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:23 smithi017 ceph-mon[108970]: pgmap v191: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:42:23.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:23 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:23.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:23 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:42:23.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:23 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:23.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:23 smithi172 ceph-mon[80431]: pgmap v191: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:42:25.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:25 smithi017 ceph-mon[108970]: pgmap v192: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:42:25.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:25 smithi172 ceph-mon[80431]: pgmap v192: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:42:26.696 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:26 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-20T18:42:26.863 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:26 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-20T18:42:27.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:27 smithi172 ceph-mon[80431]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T18:42:27.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:27 smithi172 ceph-mon[80431]: Upgrade: osd.3 is safe to restart 2024-09-20T18:42:27.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:27 smithi172 ceph-mon[80431]: pgmap v193: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:42:27.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:27 smithi017 ceph-mon[108970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-20T18:42:27.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:27 smithi017 ceph-mon[108970]: Upgrade: osd.3 is safe to restart 2024-09-20T18:42:27.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:27 smithi017 ceph-mon[108970]: pgmap v193: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:42:28.707 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:28 smithi172 ceph-mon[80431]: Upgrade: Updating osd.3 2024-09-20T18:42:28.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:28 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:28.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:28 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-20T18:42:28.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:28 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:42:28.708 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:28 smithi172 ceph-mon[80431]: Deploying daemon osd.3 on smithi172 2024-09-20T18:42:28.715 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:28 smithi017 ceph-mon[108970]: Upgrade: Updating osd.3 2024-09-20T18:42:28.715 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:28 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:28.716 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:28 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-20T18:42:28.716 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:28 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:42:28.716 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:28 smithi017 ceph-mon[108970]: Deploying daemon osd.3 on smithi172 2024-09-20T18:42:28.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.700+0000 7f67f3859640 1 -- 172.21.15.17:0/629135343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67ec074eb0 msgr2=0x7f67ec1123d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:28.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.700+0000 7f67f3859640 1 --2- 172.21.15.17:0/629135343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67ec074eb0 0x7f67ec1123d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009880 tx=0x7f67dc02a530 comp rx=0 tx=0).stop 2024-09-20T18:42:28.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.700+0000 7f67f3859640 1 -- 172.21.15.17:0/629135343 shutdown_connections 2024-09-20T18:42:28.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.700+0000 7f67f3859640 1 --2- 172.21.15.17:0/629135343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67ec074eb0 0x7f67ec1123d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:28.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.700+0000 7f67f3859640 1 --2- 172.21.15.17:0/629135343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67ec074590 0x7f67ec074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:28.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.700+0000 7f67f3859640 1 -- 172.21.15.17:0/629135343 >> 172.21.15.17:0/629135343 conn(0x7f67ec0fd600 msgr2=0x7f67ec0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:42:28.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.700+0000 7f67f3859640 1 -- 172.21.15.17:0/629135343 shutdown_connections 2024-09-20T18:42:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.700+0000 7f67f3859640 1 -- 172.21.15.17:0/629135343 wait complete. 2024-09-20T18:42:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.700+0000 7f67f3859640 1 Processor -- start 2024-09-20T18:42:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.701+0000 7f67f3859640 1 -- start start 2024-09-20T18:42:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.701+0000 7f67f3859640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67ec074590 0x7f67ec19e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.701+0000 7f67f3859640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67ec074eb0 0x7f67ec19e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.701+0000 7f67f3859640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec1153e0 con 0x7f67ec074590 2024-09-20T18:42:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.701+0000 7f67f3859640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec115260 con 0x7f67ec074eb0 2024-09-20T18:42:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.701+0000 7f67f15f5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67ec074590 0x7f67ec19e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.701+0000 7f67f15f5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67ec074590 0x7f67ec19e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56718/0 (socket says 172.21.15.17:56718) 2024-09-20T18:42:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.701+0000 7f67f15f5640 1 -- 172.21.15.17:0/87160131 learned_addr learned my addr 172.21.15.17:0/87160131 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:42:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.701+0000 7f67f0df4640 1 --2- 172.21.15.17:0/87160131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67ec074eb0 0x7f67ec19e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.701+0000 7f67f15f5640 1 -- 172.21.15.17:0/87160131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67ec074eb0 msgr2=0x7f67ec19e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.701+0000 7f67f15f5640 1 --2- 172.21.15.17:0/87160131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67ec074eb0 0x7f67ec19e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:28.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.701+0000 7f67f15f5640 1 -- 172.21.15.17:0/87160131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ec1a28f0 con 0x7f67ec074590 2024-09-20T18:42:28.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.702+0000 7f67f15f5640 1 --2- 172.21.15.17:0/87160131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67ec074590 0x7f67ec19e020 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f67e800e970 tx=0x7f67e800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:42:28.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.702+0000 7f67e27fc640 1 -- 172.21.15.17:0/87160131 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67e800cac0 con 0x7f67ec074590 2024-09-20T18:42:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.702+0000 7f67f3859640 1 -- 172.21.15.17:0/87160131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67ec1a2be0 con 0x7f67ec074590 2024-09-20T18:42:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.702+0000 7f67e27fc640 1 -- 172.21.15.17:0/87160131 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f67e80054e0 con 0x7f67ec074590 2024-09-20T18:42:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.702+0000 7f67e27fc640 1 -- 172.21.15.17:0/87160131 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67e8010430 con 0x7f67ec074590 2024-09-20T18:42:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.702+0000 7f67f3859640 1 -- 172.21.15.17:0/87160131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67ec1a3170 con 0x7f67ec074590 2024-09-20T18:42:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.703+0000 7f67f3859640 1 -- 172.21.15.17:0/87160131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67ec075cd0 con 0x7f67ec074590 2024-09-20T18:42:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.704+0000 7f67e27fc640 1 -- 172.21.15.17:0/87160131 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f67e8004e80 con 0x7f67ec074590 2024-09-20T18:42:28.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.705+0000 7f67e27fc640 1 --2- 172.21.15.17:0/87160131 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f67d807af30 0x7f67d807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:28.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.705+0000 7f67e27fc640 1 -- 172.21.15.17:0/87160131 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5984+0+0 (secure 0 0 0) 0x7f67e809e780 con 0x7f67ec074590 2024-09-20T18:42:28.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.705+0000 7f67f0df4640 1 --2- 172.21.15.17:0/87160131 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f67d807af30 0x7f67d807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:28.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.705+0000 7f67f0df4640 1 --2- 172.21.15.17:0/87160131 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f67d807af30 0x7f67d807d3f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f67ec104860 tx=0x7f67dc031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:42:28.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.708+0000 7f67e27fc640 1 -- 172.21.15.17:0/87160131 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67e8069eb0 con 0x7f67ec074590 2024-09-20T18:42:28.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.918+0000 7f67f3859640 1 -- 172.21.15.17:0/87160131 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f67ec1a3480 con 0x7f67d807af30 2024-09-20T18:42:28.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.920+0000 7f67e27fc640 1 -- 172.21.15.17:0/87160131 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f67ec1a3480 con 0x7f67d807af30 2024-09-20T18:42:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.922+0000 7f67f3859640 1 -- 172.21.15.17:0/87160131 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f67d807af30 msgr2=0x7f67d807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.922+0000 7f67f3859640 1 --2- 172.21.15.17:0/87160131 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f67d807af30 0x7f67d807d3f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f67ec104860 tx=0x7f67dc031400 comp rx=0 tx=0).stop 2024-09-20T18:42:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.922+0000 7f67f3859640 1 -- 172.21.15.17:0/87160131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67ec074590 msgr2=0x7f67ec19e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.922+0000 7f67f3859640 1 --2- 172.21.15.17:0/87160131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67ec074590 0x7f67ec19e020 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f67e800e970 tx=0x7f67e800ed70 comp rx=0 tx=0).stop 2024-09-20T18:42:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.922+0000 7f67f3859640 1 -- 172.21.15.17:0/87160131 shutdown_connections 2024-09-20T18:42:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.922+0000 7f67f3859640 1 --2- 172.21.15.17:0/87160131 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f67d807af30 0x7f67d807d3f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.922+0000 7f67f3859640 1 --2- 172.21.15.17:0/87160131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67ec074eb0 0x7f67ec19e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.922+0000 7f67f3859640 1 --2- 172.21.15.17:0/87160131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67ec074590 0x7f67ec19e020 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.922+0000 7f67f3859640 1 -- 172.21.15.17:0/87160131 >> 172.21.15.17:0/87160131 conn(0x7f67ec0fd600 msgr2=0x7f67ec104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:42:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.922+0000 7f67f3859640 1 -- 172.21.15.17:0/87160131 shutdown_connections 2024-09-20T18:42:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:28.922+0000 7f67f3859640 1 -- 172.21.15.17:0/87160131 wait complete. 2024-09-20T18:42:28.947 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:42:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.008+0000 7f5f5d92b640 1 -- 172.21.15.17:0/2781085191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f58101900 msgr2=0x7f5f58101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.008+0000 7f5f5d92b640 1 --2- 172.21.15.17:0/2781085191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f58101900 0x7f5f58101d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009880 tx=0x7f5f4c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.008+0000 7f5f5d92b640 1 -- 172.21.15.17:0/2781085191 shutdown_connections 2024-09-20T18:42:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.008+0000 7f5f5d92b640 1 --2- 172.21.15.17:0/2781085191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f58101900 0x7f5f58101d60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.008+0000 7f5f5d92b640 1 --2- 172.21.15.17:0/2781085191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f58107900 0x7f5f58107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.008+0000 7f5f5d92b640 1 -- 172.21.15.17:0/2781085191 >> 172.21.15.17:0/2781085191 conn(0x7f5f580fd600 msgr2=0x7f5f580ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:42:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.008+0000 7f5f5d92b640 1 -- 172.21.15.17:0/2781085191 shutdown_connections 2024-09-20T18:42:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.008+0000 7f5f5d92b640 1 -- 172.21.15.17:0/2781085191 wait complete. 2024-09-20T18:42:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.009+0000 7f5f5d92b640 1 Processor -- start 2024-09-20T18:42:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.009+0000 7f5f5d92b640 1 -- start start 2024-09-20T18:42:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.009+0000 7f5f5d92b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f58101900 0x7f5f5819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.009+0000 7f5f5d92b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f58107900 0x7f5f5819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.009+0000 7f5f5d92b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5810edd0 con 0x7f5f58101900 2024-09-20T18:42:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.009+0000 7f5f5d92b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5810ec50 con 0x7f5f58107900 2024-09-20T18:42:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.009+0000 7f5f56ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f58101900 0x7f5f5819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.009+0000 7f5f56ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f58101900 0x7f5f5819d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56736/0 (socket says 172.21.15.17:56736) 2024-09-20T18:42:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.009+0000 7f5f56ffd640 1 -- 172.21.15.17:0/518267907 learned_addr learned my addr 172.21.15.17:0/518267907 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:42:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.009+0000 7f5f567fc640 1 --2- 172.21.15.17:0/518267907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f58107900 0x7f5f5819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.010+0000 7f5f56ffd640 1 -- 172.21.15.17:0/518267907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f58107900 msgr2=0x7f5f5819db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.010+0000 7f5f56ffd640 1 --2- 172.21.15.17:0/518267907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f58107900 0x7f5f5819db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.010+0000 7f5f56ffd640 1 -- 172.21.15.17:0/518267907 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f581977a0 con 0x7f5f58101900 2024-09-20T18:42:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.010+0000 7f5f56ffd640 1 --2- 172.21.15.17:0/518267907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f58101900 0x7f5f5819d620 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800e970 tx=0x7f5f4800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:42:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.010+0000 7f5f5c929640 1 -- 172.21.15.17:0/518267907 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f4800cac0 con 0x7f5f58101900 2024-09-20T18:42:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.010+0000 7f5f5c929640 1 -- 172.21.15.17:0/518267907 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5f480054e0 con 0x7f5f58101900 2024-09-20T18:42:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.010+0000 7f5f5c929640 1 -- 172.21.15.17:0/518267907 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f48010430 con 0x7f5f58101900 2024-09-20T18:42:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.010+0000 7f5f5d92b640 1 -- 172.21.15.17:0/518267907 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f58197a90 con 0x7f5f58101900 2024-09-20T18:42:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.010+0000 7f5f5d92b640 1 -- 172.21.15.17:0/518267907 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f58197ff0 con 0x7f5f58101900 2024-09-20T18:42:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.011+0000 7f5f5d92b640 1 -- 172.21.15.17:0/518267907 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f58103040 con 0x7f5f58101900 2024-09-20T18:42:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.012+0000 7f5f5c929640 1 -- 172.21.15.17:0/518267907 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5f48004e80 con 0x7f5f58101900 2024-09-20T18:42:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.012+0000 7f5f5c929640 1 --2- 172.21.15.17:0/518267907 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5f4007af30 0x7f5f4007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.013+0000 7f5f5c929640 1 -- 172.21.15.17:0/518267907 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5984+0+0 (secure 0 0 0) 0x7f5f4809e5a0 con 0x7f5f58101900 2024-09-20T18:42:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.013+0000 7f5f567fc640 1 --2- 172.21.15.17:0/518267907 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5f4007af30 0x7f5f4007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:29.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.013+0000 7f5f567fc640 1 --2- 172.21.15.17:0/518267907 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5f4007af30 0x7f5f4007d3f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5f58198af0 tx=0x7f5f4c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:42:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.017+0000 7f5f5c929640 1 -- 172.21.15.17:0/518267907 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5f48069c50 con 0x7f5f58101900 2024-09-20T18:42:29.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.221+0000 7f5f5d92b640 1 -- 172.21.15.17:0/518267907 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5f58198300 con 0x7f5f4007af30 2024-09-20T18:42:29.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.222+0000 7f5f5c929640 1 -- 172.21.15.17:0/518267907 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f5f58198300 con 0x7f5f4007af30 2024-09-20T18:42:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.224+0000 7f5f5d92b640 1 -- 172.21.15.17:0/518267907 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5f4007af30 msgr2=0x7f5f4007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.224+0000 7f5f5d92b640 1 --2- 172.21.15.17:0/518267907 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5f4007af30 0x7f5f4007d3f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5f58198af0 tx=0x7f5f4c031400 comp rx=0 tx=0).stop 2024-09-20T18:42:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.224+0000 7f5f5d92b640 1 -- 172.21.15.17:0/518267907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f58101900 msgr2=0x7f5f5819d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.224+0000 7f5f5d92b640 1 --2- 172.21.15.17:0/518267907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f58101900 0x7f5f5819d620 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800e970 tx=0x7f5f4800ed70 comp rx=0 tx=0).stop 2024-09-20T18:42:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.224+0000 7f5f5d92b640 1 -- 172.21.15.17:0/518267907 shutdown_connections 2024-09-20T18:42:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.224+0000 7f5f5d92b640 1 --2- 172.21.15.17:0/518267907 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5f4007af30 0x7f5f4007d3f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.224+0000 7f5f5d92b640 1 --2- 172.21.15.17:0/518267907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f58107900 0x7f5f5819db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.224+0000 7f5f5d92b640 1 --2- 172.21.15.17:0/518267907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f58101900 0x7f5f5819d620 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.224+0000 7f5f5d92b640 1 -- 172.21.15.17:0/518267907 >> 172.21.15.17:0/518267907 conn(0x7f5f580fd600 msgr2=0x7f5f580fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:42:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.224+0000 7f5f5d92b640 1 -- 172.21.15.17:0/518267907 shutdown_connections 2024-09-20T18:42:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.224+0000 7f5f5d92b640 1 -- 172.21.15.17:0/518267907 wait complete. 2024-09-20T18:42:29.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.309+0000 7fb6559b4640 1 -- 172.21.15.17:0/773771808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650100140 msgr2=0x7fb650100520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:29.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.309+0000 7fb6559b4640 1 --2- 172.21.15.17:0/773771808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650100140 0x7fb650100520 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb640009880 tx=0x7fb64002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.309+0000 7fb6559b4640 1 -- 172.21.15.17:0/773771808 shutdown_connections 2024-09-20T18:42:29.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.309+0000 7fb6559b4640 1 --2- 172.21.15.17:0/773771808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb650100af0 0x7fb650106630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.309+0000 7fb6559b4640 1 --2- 172.21.15.17:0/773771808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650100140 0x7fb650100520 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.309+0000 7fb6559b4640 1 -- 172.21.15.17:0/773771808 >> 172.21.15.17:0/773771808 conn(0x7fb6500fbc90 msgr2=0x7fb6500fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:42:29.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.309+0000 7fb6559b4640 1 -- 172.21.15.17:0/773771808 shutdown_connections 2024-09-20T18:42:29.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.309+0000 7fb6559b4640 1 -- 172.21.15.17:0/773771808 wait complete. 2024-09-20T18:42:29.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.310+0000 7fb6559b4640 1 Processor -- start 2024-09-20T18:42:29.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.310+0000 7fb6559b4640 1 -- start start 2024-09-20T18:42:29.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.310+0000 7fb6559b4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb650100140 0x7fb65019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:29.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.310+0000 7fb6559b4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650100af0 0x7fb65019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:29.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.310+0000 7fb6559b4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb65010ee40 con 0x7fb650100af0 2024-09-20T18:42:29.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.310+0000 7fb6559b4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb65010ecc0 con 0x7fb650100140 2024-09-20T18:42:29.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.310+0000 7fb6467fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650100af0 0x7fb65019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:29.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.311+0000 7fb6467fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650100af0 0x7fb65019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56752/0 (socket says 172.21.15.17:56752) 2024-09-20T18:42:29.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.311+0000 7fb6467fc640 1 -- 172.21.15.17:0/1146043460 learned_addr learned my addr 172.21.15.17:0/1146043460 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:42:29.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.311+0000 7fb64effd640 1 --2- 172.21.15.17:0/1146043460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb650100140 0x7fb65019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:29.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.311+0000 7fb6467fc640 1 -- 172.21.15.17:0/1146043460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb650100140 msgr2=0x7fb65019d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:29.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.311+0000 7fb6467fc640 1 --2- 172.21.15.17:0/1146043460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb650100140 0x7fb65019d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.311+0000 7fb6467fc640 1 -- 172.21.15.17:0/1146043460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6501977b0 con 0x7fb650100af0 2024-09-20T18:42:29.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.311+0000 7fb6467fc640 1 --2- 172.21.15.17:0/1146043460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650100af0 0x7fb65019db70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb63800c8f0 tx=0x7fb63800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:42:29.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.311+0000 7fb6549b2640 1 -- 172.21.15.17:0/1146043460 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb638014070 con 0x7fb650100af0 2024-09-20T18:42:29.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.311+0000 7fb6559b4640 1 -- 172.21.15.17:0/1146043460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb650197aa0 con 0x7fb650100af0 2024-09-20T18:42:29.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.311+0000 7fb6549b2640 1 -- 172.21.15.17:0/1146043460 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb638007c60 con 0x7fb650100af0 2024-09-20T18:42:29.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.311+0000 7fb6559b4640 1 -- 172.21.15.17:0/1146043460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb650198030 con 0x7fb650100af0 2024-09-20T18:42:29.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.311+0000 7fb6549b2640 1 -- 172.21.15.17:0/1146043460 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb638003c30 con 0x7fb650100af0 2024-09-20T18:42:29.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.313+0000 7fb6559b4640 1 -- 172.21.15.17:0/1146043460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb630005290 con 0x7fb650100af0 2024-09-20T18:42:29.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.313+0000 7fb6549b2640 1 -- 172.21.15.17:0/1146043460 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb638017070 con 0x7fb650100af0 2024-09-20T18:42:29.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.314+0000 7fb6549b2640 1 --2- 172.21.15.17:0/1146043460 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb63c07af80 0x7fb63c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:29.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.314+0000 7fb6549b2640 1 -- 172.21.15.17:0/1146043460 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5984+0+0 (secure 0 0 0) 0x7fb63809db30 con 0x7fb650100af0 2024-09-20T18:42:29.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.314+0000 7fb64effd640 1 --2- 172.21.15.17:0/1146043460 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb63c07af80 0x7fb63c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:29.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.314+0000 7fb64effd640 1 --2- 172.21.15.17:0/1146043460 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb63c07af80 0x7fb63c07d440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb6400096c0 tx=0x7fb640031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:42:29.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.318+0000 7fb6549b2640 1 -- 172.21.15.17:0/1146043460 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb6380691e0 con 0x7fb650100af0 2024-09-20T18:42:29.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.514+0000 7fb6559b4640 1 -- 172.21.15.17:0/1146043460 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb630000bc0 con 0x7fb63c07af80 2024-09-20T18:42:29.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.524+0000 7fb6549b2640 1 -- 172.21.15.17:0/1146043460 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fb630000bc0 con 0x7fb63c07af80 2024-09-20T18:42:29.540 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:42:29.540 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (3m) 22s ago 14m 19.8M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:42:29.540 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (6m) 22s ago 15m 9042k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:42:29.540 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (6m) 2m ago 14m 8644k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:42:29.540 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (2m) 22s ago 15m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:42:29.540 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (2m) 2m ago 14m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:42:29.540 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (3m) 22s ago 14m 80.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:42:29.540 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (9m) 22s ago 9m 148M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:42:29.540 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (9m) 22s ago 9m 95.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:42:29.540 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (9m) 2m ago 9m 26.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:42:29.541 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (9m) 2m ago 9m 26.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:42:29.541 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (6m) 22s ago 16m 525M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:42:29.541 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (5m) 2m ago 14m 457M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:42:29.541 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (2m) 22s ago 16m 42.3M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:42:29.541 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (2m) 2m ago 13m 27.1M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:42:29.541 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (4m) 22s ago 14m 11.4M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:42:29.541 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (4m) 2m ago 14m 11.3M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:42:29.541 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (104s) 22s ago 12m 82.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:42:29.541 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (66s) 22s ago 12m 87.9M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:42:29.541 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (28s) 22s ago 11m 12.2M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:42:29.541 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (11m) 2m ago 11m 262M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 5e0e99e76e72 2024-09-20T18:42:29.541 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (11m) 2m ago 11m 208M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:42:29.541 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (10m) 2m ago 10m 190M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:42:29.542 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (4m) 22s ago 14m 53.2M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:42:29.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.527+0000 7fb6559b4640 1 -- 172.21.15.17:0/1146043460 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb63c07af80 msgr2=0x7fb63c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:29.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.527+0000 7fb6559b4640 1 --2- 172.21.15.17:0/1146043460 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb63c07af80 0x7fb63c07d440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb6400096c0 tx=0x7fb640031400 comp rx=0 tx=0).stop 2024-09-20T18:42:29.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.527+0000 7fb6559b4640 1 -- 172.21.15.17:0/1146043460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650100af0 msgr2=0x7fb65019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:29.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.527+0000 7fb6559b4640 1 --2- 172.21.15.17:0/1146043460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650100af0 0x7fb65019db70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb63800c8f0 tx=0x7fb63800cdb0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.527+0000 7fb6559b4640 1 -- 172.21.15.17:0/1146043460 shutdown_connections 2024-09-20T18:42:29.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.527+0000 7fb6559b4640 1 --2- 172.21.15.17:0/1146043460 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb63c07af80 0x7fb63c07d440 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.527+0000 7fb6559b4640 1 --2- 172.21.15.17:0/1146043460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650100af0 0x7fb65019db70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.527+0000 7fb6559b4640 1 --2- 172.21.15.17:0/1146043460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb650100140 0x7fb65019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.527+0000 7fb6559b4640 1 -- 172.21.15.17:0/1146043460 >> 172.21.15.17:0/1146043460 conn(0x7fb6500fbc90 msgr2=0x7fb650105850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:42:29.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.527+0000 7fb6559b4640 1 -- 172.21.15.17:0/1146043460 shutdown_connections 2024-09-20T18:42:29.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.527+0000 7fb6559b4640 1 -- 172.21.15.17:0/1146043460 wait complete. 2024-09-20T18:42:29.582 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:29 smithi172 ceph-mon[80431]: pgmap v194: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:42:29.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.610+0000 7f76b9f8d640 1 -- 172.21.15.17:0/3595164655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76b4102ab0 msgr2=0x7f76b4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:29.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.610+0000 7f76b9f8d640 1 --2- 172.21.15.17:0/3595164655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76b4102ab0 0x7f76b4102e90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f76a4009c20 tx=0x7f76a402aa00 comp rx=0 tx=0).stop 2024-09-20T18:42:29.627 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:29 smithi017 ceph-mon[108970]: pgmap v194: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-20T18:42:29.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.611+0000 7f76b9f8d640 1 -- 172.21.15.17:0/3595164655 shutdown_connections 2024-09-20T18:42:29.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.611+0000 7f76b9f8d640 1 --2- 172.21.15.17:0/3595164655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76b41033d0 0x7f76b410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.611+0000 7f76b9f8d640 1 --2- 172.21.15.17:0/3595164655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76b4102ab0 0x7f76b4102e90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.611+0000 7f76b9f8d640 1 -- 172.21.15.17:0/3595164655 >> 172.21.15.17:0/3595164655 conn(0x7f76b40fc550 msgr2=0x7f76b40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:42:29.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.611+0000 7f76b9f8d640 1 -- 172.21.15.17:0/3595164655 shutdown_connections 2024-09-20T18:42:29.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.611+0000 7f76b9f8d640 1 -- 172.21.15.17:0/3595164655 wait complete. 2024-09-20T18:42:29.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.611+0000 7f76b9f8d640 1 Processor -- start 2024-09-20T18:42:29.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.612+0000 7f76b9f8d640 1 -- start start 2024-09-20T18:42:29.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.612+0000 7f76b9f8d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76b4102ab0 0x7f76b4100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:29.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.612+0000 7f76b9f8d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76b41033d0 0x7f76b4100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:29.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.612+0000 7f76b9f8d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f76b410edc0 con 0x7f76b4102ab0 2024-09-20T18:42:29.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.612+0000 7f76b9f8d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f76b410ec40 con 0x7f76b41033d0 2024-09-20T18:42:29.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.612+0000 7f76b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76b4102ab0 0x7f76b4100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:29.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.612+0000 7f76b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76b4102ab0 0x7f76b4100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56762/0 (socket says 172.21.15.17:56762) 2024-09-20T18:42:29.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.612+0000 7f76b37fe640 1 -- 172.21.15.17:0/3093724862 learned_addr learned my addr 172.21.15.17:0/3093724862 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:42:29.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.612+0000 7f76b2ffd640 1 --2- 172.21.15.17:0/3093724862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76b41033d0 0x7f76b4100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:29.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.612+0000 7f76b37fe640 1 -- 172.21.15.17:0/3093724862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76b41033d0 msgr2=0x7f76b4100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:29.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.612+0000 7f76b37fe640 1 --2- 172.21.15.17:0/3093724862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76b41033d0 0x7f76b4100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.612+0000 7f76b37fe640 1 -- 172.21.15.17:0/3093724862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b4101190 con 0x7f76b4102ab0 2024-09-20T18:42:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.613+0000 7f76b37fe640 1 --2- 172.21.15.17:0/3093724862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76b4102ab0 0x7f76b4100710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f76a4006010 tx=0x7f76a402ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:42:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.613+0000 7f76b0ff9640 1 -- 172.21.15.17:0/3093724862 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76a4047070 con 0x7f76b4102ab0 2024-09-20T18:42:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.613+0000 7f76b9f8d640 1 -- 172.21.15.17:0/3093724862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b4101420 con 0x7f76b4102ab0 2024-09-20T18:42:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.613+0000 7f76b0ff9640 1 -- 172.21.15.17:0/3093724862 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76a4003e30 con 0x7f76b4102ab0 2024-09-20T18:42:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.613+0000 7f76b0ff9640 1 -- 172.21.15.17:0/3093724862 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76a4033050 con 0x7f76b4102ab0 2024-09-20T18:42:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.613+0000 7f76b9f8d640 1 -- 172.21.15.17:0/3093724862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b41a3d70 con 0x7f76b4102ab0 2024-09-20T18:42:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.614+0000 7f76b9f8d640 1 -- 172.21.15.17:0/3093724862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b406a580 con 0x7f76b4102ab0 2024-09-20T18:42:29.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.615+0000 7f76b0ff9640 1 -- 172.21.15.17:0/3093724862 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f76a404a070 con 0x7f76b4102ab0 2024-09-20T18:42:29.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.615+0000 7f76b0ff9640 1 --2- 172.21.15.17:0/3093724862 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f769c07af90 0x7f769c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:29.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.616+0000 7f76b2ffd640 1 --2- 172.21.15.17:0/3093724862 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f769c07af90 0x7f769c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:29.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.616+0000 7f76b0ff9640 1 -- 172.21.15.17:0/3093724862 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5984+0+0 (secure 0 0 0) 0x7f76a403e030 con 0x7f76b4102ab0 2024-09-20T18:42:29.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.616+0000 7f76b2ffd640 1 --2- 172.21.15.17:0/3093724862 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f769c07af90 0x7f769c07d450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76b41021a0 tx=0x7f76a800b360 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:42:29.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.620+0000 7f76b0ff9640 1 -- 172.21.15.17:0/3093724862 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f76a402ee90 con 0x7f76b4102ab0 2024-09-20T18:42:29.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.884+0000 7f76b9f8d640 1 -- 172.21.15.17:0/3093724862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f76b4105f80 con 0x7f76b4102ab0 2024-09-20T18:42:29.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.884+0000 7f76b0ff9640 1 -- 172.21.15.17:0/3093724862 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f76a408a5a0 con 0x7f76b4102ab0 2024-09-20T18:42:29.900 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:42:29.900 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:42:29.900 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:42:29.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:42:29.900 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:42:29.900 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:42:29.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:42:29.900 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:42:29.900 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 3, 2024-09-20T18:42:29.900 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:42:29.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:42:29.901 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:42:29.901 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:42:29.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:42:29.901 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:42:29.901 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 7, 2024-09-20T18:42:29.901 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 7 2024-09-20T18:42:29.901 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:42:29.901 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:42:29.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.886+0000 7f76b9f8d640 1 -- 172.21.15.17:0/3093724862 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f769c07af90 msgr2=0x7f769c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:29.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.886+0000 7f76b9f8d640 1 --2- 172.21.15.17:0/3093724862 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f769c07af90 0x7f769c07d450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76b41021a0 tx=0x7f76a800b360 comp rx=0 tx=0).stop 2024-09-20T18:42:29.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.886+0000 7f76b9f8d640 1 -- 172.21.15.17:0/3093724862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76b4102ab0 msgr2=0x7f76b4100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:29.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.886+0000 7f76b9f8d640 1 --2- 172.21.15.17:0/3093724862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76b4102ab0 0x7f76b4100710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f76a4006010 tx=0x7f76a402ed20 comp rx=0 tx=0).stop 2024-09-20T18:42:29.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.886+0000 7f76b9f8d640 1 -- 172.21.15.17:0/3093724862 shutdown_connections 2024-09-20T18:42:29.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.886+0000 7f76b9f8d640 1 --2- 172.21.15.17:0/3093724862 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f769c07af90 0x7f769c07d450 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.886+0000 7f76b9f8d640 1 --2- 172.21.15.17:0/3093724862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76b41033d0 0x7f76b4100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.886+0000 7f76b9f8d640 1 --2- 172.21.15.17:0/3093724862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76b4102ab0 0x7f76b4100710 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.886+0000 7f76b9f8d640 1 -- 172.21.15.17:0/3093724862 >> 172.21.15.17:0/3093724862 conn(0x7f76b40fc550 msgr2=0x7f76b4108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:42:29.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.886+0000 7f76b9f8d640 1 -- 172.21.15.17:0/3093724862 shutdown_connections 2024-09-20T18:42:29.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.886+0000 7f76b9f8d640 1 -- 172.21.15.17:0/3093724862 wait complete. 2024-09-20T18:42:29.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.971+0000 7f6bdee05640 1 -- 172.21.15.17:0/554461535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bd8101900 msgr2=0x7f6bd8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:29.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.971+0000 7f6bdee05640 1 --2- 172.21.15.17:0/554461535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bd8101900 0x7f6bd8101d60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009880 tx=0x7f6bc002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.971+0000 7f6bdee05640 1 -- 172.21.15.17:0/554461535 shutdown_connections 2024-09-20T18:42:29.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.971+0000 7f6bdee05640 1 --2- 172.21.15.17:0/554461535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bd8101900 0x7f6bd8101d60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.971+0000 7f6bdee05640 1 --2- 172.21.15.17:0/554461535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bd8107900 0x7f6bd8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.971+0000 7f6bdee05640 1 -- 172.21.15.17:0/554461535 >> 172.21.15.17:0/554461535 conn(0x7f6bd80fd600 msgr2=0x7f6bd80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:42:29.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.971+0000 7f6bdee05640 1 -- 172.21.15.17:0/554461535 shutdown_connections 2024-09-20T18:42:29.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.971+0000 7f6bdee05640 1 -- 172.21.15.17:0/554461535 wait complete. 2024-09-20T18:42:29.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.971+0000 7f6bdee05640 1 Processor -- start 2024-09-20T18:42:29.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.971+0000 7f6bdee05640 1 -- start start 2024-09-20T18:42:29.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.972+0000 7f6bdee05640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bd8101900 0x7f6bd819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:29.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.972+0000 7f6bdee05640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bd8107900 0x7f6bd819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:29.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.972+0000 7f6bdee05640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd810edb0 con 0x7f6bd8101900 2024-09-20T18:42:29.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.972+0000 7f6bdee05640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd810ec30 con 0x7f6bd8107900 2024-09-20T18:42:29.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.972+0000 7f6bdcba1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bd8101900 0x7f6bd819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:29.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.972+0000 7f6bdcba1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bd8101900 0x7f6bd819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56776/0 (socket says 172.21.15.17:56776) 2024-09-20T18:42:29.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.972+0000 7f6bdcba1640 1 -- 172.21.15.17:0/2239443989 learned_addr learned my addr 172.21.15.17:0/2239443989 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:42:29.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.972+0000 7f6bd7fff640 1 --2- 172.21.15.17:0/2239443989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bd8107900 0x7f6bd819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:29.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.972+0000 7f6bdcba1640 1 -- 172.21.15.17:0/2239443989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bd8107900 msgr2=0x7f6bd819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:29.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.972+0000 7f6bdcba1640 1 --2- 172.21.15.17:0/2239443989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bd8107900 0x7f6bd819dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:29.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.972+0000 7f6bdcba1640 1 -- 172.21.15.17:0/2239443989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd8197800 con 0x7f6bd8101900 2024-09-20T18:42:29.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.972+0000 7f6bdcba1640 1 --2- 172.21.15.17:0/2239443989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bd8101900 0x7f6bd819d680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800d8d0 tx=0x7f6bc800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:42:29.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.972+0000 7f6bd5ffb640 1 -- 172.21.15.17:0/2239443989 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6bc8017030 con 0x7f6bd8101900 2024-09-20T18:42:29.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.973+0000 7f6bd5ffb640 1 -- 172.21.15.17:0/2239443989 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6bc8004020 con 0x7f6bd8101900 2024-09-20T18:42:29.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.973+0000 7f6bdee05640 1 -- 172.21.15.17:0/2239443989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd8197af0 con 0x7f6bd8101900 2024-09-20T18:42:29.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.973+0000 7f6bd5ffb640 1 -- 172.21.15.17:0/2239443989 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6bc80047a0 con 0x7f6bd8101900 2024-09-20T18:42:29.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.973+0000 7f6bdee05640 1 -- 172.21.15.17:0/2239443989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd8198050 con 0x7f6bd8101900 2024-09-20T18:42:29.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.974+0000 7f6bdee05640 1 -- 172.21.15.17:0/2239443989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bd8103040 con 0x7f6bd8101900 2024-09-20T18:42:29.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.974+0000 7f6bd5ffb640 1 -- 172.21.15.17:0/2239443989 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6bc80041d0 con 0x7f6bd8101900 2024-09-20T18:42:29.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.975+0000 7f6bd5ffb640 1 --2- 172.21.15.17:0/2239443989 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6bc407af30 0x7f6bc407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:29.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.975+0000 7f6bd5ffb640 1 -- 172.21.15.17:0/2239443989 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5984+0+0 (secure 0 0 0) 0x7f6bc8018070 con 0x7f6bd8101900 2024-09-20T18:42:29.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.975+0000 7f6bd7fff640 1 --2- 172.21.15.17:0/2239443989 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6bc407af30 0x7f6bc407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:29.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.975+0000 7f6bd7fff640 1 --2- 172.21.15.17:0/2239443989 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6bc407af30 0x7f6bc407d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8198b50 tx=0x7f6bc0031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:42:29.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:29.979+0000 7f6bd5ffb640 1 -- 172.21.15.17:0/2239443989 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6bc8069350 con 0x7f6bd8101900 2024-09-20T18:42:30.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.205+0000 7f6bdee05640 1 -- 172.21.15.17:0/2239443989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6bd8109e90 con 0x7f6bd8101900 2024-09-20T18:42:30.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.206+0000 7f6bd5ffb640 1 -- 172.21.15.17:0/2239443989 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2043 (secure 0 0 0) 0x7f6bc806e200 con 0x7f6bd8101900 2024-09-20T18:42:30.222 INFO:teuthology.orchestra.run.smithi017.stdout:e15 2024-09-20T18:42:30.222 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:33:05:524203+0000 2024-09-20T18:42:30.222 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:42:30.222 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:42:30.222 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:42:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:42:30.222 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:42:30.222 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:42:30.222 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 15 2024-09-20T18:42:30.222 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T18:42:30.222 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:42:30.222 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:33:05.065474+0000 2024-09-20T18:42:30.223 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:42:30.223 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:42:30.223 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:42:30.223 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:42:30.223 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:42:30.223 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:42:30.223 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:42:30.223 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:42:30.223 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2024-09-20T18:42:30.223 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:42:30.223 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:42:30.223 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:42:30.224 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14552,1=24325} 2024-09-20T18:42:30.224 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-09-20T18:42:30.224 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:42:30.224 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:42:30.224 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:42:30.224 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:42:30.224 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:42:30.224 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:42:30.224 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:42:30.224 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:42:30.224 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 14552 members: 24325,14552 2024-09-20T18:42:30.224 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{0:14552} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.17:6826/3360305779,v1:172.21.15.17:6827/3360305779] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:42:30.224 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{0:14568} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.17:6828/53113052,v1:172.21.15.17:6829/53113052] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:42:30.224 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{1:24325} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.172:6824/1043027893,v1:172.21.15.172:6825/1043027893] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:42:30.224 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{1:24339} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/2975309540,v1:172.21.15.172:6827/2975309540] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:42:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:42:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:42:30.225 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 15 2024-09-20T18:42:30.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.208+0000 7f6bdee05640 1 -- 172.21.15.17:0/2239443989 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6bc407af30 msgr2=0x7f6bc407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:30.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.208+0000 7f6bdee05640 1 --2- 172.21.15.17:0/2239443989 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6bc407af30 0x7f6bc407d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8198b50 tx=0x7f6bc0031400 comp rx=0 tx=0).stop 2024-09-20T18:42:30.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.208+0000 7f6bdee05640 1 -- 172.21.15.17:0/2239443989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bd8101900 msgr2=0x7f6bd819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:30.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.208+0000 7f6bdee05640 1 --2- 172.21.15.17:0/2239443989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bd8101900 0x7f6bd819d680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800d8d0 tx=0x7f6bc800dd90 comp rx=0 tx=0).stop 2024-09-20T18:42:30.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.208+0000 7f6bdee05640 1 -- 172.21.15.17:0/2239443989 shutdown_connections 2024-09-20T18:42:30.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.208+0000 7f6bdee05640 1 --2- 172.21.15.17:0/2239443989 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6bc407af30 0x7f6bc407d3f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.208+0000 7f6bdee05640 1 --2- 172.21.15.17:0/2239443989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bd8107900 0x7f6bd819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.208+0000 7f6bdee05640 1 --2- 172.21.15.17:0/2239443989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bd8101900 0x7f6bd819d680 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.208+0000 7f6bdee05640 1 -- 172.21.15.17:0/2239443989 >> 172.21.15.17:0/2239443989 conn(0x7f6bd80fd600 msgr2=0x7f6bd80fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:42:30.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.208+0000 7f6bdee05640 1 -- 172.21.15.17:0/2239443989 shutdown_connections 2024-09-20T18:42:30.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.208+0000 7f6bdee05640 1 -- 172.21.15.17:0/2239443989 wait complete. 2024-09-20T18:42:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.293+0000 7f06e0e8b640 1 -- 172.21.15.17:0/990955600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc107900 msgr2=0x7f06dc107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.293+0000 7f06e0e8b640 1 --2- 172.21.15.17:0/990955600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc107900 0x7f06dc107ce0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009880 tx=0x7f06cc02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.293+0000 7f06e0e8b640 1 -- 172.21.15.17:0/990955600 shutdown_connections 2024-09-20T18:42:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.293+0000 7f06e0e8b640 1 --2- 172.21.15.17:0/990955600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06dc101900 0x7f06dc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.293+0000 7f06e0e8b640 1 --2- 172.21.15.17:0/990955600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc107900 0x7f06dc107ce0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.293+0000 7f06e0e8b640 1 -- 172.21.15.17:0/990955600 >> 172.21.15.17:0/990955600 conn(0x7f06dc0fd600 msgr2=0x7f06dc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:42:30.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.293+0000 7f06e0e8b640 1 -- 172.21.15.17:0/990955600 shutdown_connections 2024-09-20T18:42:30.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.293+0000 7f06e0e8b640 1 -- 172.21.15.17:0/990955600 wait complete. 2024-09-20T18:42:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.294+0000 7f06e0e8b640 1 Processor -- start 2024-09-20T18:42:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.294+0000 7f06e0e8b640 1 -- start start 2024-09-20T18:42:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.294+0000 7f06e0e8b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc101900 0x7f06dc19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.294+0000 7f06e0e8b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06dc107900 0x7f06dc19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.294+0000 7f06e0e8b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc10edd0 con 0x7f06dc101900 2024-09-20T18:42:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.294+0000 7f06e0e8b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc10ec50 con 0x7f06dc107900 2024-09-20T18:42:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.295+0000 7f06da59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc101900 0x7f06dc19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.295+0000 7f06da59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc101900 0x7f06dc19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56802/0 (socket says 172.21.15.17:56802) 2024-09-20T18:42:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.295+0000 7f06da59c640 1 -- 172.21.15.17:0/4000588622 learned_addr learned my addr 172.21.15.17:0/4000588622 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:42:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.295+0000 7f06d9d9b640 1 --2- 172.21.15.17:0/4000588622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06dc107900 0x7f06dc19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.295+0000 7f06da59c640 1 -- 172.21.15.17:0/4000588622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06dc107900 msgr2=0x7f06dc19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.295+0000 7f06da59c640 1 --2- 172.21.15.17:0/4000588622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06dc107900 0x7f06dc19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.295+0000 7f06da59c640 1 -- 172.21.15.17:0/4000588622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06dc1977c0 con 0x7f06dc101900 2024-09-20T18:42:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.295+0000 7f06da59c640 1 --2- 172.21.15.17:0/4000588622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc101900 0x7f06dc19d640 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f06cc031460 tx=0x7f06cc004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:42:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.295+0000 7f06cb7fe640 1 -- 172.21.15.17:0/4000588622 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06cc03f070 con 0x7f06dc101900 2024-09-20T18:42:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.295+0000 7f06e0e8b640 1 -- 172.21.15.17:0/4000588622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06dc197a50 con 0x7f06dc101900 2024-09-20T18:42:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.295+0000 7f06cb7fe640 1 -- 172.21.15.17:0/4000588622 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06cc0035f0 con 0x7f06dc101900 2024-09-20T18:42:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.295+0000 7f06cb7fe640 1 -- 172.21.15.17:0/4000588622 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06cc035030 con 0x7f06dc101900 2024-09-20T18:42:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.295+0000 7f06e0e8b640 1 -- 172.21.15.17:0/4000588622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06dc197f80 con 0x7f06dc101900 2024-09-20T18:42:30.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.296+0000 7f06e0e8b640 1 -- 172.21.15.17:0/4000588622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06dc103040 con 0x7f06dc101900 2024-09-20T18:42:30.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.297+0000 7f06cb7fe640 1 -- 172.21.15.17:0/4000588622 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f06cc042070 con 0x7f06dc101900 2024-09-20T18:42:30.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.297+0000 7f06cb7fe640 1 --2- 172.21.15.17:0/4000588622 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06c407af80 0x7f06c407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:30.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.298+0000 7f06cb7fe640 1 -- 172.21.15.17:0/4000588622 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5984+0+0 (secure 0 0 0) 0x7f06cc0be780 con 0x7f06dc101900 2024-09-20T18:42:30.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.298+0000 7f06d9d9b640 1 --2- 172.21.15.17:0/4000588622 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06c407af80 0x7f06c407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:30.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.298+0000 7f06d9d9b640 1 --2- 172.21.15.17:0/4000588622 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06c407af80 0x7f06c407d440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0ffbf0 tx=0x7f06d0005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:42:30.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.302+0000 7f06cb7fe640 1 -- 172.21.15.17:0/4000588622 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f06cc089eb0 con 0x7f06dc101900 2024-09-20T18:42:30.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.506+0000 7f06e0e8b640 1 -- 172.21.15.17:0/4000588622 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f06dc1982f0 con 0x7f06c407af80 2024-09-20T18:42:30.522 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:30 smithi017 ceph-mon[108970]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:42:30.522 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:30 smithi017 ceph-mon[108970]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:42:30.523 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:30 smithi017 ceph-mon[108970]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:42:30.523 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:30 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3093724862' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:42:30.523 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:30 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2239443989' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:42:30.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.508+0000 7f06cb7fe640 1 -- 172.21.15.17:0/4000588622 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f06dc1982f0 con 0x7f06c407af80 2024-09-20T18:42:30.523 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:42:30.523 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:42:30.523 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:42:30.524 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:42:30.524 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:42:30.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:42:30.524 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:42:30.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:42:30.524 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:42:30.524 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "9/23 daemons upgraded", 2024-09-20T18:42:30.524 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T18:42:30.524 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:42:30.524 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:42:30.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.510+0000 7f06e0e8b640 1 -- 172.21.15.17:0/4000588622 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06c407af80 msgr2=0x7f06c407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.510+0000 7f06e0e8b640 1 --2- 172.21.15.17:0/4000588622 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06c407af80 0x7f06c407d440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f06dc0ffbf0 tx=0x7f06d0005f90 comp rx=0 tx=0).stop 2024-09-20T18:42:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.510+0000 7f06e0e8b640 1 -- 172.21.15.17:0/4000588622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc101900 msgr2=0x7f06dc19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.510+0000 7f06e0e8b640 1 --2- 172.21.15.17:0/4000588622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc101900 0x7f06dc19d640 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f06cc031460 tx=0x7f06cc004530 comp rx=0 tx=0).stop 2024-09-20T18:42:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.510+0000 7f06e0e8b640 1 -- 172.21.15.17:0/4000588622 shutdown_connections 2024-09-20T18:42:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.510+0000 7f06e0e8b640 1 --2- 172.21.15.17:0/4000588622 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06c407af80 0x7f06c407d440 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.510+0000 7f06e0e8b640 1 --2- 172.21.15.17:0/4000588622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06dc107900 0x7f06dc19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.510+0000 7f06e0e8b640 1 --2- 172.21.15.17:0/4000588622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc101900 0x7f06dc19d640 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.510+0000 7f06e0e8b640 1 -- 172.21.15.17:0/4000588622 >> 172.21.15.17:0/4000588622 conn(0x7f06dc0fd600 msgr2=0x7f06dc0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:42:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.510+0000 7f06e0e8b640 1 -- 172.21.15.17:0/4000588622 shutdown_connections 2024-09-20T18:42:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.510+0000 7f06e0e8b640 1 -- 172.21.15.17:0/4000588622 wait complete. 2024-09-20T18:42:30.546 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:30 smithi172 ceph-mon[80431]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:42:30.546 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:30 smithi172 ceph-mon[80431]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:42:30.546 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:30 smithi172 ceph-mon[80431]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:42:30.546 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:30 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3093724862' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:42:30.547 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:30 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2239443989' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:42:30.547 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:30 smithi172 systemd[1]: Stopping Ceph osd.3 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:42:30.547 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:30 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3[41389]: 2024-09-20T18:42:30.528+0000 7f1e1623e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T18:42:30.547 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:30 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3[41389]: 2024-09-20T18:42:30.528+0000 7f1e1623e640 -1 osd.3 61 *** Got signal Terminated *** 2024-09-20T18:42:30.547 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:30 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3[41389]: 2024-09-20T18:42:30.528+0000 7f1e1623e640 -1 osd.3 61 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T18:42:30.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.594+0000 7f662f8a5640 1 -- 172.21.15.17:0/2052838254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6628106800 msgr2=0x7f6628106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:30.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.594+0000 7f662f8a5640 1 --2- 172.21.15.17:0/2052838254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6628106800 0x7f6628106be0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6624009880 tx=0x7f662402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.594+0000 7f662f8a5640 1 -- 172.21.15.17:0/2052838254 shutdown_connections 2024-09-20T18:42:30.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.595+0000 7f662f8a5640 1 --2- 172.21.15.17:0/2052838254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6628100800 0x7f6628100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.595+0000 7f662f8a5640 1 --2- 172.21.15.17:0/2052838254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6628106800 0x7f6628106be0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.595+0000 7f662f8a5640 1 -- 172.21.15.17:0/2052838254 >> 172.21.15.17:0/2052838254 conn(0x7f66280fc520 msgr2=0x7f66280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:42:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.595+0000 7f662f8a5640 1 -- 172.21.15.17:0/2052838254 shutdown_connections 2024-09-20T18:42:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.595+0000 7f662f8a5640 1 -- 172.21.15.17:0/2052838254 wait complete. 2024-09-20T18:42:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.595+0000 7f662f8a5640 1 Processor -- start 2024-09-20T18:42:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.595+0000 7f662f8a5640 1 -- start start 2024-09-20T18:42:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.595+0000 7f662f8a5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6628100800 0x7f662819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.595+0000 7f662f8a5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6628106800 0x7f662819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.595+0000 7f662f8a5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f662810dcd0 con 0x7f6628106800 2024-09-20T18:42:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.595+0000 7f662f8a5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f662810db50 con 0x7f6628100800 2024-09-20T18:42:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.596+0000 7f662ce40640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6628106800 0x7f662819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.596+0000 7f662ce40640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6628106800 0x7f662819db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35804/0 (socket says 172.21.15.17:35804) 2024-09-20T18:42:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.596+0000 7f662ce40640 1 -- 172.21.15.17:0/1520912957 learned_addr learned my addr 172.21.15.17:0/1520912957 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:42:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.596+0000 7f662d641640 1 --2- 172.21.15.17:0/1520912957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6628100800 0x7f662819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.596+0000 7f662ce40640 1 -- 172.21.15.17:0/1520912957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6628100800 msgr2=0x7f662819d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.596+0000 7f662ce40640 1 --2- 172.21.15.17:0/1520912957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6628100800 0x7f662819d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.596+0000 7f662ce40640 1 -- 172.21.15.17:0/1520912957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66281977c0 con 0x7f6628106800 2024-09-20T18:42:30.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.596+0000 7f662ce40640 1 --2- 172.21.15.17:0/1520912957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6628106800 0x7f662819db80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f661800c8f0 tx=0x7f661800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:42:30.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.596+0000 7f661e7fc640 1 -- 172.21.15.17:0/1520912957 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66180079b0 con 0x7f6628106800 2024-09-20T18:42:30.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.596+0000 7f661e7fc640 1 -- 172.21.15.17:0/1520912957 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f66180054e0 con 0x7f6628106800 2024-09-20T18:42:30.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.596+0000 7f662f8a5640 1 -- 172.21.15.17:0/1520912957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6628197ab0 con 0x7f6628106800 2024-09-20T18:42:30.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.596+0000 7f661e7fc640 1 -- 172.21.15.17:0/1520912957 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6618004dd0 con 0x7f6628106800 2024-09-20T18:42:30.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.596+0000 7f662f8a5640 1 -- 172.21.15.17:0/1520912957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6628198040 con 0x7f6628106800 2024-09-20T18:42:30.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.597+0000 7f662f8a5640 1 -- 172.21.15.17:0/1520912957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6628101f40 con 0x7f6628106800 2024-09-20T18:42:30.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.598+0000 7f661e7fc640 1 -- 172.21.15.17:0/1520912957 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6618005020 con 0x7f6628106800 2024-09-20T18:42:30.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.599+0000 7f661e7fc640 1 --2- 172.21.15.17:0/1520912957 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f661407af30 0x7f661407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:42:30.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.599+0000 7f662d641640 1 --2- 172.21.15.17:0/1520912957 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f661407af30 0x7f661407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:42:30.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.599+0000 7f661e7fc640 1 -- 172.21.15.17:0/1520912957 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5984+0+0 (secure 0 0 0) 0x7f661809ddd0 con 0x7f6628106800 2024-09-20T18:42:30.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.599+0000 7f662d641640 1 --2- 172.21.15.17:0/1520912957 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f661407af30 0x7f661407d3f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6624000c00 tx=0x7f6624031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:42:30.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.603+0000 7f661e7fc640 1 -- 172.21.15.17:0/1520912957 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6618014030 con 0x7f6628106800 2024-09-20T18:42:30.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.863+0000 7f662f8a5640 1 -- 172.21.15.17:0/1520912957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6628109d80 con 0x7f6628106800 2024-09-20T18:42:30.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.864+0000 7f661e7fc640 1 -- 172.21.15.17:0/1520912957 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f6618069500 con 0x7f6628106800 2024-09-20T18:42:30.880 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T18:42:30.880 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:42:30.880 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:42:30.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.866+0000 7f662f8a5640 1 -- 172.21.15.17:0/1520912957 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f661407af30 msgr2=0x7f661407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:30.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.866+0000 7f662f8a5640 1 --2- 172.21.15.17:0/1520912957 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f661407af30 0x7f661407d3f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6624000c00 tx=0x7f6624031400 comp rx=0 tx=0).stop 2024-09-20T18:42:30.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.866+0000 7f662f8a5640 1 -- 172.21.15.17:0/1520912957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6628106800 msgr2=0x7f662819db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:42:30.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.866+0000 7f662f8a5640 1 --2- 172.21.15.17:0/1520912957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6628106800 0x7f662819db80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f661800c8f0 tx=0x7f661800cdb0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.866+0000 7f662f8a5640 1 -- 172.21.15.17:0/1520912957 shutdown_connections 2024-09-20T18:42:30.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.866+0000 7f662f8a5640 1 --2- 172.21.15.17:0/1520912957 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f661407af30 0x7f661407d3f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.866+0000 7f662f8a5640 1 --2- 172.21.15.17:0/1520912957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6628106800 0x7f662819db80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.866+0000 7f662f8a5640 1 --2- 172.21.15.17:0/1520912957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6628100800 0x7f662819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:42:30.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.866+0000 7f662f8a5640 1 -- 172.21.15.17:0/1520912957 >> 172.21.15.17:0/1520912957 conn(0x7f66280fc520 msgr2=0x7f662806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:42:30.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.866+0000 7f662f8a5640 1 -- 172.21.15.17:0/1520912957 shutdown_connections 2024-09-20T18:42:30.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:42:30.866+0000 7f662f8a5640 1 -- 172.21.15.17:0/1520912957 wait complete. 2024-09-20T18:42:31.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:31 smithi172 ceph-mon[80431]: pgmap v195: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:42:31.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:31 smithi172 ceph-mon[80431]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:42:31.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:31 smithi172 ceph-mon[80431]: osd.3 marked itself down and dead 2024-09-20T18:42:31.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:31 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1520912957' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:42:31.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:31 smithi017 ceph-mon[108970]: pgmap v195: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:42:31.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:31 smithi017 ceph-mon[108970]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:42:31.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:31 smithi017 ceph-mon[108970]: osd.3 marked itself down and dead 2024-09-20T18:42:31.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:31 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1520912957' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:42:32.179 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:31 smithi172 podman[87889]: 2024-09-20 18:42:31.866718544 +0000 UTC m=+1.433473985 container died 5e0e99e76e72192c5b05ea41eb511899047dd73e4ebf6f40299bcdb7dd559155 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-ed8ee0f, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-20T18:42:32.452 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:32 smithi172 podman[87889]: 2024-09-20 18:42:32.372417581 +0000 UTC m=+1.939173006 container cleanup 5e0e99e76e72192c5b05ea41eb511899047dd73e4ebf6f40299bcdb7dd559155 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-ed8ee0f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-20T18:42:32.453 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:32 smithi172 bash[87889]: ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3 2024-09-20T18:42:32.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:32 smithi172 ceph-mon[80431]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T18:42:32.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:32 smithi172 ceph-mon[80431]: osdmap e62: 6 total, 5 up, 6 in 2024-09-20T18:42:32.711 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:32 smithi172 podman[87907]: 2024-09-20 18:42:32.607280223 +0000 UTC m=+0.739646579 container remove 5e0e99e76e72192c5b05ea41eb511899047dd73e4ebf6f40299bcdb7dd559155 (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-ed8ee0f, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True) 2024-09-20T18:42:32.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:32 smithi017 ceph-mon[108970]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T18:42:32.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:32 smithi017 ceph-mon[108970]: osdmap e62: 6 total, 5 up, 6 in 2024-09-20T18:42:33.210 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:32 smithi172 podman[87996]: 2024-09-20 18:42:32.908330589 +0000 UTC m=+0.103239740 container create 29dec5cda32fc5989e3b77ea91b3ca38de087914e9d2daa707ec54c3133cf68e (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-20T18:42:33.210 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:32 smithi172 podman[87996]: 2024-09-20 18:42:32.821011061 +0000 UTC m=+0.015920212 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:42:33.211 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:33 smithi172 podman[87996]: 2024-09-20 18:42:33.127374743 +0000 UTC m=+0.322283910 container init 29dec5cda32fc5989e3b77ea91b3ca38de087914e9d2daa707ec54c3133cf68e (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T18:42:33.211 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:33 smithi172 podman[87996]: 2024-09-20 18:42:33.130650483 +0000 UTC m=+0.325559637 container start 29dec5cda32fc5989e3b77ea91b3ca38de087914e9d2daa707ec54c3133cf68e (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-deactivate, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-20T18:42:33.613 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:33 smithi172 ceph-mon[80431]: pgmap v197: 65 pgs: 18 peering, 6 stale+active+clean, 41 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T18:42:33.613 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:33 smithi172 ceph-mon[80431]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-09-20T18:42:33.613 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:33 smithi172 ceph-mon[80431]: osdmap e63: 6 total, 5 up, 6 in 2024-09-20T18:42:33.613 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:33 smithi172 podman[87996]: 2024-09-20 18:42:33.218955957 +0000 UTC m=+0.413865118 container attach 29dec5cda32fc5989e3b77ea91b3ca38de087914e9d2daa707ec54c3133cf68e (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T18:42:33.613 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:33 smithi172 podman[87996]: 2024-09-20 18:42:33.31630243 +0000 UTC m=+0.511211584 container died 29dec5cda32fc5989e3b77ea91b3ca38de087914e9d2daa707ec54c3133cf68e (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-20T18:42:33.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:33 smithi017 ceph-mon[108970]: pgmap v197: 65 pgs: 18 peering, 6 stale+active+clean, 41 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-20T18:42:33.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:33 smithi017 ceph-mon[108970]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-09-20T18:42:33.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:33 smithi017 ceph-mon[108970]: osdmap e63: 6 total, 5 up, 6 in 2024-09-20T18:42:34.210 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:33 smithi172 podman[88019]: 2024-09-20 18:42:33.906632295 +0000 UTC m=+0.583276486 container remove 29dec5cda32fc5989e3b77ea91b3ca38de087914e9d2daa707ec54c3133cf68e (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T18:42:34.211 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:33 smithi172 systemd[1]: ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.3.service: Deactivated successfully. 2024-09-20T18:42:34.211 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:33 smithi172 systemd[1]: Stopped Ceph osd.3 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:42:34.211 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:33 smithi172 systemd[1]: ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.3.service: Consumed 1min 5.152s CPU time. 2024-09-20T18:42:34.211 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:34 smithi172 systemd[1]: Starting Ceph osd.3 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:42:34.600 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:34 smithi172 ceph-mon[80431]: Health check failed: Degraded data redundancy: 14/318 objects degraded (4.403%), 5 pgs degraded (PG_DEGRADED) 2024-09-20T18:42:34.600 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:34 smithi172 podman[88116]: 2024-09-20 18:42:34.236852107 +0000 UTC m=+0.015818543 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:42:34.600 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:34 smithi172 podman[88116]: 2024-09-20 18:42:34.349073114 +0000 UTC m=+0.128039576 container create 1a853c40bb133a4080c8efdaf7d2153cbb6218ede5656fa6846ca75e2d50ea59 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T18:42:34.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:34 smithi017 ceph-mon[108970]: Health check failed: Degraded data redundancy: 14/318 objects degraded (4.403%), 5 pgs degraded (PG_DEGRADED) 2024-09-20T18:42:34.960 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:34 smithi172 podman[88116]: 2024-09-20 18:42:34.58518259 +0000 UTC m=+0.364149017 container init 1a853c40bb133a4080c8efdaf7d2153cbb6218ede5656fa6846ca75e2d50ea59 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-20T18:42:34.960 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:34 smithi172 podman[88116]: 2024-09-20 18:42:34.588545819 +0000 UTC m=+0.367512244 container start 1a853c40bb133a4080c8efdaf7d2153cbb6218ede5656fa6846ca75e2d50ea59 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-20T18:42:34.960 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:34 smithi172 podman[88116]: 2024-09-20 18:42:34.685043171 +0000 UTC m=+0.464009588 container attach 1a853c40bb133a4080c8efdaf7d2153cbb6218ede5656fa6846ca75e2d50ea59 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-20T18:42:34.961 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:34 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate[88132]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:42:34.961 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:34 smithi172 bash[88116]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:42:34.961 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:34 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate[88132]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:42:34.961 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:34 smithi172 bash[88116]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:42:35.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:35 smithi017 ceph-mon[108970]: pgmap v199: 65 pgs: 6 active+undersized, 18 peering, 2 stale+active+clean, 5 active+undersized+degraded, 34 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14/318 objects degraded (4.403%) 2024-09-20T18:42:35.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:35 smithi172 ceph-mon[80431]: pgmap v199: 65 pgs: 6 active+undersized, 18 peering, 2 stale+active+clean, 5 active+undersized+degraded, 34 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14/318 objects degraded (4.403%) 2024-09-20T18:42:37.862 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:37 smithi172 ceph-mon[80431]: pgmap v200: 65 pgs: 9 active+undersized, 18 peering, 11 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 33/318 objects degraded (10.377%) 2024-09-20T18:42:37.862 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:37.863 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:42:37.863 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate[88132]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T18:42:37.863 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate[88132]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:42:37.863 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 bash[88116]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T18:42:37.863 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 bash[88116]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:42:37.863 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate[88132]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:42:37.863 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 bash[88116]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:42:37.863 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate[88132]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-20T18:42:37.863 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 bash[88116]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-20T18:42:37.863 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate[88132]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-09-20T18:42:37.863 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 bash[88116]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-09-20T18:42:37.864 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate[88132]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-20T18:42:37.864 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 bash[88116]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-20T18:42:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:37 smithi017 ceph-mon[108970]: pgmap v200: 65 pgs: 9 active+undersized, 18 peering, 11 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 33/318 objects degraded (10.377%) 2024-09-20T18:42:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:42:38.179 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate[88132]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-09-20T18:42:38.179 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 bash[88116]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-09-20T18:42:38.179 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate[88132]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-20T18:42:38.179 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 bash[88116]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-20T18:42:38.180 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate[88132]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-20T18:42:38.180 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 bash[88116]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-20T18:42:38.180 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate[88132]: --> ceph-volume lvm activate successful for osd ID: 3 2024-09-20T18:42:38.180 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 bash[88116]: --> ceph-volume lvm activate successful for osd ID: 3 2024-09-20T18:42:38.180 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:37 smithi172 podman[88116]: 2024-09-20 18:42:37.875848719 +0000 UTC m=+3.654815144 container died 1a853c40bb133a4080c8efdaf7d2153cbb6218ede5656fa6846ca75e2d50ea59 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T18:42:38.691 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:38 smithi017 ceph-mon[108970]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-09-20T18:42:38.830 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:38 smithi172 ceph-mon[80431]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-09-20T18:42:38.830 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:38 smithi172 podman[88335]: 2024-09-20 18:42:38.580826822 +0000 UTC m=+0.696914896 container remove 1a853c40bb133a4080c8efdaf7d2153cbb6218ede5656fa6846ca75e2d50ea59 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-20T18:42:38.830 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:38 smithi172 podman[88392]: 2024-09-20 18:42:38.688216314 +0000 UTC m=+0.015680905 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:42:38.830 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:38 smithi172 podman[88392]: 2024-09-20 18:42:38.81514868 +0000 UTC m=+0.142613260 container create f7f0c8354238b854cde88b2bd95896eba9eb169c486d59850ed318843b2e2e6a (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-20T18:42:39.149 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:39 smithi172 podman[88392]: 2024-09-20 18:42:39.034282432 +0000 UTC m=+0.361747022 container init f7f0c8354238b854cde88b2bd95896eba9eb169c486d59850ed318843b2e2e6a (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T18:42:39.150 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:39 smithi172 podman[88392]: 2024-09-20 18:42:39.037596788 +0000 UTC m=+0.365061380 container start f7f0c8354238b854cde88b2bd95896eba9eb169c486d59850ed318843b2e2e6a (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.vendor=CentOS) 2024-09-20T18:42:39.150 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:39 smithi172 ceph-osd[88411]: -- 172.21.15.172:0/1864255246 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555ae028c1e0 con 0x555ae021c000 2024-09-20T18:42:39.460 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:39 smithi172 bash[88392]: f7f0c8354238b854cde88b2bd95896eba9eb169c486d59850ed318843b2e2e6a 2024-09-20T18:42:39.460 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:39 smithi172 systemd[1]: Started Ceph osd.3 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:42:39.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:39 smithi017 ceph-mon[108970]: pgmap v201: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 68/318 objects degraded (21.384%) 2024-09-20T18:42:39.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:39 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:39.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:39 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:39.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:39 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:42:39.922 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:39 smithi172 ceph-mon[80431]: pgmap v201: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 68/318 objects degraded (21.384%) 2024-09-20T18:42:39.923 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:39 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:39.923 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:39 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:39.923 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:39 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:42:41.210 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:40 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3[88407]: 2024-09-20T18:42:40.902+0000 7ff67b404640 -1 Falling back to public interface 2024-09-20T18:42:41.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:41 smithi017 ceph-mon[108970]: pgmap v202: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 68/318 objects degraded (21.384%) 2024-09-20T18:42:41.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:41 smithi172 ceph-mon[80431]: pgmap v202: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 68/318 objects degraded (21.384%) 2024-09-20T18:42:42.831 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:42 smithi172 ceph-mon[80431]: Health check update: Degraded data redundancy: 68/318 objects degraded (21.384%), 19 pgs degraded (PG_DEGRADED) 2024-09-20T18:42:42.831 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:42 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:42.831 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:42 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:42.832 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:42 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:42.832 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:42 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:42.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:42 smithi017 ceph-mon[108970]: Health check update: Degraded data redundancy: 68/318 objects degraded (21.384%), 19 pgs degraded (PG_DEGRADED) 2024-09-20T18:42:42.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:42 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:42.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:42 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:42.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:42 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:42.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:42 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:43.858 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:43 smithi172 ceph-mon[80431]: pgmap v203: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 2 op/s; 68/318 objects degraded (21.384%) 2024-09-20T18:42:43.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:43 smithi017 ceph-mon[108970]: pgmap v203: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 2 op/s; 68/318 objects degraded (21.384%) 2024-09-20T18:42:45.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:45 smithi017 ceph-mon[108970]: pgmap v204: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 688 B/s rd, 1 op/s; 68/318 objects degraded (21.384%) 2024-09-20T18:42:45.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:45.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:45.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:42:45.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:42:45.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:45.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:45 smithi172 ceph-mon[80431]: pgmap v204: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 688 B/s rd, 1 op/s; 68/318 objects degraded (21.384%) 2024-09-20T18:42:45.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:45.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:45.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:42:45.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:42:45.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:46.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:46 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:42:46.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:46 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:42:46.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:46 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:42:46.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:46 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:42:46.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:46 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-20T18:42:46.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:46 smithi017 ceph-mon[108970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T18:42:46.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:46 smithi017 ceph-mon[108970]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-20T18:42:46.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:46 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:42:46.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:46 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:42:46.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:46 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:42:46.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:46 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:42:46.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:46 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-20T18:42:46.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:46 smithi172 ceph-mon[80431]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T18:42:46.903 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:46 smithi172 ceph-mon[80431]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-20T18:42:47.210 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:46 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3[88407]: 2024-09-20T18:42:46.887+0000 7ff67b404640 -1 osd.3 61 log_to_monitors true 2024-09-20T18:42:47.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:47 smithi017 ceph-mon[108970]: pgmap v205: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 68/318 objects degraded (21.384%) 2024-09-20T18:42:47.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:47 smithi017 ceph-mon[108970]: from='osd.3 [v2:172.21.15.172:6800/111681196,v1:172.21.15.172:6801/111681196]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-20T18:42:47.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:47 smithi017 ceph-mon[108970]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-20T18:42:47.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:47 smithi172 ceph-mon[80431]: pgmap v205: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 68/318 objects degraded (21.384%) 2024-09-20T18:42:47.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:47 smithi172 ceph-mon[80431]: from='osd.3 [v2:172.21.15.172:6800/111681196,v1:172.21.15.172:6801/111681196]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-20T18:42:47.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:47 smithi172 ceph-mon[80431]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-20T18:42:47.961 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 18:42:47 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3[88407]: 2024-09-20T18:42:47.589+0000 7ff6731ae640 -1 osd.3 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T18:42:48.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:48 smithi017 ceph-mon[108970]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-20T18:42:48.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:48 smithi017 ceph-mon[108970]: from='osd.3 [v2:172.21.15.172:6800/111681196,v1:172.21.15.172:6801/111681196]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-20T18:42:48.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:48 smithi017 ceph-mon[108970]: osdmap e64: 6 total, 5 up, 6 in 2024-09-20T18:42:48.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:48 smithi017 ceph-mon[108970]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-20T18:42:48.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:48 smithi172 ceph-mon[80431]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-20T18:42:48.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:48 smithi172 ceph-mon[80431]: from='osd.3 [v2:172.21.15.172:6800/111681196,v1:172.21.15.172:6801/111681196]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-20T18:42:48.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:48 smithi172 ceph-mon[80431]: osdmap e64: 6 total, 5 up, 6 in 2024-09-20T18:42:48.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:48 smithi172 ceph-mon[80431]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-20T18:42:49.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:49 smithi017 ceph-mon[108970]: pgmap v207: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 68/318 objects degraded (21.384%) 2024-09-20T18:42:49.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:49 smithi017 ceph-mon[108970]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T18:42:49.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:49 smithi017 ceph-mon[108970]: osd.3 [v2:172.21.15.172:6800/111681196,v1:172.21.15.172:6801/111681196] boot 2024-09-20T18:42:49.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:49 smithi017 ceph-mon[108970]: osdmap e65: 6 total, 6 up, 6 in 2024-09-20T18:42:49.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:49 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-20T18:42:49.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:49 smithi172 ceph-mon[80431]: pgmap v207: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 68/318 objects degraded (21.384%) 2024-09-20T18:42:49.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:49 smithi172 ceph-mon[80431]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T18:42:49.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:49 smithi172 ceph-mon[80431]: osd.3 [v2:172.21.15.172:6800/111681196,v1:172.21.15.172:6801/111681196] boot 2024-09-20T18:42:49.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:49 smithi172 ceph-mon[80431]: osdmap e65: 6 total, 6 up, 6 in 2024-09-20T18:42:49.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:49 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-20T18:42:50.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:50 smithi017 ceph-mon[108970]: osdmap e66: 6 total, 6 up, 6 in 2024-09-20T18:42:50.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:50 smithi172 ceph-mon[80431]: osdmap e66: 6 total, 6 up, 6 in 2024-09-20T18:42:51.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:51 smithi017 ceph-mon[108970]: pgmap v210: 65 pgs: 3 peering, 18 active+undersized, 17 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 64/318 objects degraded (20.126%) 2024-09-20T18:42:51.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:51 smithi017 ceph-mon[108970]: Health check update: Degraded data redundancy: 64/318 objects degraded (20.126%), 17 pgs degraded (PG_DEGRADED) 2024-09-20T18:42:51.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:51 smithi172 ceph-mon[80431]: pgmap v210: 65 pgs: 3 peering, 18 active+undersized, 17 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 64/318 objects degraded (20.126%) 2024-09-20T18:42:51.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:51 smithi172 ceph-mon[80431]: Health check update: Degraded data redundancy: 64/318 objects degraded (20.126%), 17 pgs degraded (PG_DEGRADED) 2024-09-20T18:42:53.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:53 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:53.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:53 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:42:53.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:53 smithi017 ceph-mon[108970]: pgmap v211: 65 pgs: 3 peering, 9 active+undersized, 11 active+undersized+degraded, 42 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 39/318 objects degraded (12.264%) 2024-09-20T18:42:53.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:53 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:42:53.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:53 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:42:53.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:53 smithi172 ceph-mon[80431]: pgmap v211: 65 pgs: 3 peering, 9 active+undersized, 11 active+undersized+degraded, 42 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 39/318 objects degraded (12.264%) 2024-09-20T18:42:54.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:54 smithi172 ceph-mon[80431]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 39/318 objects degraded (12.264%), 11 pgs degraded) 2024-09-20T18:42:54.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:54 smithi017 ceph-mon[108970]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 39/318 objects degraded (12.264%), 11 pgs degraded) 2024-09-20T18:42:55.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:55 smithi172 ceph-mon[80431]: pgmap v212: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-20T18:42:55.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:55 smithi017 ceph-mon[108970]: pgmap v212: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-20T18:42:57.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:57 smithi172 ceph-mon[80431]: pgmap v213: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-20T18:42:57.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:57 smithi017 ceph-mon[108970]: pgmap v213: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-20T18:42:59.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:42:59 smithi017 ceph-mon[108970]: pgmap v214: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-20T18:42:59.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:42:59 smithi172 ceph-mon[80431]: pgmap v214: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-20T18:43:00.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.965+0000 7f2d7251d640 1 -- 172.21.15.17:0/1921286336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d6c1033d0 msgr2=0x7f2d6c10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:00.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.965+0000 7f2d7251d640 1 --2- 172.21.15.17:0/1921286336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d6c1033d0 0x7f2d6c10b8c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2d60009880 tx=0x7f2d6002a530 comp rx=0 tx=0).stop 2024-09-20T18:43:00.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.965+0000 7f2d7251d640 1 -- 172.21.15.17:0/1921286336 shutdown_connections 2024-09-20T18:43:00.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.965+0000 7f2d7251d640 1 --2- 172.21.15.17:0/1921286336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d6c1033d0 0x7f2d6c10b8c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:00.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.965+0000 7f2d7251d640 1 --2- 172.21.15.17:0/1921286336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d6c102ab0 0x7f2d6c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:00.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.965+0000 7f2d7251d640 1 -- 172.21.15.17:0/1921286336 >> 172.21.15.17:0/1921286336 conn(0x7f2d6c0fc550 msgr2=0x7f2d6c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:00.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.965+0000 7f2d7251d640 1 -- 172.21.15.17:0/1921286336 shutdown_connections 2024-09-20T18:43:00.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.965+0000 7f2d7251d640 1 -- 172.21.15.17:0/1921286336 wait complete. 2024-09-20T18:43:00.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.966+0000 7f2d7251d640 1 Processor -- start 2024-09-20T18:43:00.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.966+0000 7f2d7251d640 1 -- start start 2024-09-20T18:43:00.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.966+0000 7f2d7251d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d6c102ab0 0x7f2d6c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:00.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.966+0000 7f2d7251d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d6c1033d0 0x7f2d6c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:00.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.966+0000 7f2d7251d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c10ede0 con 0x7f2d6c1033d0 2024-09-20T18:43:00.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.966+0000 7f2d7251d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c10ec60 con 0x7f2d6c102ab0 2024-09-20T18:43:00.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.967+0000 7f2d6b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d6c1033d0 0x7f2d6c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:00.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.967+0000 7f2d6b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d6c1033d0 0x7f2d6c19dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45118/0 (socket says 172.21.15.17:45118) 2024-09-20T18:43:00.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.967+0000 7f2d6b7fe640 1 -- 172.21.15.17:0/3501550099 learned_addr learned my addr 172.21.15.17:0/3501550099 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:43:00.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.967+0000 7f2d6bfff640 1 --2- 172.21.15.17:0/3501550099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d6c102ab0 0x7f2d6c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:00.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.967+0000 7f2d6b7fe640 1 -- 172.21.15.17:0/3501550099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d6c102ab0 msgr2=0x7f2d6c19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:00.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.967+0000 7f2d6b7fe640 1 --2- 172.21.15.17:0/3501550099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d6c102ab0 0x7f2d6c19d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:00.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.967+0000 7f2d6b7fe640 1 -- 172.21.15.17:0/3501550099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c197810 con 0x7f2d6c1033d0 2024-09-20T18:43:00.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.967+0000 7f2d6b7fe640 1 --2- 172.21.15.17:0/3501550099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d6c1033d0 0x7f2d6c19dbd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2d60031460 tx=0x7f2d60004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:00.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.967+0000 7f2d697fa640 1 -- 172.21.15.17:0/3501550099 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d6003f070 con 0x7f2d6c1033d0 2024-09-20T18:43:00.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.967+0000 7f2d697fa640 1 -- 172.21.15.17:0/3501550099 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2d600035f0 con 0x7f2d6c1033d0 2024-09-20T18:43:00.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.968+0000 7f2d7251d640 1 -- 172.21.15.17:0/3501550099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6c197aa0 con 0x7f2d6c1033d0 2024-09-20T18:43:00.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.968+0000 7f2d697fa640 1 -- 172.21.15.17:0/3501550099 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d60035030 con 0x7f2d6c1033d0 2024-09-20T18:43:00.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.968+0000 7f2d7251d640 1 -- 172.21.15.17:0/3501550099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d6c197fd0 con 0x7f2d6c1033d0 2024-09-20T18:43:00.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.969+0000 7f2d7251d640 1 -- 172.21.15.17:0/3501550099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d6c06a580 con 0x7f2d6c1033d0 2024-09-20T18:43:00.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.970+0000 7f2d697fa640 1 -- 172.21.15.17:0/3501550099 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2d60042070 con 0x7f2d6c1033d0 2024-09-20T18:43:00.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.970+0000 7f2d697fa640 1 --2- 172.21.15.17:0/3501550099 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2d5407af80 0x7f2d5407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:00.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.970+0000 7f2d697fa640 1 -- 172.21.15.17:0/3501550099 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5984+0+0 (secure 0 0 0) 0x7f2d600be780 con 0x7f2d6c1033d0 2024-09-20T18:43:00.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.970+0000 7f2d6bfff640 1 --2- 172.21.15.17:0/3501550099 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2d5407af80 0x7f2d5407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:00.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.971+0000 7f2d6bfff640 1 --2- 172.21.15.17:0/3501550099 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2d5407af80 0x7f2d5407d440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c005fd0 tx=0x7f2d5c00b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:00.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:00.975+0000 7f2d697fa640 1 -- 172.21.15.17:0/3501550099 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2d60089eb0 con 0x7f2d6c1033d0 2024-09-20T18:43:01.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.180+0000 7f2d7251d640 1 -- 172.21.15.17:0/3501550099 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2d6c198280 con 0x7f2d5407af80 2024-09-20T18:43:01.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.181+0000 7f2d697fa640 1 -- 172.21.15.17:0/3501550099 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f2d6c198280 con 0x7f2d5407af80 2024-09-20T18:43:01.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.183+0000 7f2d7251d640 1 -- 172.21.15.17:0/3501550099 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2d5407af80 msgr2=0x7f2d5407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:01.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.183+0000 7f2d7251d640 1 --2- 172.21.15.17:0/3501550099 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2d5407af80 0x7f2d5407d440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c005fd0 tx=0x7f2d5c00b390 comp rx=0 tx=0).stop 2024-09-20T18:43:01.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.183+0000 7f2d7251d640 1 -- 172.21.15.17:0/3501550099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d6c1033d0 msgr2=0x7f2d6c19dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:01.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.183+0000 7f2d7251d640 1 --2- 172.21.15.17:0/3501550099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d6c1033d0 0x7f2d6c19dbd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2d60031460 tx=0x7f2d60004530 comp rx=0 tx=0).stop 2024-09-20T18:43:01.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.184+0000 7f2d7251d640 1 -- 172.21.15.17:0/3501550099 shutdown_connections 2024-09-20T18:43:01.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.184+0000 7f2d7251d640 1 --2- 172.21.15.17:0/3501550099 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2d5407af80 0x7f2d5407d440 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.184+0000 7f2d7251d640 1 --2- 172.21.15.17:0/3501550099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d6c1033d0 0x7f2d6c19dbd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.184+0000 7f2d7251d640 1 --2- 172.21.15.17:0/3501550099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d6c102ab0 0x7f2d6c19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.184+0000 7f2d7251d640 1 -- 172.21.15.17:0/3501550099 >> 172.21.15.17:0/3501550099 conn(0x7f2d6c0fc550 msgr2=0x7f2d6c108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:01.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.184+0000 7f2d7251d640 1 -- 172.21.15.17:0/3501550099 shutdown_connections 2024-09-20T18:43:01.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.184+0000 7f2d7251d640 1 -- 172.21.15.17:0/3501550099 wait complete. 2024-09-20T18:43:01.208 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:43:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.269+0000 7f8f3bb7b640 1 -- 172.21.15.17:0/1272137918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f34107900 msgr2=0x7f8f34107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.269+0000 7f8f3bb7b640 1 --2- 172.21.15.17:0/1272137918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f34107900 0x7f8f34107ce0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009880 tx=0x7f8f2402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.269+0000 7f8f3bb7b640 1 -- 172.21.15.17:0/1272137918 shutdown_connections 2024-09-20T18:43:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.269+0000 7f8f3bb7b640 1 --2- 172.21.15.17:0/1272137918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f34101900 0x7f8f34101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.269+0000 7f8f3bb7b640 1 --2- 172.21.15.17:0/1272137918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f34107900 0x7f8f34107ce0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.269+0000 7f8f3bb7b640 1 -- 172.21.15.17:0/1272137918 >> 172.21.15.17:0/1272137918 conn(0x7f8f340fd600 msgr2=0x7f8f340ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.269+0000 7f8f3bb7b640 1 -- 172.21.15.17:0/1272137918 shutdown_connections 2024-09-20T18:43:01.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.269+0000 7f8f3bb7b640 1 -- 172.21.15.17:0/1272137918 wait complete. 2024-09-20T18:43:01.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.270+0000 7f8f3bb7b640 1 Processor -- start 2024-09-20T18:43:01.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.270+0000 7f8f3bb7b640 1 -- start start 2024-09-20T18:43:01.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.270+0000 7f8f3bb7b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f34101900 0x7f8f3419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:01.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.270+0000 7f8f3bb7b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f34107900 0x7f8f3419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:01.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.270+0000 7f8f3bb7b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3410edb0 con 0x7f8f34101900 2024-09-20T18:43:01.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.270+0000 7f8f3bb7b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3410ec30 con 0x7f8f34107900 2024-09-20T18:43:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.270+0000 7f8f39917640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f34101900 0x7f8f3419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.270+0000 7f8f39917640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f34101900 0x7f8f3419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45124/0 (socket says 172.21.15.17:45124) 2024-09-20T18:43:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.270+0000 7f8f39917640 1 -- 172.21.15.17:0/2448330643 learned_addr learned my addr 172.21.15.17:0/2448330643 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:43:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.270+0000 7f8f39116640 1 --2- 172.21.15.17:0/2448330643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f34107900 0x7f8f3419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.271+0000 7f8f39917640 1 -- 172.21.15.17:0/2448330643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f34107900 msgr2=0x7f8f3419dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.271+0000 7f8f39917640 1 --2- 172.21.15.17:0/2448330643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f34107900 0x7f8f3419dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.271+0000 7f8f39917640 1 -- 172.21.15.17:0/2448330643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f341977e0 con 0x7f8f34101900 2024-09-20T18:43:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.271+0000 7f8f39917640 1 --2- 172.21.15.17:0/2448330643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f34101900 0x7f8f3419d660 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8f24031460 tx=0x7f8f240045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.271+0000 7f8f32ffd640 1 -- 172.21.15.17:0/2448330643 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f2403f070 con 0x7f8f34101900 2024-09-20T18:43:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.271+0000 7f8f32ffd640 1 -- 172.21.15.17:0/2448330643 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f240035f0 con 0x7f8f34101900 2024-09-20T18:43:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.271+0000 7f8f3bb7b640 1 -- 172.21.15.17:0/2448330643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f34197a70 con 0x7f8f34101900 2024-09-20T18:43:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.271+0000 7f8f32ffd640 1 -- 172.21.15.17:0/2448330643 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f24035030 con 0x7f8f34101900 2024-09-20T18:43:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.271+0000 7f8f3bb7b640 1 -- 172.21.15.17:0/2448330643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f34197fa0 con 0x7f8f34101900 2024-09-20T18:43:01.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.272+0000 7f8f3bb7b640 1 -- 172.21.15.17:0/2448330643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f34103040 con 0x7f8f34101900 2024-09-20T18:43:01.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.273+0000 7f8f32ffd640 1 -- 172.21.15.17:0/2448330643 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8f24042070 con 0x7f8f34101900 2024-09-20T18:43:01.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.274+0000 7f8f32ffd640 1 --2- 172.21.15.17:0/2448330643 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f1c07af80 0x7f8f1c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:01.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.274+0000 7f8f39116640 1 --2- 172.21.15.17:0/2448330643 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f1c07af80 0x7f8f1c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:01.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.274+0000 7f8f32ffd640 1 -- 172.21.15.17:0/2448330643 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5984+0+0 (secure 0 0 0) 0x7f8f240be7b0 con 0x7f8f34101900 2024-09-20T18:43:01.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.274+0000 7f8f39116640 1 --2- 172.21.15.17:0/2448330643 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f1c07af80 0x7f8f1c07d440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8f34100d10 tx=0x7f8f28009760 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.278+0000 7f8f32ffd640 1 -- 172.21.15.17:0/2448330643 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8f24089ee0 con 0x7f8f34101900 2024-09-20T18:43:01.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.482+0000 7f8f3bb7b640 1 -- 172.21.15.17:0/2448330643 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8f34198310 con 0x7f8f1c07af80 2024-09-20T18:43:01.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.484+0000 7f8f32ffd640 1 -- 172.21.15.17:0/2448330643 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f8f34198310 con 0x7f8f1c07af80 2024-09-20T18:43:01.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.486+0000 7f8f3bb7b640 1 -- 172.21.15.17:0/2448330643 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f1c07af80 msgr2=0x7f8f1c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:01.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.486+0000 7f8f3bb7b640 1 --2- 172.21.15.17:0/2448330643 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f1c07af80 0x7f8f1c07d440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8f34100d10 tx=0x7f8f28009760 comp rx=0 tx=0).stop 2024-09-20T18:43:01.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.486+0000 7f8f3bb7b640 1 -- 172.21.15.17:0/2448330643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f34101900 msgr2=0x7f8f3419d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:01.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.486+0000 7f8f3bb7b640 1 --2- 172.21.15.17:0/2448330643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f34101900 0x7f8f3419d660 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8f24031460 tx=0x7f8f240045e0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.486+0000 7f8f3bb7b640 1 -- 172.21.15.17:0/2448330643 shutdown_connections 2024-09-20T18:43:01.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.486+0000 7f8f3bb7b640 1 --2- 172.21.15.17:0/2448330643 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f1c07af80 0x7f8f1c07d440 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.486+0000 7f8f3bb7b640 1 --2- 172.21.15.17:0/2448330643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f34107900 0x7f8f3419dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.486+0000 7f8f3bb7b640 1 --2- 172.21.15.17:0/2448330643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f34101900 0x7f8f3419d660 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.486+0000 7f8f3bb7b640 1 -- 172.21.15.17:0/2448330643 >> 172.21.15.17:0/2448330643 conn(0x7f8f340fd600 msgr2=0x7f8f340fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:01.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.486+0000 7f8f3bb7b640 1 -- 172.21.15.17:0/2448330643 shutdown_connections 2024-09-20T18:43:01.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.486+0000 7f8f3bb7b640 1 -- 172.21.15.17:0/2448330643 wait complete. 2024-09-20T18:43:01.582 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:01 smithi017 ceph-mon[108970]: pgmap v215: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-20T18:43:01.582 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:01 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-20T18:43:01.582 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:01 smithi017 ceph-mon[108970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T18:43:01.582 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:01 smithi017 ceph-mon[108970]: Upgrade: osd.4 is safe to restart 2024-09-20T18:43:01.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.572+0000 7f5b78dde640 1 -- 172.21.15.17:0/3300455993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b741007f0 msgr2=0x7f5b74100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.572+0000 7f5b78dde640 1 --2- 172.21.15.17:0/3300455993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b741007f0 0x7f5b74100c50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c009880 tx=0x7f5b5c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.572+0000 7f5b78dde640 1 -- 172.21.15.17:0/3300455993 shutdown_connections 2024-09-20T18:43:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.572+0000 7f5b78dde640 1 --2- 172.21.15.17:0/3300455993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b741007f0 0x7f5b74100c50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.572+0000 7f5b78dde640 1 --2- 172.21.15.17:0/3300455993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b741067f0 0x7f5b74106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.572+0000 7f5b78dde640 1 -- 172.21.15.17:0/3300455993 >> 172.21.15.17:0/3300455993 conn(0x7f5b740fc550 msgr2=0x7f5b740fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.572+0000 7f5b78dde640 1 -- 172.21.15.17:0/3300455993 shutdown_connections 2024-09-20T18:43:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.572+0000 7f5b78dde640 1 -- 172.21.15.17:0/3300455993 wait complete. 2024-09-20T18:43:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.573+0000 7f5b78dde640 1 Processor -- start 2024-09-20T18:43:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.573+0000 7f5b78dde640 1 -- start start 2024-09-20T18:43:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.573+0000 7f5b78dde640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b741007f0 0x7f5b7419f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.573+0000 7f5b78dde640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b741067f0 0x7f5b7419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.573+0000 7f5b78dde640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7410dca0 con 0x7f5b741067f0 2024-09-20T18:43:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.573+0000 7f5b78dde640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7410db20 con 0x7f5b741007f0 2024-09-20T18:43:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.573+0000 7f5b71d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b741067f0 0x7f5b7419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.573+0000 7f5b71d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b741067f0 0x7f5b7419fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45148/0 (socket says 172.21.15.17:45148) 2024-09-20T18:43:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.573+0000 7f5b71d9b640 1 -- 172.21.15.17:0/1568968968 learned_addr learned my addr 172.21.15.17:0/1568968968 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:43:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.573+0000 7f5b7259c640 1 --2- 172.21.15.17:0/1568968968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b741007f0 0x7f5b7419f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.573+0000 7f5b71d9b640 1 -- 172.21.15.17:0/1568968968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b741007f0 msgr2=0x7f5b7419f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.573+0000 7f5b71d9b640 1 --2- 172.21.15.17:0/1568968968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b741007f0 0x7f5b7419f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.573+0000 7f5b71d9b640 1 -- 172.21.15.17:0/1568968968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b741a03c0 con 0x7f5b741067f0 2024-09-20T18:43:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.574+0000 7f5b71d9b640 1 --2- 172.21.15.17:0/1568968968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b741067f0 0x7f5b7419fd10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c031460 tx=0x7f5b5c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.574+0000 7f5b6b7fe640 1 -- 172.21.15.17:0/1568968968 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b5c03f070 con 0x7f5b741067f0 2024-09-20T18:43:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.574+0000 7f5b6b7fe640 1 -- 172.21.15.17:0/1568968968 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b5c004cf0 con 0x7f5b741067f0 2024-09-20T18:43:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.574+0000 7f5b78dde640 1 -- 172.21.15.17:0/1568968968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b74199a50 con 0x7f5b741067f0 2024-09-20T18:43:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.574+0000 7f5b6b7fe640 1 -- 172.21.15.17:0/1568968968 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b5c035030 con 0x7f5b741067f0 2024-09-20T18:43:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.574+0000 7f5b78dde640 1 -- 172.21.15.17:0/1568968968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b74199f50 con 0x7f5b741067f0 2024-09-20T18:43:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.575+0000 7f5b78dde640 1 -- 172.21.15.17:0/1568968968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b74101f30 con 0x7f5b741067f0 2024-09-20T18:43:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.576+0000 7f5b6b7fe640 1 -- 172.21.15.17:0/1568968968 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5b5c042070 con 0x7f5b741067f0 2024-09-20T18:43:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.577+0000 7f5b6b7fe640 1 --2- 172.21.15.17:0/1568968968 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b6007af80 0x7f5b6007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.577+0000 7f5b7259c640 1 --2- 172.21.15.17:0/1568968968 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b6007af80 0x7f5b6007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.577+0000 7f5b6b7fe640 1 -- 172.21.15.17:0/1568968968 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5984+0+0 (secure 0 0 0) 0x7f5b5c0be8e0 con 0x7f5b741067f0 2024-09-20T18:43:01.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.577+0000 7f5b7259c640 1 --2- 172.21.15.17:0/1568968968 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b6007af80 0x7f5b6007d440 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5b7419aad0 tx=0x7f5b6400a2d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:01.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.581+0000 7f5b6b7fe640 1 -- 172.21.15.17:0/1568968968 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5b5c089f90 con 0x7f5b741067f0 2024-09-20T18:43:01.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:01 smithi172 ceph-mon[80431]: pgmap v215: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-20T18:43:01.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:01 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-20T18:43:01.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:01 smithi172 ceph-mon[80431]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-20T18:43:01.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:01 smithi172 ceph-mon[80431]: Upgrade: osd.4 is safe to restart 2024-09-20T18:43:01.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.781+0000 7f5b78dde640 1 -- 172.21.15.17:0/1568968968 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5b7419a2c0 con 0x7f5b6007af80 2024-09-20T18:43:01.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.791+0000 7f5b6b7fe640 1 -- 172.21.15.17:0/1568968968 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5b7419a2c0 con 0x7f5b6007af80 2024-09-20T18:43:01.807 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:43:01.807 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (4m) 54s ago 15m 19.8M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:43:01.807 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (7m) 54s ago 15m 9042k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:43:01.807 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (6m) 19s ago 14m 8820k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:43:01.807 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (2m) 54s ago 15m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:43:01.807 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (2m) 19s ago 14m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:43:01.807 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (3m) 54s ago 15m 80.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:43:01.807 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (10m) 54s ago 10m 148M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:43:01.807 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (10m) 54s ago 10m 95.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:43:01.808 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (10m) 19s ago 10m 27.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:43:01.808 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (10m) 19s ago 10m 26.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:43:01.808 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (6m) 54s ago 16m 525M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:43:01.808 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (5m) 19s ago 14m 458M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:43:01.808 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (3m) 54s ago 16m 42.3M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:43:01.808 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (2m) 19s ago 14m 37.2M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:43:01.808 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (5m) 54s ago 15m 11.4M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:43:01.808 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (5m) 19s ago 14m 11.0M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:43:01.808 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (2m) 54s ago 13m 82.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:43:01.808 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (98s) 54s ago 12m 87.9M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:43:01.808 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (60s) 54s ago 12m 12.2M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:43:01.808 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (23s) 19s ago 12m 12.0M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:43:01.808 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (11m) 19s ago 11m 210M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab dc1993491fc4 2024-09-20T18:43:01.808 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (11m) 19s ago 11m 191M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:43:01.809 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (4m) 54s ago 15m 53.2M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:43:01.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.793+0000 7f5b78dde640 1 -- 172.21.15.17:0/1568968968 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b6007af80 msgr2=0x7f5b6007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:01.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.793+0000 7f5b78dde640 1 --2- 172.21.15.17:0/1568968968 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b6007af80 0x7f5b6007d440 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5b7419aad0 tx=0x7f5b6400a2d0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.793+0000 7f5b78dde640 1 -- 172.21.15.17:0/1568968968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b741067f0 msgr2=0x7f5b7419fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:01.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.793+0000 7f5b78dde640 1 --2- 172.21.15.17:0/1568968968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b741067f0 0x7f5b7419fd10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c031460 tx=0x7f5b5c0048f0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.793+0000 7f5b78dde640 1 -- 172.21.15.17:0/1568968968 shutdown_connections 2024-09-20T18:43:01.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.793+0000 7f5b78dde640 1 --2- 172.21.15.17:0/1568968968 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b6007af80 0x7f5b6007d440 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.793+0000 7f5b78dde640 1 --2- 172.21.15.17:0/1568968968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b741067f0 0x7f5b7419fd10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.793+0000 7f5b78dde640 1 --2- 172.21.15.17:0/1568968968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b741007f0 0x7f5b7419f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.793+0000 7f5b78dde640 1 -- 172.21.15.17:0/1568968968 >> 172.21.15.17:0/1568968968 conn(0x7f5b740fc550 msgr2=0x7f5b74069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:01.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.793+0000 7f5b78dde640 1 -- 172.21.15.17:0/1568968968 shutdown_connections 2024-09-20T18:43:01.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.793+0000 7f5b78dde640 1 -- 172.21.15.17:0/1568968968 wait complete. 2024-09-20T18:43:01.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.877+0000 7f7e9267e640 1 -- 172.21.15.17:0/2891327941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e8c102ac0 msgr2=0x7f7e8c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:01.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.877+0000 7f7e9267e640 1 --2- 172.21.15.17:0/2891327941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e8c102ac0 0x7f7e8c102ea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009880 tx=0x7f7e7c02a530 comp rx=0 tx=0).stop 2024-09-20T18:43:01.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.877+0000 7f7e9267e640 1 -- 172.21.15.17:0/2891327941 shutdown_connections 2024-09-20T18:43:01.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.877+0000 7f7e9267e640 1 --2- 172.21.15.17:0/2891327941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e8c1033e0 0x7f7e8c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.877+0000 7f7e9267e640 1 --2- 172.21.15.17:0/2891327941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e8c102ac0 0x7f7e8c102ea0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.877+0000 7f7e9267e640 1 -- 172.21.15.17:0/2891327941 >> 172.21.15.17:0/2891327941 conn(0x7f7e8c0fc520 msgr2=0x7f7e8c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:01.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.877+0000 7f7e9267e640 1 -- 172.21.15.17:0/2891327941 shutdown_connections 2024-09-20T18:43:01.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.877+0000 7f7e9267e640 1 -- 172.21.15.17:0/2891327941 wait complete. 2024-09-20T18:43:01.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.878+0000 7f7e9267e640 1 Processor -- start 2024-09-20T18:43:01.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.878+0000 7f7e9267e640 1 -- start start 2024-09-20T18:43:01.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.878+0000 7f7e9267e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e8c102ac0 0x7f7e8c100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:01.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.878+0000 7f7e9267e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e8c1033e0 0x7f7e8c100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:01.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.878+0000 7f7e9267e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c10edf0 con 0x7f7e8c102ac0 2024-09-20T18:43:01.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.878+0000 7f7e9267e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c10ec70 con 0x7f7e8c1033e0 2024-09-20T18:43:01.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.878+0000 7f7e8bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e8c102ac0 0x7f7e8c100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:01.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.878+0000 7f7e8bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e8c102ac0 0x7f7e8c100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45178/0 (socket says 172.21.15.17:45178) 2024-09-20T18:43:01.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.878+0000 7f7e8bfff640 1 -- 172.21.15.17:0/4074152488 learned_addr learned my addr 172.21.15.17:0/4074152488 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:43:01.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.879+0000 7f7e8bfff640 1 -- 172.21.15.17:0/4074152488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e8c1033e0 msgr2=0x7f7e8c100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:01.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.879+0000 7f7e8bfff640 1 --2- 172.21.15.17:0/4074152488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e8c1033e0 0x7f7e8c100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:01.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.879+0000 7f7e8bfff640 1 -- 172.21.15.17:0/4074152488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c1011a0 con 0x7f7e8c102ac0 2024-09-20T18:43:01.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.879+0000 7f7e8bfff640 1 --2- 172.21.15.17:0/4074152488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e8c102ac0 0x7f7e8c100720 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c031460 tx=0x7f7e7c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:01.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.879+0000 7f7e897fa640 1 -- 172.21.15.17:0/4074152488 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7e7c03f070 con 0x7f7e8c102ac0 2024-09-20T18:43:01.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.879+0000 7f7e9267e640 1 -- 172.21.15.17:0/4074152488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8c101430 con 0x7f7e8c102ac0 2024-09-20T18:43:01.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.879+0000 7f7e9267e640 1 -- 172.21.15.17:0/4074152488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8c1a3da0 con 0x7f7e8c102ac0 2024-09-20T18:43:01.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.879+0000 7f7e897fa640 1 -- 172.21.15.17:0/4074152488 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7e7c0035f0 con 0x7f7e8c102ac0 2024-09-20T18:43:01.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.879+0000 7f7e897fa640 1 -- 172.21.15.17:0/4074152488 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7e7c035030 con 0x7f7e8c102ac0 2024-09-20T18:43:01.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.880+0000 7f7e9267e640 1 -- 172.21.15.17:0/4074152488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e8c06aa90 con 0x7f7e8c102ac0 2024-09-20T18:43:01.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.881+0000 7f7e897fa640 1 -- 172.21.15.17:0/4074152488 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7e7c042070 con 0x7f7e8c102ac0 2024-09-20T18:43:01.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.881+0000 7f7e897fa640 1 --2- 172.21.15.17:0/4074152488 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e7407af80 0x7f7e7407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:01.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.881+0000 7f7e897fa640 1 -- 172.21.15.17:0/4074152488 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5984+0+0 (secure 0 0 0) 0x7f7e7c0be850 con 0x7f7e8c102ac0 2024-09-20T18:43:01.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.881+0000 7f7e8b7fe640 1 --2- 172.21.15.17:0/4074152488 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e7407af80 0x7f7e7407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:01.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.882+0000 7f7e8b7fe640 1 --2- 172.21.15.17:0/4074152488 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e7407af80 0x7f7e7407d440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e80005fd0 tx=0x7f7e80005ee0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:01.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:01.886+0000 7f7e897fa640 1 -- 172.21.15.17:0/4074152488 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7e7c089f80 con 0x7f7e8c102ac0 2024-09-20T18:43:02.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.148+0000 7f7e9267e640 1 -- 172.21.15.17:0/4074152488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7e8c101c50 con 0x7f7e8c102ac0 2024-09-20T18:43:02.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.149+0000 7f7e897fa640 1 -- 172.21.15.17:0/4074152488 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f7e7c08ee30 con 0x7f7e8c102ac0 2024-09-20T18:43:02.166 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:43:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:43:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:43:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:43:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:43:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:43:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:43:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:43:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 2, 2024-09-20T18:43:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T18:43:02.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:43:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:43:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:43:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:43:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:43:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 6, 2024-09-20T18:43:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 8 2024-09-20T18:43:02.167 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:43:02.167 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:43:02.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.151+0000 7f7e9267e640 1 -- 172.21.15.17:0/4074152488 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e7407af80 msgr2=0x7f7e7407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:02.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.151+0000 7f7e9267e640 1 --2- 172.21.15.17:0/4074152488 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e7407af80 0x7f7e7407d440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e80005fd0 tx=0x7f7e80005ee0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.151+0000 7f7e9267e640 1 -- 172.21.15.17:0/4074152488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e8c102ac0 msgr2=0x7f7e8c100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:02.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.151+0000 7f7e9267e640 1 --2- 172.21.15.17:0/4074152488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e8c102ac0 0x7f7e8c100720 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c031460 tx=0x7f7e7c0045e0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.152+0000 7f7e9267e640 1 -- 172.21.15.17:0/4074152488 shutdown_connections 2024-09-20T18:43:02.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.152+0000 7f7e9267e640 1 --2- 172.21.15.17:0/4074152488 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e7407af80 0x7f7e7407d440 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.152+0000 7f7e9267e640 1 --2- 172.21.15.17:0/4074152488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e8c1033e0 0x7f7e8c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.152+0000 7f7e9267e640 1 --2- 172.21.15.17:0/4074152488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e8c102ac0 0x7f7e8c100720 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.152+0000 7f7e9267e640 1 -- 172.21.15.17:0/4074152488 >> 172.21.15.17:0/4074152488 conn(0x7f7e8c0fc520 msgr2=0x7f7e8c108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:02.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.152+0000 7f7e9267e640 1 -- 172.21.15.17:0/4074152488 shutdown_connections 2024-09-20T18:43:02.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.152+0000 7f7e9267e640 1 -- 172.21.15.17:0/4074152488 wait complete. 2024-09-20T18:43:02.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.236+0000 7f679c943640 1 -- 172.21.15.17:0/2640618558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67980ffdc0 msgr2=0x7f6798100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:02.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.236+0000 7f679c943640 1 --2- 172.21.15.17:0/2640618558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67980ffdc0 0x7f6798100220 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f678c009880 tx=0x7f678c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.236+0000 7f679c943640 1 -- 172.21.15.17:0/2640618558 shutdown_connections 2024-09-20T18:43:02.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.236+0000 7f679c943640 1 --2- 172.21.15.17:0/2640618558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67980ffdc0 0x7f6798100220 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.236+0000 7f679c943640 1 --2- 172.21.15.17:0/2640618558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67981069a0 0x7f6798106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.236+0000 7f679c943640 1 -- 172.21.15.17:0/2640618558 >> 172.21.15.17:0/2640618558 conn(0x7f67980fbc90 msgr2=0x7f67980fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:02.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.236+0000 7f679c943640 1 -- 172.21.15.17:0/2640618558 shutdown_connections 2024-09-20T18:43:02.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.236+0000 7f679c943640 1 -- 172.21.15.17:0/2640618558 wait complete. 2024-09-20T18:43:02.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.237+0000 7f679c943640 1 Processor -- start 2024-09-20T18:43:02.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.237+0000 7f679c943640 1 -- start start 2024-09-20T18:43:02.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.237+0000 7f679c943640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67980ffdc0 0x7f679819d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:02.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.237+0000 7f679c943640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67981069a0 0x7f679819dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:02.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.237+0000 7f679c943640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f679810ef20 con 0x7f67981069a0 2024-09-20T18:43:02.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.237+0000 7f679c943640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f679810eda0 con 0x7f67980ffdc0 2024-09-20T18:43:02.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.238+0000 7f6795d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67981069a0 0x7f679819dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:02.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.238+0000 7f6795d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67981069a0 0x7f679819dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45202/0 (socket says 172.21.15.17:45202) 2024-09-20T18:43:02.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.238+0000 7f6795d9b640 1 -- 172.21.15.17:0/2490036528 learned_addr learned my addr 172.21.15.17:0/2490036528 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:43:02.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.238+0000 7f679659c640 1 --2- 172.21.15.17:0/2490036528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67980ffdc0 0x7f679819d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:02.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.238+0000 7f6795d9b640 1 -- 172.21.15.17:0/2490036528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67980ffdc0 msgr2=0x7f679819d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:02.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.238+0000 7f6795d9b640 1 --2- 172.21.15.17:0/2490036528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67980ffdc0 0x7f679819d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.238+0000 7f6795d9b640 1 -- 172.21.15.17:0/2490036528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67981978d0 con 0x7f67981069a0 2024-09-20T18:43:02.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.238+0000 7f6795d9b640 1 --2- 172.21.15.17:0/2490036528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67981069a0 0x7f679819dc50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f678c031460 tx=0x7f678c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:02.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.238+0000 7f67877fe640 1 -- 172.21.15.17:0/2490036528 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f678c03f070 con 0x7f67981069a0 2024-09-20T18:43:02.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.238+0000 7f67877fe640 1 -- 172.21.15.17:0/2490036528 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f678c0035f0 con 0x7f67981069a0 2024-09-20T18:43:02.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.238+0000 7f679c943640 1 -- 172.21.15.17:0/2490036528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6798197b60 con 0x7f67981069a0 2024-09-20T18:43:02.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.238+0000 7f67877fe640 1 -- 172.21.15.17:0/2490036528 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f678c035030 con 0x7f67981069a0 2024-09-20T18:43:02.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.238+0000 7f679c943640 1 -- 172.21.15.17:0/2490036528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6798198090 con 0x7f67981069a0 2024-09-20T18:43:02.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.239+0000 7f679c943640 1 -- 172.21.15.17:0/2490036528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67981030e0 con 0x7f67981069a0 2024-09-20T18:43:02.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.240+0000 7f67877fe640 1 -- 172.21.15.17:0/2490036528 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f678c042070 con 0x7f67981069a0 2024-09-20T18:43:02.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.241+0000 7f67877fe640 1 --2- 172.21.15.17:0/2490036528 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f678007af80 0x7f678007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:02.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.241+0000 7f67877fe640 1 -- 172.21.15.17:0/2490036528 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5984+0+0 (secure 0 0 0) 0x7f678c0be820 con 0x7f67981069a0 2024-09-20T18:43:02.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.241+0000 7f679659c640 1 --2- 172.21.15.17:0/2490036528 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f678007af80 0x7f678007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:02.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.241+0000 7f679659c640 1 --2- 172.21.15.17:0/2490036528 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f678007af80 0x7f678007d440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6798198a10 tx=0x7f678800b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:02.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.245+0000 7f67877fe640 1 -- 172.21.15.17:0/2490036528 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f678c089f50 con 0x7f67981069a0 2024-09-20T18:43:02.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.476+0000 7f679c943640 1 -- 172.21.15.17:0/2490036528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6798109e90 con 0x7f67981069a0 2024-09-20T18:43:02.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.476+0000 7f67877fe640 1 -- 172.21.15.17:0/2490036528 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2043 (secure 0 0 0) 0x7f678c08ee00 con 0x7f67981069a0 2024-09-20T18:43:02.493 INFO:teuthology.orchestra.run.smithi017.stdout:e15 2024-09-20T18:43:02.493 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:33:05:524203+0000 2024-09-20T18:43:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:43:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:43:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:43:02.494 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:43:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:43:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:43:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 15 2024-09-20T18:43:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T18:43:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:43:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:33:05.065474+0000 2024-09-20T18:43:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:43:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:43:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:43:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:43:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:43:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:43:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:43:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:43:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2024-09-20T18:43:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:43:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:43:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:43:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14552,1=24325} 2024-09-20T18:43:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-09-20T18:43:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:43:02.496 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:43:02.496 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:43:02.496 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:43:02.496 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:43:02.496 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:43:02.496 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:43:02.496 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:43:02.496 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 14552 members: 24325,14552 2024-09-20T18:43:02.496 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{0:14552} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.17:6826/3360305779,v1:172.21.15.17:6827/3360305779] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:43:02.496 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{0:14568} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.17:6828/53113052,v1:172.21.15.17:6829/53113052] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:43:02.496 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{1:24325} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.172:6824/1043027893,v1:172.21.15.172:6825/1043027893] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:43:02.496 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{1:24339} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/2975309540,v1:172.21.15.172:6827/2975309540] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:43:02.496 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:43:02.496 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:43:02.497 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 15 2024-09-20T18:43:02.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.478+0000 7f679c943640 1 -- 172.21.15.17:0/2490036528 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f678007af80 msgr2=0x7f678007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:02.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.478+0000 7f679c943640 1 --2- 172.21.15.17:0/2490036528 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f678007af80 0x7f678007d440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6798198a10 tx=0x7f678800b390 comp rx=0 tx=0).stop 2024-09-20T18:43:02.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.478+0000 7f679c943640 1 -- 172.21.15.17:0/2490036528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67981069a0 msgr2=0x7f679819dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:02.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.478+0000 7f679c943640 1 --2- 172.21.15.17:0/2490036528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67981069a0 0x7f679819dc50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f678c031460 tx=0x7f678c0045e0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.478+0000 7f679c943640 1 -- 172.21.15.17:0/2490036528 shutdown_connections 2024-09-20T18:43:02.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.479+0000 7f679c943640 1 --2- 172.21.15.17:0/2490036528 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f678007af80 0x7f678007d440 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.479+0000 7f679c943640 1 --2- 172.21.15.17:0/2490036528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67981069a0 0x7f679819dc50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.479+0000 7f679c943640 1 --2- 172.21.15.17:0/2490036528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67980ffdc0 0x7f679819d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.479+0000 7f679c943640 1 -- 172.21.15.17:0/2490036528 >> 172.21.15.17:0/2490036528 conn(0x7f67980fbc90 msgr2=0x7f67980fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:02.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.479+0000 7f679c943640 1 -- 172.21.15.17:0/2490036528 shutdown_connections 2024-09-20T18:43:02.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.479+0000 7f679c943640 1 -- 172.21.15.17:0/2490036528 wait complete. 2024-09-20T18:43:02.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.565+0000 7fd2e6ccf640 1 -- 172.21.15.17:0/4166869300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2e0103b00 msgr2=0x7fd2e0103f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:02.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.565+0000 7fd2e6ccf640 1 --2- 172.21.15.17:0/4166869300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2e0103b00 0x7fd2e0103f60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009880 tx=0x7fd2d002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.565+0000 7fd2e6ccf640 1 -- 172.21.15.17:0/4166869300 shutdown_connections 2024-09-20T18:43:02.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.565+0000 7fd2e6ccf640 1 --2- 172.21.15.17:0/4166869300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2e0103b00 0x7fd2e0103f60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.565+0000 7fd2e6ccf640 1 --2- 172.21.15.17:0/4166869300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e0109b90 0x7fd2e0109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.565+0000 7fd2e6ccf640 1 -- 172.21.15.17:0/4166869300 >> 172.21.15.17:0/4166869300 conn(0x7fd2e00ff800 msgr2=0x7fd2e0101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:02.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.565+0000 7fd2e6ccf640 1 -- 172.21.15.17:0/4166869300 shutdown_connections 2024-09-20T18:43:02.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.565+0000 7fd2e6ccf640 1 -- 172.21.15.17:0/4166869300 wait complete. 2024-09-20T18:43:02.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.566+0000 7fd2e6ccf640 1 Processor -- start 2024-09-20T18:43:02.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.566+0000 7fd2e6ccf640 1 -- start start 2024-09-20T18:43:02.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.566+0000 7fd2e6ccf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2e0103b00 0x7fd2e019f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:02.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.566+0000 7fd2e6ccf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e0109b90 0x7fd2e019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:02.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.566+0000 7fd2e6ccf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e0110fd0 con 0x7fd2e0103b00 2024-09-20T18:43:02.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.566+0000 7fd2e6ccf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e0110e50 con 0x7fd2e0109b90 2024-09-20T18:43:02.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.567+0000 7fd2e4a6b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2e0103b00 0x7fd2e019f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:02.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.567+0000 7fd2e4a6b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2e0103b00 0x7fd2e019f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45220/0 (socket says 172.21.15.17:45220) 2024-09-20T18:43:02.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.567+0000 7fd2e4a6b640 1 -- 172.21.15.17:0/1909561174 learned_addr learned my addr 172.21.15.17:0/1909561174 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:43:02.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.567+0000 7fd2d7fff640 1 --2- 172.21.15.17:0/1909561174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e0109b90 0x7fd2e019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:02.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.567+0000 7fd2e4a6b640 1 -- 172.21.15.17:0/1909561174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e0109b90 msgr2=0x7fd2e019fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:02.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.567+0000 7fd2e4a6b640 1 --2- 172.21.15.17:0/1909561174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e0109b90 0x7fd2e019fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.567+0000 7fd2e4a6b640 1 -- 172.21.15.17:0/1909561174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e0199a00 con 0x7fd2e0103b00 2024-09-20T18:43:02.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.567+0000 7fd2e4a6b640 1 --2- 172.21.15.17:0/1909561174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2e0103b00 0x7fd2e019f840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00d6f0 tx=0x7fd2dc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:02.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.567+0000 7fd2d5ffb640 1 -- 172.21.15.17:0/1909561174 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2dc017070 con 0x7fd2e0103b00 2024-09-20T18:43:02.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.567+0000 7fd2d5ffb640 1 -- 172.21.15.17:0/1909561174 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd2dc00de00 con 0x7fd2e0103b00 2024-09-20T18:43:02.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.567+0000 7fd2e6ccf640 1 -- 172.21.15.17:0/1909561174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e0199cf0 con 0x7fd2e0103b00 2024-09-20T18:43:02.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.567+0000 7fd2d5ffb640 1 -- 172.21.15.17:0/1909561174 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2dc004bb0 con 0x7fd2e0103b00 2024-09-20T18:43:02.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.568+0000 7fd2e6ccf640 1 -- 172.21.15.17:0/1909561174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e019a250 con 0x7fd2e0103b00 2024-09-20T18:43:02.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.569+0000 7fd2e6ccf640 1 -- 172.21.15.17:0/1909561174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e0105200 con 0x7fd2e0103b00 2024-09-20T18:43:02.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.569+0000 7fd2d5ffb640 1 -- 172.21.15.17:0/1909561174 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd2dc004e60 con 0x7fd2e0103b00 2024-09-20T18:43:02.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.570+0000 7fd2d5ffb640 1 --2- 172.21.15.17:0/1909561174 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd2c807af30 0x7fd2c807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:02.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.570+0000 7fd2d5ffb640 1 -- 172.21.15.17:0/1909561174 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5984+0+0 (secure 0 0 0) 0x7fd2dc09db70 con 0x7fd2e0103b00 2024-09-20T18:43:02.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.570+0000 7fd2d7fff640 1 --2- 172.21.15.17:0/1909561174 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd2c807af30 0x7fd2c807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:02.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.570+0000 7fd2d7fff640 1 --2- 172.21.15.17:0/1909561174 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd2c807af30 0x7fd2c807d3f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd2e019b1f0 tx=0x7fd2d0031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:02.588 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:02 smithi172 ceph-mon[80431]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:43:02.588 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:02 smithi172 ceph-mon[80431]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:43:02.588 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:02 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:02.589 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:02 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-20T18:43:02.589 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:02 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:43:02.589 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:02 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:02.589 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:02 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4074152488' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:02.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.578+0000 7fd2d5ffb640 1 -- 172.21.15.17:0/1909561174 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd2dc0691a0 con 0x7fd2e0103b00 2024-09-20T18:43:02.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.784+0000 7fd2e6ccf640 1 -- 172.21.15.17:0/1909561174 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd2e019af30 con 0x7fd2c807af30 2024-09-20T18:43:02.816 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:02 smithi017 ceph-mon[108970]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:43:02.816 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:02 smithi017 ceph-mon[108970]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:43:02.816 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:02 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:02.816 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:02 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-20T18:43:02.816 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:02 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:43:02.816 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:02 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:02.816 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:02 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4074152488' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:02.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.786+0000 7fd2d5ffb640 1 -- 172.21.15.17:0/1909561174 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fd2e019af30 con 0x7fd2c807af30 2024-09-20T18:43:02.817 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:43:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:43:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:43:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:43:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:43:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:43:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:43:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:43:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:43:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "10/23 daemons upgraded", 2024-09-20T18:43:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T18:43:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:43:02.818 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:43:02.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.789+0000 7fd2e6ccf640 1 -- 172.21.15.17:0/1909561174 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd2c807af30 msgr2=0x7fd2c807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:02.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.789+0000 7fd2e6ccf640 1 --2- 172.21.15.17:0/1909561174 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd2c807af30 0x7fd2c807d3f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd2e019b1f0 tx=0x7fd2d0031400 comp rx=0 tx=0).stop 2024-09-20T18:43:02.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.789+0000 7fd2e6ccf640 1 -- 172.21.15.17:0/1909561174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2e0103b00 msgr2=0x7fd2e019f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:02.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.789+0000 7fd2e6ccf640 1 --2- 172.21.15.17:0/1909561174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2e0103b00 0x7fd2e019f840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00d6f0 tx=0x7fd2dc00dbb0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.789+0000 7fd2e6ccf640 1 -- 172.21.15.17:0/1909561174 shutdown_connections 2024-09-20T18:43:02.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.789+0000 7fd2e6ccf640 1 --2- 172.21.15.17:0/1909561174 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd2c807af30 0x7fd2c807d3f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.789+0000 7fd2e6ccf640 1 --2- 172.21.15.17:0/1909561174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e0109b90 0x7fd2e019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.789+0000 7fd2e6ccf640 1 --2- 172.21.15.17:0/1909561174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2e0103b00 0x7fd2e019f840 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.789+0000 7fd2e6ccf640 1 -- 172.21.15.17:0/1909561174 >> 172.21.15.17:0/1909561174 conn(0x7fd2e00ff800 msgr2=0x7fd2e0100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:02.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.789+0000 7fd2e6ccf640 1 -- 172.21.15.17:0/1909561174 shutdown_connections 2024-09-20T18:43:02.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.789+0000 7fd2e6ccf640 1 -- 172.21.15.17:0/1909561174 wait complete. 2024-09-20T18:43:02.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.875+0000 7f8150fd9640 1 -- 172.21.15.17:0/3259612676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f814c1067f0 msgr2=0x7f814c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:02.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.875+0000 7f8150fd9640 1 --2- 172.21.15.17:0/3259612676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f814c1067f0 0x7f814c106bd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f813c009880 tx=0x7f813c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.875+0000 7f8150fd9640 1 -- 172.21.15.17:0/3259612676 shutdown_connections 2024-09-20T18:43:02.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.875+0000 7f8150fd9640 1 --2- 172.21.15.17:0/3259612676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f814c1007f0 0x7f814c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.875+0000 7f8150fd9640 1 --2- 172.21.15.17:0/3259612676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f814c1067f0 0x7f814c106bd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.875+0000 7f8150fd9640 1 -- 172.21.15.17:0/3259612676 >> 172.21.15.17:0/3259612676 conn(0x7f814c0fc550 msgr2=0x7f814c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:02.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.875+0000 7f8150fd9640 1 -- 172.21.15.17:0/3259612676 shutdown_connections 2024-09-20T18:43:02.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.875+0000 7f8150fd9640 1 -- 172.21.15.17:0/3259612676 wait complete. 2024-09-20T18:43:02.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.875+0000 7f8150fd9640 1 Processor -- start 2024-09-20T18:43:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.875+0000 7f8150fd9640 1 -- start start 2024-09-20T18:43:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.876+0000 7f8150fd9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f814c1007f0 0x7f814c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.876+0000 7f8150fd9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f814c1067f0 0x7f814c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.876+0000 7f8150fd9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f814c10dca0 con 0x7f814c1007f0 2024-09-20T18:43:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.876+0000 7f8150fd9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f814c10db20 con 0x7f814c1067f0 2024-09-20T18:43:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.876+0000 7f814a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f814c1007f0 0x7f814c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.876+0000 7f814a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f814c1007f0 0x7f814c19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45238/0 (socket says 172.21.15.17:45238) 2024-09-20T18:43:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.876+0000 7f814a59c640 1 -- 172.21.15.17:0/3798434317 learned_addr learned my addr 172.21.15.17:0/3798434317 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:43:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.876+0000 7f8143fff640 1 --2- 172.21.15.17:0/3798434317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f814c1067f0 0x7f814c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.876+0000 7f814a59c640 1 -- 172.21.15.17:0/3798434317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f814c1067f0 msgr2=0x7f814c19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.876+0000 7f814a59c640 1 --2- 172.21.15.17:0/3798434317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f814c1067f0 0x7f814c19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.876+0000 7f814a59c640 1 -- 172.21.15.17:0/3798434317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f814c197750 con 0x7f814c1007f0 2024-09-20T18:43:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.876+0000 7f814a59c640 1 --2- 172.21.15.17:0/3798434317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f814c1007f0 0x7f814c19d680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f813c031460 tx=0x7f813c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:02.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.876+0000 7f81437fe640 1 -- 172.21.15.17:0/3798434317 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f813c03f070 con 0x7f814c1007f0 2024-09-20T18:43:02.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.876+0000 7f81437fe640 1 -- 172.21.15.17:0/3798434317 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f813c004cf0 con 0x7f814c1007f0 2024-09-20T18:43:02.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.876+0000 7f8150fd9640 1 -- 172.21.15.17:0/3798434317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f814c1979e0 con 0x7f814c1007f0 2024-09-20T18:43:02.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.877+0000 7f81437fe640 1 -- 172.21.15.17:0/3798434317 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f813c035030 con 0x7f814c1007f0 2024-09-20T18:43:02.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.877+0000 7f8150fd9640 1 -- 172.21.15.17:0/3798434317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f814c197f10 con 0x7f814c1007f0 2024-09-20T18:43:02.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.877+0000 7f8150fd9640 1 -- 172.21.15.17:0/3798434317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f814c101f30 con 0x7f814c1007f0 2024-09-20T18:43:02.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.878+0000 7f81437fe640 1 -- 172.21.15.17:0/3798434317 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f813c042070 con 0x7f814c1007f0 2024-09-20T18:43:02.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.879+0000 7f81437fe640 1 --2- 172.21.15.17:0/3798434317 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f813807af30 0x7f813807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:02.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.879+0000 7f81437fe640 1 -- 172.21.15.17:0/3798434317 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5984+0+0 (secure 0 0 0) 0x7f813c0be920 con 0x7f814c1007f0 2024-09-20T18:43:02.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.879+0000 7f8143fff640 1 --2- 172.21.15.17:0/3798434317 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f813807af30 0x7f813807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:02.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.879+0000 7f8143fff640 1 --2- 172.21.15.17:0/3798434317 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f813807af30 0x7f813807d3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f814c198fa0 tx=0x7f813400a2d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:02.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:02.883+0000 7f81437fe640 1 -- 172.21.15.17:0/3798434317 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f813c089fd0 con 0x7f814c1007f0 2024-09-20T18:43:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:03.150+0000 7f8150fd9640 1 -- 172.21.15.17:0/3798434317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f814c1981c0 con 0x7f814c1007f0 2024-09-20T18:43:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:03.151+0000 7f81437fe640 1 -- 172.21.15.17:0/3798434317 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f813c08ee80 con 0x7f814c1007f0 2024-09-20T18:43:03.167 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T18:43:03.168 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:43:03.168 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:43:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:03.153+0000 7f8150fd9640 1 -- 172.21.15.17:0/3798434317 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f813807af30 msgr2=0x7f813807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:03.153+0000 7f8150fd9640 1 --2- 172.21.15.17:0/3798434317 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f813807af30 0x7f813807d3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f814c198fa0 tx=0x7f813400a2d0 comp rx=0 tx=0).stop 2024-09-20T18:43:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:03.153+0000 7f8150fd9640 1 -- 172.21.15.17:0/3798434317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f814c1007f0 msgr2=0x7f814c19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:03.153+0000 7f8150fd9640 1 --2- 172.21.15.17:0/3798434317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f814c1007f0 0x7f814c19d680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f813c031460 tx=0x7f813c0048f0 comp rx=0 tx=0).stop 2024-09-20T18:43:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:03.153+0000 7f8150fd9640 1 -- 172.21.15.17:0/3798434317 shutdown_connections 2024-09-20T18:43:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:03.153+0000 7f8150fd9640 1 --2- 172.21.15.17:0/3798434317 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f813807af30 0x7f813807d3f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:03.153+0000 7f8150fd9640 1 --2- 172.21.15.17:0/3798434317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f814c1067f0 0x7f814c19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:03.153+0000 7f8150fd9640 1 --2- 172.21.15.17:0/3798434317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f814c1007f0 0x7f814c19d680 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:03.153+0000 7f8150fd9640 1 -- 172.21.15.17:0/3798434317 >> 172.21.15.17:0/3798434317 conn(0x7f814c0fc550 msgr2=0x7f814c069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:03.153+0000 7f8150fd9640 1 -- 172.21.15.17:0/3798434317 shutdown_connections 2024-09-20T18:43:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:03.153+0000 7f8150fd9640 1 -- 172.21.15.17:0/3798434317 wait complete. 2024-09-20T18:43:03.724 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:03 smithi172 ceph-mon[80431]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:43:03.724 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:03 smithi172 ceph-mon[80431]: Upgrade: Updating osd.4 2024-09-20T18:43:03.724 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:03 smithi172 ceph-mon[80431]: Deploying daemon osd.4 on smithi172 2024-09-20T18:43:03.724 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:03 smithi172 ceph-mon[80431]: pgmap v216: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:43:03.724 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:03 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2490036528' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:43:03.725 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:03 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3798434317' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:43:03.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:03 smithi017 ceph-mon[108970]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:43:03.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:03 smithi017 ceph-mon[108970]: Upgrade: Updating osd.4 2024-09-20T18:43:03.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:03 smithi017 ceph-mon[108970]: Deploying daemon osd.4 on smithi172 2024-09-20T18:43:03.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:03 smithi017 ceph-mon[108970]: pgmap v216: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:43:03.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:03 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2490036528' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:43:03.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:03 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3798434317' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:43:04.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:04 smithi172 ceph-mon[80431]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:43:04.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:04 smithi017 ceph-mon[108970]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:43:05.336 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:05 smithi172 systemd[1]: Stopping Ceph osd.4 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:43:05.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:05 smithi172 ceph-mon[80431]: pgmap v217: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:43:05.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:05 smithi172 ceph-mon[80431]: osd.4 marked itself down and dead 2024-09-20T18:43:05.711 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:05 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[48111]: 2024-09-20T18:43:05.319+0000 7f13d865f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T18:43:05.711 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:05 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[48111]: 2024-09-20T18:43:05.319+0000 7f13d865f640 -1 osd.4 66 *** Got signal Terminated *** 2024-09-20T18:43:05.711 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:05 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[48111]: 2024-09-20T18:43:05.319+0000 7f13d865f640 -1 osd.4 66 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T18:43:05.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:05 smithi017 ceph-mon[108970]: pgmap v217: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:43:05.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:05 smithi017 ceph-mon[108970]: osd.4 marked itself down and dead 2024-09-20T18:43:06.186 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:05 smithi172 podman[92604]: 2024-09-20 18:43:05.893296686 +0000 UTC m=+0.684742284 container died dc1993491fc4f0fd95656fcb3741ed55f94d7917d064bf8f5e7916bc7c0062eb (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-ed8ee0f, org.label-schema.build-date=20240731) 2024-09-20T18:43:06.460 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:06 smithi172 podman[92604]: 2024-09-20 18:43:06.270422591 +0000 UTC m=+1.061868170 container cleanup dc1993491fc4f0fd95656fcb3741ed55f94d7917d064bf8f5e7916bc7c0062eb (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ed8ee0f, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-20T18:43:06.460 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:06 smithi172 bash[92604]: ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4 2024-09-20T18:43:06.849 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:06 smithi172 ceph-mon[80431]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T18:43:06.849 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:06 smithi172 ceph-mon[80431]: osdmap e67: 6 total, 5 up, 6 in 2024-09-20T18:43:06.849 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:06 smithi172 ceph-mon[80431]: osdmap e68: 6 total, 5 up, 6 in 2024-09-20T18:43:06.850 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:06 smithi172 podman[92624]: 2024-09-20 18:43:06.522080711 +0000 UTC m=+0.631852318 container remove dc1993491fc4f0fd95656fcb3741ed55f94d7917d064bf8f5e7916bc7c0062eb (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-ed8ee0f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-20T18:43:06.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:06 smithi017 ceph-mon[108970]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T18:43:06.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:06 smithi017 ceph-mon[108970]: osdmap e67: 6 total, 5 up, 6 in 2024-09-20T18:43:06.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:06 smithi017 ceph-mon[108970]: osdmap e68: 6 total, 5 up, 6 in 2024-09-20T18:43:07.183 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:06 smithi172 podman[92709]: 2024-09-20 18:43:06.737087777 +0000 UTC m=+0.016380425 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:43:07.183 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:06 smithi172 podman[92709]: 2024-09-20 18:43:06.864656285 +0000 UTC m=+0.143948927 container create d3053aeac09de8f96cb22c79fb1ac051deb74dffb1982b6b8edf7230c4ff74ba (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-20T18:43:07.183 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:07 smithi172 podman[92709]: 2024-09-20 18:43:07.067276439 +0000 UTC m=+0.346569087 container init d3053aeac09de8f96cb22c79fb1ac051deb74dffb1982b6b8edf7230c4ff74ba (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-20T18:43:07.183 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:07 smithi172 podman[92709]: 2024-09-20 18:43:07.070605866 +0000 UTC m=+0.349898510 container start d3053aeac09de8f96cb22c79fb1ac051deb74dffb1982b6b8edf7230c4ff74ba (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-09-20T18:43:07.183 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:07 smithi172 podman[92709]: 2024-09-20 18:43:07.167551964 +0000 UTC m=+0.446844624 container attach d3053aeac09de8f96cb22c79fb1ac051deb74dffb1982b6b8edf7230c4ff74ba (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-20T18:43:07.461 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:07 smithi172 podman[92709]: 2024-09-20 18:43:07.259452423 +0000 UTC m=+0.538745065 container died d3053aeac09de8f96cb22c79fb1ac051deb74dffb1982b6b8edf7230c4ff74ba (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-20T18:43:07.802 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:07 smithi017 ceph-mon[108970]: pgmap v219: 65 pgs: 8 peering, 5 stale+active+clean, 52 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:43:07.802 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:07 smithi017 ceph-mon[108970]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-20T18:43:07.802 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:07.802 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:43:07.869 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:07 smithi172 ceph-mon[80431]: pgmap v219: 65 pgs: 8 peering, 5 stale+active+clean, 52 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:43:07.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:07 smithi172 ceph-mon[80431]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-20T18:43:07.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:07.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:43:08.210 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:07 smithi172 podman[92732]: 2024-09-20 18:43:07.854698776 +0000 UTC m=+0.590389106 container remove d3053aeac09de8f96cb22c79fb1ac051deb74dffb1982b6b8edf7230c4ff74ba (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-20T18:43:08.211 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:07 smithi172 systemd[1]: ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.4.service: Deactivated successfully. 2024-09-20T18:43:08.211 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:07 smithi172 systemd[1]: Stopped Ceph osd.4 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:43:08.211 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:07 smithi172 systemd[1]: ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.4.service: Consumed 54.411s CPU time. 2024-09-20T18:43:08.211 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:08 smithi172 systemd[1]: Starting Ceph osd.4 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:43:08.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:08 smithi172 ceph-mon[80431]: Health check failed: Degraded data redundancy: 43/318 objects degraded (13.522%), 11 pgs degraded (PG_DEGRADED) 2024-09-20T18:43:08.623 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:08 smithi172 podman[92833]: 2024-09-20 18:43:08.190206973 +0000 UTC m=+0.015588010 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:43:08.624 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:08 smithi172 podman[92833]: 2024-09-20 18:43:08.288833867 +0000 UTC m=+0.114214900 container create f8ec5025942b9973aac3c78d4e848f053da75946a3419a1e4fd3c9b98d17402c (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-20T18:43:08.624 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:08 smithi172 podman[92833]: 2024-09-20 18:43:08.516581704 +0000 UTC m=+0.341962738 container init f8ec5025942b9973aac3c78d4e848f053da75946a3419a1e4fd3c9b98d17402c (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-20T18:43:08.624 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:08 smithi172 podman[92833]: 2024-09-20 18:43:08.520165594 +0000 UTC m=+0.345546628 container start f8ec5025942b9973aac3c78d4e848f053da75946a3419a1e4fd3c9b98d17402c (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T18:43:08.624 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:08 smithi172 podman[92833]: 2024-09-20 18:43:08.608230375 +0000 UTC m=+0.433611402 container attach f8ec5025942b9973aac3c78d4e848f053da75946a3419a1e4fd3c9b98d17402c (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-20T18:43:08.819 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:08 smithi017 ceph-mon[108970]: Health check failed: Degraded data redundancy: 43/318 objects degraded (13.522%), 11 pgs degraded (PG_DEGRADED) 2024-09-20T18:43:08.960 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:08 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:43:08.961 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:08 smithi172 bash[92833]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:43:08.961 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:08 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:43:08.961 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:08 smithi172 bash[92833]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:43:09.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:09 smithi017 ceph-mon[108970]: pgmap v221: 65 pgs: 13 active+undersized, 8 peering, 1 stale+active+clean, 11 active+undersized+degraded, 32 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 43/318 objects degraded (13.522%) 2024-09-20T18:43:09.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:09 smithi172 ceph-mon[80431]: pgmap v221: 65 pgs: 13 active+undersized, 8 peering, 1 stale+active+clean, 11 active+undersized+degraded, 32 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 43/318 objects degraded (13.522%) 2024-09-20T18:43:11.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:11 smithi172 ceph-mon[80431]: pgmap v222: 65 pgs: 15 active+undersized, 8 peering, 11 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 43/318 objects degraded (13.522%) 2024-09-20T18:43:11.711 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate[92849]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T18:43:11.711 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:43:11.711 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 bash[92833]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T18:43:11.711 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 bash[92833]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:43:11.711 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:43:11.711 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 bash[92833]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:43:11.711 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-20T18:43:11.711 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 bash[92833]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-20T18:43:11.711 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-09-20T18:43:11.711 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 bash[92833]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-09-20T18:43:11.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:11 smithi017 ceph-mon[108970]: pgmap v222: 65 pgs: 15 active+undersized, 8 peering, 11 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 43/318 objects degraded (13.522%) 2024-09-20T18:43:12.177 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-20T18:43:12.177 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 bash[92833]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-20T18:43:12.177 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-09-20T18:43:12.178 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 bash[92833]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-09-20T18:43:12.178 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-20T18:43:12.178 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 bash[92833]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-20T18:43:12.178 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-20T18:43:12.178 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 bash[92833]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-20T18:43:12.178 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate[92849]: --> ceph-volume lvm activate successful for osd ID: 4 2024-09-20T18:43:12.178 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 bash[92833]: --> ceph-volume lvm activate successful for osd ID: 4 2024-09-20T18:43:12.178 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:11 smithi172 podman[92833]: 2024-09-20 18:43:11.824622151 +0000 UTC m=+3.650003184 container died f8ec5025942b9973aac3c78d4e848f053da75946a3419a1e4fd3c9b98d17402c (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-20T18:43:12.841 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:12 smithi172 ceph-mon[80431]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-20T18:43:12.842 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:12 smithi172 podman[93046]: 2024-09-20 18:43:12.495505244 +0000 UTC m=+0.664115087 container remove f8ec5025942b9973aac3c78d4e848f053da75946a3419a1e4fd3c9b98d17402c (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-activate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-20T18:43:12.842 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:12 smithi172 podman[93104]: 2024-09-20 18:43:12.608394194 +0000 UTC m=+0.016206588 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:43:12.842 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:12 smithi172 podman[93104]: 2024-09-20 18:43:12.729917656 +0000 UTC m=+0.137730036 container create 621ed127d3879defe8b49e474cd7b7a057ffff04a8fa400a2c8ce585a0d7b2b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T18:43:12.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:12 smithi017 ceph-mon[108970]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-20T18:43:13.210 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:12 smithi172 podman[93104]: 2024-09-20 18:43:12.950205441 +0000 UTC m=+0.358017831 container init 621ed127d3879defe8b49e474cd7b7a057ffff04a8fa400a2c8ce585a0d7b2b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-09-20T18:43:13.211 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:12 smithi172 podman[93104]: 2024-09-20 18:43:12.953607425 +0000 UTC m=+0.361419816 container start 621ed127d3879defe8b49e474cd7b7a057ffff04a8fa400a2c8ce585a0d7b2b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T18:43:13.211 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:12 smithi172 ceph-osd[93122]: -- 172.21.15.172:0/3360672788 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564798fc21e0 con 0x564798f52000 2024-09-20T18:43:13.211 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:13 smithi172 bash[93104]: 621ed127d3879defe8b49e474cd7b7a057ffff04a8fa400a2c8ce585a0d7b2b2 2024-09-20T18:43:13.211 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:13 smithi172 systemd[1]: Started Ceph osd.4 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:43:13.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:13 smithi017 ceph-mon[108970]: pgmap v223: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 53/318 objects degraded (16.667%) 2024-09-20T18:43:13.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:13 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:13.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:13 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:13.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:13 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:43:13.951 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:13 smithi172 ceph-mon[80431]: pgmap v223: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 53/318 objects degraded (16.667%) 2024-09-20T18:43:13.951 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:13 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:13.951 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:13 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:13.951 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:13 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:43:15.174 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:14 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T18:43:14.818+0000 7f50c9c30640 -1 Falling back to public interface 2024-09-20T18:43:15.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:15 smithi017 ceph-mon[108970]: pgmap v224: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 53/318 objects degraded (16.667%) 2024-09-20T18:43:15.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:15 smithi172 ceph-mon[80431]: pgmap v224: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 53/318 objects degraded (16.667%) 2024-09-20T18:43:17.187 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:16 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:17.187 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:16 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:17.187 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:16 smithi172 ceph-mon[80431]: pgmap v225: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 53/318 objects degraded (16.667%) 2024-09-20T18:43:17.188 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:16 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:17.188 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:16 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:17.188 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:16 smithi172 ceph-mon[80431]: Health check update: Degraded data redundancy: 53/318 objects degraded (16.667%), 15 pgs degraded (PG_DEGRADED) 2024-09-20T18:43:17.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:16 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:17.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:16 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:17.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:16 smithi017 ceph-mon[108970]: pgmap v225: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 53/318 objects degraded (16.667%) 2024-09-20T18:43:17.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:16 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:17.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:16 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:17.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:16 smithi017 ceph-mon[108970]: Health check update: Degraded data redundancy: 53/318 objects degraded (16.667%), 15 pgs degraded (PG_DEGRADED) 2024-09-20T18:43:19.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:19 smithi172 ceph-mon[80431]: pgmap v226: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 53/318 objects degraded (16.667%) 2024-09-20T18:43:19.680 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:19 smithi017 ceph-mon[108970]: pgmap v226: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 53/318 objects degraded (16.667%) 2024-09-20T18:43:20.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:20 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:20.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:20 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:20.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:20 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:43:20.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:20 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:43:20.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:20 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:20.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:20 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:43:20.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:20 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:20.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:20 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:20.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:20 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:20.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:20 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-20T18:43:20.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:20 smithi017 ceph-mon[108970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T18:43:20.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:20 smithi017 ceph-mon[108970]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-20T18:43:20.961 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:20 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T18:43:20.766+0000 7f50c9c30640 -1 osd.4 66 log_to_monitors true 2024-09-20T18:43:20.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:20 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:20.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:20 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:20.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:20 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:43:20.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:20 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:43:20.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:20 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:20.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:20 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:43:20.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:20 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:20.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:20 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:20.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:20 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:20.963 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:20 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-20T18:43:20.963 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:20 smithi172 ceph-mon[80431]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T18:43:20.963 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:20 smithi172 ceph-mon[80431]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-20T18:43:21.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:21 smithi017 ceph-mon[108970]: pgmap v227: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 53/318 objects degraded (16.667%) 2024-09-20T18:43:21.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:21 smithi017 ceph-mon[108970]: from='osd.4 [v2:172.21.15.172:6808/3081082340,v1:172.21.15.172:6809/3081082340]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-20T18:43:21.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:21 smithi017 ceph-mon[108970]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-20T18:43:21.960 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 18:43:21 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T18:43:21.604+0000 7f50bd9d2640 -1 osd.4 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T18:43:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:21 smithi172 ceph-mon[80431]: pgmap v227: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 53/318 objects degraded (16.667%) 2024-09-20T18:43:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:21 smithi172 ceph-mon[80431]: from='osd.4 [v2:172.21.15.172:6808/3081082340,v1:172.21.15.172:6809/3081082340]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-20T18:43:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:21 smithi172 ceph-mon[80431]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-20T18:43:22.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:22 smithi017 ceph-mon[108970]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-20T18:43:22.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:22 smithi017 ceph-mon[108970]: osdmap e69: 6 total, 5 up, 6 in 2024-09-20T18:43:22.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:22 smithi017 ceph-mon[108970]: from='osd.4 [v2:172.21.15.172:6808/3081082340,v1:172.21.15.172:6809/3081082340]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-20T18:43:22.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:22 smithi017 ceph-mon[108970]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-20T18:43:22.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:22.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:43:22.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:22 smithi172 ceph-mon[80431]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-20T18:43:22.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:22 smithi172 ceph-mon[80431]: osdmap e69: 6 total, 5 up, 6 in 2024-09-20T18:43:22.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:22 smithi172 ceph-mon[80431]: from='osd.4 [v2:172.21.15.172:6808/3081082340,v1:172.21.15.172:6809/3081082340]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-20T18:43:22.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:22 smithi172 ceph-mon[80431]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-20T18:43:22.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:22.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:43:23.861 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:23 smithi172 ceph-mon[80431]: pgmap v229: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 53/318 objects degraded (16.667%) 2024-09-20T18:43:23.862 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:23 smithi172 ceph-mon[80431]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T18:43:23.862 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:23 smithi172 ceph-mon[80431]: osd.4 [v2:172.21.15.172:6808/3081082340,v1:172.21.15.172:6809/3081082340] boot 2024-09-20T18:43:23.862 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:23 smithi172 ceph-mon[80431]: osdmap e70: 6 total, 6 up, 6 in 2024-09-20T18:43:23.862 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:23 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-20T18:43:23.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:23 smithi017 ceph-mon[108970]: pgmap v229: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 53/318 objects degraded (16.667%) 2024-09-20T18:43:23.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:23 smithi017 ceph-mon[108970]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T18:43:23.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:23 smithi017 ceph-mon[108970]: osd.4 [v2:172.21.15.172:6808/3081082340,v1:172.21.15.172:6809/3081082340] boot 2024-09-20T18:43:23.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:23 smithi017 ceph-mon[108970]: osdmap e70: 6 total, 6 up, 6 in 2024-09-20T18:43:23.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:23 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-20T18:43:24.881 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:24 smithi172 ceph-mon[80431]: osdmap e71: 6 total, 6 up, 6 in 2024-09-20T18:43:24.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:24 smithi017 ceph-mon[108970]: osdmap e71: 6 total, 6 up, 6 in 2024-09-20T18:43:25.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:25 smithi017 ceph-mon[108970]: pgmap v232: 65 pgs: 6 peering, 15 active+undersized, 12 active+undersized+degraded, 32 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 46/318 objects degraded (14.465%) 2024-09-20T18:43:25.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:25 smithi017 ceph-mon[108970]: Health check update: Degraded data redundancy: 46/318 objects degraded (14.465%), 12 pgs degraded (PG_DEGRADED) 2024-09-20T18:43:25.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:25 smithi172 ceph-mon[80431]: pgmap v232: 65 pgs: 6 peering, 15 active+undersized, 12 active+undersized+degraded, 32 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 46/318 objects degraded (14.465%) 2024-09-20T18:43:25.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:25 smithi172 ceph-mon[80431]: Health check update: Degraded data redundancy: 46/318 objects degraded (14.465%), 12 pgs degraded (PG_DEGRADED) 2024-09-20T18:43:27.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:27 smithi017 ceph-mon[108970]: pgmap v233: 65 pgs: 6 peering, 12 active+undersized, 8 active+undersized+degraded, 39 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 36/318 objects degraded (11.321%) 2024-09-20T18:43:27.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:27 smithi172 ceph-mon[80431]: pgmap v233: 65 pgs: 6 peering, 12 active+undersized, 8 active+undersized+degraded, 39 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 36/318 objects degraded (11.321%) 2024-09-20T18:43:28.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:28 smithi017 ceph-mon[108970]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 36/318 objects degraded (11.321%), 8 pgs degraded) 2024-09-20T18:43:28.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:28 smithi172 ceph-mon[80431]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 36/318 objects degraded (11.321%), 8 pgs degraded) 2024-09-20T18:43:29.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:29 smithi172 ceph-mon[80431]: pgmap v234: 65 pgs: 65 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 4 op/s 2024-09-20T18:43:30.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:29 smithi017 ceph-mon[108970]: pgmap v234: 65 pgs: 65 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 4 op/s 2024-09-20T18:43:31.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:31 smithi017 ceph-mon[108970]: pgmap v235: 65 pgs: 65 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-20T18:43:31.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:31 smithi172 ceph-mon[80431]: pgmap v235: 65 pgs: 65 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-20T18:43:33.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.244+0000 7f302a438640 1 -- 172.21.15.17:0/2517770693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3024107900 msgr2=0x7f3024107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:33.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.244+0000 7f302a438640 1 --2- 172.21.15.17:0/2517770693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3024107900 0x7f3024107ce0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3014009880 tx=0x7f301402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.244+0000 7f302a438640 1 -- 172.21.15.17:0/2517770693 shutdown_connections 2024-09-20T18:43:33.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.244+0000 7f302a438640 1 --2- 172.21.15.17:0/2517770693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3024101900 0x7f3024101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.244+0000 7f302a438640 1 --2- 172.21.15.17:0/2517770693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3024107900 0x7f3024107ce0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.244+0000 7f302a438640 1 -- 172.21.15.17:0/2517770693 >> 172.21.15.17:0/2517770693 conn(0x7f30240fd600 msgr2=0x7f30240ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:33.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.244+0000 7f302a438640 1 -- 172.21.15.17:0/2517770693 shutdown_connections 2024-09-20T18:43:33.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.244+0000 7f302a438640 1 -- 172.21.15.17:0/2517770693 wait complete. 2024-09-20T18:43:33.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.245+0000 7f302a438640 1 Processor -- start 2024-09-20T18:43:33.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.245+0000 7f302a438640 1 -- start start 2024-09-20T18:43:33.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.245+0000 7f302a438640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3024101900 0x7f30240744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:33.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.245+0000 7f302a438640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3024107900 0x7f3024074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:33.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.245+0000 7f302a438640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f302410edb0 con 0x7f3024101900 2024-09-20T18:43:33.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.245+0000 7f302a438640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f302410ec30 con 0x7f3024107900 2024-09-20T18:43:33.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.245+0000 7f3023fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3024101900 0x7f30240744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:33.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.245+0000 7f3023fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3024101900 0x7f30240744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35192/0 (socket says 172.21.15.17:35192) 2024-09-20T18:43:33.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.245+0000 7f3023fff640 1 -- 172.21.15.17:0/1192764537 learned_addr learned my addr 172.21.15.17:0/1192764537 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:43:33.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.246+0000 7f30237fe640 1 --2- 172.21.15.17:0/1192764537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3024107900 0x7f3024074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:33.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.246+0000 7f3023fff640 1 -- 172.21.15.17:0/1192764537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3024107900 msgr2=0x7f3024074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:33.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.246+0000 7f3023fff640 1 --2- 172.21.15.17:0/1192764537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3024107900 0x7f3024074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.246+0000 7f3023fff640 1 -- 172.21.15.17:0/1192764537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3024074f70 con 0x7f3024101900 2024-09-20T18:43:33.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.246+0000 7f30237fe640 1 --2- 172.21.15.17:0/1192764537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3024107900 0x7f3024074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:43:33.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.246+0000 7f3023fff640 1 --2- 172.21.15.17:0/1192764537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3024101900 0x7f30240744f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3014031460 tx=0x7f30140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:33.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.246+0000 7f30217fa640 1 -- 172.21.15.17:0/1192764537 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f301403f070 con 0x7f3024101900 2024-09-20T18:43:33.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.246+0000 7f302a438640 1 -- 172.21.15.17:0/1192764537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3024075200 con 0x7f3024101900 2024-09-20T18:43:33.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.246+0000 7f30217fa640 1 -- 172.21.15.17:0/1192764537 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3014004cf0 con 0x7f3024101900 2024-09-20T18:43:33.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.246+0000 7f30217fa640 1 -- 172.21.15.17:0/1192764537 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3014035030 con 0x7f3024101900 2024-09-20T18:43:33.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.246+0000 7f302a438640 1 -- 172.21.15.17:0/1192764537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30241a3d50 con 0x7f3024101900 2024-09-20T18:43:33.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.247+0000 7f302a438640 1 -- 172.21.15.17:0/1192764537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3024103040 con 0x7f3024101900 2024-09-20T18:43:33.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.248+0000 7f30217fa640 1 -- 172.21.15.17:0/1192764537 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3014042070 con 0x7f3024101900 2024-09-20T18:43:33.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.248+0000 7f30217fa640 1 --2- 172.21.15.17:0/1192764537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f300c07af30 0x7f300c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:33.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.248+0000 7f30217fa640 1 -- 172.21.15.17:0/1192764537 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5984+0+0 (secure 0 0 0) 0x7f30140bea50 con 0x7f3024101900 2024-09-20T18:43:33.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.248+0000 7f30237fe640 1 --2- 172.21.15.17:0/1192764537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f300c07af30 0x7f300c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:33.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.249+0000 7f30237fe640 1 --2- 172.21.15.17:0/1192764537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f300c07af30 0x7f300c07d3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3024075f80 tx=0x7f301800a5c0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:33.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.253+0000 7f30217fa640 1 -- 172.21.15.17:0/1192764537 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f301408a100 con 0x7f3024101900 2024-09-20T18:43:33.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.456+0000 7f302a438640 1 -- 172.21.15.17:0/1192764537 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3024104b80 con 0x7f300c07af30 2024-09-20T18:43:33.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.457+0000 7f30217fa640 1 -- 172.21.15.17:0/1192764537 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f301800a7d0 con 0x7f300c07af30 2024-09-20T18:43:33.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.459+0000 7f302a438640 1 -- 172.21.15.17:0/1192764537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f300c07af30 msgr2=0x7f300c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:33.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.459+0000 7f302a438640 1 --2- 172.21.15.17:0/1192764537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f300c07af30 0x7f300c07d3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3024075f80 tx=0x7f301800a5c0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.459+0000 7f302a438640 1 -- 172.21.15.17:0/1192764537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3024101900 msgr2=0x7f30240744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:33.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.459+0000 7f302a438640 1 --2- 172.21.15.17:0/1192764537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3024101900 0x7f30240744f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3014031460 tx=0x7f30140048f0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.459+0000 7f302a438640 1 -- 172.21.15.17:0/1192764537 shutdown_connections 2024-09-20T18:43:33.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.459+0000 7f302a438640 1 --2- 172.21.15.17:0/1192764537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f300c07af30 0x7f300c07d3f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.459+0000 7f302a438640 1 --2- 172.21.15.17:0/1192764537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3024107900 0x7f3024074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.459+0000 7f302a438640 1 --2- 172.21.15.17:0/1192764537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3024101900 0x7f30240744f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.459+0000 7f302a438640 1 -- 172.21.15.17:0/1192764537 >> 172.21.15.17:0/1192764537 conn(0x7f30240fd600 msgr2=0x7f30240fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.459+0000 7f302a438640 1 -- 172.21.15.17:0/1192764537 shutdown_connections 2024-09-20T18:43:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.459+0000 7f302a438640 1 -- 172.21.15.17:0/1192764537 wait complete. 2024-09-20T18:43:33.485 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:43:33.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.545+0000 7f95c805c640 1 -- 172.21.15.17:0/3783939205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c0074590 msgr2=0x7f95c0074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:33.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.545+0000 7f95c805c640 1 --2- 172.21.15.17:0/3783939205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c0074590 0x7f95c0074970 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009880 tx=0x7f95bc02a530 comp rx=0 tx=0).stop 2024-09-20T18:43:33.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.545+0000 7f95c805c640 1 -- 172.21.15.17:0/3783939205 shutdown_connections 2024-09-20T18:43:33.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.545+0000 7f95c805c640 1 --2- 172.21.15.17:0/3783939205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95c0074eb0 0x7f95c01123e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.545+0000 7f95c805c640 1 --2- 172.21.15.17:0/3783939205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c0074590 0x7f95c0074970 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.545+0000 7f95c805c640 1 -- 172.21.15.17:0/3783939205 >> 172.21.15.17:0/3783939205 conn(0x7f95c00fd630 msgr2=0x7f95c00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:33.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.546+0000 7f95c805c640 1 -- 172.21.15.17:0/3783939205 shutdown_connections 2024-09-20T18:43:33.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.546+0000 7f95c805c640 1 -- 172.21.15.17:0/3783939205 wait complete. 2024-09-20T18:43:33.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.546+0000 7f95c805c640 1 Processor -- start 2024-09-20T18:43:33.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.546+0000 7f95c805c640 1 -- start start 2024-09-20T18:43:33.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.546+0000 7f95c805c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95c0074590 0x7f95c019e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:33.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.546+0000 7f95c805c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c0074eb0 0x7f95c019e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:33.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.546+0000 7f95c805c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f95c0115400 con 0x7f95c0074eb0 2024-09-20T18:43:33.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.546+0000 7f95c805c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f95c0115280 con 0x7f95c0074590 2024-09-20T18:43:33.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.547+0000 7f95c55f7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c0074eb0 0x7f95c019e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:33.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.547+0000 7f95c55f7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c0074eb0 0x7f95c019e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35204/0 (socket says 172.21.15.17:35204) 2024-09-20T18:43:33.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.547+0000 7f95c55f7640 1 -- 172.21.15.17:0/2985524135 learned_addr learned my addr 172.21.15.17:0/2985524135 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:43:33.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.547+0000 7f95c5df8640 1 --2- 172.21.15.17:0/2985524135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95c0074590 0x7f95c019e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:33.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.547+0000 7f95c55f7640 1 -- 172.21.15.17:0/2985524135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95c0074590 msgr2=0x7f95c019e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:33.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.547+0000 7f95c55f7640 1 --2- 172.21.15.17:0/2985524135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95c0074590 0x7f95c019e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.547+0000 7f95c55f7640 1 -- 172.21.15.17:0/2985524135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c01a2910 con 0x7f95c0074eb0 2024-09-20T18:43:33.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.547+0000 7f95c55f7640 1 --2- 172.21.15.17:0/2985524135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c0074eb0 0x7f95c019e580 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f95b000c8f0 tx=0x7f95b000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:33.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.547+0000 7f95b6ffd640 1 -- 172.21.15.17:0/2985524135 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95b00079b0 con 0x7f95c0074eb0 2024-09-20T18:43:33.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.547+0000 7f95b6ffd640 1 -- 172.21.15.17:0/2985524135 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f95b00054e0 con 0x7f95c0074eb0 2024-09-20T18:43:33.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.547+0000 7f95c805c640 1 -- 172.21.15.17:0/2985524135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c01a2c00 con 0x7f95c0074eb0 2024-09-20T18:43:33.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.547+0000 7f95b6ffd640 1 -- 172.21.15.17:0/2985524135 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95b0004dd0 con 0x7f95c0074eb0 2024-09-20T18:43:33.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.547+0000 7f95c805c640 1 -- 172.21.15.17:0/2985524135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c01a3190 con 0x7f95c0074eb0 2024-09-20T18:43:33.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.548+0000 7f95c805c640 1 -- 172.21.15.17:0/2985524135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c0075cd0 con 0x7f95c0074eb0 2024-09-20T18:43:33.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.549+0000 7f95b6ffd640 1 -- 172.21.15.17:0/2985524135 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f95b0005020 con 0x7f95c0074eb0 2024-09-20T18:43:33.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.550+0000 7f95b6ffd640 1 --2- 172.21.15.17:0/2985524135 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f95ac07aed0 0x7f95ac07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:33.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.550+0000 7f95c5df8640 1 --2- 172.21.15.17:0/2985524135 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f95ac07aed0 0x7f95ac07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:33.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.550+0000 7f95b6ffd640 1 -- 172.21.15.17:0/2985524135 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5984+0+0 (secure 0 0 0) 0x7f95b009def0 con 0x7f95c0074eb0 2024-09-20T18:43:33.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.550+0000 7f95c5df8640 1 --2- 172.21.15.17:0/2985524135 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f95ac07aed0 0x7f95ac07d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f95bc000c00 tx=0x7f95bc031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:33.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.554+0000 7f95b6ffd640 1 -- 172.21.15.17:0/2985524135 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f95b0014030 con 0x7f95c0074eb0 2024-09-20T18:43:33.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.758+0000 7f95c805c640 1 -- 172.21.15.17:0/2985524135 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f95c019f3a0 con 0x7f95ac07aed0 2024-09-20T18:43:33.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:33 smithi017 ceph-mon[108970]: pgmap v236: 65 pgs: 65 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-20T18:43:33.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.760+0000 7f95b6ffd640 1 -- 172.21.15.17:0/2985524135 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f95c019f3a0 con 0x7f95ac07aed0 2024-09-20T18:43:33.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.762+0000 7f95c805c640 1 -- 172.21.15.17:0/2985524135 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f95ac07aed0 msgr2=0x7f95ac07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:33.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.762+0000 7f95c805c640 1 --2- 172.21.15.17:0/2985524135 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f95ac07aed0 0x7f95ac07d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f95bc000c00 tx=0x7f95bc031400 comp rx=0 tx=0).stop 2024-09-20T18:43:33.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.762+0000 7f95c805c640 1 -- 172.21.15.17:0/2985524135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c0074eb0 msgr2=0x7f95c019e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:33.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.762+0000 7f95c805c640 1 --2- 172.21.15.17:0/2985524135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c0074eb0 0x7f95c019e580 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f95b000c8f0 tx=0x7f95b000cdb0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.762+0000 7f95c805c640 1 -- 172.21.15.17:0/2985524135 shutdown_connections 2024-09-20T18:43:33.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.762+0000 7f95c805c640 1 --2- 172.21.15.17:0/2985524135 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f95ac07aed0 0x7f95ac07d390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.762+0000 7f95c805c640 1 --2- 172.21.15.17:0/2985524135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c0074eb0 0x7f95c019e580 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.762+0000 7f95c805c640 1 --2- 172.21.15.17:0/2985524135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95c0074590 0x7f95c019e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.762+0000 7f95c805c640 1 -- 172.21.15.17:0/2985524135 >> 172.21.15.17:0/2985524135 conn(0x7f95c00fd630 msgr2=0x7f95c0104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:33.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.762+0000 7f95c805c640 1 -- 172.21.15.17:0/2985524135 shutdown_connections 2024-09-20T18:43:33.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.762+0000 7f95c805c640 1 -- 172.21.15.17:0/2985524135 wait complete. 2024-09-20T18:43:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.847+0000 7f0004e3e640 1 -- 172.21.15.17:0/911201883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0000069d90 msgr2=0x7f0000100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.847+0000 7f0004e3e640 1 --2- 172.21.15.17:0/911201883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0000069d90 0x7f0000100790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efff4009880 tx=0x7efff402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.847+0000 7f0004e3e640 1 -- 172.21.15.17:0/911201883 shutdown_connections 2024-09-20T18:43:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.847+0000 7f0004e3e640 1 --2- 172.21.15.17:0/911201883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0000069d90 0x7f0000100790 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.847+0000 7f0004e3e640 1 --2- 172.21.15.17:0/911201883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0000069920 0x7f0000100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.847+0000 7f0004e3e640 1 -- 172.21.15.17:0/911201883 >> 172.21.15.17:0/911201883 conn(0x7f00000fbc90 msgr2=0x7f00000fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.847+0000 7f0004e3e640 1 -- 172.21.15.17:0/911201883 shutdown_connections 2024-09-20T18:43:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.847+0000 7f0004e3e640 1 -- 172.21.15.17:0/911201883 wait complete. 2024-09-20T18:43:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.848+0000 7f0004e3e640 1 Processor -- start 2024-09-20T18:43:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.848+0000 7f0004e3e640 1 -- start start 2024-09-20T18:43:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.848+0000 7f0004e3e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0000069920 0x7f00000fc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.848+0000 7f0004e3e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0000069d90 0x7f00000fc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.848+0000 7f0004e3e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f000010dd50 con 0x7f0000069920 2024-09-20T18:43:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.848+0000 7f0004e3e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f000010dbd0 con 0x7f0000069d90 2024-09-20T18:43:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.848+0000 7efffe59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0000069920 0x7f00000fc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.848+0000 7efffe59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0000069920 0x7f00000fc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35216/0 (socket says 172.21.15.17:35216) 2024-09-20T18:43:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.848+0000 7efffe59c640 1 -- 172.21.15.17:0/3723893878 learned_addr learned my addr 172.21.15.17:0/3723893878 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:43:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.849+0000 7efffdd9b640 1 --2- 172.21.15.17:0/3723893878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0000069d90 0x7f00000fc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.849+0000 7efffe59c640 1 -- 172.21.15.17:0/3723893878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0000069d90 msgr2=0x7f00000fc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.849+0000 7efffe59c640 1 --2- 172.21.15.17:0/3723893878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0000069d90 0x7f00000fc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.849+0000 7efffe59c640 1 -- 172.21.15.17:0/3723893878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00000fce00 con 0x7f0000069920 2024-09-20T18:43:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.849+0000 7efffe59c640 1 --2- 172.21.15.17:0/3723893878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0000069920 0x7f00000fc380 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efff000d6f0 tx=0x7efff000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.849+0000 7effef7fe640 1 -- 172.21.15.17:0/3723893878 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efff0017070 con 0x7f0000069920 2024-09-20T18:43:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.849+0000 7effef7fe640 1 -- 172.21.15.17:0/3723893878 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efff000de00 con 0x7f0000069920 2024-09-20T18:43:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.849+0000 7f0004e3e640 1 -- 172.21.15.17:0/3723893878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00000fd0f0 con 0x7f0000069920 2024-09-20T18:43:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.849+0000 7effef7fe640 1 -- 172.21.15.17:0/3723893878 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efff0004bb0 con 0x7f0000069920 2024-09-20T18:43:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.849+0000 7f0004e3e640 1 -- 172.21.15.17:0/3723893878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00001a3ec0 con 0x7f0000069920 2024-09-20T18:43:33.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.850+0000 7f0004e3e640 1 -- 172.21.15.17:0/3723893878 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0000101730 con 0x7f0000069920 2024-09-20T18:43:33.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.851+0000 7effef7fe640 1 -- 172.21.15.17:0/3723893878 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7efff0009a30 con 0x7f0000069920 2024-09-20T18:43:33.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.851+0000 7effef7fe640 1 --2- 172.21.15.17:0/3723893878 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7effe807af80 0x7effe807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:33.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.851+0000 7effef7fe640 1 -- 172.21.15.17:0/3723893878 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5984+0+0 (secure 0 0 0) 0x7efff009dac0 con 0x7f0000069920 2024-09-20T18:43:33.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.851+0000 7efffdd9b640 1 --2- 172.21.15.17:0/3723893878 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7effe807af80 0x7effe807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:33.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.852+0000 7efffdd9b640 1 --2- 172.21.15.17:0/3723893878 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7effe807af80 0x7effe807d440 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f00000fde10 tx=0x7efff4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:33.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:33.856+0000 7effef7fe640 1 -- 172.21.15.17:0/3723893878 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efff00691f0 con 0x7f0000069920 2024-09-20T18:43:33.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:33 smithi172 ceph-mon[80431]: pgmap v236: 65 pgs: 65 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-20T18:43:34.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.050+0000 7f0004e3e640 1 -- 172.21.15.17:0/3723893878 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0000062630 con 0x7effe807af80 2024-09-20T18:43:34.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.060+0000 7effef7fe640 1 -- 172.21.15.17:0/3723893878 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f0000062630 con 0x7effe807af80 2024-09-20T18:43:34.077 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:43:34.077 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (4m) 87s ago 15m 19.8M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:43:34.077 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (8m) 87s ago 16m 9042k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:43:34.078 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (7m) 18s ago 15m 8870k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:43:34.078 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (3m) 87s ago 16m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:43:34.078 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (3m) 18s ago 15m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:43:34.078 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (4m) 87s ago 15m 80.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:43:34.078 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (10m) 87s ago 10m 148M - 19.1.1-369-ged8ee0f2 6acb0a031eab 766f0586a4dc 2024-09-20T18:43:34.078 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (10m) 87s ago 10m 95.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:43:34.078 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (10m) 18s ago 10m 27.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:43:34.078 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (10m) 18s ago 10m 26.9M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:43:34.078 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (7m) 87s ago 17m 525M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:43:34.078 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (6m) 18s ago 15m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:43:34.078 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (3m) 87s ago 17m 42.3M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:43:34.078 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (3m) 18s ago 15m 37.3M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:43:34.078 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (5m) 87s ago 16m 11.4M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:43:34.079 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (5m) 18s ago 15m 11.7M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:43:34.079 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (2m) 87s ago 13m 82.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:43:34.079 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (2m) 87s ago 13m 87.9M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:43:34.079 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (92s) 87s ago 12m 12.2M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:43:34.079 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (55s) 18s ago 12m 97.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:43:34.079 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (21s) 18s ago 12m 12.2M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:43:34.079 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (11m) 18s ago 11m 192M 2240M 19.1.1-369-ged8ee0f2 6acb0a031eab 831ad57df8cd 2024-09-20T18:43:34.079 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (5m) 87s ago 15m 53.2M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:43:34.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.062+0000 7f0004e3e640 1 -- 172.21.15.17:0/3723893878 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7effe807af80 msgr2=0x7effe807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:34.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.062+0000 7f0004e3e640 1 --2- 172.21.15.17:0/3723893878 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7effe807af80 0x7effe807d440 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f00000fde10 tx=0x7efff4031400 comp rx=0 tx=0).stop 2024-09-20T18:43:34.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.062+0000 7f0004e3e640 1 -- 172.21.15.17:0/3723893878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0000069920 msgr2=0x7f00000fc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:34.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.062+0000 7f0004e3e640 1 --2- 172.21.15.17:0/3723893878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0000069920 0x7f00000fc380 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efff000d6f0 tx=0x7efff000dbb0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.063+0000 7f0004e3e640 1 -- 172.21.15.17:0/3723893878 shutdown_connections 2024-09-20T18:43:34.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.063+0000 7f0004e3e640 1 --2- 172.21.15.17:0/3723893878 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7effe807af80 0x7effe807d440 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.063+0000 7f0004e3e640 1 --2- 172.21.15.17:0/3723893878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0000069d90 0x7f00000fc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.063+0000 7f0004e3e640 1 --2- 172.21.15.17:0/3723893878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0000069920 0x7f00000fc380 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.063+0000 7f0004e3e640 1 -- 172.21.15.17:0/3723893878 >> 172.21.15.17:0/3723893878 conn(0x7f00000fbc90 msgr2=0x7f00001035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:34.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.063+0000 7f0004e3e640 1 -- 172.21.15.17:0/3723893878 shutdown_connections 2024-09-20T18:43:34.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.063+0000 7f0004e3e640 1 -- 172.21.15.17:0/3723893878 wait complete. 2024-09-20T18:43:34.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.146+0000 7f5d49376640 1 -- 172.21.15.17:0/4061800837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d441033e0 msgr2=0x7f5d4410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:34.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.146+0000 7f5d49376640 1 --2- 172.21.15.17:0/4061800837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d441033e0 0x7f5d4410b8d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5d38009880 tx=0x7f5d3802a530 comp rx=0 tx=0).stop 2024-09-20T18:43:34.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.146+0000 7f5d49376640 1 -- 172.21.15.17:0/4061800837 shutdown_connections 2024-09-20T18:43:34.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.146+0000 7f5d49376640 1 --2- 172.21.15.17:0/4061800837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d441033e0 0x7f5d4410b8d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.146+0000 7f5d49376640 1 --2- 172.21.15.17:0/4061800837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d44102ac0 0x7f5d44102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.146+0000 7f5d49376640 1 -- 172.21.15.17:0/4061800837 >> 172.21.15.17:0/4061800837 conn(0x7f5d440fc520 msgr2=0x7f5d440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:34.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.146+0000 7f5d49376640 1 -- 172.21.15.17:0/4061800837 shutdown_connections 2024-09-20T18:43:34.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.146+0000 7f5d49376640 1 -- 172.21.15.17:0/4061800837 wait complete. 2024-09-20T18:43:34.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.147+0000 7f5d49376640 1 Processor -- start 2024-09-20T18:43:34.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.147+0000 7f5d49376640 1 -- start start 2024-09-20T18:43:34.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.147+0000 7f5d49376640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d44102ac0 0x7f5d4419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:34.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.147+0000 7f5d49376640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d441033e0 0x7f5d4419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:34.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.147+0000 7f5d49376640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4410edf0 con 0x7f5d44102ac0 2024-09-20T18:43:34.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.147+0000 7f5d49376640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4410ec70 con 0x7f5d441033e0 2024-09-20T18:43:34.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.147+0000 7f5d42ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d44102ac0 0x7f5d4419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:34.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.147+0000 7f5d42ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d44102ac0 0x7f5d4419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35226/0 (socket says 172.21.15.17:35226) 2024-09-20T18:43:34.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.147+0000 7f5d42ffd640 1 -- 172.21.15.17:0/3984480020 learned_addr learned my addr 172.21.15.17:0/3984480020 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:43:34.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.147+0000 7f5d427fc640 1 --2- 172.21.15.17:0/3984480020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d441033e0 0x7f5d4419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:34.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.148+0000 7f5d42ffd640 1 -- 172.21.15.17:0/3984480020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d441033e0 msgr2=0x7f5d4419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:34.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.148+0000 7f5d42ffd640 1 --2- 172.21.15.17:0/3984480020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d441033e0 0x7f5d4419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.148+0000 7f5d42ffd640 1 -- 172.21.15.17:0/3984480020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d44197800 con 0x7f5d44102ac0 2024-09-20T18:43:34.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.148+0000 7f5d42ffd640 1 --2- 172.21.15.17:0/3984480020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d44102ac0 0x7f5d4419d680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400e970 tx=0x7f5d3400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:34.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.148+0000 7f5d2bfff640 1 -- 172.21.15.17:0/3984480020 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d3400cac0 con 0x7f5d44102ac0 2024-09-20T18:43:34.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.148+0000 7f5d2bfff640 1 -- 172.21.15.17:0/3984480020 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5d340054e0 con 0x7f5d44102ac0 2024-09-20T18:43:34.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.148+0000 7f5d49376640 1 -- 172.21.15.17:0/3984480020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d44197af0 con 0x7f5d44102ac0 2024-09-20T18:43:34.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.148+0000 7f5d2bfff640 1 -- 172.21.15.17:0/3984480020 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d34010430 con 0x7f5d44102ac0 2024-09-20T18:43:34.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.148+0000 7f5d49376640 1 -- 172.21.15.17:0/3984480020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d44198050 con 0x7f5d44102ac0 2024-09-20T18:43:34.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.149+0000 7f5d49376640 1 -- 172.21.15.17:0/3984480020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d4406aa90 con 0x7f5d44102ac0 2024-09-20T18:43:34.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.150+0000 7f5d2bfff640 1 -- 172.21.15.17:0/3984480020 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5d34004ec0 con 0x7f5d44102ac0 2024-09-20T18:43:34.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.150+0000 7f5d2bfff640 1 --2- 172.21.15.17:0/3984480020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5d2c07af40 0x7f5d2c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:34.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.150+0000 7f5d2bfff640 1 -- 172.21.15.17:0/3984480020 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5984+0+0 (secure 0 0 0) 0x7f5d3409e610 con 0x7f5d44102ac0 2024-09-20T18:43:34.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.150+0000 7f5d427fc640 1 --2- 172.21.15.17:0/3984480020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5d2c07af40 0x7f5d2c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.151+0000 7f5d427fc640 1 --2- 172.21.15.17:0/3984480020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5d2c07af40 0x7f5d2c07d400 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5d44198b50 tx=0x7f5d38031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:34.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.155+0000 7f5d2bfff640 1 -- 172.21.15.17:0/3984480020 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5d34069cc0 con 0x7f5d44102ac0 2024-09-20T18:43:34.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.419+0000 7f5d49376640 1 -- 172.21.15.17:0/3984480020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5d44105f60 con 0x7f5d44102ac0 2024-09-20T18:43:34.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.420+0000 7f5d2bfff640 1 -- 172.21.15.17:0/3984480020 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f5d3406eb70 con 0x7f5d44102ac0 2024-09-20T18:43:34.437 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:43:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:43:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:43:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:43:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:43:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:43:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:43:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:43:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:43:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 5 2024-09-20T18:43:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:43:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:43:34.437 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 4 2024-09-20T18:43:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:43:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:43:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 5, 2024-09-20T18:43:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 9 2024-09-20T18:43:34.438 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:43:34.438 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:43:34.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.422+0000 7f5d49376640 1 -- 172.21.15.17:0/3984480020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5d2c07af40 msgr2=0x7f5d2c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:34.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.422+0000 7f5d49376640 1 --2- 172.21.15.17:0/3984480020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5d2c07af40 0x7f5d2c07d400 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5d44198b50 tx=0x7f5d38031400 comp rx=0 tx=0).stop 2024-09-20T18:43:34.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.422+0000 7f5d49376640 1 -- 172.21.15.17:0/3984480020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d44102ac0 msgr2=0x7f5d4419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:34.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.422+0000 7f5d49376640 1 --2- 172.21.15.17:0/3984480020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d44102ac0 0x7f5d4419d680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400e970 tx=0x7f5d3400ed70 comp rx=0 tx=0).stop 2024-09-20T18:43:34.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.422+0000 7f5d49376640 1 -- 172.21.15.17:0/3984480020 shutdown_connections 2024-09-20T18:43:34.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.422+0000 7f5d49376640 1 --2- 172.21.15.17:0/3984480020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5d2c07af40 0x7f5d2c07d400 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.422+0000 7f5d49376640 1 --2- 172.21.15.17:0/3984480020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d441033e0 0x7f5d4419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.422+0000 7f5d49376640 1 --2- 172.21.15.17:0/3984480020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d44102ac0 0x7f5d4419d680 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.422+0000 7f5d49376640 1 -- 172.21.15.17:0/3984480020 >> 172.21.15.17:0/3984480020 conn(0x7f5d440fc520 msgr2=0x7f5d44108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.422+0000 7f5d49376640 1 -- 172.21.15.17:0/3984480020 shutdown_connections 2024-09-20T18:43:34.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.422+0000 7f5d49376640 1 -- 172.21.15.17:0/3984480020 wait complete. 2024-09-20T18:43:34.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.506+0000 7ff38bf02640 1 -- 172.21.15.17:0/3121888234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff384100800 msgr2=0x7ff384100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:34.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.506+0000 7ff38bf02640 1 --2- 172.21.15.17:0/3121888234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff384100800 0x7ff384100c60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff374009880 tx=0x7ff37402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.506+0000 7ff38bf02640 1 -- 172.21.15.17:0/3121888234 shutdown_connections 2024-09-20T18:43:34.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.506+0000 7ff38bf02640 1 --2- 172.21.15.17:0/3121888234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff384100800 0x7ff384100c60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.506+0000 7ff38bf02640 1 --2- 172.21.15.17:0/3121888234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff384106800 0x7ff384106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.506+0000 7ff38bf02640 1 -- 172.21.15.17:0/3121888234 >> 172.21.15.17:0/3121888234 conn(0x7ff3840fc520 msgr2=0x7ff3840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:34.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.506+0000 7ff38bf02640 1 -- 172.21.15.17:0/3121888234 shutdown_connections 2024-09-20T18:43:34.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.506+0000 7ff38bf02640 1 -- 172.21.15.17:0/3121888234 wait complete. 2024-09-20T18:43:34.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.507+0000 7ff38bf02640 1 Processor -- start 2024-09-20T18:43:34.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.507+0000 7ff38bf02640 1 -- start start 2024-09-20T18:43:34.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.507+0000 7ff38bf02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff384100800 0x7ff384198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:34.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.507+0000 7ff38bf02640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff384106800 0x7ff384198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:34.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.507+0000 7ff38bf02640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff38410dcd0 con 0x7ff384100800 2024-09-20T18:43:34.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.507+0000 7ff38bf02640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff38410db50 con 0x7ff384106800 2024-09-20T18:43:34.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.507+0000 7ff389c9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff384100800 0x7ff384198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:34.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.507+0000 7ff389c9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff384100800 0x7ff384198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35250/0 (socket says 172.21.15.17:35250) 2024-09-20T18:43:34.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.507+0000 7ff389c9e640 1 -- 172.21.15.17:0/1281606962 learned_addr learned my addr 172.21.15.17:0/1281606962 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:43:34.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.508+0000 7ff38949d640 1 --2- 172.21.15.17:0/1281606962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff384106800 0x7ff384198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:34.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.508+0000 7ff389c9e640 1 -- 172.21.15.17:0/1281606962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff384106800 msgr2=0x7ff384198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:34.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.508+0000 7ff389c9e640 1 --2- 172.21.15.17:0/1281606962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff384106800 0x7ff384198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.508+0000 7ff389c9e640 1 -- 172.21.15.17:0/1281606962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff384199360 con 0x7ff384100800 2024-09-20T18:43:34.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.508+0000 7ff389c9e640 1 --2- 172.21.15.17:0/1281606962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff384100800 0x7ff384198820 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff38000c8f0 tx=0x7ff38000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:34.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.508+0000 7ff37affd640 1 -- 172.21.15.17:0/1281606962 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff3800079b0 con 0x7ff384100800 2024-09-20T18:43:34.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.508+0000 7ff37affd640 1 -- 172.21.15.17:0/1281606962 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff3800054e0 con 0x7ff384100800 2024-09-20T18:43:34.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.508+0000 7ff38bf02640 1 -- 172.21.15.17:0/1281606962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff384199650 con 0x7ff384100800 2024-09-20T18:43:34.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.508+0000 7ff37affd640 1 -- 172.21.15.17:0/1281606962 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff380004dd0 con 0x7ff384100800 2024-09-20T18:43:34.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.508+0000 7ff38bf02640 1 -- 172.21.15.17:0/1281606962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3841a1c50 con 0x7ff384100800 2024-09-20T18:43:34.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.509+0000 7ff38bf02640 1 -- 172.21.15.17:0/1281606962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff384101f40 con 0x7ff384100800 2024-09-20T18:43:34.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.510+0000 7ff37affd640 1 -- 172.21.15.17:0/1281606962 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff380005020 con 0x7ff384100800 2024-09-20T18:43:34.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.510+0000 7ff37affd640 1 --2- 172.21.15.17:0/1281606962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff37007af30 0x7ff37007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:34.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.511+0000 7ff37affd640 1 -- 172.21.15.17:0/1281606962 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5984+0+0 (secure 0 0 0) 0x7ff38009de80 con 0x7ff384100800 2024-09-20T18:43:34.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.511+0000 7ff38949d640 1 --2- 172.21.15.17:0/1281606962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff37007af30 0x7ff37007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:34.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.511+0000 7ff38949d640 1 --2- 172.21.15.17:0/1281606962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff37007af30 0x7ff37007d3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff38406ad00 tx=0x7ff374031420 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:34.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.515+0000 7ff37affd640 1 -- 172.21.15.17:0/1281606962 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff384199650 con 0x7ff384100800 2024-09-20T18:43:34.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.747+0000 7ff38bf02640 1 -- 172.21.15.17:0/1281606962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff384108d70 con 0x7ff384100800 2024-09-20T18:43:34.764 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:34 smithi017 ceph-mon[108970]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:43:34.764 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:34 smithi017 ceph-mon[108970]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:43:34.764 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:34 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3984480020' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:34.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.747+0000 7ff37affd640 1 -- 172.21.15.17:0/1281606962 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) ==== 76+0+2043 (secure 0 0 0) 0x7ff380014030 con 0x7ff384100800 2024-09-20T18:43:34.765 INFO:teuthology.orchestra.run.smithi017.stdout:e15 2024-09-20T18:43:34.765 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:33:05:524203+0000 2024-09-20T18:43:34.765 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:43:34.765 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:43:34.765 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:43:34.765 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:43:34.765 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:43:34.766 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:43:34.766 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 15 2024-09-20T18:43:34.766 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T18:43:34.766 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:43:34.766 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:33:05.065474+0000 2024-09-20T18:43:34.766 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:43:34.766 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:43:34.766 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:43:34.766 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:43:34.766 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:43:34.766 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:43:34.766 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:43:34.766 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:43:34.766 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2024-09-20T18:43:34.767 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:43:34.767 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:43:34.767 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:43:34.767 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14552,1=24325} 2024-09-20T18:43:34.767 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-09-20T18:43:34.767 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:43:34.767 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:43:34.767 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:43:34.767 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:43:34.767 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:43:34.767 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:43:34.767 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:43:34.767 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:43:34.768 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 14552 members: 24325,14552 2024-09-20T18:43:34.768 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{0:14552} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.17:6826/3360305779,v1:172.21.15.17:6827/3360305779] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:43:34.768 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{0:14568} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.17:6828/53113052,v1:172.21.15.17:6829/53113052] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:43:34.768 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{1:24325} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.172:6824/1043027893,v1:172.21.15.172:6825/1043027893] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:43:34.768 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{1:24339} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.172:6826/2975309540,v1:172.21.15.172:6827/2975309540] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:43:34.768 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:43:34.768 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:43:34.768 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 15 2024-09-20T18:43:34.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.750+0000 7ff38bf02640 1 -- 172.21.15.17:0/1281606962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff37007af30 msgr2=0x7ff37007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:34.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.750+0000 7ff38bf02640 1 --2- 172.21.15.17:0/1281606962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff37007af30 0x7ff37007d3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff38406ad00 tx=0x7ff374031420 comp rx=0 tx=0).stop 2024-09-20T18:43:34.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.750+0000 7ff38bf02640 1 -- 172.21.15.17:0/1281606962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff384100800 msgr2=0x7ff384198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:34.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.750+0000 7ff38bf02640 1 --2- 172.21.15.17:0/1281606962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff384100800 0x7ff384198820 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff38000c8f0 tx=0x7ff38000cdb0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.750+0000 7ff38bf02640 1 -- 172.21.15.17:0/1281606962 shutdown_connections 2024-09-20T18:43:34.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.750+0000 7ff38bf02640 1 --2- 172.21.15.17:0/1281606962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff37007af30 0x7ff37007d3f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.750+0000 7ff38bf02640 1 --2- 172.21.15.17:0/1281606962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff384106800 0x7ff384198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.750+0000 7ff38bf02640 1 --2- 172.21.15.17:0/1281606962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff384100800 0x7ff384198820 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.750+0000 7ff38bf02640 1 -- 172.21.15.17:0/1281606962 >> 172.21.15.17:0/1281606962 conn(0x7ff3840fc520 msgr2=0x7ff3840fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:34.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.750+0000 7ff38bf02640 1 -- 172.21.15.17:0/1281606962 shutdown_connections 2024-09-20T18:43:34.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.750+0000 7ff38bf02640 1 -- 172.21.15.17:0/1281606962 wait complete. 2024-09-20T18:43:34.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.835+0000 7fac7c285640 1 -- 172.21.15.17:0/3064131056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac74106800 msgr2=0x7fac74106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:34.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.835+0000 7fac7c285640 1 --2- 172.21.15.17:0/3064131056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac74106800 0x7fac74106be0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fac70009880 tx=0x7fac7002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.835+0000 7fac7c285640 1 -- 172.21.15.17:0/3064131056 shutdown_connections 2024-09-20T18:43:34.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.835+0000 7fac7c285640 1 --2- 172.21.15.17:0/3064131056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac74100800 0x7fac74100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.835+0000 7fac7c285640 1 --2- 172.21.15.17:0/3064131056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac74106800 0x7fac74106be0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.835+0000 7fac7c285640 1 -- 172.21.15.17:0/3064131056 >> 172.21.15.17:0/3064131056 conn(0x7fac740fc520 msgr2=0x7fac740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.835+0000 7fac7c285640 1 -- 172.21.15.17:0/3064131056 shutdown_connections 2024-09-20T18:43:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.835+0000 7fac7c285640 1 -- 172.21.15.17:0/3064131056 wait complete. 2024-09-20T18:43:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.836+0000 7fac7c285640 1 Processor -- start 2024-09-20T18:43:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.836+0000 7fac7c285640 1 -- start start 2024-09-20T18:43:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.836+0000 7fac7c285640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac74100800 0x7fac7419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.836+0000 7fac7c285640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac74106800 0x7fac7419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.836+0000 7fac7c285640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fac7410dcb0 con 0x7fac74100800 2024-09-20T18:43:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.836+0000 7fac7c285640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fac7410db30 con 0x7fac74106800 2024-09-20T18:43:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.836+0000 7fac7a021640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac74100800 0x7fac7419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.836+0000 7fac7a021640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac74100800 0x7fac7419d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35274/0 (socket says 172.21.15.17:35274) 2024-09-20T18:43:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.836+0000 7fac7a021640 1 -- 172.21.15.17:0/511558298 learned_addr learned my addr 172.21.15.17:0/511558298 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:43:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.836+0000 7fac79820640 1 --2- 172.21.15.17:0/511558298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac74106800 0x7fac7419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.837+0000 7fac7a021640 1 -- 172.21.15.17:0/511558298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac74106800 msgr2=0x7fac7419db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.837+0000 7fac7a021640 1 --2- 172.21.15.17:0/511558298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac74106800 0x7fac7419db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.837+0000 7fac7a021640 1 -- 172.21.15.17:0/511558298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac74197790 con 0x7fac74100800 2024-09-20T18:43:34.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.837+0000 7fac7a021640 1 --2- 172.21.15.17:0/511558298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac74100800 0x7fac7419d610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fac70031460 tx=0x7fac700045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:34.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.837+0000 7fac6b7fe640 1 -- 172.21.15.17:0/511558298 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac7003f070 con 0x7fac74100800 2024-09-20T18:43:34.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.837+0000 7fac6b7fe640 1 -- 172.21.15.17:0/511558298 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fac70004b10 con 0x7fac74100800 2024-09-20T18:43:34.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.837+0000 7fac7c285640 1 -- 172.21.15.17:0/511558298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac74197a20 con 0x7fac74100800 2024-09-20T18:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.837+0000 7fac6b7fe640 1 -- 172.21.15.17:0/511558298 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac70035030 con 0x7fac74100800 2024-09-20T18:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.837+0000 7fac7c285640 1 -- 172.21.15.17:0/511558298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac74197f50 con 0x7fac74100800 2024-09-20T18:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.838+0000 7fac7c285640 1 -- 172.21.15.17:0/511558298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac74101f40 con 0x7fac74100800 2024-09-20T18:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.839+0000 7fac6b7fe640 1 -- 172.21.15.17:0/511558298 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fac70042070 con 0x7fac74100800 2024-09-20T18:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.839+0000 7fac6b7fe640 1 --2- 172.21.15.17:0/511558298 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac6007af90 0x7fac6007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.839+0000 7fac6b7fe640 1 -- 172.21.15.17:0/511558298 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5984+0+0 (secure 0 0 0) 0x7fac700be920 con 0x7fac74100800 2024-09-20T18:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.839+0000 7fac79820640 1 --2- 172.21.15.17:0/511558298 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac6007af90 0x7fac6007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.840+0000 7fac79820640 1 --2- 172.21.15.17:0/511558298 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac6007af90 0x7fac6007d450 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fac740ffaf0 tx=0x7fac6400b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:34.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:34.844+0000 7fac6b7fe640 1 -- 172.21.15.17:0/511558298 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fac7008a050 con 0x7fac74100800 2024-09-20T18:43:34.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:34 smithi172 ceph-mon[80431]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:43:34.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:34 smithi172 ceph-mon[80431]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:43:34.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:34 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3984480020' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:35.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.051+0000 7fac7c285640 1 -- 172.21.15.17:0/511558298 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fac74198200 con 0x7fac6007af90 2024-09-20T18:43:35.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.052+0000 7fac6b7fe640 1 -- 172.21.15.17:0/511558298 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fac74198200 con 0x7fac6007af90 2024-09-20T18:43:35.069 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:43:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:43:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:43:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:43:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:43:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:43:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:43:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:43:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:43:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "11/23 daemons upgraded", 2024-09-20T18:43:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading osd daemons", 2024-09-20T18:43:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:43:35.069 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:43:35.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.054+0000 7fac7c285640 1 -- 172.21.15.17:0/511558298 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac6007af90 msgr2=0x7fac6007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:35.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.054+0000 7fac7c285640 1 --2- 172.21.15.17:0/511558298 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac6007af90 0x7fac6007d450 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fac740ffaf0 tx=0x7fac6400b390 comp rx=0 tx=0).stop 2024-09-20T18:43:35.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.054+0000 7fac7c285640 1 -- 172.21.15.17:0/511558298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac74100800 msgr2=0x7fac7419d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:35.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.054+0000 7fac7c285640 1 --2- 172.21.15.17:0/511558298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac74100800 0x7fac7419d610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fac70031460 tx=0x7fac700045e0 comp rx=0 tx=0).stop 2024-09-20T18:43:35.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.054+0000 7fac7c285640 1 -- 172.21.15.17:0/511558298 shutdown_connections 2024-09-20T18:43:35.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.054+0000 7fac7c285640 1 --2- 172.21.15.17:0/511558298 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac6007af90 0x7fac6007d450 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:35.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.054+0000 7fac7c285640 1 --2- 172.21.15.17:0/511558298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac74106800 0x7fac7419db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:35.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.054+0000 7fac7c285640 1 --2- 172.21.15.17:0/511558298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac74100800 0x7fac7419d610 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:35.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.054+0000 7fac7c285640 1 -- 172.21.15.17:0/511558298 >> 172.21.15.17:0/511558298 conn(0x7fac740fc520 msgr2=0x7fac7406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:35.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.054+0000 7fac7c285640 1 -- 172.21.15.17:0/511558298 shutdown_connections 2024-09-20T18:43:35.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.054+0000 7fac7c285640 1 -- 172.21.15.17:0/511558298 wait complete. 2024-09-20T18:43:35.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.138+0000 7fe91afa5640 1 -- 172.21.15.17:0/2236941259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe914100800 msgr2=0x7fe914100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:35.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.138+0000 7fe91afa5640 1 --2- 172.21.15.17:0/2236941259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe914100800 0x7fe914100c60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe900009880 tx=0x7fe90002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:43:35.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.138+0000 7fe91afa5640 1 -- 172.21.15.17:0/2236941259 shutdown_connections 2024-09-20T18:43:35.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.138+0000 7fe91afa5640 1 --2- 172.21.15.17:0/2236941259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe914100800 0x7fe914100c60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:35.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.138+0000 7fe91afa5640 1 --2- 172.21.15.17:0/2236941259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe914106800 0x7fe914106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:35.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.138+0000 7fe91afa5640 1 -- 172.21.15.17:0/2236941259 >> 172.21.15.17:0/2236941259 conn(0x7fe9140fc520 msgr2=0x7fe9140fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:35.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.138+0000 7fe91afa5640 1 -- 172.21.15.17:0/2236941259 shutdown_connections 2024-09-20T18:43:35.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.138+0000 7fe91afa5640 1 -- 172.21.15.17:0/2236941259 wait complete. 2024-09-20T18:43:35.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.139+0000 7fe91afa5640 1 Processor -- start 2024-09-20T18:43:35.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.139+0000 7fe91afa5640 1 -- start start 2024-09-20T18:43:35.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.139+0000 7fe91afa5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe914100800 0x7fe9140fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:35.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.139+0000 7fe91afa5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe914106800 0x7fe9140fd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.139+0000 7fe91afa5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe91410dcd0 con 0x7fe914100800 2024-09-20T18:43:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.139+0000 7fe91afa5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe91410db50 con 0x7fe914106800 2024-09-20T18:43:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.139+0000 7fe918d41640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe914100800 0x7fe9140fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.139+0000 7fe918d41640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe914100800 0x7fe9140fcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35288/0 (socket says 172.21.15.17:35288) 2024-09-20T18:43:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.139+0000 7fe918d41640 1 -- 172.21.15.17:0/915686449 learned_addr learned my addr 172.21.15.17:0/915686449 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:43:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.139+0000 7fe913fff640 1 --2- 172.21.15.17:0/915686449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe914106800 0x7fe9140fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.139+0000 7fe918d41640 1 -- 172.21.15.17:0/915686449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe914106800 msgr2=0x7fe9140fd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.139+0000 7fe918d41640 1 --2- 172.21.15.17:0/915686449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe914106800 0x7fe9140fd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.140+0000 7fe918d41640 1 -- 172.21.15.17:0/915686449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9140fd670 con 0x7fe914100800 2024-09-20T18:43:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.140+0000 7fe918d41640 1 --2- 172.21.15.17:0/915686449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe914100800 0x7fe9140fcbf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe90800e970 tx=0x7fe90800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.140+0000 7fe911ffb640 1 -- 172.21.15.17:0/915686449 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe90800cac0 con 0x7fe914100800 2024-09-20T18:43:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.140+0000 7fe911ffb640 1 -- 172.21.15.17:0/915686449 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe9080054e0 con 0x7fe914100800 2024-09-20T18:43:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.140+0000 7fe91afa5640 1 -- 172.21.15.17:0/915686449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9140fd960 con 0x7fe914100800 2024-09-20T18:43:35.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.140+0000 7fe911ffb640 1 -- 172.21.15.17:0/915686449 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe908010430 con 0x7fe914100800 2024-09-20T18:43:35.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.140+0000 7fe91afa5640 1 -- 172.21.15.17:0/915686449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9141a3e70 con 0x7fe914100800 2024-09-20T18:43:35.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.141+0000 7fe91afa5640 1 -- 172.21.15.17:0/915686449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe914101f40 con 0x7fe914100800 2024-09-20T18:43:35.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.142+0000 7fe911ffb640 1 -- 172.21.15.17:0/915686449 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe908004e80 con 0x7fe914100800 2024-09-20T18:43:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.142+0000 7fe911ffb640 1 --2- 172.21.15.17:0/915686449 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe90407af30 0x7fe90407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:43:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.143+0000 7fe911ffb640 1 -- 172.21.15.17:0/915686449 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5984+0+0 (secure 0 0 0) 0x7fe90809e620 con 0x7fe914100800 2024-09-20T18:43:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.143+0000 7fe913fff640 1 --2- 172.21.15.17:0/915686449 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe90407af30 0x7fe90407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:43:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.143+0000 7fe913fff640 1 --2- 172.21.15.17:0/915686449 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe90407af30 0x7fe90407d3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe9140fe680 tx=0x7fe900031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:43:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.147+0000 7fe911ffb640 1 -- 172.21.15.17:0/915686449 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe908069c50 con 0x7fe914100800 2024-09-20T18:43:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.411+0000 7fe91afa5640 1 -- 172.21.15.17:0/915686449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe914100c60 con 0x7fe914100800 2024-09-20T18:43:35.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.411+0000 7fe911ffb640 1 -- 172.21.15.17:0/915686449 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fe90806eb00 con 0x7fe914100800 2024-09-20T18:43:35.428 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T18:43:35.428 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:43:35.428 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:43:35.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.413+0000 7fe91afa5640 1 -- 172.21.15.17:0/915686449 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe90407af30 msgr2=0x7fe90407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:35.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.413+0000 7fe91afa5640 1 --2- 172.21.15.17:0/915686449 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe90407af30 0x7fe90407d3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe9140fe680 tx=0x7fe900031400 comp rx=0 tx=0).stop 2024-09-20T18:43:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.413+0000 7fe91afa5640 1 -- 172.21.15.17:0/915686449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe914100800 msgr2=0x7fe9140fcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:43:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.413+0000 7fe91afa5640 1 --2- 172.21.15.17:0/915686449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe914100800 0x7fe9140fcbf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe90800e970 tx=0x7fe90800ed70 comp rx=0 tx=0).stop 2024-09-20T18:43:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.414+0000 7fe91afa5640 1 -- 172.21.15.17:0/915686449 shutdown_connections 2024-09-20T18:43:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.414+0000 7fe91afa5640 1 --2- 172.21.15.17:0/915686449 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe90407af30 0x7fe90407d3f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.414+0000 7fe91afa5640 1 --2- 172.21.15.17:0/915686449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe914106800 0x7fe9140fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.414+0000 7fe91afa5640 1 --2- 172.21.15.17:0/915686449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe914100800 0x7fe9140fcbf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:43:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.414+0000 7fe91afa5640 1 -- 172.21.15.17:0/915686449 >> 172.21.15.17:0/915686449 conn(0x7fe9140fc520 msgr2=0x7fe91406a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:43:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.414+0000 7fe91afa5640 1 -- 172.21.15.17:0/915686449 shutdown_connections 2024-09-20T18:43:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:43:35.414+0000 7fe91afa5640 1 -- 172.21.15.17:0/915686449 wait complete. 2024-09-20T18:43:35.922 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:35 smithi172 ceph-mon[80431]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:43:35.922 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:35 smithi172 ceph-mon[80431]: pgmap v237: 65 pgs: 65 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:43:35.922 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:35 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-20T18:43:35.922 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:35 smithi172 ceph-mon[80431]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T18:43:35.923 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:35 smithi172 ceph-mon[80431]: Upgrade: osd.5 is safe to restart 2024-09-20T18:43:35.923 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:35 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1281606962' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:43:35.923 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:35 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/915686449' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:43:36.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:35 smithi017 ceph-mon[108970]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:43:36.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:35 smithi017 ceph-mon[108970]: pgmap v237: 65 pgs: 65 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T18:43:36.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:35 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-20T18:43:36.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:35 smithi017 ceph-mon[108970]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-20T18:43:36.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:35 smithi017 ceph-mon[108970]: Upgrade: osd.5 is safe to restart 2024-09-20T18:43:36.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:35 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1281606962' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:43:36.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:35 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/915686449' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:43:36.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:36 smithi172 ceph-mon[80431]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:43:36.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:36 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:36.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:36 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-20T18:43:36.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:36 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:43:37.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:36 smithi017 ceph-mon[108970]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:43:37.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:36 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:37.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:36 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-20T18:43:37.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:36 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:43:37.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:37 smithi172 ceph-mon[80431]: Upgrade: Updating osd.5 2024-09-20T18:43:37.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:37 smithi172 ceph-mon[80431]: Deploying daemon osd.5 on smithi172 2024-09-20T18:43:37.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:37 smithi172 ceph-mon[80431]: pgmap v238: 65 pgs: 65 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-20T18:43:37.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:37.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:43:37.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:37 smithi017 ceph-mon[108970]: Upgrade: Updating osd.5 2024-09-20T18:43:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:37 smithi017 ceph-mon[108970]: Deploying daemon osd.5 on smithi172 2024-09-20T18:43:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:37 smithi017 ceph-mon[108970]: pgmap v238: 65 pgs: 65 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-20T18:43:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:43:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:38.998 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:38 smithi172 systemd[1]: Stopping Ceph osd.5 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:43:39.460 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:39 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[54854]: 2024-09-20T18:43:39.001+0000 7fe1229c7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T18:43:39.460 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:39 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[54854]: 2024-09-20T18:43:39.001+0000 7fe1229c7640 -1 osd.5 71 *** Got signal Terminated *** 2024-09-20T18:43:39.461 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:39 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[54854]: 2024-09-20T18:43:39.001+0000 7fe1229c7640 -1 osd.5 71 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T18:43:39.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:39 smithi172 ceph-mon[80431]: pgmap v239: 65 pgs: 65 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-20T18:43:39.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:39 smithi172 ceph-mon[80431]: osd.5 marked itself down and dead 2024-09-20T18:43:40.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:39 smithi017 ceph-mon[108970]: pgmap v239: 65 pgs: 65 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-20T18:43:40.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:39 smithi017 ceph-mon[108970]: osd.5 marked itself down and dead 2024-09-20T18:43:40.375 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:40 smithi172 podman[97317]: 2024-09-20 18:43:40.089148963 +0000 UTC m=+1.208200552 container died 831ad57df8cd57f7dd4dd56520dec7dc580c1889501823db793319f0d04d0c8c (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ed8ee0f, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-20T18:43:40.693 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:40 smithi172 podman[97317]: 2024-09-20 18:43:40.45935967 +0000 UTC m=+1.578411262 container cleanup 831ad57df8cd57f7dd4dd56520dec7dc580c1889501823db793319f0d04d0c8c (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ed8ee0f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-09-20T18:43:40.693 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:40 smithi172 bash[97317]: ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5 2024-09-20T18:43:40.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:40 smithi017 ceph-mon[108970]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T18:43:40.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:40 smithi017 ceph-mon[108970]: osdmap e72: 6 total, 5 up, 6 in 2024-09-20T18:43:40.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:40 smithi172 ceph-mon[80431]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-20T18:43:40.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:40 smithi172 ceph-mon[80431]: osdmap e72: 6 total, 5 up, 6 in 2024-09-20T18:43:40.961 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:40 smithi172 podman[97344]: 2024-09-20 18:43:40.727857098 +0000 UTC m=+0.634467890 container remove 831ad57df8cd57f7dd4dd56520dec7dc580c1889501823db793319f0d04d0c8c (image=quay.ceph.io/ceph-ci/ceph@sha256:aa3196c17ef2743d1c74c17c73389e656bc6b43f747b865ccf65c9db3cd9cf65, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5, RELEASE=squid-ed8ee0f, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-20T18:43:41.354 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:41 smithi172 podman[97434]: 2024-09-20 18:43:40.982534687 +0000 UTC m=+0.016053319 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:43:41.354 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:41 smithi172 podman[97434]: 2024-09-20 18:43:41.086938941 +0000 UTC m=+0.120457572 container create c95dc559bffceb5fdcbde498f8004e62402c994dc681db70ffaf28d6f322da91 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-20T18:43:41.354 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:41 smithi172 podman[97434]: 2024-09-20 18:43:41.331419193 +0000 UTC m=+0.364937815 container init c95dc559bffceb5fdcbde498f8004e62402c994dc681db70ffaf28d6f322da91 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-20T18:43:41.706 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:41 smithi172 podman[97434]: 2024-09-20 18:43:41.334839457 +0000 UTC m=+0.368358082 container start c95dc559bffceb5fdcbde498f8004e62402c994dc681db70ffaf28d6f322da91 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T18:43:41.706 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:41 smithi172 podman[97434]: 2024-09-20 18:43:41.414777829 +0000 UTC m=+0.448296467 container attach c95dc559bffceb5fdcbde498f8004e62402c994dc681db70ffaf28d6f322da91 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-20T18:43:41.706 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:41 smithi172 podman[97434]: 2024-09-20 18:43:41.531463579 +0000 UTC m=+0.564982206 container died c95dc559bffceb5fdcbde498f8004e62402c994dc681db70ffaf28d6f322da91 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T18:43:41.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:41 smithi172 ceph-mon[80431]: pgmap v241: 65 pgs: 13 stale+active+clean, 52 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:43:41.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:41 smithi172 ceph-mon[80431]: osdmap e73: 6 total, 5 up, 6 in 2024-09-20T18:43:41.966 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:41 smithi017 ceph-mon[108970]: pgmap v241: 65 pgs: 13 stale+active+clean, 52 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T18:43:41.966 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:41 smithi017 ceph-mon[108970]: osdmap e73: 6 total, 5 up, 6 in 2024-09-20T18:43:42.460 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:42 smithi172 podman[97457]: 2024-09-20 18:43:42.068410275 +0000 UTC m=+0.529947923 container remove c95dc559bffceb5fdcbde498f8004e62402c994dc681db70ffaf28d6f322da91 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-20T18:43:42.461 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:42 smithi172 systemd[1]: ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.5.service: Deactivated successfully. 2024-09-20T18:43:42.461 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:42 smithi172 systemd[1]: Stopped Ceph osd.5 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:43:42.461 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:42 smithi172 systemd[1]: ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.5.service: Consumed 52.271s CPU time. 2024-09-20T18:43:42.461 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:42 smithi172 systemd[1]: Starting Ceph osd.5 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T18:43:42.887 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:42 smithi172 ceph-mon[80431]: Health check failed: Degraded data redundancy: 14/318 objects degraded (4.403%), 5 pgs degraded (PG_DEGRADED) 2024-09-20T18:43:42.888 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:42 smithi172 podman[97560]: 2024-09-20 18:43:42.416765264 +0000 UTC m=+0.015942754 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:43:42.888 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:42 smithi172 podman[97560]: 2024-09-20 18:43:42.536188366 +0000 UTC m=+0.135365847 container create 04560c38a86b7b7567ebf8511a3d8ef219c91a26def99b38d6a66cd2123aa537 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-20T18:43:42.888 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:42 smithi172 podman[97560]: 2024-09-20 18:43:42.747383774 +0000 UTC m=+0.346561262 container init 04560c38a86b7b7567ebf8511a3d8ef219c91a26def99b38d6a66cd2123aa537 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-20T18:43:42.888 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:42 smithi172 podman[97560]: 2024-09-20 18:43:42.751159045 +0000 UTC m=+0.350336526 container start 04560c38a86b7b7567ebf8511a3d8ef219c91a26def99b38d6a66cd2123aa537 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-20T18:43:42.888 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:42 smithi172 podman[97560]: 2024-09-20 18:43:42.87252996 +0000 UTC m=+0.471707452 container attach 04560c38a86b7b7567ebf8511a3d8ef219c91a26def99b38d6a66cd2123aa537 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T18:43:43.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:42 smithi017 ceph-mon[108970]: Health check failed: Degraded data redundancy: 14/318 objects degraded (4.403%), 5 pgs degraded (PG_DEGRADED) 2024-09-20T18:43:43.210 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:42 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate[97575]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:43:43.211 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:42 smithi172 bash[97560]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:43:43.211 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:42 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate[97575]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:43:43.211 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:42 smithi172 bash[97560]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:43:43.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:43 smithi017 ceph-mon[108970]: pgmap v243: 65 pgs: 5 active+undersized, 8 stale+active+clean, 5 active+undersized+degraded, 47 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 14/318 objects degraded (4.403%) 2024-09-20T18:43:44.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:43 smithi172 ceph-mon[80431]: pgmap v243: 65 pgs: 5 active+undersized, 8 stale+active+clean, 5 active+undersized+degraded, 47 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 14/318 objects degraded (4.403%) 2024-09-20T18:43:45.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:45 smithi172 ceph-mon[80431]: pgmap v244: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 49/318 objects degraded (15.409%) 2024-09-20T18:43:45.961 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:45 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate[97575]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T18:43:45.961 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:45 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate[97575]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:43:45.961 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:45 smithi172 bash[97560]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-20T18:43:45.961 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:45 smithi172 bash[97560]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:43:45.961 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:45 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate[97575]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:43:45.961 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:45 smithi172 bash[97560]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-20T18:43:45.961 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:45 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate[97575]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-20T18:43:45.961 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:45 smithi172 bash[97560]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-20T18:43:45.962 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:45 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate[97575]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-09-20T18:43:45.962 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:45 smithi172 bash[97560]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-09-20T18:43:46.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:45 smithi017 ceph-mon[108970]: pgmap v244: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 49/318 objects degraded (15.409%) 2024-09-20T18:43:46.399 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:46 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate[97575]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-20T18:43:46.399 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:46 smithi172 bash[97560]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-20T18:43:46.399 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:46 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate[97575]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-09-20T18:43:46.400 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:46 smithi172 bash[97560]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-09-20T18:43:46.400 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:46 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate[97575]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-20T18:43:46.400 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:46 smithi172 bash[97560]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-20T18:43:46.400 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:46 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate[97575]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-20T18:43:46.400 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:46 smithi172 bash[97560]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-20T18:43:46.400 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:46 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate[97575]: --> ceph-volume lvm activate successful for osd ID: 5 2024-09-20T18:43:46.400 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:46 smithi172 bash[97560]: --> ceph-volume lvm activate successful for osd ID: 5 2024-09-20T18:43:46.400 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:46 smithi172 podman[97560]: 2024-09-20 18:43:46.047886221 +0000 UTC m=+3.647063703 container died 04560c38a86b7b7567ebf8511a3d8ef219c91a26def99b38d6a66cd2123aa537 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-20T18:43:46.960 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:46 smithi172 podman[97773]: 2024-09-20 18:43:46.659385408 +0000 UTC m=+0.605029606 container remove 04560c38a86b7b7567ebf8511a3d8ef219c91a26def99b38d6a66cd2123aa537 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-activate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-20T18:43:46.961 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:46 smithi172 podman[97834]: 2024-09-20 18:43:46.767575811 +0000 UTC m=+0.015595706 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T18:43:46.961 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:46 smithi172 podman[97834]: 2024-09-20 18:43:46.902200602 +0000 UTC m=+0.150220529 container create 6047a709a06ac59af0964e8793a50e2876edbd2510b1b84ad11ef744e08b4d16 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-20T18:43:47.460 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:47 smithi172 podman[97834]: 2024-09-20 18:43:47.129239334 +0000 UTC m=+0.377259224 container init 6047a709a06ac59af0964e8793a50e2876edbd2510b1b84ad11ef744e08b4d16 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-20T18:43:47.461 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:47 smithi172 podman[97834]: 2024-09-20 18:43:47.132434446 +0000 UTC m=+0.380454334 container start 6047a709a06ac59af0964e8793a50e2876edbd2510b1b84ad11ef744e08b4d16 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-20T18:43:47.461 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:47 smithi172 ceph-osd[97853]: -- 172.21.15.172:0/288521115 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557ee68ae1e0 con 0x557ee5ab9c00 2024-09-20T18:43:47.461 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:47 smithi172 bash[97834]: 6047a709a06ac59af0964e8793a50e2876edbd2510b1b84ad11ef744e08b4d16 2024-09-20T18:43:47.461 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:47 smithi172 systemd[1]: Started Ceph osd.5 for 7a27d282-777d-11ef-baf5-efdc52797490. 2024-09-20T18:43:48.065 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:47 smithi172 ceph-mon[80431]: pgmap v245: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 49/318 objects degraded (15.409%) 2024-09-20T18:43:48.065 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:47 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:48.065 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:47 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:48.065 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:47 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:43:48.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:47 smithi017 ceph-mon[108970]: pgmap v245: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 49/318 objects degraded (15.409%) 2024-09-20T18:43:48.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:47 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:48.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:47 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:48.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:47 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:43:49.384 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:49 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T18:43:49.018+0000 7f94e2b3a640 -1 Falling back to public interface 2024-09-20T18:43:49.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:49 smithi017 ceph-mon[108970]: pgmap v246: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 49/318 objects degraded (15.409%) 2024-09-20T18:43:50.045 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:49 smithi172 ceph-mon[80431]: pgmap v246: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 49/318 objects degraded (15.409%) 2024-09-20T18:43:51.317 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:51 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:51.318 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:51 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:51.318 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:51 smithi172 ceph-mon[80431]: pgmap v247: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 49/318 objects degraded (15.409%) 2024-09-20T18:43:51.318 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:51 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:51.318 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:51 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:51.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:51 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:51.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:51 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:51.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:51 smithi017 ceph-mon[108970]: pgmap v247: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 49/318 objects degraded (15.409%) 2024-09-20T18:43:51.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:51 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:51.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:51 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:52.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:52 smithi172 ceph-mon[80431]: Health check update: Degraded data redundancy: 49/318 objects degraded (15.409%), 14 pgs degraded (PG_DEGRADED) 2024-09-20T18:43:52.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:52 smithi017 ceph-mon[108970]: Health check update: Degraded data redundancy: 49/318 objects degraded (15.409%), 14 pgs degraded (PG_DEGRADED) 2024-09-20T18:43:53.337 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:53 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:53.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:53 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:43:53.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:53 smithi172 ceph-mon[80431]: pgmap v248: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 49/318 objects degraded (15.409%) 2024-09-20T18:43:53.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:53 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:53.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:53 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:43:53.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:53 smithi017 ceph-mon[108970]: pgmap v248: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 49/318 objects degraded (15.409%) 2024-09-20T18:43:54.210 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:53 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T18:43:53.801+0000 7f94e2b3a640 -1 osd.5 71 log_to_monitors true 2024-09-20T18:43:55.033 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T18:43:54.754+0000 7f94da8e4640 -1 osd.5 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-20T18:43:55.033 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:55.034 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:55.034 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:43:55.034 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:43:55.034 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:55.034 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='osd.5 [v2:172.21.15.172:6816/3180789918,v1:172.21.15.172:6817/3180789918]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-20T18:43:55.034 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-20T18:43:55.034 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:43:55.034 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:55.034 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:55.034 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:55.034 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:55.034 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:55.035 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-20T18:43:55.035 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-20T18:43:55.035 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-20T18:43:55.035 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-20T18:43:55.035 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-20T18:43:55.035 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-20T18:43:55.035 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-20T18:43:55.035 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-20T18:43:55.035 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-20T18:43:55.035 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-20T18:43:55.035 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-20T18:43:55.035 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-20T18:43:55.035 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:55.036 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:54 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"} : dispatch 2024-09-20T18:43:55.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:55.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:55.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:43:55.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:43:55.040 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:55.040 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='osd.5 [v2:172.21.15.172:6816/3180789918,v1:172.21.15.172:6817/3180789918]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-20T18:43:55.040 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-20T18:43:55.040 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:43:55.040 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:55.040 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:55.040 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:55.040 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:55.040 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:55.040 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-20T18:43:55.040 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-20T18:43:55.040 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-20T18:43:55.040 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-20T18:43:55.040 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-20T18:43:55.040 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-20T18:43:55.041 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-20T18:43:55.041 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-20T18:43:55.041 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-20T18:43:55.041 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-20T18:43:55.041 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-20T18:43:55.041 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-20T18:43:55.041 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:55.041 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"} : dispatch 2024-09-20T18:43:55.041 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:54 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:43:54.970+0000 7fd07ba0a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-20T18:43:55.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: Upgrade: Setting container_image for all osd 2024-09-20T18:43:55.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-20T18:43:55.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: pgmap v249: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 49/318 objects degraded (15.409%) 2024-09-20T18:43:55.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-20T18:43:55.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='osd.5 [v2:172.21.15.172:6816/3180789918,v1:172.21.15.172:6817/3180789918]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-20T18:43:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: osdmap e74: 6 total, 5 up, 6 in 2024-09-20T18:43:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-20T18:43:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-20T18:43:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-20T18:43:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 2024-09-20T18:43:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:43:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:43:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:43:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:43:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-20T18:43:55.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T18:43:55.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-20T18:43:55.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-20T18:43:55.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-20T18:43:55.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-20T18:43:55.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: osd.5 [v2:172.21.15.172:6816/3180789918,v1:172.21.15.172:6817/3180789918] boot 2024-09-20T18:43:55.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: osdmap e75: 6 total, 6 up, 6 in 2024-09-20T18:43:55.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: mds.? [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] up:boot 2024-09-20T18:43:55.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: mds.? [v2:172.21.15.17:6828/1871368212,v1:172.21.15.17:6829/1871368212] up:boot 2024-09-20T18:43:55.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-20T18:43:55.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi017.xhlvpy"} : dispatch 2024-09-20T18:43:55.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi172.liatxm"} : dispatch 2024-09-20T18:43:55.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-20T18:43:56.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: Upgrade: Setting container_image for all osd 2024-09-20T18:43:56.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-20T18:43:56.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: pgmap v249: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 999 MiB used, 535 GiB / 536 GiB avail; 49/318 objects degraded (15.409%) 2024-09-20T18:43:56.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-20T18:43:56.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='osd.5 [v2:172.21.15.172:6816/3180789918,v1:172.21.15.172:6817/3180789918]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-20T18:43:56.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: osdmap e74: 6 total, 5 up, 6 in 2024-09-20T18:43:56.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-20T18:43:56.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-20T18:43:56.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-20T18:43:56.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi172.mugtlk=up:active} 2024-09-20T18:43:56.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:43:56.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:43:56.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:43:56.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:56.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:43:56.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:56.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:56.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:56.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:43:56.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-20T18:43:56.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-20T18:43:56.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-20T18:43:56.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-20T18:43:56.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-20T18:43:56.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-20T18:43:56.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: osd.5 [v2:172.21.15.172:6816/3180789918,v1:172.21.15.172:6817/3180789918] boot 2024-09-20T18:43:56.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: osdmap e75: 6 total, 6 up, 6 in 2024-09-20T18:43:56.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: mds.? [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] up:boot 2024-09-20T18:43:56.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: mds.? [v2:172.21.15.17:6828/1871368212,v1:172.21.15.17:6829/1871368212] up:boot 2024-09-20T18:43:56.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-20T18:43:56.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi017.xhlvpy"} : dispatch 2024-09-20T18:43:56.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi172.liatxm"} : dispatch 2024-09-20T18:43:56.213 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-20T18:43:56.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:56 smithi017 ceph-mon[108970]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-20T18:43:56.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:56 smithi017 ceph-mon[108970]: osdmap e76: 6 total, 6 up, 6 in 2024-09-20T18:43:56.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:56 smithi017 ceph-mon[108970]: mds.? [v2:172.21.15.172:6824/2779951413,v1:172.21.15.172:6825/2779951413] up:boot 2024-09-20T18:43:56.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:56 smithi017 ceph-mon[108970]: mds.? [v2:172.21.15.17:6826/3271129451,v1:172.21.15.17:6827/3271129451] up:boot 2024-09-20T18:43:56.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:56 smithi017 ceph-mon[108970]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-20T18:43:56.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:56 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi017.puqizo"} : dispatch 2024-09-20T18:43:56.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:56 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi172.mugtlk"} : dispatch 2024-09-20T18:43:56.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:56 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:56.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:56 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.puqizo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-20T18:43:56.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:56 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:43:57.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:56 smithi172 ceph-mon[80431]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-20T18:43:57.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:56 smithi172 ceph-mon[80431]: osdmap e76: 6 total, 6 up, 6 in 2024-09-20T18:43:57.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:56 smithi172 ceph-mon[80431]: mds.? [v2:172.21.15.172:6824/2779951413,v1:172.21.15.172:6825/2779951413] up:boot 2024-09-20T18:43:57.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:56 smithi172 ceph-mon[80431]: mds.? [v2:172.21.15.17:6826/3271129451,v1:172.21.15.17:6827/3271129451] up:boot 2024-09-20T18:43:57.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:56 smithi172 ceph-mon[80431]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-20T18:43:57.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:56 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi017.puqizo"} : dispatch 2024-09-20T18:43:57.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:56 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi172.mugtlk"} : dispatch 2024-09-20T18:43:57.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:56 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:43:57.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:56 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.puqizo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-20T18:43:57.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:56 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:43:58.083 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:57 smithi017 ceph-mon[108970]: pgmap v253: 65 pgs: 2 peering, 13 active+undersized, 13 active+undersized+degraded, 37 active+clean; 245 MiB data, 953 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 46/318 objects degraded (14.465%) 2024-09-20T18:43:58.083 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:57 smithi017 ceph-mon[108970]: Upgrade: Updating mds.cephfs.smithi017.puqizo 2024-09-20T18:43:58.083 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:57 smithi017 ceph-mon[108970]: Deploying daemon mds.cephfs.smithi017.puqizo on smithi017 2024-09-20T18:43:58.083 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:57 smithi017 ceph-mon[108970]: Health check update: Degraded data redundancy: 46/318 objects degraded (14.465%), 13 pgs degraded (PG_DEGRADED) 2024-09-20T18:43:58.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:57 smithi172 ceph-mon[80431]: pgmap v253: 65 pgs: 2 peering, 13 active+undersized, 13 active+undersized+degraded, 37 active+clean; 245 MiB data, 953 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 46/318 objects degraded (14.465%) 2024-09-20T18:43:58.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:57 smithi172 ceph-mon[80431]: Upgrade: Updating mds.cephfs.smithi017.puqizo 2024-09-20T18:43:58.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:57 smithi172 ceph-mon[80431]: Deploying daemon mds.cephfs.smithi017.puqizo on smithi017 2024-09-20T18:43:58.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:57 smithi172 ceph-mon[80431]: Health check update: Degraded data redundancy: 46/318 objects degraded (14.465%), 13 pgs degraded (PG_DEGRADED) 2024-09-20T18:44:00.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:59 smithi017 ceph-mon[108970]: pgmap v254: 65 pgs: 2 peering, 9 active+undersized, 6 active+undersized+degraded, 48 active+clean; 245 MiB data, 953 MiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 19/318 objects degraded (5.975%) 2024-09-20T18:44:00.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:59 smithi017 ceph-mon[108970]: osdmap e77: 6 total, 6 up, 6 in 2024-09-20T18:44:00.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:43:59 smithi017 ceph-mon[108970]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-20T18:44:00.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:59 smithi172 ceph-mon[80431]: pgmap v254: 65 pgs: 2 peering, 9 active+undersized, 6 active+undersized+degraded, 48 active+clean; 245 MiB data, 953 MiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 19/318 objects degraded (5.975%) 2024-09-20T18:44:00.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:59 smithi172 ceph-mon[80431]: osdmap e77: 6 total, 6 up, 6 in 2024-09-20T18:44:00.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:43:59 smithi172 ceph-mon[80431]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-20T18:44:01.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:00 smithi017 ceph-mon[108970]: pgmap v256: 65 pgs: 2 peering, 63 active+clean; 245 MiB data, 953 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:01.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:00 smithi017 ceph-mon[108970]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/318 objects degraded (5.975%), 6 pgs degraded) 2024-09-20T18:44:01.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:00 smithi172 ceph-mon[80431]: pgmap v256: 65 pgs: 2 peering, 63 active+clean; 245 MiB data, 953 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:01.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:00 smithi172 ceph-mon[80431]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/318 objects degraded (5.975%), 6 pgs degraded) 2024-09-20T18:44:01.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:01 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi017.puqizo"} : dispatch 2024-09-20T18:44:02.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:01 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi017.puqizo"} : dispatch 2024-09-20T18:44:03.077 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:02 smithi017 ceph-mon[108970]: pgmap v257: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:03.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:02 smithi172 ceph-mon[80431]: pgmap v257: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:05.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.505+0000 7f20cc777640 1 -- 172.21.15.17:0/4131819116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20c4102ab0 msgr2=0x7f20c4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:05.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.505+0000 7f20cc777640 1 --2- 172.21.15.17:0/4131819116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20c4102ab0 0x7f20c4102e90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009880 tx=0x7f20c002a530 comp rx=0 tx=0).stop 2024-09-20T18:44:05.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.505+0000 7f20cc777640 1 -- 172.21.15.17:0/4131819116 shutdown_connections 2024-09-20T18:44:05.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.505+0000 7f20cc777640 1 --2- 172.21.15.17:0/4131819116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20c41033d0 0x7f20c410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:05.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.505+0000 7f20cc777640 1 --2- 172.21.15.17:0/4131819116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20c4102ab0 0x7f20c4102e90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:05.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.505+0000 7f20cc777640 1 -- 172.21.15.17:0/4131819116 >> 172.21.15.17:0/4131819116 conn(0x7f20c40fc550 msgr2=0x7f20c40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:05.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.505+0000 7f20cc777640 1 -- 172.21.15.17:0/4131819116 shutdown_connections 2024-09-20T18:44:05.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.505+0000 7f20cc777640 1 -- 172.21.15.17:0/4131819116 wait complete. 2024-09-20T18:44:05.523 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:05 smithi017 ceph-mon[108970]: mds.? [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] up:boot 2024-09-20T18:44:05.523 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:05 smithi017 ceph-mon[108970]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-20T18:44:05.523 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:05 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi017.puqizo"} : dispatch 2024-09-20T18:44:05.523 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:05 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:05.523 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:05 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:05.523 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:05 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:44:05.523 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:05 smithi017 ceph-mon[108970]: pgmap v258: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.506+0000 7f20cc777640 1 Processor -- start 2024-09-20T18:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.506+0000 7f20cc777640 1 -- start start 2024-09-20T18:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.506+0000 7f20cc777640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20c4102ab0 0x7f20c419f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.506+0000 7f20cc777640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20c41033d0 0x7f20c419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.506+0000 7f20cc777640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f20c410edc0 con 0x7f20c4102ab0 2024-09-20T18:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.506+0000 7f20cc777640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f20c410ec40 con 0x7f20c41033d0 2024-09-20T18:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.506+0000 7f20ca513640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20c4102ab0 0x7f20c419f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.506+0000 7f20ca513640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20c4102ab0 0x7f20c419f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35636/0 (socket says 172.21.15.17:35636) 2024-09-20T18:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.506+0000 7f20ca513640 1 -- 172.21.15.17:0/2855108519 learned_addr learned my addr 172.21.15.17:0/2855108519 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:44:05.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.506+0000 7f20c9d12640 1 --2- 172.21.15.17:0/2855108519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20c41033d0 0x7f20c419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.506+0000 7f20ca513640 1 -- 172.21.15.17:0/2855108519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20c41033d0 msgr2=0x7f20c419fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.506+0000 7f20ca513640 1 --2- 172.21.15.17:0/2855108519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20c41033d0 0x7f20c419fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.506+0000 7f20ca513640 1 -- 172.21.15.17:0/2855108519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c41a0400 con 0x7f20c4102ab0 2024-09-20T18:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.507+0000 7f20ca513640 1 --2- 172.21.15.17:0/2855108519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20c4102ab0 0x7f20c419f810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f20c0031460 tx=0x7f20c00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.507+0000 7f20bb7fe640 1 -- 172.21.15.17:0/2855108519 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f20c003f070 con 0x7f20c4102ab0 2024-09-20T18:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.507+0000 7f20bb7fe640 1 -- 172.21.15.17:0/2855108519 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f20c0004cf0 con 0x7f20c4102ab0 2024-09-20T18:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.507+0000 7f20cc777640 1 -- 172.21.15.17:0/2855108519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c4199a90 con 0x7f20c4102ab0 2024-09-20T18:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.507+0000 7f20bb7fe640 1 -- 172.21.15.17:0/2855108519 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f20c0035030 con 0x7f20c4102ab0 2024-09-20T18:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.507+0000 7f20cc777640 1 -- 172.21.15.17:0/2855108519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c4199ed0 con 0x7f20c4102ab0 2024-09-20T18:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.508+0000 7f20cc777640 1 -- 172.21.15.17:0/2855108519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20c406a580 con 0x7f20c4102ab0 2024-09-20T18:44:05.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.509+0000 7f20bb7fe640 1 -- 172.21.15.17:0/2855108519 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f20c0042070 con 0x7f20c4102ab0 2024-09-20T18:44:05.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.510+0000 7f20bb7fe640 1 --2- 172.21.15.17:0/2855108519 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f20b007af80 0x7f20b007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:05.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.510+0000 7f20bb7fe640 1 -- 172.21.15.17:0/2855108519 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6156+0+0 (secure 0 0 0) 0x7f20c00be930 con 0x7f20c4102ab0 2024-09-20T18:44:05.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.510+0000 7f20c9d12640 1 --2- 172.21.15.17:0/2855108519 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f20b007af80 0x7f20b007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:05.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.510+0000 7f20c9d12640 1 --2- 172.21.15.17:0/2855108519 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f20b007af80 0x7f20b007d440 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f20c40fe4c0 tx=0x7f20b400a250 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.514+0000 7f20bb7fe640 1 -- 172.21.15.17:0/2855108519 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f20c0089fb0 con 0x7f20c4102ab0 2024-09-20T18:44:05.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:05 smithi172 ceph-mon[80431]: mds.? [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] up:boot 2024-09-20T18:44:05.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:05 smithi172 ceph-mon[80431]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-20T18:44:05.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:05 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi017.puqizo"} : dispatch 2024-09-20T18:44:05.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:05 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:05.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:05 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:05.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:05 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:44:05.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:05 smithi172 ceph-mon[80431]: pgmap v258: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:05.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.724+0000 7f20cc777640 1 -- 172.21.15.17:0/2855108519 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f20c410ae50 con 0x7f20b007af80 2024-09-20T18:44:05.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.725+0000 7f20bb7fe640 1 -- 172.21.15.17:0/2855108519 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f20c410ae50 con 0x7f20b007af80 2024-09-20T18:44:05.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.728+0000 7f20cc777640 1 -- 172.21.15.17:0/2855108519 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f20b007af80 msgr2=0x7f20b007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:05.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.728+0000 7f20cc777640 1 --2- 172.21.15.17:0/2855108519 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f20b007af80 0x7f20b007d440 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f20c40fe4c0 tx=0x7f20b400a250 comp rx=0 tx=0).stop 2024-09-20T18:44:05.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.728+0000 7f20cc777640 1 -- 172.21.15.17:0/2855108519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20c4102ab0 msgr2=0x7f20c419f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:05.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.728+0000 7f20cc777640 1 --2- 172.21.15.17:0/2855108519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20c4102ab0 0x7f20c419f810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f20c0031460 tx=0x7f20c00048f0 comp rx=0 tx=0).stop 2024-09-20T18:44:05.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.728+0000 7f20cc777640 1 -- 172.21.15.17:0/2855108519 shutdown_connections 2024-09-20T18:44:05.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.728+0000 7f20cc777640 1 --2- 172.21.15.17:0/2855108519 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f20b007af80 0x7f20b007d440 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:05.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.728+0000 7f20cc777640 1 --2- 172.21.15.17:0/2855108519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20c41033d0 0x7f20c419fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:05.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.728+0000 7f20cc777640 1 --2- 172.21.15.17:0/2855108519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20c4102ab0 0x7f20c419f810 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:05.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.728+0000 7f20cc777640 1 -- 172.21.15.17:0/2855108519 >> 172.21.15.17:0/2855108519 conn(0x7f20c40fc550 msgr2=0x7f20c41009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:05.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.728+0000 7f20cc777640 1 -- 172.21.15.17:0/2855108519 shutdown_connections 2024-09-20T18:44:05.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.728+0000 7f20cc777640 1 -- 172.21.15.17:0/2855108519 wait complete. 2024-09-20T18:44:05.754 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:44:05.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.819+0000 7fbcf5f19640 1 -- 172.21.15.17:0/2988063807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf0102ac0 msgr2=0x7fbcf0102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:05.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.819+0000 7fbcf5f19640 1 --2- 172.21.15.17:0/2988063807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf0102ac0 0x7fbcf0102ea0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009880 tx=0x7fbce002a530 comp rx=0 tx=0).stop 2024-09-20T18:44:05.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.819+0000 7fbcf5f19640 1 -- 172.21.15.17:0/2988063807 shutdown_connections 2024-09-20T18:44:05.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.819+0000 7fbcf5f19640 1 --2- 172.21.15.17:0/2988063807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcf01033e0 0x7fbcf010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:05.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.819+0000 7fbcf5f19640 1 --2- 172.21.15.17:0/2988063807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf0102ac0 0x7fbcf0102ea0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:05.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.819+0000 7fbcf5f19640 1 -- 172.21.15.17:0/2988063807 >> 172.21.15.17:0/2988063807 conn(0x7fbcf00fc520 msgr2=0x7fbcf00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:05.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.819+0000 7fbcf5f19640 1 -- 172.21.15.17:0/2988063807 shutdown_connections 2024-09-20T18:44:05.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.819+0000 7fbcf5f19640 1 -- 172.21.15.17:0/2988063807 wait complete. 2024-09-20T18:44:05.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.819+0000 7fbcf5f19640 1 Processor -- start 2024-09-20T18:44:05.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.820+0000 7fbcf5f19640 1 -- start start 2024-09-20T18:44:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.820+0000 7fbcf5f19640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcf0102ac0 0x7fbcf019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.820+0000 7fbcf5f19640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf01033e0 0x7fbcf019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.820+0000 7fbcf5f19640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf010edf0 con 0x7fbcf01033e0 2024-09-20T18:44:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.820+0000 7fbcf5f19640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf010ec70 con 0x7fbcf0102ac0 2024-09-20T18:44:05.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.820+0000 7fbce6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf01033e0 0x7fbcf019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.820+0000 7fbce6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf01033e0 0x7fbcf019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35656/0 (socket says 172.21.15.17:35656) 2024-09-20T18:44:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.820+0000 7fbce6ffd640 1 -- 172.21.15.17:0/1155061503 learned_addr learned my addr 172.21.15.17:0/1155061503 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:44:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.820+0000 7fbcef7fe640 1 --2- 172.21.15.17:0/1155061503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcf0102ac0 0x7fbcf019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.820+0000 7fbce6ffd640 1 -- 172.21.15.17:0/1155061503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcf0102ac0 msgr2=0x7fbcf019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.820+0000 7fbce6ffd640 1 --2- 172.21.15.17:0/1155061503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcf0102ac0 0x7fbcf019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.820+0000 7fbce6ffd640 1 -- 172.21.15.17:0/1155061503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf01977c0 con 0x7fbcf01033e0 2024-09-20T18:44:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.820+0000 7fbcef7fe640 1 --2- 172.21.15.17:0/1155061503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcf0102ac0 0x7fbcf019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:44:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.821+0000 7fbce6ffd640 1 --2- 172.21.15.17:0/1155061503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf01033e0 0x7fbcf019db80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800d6d0 tx=0x7fbcd800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.821+0000 7fbced7fa640 1 -- 172.21.15.17:0/1155061503 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbcd8017070 con 0x7fbcf01033e0 2024-09-20T18:44:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.821+0000 7fbced7fa640 1 -- 172.21.15.17:0/1155061503 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbcd80054e0 con 0x7fbcf01033e0 2024-09-20T18:44:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.821+0000 7fbcf5f19640 1 -- 172.21.15.17:0/1155061503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf0197ab0 con 0x7fbcf01033e0 2024-09-20T18:44:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.821+0000 7fbced7fa640 1 -- 172.21.15.17:0/1155061503 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbcd8004ae0 con 0x7fbcf01033e0 2024-09-20T18:44:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.821+0000 7fbcf5f19640 1 -- 172.21.15.17:0/1155061503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf0198040 con 0x7fbcf01033e0 2024-09-20T18:44:05.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.822+0000 7fbcf5f19640 1 -- 172.21.15.17:0/1155061503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf006aa90 con 0x7fbcf01033e0 2024-09-20T18:44:05.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.823+0000 7fbced7fa640 1 -- 172.21.15.17:0/1155061503 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fbcd8004de0 con 0x7fbcf01033e0 2024-09-20T18:44:05.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.824+0000 7fbced7fa640 1 --2- 172.21.15.17:0/1155061503 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbcdc07af30 0x7fbcdc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:05.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.824+0000 7fbced7fa640 1 -- 172.21.15.17:0/1155061503 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6156+0+0 (secure 0 0 0) 0x7fbcd809dc10 con 0x7fbcf01033e0 2024-09-20T18:44:05.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.824+0000 7fbcef7fe640 1 --2- 172.21.15.17:0/1155061503 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbcdc07af30 0x7fbcdc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:05.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.824+0000 7fbcef7fe640 1 --2- 172.21.15.17:0/1155061503 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbcdc07af30 0x7fbcdc07d3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbce0000c00 tx=0x7fbce0031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:05.830+0000 7fbced7fa640 1 -- 172.21.15.17:0/1155061503 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbcd8069210 con 0x7fbcf01033e0 2024-09-20T18:44:06.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.040+0000 7fbcf5f19640 1 -- 172.21.15.17:0/1155061503 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbcf01982f0 con 0x7fbcdc07af30 2024-09-20T18:44:06.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.042+0000 7fbced7fa640 1 -- 172.21.15.17:0/1155061503 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fbcf01982f0 con 0x7fbcdc07af30 2024-09-20T18:44:06.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.044+0000 7fbcf5f19640 1 -- 172.21.15.17:0/1155061503 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbcdc07af30 msgr2=0x7fbcdc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:06.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.044+0000 7fbcf5f19640 1 --2- 172.21.15.17:0/1155061503 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbcdc07af30 0x7fbcdc07d3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbce0000c00 tx=0x7fbce0031400 comp rx=0 tx=0).stop 2024-09-20T18:44:06.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.044+0000 7fbcf5f19640 1 -- 172.21.15.17:0/1155061503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf01033e0 msgr2=0x7fbcf019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:06.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.044+0000 7fbcf5f19640 1 --2- 172.21.15.17:0/1155061503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf01033e0 0x7fbcf019db80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800d6d0 tx=0x7fbcd800db90 comp rx=0 tx=0).stop 2024-09-20T18:44:06.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.044+0000 7fbcf5f19640 1 -- 172.21.15.17:0/1155061503 shutdown_connections 2024-09-20T18:44:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.044+0000 7fbcf5f19640 1 --2- 172.21.15.17:0/1155061503 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbcdc07af30 0x7fbcdc07d3f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.044+0000 7fbcf5f19640 1 --2- 172.21.15.17:0/1155061503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf01033e0 0x7fbcf019db80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.044+0000 7fbcf5f19640 1 --2- 172.21.15.17:0/1155061503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcf0102ac0 0x7fbcf019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.044+0000 7fbcf5f19640 1 -- 172.21.15.17:0/1155061503 >> 172.21.15.17:0/1155061503 conn(0x7fbcf00fc520 msgr2=0x7fbcf010af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.044+0000 7fbcf5f19640 1 -- 172.21.15.17:0/1155061503 shutdown_connections 2024-09-20T18:44:06.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.045+0000 7fbcf5f19640 1 -- 172.21.15.17:0/1155061503 wait complete. 2024-09-20T18:44:06.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.132+0000 7fbb0f457640 1 -- 172.21.15.17:0/352320771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb08103490 msgr2=0x7fbb0810b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:06.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.132+0000 7fbb0f457640 1 --2- 172.21.15.17:0/352320771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb08103490 0x7fbb0810b980 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8009880 tx=0x7fbaf802a530 comp rx=0 tx=0).stop 2024-09-20T18:44:06.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.132+0000 7fbb0f457640 1 -- 172.21.15.17:0/352320771 shutdown_connections 2024-09-20T18:44:06.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.132+0000 7fbb0f457640 1 --2- 172.21.15.17:0/352320771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb08103490 0x7fbb0810b980 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.132+0000 7fbb0f457640 1 --2- 172.21.15.17:0/352320771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb08102b70 0x7fbb08102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.132+0000 7fbb0f457640 1 -- 172.21.15.17:0/352320771 >> 172.21.15.17:0/352320771 conn(0x7fbb080fc4d0 msgr2=0x7fbb080fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:06.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.132+0000 7fbb0f457640 1 -- 172.21.15.17:0/352320771 shutdown_connections 2024-09-20T18:44:06.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.132+0000 7fbb0f457640 1 -- 172.21.15.17:0/352320771 wait complete. 2024-09-20T18:44:06.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.133+0000 7fbb0f457640 1 Processor -- start 2024-09-20T18:44:06.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.133+0000 7fbb0f457640 1 -- start start 2024-09-20T18:44:06.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.133+0000 7fbb0f457640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb08102b70 0x7fbb081007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:06.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.133+0000 7fbb0f457640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb08103490 0x7fbb08100d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:06.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.133+0000 7fbb0f457640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0810edc0 con 0x7fbb08103490 2024-09-20T18:44:06.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.133+0000 7fbb0f457640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0810ec40 con 0x7fbb08102b70 2024-09-20T18:44:06.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.133+0000 7fbb0c9f2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb08103490 0x7fbb08100d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:06.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.133+0000 7fbb0c9f2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb08103490 0x7fbb08100d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35676/0 (socket says 172.21.15.17:35676) 2024-09-20T18:44:06.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.133+0000 7fbb0c9f2640 1 -- 172.21.15.17:0/234039237 learned_addr learned my addr 172.21.15.17:0/234039237 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:44:06.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.133+0000 7fbb0d1f3640 1 --2- 172.21.15.17:0/234039237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb08102b70 0x7fbb081007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:06.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.134+0000 7fbb0c9f2640 1 -- 172.21.15.17:0/234039237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb08102b70 msgr2=0x7fbb081007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:06.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.134+0000 7fbb0c9f2640 1 --2- 172.21.15.17:0/234039237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb08102b70 0x7fbb081007d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.134+0000 7fbb0c9f2640 1 -- 172.21.15.17:0/234039237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb08101250 con 0x7fbb08103490 2024-09-20T18:44:06.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.134+0000 7fbb0c9f2640 1 --2- 172.21.15.17:0/234039237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb08103490 0x7fbb08100d10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8004f90 tx=0x7fbaf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:06.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.134+0000 7fbafe7fc640 1 -- 172.21.15.17:0/234039237 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbaf803f070 con 0x7fbb08103490 2024-09-20T18:44:06.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.134+0000 7fbb0f457640 1 -- 172.21.15.17:0/234039237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb081014e0 con 0x7fbb08103490 2024-09-20T18:44:06.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.134+0000 7fbb0f457640 1 -- 172.21.15.17:0/234039237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb081a3db0 con 0x7fbb08103490 2024-09-20T18:44:06.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.134+0000 7fbafe7fc640 1 -- 172.21.15.17:0/234039237 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbaf8004ac0 con 0x7fbb08103490 2024-09-20T18:44:06.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.135+0000 7fbafe7fc640 1 -- 172.21.15.17:0/234039237 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbaf8035030 con 0x7fbb08103490 2024-09-20T18:44:06.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.136+0000 7fbb0f457640 1 -- 172.21.15.17:0/234039237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb0806ace0 con 0x7fbb08103490 2024-09-20T18:44:06.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.136+0000 7fbafe7fc640 1 -- 172.21.15.17:0/234039237 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fbaf8042070 con 0x7fbb08103490 2024-09-20T18:44:06.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.137+0000 7fbafe7fc640 1 --2- 172.21.15.17:0/234039237 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbaf407af80 0x7fbaf407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:06.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.137+0000 7fbafe7fc640 1 -- 172.21.15.17:0/234039237 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6156+0+0 (secure 0 0 0) 0x7fbaf80be7c0 con 0x7fbb08103490 2024-09-20T18:44:06.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.137+0000 7fbb0d1f3640 1 --2- 172.21.15.17:0/234039237 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbaf407af80 0x7fbaf407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:06.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.138+0000 7fbb0d1f3640 1 --2- 172.21.15.17:0/234039237 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbaf407af80 0x7fbaf407d440 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009bd0 tx=0x7fbb04005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:06.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.142+0000 7fbafe7fc640 1 -- 172.21.15.17:0/234039237 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbaf8089e40 con 0x7fbb08103490 2024-09-20T18:44:06.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.358+0000 7fbb0f457640 1 -- 172.21.15.17:0/234039237 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fbb08062630 con 0x7fbaf407af80 2024-09-20T18:44:06.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.368+0000 7fbafe7fc640 1 -- 172.21.15.17:0/234039237 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fbb08062630 con 0x7fbaf407af80 2024-09-20T18:44:06.384 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:44:06.384 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (5m) 119s ago 16m 19.8M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:44:06.384 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (8m) 119s ago 16m 9042k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:44:06.384 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (8m) 16s ago 15m 9017k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:44:06.384 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (3m) 119s ago 16m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:44:06.384 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (3m) 16s ago 15m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:44:06.384 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (5m) 119s ago 16m 80.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:44:06.384 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 starting - - - - 2024-09-20T18:44:06.384 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (11m) 119s ago 11m 95.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 4f8041608cbd 2024-09-20T18:44:06.384 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (11m) 16s ago 11m 27.1M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:44:06.384 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (11m) 16s ago 11m 26.8M - 19.1.1-369-ged8ee0f2 6acb0a031eab 13ff656f8710 2024-09-20T18:44:06.385 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (7m) 119s ago 17m 525M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:44:06.385 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (6m) 16s ago 15m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:44:06.385 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (4m) 119s ago 17m 42.3M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:44:06.385 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (3m) 16s ago 15m 37.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:44:06.385 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (6m) 119s ago 16m 11.4M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:44:06.385 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (6m) 16s ago 15m 11.3M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:44:06.385 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (3m) 119s ago 14m 82.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:44:06.385 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (2m) 119s ago 13m 87.9M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:44:06.385 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (2m) 119s ago 13m 12.2M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:44:06.385 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (87s) 16s ago 13m 97.9M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:44:06.385 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (53s) 16s ago 12m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:44:06.385 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (19s) 16s ago 12m 11.4M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:44:06.385 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (5m) 119s ago 16m 53.2M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:44:06.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.370+0000 7fbb0f457640 1 -- 172.21.15.17:0/234039237 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbaf407af80 msgr2=0x7fbaf407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:06.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.370+0000 7fbb0f457640 1 --2- 172.21.15.17:0/234039237 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbaf407af80 0x7fbaf407d440 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009bd0 tx=0x7fbb04005f90 comp rx=0 tx=0).stop 2024-09-20T18:44:06.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.370+0000 7fbb0f457640 1 -- 172.21.15.17:0/234039237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb08103490 msgr2=0x7fbb08100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.370+0000 7fbb0f457640 1 --2- 172.21.15.17:0/234039237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb08103490 0x7fbb08100d10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8004f90 tx=0x7fbaf80046c0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.370+0000 7fbb0f457640 1 -- 172.21.15.17:0/234039237 shutdown_connections 2024-09-20T18:44:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.370+0000 7fbb0f457640 1 --2- 172.21.15.17:0/234039237 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbaf407af80 0x7fbaf407d440 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.370+0000 7fbb0f457640 1 --2- 172.21.15.17:0/234039237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb08103490 0x7fbb08100d10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.370+0000 7fbb0f457640 1 --2- 172.21.15.17:0/234039237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb08102b70 0x7fbb081007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.370+0000 7fbb0f457640 1 -- 172.21.15.17:0/234039237 >> 172.21.15.17:0/234039237 conn(0x7fbb080fc4d0 msgr2=0x7fbb08103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.370+0000 7fbb0f457640 1 -- 172.21.15.17:0/234039237 shutdown_connections 2024-09-20T18:44:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.370+0000 7fbb0f457640 1 -- 172.21.15.17:0/234039237 wait complete. 2024-09-20T18:44:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.453+0000 7fc298cdc640 1 -- 172.21.15.17:0/4212451306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2941067f0 msgr2=0x7fc294106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.453+0000 7fc298cdc640 1 --2- 172.21.15.17:0/4212451306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2941067f0 0x7fc294106bd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc284009880 tx=0x7fc28402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.453+0000 7fc298cdc640 1 -- 172.21.15.17:0/4212451306 shutdown_connections 2024-09-20T18:44:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.453+0000 7fc298cdc640 1 --2- 172.21.15.17:0/4212451306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2941007f0 0x7fc294100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.453+0000 7fc298cdc640 1 --2- 172.21.15.17:0/4212451306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2941067f0 0x7fc294106bd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.453+0000 7fc298cdc640 1 -- 172.21.15.17:0/4212451306 >> 172.21.15.17:0/4212451306 conn(0x7fc2940fc550 msgr2=0x7fc2940fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.454+0000 7fc298cdc640 1 -- 172.21.15.17:0/4212451306 shutdown_connections 2024-09-20T18:44:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.454+0000 7fc298cdc640 1 -- 172.21.15.17:0/4212451306 wait complete. 2024-09-20T18:44:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.454+0000 7fc298cdc640 1 Processor -- start 2024-09-20T18:44:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.455+0000 7fc298cdc640 1 -- start start 2024-09-20T18:44:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.455+0000 7fc298cdc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2941007f0 0x7fc29419c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.455+0000 7fc298cdc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2941067f0 0x7fc29419cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.455+0000 7fc298cdc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc29410dca0 con 0x7fc2941067f0 2024-09-20T18:44:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.455+0000 7fc298cdc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc29410db20 con 0x7fc2941007f0 2024-09-20T18:44:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.455+0000 7fc28bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2941067f0 0x7fc29419cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.455+0000 7fc28bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2941067f0 0x7fc29419cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35694/0 (socket says 172.21.15.17:35694) 2024-09-20T18:44:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.455+0000 7fc28bfff640 1 -- 172.21.15.17:0/550133629 learned_addr learned my addr 172.21.15.17:0/550133629 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:44:06.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.455+0000 7fc29259c640 1 --2- 172.21.15.17:0/550133629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2941007f0 0x7fc29419c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:06.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.455+0000 7fc28bfff640 1 -- 172.21.15.17:0/550133629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2941007f0 msgr2=0x7fc29419c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:06.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.455+0000 7fc28bfff640 1 --2- 172.21.15.17:0/550133629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2941007f0 0x7fc29419c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.455+0000 7fc28bfff640 1 -- 172.21.15.17:0/550133629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc294196790 con 0x7fc2941067f0 2024-09-20T18:44:06.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.456+0000 7fc28bfff640 1 --2- 172.21.15.17:0/550133629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2941067f0 0x7fc29419cb50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00d8d0 tx=0x7fc27c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:06.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.456+0000 7fc28b7fe640 1 -- 172.21.15.17:0/550133629 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc27c017030 con 0x7fc2941067f0 2024-09-20T18:44:06.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.456+0000 7fc298cdc640 1 -- 172.21.15.17:0/550133629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc294196a80 con 0x7fc2941067f0 2024-09-20T18:44:06.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.456+0000 7fc28b7fe640 1 -- 172.21.15.17:0/550133629 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc27c004020 con 0x7fc2941067f0 2024-09-20T18:44:06.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.456+0000 7fc28b7fe640 1 -- 172.21.15.17:0/550133629 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc27c0047a0 con 0x7fc2941067f0 2024-09-20T18:44:06.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.456+0000 7fc298cdc640 1 -- 172.21.15.17:0/550133629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc294197010 con 0x7fc2941067f0 2024-09-20T18:44:06.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.457+0000 7fc298cdc640 1 -- 172.21.15.17:0/550133629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc294101f30 con 0x7fc2941067f0 2024-09-20T18:44:06.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.457+0000 7fc28b7fe640 1 -- 172.21.15.17:0/550133629 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc27c009a30 con 0x7fc2941067f0 2024-09-20T18:44:06.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.458+0000 7fc28b7fe640 1 --2- 172.21.15.17:0/550133629 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc28007af80 0x7fc28007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:06.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.458+0000 7fc28b7fe640 1 -- 172.21.15.17:0/550133629 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6156+0+0 (secure 0 0 0) 0x7fc27c018070 con 0x7fc2941067f0 2024-09-20T18:44:06.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.458+0000 7fc29259c640 1 --2- 172.21.15.17:0/550133629 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc28007af80 0x7fc28007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:06.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.459+0000 7fc29259c640 1 --2- 172.21.15.17:0/550133629 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc28007af80 0x7fc28007d440 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc2840096c0 tx=0x7fc284031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:06.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.463+0000 7fc28b7fe640 1 -- 172.21.15.17:0/550133629 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc27c069320 con 0x7fc2941067f0 2024-09-20T18:44:06.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:06 smithi017 ceph-mon[108970]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:44:06.700 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:06 smithi172 ceph-mon[80431]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:44:06.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.733+0000 7fc298cdc640 1 -- 172.21.15.17:0/550133629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc294197cc0 con 0x7fc2941067f0 2024-09-20T18:44:06.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.733+0000 7fc28b7fe640 1 -- 172.21.15.17:0/550133629 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fc27c06e1d0 con 0x7fc2941067f0 2024-09-20T18:44:06.749 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:44:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:44:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:44:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:44:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:44:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:44:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:44:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:44:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:44:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:44:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:44:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 3, 2024-09-20T18:44:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 1 2024-09-20T18:44:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:44:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:44:06.751 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 3, 2024-09-20T18:44:06.751 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 11 2024-09-20T18:44:06.751 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:44:06.751 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:44:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.735+0000 7fc298cdc640 1 -- 172.21.15.17:0/550133629 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc28007af80 msgr2=0x7fc28007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.735+0000 7fc298cdc640 1 --2- 172.21.15.17:0/550133629 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc28007af80 0x7fc28007d440 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc2840096c0 tx=0x7fc284031400 comp rx=0 tx=0).stop 2024-09-20T18:44:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.735+0000 7fc298cdc640 1 -- 172.21.15.17:0/550133629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2941067f0 msgr2=0x7fc29419cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.735+0000 7fc298cdc640 1 --2- 172.21.15.17:0/550133629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2941067f0 0x7fc29419cb50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00d8d0 tx=0x7fc27c00dd90 comp rx=0 tx=0).stop 2024-09-20T18:44:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.735+0000 7fc298cdc640 1 -- 172.21.15.17:0/550133629 shutdown_connections 2024-09-20T18:44:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.735+0000 7fc298cdc640 1 --2- 172.21.15.17:0/550133629 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc28007af80 0x7fc28007d440 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.735+0000 7fc298cdc640 1 --2- 172.21.15.17:0/550133629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2941067f0 0x7fc29419cb50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.736+0000 7fc298cdc640 1 --2- 172.21.15.17:0/550133629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2941007f0 0x7fc29419c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.736+0000 7fc298cdc640 1 -- 172.21.15.17:0/550133629 >> 172.21.15.17:0/550133629 conn(0x7fc2940fc550 msgr2=0x7fc2940fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.736+0000 7fc298cdc640 1 -- 172.21.15.17:0/550133629 shutdown_connections 2024-09-20T18:44:06.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.736+0000 7fc298cdc640 1 -- 172.21.15.17:0/550133629 wait complete. 2024-09-20T18:44:06.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.820+0000 7febf1ba2640 1 -- 172.21.15.17:0/3573070820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febec101900 msgr2=0x7febec101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:06.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.820+0000 7febf1ba2640 1 --2- 172.21.15.17:0/3573070820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febec101900 0x7febec101d60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7febe0009880 tx=0x7febe002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.821+0000 7febf1ba2640 1 -- 172.21.15.17:0/3573070820 shutdown_connections 2024-09-20T18:44:06.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.821+0000 7febf1ba2640 1 --2- 172.21.15.17:0/3573070820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febec101900 0x7febec101d60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.821+0000 7febf1ba2640 1 --2- 172.21.15.17:0/3573070820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febec107900 0x7febec107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.821+0000 7febf1ba2640 1 -- 172.21.15.17:0/3573070820 >> 172.21.15.17:0/3573070820 conn(0x7febec0fd600 msgr2=0x7febec0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:06.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.821+0000 7febf1ba2640 1 -- 172.21.15.17:0/3573070820 shutdown_connections 2024-09-20T18:44:06.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.821+0000 7febf1ba2640 1 -- 172.21.15.17:0/3573070820 wait complete. 2024-09-20T18:44:06.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.821+0000 7febf1ba2640 1 Processor -- start 2024-09-20T18:44:06.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.821+0000 7febf1ba2640 1 -- start start 2024-09-20T18:44:06.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.822+0000 7febf1ba2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febec101900 0x7febec0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:06.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.822+0000 7febf1ba2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febec107900 0x7febec074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:06.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.822+0000 7febf1ba2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7febec10edb0 con 0x7febec101900 2024-09-20T18:44:06.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.822+0000 7febf1ba2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7febec10ec30 con 0x7febec107900 2024-09-20T18:44:06.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.822+0000 7febeb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febec101900 0x7febec0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:06.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.822+0000 7febeb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febec101900 0x7febec0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35708/0 (socket says 172.21.15.17:35708) 2024-09-20T18:44:06.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.822+0000 7febeb7fe640 1 -- 172.21.15.17:0/2420061599 learned_addr learned my addr 172.21.15.17:0/2420061599 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:44:06.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.822+0000 7febeaffd640 1 --2- 172.21.15.17:0/2420061599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febec107900 0x7febec074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:06.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.822+0000 7febeb7fe640 1 -- 172.21.15.17:0/2420061599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febec107900 msgr2=0x7febec074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:06.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.822+0000 7febeb7fe640 1 --2- 172.21.15.17:0/2420061599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febec107900 0x7febec074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:06.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.822+0000 7febeb7fe640 1 -- 172.21.15.17:0/2420061599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febec074f70 con 0x7febec101900 2024-09-20T18:44:06.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.822+0000 7febeb7fe640 1 --2- 172.21.15.17:0/2420061599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febec101900 0x7febec0744f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7febdc00c810 tx=0x7febdc00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:06.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.823+0000 7febe8ff9640 1 -- 172.21.15.17:0/2420061599 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7febdc004020 con 0x7febec101900 2024-09-20T18:44:06.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.823+0000 7febe8ff9640 1 -- 172.21.15.17:0/2420061599 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7febdc0041c0 con 0x7febec101900 2024-09-20T18:44:06.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.823+0000 7febe8ff9640 1 -- 172.21.15.17:0/2420061599 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7febdc0047a0 con 0x7febec101900 2024-09-20T18:44:06.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.823+0000 7febf1ba2640 1 -- 172.21.15.17:0/2420061599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febec075260 con 0x7febec101900 2024-09-20T18:44:06.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.823+0000 7febf1ba2640 1 -- 172.21.15.17:0/2420061599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febec1a3e80 con 0x7febec101900 2024-09-20T18:44:06.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.824+0000 7febf1ba2640 1 -- 172.21.15.17:0/2420061599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febec103040 con 0x7febec101900 2024-09-20T18:44:06.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.824+0000 7febe8ff9640 1 -- 172.21.15.17:0/2420061599 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7febdc0079b0 con 0x7febec101900 2024-09-20T18:44:06.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.825+0000 7febe8ff9640 1 --2- 172.21.15.17:0/2420061599 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7febd407af80 0x7febd407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:06.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.825+0000 7febe8ff9640 1 -- 172.21.15.17:0/2420061599 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6156+0+0 (secure 0 0 0) 0x7febdc09de60 con 0x7febec101900 2024-09-20T18:44:06.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.825+0000 7febeaffd640 1 --2- 172.21.15.17:0/2420061599 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7febd407af80 0x7febd407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:06.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.826+0000 7febeaffd640 1 --2- 172.21.15.17:0/2420061599 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7febd407af80 0x7febd407d440 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7febec075f80 tx=0x7febe0031420 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:06.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:06.829+0000 7febe8ff9640 1 -- 172.21.15.17:0/2420061599 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7febdc014030 con 0x7febec101900 2024-09-20T18:44:07.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.072+0000 7febf1ba2640 1 -- 172.21.15.17:0/2420061599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7febec109e90 con 0x7febec101900 2024-09-20T18:44:07.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.072+0000 7febe8ff9640 1 -- 172.21.15.17:0/2420061599 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+2002 (secure 0 0 0) 0x7febdc0694e0 con 0x7febec101900 2024-09-20T18:44:07.088 INFO:teuthology.orchestra.run.smithi017.stdout:e20 2024-09-20T18:44:07.088 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:04:241218+0000 2024-09-20T18:44:07.088 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:44:07.088 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:44:07.088 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:44:07.089 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:44:07.089 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:44:07.089 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:44:07.089 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:44:07.089 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:44:07.089 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:44:07.089 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:44:07.089 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:44:07.089 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:44:07.089 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:44:07.089 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:44:07.089 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:44:07.089 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:44:07.089 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:44:07.089 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:44:07.090 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:44:07.090 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:44:07.090 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:44:07.090 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:44:07.090 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:44:07.090 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:44:07.090 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:44:07.090 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:44:07.090 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:44:07.090 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:44:07.090 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:44:07.090 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:44:07.090 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:44:07.091 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:44:07.091 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:44:07.091 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:44:07.091 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:44:07.091 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:44:07.091 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:44:07.091 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34320} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/1871368212,v1:172.21.15.17:6829/1871368212] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:44:07.091 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:44:07.091 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:44:07.091 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/2779951413,v1:172.21.15.172:6825/2779951413] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:44:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 20 2024-09-20T18:44:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.074+0000 7febf1ba2640 1 -- 172.21.15.17:0/2420061599 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7febd407af80 msgr2=0x7febd407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.074+0000 7febf1ba2640 1 --2- 172.21.15.17:0/2420061599 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7febd407af80 0x7febd407d440 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7febec075f80 tx=0x7febe0031420 comp rx=0 tx=0).stop 2024-09-20T18:44:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.074+0000 7febf1ba2640 1 -- 172.21.15.17:0/2420061599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febec101900 msgr2=0x7febec0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.074+0000 7febf1ba2640 1 --2- 172.21.15.17:0/2420061599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febec101900 0x7febec0744f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7febdc00c810 tx=0x7febdc00ccd0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.075+0000 7febf1ba2640 1 -- 172.21.15.17:0/2420061599 shutdown_connections 2024-09-20T18:44:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.075+0000 7febf1ba2640 1 --2- 172.21.15.17:0/2420061599 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7febd407af80 0x7febd407d440 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.075+0000 7febf1ba2640 1 --2- 172.21.15.17:0/2420061599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febec107900 0x7febec074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.075+0000 7febf1ba2640 1 --2- 172.21.15.17:0/2420061599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febec101900 0x7febec0744f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.075+0000 7febf1ba2640 1 -- 172.21.15.17:0/2420061599 >> 172.21.15.17:0/2420061599 conn(0x7febec0fd600 msgr2=0x7febec0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:07.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.075+0000 7febf1ba2640 1 -- 172.21.15.17:0/2420061599 shutdown_connections 2024-09-20T18:44:07.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.075+0000 7febf1ba2640 1 -- 172.21.15.17:0/2420061599 wait complete. 2024-09-20T18:44:07.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.160+0000 7f12e1fcc640 1 -- 172.21.15.17:0/4186389975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12dc1067f0 msgr2=0x7f12dc106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:07.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.160+0000 7f12e1fcc640 1 --2- 172.21.15.17:0/4186389975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12dc1067f0 0x7f12dc106bd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009880 tx=0x7f12cc02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.160+0000 7f12e1fcc640 1 -- 172.21.15.17:0/4186389975 shutdown_connections 2024-09-20T18:44:07.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.160+0000 7f12e1fcc640 1 --2- 172.21.15.17:0/4186389975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12dc1007f0 0x7f12dc100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.160+0000 7f12e1fcc640 1 --2- 172.21.15.17:0/4186389975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12dc1067f0 0x7f12dc106bd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.160+0000 7f12e1fcc640 1 -- 172.21.15.17:0/4186389975 >> 172.21.15.17:0/4186389975 conn(0x7f12dc0fc550 msgr2=0x7f12dc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:07.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.160+0000 7f12e1fcc640 1 -- 172.21.15.17:0/4186389975 shutdown_connections 2024-09-20T18:44:07.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.160+0000 7f12e1fcc640 1 -- 172.21.15.17:0/4186389975 wait complete. 2024-09-20T18:44:07.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.161+0000 7f12e1fcc640 1 Processor -- start 2024-09-20T18:44:07.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.161+0000 7f12e1fcc640 1 -- start start 2024-09-20T18:44:07.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.161+0000 7f12e1fcc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12dc1007f0 0x7f12dc0fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:07.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.161+0000 7f12e1fcc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12dc1067f0 0x7f12dc0fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:07.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.161+0000 7f12e1fcc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc10dcc0 con 0x7f12dc1067f0 2024-09-20T18:44:07.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.161+0000 7f12e1fcc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc10db40 con 0x7f12dc1007f0 2024-09-20T18:44:07.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.161+0000 7f12daffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12dc1067f0 0x7f12dc0fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:07.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.161+0000 7f12daffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12dc1067f0 0x7f12dc0fd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35724/0 (socket says 172.21.15.17:35724) 2024-09-20T18:44:07.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.161+0000 7f12daffd640 1 -- 172.21.15.17:0/3494205289 learned_addr learned my addr 172.21.15.17:0/3494205289 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:44:07.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.162+0000 7f12db7fe640 1 --2- 172.21.15.17:0/3494205289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12dc1007f0 0x7f12dc0fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:07.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.162+0000 7f12daffd640 1 -- 172.21.15.17:0/3494205289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12dc1007f0 msgr2=0x7f12dc0fccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:07.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.162+0000 7f12daffd640 1 --2- 172.21.15.17:0/3494205289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12dc1007f0 0x7f12dc0fccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.162+0000 7f12daffd640 1 -- 172.21.15.17:0/3494205289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc0fd770 con 0x7f12dc1067f0 2024-09-20T18:44:07.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.162+0000 7f12daffd640 1 --2- 172.21.15.17:0/3494205289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12dc1067f0 0x7f12dc0fd230 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f12d000d6f0 tx=0x7f12d000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:07.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.162+0000 7f12d8ff9640 1 -- 172.21.15.17:0/3494205289 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f12d0017070 con 0x7f12dc1067f0 2024-09-20T18:44:07.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.162+0000 7f12d8ff9640 1 -- 172.21.15.17:0/3494205289 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f12d000de00 con 0x7f12dc1067f0 2024-09-20T18:44:07.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.162+0000 7f12e1fcc640 1 -- 172.21.15.17:0/3494205289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12dc0fda60 con 0x7f12dc1067f0 2024-09-20T18:44:07.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.162+0000 7f12d8ff9640 1 -- 172.21.15.17:0/3494205289 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f12d0004bb0 con 0x7f12dc1067f0 2024-09-20T18:44:07.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.162+0000 7f12e1fcc640 1 -- 172.21.15.17:0/3494205289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12dc1a3e30 con 0x7f12dc1067f0 2024-09-20T18:44:07.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.163+0000 7f12e1fcc640 1 -- 172.21.15.17:0/3494205289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12dc101f30 con 0x7f12dc1067f0 2024-09-20T18:44:07.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.164+0000 7f12d8ff9640 1 -- 172.21.15.17:0/3494205289 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f12d0004e60 con 0x7f12dc1067f0 2024-09-20T18:44:07.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.165+0000 7f12d8ff9640 1 --2- 172.21.15.17:0/3494205289 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f12c407af30 0x7f12c407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:07.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.165+0000 7f12db7fe640 1 --2- 172.21.15.17:0/3494205289 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f12c407af30 0x7f12c407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:07.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.165+0000 7f12d8ff9640 1 -- 172.21.15.17:0/3494205289 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6156+0+0 (secure 0 0 0) 0x7f12d009db80 con 0x7f12dc1067f0 2024-09-20T18:44:07.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.165+0000 7f12db7fe640 1 --2- 172.21.15.17:0/3494205289 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f12c407af30 0x7f12c407d3f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f12cc0096c0 tx=0x7f12cc031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:07.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.169+0000 7f12d8ff9640 1 -- 172.21.15.17:0/3494205289 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f12d0069180 con 0x7f12dc1067f0 2024-09-20T18:44:07.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.384+0000 7f12e1fcc640 1 -- 172.21.15.17:0/3494205289 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f12dc062630 con 0x7f12c407af30 2024-09-20T18:44:07.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.385+0000 7f12d8ff9640 1 -- 172.21.15.17:0/3494205289 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f12dc062630 con 0x7f12c407af30 2024-09-20T18:44:07.401 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:44:07.401 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:44:07.401 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:44:07.401 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:44:07.401 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:44:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:44:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:44:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:44:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:44:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:44:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "12/23 daemons upgraded", 2024-09-20T18:44:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:44:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:44:07.402 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:44:07.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.387+0000 7f12e1fcc640 1 -- 172.21.15.17:0/3494205289 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f12c407af30 msgr2=0x7f12c407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:07.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.387+0000 7f12e1fcc640 1 --2- 172.21.15.17:0/3494205289 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f12c407af30 0x7f12c407d3f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f12cc0096c0 tx=0x7f12cc031400 comp rx=0 tx=0).stop 2024-09-20T18:44:07.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.387+0000 7f12e1fcc640 1 -- 172.21.15.17:0/3494205289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12dc1067f0 msgr2=0x7f12dc0fd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:07.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.387+0000 7f12e1fcc640 1 --2- 172.21.15.17:0/3494205289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12dc1067f0 0x7f12dc0fd230 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f12d000d6f0 tx=0x7f12d000dbb0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.388+0000 7f12e1fcc640 1 -- 172.21.15.17:0/3494205289 shutdown_connections 2024-09-20T18:44:07.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.388+0000 7f12e1fcc640 1 --2- 172.21.15.17:0/3494205289 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f12c407af30 0x7f12c407d3f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.388+0000 7f12e1fcc640 1 --2- 172.21.15.17:0/3494205289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12dc1067f0 0x7f12dc0fd230 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.388+0000 7f12e1fcc640 1 --2- 172.21.15.17:0/3494205289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12dc1007f0 0x7f12dc0fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.388+0000 7f12e1fcc640 1 -- 172.21.15.17:0/3494205289 >> 172.21.15.17:0/3494205289 conn(0x7f12dc0fc550 msgr2=0x7f12dc069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:07.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.388+0000 7f12e1fcc640 1 -- 172.21.15.17:0/3494205289 shutdown_connections 2024-09-20T18:44:07.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.388+0000 7f12e1fcc640 1 -- 172.21.15.17:0/3494205289 wait complete. 2024-09-20T18:44:07.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.472+0000 7f846095b640 1 -- 172.21.15.17:0/1883247496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c107900 msgr2=0x7f845c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:07.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.472+0000 7f846095b640 1 --2- 172.21.15.17:0/1883247496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c107900 0x7f845c107ce0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f844c009880 tx=0x7f844c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.472+0000 7f846095b640 1 -- 172.21.15.17:0/1883247496 shutdown_connections 2024-09-20T18:44:07.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.472+0000 7f846095b640 1 --2- 172.21.15.17:0/1883247496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f845c101900 0x7f845c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.472+0000 7f846095b640 1 --2- 172.21.15.17:0/1883247496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c107900 0x7f845c107ce0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.472+0000 7f846095b640 1 -- 172.21.15.17:0/1883247496 >> 172.21.15.17:0/1883247496 conn(0x7f845c0fd600 msgr2=0x7f845c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:07.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.472+0000 7f846095b640 1 -- 172.21.15.17:0/1883247496 shutdown_connections 2024-09-20T18:44:07.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.472+0000 7f846095b640 1 -- 172.21.15.17:0/1883247496 wait complete. 2024-09-20T18:44:07.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.473+0000 7f846095b640 1 Processor -- start 2024-09-20T18:44:07.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.473+0000 7f846095b640 1 -- start start 2024-09-20T18:44:07.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.473+0000 7f846095b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f845c101900 0x7f845c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:07.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.473+0000 7f846095b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c107900 0x7f845c19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:07.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.473+0000 7f846095b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f845c10ee30 con 0x7f845c107900 2024-09-20T18:44:07.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.473+0000 7f846095b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f845c10ecb0 con 0x7f845c101900 2024-09-20T18:44:07.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.474+0000 7f8453fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c107900 0x7f845c19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:07.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.474+0000 7f8453fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c107900 0x7f845c19dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35738/0 (socket says 172.21.15.17:35738) 2024-09-20T18:44:07.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.474+0000 7f8453fff640 1 -- 172.21.15.17:0/927748011 learned_addr learned my addr 172.21.15.17:0/927748011 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:44:07.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.474+0000 7f845a59c640 1 --2- 172.21.15.17:0/927748011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f845c101900 0x7f845c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:07.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.474+0000 7f8453fff640 1 -- 172.21.15.17:0/927748011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f845c101900 msgr2=0x7f845c19d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:07.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.474+0000 7f8453fff640 1 --2- 172.21.15.17:0/927748011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f845c101900 0x7f845c19d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.474+0000 7f8453fff640 1 -- 172.21.15.17:0/927748011 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845c197880 con 0x7f845c107900 2024-09-20T18:44:07.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.474+0000 7f845a59c640 1 --2- 172.21.15.17:0/927748011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f845c101900 0x7f845c19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:44:07.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.474+0000 7f8453fff640 1 --2- 172.21.15.17:0/927748011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c107900 0x7f845c19dc00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f844400b420 tx=0x7f844400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:07.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.474+0000 7f84537fe640 1 -- 172.21.15.17:0/927748011 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8444011630 con 0x7f845c107900 2024-09-20T18:44:07.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.474+0000 7f84537fe640 1 -- 172.21.15.17:0/927748011 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8444016070 con 0x7f845c107900 2024-09-20T18:44:07.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.474+0000 7f846095b640 1 -- 172.21.15.17:0/927748011 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f845c197b70 con 0x7f845c107900 2024-09-20T18:44:07.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.474+0000 7f84537fe640 1 -- 172.21.15.17:0/927748011 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8444010d40 con 0x7f845c107900 2024-09-20T18:44:07.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.475+0000 7f846095b640 1 -- 172.21.15.17:0/927748011 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f845c198100 con 0x7f845c107900 2024-09-20T18:44:07.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.476+0000 7f846095b640 1 -- 172.21.15.17:0/927748011 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f845c103040 con 0x7f845c107900 2024-09-20T18:44:07.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.476+0000 7f84537fe640 1 -- 172.21.15.17:0/927748011 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f844401b460 con 0x7f845c107900 2024-09-20T18:44:07.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.477+0000 7f84537fe640 1 --2- 172.21.15.17:0/927748011 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f844807af40 0x7f844807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:07.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.477+0000 7f845a59c640 1 --2- 172.21.15.17:0/927748011 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f844807af40 0x7f844807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:07.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.477+0000 7f84537fe640 1 -- 172.21.15.17:0/927748011 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6156+0+0 (secure 0 0 0) 0x7f844409d7e0 con 0x7f845c107900 2024-09-20T18:44:07.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.477+0000 7f845a59c640 1 --2- 172.21.15.17:0/927748011 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f844807af40 0x7f844807d400 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f844c000c00 tx=0x7f844c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:07.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.481+0000 7f84537fe640 1 -- 172.21.15.17:0/927748011 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8444021250 con 0x7f845c107900 2024-09-20T18:44:07.591 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:07 smithi017 ceph-mon[108970]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:44:07.591 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:07 smithi017 ceph-mon[108970]: pgmap v259: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:07.591 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:07 smithi017 ceph-mon[108970]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:44:07.591 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:07 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/550133629' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:07.591 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:07.591 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:44:07.591 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:07 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2420061599' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:44:07.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:07 smithi172 ceph-mon[80431]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:44:07.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:07 smithi172 ceph-mon[80431]: pgmap v259: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:07.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:07 smithi172 ceph-mon[80431]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:44:07.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:07 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/550133629' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:07.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:07.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:44:07.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:07 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2420061599' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:44:07.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.749+0000 7f846095b640 1 -- 172.21.15.17:0/927748011 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f845c198db0 con 0x7f845c107900 2024-09-20T18:44:07.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.750+0000 7f84537fe640 1 -- 172.21.15.17:0/927748011 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f8444068d40 con 0x7f845c107900 2024-09-20T18:44:07.765 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:44:07.766 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:44:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:44:07.766 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:44:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:44:07.766 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:44:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:44:07.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.752+0000 7f846095b640 1 -- 172.21.15.17:0/927748011 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f844807af40 msgr2=0x7f844807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:07.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.752+0000 7f846095b640 1 --2- 172.21.15.17:0/927748011 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f844807af40 0x7f844807d400 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f844c000c00 tx=0x7f844c031400 comp rx=0 tx=0).stop 2024-09-20T18:44:07.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.752+0000 7f846095b640 1 -- 172.21.15.17:0/927748011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c107900 msgr2=0x7f845c19dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:07.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.752+0000 7f846095b640 1 --2- 172.21.15.17:0/927748011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c107900 0x7f845c19dc00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f844400b420 tx=0x7f844400b8e0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.752+0000 7f846095b640 1 -- 172.21.15.17:0/927748011 shutdown_connections 2024-09-20T18:44:07.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.752+0000 7f846095b640 1 --2- 172.21.15.17:0/927748011 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f844807af40 0x7f844807d400 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.752+0000 7f846095b640 1 --2- 172.21.15.17:0/927748011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845c107900 0x7f845c19dc00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.752+0000 7f846095b640 1 --2- 172.21.15.17:0/927748011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f845c101900 0x7f845c19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:07.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.752+0000 7f846095b640 1 -- 172.21.15.17:0/927748011 >> 172.21.15.17:0/927748011 conn(0x7f845c0fd600 msgr2=0x7f845c0fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:07.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.752+0000 7f846095b640 1 -- 172.21.15.17:0/927748011 shutdown_connections 2024-09-20T18:44:07.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:07.752+0000 7f846095b640 1 -- 172.21.15.17:0/927748011 wait complete. 2024-09-20T18:44:08.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:08 smithi017 ceph-mon[108970]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:44:08.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:08 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/927748011' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:44:08.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:08 smithi172 ceph-mon[80431]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:44:08.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:08 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/927748011' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:44:09.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:09 smithi017 ceph-mon[108970]: pgmap v260: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:09.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:09 smithi172 ceph-mon[80431]: pgmap v260: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:10.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:10 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:10.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:10 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:10.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:10 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:10.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:10 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:10.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:10 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:10.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:10 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:10.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:10 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:10.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:10 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:11.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:11 smithi172 ceph-mon[80431]: pgmap v261: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:11.749 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:11 smithi017 ceph-mon[108970]: pgmap v261: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:13.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:13 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:13.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:13 smithi017 ceph-mon[108970]: pgmap v262: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:13.460 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:13 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:13.461 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:13 smithi172 ceph-mon[80431]: pgmap v262: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:14.897 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:14.897 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:14.897 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:44:14.897 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:44:14.897 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:14.897 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:44:14.897 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:14.897 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:14.897 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:14.897 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:14 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:14.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:14.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:14.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:44:14.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:44:14.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:14.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:44:14.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:14.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:14.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:14.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:14 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:15.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:15 smithi017 ceph-mon[108970]: pgmap v263: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:15.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:15 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:15.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:15 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.xhlvpy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-20T18:44:15.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:15 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:44:15.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:15 smithi172 ceph-mon[80431]: pgmap v263: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:15.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:15 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:15.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:15 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.xhlvpy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-20T18:44:15.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:15 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:44:16.739 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:16 smithi017 ceph-mon[108970]: Upgrade: Updating mds.cephfs.smithi017.xhlvpy 2024-09-20T18:44:16.739 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:16 smithi017 ceph-mon[108970]: Deploying daemon mds.cephfs.smithi017.xhlvpy on smithi017 2024-09-20T18:44:16.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:16 smithi172 ceph-mon[80431]: Upgrade: Updating mds.cephfs.smithi017.xhlvpy 2024-09-20T18:44:16.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:16 smithi172 ceph-mon[80431]: Deploying daemon mds.cephfs.smithi017.xhlvpy on smithi017 2024-09-20T18:44:17.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:17 smithi017 ceph-mon[108970]: pgmap v264: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:17.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:17 smithi172 ceph-mon[80431]: pgmap v264: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:18.884 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:18 smithi017 ceph-mon[108970]: osdmap e78: 6 total, 6 up, 6 in 2024-09-20T18:44:18.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:18 smithi017 ceph-mon[108970]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-20T18:44:18.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:18 smithi172 ceph-mon[80431]: osdmap e78: 6 total, 6 up, 6 in 2024-09-20T18:44:18.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:18 smithi172 ceph-mon[80431]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-20T18:44:19.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:19 smithi017 ceph-mon[108970]: pgmap v266: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:19.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:19 smithi172 ceph-mon[80431]: pgmap v266: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:21.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:21 smithi017 ceph-mon[108970]: pgmap v267: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:21.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:21 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:21.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:21 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:21.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:21 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:44:21.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:21 smithi017 ceph-mon[108970]: mds.? [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] up:boot 2024-09-20T18:44:21.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:21 smithi017 ceph-mon[108970]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-20T18:44:21.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:21 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi017.xhlvpy"} : dispatch 2024-09-20T18:44:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:21 smithi172 ceph-mon[80431]: pgmap v267: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:21 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:21 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:21 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:44:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:21 smithi172 ceph-mon[80431]: mds.? [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] up:boot 2024-09-20T18:44:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:21 smithi172 ceph-mon[80431]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-20T18:44:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:21 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi017.xhlvpy"} : dispatch 2024-09-20T18:44:22.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:44:22.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:44:23.862 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:23 smithi172 ceph-mon[80431]: pgmap v268: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:23.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:23 smithi017 ceph-mon[108970]: pgmap v268: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:25.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:25 smithi017 ceph-mon[108970]: pgmap v269: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:25.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:25 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:25.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:25 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:25.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:25 smithi172 ceph-mon[80431]: pgmap v269: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:25.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:25 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:25.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:25 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:27.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:26 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:27.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:26 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:27.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:26 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:27.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:26 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:27.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:27 smithi017 ceph-mon[108970]: pgmap v270: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:28.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:27 smithi172 ceph-mon[80431]: pgmap v270: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:29.885 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:29 smithi172 ceph-mon[80431]: pgmap v271: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:29.886 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:29.886 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:29.886 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:44:29.886 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:44:29.886 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:29.886 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:44:29.886 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:29.886 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:29.886 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:29.886 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:29 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:30.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:29 smithi017 ceph-mon[108970]: pgmap v271: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:30.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:30.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:30.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:44:30.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:44:30.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:30.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:44:30.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:30.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:30.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:30.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:29 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:31.742 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:31 smithi172 ceph-mon[80431]: pgmap v272: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:31.743 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:31 smithi172 ceph-mon[80431]: Upgrade: Updating mds.cephfs.smithi172.mugtlk 2024-09-20T18:44:31.743 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:31 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:31.743 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:31 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.mugtlk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-20T18:44:31.743 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:31 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:44:31.743 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:31 smithi172 ceph-mon[80431]: Deploying daemon mds.cephfs.smithi172.mugtlk on smithi172 2024-09-20T18:44:31.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:31 smithi017 ceph-mon[108970]: pgmap v272: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:31.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:31 smithi017 ceph-mon[108970]: Upgrade: Updating mds.cephfs.smithi172.mugtlk 2024-09-20T18:44:31.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:31 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:31.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:31 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.mugtlk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-20T18:44:31.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:31 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:44:31.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:31 smithi017 ceph-mon[108970]: Deploying daemon mds.cephfs.smithi172.mugtlk on smithi172 2024-09-20T18:44:33.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:33 smithi017 ceph-mon[108970]: pgmap v273: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:33.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:33 smithi017 ceph-mon[108970]: osdmap e79: 6 total, 6 up, 6 in 2024-09-20T18:44:33.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:33 smithi017 ceph-mon[108970]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-20T18:44:33.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:33 smithi172 ceph-mon[80431]: pgmap v273: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:33.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:33 smithi172 ceph-mon[80431]: osdmap e79: 6 total, 6 up, 6 in 2024-09-20T18:44:33.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:33 smithi172 ceph-mon[80431]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-20T18:44:35.599 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:35 smithi172 ceph-mon[80431]: pgmap v275: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:35.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:35 smithi017 ceph-mon[108970]: pgmap v275: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:37.862 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:37 smithi017 ceph-mon[108970]: pgmap v276: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:37.862 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:37.862 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:37.863 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:44:37.863 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:44:37.863 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:37 smithi017 ceph-mon[108970]: mds.? [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] up:boot 2024-09-20T18:44:37.863 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:37 smithi017 ceph-mon[108970]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-20T18:44:37.863 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi172.mugtlk"} : dispatch 2024-09-20T18:44:37.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.846+0000 7fd757db6640 1 -- 172.21.15.17:0/893765245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7501067f0 msgr2=0x7fd750106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:37.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.846+0000 7fd757db6640 1 --2- 172.21.15.17:0/893765245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7501067f0 0x7fd750106bd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd74c009880 tx=0x7fd74c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:44:37.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.846+0000 7fd757db6640 1 -- 172.21.15.17:0/893765245 shutdown_connections 2024-09-20T18:44:37.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.846+0000 7fd757db6640 1 --2- 172.21.15.17:0/893765245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7501007f0 0x7fd750100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:37.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.846+0000 7fd757db6640 1 --2- 172.21.15.17:0/893765245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7501067f0 0x7fd750106bd0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:37.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.846+0000 7fd757db6640 1 -- 172.21.15.17:0/893765245 >> 172.21.15.17:0/893765245 conn(0x7fd7500fc550 msgr2=0x7fd7500fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:37.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.846+0000 7fd757db6640 1 -- 172.21.15.17:0/893765245 shutdown_connections 2024-09-20T18:44:37.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.846+0000 7fd757db6640 1 -- 172.21.15.17:0/893765245 wait complete. 2024-09-20T18:44:37.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.847+0000 7fd757db6640 1 Processor -- start 2024-09-20T18:44:37.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.847+0000 7fd757db6640 1 -- start start 2024-09-20T18:44:37.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.847+0000 7fd757db6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7501007f0 0x7fd75019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:37.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.847+0000 7fd757db6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7501067f0 0x7fd75019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:37.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.847+0000 7fd757db6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd75010dca0 con 0x7fd7501007f0 2024-09-20T18:44:37.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.847+0000 7fd757db6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd75010db20 con 0x7fd7501067f0 2024-09-20T18:44:37.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.847+0000 7fd755b52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7501007f0 0x7fd75019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:37.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.848+0000 7fd755b52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7501007f0 0x7fd75019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57668/0 (socket says 172.21.15.17:57668) 2024-09-20T18:44:37.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.848+0000 7fd755b52640 1 -- 172.21.15.17:0/1739084668 learned_addr learned my addr 172.21.15.17:0/1739084668 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:44:37.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.848+0000 7fd755351640 1 --2- 172.21.15.17:0/1739084668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7501067f0 0x7fd75019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:37.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.848+0000 7fd755b52640 1 -- 172.21.15.17:0/1739084668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7501067f0 msgr2=0x7fd75019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:37.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.848+0000 7fd755b52640 1 --2- 172.21.15.17:0/1739084668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7501067f0 0x7fd75019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:37.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.848+0000 7fd755b52640 1 -- 172.21.15.17:0/1739084668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd750197750 con 0x7fd7501007f0 2024-09-20T18:44:37.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.848+0000 7fd755351640 1 --2- 172.21.15.17:0/1739084668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7501067f0 0x7fd75019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:44:37.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.848+0000 7fd755b52640 1 --2- 172.21.15.17:0/1739084668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7501007f0 0x7fd75019d680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd74c031460 tx=0x7fd74c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:37.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.848+0000 7fd746ffd640 1 -- 172.21.15.17:0/1739084668 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd74c03f070 con 0x7fd7501007f0 2024-09-20T18:44:37.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.848+0000 7fd746ffd640 1 -- 172.21.15.17:0/1739084668 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd74c004cf0 con 0x7fd7501007f0 2024-09-20T18:44:37.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.848+0000 7fd746ffd640 1 -- 172.21.15.17:0/1739084668 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd74c035030 con 0x7fd7501007f0 2024-09-20T18:44:37.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.849+0000 7fd757db6640 1 -- 172.21.15.17:0/1739084668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7501979e0 con 0x7fd7501007f0 2024-09-20T18:44:37.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.849+0000 7fd757db6640 1 -- 172.21.15.17:0/1739084668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd750197ee0 con 0x7fd7501007f0 2024-09-20T18:44:37.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.850+0000 7fd757db6640 1 -- 172.21.15.17:0/1739084668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd750101f30 con 0x7fd7501007f0 2024-09-20T18:44:37.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.851+0000 7fd746ffd640 1 -- 172.21.15.17:0/1739084668 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd74c042070 con 0x7fd7501007f0 2024-09-20T18:44:37.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.852+0000 7fd746ffd640 1 --2- 172.21.15.17:0/1739084668 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd73c07af30 0x7fd73c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:37.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.852+0000 7fd746ffd640 1 -- 172.21.15.17:0/1739084668 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fd74c0bea80 con 0x7fd7501007f0 2024-09-20T18:44:37.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.852+0000 7fd755351640 1 --2- 172.21.15.17:0/1739084668 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd73c07af30 0x7fd73c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:37.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.853+0000 7fd755351640 1 --2- 172.21.15.17:0/1739084668 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd73c07af30 0x7fd73c07d3f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd750198fa0 tx=0x7fd740005d30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:37.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:37.857+0000 7fd746ffd640 1 -- 172.21.15.17:0/1739084668 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd74c08a080 con 0x7fd7501007f0 2024-09-20T18:44:38.030 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:37 smithi172 ceph-mon[80431]: pgmap v276: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:38.031 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:38.031 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:38.031 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:44:38.031 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:44:38.031 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:37 smithi172 ceph-mon[80431]: mds.? [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] up:boot 2024-09-20T18:44:38.031 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:37 smithi172 ceph-mon[80431]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-20T18:44:38.031 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi172.mugtlk"} : dispatch 2024-09-20T18:44:38.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.064+0000 7fd757db6640 1 -- 172.21.15.17:0/1739084668 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd750198200 con 0x7fd73c07af30 2024-09-20T18:44:38.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.066+0000 7fd746ffd640 1 -- 172.21.15.17:0/1739084668 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fd750198200 con 0x7fd73c07af30 2024-09-20T18:44:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.068+0000 7fd757db6640 1 -- 172.21.15.17:0/1739084668 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd73c07af30 msgr2=0x7fd73c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.068+0000 7fd757db6640 1 --2- 172.21.15.17:0/1739084668 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd73c07af30 0x7fd73c07d3f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd750198fa0 tx=0x7fd740005d30 comp rx=0 tx=0).stop 2024-09-20T18:44:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.068+0000 7fd757db6640 1 -- 172.21.15.17:0/1739084668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7501007f0 msgr2=0x7fd75019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.068+0000 7fd757db6640 1 --2- 172.21.15.17:0/1739084668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7501007f0 0x7fd75019d680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd74c031460 tx=0x7fd74c0048f0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.068+0000 7fd757db6640 1 -- 172.21.15.17:0/1739084668 shutdown_connections 2024-09-20T18:44:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.068+0000 7fd757db6640 1 --2- 172.21.15.17:0/1739084668 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd73c07af30 0x7fd73c07d3f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.068+0000 7fd757db6640 1 --2- 172.21.15.17:0/1739084668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7501067f0 0x7fd75019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.068+0000 7fd757db6640 1 --2- 172.21.15.17:0/1739084668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7501007f0 0x7fd75019d680 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.068+0000 7fd757db6640 1 -- 172.21.15.17:0/1739084668 >> 172.21.15.17:0/1739084668 conn(0x7fd7500fc550 msgr2=0x7fd750069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:38.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.068+0000 7fd757db6640 1 -- 172.21.15.17:0/1739084668 shutdown_connections 2024-09-20T18:44:38.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.068+0000 7fd757db6640 1 -- 172.21.15.17:0/1739084668 wait complete. 2024-09-20T18:44:38.093 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:44:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.156+0000 7f84b13cc640 1 -- 172.21.15.17:0/366480587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84ac102ab0 msgr2=0x7f84ac102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.156+0000 7f84b13cc640 1 --2- 172.21.15.17:0/366480587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84ac102ab0 0x7f84ac102e90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f849c009880 tx=0x7f849c02a530 comp rx=0 tx=0).stop 2024-09-20T18:44:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.156+0000 7f84b13cc640 1 -- 172.21.15.17:0/366480587 shutdown_connections 2024-09-20T18:44:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.156+0000 7f84b13cc640 1 --2- 172.21.15.17:0/366480587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84ac1033d0 0x7f84ac10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.156+0000 7f84b13cc640 1 --2- 172.21.15.17:0/366480587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84ac102ab0 0x7f84ac102e90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.156+0000 7f84b13cc640 1 -- 172.21.15.17:0/366480587 >> 172.21.15.17:0/366480587 conn(0x7f84ac0fc550 msgr2=0x7f84ac0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.157+0000 7f84b13cc640 1 -- 172.21.15.17:0/366480587 shutdown_connections 2024-09-20T18:44:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.157+0000 7f84b13cc640 1 -- 172.21.15.17:0/366480587 wait complete. 2024-09-20T18:44:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.157+0000 7f84b13cc640 1 Processor -- start 2024-09-20T18:44:38.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.157+0000 7f84b13cc640 1 -- start start 2024-09-20T18:44:38.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.158+0000 7f84b13cc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84ac102ab0 0x7f84ac100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:38.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.158+0000 7f84b13cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84ac1033d0 0x7f84ac100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:38.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.158+0000 7f84b13cc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac10edc0 con 0x7f84ac1033d0 2024-09-20T18:44:38.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.158+0000 7f84b13cc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac10ec40 con 0x7f84ac102ab0 2024-09-20T18:44:38.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.158+0000 7f84aa7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84ac1033d0 0x7f84ac100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.158+0000 7f84aa7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84ac1033d0 0x7f84ac100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57696/0 (socket says 172.21.15.17:57696) 2024-09-20T18:44:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.158+0000 7f84aa7fc640 1 -- 172.21.15.17:0/564261181 learned_addr learned my addr 172.21.15.17:0/564261181 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:44:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.158+0000 7f84aaffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84ac102ab0 0x7f84ac100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.158+0000 7f84aa7fc640 1 -- 172.21.15.17:0/564261181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84ac102ab0 msgr2=0x7f84ac100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.158+0000 7f84aa7fc640 1 --2- 172.21.15.17:0/564261181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84ac102ab0 0x7f84ac100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.158+0000 7f84aa7fc640 1 -- 172.21.15.17:0/564261181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ac101190 con 0x7f84ac1033d0 2024-09-20T18:44:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.158+0000 7f84aa7fc640 1 --2- 172.21.15.17:0/564261181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84ac1033d0 0x7f84ac100c50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f84a000d6c0 tx=0x7f84a000db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.159+0000 7f8493fff640 1 -- 172.21.15.17:0/564261181 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84a0017070 con 0x7f84ac1033d0 2024-09-20T18:44:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.159+0000 7f84b13cc640 1 -- 172.21.15.17:0/564261181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84ac101480 con 0x7f84ac1033d0 2024-09-20T18:44:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.159+0000 7f8493fff640 1 -- 172.21.15.17:0/564261181 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f84a0009ce0 con 0x7f84ac1033d0 2024-09-20T18:44:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.159+0000 7f8493fff640 1 -- 172.21.15.17:0/564261181 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84a000f3c0 con 0x7f84ac1033d0 2024-09-20T18:44:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.159+0000 7f84b13cc640 1 -- 172.21.15.17:0/564261181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84ac1a3e30 con 0x7f84ac1033d0 2024-09-20T18:44:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.160+0000 7f84b13cc640 1 -- 172.21.15.17:0/564261181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84ac06a580 con 0x7f84ac1033d0 2024-09-20T18:44:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.161+0000 7f8493fff640 1 -- 172.21.15.17:0/564261181 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f84a0010460 con 0x7f84ac1033d0 2024-09-20T18:44:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.162+0000 7f8493fff640 1 --2- 172.21.15.17:0/564261181 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f849407af30 0x7f849407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.162+0000 7f84aaffd640 1 --2- 172.21.15.17:0/564261181 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f849407af30 0x7f849407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.162+0000 7f8493fff640 1 -- 172.21.15.17:0/564261181 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f84a009ddd0 con 0x7f84ac1033d0 2024-09-20T18:44:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.162+0000 7f84aaffd640 1 --2- 172.21.15.17:0/564261181 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f849407af30 0x7f849407d3f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f849c0096c0 tx=0x7f849c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:38.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.166+0000 7f8493fff640 1 -- 172.21.15.17:0/564261181 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f84a0069330 con 0x7f84ac1033d0 2024-09-20T18:44:38.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.373+0000 7f84b13cc640 1 -- 172.21.15.17:0/564261181 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f84ac062630 con 0x7f849407af30 2024-09-20T18:44:38.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.374+0000 7f8493fff640 1 -- 172.21.15.17:0/564261181 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f84ac062630 con 0x7f849407af30 2024-09-20T18:44:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.376+0000 7f84b13cc640 1 -- 172.21.15.17:0/564261181 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f849407af30 msgr2=0x7f849407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.376+0000 7f84b13cc640 1 --2- 172.21.15.17:0/564261181 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f849407af30 0x7f849407d3f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f849c0096c0 tx=0x7f849c031400 comp rx=0 tx=0).stop 2024-09-20T18:44:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.376+0000 7f84b13cc640 1 -- 172.21.15.17:0/564261181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84ac1033d0 msgr2=0x7f84ac100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.376+0000 7f84b13cc640 1 --2- 172.21.15.17:0/564261181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84ac1033d0 0x7f84ac100c50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f84a000d6c0 tx=0x7f84a000db80 comp rx=0 tx=0).stop 2024-09-20T18:44:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.376+0000 7f84b13cc640 1 -- 172.21.15.17:0/564261181 shutdown_connections 2024-09-20T18:44:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.376+0000 7f84b13cc640 1 --2- 172.21.15.17:0/564261181 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f849407af30 0x7f849407d3f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.376+0000 7f84b13cc640 1 --2- 172.21.15.17:0/564261181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84ac1033d0 0x7f84ac100c50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.376+0000 7f84b13cc640 1 --2- 172.21.15.17:0/564261181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84ac102ab0 0x7f84ac100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.376+0000 7f84b13cc640 1 -- 172.21.15.17:0/564261181 >> 172.21.15.17:0/564261181 conn(0x7f84ac0fc550 msgr2=0x7f84ac108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.376+0000 7f84b13cc640 1 -- 172.21.15.17:0/564261181 shutdown_connections 2024-09-20T18:44:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.376+0000 7f84b13cc640 1 -- 172.21.15.17:0/564261181 wait complete. 2024-09-20T18:44:38.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.462+0000 7f26fcdae640 1 -- 172.21.15.17:0/483941020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26f8100ff0 msgr2=0x7f26f810dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:38.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.462+0000 7f26fcdae640 1 --2- 172.21.15.17:0/483941020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26f8100ff0 0x7f26f810dcb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009880 tx=0x7f26e002a490 comp rx=0 tx=0).stop 2024-09-20T18:44:38.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.462+0000 7f26fcdae640 1 -- 172.21.15.17:0/483941020 shutdown_connections 2024-09-20T18:44:38.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.462+0000 7f26fcdae640 1 --2- 172.21.15.17:0/483941020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26f8100ff0 0x7f26f810dcb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.462+0000 7f26fcdae640 1 --2- 172.21.15.17:0/483941020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26f8100640 0x7f26f8100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.462+0000 7f26fcdae640 1 -- 172.21.15.17:0/483941020 >> 172.21.15.17:0/483941020 conn(0x7f26f80fc550 msgr2=0x7f26f80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:38.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.462+0000 7f26fcdae640 1 -- 172.21.15.17:0/483941020 shutdown_connections 2024-09-20T18:44:38.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.462+0000 7f26fcdae640 1 -- 172.21.15.17:0/483941020 wait complete. 2024-09-20T18:44:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.463+0000 7f26fcdae640 1 Processor -- start 2024-09-20T18:44:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.463+0000 7f26fcdae640 1 -- start start 2024-09-20T18:44:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.463+0000 7f26fcdae640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26f8100640 0x7f26f819f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.464+0000 7f26fcdae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26f8100ff0 0x7f26f819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.464+0000 7f26fcdae640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8110f90 con 0x7f26f8100ff0 2024-09-20T18:44:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.464+0000 7f26fcdae640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8110e10 con 0x7f26f8100640 2024-09-20T18:44:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.464+0000 7f26f5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26f8100ff0 0x7f26f819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.464+0000 7f26f659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26f8100640 0x7f26f819f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.464+0000 7f26f5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26f8100ff0 0x7f26f819fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57708/0 (socket says 172.21.15.17:57708) 2024-09-20T18:44:38.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.464+0000 7f26f659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26f8100640 0x7f26f819f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:53044/0 (socket says 172.21.15.17:53044) 2024-09-20T18:44:38.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.464+0000 7f26f5d9b640 1 -- 172.21.15.17:0/1780870348 learned_addr learned my addr 172.21.15.17:0/1780870348 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:44:38.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.464+0000 7f26f5d9b640 1 -- 172.21.15.17:0/1780870348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26f8100640 msgr2=0x7f26f819f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:38.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.464+0000 7f26f5d9b640 1 --2- 172.21.15.17:0/1780870348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26f8100640 0x7f26f819f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.464+0000 7f26f5d9b640 1 -- 172.21.15.17:0/1780870348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f81999c0 con 0x7f26f8100ff0 2024-09-20T18:44:38.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.464+0000 7f26f659c640 1 --2- 172.21.15.17:0/1780870348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26f8100640 0x7f26f819f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T18:44:38.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.464+0000 7f26f5d9b640 1 --2- 172.21.15.17:0/1780870348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26f8100ff0 0x7f26f819fd40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f26e0031460 tx=0x7f26e0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:38.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.465+0000 7f26ef7fe640 1 -- 172.21.15.17:0/1780870348 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f26e003f070 con 0x7f26f8100ff0 2024-09-20T18:44:38.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.465+0000 7f26ef7fe640 1 -- 172.21.15.17:0/1780870348 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f26e0004a90 con 0x7f26f8100ff0 2024-09-20T18:44:38.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.465+0000 7f26ef7fe640 1 -- 172.21.15.17:0/1780870348 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f26e0035030 con 0x7f26f8100ff0 2024-09-20T18:44:38.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.465+0000 7f26fcdae640 1 -- 172.21.15.17:0/1780870348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f8199c50 con 0x7f26f8100ff0 2024-09-20T18:44:38.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.465+0000 7f26fcdae640 1 -- 172.21.15.17:0/1780870348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f819a1e0 con 0x7f26f8100ff0 2024-09-20T18:44:38.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.466+0000 7f26fcdae640 1 -- 172.21.15.17:0/1780870348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f806a580 con 0x7f26f8100ff0 2024-09-20T18:44:38.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.467+0000 7f26ef7fe640 1 -- 172.21.15.17:0/1780870348 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f26e0042070 con 0x7f26f8100ff0 2024-09-20T18:44:38.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.468+0000 7f26ef7fe640 1 --2- 172.21.15.17:0/1780870348 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f26e407af90 0x7f26e407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:38.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.468+0000 7f26ef7fe640 1 -- 172.21.15.17:0/1780870348 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f26e00be9b0 con 0x7f26f8100ff0 2024-09-20T18:44:38.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.468+0000 7f26f659c640 1 --2- 172.21.15.17:0/1780870348 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f26e407af90 0x7f26e407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:38.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.469+0000 7f26f659c640 1 --2- 172.21.15.17:0/1780870348 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f26e407af90 0x7f26e407d450 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f26f819ab00 tx=0x7f26e8005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:38.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.472+0000 7f26ef7fe640 1 -- 172.21.15.17:0/1780870348 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26e008a030 con 0x7f26f8100ff0 2024-09-20T18:44:38.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.687+0000 7f26fcdae640 1 -- 172.21.15.17:0/1780870348 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f26f819aef0 con 0x7f26e407af90 2024-09-20T18:44:38.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.697+0000 7f26ef7fe640 1 -- 172.21.15.17:0/1780870348 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f26f819aef0 con 0x7f26e407af90 2024-09-20T18:44:38.713 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:44:38.713 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (5m) 13s ago 16m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:44:38.713 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (9m) 13s ago 17m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:44:38.713 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (8m) 48s ago 16m 9017k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:44:38.713 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (4m) 13s ago 17m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:44:38.714 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (4m) 48s ago 16m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:44:38.714 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (5m) 13s ago 16m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:44:38.714 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (34s) 13s ago 11m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:44:38.714 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (18s) 13s ago 11m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:44:38.714 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (11m) 48s ago 11m 27.1M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:44:38.714 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 starting - - - - 2024-09-20T18:44:38.714 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (8m) 13s ago 18m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:44:38.714 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (7m) 48s ago 16m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:44:38.714 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (4m) 13s ago 18m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:44:38.714 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (4m) 48s ago 16m 37.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:44:38.714 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (6m) 13s ago 17m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:44:38.714 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (6m) 48s ago 16m 11.3M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:44:38.714 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (3m) 13s ago 15m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:44:38.714 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (3m) 13s ago 14m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:44:38.715 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (2m) 13s ago 14m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:44:38.715 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (2m) 48s ago 13m 97.9M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:44:38.715 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (86s) 48s ago 13m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:44:38.715 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (51s) 48s ago 12m 11.4M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:44:38.715 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (6m) 13s ago 16m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:44:38.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.700+0000 7f26fcdae640 1 -- 172.21.15.17:0/1780870348 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f26e407af90 msgr2=0x7f26e407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:38.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.700+0000 7f26fcdae640 1 --2- 172.21.15.17:0/1780870348 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f26e407af90 0x7f26e407d450 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f26f819ab00 tx=0x7f26e8005f90 comp rx=0 tx=0).stop 2024-09-20T18:44:38.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.700+0000 7f26fcdae640 1 -- 172.21.15.17:0/1780870348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26f8100ff0 msgr2=0x7f26f819fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:38.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.700+0000 7f26fcdae640 1 --2- 172.21.15.17:0/1780870348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26f8100ff0 0x7f26f819fd40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f26e0031460 tx=0x7f26e0004530 comp rx=0 tx=0).stop 2024-09-20T18:44:38.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.700+0000 7f26fcdae640 1 -- 172.21.15.17:0/1780870348 shutdown_connections 2024-09-20T18:44:38.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.700+0000 7f26fcdae640 1 --2- 172.21.15.17:0/1780870348 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f26e407af90 0x7f26e407d450 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.700+0000 7f26fcdae640 1 --2- 172.21.15.17:0/1780870348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26f8100ff0 0x7f26f819fd40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.700+0000 7f26fcdae640 1 --2- 172.21.15.17:0/1780870348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26f8100640 0x7f26f819f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.700+0000 7f26fcdae640 1 -- 172.21.15.17:0/1780870348 >> 172.21.15.17:0/1780870348 conn(0x7f26f80fc550 msgr2=0x7f26f80fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:38.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.700+0000 7f26fcdae640 1 -- 172.21.15.17:0/1780870348 shutdown_connections 2024-09-20T18:44:38.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.700+0000 7f26fcdae640 1 -- 172.21.15.17:0/1780870348 wait complete. 2024-09-20T18:44:38.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.784+0000 7f4a8983a640 1 -- 172.21.15.17:0/1392327468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a84102ac0 msgr2=0x7f4a84102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:38.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.784+0000 7f4a8983a640 1 --2- 172.21.15.17:0/1392327468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a84102ac0 0x7f4a84102ea0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009880 tx=0x7f4a7402a530 comp rx=0 tx=0).stop 2024-09-20T18:44:38.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.784+0000 7f4a8983a640 1 -- 172.21.15.17:0/1392327468 shutdown_connections 2024-09-20T18:44:38.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.784+0000 7f4a8983a640 1 --2- 172.21.15.17:0/1392327468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a841033e0 0x7f4a8410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.784+0000 7f4a8983a640 1 --2- 172.21.15.17:0/1392327468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a84102ac0 0x7f4a84102ea0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.784+0000 7f4a8983a640 1 -- 172.21.15.17:0/1392327468 >> 172.21.15.17:0/1392327468 conn(0x7f4a840fc520 msgr2=0x7f4a840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:38.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.784+0000 7f4a8983a640 1 -- 172.21.15.17:0/1392327468 shutdown_connections 2024-09-20T18:44:38.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.784+0000 7f4a8983a640 1 -- 172.21.15.17:0/1392327468 wait complete. 2024-09-20T18:44:38.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.785+0000 7f4a8983a640 1 Processor -- start 2024-09-20T18:44:38.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.785+0000 7f4a8983a640 1 -- start start 2024-09-20T18:44:38.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.785+0000 7f4a8983a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a84102ac0 0x7f4a8419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:38.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.785+0000 7f4a8983a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a841033e0 0x7f4a8419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:38.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.785+0000 7f4a8983a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8410edf0 con 0x7f4a84102ac0 2024-09-20T18:44:38.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.785+0000 7f4a8983a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8410ec70 con 0x7f4a841033e0 2024-09-20T18:44:38.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.785+0000 7f4a827fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a841033e0 0x7f4a8419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:38.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.785+0000 7f4a827fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a841033e0 0x7f4a8419db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:53076/0 (socket says 172.21.15.17:53076) 2024-09-20T18:44:38.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.785+0000 7f4a827fc640 1 -- 172.21.15.17:0/1080359497 learned_addr learned my addr 172.21.15.17:0/1080359497 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:44:38.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.786+0000 7f4a82ffd640 1 --2- 172.21.15.17:0/1080359497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a84102ac0 0x7f4a8419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:38.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.786+0000 7f4a827fc640 1 -- 172.21.15.17:0/1080359497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a84102ac0 msgr2=0x7f4a8419d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:38.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.786+0000 7f4a827fc640 1 --2- 172.21.15.17:0/1080359497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a84102ac0 0x7f4a8419d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:38.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.786+0000 7f4a827fc640 1 -- 172.21.15.17:0/1080359497 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a841977a0 con 0x7f4a841033e0 2024-09-20T18:44:38.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.786+0000 7f4a827fc640 1 --2- 172.21.15.17:0/1080359497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a841033e0 0x7f4a8419db60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4a7800e970 tx=0x7f4a7800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:38.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.786+0000 7f4a88838640 1 -- 172.21.15.17:0/1080359497 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a7800cac0 con 0x7f4a841033e0 2024-09-20T18:44:38.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.786+0000 7f4a88838640 1 -- 172.21.15.17:0/1080359497 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4a780054e0 con 0x7f4a841033e0 2024-09-20T18:44:38.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.786+0000 7f4a8983a640 1 -- 172.21.15.17:0/1080359497 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a84197a90 con 0x7f4a841033e0 2024-09-20T18:44:38.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.787+0000 7f4a88838640 1 -- 172.21.15.17:0/1080359497 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a78004dd0 con 0x7f4a841033e0 2024-09-20T18:44:38.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.787+0000 7f4a8983a640 1 -- 172.21.15.17:0/1080359497 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a84198020 con 0x7f4a841033e0 2024-09-20T18:44:38.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.788+0000 7f4a8983a640 1 -- 172.21.15.17:0/1080359497 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a8406aa90 con 0x7f4a841033e0 2024-09-20T18:44:38.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.788+0000 7f4a88838640 1 -- 172.21.15.17:0/1080359497 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4a78005020 con 0x7f4a841033e0 2024-09-20T18:44:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.789+0000 7f4a88838640 1 --2- 172.21.15.17:0/1080359497 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4a6c07aed0 0x7f4a6c07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.789+0000 7f4a88838640 1 -- 172.21.15.17:0/1080359497 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f4a7809e6f0 con 0x7f4a841033e0 2024-09-20T18:44:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.789+0000 7f4a82ffd640 1 --2- 172.21.15.17:0/1080359497 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4a6c07aed0 0x7f4a6c07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.789+0000 7f4a82ffd640 1 --2- 172.21.15.17:0/1080359497 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4a6c07aed0 0x7f4a6c07d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4a740096c0 tx=0x7f4a74031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:38.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:38.793+0000 7f4a88838640 1 -- 172.21.15.17:0/1080359497 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4a78069cf0 con 0x7f4a841033e0 2024-09-20T18:44:39.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.083+0000 7f4a8983a640 1 -- 172.21.15.17:0/1080359497 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4a84105f90 con 0x7f4a841033e0 2024-09-20T18:44:39.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.084+0000 7f4a88838640 1 -- 172.21.15.17:0/1080359497 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f4a7806eba0 con 0x7f4a841033e0 2024-09-20T18:44:39.100 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:44:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:44:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:44:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:44:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:44:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:44:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:44:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:44:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:44:39.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:44:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:44:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:44:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:44:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:44:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:44:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:44:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:44:39.101 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:44:39.101 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:44:39.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.086+0000 7f4a8983a640 1 -- 172.21.15.17:0/1080359497 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4a6c07aed0 msgr2=0x7f4a6c07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:39.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.086+0000 7f4a8983a640 1 --2- 172.21.15.17:0/1080359497 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4a6c07aed0 0x7f4a6c07d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4a740096c0 tx=0x7f4a74031400 comp rx=0 tx=0).stop 2024-09-20T18:44:39.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.086+0000 7f4a8983a640 1 -- 172.21.15.17:0/1080359497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a841033e0 msgr2=0x7f4a8419db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:39.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.086+0000 7f4a8983a640 1 --2- 172.21.15.17:0/1080359497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a841033e0 0x7f4a8419db60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4a7800e970 tx=0x7f4a7800ee30 comp rx=0 tx=0).stop 2024-09-20T18:44:39.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.087+0000 7f4a8983a640 1 -- 172.21.15.17:0/1080359497 shutdown_connections 2024-09-20T18:44:39.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.087+0000 7f4a8983a640 1 --2- 172.21.15.17:0/1080359497 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4a6c07aed0 0x7f4a6c07d390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.087+0000 7f4a8983a640 1 --2- 172.21.15.17:0/1080359497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a841033e0 0x7f4a8419db60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.087+0000 7f4a8983a640 1 --2- 172.21.15.17:0/1080359497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a84102ac0 0x7f4a8419d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.087+0000 7f4a8983a640 1 -- 172.21.15.17:0/1080359497 >> 172.21.15.17:0/1080359497 conn(0x7f4a840fc520 msgr2=0x7f4a84108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:39.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.087+0000 7f4a8983a640 1 -- 172.21.15.17:0/1080359497 shutdown_connections 2024-09-20T18:44:39.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.087+0000 7f4a8983a640 1 -- 172.21.15.17:0/1080359497 wait complete. 2024-09-20T18:44:39.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.171+0000 7fad1144f640 1 -- 172.21.15.17:0/2463102054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad0c106800 msgr2=0x7fad0c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:39.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.171+0000 7fad1144f640 1 --2- 172.21.15.17:0/2463102054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad0c106800 0x7fad0c106be0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7facfc009880 tx=0x7facfc02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.171+0000 7fad1144f640 1 -- 172.21.15.17:0/2463102054 shutdown_connections 2024-09-20T18:44:39.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.171+0000 7fad1144f640 1 --2- 172.21.15.17:0/2463102054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad0c100800 0x7fad0c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.171+0000 7fad1144f640 1 --2- 172.21.15.17:0/2463102054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad0c106800 0x7fad0c106be0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.171+0000 7fad1144f640 1 -- 172.21.15.17:0/2463102054 >> 172.21.15.17:0/2463102054 conn(0x7fad0c0fc520 msgr2=0x7fad0c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:39.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.171+0000 7fad1144f640 1 -- 172.21.15.17:0/2463102054 shutdown_connections 2024-09-20T18:44:39.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.171+0000 7fad1144f640 1 -- 172.21.15.17:0/2463102054 wait complete. 2024-09-20T18:44:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.172+0000 7fad1144f640 1 Processor -- start 2024-09-20T18:44:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.172+0000 7fad1144f640 1 -- start start 2024-09-20T18:44:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.172+0000 7fad1144f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad0c100800 0x7fad0c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.172+0000 7fad1144f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad0c106800 0x7fad0c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.172+0000 7fad1144f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c10dcd0 con 0x7fad0c100800 2024-09-20T18:44:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.172+0000 7fad1144f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c10db50 con 0x7fad0c106800 2024-09-20T18:44:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.172+0000 7fad0affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad0c100800 0x7fad0c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.172+0000 7fad0affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad0c100800 0x7fad0c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57740/0 (socket says 172.21.15.17:57740) 2024-09-20T18:44:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.172+0000 7fad0affd640 1 -- 172.21.15.17:0/3389343815 learned_addr learned my addr 172.21.15.17:0/3389343815 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:44:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.172+0000 7fad03fff640 1 --2- 172.21.15.17:0/3389343815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad0c106800 0x7fad0c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.172+0000 7fad0affd640 1 -- 172.21.15.17:0/3389343815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad0c106800 msgr2=0x7fad0c19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.172+0000 7fad0affd640 1 --2- 172.21.15.17:0/3389343815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad0c106800 0x7fad0c19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.172+0000 7fad0affd640 1 -- 172.21.15.17:0/3389343815 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0c1977c0 con 0x7fad0c100800 2024-09-20T18:44:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.173+0000 7fad0affd640 1 --2- 172.21.15.17:0/3389343815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad0c100800 0x7fad0c19d640 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7facfc031460 tx=0x7facfc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.173+0000 7fad08ff9640 1 -- 172.21.15.17:0/3389343815 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7facfc03f070 con 0x7fad0c100800 2024-09-20T18:44:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.173+0000 7fad1144f640 1 -- 172.21.15.17:0/3389343815 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0c197a50 con 0x7fad0c100800 2024-09-20T18:44:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.173+0000 7fad08ff9640 1 -- 172.21.15.17:0/3389343815 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7facfc0035f0 con 0x7fad0c100800 2024-09-20T18:44:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.173+0000 7fad08ff9640 1 -- 172.21.15.17:0/3389343815 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7facfc035030 con 0x7fad0c100800 2024-09-20T18:44:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.173+0000 7fad1144f640 1 -- 172.21.15.17:0/3389343815 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad0c197f80 con 0x7fad0c100800 2024-09-20T18:44:39.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.174+0000 7fad1144f640 1 -- 172.21.15.17:0/3389343815 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad0c101f40 con 0x7fad0c100800 2024-09-20T18:44:39.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.175+0000 7fad08ff9640 1 -- 172.21.15.17:0/3389343815 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7facfc042070 con 0x7fad0c100800 2024-09-20T18:44:39.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.175+0000 7fad08ff9640 1 --2- 172.21.15.17:0/3389343815 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7facf807af80 0x7facf807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:39.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.175+0000 7fad08ff9640 1 -- 172.21.15.17:0/3389343815 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7facfc0be860 con 0x7fad0c100800 2024-09-20T18:44:39.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.175+0000 7fad03fff640 1 --2- 172.21.15.17:0/3389343815 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7facf807af80 0x7facf807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:39.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.176+0000 7fad03fff640 1 --2- 172.21.15.17:0/3389343815 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7facf807af80 0x7facf807d440 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fad0c104f50 tx=0x7facf400b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:39.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.180+0000 7fad08ff9640 1 -- 172.21.15.17:0/3389343815 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7facfc089ee0 con 0x7fad0c100800 2024-09-20T18:44:39.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.421+0000 7fad1144f640 1 -- 172.21.15.17:0/3389343815 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fad0c109d80 con 0x7fad0c100800 2024-09-20T18:44:39.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.422+0000 7fad08ff9640 1 -- 172.21.15.17:0/3389343815 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7facfc08ed90 con 0x7fad0c100800 2024-09-20T18:44:39.438 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:44:39.438 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:44:39.438 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:44:39.438 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:44:39.438 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:44:39.438 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:44:39.438 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:44:39.439 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:44:39.439 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:44:39.439 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:44:39.439 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:44:39.439 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:44:39.439 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:44:39.439 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:44:39.439 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:44:39.439 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:44:39.439 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:44:39.439 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:44:39.439 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:44:39.439 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:44:39.439 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:44:39.440 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:44:39.440 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:44:39.440 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:44:39.440 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:44:39.440 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:44:39.440 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:44:39.440 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:44:39.440 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:44:39.440 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:44:39.440 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:44:39.440 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:44:39.440 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:44:39.440 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:44:39.440 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:44:39.441 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:44:39.441 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:44:39.441 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:44:39.441 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:44:39.441 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:44:39.441 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:44:39.441 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:44:39.441 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:44:39.442 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:44:39.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.425+0000 7fad1144f640 1 -- 172.21.15.17:0/3389343815 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7facf807af80 msgr2=0x7facf807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:39.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.425+0000 7fad1144f640 1 --2- 172.21.15.17:0/3389343815 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7facf807af80 0x7facf807d440 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fad0c104f50 tx=0x7facf400b390 comp rx=0 tx=0).stop 2024-09-20T18:44:39.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.425+0000 7fad1144f640 1 -- 172.21.15.17:0/3389343815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad0c100800 msgr2=0x7fad0c19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:39.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.425+0000 7fad1144f640 1 --2- 172.21.15.17:0/3389343815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad0c100800 0x7fad0c19d640 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7facfc031460 tx=0x7facfc0045e0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.425+0000 7fad1144f640 1 -- 172.21.15.17:0/3389343815 shutdown_connections 2024-09-20T18:44:39.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.425+0000 7fad1144f640 1 --2- 172.21.15.17:0/3389343815 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7facf807af80 0x7facf807d440 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.425+0000 7fad1144f640 1 --2- 172.21.15.17:0/3389343815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad0c106800 0x7fad0c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.425+0000 7fad1144f640 1 --2- 172.21.15.17:0/3389343815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad0c100800 0x7fad0c19d640 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.425+0000 7fad1144f640 1 -- 172.21.15.17:0/3389343815 >> 172.21.15.17:0/3389343815 conn(0x7fad0c0fc520 msgr2=0x7fad0c06a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:39.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.425+0000 7fad1144f640 1 -- 172.21.15.17:0/3389343815 shutdown_connections 2024-09-20T18:44:39.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.425+0000 7fad1144f640 1 -- 172.21.15.17:0/3389343815 wait complete. 2024-09-20T18:44:39.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.515+0000 7fcf2179f640 1 -- 172.21.15.17:0/3645544020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf1c102910 msgr2=0x7fcf1c102cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:39.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.515+0000 7fcf2179f640 1 --2- 172.21.15.17:0/3645544020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf1c102910 0x7fcf1c102cf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009880 tx=0x7fcf0c02a530 comp rx=0 tx=0).stop 2024-09-20T18:44:39.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.515+0000 7fcf2179f640 1 -- 172.21.15.17:0/3645544020 shutdown_connections 2024-09-20T18:44:39.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.515+0000 7fcf2179f640 1 --2- 172.21.15.17:0/3645544020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf1c103230 0x7fcf1c10b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.515+0000 7fcf2179f640 1 --2- 172.21.15.17:0/3645544020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf1c102910 0x7fcf1c102cf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.515+0000 7fcf2179f640 1 -- 172.21.15.17:0/3645544020 >> 172.21.15.17:0/3645544020 conn(0x7fcf1c0fc350 msgr2=0x7fcf1c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:39.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.515+0000 7fcf2179f640 1 -- 172.21.15.17:0/3645544020 shutdown_connections 2024-09-20T18:44:39.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.515+0000 7fcf2179f640 1 -- 172.21.15.17:0/3645544020 wait complete. 2024-09-20T18:44:39.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.516+0000 7fcf2179f640 1 Processor -- start 2024-09-20T18:44:39.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.516+0000 7fcf2179f640 1 -- start start 2024-09-20T18:44:39.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.516+0000 7fcf2179f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf1c102910 0x7fcf1c100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:39.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.516+0000 7fcf2179f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf1c103230 0x7fcf1c100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:39.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.516+0000 7fcf2179f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1c10ec20 con 0x7fcf1c103230 2024-09-20T18:44:39.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.516+0000 7fcf2179f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1c10eaa0 con 0x7fcf1c102910 2024-09-20T18:44:39.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.516+0000 7fcf1b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf1c103230 0x7fcf1c100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:39.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.517+0000 7fcf1b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf1c103230 0x7fcf1c100ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57750/0 (socket says 172.21.15.17:57750) 2024-09-20T18:44:39.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.517+0000 7fcf1b7fe640 1 -- 172.21.15.17:0/3310261627 learned_addr learned my addr 172.21.15.17:0/3310261627 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:44:39.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.517+0000 7fcf1bfff640 1 --2- 172.21.15.17:0/3310261627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf1c102910 0x7fcf1c100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:39.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.517+0000 7fcf1b7fe640 1 -- 172.21.15.17:0/3310261627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf1c102910 msgr2=0x7fcf1c100570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:39.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.517+0000 7fcf1b7fe640 1 --2- 172.21.15.17:0/3310261627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf1c102910 0x7fcf1c100570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.517+0000 7fcf1b7fe640 1 -- 172.21.15.17:0/3310261627 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf1c100ff0 con 0x7fcf1c103230 2024-09-20T18:44:39.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.517+0000 7fcf1b7fe640 1 --2- 172.21.15.17:0/3310261627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf1c103230 0x7fcf1c100ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000d6c0 tx=0x7fcf1000db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:39.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.517+0000 7fcf197fa640 1 -- 172.21.15.17:0/3310261627 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf10017070 con 0x7fcf1c103230 2024-09-20T18:44:39.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.517+0000 7fcf2179f640 1 -- 172.21.15.17:0/3310261627 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf1c1012e0 con 0x7fcf1c103230 2024-09-20T18:44:39.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.517+0000 7fcf197fa640 1 -- 172.21.15.17:0/3310261627 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcf10009ce0 con 0x7fcf1c103230 2024-09-20T18:44:39.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.517+0000 7fcf2179f640 1 -- 172.21.15.17:0/3310261627 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf1c1a3c50 con 0x7fcf1c103230 2024-09-20T18:44:39.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.517+0000 7fcf197fa640 1 -- 172.21.15.17:0/3310261627 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf10020060 con 0x7fcf1c103230 2024-09-20T18:44:39.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.518+0000 7fcf2179f640 1 -- 172.21.15.17:0/3310261627 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf1c06aa90 con 0x7fcf1c103230 2024-09-20T18:44:39.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.519+0000 7fcf197fa640 1 -- 172.21.15.17:0/3310261627 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fcf10010460 con 0x7fcf1c103230 2024-09-20T18:44:39.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.520+0000 7fcf197fa640 1 --2- 172.21.15.17:0/3310261627 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcf0407af40 0x7fcf0407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:39.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.520+0000 7fcf197fa640 1 -- 172.21.15.17:0/3310261627 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fcf1009de70 con 0x7fcf1c103230 2024-09-20T18:44:39.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.520+0000 7fcf1bfff640 1 --2- 172.21.15.17:0/3310261627 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcf0407af40 0x7fcf0407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:39.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.520+0000 7fcf1bfff640 1 --2- 172.21.15.17:0/3310261627 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcf0407af40 0x7fcf0407d400 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0096c0 tx=0x7fcf0c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:39.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.524+0000 7fcf197fa640 1 -- 172.21.15.17:0/3310261627 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcf10069470 con 0x7fcf1c103230 2024-09-20T18:44:39.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.730+0000 7fcf2179f640 1 -- 172.21.15.17:0/3310261627 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcf1c062630 con 0x7fcf0407af40 2024-09-20T18:44:39.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.731+0000 7fcf197fa640 1 -- 172.21.15.17:0/3310261627 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fcf1c062630 con 0x7fcf0407af40 2024-09-20T18:44:39.747 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:44:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:44:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:44:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:44:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:44:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:44:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:44:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:44:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:44:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:44:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:44:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:44:39.748 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:44:39.748 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:44:39.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.733+0000 7fcf2179f640 1 -- 172.21.15.17:0/3310261627 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcf0407af40 msgr2=0x7fcf0407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:39.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.733+0000 7fcf2179f640 1 --2- 172.21.15.17:0/3310261627 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcf0407af40 0x7fcf0407d400 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0096c0 tx=0x7fcf0c031400 comp rx=0 tx=0).stop 2024-09-20T18:44:39.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.733+0000 7fcf2179f640 1 -- 172.21.15.17:0/3310261627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf1c103230 msgr2=0x7fcf1c100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:39.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.733+0000 7fcf2179f640 1 --2- 172.21.15.17:0/3310261627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf1c103230 0x7fcf1c100ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000d6c0 tx=0x7fcf1000db80 comp rx=0 tx=0).stop 2024-09-20T18:44:39.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.733+0000 7fcf2179f640 1 -- 172.21.15.17:0/3310261627 shutdown_connections 2024-09-20T18:44:39.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.733+0000 7fcf2179f640 1 --2- 172.21.15.17:0/3310261627 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcf0407af40 0x7fcf0407d400 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.733+0000 7fcf2179f640 1 --2- 172.21.15.17:0/3310261627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf1c103230 0x7fcf1c100ab0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.733+0000 7fcf2179f640 1 --2- 172.21.15.17:0/3310261627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf1c102910 0x7fcf1c100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.733+0000 7fcf2179f640 1 -- 172.21.15.17:0/3310261627 >> 172.21.15.17:0/3310261627 conn(0x7fcf1c0fc350 msgr2=0x7fcf1c108ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.733+0000 7fcf2179f640 1 -- 172.21.15.17:0/3310261627 shutdown_connections 2024-09-20T18:44:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.733+0000 7fcf2179f640 1 -- 172.21.15.17:0/3310261627 wait complete. 2024-09-20T18:44:39.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.818+0000 7f9817384640 1 -- 172.21.15.17:0/3277724990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9810107900 msgr2=0x7f9810107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:39.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.818+0000 7f9817384640 1 --2- 172.21.15.17:0/3277724990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9810107900 0x7f9810107ce0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f980c009880 tx=0x7f980c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.818+0000 7f9817384640 1 -- 172.21.15.17:0/3277724990 shutdown_connections 2024-09-20T18:44:39.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.818+0000 7f9817384640 1 --2- 172.21.15.17:0/3277724990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9810101900 0x7f9810101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.818+0000 7f9817384640 1 --2- 172.21.15.17:0/3277724990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9810107900 0x7f9810107ce0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.818+0000 7f9817384640 1 -- 172.21.15.17:0/3277724990 >> 172.21.15.17:0/3277724990 conn(0x7f98100fd600 msgr2=0x7f98100ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:39.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.819+0000 7f9817384640 1 -- 172.21.15.17:0/3277724990 shutdown_connections 2024-09-20T18:44:39.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.819+0000 7f9817384640 1 -- 172.21.15.17:0/3277724990 wait complete. 2024-09-20T18:44:39.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.819+0000 7f9817384640 1 Processor -- start 2024-09-20T18:44:39.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.819+0000 7f9817384640 1 -- start start 2024-09-20T18:44:39.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.819+0000 7f9817384640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9810101900 0x7f98100744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:39.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.819+0000 7f9817384640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9810107900 0x7f9810074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:39.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.820+0000 7f9817384640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f981010edd0 con 0x7f9810101900 2024-09-20T18:44:39.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.820+0000 7f9817384640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f981010ec50 con 0x7f9810107900 2024-09-20T18:44:39.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.820+0000 7f9815120640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9810101900 0x7f98100744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:39.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.820+0000 7f9815120640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9810101900 0x7f98100744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57756/0 (socket says 172.21.15.17:57756) 2024-09-20T18:44:39.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.820+0000 7f9815120640 1 -- 172.21.15.17:0/2342517014 learned_addr learned my addr 172.21.15.17:0/2342517014 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:44:39.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.820+0000 7f981491f640 1 --2- 172.21.15.17:0/2342517014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9810107900 0x7f9810074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:39.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.820+0000 7f9815120640 1 -- 172.21.15.17:0/2342517014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9810107900 msgr2=0x7f9810074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:39.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.820+0000 7f9815120640 1 --2- 172.21.15.17:0/2342517014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9810107900 0x7f9810074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:39.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.820+0000 7f9815120640 1 -- 172.21.15.17:0/2342517014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9810074f70 con 0x7f9810101900 2024-09-20T18:44:39.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.820+0000 7f9815120640 1 --2- 172.21.15.17:0/2342517014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9810101900 0x7f98100744f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f980c031460 tx=0x7f980c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:39.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.820+0000 7f98027fc640 1 -- 172.21.15.17:0/2342517014 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f980c03f070 con 0x7f9810101900 2024-09-20T18:44:39.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.820+0000 7f98027fc640 1 -- 172.21.15.17:0/2342517014 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f980c0035f0 con 0x7f9810101900 2024-09-20T18:44:39.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.820+0000 7f98027fc640 1 -- 172.21.15.17:0/2342517014 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f980c035030 con 0x7f9810101900 2024-09-20T18:44:39.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.820+0000 7f9817384640 1 -- 172.21.15.17:0/2342517014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9810075200 con 0x7f9810101900 2024-09-20T18:44:39.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.820+0000 7f9817384640 1 -- 172.21.15.17:0/2342517014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98101a3d60 con 0x7f9810101900 2024-09-20T18:44:39.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.822+0000 7f9817384640 1 -- 172.21.15.17:0/2342517014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9810103040 con 0x7f9810101900 2024-09-20T18:44:39.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.822+0000 7f98027fc640 1 -- 172.21.15.17:0/2342517014 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f980c042070 con 0x7f9810101900 2024-09-20T18:44:39.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.823+0000 7f98027fc640 1 --2- 172.21.15.17:0/2342517014 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f97fc07af30 0x7f97fc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:44:39.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.823+0000 7f98027fc640 1 -- 172.21.15.17:0/2342517014 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f980c0be900 con 0x7f9810101900 2024-09-20T18:44:39.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.823+0000 7f981491f640 1 --2- 172.21.15.17:0/2342517014 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f97fc07af30 0x7f97fc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:44:39.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.823+0000 7f981491f640 1 --2- 172.21.15.17:0/2342517014 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f97fc07af30 0x7f97fc07d3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9810075f80 tx=0x7f9804005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:44:39.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:39.827+0000 7f98027fc640 1 -- 172.21.15.17:0/2342517014 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f980c089f00 con 0x7f9810101900 2024-09-20T18:44:40.042 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:39 smithi172 ceph-mon[80431]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:44:40.042 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:39 smithi172 ceph-mon[80431]: pgmap v277: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:40.042 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:39 smithi172 ceph-mon[80431]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:44:40.042 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:39 smithi172 ceph-mon[80431]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:44:40.043 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:39 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1080359497' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:40.043 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:39 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3389343815' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:44:40.043 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:39 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:40.043 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:39 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:40.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:40.104+0000 7f9817384640 1 -- 172.21.15.17:0/2342517014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f9810109e70 con 0x7f9810101900 2024-09-20T18:44:40.120 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:39 smithi017 ceph-mon[108970]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:44:40.120 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:39 smithi017 ceph-mon[108970]: pgmap v277: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:40.120 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:39 smithi017 ceph-mon[108970]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:44:40.120 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:39 smithi017 ceph-mon[108970]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:44:40.120 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:39 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1080359497' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:44:40.120 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:39 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3389343815' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:44:40.120 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:39 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:40.121 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:39 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:40.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:40.104+0000 7f98027fc640 1 -- 172.21.15.17:0/2342517014 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f980c08edb0 con 0x7f9810101900 2024-09-20T18:44:40.121 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:44:40.121 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:44:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:44:40.121 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:44:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:44:40.121 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:44:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:44:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:40.106+0000 7f9817384640 1 -- 172.21.15.17:0/2342517014 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f97fc07af30 msgr2=0x7f97fc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:40.106+0000 7f9817384640 1 --2- 172.21.15.17:0/2342517014 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f97fc07af30 0x7f97fc07d3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9810075f80 tx=0x7f9804005f90 comp rx=0 tx=0).stop 2024-09-20T18:44:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:40.106+0000 7f9817384640 1 -- 172.21.15.17:0/2342517014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9810101900 msgr2=0x7f98100744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:44:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:40.106+0000 7f9817384640 1 --2- 172.21.15.17:0/2342517014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9810101900 0x7f98100744f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f980c031460 tx=0x7f980c004530 comp rx=0 tx=0).stop 2024-09-20T18:44:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:40.106+0000 7f9817384640 1 -- 172.21.15.17:0/2342517014 shutdown_connections 2024-09-20T18:44:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:40.106+0000 7f9817384640 1 --2- 172.21.15.17:0/2342517014 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f97fc07af30 0x7f97fc07d3f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:40.106+0000 7f9817384640 1 --2- 172.21.15.17:0/2342517014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9810107900 0x7f9810074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:40.106+0000 7f9817384640 1 --2- 172.21.15.17:0/2342517014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9810101900 0x7f98100744f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:44:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:40.106+0000 7f9817384640 1 -- 172.21.15.17:0/2342517014 >> 172.21.15.17:0/2342517014 conn(0x7f98100fd600 msgr2=0x7f98100fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:44:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:40.106+0000 7f9817384640 1 -- 172.21.15.17:0/2342517014 shutdown_connections 2024-09-20T18:44:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:44:40.107+0000 7f9817384640 1 -- 172.21.15.17:0/2342517014 wait complete. 2024-09-20T18:44:40.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:40 smithi017 ceph-mon[108970]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:44:40.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:40 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:40.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:40 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:40.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:40 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2342517014' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:44:41.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:40 smithi172 ceph-mon[80431]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:44:41.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:40 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:41.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:40 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:44:41.088 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:40 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2342517014' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:44:42.015 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:41 smithi172 ceph-mon[80431]: pgmap v278: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:42.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:41 smithi017 ceph-mon[108970]: pgmap v278: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:43.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:43 smithi017 ceph-mon[108970]: pgmap v279: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:44.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:43 smithi172 ceph-mon[80431]: pgmap v279: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:46.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:45 smithi017 ceph-mon[108970]: pgmap v280: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:46.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:45 smithi172 ceph-mon[80431]: pgmap v280: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:48.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:47 smithi017 ceph-mon[108970]: pgmap v281: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:48.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:47 smithi172 ceph-mon[80431]: pgmap v281: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:49.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:49 smithi017 ceph-mon[108970]: pgmap v282: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:49.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:49 smithi172 ceph-mon[80431]: pgmap v282: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:52.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:51 smithi017 ceph-mon[108970]: pgmap v283: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:52.164 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:51 smithi172 ceph-mon[80431]: pgmap v283: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:52.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:44:53.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:44:54.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:53 smithi017 ceph-mon[108970]: pgmap v284: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:54.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:53 smithi172 ceph-mon[80431]: pgmap v284: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:55.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:55 smithi017 ceph-mon[108970]: pgmap v285: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:56.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:55 smithi172 ceph-mon[80431]: pgmap v285: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:58.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:57 smithi017 ceph-mon[108970]: pgmap v286: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:58.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:57 smithi172 ceph-mon[80431]: pgmap v286: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:44:59.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:44:59 smithi017 ceph-mon[108970]: pgmap v287: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:00.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:44:59 smithi172 ceph-mon[80431]: pgmap v287: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:01.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:01 smithi017 ceph-mon[108970]: pgmap v288: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:02.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:01 smithi172 ceph-mon[80431]: pgmap v288: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:04.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:03 smithi017 ceph-mon[108970]: pgmap v289: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:04.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:03 smithi172 ceph-mon[80431]: pgmap v289: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:06.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:05 smithi017 ceph-mon[108970]: pgmap v290: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:06.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:05 smithi172 ceph-mon[80431]: pgmap v290: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:07.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:07 smithi017 ceph-mon[108970]: pgmap v291: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:07.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:45:08.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:07 smithi172 ceph-mon[80431]: pgmap v291: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:08.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:45:10.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:09 smithi017 ceph-mon[108970]: pgmap v292: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:10.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:09 smithi172 ceph-mon[80431]: pgmap v292: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:10.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.204+0000 7f2b11d0d640 1 -- 172.21.15.17:0/3853548901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b0c1067f0 msgr2=0x7f2b0c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:10.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.204+0000 7f2b11d0d640 1 --2- 172.21.15.17:0/3853548901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b0c1067f0 0x7f2b0c106bd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009c20 tx=0x7f2afc02a970 comp rx=0 tx=0).stop 2024-09-20T18:45:10.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.204+0000 7f2b11d0d640 1 -- 172.21.15.17:0/3853548901 shutdown_connections 2024-09-20T18:45:10.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.204+0000 7f2b11d0d640 1 --2- 172.21.15.17:0/3853548901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b0c1007f0 0x7f2b0c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:10.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.204+0000 7f2b11d0d640 1 --2- 172.21.15.17:0/3853548901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b0c1067f0 0x7f2b0c106bd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:10.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.204+0000 7f2b11d0d640 1 -- 172.21.15.17:0/3853548901 >> 172.21.15.17:0/3853548901 conn(0x7f2b0c0fc550 msgr2=0x7f2b0c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:10.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.204+0000 7f2b11d0d640 1 -- 172.21.15.17:0/3853548901 shutdown_connections 2024-09-20T18:45:10.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.204+0000 7f2b11d0d640 1 -- 172.21.15.17:0/3853548901 wait complete. 2024-09-20T18:45:10.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.205+0000 7f2b11d0d640 1 Processor -- start 2024-09-20T18:45:10.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.205+0000 7f2b11d0d640 1 -- start start 2024-09-20T18:45:10.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.205+0000 7f2b11d0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b0c1007f0 0x7f2b0c19f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:10.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.206+0000 7f2b11d0d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b0c1067f0 0x7f2b0c19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:10.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.206+0000 7f2b11d0d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c10dcc0 con 0x7f2b0c1007f0 2024-09-20T18:45:10.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.206+0000 7f2b11d0d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c10db40 con 0x7f2b0c1067f0 2024-09-20T18:45:10.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.206+0000 7f2b0b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b0c1007f0 0x7f2b0c19f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:10.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.206+0000 7f2b0b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b0c1007f0 0x7f2b0c19f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58234/0 (socket says 172.21.15.17:58234) 2024-09-20T18:45:10.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.206+0000 7f2b0b7fe640 1 -- 172.21.15.17:0/3533005633 learned_addr learned my addr 172.21.15.17:0/3533005633 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:45:10.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.206+0000 7f2b0affd640 1 --2- 172.21.15.17:0/3533005633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b0c1067f0 0x7f2b0c19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:10.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.206+0000 7f2b0b7fe640 1 -- 172.21.15.17:0/3533005633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b0c1067f0 msgr2=0x7f2b0c19fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:10.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.206+0000 7f2b0b7fe640 1 --2- 172.21.15.17:0/3533005633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b0c1067f0 0x7f2b0c19fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:10.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.206+0000 7f2b0b7fe640 1 -- 172.21.15.17:0/3533005633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0c1999d0 con 0x7f2b0c1007f0 2024-09-20T18:45:10.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.206+0000 7f2b0b7fe640 1 --2- 172.21.15.17:0/3533005633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b0c1007f0 0x7f2b0c19f810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2afc02ae90 tx=0x7f2afc02fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:10.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.206+0000 7f2b08ff9640 1 -- 172.21.15.17:0/3533005633 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2afc047070 con 0x7f2b0c1007f0 2024-09-20T18:45:10.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.207+0000 7f2b08ff9640 1 -- 172.21.15.17:0/3533005633 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2afc003e30 con 0x7f2b0c1007f0 2024-09-20T18:45:10.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.207+0000 7f2b11d0d640 1 -- 172.21.15.17:0/3533005633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0c199c60 con 0x7f2b0c1007f0 2024-09-20T18:45:10.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.207+0000 7f2b08ff9640 1 -- 172.21.15.17:0/3533005633 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2afc034070 con 0x7f2b0c1007f0 2024-09-20T18:45:10.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.207+0000 7f2b11d0d640 1 -- 172.21.15.17:0/3533005633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b0c19a190 con 0x7f2b0c1007f0 2024-09-20T18:45:10.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.208+0000 7f2b11d0d640 1 -- 172.21.15.17:0/3533005633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b0c101f30 con 0x7f2b0c1007f0 2024-09-20T18:45:10.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.209+0000 7f2b08ff9640 1 -- 172.21.15.17:0/3533005633 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2afc04a070 con 0x7f2b0c1007f0 2024-09-20T18:45:10.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.209+0000 7f2b08ff9640 1 --2- 172.21.15.17:0/3533005633 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2af407af30 0x7f2af407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:10.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.209+0000 7f2b08ff9640 1 -- 172.21.15.17:0/3533005633 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f2afc0bec30 con 0x7f2b0c1007f0 2024-09-20T18:45:10.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.209+0000 7f2b0affd640 1 --2- 172.21.15.17:0/3533005633 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2af407af30 0x7f2af407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:10.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.210+0000 7f2b0affd640 1 --2- 172.21.15.17:0/3533005633 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2af407af30 0x7f2af407d3f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c0fec60 tx=0x7f2b00005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:10.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.214+0000 7f2b08ff9640 1 -- 172.21.15.17:0/3533005633 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2afc03f070 con 0x7f2b0c1007f0 2024-09-20T18:45:10.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.418+0000 7f2b11d0d640 1 -- 172.21.15.17:0/3533005633 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2b0c19a440 con 0x7f2af407af30 2024-09-20T18:45:10.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.419+0000 7f2b08ff9640 1 -- 172.21.15.17:0/3533005633 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f2b0c19a440 con 0x7f2af407af30 2024-09-20T18:45:10.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.421+0000 7f2b11d0d640 1 -- 172.21.15.17:0/3533005633 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2af407af30 msgr2=0x7f2af407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:10.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.421+0000 7f2b11d0d640 1 --2- 172.21.15.17:0/3533005633 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2af407af30 0x7f2af407d3f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c0fec60 tx=0x7f2b00005f90 comp rx=0 tx=0).stop 2024-09-20T18:45:10.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.421+0000 7f2b11d0d640 1 -- 172.21.15.17:0/3533005633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b0c1007f0 msgr2=0x7f2b0c19f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:10.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.421+0000 7f2b11d0d640 1 --2- 172.21.15.17:0/3533005633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b0c1007f0 0x7f2b0c19f810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2afc02ae90 tx=0x7f2afc02fd60 comp rx=0 tx=0).stop 2024-09-20T18:45:10.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.421+0000 7f2b11d0d640 1 -- 172.21.15.17:0/3533005633 shutdown_connections 2024-09-20T18:45:10.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.421+0000 7f2b11d0d640 1 --2- 172.21.15.17:0/3533005633 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2af407af30 0x7f2af407d3f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:10.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.421+0000 7f2b11d0d640 1 --2- 172.21.15.17:0/3533005633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b0c1067f0 0x7f2b0c19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:10.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.421+0000 7f2b11d0d640 1 --2- 172.21.15.17:0/3533005633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b0c1007f0 0x7f2b0c19f810 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:10.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.421+0000 7f2b11d0d640 1 -- 172.21.15.17:0/3533005633 >> 172.21.15.17:0/3533005633 conn(0x7f2b0c0fc550 msgr2=0x7f2b0c069d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:10.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.422+0000 7f2b11d0d640 1 -- 172.21.15.17:0/3533005633 shutdown_connections 2024-09-20T18:45:10.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.422+0000 7f2b11d0d640 1 -- 172.21.15.17:0/3533005633 wait complete. 2024-09-20T18:45:10.447 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:45:10.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.507+0000 7efd2739d640 1 -- 172.21.15.17:0/2193998310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd20102ac0 msgr2=0x7efd20102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:10.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.507+0000 7efd2739d640 1 --2- 172.21.15.17:0/2193998310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd20102ac0 0x7efd20102ea0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009880 tx=0x7efd1c02a530 comp rx=0 tx=0).stop 2024-09-20T18:45:10.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.507+0000 7efd2739d640 1 -- 172.21.15.17:0/2193998310 shutdown_connections 2024-09-20T18:45:10.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.507+0000 7efd2739d640 1 --2- 172.21.15.17:0/2193998310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd201033e0 0x7efd2010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:10.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.507+0000 7efd2739d640 1 --2- 172.21.15.17:0/2193998310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd20102ac0 0x7efd20102ea0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:10.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.507+0000 7efd2739d640 1 -- 172.21.15.17:0/2193998310 >> 172.21.15.17:0/2193998310 conn(0x7efd200fc520 msgr2=0x7efd200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:10.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.507+0000 7efd2739d640 1 -- 172.21.15.17:0/2193998310 shutdown_connections 2024-09-20T18:45:10.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.508+0000 7efd2739d640 1 -- 172.21.15.17:0/2193998310 wait complete. 2024-09-20T18:45:10.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.508+0000 7efd2739d640 1 Processor -- start 2024-09-20T18:45:10.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.508+0000 7efd2739d640 1 -- start start 2024-09-20T18:45:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.508+0000 7efd2739d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd20102ac0 0x7efd2019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.508+0000 7efd2739d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd201033e0 0x7efd2019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.508+0000 7efd2739d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efd2010edf0 con 0x7efd201033e0 2024-09-20T18:45:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.508+0000 7efd2739d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efd2010ec70 con 0x7efd20102ac0 2024-09-20T18:45:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.509+0000 7efd24938640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd201033e0 0x7efd2019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.509+0000 7efd24938640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd201033e0 0x7efd2019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51172/0 (socket says 172.21.15.17:51172) 2024-09-20T18:45:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.509+0000 7efd24938640 1 -- 172.21.15.17:0/1408947765 learned_addr learned my addr 172.21.15.17:0/1408947765 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:45:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.509+0000 7efd25139640 1 --2- 172.21.15.17:0/1408947765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd20102ac0 0x7efd2019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.509+0000 7efd24938640 1 -- 172.21.15.17:0/1408947765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd20102ac0 msgr2=0x7efd2019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.509+0000 7efd24938640 1 --2- 172.21.15.17:0/1408947765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd20102ac0 0x7efd2019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.509+0000 7efd24938640 1 -- 172.21.15.17:0/1408947765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd201977c0 con 0x7efd201033e0 2024-09-20T18:45:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.509+0000 7efd24938640 1 --2- 172.21.15.17:0/1408947765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd201033e0 0x7efd2019db80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd1000d6d0 tx=0x7efd1000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.509+0000 7efd167fc640 1 -- 172.21.15.17:0/1408947765 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd10017070 con 0x7efd201033e0 2024-09-20T18:45:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.509+0000 7efd167fc640 1 -- 172.21.15.17:0/1408947765 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efd100054e0 con 0x7efd201033e0 2024-09-20T18:45:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.509+0000 7efd2739d640 1 -- 172.21.15.17:0/1408947765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd20197ab0 con 0x7efd201033e0 2024-09-20T18:45:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.510+0000 7efd2739d640 1 -- 172.21.15.17:0/1408947765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd20198040 con 0x7efd201033e0 2024-09-20T18:45:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.509+0000 7efd167fc640 1 -- 172.21.15.17:0/1408947765 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd10004ae0 con 0x7efd201033e0 2024-09-20T18:45:10.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.511+0000 7efd2739d640 1 -- 172.21.15.17:0/1408947765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd2006aa90 con 0x7efd201033e0 2024-09-20T18:45:10.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.511+0000 7efd167fc640 1 -- 172.21.15.17:0/1408947765 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7efd10004d90 con 0x7efd201033e0 2024-09-20T18:45:10.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.512+0000 7efd167fc640 1 --2- 172.21.15.17:0/1408947765 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd0c07af80 0x7efd0c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:10.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.512+0000 7efd167fc640 1 -- 172.21.15.17:0/1408947765 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7efd1009daa0 con 0x7efd201033e0 2024-09-20T18:45:10.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.512+0000 7efd25139640 1 --2- 172.21.15.17:0/1408947765 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd0c07af80 0x7efd0c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:10.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.513+0000 7efd25139640 1 --2- 172.21.15.17:0/1408947765 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd0c07af80 0x7efd0c07d440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0096c0 tx=0x7efd1c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.516+0000 7efd167fc640 1 -- 172.21.15.17:0/1408947765 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd10069120 con 0x7efd201033e0 2024-09-20T18:45:10.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.726+0000 7efd2739d640 1 -- 172.21.15.17:0/1408947765 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efd201982f0 con 0x7efd0c07af80 2024-09-20T18:45:10.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.727+0000 7efd167fc640 1 -- 172.21.15.17:0/1408947765 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7efd201982f0 con 0x7efd0c07af80 2024-09-20T18:45:10.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.729+0000 7efd2739d640 1 -- 172.21.15.17:0/1408947765 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd0c07af80 msgr2=0x7efd0c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:10.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.729+0000 7efd2739d640 1 --2- 172.21.15.17:0/1408947765 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd0c07af80 0x7efd0c07d440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0096c0 tx=0x7efd1c031400 comp rx=0 tx=0).stop 2024-09-20T18:45:10.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.729+0000 7efd2739d640 1 -- 172.21.15.17:0/1408947765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd201033e0 msgr2=0x7efd2019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:10.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.729+0000 7efd2739d640 1 --2- 172.21.15.17:0/1408947765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd201033e0 0x7efd2019db80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd1000d6d0 tx=0x7efd1000db90 comp rx=0 tx=0).stop 2024-09-20T18:45:10.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.729+0000 7efd2739d640 1 -- 172.21.15.17:0/1408947765 shutdown_connections 2024-09-20T18:45:10.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.729+0000 7efd2739d640 1 --2- 172.21.15.17:0/1408947765 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd0c07af80 0x7efd0c07d440 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:10.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.729+0000 7efd2739d640 1 --2- 172.21.15.17:0/1408947765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd201033e0 0x7efd2019db80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:10.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.729+0000 7efd2739d640 1 --2- 172.21.15.17:0/1408947765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd20102ac0 0x7efd2019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:10.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.729+0000 7efd2739d640 1 -- 172.21.15.17:0/1408947765 >> 172.21.15.17:0/1408947765 conn(0x7efd200fc520 msgr2=0x7efd2010af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:10.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.729+0000 7efd2739d640 1 -- 172.21.15.17:0/1408947765 shutdown_connections 2024-09-20T18:45:10.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.729+0000 7efd2739d640 1 -- 172.21.15.17:0/1408947765 wait complete. 2024-09-20T18:45:10.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.814+0000 7f221f79f640 1 -- 172.21.15.17:0/1815696997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2218103490 msgr2=0x7f221810b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:10.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.814+0000 7f221f79f640 1 --2- 172.21.15.17:0/1815696997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2218103490 0x7f221810b980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2208009880 tx=0x7f220802a530 comp rx=0 tx=0).stop 2024-09-20T18:45:10.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.814+0000 7f221f79f640 1 -- 172.21.15.17:0/1815696997 shutdown_connections 2024-09-20T18:45:10.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.814+0000 7f221f79f640 1 --2- 172.21.15.17:0/1815696997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2218103490 0x7f221810b980 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:10.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.814+0000 7f221f79f640 1 --2- 172.21.15.17:0/1815696997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2218102b70 0x7f2218102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:10.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.814+0000 7f221f79f640 1 -- 172.21.15.17:0/1815696997 >> 172.21.15.17:0/1815696997 conn(0x7f22180fc550 msgr2=0x7f22180fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:10.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.814+0000 7f221f79f640 1 -- 172.21.15.17:0/1815696997 shutdown_connections 2024-09-20T18:45:10.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.814+0000 7f221f79f640 1 -- 172.21.15.17:0/1815696997 wait complete. 2024-09-20T18:45:10.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.815+0000 7f221f79f640 1 Processor -- start 2024-09-20T18:45:10.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.815+0000 7f221f79f640 1 -- start start 2024-09-20T18:45:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.815+0000 7f221f79f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2218102b70 0x7f221819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.815+0000 7f221f79f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2218103490 0x7f221819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.815+0000 7f221f79f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f221810ede0 con 0x7f2218102b70 2024-09-20T18:45:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.815+0000 7f221f79f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f221810ec60 con 0x7f2218103490 2024-09-20T18:45:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.815+0000 7f221d53b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2218102b70 0x7f221819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.815+0000 7f221d53b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2218102b70 0x7f221819d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51190/0 (socket says 172.21.15.17:51190) 2024-09-20T18:45:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.815+0000 7f221d53b640 1 -- 172.21.15.17:0/2346468306 learned_addr learned my addr 172.21.15.17:0/2346468306 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:45:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.815+0000 7f221cd3a640 1 --2- 172.21.15.17:0/2346468306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2218103490 0x7f221819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.816+0000 7f221d53b640 1 -- 172.21.15.17:0/2346468306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2218103490 msgr2=0x7f221819db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.816+0000 7f221d53b640 1 --2- 172.21.15.17:0/2346468306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2218103490 0x7f221819db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:10.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.816+0000 7f221d53b640 1 -- 172.21.15.17:0/2346468306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22181977d0 con 0x7f2218102b70 2024-09-20T18:45:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.816+0000 7f221d53b640 1 --2- 172.21.15.17:0/2346468306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2218102b70 0x7f221819d650 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f221400d6f0 tx=0x7f221400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.816+0000 7f220e7fc640 1 -- 172.21.15.17:0/2346468306 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2214017070 con 0x7f2218102b70 2024-09-20T18:45:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.816+0000 7f221f79f640 1 -- 172.21.15.17:0/2346468306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2218197ac0 con 0x7f2218102b70 2024-09-20T18:45:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.816+0000 7f220e7fc640 1 -- 172.21.15.17:0/2346468306 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f221400de00 con 0x7f2218102b70 2024-09-20T18:45:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.816+0000 7f221f79f640 1 -- 172.21.15.17:0/2346468306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2218198020 con 0x7f2218102b70 2024-09-20T18:45:10.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.816+0000 7f220e7fc640 1 -- 172.21.15.17:0/2346468306 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2214004bb0 con 0x7f2218102b70 2024-09-20T18:45:10.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.818+0000 7f221f79f640 1 -- 172.21.15.17:0/2346468306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f221806a4c0 con 0x7f2218102b70 2024-09-20T18:45:10.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.818+0000 7f220e7fc640 1 -- 172.21.15.17:0/2346468306 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2214004e60 con 0x7f2218102b70 2024-09-20T18:45:10.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.818+0000 7f220e7fc640 1 --2- 172.21.15.17:0/2346468306 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f220407af30 0x7f220407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:10.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.819+0000 7f220e7fc640 1 -- 172.21.15.17:0/2346468306 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f221409d890 con 0x7f2218102b70 2024-09-20T18:45:10.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.819+0000 7f221cd3a640 1 --2- 172.21.15.17:0/2346468306 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f220407af30 0x7f220407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:10.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.819+0000 7f221cd3a640 1 --2- 172.21.15.17:0/2346468306 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f220407af30 0x7f220407d3f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2218198b20 tx=0x7f2208004f30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:10.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:10.823+0000 7f220e7fc640 1 -- 172.21.15.17:0/2346468306 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2214068f10 con 0x7f2218102b70 2024-09-20T18:45:11.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.018+0000 7f221f79f640 1 -- 172.21.15.17:0/2346468306 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f22181982d0 con 0x7f220407af30 2024-09-20T18:45:11.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.028+0000 7f220e7fc640 1 -- 172.21.15.17:0/2346468306 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f22181982d0 con 0x7f220407af30 2024-09-20T18:45:11.045 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:45:11.045 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (6m) 45s ago 17m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:45:11.045 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (9m) 45s ago 17m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:45:11.045 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (9m) 31s ago 16m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:45:11.045 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (4m) 45s ago 17m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:45:11.045 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (4m) 31s ago 16m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:45:11.045 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (6m) 45s ago 17m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:45:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (67s) 45s ago 12m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:45:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (50s) 45s ago 12m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:45:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (12m) 31s ago 12m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:45:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (34s) 31s ago 12m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:45:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (8m) 45s ago 18m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:45:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (7m) 31s ago 16m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:45:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (5m) 45s ago 18m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:45:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (5m) 31s ago 16m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:45:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (7m) 45s ago 17m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:45:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (7m) 31s ago 16m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:45:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (4m) 45s ago 15m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:45:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (3m) 45s ago 15m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:45:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (3m) 45s ago 14m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:45:11.047 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (2m) 31s ago 14m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:45:11.047 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (118s) 31s ago 13m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:45:11.047 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (84s) 31s ago 13m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:45:11.047 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (6m) 45s ago 17m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:45:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.031+0000 7f221f79f640 1 -- 172.21.15.17:0/2346468306 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f220407af30 msgr2=0x7f220407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.031+0000 7f221f79f640 1 --2- 172.21.15.17:0/2346468306 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f220407af30 0x7f220407d3f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2218198b20 tx=0x7f2208004f30 comp rx=0 tx=0).stop 2024-09-20T18:45:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.031+0000 7f221f79f640 1 -- 172.21.15.17:0/2346468306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2218102b70 msgr2=0x7f221819d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.031+0000 7f221f79f640 1 --2- 172.21.15.17:0/2346468306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2218102b70 0x7f221819d650 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f221400d6f0 tx=0x7f221400dbb0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.031+0000 7f221f79f640 1 -- 172.21.15.17:0/2346468306 shutdown_connections 2024-09-20T18:45:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.031+0000 7f221f79f640 1 --2- 172.21.15.17:0/2346468306 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f220407af30 0x7f220407d3f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.031+0000 7f221f79f640 1 --2- 172.21.15.17:0/2346468306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2218103490 0x7f221819db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.031+0000 7f221f79f640 1 --2- 172.21.15.17:0/2346468306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2218102b70 0x7f221819d650 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.031+0000 7f221f79f640 1 -- 172.21.15.17:0/2346468306 >> 172.21.15.17:0/2346468306 conn(0x7f22180fc550 msgr2=0x7f2218103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.031+0000 7f221f79f640 1 -- 172.21.15.17:0/2346468306 shutdown_connections 2024-09-20T18:45:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.031+0000 7f221f79f640 1 -- 172.21.15.17:0/2346468306 wait complete. 2024-09-20T18:45:11.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.114+0000 7fec82234640 1 -- 172.21.15.17:0/412641419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec7c1007f0 msgr2=0x7fec7c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:11.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.114+0000 7fec82234640 1 --2- 172.21.15.17:0/412641419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec7c1007f0 0x7fec7c100c50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fec70009880 tx=0x7fec7002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.114+0000 7fec82234640 1 -- 172.21.15.17:0/412641419 shutdown_connections 2024-09-20T18:45:11.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.114+0000 7fec82234640 1 --2- 172.21.15.17:0/412641419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec7c1007f0 0x7fec7c100c50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.114+0000 7fec82234640 1 --2- 172.21.15.17:0/412641419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec7c1067f0 0x7fec7c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.114+0000 7fec82234640 1 -- 172.21.15.17:0/412641419 >> 172.21.15.17:0/412641419 conn(0x7fec7c0fc550 msgr2=0x7fec7c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:11.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.114+0000 7fec82234640 1 -- 172.21.15.17:0/412641419 shutdown_connections 2024-09-20T18:45:11.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.114+0000 7fec82234640 1 -- 172.21.15.17:0/412641419 wait complete. 2024-09-20T18:45:11.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.115+0000 7fec82234640 1 Processor -- start 2024-09-20T18:45:11.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.115+0000 7fec82234640 1 -- start start 2024-09-20T18:45:11.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.115+0000 7fec82234640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec7c1007f0 0x7fec7c0fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:11.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.115+0000 7fec82234640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec7c1067f0 0x7fec7c0fd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:11.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.115+0000 7fec82234640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c10dcc0 con 0x7fec7c1007f0 2024-09-20T18:45:11.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.115+0000 7fec82234640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c10db40 con 0x7fec7c1067f0 2024-09-20T18:45:11.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.116+0000 7fec7b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec7c1007f0 0x7fec7c0fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:11.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.116+0000 7fec7b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec7c1007f0 0x7fec7c0fccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51216/0 (socket says 172.21.15.17:51216) 2024-09-20T18:45:11.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.116+0000 7fec7b7fe640 1 -- 172.21.15.17:0/1714674396 learned_addr learned my addr 172.21.15.17:0/1714674396 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:45:11.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.116+0000 7fec7affd640 1 --2- 172.21.15.17:0/1714674396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec7c1067f0 0x7fec7c0fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:11.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.116+0000 7fec7b7fe640 1 -- 172.21.15.17:0/1714674396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec7c1067f0 msgr2=0x7fec7c0fd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:11.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.116+0000 7fec7b7fe640 1 --2- 172.21.15.17:0/1714674396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec7c1067f0 0x7fec7c0fd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.116+0000 7fec7b7fe640 1 -- 172.21.15.17:0/1714674396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c0fd750 con 0x7fec7c1007f0 2024-09-20T18:45:11.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.116+0000 7fec7b7fe640 1 --2- 172.21.15.17:0/1714674396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec7c1007f0 0x7fec7c0fccd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00e970 tx=0x7fec6c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:11.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.116+0000 7fec78ff9640 1 -- 172.21.15.17:0/1714674396 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec6c00cac0 con 0x7fec7c1007f0 2024-09-20T18:45:11.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.116+0000 7fec78ff9640 1 -- 172.21.15.17:0/1714674396 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fec6c0054e0 con 0x7fec7c1007f0 2024-09-20T18:45:11.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.116+0000 7fec82234640 1 -- 172.21.15.17:0/1714674396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7c0fda40 con 0x7fec7c1007f0 2024-09-20T18:45:11.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.116+0000 7fec78ff9640 1 -- 172.21.15.17:0/1714674396 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec6c010430 con 0x7fec7c1007f0 2024-09-20T18:45:11.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.116+0000 7fec82234640 1 -- 172.21.15.17:0/1714674396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec7c1a3e60 con 0x7fec7c1007f0 2024-09-20T18:45:11.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.117+0000 7fec82234640 1 -- 172.21.15.17:0/1714674396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec7c101f30 con 0x7fec7c1007f0 2024-09-20T18:45:11.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.119+0000 7fec78ff9640 1 -- 172.21.15.17:0/1714674396 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fec6c004ec0 con 0x7fec7c1007f0 2024-09-20T18:45:11.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.120+0000 7fec78ff9640 1 --2- 172.21.15.17:0/1714674396 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec6407af80 0x7fec6407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:11.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.120+0000 7fec78ff9640 1 -- 172.21.15.17:0/1714674396 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fec6c09e780 con 0x7fec7c1007f0 2024-09-20T18:45:11.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.120+0000 7fec7affd640 1 --2- 172.21.15.17:0/1714674396 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec6407af80 0x7fec6407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:11.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.120+0000 7fec7affd640 1 --2- 172.21.15.17:0/1714674396 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec6407af80 0x7fec6407d440 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0fe760 tx=0x7fec70031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:11.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.123+0000 7fec78ff9640 1 -- 172.21.15.17:0/1714674396 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fec6c069ea0 con 0x7fec7c1007f0 2024-09-20T18:45:11.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.389+0000 7fec82234640 1 -- 172.21.15.17:0/1714674396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fec7c100c50 con 0x7fec7c1007f0 2024-09-20T18:45:11.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.390+0000 7fec78ff9640 1 -- 172.21.15.17:0/1714674396 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fec7c100c50 con 0x7fec7c1007f0 2024-09-20T18:45:11.407 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:45:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:45:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:45:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:45:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:45:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:45:11.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:45:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:45:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:45:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:45:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:45:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:45:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:45:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:45:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:45:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:45:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:45:11.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:45:11.408 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:45:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.392+0000 7fec82234640 1 -- 172.21.15.17:0/1714674396 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec6407af80 msgr2=0x7fec6407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.392+0000 7fec82234640 1 --2- 172.21.15.17:0/1714674396 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec6407af80 0x7fec6407d440 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0fe760 tx=0x7fec70031400 comp rx=0 tx=0).stop 2024-09-20T18:45:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.392+0000 7fec82234640 1 -- 172.21.15.17:0/1714674396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec7c1007f0 msgr2=0x7fec7c0fccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:11.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.392+0000 7fec82234640 1 --2- 172.21.15.17:0/1714674396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec7c1007f0 0x7fec7c0fccd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00e970 tx=0x7fec6c00ed70 comp rx=0 tx=0).stop 2024-09-20T18:45:11.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.392+0000 7fec82234640 1 -- 172.21.15.17:0/1714674396 shutdown_connections 2024-09-20T18:45:11.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.392+0000 7fec82234640 1 --2- 172.21.15.17:0/1714674396 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec6407af80 0x7fec6407d440 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.392+0000 7fec82234640 1 --2- 172.21.15.17:0/1714674396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec7c1067f0 0x7fec7c0fd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.392+0000 7fec82234640 1 --2- 172.21.15.17:0/1714674396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec7c1007f0 0x7fec7c0fccd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.392+0000 7fec82234640 1 -- 172.21.15.17:0/1714674396 >> 172.21.15.17:0/1714674396 conn(0x7fec7c0fc550 msgr2=0x7fec7c069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:11.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.393+0000 7fec82234640 1 -- 172.21.15.17:0/1714674396 shutdown_connections 2024-09-20T18:45:11.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.393+0000 7fec82234640 1 -- 172.21.15.17:0/1714674396 wait complete. 2024-09-20T18:45:11.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.477+0000 7f03c66cf640 1 -- 172.21.15.17:0/1662974676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c0100a90 msgr2=0x7f03c01065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:11.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.477+0000 7f03c66cf640 1 --2- 172.21.15.17:0/1662974676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c0100a90 0x7f03c01065d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009880 tx=0x7f03a802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.477+0000 7f03c66cf640 1 -- 172.21.15.17:0/1662974676 shutdown_connections 2024-09-20T18:45:11.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.477+0000 7f03c66cf640 1 --2- 172.21.15.17:0/1662974676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c0100a90 0x7f03c01065d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.477+0000 7f03c66cf640 1 --2- 172.21.15.17:0/1662974676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c01000e0 0x7f03c01004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.477+0000 7f03c66cf640 1 -- 172.21.15.17:0/1662974676 >> 172.21.15.17:0/1662974676 conn(0x7f03c00fbc90 msgr2=0x7f03c00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:11.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.477+0000 7f03c66cf640 1 -- 172.21.15.17:0/1662974676 shutdown_connections 2024-09-20T18:45:11.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.477+0000 7f03c66cf640 1 -- 172.21.15.17:0/1662974676 wait complete. 2024-09-20T18:45:11.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.478+0000 7f03c66cf640 1 Processor -- start 2024-09-20T18:45:11.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.478+0000 7f03c66cf640 1 -- start start 2024-09-20T18:45:11.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.478+0000 7f03c66cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c01000e0 0x7f03c019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:11.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.478+0000 7f03c66cf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c0100a90 0x7f03c019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:11.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.478+0000 7f03c66cf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f03c010ee30 con 0x7f03c01000e0 2024-09-20T18:45:11.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.478+0000 7f03c66cf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f03c010ecb0 con 0x7f03c0100a90 2024-09-20T18:45:11.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.478+0000 7f03bffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c01000e0 0x7f03c019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:11.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.478+0000 7f03bffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c01000e0 0x7f03c019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51228/0 (socket says 172.21.15.17:51228) 2024-09-20T18:45:11.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.478+0000 7f03bffff640 1 -- 172.21.15.17:0/1484436940 learned_addr learned my addr 172.21.15.17:0/1484436940 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:45:11.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.478+0000 7f03b7fff640 1 --2- 172.21.15.17:0/1484436940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c0100a90 0x7f03c019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:11.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.478+0000 7f03bffff640 1 -- 172.21.15.17:0/1484436940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c0100a90 msgr2=0x7f03c019dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:11.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.478+0000 7f03bffff640 1 --2- 172.21.15.17:0/1484436940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c0100a90 0x7f03c019dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.478+0000 7f03bffff640 1 -- 172.21.15.17:0/1484436940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c0197860 con 0x7f03c01000e0 2024-09-20T18:45:11.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.479+0000 7f03bffff640 1 --2- 172.21.15.17:0/1484436940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c01000e0 0x7f03c019d6a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f03b000d8d0 tx=0x7f03b000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:11.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.479+0000 7f03bdffb640 1 -- 172.21.15.17:0/1484436940 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03b0017030 con 0x7f03c01000e0 2024-09-20T18:45:11.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.479+0000 7f03bdffb640 1 -- 172.21.15.17:0/1484436940 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03b0004020 con 0x7f03c01000e0 2024-09-20T18:45:11.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.479+0000 7f03bdffb640 1 -- 172.21.15.17:0/1484436940 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03b00047a0 con 0x7f03c01000e0 2024-09-20T18:45:11.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.479+0000 7f03c66cf640 1 -- 172.21.15.17:0/1484436940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c0197b50 con 0x7f03c01000e0 2024-09-20T18:45:11.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.479+0000 7f03c66cf640 1 -- 172.21.15.17:0/1484436940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c01980b0 con 0x7f03c01000e0 2024-09-20T18:45:11.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.480+0000 7f03c66cf640 1 -- 172.21.15.17:0/1484436940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03c01031a0 con 0x7f03c01000e0 2024-09-20T18:45:11.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.480+0000 7f03bdffb640 1 -- 172.21.15.17:0/1484436940 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f03b00041d0 con 0x7f03c01000e0 2024-09-20T18:45:11.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.481+0000 7f03bdffb640 1 --2- 172.21.15.17:0/1484436940 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f03ac07af30 0x7f03ac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:11.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.481+0000 7f03bdffb640 1 -- 172.21.15.17:0/1484436940 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f03b0018070 con 0x7f03c01000e0 2024-09-20T18:45:11.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.481+0000 7f03b7fff640 1 --2- 172.21.15.17:0/1484436940 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f03ac07af30 0x7f03ac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:11.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.482+0000 7f03b7fff640 1 --2- 172.21.15.17:0/1484436940 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f03ac07af30 0x7f03ac07d3f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f03c0199050 tx=0x7f03a8031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:11.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.485+0000 7f03bdffb640 1 -- 172.21.15.17:0/1484436940 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f03b0069420 con 0x7f03c01000e0 2024-09-20T18:45:11.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.711+0000 7f03c66cf640 1 -- 172.21.15.17:0/1484436940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f03c0198d90 con 0x7f03c01000e0 2024-09-20T18:45:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.712+0000 7f03bdffb640 1 -- 172.21.15.17:0/1484436940 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f03b006e2d0 con 0x7f03c01000e0 2024-09-20T18:45:11.729 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:45:11.729 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:45:11.729 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:45:11.729 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:45:11.729 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:45:11.729 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:45:11.729 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:45:11.729 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:45:11.730 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:45:11.730 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:45:11.730 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:45:11.730 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:45:11.730 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:45:11.730 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:45:11.730 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:45:11.730 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:45:11.730 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:45:11.730 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:45:11.730 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:45:11.730 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:45:11.730 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:45:11.730 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:45:11.731 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:45:11.731 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:45:11.731 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:45:11.731 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:45:11.731 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:45:11.731 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:45:11.731 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:45:11.731 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:45:11.731 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:45:11.731 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:45:11.731 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:45:11.731 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:45:11.731 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:45:11.732 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:45:11.732 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:45:11.732 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:45:11.732 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:45:11.732 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:45:11.732 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:45:11.732 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:45:11.732 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:45:11.733 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:45:11.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.715+0000 7f03c66cf640 1 -- 172.21.15.17:0/1484436940 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f03ac07af30 msgr2=0x7f03ac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:11.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.715+0000 7f03c66cf640 1 --2- 172.21.15.17:0/1484436940 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f03ac07af30 0x7f03ac07d3f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f03c0199050 tx=0x7f03a8031400 comp rx=0 tx=0).stop 2024-09-20T18:45:11.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.715+0000 7f03c66cf640 1 -- 172.21.15.17:0/1484436940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c01000e0 msgr2=0x7f03c019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:11.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.715+0000 7f03c66cf640 1 --2- 172.21.15.17:0/1484436940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c01000e0 0x7f03c019d6a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f03b000d8d0 tx=0x7f03b000dd90 comp rx=0 tx=0).stop 2024-09-20T18:45:11.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.715+0000 7f03c66cf640 1 -- 172.21.15.17:0/1484436940 shutdown_connections 2024-09-20T18:45:11.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.715+0000 7f03c66cf640 1 --2- 172.21.15.17:0/1484436940 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f03ac07af30 0x7f03ac07d3f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.716+0000 7f03c66cf640 1 --2- 172.21.15.17:0/1484436940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c0100a90 0x7f03c019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.716+0000 7f03c66cf640 1 --2- 172.21.15.17:0/1484436940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c01000e0 0x7f03c019d6a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.716+0000 7f03c66cf640 1 -- 172.21.15.17:0/1484436940 >> 172.21.15.17:0/1484436940 conn(0x7f03c00fbc90 msgr2=0x7f03c00fd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.716+0000 7f03c66cf640 1 -- 172.21.15.17:0/1484436940 shutdown_connections 2024-09-20T18:45:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.716+0000 7f03c66cf640 1 -- 172.21.15.17:0/1484436940 wait complete. 2024-09-20T18:45:11.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.803+0000 7f3e47ff2640 1 -- 172.21.15.17:0/2399284690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e40107900 msgr2=0x7f3e40107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:11.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.803+0000 7f3e47ff2640 1 --2- 172.21.15.17:0/2399284690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e40107900 0x7f3e40107ce0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c009880 tx=0x7f3e3c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.803+0000 7f3e47ff2640 1 -- 172.21.15.17:0/2399284690 shutdown_connections 2024-09-20T18:45:11.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.803+0000 7f3e47ff2640 1 --2- 172.21.15.17:0/2399284690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e40101900 0x7f3e40101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.803+0000 7f3e47ff2640 1 --2- 172.21.15.17:0/2399284690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e40107900 0x7f3e40107ce0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.803+0000 7f3e47ff2640 1 -- 172.21.15.17:0/2399284690 >> 172.21.15.17:0/2399284690 conn(0x7f3e400fd600 msgr2=0x7f3e400ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:11.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.803+0000 7f3e47ff2640 1 -- 172.21.15.17:0/2399284690 shutdown_connections 2024-09-20T18:45:11.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.803+0000 7f3e47ff2640 1 -- 172.21.15.17:0/2399284690 wait complete. 2024-09-20T18:45:11.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.804+0000 7f3e47ff2640 1 Processor -- start 2024-09-20T18:45:11.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.804+0000 7f3e47ff2640 1 -- start start 2024-09-20T18:45:11.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.804+0000 7f3e47ff2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e40101900 0x7f3e4019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:11.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.804+0000 7f3e47ff2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e40107900 0x7f3e4019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:11.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.804+0000 7f3e47ff2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4010edb0 con 0x7f3e40101900 2024-09-20T18:45:11.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.804+0000 7f3e47ff2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4010ec30 con 0x7f3e40107900 2024-09-20T18:45:11.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.804+0000 7f3e45d8e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e40101900 0x7f3e4019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:11.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.804+0000 7f3e45d8e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e40101900 0x7f3e4019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51238/0 (socket says 172.21.15.17:51238) 2024-09-20T18:45:11.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.804+0000 7f3e45d8e640 1 -- 172.21.15.17:0/3584165668 learned_addr learned my addr 172.21.15.17:0/3584165668 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:45:11.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.805+0000 7f3e45d8e640 1 -- 172.21.15.17:0/3584165668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e40107900 msgr2=0x7f3e4019dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:11.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.805+0000 7f3e45d8e640 1 --2- 172.21.15.17:0/3584165668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e40107900 0x7f3e4019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:11.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.805+0000 7f3e45d8e640 1 -- 172.21.15.17:0/3584165668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e401977e0 con 0x7f3e40101900 2024-09-20T18:45:11.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.805+0000 7f3e45d8e640 1 --2- 172.21.15.17:0/3584165668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e40101900 0x7f3e4019d660 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c031460 tx=0x7f3e3c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:11.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.805+0000 7f3e36ffd640 1 -- 172.21.15.17:0/3584165668 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e3c03f070 con 0x7f3e40101900 2024-09-20T18:45:11.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.805+0000 7f3e36ffd640 1 -- 172.21.15.17:0/3584165668 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e3c004cf0 con 0x7f3e40101900 2024-09-20T18:45:11.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.805+0000 7f3e47ff2640 1 -- 172.21.15.17:0/3584165668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e40197a70 con 0x7f3e40101900 2024-09-20T18:45:11.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.805+0000 7f3e36ffd640 1 -- 172.21.15.17:0/3584165668 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e3c035030 con 0x7f3e40101900 2024-09-20T18:45:11.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.805+0000 7f3e47ff2640 1 -- 172.21.15.17:0/3584165668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e40197fa0 con 0x7f3e40101900 2024-09-20T18:45:11.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.806+0000 7f3e47ff2640 1 -- 172.21.15.17:0/3584165668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e40103040 con 0x7f3e40101900 2024-09-20T18:45:11.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.807+0000 7f3e36ffd640 1 -- 172.21.15.17:0/3584165668 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3e3c042070 con 0x7f3e40101900 2024-09-20T18:45:11.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.807+0000 7f3e36ffd640 1 --2- 172.21.15.17:0/3584165668 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3e2c07af30 0x7f3e2c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:11.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.808+0000 7f3e36ffd640 1 -- 172.21.15.17:0/3584165668 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f3e3c0beac0 con 0x7f3e40101900 2024-09-20T18:45:11.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.808+0000 7f3e4558d640 1 --2- 172.21.15.17:0/3584165668 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3e2c07af30 0x7f3e2c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:11.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.808+0000 7f3e4558d640 1 --2- 172.21.15.17:0/3584165668 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3e2c07af30 0x7f3e2c07d3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3e40100d10 tx=0x7f3e30005bf0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:11.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:11.812+0000 7f3e36ffd640 1 -- 172.21.15.17:0/3584165668 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3e3c08a0c0 con 0x7f3e40101900 2024-09-20T18:45:12.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.017+0000 7f3e47ff2640 1 -- 172.21.15.17:0/3584165668 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3e40198310 con 0x7f3e2c07af30 2024-09-20T18:45:12.034 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:11 smithi017 ceph-mon[108970]: pgmap v293: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:12.034 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:11 smithi017 ceph-mon[108970]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:45:12.035 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:11 smithi017 ceph-mon[108970]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:45:12.035 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:11 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1714674396' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:45:12.035 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:11 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1484436940' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:45:12.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.019+0000 7f3e36ffd640 1 -- 172.21.15.17:0/3584165668 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f3e40198310 con 0x7f3e2c07af30 2024-09-20T18:45:12.036 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:45:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:45:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:45:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:45:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:45:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:45:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:45:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:45:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:45:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:45:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:45:12.036 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:45:12.037 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:45:12.037 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:45:12.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.021+0000 7f3e47ff2640 1 -- 172.21.15.17:0/3584165668 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3e2c07af30 msgr2=0x7f3e2c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:12.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.021+0000 7f3e47ff2640 1 --2- 172.21.15.17:0/3584165668 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3e2c07af30 0x7f3e2c07d3f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3e40100d10 tx=0x7f3e30005bf0 comp rx=0 tx=0).stop 2024-09-20T18:45:12.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.021+0000 7f3e47ff2640 1 -- 172.21.15.17:0/3584165668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e40101900 msgr2=0x7f3e4019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:12.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.021+0000 7f3e47ff2640 1 --2- 172.21.15.17:0/3584165668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e40101900 0x7f3e4019d660 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c031460 tx=0x7f3e3c0048f0 comp rx=0 tx=0).stop 2024-09-20T18:45:12.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.021+0000 7f3e47ff2640 1 -- 172.21.15.17:0/3584165668 shutdown_connections 2024-09-20T18:45:12.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.021+0000 7f3e47ff2640 1 --2- 172.21.15.17:0/3584165668 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3e2c07af30 0x7f3e2c07d3f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:12.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.021+0000 7f3e47ff2640 1 --2- 172.21.15.17:0/3584165668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e40107900 0x7f3e4019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:12.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.021+0000 7f3e47ff2640 1 --2- 172.21.15.17:0/3584165668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e40101900 0x7f3e4019d660 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:12.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.021+0000 7f3e47ff2640 1 -- 172.21.15.17:0/3584165668 >> 172.21.15.17:0/3584165668 conn(0x7f3e400fd600 msgr2=0x7f3e400fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:12.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.021+0000 7f3e47ff2640 1 -- 172.21.15.17:0/3584165668 shutdown_connections 2024-09-20T18:45:12.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.021+0000 7f3e47ff2640 1 -- 172.21.15.17:0/3584165668 wait complete. 2024-09-20T18:45:12.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.106+0000 7fa9b480c640 1 -- 172.21.15.17:0/738624327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9b0102ab0 msgr2=0x7fa9b0102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:12.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.106+0000 7fa9b480c640 1 --2- 172.21.15.17:0/738624327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9b0102ab0 0x7fa9b0102e90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009c20 tx=0x7fa9a802aa00 comp rx=0 tx=0).stop 2024-09-20T18:45:12.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.106+0000 7fa9b480c640 1 -- 172.21.15.17:0/738624327 shutdown_connections 2024-09-20T18:45:12.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.106+0000 7fa9b480c640 1 --2- 172.21.15.17:0/738624327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b01033d0 0x7fa9b010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:12.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.106+0000 7fa9b480c640 1 --2- 172.21.15.17:0/738624327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9b0102ab0 0x7fa9b0102e90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:12.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.106+0000 7fa9b480c640 1 -- 172.21.15.17:0/738624327 >> 172.21.15.17:0/738624327 conn(0x7fa9b00fc550 msgr2=0x7fa9b00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:12.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.106+0000 7fa9b480c640 1 -- 172.21.15.17:0/738624327 shutdown_connections 2024-09-20T18:45:12.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.106+0000 7fa9b480c640 1 -- 172.21.15.17:0/738624327 wait complete. 2024-09-20T18:45:12.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.107+0000 7fa9b480c640 1 Processor -- start 2024-09-20T18:45:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.107+0000 7fa9b480c640 1 -- start start 2024-09-20T18:45:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.107+0000 7fa9b480c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9b0102ab0 0x7fa9b019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.107+0000 7fa9b480c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b01033d0 0x7fa9b019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.107+0000 7fa9b480c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b010ede0 con 0x7fa9b0102ab0 2024-09-20T18:45:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.107+0000 7fa9b480c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b010ec60 con 0x7fa9b01033d0 2024-09-20T18:45:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.107+0000 7fa9ae59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9b0102ab0 0x7fa9b019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.107+0000 7fa9ae59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9b0102ab0 0x7fa9b019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51266/0 (socket says 172.21.15.17:51266) 2024-09-20T18:45:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.107+0000 7fa9ae59c640 1 -- 172.21.15.17:0/1682503373 learned_addr learned my addr 172.21.15.17:0/1682503373 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:45:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.107+0000 7fa9add9b640 1 --2- 172.21.15.17:0/1682503373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b01033d0 0x7fa9b019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.107+0000 7fa9ae59c640 1 -- 172.21.15.17:0/1682503373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b01033d0 msgr2=0x7fa9b019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.107+0000 7fa9ae59c640 1 --2- 172.21.15.17:0/1682503373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b01033d0 0x7fa9b019db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.108+0000 7fa9ae59c640 1 -- 172.21.15.17:0/1682503373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b01977b0 con 0x7fa9b0102ab0 2024-09-20T18:45:12.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.108+0000 7fa9add9b640 1 --2- 172.21.15.17:0/1682503373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b01033d0 0x7fa9b019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:45:12.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.108+0000 7fa9ae59c640 1 --2- 172.21.15.17:0/1682503373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9b0102ab0 0x7fa9b019d630 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa9a802af20 tx=0x7fa9a802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:12.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.108+0000 7fa9a77fe640 1 -- 172.21.15.17:0/1682503373 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa9a8047070 con 0x7fa9b0102ab0 2024-09-20T18:45:12.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.108+0000 7fa9b480c640 1 -- 172.21.15.17:0/1682503373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b0197a40 con 0x7fa9b0102ab0 2024-09-20T18:45:12.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.108+0000 7fa9a77fe640 1 -- 172.21.15.17:0/1682503373 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa9a8003e30 con 0x7fa9b0102ab0 2024-09-20T18:45:12.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.108+0000 7fa9a77fe640 1 -- 172.21.15.17:0/1682503373 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa9a8033050 con 0x7fa9b0102ab0 2024-09-20T18:45:12.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.108+0000 7fa9b480c640 1 -- 172.21.15.17:0/1682503373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b0197f70 con 0x7fa9b0102ab0 2024-09-20T18:45:12.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.109+0000 7fa9b480c640 1 -- 172.21.15.17:0/1682503373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9b006a580 con 0x7fa9b0102ab0 2024-09-20T18:45:12.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.110+0000 7fa9a77fe640 1 -- 172.21.15.17:0/1682503373 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa9a804a070 con 0x7fa9b0102ab0 2024-09-20T18:45:12.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.110+0000 7fa9a77fe640 1 --2- 172.21.15.17:0/1682503373 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa99c07af40 0x7fa99c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:12.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.110+0000 7fa9a77fe640 1 -- 172.21.15.17:0/1682503373 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fa9a803e030 con 0x7fa9b0102ab0 2024-09-20T18:45:12.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.110+0000 7fa9add9b640 1 --2- 172.21.15.17:0/1682503373 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa99c07af40 0x7fa99c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:12.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.111+0000 7fa9add9b640 1 --2- 172.21.15.17:0/1682503373 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa99c07af40 0x7fa99c07d400 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa998005fd0 tx=0x7fa998005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:12.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.115+0000 7fa9a77fe640 1 -- 172.21.15.17:0/1682503373 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa9a808a6a0 con 0x7fa9b0102ab0 2024-09-20T18:45:12.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:11 smithi172 ceph-mon[80431]: pgmap v293: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:12.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:11 smithi172 ceph-mon[80431]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:45:12.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:11 smithi172 ceph-mon[80431]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:45:12.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:11 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1714674396' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:45:12.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:11 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1484436940' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:45:12.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.382+0000 7fa9b480c640 1 -- 172.21.15.17:0/1682503373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fa9b01982e0 con 0x7fa9b0102ab0 2024-09-20T18:45:12.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.382+0000 7fa9a77fe640 1 -- 172.21.15.17:0/1682503373 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fa9a808f550 con 0x7fa9b0102ab0 2024-09-20T18:45:12.400 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:45:12.400 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:45:12.400 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:45:12.400 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:45:12.400 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:45:12.400 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:45:12.400 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:45:12.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.385+0000 7fa9b480c640 1 -- 172.21.15.17:0/1682503373 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa99c07af40 msgr2=0x7fa99c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:12.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.385+0000 7fa9b480c640 1 --2- 172.21.15.17:0/1682503373 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa99c07af40 0x7fa99c07d400 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa998005fd0 tx=0x7fa998005850 comp rx=0 tx=0).stop 2024-09-20T18:45:12.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.385+0000 7fa9b480c640 1 -- 172.21.15.17:0/1682503373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9b0102ab0 msgr2=0x7fa9b019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:12.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.385+0000 7fa9b480c640 1 --2- 172.21.15.17:0/1682503373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9b0102ab0 0x7fa9b019d630 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa9a802af20 tx=0x7fa9a802ee60 comp rx=0 tx=0).stop 2024-09-20T18:45:12.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.385+0000 7fa9b480c640 1 -- 172.21.15.17:0/1682503373 shutdown_connections 2024-09-20T18:45:12.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.385+0000 7fa9b480c640 1 --2- 172.21.15.17:0/1682503373 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa99c07af40 0x7fa99c07d400 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:12.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.385+0000 7fa9b480c640 1 --2- 172.21.15.17:0/1682503373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b01033d0 0x7fa9b019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:12.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.385+0000 7fa9b480c640 1 --2- 172.21.15.17:0/1682503373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9b0102ab0 0x7fa9b019d630 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:12.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.385+0000 7fa9b480c640 1 -- 172.21.15.17:0/1682503373 >> 172.21.15.17:0/1682503373 conn(0x7fa9b00fc550 msgr2=0x7fa9b010aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:12.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.385+0000 7fa9b480c640 1 -- 172.21.15.17:0/1682503373 shutdown_connections 2024-09-20T18:45:12.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:12.385+0000 7fa9b480c640 1 -- 172.21.15.17:0/1682503373 wait complete. 2024-09-20T18:45:13.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:12 smithi017 ceph-mon[108970]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:45:13.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:12 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1682503373' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:45:13.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:12 smithi172 ceph-mon[80431]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:45:13.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:12 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1682503373' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:45:13.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:13 smithi017 ceph-mon[108970]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:45:13.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:13 smithi017 ceph-mon[108970]: pgmap v294: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:14.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:13 smithi172 ceph-mon[80431]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:45:14.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:13 smithi172 ceph-mon[80431]: pgmap v294: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:16.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:15 smithi017 ceph-mon[108970]: pgmap v295: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:16.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:15 smithi172 ceph-mon[80431]: pgmap v295: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:18.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:17 smithi017 ceph-mon[108970]: pgmap v296: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:18.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:17 smithi172 ceph-mon[80431]: pgmap v296: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:19.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:19 smithi017 ceph-mon[108970]: pgmap v297: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:20.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:19 smithi172 ceph-mon[80431]: pgmap v297: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:22.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:21 smithi017 ceph-mon[108970]: pgmap v298: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:22.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:21 smithi172 ceph-mon[80431]: pgmap v298: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:22.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:45:22.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:45:24.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:23 smithi017 ceph-mon[108970]: pgmap v299: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:24.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:23 smithi172 ceph-mon[80431]: pgmap v299: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:25.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:24 smithi017 ceph-mon[108970]: pgmap v300: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:25.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:24 smithi172 ceph-mon[80431]: pgmap v300: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:27.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:27 smithi172 ceph-mon[80431]: pgmap v301: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:27.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:27 smithi017 ceph-mon[108970]: pgmap v301: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:29.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:29 smithi172 ceph-mon[80431]: pgmap v302: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:29.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:29 smithi017 ceph-mon[108970]: pgmap v302: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:31.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:31 smithi172 ceph-mon[80431]: pgmap v303: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:31.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:31 smithi017 ceph-mon[108970]: pgmap v303: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:33.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:33 smithi172 ceph-mon[80431]: pgmap v304: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:33.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:33 smithi017 ceph-mon[108970]: pgmap v304: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:35.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:35 smithi172 ceph-mon[80431]: pgmap v305: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:35.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:35 smithi017 ceph-mon[108970]: pgmap v305: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:37.847 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:37 smithi172 ceph-mon[80431]: pgmap v306: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:37.847 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:45:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:37 smithi017 ceph-mon[108970]: pgmap v306: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:45:39.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:39 smithi017 ceph-mon[108970]: pgmap v307: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:39.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:39 smithi172 ceph-mon[80431]: pgmap v307: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:41.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:41 smithi017 ceph-mon[108970]: pgmap v308: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:41.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:41 smithi172 ceph-mon[80431]: pgmap v308: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:42.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.486+0000 7f35e9ae7640 1 -- 172.21.15.17:0/3858299521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e41067f0 msgr2=0x7f35e4106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:42.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.486+0000 7f35e9ae7640 1 --2- 172.21.15.17:0/3858299521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e41067f0 0x7f35e4106bd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009880 tx=0x7f35d402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:45:42.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.486+0000 7f35e9ae7640 1 -- 172.21.15.17:0/3858299521 shutdown_connections 2024-09-20T18:45:42.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.486+0000 7f35e9ae7640 1 --2- 172.21.15.17:0/3858299521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35e41007f0 0x7f35e4100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:42.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.486+0000 7f35e9ae7640 1 --2- 172.21.15.17:0/3858299521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e41067f0 0x7f35e4106bd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:42.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.486+0000 7f35e9ae7640 1 -- 172.21.15.17:0/3858299521 >> 172.21.15.17:0/3858299521 conn(0x7f35e40fc550 msgr2=0x7f35e40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:42.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.486+0000 7f35e9ae7640 1 -- 172.21.15.17:0/3858299521 shutdown_connections 2024-09-20T18:45:42.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.486+0000 7f35e9ae7640 1 -- 172.21.15.17:0/3858299521 wait complete. 2024-09-20T18:45:42.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.487+0000 7f35e9ae7640 1 Processor -- start 2024-09-20T18:45:42.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.487+0000 7f35e9ae7640 1 -- start start 2024-09-20T18:45:42.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.487+0000 7f35e9ae7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e41007f0 0x7f35e4107720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:42.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.487+0000 7f35e9ae7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35e41067f0 0x7f35e4107c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:42.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.487+0000 7f35e9ae7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f35e410dca0 con 0x7f35e41007f0 2024-09-20T18:45:42.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.487+0000 7f35e9ae7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f35e410db20 con 0x7f35e41067f0 2024-09-20T18:45:42.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.487+0000 7f35e37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e41007f0 0x7f35e4107720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:42.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.487+0000 7f35e37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e41007f0 0x7f35e4107720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52866/0 (socket says 172.21.15.17:52866) 2024-09-20T18:45:42.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.487+0000 7f35e37fe640 1 -- 172.21.15.17:0/3436966447 learned_addr learned my addr 172.21.15.17:0/3436966447 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:45:42.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.488+0000 7f35e2ffd640 1 --2- 172.21.15.17:0/3436966447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35e41067f0 0x7f35e4107c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:42.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.488+0000 7f35e37fe640 1 -- 172.21.15.17:0/3436966447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35e41067f0 msgr2=0x7f35e4107c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:42.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.488+0000 7f35e37fe640 1 --2- 172.21.15.17:0/3436966447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35e41067f0 0x7f35e4107c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:42.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.488+0000 7f35e37fe640 1 -- 172.21.15.17:0/3436966447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e41081a0 con 0x7f35e41007f0 2024-09-20T18:45:42.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.488+0000 7f35e37fe640 1 --2- 172.21.15.17:0/3436966447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e41007f0 0x7f35e4107720 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f35d4031460 tx=0x7f35d40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:42.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.488+0000 7f35e0ff9640 1 -- 172.21.15.17:0/3436966447 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f35d403f070 con 0x7f35e41007f0 2024-09-20T18:45:42.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.488+0000 7f35e0ff9640 1 -- 172.21.15.17:0/3436966447 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f35d40035f0 con 0x7f35e41007f0 2024-09-20T18:45:42.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.488+0000 7f35e9ae7640 1 -- 172.21.15.17:0/3436966447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e4108430 con 0x7f35e41007f0 2024-09-20T18:45:42.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.488+0000 7f35e0ff9640 1 -- 172.21.15.17:0/3436966447 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f35d4035030 con 0x7f35e41007f0 2024-09-20T18:45:42.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.488+0000 7f35e9ae7640 1 -- 172.21.15.17:0/3436966447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e41a3d10 con 0x7f35e41007f0 2024-09-20T18:45:42.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.489+0000 7f35e9ae7640 1 -- 172.21.15.17:0/3436966447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e4101f30 con 0x7f35e41007f0 2024-09-20T18:45:42.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.490+0000 7f35e0ff9640 1 -- 172.21.15.17:0/3436966447 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f35d4042070 con 0x7f35e41007f0 2024-09-20T18:45:42.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.491+0000 7f35e0ff9640 1 --2- 172.21.15.17:0/3436966447 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f35cc07af80 0x7f35cc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:42.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.491+0000 7f35e0ff9640 1 -- 172.21.15.17:0/3436966447 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f35d40be910 con 0x7f35e41007f0 2024-09-20T18:45:42.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.491+0000 7f35e2ffd640 1 --2- 172.21.15.17:0/3436966447 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f35cc07af80 0x7f35cc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:42.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.491+0000 7f35e2ffd640 1 --2- 172.21.15.17:0/3436966447 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f35cc07af80 0x7f35cc07d440 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f35e41091b0 tx=0x7f35d800b590 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:42.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.495+0000 7f35e0ff9640 1 -- 172.21.15.17:0/3436966447 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f35d4089f90 con 0x7f35e41007f0 2024-09-20T18:45:42.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.701+0000 7f35e9ae7640 1 -- 172.21.15.17:0/3436966447 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f35e406a520 con 0x7f35cc07af80 2024-09-20T18:45:42.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.702+0000 7f35e0ff9640 1 -- 172.21.15.17:0/3436966447 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f35e406a520 con 0x7f35cc07af80 2024-09-20T18:45:42.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.705+0000 7f35e9ae7640 1 -- 172.21.15.17:0/3436966447 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f35cc07af80 msgr2=0x7f35cc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:42.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.705+0000 7f35e9ae7640 1 --2- 172.21.15.17:0/3436966447 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f35cc07af80 0x7f35cc07d440 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f35e41091b0 tx=0x7f35d800b590 comp rx=0 tx=0).stop 2024-09-20T18:45:42.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.705+0000 7f35e9ae7640 1 -- 172.21.15.17:0/3436966447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e41007f0 msgr2=0x7f35e4107720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:42.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.705+0000 7f35e9ae7640 1 --2- 172.21.15.17:0/3436966447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e41007f0 0x7f35e4107720 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f35d4031460 tx=0x7f35d40045e0 comp rx=0 tx=0).stop 2024-09-20T18:45:42.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.705+0000 7f35e9ae7640 1 -- 172.21.15.17:0/3436966447 shutdown_connections 2024-09-20T18:45:42.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.705+0000 7f35e9ae7640 1 --2- 172.21.15.17:0/3436966447 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f35cc07af80 0x7f35cc07d440 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:42.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.705+0000 7f35e9ae7640 1 --2- 172.21.15.17:0/3436966447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35e41067f0 0x7f35e4107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:42.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.705+0000 7f35e9ae7640 1 --2- 172.21.15.17:0/3436966447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35e41007f0 0x7f35e4107720 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:42.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.705+0000 7f35e9ae7640 1 -- 172.21.15.17:0/3436966447 >> 172.21.15.17:0/3436966447 conn(0x7f35e40fc550 msgr2=0x7f35e4069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:42.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.705+0000 7f35e9ae7640 1 -- 172.21.15.17:0/3436966447 shutdown_connections 2024-09-20T18:45:42.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.705+0000 7f35e9ae7640 1 -- 172.21.15.17:0/3436966447 wait complete. 2024-09-20T18:45:42.730 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:45:42.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.791+0000 7f336a6ef640 1 -- 172.21.15.17:0/1571756861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3364107900 msgr2=0x7f3364107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:42.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.791+0000 7f336a6ef640 1 --2- 172.21.15.17:0/1571756861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3364107900 0x7f3364107ce0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3354009880 tx=0x7f335402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:45:42.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.791+0000 7f336a6ef640 1 -- 172.21.15.17:0/1571756861 shutdown_connections 2024-09-20T18:45:42.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.791+0000 7f336a6ef640 1 --2- 172.21.15.17:0/1571756861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3364101900 0x7f3364101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:42.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.791+0000 7f336a6ef640 1 --2- 172.21.15.17:0/1571756861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3364107900 0x7f3364107ce0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:42.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.791+0000 7f336a6ef640 1 -- 172.21.15.17:0/1571756861 >> 172.21.15.17:0/1571756861 conn(0x7f33640fd600 msgr2=0x7f33640ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:42.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.791+0000 7f336a6ef640 1 -- 172.21.15.17:0/1571756861 shutdown_connections 2024-09-20T18:45:42.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.791+0000 7f336a6ef640 1 -- 172.21.15.17:0/1571756861 wait complete. 2024-09-20T18:45:42.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.792+0000 7f336a6ef640 1 Processor -- start 2024-09-20T18:45:42.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.792+0000 7f336a6ef640 1 -- start start 2024-09-20T18:45:42.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.793+0000 7f336a6ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3364101900 0x7f336419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:42.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.793+0000 7f336a6ef640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3364107900 0x7f336419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:42.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.793+0000 7f336a6ef640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f336410edd0 con 0x7f3364101900 2024-09-20T18:45:42.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.793+0000 7f336a6ef640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f336410ec50 con 0x7f3364107900 2024-09-20T18:45:42.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.793+0000 7f3363fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3364101900 0x7f336419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:42.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.793+0000 7f3363fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3364101900 0x7f336419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52884/0 (socket says 172.21.15.17:52884) 2024-09-20T18:45:42.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.793+0000 7f3363fff640 1 -- 172.21.15.17:0/121333933 learned_addr learned my addr 172.21.15.17:0/121333933 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:45:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.793+0000 7f33637fe640 1 --2- 172.21.15.17:0/121333933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3364107900 0x7f336419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.793+0000 7f3363fff640 1 -- 172.21.15.17:0/121333933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3364107900 msgr2=0x7f336419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.793+0000 7f3363fff640 1 --2- 172.21.15.17:0/121333933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3364107900 0x7f336419db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.793+0000 7f3363fff640 1 -- 172.21.15.17:0/121333933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33641977c0 con 0x7f3364101900 2024-09-20T18:45:42.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.793+0000 7f3363fff640 1 --2- 172.21.15.17:0/121333933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3364101900 0x7f336419d640 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3354031460 tx=0x7f33540045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:42.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.794+0000 7f33617fa640 1 -- 172.21.15.17:0/121333933 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f335403f070 con 0x7f3364101900 2024-09-20T18:45:42.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.794+0000 7f33617fa640 1 -- 172.21.15.17:0/121333933 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f33540035f0 con 0x7f3364101900 2024-09-20T18:45:42.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.794+0000 7f336a6ef640 1 -- 172.21.15.17:0/121333933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3364197a50 con 0x7f3364101900 2024-09-20T18:45:42.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.794+0000 7f33617fa640 1 -- 172.21.15.17:0/121333933 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3354035030 con 0x7f3364101900 2024-09-20T18:45:42.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.794+0000 7f336a6ef640 1 -- 172.21.15.17:0/121333933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3364197f80 con 0x7f3364101900 2024-09-20T18:45:42.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.795+0000 7f336a6ef640 1 -- 172.21.15.17:0/121333933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3364103040 con 0x7f3364101900 2024-09-20T18:45:42.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.796+0000 7f33617fa640 1 -- 172.21.15.17:0/121333933 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3354042070 con 0x7f3364101900 2024-09-20T18:45:42.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.796+0000 7f33617fa640 1 --2- 172.21.15.17:0/121333933 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f334c07af80 0x7f334c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:42.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.797+0000 7f33637fe640 1 --2- 172.21.15.17:0/121333933 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f334c07af80 0x7f334c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:42.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.797+0000 7f33617fa640 1 -- 172.21.15.17:0/121333933 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f33540be860 con 0x7f3364101900 2024-09-20T18:45:42.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.797+0000 7f33637fe640 1 --2- 172.21.15.17:0/121333933 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f334c07af80 0x7f334c07d440 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f33640ffbf0 tx=0x7f335800b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:42.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:42.801+0000 7f33617fa640 1 -- 172.21.15.17:0/121333933 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3354089ee0 con 0x7f3364101900 2024-09-20T18:45:43.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.005+0000 7f336a6ef640 1 -- 172.21.15.17:0/121333933 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3364198230 con 0x7f334c07af80 2024-09-20T18:45:43.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.006+0000 7f33617fa640 1 -- 172.21.15.17:0/121333933 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f3364198230 con 0x7f334c07af80 2024-09-20T18:45:43.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.009+0000 7f336a6ef640 1 -- 172.21.15.17:0/121333933 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f334c07af80 msgr2=0x7f334c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:43.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.009+0000 7f336a6ef640 1 --2- 172.21.15.17:0/121333933 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f334c07af80 0x7f334c07d440 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f33640ffbf0 tx=0x7f335800b390 comp rx=0 tx=0).stop 2024-09-20T18:45:43.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.009+0000 7f336a6ef640 1 -- 172.21.15.17:0/121333933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3364101900 msgr2=0x7f336419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:43.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.009+0000 7f336a6ef640 1 --2- 172.21.15.17:0/121333933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3364101900 0x7f336419d640 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3354031460 tx=0x7f33540045e0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.009+0000 7f336a6ef640 1 -- 172.21.15.17:0/121333933 shutdown_connections 2024-09-20T18:45:43.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.009+0000 7f336a6ef640 1 --2- 172.21.15.17:0/121333933 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f334c07af80 0x7f334c07d440 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.009+0000 7f336a6ef640 1 --2- 172.21.15.17:0/121333933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3364107900 0x7f336419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.009+0000 7f336a6ef640 1 --2- 172.21.15.17:0/121333933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3364101900 0x7f336419d640 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.009+0000 7f336a6ef640 1 -- 172.21.15.17:0/121333933 >> 172.21.15.17:0/121333933 conn(0x7f33640fd600 msgr2=0x7f33640fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:43.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.009+0000 7f336a6ef640 1 -- 172.21.15.17:0/121333933 shutdown_connections 2024-09-20T18:45:43.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.009+0000 7f336a6ef640 1 -- 172.21.15.17:0/121333933 wait complete. 2024-09-20T18:45:43.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.093+0000 7f2f63e17640 1 -- 172.21.15.17:0/1871135880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107900 msgr2=0x7f2f5c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:43.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.093+0000 7f2f63e17640 1 --2- 172.21.15.17:0/1871135880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107900 0x7f2f5c107ce0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009880 tx=0x7f2f5002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.093+0000 7f2f63e17640 1 -- 172.21.15.17:0/1871135880 shutdown_connections 2024-09-20T18:45:43.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.093+0000 7f2f63e17640 1 --2- 172.21.15.17:0/1871135880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f5c101900 0x7f2f5c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.093+0000 7f2f63e17640 1 --2- 172.21.15.17:0/1871135880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107900 0x7f2f5c107ce0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.093+0000 7f2f63e17640 1 -- 172.21.15.17:0/1871135880 >> 172.21.15.17:0/1871135880 conn(0x7f2f5c0fd600 msgr2=0x7f2f5c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:43.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.093+0000 7f2f63e17640 1 -- 172.21.15.17:0/1871135880 shutdown_connections 2024-09-20T18:45:43.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.093+0000 7f2f63e17640 1 -- 172.21.15.17:0/1871135880 wait complete. 2024-09-20T18:45:43.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.094+0000 7f2f63e17640 1 Processor -- start 2024-09-20T18:45:43.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.094+0000 7f2f63e17640 1 -- start start 2024-09-20T18:45:43.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.094+0000 7f2f63e17640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f5c101900 0x7f2f5c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:43.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.094+0000 7f2f63e17640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107900 0x7f2f5c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:43.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.094+0000 7f2f63e17640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c10ee30 con 0x7f2f5c107900 2024-09-20T18:45:43.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.094+0000 7f2f63e17640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c10ecb0 con 0x7f2f5c101900 2024-09-20T18:45:43.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.094+0000 7f2f613b2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107900 0x7f2f5c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:43.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.094+0000 7f2f613b2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107900 0x7f2f5c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52904/0 (socket says 172.21.15.17:52904) 2024-09-20T18:45:43.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.094+0000 7f2f613b2640 1 -- 172.21.15.17:0/2076351239 learned_addr learned my addr 172.21.15.17:0/2076351239 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:45:43.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.095+0000 7f2f61bb3640 1 --2- 172.21.15.17:0/2076351239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f5c101900 0x7f2f5c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:43.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.095+0000 7f2f613b2640 1 -- 172.21.15.17:0/2076351239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f5c101900 msgr2=0x7f2f5c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:43.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.095+0000 7f2f613b2640 1 --2- 172.21.15.17:0/2076351239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f5c101900 0x7f2f5c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.095+0000 7f2f613b2640 1 -- 172.21.15.17:0/2076351239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c074f70 con 0x7f2f5c107900 2024-09-20T18:45:43.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.095+0000 7f2f613b2640 1 --2- 172.21.15.17:0/2076351239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107900 0x7f2f5c074a30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800b420 tx=0x7f2f5800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:43.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.095+0000 7f2f4effd640 1 -- 172.21.15.17:0/2076351239 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f58011630 con 0x7f2f5c107900 2024-09-20T18:45:43.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.095+0000 7f2f4effd640 1 -- 172.21.15.17:0/2076351239 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f58016070 con 0x7f2f5c107900 2024-09-20T18:45:43.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.095+0000 7f2f63e17640 1 -- 172.21.15.17:0/2076351239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c075260 con 0x7f2f5c107900 2024-09-20T18:45:43.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.095+0000 7f2f4effd640 1 -- 172.21.15.17:0/2076351239 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f58010d40 con 0x7f2f5c107900 2024-09-20T18:45:43.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.095+0000 7f2f63e17640 1 -- 172.21.15.17:0/2076351239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5c1a3ee0 con 0x7f2f5c107900 2024-09-20T18:45:43.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.096+0000 7f2f63e17640 1 -- 172.21.15.17:0/2076351239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5c103040 con 0x7f2f5c107900 2024-09-20T18:45:43.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.097+0000 7f2f4effd640 1 -- 172.21.15.17:0/2076351239 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2f5801b460 con 0x7f2f5c107900 2024-09-20T18:45:43.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.097+0000 7f2f4effd640 1 --2- 172.21.15.17:0/2076351239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2f4807af80 0x7f2f4807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:43.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.098+0000 7f2f4effd640 1 -- 172.21.15.17:0/2076351239 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f2f5809d6f0 con 0x7f2f5c107900 2024-09-20T18:45:43.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.098+0000 7f2f61bb3640 1 --2- 172.21.15.17:0/2076351239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2f4807af80 0x7f2f4807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:43.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.098+0000 7f2f61bb3640 1 --2- 172.21.15.17:0/2076351239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2f4807af80 0x7f2f4807d440 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2f500096c0 tx=0x7f2f50031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:43.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.102+0000 7f2f4effd640 1 -- 172.21.15.17:0/2076351239 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2f58021250 con 0x7f2f5c107900 2024-09-20T18:45:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.301+0000 7f2f63e17640 1 -- 172.21.15.17:0/2076351239 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2f5c062630 con 0x7f2f4807af80 2024-09-20T18:45:43.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.311+0000 7f2f4effd640 1 -- 172.21.15.17:0/2076351239 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f2f5c062630 con 0x7f2f4807af80 2024-09-20T18:45:43.327 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:45:43.327 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (7m) 78s ago 18m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:45:43.327 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (10m) 78s ago 18m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:45:43.327 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (9m) 63s ago 17m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:45:43.327 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (5m) 78s ago 18m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:45:43.327 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (5m) 63s ago 17m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:45:43.327 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (6m) 78s ago 17m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:45:43.327 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (99s) 78s ago 12m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:45:43.327 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (83s) 78s ago 12m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:45:43.328 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (12m) 63s ago 12m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:45:43.328 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (67s) 63s ago 12m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:45:43.328 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (9m) 78s ago 19m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:45:43.328 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (8m) 63s ago 17m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:45:43.328 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (5m) 78s ago 19m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:45:43.328 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (5m) 63s ago 17m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:45:43.328 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (7m) 78s ago 18m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:45:43.328 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (7m) 63s ago 17m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:45:43.328 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (4m) 78s ago 16m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:45:43.328 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (4m) 78s ago 15m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:45:43.328 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (3m) 78s ago 15m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:45:43.328 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (3m) 63s ago 14m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:45:43.328 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (2m) 63s ago 14m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:45:43.329 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (116s) 63s ago 13m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:45:43.329 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (7m) 78s ago 17m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:45:43.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.313+0000 7f2f63e17640 1 -- 172.21.15.17:0/2076351239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2f4807af80 msgr2=0x7f2f4807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:43.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.313+0000 7f2f63e17640 1 --2- 172.21.15.17:0/2076351239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2f4807af80 0x7f2f4807d440 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2f500096c0 tx=0x7f2f50031400 comp rx=0 tx=0).stop 2024-09-20T18:45:43.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.313+0000 7f2f63e17640 1 -- 172.21.15.17:0/2076351239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107900 msgr2=0x7f2f5c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:43.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.313+0000 7f2f63e17640 1 --2- 172.21.15.17:0/2076351239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107900 0x7f2f5c074a30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800b420 tx=0x7f2f5800b8e0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.313+0000 7f2f63e17640 1 -- 172.21.15.17:0/2076351239 shutdown_connections 2024-09-20T18:45:43.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.313+0000 7f2f63e17640 1 --2- 172.21.15.17:0/2076351239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2f4807af80 0x7f2f4807d440 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.313+0000 7f2f63e17640 1 --2- 172.21.15.17:0/2076351239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c107900 0x7f2f5c074a30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.313+0000 7f2f63e17640 1 --2- 172.21.15.17:0/2076351239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f5c101900 0x7f2f5c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.313+0000 7f2f63e17640 1 -- 172.21.15.17:0/2076351239 >> 172.21.15.17:0/2076351239 conn(0x7f2f5c0fd600 msgr2=0x7f2f5c0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:43.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.313+0000 7f2f63e17640 1 -- 172.21.15.17:0/2076351239 shutdown_connections 2024-09-20T18:45:43.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.313+0000 7f2f63e17640 1 -- 172.21.15.17:0/2076351239 wait complete. 2024-09-20T18:45:43.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.396+0000 7fc11513f640 1 -- 172.21.15.17:0/3013921556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1101033d0 msgr2=0x7fc11010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:43.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.396+0000 7fc11513f640 1 --2- 172.21.15.17:0/3013921556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1101033d0 0x7fc11010b8c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc104009880 tx=0x7fc10402a530 comp rx=0 tx=0).stop 2024-09-20T18:45:43.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.396+0000 7fc11513f640 1 -- 172.21.15.17:0/3013921556 shutdown_connections 2024-09-20T18:45:43.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.396+0000 7fc11513f640 1 --2- 172.21.15.17:0/3013921556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1101033d0 0x7fc11010b8c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.396+0000 7fc11513f640 1 --2- 172.21.15.17:0/3013921556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc110102ab0 0x7fc110102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.396+0000 7fc11513f640 1 -- 172.21.15.17:0/3013921556 >> 172.21.15.17:0/3013921556 conn(0x7fc1100fc550 msgr2=0x7fc1100fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:43.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.397+0000 7fc11513f640 1 -- 172.21.15.17:0/3013921556 shutdown_connections 2024-09-20T18:45:43.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.397+0000 7fc11513f640 1 -- 172.21.15.17:0/3013921556 wait complete. 2024-09-20T18:45:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.397+0000 7fc11513f640 1 Processor -- start 2024-09-20T18:45:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.397+0000 7fc11513f640 1 -- start start 2024-09-20T18:45:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.398+0000 7fc11513f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc110102ab0 0x7fc11019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.398+0000 7fc11513f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1101033d0 0x7fc11019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.398+0000 7fc11513f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc11010ede0 con 0x7fc1101033d0 2024-09-20T18:45:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.398+0000 7fc11513f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc11010ec60 con 0x7fc110102ab0 2024-09-20T18:45:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.398+0000 7fc10e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1101033d0 0x7fc11019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.398+0000 7fc10e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1101033d0 0x7fc11019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52922/0 (socket says 172.21.15.17:52922) 2024-09-20T18:45:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.398+0000 7fc10e59c640 1 -- 172.21.15.17:0/2524577301 learned_addr learned my addr 172.21.15.17:0/2524577301 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:45:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.398+0000 7fc10ed9d640 1 --2- 172.21.15.17:0/2524577301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc110102ab0 0x7fc11019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.398+0000 7fc10e59c640 1 -- 172.21.15.17:0/2524577301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc110102ab0 msgr2=0x7fc11019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.398+0000 7fc10e59c640 1 --2- 172.21.15.17:0/2524577301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc110102ab0 0x7fc11019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.398+0000 7fc10e59c640 1 -- 172.21.15.17:0/2524577301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc110197810 con 0x7fc1101033d0 2024-09-20T18:45:43.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.398+0000 7fc10e59c640 1 --2- 172.21.15.17:0/2524577301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1101033d0 0x7fc11019dbd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc104031460 tx=0x7fc1040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:43.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.398+0000 7fc0f7fff640 1 -- 172.21.15.17:0/2524577301 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc10403f070 con 0x7fc1101033d0 2024-09-20T18:45:43.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.399+0000 7fc11513f640 1 -- 172.21.15.17:0/2524577301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc110197aa0 con 0x7fc1101033d0 2024-09-20T18:45:43.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.399+0000 7fc0f7fff640 1 -- 172.21.15.17:0/2524577301 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc104004ac0 con 0x7fc1101033d0 2024-09-20T18:45:43.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.399+0000 7fc0f7fff640 1 -- 172.21.15.17:0/2524577301 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc104035030 con 0x7fc1101033d0 2024-09-20T18:45:43.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.399+0000 7fc11513f640 1 -- 172.21.15.17:0/2524577301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc110197fd0 con 0x7fc1101033d0 2024-09-20T18:45:43.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.400+0000 7fc11513f640 1 -- 172.21.15.17:0/2524577301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc11006a580 con 0x7fc1101033d0 2024-09-20T18:45:43.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.400+0000 7fc0f7fff640 1 -- 172.21.15.17:0/2524577301 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc104042070 con 0x7fc1101033d0 2024-09-20T18:45:43.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.401+0000 7fc0f7fff640 1 --2- 172.21.15.17:0/2524577301 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc0f807af30 0x7fc0f807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:43.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.401+0000 7fc10ed9d640 1 --2- 172.21.15.17:0/2524577301 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc0f807af30 0x7fc0f807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:43.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.401+0000 7fc0f7fff640 1 -- 172.21.15.17:0/2524577301 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fc1040bea60 con 0x7fc1101033d0 2024-09-20T18:45:43.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.401+0000 7fc10ed9d640 1 --2- 172.21.15.17:0/2524577301 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc0f807af30 0x7fc0f807d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc100005fd0 tx=0x7fc100005e20 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:43.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.405+0000 7fc0f7fff640 1 -- 172.21.15.17:0/2524577301 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc10408a060 con 0x7fc1101033d0 2024-09-20T18:45:43.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.671+0000 7fc11513f640 1 -- 172.21.15.17:0/2524577301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc110105f50 con 0x7fc1101033d0 2024-09-20T18:45:43.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:43 smithi017 ceph-mon[108970]: pgmap v309: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:43.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:43 smithi017 ceph-mon[108970]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:45:43.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.672+0000 7fc0f7fff640 1 -- 172.21.15.17:0/2524577301 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fc10408c580 con 0x7fc1101033d0 2024-09-20T18:45:43.689 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:45:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:45:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:45:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:45:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:45:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:45:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:45:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:45:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:45:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:45:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:45:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:45:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:45:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:45:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:45:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:45:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:45:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:45:43.690 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:45:43.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.674+0000 7fc11513f640 1 -- 172.21.15.17:0/2524577301 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc0f807af30 msgr2=0x7fc0f807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:43.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.674+0000 7fc11513f640 1 --2- 172.21.15.17:0/2524577301 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc0f807af30 0x7fc0f807d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc100005fd0 tx=0x7fc100005e20 comp rx=0 tx=0).stop 2024-09-20T18:45:43.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.674+0000 7fc11513f640 1 -- 172.21.15.17:0/2524577301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1101033d0 msgr2=0x7fc11019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:43.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.674+0000 7fc11513f640 1 --2- 172.21.15.17:0/2524577301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1101033d0 0x7fc11019dbd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc104031460 tx=0x7fc1040046c0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.674+0000 7fc11513f640 1 -- 172.21.15.17:0/2524577301 shutdown_connections 2024-09-20T18:45:43.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.674+0000 7fc11513f640 1 --2- 172.21.15.17:0/2524577301 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc0f807af30 0x7fc0f807d3f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.674+0000 7fc11513f640 1 --2- 172.21.15.17:0/2524577301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1101033d0 0x7fc11019dbd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.674+0000 7fc11513f640 1 --2- 172.21.15.17:0/2524577301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc110102ab0 0x7fc11019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.674+0000 7fc11513f640 1 -- 172.21.15.17:0/2524577301 >> 172.21.15.17:0/2524577301 conn(0x7fc1100fc550 msgr2=0x7fc110108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:43.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.674+0000 7fc11513f640 1 -- 172.21.15.17:0/2524577301 shutdown_connections 2024-09-20T18:45:43.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.674+0000 7fc11513f640 1 -- 172.21.15.17:0/2524577301 wait complete. 2024-09-20T18:45:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.759+0000 7fbaac215640 1 -- 172.21.15.17:0/3417780734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbaa4101900 msgr2=0x7fbaa4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.759+0000 7fbaac215640 1 --2- 172.21.15.17:0/3417780734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbaa4101900 0x7fbaa4101d60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba94009880 tx=0x7fba9402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.759+0000 7fbaac215640 1 -- 172.21.15.17:0/3417780734 shutdown_connections 2024-09-20T18:45:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.759+0000 7fbaac215640 1 --2- 172.21.15.17:0/3417780734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbaa4101900 0x7fbaa4101d60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.759+0000 7fbaac215640 1 --2- 172.21.15.17:0/3417780734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbaa4107900 0x7fbaa4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.759+0000 7fbaac215640 1 -- 172.21.15.17:0/3417780734 >> 172.21.15.17:0/3417780734 conn(0x7fbaa40fd600 msgr2=0x7fbaa40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.759+0000 7fbaac215640 1 -- 172.21.15.17:0/3417780734 shutdown_connections 2024-09-20T18:45:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.759+0000 7fbaac215640 1 -- 172.21.15.17:0/3417780734 wait complete. 2024-09-20T18:45:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.760+0000 7fbaac215640 1 Processor -- start 2024-09-20T18:45:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.760+0000 7fbaac215640 1 -- start start 2024-09-20T18:45:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.760+0000 7fbaac215640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbaa4101900 0x7fbaa40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.760+0000 7fbaac215640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbaa4107900 0x7fbaa4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.760+0000 7fbaac215640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa410edb0 con 0x7fbaa4107900 2024-09-20T18:45:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.760+0000 7fbaac215640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa410ec30 con 0x7fbaa4101900 2024-09-20T18:45:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.760+0000 7fbaa97b0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbaa4107900 0x7fbaa4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.760+0000 7fbaa97b0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbaa4107900 0x7fbaa4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52942/0 (socket says 172.21.15.17:52942) 2024-09-20T18:45:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.760+0000 7fbaa97b0640 1 -- 172.21.15.17:0/3519260323 learned_addr learned my addr 172.21.15.17:0/3519260323 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:45:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.760+0000 7fbaa9fb1640 1 --2- 172.21.15.17:0/3519260323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbaa4101900 0x7fbaa40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.761+0000 7fbaa97b0640 1 -- 172.21.15.17:0/3519260323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbaa4101900 msgr2=0x7fbaa40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.761+0000 7fbaa97b0640 1 --2- 172.21.15.17:0/3519260323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbaa4101900 0x7fbaa40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.761+0000 7fbaa97b0640 1 -- 172.21.15.17:0/3519260323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa4074f70 con 0x7fbaa4107900 2024-09-20T18:45:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.761+0000 7fbaa97b0640 1 --2- 172.21.15.17:0/3519260323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbaa4107900 0x7fbaa4074a30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fba94031460 tx=0x7fba940045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.761+0000 7fba9affd640 1 -- 172.21.15.17:0/3519260323 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba9403f070 con 0x7fbaa4107900 2024-09-20T18:45:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.761+0000 7fba9affd640 1 -- 172.21.15.17:0/3519260323 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba940035f0 con 0x7fbaa4107900 2024-09-20T18:45:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.761+0000 7fbaac215640 1 -- 172.21.15.17:0/3519260323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa4075200 con 0x7fbaa4107900 2024-09-20T18:45:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.761+0000 7fba9affd640 1 -- 172.21.15.17:0/3519260323 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba94035030 con 0x7fbaa4107900 2024-09-20T18:45:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.761+0000 7fbaac215640 1 -- 172.21.15.17:0/3519260323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa41a3dc0 con 0x7fbaa4107900 2024-09-20T18:45:43.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.762+0000 7fbaac215640 1 -- 172.21.15.17:0/3519260323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa4103040 con 0x7fbaa4107900 2024-09-20T18:45:43.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.763+0000 7fba9affd640 1 -- 172.21.15.17:0/3519260323 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fba94042070 con 0x7fbaa4107900 2024-09-20T18:45:43.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.763+0000 7fba9affd640 1 --2- 172.21.15.17:0/3519260323 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fba9007af30 0x7fba9007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:43.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.764+0000 7fba9affd640 1 -- 172.21.15.17:0/3519260323 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fba940be970 con 0x7fbaa4107900 2024-09-20T18:45:43.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.764+0000 7fbaa9fb1640 1 --2- 172.21.15.17:0/3519260323 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fba9007af30 0x7fba9007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:43.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.764+0000 7fbaa9fb1640 1 --2- 172.21.15.17:0/3519260323 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fba9007af30 0x7fba9007d3f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0005d00 tx=0x7fbaa000b410 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:43.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.768+0000 7fba9affd640 1 -- 172.21.15.17:0/3519260323 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fba940c0e20 con 0x7fbaa4107900 2024-09-20T18:45:43.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:43 smithi172 ceph-mon[80431]: pgmap v309: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:43.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:43 smithi172 ceph-mon[80431]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:45:44.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.995+0000 7fbaac215640 1 -- 172.21.15.17:0/3519260323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbaa4109e90 con 0x7fbaa4107900 2024-09-20T18:45:44.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.996+0000 7fba9affd640 1 -- 172.21.15.17:0/3519260323 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7fba94089f70 con 0x7fbaa4107900 2024-09-20T18:45:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:45:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:45:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:45:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:45:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:45:44.012 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:45:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:45:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:45:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:45:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:45:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:45:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:45:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:45:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:45:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:45:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:45:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:45:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:45:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:45:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:45:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:45:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:45:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:45:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:45:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:45:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:45:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:45:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:45:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:45:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:45:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:45:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:45:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:45:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:45:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:45:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:45:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:45:44.014 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:45:44.014 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:45:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:45:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:45:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:45:44.015 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:45:44.015 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:45:44.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.999+0000 7fbaac215640 1 -- 172.21.15.17:0/3519260323 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fba9007af30 msgr2=0x7fba9007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:44.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.999+0000 7fbaac215640 1 --2- 172.21.15.17:0/3519260323 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fba9007af30 0x7fba9007d3f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0005d00 tx=0x7fbaa000b410 comp rx=0 tx=0).stop 2024-09-20T18:45:44.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.999+0000 7fbaac215640 1 -- 172.21.15.17:0/3519260323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbaa4107900 msgr2=0x7fbaa4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:44.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.999+0000 7fbaac215640 1 --2- 172.21.15.17:0/3519260323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbaa4107900 0x7fbaa4074a30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fba94031460 tx=0x7fba940045e0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.999+0000 7fbaac215640 1 -- 172.21.15.17:0/3519260323 shutdown_connections 2024-09-20T18:45:44.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.999+0000 7fbaac215640 1 --2- 172.21.15.17:0/3519260323 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fba9007af30 0x7fba9007d3f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.999+0000 7fbaac215640 1 --2- 172.21.15.17:0/3519260323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbaa4107900 0x7fbaa4074a30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.999+0000 7fbaac215640 1 --2- 172.21.15.17:0/3519260323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbaa4101900 0x7fbaa40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.999+0000 7fbaac215640 1 -- 172.21.15.17:0/3519260323 >> 172.21.15.17:0/3519260323 conn(0x7fbaa40fd600 msgr2=0x7fbaa40fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:44.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.999+0000 7fbaac215640 1 -- 172.21.15.17:0/3519260323 shutdown_connections 2024-09-20T18:45:44.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:43.999+0000 7fbaac215640 1 -- 172.21.15.17:0/3519260323 wait complete. 2024-09-20T18:45:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.084+0000 7f602e710640 1 -- 172.21.15.17:0/2864446101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6028102ac0 msgr2=0x7f6028102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.084+0000 7f602e710640 1 --2- 172.21.15.17:0/2864446101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6028102ac0 0x7f6028102ea0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6018009880 tx=0x7f601802a530 comp rx=0 tx=0).stop 2024-09-20T18:45:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.084+0000 7f602e710640 1 -- 172.21.15.17:0/2864446101 shutdown_connections 2024-09-20T18:45:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.084+0000 7f602e710640 1 --2- 172.21.15.17:0/2864446101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60281033e0 0x7f602810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.084+0000 7f602e710640 1 --2- 172.21.15.17:0/2864446101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6028102ac0 0x7f6028102ea0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.085+0000 7f602e710640 1 -- 172.21.15.17:0/2864446101 >> 172.21.15.17:0/2864446101 conn(0x7f60280fc520 msgr2=0x7f60280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.085+0000 7f602e710640 1 -- 172.21.15.17:0/2864446101 shutdown_connections 2024-09-20T18:45:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.085+0000 7f602e710640 1 -- 172.21.15.17:0/2864446101 wait complete. 2024-09-20T18:45:44.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.085+0000 7f602e710640 1 Processor -- start 2024-09-20T18:45:44.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.085+0000 7f602e710640 1 -- start start 2024-09-20T18:45:44.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.086+0000 7f602e710640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6028102ac0 0x7f602819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:44.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.086+0000 7f602e710640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60281033e0 0x7f602819dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:44.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.086+0000 7f602e710640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f602810edd0 con 0x7f60281033e0 2024-09-20T18:45:44.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.086+0000 7f602e710640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f602810ec50 con 0x7f6028102ac0 2024-09-20T18:45:44.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.086+0000 7f60277fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60281033e0 0x7f602819dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:44.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.086+0000 7f60277fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60281033e0 0x7f602819dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52954/0 (socket says 172.21.15.17:52954) 2024-09-20T18:45:44.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.086+0000 7f60277fe640 1 -- 172.21.15.17:0/3318293978 learned_addr learned my addr 172.21.15.17:0/3318293978 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:45:44.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.086+0000 7f6027fff640 1 --2- 172.21.15.17:0/3318293978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6028102ac0 0x7f602819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:44.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.086+0000 7f60277fe640 1 -- 172.21.15.17:0/3318293978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6028102ac0 msgr2=0x7f602819d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:44.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.086+0000 7f60277fe640 1 --2- 172.21.15.17:0/3318293978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6028102ac0 0x7f602819d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.086+0000 7f60277fe640 1 -- 172.21.15.17:0/3318293978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602819e310 con 0x7f60281033e0 2024-09-20T18:45:44.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.086+0000 7f6027fff640 1 --2- 172.21.15.17:0/3318293978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6028102ac0 0x7f602819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:45:44.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.086+0000 7f60277fe640 1 --2- 172.21.15.17:0/3318293978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60281033e0 0x7f602819dc60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f601c00c8f0 tx=0x7f601c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:44.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.087+0000 7f60257fa640 1 -- 172.21.15.17:0/3318293978 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f601c0079b0 con 0x7f60281033e0 2024-09-20T18:45:44.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.087+0000 7f60257fa640 1 -- 172.21.15.17:0/3318293978 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f601c007b50 con 0x7f60281033e0 2024-09-20T18:45:44.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.087+0000 7f60257fa640 1 -- 172.21.15.17:0/3318293978 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f601c018610 con 0x7f60281033e0 2024-09-20T18:45:44.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.087+0000 7f602e710640 1 -- 172.21.15.17:0/3318293978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6028197a00 con 0x7f60281033e0 2024-09-20T18:45:44.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.087+0000 7f602e710640 1 -- 172.21.15.17:0/3318293978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6028197f60 con 0x7f60281033e0 2024-09-20T18:45:44.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.088+0000 7f602e710640 1 -- 172.21.15.17:0/3318293978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f602806aa90 con 0x7f60281033e0 2024-09-20T18:45:44.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.088+0000 7f60257fa640 1 -- 172.21.15.17:0/3318293978 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f601c007d00 con 0x7f60281033e0 2024-09-20T18:45:44.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.089+0000 7f60257fa640 1 --2- 172.21.15.17:0/3318293978 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f601007af80 0x7f601007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:44.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.089+0000 7f60257fa640 1 -- 172.21.15.17:0/3318293978 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f601c09e1a0 con 0x7f60281033e0 2024-09-20T18:45:44.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.089+0000 7f6027fff640 1 --2- 172.21.15.17:0/3318293978 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f601007af80 0x7f601007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:44.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.090+0000 7f6027fff640 1 --2- 172.21.15.17:0/3318293978 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f601007af80 0x7f601007d440 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6018000c00 tx=0x7f6018031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.094+0000 7f60257fa640 1 -- 172.21.15.17:0/3318293978 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f601c014030 con 0x7f60281033e0 2024-09-20T18:45:44.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.297+0000 7f602e710640 1 -- 172.21.15.17:0/3318293978 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6028198e80 con 0x7f601007af80 2024-09-20T18:45:44.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.299+0000 7f60257fa640 1 -- 172.21.15.17:0/3318293978 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f6028198e80 con 0x7f601007af80 2024-09-20T18:45:44.315 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:45:44.315 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:45:44.315 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:45:44.315 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:45:44.315 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:45:44.315 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:45:44.315 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:45:44.315 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:45:44.316 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:45:44.316 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:45:44.316 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:45:44.316 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:45:44.316 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:45:44.316 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:45:44.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.301+0000 7f602e710640 1 -- 172.21.15.17:0/3318293978 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f601007af80 msgr2=0x7f601007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:44.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.301+0000 7f602e710640 1 --2- 172.21.15.17:0/3318293978 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f601007af80 0x7f601007d440 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6018000c00 tx=0x7f6018031400 comp rx=0 tx=0).stop 2024-09-20T18:45:44.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.301+0000 7f602e710640 1 -- 172.21.15.17:0/3318293978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60281033e0 msgr2=0x7f602819dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:44.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.301+0000 7f602e710640 1 --2- 172.21.15.17:0/3318293978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60281033e0 0x7f602819dc60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f601c00c8f0 tx=0x7f601c00cdb0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.301+0000 7f602e710640 1 -- 172.21.15.17:0/3318293978 shutdown_connections 2024-09-20T18:45:44.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.301+0000 7f602e710640 1 --2- 172.21.15.17:0/3318293978 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f601007af80 0x7f601007d440 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.301+0000 7f602e710640 1 --2- 172.21.15.17:0/3318293978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60281033e0 0x7f602819dc60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.301+0000 7f602e710640 1 --2- 172.21.15.17:0/3318293978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6028102ac0 0x7f602819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.301+0000 7f602e710640 1 -- 172.21.15.17:0/3318293978 >> 172.21.15.17:0/3318293978 conn(0x7f60280fc520 msgr2=0x7f6028108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:44.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.301+0000 7f602e710640 1 -- 172.21.15.17:0/3318293978 shutdown_connections 2024-09-20T18:45:44.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.301+0000 7f602e710640 1 -- 172.21.15.17:0/3318293978 wait complete. 2024-09-20T18:45:44.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.385+0000 7fc2b5fa0640 1 -- 172.21.15.17:0/352389230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2b01066a0 msgr2=0x7fc2b0106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:44.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.385+0000 7fc2b5fa0640 1 --2- 172.21.15.17:0/352389230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2b01066a0 0x7fc2b0106a80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc298009880 tx=0x7fc29802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.385+0000 7fc2b5fa0640 1 -- 172.21.15.17:0/352389230 shutdown_connections 2024-09-20T18:45:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.385+0000 7fc2b5fa0640 1 --2- 172.21.15.17:0/352389230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b0100610 0x7fc2b0100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.385+0000 7fc2b5fa0640 1 --2- 172.21.15.17:0/352389230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2b01066a0 0x7fc2b0106a80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.385+0000 7fc2b5fa0640 1 -- 172.21.15.17:0/352389230 >> 172.21.15.17:0/352389230 conn(0x7fc2b00fc310 msgr2=0x7fc2b00fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.386+0000 7fc2b5fa0640 1 -- 172.21.15.17:0/352389230 shutdown_connections 2024-09-20T18:45:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.386+0000 7fc2b5fa0640 1 -- 172.21.15.17:0/352389230 wait complete. 2024-09-20T18:45:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.386+0000 7fc2b5fa0640 1 Processor -- start 2024-09-20T18:45:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.386+0000 7fc2b5fa0640 1 -- start start 2024-09-20T18:45:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.386+0000 7fc2b5fa0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2b0100610 0x7fc2b019f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.386+0000 7fc2b5fa0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b01066a0 0x7fc2b019fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.386+0000 7fc2b5fa0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b010dad0 con 0x7fc2b0100610 2024-09-20T18:45:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.386+0000 7fc2b5fa0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b010d950 con 0x7fc2b01066a0 2024-09-20T18:45:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.386+0000 7fc2b4f9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2b0100610 0x7fc2b019f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.387+0000 7fc2b4f9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2b0100610 0x7fc2b019f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52976/0 (socket says 172.21.15.17:52976) 2024-09-20T18:45:44.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.387+0000 7fc2b4f9e640 1 -- 172.21.15.17:0/1968392856 learned_addr learned my addr 172.21.15.17:0/1968392856 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:45:44.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.387+0000 7fc2affff640 1 --2- 172.21.15.17:0/1968392856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b01066a0 0x7fc2b019fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:44.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.387+0000 7fc2b4f9e640 1 -- 172.21.15.17:0/1968392856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b01066a0 msgr2=0x7fc2b019fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:44.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.387+0000 7fc2b4f9e640 1 --2- 172.21.15.17:0/1968392856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b01066a0 0x7fc2b019fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.387+0000 7fc2b4f9e640 1 -- 172.21.15.17:0/1968392856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b01997a0 con 0x7fc2b0100610 2024-09-20T18:45:44.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.387+0000 7fc2b4f9e640 1 --2- 172.21.15.17:0/1968392856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2b0100610 0x7fc2b019f620 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc298031460 tx=0x7fc2980045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:44.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.387+0000 7fc2adffb640 1 -- 172.21.15.17:0/1968392856 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc29803f070 con 0x7fc2b0100610 2024-09-20T18:45:44.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.387+0000 7fc2adffb640 1 -- 172.21.15.17:0/1968392856 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc2980035f0 con 0x7fc2b0100610 2024-09-20T18:45:44.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.387+0000 7fc2adffb640 1 -- 172.21.15.17:0/1968392856 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc298035030 con 0x7fc2b0100610 2024-09-20T18:45:44.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.387+0000 7fc2b5fa0640 1 -- 172.21.15.17:0/1968392856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b0199a30 con 0x7fc2b0100610 2024-09-20T18:45:44.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.388+0000 7fc2b5fa0640 1 -- 172.21.15.17:0/1968392856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b0199f60 con 0x7fc2b0100610 2024-09-20T18:45:44.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.388+0000 7fc2b5fa0640 1 -- 172.21.15.17:0/1968392856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2b0101d50 con 0x7fc2b0100610 2024-09-20T18:45:44.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.389+0000 7fc2adffb640 1 -- 172.21.15.17:0/1968392856 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc298042070 con 0x7fc2b0100610 2024-09-20T18:45:44.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.390+0000 7fc2adffb640 1 --2- 172.21.15.17:0/1968392856 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc29c07af80 0x7fc29c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:45:44.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.390+0000 7fc2adffb640 1 -- 172.21.15.17:0/1968392856 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fc2980bea20 con 0x7fc2b0100610 2024-09-20T18:45:44.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.390+0000 7fc2affff640 1 --2- 172.21.15.17:0/1968392856 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc29c07af80 0x7fc29c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:45:44.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.390+0000 7fc2affff640 1 --2- 172.21.15.17:0/1968392856 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc29c07af80 0x7fc29c07d440 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0005fd0 tx=0x7fc2a0005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:45:44.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.394+0000 7fc2adffb640 1 -- 172.21.15.17:0/1968392856 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc29808a000 con 0x7fc2b0100610 2024-09-20T18:45:44.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:44 smithi017 ceph-mon[108970]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:45:44.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:44 smithi017 ceph-mon[108970]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:45:44.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:44 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2524577301' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:45:44.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:44 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3519260323' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:45:44.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.657+0000 7fc2b5fa0640 1 -- 172.21.15.17:0/1968392856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fc2b019a210 con 0x7fc2b0100610 2024-09-20T18:45:44.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.658+0000 7fc2adffb640 1 -- 172.21.15.17:0/1968392856 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fc29808eeb0 con 0x7fc2b0100610 2024-09-20T18:45:44.674 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:45:44.674 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:45:44.674 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:45:44.674 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:45:44.674 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:45:44.674 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:45:44.675 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:45:44.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.660+0000 7fc2b5fa0640 1 -- 172.21.15.17:0/1968392856 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc29c07af80 msgr2=0x7fc29c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:44.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.660+0000 7fc2b5fa0640 1 --2- 172.21.15.17:0/1968392856 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc29c07af80 0x7fc29c07d440 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0005fd0 tx=0x7fc2a0005850 comp rx=0 tx=0).stop 2024-09-20T18:45:44.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.660+0000 7fc2b5fa0640 1 -- 172.21.15.17:0/1968392856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2b0100610 msgr2=0x7fc2b019f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:45:44.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.660+0000 7fc2b5fa0640 1 --2- 172.21.15.17:0/1968392856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2b0100610 0x7fc2b019f620 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc298031460 tx=0x7fc2980045e0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.660+0000 7fc2b5fa0640 1 -- 172.21.15.17:0/1968392856 shutdown_connections 2024-09-20T18:45:44.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.660+0000 7fc2b5fa0640 1 --2- 172.21.15.17:0/1968392856 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc29c07af80 0x7fc29c07d440 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.660+0000 7fc2b5fa0640 1 --2- 172.21.15.17:0/1968392856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b01066a0 0x7fc2b019fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.660+0000 7fc2b5fa0640 1 --2- 172.21.15.17:0/1968392856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2b0100610 0x7fc2b019f620 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:45:44.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.660+0000 7fc2b5fa0640 1 -- 172.21.15.17:0/1968392856 >> 172.21.15.17:0/1968392856 conn(0x7fc2b00fc310 msgr2=0x7fc2b0069d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:45:44.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.660+0000 7fc2b5fa0640 1 -- 172.21.15.17:0/1968392856 shutdown_connections 2024-09-20T18:45:44.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:45:44.660+0000 7fc2b5fa0640 1 -- 172.21.15.17:0/1968392856 wait complete. 2024-09-20T18:45:44.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:44 smithi172 ceph-mon[80431]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:45:44.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:44 smithi172 ceph-mon[80431]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:45:44.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:44 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2524577301' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:45:44.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:44 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3519260323' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:45:45.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:45 smithi017 ceph-mon[108970]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:45:45.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:45 smithi017 ceph-mon[108970]: pgmap v310: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:45.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:45 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1968392856' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:45:45.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:45 smithi172 ceph-mon[80431]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:45:45.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:45 smithi172 ceph-mon[80431]: pgmap v310: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:45.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:45 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1968392856' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:45:47.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:47 smithi017 ceph-mon[108970]: pgmap v311: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:47.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:47 smithi172 ceph-mon[80431]: pgmap v311: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:49.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:49 smithi017 ceph-mon[108970]: pgmap v312: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:49.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:49 smithi172 ceph-mon[80431]: pgmap v312: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:51.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:51 smithi017 ceph-mon[108970]: pgmap v313: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:51.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:51 smithi172 ceph-mon[80431]: pgmap v313: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:52.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:45:52.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:45:53.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:53 smithi017 ceph-mon[108970]: pgmap v314: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:53.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:53 smithi172 ceph-mon[80431]: pgmap v314: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:55.652 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:55 smithi017 ceph-mon[108970]: pgmap v315: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:55.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:55 smithi172 ceph-mon[80431]: pgmap v315: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:57.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:57 smithi017 ceph-mon[108970]: pgmap v316: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:57.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:57 smithi172 ceph-mon[80431]: pgmap v316: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:59.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:45:59 smithi017 ceph-mon[108970]: pgmap v317: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:45:59.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:45:59 smithi172 ceph-mon[80431]: pgmap v317: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:01.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:01 smithi017 ceph-mon[108970]: pgmap v318: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:01.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:01 smithi172 ceph-mon[80431]: pgmap v318: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:03.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:03 smithi017 ceph-mon[108970]: pgmap v319: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:03.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:03 smithi172 ceph-mon[80431]: pgmap v319: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:05.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:05 smithi017 ceph-mon[108970]: pgmap v320: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:05.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:05 smithi172 ceph-mon[80431]: pgmap v320: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:07.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:07 smithi017 ceph-mon[108970]: pgmap v321: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:07.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:46:07.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:07 smithi172 ceph-mon[80431]: pgmap v321: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:07.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:46:09.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:09 smithi017 ceph-mon[108970]: pgmap v322: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:09.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:09 smithi172 ceph-mon[80431]: pgmap v322: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:11.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:11 smithi017 ceph-mon[108970]: pgmap v323: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:11.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:11 smithi172 ceph-mon[80431]: pgmap v323: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:13.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:13 smithi172 ceph-mon[80431]: pgmap v324: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:13.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:13 smithi017 ceph-mon[108970]: pgmap v324: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:14.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.759+0000 7f38c8fb7640 1 -- 172.21.15.17:0/438768397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c4102ac0 msgr2=0x7f38c4102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:14.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.759+0000 7f38c8fb7640 1 --2- 172.21.15.17:0/438768397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c4102ac0 0x7f38c4102ea0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f38b4009880 tx=0x7f38b402a530 comp rx=0 tx=0).stop 2024-09-20T18:46:14.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.759+0000 7f38c8fb7640 1 -- 172.21.15.17:0/438768397 shutdown_connections 2024-09-20T18:46:14.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.759+0000 7f38c8fb7640 1 --2- 172.21.15.17:0/438768397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38c41033e0 0x7f38c410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:14.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.759+0000 7f38c8fb7640 1 --2- 172.21.15.17:0/438768397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c4102ac0 0x7f38c4102ea0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:14.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.759+0000 7f38c8fb7640 1 -- 172.21.15.17:0/438768397 >> 172.21.15.17:0/438768397 conn(0x7f38c40fc520 msgr2=0x7f38c40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:14.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.759+0000 7f38c8fb7640 1 -- 172.21.15.17:0/438768397 shutdown_connections 2024-09-20T18:46:14.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.759+0000 7f38c8fb7640 1 -- 172.21.15.17:0/438768397 wait complete. 2024-09-20T18:46:14.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.760+0000 7f38c8fb7640 1 Processor -- start 2024-09-20T18:46:14.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.760+0000 7f38c8fb7640 1 -- start start 2024-09-20T18:46:14.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.761+0000 7f38c8fb7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38c4102ac0 0x7f38c419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.761+0000 7f38c8fb7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c41033e0 0x7f38c419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.761+0000 7f38c8fb7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f38c410edf0 con 0x7f38c41033e0 2024-09-20T18:46:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.761+0000 7f38c8fb7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f38c410ec70 con 0x7f38c4102ac0 2024-09-20T18:46:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.761+0000 7f38c1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c41033e0 0x7f38c419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.761+0000 7f38c1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c41033e0 0x7f38c419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52350/0 (socket says 172.21.15.17:52350) 2024-09-20T18:46:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.761+0000 7f38c1d9b640 1 -- 172.21.15.17:0/346419315 learned_addr learned my addr 172.21.15.17:0/346419315 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:46:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.761+0000 7f38c259c640 1 --2- 172.21.15.17:0/346419315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38c4102ac0 0x7f38c419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.761+0000 7f38c1d9b640 1 -- 172.21.15.17:0/346419315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38c4102ac0 msgr2=0x7f38c419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.761+0000 7f38c1d9b640 1 --2- 172.21.15.17:0/346419315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38c4102ac0 0x7f38c419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.761+0000 7f38c1d9b640 1 -- 172.21.15.17:0/346419315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c4197800 con 0x7f38c41033e0 2024-09-20T18:46:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.761+0000 7f38c259c640 1 --2- 172.21.15.17:0/346419315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38c4102ac0 0x7f38c419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:46:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.761+0000 7f38c1d9b640 1 --2- 172.21.15.17:0/346419315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c41033e0 0x7f38c419dbc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00d6d0 tx=0x7f38ac00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.762+0000 7f38bb7fe640 1 -- 172.21.15.17:0/346419315 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f38ac017070 con 0x7f38c41033e0 2024-09-20T18:46:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.762+0000 7f38bb7fe640 1 -- 172.21.15.17:0/346419315 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f38ac0054e0 con 0x7f38c41033e0 2024-09-20T18:46:14.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.762+0000 7f38c8fb7640 1 -- 172.21.15.17:0/346419315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c4197af0 con 0x7f38c41033e0 2024-09-20T18:46:14.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.762+0000 7f38bb7fe640 1 -- 172.21.15.17:0/346419315 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f38ac004ae0 con 0x7f38c41033e0 2024-09-20T18:46:14.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.762+0000 7f38c8fb7640 1 -- 172.21.15.17:0/346419315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c4198080 con 0x7f38c41033e0 2024-09-20T18:46:14.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.763+0000 7f38c8fb7640 1 -- 172.21.15.17:0/346419315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c406aa90 con 0x7f38c41033e0 2024-09-20T18:46:14.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.764+0000 7f38bb7fe640 1 -- 172.21.15.17:0/346419315 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f38ac004de0 con 0x7f38c41033e0 2024-09-20T18:46:14.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.764+0000 7f38bb7fe640 1 --2- 172.21.15.17:0/346419315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f38b007af30 0x7f38b007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:14.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.764+0000 7f38c259c640 1 --2- 172.21.15.17:0/346419315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f38b007af30 0x7f38b007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:14.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.764+0000 7f38bb7fe640 1 -- 172.21.15.17:0/346419315 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f38ac09dbf0 con 0x7f38c41033e0 2024-09-20T18:46:14.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.765+0000 7f38c259c640 1 --2- 172.21.15.17:0/346419315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f38b007af30 0x7f38b007d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f38b4000c00 tx=0x7f38b4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:14.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.769+0000 7f38bb7fe640 1 -- 172.21.15.17:0/346419315 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f38ac0691f0 con 0x7f38c41033e0 2024-09-20T18:46:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.979+0000 7f38c8fb7640 1 -- 172.21.15.17:0/346419315 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f38c4198330 con 0x7f38b007af30 2024-09-20T18:46:14.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.980+0000 7f38bb7fe640 1 -- 172.21.15.17:0/346419315 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f38c4198330 con 0x7f38b007af30 2024-09-20T18:46:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.982+0000 7f38c8fb7640 1 -- 172.21.15.17:0/346419315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f38b007af30 msgr2=0x7f38b007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.982+0000 7f38c8fb7640 1 --2- 172.21.15.17:0/346419315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f38b007af30 0x7f38b007d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f38b4000c00 tx=0x7f38b4031400 comp rx=0 tx=0).stop 2024-09-20T18:46:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.982+0000 7f38c8fb7640 1 -- 172.21.15.17:0/346419315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c41033e0 msgr2=0x7f38c419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.982+0000 7f38c8fb7640 1 --2- 172.21.15.17:0/346419315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c41033e0 0x7f38c419dbc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00d6d0 tx=0x7f38ac00db90 comp rx=0 tx=0).stop 2024-09-20T18:46:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.982+0000 7f38c8fb7640 1 -- 172.21.15.17:0/346419315 shutdown_connections 2024-09-20T18:46:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.982+0000 7f38c8fb7640 1 --2- 172.21.15.17:0/346419315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f38b007af30 0x7f38b007d3f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.982+0000 7f38c8fb7640 1 --2- 172.21.15.17:0/346419315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c41033e0 0x7f38c419dbc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.982+0000 7f38c8fb7640 1 --2- 172.21.15.17:0/346419315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38c4102ac0 0x7f38c419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.982+0000 7f38c8fb7640 1 -- 172.21.15.17:0/346419315 >> 172.21.15.17:0/346419315 conn(0x7f38c40fc520 msgr2=0x7f38c4108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.982+0000 7f38c8fb7640 1 -- 172.21.15.17:0/346419315 shutdown_connections 2024-09-20T18:46:14.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:14.983+0000 7f38c8fb7640 1 -- 172.21.15.17:0/346419315 wait complete. 2024-09-20T18:46:15.008 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:46:15.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.069+0000 7f3ab57a1640 1 -- 172.21.15.17:0/41380339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0107900 msgr2=0x7f3ab0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:15.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.069+0000 7f3ab57a1640 1 --2- 172.21.15.17:0/41380339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0107900 0x7f3ab0107ce0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0009880 tx=0x7f3aa002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.069+0000 7f3ab57a1640 1 -- 172.21.15.17:0/41380339 shutdown_connections 2024-09-20T18:46:15.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.069+0000 7f3ab57a1640 1 --2- 172.21.15.17:0/41380339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ab0101900 0x7f3ab0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.069+0000 7f3ab57a1640 1 --2- 172.21.15.17:0/41380339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0107900 0x7f3ab0107ce0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.069+0000 7f3ab57a1640 1 -- 172.21.15.17:0/41380339 >> 172.21.15.17:0/41380339 conn(0x7f3ab00fd600 msgr2=0x7f3ab00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:15.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.069+0000 7f3ab57a1640 1 -- 172.21.15.17:0/41380339 shutdown_connections 2024-09-20T18:46:15.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.069+0000 7f3ab57a1640 1 -- 172.21.15.17:0/41380339 wait complete. 2024-09-20T18:46:15.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.070+0000 7f3ab57a1640 1 Processor -- start 2024-09-20T18:46:15.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.070+0000 7f3ab57a1640 1 -- start start 2024-09-20T18:46:15.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.070+0000 7f3ab57a1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ab0101900 0x7f3ab019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:15.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.070+0000 7f3ab57a1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0107900 0x7f3ab019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:15.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.070+0000 7f3ab57a1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab010edb0 con 0x7f3ab0107900 2024-09-20T18:46:15.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.070+0000 7f3ab57a1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab010ec30 con 0x7f3ab0101900 2024-09-20T18:46:15.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.070+0000 7f3aae7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0107900 0x7f3ab019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:15.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.071+0000 7f3aae7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0107900 0x7f3ab019dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52370/0 (socket says 172.21.15.17:52370) 2024-09-20T18:46:15.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.071+0000 7f3aae7fc640 1 -- 172.21.15.17:0/1726920861 learned_addr learned my addr 172.21.15.17:0/1726920861 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:46:15.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.071+0000 7f3aaeffd640 1 --2- 172.21.15.17:0/1726920861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ab0101900 0x7f3ab019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:15.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.071+0000 7f3aae7fc640 1 -- 172.21.15.17:0/1726920861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ab0101900 msgr2=0x7f3ab019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:15.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.071+0000 7f3aae7fc640 1 --2- 172.21.15.17:0/1726920861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ab0101900 0x7f3ab019d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.071+0000 7f3aae7fc640 1 -- 172.21.15.17:0/1726920861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab01977e0 con 0x7f3ab0107900 2024-09-20T18:46:15.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.071+0000 7f3aae7fc640 1 --2- 172.21.15.17:0/1726920861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0107900 0x7f3ab019dba0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400d8d0 tx=0x7f3aa400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:15.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.071+0000 7f3a97fff640 1 -- 172.21.15.17:0/1726920861 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3aa4017070 con 0x7f3ab0107900 2024-09-20T18:46:15.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.071+0000 7f3a97fff640 1 -- 172.21.15.17:0/1726920861 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3aa4010460 con 0x7f3ab0107900 2024-09-20T18:46:15.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.071+0000 7f3ab57a1640 1 -- 172.21.15.17:0/1726920861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab0197ad0 con 0x7f3ab0107900 2024-09-20T18:46:15.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.071+0000 7f3a97fff640 1 -- 172.21.15.17:0/1726920861 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3aa400f5f0 con 0x7f3ab0107900 2024-09-20T18:46:15.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.071+0000 7f3ab57a1640 1 -- 172.21.15.17:0/1726920861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab0198060 con 0x7f3ab0107900 2024-09-20T18:46:15.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.072+0000 7f3ab57a1640 1 -- 172.21.15.17:0/1726920861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ab0103040 con 0x7f3ab0107900 2024-09-20T18:46:15.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.073+0000 7f3a97fff640 1 -- 172.21.15.17:0/1726920861 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3aa4009a30 con 0x7f3ab0107900 2024-09-20T18:46:15.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.074+0000 7f3a97fff640 1 --2- 172.21.15.17:0/1726920861 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a9807af90 0x7f3a9807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:15.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.074+0000 7f3a97fff640 1 -- 172.21.15.17:0/1726920861 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f3aa409de00 con 0x7f3ab0107900 2024-09-20T18:46:15.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.074+0000 7f3aaeffd640 1 --2- 172.21.15.17:0/1726920861 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a9807af90 0x7f3a9807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:15.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.074+0000 7f3aaeffd640 1 --2- 172.21.15.17:0/1726920861 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a9807af90 0x7f3a9807d450 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00096c0 tx=0x7f3aa0031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:15.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.078+0000 7f3a97fff640 1 -- 172.21.15.17:0/1726920861 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3aa40693e0 con 0x7f3ab0107900 2024-09-20T18:46:15.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.283+0000 7f3ab57a1640 1 -- 172.21.15.17:0/1726920861 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3ab01983d0 con 0x7f3a9807af90 2024-09-20T18:46:15.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.284+0000 7f3a97fff640 1 -- 172.21.15.17:0/1726920861 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f3ab01983d0 con 0x7f3a9807af90 2024-09-20T18:46:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.286+0000 7f3ab57a1640 1 -- 172.21.15.17:0/1726920861 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a9807af90 msgr2=0x7f3a9807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.286+0000 7f3ab57a1640 1 --2- 172.21.15.17:0/1726920861 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a9807af90 0x7f3a9807d450 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00096c0 tx=0x7f3aa0031400 comp rx=0 tx=0).stop 2024-09-20T18:46:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.286+0000 7f3ab57a1640 1 -- 172.21.15.17:0/1726920861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0107900 msgr2=0x7f3ab019dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.286+0000 7f3ab57a1640 1 --2- 172.21.15.17:0/1726920861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0107900 0x7f3ab019dba0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400d8d0 tx=0x7f3aa400dd90 comp rx=0 tx=0).stop 2024-09-20T18:46:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.286+0000 7f3ab57a1640 1 -- 172.21.15.17:0/1726920861 shutdown_connections 2024-09-20T18:46:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.286+0000 7f3ab57a1640 1 --2- 172.21.15.17:0/1726920861 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a9807af90 0x7f3a9807d450 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.286+0000 7f3ab57a1640 1 --2- 172.21.15.17:0/1726920861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0107900 0x7f3ab019dba0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.286+0000 7f3ab57a1640 1 --2- 172.21.15.17:0/1726920861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ab0101900 0x7f3ab019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.286+0000 7f3ab57a1640 1 -- 172.21.15.17:0/1726920861 >> 172.21.15.17:0/1726920861 conn(0x7f3ab00fd600 msgr2=0x7f3ab00fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.287+0000 7f3ab57a1640 1 -- 172.21.15.17:0/1726920861 shutdown_connections 2024-09-20T18:46:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.287+0000 7f3ab57a1640 1 -- 172.21.15.17:0/1726920861 wait complete. 2024-09-20T18:46:15.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.371+0000 7f36e941b640 1 -- 172.21.15.17:0/2629464327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e4101900 msgr2=0x7f36e4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:15.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.371+0000 7f36e941b640 1 --2- 172.21.15.17:0/2629464327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e4101900 0x7f36e4101d60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f36cc009880 tx=0x7f36cc02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.371+0000 7f36e941b640 1 -- 172.21.15.17:0/2629464327 shutdown_connections 2024-09-20T18:46:15.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.371+0000 7f36e941b640 1 --2- 172.21.15.17:0/2629464327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e4101900 0x7f36e4101d60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.371+0000 7f36e941b640 1 --2- 172.21.15.17:0/2629464327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e4107900 0x7f36e4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.371+0000 7f36e941b640 1 -- 172.21.15.17:0/2629464327 >> 172.21.15.17:0/2629464327 conn(0x7f36e40fd600 msgr2=0x7f36e40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:15.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.371+0000 7f36e941b640 1 -- 172.21.15.17:0/2629464327 shutdown_connections 2024-09-20T18:46:15.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.371+0000 7f36e941b640 1 -- 172.21.15.17:0/2629464327 wait complete. 2024-09-20T18:46:15.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.371+0000 7f36e941b640 1 Processor -- start 2024-09-20T18:46:15.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.372+0000 7f36e941b640 1 -- start start 2024-09-20T18:46:15.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.372+0000 7f36e941b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e4101900 0x7f36e40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:15.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.372+0000 7f36e941b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e4107900 0x7f36e4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:15.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.372+0000 7f36e941b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f36e410edb0 con 0x7f36e4101900 2024-09-20T18:46:15.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.372+0000 7f36e941b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f36e410ec30 con 0x7f36e4107900 2024-09-20T18:46:15.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.372+0000 7f36e2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e4101900 0x7f36e40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:15.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.372+0000 7f36e2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e4101900 0x7f36e40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52398/0 (socket says 172.21.15.17:52398) 2024-09-20T18:46:15.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.372+0000 7f36e2ffd640 1 -- 172.21.15.17:0/3680666616 learned_addr learned my addr 172.21.15.17:0/3680666616 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:46:15.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.372+0000 7f36e27fc640 1 --2- 172.21.15.17:0/3680666616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e4107900 0x7f36e4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:15.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.372+0000 7f36e2ffd640 1 -- 172.21.15.17:0/3680666616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e4107900 msgr2=0x7f36e4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:15.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.372+0000 7f36e2ffd640 1 --2- 172.21.15.17:0/3680666616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e4107900 0x7f36e4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.372+0000 7f36e2ffd640 1 -- 172.21.15.17:0/3680666616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e4074f70 con 0x7f36e4101900 2024-09-20T18:46:15.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.372+0000 7f36e27fc640 1 --2- 172.21.15.17:0/3680666616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e4107900 0x7f36e4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:46:15.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.373+0000 7f36e2ffd640 1 --2- 172.21.15.17:0/3680666616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e4101900 0x7f36e40744f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00d8d0 tx=0x7f36dc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:15.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.373+0000 7f36dbfff640 1 -- 172.21.15.17:0/3680666616 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36dc017070 con 0x7f36e4101900 2024-09-20T18:46:15.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.373+0000 7f36e941b640 1 -- 172.21.15.17:0/3680666616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e4075260 con 0x7f36e4101900 2024-09-20T18:46:15.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.373+0000 7f36dbfff640 1 -- 172.21.15.17:0/3680666616 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f36dc010460 con 0x7f36e4101900 2024-09-20T18:46:15.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.373+0000 7f36dbfff640 1 -- 172.21.15.17:0/3680666616 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36dc00f5f0 con 0x7f36e4101900 2024-09-20T18:46:15.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.373+0000 7f36e941b640 1 -- 172.21.15.17:0/3680666616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e41a3e80 con 0x7f36e4101900 2024-09-20T18:46:15.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.374+0000 7f36e941b640 1 -- 172.21.15.17:0/3680666616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36e4103040 con 0x7f36e4101900 2024-09-20T18:46:15.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.375+0000 7f36dbfff640 1 -- 172.21.15.17:0/3680666616 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f36dc009a30 con 0x7f36e4101900 2024-09-20T18:46:15.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.375+0000 7f36dbfff640 1 --2- 172.21.15.17:0/3680666616 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f36d007af80 0x7f36d007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:15.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.375+0000 7f36dbfff640 1 -- 172.21.15.17:0/3680666616 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f36dc09de30 con 0x7f36e4101900 2024-09-20T18:46:15.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.375+0000 7f36e27fc640 1 --2- 172.21.15.17:0/3680666616 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f36d007af80 0x7f36d007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:15.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.376+0000 7f36e27fc640 1 --2- 172.21.15.17:0/3680666616 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f36d007af80 0x7f36d007d440 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f36e4075f80 tx=0x7f36cc031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:15.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.380+0000 7f36dbfff640 1 -- 172.21.15.17:0/3680666616 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36dc0694b0 con 0x7f36e4101900 2024-09-20T18:46:15.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.576+0000 7f36e941b640 1 -- 172.21.15.17:0/3680666616 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f36e4062630 con 0x7f36d007af80 2024-09-20T18:46:15.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.585+0000 7f36dbfff640 1 -- 172.21.15.17:0/3680666616 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f36e4062630 con 0x7f36d007af80 2024-09-20T18:46:15.602 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:46:15.602 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (7m) 110s ago 18m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:46:15.602 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (10m) 110s ago 18m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:46:15.602 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (10m) 96s ago 17m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:46:15.602 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (5m) 110s ago 18m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:46:15.602 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (5m) 96s ago 17m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:46:15.602 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (7m) 110s ago 18m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:46:15.602 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (2m) 110s ago 13m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:46:15.603 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (115s) 110s ago 13m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:46:15.603 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (13m) 96s ago 13m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:46:15.603 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (99s) 96s ago 13m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:46:15.603 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (9m) 110s ago 19m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:46:15.603 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (8m) 96s ago 17m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:46:15.603 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (6m) 110s ago 19m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:46:15.603 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (6m) 96s ago 17m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:46:15.603 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (8m) 110s ago 18m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:46:15.603 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (8m) 96s ago 17m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:46:15.603 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (5m) 110s ago 16m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:46:15.603 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (4m) 110s ago 16m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:46:15.603 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (4m) 110s ago 15m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:46:15.603 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (3m) 96s ago 15m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:46:15.604 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (3m) 96s ago 14m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:46:15.604 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (2m) 96s ago 14m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:46:15.604 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (7m) 110s ago 18m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:46:15.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.588+0000 7f36e941b640 1 -- 172.21.15.17:0/3680666616 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f36d007af80 msgr2=0x7f36d007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:15.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.588+0000 7f36e941b640 1 --2- 172.21.15.17:0/3680666616 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f36d007af80 0x7f36d007d440 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f36e4075f80 tx=0x7f36cc031400 comp rx=0 tx=0).stop 2024-09-20T18:46:15.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.588+0000 7f36e941b640 1 -- 172.21.15.17:0/3680666616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e4101900 msgr2=0x7f36e40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.588+0000 7f36e941b640 1 --2- 172.21.15.17:0/3680666616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e4101900 0x7f36e40744f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00d8d0 tx=0x7f36dc00dd90 comp rx=0 tx=0).stop 2024-09-20T18:46:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.588+0000 7f36e941b640 1 -- 172.21.15.17:0/3680666616 shutdown_connections 2024-09-20T18:46:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.588+0000 7f36e941b640 1 --2- 172.21.15.17:0/3680666616 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f36d007af80 0x7f36d007d440 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.588+0000 7f36e941b640 1 --2- 172.21.15.17:0/3680666616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e4107900 0x7f36e4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.588+0000 7f36e941b640 1 --2- 172.21.15.17:0/3680666616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e4101900 0x7f36e40744f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.588+0000 7f36e941b640 1 -- 172.21.15.17:0/3680666616 >> 172.21.15.17:0/3680666616 conn(0x7f36e40fd600 msgr2=0x7f36e40fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.588+0000 7f36e941b640 1 -- 172.21.15.17:0/3680666616 shutdown_connections 2024-09-20T18:46:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.588+0000 7f36e941b640 1 -- 172.21.15.17:0/3680666616 wait complete. 2024-09-20T18:46:15.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:15 smithi017 ceph-mon[108970]: pgmap v325: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:15.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.672+0000 7f982ef68640 1 -- 172.21.15.17:0/2443003869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98281067f0 msgr2=0x7f9828106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:15.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.672+0000 7f982ef68640 1 --2- 172.21.15.17:0/2443003869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98281067f0 0x7f9828106bd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f981c009880 tx=0x7f981c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.672+0000 7f982ef68640 1 -- 172.21.15.17:0/2443003869 shutdown_connections 2024-09-20T18:46:15.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.672+0000 7f982ef68640 1 --2- 172.21.15.17:0/2443003869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98281007f0 0x7f9828100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.672+0000 7f982ef68640 1 --2- 172.21.15.17:0/2443003869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98281067f0 0x7f9828106bd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.672+0000 7f982ef68640 1 -- 172.21.15.17:0/2443003869 >> 172.21.15.17:0/2443003869 conn(0x7f98280fc550 msgr2=0x7f98280fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:15.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.672+0000 7f982ef68640 1 -- 172.21.15.17:0/2443003869 shutdown_connections 2024-09-20T18:46:15.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.672+0000 7f982ef68640 1 -- 172.21.15.17:0/2443003869 wait complete. 2024-09-20T18:46:15.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.673+0000 7f982ef68640 1 Processor -- start 2024-09-20T18:46:15.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.673+0000 7f982ef68640 1 -- start start 2024-09-20T18:46:15.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.673+0000 7f982ef68640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98281007f0 0x7f98280fcd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.673+0000 7f982ef68640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98281067f0 0x7f98280fd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.673+0000 7f982ef68640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f982810dcc0 con 0x7f98281007f0 2024-09-20T18:46:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.673+0000 7f982ef68640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f982810db40 con 0x7f98281067f0 2024-09-20T18:46:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.673+0000 7f982cd04640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98281007f0 0x7f98280fcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.673+0000 7f982cd04640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98281007f0 0x7f98280fcd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52416/0 (socket says 172.21.15.17:52416) 2024-09-20T18:46:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.673+0000 7f982cd04640 1 -- 172.21.15.17:0/3252611310 learned_addr learned my addr 172.21.15.17:0/3252611310 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:46:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.673+0000 7f9827fff640 1 --2- 172.21.15.17:0/3252611310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98281067f0 0x7f98280fd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.674+0000 7f982cd04640 1 -- 172.21.15.17:0/3252611310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98281067f0 msgr2=0x7f98280fd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.674+0000 7f982cd04640 1 --2- 172.21.15.17:0/3252611310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98281067f0 0x7f98280fd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.674+0000 7f982cd04640 1 -- 172.21.15.17:0/3252611310 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98280fd7b0 con 0x7f98281007f0 2024-09-20T18:46:15.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.674+0000 7f982cd04640 1 --2- 172.21.15.17:0/3252611310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98281007f0 0x7f98280fcd30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f981c031460 tx=0x7f981c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:15.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.674+0000 7f9825ffb640 1 -- 172.21.15.17:0/3252611310 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f981c03f070 con 0x7f98281007f0 2024-09-20T18:46:15.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.674+0000 7f982ef68640 1 -- 172.21.15.17:0/3252611310 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98280fda40 con 0x7f98281007f0 2024-09-20T18:46:15.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.674+0000 7f9825ffb640 1 -- 172.21.15.17:0/3252611310 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f981c0035f0 con 0x7f98281007f0 2024-09-20T18:46:15.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.674+0000 7f9825ffb640 1 -- 172.21.15.17:0/3252611310 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f981c035030 con 0x7f98281007f0 2024-09-20T18:46:15.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.674+0000 7f982ef68640 1 -- 172.21.15.17:0/3252611310 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98281a3d70 con 0x7f98281007f0 2024-09-20T18:46:15.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.676+0000 7f982ef68640 1 -- 172.21.15.17:0/3252611310 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9828101f30 con 0x7f98281007f0 2024-09-20T18:46:15.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.676+0000 7f9825ffb640 1 -- 172.21.15.17:0/3252611310 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f981c042070 con 0x7f98281007f0 2024-09-20T18:46:15.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.677+0000 7f9825ffb640 1 --2- 172.21.15.17:0/3252611310 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f981807af30 0x7f981807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:15.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.677+0000 7f9825ffb640 1 -- 172.21.15.17:0/3252611310 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f981c0be970 con 0x7f98281007f0 2024-09-20T18:46:15.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.677+0000 7f9827fff640 1 --2- 172.21.15.17:0/3252611310 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f981807af30 0x7f981807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:15.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.677+0000 7f9827fff640 1 --2- 172.21.15.17:0/3252611310 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f981807af30 0x7f981807d3f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f98280fe7c0 tx=0x7f981400b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:15.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.681+0000 7f9825ffb640 1 -- 172.21.15.17:0/3252611310 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f981c0c0e20 con 0x7f98281007f0 2024-09-20T18:46:15.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.943+0000 7f982ef68640 1 -- 172.21.15.17:0/3252611310 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f9828109d70 con 0x7f98281007f0 2024-09-20T18:46:15.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.943+0000 7f9825ffb640 1 -- 172.21.15.17:0/3252611310 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f981c08c490 con 0x7f98281007f0 2024-09-20T18:46:15.960 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:46:15.960 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:46:15.960 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:46:15.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:46:15.960 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:46:15.960 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:46:15.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:46:15.961 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:46:15.961 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:46:15.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:46:15.961 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:46:15.961 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:46:15.961 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:46:15.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:46:15.961 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:46:15.961 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:46:15.961 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:46:15.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:46:15.961 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:46:15.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:15 smithi172 ceph-mon[80431]: pgmap v325: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:15.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.945+0000 7f982ef68640 1 -- 172.21.15.17:0/3252611310 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f981807af30 msgr2=0x7f981807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.946+0000 7f982ef68640 1 --2- 172.21.15.17:0/3252611310 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f981807af30 0x7f981807d3f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f98280fe7c0 tx=0x7f981400b390 comp rx=0 tx=0).stop 2024-09-20T18:46:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.946+0000 7f982ef68640 1 -- 172.21.15.17:0/3252611310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98281007f0 msgr2=0x7f98280fcd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.946+0000 7f982ef68640 1 --2- 172.21.15.17:0/3252611310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98281007f0 0x7f98280fcd30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f981c031460 tx=0x7f981c0045e0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.946+0000 7f982ef68640 1 -- 172.21.15.17:0/3252611310 shutdown_connections 2024-09-20T18:46:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.946+0000 7f982ef68640 1 --2- 172.21.15.17:0/3252611310 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f981807af30 0x7f981807d3f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.946+0000 7f982ef68640 1 --2- 172.21.15.17:0/3252611310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98281067f0 0x7f98280fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.946+0000 7f982ef68640 1 --2- 172.21.15.17:0/3252611310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98281007f0 0x7f98280fcd30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.946+0000 7f982ef68640 1 -- 172.21.15.17:0/3252611310 >> 172.21.15.17:0/3252611310 conn(0x7f98280fc550 msgr2=0x7f9828069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.946+0000 7f982ef68640 1 -- 172.21.15.17:0/3252611310 shutdown_connections 2024-09-20T18:46:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:15.946+0000 7f982ef68640 1 -- 172.21.15.17:0/3252611310 wait complete. 2024-09-20T18:46:16.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.031+0000 7fd771e7f640 1 -- 172.21.15.17:0/1439918115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd76c103470 msgr2=0x7fd76c10b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.031+0000 7fd771e7f640 1 --2- 172.21.15.17:0/1439918115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd76c103470 0x7fd76c10b960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd754009880 tx=0x7fd75402a530 comp rx=0 tx=0).stop 2024-09-20T18:46:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.031+0000 7fd771e7f640 1 -- 172.21.15.17:0/1439918115 shutdown_connections 2024-09-20T18:46:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.031+0000 7fd771e7f640 1 --2- 172.21.15.17:0/1439918115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd76c103470 0x7fd76c10b960 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.031+0000 7fd771e7f640 1 --2- 172.21.15.17:0/1439918115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd76c102b50 0x7fd76c102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.031+0000 7fd771e7f640 1 -- 172.21.15.17:0/1439918115 >> 172.21.15.17:0/1439918115 conn(0x7fd76c0fc550 msgr2=0x7fd76c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.031+0000 7fd771e7f640 1 -- 172.21.15.17:0/1439918115 shutdown_connections 2024-09-20T18:46:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.031+0000 7fd771e7f640 1 -- 172.21.15.17:0/1439918115 wait complete. 2024-09-20T18:46:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.031+0000 7fd771e7f640 1 Processor -- start 2024-09-20T18:46:16.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.032+0000 7fd771e7f640 1 -- start start 2024-09-20T18:46:16.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.032+0000 7fd771e7f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd76c102b50 0x7fd76c19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:16.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.032+0000 7fd771e7f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd76c103470 0x7fd76c19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:16.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.032+0000 7fd771e7f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c10ee40 con 0x7fd76c102b50 2024-09-20T18:46:16.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.032+0000 7fd771e7f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c10ecc0 con 0x7fd76c103470 2024-09-20T18:46:16.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.032+0000 7fd76b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd76c102b50 0x7fd76c19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:16.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.032+0000 7fd76b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd76c102b50 0x7fd76c19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52428/0 (socket says 172.21.15.17:52428) 2024-09-20T18:46:16.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.032+0000 7fd76b7fe640 1 -- 172.21.15.17:0/1656029841 learned_addr learned my addr 172.21.15.17:0/1656029841 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:46:16.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.032+0000 7fd763fff640 1 --2- 172.21.15.17:0/1656029841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd76c103470 0x7fd76c19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:16.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.032+0000 7fd76b7fe640 1 -- 172.21.15.17:0/1656029841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd76c103470 msgr2=0x7fd76c19dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:16.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.032+0000 7fd76b7fe640 1 --2- 172.21.15.17:0/1656029841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd76c103470 0x7fd76c19dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.032+0000 7fd76b7fe640 1 -- 172.21.15.17:0/1656029841 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76c197890 con 0x7fd76c102b50 2024-09-20T18:46:16.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.032+0000 7fd76b7fe640 1 --2- 172.21.15.17:0/1656029841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd76c102b50 0x7fd76c19d6d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00b420 tx=0x7fd75c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:16.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.032+0000 7fd7697fa640 1 -- 172.21.15.17:0/1656029841 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd75c011630 con 0x7fd76c102b50 2024-09-20T18:46:16.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.033+0000 7fd771e7f640 1 -- 172.21.15.17:0/1656029841 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd76c197b80 con 0x7fd76c102b50 2024-09-20T18:46:16.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.033+0000 7fd7697fa640 1 -- 172.21.15.17:0/1656029841 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd75c016070 con 0x7fd76c102b50 2024-09-20T18:46:16.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.033+0000 7fd7697fa640 1 -- 172.21.15.17:0/1656029841 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd75c010d40 con 0x7fd76c102b50 2024-09-20T18:46:16.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.033+0000 7fd771e7f640 1 -- 172.21.15.17:0/1656029841 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd76c1980e0 con 0x7fd76c102b50 2024-09-20T18:46:16.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.034+0000 7fd771e7f640 1 -- 172.21.15.17:0/1656029841 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd76c06a4e0 con 0x7fd76c102b50 2024-09-20T18:46:16.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.034+0000 7fd7697fa640 1 -- 172.21.15.17:0/1656029841 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd75c01b460 con 0x7fd76c102b50 2024-09-20T18:46:16.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.035+0000 7fd7697fa640 1 --2- 172.21.15.17:0/1656029841 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd75807af30 0x7fd75807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:16.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.035+0000 7fd7697fa640 1 -- 172.21.15.17:0/1656029841 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fd75c09d740 con 0x7fd76c102b50 2024-09-20T18:46:16.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.035+0000 7fd763fff640 1 --2- 172.21.15.17:0/1656029841 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd75807af30 0x7fd75807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:16.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.035+0000 7fd763fff640 1 --2- 172.21.15.17:0/1656029841 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd75807af30 0x7fd75807d3f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd76c199080 tx=0x7fd754004f30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:16.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.039+0000 7fd7697fa640 1 -- 172.21.15.17:0/1656029841 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd75c021250 con 0x7fd76c102b50 2024-09-20T18:46:16.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.265+0000 7fd771e7f640 1 -- 172.21.15.17:0/1656029841 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd76c198dc0 con 0x7fd76c102b50 2024-09-20T18:46:16.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.265+0000 7fd7697fa640 1 -- 172.21.15.17:0/1656029841 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7fd75c068d40 con 0x7fd76c102b50 2024-09-20T18:46:16.282 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:46:16.282 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:46:16.282 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:46:16.282 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:46:16.282 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:46:16.282 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:46:16.282 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:46:16.282 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:46:16.282 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:46:16.282 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:46:16.282 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:46:16.282 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:46:16.283 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:46:16.283 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:46:16.283 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:46:16.283 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:46:16.283 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:46:16.283 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:46:16.283 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:46:16.283 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:46:16.283 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:46:16.283 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:46:16.283 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:46:16.283 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:46:16.283 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:46:16.284 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:46:16.284 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:46:16.284 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:46:16.284 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:46:16.284 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:46:16.284 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:46:16.284 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:46:16.284 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:46:16.284 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:46:16.284 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:46:16.284 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:46:16.284 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:46:16.284 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:46:16.284 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:46:16.285 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:46:16.285 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:46:16.285 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:46:16.285 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:46:16.285 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:46:16.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.268+0000 7fd771e7f640 1 -- 172.21.15.17:0/1656029841 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd75807af30 msgr2=0x7fd75807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:16.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.268+0000 7fd771e7f640 1 --2- 172.21.15.17:0/1656029841 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd75807af30 0x7fd75807d3f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd76c199080 tx=0x7fd754004f30 comp rx=0 tx=0).stop 2024-09-20T18:46:16.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.268+0000 7fd771e7f640 1 -- 172.21.15.17:0/1656029841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd76c102b50 msgr2=0x7fd76c19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:16.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.268+0000 7fd771e7f640 1 --2- 172.21.15.17:0/1656029841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd76c102b50 0x7fd76c19d6d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00b420 tx=0x7fd75c00b8e0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.268+0000 7fd771e7f640 1 -- 172.21.15.17:0/1656029841 shutdown_connections 2024-09-20T18:46:16.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.268+0000 7fd771e7f640 1 --2- 172.21.15.17:0/1656029841 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd75807af30 0x7fd75807d3f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.268+0000 7fd771e7f640 1 --2- 172.21.15.17:0/1656029841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd76c103470 0x7fd76c19dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.268+0000 7fd771e7f640 1 --2- 172.21.15.17:0/1656029841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd76c102b50 0x7fd76c19d6d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.268+0000 7fd771e7f640 1 -- 172.21.15.17:0/1656029841 >> 172.21.15.17:0/1656029841 conn(0x7fd76c0fc550 msgr2=0x7fd76c107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:16.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.268+0000 7fd771e7f640 1 -- 172.21.15.17:0/1656029841 shutdown_connections 2024-09-20T18:46:16.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.268+0000 7fd771e7f640 1 -- 172.21.15.17:0/1656029841 wait complete. 2024-09-20T18:46:16.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.354+0000 7fc571bd4640 1 -- 172.21.15.17:0/889101977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c107900 msgr2=0x7fc56c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:16.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.354+0000 7fc571bd4640 1 --2- 172.21.15.17:0/889101977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c107900 0x7fc56c107ce0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009880 tx=0x7fc55c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.354+0000 7fc571bd4640 1 -- 172.21.15.17:0/889101977 shutdown_connections 2024-09-20T18:46:16.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.354+0000 7fc571bd4640 1 --2- 172.21.15.17:0/889101977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc56c101900 0x7fc56c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.354+0000 7fc571bd4640 1 --2- 172.21.15.17:0/889101977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c107900 0x7fc56c107ce0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.354+0000 7fc571bd4640 1 -- 172.21.15.17:0/889101977 >> 172.21.15.17:0/889101977 conn(0x7fc56c0fd600 msgr2=0x7fc56c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:16.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.354+0000 7fc571bd4640 1 -- 172.21.15.17:0/889101977 shutdown_connections 2024-09-20T18:46:16.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.354+0000 7fc571bd4640 1 -- 172.21.15.17:0/889101977 wait complete. 2024-09-20T18:46:16.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.355+0000 7fc571bd4640 1 Processor -- start 2024-09-20T18:46:16.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.355+0000 7fc571bd4640 1 -- start start 2024-09-20T18:46:16.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.355+0000 7fc571bd4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c101900 0x7fc56c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:16.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.355+0000 7fc571bd4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc56c107900 0x7fc56c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:16.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.355+0000 7fc571bd4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c10edd0 con 0x7fc56c101900 2024-09-20T18:46:16.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.355+0000 7fc571bd4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c10ec50 con 0x7fc56c107900 2024-09-20T18:46:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.355+0000 7fc56b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c101900 0x7fc56c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.355+0000 7fc56b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c101900 0x7fc56c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52450/0 (socket says 172.21.15.17:52450) 2024-09-20T18:46:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.355+0000 7fc56b7fe640 1 -- 172.21.15.17:0/465685079 learned_addr learned my addr 172.21.15.17:0/465685079 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:46:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.356+0000 7fc56affd640 1 --2- 172.21.15.17:0/465685079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc56c107900 0x7fc56c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.356+0000 7fc56b7fe640 1 -- 172.21.15.17:0/465685079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc56c107900 msgr2=0x7fc56c19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.356+0000 7fc56b7fe640 1 --2- 172.21.15.17:0/465685079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc56c107900 0x7fc56c19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.356+0000 7fc56b7fe640 1 -- 172.21.15.17:0/465685079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56c1977c0 con 0x7fc56c101900 2024-09-20T18:46:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.356+0000 7fc56b7fe640 1 --2- 172.21.15.17:0/465685079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c101900 0x7fc56c19d640 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc55c031460 tx=0x7fc55c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.356+0000 7fc568ff9640 1 -- 172.21.15.17:0/465685079 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc55c03f070 con 0x7fc56c101900 2024-09-20T18:46:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.356+0000 7fc568ff9640 1 -- 172.21.15.17:0/465685079 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc55c0035f0 con 0x7fc56c101900 2024-09-20T18:46:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.356+0000 7fc571bd4640 1 -- 172.21.15.17:0/465685079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56c197a50 con 0x7fc56c101900 2024-09-20T18:46:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.356+0000 7fc568ff9640 1 -- 172.21.15.17:0/465685079 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc55c035030 con 0x7fc56c101900 2024-09-20T18:46:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.356+0000 7fc571bd4640 1 -- 172.21.15.17:0/465685079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc56c197f80 con 0x7fc56c101900 2024-09-20T18:46:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.357+0000 7fc571bd4640 1 -- 172.21.15.17:0/465685079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc56c103040 con 0x7fc56c101900 2024-09-20T18:46:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.358+0000 7fc568ff9640 1 -- 172.21.15.17:0/465685079 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc55c042070 con 0x7fc56c101900 2024-09-20T18:46:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.359+0000 7fc568ff9640 1 --2- 172.21.15.17:0/465685079 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc55407af30 0x7fc55407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:16.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.359+0000 7fc568ff9640 1 -- 172.21.15.17:0/465685079 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fc55c0be9b0 con 0x7fc56c101900 2024-09-20T18:46:16.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.359+0000 7fc56affd640 1 --2- 172.21.15.17:0/465685079 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc55407af30 0x7fc55407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:16.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.359+0000 7fc56affd640 1 --2- 172.21.15.17:0/465685079 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc55407af30 0x7fc55407d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0ffbf0 tx=0x7fc560005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:16.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.363+0000 7fc568ff9640 1 -- 172.21.15.17:0/465685079 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc55c089fb0 con 0x7fc56c101900 2024-09-20T18:46:16.584 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:16 smithi017 ceph-mon[108970]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:46:16.585 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:16 smithi017 ceph-mon[108970]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:46:16.585 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:16 smithi017 ceph-mon[108970]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:46:16.585 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:16 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3252611310' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:46:16.585 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:16 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1656029841' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:46:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.570+0000 7fc571bd4640 1 -- 172.21.15.17:0/465685079 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc56c1982f0 con 0x7fc55407af30 2024-09-20T18:46:16.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.571+0000 7fc568ff9640 1 -- 172.21.15.17:0/465685079 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fc56c1982f0 con 0x7fc55407af30 2024-09-20T18:46:16.587 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:46:16.587 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:46:16.587 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:46:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:46:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:46:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:46:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:46:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:46:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:46:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:46:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:46:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:46:16.588 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:46:16.588 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:46:16.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.573+0000 7fc571bd4640 1 -- 172.21.15.17:0/465685079 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc55407af30 msgr2=0x7fc55407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:16.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.573+0000 7fc571bd4640 1 --2- 172.21.15.17:0/465685079 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc55407af30 0x7fc55407d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0ffbf0 tx=0x7fc560005f90 comp rx=0 tx=0).stop 2024-09-20T18:46:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.573+0000 7fc571bd4640 1 -- 172.21.15.17:0/465685079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c101900 msgr2=0x7fc56c19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.573+0000 7fc571bd4640 1 --2- 172.21.15.17:0/465685079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c101900 0x7fc56c19d640 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc55c031460 tx=0x7fc55c004530 comp rx=0 tx=0).stop 2024-09-20T18:46:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.573+0000 7fc571bd4640 1 -- 172.21.15.17:0/465685079 shutdown_connections 2024-09-20T18:46:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.573+0000 7fc571bd4640 1 --2- 172.21.15.17:0/465685079 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc55407af30 0x7fc55407d3f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.573+0000 7fc571bd4640 1 --2- 172.21.15.17:0/465685079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc56c107900 0x7fc56c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.573+0000 7fc571bd4640 1 --2- 172.21.15.17:0/465685079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc56c101900 0x7fc56c19d640 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.573+0000 7fc571bd4640 1 -- 172.21.15.17:0/465685079 >> 172.21.15.17:0/465685079 conn(0x7fc56c0fd600 msgr2=0x7fc56c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.574+0000 7fc571bd4640 1 -- 172.21.15.17:0/465685079 shutdown_connections 2024-09-20T18:46:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.574+0000 7fc571bd4640 1 -- 172.21.15.17:0/465685079 wait complete. 2024-09-20T18:46:16.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.657+0000 7f3816ad6640 1 -- 172.21.15.17:0/1905807945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3810103490 msgr2=0x7f381010b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:16.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.657+0000 7f3816ad6640 1 --2- 172.21.15.17:0/1905807945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3810103490 0x7f381010b980 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3804009880 tx=0x7f380402a530 comp rx=0 tx=0).stop 2024-09-20T18:46:16.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.657+0000 7f3816ad6640 1 -- 172.21.15.17:0/1905807945 shutdown_connections 2024-09-20T18:46:16.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.657+0000 7f3816ad6640 1 --2- 172.21.15.17:0/1905807945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3810103490 0x7f381010b980 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.657+0000 7f3816ad6640 1 --2- 172.21.15.17:0/1905807945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3810102b70 0x7f3810102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.657+0000 7f3816ad6640 1 -- 172.21.15.17:0/1905807945 >> 172.21.15.17:0/1905807945 conn(0x7f38100fc550 msgr2=0x7f38100fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:16.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.658+0000 7f3816ad6640 1 -- 172.21.15.17:0/1905807945 shutdown_connections 2024-09-20T18:46:16.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.658+0000 7f3816ad6640 1 -- 172.21.15.17:0/1905807945 wait complete. 2024-09-20T18:46:16.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.658+0000 7f3816ad6640 1 Processor -- start 2024-09-20T18:46:16.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.658+0000 7f3816ad6640 1 -- start start 2024-09-20T18:46:16.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.658+0000 7f3816ad6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3810102b70 0x7f381019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:16.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.658+0000 7f3816ad6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3810103490 0x7f381019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:16.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.658+0000 7f3816ad6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f381010ee40 con 0x7f3810103490 2024-09-20T18:46:16.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.658+0000 7f3816ad6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f381010ecc0 con 0x7f3810102b70 2024-09-20T18:46:16.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.659+0000 7f380ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3810103490 0x7f381019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:16.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.659+0000 7f380ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3810103490 0x7f381019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52474/0 (socket says 172.21.15.17:52474) 2024-09-20T18:46:16.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.659+0000 7f380ffff640 1 -- 172.21.15.17:0/2223448166 learned_addr learned my addr 172.21.15.17:0/2223448166 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:46:16.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.659+0000 7f3814872640 1 --2- 172.21.15.17:0/2223448166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3810102b70 0x7f381019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.659+0000 7f380ffff640 1 -- 172.21.15.17:0/2223448166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3810102b70 msgr2=0x7f381019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.659+0000 7f380ffff640 1 --2- 172.21.15.17:0/2223448166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3810102b70 0x7f381019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.659+0000 7f380ffff640 1 -- 172.21.15.17:0/2223448166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3810197810 con 0x7f3810103490 2024-09-20T18:46:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.659+0000 7f380ffff640 1 --2- 172.21.15.17:0/2223448166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3810103490 0x7f381019dbd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3804004f90 tx=0x7f38040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.659+0000 7f380dffb640 1 -- 172.21.15.17:0/2223448166 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f380403f070 con 0x7f3810103490 2024-09-20T18:46:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.659+0000 7f3816ad6640 1 -- 172.21.15.17:0/2223448166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3810197aa0 con 0x7f3810103490 2024-09-20T18:46:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.659+0000 7f380dffb640 1 -- 172.21.15.17:0/2223448166 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3804004cf0 con 0x7f3810103490 2024-09-20T18:46:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.659+0000 7f380dffb640 1 -- 172.21.15.17:0/2223448166 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3804035030 con 0x7f3810103490 2024-09-20T18:46:16.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.660+0000 7f3816ad6640 1 -- 172.21.15.17:0/2223448166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3810197fd0 con 0x7f3810103490 2024-09-20T18:46:16.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.661+0000 7f3816ad6640 1 -- 172.21.15.17:0/2223448166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f381006a4c0 con 0x7f3810103490 2024-09-20T18:46:16.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.661+0000 7f380dffb640 1 -- 172.21.15.17:0/2223448166 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3804042070 con 0x7f3810103490 2024-09-20T18:46:16.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.662+0000 7f380dffb640 1 --2- 172.21.15.17:0/2223448166 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f37f807af30 0x7f37f807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:16.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.662+0000 7f380dffb640 1 -- 172.21.15.17:0/2223448166 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f38040beb50 con 0x7f3810103490 2024-09-20T18:46:16.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.662+0000 7f3814872640 1 --2- 172.21.15.17:0/2223448166 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f37f807af30 0x7f37f807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:16.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.662+0000 7f3814872640 1 --2- 172.21.15.17:0/2223448166 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f37f807af30 0x7f37f807d3f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3800009890 tx=0x7f3800008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:16.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.666+0000 7f380dffb640 1 -- 172.21.15.17:0/2223448166 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f380408a150 con 0x7f3810103490 2024-09-20T18:46:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.931+0000 7f3816ad6640 1 -- 172.21.15.17:0/2223448166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f3810198d40 con 0x7f3810103490 2024-09-20T18:46:16.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.932+0000 7f380dffb640 1 -- 172.21.15.17:0/2223448166 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f380408f000 con 0x7f3810103490 2024-09-20T18:46:16.948 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:46:16.948 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:46:16.948 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:46:16.948 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:46:16.948 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:46:16.948 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:46:16.948 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:46:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.934+0000 7f3816ad6640 1 -- 172.21.15.17:0/2223448166 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f37f807af30 msgr2=0x7f37f807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:16.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.934+0000 7f3816ad6640 1 --2- 172.21.15.17:0/2223448166 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f37f807af30 0x7f37f807d3f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3800009890 tx=0x7f3800008040 comp rx=0 tx=0).stop 2024-09-20T18:46:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.934+0000 7f3816ad6640 1 -- 172.21.15.17:0/2223448166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3810103490 msgr2=0x7f381019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.934+0000 7f3816ad6640 1 --2- 172.21.15.17:0/2223448166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3810103490 0x7f381019dbd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3804004f90 tx=0x7f38040048f0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.934+0000 7f3816ad6640 1 -- 172.21.15.17:0/2223448166 shutdown_connections 2024-09-20T18:46:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.934+0000 7f3816ad6640 1 --2- 172.21.15.17:0/2223448166 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f37f807af30 0x7f37f807d3f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.934+0000 7f3816ad6640 1 --2- 172.21.15.17:0/2223448166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3810103490 0x7f381019dbd0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.934+0000 7f3816ad6640 1 --2- 172.21.15.17:0/2223448166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3810102b70 0x7f381019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.934+0000 7f3816ad6640 1 -- 172.21.15.17:0/2223448166 >> 172.21.15.17:0/2223448166 conn(0x7f38100fc550 msgr2=0x7f3810108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.934+0000 7f3816ad6640 1 -- 172.21.15.17:0/2223448166 shutdown_connections 2024-09-20T18:46:16.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:16.934+0000 7f3816ad6640 1 -- 172.21.15.17:0/2223448166 wait complete. 2024-09-20T18:46:16.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:16 smithi172 ceph-mon[80431]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:46:16.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:16 smithi172 ceph-mon[80431]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:46:16.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:16 smithi172 ceph-mon[80431]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:46:16.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:16 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3252611310' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:46:16.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:16 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1656029841' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:46:17.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:17 smithi017 ceph-mon[108970]: pgmap v326: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:17.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:17 smithi017 ceph-mon[108970]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:46:17.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:17 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2223448166' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:46:17.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:17 smithi172 ceph-mon[80431]: pgmap v326: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:17.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:17 smithi172 ceph-mon[80431]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:46:17.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:17 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2223448166' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:46:19.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:19 smithi017 ceph-mon[108970]: pgmap v327: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:19.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:19 smithi172 ceph-mon[80431]: pgmap v327: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:21.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:21 smithi017 ceph-mon[108970]: pgmap v328: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:21 smithi172 ceph-mon[80431]: pgmap v328: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:22.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:46:22.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:46:23.862 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:23 smithi172 ceph-mon[80431]: pgmap v329: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:23.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:23 smithi017 ceph-mon[108970]: pgmap v329: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:25.802 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:25 smithi017 ceph-mon[108970]: pgmap v330: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:25.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:25 smithi172 ceph-mon[80431]: pgmap v330: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:27.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:27 smithi017 ceph-mon[108970]: pgmap v331: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:27.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:27 smithi172 ceph-mon[80431]: pgmap v331: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:29.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:29 smithi017 ceph-mon[108970]: pgmap v332: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:29.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:29 smithi172 ceph-mon[80431]: pgmap v332: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:31.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:31 smithi017 ceph-mon[108970]: pgmap v333: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:31.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:31 smithi172 ceph-mon[80431]: pgmap v333: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:33.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:33 smithi017 ceph-mon[108970]: pgmap v334: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:33.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:33 smithi172 ceph-mon[80431]: pgmap v334: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:35.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:35 smithi017 ceph-mon[108970]: pgmap v335: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:35.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:35 smithi172 ceph-mon[80431]: pgmap v335: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:37.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:37 smithi017 ceph-mon[108970]: pgmap v336: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:46:37.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:37 smithi172 ceph-mon[80431]: pgmap v336: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:37.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:46:39.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:39 smithi017 ceph-mon[108970]: pgmap v337: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:39.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:39 smithi172 ceph-mon[80431]: pgmap v337: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:41.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:41 smithi017 ceph-mon[108970]: pgmap v338: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:41.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:41 smithi172 ceph-mon[80431]: pgmap v338: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:43.836 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:43 smithi172 ceph-mon[80431]: pgmap v339: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:43.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:43 smithi017 ceph-mon[108970]: pgmap v339: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:45.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:45 smithi017 ceph-mon[108970]: pgmap v340: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:45.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:45 smithi172 ceph-mon[80431]: pgmap v340: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:47.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.031+0000 7fc503439640 1 -- 172.21.15.17:0/2194001016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4fc101900 msgr2=0x7fc4fc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:47.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.031+0000 7fc503439640 1 --2- 172.21.15.17:0/2194001016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4fc101900 0x7fc4fc101d60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009880 tx=0x7fc4ec02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.031+0000 7fc503439640 1 -- 172.21.15.17:0/2194001016 shutdown_connections 2024-09-20T18:46:47.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.031+0000 7fc503439640 1 --2- 172.21.15.17:0/2194001016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4fc101900 0x7fc4fc101d60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.031+0000 7fc503439640 1 --2- 172.21.15.17:0/2194001016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4fc107900 0x7fc4fc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.031+0000 7fc503439640 1 -- 172.21.15.17:0/2194001016 >> 172.21.15.17:0/2194001016 conn(0x7fc4fc0fd600 msgr2=0x7fc4fc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:47.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.031+0000 7fc503439640 1 -- 172.21.15.17:0/2194001016 shutdown_connections 2024-09-20T18:46:47.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.031+0000 7fc503439640 1 -- 172.21.15.17:0/2194001016 wait complete. 2024-09-20T18:46:47.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.032+0000 7fc503439640 1 Processor -- start 2024-09-20T18:46:47.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.032+0000 7fc503439640 1 -- start start 2024-09-20T18:46:47.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.032+0000 7fc503439640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4fc101900 0x7fc4fc19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:47.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.032+0000 7fc503439640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4fc107900 0x7fc4fc19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:47.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.032+0000 7fc503439640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc4fc10edb0 con 0x7fc4fc107900 2024-09-20T18:46:47.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.032+0000 7fc503439640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc4fc10ec30 con 0x7fc4fc101900 2024-09-20T18:46:47.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.033+0000 7fc5009d4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4fc107900 0x7fc4fc19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:47.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.033+0000 7fc5009d4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4fc107900 0x7fc4fc19db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39934/0 (socket says 172.21.15.17:39934) 2024-09-20T18:46:47.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.033+0000 7fc5009d4640 1 -- 172.21.15.17:0/4229234825 learned_addr learned my addr 172.21.15.17:0/4229234825 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:46:47.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.033+0000 7fc5011d5640 1 --2- 172.21.15.17:0/4229234825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4fc101900 0x7fc4fc19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:47.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.033+0000 7fc5009d4640 1 -- 172.21.15.17:0/4229234825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4fc101900 msgr2=0x7fc4fc19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:47.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.033+0000 7fc5009d4640 1 --2- 172.21.15.17:0/4229234825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4fc101900 0x7fc4fc19d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.033+0000 7fc5009d4640 1 -- 172.21.15.17:0/4229234825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4fc1977d0 con 0x7fc4fc107900 2024-09-20T18:46:47.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.033+0000 7fc5009d4640 1 --2- 172.21.15.17:0/4229234825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4fc107900 0x7fc4fc19db90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec031460 tx=0x7fc4ec0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:47.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.033+0000 7fc4f27fc640 1 -- 172.21.15.17:0/4229234825 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc4ec03f070 con 0x7fc4fc107900 2024-09-20T18:46:47.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.033+0000 7fc4f27fc640 1 -- 172.21.15.17:0/4229234825 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc4ec004b10 con 0x7fc4fc107900 2024-09-20T18:46:47.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.033+0000 7fc4f27fc640 1 -- 172.21.15.17:0/4229234825 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc4ec035030 con 0x7fc4fc107900 2024-09-20T18:46:47.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.033+0000 7fc503439640 1 -- 172.21.15.17:0/4229234825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4fc197a60 con 0x7fc4fc107900 2024-09-20T18:46:47.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.034+0000 7fc503439640 1 -- 172.21.15.17:0/4229234825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4fc197f90 con 0x7fc4fc107900 2024-09-20T18:46:47.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.035+0000 7fc503439640 1 -- 172.21.15.17:0/4229234825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4fc103040 con 0x7fc4fc107900 2024-09-20T18:46:47.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.036+0000 7fc4f27fc640 1 -- 172.21.15.17:0/4229234825 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc4ec042070 con 0x7fc4fc107900 2024-09-20T18:46:47.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.036+0000 7fc4f27fc640 1 --2- 172.21.15.17:0/4229234825 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc4e807af40 0x7fc4e807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:47.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.036+0000 7fc4f27fc640 1 -- 172.21.15.17:0/4229234825 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fc4ec0bebf0 con 0x7fc4fc107900 2024-09-20T18:46:47.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.036+0000 7fc5011d5640 1 --2- 172.21.15.17:0/4229234825 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc4e807af40 0x7fc4e807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:47.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.037+0000 7fc5011d5640 1 --2- 172.21.15.17:0/4229234825 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc4e807af40 0x7fc4e807d400 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8005fd0 tx=0x7fc4f8005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:47.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.041+0000 7fc4f27fc640 1 -- 172.21.15.17:0/4229234825 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc4ec08a150 con 0x7fc4fc107900 2024-09-20T18:46:47.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.248+0000 7fc503439640 1 -- 172.21.15.17:0/4229234825 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc4fc198300 con 0x7fc4e807af40 2024-09-20T18:46:47.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.249+0000 7fc4f27fc640 1 -- 172.21.15.17:0/4229234825 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fc4fc198300 con 0x7fc4e807af40 2024-09-20T18:46:47.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.251+0000 7fc503439640 1 -- 172.21.15.17:0/4229234825 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc4e807af40 msgr2=0x7fc4e807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:47.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.251+0000 7fc503439640 1 --2- 172.21.15.17:0/4229234825 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc4e807af40 0x7fc4e807d400 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8005fd0 tx=0x7fc4f8005850 comp rx=0 tx=0).stop 2024-09-20T18:46:47.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.251+0000 7fc503439640 1 -- 172.21.15.17:0/4229234825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4fc107900 msgr2=0x7fc4fc19db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:47.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.251+0000 7fc503439640 1 --2- 172.21.15.17:0/4229234825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4fc107900 0x7fc4fc19db90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec031460 tx=0x7fc4ec0045e0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.251+0000 7fc503439640 1 -- 172.21.15.17:0/4229234825 shutdown_connections 2024-09-20T18:46:47.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.251+0000 7fc503439640 1 --2- 172.21.15.17:0/4229234825 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc4e807af40 0x7fc4e807d400 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.251+0000 7fc503439640 1 --2- 172.21.15.17:0/4229234825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4fc107900 0x7fc4fc19db90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.251+0000 7fc503439640 1 --2- 172.21.15.17:0/4229234825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4fc101900 0x7fc4fc19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.251+0000 7fc503439640 1 -- 172.21.15.17:0/4229234825 >> 172.21.15.17:0/4229234825 conn(0x7fc4fc0fd600 msgr2=0x7fc4fc0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:47.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.251+0000 7fc503439640 1 -- 172.21.15.17:0/4229234825 shutdown_connections 2024-09-20T18:46:47.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.251+0000 7fc503439640 1 -- 172.21.15.17:0/4229234825 wait complete. 2024-09-20T18:46:47.277 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:46:47.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.337+0000 7f06d0757640 1 -- 172.21.15.17:0/522361807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c8107900 msgr2=0x7f06c8107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:47.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.337+0000 7f06d0757640 1 --2- 172.21.15.17:0/522361807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c8107900 0x7f06c8107ce0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009880 tx=0x7f06c402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.337+0000 7f06d0757640 1 -- 172.21.15.17:0/522361807 shutdown_connections 2024-09-20T18:46:47.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.337+0000 7f06d0757640 1 --2- 172.21.15.17:0/522361807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06c8101900 0x7f06c8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.337+0000 7f06d0757640 1 --2- 172.21.15.17:0/522361807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c8107900 0x7f06c8107ce0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.337+0000 7f06d0757640 1 -- 172.21.15.17:0/522361807 >> 172.21.15.17:0/522361807 conn(0x7f06c80fd600 msgr2=0x7f06c80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:47.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.337+0000 7f06d0757640 1 -- 172.21.15.17:0/522361807 shutdown_connections 2024-09-20T18:46:47.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.338+0000 7f06d0757640 1 -- 172.21.15.17:0/522361807 wait complete. 2024-09-20T18:46:47.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.338+0000 7f06d0757640 1 Processor -- start 2024-09-20T18:46:47.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.338+0000 7f06d0757640 1 -- start start 2024-09-20T18:46:47.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.339+0000 7f06d0757640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c8101900 0x7f06c80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:47.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.339+0000 7f06d0757640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06c8107900 0x7f06c8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:47.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.339+0000 7f06d0757640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f06c810edd0 con 0x7f06c8101900 2024-09-20T18:46:47.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.339+0000 7f06d0757640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f06c810ec50 con 0x7f06c8107900 2024-09-20T18:46:47.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.339+0000 7f06ce4f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c8101900 0x7f06c80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:47.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.339+0000 7f06ce4f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c8101900 0x7f06c80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39946/0 (socket says 172.21.15.17:39946) 2024-09-20T18:46:47.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.339+0000 7f06ce4f3640 1 -- 172.21.15.17:0/4132964448 learned_addr learned my addr 172.21.15.17:0/4132964448 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:46:47.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.339+0000 7f06cdcf2640 1 --2- 172.21.15.17:0/4132964448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06c8107900 0x7f06c8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:47.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.339+0000 7f06ce4f3640 1 -- 172.21.15.17:0/4132964448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06c8107900 msgr2=0x7f06c8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:47.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.339+0000 7f06ce4f3640 1 --2- 172.21.15.17:0/4132964448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06c8107900 0x7f06c8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.339+0000 7f06ce4f3640 1 -- 172.21.15.17:0/4132964448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c8074f70 con 0x7f06c8101900 2024-09-20T18:46:47.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.339+0000 7f06ce4f3640 1 --2- 172.21.15.17:0/4132964448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c8101900 0x7f06c80744f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f06c4031460 tx=0x7f06c40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:47.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.340+0000 7f06bf7fe640 1 -- 172.21.15.17:0/4132964448 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06c403f070 con 0x7f06c8101900 2024-09-20T18:46:47.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.340+0000 7f06bf7fe640 1 -- 172.21.15.17:0/4132964448 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06c40035f0 con 0x7f06c8101900 2024-09-20T18:46:47.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.340+0000 7f06d0757640 1 -- 172.21.15.17:0/4132964448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c8075200 con 0x7f06c8101900 2024-09-20T18:46:47.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.340+0000 7f06bf7fe640 1 -- 172.21.15.17:0/4132964448 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06c4035030 con 0x7f06c8101900 2024-09-20T18:46:47.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.340+0000 7f06d0757640 1 -- 172.21.15.17:0/4132964448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c81a3d80 con 0x7f06c8101900 2024-09-20T18:46:47.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.341+0000 7f06d0757640 1 -- 172.21.15.17:0/4132964448 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06c8103040 con 0x7f06c8101900 2024-09-20T18:46:47.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.343+0000 7f06bf7fe640 1 -- 172.21.15.17:0/4132964448 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f06c4042070 con 0x7f06c8101900 2024-09-20T18:46:47.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.343+0000 7f06bf7fe640 1 --2- 172.21.15.17:0/4132964448 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06b407af30 0x7f06b407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:47.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.343+0000 7f06bf7fe640 1 -- 172.21.15.17:0/4132964448 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f06c40be690 con 0x7f06c8101900 2024-09-20T18:46:47.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.343+0000 7f06cdcf2640 1 --2- 172.21.15.17:0/4132964448 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06b407af30 0x7f06b407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:47.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.344+0000 7f06cdcf2640 1 --2- 172.21.15.17:0/4132964448 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06b407af30 0x7f06b407d3f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f06c8075f80 tx=0x7f06b800b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:47.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.348+0000 7f06bf7fe640 1 -- 172.21.15.17:0/4132964448 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f06c4089bf0 con 0x7f06c8101900 2024-09-20T18:46:47.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.553+0000 7f06d0757640 1 -- 172.21.15.17:0/4132964448 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f06c8062630 con 0x7f06b407af30 2024-09-20T18:46:47.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.554+0000 7f06bf7fe640 1 -- 172.21.15.17:0/4132964448 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f06c8062630 con 0x7f06b407af30 2024-09-20T18:46:47.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.556+0000 7f06d0757640 1 -- 172.21.15.17:0/4132964448 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06b407af30 msgr2=0x7f06b407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:47.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.556+0000 7f06d0757640 1 --2- 172.21.15.17:0/4132964448 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06b407af30 0x7f06b407d3f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f06c8075f80 tx=0x7f06b800b390 comp rx=0 tx=0).stop 2024-09-20T18:46:47.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.556+0000 7f06d0757640 1 -- 172.21.15.17:0/4132964448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c8101900 msgr2=0x7f06c80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:47.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.556+0000 7f06d0757640 1 --2- 172.21.15.17:0/4132964448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c8101900 0x7f06c80744f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f06c4031460 tx=0x7f06c40045e0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.556+0000 7f06d0757640 1 -- 172.21.15.17:0/4132964448 shutdown_connections 2024-09-20T18:46:47.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.556+0000 7f06d0757640 1 --2- 172.21.15.17:0/4132964448 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06b407af30 0x7f06b407d3f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.556+0000 7f06d0757640 1 --2- 172.21.15.17:0/4132964448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06c8107900 0x7f06c8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.556+0000 7f06d0757640 1 --2- 172.21.15.17:0/4132964448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c8101900 0x7f06c80744f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.556+0000 7f06d0757640 1 -- 172.21.15.17:0/4132964448 >> 172.21.15.17:0/4132964448 conn(0x7f06c80fd600 msgr2=0x7f06c80fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:47.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.556+0000 7f06d0757640 1 -- 172.21.15.17:0/4132964448 shutdown_connections 2024-09-20T18:46:47.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.556+0000 7f06d0757640 1 -- 172.21.15.17:0/4132964448 wait complete. 2024-09-20T18:46:47.651 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:47 smithi017 ceph-mon[108970]: pgmap v341: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:47.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.642+0000 7f601e662640 1 -- 172.21.15.17:0/3757599946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f601810cf10 msgr2=0x7f6018110f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:47.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.642+0000 7f601e662640 1 --2- 172.21.15.17:0/3757599946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f601810cf10 0x7f6018110f60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6000009880 tx=0x7f600002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.642+0000 7f601e662640 1 -- 172.21.15.17:0/3757599946 shutdown_connections 2024-09-20T18:46:47.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.642+0000 7f601e662640 1 --2- 172.21.15.17:0/3757599946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f601810cf10 0x7f6018110f60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.642+0000 7f601e662640 1 --2- 172.21.15.17:0/3757599946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f601810c560 0x7f601810c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.642+0000 7f601e662640 1 -- 172.21.15.17:0/3757599946 >> 172.21.15.17:0/3757599946 conn(0x7f601806c5b0 msgr2=0x7f601806c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:47.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.642+0000 7f601e662640 1 -- 172.21.15.17:0/3757599946 shutdown_connections 2024-09-20T18:46:47.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.642+0000 7f601e662640 1 -- 172.21.15.17:0/3757599946 wait complete. 2024-09-20T18:46:47.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.642+0000 7f601e662640 1 Processor -- start 2024-09-20T18:46:47.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.643+0000 7f601e662640 1 -- start start 2024-09-20T18:46:47.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.643+0000 7f601e662640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f601810c560 0x7f60181a2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:47.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.643+0000 7f601e662640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f601810cf10 0x7f60181a2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.643+0000 7f601e662640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6018119840 con 0x7f601810c560 2024-09-20T18:46:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.643+0000 7f601e662640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f60181196c0 con 0x7f601810cf10 2024-09-20T18:46:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.643+0000 7f6017fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f601810c560 0x7f60181a2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.643+0000 7f6017fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f601810c560 0x7f60181a2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39970/0 (socket says 172.21.15.17:39970) 2024-09-20T18:46:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.643+0000 7f6017fff640 1 -- 172.21.15.17:0/1214854946 learned_addr learned my addr 172.21.15.17:0/1214854946 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:46:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.643+0000 7f600ffff640 1 --2- 172.21.15.17:0/1214854946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f601810cf10 0x7f60181a2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.643+0000 7f6017fff640 1 -- 172.21.15.17:0/1214854946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f601810cf10 msgr2=0x7f60181a2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.643+0000 7f6017fff640 1 --2- 172.21.15.17:0/1214854946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f601810cf10 0x7f60181a2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.643+0000 7f6017fff640 1 -- 172.21.15.17:0/1214854946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60181a6d00 con 0x7f601810c560 2024-09-20T18:46:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.643+0000 7f6017fff640 1 --2- 172.21.15.17:0/1214854946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f601810c560 0x7f60181a2430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f600800b420 tx=0x7f600800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.644+0000 7f6015ffb640 1 -- 172.21.15.17:0/1214854946 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6008011630 con 0x7f601810c560 2024-09-20T18:46:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.644+0000 7f6015ffb640 1 -- 172.21.15.17:0/1214854946 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6008016070 con 0x7f601810c560 2024-09-20T18:46:47.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.644+0000 7f6015ffb640 1 -- 172.21.15.17:0/1214854946 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6008010d40 con 0x7f601810c560 2024-09-20T18:46:47.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.644+0000 7f601e662640 1 -- 172.21.15.17:0/1214854946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60181a6ff0 con 0x7f601810c560 2024-09-20T18:46:47.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.644+0000 7f601e662640 1 -- 172.21.15.17:0/1214854946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60181a7580 con 0x7f601810c560 2024-09-20T18:46:47.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.645+0000 7f601e662640 1 -- 172.21.15.17:0/1214854946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f601810da40 con 0x7f601810c560 2024-09-20T18:46:47.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.645+0000 7f6015ffb640 1 -- 172.21.15.17:0/1214854946 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f600801b460 con 0x7f601810c560 2024-09-20T18:46:47.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.646+0000 7f6015ffb640 1 --2- 172.21.15.17:0/1214854946 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f600407af80 0x7f600407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:47.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.646+0000 7f6015ffb640 1 -- 172.21.15.17:0/1214854946 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f600809d5f0 con 0x7f601810c560 2024-09-20T18:46:47.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.646+0000 7f600ffff640 1 --2- 172.21.15.17:0/1214854946 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f600407af80 0x7f600407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:47.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.647+0000 7f600ffff640 1 --2- 172.21.15.17:0/1214854946 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f600407af80 0x7f600407d440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f601810bde0 tx=0x7f6000031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:47.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.650+0000 7f6015ffb640 1 -- 172.21.15.17:0/1214854946 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6008068c70 con 0x7f601810c560 2024-09-20T18:46:47.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.846+0000 7f601e662640 1 -- 172.21.15.17:0/1214854946 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f60181a37c0 con 0x7f600407af80 2024-09-20T18:46:47.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.856+0000 7f6015ffb640 1 -- 172.21.15.17:0/1214854946 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f60181a37c0 con 0x7f600407af80 2024-09-20T18:46:47.873 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:46:47.874 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (8m) 2m ago 19m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:46:47.874 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (11m) 2m ago 19m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:46:47.874 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (10m) 2m ago 18m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:46:47.874 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (6m) 2m ago 19m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:46:47.874 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (6m) 2m ago 18m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:46:47.874 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (7m) 2m ago 18m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:46:47.874 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (2m) 2m ago 13m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:46:47.874 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (2m) 2m ago 13m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:46:47.874 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (13m) 2m ago 13m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:46:47.874 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (2m) 2m ago 13m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:46:47.874 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (10m) 2m ago 20m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:46:47.874 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (9m) 2m ago 18m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:46:47.874 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (6m) 2m ago 20m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:46:47.874 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (6m) 2m ago 18m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:46:47.875 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (8m) 2m ago 19m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:46:47.875 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (8m) 2m ago 18m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:46:47.875 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (6m) 2m ago 17m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:46:47.875 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (5m) 2m ago 16m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:46:47.875 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (4m) 2m ago 16m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:46:47.875 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (4m) 2m ago 15m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:46:47.875 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (3m) 2m ago 15m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:46:47.875 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (3m) 2m ago 14m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:46:47.875 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (8m) 2m ago 18m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:46:47.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.858+0000 7f601e662640 1 -- 172.21.15.17:0/1214854946 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f600407af80 msgr2=0x7f600407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:47.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.858+0000 7f601e662640 1 --2- 172.21.15.17:0/1214854946 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f600407af80 0x7f600407d440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f601810bde0 tx=0x7f6000031400 comp rx=0 tx=0).stop 2024-09-20T18:46:47.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.858+0000 7f601e662640 1 -- 172.21.15.17:0/1214854946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f601810c560 msgr2=0x7f60181a2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:47.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.858+0000 7f601e662640 1 --2- 172.21.15.17:0/1214854946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f601810c560 0x7f60181a2430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f600800b420 tx=0x7f600800b8e0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.858+0000 7f601e662640 1 -- 172.21.15.17:0/1214854946 shutdown_connections 2024-09-20T18:46:47.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.858+0000 7f601e662640 1 --2- 172.21.15.17:0/1214854946 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f600407af80 0x7f600407d440 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.858+0000 7f601e662640 1 --2- 172.21.15.17:0/1214854946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f601810cf10 0x7f60181a2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.858+0000 7f601e662640 1 --2- 172.21.15.17:0/1214854946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f601810c560 0x7f60181a2430 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.858+0000 7f601e662640 1 -- 172.21.15.17:0/1214854946 >> 172.21.15.17:0/1214854946 conn(0x7f601806c5b0 msgr2=0x7f601810a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:47.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.858+0000 7f601e662640 1 -- 172.21.15.17:0/1214854946 shutdown_connections 2024-09-20T18:46:47.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.858+0000 7f601e662640 1 -- 172.21.15.17:0/1214854946 wait complete. 2024-09-20T18:46:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.941+0000 7fdf74b79640 1 -- 172.21.15.17:0/1523717799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf70100250 msgr2=0x7fdf70100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.941+0000 7fdf74b79640 1 --2- 172.21.15.17:0/1523717799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf70100250 0x7fdf70100630 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000a990 tx=0x7fdf6002b7d0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.941+0000 7fdf74b79640 1 -- 172.21.15.17:0/1523717799 shutdown_connections 2024-09-20T18:46:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.941+0000 7fdf74b79640 1 --2- 172.21.15.17:0/1523717799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf70100c00 0x7fdf70104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.941+0000 7fdf74b79640 1 --2- 172.21.15.17:0/1523717799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf70100250 0x7fdf70100630 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.941+0000 7fdf74b79640 1 -- 172.21.15.17:0/1523717799 >> 172.21.15.17:0/1523717799 conn(0x7fdf700fbc90 msgr2=0x7fdf700fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.941+0000 7fdf74b79640 1 -- 172.21.15.17:0/1523717799 shutdown_connections 2024-09-20T18:46:47.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.942+0000 7fdf74b79640 1 -- 172.21.15.17:0/1523717799 wait complete. 2024-09-20T18:46:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.942+0000 7fdf74b79640 1 Processor -- start 2024-09-20T18:46:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.942+0000 7fdf74b79640 1 -- start start 2024-09-20T18:46:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.943+0000 7fdf74b79640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf70100250 0x7fdf7019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.943+0000 7fdf74b79640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf70100c00 0x7fdf7019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.943+0000 7fdf74b79640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7010cbb0 con 0x7fdf70100250 2024-09-20T18:46:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.943+0000 7fdf74b79640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7010ca30 con 0x7fdf70100c00 2024-09-20T18:46:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.943+0000 7fdf6e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf70100250 0x7fdf7019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.943+0000 7fdf6e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf70100250 0x7fdf7019d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39984/0 (socket says 172.21.15.17:39984) 2024-09-20T18:46:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.943+0000 7fdf6e59c640 1 -- 172.21.15.17:0/340300191 learned_addr learned my addr 172.21.15.17:0/340300191 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:46:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.943+0000 7fdf6dd9b640 1 --2- 172.21.15.17:0/340300191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf70100c00 0x7fdf7019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.943+0000 7fdf6e59c640 1 -- 172.21.15.17:0/340300191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf70100c00 msgr2=0x7fdf7019dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.943+0000 7fdf6e59c640 1 --2- 172.21.15.17:0/340300191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf70100c00 0x7fdf7019dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.943+0000 7fdf6e59c640 1 -- 172.21.15.17:0/340300191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf70197880 con 0x7fdf70100250 2024-09-20T18:46:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.943+0000 7fdf6e59c640 1 --2- 172.21.15.17:0/340300191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf70100250 0x7fdf7019d6b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdf60006010 tx=0x7fdf60004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.944+0000 7fdf5f7fe640 1 -- 172.21.15.17:0/340300191 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf60008e90 con 0x7fdf70100250 2024-09-20T18:46:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.944+0000 7fdf74b79640 1 -- 172.21.15.17:0/340300191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf70197b10 con 0x7fdf70100250 2024-09-20T18:46:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.944+0000 7fdf74b79640 1 -- 172.21.15.17:0/340300191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf70198040 con 0x7fdf70100250 2024-09-20T18:46:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.944+0000 7fdf5f7fe640 1 -- 172.21.15.17:0/340300191 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdf60045070 con 0x7fdf70100250 2024-09-20T18:46:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.944+0000 7fdf5f7fe640 1 -- 172.21.15.17:0/340300191 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf600035f0 con 0x7fdf70100250 2024-09-20T18:46:47.963 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:47 smithi172 ceph-mon[80431]: pgmap v341: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:47.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.945+0000 7fdf74b79640 1 -- 172.21.15.17:0/340300191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf70101730 con 0x7fdf70100250 2024-09-20T18:46:47.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.946+0000 7fdf5f7fe640 1 -- 172.21.15.17:0/340300191 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdf60032070 con 0x7fdf70100250 2024-09-20T18:46:47.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.946+0000 7fdf5f7fe640 1 --2- 172.21.15.17:0/340300191 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf5807af80 0x7fdf5807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:47.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.946+0000 7fdf5f7fe640 1 -- 172.21.15.17:0/340300191 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fdf60008030 con 0x7fdf70100250 2024-09-20T18:46:47.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.946+0000 7fdf6dd9b640 1 --2- 172.21.15.17:0/340300191 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf5807af80 0x7fdf5807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:47.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.947+0000 7fdf6dd9b640 1 --2- 172.21.15.17:0/340300191 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf5807af80 0x7fdf5807d440 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdf700fc440 tx=0x7fdf6400b410 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:47.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:47.951+0000 7fdf5f7fe640 1 -- 172.21.15.17:0/340300191 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdf6008a440 con 0x7fdf70100250 2024-09-20T18:46:48.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.213+0000 7fdf74b79640 1 -- 172.21.15.17:0/340300191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fdf70198d60 con 0x7fdf70100250 2024-09-20T18:46:48.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.214+0000 7fdf5f7fe640 1 -- 172.21.15.17:0/340300191 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fdf6008f2f0 con 0x7fdf70100250 2024-09-20T18:46:48.231 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:46:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:46:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:46:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:46:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:46:48.232 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:46:48.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:46:48.232 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:46:48.232 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:46:48.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:46:48.232 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:46:48.232 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:46:48.232 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:46:48.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:46:48.232 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:46:48.232 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:46:48.232 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:46:48.232 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:46:48.232 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:46:48.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.217+0000 7fdf74b79640 1 -- 172.21.15.17:0/340300191 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf5807af80 msgr2=0x7fdf5807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:48.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.217+0000 7fdf74b79640 1 --2- 172.21.15.17:0/340300191 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf5807af80 0x7fdf5807d440 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdf700fc440 tx=0x7fdf6400b410 comp rx=0 tx=0).stop 2024-09-20T18:46:48.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.217+0000 7fdf74b79640 1 -- 172.21.15.17:0/340300191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf70100250 msgr2=0x7fdf7019d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:48.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.217+0000 7fdf74b79640 1 --2- 172.21.15.17:0/340300191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf70100250 0x7fdf7019d6b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdf60006010 tx=0x7fdf60004270 comp rx=0 tx=0).stop 2024-09-20T18:46:48.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.217+0000 7fdf74b79640 1 -- 172.21.15.17:0/340300191 shutdown_connections 2024-09-20T18:46:48.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.217+0000 7fdf74b79640 1 --2- 172.21.15.17:0/340300191 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf5807af80 0x7fdf5807d440 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.217+0000 7fdf74b79640 1 --2- 172.21.15.17:0/340300191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf70100c00 0x7fdf7019dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.217+0000 7fdf74b79640 1 --2- 172.21.15.17:0/340300191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf70100250 0x7fdf7019d6b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.217+0000 7fdf74b79640 1 -- 172.21.15.17:0/340300191 >> 172.21.15.17:0/340300191 conn(0x7fdf700fbc90 msgr2=0x7fdf700fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:48.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.217+0000 7fdf74b79640 1 -- 172.21.15.17:0/340300191 shutdown_connections 2024-09-20T18:46:48.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.217+0000 7fdf74b79640 1 -- 172.21.15.17:0/340300191 wait complete. 2024-09-20T18:46:48.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.301+0000 7f836224e640 1 -- 172.21.15.17:0/3194623936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f835c102ac0 msgr2=0x7f835c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:48.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.301+0000 7f836224e640 1 --2- 172.21.15.17:0/3194623936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f835c102ac0 0x7f835c102ea0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f834c009880 tx=0x7f834c02a530 comp rx=0 tx=0).stop 2024-09-20T18:46:48.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.301+0000 7f836224e640 1 -- 172.21.15.17:0/3194623936 shutdown_connections 2024-09-20T18:46:48.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.301+0000 7f836224e640 1 --2- 172.21.15.17:0/3194623936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835c1033e0 0x7f835c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.301+0000 7f836224e640 1 --2- 172.21.15.17:0/3194623936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f835c102ac0 0x7f835c102ea0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.301+0000 7f836224e640 1 -- 172.21.15.17:0/3194623936 >> 172.21.15.17:0/3194623936 conn(0x7f835c0fc520 msgr2=0x7f835c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:48.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.301+0000 7f836224e640 1 -- 172.21.15.17:0/3194623936 shutdown_connections 2024-09-20T18:46:48.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.301+0000 7f836224e640 1 -- 172.21.15.17:0/3194623936 wait complete. 2024-09-20T18:46:48.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.302+0000 7f836224e640 1 Processor -- start 2024-09-20T18:46:48.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.302+0000 7f836224e640 1 -- start start 2024-09-20T18:46:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.302+0000 7f836224e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f835c102ac0 0x7f835c100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.302+0000 7f836224e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835c1033e0 0x7f835c100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.302+0000 7f836224e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f835c10ee50 con 0x7f835c102ac0 2024-09-20T18:46:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.302+0000 7f836224e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f835c10ecd0 con 0x7f835c1033e0 2024-09-20T18:46:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.302+0000 7f835b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f835c102ac0 0x7f835c100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.302+0000 7f835b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f835c102ac0 0x7f835c100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39994/0 (socket says 172.21.15.17:39994) 2024-09-20T18:46:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.302+0000 7f835b7fe640 1 -- 172.21.15.17:0/672295201 learned_addr learned my addr 172.21.15.17:0/672295201 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:46:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.303+0000 7f835affd640 1 --2- 172.21.15.17:0/672295201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835c1033e0 0x7f835c100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.303+0000 7f835b7fe640 1 -- 172.21.15.17:0/672295201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835c1033e0 msgr2=0x7f835c100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.303+0000 7f835b7fe640 1 --2- 172.21.15.17:0/672295201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835c1033e0 0x7f835c100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.303+0000 7f835b7fe640 1 -- 172.21.15.17:0/672295201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835c1011a0 con 0x7f835c102ac0 2024-09-20T18:46:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.303+0000 7f835affd640 1 --2- 172.21.15.17:0/672295201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835c1033e0 0x7f835c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:46:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.303+0000 7f835b7fe640 1 --2- 172.21.15.17:0/672295201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f835c102ac0 0x7f835c100720 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f834c031460 tx=0x7f834c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:48.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.303+0000 7f8358ff9640 1 -- 172.21.15.17:0/672295201 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f834c03f070 con 0x7f835c102ac0 2024-09-20T18:46:48.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.303+0000 7f8358ff9640 1 -- 172.21.15.17:0/672295201 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f834c0044d0 con 0x7f835c102ac0 2024-09-20T18:46:48.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.303+0000 7f836224e640 1 -- 172.21.15.17:0/672295201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835c101430 con 0x7f835c102ac0 2024-09-20T18:46:48.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.303+0000 7f8358ff9640 1 -- 172.21.15.17:0/672295201 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f834c035030 con 0x7f835c102ac0 2024-09-20T18:46:48.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.303+0000 7f836224e640 1 -- 172.21.15.17:0/672295201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f835c1a3e20 con 0x7f835c102ac0 2024-09-20T18:46:48.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.304+0000 7f836224e640 1 -- 172.21.15.17:0/672295201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f835c06aa90 con 0x7f835c102ac0 2024-09-20T18:46:48.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.305+0000 7f8358ff9640 1 -- 172.21.15.17:0/672295201 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f834c042070 con 0x7f835c102ac0 2024-09-20T18:46:48.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.305+0000 7f8358ff9640 1 --2- 172.21.15.17:0/672295201 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f834807af40 0x7f834807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:48.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.306+0000 7f8358ff9640 1 -- 172.21.15.17:0/672295201 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f834c0bec00 con 0x7f835c102ac0 2024-09-20T18:46:48.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.306+0000 7f835affd640 1 --2- 172.21.15.17:0/672295201 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f834807af40 0x7f834807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:48.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.306+0000 7f835affd640 1 --2- 172.21.15.17:0/672295201 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f834807af40 0x7f834807d400 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8344006fd0 tx=0x7f8344008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:48.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.310+0000 7f8358ff9640 1 -- 172.21.15.17:0/672295201 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f834c0c4020 con 0x7f835c102ac0 2024-09-20T18:46:48.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.535+0000 7f836224e640 1 -- 172.21.15.17:0/672295201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f835c1a40d0 con 0x7f835c102ac0 2024-09-20T18:46:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.536+0000 7f8358ff9640 1 -- 172.21.15.17:0/672295201 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f834c07fe20 con 0x7f835c102ac0 2024-09-20T18:46:48.553 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:46:48.553 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:46:48.553 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:46:48.553 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:46:48.553 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:46:48.553 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:46:48.553 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:46:48.554 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:46:48.554 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:46:48.554 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:46:48.554 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:46:48.554 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:46:48.554 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:46:48.554 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:46:48.554 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:46:48.554 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:46:48.554 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:46:48.554 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:46:48.554 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:46:48.554 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:46:48.554 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:46:48.555 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:46:48.555 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:46:48.555 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:46:48.555 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:46:48.555 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:46:48.555 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:46:48.555 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:46:48.555 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:46:48.555 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:46:48.555 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:46:48.555 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:46:48.555 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:46:48.555 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:46:48.555 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:46:48.556 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:46:48.556 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:46:48.556 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:46:48.556 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:46:48.556 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:46:48.556 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:46:48.556 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:46:48.556 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:46:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:46:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.539+0000 7f836224e640 1 -- 172.21.15.17:0/672295201 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f834807af40 msgr2=0x7f834807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.539+0000 7f836224e640 1 --2- 172.21.15.17:0/672295201 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f834807af40 0x7f834807d400 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8344006fd0 tx=0x7f8344008040 comp rx=0 tx=0).stop 2024-09-20T18:46:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.539+0000 7f836224e640 1 -- 172.21.15.17:0/672295201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f835c102ac0 msgr2=0x7f835c100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.539+0000 7f836224e640 1 --2- 172.21.15.17:0/672295201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f835c102ac0 0x7f835c100720 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f834c031460 tx=0x7f834c0048f0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.539+0000 7f836224e640 1 -- 172.21.15.17:0/672295201 shutdown_connections 2024-09-20T18:46:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.539+0000 7f836224e640 1 --2- 172.21.15.17:0/672295201 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f834807af40 0x7f834807d400 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.539+0000 7f836224e640 1 --2- 172.21.15.17:0/672295201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835c1033e0 0x7f835c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.539+0000 7f836224e640 1 --2- 172.21.15.17:0/672295201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f835c102ac0 0x7f835c100720 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.539+0000 7f836224e640 1 -- 172.21.15.17:0/672295201 >> 172.21.15.17:0/672295201 conn(0x7f835c0fc520 msgr2=0x7f835c10af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.539+0000 7f836224e640 1 -- 172.21.15.17:0/672295201 shutdown_connections 2024-09-20T18:46:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.539+0000 7f836224e640 1 -- 172.21.15.17:0/672295201 wait complete. 2024-09-20T18:46:48.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.625+0000 7f782b68f640 1 -- 172.21.15.17:0/2846130374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7824100ff0 msgr2=0x7f782410dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:48.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.625+0000 7f782b68f640 1 --2- 172.21.15.17:0/2846130374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7824100ff0 0x7f782410dcb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7814009880 tx=0x7f781402a490 comp rx=0 tx=0).stop 2024-09-20T18:46:48.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.625+0000 7f782b68f640 1 -- 172.21.15.17:0/2846130374 shutdown_connections 2024-09-20T18:46:48.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.625+0000 7f782b68f640 1 --2- 172.21.15.17:0/2846130374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7824100ff0 0x7f782410dcb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.625+0000 7f782b68f640 1 --2- 172.21.15.17:0/2846130374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7824100640 0x7f7824100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.625+0000 7f782b68f640 1 -- 172.21.15.17:0/2846130374 >> 172.21.15.17:0/2846130374 conn(0x7f78240fc550 msgr2=0x7f78240fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:48.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.625+0000 7f782b68f640 1 -- 172.21.15.17:0/2846130374 shutdown_connections 2024-09-20T18:46:48.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.625+0000 7f782b68f640 1 -- 172.21.15.17:0/2846130374 wait complete. 2024-09-20T18:46:48.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.626+0000 7f782b68f640 1 Processor -- start 2024-09-20T18:46:48.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.626+0000 7f782b68f640 1 -- start start 2024-09-20T18:46:48.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.626+0000 7f782b68f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7824100640 0x7f782419f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:48.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.626+0000 7f782b68f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7824100ff0 0x7f782419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:48.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.626+0000 7f782b68f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7824110f90 con 0x7f7824100ff0 2024-09-20T18:46:48.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.626+0000 7f782b68f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7824110e10 con 0x7f7824100640 2024-09-20T18:46:48.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.626+0000 7f7828c2a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7824100ff0 0x7f782419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:48.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.626+0000 7f7828c2a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7824100ff0 0x7f782419fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40020/0 (socket says 172.21.15.17:40020) 2024-09-20T18:46:48.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.626+0000 7f7828c2a640 1 -- 172.21.15.17:0/4174025058 learned_addr learned my addr 172.21.15.17:0/4174025058 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:46:48.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.626+0000 7f782942b640 1 --2- 172.21.15.17:0/4174025058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7824100640 0x7f782419f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:48.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.626+0000 7f7828c2a640 1 -- 172.21.15.17:0/4174025058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7824100640 msgr2=0x7f782419f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:48.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.626+0000 7f7828c2a640 1 --2- 172.21.15.17:0/4174025058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7824100640 0x7f782419f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.626+0000 7f7828c2a640 1 -- 172.21.15.17:0/4174025058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78241999c0 con 0x7f7824100ff0 2024-09-20T18:46:48.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.627+0000 7f7828c2a640 1 --2- 172.21.15.17:0/4174025058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7824100ff0 0x7f782419fd40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7814031460 tx=0x7f78140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:48.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.627+0000 7f781a7fc640 1 -- 172.21.15.17:0/4174025058 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f781403f070 con 0x7f7824100ff0 2024-09-20T18:46:48.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.627+0000 7f782b68f640 1 -- 172.21.15.17:0/4174025058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7824199c50 con 0x7f7824100ff0 2024-09-20T18:46:48.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.627+0000 7f781a7fc640 1 -- 172.21.15.17:0/4174025058 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f78140035f0 con 0x7f7824100ff0 2024-09-20T18:46:48.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.627+0000 7f781a7fc640 1 -- 172.21.15.17:0/4174025058 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7814035030 con 0x7f7824100ff0 2024-09-20T18:46:48.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.627+0000 7f782b68f640 1 -- 172.21.15.17:0/4174025058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f782419a1e0 con 0x7f7824100ff0 2024-09-20T18:46:48.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.628+0000 7f782b68f640 1 -- 172.21.15.17:0/4174025058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f782406a580 con 0x7f7824100ff0 2024-09-20T18:46:48.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.629+0000 7f781a7fc640 1 -- 172.21.15.17:0/4174025058 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7814042070 con 0x7f7824100ff0 2024-09-20T18:46:48.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.629+0000 7f781a7fc640 1 --2- 172.21.15.17:0/4174025058 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f781007af30 0x7f781007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:48.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.629+0000 7f781a7fc640 1 -- 172.21.15.17:0/4174025058 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f78140be970 con 0x7f7824100ff0 2024-09-20T18:46:48.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.629+0000 7f782942b640 1 --2- 172.21.15.17:0/4174025058 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f781007af30 0x7f781007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:48.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.630+0000 7f782942b640 1 --2- 172.21.15.17:0/4174025058 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f781007af30 0x7f781007d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f782419ab00 tx=0x7f782000b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:48.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.634+0000 7f781a7fc640 1 -- 172.21.15.17:0/4174025058 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78140c0e20 con 0x7f7824100ff0 2024-09-20T18:46:48.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.839+0000 7f782b68f640 1 -- 172.21.15.17:0/4174025058 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f782419aef0 con 0x7f781007af30 2024-09-20T18:46:48.856 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:48 smithi017 ceph-mon[108970]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:46:48.856 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:48 smithi017 ceph-mon[108970]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:46:48.856 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:48 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/340300191' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:46:48.856 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:48 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/672295201' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:46:48.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.840+0000 7f781a7fc640 1 -- 172.21.15.17:0/4174025058 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f782419aef0 con 0x7f781007af30 2024-09-20T18:46:48.857 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:46:48.857 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:46:48.857 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:46:48.857 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:46:48.857 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:46:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:46:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:46:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:46:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:46:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:46:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:46:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:46:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:46:48.858 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:46:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.842+0000 7f782b68f640 1 -- 172.21.15.17:0/4174025058 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f781007af30 msgr2=0x7f781007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.842+0000 7f782b68f640 1 --2- 172.21.15.17:0/4174025058 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f781007af30 0x7f781007d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f782419ab00 tx=0x7f782000b390 comp rx=0 tx=0).stop 2024-09-20T18:46:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.842+0000 7f782b68f640 1 -- 172.21.15.17:0/4174025058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7824100ff0 msgr2=0x7f782419fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.842+0000 7f782b68f640 1 --2- 172.21.15.17:0/4174025058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7824100ff0 0x7f782419fd40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7814031460 tx=0x7f78140045e0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.842+0000 7f782b68f640 1 -- 172.21.15.17:0/4174025058 shutdown_connections 2024-09-20T18:46:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.842+0000 7f782b68f640 1 --2- 172.21.15.17:0/4174025058 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f781007af30 0x7f781007d3f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.842+0000 7f782b68f640 1 --2- 172.21.15.17:0/4174025058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7824100ff0 0x7f782419fd40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.842+0000 7f782b68f640 1 --2- 172.21.15.17:0/4174025058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7824100640 0x7f782419f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.842+0000 7f782b68f640 1 -- 172.21.15.17:0/4174025058 >> 172.21.15.17:0/4174025058 conn(0x7f78240fc550 msgr2=0x7f78240fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:48.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.843+0000 7f782b68f640 1 -- 172.21.15.17:0/4174025058 shutdown_connections 2024-09-20T18:46:48.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.843+0000 7f782b68f640 1 -- 172.21.15.17:0/4174025058 wait complete. 2024-09-20T18:46:48.911 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:48 smithi172 ceph-mon[80431]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:46:48.911 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:48 smithi172 ceph-mon[80431]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:46:48.911 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:48 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/340300191' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:46:48.911 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:48 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/672295201' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:46:48.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.927+0000 7f79e681b640 1 -- 172.21.15.17:0/2294048254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e0107900 msgr2=0x7f79e0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:48.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.927+0000 7f79e681b640 1 --2- 172.21.15.17:0/2294048254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e0107900 0x7f79e0107ce0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009880 tx=0x7f79d002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.927+0000 7f79e681b640 1 -- 172.21.15.17:0/2294048254 shutdown_connections 2024-09-20T18:46:48.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.927+0000 7f79e681b640 1 --2- 172.21.15.17:0/2294048254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79e0101900 0x7f79e0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.927+0000 7f79e681b640 1 --2- 172.21.15.17:0/2294048254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e0107900 0x7f79e0107ce0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.927+0000 7f79e681b640 1 -- 172.21.15.17:0/2294048254 >> 172.21.15.17:0/2294048254 conn(0x7f79e00fd600 msgr2=0x7f79e00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:48.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.927+0000 7f79e681b640 1 -- 172.21.15.17:0/2294048254 shutdown_connections 2024-09-20T18:46:48.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.927+0000 7f79e681b640 1 -- 172.21.15.17:0/2294048254 wait complete. 2024-09-20T18:46:48.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.928+0000 7f79e681b640 1 Processor -- start 2024-09-20T18:46:48.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.928+0000 7f79e681b640 1 -- start start 2024-09-20T18:46:48.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.928+0000 7f79e681b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e0101900 0x7f79e00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:48.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.928+0000 7f79e681b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79e0107900 0x7f79e0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:48.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.928+0000 7f79e681b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f79e010edd0 con 0x7f79e0101900 2024-09-20T18:46:48.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.928+0000 7f79e681b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79e010ec50 con 0x7f79e0107900 2024-09-20T18:46:48.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.928+0000 7f79dffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e0101900 0x7f79e00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:48.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.928+0000 7f79dffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e0101900 0x7f79e00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40034/0 (socket says 172.21.15.17:40034) 2024-09-20T18:46:48.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.928+0000 7f79dffff640 1 -- 172.21.15.17:0/3780738583 learned_addr learned my addr 172.21.15.17:0/3780738583 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:46:48.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.928+0000 7f79df7fe640 1 --2- 172.21.15.17:0/3780738583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79e0107900 0x7f79e0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:48.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.929+0000 7f79dffff640 1 -- 172.21.15.17:0/3780738583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79e0107900 msgr2=0x7f79e0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:48.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.929+0000 7f79dffff640 1 --2- 172.21.15.17:0/3780738583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79e0107900 0x7f79e0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:48.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.929+0000 7f79dffff640 1 -- 172.21.15.17:0/3780738583 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e0074f70 con 0x7f79e0101900 2024-09-20T18:46:48.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.929+0000 7f79dffff640 1 --2- 172.21.15.17:0/3780738583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e0101900 0x7f79e00744f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f79d0031460 tx=0x7f79d00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:48.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.929+0000 7f79dd7fa640 1 -- 172.21.15.17:0/3780738583 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79d003f070 con 0x7f79e0101900 2024-09-20T18:46:48.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.929+0000 7f79dd7fa640 1 -- 172.21.15.17:0/3780738583 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f79d00035f0 con 0x7f79e0101900 2024-09-20T18:46:48.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.929+0000 7f79e681b640 1 -- 172.21.15.17:0/3780738583 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e0075200 con 0x7f79e0101900 2024-09-20T18:46:48.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.929+0000 7f79dd7fa640 1 -- 172.21.15.17:0/3780738583 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79d0035030 con 0x7f79e0101900 2024-09-20T18:46:48.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.929+0000 7f79e681b640 1 -- 172.21.15.17:0/3780738583 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e01a3d60 con 0x7f79e0101900 2024-09-20T18:46:48.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.930+0000 7f79e681b640 1 -- 172.21.15.17:0/3780738583 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e0103040 con 0x7f79e0101900 2024-09-20T18:46:48.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.931+0000 7f79dd7fa640 1 -- 172.21.15.17:0/3780738583 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f79d0042070 con 0x7f79e0101900 2024-09-20T18:46:48.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.931+0000 7f79dd7fa640 1 --2- 172.21.15.17:0/3780738583 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f79c807af30 0x7f79c807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:46:48.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.931+0000 7f79dd7fa640 1 -- 172.21.15.17:0/3780738583 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f79d00bea10 con 0x7f79e0101900 2024-09-20T18:46:48.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.931+0000 7f79df7fe640 1 --2- 172.21.15.17:0/3780738583 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f79c807af30 0x7f79c807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:46:48.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.932+0000 7f79df7fe640 1 --2- 172.21.15.17:0/3780738583 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f79c807af30 0x7f79c807d3f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f79e0075f80 tx=0x7f79d400b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:46:48.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:48.936+0000 7f79dd7fa640 1 -- 172.21.15.17:0/3780738583 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f79d0089f70 con 0x7f79e0101900 2024-09-20T18:46:49.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:49.197+0000 7f79e681b640 1 -- 172.21.15.17:0/3780738583 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f79e0075a20 con 0x7f79e0101900 2024-09-20T18:46:49.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:49.198+0000 7f79dd7fa640 1 -- 172.21.15.17:0/3780738583 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f79d008ee20 con 0x7f79e0101900 2024-09-20T18:46:49.215 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:46:49.215 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:46:49.215 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:46:49.215 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:46:49.215 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:46:49.215 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:46:49.216 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:46:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:49.200+0000 7f79e681b640 1 -- 172.21.15.17:0/3780738583 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f79c807af30 msgr2=0x7f79c807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:49.200+0000 7f79e681b640 1 --2- 172.21.15.17:0/3780738583 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f79c807af30 0x7f79c807d3f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f79e0075f80 tx=0x7f79d400b390 comp rx=0 tx=0).stop 2024-09-20T18:46:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:49.200+0000 7f79e681b640 1 -- 172.21.15.17:0/3780738583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e0101900 msgr2=0x7f79e00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:46:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:49.200+0000 7f79e681b640 1 --2- 172.21.15.17:0/3780738583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e0101900 0x7f79e00744f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f79d0031460 tx=0x7f79d00045e0 comp rx=0 tx=0).stop 2024-09-20T18:46:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:49.200+0000 7f79e681b640 1 -- 172.21.15.17:0/3780738583 shutdown_connections 2024-09-20T18:46:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:49.200+0000 7f79e681b640 1 --2- 172.21.15.17:0/3780738583 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f79c807af30 0x7f79c807d3f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:49.200+0000 7f79e681b640 1 --2- 172.21.15.17:0/3780738583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79e0107900 0x7f79e0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:49.200+0000 7f79e681b640 1 --2- 172.21.15.17:0/3780738583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e0101900 0x7f79e00744f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:46:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:49.200+0000 7f79e681b640 1 -- 172.21.15.17:0/3780738583 >> 172.21.15.17:0/3780738583 conn(0x7f79e00fd600 msgr2=0x7f79e00fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:46:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:49.200+0000 7f79e681b640 1 -- 172.21.15.17:0/3780738583 shutdown_connections 2024-09-20T18:46:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:46:49.200+0000 7f79e681b640 1 -- 172.21.15.17:0/3780738583 wait complete. 2024-09-20T18:46:49.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:49 smithi017 ceph-mon[108970]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:46:49.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:49 smithi017 ceph-mon[108970]: pgmap v342: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:49.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:49 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3780738583' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:46:49.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:49 smithi172 ceph-mon[80431]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:46:49.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:49 smithi172 ceph-mon[80431]: pgmap v342: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:49.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:49 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3780738583' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:46:50.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:50 smithi017 ceph-mon[108970]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:46:50.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:50 smithi172 ceph-mon[80431]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:46:51.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:51 smithi017 ceph-mon[108970]: pgmap v343: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:51.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:51 smithi172 ceph-mon[80431]: pgmap v343: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:52.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:46:52.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:46:53.862 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:53 smithi172 ceph-mon[80431]: pgmap v344: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:53.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:53 smithi017 ceph-mon[108970]: pgmap v344: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:55.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:55 smithi017 ceph-mon[108970]: pgmap v345: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:55.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:55 smithi172 ceph-mon[80431]: pgmap v345: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:57.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:57 smithi017 ceph-mon[108970]: pgmap v346: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:57.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:57 smithi172 ceph-mon[80431]: pgmap v346: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:59.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:46:59 smithi017 ceph-mon[108970]: pgmap v347: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:46:59.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:46:59 smithi172 ceph-mon[80431]: pgmap v347: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:01.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:01 smithi017 ceph-mon[108970]: pgmap v348: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:01.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:01 smithi172 ceph-mon[80431]: pgmap v348: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:03.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:03 smithi017 ceph-mon[108970]: pgmap v349: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:03.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:03 smithi172 ceph-mon[80431]: pgmap v349: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:05.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:05 smithi017 ceph-mon[108970]: pgmap v350: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:05.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:05 smithi172 ceph-mon[80431]: pgmap v350: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:07.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:07 smithi017 ceph-mon[108970]: pgmap v351: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:07.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:47:07.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:07 smithi172 ceph-mon[80431]: pgmap v351: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:07.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:47:09.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:09 smithi017 ceph-mon[108970]: pgmap v352: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:09.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:09 smithi172 ceph-mon[80431]: pgmap v352: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:11.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:11 smithi017 ceph-mon[108970]: pgmap v353: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:11.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:11 smithi172 ceph-mon[80431]: pgmap v353: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:13.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:13 smithi017 ceph-mon[108970]: pgmap v354: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:13.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:13 smithi172 ceph-mon[80431]: pgmap v354: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:15.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:15 smithi017 ceph-mon[108970]: pgmap v355: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:15.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:15 smithi172 ceph-mon[80431]: pgmap v355: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:17.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:17 smithi017 ceph-mon[108970]: pgmap v356: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:17.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:17 smithi172 ceph-mon[80431]: pgmap v356: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:19.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.299+0000 7f64b7871640 1 -- 172.21.15.17:0/2304033433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b0074590 msgr2=0x7f64b0074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:19.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.299+0000 7f64b7871640 1 --2- 172.21.15.17:0/2304033433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b0074590 0x7f64b0074970 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f64ac009880 tx=0x7f64ac02a530 comp rx=0 tx=0).stop 2024-09-20T18:47:19.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.299+0000 7f64b7871640 1 -- 172.21.15.17:0/2304033433 shutdown_connections 2024-09-20T18:47:19.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.300+0000 7f64b7871640 1 --2- 172.21.15.17:0/2304033433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b0074eb0 0x7f64b01123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:19.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.300+0000 7f64b7871640 1 --2- 172.21.15.17:0/2304033433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b0074590 0x7f64b0074970 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:19.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.300+0000 7f64b7871640 1 -- 172.21.15.17:0/2304033433 >> 172.21.15.17:0/2304033433 conn(0x7f64b00fd600 msgr2=0x7f64b00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:19.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.300+0000 7f64b7871640 1 -- 172.21.15.17:0/2304033433 shutdown_connections 2024-09-20T18:47:19.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.300+0000 7f64b7871640 1 -- 172.21.15.17:0/2304033433 wait complete. 2024-09-20T18:47:19.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.300+0000 7f64b7871640 1 Processor -- start 2024-09-20T18:47:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.300+0000 7f64b7871640 1 -- start start 2024-09-20T18:47:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.301+0000 7f64b7871640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b0074590 0x7f64b019dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.301+0000 7f64b7871640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b0074eb0 0x7f64b019e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.301+0000 7f64b7871640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f64b01153d0 con 0x7f64b0074eb0 2024-09-20T18:47:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.301+0000 7f64b7871640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64b0115250 con 0x7f64b0074590 2024-09-20T18:47:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.301+0000 7f64b4e0c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b0074eb0 0x7f64b019e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.301+0000 7f64b4e0c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b0074eb0 0x7f64b019e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55222/0 (socket says 172.21.15.17:55222) 2024-09-20T18:47:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.301+0000 7f64b4e0c640 1 -- 172.21.15.17:0/383186163 learned_addr learned my addr 172.21.15.17:0/383186163 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:47:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.301+0000 7f64b560d640 1 --2- 172.21.15.17:0/383186163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b0074590 0x7f64b019dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.301+0000 7f64b4e0c640 1 -- 172.21.15.17:0/383186163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b0074590 msgr2=0x7f64b019dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:19.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.301+0000 7f64b4e0c640 1 --2- 172.21.15.17:0/383186163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b0074590 0x7f64b019dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.301+0000 7f64b4e0c640 1 -- 172.21.15.17:0/383186163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b01a28c0 con 0x7f64b0074eb0 2024-09-20T18:47:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.301+0000 7f64b560d640 1 --2- 172.21.15.17:0/383186163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b0074590 0x7f64b019dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:47:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.301+0000 7f64b4e0c640 1 --2- 172.21.15.17:0/383186163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b0074eb0 0x7f64b019e530 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f64a000d8d0 tx=0x7f64a000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.302+0000 7f64a67fc640 1 -- 172.21.15.17:0/383186163 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64a0017070 con 0x7f64b0074eb0 2024-09-20T18:47:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.302+0000 7f64a67fc640 1 -- 172.21.15.17:0/383186163 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64a0010460 con 0x7f64b0074eb0 2024-09-20T18:47:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.302+0000 7f64b7871640 1 -- 172.21.15.17:0/383186163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b01a2bb0 con 0x7f64b0074eb0 2024-09-20T18:47:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.302+0000 7f64a67fc640 1 -- 172.21.15.17:0/383186163 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64a000f5f0 con 0x7f64b0074eb0 2024-09-20T18:47:19.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.302+0000 7f64b7871640 1 -- 172.21.15.17:0/383186163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b01a3140 con 0x7f64b0074eb0 2024-09-20T18:47:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.303+0000 7f64b7871640 1 -- 172.21.15.17:0/383186163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b0075cd0 con 0x7f64b0074eb0 2024-09-20T18:47:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.304+0000 7f64a67fc640 1 -- 172.21.15.17:0/383186163 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f64a0009a30 con 0x7f64b0074eb0 2024-09-20T18:47:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.304+0000 7f64a67fc640 1 --2- 172.21.15.17:0/383186163 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f649c07af40 0x7f649c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.304+0000 7f64a67fc640 1 -- 172.21.15.17:0/383186163 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f64a009dee0 con 0x7f64b0074eb0 2024-09-20T18:47:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.304+0000 7f64b560d640 1 --2- 172.21.15.17:0/383186163 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f649c07af40 0x7f649c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:19.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.305+0000 7f64b560d640 1 --2- 172.21.15.17:0/383186163 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f649c07af40 0x7f649c07d400 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f64ac000c00 tx=0x7f64ac031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:19.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.309+0000 7f64a67fc640 1 -- 172.21.15.17:0/383186163 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f64a00694e0 con 0x7f64b0074eb0 2024-09-20T18:47:19.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.515+0000 7f64b7871640 1 -- 172.21.15.17:0/383186163 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f64b01a33f0 con 0x7f649c07af40 2024-09-20T18:47:19.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.517+0000 7f64a67fc640 1 -- 172.21.15.17:0/383186163 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f64b01a33f0 con 0x7f649c07af40 2024-09-20T18:47:19.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.519+0000 7f64b7871640 1 -- 172.21.15.17:0/383186163 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f649c07af40 msgr2=0x7f649c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:19.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.519+0000 7f64b7871640 1 --2- 172.21.15.17:0/383186163 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f649c07af40 0x7f649c07d400 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f64ac000c00 tx=0x7f64ac031400 comp rx=0 tx=0).stop 2024-09-20T18:47:19.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.519+0000 7f64b7871640 1 -- 172.21.15.17:0/383186163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b0074eb0 msgr2=0x7f64b019e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:19.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.519+0000 7f64b7871640 1 --2- 172.21.15.17:0/383186163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b0074eb0 0x7f64b019e530 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f64a000d8d0 tx=0x7f64a000dd90 comp rx=0 tx=0).stop 2024-09-20T18:47:19.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.519+0000 7f64b7871640 1 -- 172.21.15.17:0/383186163 shutdown_connections 2024-09-20T18:47:19.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.519+0000 7f64b7871640 1 --2- 172.21.15.17:0/383186163 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f649c07af40 0x7f649c07d400 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:19.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.519+0000 7f64b7871640 1 --2- 172.21.15.17:0/383186163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64b0074eb0 0x7f64b019e530 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:19.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.519+0000 7f64b7871640 1 --2- 172.21.15.17:0/383186163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b0074590 0x7f64b019dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:19.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.519+0000 7f64b7871640 1 -- 172.21.15.17:0/383186163 >> 172.21.15.17:0/383186163 conn(0x7f64b00fd600 msgr2=0x7f64b0104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:19.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.519+0000 7f64b7871640 1 -- 172.21.15.17:0/383186163 shutdown_connections 2024-09-20T18:47:19.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.519+0000 7f64b7871640 1 -- 172.21.15.17:0/383186163 wait complete. 2024-09-20T18:47:19.544 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:47:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.606+0000 7fedd0e15640 1 -- 172.21.15.17:0/3998882913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedcc102ac0 msgr2=0x7fedcc102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.606+0000 7fedd0e15640 1 --2- 172.21.15.17:0/3998882913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedcc102ac0 0x7fedcc102ea0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fedbc009880 tx=0x7fedbc02a530 comp rx=0 tx=0).stop 2024-09-20T18:47:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.606+0000 7fedd0e15640 1 -- 172.21.15.17:0/3998882913 shutdown_connections 2024-09-20T18:47:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.606+0000 7fedd0e15640 1 --2- 172.21.15.17:0/3998882913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedcc1033e0 0x7fedcc10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.606+0000 7fedd0e15640 1 --2- 172.21.15.17:0/3998882913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedcc102ac0 0x7fedcc102ea0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.606+0000 7fedd0e15640 1 -- 172.21.15.17:0/3998882913 >> 172.21.15.17:0/3998882913 conn(0x7fedcc0fc520 msgr2=0x7fedcc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.606+0000 7fedd0e15640 1 -- 172.21.15.17:0/3998882913 shutdown_connections 2024-09-20T18:47:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.606+0000 7fedd0e15640 1 -- 172.21.15.17:0/3998882913 wait complete. 2024-09-20T18:47:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.607+0000 7fedd0e15640 1 Processor -- start 2024-09-20T18:47:19.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.607+0000 7fedd0e15640 1 -- start start 2024-09-20T18:47:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.607+0000 7fedd0e15640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedcc102ac0 0x7fedcc19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.607+0000 7fedd0e15640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedcc1033e0 0x7fedcc19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.607+0000 7fedd0e15640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc10edf0 con 0x7fedcc1033e0 2024-09-20T18:47:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.607+0000 7fedd0e15640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc10ec70 con 0x7fedcc102ac0 2024-09-20T18:47:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.607+0000 7fedc9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedcc1033e0 0x7fedcc19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.607+0000 7fedc9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedcc1033e0 0x7fedcc19db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55236/0 (socket says 172.21.15.17:55236) 2024-09-20T18:47:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.607+0000 7fedc9d9b640 1 -- 172.21.15.17:0/733418945 learned_addr learned my addr 172.21.15.17:0/733418945 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:47:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.607+0000 7fedca59c640 1 --2- 172.21.15.17:0/733418945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedcc102ac0 0x7fedcc19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.607+0000 7fedc9d9b640 1 -- 172.21.15.17:0/733418945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedcc102ac0 msgr2=0x7fedcc19d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:19.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.607+0000 7fedc9d9b640 1 --2- 172.21.15.17:0/733418945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedcc102ac0 0x7fedcc19d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.608+0000 7fedc9d9b640 1 -- 172.21.15.17:0/733418945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedcc1977c0 con 0x7fedcc1033e0 2024-09-20T18:47:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.608+0000 7fedca59c640 1 --2- 172.21.15.17:0/733418945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedcc102ac0 0x7fedcc19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:47:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.608+0000 7fedc9d9b640 1 --2- 172.21.15.17:0/733418945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedcc1033e0 0x7fedcc19db80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fedc000d6d0 tx=0x7fedc000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.608+0000 7fedbb7fe640 1 -- 172.21.15.17:0/733418945 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedc0017070 con 0x7fedcc1033e0 2024-09-20T18:47:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.608+0000 7fedbb7fe640 1 -- 172.21.15.17:0/733418945 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fedc00054e0 con 0x7fedcc1033e0 2024-09-20T18:47:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.608+0000 7fedd0e15640 1 -- 172.21.15.17:0/733418945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedcc197ab0 con 0x7fedcc1033e0 2024-09-20T18:47:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.608+0000 7fedbb7fe640 1 -- 172.21.15.17:0/733418945 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedc0004ae0 con 0x7fedcc1033e0 2024-09-20T18:47:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.608+0000 7fedd0e15640 1 -- 172.21.15.17:0/733418945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedcc198040 con 0x7fedcc1033e0 2024-09-20T18:47:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.609+0000 7fedd0e15640 1 -- 172.21.15.17:0/733418945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedcc06aa90 con 0x7fedcc1033e0 2024-09-20T18:47:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.610+0000 7fedbb7fe640 1 -- 172.21.15.17:0/733418945 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fedc0004de0 con 0x7fedcc1033e0 2024-09-20T18:47:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.610+0000 7fedbb7fe640 1 --2- 172.21.15.17:0/733418945 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fedb407af30 0x7fedb407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.610+0000 7fedbb7fe640 1 -- 172.21.15.17:0/733418945 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fedc009dbf0 con 0x7fedcc1033e0 2024-09-20T18:47:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.610+0000 7fedca59c640 1 --2- 172.21.15.17:0/733418945 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fedb407af30 0x7fedb407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.611+0000 7fedca59c640 1 --2- 172.21.15.17:0/733418945 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fedb407af30 0x7fedb407d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fedbc000c00 tx=0x7fedbc031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.615+0000 7fedbb7fe640 1 -- 172.21.15.17:0/733418945 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fedc00691f0 con 0x7fedcc1033e0 2024-09-20T18:47:19.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.819+0000 7fedd0e15640 1 -- 172.21.15.17:0/733418945 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fedcc1982f0 con 0x7fedb407af30 2024-09-20T18:47:19.835 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:19 smithi017 ceph-mon[108970]: pgmap v357: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:19.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.820+0000 7fedbb7fe640 1 -- 172.21.15.17:0/733418945 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fedcc1982f0 con 0x7fedb407af30 2024-09-20T18:47:19.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.822+0000 7fedd0e15640 1 -- 172.21.15.17:0/733418945 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fedb407af30 msgr2=0x7fedb407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:19.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.822+0000 7fedd0e15640 1 --2- 172.21.15.17:0/733418945 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fedb407af30 0x7fedb407d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fedbc000c00 tx=0x7fedbc031400 comp rx=0 tx=0).stop 2024-09-20T18:47:19.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.822+0000 7fedd0e15640 1 -- 172.21.15.17:0/733418945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedcc1033e0 msgr2=0x7fedcc19db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:19.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.822+0000 7fedd0e15640 1 --2- 172.21.15.17:0/733418945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedcc1033e0 0x7fedcc19db80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fedc000d6d0 tx=0x7fedc000db90 comp rx=0 tx=0).stop 2024-09-20T18:47:19.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.823+0000 7fedd0e15640 1 -- 172.21.15.17:0/733418945 shutdown_connections 2024-09-20T18:47:19.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.823+0000 7fedd0e15640 1 --2- 172.21.15.17:0/733418945 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fedb407af30 0x7fedb407d3f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:19.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.823+0000 7fedd0e15640 1 --2- 172.21.15.17:0/733418945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedcc1033e0 0x7fedcc19db80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:19.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.823+0000 7fedd0e15640 1 --2- 172.21.15.17:0/733418945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedcc102ac0 0x7fedcc19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:19.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.823+0000 7fedd0e15640 1 -- 172.21.15.17:0/733418945 >> 172.21.15.17:0/733418945 conn(0x7fedcc0fc520 msgr2=0x7fedcc10af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:19.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.823+0000 7fedd0e15640 1 -- 172.21.15.17:0/733418945 shutdown_connections 2024-09-20T18:47:19.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.823+0000 7fedd0e15640 1 -- 172.21.15.17:0/733418945 wait complete. 2024-09-20T18:47:19.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.907+0000 7fe85524c640 1 -- 172.21.15.17:0/4214188961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe850100250 msgr2=0x7fe850100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:19.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.907+0000 7fe85524c640 1 --2- 172.21.15.17:0/4214188961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe850100250 0x7fe850100630 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe84000ad30 tx=0x7fe84002b860 comp rx=0 tx=0).stop 2024-09-20T18:47:19.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.907+0000 7fe85524c640 1 -- 172.21.15.17:0/4214188961 shutdown_connections 2024-09-20T18:47:19.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.907+0000 7fe85524c640 1 --2- 172.21.15.17:0/4214188961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe850100c00 0x7fe850104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:19.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.907+0000 7fe85524c640 1 --2- 172.21.15.17:0/4214188961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe850100250 0x7fe850100630 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:19.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.907+0000 7fe85524c640 1 -- 172.21.15.17:0/4214188961 >> 172.21.15.17:0/4214188961 conn(0x7fe8500fbc90 msgr2=0x7fe8500fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:19.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.907+0000 7fe85524c640 1 -- 172.21.15.17:0/4214188961 shutdown_connections 2024-09-20T18:47:19.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.907+0000 7fe85524c640 1 -- 172.21.15.17:0/4214188961 wait complete. 2024-09-20T18:47:19.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.908+0000 7fe85524c640 1 Processor -- start 2024-09-20T18:47:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.908+0000 7fe85524c640 1 -- start start 2024-09-20T18:47:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.908+0000 7fe85524c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe850100250 0x7fe85019b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.908+0000 7fe85524c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe850100c00 0x7fe85019bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.908+0000 7fe85524c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe85010cc40 con 0x7fe850100c00 2024-09-20T18:47:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.908+0000 7fe85524c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe85010cac0 con 0x7fe850100250 2024-09-20T18:47:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.909+0000 7fe84e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe850100c00 0x7fe85019bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.909+0000 7fe84e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe850100c00 0x7fe85019bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55244/0 (socket says 172.21.15.17:55244) 2024-09-20T18:47:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.909+0000 7fe84e59c640 1 -- 172.21.15.17:0/2910911451 learned_addr learned my addr 172.21.15.17:0/2910911451 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:47:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.909+0000 7fe84ed9d640 1 --2- 172.21.15.17:0/2910911451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe850100250 0x7fe85019b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.909+0000 7fe84e59c640 1 -- 172.21.15.17:0/2910911451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe850100250 msgr2=0x7fe85019b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.909+0000 7fe84e59c640 1 --2- 172.21.15.17:0/2910911451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe850100250 0x7fe85019b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.909+0000 7fe84e59c640 1 -- 172.21.15.17:0/2910911451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe850195650 con 0x7fe850100c00 2024-09-20T18:47:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.909+0000 7fe84e59c640 1 --2- 172.21.15.17:0/2910911451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe850100c00 0x7fe85019bac0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe83800d6f0 tx=0x7fe83800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.909+0000 7fe847fff640 1 -- 172.21.15.17:0/2910911451 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe838017070 con 0x7fe850100c00 2024-09-20T18:47:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.909+0000 7fe847fff640 1 -- 172.21.15.17:0/2910911451 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe83800de00 con 0x7fe850100c00 2024-09-20T18:47:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.909+0000 7fe85524c640 1 -- 172.21.15.17:0/2910911451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe850195940 con 0x7fe850100c00 2024-09-20T18:47:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.909+0000 7fe847fff640 1 -- 172.21.15.17:0/2910911451 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe838004bb0 con 0x7fe850100c00 2024-09-20T18:47:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.909+0000 7fe85524c640 1 -- 172.21.15.17:0/2910911451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe850195ea0 con 0x7fe850100c00 2024-09-20T18:47:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.910+0000 7fe85524c640 1 -- 172.21.15.17:0/2910911451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe850101730 con 0x7fe850100c00 2024-09-20T18:47:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.911+0000 7fe847fff640 1 -- 172.21.15.17:0/2910911451 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe838004e60 con 0x7fe850100c00 2024-09-20T18:47:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.912+0000 7fe847fff640 1 --2- 172.21.15.17:0/2910911451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe83c07af40 0x7fe83c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.912+0000 7fe847fff640 1 -- 172.21.15.17:0/2910911451 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fe83809dba0 con 0x7fe850100c00 2024-09-20T18:47:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.912+0000 7fe84ed9d640 1 --2- 172.21.15.17:0/2910911451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe83c07af40 0x7fe83c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.912+0000 7fe84ed9d640 1 --2- 172.21.15.17:0/2910911451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe83c07af40 0x7fe83c07d400 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe840034040 tx=0x7fe8400328e0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:19.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:19.916+0000 7fe847fff640 1 -- 172.21.15.17:0/2910911451 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe8380691a0 con 0x7fe850100c00 2024-09-20T18:47:19.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:19 smithi172 ceph-mon[80431]: pgmap v357: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:20.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.118+0000 7fe85524c640 1 -- 172.21.15.17:0/2910911451 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe850196150 con 0x7fe83c07af40 2024-09-20T18:47:20.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.128+0000 7fe847fff640 1 -- 172.21.15.17:0/2910911451 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fe850196150 con 0x7fe83c07af40 2024-09-20T18:47:20.145 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:47:20.145 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (8m) 2m ago 19m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:47:20.145 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (11m) 2m ago 19m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:47:20.145 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (11m) 2m ago 19m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:47:20.145 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (7m) 2m ago 19m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:47:20.145 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (6m) 2m ago 18m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:47:20.145 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (8m) 2m ago 19m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:47:20.145 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (3m) 2m ago 14m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:47:20.145 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (3m) 2m ago 14m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:47:20.145 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (14m) 2m ago 14m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:47:20.145 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (2m) 2m ago 14m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:47:20.145 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (10m) 2m ago 20m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:47:20.145 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (9m) 2m ago 18m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:47:20.145 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (7m) 2m ago 21m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:47:20.146 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (7m) 2m ago 18m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:47:20.146 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (9m) 2m ago 19m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:47:20.146 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (9m) 2m ago 18m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:47:20.146 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (6m) 2m ago 17m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:47:20.146 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (5m) 2m ago 17m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:47:20.146 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (5m) 2m ago 16m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:47:20.146 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (4m) 2m ago 16m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:47:20.146 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (4m) 2m ago 15m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:47:20.146 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (3m) 2m ago 15m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:47:20.146 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (9m) 2m ago 19m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:47:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.130+0000 7fe85524c640 1 -- 172.21.15.17:0/2910911451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe83c07af40 msgr2=0x7fe83c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.130+0000 7fe85524c640 1 --2- 172.21.15.17:0/2910911451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe83c07af40 0x7fe83c07d400 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe840034040 tx=0x7fe8400328e0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.130+0000 7fe85524c640 1 -- 172.21.15.17:0/2910911451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe850100c00 msgr2=0x7fe85019bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.130+0000 7fe85524c640 1 --2- 172.21.15.17:0/2910911451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe850100c00 0x7fe85019bac0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe83800d6f0 tx=0x7fe83800dbb0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.131+0000 7fe85524c640 1 -- 172.21.15.17:0/2910911451 shutdown_connections 2024-09-20T18:47:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.131+0000 7fe85524c640 1 --2- 172.21.15.17:0/2910911451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe83c07af40 0x7fe83c07d400 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.131+0000 7fe85524c640 1 --2- 172.21.15.17:0/2910911451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe850100c00 0x7fe85019bac0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.131+0000 7fe85524c640 1 --2- 172.21.15.17:0/2910911451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe850100250 0x7fe85019b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.131+0000 7fe85524c640 1 -- 172.21.15.17:0/2910911451 >> 172.21.15.17:0/2910911451 conn(0x7fe8500fbc90 msgr2=0x7fe8500fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:20.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.131+0000 7fe85524c640 1 -- 172.21.15.17:0/2910911451 shutdown_connections 2024-09-20T18:47:20.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.131+0000 7fe85524c640 1 -- 172.21.15.17:0/2910911451 wait complete. 2024-09-20T18:47:20.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.214+0000 7fc9a690b640 1 -- 172.21.15.17:0/1015408035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a01033e0 msgr2=0x7fc9a010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:20.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.214+0000 7fc9a690b640 1 --2- 172.21.15.17:0/1015408035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a01033e0 0x7fc9a010b8d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc994009880 tx=0x7fc99402a530 comp rx=0 tx=0).stop 2024-09-20T18:47:20.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.214+0000 7fc9a690b640 1 -- 172.21.15.17:0/1015408035 shutdown_connections 2024-09-20T18:47:20.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.214+0000 7fc9a690b640 1 --2- 172.21.15.17:0/1015408035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a01033e0 0x7fc9a010b8d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.214+0000 7fc9a690b640 1 --2- 172.21.15.17:0/1015408035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9a0102ac0 0x7fc9a0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.214+0000 7fc9a690b640 1 -- 172.21.15.17:0/1015408035 >> 172.21.15.17:0/1015408035 conn(0x7fc9a00fc520 msgr2=0x7fc9a00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:20.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.214+0000 7fc9a690b640 1 -- 172.21.15.17:0/1015408035 shutdown_connections 2024-09-20T18:47:20.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.214+0000 7fc9a690b640 1 -- 172.21.15.17:0/1015408035 wait complete. 2024-09-20T18:47:20.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.215+0000 7fc9a690b640 1 Processor -- start 2024-09-20T18:47:20.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.215+0000 7fc9a690b640 1 -- start start 2024-09-20T18:47:20.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.215+0000 7fc9a690b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9a0102ac0 0x7fc9a0100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:20.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.215+0000 7fc9a690b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a01033e0 0x7fc9a0100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.215+0000 7fc9a690b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a010ee50 con 0x7fc9a01033e0 2024-09-20T18:47:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.215+0000 7fc9a690b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a010ecd0 con 0x7fc9a0102ac0 2024-09-20T18:47:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.215+0000 7fc99f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a01033e0 0x7fc9a0100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.216+0000 7fc99f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a01033e0 0x7fc9a0100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55276/0 (socket says 172.21.15.17:55276) 2024-09-20T18:47:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.216+0000 7fc99f7fe640 1 -- 172.21.15.17:0/3629237185 learned_addr learned my addr 172.21.15.17:0/3629237185 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:47:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.216+0000 7fc99ffff640 1 --2- 172.21.15.17:0/3629237185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9a0102ac0 0x7fc9a0100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.216+0000 7fc99f7fe640 1 -- 172.21.15.17:0/3629237185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9a0102ac0 msgr2=0x7fc9a0100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.216+0000 7fc99f7fe640 1 --2- 172.21.15.17:0/3629237185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9a0102ac0 0x7fc9a0100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.216+0000 7fc99f7fe640 1 -- 172.21.15.17:0/3629237185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a01011a0 con 0x7fc9a01033e0 2024-09-20T18:47:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.216+0000 7fc99ffff640 1 --2- 172.21.15.17:0/3629237185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9a0102ac0 0x7fc9a0100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:47:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.216+0000 7fc99f7fe640 1 --2- 172.21.15.17:0/3629237185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a01033e0 0x7fc9a0100c60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc994031460 tx=0x7fc9940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.216+0000 7fc99d7fa640 1 -- 172.21.15.17:0/3629237185 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc99403f070 con 0x7fc9a01033e0 2024-09-20T18:47:20.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.216+0000 7fc99d7fa640 1 -- 172.21.15.17:0/3629237185 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc994004ac0 con 0x7fc9a01033e0 2024-09-20T18:47:20.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.216+0000 7fc9a690b640 1 -- 172.21.15.17:0/3629237185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a0101430 con 0x7fc9a01033e0 2024-09-20T18:47:20.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.216+0000 7fc99d7fa640 1 -- 172.21.15.17:0/3629237185 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc994035030 con 0x7fc9a01033e0 2024-09-20T18:47:20.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.216+0000 7fc9a690b640 1 -- 172.21.15.17:0/3629237185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a01a3e20 con 0x7fc9a01033e0 2024-09-20T18:47:20.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.217+0000 7fc9a690b640 1 -- 172.21.15.17:0/3629237185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a006aa90 con 0x7fc9a01033e0 2024-09-20T18:47:20.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.218+0000 7fc99d7fa640 1 -- 172.21.15.17:0/3629237185 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc994042070 con 0x7fc9a01033e0 2024-09-20T18:47:20.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.219+0000 7fc99d7fa640 1 --2- 172.21.15.17:0/3629237185 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc98807af40 0x7fc98807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:20.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.219+0000 7fc99ffff640 1 --2- 172.21.15.17:0/3629237185 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc98807af40 0x7fc98807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:20.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.219+0000 7fc99d7fa640 1 -- 172.21.15.17:0/3629237185 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fc9940bead0 con 0x7fc9a01033e0 2024-09-20T18:47:20.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.219+0000 7fc99ffff640 1 --2- 172.21.15.17:0/3629237185 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc98807af40 0x7fc98807d400 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc990006fd0 tx=0x7fc990008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:20.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.223+0000 7fc99d7fa640 1 -- 172.21.15.17:0/3629237185 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc99408a0d0 con 0x7fc9a01033e0 2024-09-20T18:47:20.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.486+0000 7fc9a690b640 1 -- 172.21.15.17:0/3629237185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc9a0101c50 con 0x7fc9a01033e0 2024-09-20T18:47:20.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.487+0000 7fc99d7fa640 1 -- 172.21.15.17:0/3629237185 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fc99408ef80 con 0x7fc9a01033e0 2024-09-20T18:47:20.503 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:47:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:47:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:47:20.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:47:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:47:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:47:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:47:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:47:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:47:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:47:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:47:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:47:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:47:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:47:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:47:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:47:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:47:20.504 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:47:20.505 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:47:20.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.489+0000 7fc9a690b640 1 -- 172.21.15.17:0/3629237185 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc98807af40 msgr2=0x7fc98807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:20.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.489+0000 7fc9a690b640 1 --2- 172.21.15.17:0/3629237185 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc98807af40 0x7fc98807d400 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc990006fd0 tx=0x7fc990008040 comp rx=0 tx=0).stop 2024-09-20T18:47:20.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.489+0000 7fc9a690b640 1 -- 172.21.15.17:0/3629237185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a01033e0 msgr2=0x7fc9a0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:20.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.489+0000 7fc9a690b640 1 --2- 172.21.15.17:0/3629237185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a01033e0 0x7fc9a0100c60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc994031460 tx=0x7fc9940046c0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.489+0000 7fc9a690b640 1 -- 172.21.15.17:0/3629237185 shutdown_connections 2024-09-20T18:47:20.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.489+0000 7fc9a690b640 1 --2- 172.21.15.17:0/3629237185 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc98807af40 0x7fc98807d400 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.489+0000 7fc9a690b640 1 --2- 172.21.15.17:0/3629237185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a01033e0 0x7fc9a0100c60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.489+0000 7fc9a690b640 1 --2- 172.21.15.17:0/3629237185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9a0102ac0 0x7fc9a0100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.489+0000 7fc9a690b640 1 -- 172.21.15.17:0/3629237185 >> 172.21.15.17:0/3629237185 conn(0x7fc9a00fc520 msgr2=0x7fc9a0108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:20.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.489+0000 7fc9a690b640 1 -- 172.21.15.17:0/3629237185 shutdown_connections 2024-09-20T18:47:20.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.489+0000 7fc9a690b640 1 -- 172.21.15.17:0/3629237185 wait complete. 2024-09-20T18:47:20.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.574+0000 7f41079b8640 1 -- 172.21.15.17:0/1527682397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4100101900 msgr2=0x7f4100101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:20.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.574+0000 7f41079b8640 1 --2- 172.21.15.17:0/1527682397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4100101900 0x7f4100101d60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009880 tx=0x7f40f002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.574+0000 7f41079b8640 1 -- 172.21.15.17:0/1527682397 shutdown_connections 2024-09-20T18:47:20.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.574+0000 7f41079b8640 1 --2- 172.21.15.17:0/1527682397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4100101900 0x7f4100101d60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.574+0000 7f41079b8640 1 --2- 172.21.15.17:0/1527682397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4100107900 0x7f4100107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.574+0000 7f41079b8640 1 -- 172.21.15.17:0/1527682397 >> 172.21.15.17:0/1527682397 conn(0x7f41000fd600 msgr2=0x7f41000ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:20.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.574+0000 7f41079b8640 1 -- 172.21.15.17:0/1527682397 shutdown_connections 2024-09-20T18:47:20.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.574+0000 7f41079b8640 1 -- 172.21.15.17:0/1527682397 wait complete. 2024-09-20T18:47:20.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.575+0000 7f41079b8640 1 Processor -- start 2024-09-20T18:47:20.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.575+0000 7f41079b8640 1 -- start start 2024-09-20T18:47:20.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.575+0000 7f41079b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4100101900 0x7f41000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:20.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.575+0000 7f41079b8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4100107900 0x7f4100074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:20.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.575+0000 7f41079b8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f410010edd0 con 0x7f4100101900 2024-09-20T18:47:20.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.575+0000 7f41079b8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f410010ec50 con 0x7f4100107900 2024-09-20T18:47:20.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.575+0000 7f4105754640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4100101900 0x7f41000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:20.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.575+0000 7f4105754640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4100101900 0x7f41000744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41546/0 (socket says 172.21.15.17:41546) 2024-09-20T18:47:20.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.575+0000 7f4105754640 1 -- 172.21.15.17:0/3141308653 learned_addr learned my addr 172.21.15.17:0/3141308653 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:47:20.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.575+0000 7f4104f53640 1 --2- 172.21.15.17:0/3141308653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4100107900 0x7f4100074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:20.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.576+0000 7f4105754640 1 -- 172.21.15.17:0/3141308653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4100107900 msgr2=0x7f4100074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:20.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.576+0000 7f4105754640 1 --2- 172.21.15.17:0/3141308653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4100107900 0x7f4100074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.576+0000 7f4105754640 1 -- 172.21.15.17:0/3141308653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4100074f70 con 0x7f4100101900 2024-09-20T18:47:20.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.576+0000 7f4105754640 1 --2- 172.21.15.17:0/3141308653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4100101900 0x7f41000744f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00d6f0 tx=0x7f40fc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:20.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.576+0000 7f40f67fc640 1 -- 172.21.15.17:0/3141308653 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40fc017070 con 0x7f4100101900 2024-09-20T18:47:20.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.576+0000 7f40f67fc640 1 -- 172.21.15.17:0/3141308653 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f40fc00de00 con 0x7f4100101900 2024-09-20T18:47:20.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.576+0000 7f41079b8640 1 -- 172.21.15.17:0/3141308653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4100075260 con 0x7f4100101900 2024-09-20T18:47:20.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.576+0000 7f40f67fc640 1 -- 172.21.15.17:0/3141308653 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40fc004bb0 con 0x7f4100101900 2024-09-20T18:47:20.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.576+0000 7f41079b8640 1 -- 172.21.15.17:0/3141308653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41001a3e80 con 0x7f4100101900 2024-09-20T18:47:20.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.577+0000 7f41079b8640 1 -- 172.21.15.17:0/3141308653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4100103040 con 0x7f4100101900 2024-09-20T18:47:20.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.578+0000 7f40f67fc640 1 -- 172.21.15.17:0/3141308653 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f40fc009a30 con 0x7f4100101900 2024-09-20T18:47:20.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.578+0000 7f40f67fc640 1 --2- 172.21.15.17:0/3141308653 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f40ec07af30 0x7f40ec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:20.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.578+0000 7f40f67fc640 1 -- 172.21.15.17:0/3141308653 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f40fc09dbb0 con 0x7f4100101900 2024-09-20T18:47:20.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.578+0000 7f4104f53640 1 --2- 172.21.15.17:0/3141308653 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f40ec07af30 0x7f40ec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:20.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.579+0000 7f4104f53640 1 --2- 172.21.15.17:0/3141308653 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f40ec07af30 0x7f40ec07d3f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4100075f80 tx=0x7f40f0031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:20.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.583+0000 7f40f67fc640 1 -- 172.21.15.17:0/3141308653 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f40fc0a4080 con 0x7f4100101900 2024-09-20T18:47:20.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.809+0000 7f41079b8640 1 -- 172.21.15.17:0/3141308653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4100109e70 con 0x7f4100101900 2024-09-20T18:47:20.826 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:20 smithi017 ceph-mon[108970]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:47:20.826 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:20 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3629237185' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:47:20.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.810+0000 7f40f67fc640 1 -- 172.21.15.17:0/3141308653 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f40fc0691b0 con 0x7f4100101900 2024-09-20T18:47:20.827 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:47:20.827 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:47:20.827 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:47:20.827 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:47:20.827 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:47:20.827 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:47:20.827 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:47:20.827 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:47:20.828 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:47:20.828 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:47:20.828 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:47:20.828 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:47:20.828 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:47:20.828 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:47:20.828 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:47:20.828 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:47:20.828 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:47:20.828 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:47:20.828 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:47:20.828 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:47:20.829 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:47:20.829 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:47:20.829 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:47:20.829 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:47:20.829 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:47:20.829 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:47:20.829 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:47:20.829 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:47:20.829 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:47:20.829 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:47:20.829 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:47:20.829 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:47:20.830 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:47:20.830 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:47:20.830 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:47:20.830 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:47:20.830 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:47:20.830 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:47:20.830 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:47:20.830 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:47:20.830 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:47:20.830 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:47:20.830 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:47:20.831 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:47:20.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.812+0000 7f41079b8640 1 -- 172.21.15.17:0/3141308653 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f40ec07af30 msgr2=0x7f40ec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:20.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.812+0000 7f41079b8640 1 --2- 172.21.15.17:0/3141308653 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f40ec07af30 0x7f40ec07d3f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4100075f80 tx=0x7f40f0031400 comp rx=0 tx=0).stop 2024-09-20T18:47:20.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.812+0000 7f41079b8640 1 -- 172.21.15.17:0/3141308653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4100101900 msgr2=0x7f41000744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:20.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.812+0000 7f41079b8640 1 --2- 172.21.15.17:0/3141308653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4100101900 0x7f41000744f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00d6f0 tx=0x7f40fc00dbb0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.812+0000 7f41079b8640 1 -- 172.21.15.17:0/3141308653 shutdown_connections 2024-09-20T18:47:20.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.812+0000 7f41079b8640 1 --2- 172.21.15.17:0/3141308653 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f40ec07af30 0x7f40ec07d3f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.812+0000 7f41079b8640 1 --2- 172.21.15.17:0/3141308653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4100107900 0x7f4100074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.812+0000 7f41079b8640 1 --2- 172.21.15.17:0/3141308653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4100101900 0x7f41000744f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.812+0000 7f41079b8640 1 -- 172.21.15.17:0/3141308653 >> 172.21.15.17:0/3141308653 conn(0x7f41000fd600 msgr2=0x7f41000fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:20.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.812+0000 7f41079b8640 1 -- 172.21.15.17:0/3141308653 shutdown_connections 2024-09-20T18:47:20.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.812+0000 7f41079b8640 1 -- 172.21.15.17:0/3141308653 wait complete. 2024-09-20T18:47:20.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.898+0000 7fa289a89640 1 -- 172.21.15.17:0/2054921293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa284102ac0 msgr2=0x7fa284102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:20.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.898+0000 7fa289a89640 1 --2- 172.21.15.17:0/2054921293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa284102ac0 0x7fa284102ea0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa274009880 tx=0x7fa27402a530 comp rx=0 tx=0).stop 2024-09-20T18:47:20.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.898+0000 7fa289a89640 1 -- 172.21.15.17:0/2054921293 shutdown_connections 2024-09-20T18:47:20.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.898+0000 7fa289a89640 1 --2- 172.21.15.17:0/2054921293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2841033e0 0x7fa28410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.898+0000 7fa289a89640 1 --2- 172.21.15.17:0/2054921293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa284102ac0 0x7fa284102ea0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.898+0000 7fa289a89640 1 -- 172.21.15.17:0/2054921293 >> 172.21.15.17:0/2054921293 conn(0x7fa2840fc520 msgr2=0x7fa2840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:20.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.898+0000 7fa289a89640 1 -- 172.21.15.17:0/2054921293 shutdown_connections 2024-09-20T18:47:20.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.898+0000 7fa289a89640 1 -- 172.21.15.17:0/2054921293 wait complete. 2024-09-20T18:47:20.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.899+0000 7fa289a89640 1 Processor -- start 2024-09-20T18:47:20.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.899+0000 7fa289a89640 1 -- start start 2024-09-20T18:47:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.899+0000 7fa289a89640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa284102ac0 0x7fa28419d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.899+0000 7fa289a89640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2841033e0 0x7fa28419dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.899+0000 7fa289a89640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa28410edd0 con 0x7fa284102ac0 2024-09-20T18:47:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.899+0000 7fa289a89640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa28410ec50 con 0x7fa2841033e0 2024-09-20T18:47:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.899+0000 7fa2837fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa284102ac0 0x7fa28419d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.899+0000 7fa2837fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa284102ac0 0x7fa28419d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41560/0 (socket says 172.21.15.17:41560) 2024-09-20T18:47:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.900+0000 7fa2837fe640 1 -- 172.21.15.17:0/2419453983 learned_addr learned my addr 172.21.15.17:0/2419453983 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:47:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.900+0000 7fa282ffd640 1 --2- 172.21.15.17:0/2419453983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2841033e0 0x7fa28419dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.900+0000 7fa2837fe640 1 -- 172.21.15.17:0/2419453983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2841033e0 msgr2=0x7fa28419dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.900+0000 7fa2837fe640 1 --2- 172.21.15.17:0/2419453983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2841033e0 0x7fa28419dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.900+0000 7fa2837fe640 1 -- 172.21.15.17:0/2419453983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2841978e0 con 0x7fa284102ac0 2024-09-20T18:47:20.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.900+0000 7fa282ffd640 1 --2- 172.21.15.17:0/2419453983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2841033e0 0x7fa28419dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:47:20.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.900+0000 7fa2837fe640 1 --2- 172.21.15.17:0/2419453983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa284102ac0 0x7fa28419d720 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa274031460 tx=0x7fa2740045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:20.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.900+0000 7fa280ff9640 1 -- 172.21.15.17:0/2419453983 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa27403f070 con 0x7fa284102ac0 2024-09-20T18:47:20.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.900+0000 7fa280ff9640 1 -- 172.21.15.17:0/2419453983 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa2740035f0 con 0x7fa284102ac0 2024-09-20T18:47:20.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.900+0000 7fa289a89640 1 -- 172.21.15.17:0/2419453983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa284197b70 con 0x7fa284102ac0 2024-09-20T18:47:20.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.900+0000 7fa280ff9640 1 -- 172.21.15.17:0/2419453983 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa274035030 con 0x7fa284102ac0 2024-09-20T18:47:20.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.900+0000 7fa289a89640 1 -- 172.21.15.17:0/2419453983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2841980a0 con 0x7fa284102ac0 2024-09-20T18:47:20.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.901+0000 7fa289a89640 1 -- 172.21.15.17:0/2419453983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa28406aa90 con 0x7fa284102ac0 2024-09-20T18:47:20.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.902+0000 7fa280ff9640 1 -- 172.21.15.17:0/2419453983 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa274042070 con 0x7fa284102ac0 2024-09-20T18:47:20.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.902+0000 7fa280ff9640 1 --2- 172.21.15.17:0/2419453983 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa26c07af30 0x7fa26c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:20.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.903+0000 7fa280ff9640 1 -- 172.21.15.17:0/2419453983 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fa2740bea20 con 0x7fa284102ac0 2024-09-20T18:47:20.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.903+0000 7fa282ffd640 1 --2- 172.21.15.17:0/2419453983 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa26c07af30 0x7fa26c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:20.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.903+0000 7fa282ffd640 1 --2- 172.21.15.17:0/2419453983 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa26c07af30 0x7fa26c07d3f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa2840feec0 tx=0x7fa278009670 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:20.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:20.907+0000 7fa280ff9640 1 -- 172.21.15.17:0/2419453983 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa27408a020 con 0x7fa284102ac0 2024-09-20T18:47:20.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:20 smithi172 ceph-mon[80431]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:47:20.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:20 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3629237185' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:47:21.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.112+0000 7fa289a89640 1 -- 172.21.15.17:0/2419453983 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa284106000 con 0x7fa26c07af30 2024-09-20T18:47:21.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.114+0000 7fa280ff9640 1 -- 172.21.15.17:0/2419453983 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fa278009880 con 0x7fa26c07af30 2024-09-20T18:47:21.130 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:47:21.130 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:47:21.130 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:47:21.130 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:47:21.130 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:47:21.130 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:47:21.130 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:47:21.131 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:47:21.131 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:47:21.131 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:47:21.131 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:47:21.131 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:47:21.131 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:47:21.131 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:47:21.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.116+0000 7fa289a89640 1 -- 172.21.15.17:0/2419453983 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa26c07af30 msgr2=0x7fa26c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:21.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.116+0000 7fa289a89640 1 --2- 172.21.15.17:0/2419453983 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa26c07af30 0x7fa26c07d3f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa2840feec0 tx=0x7fa278009670 comp rx=0 tx=0).stop 2024-09-20T18:47:21.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.116+0000 7fa289a89640 1 -- 172.21.15.17:0/2419453983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa284102ac0 msgr2=0x7fa28419d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:21.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.116+0000 7fa289a89640 1 --2- 172.21.15.17:0/2419453983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa284102ac0 0x7fa28419d720 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa274031460 tx=0x7fa2740045e0 comp rx=0 tx=0).stop 2024-09-20T18:47:21.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.116+0000 7fa289a89640 1 -- 172.21.15.17:0/2419453983 shutdown_connections 2024-09-20T18:47:21.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.116+0000 7fa289a89640 1 --2- 172.21.15.17:0/2419453983 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa26c07af30 0x7fa26c07d3f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:21.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.116+0000 7fa289a89640 1 --2- 172.21.15.17:0/2419453983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2841033e0 0x7fa28419dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:21.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.116+0000 7fa289a89640 1 --2- 172.21.15.17:0/2419453983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa284102ac0 0x7fa28419d720 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:21.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.116+0000 7fa289a89640 1 -- 172.21.15.17:0/2419453983 >> 172.21.15.17:0/2419453983 conn(0x7fa2840fc520 msgr2=0x7fa284108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:21.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.116+0000 7fa289a89640 1 -- 172.21.15.17:0/2419453983 shutdown_connections 2024-09-20T18:47:21.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.116+0000 7fa289a89640 1 -- 172.21.15.17:0/2419453983 wait complete. 2024-09-20T18:47:21.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.201+0000 7f0df1aa4640 1 -- 172.21.15.17:0/3016625818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dec106810 msgr2=0x7f0dec106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:21.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.201+0000 7f0df1aa4640 1 --2- 172.21.15.17:0/3016625818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dec106810 0x7f0dec106bf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009880 tx=0x7f0ddc02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:47:21.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.202+0000 7f0df1aa4640 1 -- 172.21.15.17:0/3016625818 shutdown_connections 2024-09-20T18:47:21.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.202+0000 7f0df1aa4640 1 --2- 172.21.15.17:0/3016625818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dec100810 0x7f0dec100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:21.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.202+0000 7f0df1aa4640 1 --2- 172.21.15.17:0/3016625818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dec106810 0x7f0dec106bf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:21.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.202+0000 7f0df1aa4640 1 -- 172.21.15.17:0/3016625818 >> 172.21.15.17:0/3016625818 conn(0x7f0dec0fc510 msgr2=0x7f0dec0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:21.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.202+0000 7f0df1aa4640 1 -- 172.21.15.17:0/3016625818 shutdown_connections 2024-09-20T18:47:21.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.202+0000 7f0df1aa4640 1 -- 172.21.15.17:0/3016625818 wait complete. 2024-09-20T18:47:21.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.202+0000 7f0df1aa4640 1 Processor -- start 2024-09-20T18:47:21.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.203+0000 7f0df1aa4640 1 -- start start 2024-09-20T18:47:21.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.203+0000 7f0df1aa4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dec100810 0x7f0dec1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:21.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.203+0000 7f0df1aa4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dec106810 0x7f0dec198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:21.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.203+0000 7f0df1aa4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec10dcc0 con 0x7f0dec106810 2024-09-20T18:47:21.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.203+0000 7f0df1aa4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec10db40 con 0x7f0dec100810 2024-09-20T18:47:21.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.203+0000 7f0deaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dec106810 0x7f0dec198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:21.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.203+0000 7f0deaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dec106810 0x7f0dec198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41576/0 (socket says 172.21.15.17:41576) 2024-09-20T18:47:21.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.203+0000 7f0deaffd640 1 -- 172.21.15.17:0/1755924013 learned_addr learned my addr 172.21.15.17:0/1755924013 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:47:21.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.203+0000 7f0deb7fe640 1 --2- 172.21.15.17:0/1755924013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dec100810 0x7f0dec1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:21.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.203+0000 7f0deaffd640 1 -- 172.21.15.17:0/1755924013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dec100810 msgr2=0x7f0dec1987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:21.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.203+0000 7f0deaffd640 1 --2- 172.21.15.17:0/1755924013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dec100810 0x7f0dec1987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:21.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.203+0000 7f0deaffd640 1 -- 172.21.15.17:0/1755924013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dec199330 con 0x7f0dec106810 2024-09-20T18:47:21.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.203+0000 7f0deb7fe640 1 --2- 172.21.15.17:0/1755924013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dec100810 0x7f0dec1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:47:21.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.203+0000 7f0deaffd640 1 --2- 172.21.15.17:0/1755924013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dec106810 0x7f0dec198d30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0de000d8d0 tx=0x7f0de000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:21.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.204+0000 7f0de8ff9640 1 -- 172.21.15.17:0/1755924013 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0de0017070 con 0x7f0dec106810 2024-09-20T18:47:21.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.204+0000 7f0de8ff9640 1 -- 172.21.15.17:0/1755924013 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0de0010460 con 0x7f0dec106810 2024-09-20T18:47:21.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.204+0000 7f0df1aa4640 1 -- 172.21.15.17:0/1755924013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dec199620 con 0x7f0dec106810 2024-09-20T18:47:21.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.204+0000 7f0de8ff9640 1 -- 172.21.15.17:0/1755924013 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0de000f5f0 con 0x7f0dec106810 2024-09-20T18:47:21.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.204+0000 7f0df1aa4640 1 -- 172.21.15.17:0/1755924013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dec1a1c20 con 0x7f0dec106810 2024-09-20T18:47:21.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.205+0000 7f0df1aa4640 1 -- 172.21.15.17:0/1755924013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dec101f50 con 0x7f0dec106810 2024-09-20T18:47:21.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.205+0000 7f0de8ff9640 1 -- 172.21.15.17:0/1755924013 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0de0009a30 con 0x7f0dec106810 2024-09-20T18:47:21.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.206+0000 7f0de8ff9640 1 --2- 172.21.15.17:0/1755924013 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0dd407af30 0x7f0dd407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:21.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.206+0000 7f0deb7fe640 1 --2- 172.21.15.17:0/1755924013 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0dd407af30 0x7f0dd407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:21.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.206+0000 7f0de8ff9640 1 -- 172.21.15.17:0/1755924013 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f0de009dee0 con 0x7f0dec106810 2024-09-20T18:47:21.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.206+0000 7f0deb7fe640 1 --2- 172.21.15.17:0/1755924013 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0dd407af30 0x7f0dd407d3f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc000c00 tx=0x7f0ddc031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:21.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.210+0000 7f0de8ff9640 1 -- 172.21.15.17:0/1755924013 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0dec199620 con 0x7f0dec106810 2024-09-20T18:47:21.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.474+0000 7f0df1aa4640 1 -- 172.21.15.17:0/1755924013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f0dec103a20 con 0x7f0dec106810 2024-09-20T18:47:21.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.474+0000 7f0de8ff9640 1 -- 172.21.15.17:0/1755924013 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f0de00694e0 con 0x7f0dec106810 2024-09-20T18:47:21.490 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:47:21.490 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:47:21.491 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:47:21.491 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:47:21.491 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:47:21.491 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:47:21.491 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:47:21.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.476+0000 7f0df1aa4640 1 -- 172.21.15.17:0/1755924013 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0dd407af30 msgr2=0x7f0dd407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.476+0000 7f0df1aa4640 1 --2- 172.21.15.17:0/1755924013 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0dd407af30 0x7f0dd407d3f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc000c00 tx=0x7f0ddc031400 comp rx=0 tx=0).stop 2024-09-20T18:47:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.476+0000 7f0df1aa4640 1 -- 172.21.15.17:0/1755924013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dec106810 msgr2=0x7f0dec198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.476+0000 7f0df1aa4640 1 --2- 172.21.15.17:0/1755924013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dec106810 0x7f0dec198d30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0de000d8d0 tx=0x7f0de000dd90 comp rx=0 tx=0).stop 2024-09-20T18:47:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.476+0000 7f0df1aa4640 1 -- 172.21.15.17:0/1755924013 shutdown_connections 2024-09-20T18:47:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.476+0000 7f0df1aa4640 1 --2- 172.21.15.17:0/1755924013 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0dd407af30 0x7f0dd407d3f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.476+0000 7f0df1aa4640 1 --2- 172.21.15.17:0/1755924013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dec106810 0x7f0dec198d30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.476+0000 7f0df1aa4640 1 --2- 172.21.15.17:0/1755924013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dec100810 0x7f0dec1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.476+0000 7f0df1aa4640 1 -- 172.21.15.17:0/1755924013 >> 172.21.15.17:0/1755924013 conn(0x7f0dec0fc510 msgr2=0x7f0dec0fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.476+0000 7f0df1aa4640 1 -- 172.21.15.17:0/1755924013 shutdown_connections 2024-09-20T18:47:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:21.476+0000 7f0df1aa4640 1 -- 172.21.15.17:0/1755924013 wait complete. 2024-09-20T18:47:21.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:21 smithi017 ceph-mon[108970]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:47:21.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:21 smithi017 ceph-mon[108970]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:47:21.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:21 smithi017 ceph-mon[108970]: pgmap v358: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:21.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:21 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3141308653' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:47:21.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:21 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1755924013' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:47:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:21 smithi172 ceph-mon[80431]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:47:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:21 smithi172 ceph-mon[80431]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:47:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:21 smithi172 ceph-mon[80431]: pgmap v358: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:21 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3141308653' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:47:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:21 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1755924013' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:47:22.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:22 smithi017 ceph-mon[108970]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:47:22.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:47:22.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:22 smithi172 ceph-mon[80431]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:47:22.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:47:23.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:23 smithi172 ceph-mon[80431]: pgmap v359: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:24.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:23 smithi017 ceph-mon[108970]: pgmap v359: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:25.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:25 smithi017 ceph-mon[108970]: pgmap v360: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:25.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:25 smithi172 ceph-mon[80431]: pgmap v360: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:27.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:27 smithi172 ceph-mon[80431]: pgmap v361: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:28.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:27 smithi017 ceph-mon[108970]: pgmap v361: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:29.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:29 smithi172 ceph-mon[80431]: pgmap v362: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:30.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:29 smithi017 ceph-mon[108970]: pgmap v362: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:31.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:31 smithi017 ceph-mon[108970]: pgmap v363: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:31.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:31 smithi172 ceph-mon[80431]: pgmap v363: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:33.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:33 smithi172 ceph-mon[80431]: pgmap v364: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:34.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:33 smithi017 ceph-mon[108970]: pgmap v364: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:35.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:35 smithi172 ceph-mon[80431]: pgmap v365: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:36.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:35 smithi017 ceph-mon[108970]: pgmap v365: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:37 smithi017 ceph-mon[108970]: pgmap v366: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:47:37.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:37 smithi172 ceph-mon[80431]: pgmap v366: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:37.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:47:39.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:39 smithi172 ceph-mon[80431]: pgmap v367: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:40.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:39 smithi017 ceph-mon[108970]: pgmap v367: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:41.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:41 smithi017 ceph-mon[108970]: pgmap v368: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:41.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:41 smithi172 ceph-mon[80431]: pgmap v368: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:43.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:43 smithi017 ceph-mon[108970]: pgmap v369: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:43.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:43 smithi172 ceph-mon[80431]: pgmap v369: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:45.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:45 smithi172 ceph-mon[80431]: pgmap v370: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:46.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:45 smithi017 ceph-mon[108970]: pgmap v370: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:47.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:47 smithi172 ceph-mon[80431]: pgmap v371: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:48.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:47 smithi017 ceph-mon[108970]: pgmap v371: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:49.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:49 smithi017 ceph-mon[108970]: pgmap v372: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:49.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:49 smithi172 ceph-mon[80431]: pgmap v372: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.574+0000 7fafe05de640 1 -- 172.21.15.17:0/2648331459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafd8102ab0 msgr2=0x7fafd8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.574+0000 7fafe05de640 1 --2- 172.21.15.17:0/2648331459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafd8102ab0 0x7fafd8102e90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009880 tx=0x7fafd402a530 comp rx=0 tx=0).stop 2024-09-20T18:47:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.574+0000 7fafe05de640 1 -- 172.21.15.17:0/2648331459 shutdown_connections 2024-09-20T18:47:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.574+0000 7fafe05de640 1 --2- 172.21.15.17:0/2648331459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafd81033d0 0x7fafd810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.574+0000 7fafe05de640 1 --2- 172.21.15.17:0/2648331459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafd8102ab0 0x7fafd8102e90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.574+0000 7fafe05de640 1 -- 172.21.15.17:0/2648331459 >> 172.21.15.17:0/2648331459 conn(0x7fafd80fc550 msgr2=0x7fafd80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.574+0000 7fafe05de640 1 -- 172.21.15.17:0/2648331459 shutdown_connections 2024-09-20T18:47:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.574+0000 7fafe05de640 1 -- 172.21.15.17:0/2648331459 wait complete. 2024-09-20T18:47:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.575+0000 7fafe05de640 1 Processor -- start 2024-09-20T18:47:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.575+0000 7fafe05de640 1 -- start start 2024-09-20T18:47:51.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.575+0000 7fafe05de640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafd8102ab0 0x7fafd819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:51.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.575+0000 7fafe05de640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafd81033d0 0x7fafd819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:51.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.575+0000 7fafe05de640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fafd810edc0 con 0x7fafd8102ab0 2024-09-20T18:47:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.575+0000 7fafe05de640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fafd810ec40 con 0x7fafd81033d0 2024-09-20T18:47:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.575+0000 7fafde37a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafd8102ab0 0x7fafd819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.575+0000 7fafde37a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafd8102ab0 0x7fafd819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37714/0 (socket says 172.21.15.17:37714) 2024-09-20T18:47:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.575+0000 7fafde37a640 1 -- 172.21.15.17:0/2341018020 learned_addr learned my addr 172.21.15.17:0/2341018020 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:47:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.575+0000 7fafddb79640 1 --2- 172.21.15.17:0/2341018020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafd81033d0 0x7fafd819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.576+0000 7fafde37a640 1 -- 172.21.15.17:0/2341018020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafd81033d0 msgr2=0x7fafd819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.576+0000 7fafde37a640 1 --2- 172.21.15.17:0/2341018020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafd81033d0 0x7fafd819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.576+0000 7fafde37a640 1 -- 172.21.15.17:0/2341018020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd81977b0 con 0x7fafd8102ab0 2024-09-20T18:47:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.576+0000 7fafde37a640 1 --2- 172.21.15.17:0/2341018020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafd8102ab0 0x7fafd819d630 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fafd4031460 tx=0x7fafd40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.576+0000 7fafcf7fe640 1 -- 172.21.15.17:0/2341018020 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fafd403f070 con 0x7fafd8102ab0 2024-09-20T18:47:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.576+0000 7fafcf7fe640 1 -- 172.21.15.17:0/2341018020 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fafd4004cf0 con 0x7fafd8102ab0 2024-09-20T18:47:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.576+0000 7fafe05de640 1 -- 172.21.15.17:0/2341018020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd8197a40 con 0x7fafd8102ab0 2024-09-20T18:47:51.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.576+0000 7fafcf7fe640 1 -- 172.21.15.17:0/2341018020 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fafd4035030 con 0x7fafd8102ab0 2024-09-20T18:47:51.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.576+0000 7fafe05de640 1 -- 172.21.15.17:0/2341018020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd8197f70 con 0x7fafd8102ab0 2024-09-20T18:47:51.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.577+0000 7fafe05de640 1 -- 172.21.15.17:0/2341018020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd806a580 con 0x7fafd8102ab0 2024-09-20T18:47:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.578+0000 7fafcf7fe640 1 -- 172.21.15.17:0/2341018020 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fafd4042070 con 0x7fafd8102ab0 2024-09-20T18:47:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.578+0000 7fafcf7fe640 1 --2- 172.21.15.17:0/2341018020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fafc407af80 0x7fafc407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.579+0000 7fafcf7fe640 1 -- 172.21.15.17:0/2341018020 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fafd40be930 con 0x7fafd8102ab0 2024-09-20T18:47:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.579+0000 7fafddb79640 1 --2- 172.21.15.17:0/2341018020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fafc407af80 0x7fafc407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.579+0000 7fafddb79640 1 --2- 172.21.15.17:0/2341018020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fafc407af80 0x7fafc407d440 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fafd80ff010 tx=0x7fafc800a250 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:51.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.583+0000 7fafcf7fe640 1 -- 172.21.15.17:0/2341018020 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fafd4089fb0 con 0x7fafd8102ab0 2024-09-20T18:47:51.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.791+0000 7fafe05de640 1 -- 172.21.15.17:0/2341018020 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fafd8198ce0 con 0x7fafc407af80 2024-09-20T18:47:51.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.792+0000 7fafcf7fe640 1 -- 172.21.15.17:0/2341018020 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fafd8198ce0 con 0x7fafc407af80 2024-09-20T18:47:51.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.794+0000 7fafe05de640 1 -- 172.21.15.17:0/2341018020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fafc407af80 msgr2=0x7fafc407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:51.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.794+0000 7fafe05de640 1 --2- 172.21.15.17:0/2341018020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fafc407af80 0x7fafc407d440 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fafd80ff010 tx=0x7fafc800a250 comp rx=0 tx=0).stop 2024-09-20T18:47:51.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.794+0000 7fafe05de640 1 -- 172.21.15.17:0/2341018020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafd8102ab0 msgr2=0x7fafd819d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:51.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.794+0000 7fafe05de640 1 --2- 172.21.15.17:0/2341018020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafd8102ab0 0x7fafd819d630 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fafd4031460 tx=0x7fafd40048f0 comp rx=0 tx=0).stop 2024-09-20T18:47:51.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.794+0000 7fafe05de640 1 -- 172.21.15.17:0/2341018020 shutdown_connections 2024-09-20T18:47:51.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.794+0000 7fafe05de640 1 --2- 172.21.15.17:0/2341018020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fafc407af80 0x7fafc407d440 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:51.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.794+0000 7fafe05de640 1 --2- 172.21.15.17:0/2341018020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafd81033d0 0x7fafd819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:51.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.794+0000 7fafe05de640 1 --2- 172.21.15.17:0/2341018020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafd8102ab0 0x7fafd819d630 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:51.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.794+0000 7fafe05de640 1 -- 172.21.15.17:0/2341018020 >> 172.21.15.17:0/2341018020 conn(0x7fafd80fc550 msgr2=0x7fafd8108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:51.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.795+0000 7fafe05de640 1 -- 172.21.15.17:0/2341018020 shutdown_connections 2024-09-20T18:47:51.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.795+0000 7fafe05de640 1 -- 172.21.15.17:0/2341018020 wait complete. 2024-09-20T18:47:51.820 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:47:51.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.880+0000 7ff8bae2c640 1 -- 172.21.15.17:0/2809152204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b4101900 msgr2=0x7ff8b4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:51.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.880+0000 7ff8bae2c640 1 --2- 172.21.15.17:0/2809152204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b4101900 0x7ff8b4101d60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4009c20 tx=0x7ff8a402a970 comp rx=0 tx=0).stop 2024-09-20T18:47:51.916 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:51 smithi017 ceph-mon[108970]: pgmap v373: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:51.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.880+0000 7ff8bae2c640 1 -- 172.21.15.17:0/2809152204 shutdown_connections 2024-09-20T18:47:51.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.880+0000 7ff8bae2c640 1 --2- 172.21.15.17:0/2809152204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b4101900 0x7ff8b4101d60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:51.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.880+0000 7ff8bae2c640 1 --2- 172.21.15.17:0/2809152204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8b4107900 0x7ff8b4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:51.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.880+0000 7ff8bae2c640 1 -- 172.21.15.17:0/2809152204 >> 172.21.15.17:0/2809152204 conn(0x7ff8b40fd600 msgr2=0x7ff8b40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:51.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.880+0000 7ff8bae2c640 1 -- 172.21.15.17:0/2809152204 shutdown_connections 2024-09-20T18:47:51.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.881+0000 7ff8bae2c640 1 -- 172.21.15.17:0/2809152204 wait complete. 2024-09-20T18:47:51.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.881+0000 7ff8bae2c640 1 Processor -- start 2024-09-20T18:47:51.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.881+0000 7ff8bae2c640 1 -- start start 2024-09-20T18:47:51.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.881+0000 7ff8bae2c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8b4101900 0x7ff8b40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:51.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.881+0000 7ff8bae2c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b4107900 0x7ff8b4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.881+0000 7ff8bae2c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b410edb0 con 0x7ff8b4107900 2024-09-20T18:47:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.881+0000 7ff8bae2c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b410ec30 con 0x7ff8b4101900 2024-09-20T18:47:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.882+0000 7ff8b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b4107900 0x7ff8b4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.882+0000 7ff8b3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b4107900 0x7ff8b4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37734/0 (socket says 172.21.15.17:37734) 2024-09-20T18:47:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.882+0000 7ff8b3fff640 1 -- 172.21.15.17:0/2866776458 learned_addr learned my addr 172.21.15.17:0/2866776458 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:47:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.882+0000 7ff8b8bc8640 1 --2- 172.21.15.17:0/2866776458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8b4101900 0x7ff8b40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.882+0000 7ff8b3fff640 1 -- 172.21.15.17:0/2866776458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8b4101900 msgr2=0x7ff8b40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:51.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.882+0000 7ff8b3fff640 1 --2- 172.21.15.17:0/2866776458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8b4101900 0x7ff8b40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:51.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.882+0000 7ff8b3fff640 1 -- 172.21.15.17:0/2866776458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b4074f70 con 0x7ff8b4107900 2024-09-20T18:47:51.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.882+0000 7ff8b3fff640 1 --2- 172.21.15.17:0/2866776458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b4107900 0x7ff8b4074a30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4005cc0 tx=0x7ff8a402f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:51.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.882+0000 7ff8b1ffb640 1 -- 172.21.15.17:0/2866776458 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff8a4047070 con 0x7ff8b4107900 2024-09-20T18:47:51.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.883+0000 7ff8bae2c640 1 -- 172.21.15.17:0/2866776458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b4075200 con 0x7ff8b4107900 2024-09-20T18:47:51.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.883+0000 7ff8b1ffb640 1 -- 172.21.15.17:0/2866776458 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff8a402f7e0 con 0x7ff8b4107900 2024-09-20T18:47:51.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.883+0000 7ff8b1ffb640 1 -- 172.21.15.17:0/2866776458 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff8a4034070 con 0x7ff8b4107900 2024-09-20T18:47:51.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.883+0000 7ff8bae2c640 1 -- 172.21.15.17:0/2866776458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b41a3d40 con 0x7ff8b4107900 2024-09-20T18:47:51.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.884+0000 7ff8bae2c640 1 -- 172.21.15.17:0/2866776458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8b4103040 con 0x7ff8b4107900 2024-09-20T18:47:51.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.884+0000 7ff8b1ffb640 1 -- 172.21.15.17:0/2866776458 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff8a404a070 con 0x7ff8b4107900 2024-09-20T18:47:51.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.885+0000 7ff8b1ffb640 1 --2- 172.21.15.17:0/2866776458 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff8a007af30 0x7ff8a007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:51.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.885+0000 7ff8b1ffb640 1 -- 172.21.15.17:0/2866776458 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7ff8a40bee20 con 0x7ff8b4107900 2024-09-20T18:47:51.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.885+0000 7ff8b8bc8640 1 --2- 172.21.15.17:0/2866776458 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff8a007af30 0x7ff8a007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:51.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.886+0000 7ff8b8bc8640 1 --2- 172.21.15.17:0/2866776458 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff8a007af30 0x7ff8a007d3f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00abe0 tx=0x7ff89c00a2d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:51.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:51.889+0000 7ff8b1ffb640 1 -- 172.21.15.17:0/2866776458 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff8a403f070 con 0x7ff8b4107900 2024-09-20T18:47:51.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:51 smithi172 ceph-mon[80431]: pgmap v373: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:52.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.095+0000 7ff8bae2c640 1 -- 172.21.15.17:0/2866776458 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff8b4062630 con 0x7ff8a007af30 2024-09-20T18:47:52.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.096+0000 7ff8b1ffb640 1 -- 172.21.15.17:0/2866776458 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7ff8b4062630 con 0x7ff8a007af30 2024-09-20T18:47:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.098+0000 7ff8bae2c640 1 -- 172.21.15.17:0/2866776458 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff8a007af30 msgr2=0x7ff8a007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.098+0000 7ff8bae2c640 1 --2- 172.21.15.17:0/2866776458 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff8a007af30 0x7ff8a007d3f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00abe0 tx=0x7ff89c00a2d0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.098+0000 7ff8bae2c640 1 -- 172.21.15.17:0/2866776458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b4107900 msgr2=0x7ff8b4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.098+0000 7ff8bae2c640 1 --2- 172.21.15.17:0/2866776458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b4107900 0x7ff8b4074a30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4005cc0 tx=0x7ff8a402f5f0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.098+0000 7ff8bae2c640 1 -- 172.21.15.17:0/2866776458 shutdown_connections 2024-09-20T18:47:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.098+0000 7ff8bae2c640 1 --2- 172.21.15.17:0/2866776458 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff8a007af30 0x7ff8a007d3f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.098+0000 7ff8bae2c640 1 --2- 172.21.15.17:0/2866776458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8b4107900 0x7ff8b4074a30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.098+0000 7ff8bae2c640 1 --2- 172.21.15.17:0/2866776458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8b4101900 0x7ff8b40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.098+0000 7ff8bae2c640 1 -- 172.21.15.17:0/2866776458 >> 172.21.15.17:0/2866776458 conn(0x7ff8b40fd600 msgr2=0x7ff8b40fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.098+0000 7ff8bae2c640 1 -- 172.21.15.17:0/2866776458 shutdown_connections 2024-09-20T18:47:52.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.098+0000 7ff8bae2c640 1 -- 172.21.15.17:0/2866776458 wait complete. 2024-09-20T18:47:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.185+0000 7f1c69f4c640 1 -- 172.21.15.17:0/1618064513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c641033e0 msgr2=0x7f1c6410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.185+0000 7f1c69f4c640 1 --2- 172.21.15.17:0/1618064513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c641033e0 0x7f1c6410b8d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009880 tx=0x7f1c5802a530 comp rx=0 tx=0).stop 2024-09-20T18:47:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.185+0000 7f1c69f4c640 1 -- 172.21.15.17:0/1618064513 shutdown_connections 2024-09-20T18:47:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.185+0000 7f1c69f4c640 1 --2- 172.21.15.17:0/1618064513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c641033e0 0x7f1c6410b8d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.185+0000 7f1c69f4c640 1 --2- 172.21.15.17:0/1618064513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c64102ac0 0x7f1c64102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.185+0000 7f1c69f4c640 1 -- 172.21.15.17:0/1618064513 >> 172.21.15.17:0/1618064513 conn(0x7f1c640fc520 msgr2=0x7f1c640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.185+0000 7f1c69f4c640 1 -- 172.21.15.17:0/1618064513 shutdown_connections 2024-09-20T18:47:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.185+0000 7f1c69f4c640 1 -- 172.21.15.17:0/1618064513 wait complete. 2024-09-20T18:47:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.186+0000 7f1c69f4c640 1 Processor -- start 2024-09-20T18:47:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.186+0000 7f1c69f4c640 1 -- start start 2024-09-20T18:47:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.186+0000 7f1c69f4c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c64102ac0 0x7f1c64100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.186+0000 7f1c69f4c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c641033e0 0x7f1c64100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.186+0000 7f1c69f4c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6410edd0 con 0x7f1c641033e0 2024-09-20T18:47:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.186+0000 7f1c69f4c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6410ec50 con 0x7f1c64102ac0 2024-09-20T18:47:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.186+0000 7f1c62ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c641033e0 0x7f1c64100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.186+0000 7f1c62ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c641033e0 0x7f1c64100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37758/0 (socket says 172.21.15.17:37758) 2024-09-20T18:47:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.186+0000 7f1c62ffd640 1 -- 172.21.15.17:0/309415034 learned_addr learned my addr 172.21.15.17:0/309415034 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:47:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.186+0000 7f1c637fe640 1 --2- 172.21.15.17:0/309415034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c64102ac0 0x7f1c64100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.187+0000 7f1c62ffd640 1 -- 172.21.15.17:0/309415034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c64102ac0 msgr2=0x7f1c64100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.187+0000 7f1c62ffd640 1 --2- 172.21.15.17:0/309415034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c64102ac0 0x7f1c64100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.187+0000 7f1c62ffd640 1 -- 172.21.15.17:0/309415034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c641011a0 con 0x7f1c641033e0 2024-09-20T18:47:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.187+0000 7f1c62ffd640 1 --2- 172.21.15.17:0/309415034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c641033e0 0x7f1c64100c60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1c58031460 tx=0x7f1c580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.187+0000 7f1c60ff9640 1 -- 172.21.15.17:0/309415034 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c5803f070 con 0x7f1c641033e0 2024-09-20T18:47:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.187+0000 7f1c60ff9640 1 -- 172.21.15.17:0/309415034 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1c58004ac0 con 0x7f1c641033e0 2024-09-20T18:47:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.187+0000 7f1c60ff9640 1 -- 172.21.15.17:0/309415034 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c58035030 con 0x7f1c641033e0 2024-09-20T18:47:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.187+0000 7f1c69f4c640 1 -- 172.21.15.17:0/309415034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c64101430 con 0x7f1c641033e0 2024-09-20T18:47:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.187+0000 7f1c69f4c640 1 -- 172.21.15.17:0/309415034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c641a3d80 con 0x7f1c641033e0 2024-09-20T18:47:52.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.188+0000 7f1c69f4c640 1 -- 172.21.15.17:0/309415034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c6406aa90 con 0x7f1c641033e0 2024-09-20T18:47:52.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.189+0000 7f1c60ff9640 1 -- 172.21.15.17:0/309415034 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1c58042070 con 0x7f1c641033e0 2024-09-20T18:47:52.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.189+0000 7f1c60ff9640 1 --2- 172.21.15.17:0/309415034 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1c4c07af80 0x7f1c4c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:52.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.189+0000 7f1c60ff9640 1 -- 172.21.15.17:0/309415034 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f1c580be8b0 con 0x7f1c641033e0 2024-09-20T18:47:52.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.189+0000 7f1c637fe640 1 --2- 172.21.15.17:0/309415034 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1c4c07af80 0x7f1c4c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:52.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.190+0000 7f1c637fe640 1 --2- 172.21.15.17:0/309415034 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1c4c07af80 0x7f1c4c07d440 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1c540058c0 tx=0x7f1c5400a2d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:52.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.194+0000 7f1c60ff9640 1 -- 172.21.15.17:0/309415034 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c58089f30 con 0x7f1c641033e0 2024-09-20T18:47:52.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.390+0000 7f1c69f4c640 1 -- 172.21.15.17:0/309415034 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1c64062630 con 0x7f1c4c07af80 2024-09-20T18:47:52.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.399+0000 7f1c60ff9640 1 -- 172.21.15.17:0/309415034 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f1c64062630 con 0x7f1c4c07af80 2024-09-20T18:47:52.416 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:47:52.416 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (9m) 3m ago 20m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:47:52.416 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (12m) 3m ago 20m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:47:52.416 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (11m) 3m ago 19m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:47:52.416 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (7m) 3m ago 20m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:47:52.416 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (7m) 3m ago 19m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:47:52.416 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (8m) 3m ago 20m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:47:52.416 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (3m) 3m ago 14m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:47:52.416 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (3m) 3m ago 14m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:47:52.416 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (14m) 3m ago 14m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:47:52.417 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (3m) 3m ago 14m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:47:52.417 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (11m) 3m ago 21m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:47:52.417 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (10m) 3m ago 19m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:47:52.417 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (8m) 3m ago 21m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:47:52.417 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (7m) 3m ago 19m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:47:52.417 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (10m) 3m ago 20m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:47:52.417 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (9m) 3m ago 19m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:47:52.417 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (7m) 3m ago 18m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:47:52.417 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (6m) 3m ago 17m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:47:52.417 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (5m) 3m ago 17m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:47:52.417 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (5m) 3m ago 16m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:47:52.417 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (4m) 3m ago 16m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:47:52.417 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (4m) 3m ago 15m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:47:52.418 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (9m) 3m ago 19m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:47:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.402+0000 7f1c69f4c640 1 -- 172.21.15.17:0/309415034 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1c4c07af80 msgr2=0x7f1c4c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.402+0000 7f1c69f4c640 1 --2- 172.21.15.17:0/309415034 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1c4c07af80 0x7f1c4c07d440 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1c540058c0 tx=0x7f1c5400a2d0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.402+0000 7f1c69f4c640 1 -- 172.21.15.17:0/309415034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c641033e0 msgr2=0x7f1c64100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.402+0000 7f1c69f4c640 1 --2- 172.21.15.17:0/309415034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c641033e0 0x7f1c64100c60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1c58031460 tx=0x7f1c580046c0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.402+0000 7f1c69f4c640 1 -- 172.21.15.17:0/309415034 shutdown_connections 2024-09-20T18:47:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.402+0000 7f1c69f4c640 1 --2- 172.21.15.17:0/309415034 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1c4c07af80 0x7f1c4c07d440 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.402+0000 7f1c69f4c640 1 --2- 172.21.15.17:0/309415034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c641033e0 0x7f1c64100c60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.402+0000 7f1c69f4c640 1 --2- 172.21.15.17:0/309415034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c64102ac0 0x7f1c64100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.402+0000 7f1c69f4c640 1 -- 172.21.15.17:0/309415034 >> 172.21.15.17:0/309415034 conn(0x7f1c640fc520 msgr2=0x7f1c64108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.402+0000 7f1c69f4c640 1 -- 172.21.15.17:0/309415034 shutdown_connections 2024-09-20T18:47:52.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.402+0000 7f1c69f4c640 1 -- 172.21.15.17:0/309415034 wait complete. 2024-09-20T18:47:52.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.486+0000 7ff4341bd640 1 -- 172.21.15.17:0/3272940943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c107900 msgr2=0x7ff42c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:52.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.486+0000 7ff4341bd640 1 --2- 172.21.15.17:0/3272940943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c107900 0x7ff42c107ce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff428009880 tx=0x7ff42802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.486+0000 7ff4341bd640 1 -- 172.21.15.17:0/3272940943 shutdown_connections 2024-09-20T18:47:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.486+0000 7ff4341bd640 1 --2- 172.21.15.17:0/3272940943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff42c101900 0x7ff42c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.486+0000 7ff4341bd640 1 --2- 172.21.15.17:0/3272940943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c107900 0x7ff42c107ce0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.486+0000 7ff4341bd640 1 -- 172.21.15.17:0/3272940943 >> 172.21.15.17:0/3272940943 conn(0x7ff42c0fd5e0 msgr2=0x7ff42c0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.486+0000 7ff4341bd640 1 -- 172.21.15.17:0/3272940943 shutdown_connections 2024-09-20T18:47:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.486+0000 7ff4341bd640 1 -- 172.21.15.17:0/3272940943 wait complete. 2024-09-20T18:47:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.486+0000 7ff4341bd640 1 Processor -- start 2024-09-20T18:47:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.486+0000 7ff4341bd640 1 -- start start 2024-09-20T18:47:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.487+0000 7ff4341bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff42c101900 0x7ff42c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.487+0000 7ff4341bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c107900 0x7ff42c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.487+0000 7ff4341bd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c10ee30 con 0x7ff42c107900 2024-09-20T18:47:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.487+0000 7ff4341bd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c10ecb0 con 0x7ff42c101900 2024-09-20T18:47:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.487+0000 7ff431758640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c107900 0x7ff42c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:52.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.487+0000 7ff431758640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c107900 0x7ff42c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37780/0 (socket says 172.21.15.17:37780) 2024-09-20T18:47:52.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.487+0000 7ff431758640 1 -- 172.21.15.17:0/1537573177 learned_addr learned my addr 172.21.15.17:0/1537573177 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:47:52.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.487+0000 7ff431f59640 1 --2- 172.21.15.17:0/1537573177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff42c101900 0x7ff42c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:52.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.487+0000 7ff431758640 1 -- 172.21.15.17:0/1537573177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff42c101900 msgr2=0x7ff42c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:52.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.487+0000 7ff431758640 1 --2- 172.21.15.17:0/1537573177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff42c101900 0x7ff42c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.487+0000 7ff431758640 1 -- 172.21.15.17:0/1537573177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42c197800 con 0x7ff42c107900 2024-09-20T18:47:52.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.487+0000 7ff431758640 1 --2- 172.21.15.17:0/1537573177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c107900 0x7ff42c19dbc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff42000ba50 tx=0x7ff42000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:52.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.488+0000 7ff41effd640 1 -- 172.21.15.17:0/1537573177 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff420019070 con 0x7ff42c107900 2024-09-20T18:47:52.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.488+0000 7ff41effd640 1 -- 172.21.15.17:0/1537573177 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff42000ce20 con 0x7ff42c107900 2024-09-20T18:47:52.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.488+0000 7ff4341bd640 1 -- 172.21.15.17:0/1537573177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff42c197af0 con 0x7ff42c107900 2024-09-20T18:47:52.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.488+0000 7ff4341bd640 1 -- 172.21.15.17:0/1537573177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff42c198080 con 0x7ff42c107900 2024-09-20T18:47:52.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.488+0000 7ff41effd640 1 -- 172.21.15.17:0/1537573177 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4200075a0 con 0x7ff42c107900 2024-09-20T18:47:52.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.489+0000 7ff4341bd640 1 -- 172.21.15.17:0/1537573177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff42c103040 con 0x7ff42c107900 2024-09-20T18:47:52.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.489+0000 7ff41effd640 1 -- 172.21.15.17:0/1537573177 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff42001c070 con 0x7ff42c107900 2024-09-20T18:47:52.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.490+0000 7ff41effd640 1 --2- 172.21.15.17:0/1537573177 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff41807af80 0x7ff41807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:52.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.490+0000 7ff41effd640 1 -- 172.21.15.17:0/1537573177 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7ff42009d7c0 con 0x7ff42c107900 2024-09-20T18:47:52.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.490+0000 7ff431f59640 1 --2- 172.21.15.17:0/1537573177 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff41807af80 0x7ff41807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:52.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.491+0000 7ff431f59640 1 --2- 172.21.15.17:0/1537573177 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff41807af80 0x7ff41807d440 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff4280096c0 tx=0x7ff428031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:52.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.495+0000 7ff41effd640 1 -- 172.21.15.17:0/1537573177 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff420068e40 con 0x7ff42c107900 2024-09-20T18:47:52.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.760+0000 7ff4341bd640 1 -- 172.21.15.17:0/1537573177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff42c198d30 con 0x7ff42c107900 2024-09-20T18:47:52.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:52 smithi017 ceph-mon[108970]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:47:52.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:47:52.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.761+0000 7ff41effd640 1 -- 172.21.15.17:0/1537573177 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7ff42006dcf0 con 0x7ff42c107900 2024-09-20T18:47:52.778 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:47:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:47:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:47:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:47:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:47:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:47:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:47:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:47:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:47:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:47:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:47:52.778 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:47:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:47:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:47:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:47:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:47:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:47:52.779 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:47:52.779 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:47:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.763+0000 7ff4341bd640 1 -- 172.21.15.17:0/1537573177 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff41807af80 msgr2=0x7ff41807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.763+0000 7ff4341bd640 1 --2- 172.21.15.17:0/1537573177 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff41807af80 0x7ff41807d440 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff4280096c0 tx=0x7ff428031400 comp rx=0 tx=0).stop 2024-09-20T18:47:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.763+0000 7ff4341bd640 1 -- 172.21.15.17:0/1537573177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c107900 msgr2=0x7ff42c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.763+0000 7ff4341bd640 1 --2- 172.21.15.17:0/1537573177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c107900 0x7ff42c19dbc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff42000ba50 tx=0x7ff42000bf10 comp rx=0 tx=0).stop 2024-09-20T18:47:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.763+0000 7ff4341bd640 1 -- 172.21.15.17:0/1537573177 shutdown_connections 2024-09-20T18:47:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.763+0000 7ff4341bd640 1 --2- 172.21.15.17:0/1537573177 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff41807af80 0x7ff41807d440 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.763+0000 7ff4341bd640 1 --2- 172.21.15.17:0/1537573177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c107900 0x7ff42c19dbc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.763+0000 7ff4341bd640 1 --2- 172.21.15.17:0/1537573177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff42c101900 0x7ff42c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.763+0000 7ff4341bd640 1 -- 172.21.15.17:0/1537573177 >> 172.21.15.17:0/1537573177 conn(0x7ff42c0fd5e0 msgr2=0x7ff42c0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:52.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.763+0000 7ff4341bd640 1 -- 172.21.15.17:0/1537573177 shutdown_connections 2024-09-20T18:47:52.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.763+0000 7ff4341bd640 1 -- 172.21.15.17:0/1537573177 wait complete. 2024-09-20T18:47:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.847+0000 7f8faa632640 1 -- 172.21.15.17:0/1313972492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa4100800 msgr2=0x7f8fa4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.847+0000 7f8faa632640 1 --2- 172.21.15.17:0/1313972492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa4100800 0x7f8fa4100c60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009880 tx=0x7f8f8c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.847+0000 7f8faa632640 1 -- 172.21.15.17:0/1313972492 shutdown_connections 2024-09-20T18:47:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.847+0000 7f8faa632640 1 --2- 172.21.15.17:0/1313972492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa4100800 0x7f8fa4100c60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.847+0000 7f8faa632640 1 --2- 172.21.15.17:0/1313972492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa4106800 0x7f8fa4106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.847+0000 7f8faa632640 1 -- 172.21.15.17:0/1313972492 >> 172.21.15.17:0/1313972492 conn(0x7f8fa40fc520 msgr2=0x7f8fa40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.847+0000 7f8faa632640 1 -- 172.21.15.17:0/1313972492 shutdown_connections 2024-09-20T18:47:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.847+0000 7f8faa632640 1 -- 172.21.15.17:0/1313972492 wait complete. 2024-09-20T18:47:52.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.848+0000 7f8faa632640 1 Processor -- start 2024-09-20T18:47:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.848+0000 7f8faa632640 1 -- start start 2024-09-20T18:47:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.848+0000 7f8faa632640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa4100800 0x7f8fa419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.848+0000 7f8faa632640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa4106800 0x7f8fa419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.848+0000 7f8faa632640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa410dcd0 con 0x7f8fa4106800 2024-09-20T18:47:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.848+0000 7f8faa632640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa410db50 con 0x7f8fa4100800 2024-09-20T18:47:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.848+0000 7f8f9bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa4106800 0x7f8fa419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.848+0000 7f8f9bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa4106800 0x7f8fa419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37808/0 (socket says 172.21.15.17:37808) 2024-09-20T18:47:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.848+0000 7f8f9bfff640 1 -- 172.21.15.17:0/3568817338 learned_addr learned my addr 172.21.15.17:0/3568817338 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:47:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.848+0000 7f8fa3fff640 1 --2- 172.21.15.17:0/3568817338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa4100800 0x7f8fa419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.849+0000 7f8f9bfff640 1 -- 172.21.15.17:0/3568817338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa4100800 msgr2=0x7f8fa419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.849+0000 7f8f9bfff640 1 --2- 172.21.15.17:0/3568817338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa4100800 0x7f8fa419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.849+0000 7f8f9bfff640 1 -- 172.21.15.17:0/3568817338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa41977f0 con 0x7f8fa4106800 2024-09-20T18:47:52.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.849+0000 7f8f9bfff640 1 --2- 172.21.15.17:0/3568817338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa4106800 0x7f8fa419dbb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c031460 tx=0x7f8f8c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:52.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.849+0000 7f8fa1ffb640 1 -- 172.21.15.17:0/3568817338 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f8c03f070 con 0x7f8fa4106800 2024-09-20T18:47:52.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.849+0000 7f8fa1ffb640 1 -- 172.21.15.17:0/3568817338 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f8c004cf0 con 0x7f8fa4106800 2024-09-20T18:47:52.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.849+0000 7f8faa632640 1 -- 172.21.15.17:0/3568817338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa4197a80 con 0x7f8fa4106800 2024-09-20T18:47:52.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.849+0000 7f8fa1ffb640 1 -- 172.21.15.17:0/3568817338 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f8c035030 con 0x7f8fa4106800 2024-09-20T18:47:52.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.849+0000 7f8faa632640 1 -- 172.21.15.17:0/3568817338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa4197fb0 con 0x7f8fa4106800 2024-09-20T18:47:52.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.850+0000 7f8faa632640 1 -- 172.21.15.17:0/3568817338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa4101f40 con 0x7f8fa4106800 2024-09-20T18:47:52.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.851+0000 7f8fa1ffb640 1 -- 172.21.15.17:0/3568817338 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8f8c042070 con 0x7f8fa4106800 2024-09-20T18:47:52.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.851+0000 7f8fa1ffb640 1 --2- 172.21.15.17:0/3568817338 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f9007af30 0x7f8f9007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:52.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.851+0000 7f8fa1ffb640 1 -- 172.21.15.17:0/3568817338 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f8f8c0bea10 con 0x7f8fa4106800 2024-09-20T18:47:52.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.851+0000 7f8fa3fff640 1 --2- 172.21.15.17:0/3568817338 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f9007af30 0x7f8f9007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:52.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.852+0000 7f8fa3fff640 1 --2- 172.21.15.17:0/3568817338 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f9007af30 0x7f8f9007d3f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8f940058c0 tx=0x7f8f9400a250 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:52.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:52.856+0000 7f8fa1ffb640 1 -- 172.21.15.17:0/3568817338 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8f8c08a010 con 0x7f8fa4106800 2024-09-20T18:47:52.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:52 smithi172 ceph-mon[80431]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:47:52.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:47:53.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.081+0000 7f8faa632640 1 -- 172.21.15.17:0/3568817338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8fa4109d80 con 0x7f8fa4106800 2024-09-20T18:47:53.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.081+0000 7f8fa1ffb640 1 -- 172.21.15.17:0/3568817338 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f8f8c08eec0 con 0x7f8fa4106800 2024-09-20T18:47:53.098 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:47:53.098 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:47:53.098 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:47:53.098 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:47:53.098 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:47:53.099 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:47:53.099 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:47:53.099 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:47:53.099 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:47:53.099 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:47:53.099 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:47:53.099 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:47:53.099 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:47:53.099 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:47:53.099 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:47:53.099 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:47:53.099 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:47:53.099 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:47:53.099 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:47:53.100 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:47:53.100 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:47:53.100 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:47:53.100 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:47:53.100 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:47:53.100 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:47:53.100 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:47:53.100 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:47:53.100 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:47:53.100 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:47:53.100 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:47:53.101 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:47:53.101 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:47:53.101 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:47:53.101 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:47:53.101 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:47:53.101 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:47:53.101 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:47:53.101 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:47:53.101 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:47:53.101 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:47:53.101 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:47:53.101 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:47:53.101 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:47:53.102 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:47:53.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.084+0000 7f8faa632640 1 -- 172.21.15.17:0/3568817338 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f9007af30 msgr2=0x7f8f9007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:53.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.084+0000 7f8faa632640 1 --2- 172.21.15.17:0/3568817338 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f9007af30 0x7f8f9007d3f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8f940058c0 tx=0x7f8f9400a250 comp rx=0 tx=0).stop 2024-09-20T18:47:53.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.084+0000 7f8faa632640 1 -- 172.21.15.17:0/3568817338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa4106800 msgr2=0x7f8fa419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:53.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.084+0000 7f8faa632640 1 --2- 172.21.15.17:0/3568817338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa4106800 0x7f8fa419dbb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c031460 tx=0x7f8f8c0048f0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.084+0000 7f8faa632640 1 -- 172.21.15.17:0/3568817338 shutdown_connections 2024-09-20T18:47:53.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.084+0000 7f8faa632640 1 --2- 172.21.15.17:0/3568817338 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f9007af30 0x7f8f9007d3f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.084+0000 7f8faa632640 1 --2- 172.21.15.17:0/3568817338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa4106800 0x7f8fa419dbb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.084+0000 7f8faa632640 1 --2- 172.21.15.17:0/3568817338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa4100800 0x7f8fa419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.084+0000 7f8faa632640 1 -- 172.21.15.17:0/3568817338 >> 172.21.15.17:0/3568817338 conn(0x7f8fa40fc520 msgr2=0x7f8fa406a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:53.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.085+0000 7f8faa632640 1 -- 172.21.15.17:0/3568817338 shutdown_connections 2024-09-20T18:47:53.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.085+0000 7f8faa632640 1 -- 172.21.15.17:0/3568817338 wait complete. 2024-09-20T18:47:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.170+0000 7ff9d4399640 1 -- 172.21.15.17:0/747621813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc103450 msgr2=0x7ff9cc10b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.170+0000 7ff9d4399640 1 --2- 172.21.15.17:0/747621813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc103450 0x7ff9cc10b940 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009880 tx=0x7ff9bc02a530 comp rx=0 tx=0).stop 2024-09-20T18:47:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.171+0000 7ff9d4399640 1 -- 172.21.15.17:0/747621813 shutdown_connections 2024-09-20T18:47:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.171+0000 7ff9d4399640 1 --2- 172.21.15.17:0/747621813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc103450 0x7ff9cc10b940 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.171+0000 7ff9d4399640 1 --2- 172.21.15.17:0/747621813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9cc102b30 0x7ff9cc102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.171+0000 7ff9d4399640 1 -- 172.21.15.17:0/747621813 >> 172.21.15.17:0/747621813 conn(0x7ff9cc0fc550 msgr2=0x7ff9cc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.171+0000 7ff9d4399640 1 -- 172.21.15.17:0/747621813 shutdown_connections 2024-09-20T18:47:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.171+0000 7ff9d4399640 1 -- 172.21.15.17:0/747621813 wait complete. 2024-09-20T18:47:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.171+0000 7ff9d4399640 1 Processor -- start 2024-09-20T18:47:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.171+0000 7ff9d4399640 1 -- start start 2024-09-20T18:47:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.172+0000 7ff9d4399640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc102b30 0x7ff9cc19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.172+0000 7ff9d4399640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9cc103450 0x7ff9cc19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.172+0000 7ff9d4399640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc10edc0 con 0x7ff9cc102b30 2024-09-20T18:47:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.172+0000 7ff9d4399640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc10ec40 con 0x7ff9cc103450 2024-09-20T18:47:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.172+0000 7ff9d2135640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc102b30 0x7ff9cc19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.172+0000 7ff9d2135640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc102b30 0x7ff9cc19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37820/0 (socket says 172.21.15.17:37820) 2024-09-20T18:47:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.172+0000 7ff9d2135640 1 -- 172.21.15.17:0/769374572 learned_addr learned my addr 172.21.15.17:0/769374572 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:47:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.172+0000 7ff9d1934640 1 --2- 172.21.15.17:0/769374572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9cc103450 0x7ff9cc19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.172+0000 7ff9d2135640 1 -- 172.21.15.17:0/769374572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9cc103450 msgr2=0x7ff9cc19dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.172+0000 7ff9d2135640 1 --2- 172.21.15.17:0/769374572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9cc103450 0x7ff9cc19dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.172+0000 7ff9d2135640 1 -- 172.21.15.17:0/769374572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9cc197890 con 0x7ff9cc102b30 2024-09-20T18:47:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.172+0000 7ff9d2135640 1 --2- 172.21.15.17:0/769374572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc102b30 0x7ff9cc19d6d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800d8d0 tx=0x7ff9c800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.172+0000 7ff9c37fe640 1 -- 172.21.15.17:0/769374572 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9c8017070 con 0x7ff9cc102b30 2024-09-20T18:47:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.172+0000 7ff9c37fe640 1 -- 172.21.15.17:0/769374572 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9c8010460 con 0x7ff9cc102b30 2024-09-20T18:47:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.172+0000 7ff9d4399640 1 -- 172.21.15.17:0/769374572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9cc197b80 con 0x7ff9cc102b30 2024-09-20T18:47:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.172+0000 7ff9c37fe640 1 -- 172.21.15.17:0/769374572 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9c800f5f0 con 0x7ff9cc102b30 2024-09-20T18:47:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.173+0000 7ff9d4399640 1 -- 172.21.15.17:0/769374572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9cc1980e0 con 0x7ff9cc102b30 2024-09-20T18:47:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.173+0000 7ff9d4399640 1 -- 172.21.15.17:0/769374572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9cc06a500 con 0x7ff9cc102b30 2024-09-20T18:47:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.174+0000 7ff9c37fe640 1 -- 172.21.15.17:0/769374572 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff9c8009a30 con 0x7ff9cc102b30 2024-09-20T18:47:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.175+0000 7ff9c37fe640 1 --2- 172.21.15.17:0/769374572 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff9b807af40 0x7ff9b807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.175+0000 7ff9c37fe640 1 -- 172.21.15.17:0/769374572 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7ff9c809de30 con 0x7ff9cc102b30 2024-09-20T18:47:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.175+0000 7ff9d1934640 1 --2- 172.21.15.17:0/769374572 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff9b807af40 0x7ff9b807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.175+0000 7ff9d1934640 1 --2- 172.21.15.17:0/769374572 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff9b807af40 0x7ff9b807d400 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc199080 tx=0x7ff9bc004f30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:53.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.179+0000 7ff9c37fe640 1 -- 172.21.15.17:0/769374572 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff9c8069430 con 0x7ff9cc102b30 2024-09-20T18:47:53.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.384+0000 7ff9d4399640 1 -- 172.21.15.17:0/769374572 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff9cc198dc0 con 0x7ff9b807af40 2024-09-20T18:47:53.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.385+0000 7ff9c37fe640 1 -- 172.21.15.17:0/769374572 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7ff9cc198dc0 con 0x7ff9b807af40 2024-09-20T18:47:53.401 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:47:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:47:53.401 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:47:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:47:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:47:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:47:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:47:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:47:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:47:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:47:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:47:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:47:53.402 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:47:53.402 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:47:53.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.387+0000 7ff9d4399640 1 -- 172.21.15.17:0/769374572 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff9b807af40 msgr2=0x7ff9b807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:53.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.387+0000 7ff9d4399640 1 --2- 172.21.15.17:0/769374572 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff9b807af40 0x7ff9b807d400 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc199080 tx=0x7ff9bc004f30 comp rx=0 tx=0).stop 2024-09-20T18:47:53.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.387+0000 7ff9d4399640 1 -- 172.21.15.17:0/769374572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc102b30 msgr2=0x7ff9cc19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:53.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.387+0000 7ff9d4399640 1 --2- 172.21.15.17:0/769374572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc102b30 0x7ff9cc19d6d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800d8d0 tx=0x7ff9c800dd90 comp rx=0 tx=0).stop 2024-09-20T18:47:53.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.387+0000 7ff9d4399640 1 -- 172.21.15.17:0/769374572 shutdown_connections 2024-09-20T18:47:53.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.387+0000 7ff9d4399640 1 --2- 172.21.15.17:0/769374572 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff9b807af40 0x7ff9b807d400 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.387+0000 7ff9d4399640 1 --2- 172.21.15.17:0/769374572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9cc103450 0x7ff9cc19dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.387+0000 7ff9d4399640 1 --2- 172.21.15.17:0/769374572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9cc102b30 0x7ff9cc19d6d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.387+0000 7ff9d4399640 1 -- 172.21.15.17:0/769374572 >> 172.21.15.17:0/769374572 conn(0x7ff9cc0fc550 msgr2=0x7ff9cc107e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:53.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.387+0000 7ff9d4399640 1 -- 172.21.15.17:0/769374572 shutdown_connections 2024-09-20T18:47:53.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.388+0000 7ff9d4399640 1 -- 172.21.15.17:0/769374572 wait complete. 2024-09-20T18:47:53.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.472+0000 7f6eb2c40640 1 -- 172.21.15.17:0/3534423285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6eac1067f0 msgr2=0x7f6eac106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:53.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.472+0000 7f6eb2c40640 1 --2- 172.21.15.17:0/3534423285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6eac1067f0 0x7f6eac106bd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009880 tx=0x7f6ea002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.472+0000 7f6eb2c40640 1 -- 172.21.15.17:0/3534423285 shutdown_connections 2024-09-20T18:47:53.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.472+0000 7f6eb2c40640 1 --2- 172.21.15.17:0/3534423285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6eac1007f0 0x7f6eac100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.472+0000 7f6eb2c40640 1 --2- 172.21.15.17:0/3534423285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6eac1067f0 0x7f6eac106bd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.472+0000 7f6eb2c40640 1 -- 172.21.15.17:0/3534423285 >> 172.21.15.17:0/3534423285 conn(0x7f6eac0fc550 msgr2=0x7f6eac0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:53.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.472+0000 7f6eb2c40640 1 -- 172.21.15.17:0/3534423285 shutdown_connections 2024-09-20T18:47:53.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.472+0000 7f6eb2c40640 1 -- 172.21.15.17:0/3534423285 wait complete. 2024-09-20T18:47:53.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.472+0000 7f6eb2c40640 1 Processor -- start 2024-09-20T18:47:53.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.472+0000 7f6eb2c40640 1 -- start start 2024-09-20T18:47:53.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.473+0000 7f6eb2c40640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6eac1007f0 0x7f6eac19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:53.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.473+0000 7f6eb2c40640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6eac1067f0 0x7f6eac19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:53.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.473+0000 7f6eb2c40640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6eac10dcc0 con 0x7f6eac1007f0 2024-09-20T18:47:53.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.473+0000 7f6eb2c40640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6eac10db40 con 0x7f6eac1067f0 2024-09-20T18:47:53.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.473+0000 7f6eb09dc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6eac1007f0 0x7f6eac19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:53.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.473+0000 7f6eb09dc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6eac1007f0 0x7f6eac19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37834/0 (socket says 172.21.15.17:37834) 2024-09-20T18:47:53.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.473+0000 7f6eb09dc640 1 -- 172.21.15.17:0/2150677371 learned_addr learned my addr 172.21.15.17:0/2150677371 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:47:53.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.473+0000 7f6eabfff640 1 --2- 172.21.15.17:0/2150677371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6eac1067f0 0x7f6eac19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:53.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.473+0000 7f6eb09dc640 1 -- 172.21.15.17:0/2150677371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6eac1067f0 msgr2=0x7f6eac19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:53.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.473+0000 7f6eb09dc640 1 --2- 172.21.15.17:0/2150677371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6eac1067f0 0x7f6eac19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.473+0000 7f6eb09dc640 1 -- 172.21.15.17:0/2150677371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eac1977b0 con 0x7f6eac1007f0 2024-09-20T18:47:53.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.473+0000 7f6eb09dc640 1 --2- 172.21.15.17:0/2150677371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6eac1007f0 0x7f6eac19d630 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0031460 tx=0x7f6ea00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:53.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.474+0000 7f6ea9ffb640 1 -- 172.21.15.17:0/2150677371 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ea003f070 con 0x7f6eac1007f0 2024-09-20T18:47:53.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.474+0000 7f6eb2c40640 1 -- 172.21.15.17:0/2150677371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eac197a40 con 0x7f6eac1007f0 2024-09-20T18:47:53.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.474+0000 7f6ea9ffb640 1 -- 172.21.15.17:0/2150677371 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ea00035f0 con 0x7f6eac1007f0 2024-09-20T18:47:53.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.474+0000 7f6ea9ffb640 1 -- 172.21.15.17:0/2150677371 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ea0035030 con 0x7f6eac1007f0 2024-09-20T18:47:53.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.474+0000 7f6eb2c40640 1 -- 172.21.15.17:0/2150677371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eac197f70 con 0x7f6eac1007f0 2024-09-20T18:47:53.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.475+0000 7f6eb2c40640 1 -- 172.21.15.17:0/2150677371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eac101f30 con 0x7f6eac1007f0 2024-09-20T18:47:53.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.475+0000 7f6ea9ffb640 1 -- 172.21.15.17:0/2150677371 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6ea0042070 con 0x7f6eac1007f0 2024-09-20T18:47:53.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.476+0000 7f6ea9ffb640 1 --2- 172.21.15.17:0/2150677371 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6e9c07af30 0x7f6e9c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:47:53.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.476+0000 7f6ea9ffb640 1 -- 172.21.15.17:0/2150677371 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f6ea00be970 con 0x7f6eac1007f0 2024-09-20T18:47:53.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.476+0000 7f6eabfff640 1 --2- 172.21.15.17:0/2150677371 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6e9c07af30 0x7f6e9c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:47:53.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.476+0000 7f6eabfff640 1 --2- 172.21.15.17:0/2150677371 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6e9c07af30 0x7f6e9c07d3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6eac104fd0 tx=0x7f6e9800b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:47:53.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.480+0000 7f6ea9ffb640 1 -- 172.21.15.17:0/2150677371 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ea00c0e20 con 0x7f6eac1007f0 2024-09-20T18:47:53.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.743+0000 7f6eb2c40640 1 -- 172.21.15.17:0/2150677371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6eac109d70 con 0x7f6eac1007f0 2024-09-20T18:47:53.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.744+0000 7f6ea9ffb640 1 -- 172.21.15.17:0/2150677371 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f6ea0089f70 con 0x7f6eac1007f0 2024-09-20T18:47:53.764 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:47:53.764 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:47:53.765 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:47:53.765 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:47:53.765 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:47:53.765 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:47:53.765 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:47:53.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.746+0000 7f6eb2c40640 1 -- 172.21.15.17:0/2150677371 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6e9c07af30 msgr2=0x7f6e9c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.746+0000 7f6eb2c40640 1 --2- 172.21.15.17:0/2150677371 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6e9c07af30 0x7f6e9c07d3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6eac104fd0 tx=0x7f6e9800b390 comp rx=0 tx=0).stop 2024-09-20T18:47:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.746+0000 7f6eb2c40640 1 -- 172.21.15.17:0/2150677371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6eac1007f0 msgr2=0x7f6eac19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:47:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.746+0000 7f6eb2c40640 1 --2- 172.21.15.17:0/2150677371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6eac1007f0 0x7f6eac19d630 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0031460 tx=0x7f6ea00045e0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.746+0000 7f6eb2c40640 1 -- 172.21.15.17:0/2150677371 shutdown_connections 2024-09-20T18:47:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.746+0000 7f6eb2c40640 1 --2- 172.21.15.17:0/2150677371 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6e9c07af30 0x7f6e9c07d3f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.746+0000 7f6eb2c40640 1 --2- 172.21.15.17:0/2150677371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6eac1067f0 0x7f6eac19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.746+0000 7f6eb2c40640 1 --2- 172.21.15.17:0/2150677371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6eac1007f0 0x7f6eac19d630 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:47:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.746+0000 7f6eb2c40640 1 -- 172.21.15.17:0/2150677371 >> 172.21.15.17:0/2150677371 conn(0x7f6eac0fc550 msgr2=0x7f6eac069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:47:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.746+0000 7f6eb2c40640 1 -- 172.21.15.17:0/2150677371 shutdown_connections 2024-09-20T18:47:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:47:53.746+0000 7f6eb2c40640 1 -- 172.21.15.17:0/2150677371 wait complete. 2024-09-20T18:47:53.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:53 smithi172 ceph-mon[80431]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:47:53.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:53 smithi172 ceph-mon[80431]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:47:53.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:53 smithi172 ceph-mon[80431]: pgmap v374: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:53.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:53 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1537573177' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:47:53.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:53 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3568817338' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:47:54.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:53 smithi017 ceph-mon[108970]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:47:54.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:53 smithi017 ceph-mon[108970]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:47:54.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:53 smithi017 ceph-mon[108970]: pgmap v374: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:54.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:53 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1537573177' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:47:54.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:53 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3568817338' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:47:54.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:54 smithi172 ceph-mon[80431]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:47:54.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:54 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2150677371' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:47:55.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:54 smithi017 ceph-mon[108970]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:47:55.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:54 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2150677371' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:47:55.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:55 smithi017 ceph-mon[108970]: pgmap v375: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:55.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:55 smithi172 ceph-mon[80431]: pgmap v375: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:58.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:57 smithi017 ceph-mon[108970]: pgmap v376: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:58.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:57 smithi172 ceph-mon[80431]: pgmap v376: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:47:59.970 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:47:59 smithi172 ceph-mon[80431]: pgmap v377: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:00.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:47:59 smithi017 ceph-mon[108970]: pgmap v377: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:01.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:01 smithi017 ceph-mon[108970]: pgmap v378: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:02.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:01 smithi172 ceph-mon[80431]: pgmap v378: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:04.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:03 smithi017 ceph-mon[108970]: pgmap v379: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:04.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:03 smithi172 ceph-mon[80431]: pgmap v379: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:06.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:05 smithi017 ceph-mon[108970]: pgmap v380: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:06.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:05 smithi172 ceph-mon[80431]: pgmap v380: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:07.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:07 smithi017 ceph-mon[108970]: pgmap v381: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:07.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:48:08.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:07 smithi172 ceph-mon[80431]: pgmap v381: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:08.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:48:10.122 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:09 smithi172 ceph-mon[80431]: pgmap v382: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:10.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:09 smithi017 ceph-mon[108970]: pgmap v382: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:12.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:11 smithi017 ceph-mon[108970]: pgmap v383: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:12.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:11 smithi172 ceph-mon[80431]: pgmap v383: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:13.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:13 smithi017 ceph-mon[108970]: pgmap v384: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:14.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:13 smithi172 ceph-mon[80431]: pgmap v384: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:16.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:15 smithi017 ceph-mon[108970]: pgmap v385: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:16.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:15 smithi172 ceph-mon[80431]: pgmap v385: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:18.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:17 smithi017 ceph-mon[108970]: pgmap v386: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:18.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:17 smithi172 ceph-mon[80431]: pgmap v386: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:19.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:19 smithi017 ceph-mon[108970]: pgmap v387: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:20.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:19 smithi172 ceph-mon[80431]: pgmap v387: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:22.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:21 smithi017 ceph-mon[108970]: pgmap v388: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:22.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:21 smithi172 ceph-mon[80431]: pgmap v388: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:22.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:48:23.112 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:48:23.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.843+0000 7f91ec970640 1 -- 172.21.15.17:0/3518146213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e8101900 msgr2=0x7f91e8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:23.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.843+0000 7f91ec970640 1 --2- 172.21.15.17:0/3518146213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e8101900 0x7f91e8101d60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009880 tx=0x7f91dc02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:48:23.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.844+0000 7f91ec970640 1 -- 172.21.15.17:0/3518146213 shutdown_connections 2024-09-20T18:48:23.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.844+0000 7f91ec970640 1 --2- 172.21.15.17:0/3518146213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e8101900 0x7f91e8101d60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:23.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.844+0000 7f91ec970640 1 --2- 172.21.15.17:0/3518146213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91e8107900 0x7f91e8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:23.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.844+0000 7f91ec970640 1 -- 172.21.15.17:0/3518146213 >> 172.21.15.17:0/3518146213 conn(0x7f91e80fd600 msgr2=0x7f91e80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:23.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.844+0000 7f91ec970640 1 -- 172.21.15.17:0/3518146213 shutdown_connections 2024-09-20T18:48:23.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.844+0000 7f91ec970640 1 -- 172.21.15.17:0/3518146213 wait complete. 2024-09-20T18:48:23.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.844+0000 7f91ec970640 1 Processor -- start 2024-09-20T18:48:23.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.845+0000 7f91ec970640 1 -- start start 2024-09-20T18:48:23.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.845+0000 7f91ec970640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e8101900 0x7f91e819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:23.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.845+0000 7f91ec970640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91e8107900 0x7f91e819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:23.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.845+0000 7f91ec970640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f91e810edd0 con 0x7f91e8101900 2024-09-20T18:48:23.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.845+0000 7f91ec970640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f91e810ec50 con 0x7f91e8107900 2024-09-20T18:48:23.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.845+0000 7f91e659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e8101900 0x7f91e819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:23.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.845+0000 7f91e659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e8101900 0x7f91e819d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51266/0 (socket says 172.21.15.17:51266) 2024-09-20T18:48:23.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.845+0000 7f91e659c640 1 -- 172.21.15.17:0/3154698927 learned_addr learned my addr 172.21.15.17:0/3154698927 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:48:23.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.845+0000 7f91e5d9b640 1 --2- 172.21.15.17:0/3154698927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91e8107900 0x7f91e819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:23.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.845+0000 7f91e659c640 1 -- 172.21.15.17:0/3154698927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91e8107900 msgr2=0x7f91e819db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:23.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.845+0000 7f91e659c640 1 --2- 172.21.15.17:0/3154698927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91e8107900 0x7f91e819db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:23.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.845+0000 7f91e659c640 1 -- 172.21.15.17:0/3154698927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e81977a0 con 0x7f91e8101900 2024-09-20T18:48:23.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.846+0000 7f91e659c640 1 --2- 172.21.15.17:0/3154698927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e8101900 0x7f91e819d620 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f91d800e970 tx=0x7f91d800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:23.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.846+0000 7f91d77fe640 1 -- 172.21.15.17:0/3154698927 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f91d800cac0 con 0x7f91e8101900 2024-09-20T18:48:23.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.846+0000 7f91d77fe640 1 -- 172.21.15.17:0/3154698927 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f91d80054e0 con 0x7f91e8101900 2024-09-20T18:48:23.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.846+0000 7f91ec970640 1 -- 172.21.15.17:0/3154698927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e8197a90 con 0x7f91e8101900 2024-09-20T18:48:23.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.846+0000 7f91d77fe640 1 -- 172.21.15.17:0/3154698927 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f91d8010430 con 0x7f91e8101900 2024-09-20T18:48:23.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.846+0000 7f91ec970640 1 -- 172.21.15.17:0/3154698927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e8197ff0 con 0x7f91e8101900 2024-09-20T18:48:23.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.847+0000 7f91ec970640 1 -- 172.21.15.17:0/3154698927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e8103040 con 0x7f91e8101900 2024-09-20T18:48:23.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.848+0000 7f91d77fe640 1 -- 172.21.15.17:0/3154698927 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f91d8004f00 con 0x7f91e8101900 2024-09-20T18:48:23.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.848+0000 7f91d77fe640 1 --2- 172.21.15.17:0/3154698927 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f91d007af80 0x7f91d007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:23.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.848+0000 7f91d77fe640 1 -- 172.21.15.17:0/3154698927 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f91d809e640 con 0x7f91e8101900 2024-09-20T18:48:23.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.849+0000 7f91e5d9b640 1 --2- 172.21.15.17:0/3154698927 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f91d007af80 0x7f91d007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:23.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.849+0000 7f91e5d9b640 1 --2- 172.21.15.17:0/3154698927 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f91d007af80 0x7f91d007d440 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f91e8198af0 tx=0x7f91dc031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:23.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:23.853+0000 7f91d77fe640 1 -- 172.21.15.17:0/3154698927 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f91d8069c20 con 0x7f91e8101900 2024-09-20T18:48:24.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.058+0000 7f91ec970640 1 -- 172.21.15.17:0/3154698927 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f91e8198360 con 0x7f91d007af80 2024-09-20T18:48:24.076 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:23 smithi017 ceph-mon[108970]: pgmap v389: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.060+0000 7f91d77fe640 1 -- 172.21.15.17:0/3154698927 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f91e8198360 con 0x7f91d007af80 2024-09-20T18:48:24.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.062+0000 7f91ec970640 1 -- 172.21.15.17:0/3154698927 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f91d007af80 msgr2=0x7f91d007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.062+0000 7f91ec970640 1 --2- 172.21.15.17:0/3154698927 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f91d007af80 0x7f91d007d440 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f91e8198af0 tx=0x7f91dc031400 comp rx=0 tx=0).stop 2024-09-20T18:48:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.062+0000 7f91ec970640 1 -- 172.21.15.17:0/3154698927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e8101900 msgr2=0x7f91e819d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.062+0000 7f91ec970640 1 --2- 172.21.15.17:0/3154698927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e8101900 0x7f91e819d620 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f91d800e970 tx=0x7f91d800ed70 comp rx=0 tx=0).stop 2024-09-20T18:48:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.062+0000 7f91ec970640 1 -- 172.21.15.17:0/3154698927 shutdown_connections 2024-09-20T18:48:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.062+0000 7f91ec970640 1 --2- 172.21.15.17:0/3154698927 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f91d007af80 0x7f91d007d440 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.062+0000 7f91ec970640 1 --2- 172.21.15.17:0/3154698927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91e8107900 0x7f91e819db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.062+0000 7f91ec970640 1 --2- 172.21.15.17:0/3154698927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91e8101900 0x7f91e819d620 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.062+0000 7f91ec970640 1 -- 172.21.15.17:0/3154698927 >> 172.21.15.17:0/3154698927 conn(0x7f91e80fd600 msgr2=0x7f91e80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.062+0000 7f91ec970640 1 -- 172.21.15.17:0/3154698927 shutdown_connections 2024-09-20T18:48:24.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.062+0000 7f91ec970640 1 -- 172.21.15.17:0/3154698927 wait complete. 2024-09-20T18:48:24.089 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:48:24.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.148+0000 7fb754372640 1 -- 172.21.15.17:0/3351079344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c103430 msgr2=0x7fb74c10b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:24.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.148+0000 7fb754372640 1 --2- 172.21.15.17:0/3351079344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c103430 0x7fb74c10b920 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb7480098b0 tx=0x7fb74802a560 comp rx=0 tx=0).stop 2024-09-20T18:48:24.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.148+0000 7fb754372640 1 -- 172.21.15.17:0/3351079344 shutdown_connections 2024-09-20T18:48:24.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.148+0000 7fb754372640 1 --2- 172.21.15.17:0/3351079344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c103430 0x7fb74c10b920 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.148+0000 7fb754372640 1 --2- 172.21.15.17:0/3351079344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb74c102b10 0x7fb74c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.148+0000 7fb754372640 1 -- 172.21.15.17:0/3351079344 >> 172.21.15.17:0/3351079344 conn(0x7fb74c0fc550 msgr2=0x7fb74c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:24.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.149+0000 7fb754372640 1 -- 172.21.15.17:0/3351079344 shutdown_connections 2024-09-20T18:48:24.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.149+0000 7fb754372640 1 -- 172.21.15.17:0/3351079344 wait complete. 2024-09-20T18:48:24.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.149+0000 7fb754372640 1 Processor -- start 2024-09-20T18:48:24.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.149+0000 7fb754372640 1 -- start start 2024-09-20T18:48:24.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.149+0000 7fb754372640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c102b10 0x7fb74c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:24.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.149+0000 7fb754372640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb74c103430 0x7fb74c19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:24.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.149+0000 7fb754372640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb74c10ede0 con 0x7fb74c102b10 2024-09-20T18:48:24.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.149+0000 7fb754372640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb74c10ec60 con 0x7fb74c103430 2024-09-20T18:48:24.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.149+0000 7fb75210e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c102b10 0x7fb74c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:24.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.150+0000 7fb75210e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c102b10 0x7fb74c19d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51286/0 (socket says 172.21.15.17:51286) 2024-09-20T18:48:24.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.150+0000 7fb75210e640 1 -- 172.21.15.17:0/1178287130 learned_addr learned my addr 172.21.15.17:0/1178287130 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:48:24.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.150+0000 7fb75190d640 1 --2- 172.21.15.17:0/1178287130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb74c103430 0x7fb74c19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:24.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.150+0000 7fb75210e640 1 -- 172.21.15.17:0/1178287130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb74c103430 msgr2=0x7fb74c19dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:24.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.150+0000 7fb75210e640 1 --2- 172.21.15.17:0/1178287130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb74c103430 0x7fb74c19dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.150+0000 7fb75210e640 1 -- 172.21.15.17:0/1178287130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74c1977f0 con 0x7fb74c102b10 2024-09-20T18:48:24.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.150+0000 7fb75210e640 1 --2- 172.21.15.17:0/1178287130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c102b10 0x7fb74c19d670 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb74000ea00 tx=0x7fb74000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:24.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.150+0000 7fb73f7fe640 1 -- 172.21.15.17:0/1178287130 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb74000cb80 con 0x7fb74c102b10 2024-09-20T18:48:24.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.150+0000 7fb73f7fe640 1 -- 172.21.15.17:0/1178287130 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb74000cd20 con 0x7fb74c102b10 2024-09-20T18:48:24.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.150+0000 7fb754372640 1 -- 172.21.15.17:0/1178287130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb74c197ae0 con 0x7fb74c102b10 2024-09-20T18:48:24.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.150+0000 7fb73f7fe640 1 -- 172.21.15.17:0/1178287130 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb740011470 con 0x7fb74c102b10 2024-09-20T18:48:24.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.150+0000 7fb754372640 1 -- 172.21.15.17:0/1178287130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb74c198040 con 0x7fb74c102b10 2024-09-20T18:48:24.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.151+0000 7fb754372640 1 -- 172.21.15.17:0/1178287130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb74c06a520 con 0x7fb74c102b10 2024-09-20T18:48:24.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.152+0000 7fb73f7fe640 1 -- 172.21.15.17:0/1178287130 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb740005020 con 0x7fb74c102b10 2024-09-20T18:48:24.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.152+0000 7fb73f7fe640 1 --2- 172.21.15.17:0/1178287130 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb73807af90 0x7fb73807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:24.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.153+0000 7fb73f7fe640 1 -- 172.21.15.17:0/1178287130 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fb74009e3f0 con 0x7fb74c102b10 2024-09-20T18:48:24.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.153+0000 7fb75190d640 1 --2- 172.21.15.17:0/1178287130 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb73807af90 0x7fb73807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:24.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.153+0000 7fb75190d640 1 --2- 172.21.15.17:0/1178287130 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb73807af90 0x7fb73807d450 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb748000c00 tx=0x7fb748031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:24.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.157+0000 7fb73f7fe640 1 -- 172.21.15.17:0/1178287130 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb740016030 con 0x7fb74c102b10 2024-09-20T18:48:24.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:23 smithi172 ceph-mon[80431]: pgmap v389: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:24.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.364+0000 7fb754372640 1 -- 172.21.15.17:0/1178287130 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb74c198380 con 0x7fb73807af90 2024-09-20T18:48:24.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.365+0000 7fb73f7fe640 1 -- 172.21.15.17:0/1178287130 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fb74c198380 con 0x7fb73807af90 2024-09-20T18:48:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.368+0000 7fb754372640 1 -- 172.21.15.17:0/1178287130 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb73807af90 msgr2=0x7fb73807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.368+0000 7fb754372640 1 --2- 172.21.15.17:0/1178287130 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb73807af90 0x7fb73807d450 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb748000c00 tx=0x7fb748031400 comp rx=0 tx=0).stop 2024-09-20T18:48:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.368+0000 7fb754372640 1 -- 172.21.15.17:0/1178287130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c102b10 msgr2=0x7fb74c19d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.368+0000 7fb754372640 1 --2- 172.21.15.17:0/1178287130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c102b10 0x7fb74c19d670 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb74000ea00 tx=0x7fb74000eec0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.368+0000 7fb754372640 1 -- 172.21.15.17:0/1178287130 shutdown_connections 2024-09-20T18:48:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.368+0000 7fb754372640 1 --2- 172.21.15.17:0/1178287130 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb73807af90 0x7fb73807d450 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.368+0000 7fb754372640 1 --2- 172.21.15.17:0/1178287130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb74c103430 0x7fb74c19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.368+0000 7fb754372640 1 --2- 172.21.15.17:0/1178287130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c102b10 0x7fb74c19d670 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.368+0000 7fb754372640 1 -- 172.21.15.17:0/1178287130 >> 172.21.15.17:0/1178287130 conn(0x7fb74c0fc550 msgr2=0x7fb74c103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.368+0000 7fb754372640 1 -- 172.21.15.17:0/1178287130 shutdown_connections 2024-09-20T18:48:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.368+0000 7fb754372640 1 -- 172.21.15.17:0/1178287130 wait complete. 2024-09-20T18:48:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.452+0000 7fb41ae6d640 1 -- 172.21.15.17:0/4066832745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb414106800 msgr2=0x7fb414106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.452+0000 7fb41ae6d640 1 --2- 172.21.15.17:0/4066832745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb414106800 0x7fb414106be0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb404009880 tx=0x7fb40402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.452+0000 7fb41ae6d640 1 -- 172.21.15.17:0/4066832745 shutdown_connections 2024-09-20T18:48:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.452+0000 7fb41ae6d640 1 --2- 172.21.15.17:0/4066832745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb414100800 0x7fb414100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.452+0000 7fb41ae6d640 1 --2- 172.21.15.17:0/4066832745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb414106800 0x7fb414106be0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.452+0000 7fb41ae6d640 1 -- 172.21.15.17:0/4066832745 >> 172.21.15.17:0/4066832745 conn(0x7fb4140fc520 msgr2=0x7fb4140fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.452+0000 7fb41ae6d640 1 -- 172.21.15.17:0/4066832745 shutdown_connections 2024-09-20T18:48:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.452+0000 7fb41ae6d640 1 -- 172.21.15.17:0/4066832745 wait complete. 2024-09-20T18:48:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.453+0000 7fb41ae6d640 1 Processor -- start 2024-09-20T18:48:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.453+0000 7fb41ae6d640 1 -- start start 2024-09-20T18:48:24.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.453+0000 7fb41ae6d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb414100800 0x7fb414198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:24.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.453+0000 7fb41ae6d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb414106800 0x7fb414198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:24.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.453+0000 7fb41ae6d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb41410dcd0 con 0x7fb414106800 2024-09-20T18:48:24.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.453+0000 7fb41ae6d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb41410db50 con 0x7fb414100800 2024-09-20T18:48:24.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.453+0000 7fb413fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb414106800 0x7fb414198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:24.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.453+0000 7fb413fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb414106800 0x7fb414198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51300/0 (socket says 172.21.15.17:51300) 2024-09-20T18:48:24.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.453+0000 7fb413fff640 1 -- 172.21.15.17:0/2812772257 learned_addr learned my addr 172.21.15.17:0/2812772257 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:48:24.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.453+0000 7fb418c09640 1 --2- 172.21.15.17:0/2812772257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb414100800 0x7fb414198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:24.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.454+0000 7fb413fff640 1 -- 172.21.15.17:0/2812772257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb414100800 msgr2=0x7fb414198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:24.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.454+0000 7fb413fff640 1 --2- 172.21.15.17:0/2812772257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb414100800 0x7fb414198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.454+0000 7fb413fff640 1 -- 172.21.15.17:0/2812772257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb414199350 con 0x7fb414106800 2024-09-20T18:48:24.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.454+0000 7fb413fff640 1 --2- 172.21.15.17:0/2812772257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb414106800 0x7fb414198d50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00e970 tx=0x7fb3fc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.454+0000 7fb411ffb640 1 -- 172.21.15.17:0/2812772257 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb3fc00cac0 con 0x7fb414106800 2024-09-20T18:48:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.454+0000 7fb411ffb640 1 -- 172.21.15.17:0/2812772257 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb3fc0054e0 con 0x7fb414106800 2024-09-20T18:48:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.454+0000 7fb41ae6d640 1 -- 172.21.15.17:0/2812772257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb414199640 con 0x7fb414106800 2024-09-20T18:48:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.454+0000 7fb411ffb640 1 -- 172.21.15.17:0/2812772257 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb3fc010430 con 0x7fb414106800 2024-09-20T18:48:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.454+0000 7fb41ae6d640 1 -- 172.21.15.17:0/2812772257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4141a1c40 con 0x7fb414106800 2024-09-20T18:48:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.455+0000 7fb41ae6d640 1 -- 172.21.15.17:0/2812772257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb414101f40 con 0x7fb414106800 2024-09-20T18:48:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.456+0000 7fb411ffb640 1 -- 172.21.15.17:0/2812772257 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb3fc004e80 con 0x7fb414106800 2024-09-20T18:48:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.456+0000 7fb411ffb640 1 --2- 172.21.15.17:0/2812772257 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb40007af30 0x7fb40007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.456+0000 7fb411ffb640 1 -- 172.21.15.17:0/2812772257 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fb3fc09e630 con 0x7fb414106800 2024-09-20T18:48:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.456+0000 7fb418c09640 1 --2- 172.21.15.17:0/2812772257 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb40007af30 0x7fb40007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:24.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.457+0000 7fb418c09640 1 --2- 172.21.15.17:0/2812772257 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb40007af30 0x7fb40007d3f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb4040096c0 tx=0x7fb404031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:24.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.461+0000 7fb411ffb640 1 -- 172.21.15.17:0/2812772257 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb414199640 con 0x7fb414106800 2024-09-20T18:48:24.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.658+0000 7fb41ae6d640 1 -- 172.21.15.17:0/2812772257 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb414062630 con 0x7fb40007af30 2024-09-20T18:48:24.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.668+0000 7fb411ffb640 1 -- 172.21.15.17:0/2812772257 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb414062630 con 0x7fb40007af30 2024-09-20T18:48:24.685 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:48:24.685 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (9m) 3m ago 20m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:48:24.685 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (12m) 3m ago 20m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:48:24.686 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (12m) 3m ago 20m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:48:24.686 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (8m) 3m ago 20m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:48:24.686 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (8m) 3m ago 20m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:48:24.686 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (9m) 3m ago 20m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:48:24.686 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (4m) 3m ago 15m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:48:24.686 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (4m) 3m ago 15m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:48:24.686 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (15m) 3m ago 15m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:48:24.686 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (3m) 3m ago 15m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:48:24.686 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (11m) 3m ago 22m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:48:24.686 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (10m) 3m ago 19m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:48:24.686 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (8m) 3m ago 22m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:48:24.686 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (8m) 3m ago 19m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:48:24.686 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (10m) 3m ago 20m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:48:24.687 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (10m) 3m ago 19m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:48:24.687 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (7m) 3m ago 18m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:48:24.687 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (7m) 3m ago 18m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:48:24.687 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (6m) 3m ago 17m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:48:24.687 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (5m) 3m ago 17m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:48:24.687 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (5m) 3m ago 16m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:48:24.687 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (4m) 3m ago 16m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:48:24.687 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (10m) 3m ago 20m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:48:24.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.670+0000 7fb41ae6d640 1 -- 172.21.15.17:0/2812772257 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb40007af30 msgr2=0x7fb40007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:24.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.670+0000 7fb41ae6d640 1 --2- 172.21.15.17:0/2812772257 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb40007af30 0x7fb40007d3f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb4040096c0 tx=0x7fb404031400 comp rx=0 tx=0).stop 2024-09-20T18:48:24.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.670+0000 7fb41ae6d640 1 -- 172.21.15.17:0/2812772257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb414106800 msgr2=0x7fb414198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:24.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.670+0000 7fb41ae6d640 1 --2- 172.21.15.17:0/2812772257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb414106800 0x7fb414198d50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00e970 tx=0x7fb3fc00ed70 comp rx=0 tx=0).stop 2024-09-20T18:48:24.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.670+0000 7fb41ae6d640 1 -- 172.21.15.17:0/2812772257 shutdown_connections 2024-09-20T18:48:24.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.670+0000 7fb41ae6d640 1 --2- 172.21.15.17:0/2812772257 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb40007af30 0x7fb40007d3f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.670+0000 7fb41ae6d640 1 --2- 172.21.15.17:0/2812772257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb414106800 0x7fb414198d50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.670+0000 7fb41ae6d640 1 --2- 172.21.15.17:0/2812772257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb414100800 0x7fb414198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.670+0000 7fb41ae6d640 1 -- 172.21.15.17:0/2812772257 >> 172.21.15.17:0/2812772257 conn(0x7fb4140fc520 msgr2=0x7fb4140fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:24.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.670+0000 7fb41ae6d640 1 -- 172.21.15.17:0/2812772257 shutdown_connections 2024-09-20T18:48:24.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.670+0000 7fb41ae6d640 1 -- 172.21.15.17:0/2812772257 wait complete. 2024-09-20T18:48:24.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.753+0000 7fe4b05d0640 1 -- 172.21.15.17:0/2366921400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4a8101900 msgr2=0x7fe4a8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:24.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.753+0000 7fe4b05d0640 1 --2- 172.21.15.17:0/2366921400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4a8101900 0x7fe4a8101d60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe498009880 tx=0x7fe49802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.753+0000 7fe4b05d0640 1 -- 172.21.15.17:0/2366921400 shutdown_connections 2024-09-20T18:48:24.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.753+0000 7fe4b05d0640 1 --2- 172.21.15.17:0/2366921400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4a8101900 0x7fe4a8101d60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.753+0000 7fe4b05d0640 1 --2- 172.21.15.17:0/2366921400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4a8107900 0x7fe4a8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.753+0000 7fe4b05d0640 1 -- 172.21.15.17:0/2366921400 >> 172.21.15.17:0/2366921400 conn(0x7fe4a80fd600 msgr2=0x7fe4a80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:24.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.753+0000 7fe4b05d0640 1 -- 172.21.15.17:0/2366921400 shutdown_connections 2024-09-20T18:48:24.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.753+0000 7fe4b05d0640 1 -- 172.21.15.17:0/2366921400 wait complete. 2024-09-20T18:48:24.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.754+0000 7fe4b05d0640 1 Processor -- start 2024-09-20T18:48:24.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.754+0000 7fe4b05d0640 1 -- start start 2024-09-20T18:48:24.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.754+0000 7fe4b05d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4a8101900 0x7fe4a819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:24.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.754+0000 7fe4b05d0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4a8107900 0x7fe4a819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:24.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.754+0000 7fe4b05d0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a810edb0 con 0x7fe4a8101900 2024-09-20T18:48:24.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.754+0000 7fe4b05d0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a810ec30 con 0x7fe4a8107900 2024-09-20T18:48:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.754+0000 7fe4ae36c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4a8101900 0x7fe4a819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.754+0000 7fe4ae36c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4a8101900 0x7fe4a819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51314/0 (socket says 172.21.15.17:51314) 2024-09-20T18:48:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.754+0000 7fe4ae36c640 1 -- 172.21.15.17:0/3320242682 learned_addr learned my addr 172.21.15.17:0/3320242682 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:48:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.755+0000 7fe4adb6b640 1 --2- 172.21.15.17:0/3320242682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4a8107900 0x7fe4a819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.755+0000 7fe4ae36c640 1 -- 172.21.15.17:0/3320242682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4a8107900 msgr2=0x7fe4a819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.755+0000 7fe4ae36c640 1 --2- 172.21.15.17:0/3320242682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4a8107900 0x7fe4a819dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.755+0000 7fe4ae36c640 1 -- 172.21.15.17:0/3320242682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a8197800 con 0x7fe4a8101900 2024-09-20T18:48:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.755+0000 7fe4adb6b640 1 --2- 172.21.15.17:0/3320242682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4a8107900 0x7fe4a819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:48:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.755+0000 7fe4ae36c640 1 --2- 172.21.15.17:0/3320242682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4a8101900 0x7fe4a819d680 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400c8a0 tx=0x7fe4a400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.755+0000 7fe49f7fe640 1 -- 172.21.15.17:0/3320242682 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe4a40079b0 con 0x7fe4a8101900 2024-09-20T18:48:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.755+0000 7fe49f7fe640 1 -- 172.21.15.17:0/3320242682 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe4a4007b50 con 0x7fe4a8101900 2024-09-20T18:48:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.755+0000 7fe4b05d0640 1 -- 172.21.15.17:0/3320242682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a8197af0 con 0x7fe4a8101900 2024-09-20T18:48:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.755+0000 7fe49f7fe640 1 -- 172.21.15.17:0/3320242682 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe4a4018700 con 0x7fe4a8101900 2024-09-20T18:48:24.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.755+0000 7fe4b05d0640 1 -- 172.21.15.17:0/3320242682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a8198080 con 0x7fe4a8101900 2024-09-20T18:48:24.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.756+0000 7fe4b05d0640 1 -- 172.21.15.17:0/3320242682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a8103040 con 0x7fe4a8101900 2024-09-20T18:48:24.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.757+0000 7fe49f7fe640 1 -- 172.21.15.17:0/3320242682 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe4a4007d00 con 0x7fe4a8101900 2024-09-20T18:48:24.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.757+0000 7fe49f7fe640 1 --2- 172.21.15.17:0/3320242682 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe49407af80 0x7fe49407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:24.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.757+0000 7fe49f7fe640 1 -- 172.21.15.17:0/3320242682 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fe4a409e250 con 0x7fe4a8101900 2024-09-20T18:48:24.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.757+0000 7fe4adb6b640 1 --2- 172.21.15.17:0/3320242682 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe49407af80 0x7fe49407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:24.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.758+0000 7fe4adb6b640 1 --2- 172.21.15.17:0/3320242682 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe49407af80 0x7fe49407d440 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe498031460 tx=0x7fe4980095f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:24.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:24.762+0000 7fe49f7fe640 1 -- 172.21.15.17:0/3320242682 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe4a4014030 con 0x7fe4a8101900 2024-09-20T18:48:25.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.025+0000 7fe4b05d0640 1 -- 172.21.15.17:0/3320242682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe4a8109e90 con 0x7fe4a8101900 2024-09-20T18:48:25.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.025+0000 7fe49f7fe640 1 -- 172.21.15.17:0/3320242682 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fe4a40698d0 con 0x7fe4a8101900 2024-09-20T18:48:25.043 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:48:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:48:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:48:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:48:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:48:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:48:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:48:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:48:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:48:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:48:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:48:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:48:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:48:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:48:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:48:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:48:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:48:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:48:25.044 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:48:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.028+0000 7fe4b05d0640 1 -- 172.21.15.17:0/3320242682 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe49407af80 msgr2=0x7fe49407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.028+0000 7fe4b05d0640 1 --2- 172.21.15.17:0/3320242682 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe49407af80 0x7fe49407d440 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe498031460 tx=0x7fe4980095f0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.028+0000 7fe4b05d0640 1 -- 172.21.15.17:0/3320242682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4a8101900 msgr2=0x7fe4a819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.028+0000 7fe4b05d0640 1 --2- 172.21.15.17:0/3320242682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4a8101900 0x7fe4a819d680 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400c8a0 tx=0x7fe4a400cd60 comp rx=0 tx=0).stop 2024-09-20T18:48:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.028+0000 7fe4b05d0640 1 -- 172.21.15.17:0/3320242682 shutdown_connections 2024-09-20T18:48:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.028+0000 7fe4b05d0640 1 --2- 172.21.15.17:0/3320242682 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe49407af80 0x7fe49407d440 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.028+0000 7fe4b05d0640 1 --2- 172.21.15.17:0/3320242682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4a8107900 0x7fe4a819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.028+0000 7fe4b05d0640 1 --2- 172.21.15.17:0/3320242682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4a8101900 0x7fe4a819d680 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.028+0000 7fe4b05d0640 1 -- 172.21.15.17:0/3320242682 >> 172.21.15.17:0/3320242682 conn(0x7fe4a80fd600 msgr2=0x7fe4a80fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.028+0000 7fe4b05d0640 1 -- 172.21.15.17:0/3320242682 shutdown_connections 2024-09-20T18:48:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.028+0000 7fe4b05d0640 1 -- 172.21.15.17:0/3320242682 wait complete. 2024-09-20T18:48:25.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.112+0000 7f700554e640 1 -- 172.21.15.17:0/179375063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7000106800 msgr2=0x7f7000106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:25.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.112+0000 7f700554e640 1 --2- 172.21.15.17:0/179375063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7000106800 0x7f7000106be0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009880 tx=0x7f6ff002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.112+0000 7f700554e640 1 -- 172.21.15.17:0/179375063 shutdown_connections 2024-09-20T18:48:25.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.112+0000 7f700554e640 1 --2- 172.21.15.17:0/179375063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7000100800 0x7f7000100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.112+0000 7f700554e640 1 --2- 172.21.15.17:0/179375063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7000106800 0x7f7000106be0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.112+0000 7f700554e640 1 -- 172.21.15.17:0/179375063 >> 172.21.15.17:0/179375063 conn(0x7f70000fc520 msgr2=0x7f70000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:25.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.113+0000 7f700554e640 1 -- 172.21.15.17:0/179375063 shutdown_connections 2024-09-20T18:48:25.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.113+0000 7f700554e640 1 -- 172.21.15.17:0/179375063 wait complete. 2024-09-20T18:48:25.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.113+0000 7f700554e640 1 Processor -- start 2024-09-20T18:48:25.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.113+0000 7f700554e640 1 -- start start 2024-09-20T18:48:25.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f700554e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7000100800 0x7f700019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:25.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f700554e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7000106800 0x7f700019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:25.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f700554e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f700010dcb0 con 0x7f7000100800 2024-09-20T18:48:25.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f700554e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f700010db30 con 0x7f7000106800 2024-09-20T18:48:25.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f6ffeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7000100800 0x7f700019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:25.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f6ffeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7000100800 0x7f700019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51328/0 (socket says 172.21.15.17:51328) 2024-09-20T18:48:25.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f6ffeffd640 1 -- 172.21.15.17:0/3111704229 learned_addr learned my addr 172.21.15.17:0/3111704229 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:48:25.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f6ffe7fc640 1 --2- 172.21.15.17:0/3111704229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7000106800 0x7f700019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:25.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f6ffeffd640 1 -- 172.21.15.17:0/3111704229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7000106800 msgr2=0x7f700019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:25.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f6ffeffd640 1 --2- 172.21.15.17:0/3111704229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7000106800 0x7f700019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f6ffeffd640 1 -- 172.21.15.17:0/3111704229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70001977c0 con 0x7f7000100800 2024-09-20T18:48:25.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f6ffe7fc640 1 --2- 172.21.15.17:0/3111704229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7000106800 0x7f700019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:48:25.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f6ffeffd640 1 --2- 172.21.15.17:0/3111704229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7000100800 0x7f700019d640 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0031460 tx=0x7f6ff00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:25.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f6fe7fff640 1 -- 172.21.15.17:0/3111704229 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ff003f070 con 0x7f7000100800 2024-09-20T18:48:25.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f6fe7fff640 1 -- 172.21.15.17:0/3111704229 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ff0004cf0 con 0x7f7000100800 2024-09-20T18:48:25.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f6fe7fff640 1 -- 172.21.15.17:0/3111704229 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ff0035030 con 0x7f7000100800 2024-09-20T18:48:25.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f700554e640 1 -- 172.21.15.17:0/3111704229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7000197a50 con 0x7f7000100800 2024-09-20T18:48:25.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.114+0000 7f700554e640 1 -- 172.21.15.17:0/3111704229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7000197f80 con 0x7f7000100800 2024-09-20T18:48:25.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.116+0000 7f700554e640 1 -- 172.21.15.17:0/3111704229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7000101f40 con 0x7f7000100800 2024-09-20T18:48:25.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.116+0000 7f6fe7fff640 1 -- 172.21.15.17:0/3111704229 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6ff0042070 con 0x7f7000100800 2024-09-20T18:48:25.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.117+0000 7f6fe7fff640 1 --2- 172.21.15.17:0/3111704229 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6fe807af30 0x7f6fe807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:25.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.117+0000 7f6fe7fff640 1 -- 172.21.15.17:0/3111704229 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f6ff00beac0 con 0x7f7000100800 2024-09-20T18:48:25.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.117+0000 7f6ffe7fc640 1 --2- 172.21.15.17:0/3111704229 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6fe807af30 0x7f6fe807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:25.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.117+0000 7f6ffe7fc640 1 --2- 172.21.15.17:0/3111704229 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6fe807af30 0x7f6fe807d3f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f70000ffb40 tx=0x7f6ff4005d90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:25.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.121+0000 7f6fe7fff640 1 -- 172.21.15.17:0/3111704229 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ff008a0c0 con 0x7f7000100800 2024-09-20T18:48:25.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.347+0000 7f700554e640 1 -- 172.21.15.17:0/3111704229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7000198230 con 0x7f7000100800 2024-09-20T18:48:25.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.348+0000 7f6fe7fff640 1 -- 172.21.15.17:0/3111704229 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f6ff008ef70 con 0x7f7000100800 2024-09-20T18:48:25.365 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:48:25.365 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:48:25.365 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:48:25.365 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:48:25.366 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:48:25.366 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:48:25.366 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:48:25.366 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:48:25.366 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:48:25.366 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:48:25.366 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:48:25.366 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:48:25.366 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:48:25.366 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:48:25.366 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:48:25.366 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:48:25.366 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:48:25.367 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:48:25.367 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:48:25.367 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:48:25.367 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:48:25.367 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:48:25.367 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:48:25.367 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:48:25.367 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:48:25.367 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:48:25.367 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:48:25.367 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:48:25.367 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:48:25.367 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:48:25.367 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:48:25.368 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:48:25.368 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:48:25.368 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:48:25.368 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:48:25.368 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:48:25.368 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:48:25.368 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:48:25.368 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:48:25.368 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:48:25.368 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:48:25.368 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:48:25.368 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:48:25.369 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:48:25.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.351+0000 7f700554e640 1 -- 172.21.15.17:0/3111704229 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6fe807af30 msgr2=0x7f6fe807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:25.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.351+0000 7f700554e640 1 --2- 172.21.15.17:0/3111704229 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6fe807af30 0x7f6fe807d3f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f70000ffb40 tx=0x7f6ff4005d90 comp rx=0 tx=0).stop 2024-09-20T18:48:25.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.351+0000 7f700554e640 1 -- 172.21.15.17:0/3111704229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7000100800 msgr2=0x7f700019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:25.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.351+0000 7f700554e640 1 --2- 172.21.15.17:0/3111704229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7000100800 0x7f700019d640 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0031460 tx=0x7f6ff00048f0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.351+0000 7f700554e640 1 -- 172.21.15.17:0/3111704229 shutdown_connections 2024-09-20T18:48:25.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.351+0000 7f700554e640 1 --2- 172.21.15.17:0/3111704229 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6fe807af30 0x7f6fe807d3f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.351+0000 7f700554e640 1 --2- 172.21.15.17:0/3111704229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7000106800 0x7f700019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.351+0000 7f700554e640 1 --2- 172.21.15.17:0/3111704229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7000100800 0x7f700019d640 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.351+0000 7f700554e640 1 -- 172.21.15.17:0/3111704229 >> 172.21.15.17:0/3111704229 conn(0x7f70000fc520 msgr2=0x7f700006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:25.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.351+0000 7f700554e640 1 -- 172.21.15.17:0/3111704229 shutdown_connections 2024-09-20T18:48:25.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.351+0000 7f700554e640 1 -- 172.21.15.17:0/3111704229 wait complete. 2024-09-20T18:48:25.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.438+0000 7fbefed8a640 1 -- 172.21.15.17:0/4099063580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbef8102ab0 msgr2=0x7fbef8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:25.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.438+0000 7fbefed8a640 1 --2- 172.21.15.17:0/4099063580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbef8102ab0 0x7fbef8102e90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009880 tx=0x7fbef002a530 comp rx=0 tx=0).stop 2024-09-20T18:48:25.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.438+0000 7fbefed8a640 1 -- 172.21.15.17:0/4099063580 shutdown_connections 2024-09-20T18:48:25.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.438+0000 7fbefed8a640 1 --2- 172.21.15.17:0/4099063580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef81033d0 0x7fbef810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.438+0000 7fbefed8a640 1 --2- 172.21.15.17:0/4099063580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbef8102ab0 0x7fbef8102e90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.438+0000 7fbefed8a640 1 -- 172.21.15.17:0/4099063580 >> 172.21.15.17:0/4099063580 conn(0x7fbef80fc550 msgr2=0x7fbef80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:25.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.438+0000 7fbefed8a640 1 -- 172.21.15.17:0/4099063580 shutdown_connections 2024-09-20T18:48:25.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.438+0000 7fbefed8a640 1 -- 172.21.15.17:0/4099063580 wait complete. 2024-09-20T18:48:25.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.438+0000 7fbefed8a640 1 Processor -- start 2024-09-20T18:48:25.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.438+0000 7fbefed8a640 1 -- start start 2024-09-20T18:48:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.439+0000 7fbefed8a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbef8102ab0 0x7fbef819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.439+0000 7fbefed8a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef81033d0 0x7fbef819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.439+0000 7fbefed8a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbef810ede0 con 0x7fbef8102ab0 2024-09-20T18:48:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.439+0000 7fbefed8a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbef810ec60 con 0x7fbef81033d0 2024-09-20T18:48:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.439+0000 7fbefcb26640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbef8102ab0 0x7fbef819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.439+0000 7fbefcb26640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbef8102ab0 0x7fbef819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51354/0 (socket says 172.21.15.17:51354) 2024-09-20T18:48:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.439+0000 7fbefcb26640 1 -- 172.21.15.17:0/40767369 learned_addr learned my addr 172.21.15.17:0/40767369 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:48:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.439+0000 7fbef7fff640 1 --2- 172.21.15.17:0/40767369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef81033d0 0x7fbef819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:25.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.439+0000 7fbefcb26640 1 -- 172.21.15.17:0/40767369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef81033d0 msgr2=0x7fbef819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:25.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.439+0000 7fbefcb26640 1 --2- 172.21.15.17:0/40767369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef81033d0 0x7fbef819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.439+0000 7fbefcb26640 1 -- 172.21.15.17:0/40767369 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef81977b0 con 0x7fbef8102ab0 2024-09-20T18:48:25.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.439+0000 7fbef7fff640 1 --2- 172.21.15.17:0/40767369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef81033d0 0x7fbef819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:48:25.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.439+0000 7fbefcb26640 1 --2- 172.21.15.17:0/40767369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbef8102ab0 0x7fbef819d630 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbef0031460 tx=0x7fbef00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:25.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.439+0000 7fbef5ffb640 1 -- 172.21.15.17:0/40767369 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbef003f070 con 0x7fbef8102ab0 2024-09-20T18:48:25.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.439+0000 7fbef5ffb640 1 -- 172.21.15.17:0/40767369 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbef0004cf0 con 0x7fbef8102ab0 2024-09-20T18:48:25.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.439+0000 7fbefed8a640 1 -- 172.21.15.17:0/40767369 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef8197a40 con 0x7fbef8102ab0 2024-09-20T18:48:25.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.440+0000 7fbef5ffb640 1 -- 172.21.15.17:0/40767369 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbef0035030 con 0x7fbef8102ab0 2024-09-20T18:48:25.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.440+0000 7fbefed8a640 1 -- 172.21.15.17:0/40767369 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef8197f70 con 0x7fbef8102ab0 2024-09-20T18:48:25.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.441+0000 7fbefed8a640 1 -- 172.21.15.17:0/40767369 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef806a580 con 0x7fbef8102ab0 2024-09-20T18:48:25.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.442+0000 7fbef5ffb640 1 -- 172.21.15.17:0/40767369 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fbef0042070 con 0x7fbef8102ab0 2024-09-20T18:48:25.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.442+0000 7fbef5ffb640 1 --2- 172.21.15.17:0/40767369 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbee407af80 0x7fbee407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:25.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.442+0000 7fbef5ffb640 1 -- 172.21.15.17:0/40767369 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fbef00be9e0 con 0x7fbef8102ab0 2024-09-20T18:48:25.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.442+0000 7fbef7fff640 1 --2- 172.21.15.17:0/40767369 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbee407af80 0x7fbee407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:25.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.443+0000 7fbef7fff640 1 --2- 172.21.15.17:0/40767369 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbee407af80 0x7fbee407d440 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbef81088f0 tx=0x7fbee8008380 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:25.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.446+0000 7fbef5ffb640 1 -- 172.21.15.17:0/40767369 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbef008a060 con 0x7fbef8102ab0 2024-09-20T18:48:25.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.665+0000 7fbefed8a640 1 -- 172.21.15.17:0/40767369 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbef8198220 con 0x7fbee407af80 2024-09-20T18:48:25.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.666+0000 7fbef5ffb640 1 -- 172.21.15.17:0/40767369 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fbef8198220 con 0x7fbee407af80 2024-09-20T18:48:25.683 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:48:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:48:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:48:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:48:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:48:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:48:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:48:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:48:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:48:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:48:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:48:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:48:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:48:25.684 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:48:25.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.668+0000 7fbefed8a640 1 -- 172.21.15.17:0/40767369 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbee407af80 msgr2=0x7fbee407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:25.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.668+0000 7fbefed8a640 1 --2- 172.21.15.17:0/40767369 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbee407af80 0x7fbee407d440 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbef81088f0 tx=0x7fbee8008380 comp rx=0 tx=0).stop 2024-09-20T18:48:25.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.668+0000 7fbefed8a640 1 -- 172.21.15.17:0/40767369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbef8102ab0 msgr2=0x7fbef819d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:25.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.668+0000 7fbefed8a640 1 --2- 172.21.15.17:0/40767369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbef8102ab0 0x7fbef819d630 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbef0031460 tx=0x7fbef00048f0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.668+0000 7fbefed8a640 1 -- 172.21.15.17:0/40767369 shutdown_connections 2024-09-20T18:48:25.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.668+0000 7fbefed8a640 1 --2- 172.21.15.17:0/40767369 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbee407af80 0x7fbee407d440 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.668+0000 7fbefed8a640 1 --2- 172.21.15.17:0/40767369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef81033d0 0x7fbef819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.668+0000 7fbefed8a640 1 --2- 172.21.15.17:0/40767369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbef8102ab0 0x7fbef819d630 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.668+0000 7fbefed8a640 1 -- 172.21.15.17:0/40767369 >> 172.21.15.17:0/40767369 conn(0x7fbef80fc550 msgr2=0x7fbef810aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:25.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.668+0000 7fbefed8a640 1 -- 172.21.15.17:0/40767369 shutdown_connections 2024-09-20T18:48:25.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.668+0000 7fbefed8a640 1 -- 172.21.15.17:0/40767369 wait complete. 2024-09-20T18:48:25.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.753+0000 7fce5ef59640 1 -- 172.21.15.17:0/1273366793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce58100160 msgr2=0x7fce581005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:25.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.753+0000 7fce5ef59640 1 --2- 172.21.15.17:0/1273366793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce58100160 0x7fce581005e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fce48009c20 tx=0x7fce4802a970 comp rx=0 tx=0).stop 2024-09-20T18:48:25.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.753+0000 7fce5ef59640 1 -- 172.21.15.17:0/1273366793 shutdown_connections 2024-09-20T18:48:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.753+0000 7fce5ef59640 1 --2- 172.21.15.17:0/1273366793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce58100160 0x7fce581005e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.753+0000 7fce5ef59640 1 --2- 172.21.15.17:0/1273366793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce58102640 0x7fce58102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.753+0000 7fce5ef59640 1 -- 172.21.15.17:0/1273366793 >> 172.21.15.17:0/1273366793 conn(0x7fce580771e0 msgr2=0x7fce580775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.753+0000 7fce5ef59640 1 -- 172.21.15.17:0/1273366793 shutdown_connections 2024-09-20T18:48:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.753+0000 7fce5ef59640 1 -- 172.21.15.17:0/1273366793 wait complete. 2024-09-20T18:48:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.754+0000 7fce5ef59640 1 Processor -- start 2024-09-20T18:48:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.754+0000 7fce5ef59640 1 -- start start 2024-09-20T18:48:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.754+0000 7fce5ef59640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce58100160 0x7fce5819f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.754+0000 7fce5ef59640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce58102640 0x7fce5819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.754+0000 7fce5ef59640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fce58110fe0 con 0x7fce58100160 2024-09-20T18:48:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.754+0000 7fce5ef59640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fce58110e60 con 0x7fce58102640 2024-09-20T18:48:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.754+0000 7fce5ccf5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce58100160 0x7fce5819f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.754+0000 7fce5ccf5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce58100160 0x7fce5819f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51378/0 (socket says 172.21.15.17:51378) 2024-09-20T18:48:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.754+0000 7fce5ccf5640 1 -- 172.21.15.17:0/207819048 learned_addr learned my addr 172.21.15.17:0/207819048 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:48:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.754+0000 7fce57fff640 1 --2- 172.21.15.17:0/207819048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce58102640 0x7fce5819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.755+0000 7fce5ccf5640 1 -- 172.21.15.17:0/207819048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce58102640 msgr2=0x7fce5819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.755+0000 7fce5ccf5640 1 --2- 172.21.15.17:0/207819048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce58102640 0x7fce5819fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.755+0000 7fce5ccf5640 1 -- 172.21.15.17:0/207819048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce58199950 con 0x7fce58100160 2024-09-20T18:48:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.755+0000 7fce5ccf5640 1 --2- 172.21.15.17:0/207819048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce58100160 0x7fce5819f790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fce4000e970 tx=0x7fce4000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.755+0000 7fce55ffb640 1 -- 172.21.15.17:0/207819048 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce4000cac0 con 0x7fce58100160 2024-09-20T18:48:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.755+0000 7fce55ffb640 1 -- 172.21.15.17:0/207819048 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce400054e0 con 0x7fce58100160 2024-09-20T18:48:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.755+0000 7fce5ef59640 1 -- 172.21.15.17:0/207819048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce58199c40 con 0x7fce58100160 2024-09-20T18:48:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.755+0000 7fce55ffb640 1 -- 172.21.15.17:0/207819048 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce40010430 con 0x7fce58100160 2024-09-20T18:48:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.755+0000 7fce5ef59640 1 -- 172.21.15.17:0/207819048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce5819a250 con 0x7fce58100160 2024-09-20T18:48:25.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.756+0000 7fce5ef59640 1 -- 172.21.15.17:0/207819048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce58069e70 con 0x7fce58100160 2024-09-20T18:48:25.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.757+0000 7fce55ffb640 1 -- 172.21.15.17:0/207819048 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fce40004ec0 con 0x7fce58100160 2024-09-20T18:48:25.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.757+0000 7fce55ffb640 1 --2- 172.21.15.17:0/207819048 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fce4407af30 0x7fce4407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:25.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.757+0000 7fce55ffb640 1 -- 172.21.15.17:0/207819048 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fce4009e750 con 0x7fce58100160 2024-09-20T18:48:25.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.757+0000 7fce57fff640 1 --2- 172.21.15.17:0/207819048 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fce4407af30 0x7fce4407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:25.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.758+0000 7fce57fff640 1 --2- 172.21.15.17:0/207819048 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fce4407af30 0x7fce4407d3f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fce58077750 tx=0x7fce48005f30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:25.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:25.762+0000 7fce55ffb640 1 -- 172.21.15.17:0/207819048 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce40069d50 con 0x7fce58100160 2024-09-20T18:48:26.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:26.021+0000 7fce5ef59640 1 -- 172.21.15.17:0/207819048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fce5819a560 con 0x7fce58100160 2024-09-20T18:48:26.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:25 smithi017 ceph-mon[108970]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:48:26.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:25 smithi017 ceph-mon[108970]: from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:48:26.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:25 smithi017 ceph-mon[108970]: pgmap v390: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:26.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:25 smithi017 ceph-mon[108970]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:48:26.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:25 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3320242682' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:48:26.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:25 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3111704229' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:48:26.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:26.021+0000 7fce55ffb640 1 -- 172.21.15.17:0/207819048 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fce4006ec00 con 0x7fce58100160 2024-09-20T18:48:26.040 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:48:26.040 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:48:26.040 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:48:26.040 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:48:26.040 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:48:26.040 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:48:26.040 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:48:26.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:26.024+0000 7fce5ef59640 1 -- 172.21.15.17:0/207819048 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fce4407af30 msgr2=0x7fce4407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:26.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:26.024+0000 7fce5ef59640 1 --2- 172.21.15.17:0/207819048 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fce4407af30 0x7fce4407d3f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fce58077750 tx=0x7fce48005f30 comp rx=0 tx=0).stop 2024-09-20T18:48:26.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:26.024+0000 7fce5ef59640 1 -- 172.21.15.17:0/207819048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce58100160 msgr2=0x7fce5819f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:26.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:26.024+0000 7fce5ef59640 1 --2- 172.21.15.17:0/207819048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce58100160 0x7fce5819f790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fce4000e970 tx=0x7fce4000ed70 comp rx=0 tx=0).stop 2024-09-20T18:48:26.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:26.024+0000 7fce5ef59640 1 -- 172.21.15.17:0/207819048 shutdown_connections 2024-09-20T18:48:26.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:26.024+0000 7fce5ef59640 1 --2- 172.21.15.17:0/207819048 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fce4407af30 0x7fce4407d3f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:26.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:26.024+0000 7fce5ef59640 1 --2- 172.21.15.17:0/207819048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce58102640 0x7fce5819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:26.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:26.024+0000 7fce5ef59640 1 --2- 172.21.15.17:0/207819048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce58100160 0x7fce5819f790 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:26.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:26.024+0000 7fce5ef59640 1 -- 172.21.15.17:0/207819048 >> 172.21.15.17:0/207819048 conn(0x7fce580771e0 msgr2=0x7fce580fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:26.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:26.024+0000 7fce5ef59640 1 -- 172.21.15.17:0/207819048 shutdown_connections 2024-09-20T18:48:26.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:26.024+0000 7fce5ef59640 1 -- 172.21.15.17:0/207819048 wait complete. 2024-09-20T18:48:26.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:25 smithi172 ceph-mon[80431]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:48:26.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:25 smithi172 ceph-mon[80431]: from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:48:26.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:25 smithi172 ceph-mon[80431]: pgmap v390: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:26.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:25 smithi172 ceph-mon[80431]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:48:26.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:25 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3320242682' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:48:26.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:25 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3111704229' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:48:27.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:26 smithi017 ceph-mon[108970]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:48:27.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:26 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/207819048' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:48:27.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:26 smithi172 ceph-mon[80431]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:48:27.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:26 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/207819048' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:48:27.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:27 smithi017 ceph-mon[108970]: pgmap v391: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:28.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:27 smithi172 ceph-mon[80431]: pgmap v391: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:30.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:29 smithi017 ceph-mon[108970]: pgmap v392: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:30.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:29 smithi172 ceph-mon[80431]: pgmap v392: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:31.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:31 smithi017 ceph-mon[108970]: pgmap v393: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:32.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:31 smithi172 ceph-mon[80431]: pgmap v393: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:34.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:33 smithi017 ceph-mon[108970]: pgmap v394: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:34.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:33 smithi172 ceph-mon[80431]: pgmap v394: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:36.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:35 smithi017 ceph-mon[108970]: pgmap v395: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:36.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:35 smithi172 ceph-mon[80431]: pgmap v395: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:37 smithi017 ceph-mon[108970]: pgmap v396: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:48:38.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:37 smithi172 ceph-mon[80431]: pgmap v396: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:38.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:48:40.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:39 smithi017 ceph-mon[108970]: pgmap v397: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:40.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:39 smithi172 ceph-mon[80431]: pgmap v397: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:42.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:41 smithi017 ceph-mon[108970]: pgmap v398: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:42.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:41 smithi172 ceph-mon[80431]: pgmap v398: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:43.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:43 smithi017 ceph-mon[108970]: pgmap v399: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:44.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:43 smithi172 ceph-mon[80431]: pgmap v399: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:45.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:45 smithi172 ceph-mon[80431]: pgmap v400: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:46.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:45 smithi017 ceph-mon[108970]: pgmap v400: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:48.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:47 smithi017 ceph-mon[108970]: pgmap v401: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:48.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:47 smithi172 ceph-mon[80431]: pgmap v401: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:49.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:49 smithi017 ceph-mon[108970]: pgmap v402: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:50.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:49 smithi172 ceph-mon[80431]: pgmap v402: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:52.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:51 smithi017 ceph-mon[108970]: pgmap v403: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:52.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:51 smithi172 ceph-mon[80431]: pgmap v403: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:52.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:48:53.112 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:48:54.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:53 smithi017 ceph-mon[108970]: pgmap v404: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:54.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:53 smithi172 ceph-mon[80431]: pgmap v404: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:55.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:55 smithi017 ceph-mon[108970]: pgmap v405: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.124+0000 7ffa7bc66640 1 -- 172.21.15.17:0/1210629626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa74101000 msgr2=0x7ffa7410dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.124+0000 7ffa7bc66640 1 --2- 172.21.15.17:0/1210629626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa74101000 0x7ffa7410dcc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009880 tx=0x7ffa6402a490 comp rx=0 tx=0).stop 2024-09-20T18:48:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.124+0000 7ffa7bc66640 1 -- 172.21.15.17:0/1210629626 shutdown_connections 2024-09-20T18:48:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.124+0000 7ffa7bc66640 1 --2- 172.21.15.17:0/1210629626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa74101000 0x7ffa7410dcc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.124+0000 7ffa7bc66640 1 --2- 172.21.15.17:0/1210629626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74100650 0x7ffa74100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.124+0000 7ffa7bc66640 1 -- 172.21.15.17:0/1210629626 >> 172.21.15.17:0/1210629626 conn(0x7ffa740fc520 msgr2=0x7ffa740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.124+0000 7ffa7bc66640 1 -- 172.21.15.17:0/1210629626 shutdown_connections 2024-09-20T18:48:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.125+0000 7ffa7bc66640 1 -- 172.21.15.17:0/1210629626 wait complete. 2024-09-20T18:48:56.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.125+0000 7ffa7bc66640 1 Processor -- start 2024-09-20T18:48:56.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.125+0000 7ffa7bc66640 1 -- start start 2024-09-20T18:48:56.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.125+0000 7ffa7bc66640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74100650 0x7ffa7419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:56.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.125+0000 7ffa7bc66640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa74101000 0x7ffa7419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:56.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.126+0000 7ffa7bc66640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffa74110f70 con 0x7ffa74101000 2024-09-20T18:48:56.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.126+0000 7ffa7bc66640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa74110df0 con 0x7ffa74100650 2024-09-20T18:48:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.126+0000 7ffa79201640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa74101000 0x7ffa7419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.126+0000 7ffa79201640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa74101000 0x7ffa7419fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43064/0 (socket says 172.21.15.17:43064) 2024-09-20T18:48:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.126+0000 7ffa79201640 1 -- 172.21.15.17:0/2793713092 learned_addr learned my addr 172.21.15.17:0/2793713092 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:48:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.126+0000 7ffa79a02640 1 --2- 172.21.15.17:0/2793713092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74100650 0x7ffa7419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.126+0000 7ffa79201640 1 -- 172.21.15.17:0/2793713092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74100650 msgr2=0x7ffa7419f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.126+0000 7ffa79201640 1 --2- 172.21.15.17:0/2793713092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74100650 0x7ffa7419f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.126+0000 7ffa79201640 1 -- 172.21.15.17:0/2793713092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa741999e0 con 0x7ffa74101000 2024-09-20T18:48:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.126+0000 7ffa79a02640 1 --2- 172.21.15.17:0/2793713092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74100650 0x7ffa7419f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:48:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.126+0000 7ffa79201640 1 --2- 172.21.15.17:0/2793713092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa74101000 0x7ffa7419fd60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ffa64031460 tx=0x7ffa640045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.126+0000 7ffa6affd640 1 -- 172.21.15.17:0/2793713092 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa6403f070 con 0x7ffa74101000 2024-09-20T18:48:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.126+0000 7ffa6affd640 1 -- 172.21.15.17:0/2793713092 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa640035f0 con 0x7ffa74101000 2024-09-20T18:48:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.126+0000 7ffa7bc66640 1 -- 172.21.15.17:0/2793713092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa74199c70 con 0x7ffa74101000 2024-09-20T18:48:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.127+0000 7ffa6affd640 1 -- 172.21.15.17:0/2793713092 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa64035030 con 0x7ffa74101000 2024-09-20T18:48:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.127+0000 7ffa7bc66640 1 -- 172.21.15.17:0/2793713092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa7419a200 con 0x7ffa74101000 2024-09-20T18:48:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.128+0000 7ffa7bc66640 1 -- 172.21.15.17:0/2793713092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa7406aa90 con 0x7ffa74101000 2024-09-20T18:48:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.128+0000 7ffa6affd640 1 -- 172.21.15.17:0/2793713092 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ffa64042070 con 0x7ffa74101000 2024-09-20T18:48:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.129+0000 7ffa6affd640 1 --2- 172.21.15.17:0/2793713092 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa6007af80 0x7ffa6007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.129+0000 7ffa6affd640 1 -- 172.21.15.17:0/2793713092 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7ffa640be910 con 0x7ffa74101000 2024-09-20T18:48:56.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.129+0000 7ffa79a02640 1 --2- 172.21.15.17:0/2793713092 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa6007af80 0x7ffa6007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:56.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.129+0000 7ffa79a02640 1 --2- 172.21.15.17:0/2793713092 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa6007af80 0x7ffa6007d440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ffa70005d00 tx=0x7ffa70005c70 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:56.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.133+0000 7ffa6affd640 1 -- 172.21.15.17:0/2793713092 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffa64089f90 con 0x7ffa74101000 2024-09-20T18:48:56.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:55 smithi172 ceph-mon[80431]: pgmap v405: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:56.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.343+0000 7ffa7bc66640 1 -- 172.21.15.17:0/2793713092 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ffa7419af10 con 0x7ffa6007af80 2024-09-20T18:48:56.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.344+0000 7ffa6affd640 1 -- 172.21.15.17:0/2793713092 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7ffa7419af10 con 0x7ffa6007af80 2024-09-20T18:48:56.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.346+0000 7ffa7bc66640 1 -- 172.21.15.17:0/2793713092 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa6007af80 msgr2=0x7ffa6007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:56.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.346+0000 7ffa7bc66640 1 --2- 172.21.15.17:0/2793713092 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa6007af80 0x7ffa6007d440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ffa70005d00 tx=0x7ffa70005c70 comp rx=0 tx=0).stop 2024-09-20T18:48:56.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.346+0000 7ffa7bc66640 1 -- 172.21.15.17:0/2793713092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa74101000 msgr2=0x7ffa7419fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:56.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.346+0000 7ffa7bc66640 1 --2- 172.21.15.17:0/2793713092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa74101000 0x7ffa7419fd60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ffa64031460 tx=0x7ffa640045e0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.346+0000 7ffa7bc66640 1 -- 172.21.15.17:0/2793713092 shutdown_connections 2024-09-20T18:48:56.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.346+0000 7ffa7bc66640 1 --2- 172.21.15.17:0/2793713092 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa6007af80 0x7ffa6007d440 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.346+0000 7ffa7bc66640 1 --2- 172.21.15.17:0/2793713092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa74101000 0x7ffa7419fd60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.346+0000 7ffa7bc66640 1 --2- 172.21.15.17:0/2793713092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74100650 0x7ffa7419f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.346+0000 7ffa7bc66640 1 -- 172.21.15.17:0/2793713092 >> 172.21.15.17:0/2793713092 conn(0x7ffa740fc520 msgr2=0x7ffa740fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:56.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.347+0000 7ffa7bc66640 1 -- 172.21.15.17:0/2793713092 shutdown_connections 2024-09-20T18:48:56.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.347+0000 7ffa7bc66640 1 -- 172.21.15.17:0/2793713092 wait complete. 2024-09-20T18:48:56.372 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:48:56.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.432+0000 7fef4768e640 1 -- 172.21.15.17:0/572181008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef401067f0 msgr2=0x7fef40106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:56.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.432+0000 7fef4768e640 1 --2- 172.21.15.17:0/572181008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef401067f0 0x7fef40106bd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009c20 tx=0x7fef3c02a970 comp rx=0 tx=0).stop 2024-09-20T18:48:56.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.432+0000 7fef4768e640 1 -- 172.21.15.17:0/572181008 shutdown_connections 2024-09-20T18:48:56.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.432+0000 7fef4768e640 1 --2- 172.21.15.17:0/572181008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef401007f0 0x7fef40100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.432+0000 7fef4768e640 1 --2- 172.21.15.17:0/572181008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef401067f0 0x7fef40106bd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.432+0000 7fef4768e640 1 -- 172.21.15.17:0/572181008 >> 172.21.15.17:0/572181008 conn(0x7fef400fc550 msgr2=0x7fef400fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.432+0000 7fef4768e640 1 -- 172.21.15.17:0/572181008 shutdown_connections 2024-09-20T18:48:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.432+0000 7fef4768e640 1 -- 172.21.15.17:0/572181008 wait complete. 2024-09-20T18:48:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.433+0000 7fef4768e640 1 Processor -- start 2024-09-20T18:48:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.433+0000 7fef4768e640 1 -- start start 2024-09-20T18:48:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.433+0000 7fef4768e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef401007f0 0x7fef4019c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.433+0000 7fef4768e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef401067f0 0x7fef4019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.433+0000 7fef4768e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fef4010dd20 con 0x7fef401007f0 2024-09-20T18:48:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.433+0000 7fef4768e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fef4010dba0 con 0x7fef401067f0 2024-09-20T18:48:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.433+0000 7fef4542a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef401007f0 0x7fef4019c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.433+0000 7fef4542a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef401007f0 0x7fef4019c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43070/0 (socket says 172.21.15.17:43070) 2024-09-20T18:48:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.433+0000 7fef4542a640 1 -- 172.21.15.17:0/698456979 learned_addr learned my addr 172.21.15.17:0/698456979 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:48:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.434+0000 7fef44c29640 1 --2- 172.21.15.17:0/698456979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef401067f0 0x7fef4019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.434+0000 7fef4542a640 1 -- 172.21.15.17:0/698456979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef401067f0 msgr2=0x7fef4019cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.434+0000 7fef4542a640 1 --2- 172.21.15.17:0/698456979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef401067f0 0x7fef4019cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.434+0000 7fef4542a640 1 -- 172.21.15.17:0/698456979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef401967c0 con 0x7fef401007f0 2024-09-20T18:48:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.434+0000 7fef4542a640 1 --2- 172.21.15.17:0/698456979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef401007f0 0x7fef4019c640 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fef3c005cc0 tx=0x7fef3c02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.434+0000 7fef367fc640 1 -- 172.21.15.17:0/698456979 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef3c049070 con 0x7fef401007f0 2024-09-20T18:48:56.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.434+0000 7fef367fc640 1 -- 172.21.15.17:0/698456979 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fef3c02fea0 con 0x7fef401007f0 2024-09-20T18:48:56.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.434+0000 7fef4768e640 1 -- 172.21.15.17:0/698456979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef40196a50 con 0x7fef401007f0 2024-09-20T18:48:56.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.434+0000 7fef367fc640 1 -- 172.21.15.17:0/698456979 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef3c034050 con 0x7fef401007f0 2024-09-20T18:48:56.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.434+0000 7fef4768e640 1 -- 172.21.15.17:0/698456979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef40196f80 con 0x7fef401007f0 2024-09-20T18:48:56.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.435+0000 7fef4768e640 1 -- 172.21.15.17:0/698456979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef40101f30 con 0x7fef401007f0 2024-09-20T18:48:56.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.436+0000 7fef367fc640 1 -- 172.21.15.17:0/698456979 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fef3c04c070 con 0x7fef401007f0 2024-09-20T18:48:56.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.436+0000 7fef367fc640 1 --2- 172.21.15.17:0/698456979 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fef2c07af80 0x7fef2c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:56.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.437+0000 7fef367fc640 1 -- 172.21.15.17:0/698456979 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fef3c040030 con 0x7fef401007f0 2024-09-20T18:48:56.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.437+0000 7fef44c29640 1 --2- 172.21.15.17:0/698456979 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fef2c07af80 0x7fef2c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:56.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.437+0000 7fef44c29640 1 --2- 172.21.15.17:0/698456979 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fef2c07af80 0x7fef2c07d440 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fef40105e60 tx=0x7fef30008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:56.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.441+0000 7fef367fc640 1 -- 172.21.15.17:0/698456979 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef3c08c6c0 con 0x7fef401007f0 2024-09-20T18:48:56.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.644+0000 7fef4768e640 1 -- 172.21.15.17:0/698456979 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fef40197230 con 0x7fef2c07af80 2024-09-20T18:48:56.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.645+0000 7fef367fc640 1 -- 172.21.15.17:0/698456979 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fef40197230 con 0x7fef2c07af80 2024-09-20T18:48:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.647+0000 7fef4768e640 1 -- 172.21.15.17:0/698456979 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fef2c07af80 msgr2=0x7fef2c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.647+0000 7fef4768e640 1 --2- 172.21.15.17:0/698456979 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fef2c07af80 0x7fef2c07d440 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fef40105e60 tx=0x7fef30008040 comp rx=0 tx=0).stop 2024-09-20T18:48:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.647+0000 7fef4768e640 1 -- 172.21.15.17:0/698456979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef401007f0 msgr2=0x7fef4019c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.647+0000 7fef4768e640 1 --2- 172.21.15.17:0/698456979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef401007f0 0x7fef4019c640 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fef3c005cc0 tx=0x7fef3c02f5f0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.647+0000 7fef4768e640 1 -- 172.21.15.17:0/698456979 shutdown_connections 2024-09-20T18:48:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.647+0000 7fef4768e640 1 --2- 172.21.15.17:0/698456979 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fef2c07af80 0x7fef2c07d440 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.647+0000 7fef4768e640 1 --2- 172.21.15.17:0/698456979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef401067f0 0x7fef4019cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.647+0000 7fef4768e640 1 --2- 172.21.15.17:0/698456979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef401007f0 0x7fef4019c640 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.647+0000 7fef4768e640 1 -- 172.21.15.17:0/698456979 >> 172.21.15.17:0/698456979 conn(0x7fef400fc550 msgr2=0x7fef400fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:56.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.648+0000 7fef4768e640 1 -- 172.21.15.17:0/698456979 shutdown_connections 2024-09-20T18:48:56.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.648+0000 7fef4768e640 1 -- 172.21.15.17:0/698456979 wait complete. 2024-09-20T18:48:56.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.732+0000 7f8298a81640 1 -- 172.21.15.17:0/34650866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8294102b20 msgr2=0x7f8294102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:56.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.732+0000 7f8298a81640 1 --2- 172.21.15.17:0/34650866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8294102b20 0x7f8294102f00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f82840098b0 tx=0x7f828402a560 comp rx=0 tx=0).stop 2024-09-20T18:48:56.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.732+0000 7f8298a81640 1 -- 172.21.15.17:0/34650866 shutdown_connections 2024-09-20T18:48:56.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.732+0000 7f8298a81640 1 --2- 172.21.15.17:0/34650866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8294103440 0x7f829410b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.732+0000 7f8298a81640 1 --2- 172.21.15.17:0/34650866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8294102b20 0x7f8294102f00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.732+0000 7f8298a81640 1 -- 172.21.15.17:0/34650866 >> 172.21.15.17:0/34650866 conn(0x7f82940fc520 msgr2=0x7f82940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:56.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.732+0000 7f8298a81640 1 -- 172.21.15.17:0/34650866 shutdown_connections 2024-09-20T18:48:56.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.732+0000 7f8298a81640 1 -- 172.21.15.17:0/34650866 wait complete. 2024-09-20T18:48:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.733+0000 7f8298a81640 1 Processor -- start 2024-09-20T18:48:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.733+0000 7f8298a81640 1 -- start start 2024-09-20T18:48:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.733+0000 7f8298a81640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8294102b20 0x7f829419f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.733+0000 7f8298a81640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8294103440 0x7f829419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.733+0000 7f8298a81640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f829410edf0 con 0x7f8294103440 2024-09-20T18:48:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.733+0000 7f8298a81640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f829410ec70 con 0x7f8294102b20 2024-09-20T18:48:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.734+0000 7f8291d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8294103440 0x7f829419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.734+0000 7f8291d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8294103440 0x7f829419fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43086/0 (socket says 172.21.15.17:43086) 2024-09-20T18:48:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.734+0000 7f8291d9b640 1 -- 172.21.15.17:0/4225859183 learned_addr learned my addr 172.21.15.17:0/4225859183 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:48:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.734+0000 7f829259c640 1 --2- 172.21.15.17:0/4225859183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8294102b20 0x7f829419f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.734+0000 7f8291d9b640 1 -- 172.21.15.17:0/4225859183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8294102b20 msgr2=0x7f829419f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.734+0000 7f8291d9b640 1 --2- 172.21.15.17:0/4225859183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8294102b20 0x7f829419f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.734+0000 7f8291d9b640 1 -- 172.21.15.17:0/4225859183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8294199a50 con 0x7f8294103440 2024-09-20T18:48:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.734+0000 7f829259c640 1 --2- 172.21.15.17:0/4225859183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8294102b20 0x7f829419f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:48:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.734+0000 7f8291d9b640 1 --2- 172.21.15.17:0/4225859183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8294103440 0x7f829419fd80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f828800c8f0 tx=0x7f828800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.734+0000 7f82837fe640 1 -- 172.21.15.17:0/4225859183 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f82880079b0 con 0x7f8294103440 2024-09-20T18:48:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.735+0000 7f82837fe640 1 -- 172.21.15.17:0/4225859183 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f82880054e0 con 0x7f8294103440 2024-09-20T18:48:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.735+0000 7f8298a81640 1 -- 172.21.15.17:0/4225859183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8294199d40 con 0x7f8294103440 2024-09-20T18:48:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.735+0000 7f82837fe640 1 -- 172.21.15.17:0/4225859183 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8288004dd0 con 0x7f8294103440 2024-09-20T18:48:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.735+0000 7f8298a81640 1 -- 172.21.15.17:0/4225859183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829419a2d0 con 0x7f8294103440 2024-09-20T18:48:56.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.736+0000 7f8298a81640 1 -- 172.21.15.17:0/4225859183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f829406aa30 con 0x7f8294103440 2024-09-20T18:48:56.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.736+0000 7f82837fe640 1 -- 172.21.15.17:0/4225859183 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f828800f470 con 0x7f8294103440 2024-09-20T18:48:56.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.737+0000 7f82837fe640 1 --2- 172.21.15.17:0/4225859183 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f827c07af40 0x7f827c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:56.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.737+0000 7f82837fe640 1 -- 172.21.15.17:0/4225859183 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f828809df00 con 0x7f8294103440 2024-09-20T18:48:56.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.737+0000 7f829259c640 1 --2- 172.21.15.17:0/4225859183 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f827c07af40 0x7f827c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:56.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.738+0000 7f829259c640 1 --2- 172.21.15.17:0/4225859183 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f827c07af40 0x7f827c07d400 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8284006010 tx=0x7f8284031420 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:56.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.741+0000 7f82837fe640 1 -- 172.21.15.17:0/4225859183 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8288014030 con 0x7f8294103440 2024-09-20T18:48:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.939+0000 7f8298a81640 1 -- 172.21.15.17:0/4225859183 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f829419af30 con 0x7f827c07af40 2024-09-20T18:48:56.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.948+0000 7f82837fe640 1 -- 172.21.15.17:0/4225859183 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f829419af30 con 0x7f827c07af40 2024-09-20T18:48:56.965 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:48:56.965 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (10m) 4m ago 21m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:48:56.965 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (13m) 4m ago 21m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:48:56.965 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (12m) 4m ago 20m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:48:56.965 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (8m) 4m ago 21m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:48:56.965 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (8m) 4m ago 20m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:48:56.965 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (9m) 4m ago 21m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:48:56.966 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (4m) 4m ago 16m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:48:56.966 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (4m) 4m ago 15m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:48:56.966 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (15m) 4m ago 15m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:48:56.966 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (4m) 4m ago 16m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:48:56.966 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (12m) 4m ago 22m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:48:56.966 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (11m) 4m ago 20m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:48:56.966 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (9m) 4m ago 22m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:48:56.966 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (8m) 4m ago 20m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:48:56.966 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (11m) 4m ago 21m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:48:56.966 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (11m) 4m ago 20m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:48:56.966 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (8m) 4m ago 19m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:48:56.966 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (7m) 4m ago 18m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:48:56.966 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (6m) 4m ago 18m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:48:56.967 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (6m) 4m ago 17m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:48:56.967 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (5m) 4m ago 17m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:48:56.967 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (5m) 4m ago 17m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:48:56.967 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (10m) 4m ago 20m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:48:56.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.950+0000 7f8298a81640 1 -- 172.21.15.17:0/4225859183 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f827c07af40 msgr2=0x7f827c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:56.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.950+0000 7f8298a81640 1 --2- 172.21.15.17:0/4225859183 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f827c07af40 0x7f827c07d400 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8284006010 tx=0x7f8284031420 comp rx=0 tx=0).stop 2024-09-20T18:48:56.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.950+0000 7f8298a81640 1 -- 172.21.15.17:0/4225859183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8294103440 msgr2=0x7f829419fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:56.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.950+0000 7f8298a81640 1 --2- 172.21.15.17:0/4225859183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8294103440 0x7f829419fd80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f828800c8f0 tx=0x7f828800cdb0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.950+0000 7f8298a81640 1 -- 172.21.15.17:0/4225859183 shutdown_connections 2024-09-20T18:48:56.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.950+0000 7f8298a81640 1 --2- 172.21.15.17:0/4225859183 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f827c07af40 0x7f827c07d400 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.950+0000 7f8298a81640 1 --2- 172.21.15.17:0/4225859183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8294103440 0x7f829419fd80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.950+0000 7f8298a81640 1 --2- 172.21.15.17:0/4225859183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8294102b20 0x7f829419f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:56.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.951+0000 7f8298a81640 1 -- 172.21.15.17:0/4225859183 >> 172.21.15.17:0/4225859183 conn(0x7f82940fc520 msgr2=0x7f8294100a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:56.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.951+0000 7f8298a81640 1 -- 172.21.15.17:0/4225859183 shutdown_connections 2024-09-20T18:48:56.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:56.951+0000 7f8298a81640 1 -- 172.21.15.17:0/4225859183 wait complete. 2024-09-20T18:48:57.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.033+0000 7f8fecf5d640 1 -- 172.21.15.17:0/2073921853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe8074eb0 msgr2=0x7f8fe81123d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:57.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.033+0000 7f8fecf5d640 1 --2- 172.21.15.17:0/2073921853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe8074eb0 0x7f8fe81123d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009880 tx=0x7f8fd002a530 comp rx=0 tx=0).stop 2024-09-20T18:48:57.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.033+0000 7f8fecf5d640 1 -- 172.21.15.17:0/2073921853 shutdown_connections 2024-09-20T18:48:57.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.033+0000 7f8fecf5d640 1 --2- 172.21.15.17:0/2073921853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe8074eb0 0x7f8fe81123d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.033+0000 7f8fecf5d640 1 --2- 172.21.15.17:0/2073921853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fe8074590 0x7f8fe8074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.033+0000 7f8fecf5d640 1 -- 172.21.15.17:0/2073921853 >> 172.21.15.17:0/2073921853 conn(0x7f8fe80fd600 msgr2=0x7f8fe80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:57.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.034+0000 7f8fecf5d640 1 -- 172.21.15.17:0/2073921853 shutdown_connections 2024-09-20T18:48:57.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.034+0000 7f8fecf5d640 1 -- 172.21.15.17:0/2073921853 wait complete. 2024-09-20T18:48:57.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.034+0000 7f8fecf5d640 1 Processor -- start 2024-09-20T18:48:57.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.035+0000 7f8fecf5d640 1 -- start start 2024-09-20T18:48:57.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.035+0000 7f8fecf5d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fe8074590 0x7f8fe819dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:57.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.035+0000 7f8fecf5d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe8074eb0 0x7f8fe819e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:57.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.035+0000 7f8fecf5d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe81153e0 con 0x7f8fe8074eb0 2024-09-20T18:48:57.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.035+0000 7f8fecf5d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe8115260 con 0x7f8fe8074590 2024-09-20T18:48:57.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.035+0000 7f8fdffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe8074eb0 0x7f8fe819e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:57.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.035+0000 7f8fdffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe8074eb0 0x7f8fe819e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43112/0 (socket says 172.21.15.17:43112) 2024-09-20T18:48:57.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.035+0000 7f8fdffff640 1 -- 172.21.15.17:0/3027422389 learned_addr learned my addr 172.21.15.17:0/3027422389 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:48:57.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.035+0000 7f8fe659c640 1 --2- 172.21.15.17:0/3027422389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fe8074590 0x7f8fe819dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:57.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.035+0000 7f8fdffff640 1 -- 172.21.15.17:0/3027422389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fe8074590 msgr2=0x7f8fe819dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:57.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.035+0000 7f8fdffff640 1 --2- 172.21.15.17:0/3027422389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fe8074590 0x7f8fe819dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.035+0000 7f8fdffff640 1 -- 172.21.15.17:0/3027422389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe81a28b0 con 0x7f8fe8074eb0 2024-09-20T18:48:57.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.036+0000 7f8fdffff640 1 --2- 172.21.15.17:0/3027422389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe8074eb0 0x7f8fe819e520 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0031460 tx=0x7f8fd00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:57.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.036+0000 7f8fdf7fe640 1 -- 172.21.15.17:0/3027422389 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8fd003f070 con 0x7f8fe8074eb0 2024-09-20T18:48:57.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.036+0000 7f8fdf7fe640 1 -- 172.21.15.17:0/3027422389 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8fd0004cf0 con 0x7f8fe8074eb0 2024-09-20T18:48:57.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.036+0000 7f8fecf5d640 1 -- 172.21.15.17:0/3027422389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe81a2b40 con 0x7f8fe8074eb0 2024-09-20T18:48:57.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.036+0000 7f8fdf7fe640 1 -- 172.21.15.17:0/3027422389 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8fd0035030 con 0x7f8fe8074eb0 2024-09-20T18:48:57.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.036+0000 7f8fecf5d640 1 -- 172.21.15.17:0/3027422389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe81a2fb0 con 0x7f8fe8074eb0 2024-09-20T18:48:57.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.037+0000 7f8fecf5d640 1 -- 172.21.15.17:0/3027422389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fe8075cd0 con 0x7f8fe8074eb0 2024-09-20T18:48:57.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.038+0000 7f8fdf7fe640 1 -- 172.21.15.17:0/3027422389 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8fd0042070 con 0x7f8fe8074eb0 2024-09-20T18:48:57.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.039+0000 7f8fdf7fe640 1 --2- 172.21.15.17:0/3027422389 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8fd407af80 0x7f8fd407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:57.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.039+0000 7f8fdf7fe640 1 -- 172.21.15.17:0/3027422389 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f8fd00be930 con 0x7f8fe8074eb0 2024-09-20T18:48:57.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.039+0000 7f8fe659c640 1 --2- 172.21.15.17:0/3027422389 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8fd407af80 0x7f8fd407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:57.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.040+0000 7f8fe659c640 1 --2- 172.21.15.17:0/3027422389 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8fd407af80 0x7f8fd407d440 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80058c0 tx=0x7f8fd800a250 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:57.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.043+0000 7f8fdf7fe640 1 -- 172.21.15.17:0/3027422389 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8fd0089fb0 con 0x7f8fe8074eb0 2024-09-20T18:48:57.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.304+0000 7f8fecf5d640 1 -- 172.21.15.17:0/3027422389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8fe8074970 con 0x7f8fe8074eb0 2024-09-20T18:48:57.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.305+0000 7f8fdf7fe640 1 -- 172.21.15.17:0/3027422389 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f8fd008c4d0 con 0x7f8fe8074eb0 2024-09-20T18:48:57.321 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:48:57.321 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:48:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:48:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:48:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:48:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:48:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:48:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:48:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:48:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:48:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:48:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:48:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:48:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:48:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:48:57.323 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:48:57.323 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:48:57.323 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:48:57.323 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:48:57.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.307+0000 7f8fecf5d640 1 -- 172.21.15.17:0/3027422389 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8fd407af80 msgr2=0x7f8fd407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:57.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.307+0000 7f8fecf5d640 1 --2- 172.21.15.17:0/3027422389 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8fd407af80 0x7f8fd407d440 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80058c0 tx=0x7f8fd800a250 comp rx=0 tx=0).stop 2024-09-20T18:48:57.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.307+0000 7f8fecf5d640 1 -- 172.21.15.17:0/3027422389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe8074eb0 msgr2=0x7f8fe819e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:57.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.307+0000 7f8fecf5d640 1 --2- 172.21.15.17:0/3027422389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe8074eb0 0x7f8fe819e520 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0031460 tx=0x7f8fd00048f0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.307+0000 7f8fecf5d640 1 -- 172.21.15.17:0/3027422389 shutdown_connections 2024-09-20T18:48:57.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.307+0000 7f8fecf5d640 1 --2- 172.21.15.17:0/3027422389 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8fd407af80 0x7f8fd407d440 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.307+0000 7f8fecf5d640 1 --2- 172.21.15.17:0/3027422389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe8074eb0 0x7f8fe819e520 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.307+0000 7f8fecf5d640 1 --2- 172.21.15.17:0/3027422389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fe8074590 0x7f8fe819dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.307+0000 7f8fecf5d640 1 -- 172.21.15.17:0/3027422389 >> 172.21.15.17:0/3027422389 conn(0x7f8fe80fd600 msgr2=0x7f8fe8104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:57.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.307+0000 7f8fecf5d640 1 -- 172.21.15.17:0/3027422389 shutdown_connections 2024-09-20T18:48:57.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.307+0000 7f8fecf5d640 1 -- 172.21.15.17:0/3027422389 wait complete. 2024-09-20T18:48:57.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.391+0000 7f9412a42640 1 -- 172.21.15.17:0/853807597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f940c101900 msgr2=0x7f940c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:57.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.391+0000 7f9412a42640 1 --2- 172.21.15.17:0/853807597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f940c101900 0x7f940c101d60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9400009880 tx=0x7f940002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.391+0000 7f9412a42640 1 -- 172.21.15.17:0/853807597 shutdown_connections 2024-09-20T18:48:57.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.391+0000 7f9412a42640 1 --2- 172.21.15.17:0/853807597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f940c101900 0x7f940c101d60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.391+0000 7f9412a42640 1 --2- 172.21.15.17:0/853807597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f940c107900 0x7f940c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.392+0000 7f9412a42640 1 -- 172.21.15.17:0/853807597 >> 172.21.15.17:0/853807597 conn(0x7f940c0fd600 msgr2=0x7f940c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:57.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.392+0000 7f9412a42640 1 -- 172.21.15.17:0/853807597 shutdown_connections 2024-09-20T18:48:57.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.392+0000 7f9412a42640 1 -- 172.21.15.17:0/853807597 wait complete. 2024-09-20T18:48:57.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.392+0000 7f9412a42640 1 Processor -- start 2024-09-20T18:48:57.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.392+0000 7f9412a42640 1 -- start start 2024-09-20T18:48:57.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.393+0000 7f9412a42640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f940c101900 0x7f940c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:57.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.393+0000 7f9412a42640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f940c107900 0x7f940c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.393+0000 7f9412a42640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f940c10edb0 con 0x7f940c101900 2024-09-20T18:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.393+0000 7f9412a42640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f940c10ec30 con 0x7f940c107900 2024-09-20T18:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.393+0000 7f940bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f940c101900 0x7f940c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.393+0000 7f940bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f940c101900 0x7f940c19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43126/0 (socket says 172.21.15.17:43126) 2024-09-20T18:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.393+0000 7f940bfff640 1 -- 172.21.15.17:0/288868410 learned_addr learned my addr 172.21.15.17:0/288868410 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.393+0000 7f940b7fe640 1 --2- 172.21.15.17:0/288868410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f940c107900 0x7f940c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.393+0000 7f940bfff640 1 -- 172.21.15.17:0/288868410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f940c107900 msgr2=0x7f940c19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.393+0000 7f940bfff640 1 --2- 172.21.15.17:0/288868410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f940c107900 0x7f940c19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.393+0000 7f940bfff640 1 -- 172.21.15.17:0/288868410 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940c197800 con 0x7f940c101900 2024-09-20T18:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.393+0000 7f940bfff640 1 --2- 172.21.15.17:0/288868410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f940c101900 0x7f940c19d680 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00d8d0 tx=0x7f93fc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.393+0000 7f94097fa640 1 -- 172.21.15.17:0/288868410 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93fc017030 con 0x7f940c101900 2024-09-20T18:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.393+0000 7f94097fa640 1 -- 172.21.15.17:0/288868410 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f93fc004020 con 0x7f940c101900 2024-09-20T18:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.393+0000 7f9412a42640 1 -- 172.21.15.17:0/288868410 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f940c197af0 con 0x7f940c101900 2024-09-20T18:48:57.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.393+0000 7f94097fa640 1 -- 172.21.15.17:0/288868410 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93fc0047a0 con 0x7f940c101900 2024-09-20T18:48:57.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.394+0000 7f9412a42640 1 -- 172.21.15.17:0/288868410 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f940c198050 con 0x7f940c101900 2024-09-20T18:48:57.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.395+0000 7f9412a42640 1 -- 172.21.15.17:0/288868410 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f940c103040 con 0x7f940c101900 2024-09-20T18:48:57.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.395+0000 7f94097fa640 1 -- 172.21.15.17:0/288868410 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f93fc0041d0 con 0x7f940c101900 2024-09-20T18:48:57.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.396+0000 7f94097fa640 1 --2- 172.21.15.17:0/288868410 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93f407af30 0x7f93f407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:57.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.396+0000 7f94097fa640 1 -- 172.21.15.17:0/288868410 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f93fc018070 con 0x7f940c101900 2024-09-20T18:48:57.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.396+0000 7f940b7fe640 1 --2- 172.21.15.17:0/288868410 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93f407af30 0x7f93f407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:57.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.396+0000 7f940b7fe640 1 --2- 172.21.15.17:0/288868410 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93f407af30 0x7f93f407d3f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f940c198b50 tx=0x7f9400031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:57.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.400+0000 7f94097fa640 1 -- 172.21.15.17:0/288868410 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f93fc069420 con 0x7f940c101900 2024-09-20T18:48:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.629+0000 7f9412a42640 1 -- 172.21.15.17:0/288868410 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f940c109e90 con 0x7f940c101900 2024-09-20T18:48:57.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.629+0000 7f94097fa640 1 -- 172.21.15.17:0/288868410 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f93fc06e2d0 con 0x7f940c101900 2024-09-20T18:48:57.646 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:48:57.646 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:48:57.646 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:48:57.646 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:48:57.646 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:48:57.646 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:48:57.646 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:48:57.647 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:48:57.647 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:48:57.647 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:48:57.647 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:48:57.647 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:48:57.647 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:48:57.647 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:48:57.647 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:48:57.647 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:48:57.647 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:48:57.647 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:48:57.647 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:48:57.647 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:48:57.647 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:48:57.648 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:48:57.648 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:48:57.648 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:48:57.648 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:48:57.648 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:48:57.648 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:48:57.648 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:48:57.648 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:48:57.648 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:48:57.648 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:48:57.648 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:48:57.648 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:48:57.648 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:48:57.648 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:48:57.649 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:48:57.649 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:48:57.649 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:48:57.649 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:48:57.649 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:48:57.649 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:48:57.649 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:48:57.649 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:48:57.650 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:48:57.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.632+0000 7f9412a42640 1 -- 172.21.15.17:0/288868410 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93f407af30 msgr2=0x7f93f407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:57.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.632+0000 7f9412a42640 1 --2- 172.21.15.17:0/288868410 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93f407af30 0x7f93f407d3f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f940c198b50 tx=0x7f9400031400 comp rx=0 tx=0).stop 2024-09-20T18:48:57.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.632+0000 7f9412a42640 1 -- 172.21.15.17:0/288868410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f940c101900 msgr2=0x7f940c19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:57.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.632+0000 7f9412a42640 1 --2- 172.21.15.17:0/288868410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f940c101900 0x7f940c19d680 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00d8d0 tx=0x7f93fc00dd90 comp rx=0 tx=0).stop 2024-09-20T18:48:57.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.633+0000 7f9412a42640 1 -- 172.21.15.17:0/288868410 shutdown_connections 2024-09-20T18:48:57.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.633+0000 7f9412a42640 1 --2- 172.21.15.17:0/288868410 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93f407af30 0x7f93f407d3f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.633+0000 7f9412a42640 1 --2- 172.21.15.17:0/288868410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f940c107900 0x7f940c19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.633+0000 7f9412a42640 1 --2- 172.21.15.17:0/288868410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f940c101900 0x7f940c19d680 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.633+0000 7f9412a42640 1 -- 172.21.15.17:0/288868410 >> 172.21.15.17:0/288868410 conn(0x7f940c0fd600 msgr2=0x7f940c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:57.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.633+0000 7f9412a42640 1 -- 172.21.15.17:0/288868410 shutdown_connections 2024-09-20T18:48:57.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.633+0000 7f9412a42640 1 -- 172.21.15.17:0/288868410 wait complete. 2024-09-20T18:48:57.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.718+0000 7f6421f08640 1 -- 172.21.15.17:0/2493405379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f641c1033d0 msgr2=0x7f641c10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:57.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.718+0000 7f6421f08640 1 --2- 172.21.15.17:0/2493405379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f641c1033d0 0x7f641c10b8c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6404009880 tx=0x7f640402a530 comp rx=0 tx=0).stop 2024-09-20T18:48:57.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.719+0000 7f6421f08640 1 -- 172.21.15.17:0/2493405379 shutdown_connections 2024-09-20T18:48:57.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.719+0000 7f6421f08640 1 --2- 172.21.15.17:0/2493405379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f641c1033d0 0x7f641c10b8c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.719+0000 7f6421f08640 1 --2- 172.21.15.17:0/2493405379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f641c102ab0 0x7f641c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.719+0000 7f6421f08640 1 -- 172.21.15.17:0/2493405379 >> 172.21.15.17:0/2493405379 conn(0x7f641c0fc550 msgr2=0x7f641c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:57.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.719+0000 7f6421f08640 1 -- 172.21.15.17:0/2493405379 shutdown_connections 2024-09-20T18:48:57.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.719+0000 7f6421f08640 1 -- 172.21.15.17:0/2493405379 wait complete. 2024-09-20T18:48:57.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.719+0000 7f6421f08640 1 Processor -- start 2024-09-20T18:48:57.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.719+0000 7f6421f08640 1 -- start start 2024-09-20T18:48:57.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.720+0000 7f6421f08640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f641c102ab0 0x7f641c19f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:57.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.720+0000 7f6421f08640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f641c1033d0 0x7f641c19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:57.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.720+0000 7f6421f08640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f641c10ee40 con 0x7f641c102ab0 2024-09-20T18:48:57.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.720+0000 7f6421f08640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f641c10ecc0 con 0x7f641c1033d0 2024-09-20T18:48:57.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.720+0000 7f641b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f641c102ab0 0x7f641c19f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:57.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.720+0000 7f641b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f641c102ab0 0x7f641c19f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43140/0 (socket says 172.21.15.17:43140) 2024-09-20T18:48:57.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.720+0000 7f641b7fe640 1 -- 172.21.15.17:0/394384147 learned_addr learned my addr 172.21.15.17:0/394384147 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:48:57.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.720+0000 7f6412ffd640 1 --2- 172.21.15.17:0/394384147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f641c1033d0 0x7f641c19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:57.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.720+0000 7f641b7fe640 1 -- 172.21.15.17:0/394384147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f641c1033d0 msgr2=0x7f641c19fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:57.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.720+0000 7f641b7fe640 1 --2- 172.21.15.17:0/394384147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f641c1033d0 0x7f641c19fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.720+0000 7f641b7fe640 1 -- 172.21.15.17:0/394384147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641c199a30 con 0x7f641c102ab0 2024-09-20T18:48:57.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.720+0000 7f641b7fe640 1 --2- 172.21.15.17:0/394384147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f641c102ab0 0x7f641c19f870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f640c00b420 tx=0x7f640c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:57.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.720+0000 7f64197fa640 1 -- 172.21.15.17:0/394384147 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f640c011630 con 0x7f641c102ab0 2024-09-20T18:48:57.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.721+0000 7f64197fa640 1 -- 172.21.15.17:0/394384147 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f640c016070 con 0x7f641c102ab0 2024-09-20T18:48:57.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.721+0000 7f6421f08640 1 -- 172.21.15.17:0/394384147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641c199d20 con 0x7f641c102ab0 2024-09-20T18:48:57.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.721+0000 7f64197fa640 1 -- 172.21.15.17:0/394384147 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f640c010d40 con 0x7f641c102ab0 2024-09-20T18:48:57.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.721+0000 7f6421f08640 1 -- 172.21.15.17:0/394384147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f641c19a280 con 0x7f641c102ab0 2024-09-20T18:48:57.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.722+0000 7f6421f08640 1 -- 172.21.15.17:0/394384147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f641c06a580 con 0x7f641c102ab0 2024-09-20T18:48:57.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.722+0000 7f64197fa640 1 -- 172.21.15.17:0/394384147 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f640c01b460 con 0x7f641c102ab0 2024-09-20T18:48:57.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.723+0000 7f64197fa640 1 --2- 172.21.15.17:0/394384147 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f640807af80 0x7f640807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:57.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.723+0000 7f64197fa640 1 -- 172.21.15.17:0/394384147 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f640c09d6f0 con 0x7f641c102ab0 2024-09-20T18:48:57.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.723+0000 7f6412ffd640 1 --2- 172.21.15.17:0/394384147 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f640807af80 0x7f640807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:57.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.724+0000 7f6412ffd640 1 --2- 172.21.15.17:0/394384147 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f640807af80 0x7f640807d440 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f641c19b220 tx=0x7f6404031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:57.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.729+0000 7f64197fa640 1 -- 172.21.15.17:0/394384147 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f640c021250 con 0x7f641c102ab0 2024-09-20T18:48:57.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:57 smithi017 ceph-mon[108970]: from='client.34594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:48:57.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:57 smithi017 ceph-mon[108970]: pgmap v406: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:57.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:57 smithi017 ceph-mon[108970]: from='client.34598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:48:57.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:57 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3027422389' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:48:57.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:57 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/288868410' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:48:57.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.936+0000 7f6421f08640 1 -- 172.21.15.17:0/394384147 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f641c19af60 con 0x7f640807af80 2024-09-20T18:48:57.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.937+0000 7f64197fa640 1 -- 172.21.15.17:0/394384147 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f641c19af60 con 0x7f640807af80 2024-09-20T18:48:57.953 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:48:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:48:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:48:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:48:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:48:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:48:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:48:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:48:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:48:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:48:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:48:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:48:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:48:57.954 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:48:57.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.940+0000 7f6421f08640 1 -- 172.21.15.17:0/394384147 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f640807af80 msgr2=0x7f640807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:57.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.940+0000 7f6421f08640 1 --2- 172.21.15.17:0/394384147 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f640807af80 0x7f640807d440 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f641c19b220 tx=0x7f6404031400 comp rx=0 tx=0).stop 2024-09-20T18:48:57.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.940+0000 7f6421f08640 1 -- 172.21.15.17:0/394384147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f641c102ab0 msgr2=0x7f641c19f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:57.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.940+0000 7f6421f08640 1 --2- 172.21.15.17:0/394384147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f641c102ab0 0x7f641c19f870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f640c00b420 tx=0x7f640c00b8e0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.940+0000 7f6421f08640 1 -- 172.21.15.17:0/394384147 shutdown_connections 2024-09-20T18:48:57.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.940+0000 7f6421f08640 1 --2- 172.21.15.17:0/394384147 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f640807af80 0x7f640807d440 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.940+0000 7f6421f08640 1 --2- 172.21.15.17:0/394384147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f641c1033d0 0x7f641c19fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.940+0000 7f6421f08640 1 --2- 172.21.15.17:0/394384147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f641c102ab0 0x7f641c19f870 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:57.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.940+0000 7f6421f08640 1 -- 172.21.15.17:0/394384147 >> 172.21.15.17:0/394384147 conn(0x7f641c0fc550 msgr2=0x7f641c100b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:57.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.940+0000 7f6421f08640 1 -- 172.21.15.17:0/394384147 shutdown_connections 2024-09-20T18:48:57.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:57.940+0000 7f6421f08640 1 -- 172.21.15.17:0/394384147 wait complete. 2024-09-20T18:48:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.024+0000 7f6571922640 1 -- 172.21.15.17:0/1962580358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c106800 msgr2=0x7f656c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.024+0000 7f6571922640 1 --2- 172.21.15.17:0/1962580358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c106800 0x7f656c106be0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f655c009880 tx=0x7f655c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:48:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.024+0000 7f6571922640 1 -- 172.21.15.17:0/1962580358 shutdown_connections 2024-09-20T18:48:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.024+0000 7f6571922640 1 --2- 172.21.15.17:0/1962580358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f656c100800 0x7f656c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.024+0000 7f6571922640 1 --2- 172.21.15.17:0/1962580358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c106800 0x7f656c106be0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.024+0000 7f6571922640 1 -- 172.21.15.17:0/1962580358 >> 172.21.15.17:0/1962580358 conn(0x7f656c0fc520 msgr2=0x7f656c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.024+0000 7f6571922640 1 -- 172.21.15.17:0/1962580358 shutdown_connections 2024-09-20T18:48:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.024+0000 7f6571922640 1 -- 172.21.15.17:0/1962580358 wait complete. 2024-09-20T18:48:58.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.025+0000 7f6571922640 1 Processor -- start 2024-09-20T18:48:58.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.025+0000 7f6571922640 1 -- start start 2024-09-20T18:48:58.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.025+0000 7f6571922640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c100800 0x7f656c198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:58.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.025+0000 7f6571922640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f656c106800 0x7f656c198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:58.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.025+0000 7f6571922640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f656c10dd30 con 0x7f656c100800 2024-09-20T18:48:58.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.025+0000 7f6571922640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f656c10dbb0 con 0x7f656c106800 2024-09-20T18:48:58.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.025+0000 7f656affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c100800 0x7f656c198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:58.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.025+0000 7f656affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c100800 0x7f656c198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43150/0 (socket says 172.21.15.17:43150) 2024-09-20T18:48:58.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.025+0000 7f656affd640 1 -- 172.21.15.17:0/443673838 learned_addr learned my addr 172.21.15.17:0/443673838 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:48:58.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.025+0000 7f6563fff640 1 --2- 172.21.15.17:0/443673838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f656c106800 0x7f656c198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:58.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.026+0000 7f656affd640 1 -- 172.21.15.17:0/443673838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f656c106800 msgr2=0x7f656c198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:58.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.026+0000 7f656affd640 1 --2- 172.21.15.17:0/443673838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f656c106800 0x7f656c198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:58.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.026+0000 7f656affd640 1 -- 172.21.15.17:0/443673838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f656c1993c0 con 0x7f656c100800 2024-09-20T18:48:58.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.026+0000 7f6563fff640 1 --2- 172.21.15.17:0/443673838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f656c106800 0x7f656c198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:48:58.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.026+0000 7f656affd640 1 --2- 172.21.15.17:0/443673838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c100800 0x7f656c198880 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f655c031460 tx=0x7f655c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:58.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.026+0000 7f6570920640 1 -- 172.21.15.17:0/443673838 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f655c03f070 con 0x7f656c100800 2024-09-20T18:48:58.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.026+0000 7f6570920640 1 -- 172.21.15.17:0/443673838 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f655c0044d0 con 0x7f656c100800 2024-09-20T18:48:58.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.026+0000 7f6570920640 1 -- 172.21.15.17:0/443673838 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f655c035030 con 0x7f656c100800 2024-09-20T18:48:58.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.026+0000 7f6571922640 1 -- 172.21.15.17:0/443673838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f656c199650 con 0x7f656c100800 2024-09-20T18:48:58.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.026+0000 7f6571922640 1 -- 172.21.15.17:0/443673838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f656c1a1c00 con 0x7f656c100800 2024-09-20T18:48:58.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.027+0000 7f6571922640 1 -- 172.21.15.17:0/443673838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f656c101f40 con 0x7f656c100800 2024-09-20T18:48:58.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.028+0000 7f6570920640 1 -- 172.21.15.17:0/443673838 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f655c042070 con 0x7f656c100800 2024-09-20T18:48:58.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.028+0000 7f6570920640 1 --2- 172.21.15.17:0/443673838 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f655807af90 0x7f655807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:48:58.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.029+0000 7f6570920640 1 -- 172.21.15.17:0/443673838 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f655c0beaa0 con 0x7f656c100800 2024-09-20T18:48:58.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.029+0000 7f6563fff640 1 --2- 172.21.15.17:0/443673838 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f655807af90 0x7f655807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:48:58.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.029+0000 7f6563fff640 1 --2- 172.21.15.17:0/443673838 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f655807af90 0x7f655807d450 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6554006fd0 tx=0x7f6554008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:48:58.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.033+0000 7f6570920640 1 -- 172.21.15.17:0/443673838 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f655c004cf0 con 0x7f656c100800 2024-09-20T18:48:58.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:57 smithi172 ceph-mon[80431]: from='client.34594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:48:58.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:57 smithi172 ceph-mon[80431]: pgmap v406: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:48:58.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:57 smithi172 ceph-mon[80431]: from='client.34598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:48:58.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:57 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3027422389' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:48:58.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:57 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/288868410' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:48:58.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.301+0000 7f6571922640 1 -- 172.21.15.17:0/443673838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f656c108d70 con 0x7f656c100800 2024-09-20T18:48:58.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.302+0000 7f6570920640 1 -- 172.21.15.17:0/443673838 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f655c08a120 con 0x7f656c100800 2024-09-20T18:48:58.318 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:48:58.318 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:48:58.319 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:48:58.319 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:48:58.319 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:48:58.319 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:48:58.319 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:48:58.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.304+0000 7f6571922640 1 -- 172.21.15.17:0/443673838 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f655807af90 msgr2=0x7f655807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:58.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.304+0000 7f6571922640 1 --2- 172.21.15.17:0/443673838 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f655807af90 0x7f655807d450 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6554006fd0 tx=0x7f6554008040 comp rx=0 tx=0).stop 2024-09-20T18:48:58.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.304+0000 7f6571922640 1 -- 172.21.15.17:0/443673838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c100800 msgr2=0x7f656c198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:48:58.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.304+0000 7f6571922640 1 --2- 172.21.15.17:0/443673838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c100800 0x7f656c198880 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f655c031460 tx=0x7f655c0048f0 comp rx=0 tx=0).stop 2024-09-20T18:48:58.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.304+0000 7f6571922640 1 -- 172.21.15.17:0/443673838 shutdown_connections 2024-09-20T18:48:58.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.304+0000 7f6571922640 1 --2- 172.21.15.17:0/443673838 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f655807af90 0x7f655807d450 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:58.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.304+0000 7f6571922640 1 --2- 172.21.15.17:0/443673838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f656c106800 0x7f656c198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:58.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.304+0000 7f6571922640 1 --2- 172.21.15.17:0/443673838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c100800 0x7f656c198880 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:48:58.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.304+0000 7f6571922640 1 -- 172.21.15.17:0/443673838 >> 172.21.15.17:0/443673838 conn(0x7f656c0fc520 msgr2=0x7f656c0fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:48:58.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.304+0000 7f6571922640 1 -- 172.21.15.17:0/443673838 shutdown_connections 2024-09-20T18:48:58.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:48:58.304+0000 7f6571922640 1 -- 172.21.15.17:0/443673838 wait complete. 2024-09-20T18:48:58.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:58 smithi017 ceph-mon[108970]: from='client.34602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:48:58.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:58 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/443673838' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:48:59.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:58 smithi172 ceph-mon[80431]: from='client.34602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:48:59.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:58 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/443673838' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:49:00.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:59 smithi017 ceph-mon[108970]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:49:00.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:48:59 smithi017 ceph-mon[108970]: pgmap v407: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:00.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:59 smithi172 ceph-mon[80431]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:49:00.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:48:59 smithi172 ceph-mon[80431]: pgmap v407: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:02.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:01 smithi017 ceph-mon[108970]: pgmap v408: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:02.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:01 smithi172 ceph-mon[80431]: pgmap v408: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:04.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:03 smithi017 ceph-mon[108970]: pgmap v409: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:04.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:03 smithi172 ceph-mon[80431]: pgmap v409: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:06.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:05 smithi017 ceph-mon[108970]: pgmap v410: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:06.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:05 smithi172 ceph-mon[80431]: pgmap v410: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:08.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:07 smithi017 ceph-mon[108970]: pgmap v411: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:08.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:49:08.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:07 smithi172 ceph-mon[80431]: pgmap v411: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:08.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:49:10.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:09 smithi017 ceph-mon[108970]: pgmap v412: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:10.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:09 smithi172 ceph-mon[80431]: pgmap v412: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:12.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:11 smithi017 ceph-mon[108970]: pgmap v413: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:12.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:11 smithi172 ceph-mon[80431]: pgmap v413: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:14.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:13 smithi017 ceph-mon[108970]: pgmap v414: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:14.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:13 smithi172 ceph-mon[80431]: pgmap v414: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:16.104 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:15 smithi172 ceph-mon[80431]: pgmap v415: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:16.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:15 smithi017 ceph-mon[108970]: pgmap v415: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:18.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:17 smithi017 ceph-mon[108970]: pgmap v416: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:18.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:17 smithi172 ceph-mon[80431]: pgmap v416: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:19.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:18 smithi017 ceph-mon[108970]: pgmap v417: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:19.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:18 smithi172 ceph-mon[80431]: pgmap v417: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:21.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:21 smithi017 ceph-mon[108970]: pgmap v418: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:21 smithi172 ceph-mon[80431]: pgmap v418: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:22.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:49:22.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:49:23.862 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:23 smithi172 ceph-mon[80431]: pgmap v419: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:23.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:23 smithi017 ceph-mon[108970]: pgmap v419: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:25.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:25 smithi017 ceph-mon[108970]: pgmap v420: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:25.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:25 smithi172 ceph-mon[80431]: pgmap v420: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:27.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:27 smithi017 ceph-mon[108970]: pgmap v421: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:27.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:27 smithi172 ceph-mon[80431]: pgmap v421: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:28.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.403+0000 7f05b8433640 1 -- 172.21.15.17:0/582825109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05b0107900 msgr2=0x7f05b0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:28.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.403+0000 7f05b8433640 1 --2- 172.21.15.17:0/582825109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05b0107900 0x7f05b0107ce0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009c20 tx=0x7f05a002a970 comp rx=0 tx=0).stop 2024-09-20T18:49:28.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.403+0000 7f05b8433640 1 -- 172.21.15.17:0/582825109 shutdown_connections 2024-09-20T18:49:28.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.403+0000 7f05b8433640 1 --2- 172.21.15.17:0/582825109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05b0101900 0x7f05b0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:28.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.403+0000 7f05b8433640 1 --2- 172.21.15.17:0/582825109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05b0107900 0x7f05b0107ce0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:28.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.403+0000 7f05b8433640 1 -- 172.21.15.17:0/582825109 >> 172.21.15.17:0/582825109 conn(0x7f05b00fd600 msgr2=0x7f05b00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:49:28.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.403+0000 7f05b8433640 1 -- 172.21.15.17:0/582825109 shutdown_connections 2024-09-20T18:49:28.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.403+0000 7f05b8433640 1 -- 172.21.15.17:0/582825109 wait complete. 2024-09-20T18:49:28.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.403+0000 7f05b8433640 1 Processor -- start 2024-09-20T18:49:28.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.404+0000 7f05b8433640 1 -- start start 2024-09-20T18:49:28.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.404+0000 7f05b8433640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05b0101900 0x7f05b019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:28.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.404+0000 7f05b8433640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05b0107900 0x7f05b019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:28.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.404+0000 7f05b8433640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f05b010edd0 con 0x7f05b0101900 2024-09-20T18:49:28.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.404+0000 7f05b8433640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f05b010ec50 con 0x7f05b0107900 2024-09-20T18:49:28.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.404+0000 7f05b61cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05b0101900 0x7f05b019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:28.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.404+0000 7f05b61cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05b0101900 0x7f05b019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49868/0 (socket says 172.21.15.17:49868) 2024-09-20T18:49:28.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.404+0000 7f05b61cf640 1 -- 172.21.15.17:0/3775468925 learned_addr learned my addr 172.21.15.17:0/3775468925 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:49:28.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.404+0000 7f05b59ce640 1 --2- 172.21.15.17:0/3775468925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05b0107900 0x7f05b019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:28.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.404+0000 7f05b61cf640 1 -- 172.21.15.17:0/3775468925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05b0107900 msgr2=0x7f05b019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:28.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.404+0000 7f05b61cf640 1 --2- 172.21.15.17:0/3775468925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05b0107900 0x7f05b019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:28.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.404+0000 7f05b61cf640 1 -- 172.21.15.17:0/3775468925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b01977c0 con 0x7f05b0101900 2024-09-20T18:49:28.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.405+0000 7f05b61cf640 1 --2- 172.21.15.17:0/3775468925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05b0101900 0x7f05b019d640 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f05a0006010 tx=0x7f05a002fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:49:28.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.405+0000 7f05af7fe640 1 -- 172.21.15.17:0/3775468925 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05a0047070 con 0x7f05b0101900 2024-09-20T18:49:28.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.405+0000 7f05af7fe640 1 -- 172.21.15.17:0/3775468925 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05a0003e30 con 0x7f05b0101900 2024-09-20T18:49:28.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.405+0000 7f05b8433640 1 -- 172.21.15.17:0/3775468925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b0197a50 con 0x7f05b0101900 2024-09-20T18:49:28.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.405+0000 7f05af7fe640 1 -- 172.21.15.17:0/3775468925 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05a0034070 con 0x7f05b0101900 2024-09-20T18:49:28.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.405+0000 7f05b8433640 1 -- 172.21.15.17:0/3775468925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b0197f80 con 0x7f05b0101900 2024-09-20T18:49:28.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.406+0000 7f05b8433640 1 -- 172.21.15.17:0/3775468925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05b0103040 con 0x7f05b0101900 2024-09-20T18:49:28.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.407+0000 7f05af7fe640 1 -- 172.21.15.17:0/3775468925 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f05a004a070 con 0x7f05b0101900 2024-09-20T18:49:28.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.407+0000 7f05af7fe640 1 --2- 172.21.15.17:0/3775468925 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f059807af40 0x7f059807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:28.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.408+0000 7f05af7fe640 1 -- 172.21.15.17:0/3775468925 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f05a00becd0 con 0x7f05b0101900 2024-09-20T18:49:28.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.408+0000 7f05b59ce640 1 --2- 172.21.15.17:0/3775468925 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f059807af40 0x7f059807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:28.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.408+0000 7f05b59ce640 1 --2- 172.21.15.17:0/3775468925 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f059807af40 0x7f059807d400 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f05b00ffbf0 tx=0x7f05a400b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:49:28.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.412+0000 7f05af7fe640 1 -- 172.21.15.17:0/3775468925 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f05a003f070 con 0x7f05b0101900 2024-09-20T18:49:28.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.624+0000 7f05b8433640 1 -- 172.21.15.17:0/3775468925 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f05b0198230 con 0x7f059807af40 2024-09-20T18:49:28.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.625+0000 7f05af7fe640 1 -- 172.21.15.17:0/3775468925 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f05b0198230 con 0x7f059807af40 2024-09-20T18:49:28.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.627+0000 7f05b8433640 1 -- 172.21.15.17:0/3775468925 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f059807af40 msgr2=0x7f059807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:28.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.627+0000 7f05b8433640 1 --2- 172.21.15.17:0/3775468925 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f059807af40 0x7f059807d400 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f05b00ffbf0 tx=0x7f05a400b390 comp rx=0 tx=0).stop 2024-09-20T18:49:28.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.627+0000 7f05b8433640 1 -- 172.21.15.17:0/3775468925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05b0101900 msgr2=0x7f05b019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:28.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.627+0000 7f05b8433640 1 --2- 172.21.15.17:0/3775468925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05b0101900 0x7f05b019d640 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f05a0006010 tx=0x7f05a002fdd0 comp rx=0 tx=0).stop 2024-09-20T18:49:28.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.627+0000 7f05b8433640 1 -- 172.21.15.17:0/3775468925 shutdown_connections 2024-09-20T18:49:28.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.627+0000 7f05b8433640 1 --2- 172.21.15.17:0/3775468925 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f059807af40 0x7f059807d400 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:28.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.627+0000 7f05b8433640 1 --2- 172.21.15.17:0/3775468925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05b0107900 0x7f05b019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:28.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.627+0000 7f05b8433640 1 --2- 172.21.15.17:0/3775468925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05b0101900 0x7f05b019d640 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:28.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.627+0000 7f05b8433640 1 -- 172.21.15.17:0/3775468925 >> 172.21.15.17:0/3775468925 conn(0x7f05b00fd600 msgr2=0x7f05b00fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:49:28.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.628+0000 7f05b8433640 1 -- 172.21.15.17:0/3775468925 shutdown_connections 2024-09-20T18:49:28.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.628+0000 7f05b8433640 1 -- 172.21.15.17:0/3775468925 wait complete. 2024-09-20T18:49:28.653 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:49:28.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.713+0000 7f8e38058640 1 -- 172.21.15.17:0/1966055793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e30101900 msgr2=0x7f8e30101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:28.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.713+0000 7f8e38058640 1 --2- 172.21.15.17:0/1966055793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e30101900 0x7f8e30101d60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009880 tx=0x7f8e2002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:49:28.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.713+0000 7f8e38058640 1 -- 172.21.15.17:0/1966055793 shutdown_connections 2024-09-20T18:49:28.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.713+0000 7f8e38058640 1 --2- 172.21.15.17:0/1966055793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e30101900 0x7f8e30101d60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:28.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.713+0000 7f8e38058640 1 --2- 172.21.15.17:0/1966055793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e30107900 0x7f8e30107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:28.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.713+0000 7f8e38058640 1 -- 172.21.15.17:0/1966055793 >> 172.21.15.17:0/1966055793 conn(0x7f8e300fd5e0 msgr2=0x7f8e300ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:49:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.714+0000 7f8e38058640 1 -- 172.21.15.17:0/1966055793 shutdown_connections 2024-09-20T18:49:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.714+0000 7f8e38058640 1 -- 172.21.15.17:0/1966055793 wait complete. 2024-09-20T18:49:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.714+0000 7f8e38058640 1 Processor -- start 2024-09-20T18:49:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.714+0000 7f8e38058640 1 -- start start 2024-09-20T18:49:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.714+0000 7f8e38058640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e30101900 0x7f8e3019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.714+0000 7f8e38058640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e30107900 0x7f8e3019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.714+0000 7f8e38058640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3010edb0 con 0x7f8e30101900 2024-09-20T18:49:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.714+0000 7f8e38058640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3010ec30 con 0x7f8e30107900 2024-09-20T18:49:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.715+0000 7f8e35df4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e30101900 0x7f8e3019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.715+0000 7f8e35df4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e30101900 0x7f8e3019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49876/0 (socket says 172.21.15.17:49876) 2024-09-20T18:49:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.715+0000 7f8e35df4640 1 -- 172.21.15.17:0/3032173707 learned_addr learned my addr 172.21.15.17:0/3032173707 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:49:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.715+0000 7f8e355f3640 1 --2- 172.21.15.17:0/3032173707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e30107900 0x7f8e3019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.715+0000 7f8e35df4640 1 -- 172.21.15.17:0/3032173707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e30107900 msgr2=0x7f8e3019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.715+0000 7f8e35df4640 1 --2- 172.21.15.17:0/3032173707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e30107900 0x7f8e3019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.715+0000 7f8e35df4640 1 -- 172.21.15.17:0/3032173707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e301977c0 con 0x7f8e30101900 2024-09-20T18:49:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.715+0000 7f8e355f3640 1 --2- 172.21.15.17:0/3032173707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e30107900 0x7f8e3019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:49:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.715+0000 7f8e35df4640 1 --2- 172.21.15.17:0/3032173707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e30101900 0x7f8e3019d640 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00d8d0 tx=0x7f8e2c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:49:28.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.715+0000 7f8e26ffd640 1 -- 172.21.15.17:0/3032173707 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e2c017070 con 0x7f8e30101900 2024-09-20T18:49:28.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.715+0000 7f8e38058640 1 -- 172.21.15.17:0/3032173707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e30197ab0 con 0x7f8e30101900 2024-09-20T18:49:28.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.715+0000 7f8e26ffd640 1 -- 172.21.15.17:0/3032173707 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e2c010460 con 0x7f8e30101900 2024-09-20T18:49:28.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.716+0000 7f8e26ffd640 1 -- 172.21.15.17:0/3032173707 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e2c00f5f0 con 0x7f8e30101900 2024-09-20T18:49:28.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.716+0000 7f8e38058640 1 -- 172.21.15.17:0/3032173707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e30198010 con 0x7f8e30101900 2024-09-20T18:49:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.717+0000 7f8e38058640 1 -- 172.21.15.17:0/3032173707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e30103040 con 0x7f8e30101900 2024-09-20T18:49:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.717+0000 7f8e26ffd640 1 -- 172.21.15.17:0/3032173707 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8e2c009a30 con 0x7f8e30101900 2024-09-20T18:49:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.718+0000 7f8e26ffd640 1 --2- 172.21.15.17:0/3032173707 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e1c07af80 0x7f8e1c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.718+0000 7f8e26ffd640 1 -- 172.21.15.17:0/3032173707 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f8e2c09de10 con 0x7f8e30101900 2024-09-20T18:49:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.718+0000 7f8e355f3640 1 --2- 172.21.15.17:0/3032173707 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e1c07af80 0x7f8e1c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.719+0000 7f8e355f3640 1 --2- 172.21.15.17:0/3032173707 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e1c07af80 0x7f8e1c07d440 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8e30198b10 tx=0x7f8e20031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:49:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.722+0000 7f8e26ffd640 1 -- 172.21.15.17:0/3032173707 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8e2c069490 con 0x7f8e30101900 2024-09-20T18:49:28.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.928+0000 7f8e38058640 1 -- 172.21.15.17:0/3032173707 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8e301982c0 con 0x7f8e1c07af80 2024-09-20T18:49:28.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.929+0000 7f8e26ffd640 1 -- 172.21.15.17:0/3032173707 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f8e301982c0 con 0x7f8e1c07af80 2024-09-20T18:49:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.931+0000 7f8e38058640 1 -- 172.21.15.17:0/3032173707 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e1c07af80 msgr2=0x7f8e1c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.931+0000 7f8e38058640 1 --2- 172.21.15.17:0/3032173707 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e1c07af80 0x7f8e1c07d440 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8e30198b10 tx=0x7f8e20031400 comp rx=0 tx=0).stop 2024-09-20T18:49:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.931+0000 7f8e38058640 1 -- 172.21.15.17:0/3032173707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e30101900 msgr2=0x7f8e3019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.931+0000 7f8e38058640 1 --2- 172.21.15.17:0/3032173707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e30101900 0x7f8e3019d640 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00d8d0 tx=0x7f8e2c00dd90 comp rx=0 tx=0).stop 2024-09-20T18:49:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.931+0000 7f8e38058640 1 -- 172.21.15.17:0/3032173707 shutdown_connections 2024-09-20T18:49:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.931+0000 7f8e38058640 1 --2- 172.21.15.17:0/3032173707 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e1c07af80 0x7f8e1c07d440 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.931+0000 7f8e38058640 1 --2- 172.21.15.17:0/3032173707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e30107900 0x7f8e3019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.931+0000 7f8e38058640 1 --2- 172.21.15.17:0/3032173707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e30101900 0x7f8e3019d640 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.931+0000 7f8e38058640 1 -- 172.21.15.17:0/3032173707 >> 172.21.15.17:0/3032173707 conn(0x7f8e300fd5e0 msgr2=0x7f8e300fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:49:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.931+0000 7f8e38058640 1 -- 172.21.15.17:0/3032173707 shutdown_connections 2024-09-20T18:49:28.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:28.931+0000 7f8e38058640 1 -- 172.21.15.17:0/3032173707 wait complete. 2024-09-20T18:49:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.015+0000 7ff4feb84640 1 -- 172.21.15.17:0/3773264552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f8100800 msgr2=0x7ff4f8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.015+0000 7ff4feb84640 1 --2- 172.21.15.17:0/3773264552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f8100800 0x7ff4f8100c60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009880 tx=0x7ff4e402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.015+0000 7ff4feb84640 1 -- 172.21.15.17:0/3773264552 shutdown_connections 2024-09-20T18:49:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.015+0000 7ff4feb84640 1 --2- 172.21.15.17:0/3773264552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f8100800 0x7ff4f8100c60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.015+0000 7ff4feb84640 1 --2- 172.21.15.17:0/3773264552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f8106800 0x7ff4f8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.015+0000 7ff4feb84640 1 -- 172.21.15.17:0/3773264552 >> 172.21.15.17:0/3773264552 conn(0x7ff4f80fc520 msgr2=0x7ff4f80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:49:29.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.015+0000 7ff4feb84640 1 -- 172.21.15.17:0/3773264552 shutdown_connections 2024-09-20T18:49:29.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.015+0000 7ff4feb84640 1 -- 172.21.15.17:0/3773264552 wait complete. 2024-09-20T18:49:29.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.016+0000 7ff4feb84640 1 Processor -- start 2024-09-20T18:49:29.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.016+0000 7ff4feb84640 1 -- start start 2024-09-20T18:49:29.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.016+0000 7ff4feb84640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f8100800 0x7ff4f819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:29.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.016+0000 7ff4feb84640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f8106800 0x7ff4f819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:29.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.016+0000 7ff4feb84640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f810dcb0 con 0x7ff4f8106800 2024-09-20T18:49:29.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.016+0000 7ff4feb84640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f810db30 con 0x7ff4f8100800 2024-09-20T18:49:29.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.016+0000 7ff4f7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f8106800 0x7ff4f819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.016+0000 7ff4f7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f8106800 0x7ff4f819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49902/0 (socket says 172.21.15.17:49902) 2024-09-20T18:49:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.016+0000 7ff4f7fff640 1 -- 172.21.15.17:0/3116798827 learned_addr learned my addr 172.21.15.17:0/3116798827 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:49:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.016+0000 7ff4fc920640 1 --2- 172.21.15.17:0/3116798827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f8100800 0x7ff4f819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.017+0000 7ff4f7fff640 1 -- 172.21.15.17:0/3116798827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f8100800 msgr2=0x7ff4f819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.017+0000 7ff4f7fff640 1 --2- 172.21.15.17:0/3116798827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f8100800 0x7ff4f819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.017+0000 7ff4f7fff640 1 -- 172.21.15.17:0/3116798827 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f81977f0 con 0x7ff4f8106800 2024-09-20T18:49:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.017+0000 7ff4fc920640 1 --2- 172.21.15.17:0/3116798827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f8100800 0x7ff4f819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:49:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.017+0000 7ff4f7fff640 1 --2- 172.21.15.17:0/3116798827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f8106800 0x7ff4f819dbb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4031460 tx=0x7ff4e40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:49:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.017+0000 7ff4f5ffb640 1 -- 172.21.15.17:0/3116798827 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4e403f070 con 0x7ff4f8106800 2024-09-20T18:49:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.017+0000 7ff4feb84640 1 -- 172.21.15.17:0/3116798827 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f8197a80 con 0x7ff4f8106800 2024-09-20T18:49:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.017+0000 7ff4f5ffb640 1 -- 172.21.15.17:0/3116798827 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff4e4004cf0 con 0x7ff4f8106800 2024-09-20T18:49:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.017+0000 7ff4f5ffb640 1 -- 172.21.15.17:0/3116798827 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4e4035030 con 0x7ff4f8106800 2024-09-20T18:49:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.017+0000 7ff4feb84640 1 -- 172.21.15.17:0/3116798827 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f8197fb0 con 0x7ff4f8106800 2024-09-20T18:49:29.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.018+0000 7ff4feb84640 1 -- 172.21.15.17:0/3116798827 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4f8101f40 con 0x7ff4f8106800 2024-09-20T18:49:29.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.019+0000 7ff4f5ffb640 1 -- 172.21.15.17:0/3116798827 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff4e4042070 con 0x7ff4f8106800 2024-09-20T18:49:29.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.019+0000 7ff4f5ffb640 1 --2- 172.21.15.17:0/3116798827 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4e807af30 0x7ff4e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:29.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.020+0000 7ff4f5ffb640 1 -- 172.21.15.17:0/3116798827 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7ff4e40beb20 con 0x7ff4f8106800 2024-09-20T18:49:29.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.020+0000 7ff4fc920640 1 --2- 172.21.15.17:0/3116798827 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4e807af30 0x7ff4e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:29.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.020+0000 7ff4fc920640 1 --2- 172.21.15.17:0/3116798827 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4e807af30 0x7ff4e807d3f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00abe0 tx=0x7ff4ec00a5c0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:49:29.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.024+0000 7ff4f5ffb640 1 -- 172.21.15.17:0/3116798827 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff4e408a120 con 0x7ff4f8106800 2024-09-20T18:49:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.224+0000 7ff4feb84640 1 -- 172.21.15.17:0/3116798827 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff4f8198320 con 0x7ff4e807af30 2024-09-20T18:49:29.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.234+0000 7ff4f5ffb640 1 -- 172.21.15.17:0/3116798827 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ff4f8198320 con 0x7ff4e807af30 2024-09-20T18:49:29.251 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:49:29.251 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (10m) 5m ago 21m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:49:29.251 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (13m) 5m ago 22m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:49:29.251 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (13m) 4m ago 21m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:49:29.251 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (9m) 5m ago 22m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:49:29.251 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (9m) 4m ago 21m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:49:29.251 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (10m) 5m ago 21m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:49:29.251 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (5m) 5m ago 16m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:49:29.251 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (5m) 5m ago 16m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:49:29.251 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (16m) 4m ago 16m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:49:29.251 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (4m) 4m ago 16m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:49:29.251 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (13m) 5m ago 23m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:49:29.252 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (12m) 4m ago 21m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:49:29.252 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (9m) 5m ago 23m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:49:29.252 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (9m) 4m ago 20m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:49:29.252 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (11m) 5m ago 21m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:49:29.252 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (11m) 4m ago 21m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:49:29.252 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (8m) 5m ago 19m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:49:29.252 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (8m) 5m ago 19m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:49:29.252 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (7m) 5m ago 18m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:49:29.252 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (6m) 4m ago 18m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:49:29.252 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (6m) 4m ago 18m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:49:29.252 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (5m) 4m ago 17m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:49:29.252 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (11m) 5m ago 21m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:49:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.236+0000 7ff4feb84640 1 -- 172.21.15.17:0/3116798827 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4e807af30 msgr2=0x7ff4e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.236+0000 7ff4feb84640 1 --2- 172.21.15.17:0/3116798827 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4e807af30 0x7ff4e807d3f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00abe0 tx=0x7ff4ec00a5c0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.236+0000 7ff4feb84640 1 -- 172.21.15.17:0/3116798827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f8106800 msgr2=0x7ff4f819dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.236+0000 7ff4feb84640 1 --2- 172.21.15.17:0/3116798827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f8106800 0x7ff4f819dbb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4031460 tx=0x7ff4e40048f0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.236+0000 7ff4feb84640 1 -- 172.21.15.17:0/3116798827 shutdown_connections 2024-09-20T18:49:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.236+0000 7ff4feb84640 1 --2- 172.21.15.17:0/3116798827 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4e807af30 0x7ff4e807d3f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.236+0000 7ff4feb84640 1 --2- 172.21.15.17:0/3116798827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f8106800 0x7ff4f819dbb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.236+0000 7ff4feb84640 1 --2- 172.21.15.17:0/3116798827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f8100800 0x7ff4f819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.236+0000 7ff4feb84640 1 -- 172.21.15.17:0/3116798827 >> 172.21.15.17:0/3116798827 conn(0x7ff4f80fc520 msgr2=0x7ff4f806a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:49:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.237+0000 7ff4feb84640 1 -- 172.21.15.17:0/3116798827 shutdown_connections 2024-09-20T18:49:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.237+0000 7ff4feb84640 1 -- 172.21.15.17:0/3116798827 wait complete. 2024-09-20T18:49:29.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.320+0000 7f3c1fa54640 1 -- 172.21.15.17:0/2865408373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c18100800 msgr2=0x7f3c18100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:29.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.320+0000 7f3c1fa54640 1 --2- 172.21.15.17:0/2865408373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c18100800 0x7f3c18100c60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009880 tx=0x7f3c0802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.320+0000 7f3c1fa54640 1 -- 172.21.15.17:0/2865408373 shutdown_connections 2024-09-20T18:49:29.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.320+0000 7f3c1fa54640 1 --2- 172.21.15.17:0/2865408373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c18100800 0x7f3c18100c60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.320+0000 7f3c1fa54640 1 --2- 172.21.15.17:0/2865408373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c18106800 0x7f3c18106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.320+0000 7f3c1fa54640 1 -- 172.21.15.17:0/2865408373 >> 172.21.15.17:0/2865408373 conn(0x7f3c180fc520 msgr2=0x7f3c180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:49:29.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.321+0000 7f3c1fa54640 1 -- 172.21.15.17:0/2865408373 shutdown_connections 2024-09-20T18:49:29.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.321+0000 7f3c1fa54640 1 -- 172.21.15.17:0/2865408373 wait complete. 2024-09-20T18:49:29.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.321+0000 7f3c1fa54640 1 Processor -- start 2024-09-20T18:49:29.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.321+0000 7f3c1fa54640 1 -- start start 2024-09-20T18:49:29.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.321+0000 7f3c1fa54640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c18100800 0x7f3c180fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:29.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.321+0000 7f3c1fa54640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c18106800 0x7f3c180fd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:29.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.321+0000 7f3c1fa54640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1810dcd0 con 0x7f3c18106800 2024-09-20T18:49:29.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.321+0000 7f3c1fa54640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1810db50 con 0x7f3c18100800 2024-09-20T18:49:29.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.322+0000 7f3c1cfef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c18106800 0x7f3c180fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.322+0000 7f3c1cfef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c18106800 0x7f3c180fd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49922/0 (socket says 172.21.15.17:49922) 2024-09-20T18:49:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.322+0000 7f3c1cfef640 1 -- 172.21.15.17:0/3509407006 learned_addr learned my addr 172.21.15.17:0/3509407006 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:49:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.322+0000 7f3c1d7f0640 1 --2- 172.21.15.17:0/3509407006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c18100800 0x7f3c180fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.322+0000 7f3c1cfef640 1 -- 172.21.15.17:0/3509407006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c18100800 msgr2=0x7f3c180fcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.322+0000 7f3c1cfef640 1 --2- 172.21.15.17:0/3509407006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c18100800 0x7f3c180fcbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.322+0000 7f3c1cfef640 1 -- 172.21.15.17:0/3509407006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c180fd670 con 0x7f3c18106800 2024-09-20T18:49:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.322+0000 7f3c1cfef640 1 --2- 172.21.15.17:0/3509407006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c18106800 0x7f3c180fd130 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3c08031460 tx=0x7f3c080045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:49:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.322+0000 7f3c0e7fc640 1 -- 172.21.15.17:0/3509407006 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c0803f070 con 0x7f3c18106800 2024-09-20T18:49:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.322+0000 7f3c0e7fc640 1 -- 172.21.15.17:0/3509407006 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c080035f0 con 0x7f3c18106800 2024-09-20T18:49:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.322+0000 7f3c1fa54640 1 -- 172.21.15.17:0/3509407006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c180fd900 con 0x7f3c18106800 2024-09-20T18:49:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.322+0000 7f3c0e7fc640 1 -- 172.21.15.17:0/3509407006 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c08035030 con 0x7f3c18106800 2024-09-20T18:49:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.322+0000 7f3c1fa54640 1 -- 172.21.15.17:0/3509407006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c181a3db0 con 0x7f3c18106800 2024-09-20T18:49:29.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.324+0000 7f3c1fa54640 1 -- 172.21.15.17:0/3509407006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c18101f40 con 0x7f3c18106800 2024-09-20T18:49:29.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.324+0000 7f3c0e7fc640 1 -- 172.21.15.17:0/3509407006 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3c08042070 con 0x7f3c18106800 2024-09-20T18:49:29.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.325+0000 7f3c0e7fc640 1 --2- 172.21.15.17:0/3509407006 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c0407af30 0x7f3c0407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:29.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.325+0000 7f3c0e7fc640 1 -- 172.21.15.17:0/3509407006 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f3c080be5a0 con 0x7f3c18106800 2024-09-20T18:49:29.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.325+0000 7f3c1d7f0640 1 --2- 172.21.15.17:0/3509407006 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c0407af30 0x7f3c0407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:29.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.325+0000 7f3c1d7f0640 1 --2- 172.21.15.17:0/3509407006 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c0407af30 0x7f3c0407d3f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3c14005fd0 tx=0x7f3c1400b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:49:29.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.329+0000 7f3c0e7fc640 1 -- 172.21.15.17:0/3509407006 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c08089ba0 con 0x7f3c18106800 2024-09-20T18:49:29.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.596+0000 7f3c1fa54640 1 -- 172.21.15.17:0/3509407006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3c180fe120 con 0x7f3c18106800 2024-09-20T18:49:29.613 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:29 smithi017 ceph-mon[108970]: pgmap v422: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:29.613 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:29 smithi017 ceph-mon[108970]: from='client.34622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:49:29.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.597+0000 7f3c0e7fc640 1 -- 172.21.15.17:0/3509407006 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f3c0808ea50 con 0x7f3c18106800 2024-09-20T18:49:29.614 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:49:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:49:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:49:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:49:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:49:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:49:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:49:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:49:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:49:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:49:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:49:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:49:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:49:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:49:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:49:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:49:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:49:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:49:29.615 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:49:29.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.599+0000 7f3c1fa54640 1 -- 172.21.15.17:0/3509407006 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c0407af30 msgr2=0x7f3c0407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:29.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.599+0000 7f3c1fa54640 1 --2- 172.21.15.17:0/3509407006 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c0407af30 0x7f3c0407d3f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3c14005fd0 tx=0x7f3c1400b390 comp rx=0 tx=0).stop 2024-09-20T18:49:29.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.599+0000 7f3c1fa54640 1 -- 172.21.15.17:0/3509407006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c18106800 msgr2=0x7f3c180fd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:29.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.599+0000 7f3c1fa54640 1 --2- 172.21.15.17:0/3509407006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c18106800 0x7f3c180fd130 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3c08031460 tx=0x7f3c080045e0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.599+0000 7f3c1fa54640 1 -- 172.21.15.17:0/3509407006 shutdown_connections 2024-09-20T18:49:29.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.599+0000 7f3c1fa54640 1 --2- 172.21.15.17:0/3509407006 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c0407af30 0x7f3c0407d3f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.599+0000 7f3c1fa54640 1 --2- 172.21.15.17:0/3509407006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c18106800 0x7f3c180fd130 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.599+0000 7f3c1fa54640 1 --2- 172.21.15.17:0/3509407006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c18100800 0x7f3c180fcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.599+0000 7f3c1fa54640 1 -- 172.21.15.17:0/3509407006 >> 172.21.15.17:0/3509407006 conn(0x7f3c180fc520 msgr2=0x7f3c1806a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:49:29.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.599+0000 7f3c1fa54640 1 -- 172.21.15.17:0/3509407006 shutdown_connections 2024-09-20T18:49:29.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.599+0000 7f3c1fa54640 1 -- 172.21.15.17:0/3509407006 wait complete. 2024-09-20T18:49:29.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.685+0000 7fb7f05c1640 1 -- 172.21.15.17:0/2955845878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e8107900 msgr2=0x7fb7e8107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:29.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.685+0000 7fb7f05c1640 1 --2- 172.21.15.17:0/2955845878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e8107900 0x7fb7e8107ce0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009880 tx=0x7fb7e402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.685+0000 7fb7f05c1640 1 -- 172.21.15.17:0/2955845878 shutdown_connections 2024-09-20T18:49:29.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.685+0000 7fb7f05c1640 1 --2- 172.21.15.17:0/2955845878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7e8101900 0x7fb7e8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.685+0000 7fb7f05c1640 1 --2- 172.21.15.17:0/2955845878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e8107900 0x7fb7e8107ce0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.685+0000 7fb7f05c1640 1 -- 172.21.15.17:0/2955845878 >> 172.21.15.17:0/2955845878 conn(0x7fb7e80fd600 msgr2=0x7fb7e80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:49:29.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.685+0000 7fb7f05c1640 1 -- 172.21.15.17:0/2955845878 shutdown_connections 2024-09-20T18:49:29.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.685+0000 7fb7f05c1640 1 -- 172.21.15.17:0/2955845878 wait complete. 2024-09-20T18:49:29.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.686+0000 7fb7f05c1640 1 Processor -- start 2024-09-20T18:49:29.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.686+0000 7fb7f05c1640 1 -- start start 2024-09-20T18:49:29.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.686+0000 7fb7f05c1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7e8101900 0x7fb7e819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.686+0000 7fb7f05c1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e8107900 0x7fb7e819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.686+0000 7fb7f05c1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e810edb0 con 0x7fb7e8107900 2024-09-20T18:49:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.686+0000 7fb7f05c1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e810ec30 con 0x7fb7e8101900 2024-09-20T18:49:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.686+0000 7fb7edb5c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e8107900 0x7fb7e819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.686+0000 7fb7edb5c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e8107900 0x7fb7e819db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49952/0 (socket says 172.21.15.17:49952) 2024-09-20T18:49:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.686+0000 7fb7edb5c640 1 -- 172.21.15.17:0/1012364474 learned_addr learned my addr 172.21.15.17:0/1012364474 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:49:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.686+0000 7fb7ee35d640 1 --2- 172.21.15.17:0/1012364474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7e8101900 0x7fb7e819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.686+0000 7fb7edb5c640 1 -- 172.21.15.17:0/1012364474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7e8101900 msgr2=0x7fb7e819d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.686+0000 7fb7edb5c640 1 --2- 172.21.15.17:0/1012364474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7e8101900 0x7fb7e819d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.686+0000 7fb7edb5c640 1 -- 172.21.15.17:0/1012364474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e81977c0 con 0x7fb7e8107900 2024-09-20T18:49:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.687+0000 7fb7ee35d640 1 --2- 172.21.15.17:0/1012364474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7e8101900 0x7fb7e819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:49:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.687+0000 7fb7edb5c640 1 --2- 172.21.15.17:0/1012364474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e8107900 0x7fb7e819db80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800c8a0 tx=0x7fb7d800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:49:29.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.687+0000 7fb7df7fe640 1 -- 172.21.15.17:0/1012364474 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7d80079b0 con 0x7fb7e8107900 2024-09-20T18:49:29.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.687+0000 7fb7df7fe640 1 -- 172.21.15.17:0/1012364474 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7d8007b50 con 0x7fb7e8107900 2024-09-20T18:49:29.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.687+0000 7fb7f05c1640 1 -- 172.21.15.17:0/1012364474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e8197ab0 con 0x7fb7e8107900 2024-09-20T18:49:29.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.687+0000 7fb7df7fe640 1 -- 172.21.15.17:0/1012364474 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7d8018700 con 0x7fb7e8107900 2024-09-20T18:49:29.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.687+0000 7fb7f05c1640 1 -- 172.21.15.17:0/1012364474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e8198040 con 0x7fb7e8107900 2024-09-20T18:49:29.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.688+0000 7fb7f05c1640 1 -- 172.21.15.17:0/1012364474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e8103040 con 0x7fb7e8107900 2024-09-20T18:49:29.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.689+0000 7fb7df7fe640 1 -- 172.21.15.17:0/1012364474 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb7d8007d00 con 0x7fb7e8107900 2024-09-20T18:49:29.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.689+0000 7fb7df7fe640 1 --2- 172.21.15.17:0/1012364474 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7d407af40 0x7fb7d407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:29.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.689+0000 7fb7df7fe640 1 -- 172.21.15.17:0/1012364474 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fb7d809e310 con 0x7fb7e8107900 2024-09-20T18:49:29.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.689+0000 7fb7ee35d640 1 --2- 172.21.15.17:0/1012364474 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7d407af40 0x7fb7d407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:29.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.690+0000 7fb7ee35d640 1 --2- 172.21.15.17:0/1012364474 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7d407af40 0x7fb7d407d400 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4031460 tx=0x7fb7e4004280 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:49:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.694+0000 7fb7df7fe640 1 -- 172.21.15.17:0/1012364474 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7d8014030 con 0x7fb7e8107900 2024-09-20T18:49:29.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.923+0000 7fb7f05c1640 1 -- 172.21.15.17:0/1012364474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb7e8104b10 con 0x7fb7e8107900 2024-09-20T18:49:29.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.924+0000 7fb7df7fe640 1 -- 172.21.15.17:0/1012364474 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7fb7d8069910 con 0x7fb7e8107900 2024-09-20T18:49:29.941 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:49:29.941 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:49:29.941 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:49:29.941 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:49:29.941 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:49:29.941 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:49:29.941 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:49:29.941 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:49:29.941 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:49:29.941 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:49:29.942 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:49:29.942 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:49:29.942 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:49:29.942 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:49:29.942 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:49:29.942 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:49:29.942 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:49:29.942 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:49:29.942 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:49:29.942 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:49:29.942 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:49:29.942 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:49:29.943 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:49:29.943 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:49:29.943 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:49:29.943 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:49:29.943 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:49:29.943 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:49:29.943 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:49:29.943 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:49:29.943 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:49:29.943 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:49:29.943 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:49:29.943 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:49:29.943 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:49:29.943 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:49:29.944 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:49:29.944 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:49:29.944 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:49:29.944 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:49:29.944 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:49:29.944 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:49:29.944 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:49:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:49:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.926+0000 7fb7f05c1640 1 -- 172.21.15.17:0/1012364474 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7d407af40 msgr2=0x7fb7d407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.926+0000 7fb7f05c1640 1 --2- 172.21.15.17:0/1012364474 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7d407af40 0x7fb7d407d400 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4031460 tx=0x7fb7e4004280 comp rx=0 tx=0).stop 2024-09-20T18:49:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.926+0000 7fb7f05c1640 1 -- 172.21.15.17:0/1012364474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e8107900 msgr2=0x7fb7e819db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.926+0000 7fb7f05c1640 1 --2- 172.21.15.17:0/1012364474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e8107900 0x7fb7e819db80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800c8a0 tx=0x7fb7d800cd60 comp rx=0 tx=0).stop 2024-09-20T18:49:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.926+0000 7fb7f05c1640 1 -- 172.21.15.17:0/1012364474 shutdown_connections 2024-09-20T18:49:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.926+0000 7fb7f05c1640 1 --2- 172.21.15.17:0/1012364474 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7d407af40 0x7fb7d407d400 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.926+0000 7fb7f05c1640 1 --2- 172.21.15.17:0/1012364474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e8107900 0x7fb7e819db80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.926+0000 7fb7f05c1640 1 --2- 172.21.15.17:0/1012364474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7e8101900 0x7fb7e819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:29.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.926+0000 7fb7f05c1640 1 -- 172.21.15.17:0/1012364474 >> 172.21.15.17:0/1012364474 conn(0x7fb7e80fd600 msgr2=0x7fb7e80ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:49:29.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.926+0000 7fb7f05c1640 1 -- 172.21.15.17:0/1012364474 shutdown_connections 2024-09-20T18:49:29.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:29.926+0000 7fb7f05c1640 1 -- 172.21.15.17:0/1012364474 wait complete. 2024-09-20T18:49:29.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:29 smithi172 ceph-mon[80431]: pgmap v422: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:29.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:29 smithi172 ceph-mon[80431]: from='client.34622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:49:30.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.011+0000 7f9bbff36640 1 -- 172.21.15.17:0/3413664213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8101900 msgr2=0x7f9bb8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:30.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.011+0000 7f9bbff36640 1 --2- 172.21.15.17:0/3413664213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8101900 0x7f9bb8101d60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009c20 tx=0x7f9bac02a970 comp rx=0 tx=0).stop 2024-09-20T18:49:30.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.011+0000 7f9bbff36640 1 -- 172.21.15.17:0/3413664213 shutdown_connections 2024-09-20T18:49:30.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.011+0000 7f9bbff36640 1 --2- 172.21.15.17:0/3413664213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8101900 0x7f9bb8101d60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:30.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.011+0000 7f9bbff36640 1 --2- 172.21.15.17:0/3413664213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8107900 0x7f9bb8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:30.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.011+0000 7f9bbff36640 1 -- 172.21.15.17:0/3413664213 >> 172.21.15.17:0/3413664213 conn(0x7f9bb80fd600 msgr2=0x7f9bb80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:49:30.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.011+0000 7f9bbff36640 1 -- 172.21.15.17:0/3413664213 shutdown_connections 2024-09-20T18:49:30.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.011+0000 7f9bbff36640 1 -- 172.21.15.17:0/3413664213 wait complete. 2024-09-20T18:49:30.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.012+0000 7f9bbff36640 1 Processor -- start 2024-09-20T18:49:30.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.012+0000 7f9bbff36640 1 -- start start 2024-09-20T18:49:30.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.012+0000 7f9bbff36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8101900 0x7f9bb80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:30.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.012+0000 7f9bbff36640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8107900 0x7f9bb8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:30.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.012+0000 7f9bbff36640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb810edd0 con 0x7f9bb8101900 2024-09-20T18:49:30.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.012+0000 7f9bbff36640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb810ec50 con 0x7f9bb8107900 2024-09-20T18:49:30.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.012+0000 7f9bbdcd2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8101900 0x7f9bb80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:30.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.012+0000 7f9bbdcd2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8101900 0x7f9bb80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49964/0 (socket says 172.21.15.17:49964) 2024-09-20T18:49:30.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.012+0000 7f9bbdcd2640 1 -- 172.21.15.17:0/2663485914 learned_addr learned my addr 172.21.15.17:0/2663485914 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:49:30.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.012+0000 7f9bbd4d1640 1 --2- 172.21.15.17:0/2663485914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8107900 0x7f9bb8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:30.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.012+0000 7f9bbdcd2640 1 -- 172.21.15.17:0/2663485914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8107900 msgr2=0x7f9bb8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:30.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.012+0000 7f9bbdcd2640 1 --2- 172.21.15.17:0/2663485914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8107900 0x7f9bb8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:30.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.013+0000 7f9bbdcd2640 1 -- 172.21.15.17:0/2663485914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb8074f70 con 0x7f9bb8101900 2024-09-20T18:49:30.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.013+0000 7f9bbd4d1640 1 --2- 172.21.15.17:0/2663485914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8107900 0x7f9bb8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:49:30.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.013+0000 7f9bbdcd2640 1 --2- 172.21.15.17:0/2663485914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8101900 0x7f9bb80744f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000d6f0 tx=0x7f9bb000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:49:30.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.013+0000 7f9bb6ffd640 1 -- 172.21.15.17:0/2663485914 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9bb0017070 con 0x7f9bb8101900 2024-09-20T18:49:30.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.013+0000 7f9bbff36640 1 -- 172.21.15.17:0/2663485914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb8075260 con 0x7f9bb8101900 2024-09-20T18:49:30.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.013+0000 7f9bb6ffd640 1 -- 172.21.15.17:0/2663485914 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9bb000de00 con 0x7f9bb8101900 2024-09-20T18:49:30.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.013+0000 7f9bb6ffd640 1 -- 172.21.15.17:0/2663485914 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9bb0004bb0 con 0x7f9bb8101900 2024-09-20T18:49:30.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.013+0000 7f9bbff36640 1 -- 172.21.15.17:0/2663485914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bb81a3e20 con 0x7f9bb8101900 2024-09-20T18:49:30.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.014+0000 7f9bbff36640 1 -- 172.21.15.17:0/2663485914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bb8103040 con 0x7f9bb8101900 2024-09-20T18:49:30.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.015+0000 7f9bb6ffd640 1 -- 172.21.15.17:0/2663485914 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9bb0004e60 con 0x7f9bb8101900 2024-09-20T18:49:30.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.015+0000 7f9bb6ffd640 1 --2- 172.21.15.17:0/2663485914 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9ba007af40 0x7f9ba007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:30.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.015+0000 7f9bb6ffd640 1 -- 172.21.15.17:0/2663485914 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f9bb009dc30 con 0x7f9bb8101900 2024-09-20T18:49:30.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.015+0000 7f9bbd4d1640 1 --2- 172.21.15.17:0/2663485914 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9ba007af40 0x7f9ba007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:30.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.016+0000 7f9bbd4d1640 1 --2- 172.21.15.17:0/2663485914 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9ba007af40 0x7f9ba007d400 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9bac006010 tx=0x7f9bac02fa60 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:49:30.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.020+0000 7f9bb6ffd640 1 -- 172.21.15.17:0/2663485914 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9bb0069230 con 0x7f9bb8101900 2024-09-20T18:49:30.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.223+0000 7f9bbff36640 1 -- 172.21.15.17:0/2663485914 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9bb8062630 con 0x7f9ba007af40 2024-09-20T18:49:30.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.224+0000 7f9bb6ffd640 1 -- 172.21.15.17:0/2663485914 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f9bb8062630 con 0x7f9ba007af40 2024-09-20T18:49:30.241 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:49:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:49:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:49:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:49:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:49:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:49:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:49:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:49:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:49:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:49:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:49:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:49:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:49:30.242 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:49:30.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.226+0000 7f9bbff36640 1 -- 172.21.15.17:0/2663485914 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9ba007af40 msgr2=0x7f9ba007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:30.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.226+0000 7f9bbff36640 1 --2- 172.21.15.17:0/2663485914 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9ba007af40 0x7f9ba007d400 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9bac006010 tx=0x7f9bac02fa60 comp rx=0 tx=0).stop 2024-09-20T18:49:30.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.226+0000 7f9bbff36640 1 -- 172.21.15.17:0/2663485914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8101900 msgr2=0x7f9bb80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:30.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.226+0000 7f9bbff36640 1 --2- 172.21.15.17:0/2663485914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8101900 0x7f9bb80744f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000d6f0 tx=0x7f9bb000dbb0 comp rx=0 tx=0).stop 2024-09-20T18:49:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.227+0000 7f9bbff36640 1 -- 172.21.15.17:0/2663485914 shutdown_connections 2024-09-20T18:49:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.227+0000 7f9bbff36640 1 --2- 172.21.15.17:0/2663485914 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9ba007af40 0x7f9ba007d400 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.227+0000 7f9bbff36640 1 --2- 172.21.15.17:0/2663485914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb8107900 0x7f9bb8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.227+0000 7f9bbff36640 1 --2- 172.21.15.17:0/2663485914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bb8101900 0x7f9bb80744f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.227+0000 7f9bbff36640 1 -- 172.21.15.17:0/2663485914 >> 172.21.15.17:0/2663485914 conn(0x7f9bb80fd600 msgr2=0x7f9bb80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:49:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.227+0000 7f9bbff36640 1 -- 172.21.15.17:0/2663485914 shutdown_connections 2024-09-20T18:49:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.227+0000 7f9bbff36640 1 -- 172.21.15.17:0/2663485914 wait complete. 2024-09-20T18:49:30.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.311+0000 7f781d686640 1 -- 172.21.15.17:0/1176227361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78181033e0 msgr2=0x7f781810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:30.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.311+0000 7f781d686640 1 --2- 172.21.15.17:0/1176227361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78181033e0 0x7f781810b8d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7800009880 tx=0x7f780002a530 comp rx=0 tx=0).stop 2024-09-20T18:49:30.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.311+0000 7f781d686640 1 -- 172.21.15.17:0/1176227361 shutdown_connections 2024-09-20T18:49:30.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.311+0000 7f781d686640 1 --2- 172.21.15.17:0/1176227361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78181033e0 0x7f781810b8d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:30.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.311+0000 7f781d686640 1 --2- 172.21.15.17:0/1176227361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7818102ac0 0x7f7818102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:30.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.311+0000 7f781d686640 1 -- 172.21.15.17:0/1176227361 >> 172.21.15.17:0/1176227361 conn(0x7f78180fc520 msgr2=0x7f78180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:49:30.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.311+0000 7f781d686640 1 -- 172.21.15.17:0/1176227361 shutdown_connections 2024-09-20T18:49:30.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.311+0000 7f781d686640 1 -- 172.21.15.17:0/1176227361 wait complete. 2024-09-20T18:49:30.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.312+0000 7f781d686640 1 Processor -- start 2024-09-20T18:49:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.312+0000 7f781d686640 1 -- start start 2024-09-20T18:49:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.312+0000 7f781d686640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7818102ac0 0x7f781819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.312+0000 7f781d686640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78181033e0 0x7f781819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.312+0000 7f781d686640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f781810edd0 con 0x7f78181033e0 2024-09-20T18:49:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.312+0000 7f781d686640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f781810ec50 con 0x7f7818102ac0 2024-09-20T18:49:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.312+0000 7f78167fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78181033e0 0x7f781819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.312+0000 7f78167fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78181033e0 0x7f781819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49992/0 (socket says 172.21.15.17:49992) 2024-09-20T18:49:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.312+0000 7f78167fc640 1 -- 172.21.15.17:0/775035231 learned_addr learned my addr 172.21.15.17:0/775035231 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:49:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.313+0000 7f7816ffd640 1 --2- 172.21.15.17:0/775035231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7818102ac0 0x7f781819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.313+0000 7f78167fc640 1 -- 172.21.15.17:0/775035231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7818102ac0 msgr2=0x7f781819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.313+0000 7f78167fc640 1 --2- 172.21.15.17:0/775035231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7818102ac0 0x7f781819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.313+0000 7f78167fc640 1 -- 172.21.15.17:0/775035231 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78181977e0 con 0x7f78181033e0 2024-09-20T18:49:30.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.313+0000 7f7816ffd640 1 --2- 172.21.15.17:0/775035231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7818102ac0 0x7f781819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:49:30.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.313+0000 7f78167fc640 1 --2- 172.21.15.17:0/775035231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78181033e0 0x7f781819dba0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7800031460 tx=0x7f78000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:49:30.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.313+0000 7f780ffff640 1 -- 172.21.15.17:0/775035231 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f780003f070 con 0x7f78181033e0 2024-09-20T18:49:30.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.313+0000 7f780ffff640 1 -- 172.21.15.17:0/775035231 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7800004ac0 con 0x7f78181033e0 2024-09-20T18:49:30.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.313+0000 7f781d686640 1 -- 172.21.15.17:0/775035231 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7818197a70 con 0x7f78181033e0 2024-09-20T18:49:30.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.313+0000 7f780ffff640 1 -- 172.21.15.17:0/775035231 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7800035030 con 0x7f78181033e0 2024-09-20T18:49:30.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.313+0000 7f781d686640 1 -- 172.21.15.17:0/775035231 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7818197fa0 con 0x7f78181033e0 2024-09-20T18:49:30.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.314+0000 7f781d686640 1 -- 172.21.15.17:0/775035231 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f781806aa90 con 0x7f78181033e0 2024-09-20T18:49:30.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.315+0000 7f780ffff640 1 -- 172.21.15.17:0/775035231 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7800042070 con 0x7f78181033e0 2024-09-20T18:49:30.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.315+0000 7f780ffff640 1 --2- 172.21.15.17:0/775035231 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f780407af80 0x7f780407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:49:30.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.316+0000 7f780ffff640 1 -- 172.21.15.17:0/775035231 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f78000be960 con 0x7f78181033e0 2024-09-20T18:49:30.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.316+0000 7f7816ffd640 1 --2- 172.21.15.17:0/775035231 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f780407af80 0x7f780407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:49:30.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.316+0000 7f7816ffd640 1 --2- 172.21.15.17:0/775035231 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f780407af80 0x7f780407d440 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f780800abe0 tx=0x7f780800a5c0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:49:30.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.320+0000 7f780ffff640 1 -- 172.21.15.17:0/775035231 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7800089fe0 con 0x7f78181033e0 2024-09-20T18:49:30.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.582+0000 7f781d686640 1 -- 172.21.15.17:0/775035231 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f7818198d40 con 0x7f78181033e0 2024-09-20T18:49:30.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.583+0000 7f780ffff640 1 -- 172.21.15.17:0/775035231 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f7818198d40 con 0x7f78181033e0 2024-09-20T18:49:30.599 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:49:30.600 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:49:30.600 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:49:30.600 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:49:30.600 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:49:30.600 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:49:30.600 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:49:30.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.585+0000 7f781d686640 1 -- 172.21.15.17:0/775035231 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f780407af80 msgr2=0x7f780407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:30.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.585+0000 7f781d686640 1 --2- 172.21.15.17:0/775035231 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f780407af80 0x7f780407d440 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f780800abe0 tx=0x7f780800a5c0 comp rx=0 tx=0).stop 2024-09-20T18:49:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.585+0000 7f781d686640 1 -- 172.21.15.17:0/775035231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78181033e0 msgr2=0x7f781819dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:49:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.585+0000 7f781d686640 1 --2- 172.21.15.17:0/775035231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78181033e0 0x7f781819dba0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7800031460 tx=0x7f78000046c0 comp rx=0 tx=0).stop 2024-09-20T18:49:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.585+0000 7f781d686640 1 -- 172.21.15.17:0/775035231 shutdown_connections 2024-09-20T18:49:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.585+0000 7f781d686640 1 --2- 172.21.15.17:0/775035231 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f780407af80 0x7f780407d440 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.585+0000 7f781d686640 1 --2- 172.21.15.17:0/775035231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78181033e0 0x7f781819dba0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.585+0000 7f781d686640 1 --2- 172.21.15.17:0/775035231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7818102ac0 0x7f781819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:49:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.585+0000 7f781d686640 1 -- 172.21.15.17:0/775035231 >> 172.21.15.17:0/775035231 conn(0x7f78180fc520 msgr2=0x7f7818108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:49:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.585+0000 7f781d686640 1 -- 172.21.15.17:0/775035231 shutdown_connections 2024-09-20T18:49:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:49:30.585+0000 7f781d686640 1 -- 172.21.15.17:0/775035231 wait complete. 2024-09-20T18:49:30.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:30 smithi017 ceph-mon[108970]: from='client.34626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:49:30.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:30 smithi017 ceph-mon[108970]: from='client.34630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:49:30.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:30 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3509407006' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:49:30.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:30 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1012364474' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:49:30.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:30 smithi172 ceph-mon[80431]: from='client.34626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:49:30.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:30 smithi172 ceph-mon[80431]: from='client.34630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:49:30.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:30 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3509407006' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:49:30.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:30 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1012364474' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:49:31.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:31 smithi172 ceph-mon[80431]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:49:31.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:31 smithi172 ceph-mon[80431]: pgmap v423: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:31.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:31 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/775035231' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:49:31.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:31 smithi017 ceph-mon[108970]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:49:31.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:31 smithi017 ceph-mon[108970]: pgmap v423: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:31.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:31 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/775035231' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:49:33.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:33 smithi017 ceph-mon[108970]: pgmap v424: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:33.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:33 smithi172 ceph-mon[80431]: pgmap v424: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:35.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:35 smithi017 ceph-mon[108970]: pgmap v425: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:35.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:35 smithi172 ceph-mon[80431]: pgmap v425: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:37 smithi017 ceph-mon[108970]: pgmap v426: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:49:37.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:37 smithi172 ceph-mon[80431]: pgmap v426: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:37.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:49:39.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:39 smithi017 ceph-mon[108970]: pgmap v427: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:39.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:39 smithi172 ceph-mon[80431]: pgmap v427: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:41.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:41 smithi017 ceph-mon[108970]: pgmap v428: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:41.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:41 smithi172 ceph-mon[80431]: pgmap v428: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:43.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:43 smithi017 ceph-mon[108970]: pgmap v429: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:43.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:43 smithi172 ceph-mon[80431]: pgmap v429: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:45.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:45 smithi017 ceph-mon[108970]: pgmap v430: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:45.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:45 smithi172 ceph-mon[80431]: pgmap v430: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:47.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:47 smithi017 ceph-mon[108970]: pgmap v431: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:47.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:47 smithi172 ceph-mon[80431]: pgmap v431: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:49.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:49 smithi017 ceph-mon[108970]: pgmap v432: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:49.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:49 smithi172 ceph-mon[80431]: pgmap v432: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:51.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:51 smithi017 ceph-mon[108970]: pgmap v433: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:51.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:51 smithi172 ceph-mon[80431]: pgmap v433: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:52.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:49:52.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:49:53.863 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:53 smithi172 ceph-mon[80431]: pgmap v434: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:53.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:53 smithi017 ceph-mon[108970]: pgmap v434: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:55.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:55 smithi017 ceph-mon[108970]: pgmap v435: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:55.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:55 smithi172 ceph-mon[80431]: pgmap v435: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:57.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:57 smithi017 ceph-mon[108970]: pgmap v436: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:57.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:57 smithi172 ceph-mon[80431]: pgmap v436: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:59.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:49:59 smithi017 ceph-mon[108970]: pgmap v437: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:49:59.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:49:59 smithi172 ceph-mon[80431]: pgmap v437: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:00.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:49:59.998+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:50:00.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:49:59.998+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:50:00.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:49:59.998+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2024-09-20T18:50:00.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:49:59.998+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:50:00.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:49:59.998+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:50:00.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:49:59.998+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:50:00.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:49:59.998+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2024-09-20T18:50:00.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.681+0000 7fe3952ae640 1 -- 172.21.15.17:0/2007120467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe390107900 msgr2=0x7fe390107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:00.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.681+0000 7fe3952ae640 1 --2- 172.21.15.17:0/2007120467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe390107900 0x7fe390107ce0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe380009880 tx=0x7fe38002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:50:00.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.681+0000 7fe3952ae640 1 -- 172.21.15.17:0/2007120467 shutdown_connections 2024-09-20T18:50:00.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.681+0000 7fe3952ae640 1 --2- 172.21.15.17:0/2007120467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe390101900 0x7fe390101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:00.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.681+0000 7fe3952ae640 1 --2- 172.21.15.17:0/2007120467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe390107900 0x7fe390107ce0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:00.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.681+0000 7fe3952ae640 1 -- 172.21.15.17:0/2007120467 >> 172.21.15.17:0/2007120467 conn(0x7fe3900fd600 msgr2=0x7fe3900ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:00.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.681+0000 7fe3952ae640 1 -- 172.21.15.17:0/2007120467 shutdown_connections 2024-09-20T18:50:00.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.681+0000 7fe3952ae640 1 -- 172.21.15.17:0/2007120467 wait complete. 2024-09-20T18:50:00.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.682+0000 7fe3952ae640 1 Processor -- start 2024-09-20T18:50:00.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.682+0000 7fe3952ae640 1 -- start start 2024-09-20T18:50:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.682+0000 7fe3952ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe390101900 0x7fe39019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.682+0000 7fe3952ae640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe390107900 0x7fe39019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.682+0000 7fe3952ae640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe39010edb0 con 0x7fe390101900 2024-09-20T18:50:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.682+0000 7fe3952ae640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe39010ec30 con 0x7fe390107900 2024-09-20T18:50:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.682+0000 7fe38effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe390101900 0x7fe39019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.682+0000 7fe38effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe390101900 0x7fe39019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34180/0 (socket says 172.21.15.17:34180) 2024-09-20T18:50:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.682+0000 7fe38effd640 1 -- 172.21.15.17:0/1900446999 learned_addr learned my addr 172.21.15.17:0/1900446999 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:50:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.683+0000 7fe38effd640 1 -- 172.21.15.17:0/1900446999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe390107900 msgr2=0x7fe39019dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.683+0000 7fe38e7fc640 1 --2- 172.21.15.17:0/1900446999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe390107900 0x7fe39019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.683+0000 7fe38effd640 1 --2- 172.21.15.17:0/1900446999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe390107900 0x7fe39019dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.683+0000 7fe38effd640 1 -- 172.21.15.17:0/1900446999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3901977e0 con 0x7fe390101900 2024-09-20T18:50:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.683+0000 7fe38e7fc640 1 --2- 172.21.15.17:0/1900446999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe390107900 0x7fe39019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:50:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.683+0000 7fe38effd640 1 --2- 172.21.15.17:0/1900446999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe390101900 0x7fe39019d660 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe380031460 tx=0x7fe3800045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:00.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.683+0000 7fe387fff640 1 -- 172.21.15.17:0/1900446999 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe38003f070 con 0x7fe390101900 2024-09-20T18:50:00.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.683+0000 7fe387fff640 1 -- 172.21.15.17:0/1900446999 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe380004b10 con 0x7fe390101900 2024-09-20T18:50:00.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.683+0000 7fe3952ae640 1 -- 172.21.15.17:0/1900446999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe390197a70 con 0x7fe390101900 2024-09-20T18:50:00.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.683+0000 7fe387fff640 1 -- 172.21.15.17:0/1900446999 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe380035030 con 0x7fe390101900 2024-09-20T18:50:00.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.683+0000 7fe3952ae640 1 -- 172.21.15.17:0/1900446999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe390197fa0 con 0x7fe390101900 2024-09-20T18:50:00.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.684+0000 7fe3952ae640 1 -- 172.21.15.17:0/1900446999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe390103040 con 0x7fe390101900 2024-09-20T18:50:00.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.685+0000 7fe387fff640 1 -- 172.21.15.17:0/1900446999 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe380042070 con 0x7fe390101900 2024-09-20T18:50:00.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.686+0000 7fe387fff640 1 --2- 172.21.15.17:0/1900446999 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe37c07af40 0x7fe37c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:00.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.686+0000 7fe387fff640 1 -- 172.21.15.17:0/1900446999 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fe3800beb50 con 0x7fe390101900 2024-09-20T18:50:00.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.686+0000 7fe38e7fc640 1 --2- 172.21.15.17:0/1900446999 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe37c07af40 0x7fe37c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:00.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.686+0000 7fe38e7fc640 1 --2- 172.21.15.17:0/1900446999 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe37c07af40 0x7fe37c07d400 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe390100d10 tx=0x7fe378005e50 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:00.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.690+0000 7fe387fff640 1 -- 172.21.15.17:0/1900446999 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe38008a150 con 0x7fe390101900 2024-09-20T18:50:00.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:00 smithi017 ceph-mon[108970]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:50:00.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:00 smithi017 ceph-mon[108970]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:50:00.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:00 smithi017 ceph-mon[108970]: fs cephfs is degraded 2024-09-20T18:50:00.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:00 smithi017 ceph-mon[108970]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:50:00.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:00 smithi017 ceph-mon[108970]: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:50:00.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:00 smithi017 ceph-mon[108970]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:50:00.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:00 smithi017 ceph-mon[108970]: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:50:00.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.899+0000 7fe3952ae640 1 -- 172.21.15.17:0/1900446999 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe390198250 con 0x7fe37c07af40 2024-09-20T18:50:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.900+0000 7fe387fff640 1 -- 172.21.15.17:0/1900446999 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fe390198250 con 0x7fe37c07af40 2024-09-20T18:50:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.902+0000 7fe3952ae640 1 -- 172.21.15.17:0/1900446999 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe37c07af40 msgr2=0x7fe37c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.902+0000 7fe3952ae640 1 --2- 172.21.15.17:0/1900446999 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe37c07af40 0x7fe37c07d400 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe390100d10 tx=0x7fe378005e50 comp rx=0 tx=0).stop 2024-09-20T18:50:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.902+0000 7fe3952ae640 1 -- 172.21.15.17:0/1900446999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe390101900 msgr2=0x7fe39019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.902+0000 7fe3952ae640 1 --2- 172.21.15.17:0/1900446999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe390101900 0x7fe39019d660 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe380031460 tx=0x7fe3800045e0 comp rx=0 tx=0).stop 2024-09-20T18:50:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.903+0000 7fe3952ae640 1 -- 172.21.15.17:0/1900446999 shutdown_connections 2024-09-20T18:50:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.903+0000 7fe3952ae640 1 --2- 172.21.15.17:0/1900446999 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe37c07af40 0x7fe37c07d400 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.903+0000 7fe3952ae640 1 --2- 172.21.15.17:0/1900446999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe390107900 0x7fe39019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.903+0000 7fe3952ae640 1 --2- 172.21.15.17:0/1900446999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe390101900 0x7fe39019d660 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.903+0000 7fe3952ae640 1 -- 172.21.15.17:0/1900446999 >> 172.21.15.17:0/1900446999 conn(0x7fe3900fd600 msgr2=0x7fe3900fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.903+0000 7fe3952ae640 1 -- 172.21.15.17:0/1900446999 shutdown_connections 2024-09-20T18:50:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.903+0000 7fe3952ae640 1 -- 172.21.15.17:0/1900446999 wait complete. 2024-09-20T18:50:00.930 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:50:00.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:00 smithi172 ceph-mon[80431]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:50:00.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:00 smithi172 ceph-mon[80431]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:50:00.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:00 smithi172 ceph-mon[80431]: fs cephfs is degraded 2024-09-20T18:50:00.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:00 smithi172 ceph-mon[80431]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:50:00.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:00 smithi172 ceph-mon[80431]: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:50:00.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:00 smithi172 ceph-mon[80431]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:50:00.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:00 smithi172 ceph-mon[80431]: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:50:01.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.988+0000 7f125fcfd640 1 -- 172.21.15.17:0/3482024261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1258100820 msgr2=0x7f1258100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:01.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.988+0000 7f125fcfd640 1 --2- 172.21.15.17:0/3482024261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1258100820 0x7f1258100c80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1248009880 tx=0x7f124802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.988+0000 7f125fcfd640 1 -- 172.21.15.17:0/3482024261 shutdown_connections 2024-09-20T18:50:01.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.988+0000 7f125fcfd640 1 --2- 172.21.15.17:0/3482024261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1258100820 0x7f1258100c80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.988+0000 7f125fcfd640 1 --2- 172.21.15.17:0/3482024261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1258106820 0x7f1258106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.988+0000 7f125fcfd640 1 -- 172.21.15.17:0/3482024261 >> 172.21.15.17:0/3482024261 conn(0x7f12580fc540 msgr2=0x7f12580fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:01.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.989+0000 7f125fcfd640 1 -- 172.21.15.17:0/3482024261 shutdown_connections 2024-09-20T18:50:01.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.989+0000 7f125fcfd640 1 -- 172.21.15.17:0/3482024261 wait complete. 2024-09-20T18:50:01.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.989+0000 7f125fcfd640 1 Processor -- start 2024-09-20T18:50:01.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.989+0000 7f125fcfd640 1 -- start start 2024-09-20T18:50:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.989+0000 7f125fcfd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1258100820 0x7f12580fcd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.989+0000 7f125fcfd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1258106820 0x7f12580fd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.989+0000 7f125fcfd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f125810dcf0 con 0x7f1258106820 2024-09-20T18:50:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.989+0000 7f125fcfd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f125810db70 con 0x7f1258100820 2024-09-20T18:50:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.990+0000 7f125d298640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1258106820 0x7f12580fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.990+0000 7f125d298640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1258106820 0x7f12580fd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34192/0 (socket says 172.21.15.17:34192) 2024-09-20T18:50:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.990+0000 7f125d298640 1 -- 172.21.15.17:0/1243360600 learned_addr learned my addr 172.21.15.17:0/1243360600 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:50:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.990+0000 7f125da99640 1 --2- 172.21.15.17:0/1243360600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1258100820 0x7f12580fcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.990+0000 7f125d298640 1 -- 172.21.15.17:0/1243360600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1258100820 msgr2=0x7f12580fcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.990+0000 7f125d298640 1 --2- 172.21.15.17:0/1243360600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1258100820 0x7f12580fcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.990+0000 7f125d298640 1 -- 172.21.15.17:0/1243360600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12580fd780 con 0x7f1258106820 2024-09-20T18:50:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.990+0000 7f125da99640 1 --2- 172.21.15.17:0/1243360600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1258100820 0x7f12580fcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:50:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.990+0000 7f125d298640 1 --2- 172.21.15.17:0/1243360600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1258106820 0x7f12580fd240 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1248031460 tx=0x7f12480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.990+0000 7f124effd640 1 -- 172.21.15.17:0/1243360600 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f124803f070 con 0x7f1258106820 2024-09-20T18:50:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.990+0000 7f124effd640 1 -- 172.21.15.17:0/1243360600 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f12480035f0 con 0x7f1258106820 2024-09-20T18:50:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.990+0000 7f125fcfd640 1 -- 172.21.15.17:0/1243360600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12580fda10 con 0x7f1258106820 2024-09-20T18:50:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.990+0000 7f124effd640 1 -- 172.21.15.17:0/1243360600 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1248035030 con 0x7f1258106820 2024-09-20T18:50:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.990+0000 7f125fcfd640 1 -- 172.21.15.17:0/1243360600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12581a3dc0 con 0x7f1258106820 2024-09-20T18:50:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.991+0000 7f125fcfd640 1 -- 172.21.15.17:0/1243360600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1258101f60 con 0x7f1258106820 2024-09-20T18:50:01.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.992+0000 7f124effd640 1 -- 172.21.15.17:0/1243360600 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1248042070 con 0x7f1258106820 2024-09-20T18:50:01.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.992+0000 7f124effd640 1 --2- 172.21.15.17:0/1243360600 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f124407af30 0x7f124407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:01.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.993+0000 7f125da99640 1 --2- 172.21.15.17:0/1243360600 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f124407af30 0x7f124407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:01.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.993+0000 7f124effd640 1 -- 172.21.15.17:0/1243360600 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f12480bea20 con 0x7f1258106820 2024-09-20T18:50:01.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.993+0000 7f125da99640 1 --2- 172.21.15.17:0/1243360600 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f124407af30 0x7f124407d3f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1254009b40 tx=0x7f1254005e50 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:01.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:00.997+0000 7f124effd640 1 -- 172.21.15.17:0/1243360600 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f124808a020 con 0x7f1258106820 2024-09-20T18:50:01.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.200+0000 7f125fcfd640 1 -- 172.21.15.17:0/1243360600 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1258062630 con 0x7f124407af30 2024-09-20T18:50:01.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.201+0000 7f124effd640 1 -- 172.21.15.17:0/1243360600 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f1258062630 con 0x7f124407af30 2024-09-20T18:50:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.204+0000 7f125fcfd640 1 -- 172.21.15.17:0/1243360600 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f124407af30 msgr2=0x7f124407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.204+0000 7f125fcfd640 1 --2- 172.21.15.17:0/1243360600 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f124407af30 0x7f124407d3f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1254009b40 tx=0x7f1254005e50 comp rx=0 tx=0).stop 2024-09-20T18:50:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.204+0000 7f125fcfd640 1 -- 172.21.15.17:0/1243360600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1258106820 msgr2=0x7f12580fd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.204+0000 7f125fcfd640 1 --2- 172.21.15.17:0/1243360600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1258106820 0x7f12580fd240 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1248031460 tx=0x7f12480045e0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.204+0000 7f125fcfd640 1 -- 172.21.15.17:0/1243360600 shutdown_connections 2024-09-20T18:50:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.204+0000 7f125fcfd640 1 --2- 172.21.15.17:0/1243360600 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f124407af30 0x7f124407d3f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.204+0000 7f125fcfd640 1 --2- 172.21.15.17:0/1243360600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1258106820 0x7f12580fd240 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.204+0000 7f125fcfd640 1 --2- 172.21.15.17:0/1243360600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1258100820 0x7f12580fcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.204+0000 7f125fcfd640 1 -- 172.21.15.17:0/1243360600 >> 172.21.15.17:0/1243360600 conn(0x7f12580fc540 msgr2=0x7f125806a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.204+0000 7f125fcfd640 1 -- 172.21.15.17:0/1243360600 shutdown_connections 2024-09-20T18:50:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.204+0000 7f125fcfd640 1 -- 172.21.15.17:0/1243360600 wait complete. 2024-09-20T18:50:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.288+0000 7ff39574c640 1 -- 172.21.15.17:0/2519928417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff390102ac0 msgr2=0x7ff390102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.288+0000 7ff39574c640 1 --2- 172.21.15.17:0/2519928417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff390102ac0 0x7ff390102ea0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff380009880 tx=0x7ff38002a530 comp rx=0 tx=0).stop 2024-09-20T18:50:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.288+0000 7ff39574c640 1 -- 172.21.15.17:0/2519928417 shutdown_connections 2024-09-20T18:50:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.288+0000 7ff39574c640 1 --2- 172.21.15.17:0/2519928417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3901033e0 0x7ff39010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.288+0000 7ff39574c640 1 --2- 172.21.15.17:0/2519928417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff390102ac0 0x7ff390102ea0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.288+0000 7ff39574c640 1 -- 172.21.15.17:0/2519928417 >> 172.21.15.17:0/2519928417 conn(0x7ff3900fc520 msgr2=0x7ff3900fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.288+0000 7ff39574c640 1 -- 172.21.15.17:0/2519928417 shutdown_connections 2024-09-20T18:50:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.288+0000 7ff39574c640 1 -- 172.21.15.17:0/2519928417 wait complete. 2024-09-20T18:50:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.289+0000 7ff39574c640 1 Processor -- start 2024-09-20T18:50:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.289+0000 7ff39574c640 1 -- start start 2024-09-20T18:50:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.289+0000 7ff39574c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff390102ac0 0x7ff39019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:01.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.289+0000 7ff39574c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3901033e0 0x7ff39019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:01.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.289+0000 7ff39574c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff39010edf0 con 0x7ff3901033e0 2024-09-20T18:50:01.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.289+0000 7ff39574c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff39010ec70 con 0x7ff390102ac0 2024-09-20T18:50:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.289+0000 7ff387fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3901033e0 0x7ff39019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.289+0000 7ff387fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3901033e0 0x7ff39019dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34208/0 (socket says 172.21.15.17:34208) 2024-09-20T18:50:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.289+0000 7ff387fff640 1 -- 172.21.15.17:0/2439490499 learned_addr learned my addr 172.21.15.17:0/2439490499 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:50:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.290+0000 7ff38effd640 1 --2- 172.21.15.17:0/2439490499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff390102ac0 0x7ff39019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.290+0000 7ff387fff640 1 -- 172.21.15.17:0/2439490499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff390102ac0 msgr2=0x7ff39019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.290+0000 7ff387fff640 1 --2- 172.21.15.17:0/2439490499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff390102ac0 0x7ff39019d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.290+0000 7ff387fff640 1 -- 172.21.15.17:0/2439490499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3901977e0 con 0x7ff3901033e0 2024-09-20T18:50:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.290+0000 7ff38effd640 1 --2- 172.21.15.17:0/2439490499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff390102ac0 0x7ff39019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:50:01.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.290+0000 7ff387fff640 1 --2- 172.21.15.17:0/2439490499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3901033e0 0x7ff39019dba0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff37800c8f0 tx=0x7ff37800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:01.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.290+0000 7ff38cff9640 1 -- 172.21.15.17:0/2439490499 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff37800ae50 con 0x7ff3901033e0 2024-09-20T18:50:01.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.290+0000 7ff38cff9640 1 -- 172.21.15.17:0/2439490499 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff378005020 con 0x7ff3901033e0 2024-09-20T18:50:01.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.290+0000 7ff39574c640 1 -- 172.21.15.17:0/2439490499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff390197ad0 con 0x7ff3901033e0 2024-09-20T18:50:01.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.290+0000 7ff38cff9640 1 -- 172.21.15.17:0/2439490499 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff378004d70 con 0x7ff3901033e0 2024-09-20T18:50:01.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.290+0000 7ff39574c640 1 -- 172.21.15.17:0/2439490499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff390198060 con 0x7ff3901033e0 2024-09-20T18:50:01.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.291+0000 7ff39574c640 1 -- 172.21.15.17:0/2439490499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff39006aa90 con 0x7ff3901033e0 2024-09-20T18:50:01.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.292+0000 7ff38cff9640 1 -- 172.21.15.17:0/2439490499 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff3780051d0 con 0x7ff3901033e0 2024-09-20T18:50:01.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.292+0000 7ff38cff9640 1 --2- 172.21.15.17:0/2439490499 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff37c07b0e0 0x7ff37c07d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:01.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.293+0000 7ff38effd640 1 --2- 172.21.15.17:0/2439490499 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff37c07b0e0 0x7ff37c07d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:01.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.293+0000 7ff38cff9640 1 -- 172.21.15.17:0/2439490499 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7ff37809de20 con 0x7ff3901033e0 2024-09-20T18:50:01.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.293+0000 7ff38effd640 1 --2- 172.21.15.17:0/2439490499 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff37c07b0e0 0x7ff37c07d5a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff380031460 tx=0x7ff380009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:01.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.297+0000 7ff38cff9640 1 -- 172.21.15.17:0/2439490499 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff378014030 con 0x7ff3901033e0 2024-09-20T18:50:01.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.493+0000 7ff39574c640 1 -- 172.21.15.17:0/2439490499 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff390198370 con 0x7ff37c07b0e0 2024-09-20T18:50:01.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.502+0000 7ff38cff9640 1 -- 172.21.15.17:0/2439490499 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ff390198370 con 0x7ff37c07b0e0 2024-09-20T18:50:01.520 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:50:01.520 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (11m) 5m ago 22m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:50:01.520 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (14m) 5m ago 22m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:50:01.521 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (13m) 5m ago 21m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:50:01.521 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (9m) 5m ago 22m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:50:01.521 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (9m) 5m ago 21m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:50:01.521 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (10m) 5m ago 22m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:50:01.521 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (5m) 5m ago 17m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:50:01.521 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (5m) 5m ago 17m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:50:01.521 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (17m) 5m ago 17m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:50:01.521 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (5m) 5m ago 17m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:50:01.521 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (13m) 5m ago 23m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:50:01.521 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (12m) 5m ago 21m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:50:01.521 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (10m) 5m ago 23m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:50:01.521 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (9m) 5m ago 21m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:50:01.521 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (12m) 5m ago 22m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:50:01.522 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (12m) 5m ago 21m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:50:01.522 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (9m) 5m ago 20m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:50:01.522 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (8m) 5m ago 19m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:50:01.522 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (8m) 5m ago 19m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:50:01.522 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (7m) 5m ago 18m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:50:01.522 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (6m) 5m ago 18m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:50:01.522 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (6m) 5m ago 18m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:50:01.522 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (11m) 5m ago 22m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:50:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.505+0000 7ff39574c640 1 -- 172.21.15.17:0/2439490499 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff37c07b0e0 msgr2=0x7ff37c07d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.505+0000 7ff39574c640 1 --2- 172.21.15.17:0/2439490499 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff37c07b0e0 0x7ff37c07d5a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff380031460 tx=0x7ff380009560 comp rx=0 tx=0).stop 2024-09-20T18:50:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.505+0000 7ff39574c640 1 -- 172.21.15.17:0/2439490499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3901033e0 msgr2=0x7ff39019dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.505+0000 7ff39574c640 1 --2- 172.21.15.17:0/2439490499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3901033e0 0x7ff39019dba0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff37800c8f0 tx=0x7ff37800cdb0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.505+0000 7ff39574c640 1 -- 172.21.15.17:0/2439490499 shutdown_connections 2024-09-20T18:50:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.505+0000 7ff39574c640 1 --2- 172.21.15.17:0/2439490499 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff37c07b0e0 0x7ff37c07d5a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.505+0000 7ff39574c640 1 --2- 172.21.15.17:0/2439490499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3901033e0 0x7ff39019dba0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.505+0000 7ff39574c640 1 --2- 172.21.15.17:0/2439490499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff390102ac0 0x7ff39019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.505+0000 7ff39574c640 1 -- 172.21.15.17:0/2439490499 >> 172.21.15.17:0/2439490499 conn(0x7ff3900fc520 msgr2=0x7ff390108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:01.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.505+0000 7ff39574c640 1 -- 172.21.15.17:0/2439490499 shutdown_connections 2024-09-20T18:50:01.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.505+0000 7ff39574c640 1 -- 172.21.15.17:0/2439490499 wait complete. 2024-09-20T18:50:01.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.589+0000 7f195033f640 1 -- 172.21.15.17:0/1376146661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1948107900 msgr2=0x7f1948107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.589+0000 7f195033f640 1 --2- 172.21.15.17:0/1376146661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1948107900 0x7f1948107ce0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1944009880 tx=0x7f194402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.590+0000 7f195033f640 1 -- 172.21.15.17:0/1376146661 shutdown_connections 2024-09-20T18:50:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.590+0000 7f195033f640 1 --2- 172.21.15.17:0/1376146661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1948101900 0x7f1948101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.590+0000 7f195033f640 1 --2- 172.21.15.17:0/1376146661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1948107900 0x7f1948107ce0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.590+0000 7f195033f640 1 -- 172.21.15.17:0/1376146661 >> 172.21.15.17:0/1376146661 conn(0x7f19480fd600 msgr2=0x7f19480ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.590+0000 7f195033f640 1 -- 172.21.15.17:0/1376146661 shutdown_connections 2024-09-20T18:50:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.590+0000 7f195033f640 1 -- 172.21.15.17:0/1376146661 wait complete. 2024-09-20T18:50:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.590+0000 7f195033f640 1 Processor -- start 2024-09-20T18:50:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.590+0000 7f195033f640 1 -- start start 2024-09-20T18:50:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.591+0000 7f195033f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1948101900 0x7f19480744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.591+0000 7f195033f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1948107900 0x7f1948074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.591+0000 7f195033f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f194810ee30 con 0x7f1948101900 2024-09-20T18:50:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.591+0000 7f195033f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f194810ecb0 con 0x7f1948107900 2024-09-20T18:50:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.591+0000 7f194e0db640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1948101900 0x7f19480744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.591+0000 7f194e0db640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1948101900 0x7f19480744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34222/0 (socket says 172.21.15.17:34222) 2024-09-20T18:50:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.591+0000 7f194e0db640 1 -- 172.21.15.17:0/1323861285 learned_addr learned my addr 172.21.15.17:0/1323861285 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:50:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.591+0000 7f194d8da640 1 --2- 172.21.15.17:0/1323861285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1948107900 0x7f1948074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.591+0000 7f194e0db640 1 -- 172.21.15.17:0/1323861285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1948107900 msgr2=0x7f1948074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.591+0000 7f194e0db640 1 --2- 172.21.15.17:0/1323861285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1948107900 0x7f1948074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.591+0000 7f194e0db640 1 -- 172.21.15.17:0/1323861285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1948074f70 con 0x7f1948101900 2024-09-20T18:50:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.591+0000 7f194e0db640 1 --2- 172.21.15.17:0/1323861285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1948101900 0x7f19480744f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1944031460 tx=0x7f19440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.591+0000 7f193f7fe640 1 -- 172.21.15.17:0/1323861285 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f194403f070 con 0x7f1948101900 2024-09-20T18:50:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.591+0000 7f193f7fe640 1 -- 172.21.15.17:0/1323861285 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f19440044d0 con 0x7f1948101900 2024-09-20T18:50:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.591+0000 7f195033f640 1 -- 172.21.15.17:0/1323861285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1948075200 con 0x7f1948101900 2024-09-20T18:50:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.591+0000 7f193f7fe640 1 -- 172.21.15.17:0/1323861285 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1944035030 con 0x7f1948101900 2024-09-20T18:50:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.592+0000 7f195033f640 1 -- 172.21.15.17:0/1323861285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19481a3e20 con 0x7f1948101900 2024-09-20T18:50:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.592+0000 7f195033f640 1 -- 172.21.15.17:0/1323861285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1948103040 con 0x7f1948101900 2024-09-20T18:50:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.593+0000 7f193f7fe640 1 -- 172.21.15.17:0/1323861285 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1944042070 con 0x7f1948101900 2024-09-20T18:50:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.594+0000 7f193f7fe640 1 --2- 172.21.15.17:0/1323861285 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f193407af90 0x7f193407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.594+0000 7f194d8da640 1 --2- 172.21.15.17:0/1323861285 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f193407af90 0x7f193407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.594+0000 7f193f7fe640 1 -- 172.21.15.17:0/1323861285 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f19440beaa0 con 0x7f1948101900 2024-09-20T18:50:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.595+0000 7f194d8da640 1 --2- 172.21.15.17:0/1323861285 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f193407af90 0x7f193407d450 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1948075f80 tx=0x7f1938008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:01.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.598+0000 7f193f7fe640 1 -- 172.21.15.17:0/1323861285 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1944004cf0 con 0x7f1948101900 2024-09-20T18:50:01.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.861+0000 7f195033f640 1 -- 172.21.15.17:0/1323861285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1948109e70 con 0x7f1948101900 2024-09-20T18:50:01.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:01 smithi017 ceph-mon[108970]: pgmap v438: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:01.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.862+0000 7f193f7fe640 1 -- 172.21.15.17:0/1323861285 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f194408c640 con 0x7f1948101900 2024-09-20T18:50:01.880 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:50:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:50:01.880 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:50:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:50:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:50:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:50:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:50:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:50:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:50:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:50:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:50:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:50:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:50:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:50:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:50:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:50:01.881 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:50:01.882 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:50:01.882 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:50:01.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.864+0000 7f195033f640 1 -- 172.21.15.17:0/1323861285 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f193407af90 msgr2=0x7f193407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:01.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.864+0000 7f195033f640 1 --2- 172.21.15.17:0/1323861285 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f193407af90 0x7f193407d450 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1948075f80 tx=0x7f1938008040 comp rx=0 tx=0).stop 2024-09-20T18:50:01.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.864+0000 7f195033f640 1 -- 172.21.15.17:0/1323861285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1948101900 msgr2=0x7f19480744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:01.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.864+0000 7f195033f640 1 --2- 172.21.15.17:0/1323861285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1948101900 0x7f19480744f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1944031460 tx=0x7f19440048f0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.864+0000 7f195033f640 1 -- 172.21.15.17:0/1323861285 shutdown_connections 2024-09-20T18:50:01.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.864+0000 7f195033f640 1 --2- 172.21.15.17:0/1323861285 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f193407af90 0x7f193407d450 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.864+0000 7f195033f640 1 --2- 172.21.15.17:0/1323861285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1948107900 0x7f1948074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.864+0000 7f195033f640 1 --2- 172.21.15.17:0/1323861285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1948101900 0x7f19480744f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.864+0000 7f195033f640 1 -- 172.21.15.17:0/1323861285 >> 172.21.15.17:0/1323861285 conn(0x7f19480fd600 msgr2=0x7f19480fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:01.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.864+0000 7f195033f640 1 -- 172.21.15.17:0/1323861285 shutdown_connections 2024-09-20T18:50:01.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.864+0000 7f195033f640 1 -- 172.21.15.17:0/1323861285 wait complete. 2024-09-20T18:50:01.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:01 smithi172 ceph-mon[80431]: pgmap v438: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.948+0000 7f7b46f04640 1 -- 172.21.15.17:0/3646446844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b40107900 msgr2=0x7f7b40107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.948+0000 7f7b46f04640 1 --2- 172.21.15.17:0/3646446844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b40107900 0x7f7b40107ce0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009880 tx=0x7f7b3402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.948+0000 7f7b46f04640 1 -- 172.21.15.17:0/3646446844 shutdown_connections 2024-09-20T18:50:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.948+0000 7f7b46f04640 1 --2- 172.21.15.17:0/3646446844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b40101900 0x7f7b40101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.948+0000 7f7b46f04640 1 --2- 172.21.15.17:0/3646446844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b40107900 0x7f7b40107ce0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.948+0000 7f7b46f04640 1 -- 172.21.15.17:0/3646446844 >> 172.21.15.17:0/3646446844 conn(0x7f7b400fd600 msgr2=0x7f7b400ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.948+0000 7f7b46f04640 1 -- 172.21.15.17:0/3646446844 shutdown_connections 2024-09-20T18:50:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.948+0000 7f7b46f04640 1 -- 172.21.15.17:0/3646446844 wait complete. 2024-09-20T18:50:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.949+0000 7f7b46f04640 1 Processor -- start 2024-09-20T18:50:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.949+0000 7f7b46f04640 1 -- start start 2024-09-20T18:50:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.949+0000 7f7b46f04640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b40101900 0x7f7b4019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.949+0000 7f7b46f04640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b40107900 0x7f7b4019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.949+0000 7f7b46f04640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4010edb0 con 0x7f7b40101900 2024-09-20T18:50:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.949+0000 7f7b46f04640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4010ec30 con 0x7f7b40107900 2024-09-20T18:50:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.949+0000 7f7b44ca0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b40101900 0x7f7b4019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.949+0000 7f7b44ca0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b40101900 0x7f7b4019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34240/0 (socket says 172.21.15.17:34240) 2024-09-20T18:50:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.949+0000 7f7b44ca0640 1 -- 172.21.15.17:0/3017774536 learned_addr learned my addr 172.21.15.17:0/3017774536 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:50:01.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.949+0000 7f7b3ffff640 1 --2- 172.21.15.17:0/3017774536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b40107900 0x7f7b4019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.950+0000 7f7b44ca0640 1 -- 172.21.15.17:0/3017774536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b40107900 msgr2=0x7f7b4019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.950+0000 7f7b44ca0640 1 --2- 172.21.15.17:0/3017774536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b40107900 0x7f7b4019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.950+0000 7f7b44ca0640 1 -- 172.21.15.17:0/3017774536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b401977c0 con 0x7f7b40101900 2024-09-20T18:50:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.950+0000 7f7b44ca0640 1 --2- 172.21.15.17:0/3017774536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b40101900 0x7f7b4019d640 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7b34031460 tx=0x7f7b340045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.950+0000 7f7b3dffb640 1 -- 172.21.15.17:0/3017774536 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b3403f070 con 0x7f7b40101900 2024-09-20T18:50:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.950+0000 7f7b3dffb640 1 -- 172.21.15.17:0/3017774536 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b340035f0 con 0x7f7b40101900 2024-09-20T18:50:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.950+0000 7f7b46f04640 1 -- 172.21.15.17:0/3017774536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b40197a50 con 0x7f7b40101900 2024-09-20T18:50:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.950+0000 7f7b3dffb640 1 -- 172.21.15.17:0/3017774536 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b34035030 con 0x7f7b40101900 2024-09-20T18:50:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.950+0000 7f7b46f04640 1 -- 172.21.15.17:0/3017774536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b40197f80 con 0x7f7b40101900 2024-09-20T18:50:01.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.951+0000 7f7b46f04640 1 -- 172.21.15.17:0/3017774536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b40103040 con 0x7f7b40101900 2024-09-20T18:50:01.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.952+0000 7f7b3dffb640 1 -- 172.21.15.17:0/3017774536 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7b34042070 con 0x7f7b40101900 2024-09-20T18:50:01.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.953+0000 7f7b3dffb640 1 --2- 172.21.15.17:0/3017774536 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7b3007af80 0x7f7b3007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:01.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.953+0000 7f7b3dffb640 1 -- 172.21.15.17:0/3017774536 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f7b340be9b0 con 0x7f7b40101900 2024-09-20T18:50:01.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.953+0000 7f7b3ffff640 1 --2- 172.21.15.17:0/3017774536 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7b3007af80 0x7f7b3007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:01.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.953+0000 7f7b3ffff640 1 --2- 172.21.15.17:0/3017774536 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7b3007af80 0x7f7b3007d440 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7b40100e00 tx=0x7f7b2c00b590 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:01.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:01.957+0000 7f7b3dffb640 1 -- 172.21.15.17:0/3017774536 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7b34089f90 con 0x7f7b40101900 2024-09-20T18:50:02.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.183+0000 7f7b46f04640 1 -- 172.21.15.17:0/3017774536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7b40104b10 con 0x7f7b40101900 2024-09-20T18:50:02.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.184+0000 7f7b3dffb640 1 -- 172.21.15.17:0/3017774536 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f7b3408ee40 con 0x7f7b40101900 2024-09-20T18:50:02.202 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:50:02.202 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:50:02.202 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:50:02.202 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:50:02.202 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:50:02.202 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:50:02.202 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:50:02.202 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:50:02.203 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:50:02.203 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:50:02.203 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:50:02.203 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:50:02.203 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:50:02.203 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:50:02.203 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:50:02.203 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:50:02.203 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:50:02.203 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:50:02.203 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:50:02.204 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:50:02.204 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:50:02.204 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:50:02.204 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:50:02.204 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:50:02.204 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:50:02.204 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:50:02.204 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:50:02.204 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:50:02.205 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:50:02.205 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:50:02.205 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:50:02.205 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:50:02.205 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:50:02.205 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:50:02.205 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:50:02.205 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:50:02.205 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:50:02.205 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:50:02.205 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:50:02.205 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:50:02.205 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:50:02.206 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:50:02.206 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:50:02.206 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:50:02.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.186+0000 7f7b46f04640 1 -- 172.21.15.17:0/3017774536 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7b3007af80 msgr2=0x7f7b3007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:02.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.186+0000 7f7b46f04640 1 --2- 172.21.15.17:0/3017774536 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7b3007af80 0x7f7b3007d440 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7b40100e00 tx=0x7f7b2c00b590 comp rx=0 tx=0).stop 2024-09-20T18:50:02.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.186+0000 7f7b46f04640 1 -- 172.21.15.17:0/3017774536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b40101900 msgr2=0x7f7b4019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:02.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.186+0000 7f7b46f04640 1 --2- 172.21.15.17:0/3017774536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b40101900 0x7f7b4019d640 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7b34031460 tx=0x7f7b340045e0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.186+0000 7f7b46f04640 1 -- 172.21.15.17:0/3017774536 shutdown_connections 2024-09-20T18:50:02.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.186+0000 7f7b46f04640 1 --2- 172.21.15.17:0/3017774536 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7b3007af80 0x7f7b3007d440 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.186+0000 7f7b46f04640 1 --2- 172.21.15.17:0/3017774536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b40107900 0x7f7b4019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.186+0000 7f7b46f04640 1 --2- 172.21.15.17:0/3017774536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b40101900 0x7f7b4019d640 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.186+0000 7f7b46f04640 1 -- 172.21.15.17:0/3017774536 >> 172.21.15.17:0/3017774536 conn(0x7f7b400fd600 msgr2=0x7f7b400ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:02.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.186+0000 7f7b46f04640 1 -- 172.21.15.17:0/3017774536 shutdown_connections 2024-09-20T18:50:02.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.186+0000 7f7b46f04640 1 -- 172.21.15.17:0/3017774536 wait complete. 2024-09-20T18:50:02.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.271+0000 7fa5d27e2640 1 -- 172.21.15.17:0/464021999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5cc1033e0 msgr2=0x7fa5cc10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:02.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.271+0000 7fa5d27e2640 1 --2- 172.21.15.17:0/464021999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5cc1033e0 0x7fa5cc10b8d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009880 tx=0x7fa5bc02a530 comp rx=0 tx=0).stop 2024-09-20T18:50:02.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.271+0000 7fa5d27e2640 1 -- 172.21.15.17:0/464021999 shutdown_connections 2024-09-20T18:50:02.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.271+0000 7fa5d27e2640 1 --2- 172.21.15.17:0/464021999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5cc1033e0 0x7fa5cc10b8d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.271+0000 7fa5d27e2640 1 --2- 172.21.15.17:0/464021999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5cc102ac0 0x7fa5cc102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.271+0000 7fa5d27e2640 1 -- 172.21.15.17:0/464021999 >> 172.21.15.17:0/464021999 conn(0x7fa5cc0fc520 msgr2=0x7fa5cc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:02.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.271+0000 7fa5d27e2640 1 -- 172.21.15.17:0/464021999 shutdown_connections 2024-09-20T18:50:02.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.271+0000 7fa5d27e2640 1 -- 172.21.15.17:0/464021999 wait complete. 2024-09-20T18:50:02.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.272+0000 7fa5d27e2640 1 Processor -- start 2024-09-20T18:50:02.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.272+0000 7fa5d27e2640 1 -- start start 2024-09-20T18:50:02.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.272+0000 7fa5d27e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5cc102ac0 0x7fa5cc19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:02.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.272+0000 7fa5d27e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5cc1033e0 0x7fa5cc19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:02.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.272+0000 7fa5d27e2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc10edd0 con 0x7fa5cc1033e0 2024-09-20T18:50:02.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.272+0000 7fa5d27e2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc10ec50 con 0x7fa5cc102ac0 2024-09-20T18:50:02.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.272+0000 7fa5cb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5cc1033e0 0x7fa5cc19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:02.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.272+0000 7fa5cb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5cc1033e0 0x7fa5cc19fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34248/0 (socket says 172.21.15.17:34248) 2024-09-20T18:50:02.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.273+0000 7fa5cb7fe640 1 -- 172.21.15.17:0/605486827 learned_addr learned my addr 172.21.15.17:0/605486827 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:50:02.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.273+0000 7fa5cbfff640 1 --2- 172.21.15.17:0/605486827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5cc102ac0 0x7fa5cc19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:02.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.273+0000 7fa5cb7fe640 1 -- 172.21.15.17:0/605486827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5cc102ac0 msgr2=0x7fa5cc19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:02.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.273+0000 7fa5cb7fe640 1 --2- 172.21.15.17:0/605486827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5cc102ac0 0x7fa5cc19f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.273+0000 7fa5cb7fe640 1 -- 172.21.15.17:0/605486827 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5cc1a0410 con 0x7fa5cc1033e0 2024-09-20T18:50:02.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.273+0000 7fa5cb7fe640 1 --2- 172.21.15.17:0/605486827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5cc1033e0 0x7fa5cc19fd60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc031460 tx=0x7fa5bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:02.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.273+0000 7fa5c97fa640 1 -- 172.21.15.17:0/605486827 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa5bc03f070 con 0x7fa5cc1033e0 2024-09-20T18:50:02.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.273+0000 7fa5c97fa640 1 -- 172.21.15.17:0/605486827 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa5bc004ac0 con 0x7fa5cc1033e0 2024-09-20T18:50:02.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.273+0000 7fa5d27e2640 1 -- 172.21.15.17:0/605486827 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5cc199aa0 con 0x7fa5cc1033e0 2024-09-20T18:50:02.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.273+0000 7fa5c97fa640 1 -- 172.21.15.17:0/605486827 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa5bc035030 con 0x7fa5cc1033e0 2024-09-20T18:50:02.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.273+0000 7fa5d27e2640 1 -- 172.21.15.17:0/605486827 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5cc199fa0 con 0x7fa5cc1033e0 2024-09-20T18:50:02.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.274+0000 7fa5d27e2640 1 -- 172.21.15.17:0/605486827 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5cc06aa90 con 0x7fa5cc1033e0 2024-09-20T18:50:02.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.275+0000 7fa5c97fa640 1 -- 172.21.15.17:0/605486827 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa5bc042070 con 0x7fa5cc1033e0 2024-09-20T18:50:02.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.276+0000 7fa5c97fa640 1 --2- 172.21.15.17:0/605486827 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa5b807af30 0x7fa5b807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:02.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.276+0000 7fa5c97fa640 1 -- 172.21.15.17:0/605486827 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fa5bc0be980 con 0x7fa5cc1033e0 2024-09-20T18:50:02.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.276+0000 7fa5cbfff640 1 --2- 172.21.15.17:0/605486827 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa5b807af30 0x7fa5b807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:02.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.276+0000 7fa5cbfff640 1 --2- 172.21.15.17:0/605486827 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa5b807af30 0x7fa5b807d3f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc19ab20 tx=0x7fa5b400a2d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:02.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.280+0000 7fa5c97fa640 1 -- 172.21.15.17:0/605486827 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa5bc089f80 con 0x7fa5cc1033e0 2024-09-20T18:50:02.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.484+0000 7fa5d27e2640 1 -- 172.21.15.17:0/605486827 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa5cc19af10 con 0x7fa5b807af30 2024-09-20T18:50:02.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.486+0000 7fa5c97fa640 1 -- 172.21.15.17:0/605486827 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fa5cc19af10 con 0x7fa5b807af30 2024-09-20T18:50:02.503 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:50:02.503 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:50:02.503 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:50:02.504 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:50:02.504 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:50:02.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:50:02.504 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:50:02.504 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:50:02.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:50:02.504 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:50:02.504 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:50:02.504 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:50:02.504 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:50:02.504 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:50:02.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.488+0000 7fa5d27e2640 1 -- 172.21.15.17:0/605486827 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa5b807af30 msgr2=0x7fa5b807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:02.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.488+0000 7fa5d27e2640 1 --2- 172.21.15.17:0/605486827 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa5b807af30 0x7fa5b807d3f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc19ab20 tx=0x7fa5b400a2d0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.488+0000 7fa5d27e2640 1 -- 172.21.15.17:0/605486827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5cc1033e0 msgr2=0x7fa5cc19fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:02.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.488+0000 7fa5d27e2640 1 --2- 172.21.15.17:0/605486827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5cc1033e0 0x7fa5cc19fd60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc031460 tx=0x7fa5bc0046c0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.488+0000 7fa5d27e2640 1 -- 172.21.15.17:0/605486827 shutdown_connections 2024-09-20T18:50:02.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.488+0000 7fa5d27e2640 1 --2- 172.21.15.17:0/605486827 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa5b807af30 0x7fa5b807d3f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.488+0000 7fa5d27e2640 1 --2- 172.21.15.17:0/605486827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5cc1033e0 0x7fa5cc19fd60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.488+0000 7fa5d27e2640 1 --2- 172.21.15.17:0/605486827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5cc102ac0 0x7fa5cc19f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.488+0000 7fa5d27e2640 1 -- 172.21.15.17:0/605486827 >> 172.21.15.17:0/605486827 conn(0x7fa5cc0fc520 msgr2=0x7fa5cc100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:02.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.488+0000 7fa5d27e2640 1 -- 172.21.15.17:0/605486827 shutdown_connections 2024-09-20T18:50:02.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.488+0000 7fa5d27e2640 1 -- 172.21.15.17:0/605486827 wait complete. 2024-09-20T18:50:02.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.573+0000 7f0e68104640 1 -- 172.21.15.17:0/2197225923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e60101900 msgr2=0x7f0e60101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:02.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.573+0000 7f0e68104640 1 --2- 172.21.15.17:0/2197225923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e60101900 0x7f0e60101d60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009880 tx=0x7f0e5c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.573+0000 7f0e68104640 1 -- 172.21.15.17:0/2197225923 shutdown_connections 2024-09-20T18:50:02.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.573+0000 7f0e68104640 1 --2- 172.21.15.17:0/2197225923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e60101900 0x7f0e60101d60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.573+0000 7f0e68104640 1 --2- 172.21.15.17:0/2197225923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e60107900 0x7f0e60107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.573+0000 7f0e68104640 1 -- 172.21.15.17:0/2197225923 >> 172.21.15.17:0/2197225923 conn(0x7f0e600fd5e0 msgr2=0x7f0e600ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:02.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.573+0000 7f0e68104640 1 -- 172.21.15.17:0/2197225923 shutdown_connections 2024-09-20T18:50:02.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.573+0000 7f0e68104640 1 -- 172.21.15.17:0/2197225923 wait complete. 2024-09-20T18:50:02.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.574+0000 7f0e68104640 1 Processor -- start 2024-09-20T18:50:02.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.574+0000 7f0e68104640 1 -- start start 2024-09-20T18:50:02.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.574+0000 7f0e68104640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e60101900 0x7f0e600744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:02.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.574+0000 7f0e68104640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e60107900 0x7f0e60074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:02.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.574+0000 7f0e68104640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6010edb0 con 0x7f0e60107900 2024-09-20T18:50:02.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.574+0000 7f0e68104640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6010ec30 con 0x7f0e60101900 2024-09-20T18:50:02.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.574+0000 7f0e6569f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e60107900 0x7f0e60074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:02.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.574+0000 7f0e6569f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e60107900 0x7f0e60074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34266/0 (socket says 172.21.15.17:34266) 2024-09-20T18:50:02.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.574+0000 7f0e6569f640 1 -- 172.21.15.17:0/4091428277 learned_addr learned my addr 172.21.15.17:0/4091428277 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:50:02.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.574+0000 7f0e65ea0640 1 --2- 172.21.15.17:0/4091428277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e60101900 0x7f0e600744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:02.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.575+0000 7f0e6569f640 1 -- 172.21.15.17:0/4091428277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e60101900 msgr2=0x7f0e600744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:02.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.575+0000 7f0e6569f640 1 --2- 172.21.15.17:0/4091428277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e60101900 0x7f0e600744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.575+0000 7f0e6569f640 1 -- 172.21.15.17:0/4091428277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e60074f70 con 0x7f0e60107900 2024-09-20T18:50:02.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.575+0000 7f0e6569f640 1 --2- 172.21.15.17:0/4091428277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e60107900 0x7f0e60074a30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c031460 tx=0x7f0e5c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:02.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.575+0000 7f0e52ffd640 1 -- 172.21.15.17:0/4091428277 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e5c03f070 con 0x7f0e60107900 2024-09-20T18:50:02.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.575+0000 7f0e68104640 1 -- 172.21.15.17:0/4091428277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e60075200 con 0x7f0e60107900 2024-09-20T18:50:02.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.575+0000 7f0e52ffd640 1 -- 172.21.15.17:0/4091428277 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0e5c004cf0 con 0x7f0e60107900 2024-09-20T18:50:02.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.575+0000 7f0e52ffd640 1 -- 172.21.15.17:0/4091428277 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e5c035030 con 0x7f0e60107900 2024-09-20T18:50:02.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.575+0000 7f0e68104640 1 -- 172.21.15.17:0/4091428277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e601a3cd0 con 0x7f0e60107900 2024-09-20T18:50:02.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.576+0000 7f0e68104640 1 -- 172.21.15.17:0/4091428277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e60103040 con 0x7f0e60107900 2024-09-20T18:50:02.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.577+0000 7f0e52ffd640 1 -- 172.21.15.17:0/4091428277 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0e5c042070 con 0x7f0e60107900 2024-09-20T18:50:02.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.577+0000 7f0e52ffd640 1 --2- 172.21.15.17:0/4091428277 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0e4c07af30 0x7f0e4c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:02.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.578+0000 7f0e52ffd640 1 -- 172.21.15.17:0/4091428277 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f0e5c0bea80 con 0x7f0e60107900 2024-09-20T18:50:02.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.578+0000 7f0e65ea0640 1 --2- 172.21.15.17:0/4091428277 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0e4c07af30 0x7f0e4c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:02.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.578+0000 7f0e65ea0640 1 --2- 172.21.15.17:0/4091428277 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0e4c07af30 0x7f0e4c07d3f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400abe0 tx=0x7f0e5400a2d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:02.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.582+0000 7f0e52ffd640 1 -- 172.21.15.17:0/4091428277 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e5c089fe0 con 0x7f0e60107900 2024-09-20T18:50:02.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.846+0000 7f0e68104640 1 -- 172.21.15.17:0/4091428277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f0e60109e90 con 0x7f0e60107900 2024-09-20T18:50:02.864 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:02 smithi017 ceph-mon[108970]: from='client.34650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:50:02.865 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:02 smithi017 ceph-mon[108970]: from='client.34654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:50:02.865 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:02 smithi017 ceph-mon[108970]: from='client.34658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:50:02.865 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:02 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1323861285' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:50:02.865 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:02 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3017774536' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:50:02.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.847+0000 7f0e52ffd640 1 -- 172.21.15.17:0/4091428277 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f0e5c08ee90 con 0x7f0e60107900 2024-09-20T18:50:02.865 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:50:02.865 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:50:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:50:02.865 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:50:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:50:02.866 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:50:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:50:02.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.849+0000 7f0e68104640 1 -- 172.21.15.17:0/4091428277 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0e4c07af30 msgr2=0x7f0e4c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:02.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.849+0000 7f0e68104640 1 --2- 172.21.15.17:0/4091428277 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0e4c07af30 0x7f0e4c07d3f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400abe0 tx=0x7f0e5400a2d0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.849+0000 7f0e68104640 1 -- 172.21.15.17:0/4091428277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e60107900 msgr2=0x7f0e60074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:02.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.849+0000 7f0e68104640 1 --2- 172.21.15.17:0/4091428277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e60107900 0x7f0e60074a30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c031460 tx=0x7f0e5c0048f0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.849+0000 7f0e68104640 1 -- 172.21.15.17:0/4091428277 shutdown_connections 2024-09-20T18:50:02.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.849+0000 7f0e68104640 1 --2- 172.21.15.17:0/4091428277 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0e4c07af30 0x7f0e4c07d3f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.849+0000 7f0e68104640 1 --2- 172.21.15.17:0/4091428277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e60107900 0x7f0e60074a30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.849+0000 7f0e68104640 1 --2- 172.21.15.17:0/4091428277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e60101900 0x7f0e600744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:02.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.849+0000 7f0e68104640 1 -- 172.21.15.17:0/4091428277 >> 172.21.15.17:0/4091428277 conn(0x7f0e600fd5e0 msgr2=0x7f0e600fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:02.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.849+0000 7f0e68104640 1 -- 172.21.15.17:0/4091428277 shutdown_connections 2024-09-20T18:50:02.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:02.849+0000 7f0e68104640 1 -- 172.21.15.17:0/4091428277 wait complete. 2024-09-20T18:50:02.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:02 smithi172 ceph-mon[80431]: from='client.34650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:50:02.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:02 smithi172 ceph-mon[80431]: from='client.34654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:50:02.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:02 smithi172 ceph-mon[80431]: from='client.34658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:50:02.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:02 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1323861285' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:50:02.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:02 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3017774536' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:50:03.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:03 smithi017 ceph-mon[108970]: pgmap v439: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:03.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:03 smithi017 ceph-mon[108970]: from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:50:03.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:03 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4091428277' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:50:03.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:03 smithi172 ceph-mon[80431]: pgmap v439: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:03.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:03 smithi172 ceph-mon[80431]: from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:50:03.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:03 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4091428277' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:50:05.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:05 smithi017 ceph-mon[108970]: pgmap v440: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:05.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:05 smithi172 ceph-mon[80431]: pgmap v440: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:07.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:07 smithi017 ceph-mon[108970]: pgmap v441: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:07.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:50:07.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:07 smithi172 ceph-mon[80431]: pgmap v441: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:07.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:50:09.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:09 smithi017 ceph-mon[108970]: pgmap v442: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:09.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:09 smithi172 ceph-mon[80431]: pgmap v442: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:11.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:11 smithi017 ceph-mon[108970]: pgmap v443: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:11.938 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:11 smithi172 ceph-mon[80431]: pgmap v443: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:13.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:13 smithi017 ceph-mon[108970]: pgmap v444: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:13.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:13 smithi172 ceph-mon[80431]: pgmap v444: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:15.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:15 smithi017 ceph-mon[108970]: pgmap v445: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:15.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:15 smithi172 ceph-mon[80431]: pgmap v445: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:17.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:17 smithi017 ceph-mon[108970]: pgmap v446: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:17.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:17 smithi172 ceph-mon[80431]: pgmap v446: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:19.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:19 smithi017 ceph-mon[108970]: pgmap v447: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:19.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:19 smithi172 ceph-mon[80431]: pgmap v447: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:21.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:21 smithi017 ceph-mon[108970]: pgmap v448: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:21.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:21 smithi172 ceph-mon[80431]: pgmap v448: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:22.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:50:22.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:50:23.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:23 smithi017 ceph-mon[108970]: pgmap v449: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:23.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:23 smithi172 ceph-mon[80431]: pgmap v449: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:25.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:25 smithi017 ceph-mon[108970]: pgmap v450: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:25.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:25 smithi172 ceph-mon[80431]: pgmap v450: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:27.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:27 smithi017 ceph-mon[108970]: pgmap v451: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:27.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:27 smithi172 ceph-mon[80431]: pgmap v451: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:29.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:29 smithi017 ceph-mon[108970]: pgmap v452: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:29.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:29 smithi172 ceph-mon[80431]: pgmap v452: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:31.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:31 smithi017 ceph-mon[108970]: pgmap v453: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:31.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:31 smithi172 ceph-mon[80431]: pgmap v453: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:32.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.949+0000 7ff93060a640 1 -- 172.21.15.17:0/963583748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff928100ed0 msgr2=0x7ff928101330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:32.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.949+0000 7ff93060a640 1 --2- 172.21.15.17:0/963583748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff928100ed0 0x7ff928101330 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff918009880 tx=0x7ff91802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:50:32.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.949+0000 7ff93060a640 1 -- 172.21.15.17:0/963583748 shutdown_connections 2024-09-20T18:50:32.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.949+0000 7ff93060a640 1 --2- 172.21.15.17:0/963583748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff928100ed0 0x7ff928101330 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:32.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.949+0000 7ff93060a640 1 --2- 172.21.15.17:0/963583748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff928106870 0x7ff928106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:32.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.949+0000 7ff93060a640 1 -- 172.21.15.17:0/963583748 >> 172.21.15.17:0/963583748 conn(0x7ff9280fbc90 msgr2=0x7ff9280fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:32.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.949+0000 7ff93060a640 1 -- 172.21.15.17:0/963583748 shutdown_connections 2024-09-20T18:50:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.949+0000 7ff93060a640 1 -- 172.21.15.17:0/963583748 wait complete. 2024-09-20T18:50:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.950+0000 7ff93060a640 1 Processor -- start 2024-09-20T18:50:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.950+0000 7ff93060a640 1 -- start start 2024-09-20T18:50:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.950+0000 7ff93060a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff928100ed0 0x7ff928198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.950+0000 7ff93060a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff928106870 0x7ff928198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.950+0000 7ff93060a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff92810dd40 con 0x7ff928100ed0 2024-09-20T18:50:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.950+0000 7ff93060a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff92810dbc0 con 0x7ff928106870 2024-09-20T18:50:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.950+0000 7ff92e3a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff928100ed0 0x7ff928198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.950+0000 7ff92e3a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff928100ed0 0x7ff928198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43678/0 (socket says 172.21.15.17:43678) 2024-09-20T18:50:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.951+0000 7ff92e3a6640 1 -- 172.21.15.17:0/1097900496 learned_addr learned my addr 172.21.15.17:0/1097900496 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:50:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.951+0000 7ff92dba5640 1 --2- 172.21.15.17:0/1097900496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff928106870 0x7ff928198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.951+0000 7ff92e3a6640 1 -- 172.21.15.17:0/1097900496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff928106870 msgr2=0x7ff928198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.951+0000 7ff92e3a6640 1 --2- 172.21.15.17:0/1097900496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff928106870 0x7ff928198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.951+0000 7ff92e3a6640 1 -- 172.21.15.17:0/1097900496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9281993c0 con 0x7ff928100ed0 2024-09-20T18:50:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.951+0000 7ff92e3a6640 1 --2- 172.21.15.17:0/1097900496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff928100ed0 0x7ff928198880 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff92400d6f0 tx=0x7ff92400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:32.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.951+0000 7ff91f7fe640 1 -- 172.21.15.17:0/1097900496 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff924017070 con 0x7ff928100ed0 2024-09-20T18:50:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.951+0000 7ff91f7fe640 1 -- 172.21.15.17:0/1097900496 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff92400de00 con 0x7ff928100ed0 2024-09-20T18:50:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.951+0000 7ff93060a640 1 -- 172.21.15.17:0/1097900496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9281996b0 con 0x7ff928100ed0 2024-09-20T18:50:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.951+0000 7ff91f7fe640 1 -- 172.21.15.17:0/1097900496 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff924004bb0 con 0x7ff928100ed0 2024-09-20T18:50:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.951+0000 7ff93060a640 1 -- 172.21.15.17:0/1097900496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9281a1cb0 con 0x7ff928100ed0 2024-09-20T18:50:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.952+0000 7ff93060a640 1 -- 172.21.15.17:0/1097900496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9281020f0 con 0x7ff928100ed0 2024-09-20T18:50:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.953+0000 7ff91f7fe640 1 -- 172.21.15.17:0/1097900496 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff924009a30 con 0x7ff928100ed0 2024-09-20T18:50:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.954+0000 7ff91f7fe640 1 --2- 172.21.15.17:0/1097900496 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff91407af80 0x7ff91407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.954+0000 7ff91f7fe640 1 -- 172.21.15.17:0/1097900496 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7ff92409db70 con 0x7ff928100ed0 2024-09-20T18:50:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.954+0000 7ff92dba5640 1 --2- 172.21.15.17:0/1097900496 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff91407af80 0x7ff91407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:32.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.954+0000 7ff92dba5640 1 --2- 172.21.15.17:0/1097900496 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff91407af80 0x7ff91407d440 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff918031460 tx=0x7ff918009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:32.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:32.958+0000 7ff91f7fe640 1 -- 172.21.15.17:0/1097900496 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff9281996b0 con 0x7ff928100ed0 2024-09-20T18:50:33.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.164+0000 7ff93060a640 1 -- 172.21.15.17:0/1097900496 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff928062630 con 0x7ff91407af80 2024-09-20T18:50:33.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.165+0000 7ff91f7fe640 1 -- 172.21.15.17:0/1097900496 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7ff928062630 con 0x7ff91407af80 2024-09-20T18:50:33.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.168+0000 7ff93060a640 1 -- 172.21.15.17:0/1097900496 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff91407af80 msgr2=0x7ff91407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:33.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.168+0000 7ff93060a640 1 --2- 172.21.15.17:0/1097900496 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff91407af80 0x7ff91407d440 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff918031460 tx=0x7ff918009560 comp rx=0 tx=0).stop 2024-09-20T18:50:33.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.168+0000 7ff93060a640 1 -- 172.21.15.17:0/1097900496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff928100ed0 msgr2=0x7ff928198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:33.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.168+0000 7ff93060a640 1 --2- 172.21.15.17:0/1097900496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff928100ed0 0x7ff928198880 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff92400d6f0 tx=0x7ff92400dbb0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.168+0000 7ff93060a640 1 -- 172.21.15.17:0/1097900496 shutdown_connections 2024-09-20T18:50:33.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.168+0000 7ff93060a640 1 --2- 172.21.15.17:0/1097900496 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff91407af80 0x7ff91407d440 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.168+0000 7ff93060a640 1 --2- 172.21.15.17:0/1097900496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff928106870 0x7ff928198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.168+0000 7ff93060a640 1 --2- 172.21.15.17:0/1097900496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff928100ed0 0x7ff928198880 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.168+0000 7ff93060a640 1 -- 172.21.15.17:0/1097900496 >> 172.21.15.17:0/1097900496 conn(0x7ff9280fbc90 msgr2=0x7ff9280fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:33.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.168+0000 7ff93060a640 1 -- 172.21.15.17:0/1097900496 shutdown_connections 2024-09-20T18:50:33.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.168+0000 7ff93060a640 1 -- 172.21.15.17:0/1097900496 wait complete. 2024-09-20T18:50:33.194 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:50:33.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.254+0000 7f688d471640 1 -- 172.21.15.17:0/2214858192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6888100800 msgr2=0x7f6888100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:33.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.254+0000 7f688d471640 1 --2- 172.21.15.17:0/2214858192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6888100800 0x7f6888100c60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6870009880 tx=0x7f687002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.254+0000 7f688d471640 1 -- 172.21.15.17:0/2214858192 shutdown_connections 2024-09-20T18:50:33.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.254+0000 7f688d471640 1 --2- 172.21.15.17:0/2214858192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6888100800 0x7f6888100c60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.254+0000 7f688d471640 1 --2- 172.21.15.17:0/2214858192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6888106800 0x7f6888106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.254+0000 7f688d471640 1 -- 172.21.15.17:0/2214858192 >> 172.21.15.17:0/2214858192 conn(0x7f68880fc520 msgr2=0x7f68880fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:33.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.254+0000 7f688d471640 1 -- 172.21.15.17:0/2214858192 shutdown_connections 2024-09-20T18:50:33.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.255+0000 7f688d471640 1 -- 172.21.15.17:0/2214858192 wait complete. 2024-09-20T18:50:33.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.255+0000 7f688d471640 1 Processor -- start 2024-09-20T18:50:33.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.255+0000 7f688d471640 1 -- start start 2024-09-20T18:50:33.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.255+0000 7f688d471640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6888100800 0x7f688819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:33.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.255+0000 7f688d471640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6888106800 0x7f688819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:33.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.255+0000 7f688d471640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f688810dcd0 con 0x7f6888106800 2024-09-20T18:50:33.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.255+0000 7f688d471640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f688810db50 con 0x7f6888100800 2024-09-20T18:50:33.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.255+0000 7f687ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6888106800 0x7f688819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:33.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.256+0000 7f687ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6888106800 0x7f688819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43688/0 (socket says 172.21.15.17:43688) 2024-09-20T18:50:33.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.256+0000 7f687ffff640 1 -- 172.21.15.17:0/3110391557 learned_addr learned my addr 172.21.15.17:0/3110391557 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:50:33.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.256+0000 7f6886ffd640 1 --2- 172.21.15.17:0/3110391557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6888100800 0x7f688819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:33.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.256+0000 7f687ffff640 1 -- 172.21.15.17:0/3110391557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6888100800 msgr2=0x7f688819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:33.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.256+0000 7f687ffff640 1 --2- 172.21.15.17:0/3110391557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6888100800 0x7f688819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.256+0000 7f687ffff640 1 -- 172.21.15.17:0/3110391557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68881977f0 con 0x7f6888106800 2024-09-20T18:50:33.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.256+0000 7f6886ffd640 1 --2- 172.21.15.17:0/3110391557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6888100800 0x7f688819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:50:33.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.256+0000 7f687ffff640 1 --2- 172.21.15.17:0/3110391557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6888106800 0x7f688819dbb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6870031460 tx=0x7f68700045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:33.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.256+0000 7f6884ff9640 1 -- 172.21.15.17:0/3110391557 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f687003f070 con 0x7f6888106800 2024-09-20T18:50:33.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.256+0000 7f6884ff9640 1 -- 172.21.15.17:0/3110391557 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f68700035f0 con 0x7f6888106800 2024-09-20T18:50:33.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.256+0000 7f688d471640 1 -- 172.21.15.17:0/3110391557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6888197a80 con 0x7f6888106800 2024-09-20T18:50:33.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.256+0000 7f6884ff9640 1 -- 172.21.15.17:0/3110391557 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6870035030 con 0x7f6888106800 2024-09-20T18:50:33.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.256+0000 7f688d471640 1 -- 172.21.15.17:0/3110391557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6888197fb0 con 0x7f6888106800 2024-09-20T18:50:33.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.257+0000 7f688d471640 1 -- 172.21.15.17:0/3110391557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6888101f40 con 0x7f6888106800 2024-09-20T18:50:33.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.259+0000 7f6884ff9640 1 -- 172.21.15.17:0/3110391557 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6870042070 con 0x7f6888106800 2024-09-20T18:50:33.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.259+0000 7f6884ff9640 1 --2- 172.21.15.17:0/3110391557 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f687407af80 0x7f687407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:33.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.260+0000 7f6884ff9640 1 -- 172.21.15.17:0/3110391557 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f68700be910 con 0x7f6888106800 2024-09-20T18:50:33.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.260+0000 7f6886ffd640 1 --2- 172.21.15.17:0/3110391557 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f687407af80 0x7f687407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:33.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.260+0000 7f6886ffd640 1 --2- 172.21.15.17:0/3110391557 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f687407af80 0x7f687407d440 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f68780058c0 tx=0x7f6878005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.264+0000 7f6884ff9640 1 -- 172.21.15.17:0/3110391557 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6870089f90 con 0x7f6888106800 2024-09-20T18:50:33.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.468+0000 7f688d471640 1 -- 172.21.15.17:0/3110391557 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6888198320 con 0x7f687407af80 2024-09-20T18:50:33.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.469+0000 7f6884ff9640 1 -- 172.21.15.17:0/3110391557 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f6888198320 con 0x7f687407af80 2024-09-20T18:50:33.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.471+0000 7f688d471640 1 -- 172.21.15.17:0/3110391557 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f687407af80 msgr2=0x7f687407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:33.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.471+0000 7f688d471640 1 --2- 172.21.15.17:0/3110391557 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f687407af80 0x7f687407d440 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f68780058c0 tx=0x7f6878005850 comp rx=0 tx=0).stop 2024-09-20T18:50:33.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.471+0000 7f688d471640 1 -- 172.21.15.17:0/3110391557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6888106800 msgr2=0x7f688819dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.471+0000 7f688d471640 1 --2- 172.21.15.17:0/3110391557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6888106800 0x7f688819dbb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6870031460 tx=0x7f68700045e0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.471+0000 7f688d471640 1 -- 172.21.15.17:0/3110391557 shutdown_connections 2024-09-20T18:50:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.471+0000 7f688d471640 1 --2- 172.21.15.17:0/3110391557 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f687407af80 0x7f687407d440 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.471+0000 7f688d471640 1 --2- 172.21.15.17:0/3110391557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6888106800 0x7f688819dbb0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.471+0000 7f688d471640 1 --2- 172.21.15.17:0/3110391557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6888100800 0x7f688819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.471+0000 7f688d471640 1 -- 172.21.15.17:0/3110391557 >> 172.21.15.17:0/3110391557 conn(0x7f68880fc520 msgr2=0x7f688806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.472+0000 7f688d471640 1 -- 172.21.15.17:0/3110391557 shutdown_connections 2024-09-20T18:50:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.472+0000 7f688d471640 1 -- 172.21.15.17:0/3110391557 wait complete. 2024-09-20T18:50:33.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.556+0000 7fc306820640 1 -- 172.21.15.17:0/2094306259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc300107900 msgr2=0x7fc300107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:33.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.556+0000 7fc306820640 1 --2- 172.21.15.17:0/2094306259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc300107900 0x7fc300107ce0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0009880 tx=0x7fc2f002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.556+0000 7fc306820640 1 -- 172.21.15.17:0/2094306259 shutdown_connections 2024-09-20T18:50:33.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.556+0000 7fc306820640 1 --2- 172.21.15.17:0/2094306259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc300101900 0x7fc300101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.556+0000 7fc306820640 1 --2- 172.21.15.17:0/2094306259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc300107900 0x7fc300107ce0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.556+0000 7fc306820640 1 -- 172.21.15.17:0/2094306259 >> 172.21.15.17:0/2094306259 conn(0x7fc3000fd600 msgr2=0x7fc3000ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:33.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.556+0000 7fc306820640 1 -- 172.21.15.17:0/2094306259 shutdown_connections 2024-09-20T18:50:33.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.556+0000 7fc306820640 1 -- 172.21.15.17:0/2094306259 wait complete. 2024-09-20T18:50:33.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.557+0000 7fc306820640 1 Processor -- start 2024-09-20T18:50:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.557+0000 7fc306820640 1 -- start start 2024-09-20T18:50:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.558+0000 7fc306820640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc300101900 0x7fc30019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.558+0000 7fc306820640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc300107900 0x7fc30019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.558+0000 7fc306820640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc30010edd0 con 0x7fc300107900 2024-09-20T18:50:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.558+0000 7fc306820640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc30010ec50 con 0x7fc300101900 2024-09-20T18:50:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.558+0000 7fc2ff7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc300107900 0x7fc30019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.558+0000 7fc2ff7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc300107900 0x7fc30019db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43698/0 (socket says 172.21.15.17:43698) 2024-09-20T18:50:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.558+0000 7fc2ff7fe640 1 -- 172.21.15.17:0/681895748 learned_addr learned my addr 172.21.15.17:0/681895748 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:50:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.558+0000 7fc2fffff640 1 --2- 172.21.15.17:0/681895748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc300101900 0x7fc30019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.558+0000 7fc2ff7fe640 1 -- 172.21.15.17:0/681895748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc300101900 msgr2=0x7fc30019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.558+0000 7fc2ff7fe640 1 --2- 172.21.15.17:0/681895748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc300101900 0x7fc30019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.558+0000 7fc2ff7fe640 1 -- 172.21.15.17:0/681895748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3001977a0 con 0x7fc300107900 2024-09-20T18:50:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.559+0000 7fc2ff7fe640 1 --2- 172.21.15.17:0/681895748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc300107900 0x7fc30019db60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400c8f0 tx=0x7fc2f400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.559+0000 7fc2fd7fa640 1 -- 172.21.15.17:0/681895748 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc2f40079b0 con 0x7fc300107900 2024-09-20T18:50:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.559+0000 7fc2fd7fa640 1 -- 172.21.15.17:0/681895748 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc2f40054e0 con 0x7fc300107900 2024-09-20T18:50:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.559+0000 7fc2fd7fa640 1 -- 172.21.15.17:0/681895748 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc2f4004dd0 con 0x7fc300107900 2024-09-20T18:50:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.559+0000 7fc306820640 1 -- 172.21.15.17:0/681895748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc300197a90 con 0x7fc300107900 2024-09-20T18:50:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.559+0000 7fc306820640 1 -- 172.21.15.17:0/681895748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc300198020 con 0x7fc300107900 2024-09-20T18:50:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.560+0000 7fc306820640 1 -- 172.21.15.17:0/681895748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc300103040 con 0x7fc300107900 2024-09-20T18:50:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.561+0000 7fc2fd7fa640 1 -- 172.21.15.17:0/681895748 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc2f4005020 con 0x7fc300107900 2024-09-20T18:50:33.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.561+0000 7fc2fd7fa640 1 --2- 172.21.15.17:0/681895748 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc2e807af30 0x7fc2e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:33.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.561+0000 7fc2fd7fa640 1 -- 172.21.15.17:0/681895748 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fc2f409de90 con 0x7fc300107900 2024-09-20T18:50:33.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.561+0000 7fc2fffff640 1 --2- 172.21.15.17:0/681895748 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc2e807af30 0x7fc2e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:33.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.562+0000 7fc2fffff640 1 --2- 172.21.15.17:0/681895748 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc2e807af30 0x7fc2e807d3f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0000c00 tx=0x7fc2f0031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:33.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.566+0000 7fc2fd7fa640 1 -- 172.21.15.17:0/681895748 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc2f4014030 con 0x7fc300107900 2024-09-20T18:50:33.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.765+0000 7fc306820640 1 -- 172.21.15.17:0/681895748 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc300198330 con 0x7fc2e807af30 2024-09-20T18:50:33.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.775+0000 7fc2fd7fa640 1 -- 172.21.15.17:0/681895748 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fc300198330 con 0x7fc2e807af30 2024-09-20T18:50:33.792 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:50:33.792 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (11m) 6m ago 22m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:50:33.792 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (15m) 6m ago 23m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:50:33.792 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (14m) 5m ago 22m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:50:33.793 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (10m) 6m ago 23m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:50:33.793 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (10m) 5m ago 22m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:50:33.793 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (11m) 6m ago 22m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:50:33.793 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (6m) 6m ago 17m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:50:33.793 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (6m) 6m ago 17m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:50:33.793 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (17m) 5m ago 17m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:50:33.793 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (5m) 5m ago 17m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:50:33.793 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (14m) 6m ago 24m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:50:33.793 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (13m) 5m ago 22m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:50:33.793 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (10m) 6m ago 24m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:50:33.793 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (10m) 5m ago 22m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:50:33.793 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (12m) 6m ago 23m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:50:33.793 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (12m) 5m ago 22m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:50:33.794 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (9m) 6m ago 20m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:50:33.794 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (9m) 6m ago 20m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:50:33.794 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (8m) 6m ago 19m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:50:33.794 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (7m) 5m ago 19m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:50:33.794 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (7m) 5m ago 19m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:50:33.794 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (6m) 5m ago 18m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:50:33.794 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (12m) 6m ago 22m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:50:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.778+0000 7fc306820640 1 -- 172.21.15.17:0/681895748 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc2e807af30 msgr2=0x7fc2e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.778+0000 7fc306820640 1 --2- 172.21.15.17:0/681895748 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc2e807af30 0x7fc2e807d3f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0000c00 tx=0x7fc2f0031400 comp rx=0 tx=0).stop 2024-09-20T18:50:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.778+0000 7fc306820640 1 -- 172.21.15.17:0/681895748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc300107900 msgr2=0x7fc30019db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.778+0000 7fc306820640 1 --2- 172.21.15.17:0/681895748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc300107900 0x7fc30019db60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400c8f0 tx=0x7fc2f400cdb0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.778+0000 7fc306820640 1 -- 172.21.15.17:0/681895748 shutdown_connections 2024-09-20T18:50:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.778+0000 7fc306820640 1 --2- 172.21.15.17:0/681895748 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc2e807af30 0x7fc2e807d3f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.778+0000 7fc306820640 1 --2- 172.21.15.17:0/681895748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc300107900 0x7fc30019db60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.778+0000 7fc306820640 1 --2- 172.21.15.17:0/681895748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc300101900 0x7fc30019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.778+0000 7fc306820640 1 -- 172.21.15.17:0/681895748 >> 172.21.15.17:0/681895748 conn(0x7fc3000fd600 msgr2=0x7fc3000fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.778+0000 7fc306820640 1 -- 172.21.15.17:0/681895748 shutdown_connections 2024-09-20T18:50:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.778+0000 7fc306820640 1 -- 172.21.15.17:0/681895748 wait complete. 2024-09-20T18:50:33.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.861+0000 7fe35b3a3640 1 -- 172.21.15.17:0/1391509732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe354100650 msgr2=0x7fe354100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:33.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.861+0000 7fe35b3a3640 1 --2- 172.21.15.17:0/1391509732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe354100650 0x7fe354100a30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe350009880 tx=0x7fe35002a490 comp rx=0 tx=0).stop 2024-09-20T18:50:33.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.861+0000 7fe35b3a3640 1 -- 172.21.15.17:0/1391509732 shutdown_connections 2024-09-20T18:50:33.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:33 smithi017 ceph-mon[108970]: pgmap v454: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.861+0000 7fe35b3a3640 1 --2- 172.21.15.17:0/1391509732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe354101000 0x7fe35410dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.861+0000 7fe35b3a3640 1 --2- 172.21.15.17:0/1391509732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe354100650 0x7fe354100a30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.861+0000 7fe35b3a3640 1 -- 172.21.15.17:0/1391509732 >> 172.21.15.17:0/1391509732 conn(0x7fe3540fc520 msgr2=0x7fe3540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.862+0000 7fe35b3a3640 1 -- 172.21.15.17:0/1391509732 shutdown_connections 2024-09-20T18:50:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.862+0000 7fe35b3a3640 1 -- 172.21.15.17:0/1391509732 wait complete. 2024-09-20T18:50:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.862+0000 7fe35b3a3640 1 Processor -- start 2024-09-20T18:50:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.862+0000 7fe35b3a3640 1 -- start start 2024-09-20T18:50:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.863+0000 7fe35b3a3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe354100650 0x7fe35419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.863+0000 7fe35b3a3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe354101000 0x7fe35419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.863+0000 7fe35b3a3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe354110fb0 con 0x7fe354101000 2024-09-20T18:50:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.863+0000 7fe35b3a3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe354110e30 con 0x7fe354100650 2024-09-20T18:50:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.863+0000 7fe35893e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe354101000 0x7fe35419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.863+0000 7fe35893e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe354101000 0x7fe35419fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43716/0 (socket says 172.21.15.17:43716) 2024-09-20T18:50:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.863+0000 7fe35893e640 1 -- 172.21.15.17:0/1187954766 learned_addr learned my addr 172.21.15.17:0/1187954766 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:50:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.863+0000 7fe35913f640 1 --2- 172.21.15.17:0/1187954766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe354100650 0x7fe35419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.863+0000 7fe35893e640 1 -- 172.21.15.17:0/1187954766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe354100650 msgr2=0x7fe35419f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.863+0000 7fe35893e640 1 --2- 172.21.15.17:0/1187954766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe354100650 0x7fe35419f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.863+0000 7fe35893e640 1 -- 172.21.15.17:0/1187954766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe354199a40 con 0x7fe354101000 2024-09-20T18:50:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.863+0000 7fe35893e640 1 --2- 172.21.15.17:0/1187954766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe354101000 0x7fe35419fdc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe34400d6f0 tx=0x7fe34400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.864+0000 7fe34a7fc640 1 -- 172.21.15.17:0/1187954766 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe344017070 con 0x7fe354101000 2024-09-20T18:50:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.864+0000 7fe35b3a3640 1 -- 172.21.15.17:0/1187954766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe354199d30 con 0x7fe354101000 2024-09-20T18:50:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.864+0000 7fe35b3a3640 1 -- 172.21.15.17:0/1187954766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe35419a2c0 con 0x7fe354101000 2024-09-20T18:50:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.864+0000 7fe34a7fc640 1 -- 172.21.15.17:0/1187954766 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe34400de00 con 0x7fe354101000 2024-09-20T18:50:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.864+0000 7fe34a7fc640 1 -- 172.21.15.17:0/1187954766 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe344004bb0 con 0x7fe354101000 2024-09-20T18:50:33.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.865+0000 7fe35b3a3640 1 -- 172.21.15.17:0/1187954766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe338005290 con 0x7fe354101000 2024-09-20T18:50:33.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.865+0000 7fe34a7fc640 1 -- 172.21.15.17:0/1187954766 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe344009a30 con 0x7fe354101000 2024-09-20T18:50:33.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.866+0000 7fe34a7fc640 1 --2- 172.21.15.17:0/1187954766 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe34007af80 0x7fe34007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:33.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.866+0000 7fe34a7fc640 1 -- 172.21.15.17:0/1187954766 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fe34409da00 con 0x7fe354101000 2024-09-20T18:50:33.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.866+0000 7fe35913f640 1 --2- 172.21.15.17:0/1187954766 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe34007af80 0x7fe34007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:33.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.867+0000 7fe35913f640 1 --2- 172.21.15.17:0/1187954766 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe34007af80 0x7fe34007d440 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe350000c00 tx=0x7fe350031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:33.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:33.871+0000 7fe34a7fc640 1 -- 172.21.15.17:0/1187954766 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe344069080 con 0x7fe354101000 2024-09-20T18:50:33.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:33 smithi172 ceph-mon[80431]: pgmap v454: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:34.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.132+0000 7fe35b3a3640 1 -- 172.21.15.17:0/1187954766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe338005d90 con 0x7fe354101000 2024-09-20T18:50:34.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.133+0000 7fe34a7fc640 1 -- 172.21.15.17:0/1187954766 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fe34406df30 con 0x7fe354101000 2024-09-20T18:50:34.150 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:50:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:50:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:50:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:50:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:50:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:50:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:50:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:50:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:50:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:50:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:50:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:50:34.150 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:50:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:50:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:50:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:50:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:50:34.151 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:50:34.154 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:50:34.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.135+0000 7fe35b3a3640 1 -- 172.21.15.17:0/1187954766 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe34007af80 msgr2=0x7fe34007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:34.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.135+0000 7fe35b3a3640 1 --2- 172.21.15.17:0/1187954766 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe34007af80 0x7fe34007d440 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe350000c00 tx=0x7fe350031400 comp rx=0 tx=0).stop 2024-09-20T18:50:34.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.135+0000 7fe35b3a3640 1 -- 172.21.15.17:0/1187954766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe354101000 msgr2=0x7fe35419fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:34.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.135+0000 7fe35b3a3640 1 --2- 172.21.15.17:0/1187954766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe354101000 0x7fe35419fdc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe34400d6f0 tx=0x7fe34400dbb0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.135+0000 7fe35b3a3640 1 -- 172.21.15.17:0/1187954766 shutdown_connections 2024-09-20T18:50:34.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.135+0000 7fe35b3a3640 1 --2- 172.21.15.17:0/1187954766 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe34007af80 0x7fe34007d440 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.135+0000 7fe35b3a3640 1 --2- 172.21.15.17:0/1187954766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe354101000 0x7fe35419fdc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.135+0000 7fe35b3a3640 1 --2- 172.21.15.17:0/1187954766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe354100650 0x7fe35419f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.135+0000 7fe35b3a3640 1 -- 172.21.15.17:0/1187954766 >> 172.21.15.17:0/1187954766 conn(0x7fe3540fc520 msgr2=0x7fe3540fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:34.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.135+0000 7fe35b3a3640 1 -- 172.21.15.17:0/1187954766 shutdown_connections 2024-09-20T18:50:34.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.135+0000 7fe35b3a3640 1 -- 172.21.15.17:0/1187954766 wait complete. 2024-09-20T18:50:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.219+0000 7f3935253640 1 -- 172.21.15.17:0/2858137016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3930106800 msgr2=0x7f3930106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.219+0000 7f3935253640 1 --2- 172.21.15.17:0/2858137016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3930106800 0x7f3930106be0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3920009880 tx=0x7f392002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.219+0000 7f3935253640 1 -- 172.21.15.17:0/2858137016 shutdown_connections 2024-09-20T18:50:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.219+0000 7f3935253640 1 --2- 172.21.15.17:0/2858137016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3930100800 0x7f3930100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.219+0000 7f3935253640 1 --2- 172.21.15.17:0/2858137016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3930106800 0x7f3930106be0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.219+0000 7f3935253640 1 -- 172.21.15.17:0/2858137016 >> 172.21.15.17:0/2858137016 conn(0x7f39300fc520 msgr2=0x7f39300fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.219+0000 7f3935253640 1 -- 172.21.15.17:0/2858137016 shutdown_connections 2024-09-20T18:50:34.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.219+0000 7f3935253640 1 -- 172.21.15.17:0/2858137016 wait complete. 2024-09-20T18:50:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.220+0000 7f3935253640 1 Processor -- start 2024-09-20T18:50:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.220+0000 7f3935253640 1 -- start start 2024-09-20T18:50:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.220+0000 7f3935253640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3930100800 0x7f3930198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.220+0000 7f3935253640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3930106800 0x7f3930198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.220+0000 7f3935253640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f393010dcd0 con 0x7f3930100800 2024-09-20T18:50:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.220+0000 7f3935253640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f393010db50 con 0x7f3930106800 2024-09-20T18:50:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.220+0000 7f392ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3930100800 0x7f3930198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.220+0000 7f392ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3930100800 0x7f3930198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43736/0 (socket says 172.21.15.17:43736) 2024-09-20T18:50:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.220+0000 7f392ed9d640 1 -- 172.21.15.17:0/1685703738 learned_addr learned my addr 172.21.15.17:0/1685703738 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:50:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.220+0000 7f3927fff640 1 --2- 172.21.15.17:0/1685703738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3930106800 0x7f3930198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.220+0000 7f392ed9d640 1 -- 172.21.15.17:0/1685703738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3930106800 msgr2=0x7f3930198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.220+0000 7f392ed9d640 1 --2- 172.21.15.17:0/1685703738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3930106800 0x7f3930198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.220+0000 7f392ed9d640 1 -- 172.21.15.17:0/1685703738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3930199350 con 0x7f3930100800 2024-09-20T18:50:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.221+0000 7f392ed9d640 1 --2- 172.21.15.17:0/1685703738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3930100800 0x7f3930198810 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3920031460 tx=0x7f39200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.221+0000 7f392cd99640 1 -- 172.21.15.17:0/1685703738 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f392003f070 con 0x7f3930100800 2024-09-20T18:50:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.221+0000 7f392cd99640 1 -- 172.21.15.17:0/1685703738 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39200035f0 con 0x7f3930100800 2024-09-20T18:50:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.221+0000 7f3935253640 1 -- 172.21.15.17:0/1685703738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39301995e0 con 0x7f3930100800 2024-09-20T18:50:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.221+0000 7f392cd99640 1 -- 172.21.15.17:0/1685703738 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3920035030 con 0x7f3930100800 2024-09-20T18:50:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.221+0000 7f3935253640 1 -- 172.21.15.17:0/1685703738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39301a1b90 con 0x7f3930100800 2024-09-20T18:50:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.222+0000 7f3935253640 1 -- 172.21.15.17:0/1685703738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3930101f40 con 0x7f3930100800 2024-09-20T18:50:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.223+0000 7f392cd99640 1 -- 172.21.15.17:0/1685703738 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3920042070 con 0x7f3930100800 2024-09-20T18:50:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.223+0000 7f392cd99640 1 --2- 172.21.15.17:0/1685703738 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f391c07af30 0x7f391c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.223+0000 7f392cd99640 1 -- 172.21.15.17:0/1685703738 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f39200be900 con 0x7f3930100800 2024-09-20T18:50:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.223+0000 7f3927fff640 1 --2- 172.21.15.17:0/1685703738 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f391c07af30 0x7f391c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.224+0000 7f3927fff640 1 --2- 172.21.15.17:0/1685703738 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f391c07af30 0x7f391c07d3f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f393006ad00 tx=0x7f391800b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.228+0000 7f392cd99640 1 -- 172.21.15.17:0/1685703738 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3920089f00 con 0x7f3930100800 2024-09-20T18:50:34.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.452+0000 7f3935253640 1 -- 172.21.15.17:0/1685703738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3930108d70 con 0x7f3930100800 2024-09-20T18:50:34.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.452+0000 7f392cd99640 1 -- 172.21.15.17:0/1685703738 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f392008edb0 con 0x7f3930100800 2024-09-20T18:50:34.469 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:50:34.469 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:50:34.469 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:50:34.469 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:50:34.469 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:50:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:50:34.470 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:50:34.470 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:50:34.470 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:50:34.470 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:50:34.470 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:50:34.470 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:50:34.470 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:50:34.470 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:50:34.470 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:50:34.470 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:50:34.470 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:50:34.470 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:50:34.471 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:50:34.471 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:50:34.471 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:50:34.471 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:50:34.471 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:50:34.471 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:50:34.471 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:50:34.471 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:50:34.471 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:50:34.471 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:50:34.471 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:50:34.472 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:50:34.472 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:50:34.472 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:50:34.472 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:50:34.472 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:50:34.472 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:50:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:50:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:50:34.472 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:50:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:50:34.472 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:50:34.472 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:50:34.472 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:50:34.472 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:50:34.473 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:50:34.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.454+0000 7f3935253640 1 -- 172.21.15.17:0/1685703738 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f391c07af30 msgr2=0x7f391c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:34.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.454+0000 7f3935253640 1 --2- 172.21.15.17:0/1685703738 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f391c07af30 0x7f391c07d3f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f393006ad00 tx=0x7f391800b390 comp rx=0 tx=0).stop 2024-09-20T18:50:34.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.454+0000 7f3935253640 1 -- 172.21.15.17:0/1685703738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3930100800 msgr2=0x7f3930198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:34.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.454+0000 7f3935253640 1 --2- 172.21.15.17:0/1685703738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3930100800 0x7f3930198810 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3920031460 tx=0x7f39200045e0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.454+0000 7f3935253640 1 -- 172.21.15.17:0/1685703738 shutdown_connections 2024-09-20T18:50:34.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.454+0000 7f3935253640 1 --2- 172.21.15.17:0/1685703738 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f391c07af30 0x7f391c07d3f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.454+0000 7f3935253640 1 --2- 172.21.15.17:0/1685703738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3930106800 0x7f3930198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.454+0000 7f3935253640 1 --2- 172.21.15.17:0/1685703738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3930100800 0x7f3930198810 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.454+0000 7f3935253640 1 -- 172.21.15.17:0/1685703738 >> 172.21.15.17:0/1685703738 conn(0x7f39300fc520 msgr2=0x7f39300fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:34.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.455+0000 7f3935253640 1 -- 172.21.15.17:0/1685703738 shutdown_connections 2024-09-20T18:50:34.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.455+0000 7f3935253640 1 -- 172.21.15.17:0/1685703738 wait complete. 2024-09-20T18:50:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.555+0000 7fa5569c7640 1 -- 172.21.15.17:0/3711581132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa550106860 msgr2=0x7fa550106c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.555+0000 7fa5569c7640 1 --2- 172.21.15.17:0/3711581132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa550106860 0x7fa550106c40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa540009880 tx=0x7fa54002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.555+0000 7fa5569c7640 1 -- 172.21.15.17:0/3711581132 shutdown_connections 2024-09-20T18:50:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.555+0000 7fa5569c7640 1 --2- 172.21.15.17:0/3711581132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa550100860 0x7fa550100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.555+0000 7fa5569c7640 1 --2- 172.21.15.17:0/3711581132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa550106860 0x7fa550106c40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.555+0000 7fa5569c7640 1 -- 172.21.15.17:0/3711581132 >> 172.21.15.17:0/3711581132 conn(0x7fa5500fc580 msgr2=0x7fa5500fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.555+0000 7fa5569c7640 1 -- 172.21.15.17:0/3711581132 shutdown_connections 2024-09-20T18:50:34.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.555+0000 7fa5569c7640 1 -- 172.21.15.17:0/3711581132 wait complete. 2024-09-20T18:50:34.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.556+0000 7fa5569c7640 1 Processor -- start 2024-09-20T18:50:34.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.556+0000 7fa5569c7640 1 -- start start 2024-09-20T18:50:34.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.556+0000 7fa5569c7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa550100860 0x7fa550198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.556+0000 7fa5569c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa550106860 0x7fa550198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.556+0000 7fa5569c7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa55010dd30 con 0x7fa550106860 2024-09-20T18:50:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.556+0000 7fa5569c7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa55010dbb0 con 0x7fa550100860 2024-09-20T18:50:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.557+0000 7fa54f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa550106860 0x7fa550198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.557+0000 7fa54f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa550106860 0x7fa550198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43760/0 (socket says 172.21.15.17:43760) 2024-09-20T18:50:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.557+0000 7fa54f7fe640 1 -- 172.21.15.17:0/290475575 learned_addr learned my addr 172.21.15.17:0/290475575 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:50:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.557+0000 7fa54ffff640 1 --2- 172.21.15.17:0/290475575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa550100860 0x7fa550198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.557+0000 7fa54f7fe640 1 -- 172.21.15.17:0/290475575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa550100860 msgr2=0x7fa550198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.557+0000 7fa54f7fe640 1 --2- 172.21.15.17:0/290475575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa550100860 0x7fa550198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.557+0000 7fa54f7fe640 1 -- 172.21.15.17:0/290475575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa550199380 con 0x7fa550106860 2024-09-20T18:50:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.557+0000 7fa54f7fe640 1 --2- 172.21.15.17:0/290475575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa550106860 0x7fa550198d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa54400d6f0 tx=0x7fa54400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.557+0000 7fa54d7fa640 1 -- 172.21.15.17:0/290475575 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa544017070 con 0x7fa550106860 2024-09-20T18:50:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.558+0000 7fa54d7fa640 1 -- 172.21.15.17:0/290475575 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa54400de00 con 0x7fa550106860 2024-09-20T18:50:34.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.558+0000 7fa54d7fa640 1 -- 172.21.15.17:0/290475575 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa544004bb0 con 0x7fa550106860 2024-09-20T18:50:34.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.558+0000 7fa5569c7640 1 -- 172.21.15.17:0/290475575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa550199670 con 0x7fa550106860 2024-09-20T18:50:34.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.558+0000 7fa5569c7640 1 -- 172.21.15.17:0/290475575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5501a1c70 con 0x7fa550106860 2024-09-20T18:50:34.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.559+0000 7fa5569c7640 1 -- 172.21.15.17:0/290475575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa550101fa0 con 0x7fa550106860 2024-09-20T18:50:34.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.559+0000 7fa54d7fa640 1 -- 172.21.15.17:0/290475575 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa544009a30 con 0x7fa550106860 2024-09-20T18:50:34.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.560+0000 7fa54d7fa640 1 --2- 172.21.15.17:0/290475575 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa53807af80 0x7fa53807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:34.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.560+0000 7fa54ffff640 1 --2- 172.21.15.17:0/290475575 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa53807af80 0x7fa53807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:34.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.561+0000 7fa54d7fa640 1 -- 172.21.15.17:0/290475575 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fa54409db20 con 0x7fa550106860 2024-09-20T18:50:34.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.561+0000 7fa54ffff640 1 --2- 172.21.15.17:0/290475575 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa53807af80 0x7fa53807d440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa5400096c0 tx=0x7fa540031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:34.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.565+0000 7fa54d7fa640 1 -- 172.21.15.17:0/290475575 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa550199670 con 0x7fa550106860 2024-09-20T18:50:34.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.775+0000 7fa5569c7640 1 -- 172.21.15.17:0/290475575 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa550062630 con 0x7fa53807af80 2024-09-20T18:50:34.792 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:34 smithi017 ceph-mon[108970]: from='client.34678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:50:34.793 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:34 smithi017 ceph-mon[108970]: from='client.34682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:50:34.793 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:34 smithi017 ceph-mon[108970]: from='client.34686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:50:34.793 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:34 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1187954766' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:50:34.793 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:34 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1685703738' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:50:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.777+0000 7fa54d7fa640 1 -- 172.21.15.17:0/290475575 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fa550062630 con 0x7fa53807af80 2024-09-20T18:50:34.793 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:50:34.793 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:50:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:50:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:50:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:50:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:50:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:50:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:50:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:50:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:50:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:50:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:50:34.794 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:50:34.794 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:50:34.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.779+0000 7fa5569c7640 1 -- 172.21.15.17:0/290475575 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa53807af80 msgr2=0x7fa53807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:34.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.779+0000 7fa5569c7640 1 --2- 172.21.15.17:0/290475575 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa53807af80 0x7fa53807d440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa5400096c0 tx=0x7fa540031400 comp rx=0 tx=0).stop 2024-09-20T18:50:34.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.779+0000 7fa5569c7640 1 -- 172.21.15.17:0/290475575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa550106860 msgr2=0x7fa550198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:34.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.779+0000 7fa5569c7640 1 --2- 172.21.15.17:0/290475575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa550106860 0x7fa550198d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa54400d6f0 tx=0x7fa54400dbb0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.779+0000 7fa5569c7640 1 -- 172.21.15.17:0/290475575 shutdown_connections 2024-09-20T18:50:34.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.779+0000 7fa5569c7640 1 --2- 172.21.15.17:0/290475575 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa53807af80 0x7fa53807d440 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.779+0000 7fa5569c7640 1 --2- 172.21.15.17:0/290475575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa550106860 0x7fa550198d80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.779+0000 7fa5569c7640 1 --2- 172.21.15.17:0/290475575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa550100860 0x7fa550198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.779+0000 7fa5569c7640 1 -- 172.21.15.17:0/290475575 >> 172.21.15.17:0/290475575 conn(0x7fa5500fc580 msgr2=0x7fa5500fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:34.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.779+0000 7fa5569c7640 1 -- 172.21.15.17:0/290475575 shutdown_connections 2024-09-20T18:50:34.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.779+0000 7fa5569c7640 1 -- 172.21.15.17:0/290475575 wait complete. 2024-09-20T18:50:34.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.863+0000 7f0f3be9f640 1 -- 172.21.15.17:0/480282522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f34102ab0 msgr2=0x7f0f34102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:34.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.863+0000 7f0f3be9f640 1 --2- 172.21.15.17:0/480282522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f34102ab0 0x7f0f34102e90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009880 tx=0x7f0f3002a530 comp rx=0 tx=0).stop 2024-09-20T18:50:34.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.863+0000 7f0f3be9f640 1 -- 172.21.15.17:0/480282522 shutdown_connections 2024-09-20T18:50:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.863+0000 7f0f3be9f640 1 --2- 172.21.15.17:0/480282522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f341033d0 0x7f0f3410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.863+0000 7f0f3be9f640 1 --2- 172.21.15.17:0/480282522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f34102ab0 0x7f0f34102e90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.863+0000 7f0f3be9f640 1 -- 172.21.15.17:0/480282522 >> 172.21.15.17:0/480282522 conn(0x7f0f340fc550 msgr2=0x7f0f340fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.864+0000 7f0f3be9f640 1 -- 172.21.15.17:0/480282522 shutdown_connections 2024-09-20T18:50:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.864+0000 7f0f3be9f640 1 -- 172.21.15.17:0/480282522 wait complete. 2024-09-20T18:50:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.864+0000 7f0f3be9f640 1 Processor -- start 2024-09-20T18:50:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.864+0000 7f0f3be9f640 1 -- start start 2024-09-20T18:50:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.864+0000 7f0f3be9f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f34102ab0 0x7f0f3419f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.864+0000 7f0f3be9f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f341033d0 0x7f0f3419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.864+0000 7f0f3be9f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3410ee40 con 0x7f0f34102ab0 2024-09-20T18:50:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.864+0000 7f0f3be9f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3410ecc0 con 0x7f0f341033d0 2024-09-20T18:50:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.864+0000 7f0f39c3b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f34102ab0 0x7f0f3419f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.864+0000 7f0f39c3b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f34102ab0 0x7f0f3419f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43788/0 (socket says 172.21.15.17:43788) 2024-09-20T18:50:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.864+0000 7f0f39c3b640 1 -- 172.21.15.17:0/2152694577 learned_addr learned my addr 172.21.15.17:0/2152694577 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:50:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.865+0000 7f0f3943a640 1 --2- 172.21.15.17:0/2152694577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f341033d0 0x7f0f3419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.865+0000 7f0f39c3b640 1 -- 172.21.15.17:0/2152694577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f341033d0 msgr2=0x7f0f3419fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.865+0000 7f0f39c3b640 1 --2- 172.21.15.17:0/2152694577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f341033d0 0x7f0f3419fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.865+0000 7f0f39c3b640 1 -- 172.21.15.17:0/2152694577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f341999f0 con 0x7f0f34102ab0 2024-09-20T18:50:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.865+0000 7f0f3943a640 1 --2- 172.21.15.17:0/2152694577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f341033d0 0x7f0f3419fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:50:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.865+0000 7f0f39c3b640 1 --2- 172.21.15.17:0/2152694577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f34102ab0 0x7f0f3419f830 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0f30031460 tx=0x7f0f300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.865+0000 7f0f2affd640 1 -- 172.21.15.17:0/2152694577 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f3003f070 con 0x7f0f34102ab0 2024-09-20T18:50:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.865+0000 7f0f2affd640 1 -- 172.21.15.17:0/2152694577 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f30004cf0 con 0x7f0f34102ab0 2024-09-20T18:50:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.865+0000 7f0f3be9f640 1 -- 172.21.15.17:0/2152694577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f34199c80 con 0x7f0f34102ab0 2024-09-20T18:50:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.865+0000 7f0f2affd640 1 -- 172.21.15.17:0/2152694577 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f30035030 con 0x7f0f34102ab0 2024-09-20T18:50:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.865+0000 7f0f3be9f640 1 -- 172.21.15.17:0/2152694577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f3419a1b0 con 0x7f0f34102ab0 2024-09-20T18:50:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.866+0000 7f0f3be9f640 1 -- 172.21.15.17:0/2152694577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f3406a580 con 0x7f0f34102ab0 2024-09-20T18:50:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.867+0000 7f0f2affd640 1 -- 172.21.15.17:0/2152694577 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0f30042070 con 0x7f0f34102ab0 2024-09-20T18:50:34.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.867+0000 7f0f2affd640 1 --2- 172.21.15.17:0/2152694577 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0f2007af80 0x7f0f2007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:50:34.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.868+0000 7f0f2affd640 1 -- 172.21.15.17:0/2152694577 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f0f300be9e0 con 0x7f0f34102ab0 2024-09-20T18:50:34.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.868+0000 7f0f3943a640 1 --2- 172.21.15.17:0/2152694577 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0f2007af80 0x7f0f2007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:50:34.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.868+0000 7f0f3943a640 1 --2- 172.21.15.17:0/2152694577 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0f2007af80 0x7f0f2007d440 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0f24006fd0 tx=0x7f0f24008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:50:34.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:34.872+0000 7f0f2affd640 1 -- 172.21.15.17:0/2152694577 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f3008a060 con 0x7f0f34102ab0 2024-09-20T18:50:34.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:34 smithi172 ceph-mon[80431]: from='client.34678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:50:34.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:34 smithi172 ceph-mon[80431]: from='client.34682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:50:34.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:34 smithi172 ceph-mon[80431]: from='client.34686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:50:34.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:34 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1187954766' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:50:34.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:34 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1685703738' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:50:35.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:35.134+0000 7f0f3be9f640 1 -- 172.21.15.17:0/2152694577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f0f3419af20 con 0x7f0f34102ab0 2024-09-20T18:50:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:35.135+0000 7f0f2affd640 1 -- 172.21.15.17:0/2152694577 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f0f3008ef10 con 0x7f0f34102ab0 2024-09-20T18:50:35.152 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:50:35.152 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:50:35.152 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:50:35.152 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:50:35.152 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:50:35.152 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:50:35.152 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:50:35.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:35.137+0000 7f0f3be9f640 1 -- 172.21.15.17:0/2152694577 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0f2007af80 msgr2=0x7f0f2007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:35.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:35.137+0000 7f0f3be9f640 1 --2- 172.21.15.17:0/2152694577 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0f2007af80 0x7f0f2007d440 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0f24006fd0 tx=0x7f0f24008040 comp rx=0 tx=0).stop 2024-09-20T18:50:35.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:35.137+0000 7f0f3be9f640 1 -- 172.21.15.17:0/2152694577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f34102ab0 msgr2=0x7f0f3419f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:50:35.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:35.137+0000 7f0f3be9f640 1 --2- 172.21.15.17:0/2152694577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f34102ab0 0x7f0f3419f830 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0f30031460 tx=0x7f0f300048f0 comp rx=0 tx=0).stop 2024-09-20T18:50:35.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:35.137+0000 7f0f3be9f640 1 -- 172.21.15.17:0/2152694577 shutdown_connections 2024-09-20T18:50:35.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:35.137+0000 7f0f3be9f640 1 --2- 172.21.15.17:0/2152694577 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0f2007af80 0x7f0f2007d440 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:35.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:35.137+0000 7f0f3be9f640 1 --2- 172.21.15.17:0/2152694577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f341033d0 0x7f0f3419fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:35.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:35.137+0000 7f0f3be9f640 1 --2- 172.21.15.17:0/2152694577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f34102ab0 0x7f0f3419f830 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:50:35.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:35.137+0000 7f0f3be9f640 1 -- 172.21.15.17:0/2152694577 >> 172.21.15.17:0/2152694577 conn(0x7f0f340fc550 msgr2=0x7f0f341009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:50:35.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:35.137+0000 7f0f3be9f640 1 -- 172.21.15.17:0/2152694577 shutdown_connections 2024-09-20T18:50:35.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:50:35.137+0000 7f0f3be9f640 1 -- 172.21.15.17:0/2152694577 wait complete. 2024-09-20T18:50:35.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:35 smithi017 ceph-mon[108970]: pgmap v455: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:35.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:35 smithi017 ceph-mon[108970]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:50:35.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:35 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2152694577' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:50:35.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:35 smithi172 ceph-mon[80431]: pgmap v455: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:35.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:35 smithi172 ceph-mon[80431]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:50:35.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:35 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2152694577' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:50:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:37 smithi017 ceph-mon[108970]: pgmap v456: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:37.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:50:37.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:37 smithi172 ceph-mon[80431]: pgmap v456: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:37.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:50:39.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:39 smithi017 ceph-mon[108970]: pgmap v457: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:39.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:39 smithi172 ceph-mon[80431]: pgmap v457: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:41.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:41 smithi017 ceph-mon[108970]: pgmap v458: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:41.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:41 smithi172 ceph-mon[80431]: pgmap v458: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:43.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:43 smithi017 ceph-mon[108970]: pgmap v459: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:43.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:43 smithi172 ceph-mon[80431]: pgmap v459: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:45.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:45 smithi172 ceph-mon[80431]: pgmap v460: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:46.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:45 smithi017 ceph-mon[108970]: pgmap v460: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:47.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:47 smithi172 ceph-mon[80431]: pgmap v461: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:48.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:47 smithi017 ceph-mon[108970]: pgmap v461: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:49.757 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:49 smithi017 ceph-mon[108970]: pgmap v462: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:49.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:49 smithi172 ceph-mon[80431]: pgmap v462: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:51.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:51 smithi172 ceph-mon[80431]: pgmap v463: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:51.967 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:51 smithi017 ceph-mon[108970]: pgmap v463: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:52.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:50:52.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:50:53.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:53 smithi172 ceph-mon[80431]: pgmap v464: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:54.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:53 smithi017 ceph-mon[108970]: pgmap v464: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:55.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:55 smithi017 ceph-mon[108970]: pgmap v465: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:55.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:55 smithi172 ceph-mon[80431]: pgmap v465: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:57.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:57 smithi172 ceph-mon[80431]: pgmap v466: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:58.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:57 smithi017 ceph-mon[108970]: pgmap v466: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:50:59.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:50:59 smithi172 ceph-mon[80431]: pgmap v467: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:00.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:50:59 smithi017 ceph-mon[108970]: pgmap v467: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:01.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:01 smithi017 ceph-mon[108970]: pgmap v468: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:01.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:01 smithi172 ceph-mon[80431]: pgmap v468: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:03.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:03 smithi172 ceph-mon[80431]: pgmap v469: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:04.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:03 smithi017 ceph-mon[108970]: pgmap v469: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:05.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.231+0000 7ff88e408640 1 -- 172.21.15.17:0/3939765400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff888102ac0 msgr2=0x7ff888102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:05.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.231+0000 7ff88e408640 1 --2- 172.21.15.17:0/3939765400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff888102ac0 0x7ff888102ea0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff878009880 tx=0x7ff87802a530 comp rx=0 tx=0).stop 2024-09-20T18:51:05.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.231+0000 7ff88e408640 1 -- 172.21.15.17:0/3939765400 shutdown_connections 2024-09-20T18:51:05.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.231+0000 7ff88e408640 1 --2- 172.21.15.17:0/3939765400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8881033e0 0x7ff88810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.231+0000 7ff88e408640 1 --2- 172.21.15.17:0/3939765400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff888102ac0 0x7ff888102ea0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.231+0000 7ff88e408640 1 -- 172.21.15.17:0/3939765400 >> 172.21.15.17:0/3939765400 conn(0x7ff8880fc520 msgr2=0x7ff8880fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:05.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.231+0000 7ff88e408640 1 -- 172.21.15.17:0/3939765400 shutdown_connections 2024-09-20T18:51:05.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.231+0000 7ff88e408640 1 -- 172.21.15.17:0/3939765400 wait complete. 2024-09-20T18:51:05.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.232+0000 7ff88e408640 1 Processor -- start 2024-09-20T18:51:05.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.232+0000 7ff88e408640 1 -- start start 2024-09-20T18:51:05.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.233+0000 7ff88e408640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff888102ac0 0x7ff888100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:05.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.233+0000 7ff88e408640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8881033e0 0x7ff888100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:05.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.233+0000 7ff88e408640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff88810edf0 con 0x7ff888102ac0 2024-09-20T18:51:05.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.233+0000 7ff88e408640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff88810ec70 con 0x7ff8881033e0 2024-09-20T18:51:05.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.233+0000 7ff887fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff888102ac0 0x7ff888100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:05.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.233+0000 7ff887fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff888102ac0 0x7ff888100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33914/0 (socket says 172.21.15.17:33914) 2024-09-20T18:51:05.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.233+0000 7ff887fff640 1 -- 172.21.15.17:0/896408367 learned_addr learned my addr 172.21.15.17:0/896408367 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:51:05.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.233+0000 7ff8877fe640 1 --2- 172.21.15.17:0/896408367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8881033e0 0x7ff888100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:05.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.233+0000 7ff887fff640 1 -- 172.21.15.17:0/896408367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8881033e0 msgr2=0x7ff888100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:05.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.233+0000 7ff887fff640 1 --2- 172.21.15.17:0/896408367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8881033e0 0x7ff888100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.233+0000 7ff887fff640 1 -- 172.21.15.17:0/896408367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8881011a0 con 0x7ff888102ac0 2024-09-20T18:51:05.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.233+0000 7ff887fff640 1 --2- 172.21.15.17:0/896408367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff888102ac0 0x7ff888100720 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff878031460 tx=0x7ff8780045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:05.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.233+0000 7ff8857fa640 1 -- 172.21.15.17:0/896408367 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff87803f070 con 0x7ff888102ac0 2024-09-20T18:51:05.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.234+0000 7ff8857fa640 1 -- 172.21.15.17:0/896408367 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff8780035f0 con 0x7ff888102ac0 2024-09-20T18:51:05.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.234+0000 7ff88e408640 1 -- 172.21.15.17:0/896408367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff888101430 con 0x7ff888102ac0 2024-09-20T18:51:05.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.234+0000 7ff8857fa640 1 -- 172.21.15.17:0/896408367 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff878035030 con 0x7ff888102ac0 2024-09-20T18:51:05.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.234+0000 7ff88e408640 1 -- 172.21.15.17:0/896408367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8881a3d80 con 0x7ff888102ac0 2024-09-20T18:51:05.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.235+0000 7ff88e408640 1 -- 172.21.15.17:0/896408367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff88806aa90 con 0x7ff888102ac0 2024-09-20T18:51:05.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.235+0000 7ff8857fa640 1 -- 172.21.15.17:0/896408367 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff878042070 con 0x7ff888102ac0 2024-09-20T18:51:05.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.236+0000 7ff8857fa640 1 --2- 172.21.15.17:0/896408367 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff87007af80 0x7ff87007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:05.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.236+0000 7ff8857fa640 1 -- 172.21.15.17:0/896408367 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7ff8780be860 con 0x7ff888102ac0 2024-09-20T18:51:05.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.236+0000 7ff8877fe640 1 --2- 172.21.15.17:0/896408367 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff87007af80 0x7ff87007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:05.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.236+0000 7ff8877fe640 1 --2- 172.21.15.17:0/896408367 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff87007af80 0x7ff87007d440 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff8881021b0 tx=0x7ff87c00b2e0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:05.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.240+0000 7ff8857fa640 1 -- 172.21.15.17:0/896408367 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff878089ee0 con 0x7ff888102ac0 2024-09-20T18:51:05.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.448+0000 7ff88e408640 1 -- 172.21.15.17:0/896408367 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff88810b640 con 0x7ff87007af80 2024-09-20T18:51:05.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.449+0000 7ff8857fa640 1 -- 172.21.15.17:0/896408367 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7ff88810b640 con 0x7ff87007af80 2024-09-20T18:51:05.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.451+0000 7ff88e408640 1 -- 172.21.15.17:0/896408367 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff87007af80 msgr2=0x7ff87007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:05.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.451+0000 7ff88e408640 1 --2- 172.21.15.17:0/896408367 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff87007af80 0x7ff87007d440 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff8881021b0 tx=0x7ff87c00b2e0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.451+0000 7ff88e408640 1 -- 172.21.15.17:0/896408367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff888102ac0 msgr2=0x7ff888100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:05.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.451+0000 7ff88e408640 1 --2- 172.21.15.17:0/896408367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff888102ac0 0x7ff888100720 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff878031460 tx=0x7ff8780045e0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.451+0000 7ff88e408640 1 -- 172.21.15.17:0/896408367 shutdown_connections 2024-09-20T18:51:05.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.451+0000 7ff88e408640 1 --2- 172.21.15.17:0/896408367 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff87007af80 0x7ff87007d440 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.451+0000 7ff88e408640 1 --2- 172.21.15.17:0/896408367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8881033e0 0x7ff888100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.451+0000 7ff88e408640 1 --2- 172.21.15.17:0/896408367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff888102ac0 0x7ff888100720 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.451+0000 7ff88e408640 1 -- 172.21.15.17:0/896408367 >> 172.21.15.17:0/896408367 conn(0x7ff8880fc520 msgr2=0x7ff88810af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:05.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.451+0000 7ff88e408640 1 -- 172.21.15.17:0/896408367 shutdown_connections 2024-09-20T18:51:05.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.451+0000 7ff88e408640 1 -- 172.21.15.17:0/896408367 wait complete. 2024-09-20T18:51:05.477 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:51:05.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.538+0000 7f7f1a69d640 1 -- 172.21.15.17:0/2312475489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f14107900 msgr2=0x7f7f14107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:05.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.538+0000 7f7f1a69d640 1 --2- 172.21.15.17:0/2312475489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f14107900 0x7f7f14107ce0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009880 tx=0x7f7f0402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.538+0000 7f7f1a69d640 1 -- 172.21.15.17:0/2312475489 shutdown_connections 2024-09-20T18:51:05.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.538+0000 7f7f1a69d640 1 --2- 172.21.15.17:0/2312475489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f14101900 0x7f7f14101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.538+0000 7f7f1a69d640 1 --2- 172.21.15.17:0/2312475489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f14107900 0x7f7f14107ce0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.538+0000 7f7f1a69d640 1 -- 172.21.15.17:0/2312475489 >> 172.21.15.17:0/2312475489 conn(0x7f7f140fd600 msgr2=0x7f7f140ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:05.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.538+0000 7f7f1a69d640 1 -- 172.21.15.17:0/2312475489 shutdown_connections 2024-09-20T18:51:05.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.538+0000 7f7f1a69d640 1 -- 172.21.15.17:0/2312475489 wait complete. 2024-09-20T18:51:05.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.539+0000 7f7f1a69d640 1 Processor -- start 2024-09-20T18:51:05.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.539+0000 7f7f1a69d640 1 -- start start 2024-09-20T18:51:05.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.539+0000 7f7f1a69d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f14101900 0x7f7f1419f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:05.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.539+0000 7f7f1a69d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f14107900 0x7f7f1419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:05.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.539+0000 7f7f1a69d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1410edd0 con 0x7f7f14107900 2024-09-20T18:51:05.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.539+0000 7f7f1a69d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1410ec50 con 0x7f7f14101900 2024-09-20T18:51:05.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.539+0000 7f7f137fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f14107900 0x7f7f1419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:05.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.539+0000 7f7f137fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f14107900 0x7f7f1419fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33924/0 (socket says 172.21.15.17:33924) 2024-09-20T18:51:05.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.539+0000 7f7f137fe640 1 -- 172.21.15.17:0/3532019537 learned_addr learned my addr 172.21.15.17:0/3532019537 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:51:05.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.539+0000 7f7f13fff640 1 --2- 172.21.15.17:0/3532019537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f14101900 0x7f7f1419f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:05.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.540+0000 7f7f137fe640 1 -- 172.21.15.17:0/3532019537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f14101900 msgr2=0x7f7f1419f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:05.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.540+0000 7f7f137fe640 1 --2- 172.21.15.17:0/3532019537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f14101900 0x7f7f1419f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.540+0000 7f7f137fe640 1 -- 172.21.15.17:0/3532019537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f14199a10 con 0x7f7f14107900 2024-09-20T18:51:05.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.540+0000 7f7f13fff640 1 --2- 172.21.15.17:0/3532019537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f14101900 0x7f7f1419f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:51:05.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.540+0000 7f7f137fe640 1 --2- 172.21.15.17:0/3532019537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f14107900 0x7f7f1419fd90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800d6f0 tx=0x7f7f0800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:05.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.540+0000 7f7f117fa640 1 -- 172.21.15.17:0/3532019537 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f08017070 con 0x7f7f14107900 2024-09-20T18:51:05.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.540+0000 7f7f1a69d640 1 -- 172.21.15.17:0/3532019537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f14199d00 con 0x7f7f14107900 2024-09-20T18:51:05.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.540+0000 7f7f117fa640 1 -- 172.21.15.17:0/3532019537 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7f0800de00 con 0x7f7f14107900 2024-09-20T18:51:05.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.540+0000 7f7f117fa640 1 -- 172.21.15.17:0/3532019537 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f08004bb0 con 0x7f7f14107900 2024-09-20T18:51:05.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.540+0000 7f7f1a69d640 1 -- 172.21.15.17:0/3532019537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f1419a290 con 0x7f7f14107900 2024-09-20T18:51:05.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.541+0000 7f7f1a69d640 1 -- 172.21.15.17:0/3532019537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f14103040 con 0x7f7f14107900 2024-09-20T18:51:05.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.542+0000 7f7f117fa640 1 -- 172.21.15.17:0/3532019537 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7f08004e60 con 0x7f7f14107900 2024-09-20T18:51:05.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.542+0000 7f7f117fa640 1 --2- 172.21.15.17:0/3532019537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7efc07af30 0x7f7efc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:05.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.543+0000 7f7f117fa640 1 -- 172.21.15.17:0/3532019537 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f7f0809dc50 con 0x7f7f14107900 2024-09-20T18:51:05.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.543+0000 7f7f13fff640 1 --2- 172.21.15.17:0/3532019537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7efc07af30 0x7f7efc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:05.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.543+0000 7f7f13fff640 1 --2- 172.21.15.17:0/3532019537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7efc07af30 0x7f7efc07d3f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7f04000c00 tx=0x7f7f04031420 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:05.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.548+0000 7f7f117fa640 1 -- 172.21.15.17:0/3532019537 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7f08069250 con 0x7f7f14107900 2024-09-20T18:51:05.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.755+0000 7f7f1a69d640 1 -- 172.21.15.17:0/3532019537 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7f1419a540 con 0x7f7efc07af30 2024-09-20T18:51:05.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.756+0000 7f7f117fa640 1 -- 172.21.15.17:0/3532019537 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f7f1419a540 con 0x7f7efc07af30 2024-09-20T18:51:05.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.758+0000 7f7f1a69d640 1 -- 172.21.15.17:0/3532019537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7efc07af30 msgr2=0x7f7efc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:05.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.758+0000 7f7f1a69d640 1 --2- 172.21.15.17:0/3532019537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7efc07af30 0x7f7efc07d3f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7f04000c00 tx=0x7f7f04031420 comp rx=0 tx=0).stop 2024-09-20T18:51:05.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.759+0000 7f7f1a69d640 1 -- 172.21.15.17:0/3532019537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f14107900 msgr2=0x7f7f1419fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:05.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.759+0000 7f7f1a69d640 1 --2- 172.21.15.17:0/3532019537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f14107900 0x7f7f1419fd90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800d6f0 tx=0x7f7f0800dbb0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.759+0000 7f7f1a69d640 1 -- 172.21.15.17:0/3532019537 shutdown_connections 2024-09-20T18:51:05.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.759+0000 7f7f1a69d640 1 --2- 172.21.15.17:0/3532019537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7efc07af30 0x7f7efc07d3f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.759+0000 7f7f1a69d640 1 --2- 172.21.15.17:0/3532019537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f14107900 0x7f7f1419fd90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.759+0000 7f7f1a69d640 1 --2- 172.21.15.17:0/3532019537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f14101900 0x7f7f1419f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.759+0000 7f7f1a69d640 1 -- 172.21.15.17:0/3532019537 >> 172.21.15.17:0/3532019537 conn(0x7f7f140fd600 msgr2=0x7f7f14074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:05.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.759+0000 7f7f1a69d640 1 -- 172.21.15.17:0/3532019537 shutdown_connections 2024-09-20T18:51:05.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.759+0000 7f7f1a69d640 1 -- 172.21.15.17:0/3532019537 wait complete. 2024-09-20T18:51:05.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.843+0000 7f39e53a2640 1 -- 172.21.15.17:0/2686531908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e0102990 msgr2=0x7f39e0102d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.843+0000 7f39e53a2640 1 --2- 172.21.15.17:0/2686531908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e0102990 0x7f39e0102d70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009880 tx=0x7f39d002a530 comp rx=0 tx=0).stop 2024-09-20T18:51:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.844+0000 7f39e53a2640 1 -- 172.21.15.17:0/2686531908 shutdown_connections 2024-09-20T18:51:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.844+0000 7f39e53a2640 1 --2- 172.21.15.17:0/2686531908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39e01032b0 0x7f39e010b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.844+0000 7f39e53a2640 1 --2- 172.21.15.17:0/2686531908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e0102990 0x7f39e0102d70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.844+0000 7f39e53a2640 1 -- 172.21.15.17:0/2686531908 >> 172.21.15.17:0/2686531908 conn(0x7f39e00fc310 msgr2=0x7f39e00fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:05.861 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:05 smithi017 ceph-mon[108970]: pgmap v470: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.844+0000 7f39e53a2640 1 -- 172.21.15.17:0/2686531908 shutdown_connections 2024-09-20T18:51:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.844+0000 7f39e53a2640 1 -- 172.21.15.17:0/2686531908 wait complete. 2024-09-20T18:51:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.844+0000 7f39e53a2640 1 Processor -- start 2024-09-20T18:51:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.845+0000 7f39e53a2640 1 -- start start 2024-09-20T18:51:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.845+0000 7f39e53a2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e0102990 0x7f39e019d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.845+0000 7f39e53a2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39e01032b0 0x7f39e019d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.845+0000 7f39e53a2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f39e010ebe0 con 0x7f39e0102990 2024-09-20T18:51:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.845+0000 7f39e53a2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f39e010ea60 con 0x7f39e01032b0 2024-09-20T18:51:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.845+0000 7f39dffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e0102990 0x7f39e019d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.845+0000 7f39dffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e0102990 0x7f39e019d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33932/0 (socket says 172.21.15.17:33932) 2024-09-20T18:51:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.845+0000 7f39dffff640 1 -- 172.21.15.17:0/3478749189 learned_addr learned my addr 172.21.15.17:0/3478749189 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:51:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.845+0000 7f39df7fe640 1 --2- 172.21.15.17:0/3478749189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39e01032b0 0x7f39e019d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.845+0000 7f39dffff640 1 -- 172.21.15.17:0/3478749189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39e01032b0 msgr2=0x7f39e019d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.845+0000 7f39dffff640 1 --2- 172.21.15.17:0/3478749189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39e01032b0 0x7f39e019d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.845+0000 7f39dffff640 1 -- 172.21.15.17:0/3478749189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e01975d0 con 0x7f39e0102990 2024-09-20T18:51:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.846+0000 7f39dffff640 1 --2- 172.21.15.17:0/3478749189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e0102990 0x7f39e019d410 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f39d0004f90 tx=0x7f39d00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.846+0000 7f39dd7fa640 1 -- 172.21.15.17:0/3478749189 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39d003f070 con 0x7f39e0102990 2024-09-20T18:51:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.846+0000 7f39e53a2640 1 -- 172.21.15.17:0/3478749189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e0197860 con 0x7f39e0102990 2024-09-20T18:51:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.846+0000 7f39dd7fa640 1 -- 172.21.15.17:0/3478749189 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39d0004c70 con 0x7f39e0102990 2024-09-20T18:51:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.846+0000 7f39dd7fa640 1 -- 172.21.15.17:0/3478749189 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39d0035030 con 0x7f39e0102990 2024-09-20T18:51:05.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.846+0000 7f39e53a2640 1 -- 172.21.15.17:0/3478749189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e0197d90 con 0x7f39e0102990 2024-09-20T18:51:05.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.847+0000 7f39e53a2640 1 -- 172.21.15.17:0/3478749189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e006a4c0 con 0x7f39e0102990 2024-09-20T18:51:05.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.848+0000 7f39dd7fa640 1 -- 172.21.15.17:0/3478749189 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f39d0042070 con 0x7f39e0102990 2024-09-20T18:51:05.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.848+0000 7f39dd7fa640 1 --2- 172.21.15.17:0/3478749189 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f39c807af30 0x7f39c807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:05.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.848+0000 7f39dd7fa640 1 -- 172.21.15.17:0/3478749189 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f39d00bea30 con 0x7f39e0102990 2024-09-20T18:51:05.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.848+0000 7f39df7fe640 1 --2- 172.21.15.17:0/3478749189 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f39c807af30 0x7f39c807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:05.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.849+0000 7f39df7fe640 1 --2- 172.21.15.17:0/3478749189 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f39c807af30 0x7f39c807d3f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f39e01087d0 tx=0x7f39d400b590 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:05.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:05.853+0000 7f39dd7fa640 1 -- 172.21.15.17:0/3478749189 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f39d008a030 con 0x7f39e0102990 2024-09-20T18:51:05.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:05 smithi172 ceph-mon[80431]: pgmap v470: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:06.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.050+0000 7f39e53a2640 1 -- 172.21.15.17:0/3478749189 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f39e0198100 con 0x7f39c807af30 2024-09-20T18:51:06.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.059+0000 7f39dd7fa640 1 -- 172.21.15.17:0/3478749189 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f39e0198100 con 0x7f39c807af30 2024-09-20T18:51:06.076 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:51:06.077 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (12m) 6m ago 23m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:51:06.077 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (15m) 6m ago 23m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:51:06.077 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (15m) 6m ago 22m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:51:06.077 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (10m) 6m ago 23m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:51:06.077 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (10m) 6m ago 22m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:51:06.077 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (12m) 6m ago 23m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:51:06.077 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (7m) 6m ago 18m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:51:06.077 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (6m) 6m ago 18m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:51:06.077 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (18m) 6m ago 18m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:51:06.077 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (6m) 6m ago 18m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:51:06.077 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (14m) 6m ago 24m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:51:06.077 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (13m) 6m ago 22m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:51:06.077 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (11m) 6m ago 24m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:51:06.077 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (10m) 6m ago 22m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:51:06.078 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (13m) 6m ago 23m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:51:06.078 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (13m) 6m ago 22m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:51:06.078 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (10m) 6m ago 21m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:51:06.078 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (9m) 6m ago 20m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:51:06.078 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (9m) 6m ago 20m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:51:06.078 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (8m) 6m ago 20m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:51:06.078 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (7m) 6m ago 19m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:51:06.078 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (7m) 6m ago 19m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:51:06.078 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (12m) 6m ago 23m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:51:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.062+0000 7f39e53a2640 1 -- 172.21.15.17:0/3478749189 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f39c807af30 msgr2=0x7f39c807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.062+0000 7f39e53a2640 1 --2- 172.21.15.17:0/3478749189 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f39c807af30 0x7f39c807d3f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f39e01087d0 tx=0x7f39d400b590 comp rx=0 tx=0).stop 2024-09-20T18:51:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.062+0000 7f39e53a2640 1 -- 172.21.15.17:0/3478749189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e0102990 msgr2=0x7f39e019d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.062+0000 7f39e53a2640 1 --2- 172.21.15.17:0/3478749189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e0102990 0x7f39e019d410 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f39d0004f90 tx=0x7f39d00048f0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.062+0000 7f39e53a2640 1 -- 172.21.15.17:0/3478749189 shutdown_connections 2024-09-20T18:51:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.062+0000 7f39e53a2640 1 --2- 172.21.15.17:0/3478749189 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f39c807af30 0x7f39c807d3f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.062+0000 7f39e53a2640 1 --2- 172.21.15.17:0/3478749189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39e01032b0 0x7f39e019d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.062+0000 7f39e53a2640 1 --2- 172.21.15.17:0/3478749189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e0102990 0x7f39e019d410 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.062+0000 7f39e53a2640 1 -- 172.21.15.17:0/3478749189 >> 172.21.15.17:0/3478749189 conn(0x7f39e00fc310 msgr2=0x7f39e0103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:06.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.062+0000 7f39e53a2640 1 -- 172.21.15.17:0/3478749189 shutdown_connections 2024-09-20T18:51:06.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.062+0000 7f39e53a2640 1 -- 172.21.15.17:0/3478749189 wait complete. 2024-09-20T18:51:06.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.147+0000 7f8bf5a0e640 1 -- 172.21.15.17:0/2148629616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0102b20 msgr2=0x7f8bf0102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:06.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.147+0000 7f8bf5a0e640 1 --2- 172.21.15.17:0/2148629616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0102b20 0x7f8bf0102f00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009c50 tx=0x7f8be002aa30 comp rx=0 tx=0).stop 2024-09-20T18:51:06.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.147+0000 7f8bf5a0e640 1 -- 172.21.15.17:0/2148629616 shutdown_connections 2024-09-20T18:51:06.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.147+0000 7f8bf5a0e640 1 --2- 172.21.15.17:0/2148629616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bf0103440 0x7f8bf010b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.147+0000 7f8bf5a0e640 1 --2- 172.21.15.17:0/2148629616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0102b20 0x7f8bf0102f00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.147+0000 7f8bf5a0e640 1 -- 172.21.15.17:0/2148629616 >> 172.21.15.17:0/2148629616 conn(0x7f8bf00fc520 msgr2=0x7f8bf00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:06.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.147+0000 7f8bf5a0e640 1 -- 172.21.15.17:0/2148629616 shutdown_connections 2024-09-20T18:51:06.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.147+0000 7f8bf5a0e640 1 -- 172.21.15.17:0/2148629616 wait complete. 2024-09-20T18:51:06.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.148+0000 7f8bf5a0e640 1 Processor -- start 2024-09-20T18:51:06.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.148+0000 7f8bf5a0e640 1 -- start start 2024-09-20T18:51:06.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.148+0000 7f8bf5a0e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bf0102b20 0x7f8bf019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:06.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.148+0000 7f8bf5a0e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0103440 0x7f8bf019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:06.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.148+0000 7f8bf5a0e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf010edf0 con 0x7f8bf0103440 2024-09-20T18:51:06.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.148+0000 7f8bf5a0e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf010ec70 con 0x7f8bf0102b20 2024-09-20T18:51:06.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.148+0000 7f8bee7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0103440 0x7f8bf019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:06.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.148+0000 7f8bee7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0103440 0x7f8bf019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33944/0 (socket says 172.21.15.17:33944) 2024-09-20T18:51:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.148+0000 7f8bee7fc640 1 -- 172.21.15.17:0/1444731465 learned_addr learned my addr 172.21.15.17:0/1444731465 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:51:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.148+0000 7f8beeffd640 1 --2- 172.21.15.17:0/1444731465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bf0102b20 0x7f8bf019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.148+0000 7f8bee7fc640 1 -- 172.21.15.17:0/1444731465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bf0102b20 msgr2=0x7f8bf019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.148+0000 7f8bee7fc640 1 --2- 172.21.15.17:0/1444731465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bf0102b20 0x7f8bf019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.148+0000 7f8bee7fc640 1 -- 172.21.15.17:0/1444731465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf0197820 con 0x7f8bf0103440 2024-09-20T18:51:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.149+0000 7f8bee7fc640 1 --2- 172.21.15.17:0/1444731465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0103440 0x7f8bf019dbe0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8be400e970 tx=0x7f8be400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.149+0000 7f8bf4a0c640 1 -- 172.21.15.17:0/1444731465 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8be400cac0 con 0x7f8bf0103440 2024-09-20T18:51:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.149+0000 7f8bf4a0c640 1 -- 172.21.15.17:0/1444731465 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8be40054e0 con 0x7f8bf0103440 2024-09-20T18:51:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.149+0000 7f8bf5a0e640 1 -- 172.21.15.17:0/1444731465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf0197b10 con 0x7f8bf0103440 2024-09-20T18:51:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.149+0000 7f8bf4a0c640 1 -- 172.21.15.17:0/1444731465 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8be4010430 con 0x7f8bf0103440 2024-09-20T18:51:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.149+0000 7f8bf5a0e640 1 -- 172.21.15.17:0/1444731465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf01980a0 con 0x7f8bf0103440 2024-09-20T18:51:06.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.150+0000 7f8bf5a0e640 1 -- 172.21.15.17:0/1444731465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf006aa30 con 0x7f8bf0103440 2024-09-20T18:51:06.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.151+0000 7f8bf4a0c640 1 -- 172.21.15.17:0/1444731465 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8be4004ea0 con 0x7f8bf0103440 2024-09-20T18:51:06.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.151+0000 7f8bf4a0c640 1 --2- 172.21.15.17:0/1444731465 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8bd807af30 0x7f8bd807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:06.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.151+0000 7f8bf4a0c640 1 -- 172.21.15.17:0/1444731465 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f8be409e670 con 0x7f8bf0103440 2024-09-20T18:51:06.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.151+0000 7f8beeffd640 1 --2- 172.21.15.17:0/1444731465 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8bd807af30 0x7f8bd807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:06.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.152+0000 7f8beeffd640 1 --2- 172.21.15.17:0/1444731465 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8bd807af30 0x7f8bd807d3f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009430 tx=0x7f8be003a040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:06.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.156+0000 7f8bf4a0c640 1 -- 172.21.15.17:0/1444731465 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8be4069c70 con 0x7f8bf0103440 2024-09-20T18:51:06.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.420+0000 7f8bf5a0e640 1 -- 172.21.15.17:0/1444731465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8bf0105ff0 con 0x7f8bf0103440 2024-09-20T18:51:06.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.421+0000 7f8bf4a0c640 1 -- 172.21.15.17:0/1444731465 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f8be406eb20 con 0x7f8bf0103440 2024-09-20T18:51:06.438 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:51:06.438 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:51:06.438 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:51:06.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:51:06.439 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:51:06.439 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:51:06.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:51:06.439 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:51:06.439 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:51:06.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:51:06.439 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:51:06.439 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:51:06.439 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:51:06.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:51:06.439 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:51:06.439 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:51:06.440 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:51:06.440 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:51:06.440 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:51:06.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.423+0000 7f8bf5a0e640 1 -- 172.21.15.17:0/1444731465 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8bd807af30 msgr2=0x7f8bd807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:06.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.423+0000 7f8bf5a0e640 1 --2- 172.21.15.17:0/1444731465 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8bd807af30 0x7f8bd807d3f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009430 tx=0x7f8be003a040 comp rx=0 tx=0).stop 2024-09-20T18:51:06.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.423+0000 7f8bf5a0e640 1 -- 172.21.15.17:0/1444731465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0103440 msgr2=0x7f8bf019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:06.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.423+0000 7f8bf5a0e640 1 --2- 172.21.15.17:0/1444731465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0103440 0x7f8bf019dbe0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8be400e970 tx=0x7f8be400ed70 comp rx=0 tx=0).stop 2024-09-20T18:51:06.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.423+0000 7f8bf5a0e640 1 -- 172.21.15.17:0/1444731465 shutdown_connections 2024-09-20T18:51:06.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.423+0000 7f8bf5a0e640 1 --2- 172.21.15.17:0/1444731465 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8bd807af30 0x7f8bd807d3f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.423+0000 7f8bf5a0e640 1 --2- 172.21.15.17:0/1444731465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf0103440 0x7f8bf019dbe0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.423+0000 7f8bf5a0e640 1 --2- 172.21.15.17:0/1444731465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bf0102b20 0x7f8bf019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.423+0000 7f8bf5a0e640 1 -- 172.21.15.17:0/1444731465 >> 172.21.15.17:0/1444731465 conn(0x7f8bf00fc520 msgr2=0x7f8bf0103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:06.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.424+0000 7f8bf5a0e640 1 -- 172.21.15.17:0/1444731465 shutdown_connections 2024-09-20T18:51:06.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.424+0000 7f8bf5a0e640 1 -- 172.21.15.17:0/1444731465 wait complete. 2024-09-20T18:51:06.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.509+0000 7f7989aa3640 1 -- 172.21.15.17:0/1042227022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7984100800 msgr2=0x7f7984100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:06.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.509+0000 7f7989aa3640 1 --2- 172.21.15.17:0/1042227022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7984100800 0x7f7984100c60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7978009880 tx=0x7f797802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.509+0000 7f7989aa3640 1 -- 172.21.15.17:0/1042227022 shutdown_connections 2024-09-20T18:51:06.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.509+0000 7f7989aa3640 1 --2- 172.21.15.17:0/1042227022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7984100800 0x7f7984100c60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.509+0000 7f7989aa3640 1 --2- 172.21.15.17:0/1042227022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7984106800 0x7f7984106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.509+0000 7f7989aa3640 1 -- 172.21.15.17:0/1042227022 >> 172.21.15.17:0/1042227022 conn(0x7f79840fc520 msgr2=0x7f79840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:06.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.509+0000 7f7989aa3640 1 -- 172.21.15.17:0/1042227022 shutdown_connections 2024-09-20T18:51:06.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.509+0000 7f7989aa3640 1 -- 172.21.15.17:0/1042227022 wait complete. 2024-09-20T18:51:06.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.510+0000 7f7989aa3640 1 Processor -- start 2024-09-20T18:51:06.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.510+0000 7f7989aa3640 1 -- start start 2024-09-20T18:51:06.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.510+0000 7f7989aa3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7984100800 0x7f79841987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:06.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.510+0000 7f7989aa3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7984106800 0x7f7984198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:06.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.510+0000 7f7989aa3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f798410dcd0 con 0x7f7984106800 2024-09-20T18:51:06.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.510+0000 7f7989aa3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f798410db50 con 0x7f7984100800 2024-09-20T18:51:06.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.510+0000 7f7982ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7984106800 0x7f7984198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:06.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.510+0000 7f7982ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7984106800 0x7f7984198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33968/0 (socket says 172.21.15.17:33968) 2024-09-20T18:51:06.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.511+0000 7f7982ffd640 1 -- 172.21.15.17:0/2582621306 learned_addr learned my addr 172.21.15.17:0/2582621306 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:51:06.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.511+0000 7f79837fe640 1 --2- 172.21.15.17:0/2582621306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7984100800 0x7f79841987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:06.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.511+0000 7f7982ffd640 1 -- 172.21.15.17:0/2582621306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7984100800 msgr2=0x7f79841987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:06.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.511+0000 7f7982ffd640 1 --2- 172.21.15.17:0/2582621306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7984100800 0x7f79841987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.511+0000 7f7982ffd640 1 -- 172.21.15.17:0/2582621306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7984199370 con 0x7f7984106800 2024-09-20T18:51:06.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.511+0000 7f7982ffd640 1 --2- 172.21.15.17:0/2582621306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7984106800 0x7f7984198d20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7978031460 tx=0x7f79780045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:06.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.511+0000 7f7980ff9640 1 -- 172.21.15.17:0/2582621306 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f797803f070 con 0x7f7984106800 2024-09-20T18:51:06.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.511+0000 7f7989aa3640 1 -- 172.21.15.17:0/2582621306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7984199600 con 0x7f7984106800 2024-09-20T18:51:06.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.511+0000 7f7980ff9640 1 -- 172.21.15.17:0/2582621306 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f79780035f0 con 0x7f7984106800 2024-09-20T18:51:06.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.511+0000 7f7980ff9640 1 -- 172.21.15.17:0/2582621306 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7978035030 con 0x7f7984106800 2024-09-20T18:51:06.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.511+0000 7f7989aa3640 1 -- 172.21.15.17:0/2582621306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79841a1bb0 con 0x7f7984106800 2024-09-20T18:51:06.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.512+0000 7f7989aa3640 1 -- 172.21.15.17:0/2582621306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7984101f40 con 0x7f7984106800 2024-09-20T18:51:06.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.513+0000 7f7980ff9640 1 -- 172.21.15.17:0/2582621306 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7978042070 con 0x7f7984106800 2024-09-20T18:51:06.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.514+0000 7f7980ff9640 1 --2- 172.21.15.17:0/2582621306 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f796c07af30 0x7f796c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:06.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.514+0000 7f79837fe640 1 --2- 172.21.15.17:0/2582621306 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f796c07af30 0x7f796c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:06.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.514+0000 7f7980ff9640 1 -- 172.21.15.17:0/2582621306 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f79780bea20 con 0x7f7984106800 2024-09-20T18:51:06.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.514+0000 7f79837fe640 1 --2- 172.21.15.17:0/2582621306 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f796c07af30 0x7f796c07d3f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7974005fd0 tx=0x7f7974005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:06.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.518+0000 7f7980ff9640 1 -- 172.21.15.17:0/2582621306 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f797808a020 con 0x7f7984106800 2024-09-20T18:51:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.745+0000 7f7989aa3640 1 -- 172.21.15.17:0/2582621306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f798406a7e0 con 0x7f7984106800 2024-09-20T18:51:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.745+0000 7f7980ff9640 1 -- 172.21.15.17:0/2582621306 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f797808c020 con 0x7f7984106800 2024-09-20T18:51:06.763 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:51:06.763 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:51:06.763 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:51:06.763 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:51:06.763 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:51:06.763 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:51:06.763 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:51:06.763 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:51:06.763 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:51:06.763 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:51:06.763 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:51:06.763 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:51:06.763 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:51:06.764 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:51:06.764 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:51:06.764 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:51:06.764 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:51:06.764 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:51:06.764 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:51:06.764 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:51:06.764 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:51:06.764 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:51:06.764 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:51:06.764 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:51:06.764 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:51:06.764 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:51:06.765 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:51:06.765 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:51:06.765 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:51:06.765 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:51:06.765 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:51:06.765 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:51:06.765 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:51:06.765 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:51:06.765 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:51:06.765 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:51:06.765 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:51:06.765 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:51:06.765 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:51:06.765 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:51:06.765 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:51:06.766 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:51:06.766 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:51:06.766 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:51:06.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.748+0000 7f7989aa3640 1 -- 172.21.15.17:0/2582621306 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f796c07af30 msgr2=0x7f796c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.748+0000 7f7989aa3640 1 --2- 172.21.15.17:0/2582621306 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f796c07af30 0x7f796c07d3f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7974005fd0 tx=0x7f7974005850 comp rx=0 tx=0).stop 2024-09-20T18:51:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.748+0000 7f7989aa3640 1 -- 172.21.15.17:0/2582621306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7984106800 msgr2=0x7f7984198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.748+0000 7f7989aa3640 1 --2- 172.21.15.17:0/2582621306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7984106800 0x7f7984198d20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7978031460 tx=0x7f79780045e0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.748+0000 7f7989aa3640 1 -- 172.21.15.17:0/2582621306 shutdown_connections 2024-09-20T18:51:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.748+0000 7f7989aa3640 1 --2- 172.21.15.17:0/2582621306 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f796c07af30 0x7f796c07d3f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.748+0000 7f7989aa3640 1 --2- 172.21.15.17:0/2582621306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7984106800 0x7f7984198d20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.748+0000 7f7989aa3640 1 --2- 172.21.15.17:0/2582621306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7984100800 0x7f79841987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.748+0000 7f7989aa3640 1 -- 172.21.15.17:0/2582621306 >> 172.21.15.17:0/2582621306 conn(0x7f79840fc520 msgr2=0x7f79840fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.748+0000 7f7989aa3640 1 -- 172.21.15.17:0/2582621306 shutdown_connections 2024-09-20T18:51:06.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.748+0000 7f7989aa3640 1 -- 172.21.15.17:0/2582621306 wait complete. 2024-09-20T18:51:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.834+0000 7fa0b7b0b640 1 -- 172.21.15.17:0/3579705492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0b0101900 msgr2=0x7fa0b0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.834+0000 7fa0b7b0b640 1 --2- 172.21.15.17:0/3579705492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0b0101900 0x7fa0b0101d60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009880 tx=0x7fa0a002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.834+0000 7fa0b7b0b640 1 -- 172.21.15.17:0/3579705492 shutdown_connections 2024-09-20T18:51:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.834+0000 7fa0b7b0b640 1 --2- 172.21.15.17:0/3579705492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0b0101900 0x7fa0b0101d60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.834+0000 7fa0b7b0b640 1 --2- 172.21.15.17:0/3579705492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0b0107900 0x7fa0b0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.834+0000 7fa0b7b0b640 1 -- 172.21.15.17:0/3579705492 >> 172.21.15.17:0/3579705492 conn(0x7fa0b00fd600 msgr2=0x7fa0b00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.834+0000 7fa0b7b0b640 1 -- 172.21.15.17:0/3579705492 shutdown_connections 2024-09-20T18:51:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.834+0000 7fa0b7b0b640 1 -- 172.21.15.17:0/3579705492 wait complete. 2024-09-20T18:51:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.834+0000 7fa0b7b0b640 1 Processor -- start 2024-09-20T18:51:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.835+0000 7fa0b7b0b640 1 -- start start 2024-09-20T18:51:06.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.835+0000 7fa0b7b0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0b0101900 0x7fa0b019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:06.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.835+0000 7fa0b7b0b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0b0107900 0x7fa0b019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:06.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.835+0000 7fa0b7b0b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b010edb0 con 0x7fa0b0101900 2024-09-20T18:51:06.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.835+0000 7fa0b7b0b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b010ec30 con 0x7fa0b0107900 2024-09-20T18:51:06.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.835+0000 7fa0b58a7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0b0101900 0x7fa0b019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:06.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.835+0000 7fa0b58a7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0b0101900 0x7fa0b019d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33980/0 (socket says 172.21.15.17:33980) 2024-09-20T18:51:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.835+0000 7fa0b58a7640 1 -- 172.21.15.17:0/2913604204 learned_addr learned my addr 172.21.15.17:0/2913604204 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:51:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.835+0000 7fa0b50a6640 1 --2- 172.21.15.17:0/2913604204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0b0107900 0x7fa0b019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.835+0000 7fa0b58a7640 1 -- 172.21.15.17:0/2913604204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0b0107900 msgr2=0x7fa0b019db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.835+0000 7fa0b58a7640 1 --2- 172.21.15.17:0/2913604204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0b0107900 0x7fa0b019db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.835+0000 7fa0b58a7640 1 -- 172.21.15.17:0/2913604204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b01977d0 con 0x7fa0b0101900 2024-09-20T18:51:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.835+0000 7fa0b50a6640 1 --2- 172.21.15.17:0/2913604204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0b0107900 0x7fa0b019db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:51:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.835+0000 7fa0b58a7640 1 --2- 172.21.15.17:0/2913604204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0b0101900 0x7fa0b019d650 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00c8a0 tx=0x7fa0ac00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.836+0000 7fa0a6ffd640 1 -- 172.21.15.17:0/2913604204 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0ac0079b0 con 0x7fa0b0101900 2024-09-20T18:51:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.836+0000 7fa0a6ffd640 1 -- 172.21.15.17:0/2913604204 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa0ac007b50 con 0x7fa0b0101900 2024-09-20T18:51:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.836+0000 7fa0b7b0b640 1 -- 172.21.15.17:0/2913604204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b0197ac0 con 0x7fa0b0101900 2024-09-20T18:51:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.836+0000 7fa0a6ffd640 1 -- 172.21.15.17:0/2913604204 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0ac018700 con 0x7fa0b0101900 2024-09-20T18:51:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.836+0000 7fa0b7b0b640 1 -- 172.21.15.17:0/2913604204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b0198050 con 0x7fa0b0101900 2024-09-20T18:51:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.837+0000 7fa0b7b0b640 1 -- 172.21.15.17:0/2913604204 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b0103040 con 0x7fa0b0101900 2024-09-20T18:51:06.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.837+0000 7fa0a6ffd640 1 -- 172.21.15.17:0/2913604204 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa0ac007d00 con 0x7fa0b0101900 2024-09-20T18:51:06.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.838+0000 7fa0a6ffd640 1 --2- 172.21.15.17:0/2913604204 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa09c07af40 0x7fa09c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:06.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.838+0000 7fa0a6ffd640 1 -- 172.21.15.17:0/2913604204 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fa0ac09e310 con 0x7fa0b0101900 2024-09-20T18:51:06.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.838+0000 7fa0b50a6640 1 --2- 172.21.15.17:0/2913604204 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa09c07af40 0x7fa09c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:06.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.838+0000 7fa0b50a6640 1 --2- 172.21.15.17:0/2913604204 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa09c07af40 0x7fa09c07d400 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0031460 tx=0x7fa0a0004280 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:06.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:06.842+0000 7fa0a6ffd640 1 -- 172.21.15.17:0/2913604204 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa0ac014030 con 0x7fa0b0101900 2024-09-20T18:51:06.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:06 smithi172 ceph-mon[80431]: from='client.34706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:51:06.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:06 smithi172 ceph-mon[80431]: from='client.34710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:51:06.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:06 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1444731465' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:51:07.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.046+0000 7fa0b7b0b640 1 -- 172.21.15.17:0/2913604204 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa0b0198360 con 0x7fa09c07af40 2024-09-20T18:51:07.064 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:06 smithi017 ceph-mon[108970]: from='client.34706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:51:07.064 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:06 smithi017 ceph-mon[108970]: from='client.34710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:51:07.064 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:06 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1444731465' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:51:07.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.048+0000 7fa0a6ffd640 1 -- 172.21.15.17:0/2913604204 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fa0b0198360 con 0x7fa09c07af40 2024-09-20T18:51:07.064 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:51:07.065 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:51:07.065 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:51:07.065 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:51:07.065 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:51:07.065 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:51:07.065 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:51:07.065 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:51:07.065 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:51:07.065 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:51:07.065 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:51:07.065 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:51:07.065 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:51:07.065 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:51:07.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.050+0000 7fa0b7b0b640 1 -- 172.21.15.17:0/2913604204 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa09c07af40 msgr2=0x7fa09c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:07.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.050+0000 7fa0b7b0b640 1 --2- 172.21.15.17:0/2913604204 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa09c07af40 0x7fa09c07d400 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0031460 tx=0x7fa0a0004280 comp rx=0 tx=0).stop 2024-09-20T18:51:07.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.050+0000 7fa0b7b0b640 1 -- 172.21.15.17:0/2913604204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0b0101900 msgr2=0x7fa0b019d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:07.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.050+0000 7fa0b7b0b640 1 --2- 172.21.15.17:0/2913604204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0b0101900 0x7fa0b019d650 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00c8a0 tx=0x7fa0ac00cd60 comp rx=0 tx=0).stop 2024-09-20T18:51:07.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.050+0000 7fa0b7b0b640 1 -- 172.21.15.17:0/2913604204 shutdown_connections 2024-09-20T18:51:07.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.050+0000 7fa0b7b0b640 1 --2- 172.21.15.17:0/2913604204 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa09c07af40 0x7fa09c07d400 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:07.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.050+0000 7fa0b7b0b640 1 --2- 172.21.15.17:0/2913604204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0b0107900 0x7fa0b019db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:07.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.050+0000 7fa0b7b0b640 1 --2- 172.21.15.17:0/2913604204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0b0101900 0x7fa0b019d650 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:07.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.050+0000 7fa0b7b0b640 1 -- 172.21.15.17:0/2913604204 >> 172.21.15.17:0/2913604204 conn(0x7fa0b00fd600 msgr2=0x7fa0b00fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:07.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.050+0000 7fa0b7b0b640 1 -- 172.21.15.17:0/2913604204 shutdown_connections 2024-09-20T18:51:07.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.050+0000 7fa0b7b0b640 1 -- 172.21.15.17:0/2913604204 wait complete. 2024-09-20T18:51:07.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.134+0000 7f43c7132640 1 -- 172.21.15.17:0/784017988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43c0100800 msgr2=0x7f43c0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:07.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.134+0000 7f43c7132640 1 --2- 172.21.15.17:0/784017988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43c0100800 0x7f43c0100c60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f43ac009880 tx=0x7f43ac02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:51:07.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.134+0000 7f43c7132640 1 -- 172.21.15.17:0/784017988 shutdown_connections 2024-09-20T18:51:07.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.134+0000 7f43c7132640 1 --2- 172.21.15.17:0/784017988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43c0100800 0x7f43c0100c60 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:07.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.134+0000 7f43c7132640 1 --2- 172.21.15.17:0/784017988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43c0106800 0x7f43c0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:07.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.134+0000 7f43c7132640 1 -- 172.21.15.17:0/784017988 >> 172.21.15.17:0/784017988 conn(0x7f43c00fc520 msgr2=0x7f43c00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:07.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.134+0000 7f43c7132640 1 -- 172.21.15.17:0/784017988 shutdown_connections 2024-09-20T18:51:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.134+0000 7f43c7132640 1 -- 172.21.15.17:0/784017988 wait complete. 2024-09-20T18:51:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.135+0000 7f43c7132640 1 Processor -- start 2024-09-20T18:51:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.135+0000 7f43c7132640 1 -- start start 2024-09-20T18:51:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.135+0000 7f43c7132640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43c0100800 0x7f43c019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.135+0000 7f43c7132640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43c0106800 0x7f43c019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.135+0000 7f43c7132640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f43c010dcd0 con 0x7f43c0100800 2024-09-20T18:51:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.135+0000 7f43c7132640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f43c010db50 con 0x7f43c0106800 2024-09-20T18:51:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.135+0000 7f43c4ece640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43c0100800 0x7f43c019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.135+0000 7f43c4ece640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43c0100800 0x7f43c019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34004/0 (socket says 172.21.15.17:34004) 2024-09-20T18:51:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.135+0000 7f43c4ece640 1 -- 172.21.15.17:0/1971886167 learned_addr learned my addr 172.21.15.17:0/1971886167 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:51:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.136+0000 7f43bffff640 1 --2- 172.21.15.17:0/1971886167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43c0106800 0x7f43c019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:07.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.136+0000 7f43c4ece640 1 -- 172.21.15.17:0/1971886167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43c0106800 msgr2=0x7f43c019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:07.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.136+0000 7f43c4ece640 1 --2- 172.21.15.17:0/1971886167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43c0106800 0x7f43c019dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:07.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.136+0000 7f43c4ece640 1 -- 172.21.15.17:0/1971886167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c01977f0 con 0x7f43c0100800 2024-09-20T18:51:07.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.136+0000 7f43c4ece640 1 --2- 172.21.15.17:0/1971886167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43c0100800 0x7f43c019d670 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f43b400d6f0 tx=0x7f43b400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:07.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.136+0000 7f43bdffb640 1 -- 172.21.15.17:0/1971886167 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f43b4017070 con 0x7f43c0100800 2024-09-20T18:51:07.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.136+0000 7f43bdffb640 1 -- 172.21.15.17:0/1971886167 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f43b400de00 con 0x7f43c0100800 2024-09-20T18:51:07.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.136+0000 7f43c7132640 1 -- 172.21.15.17:0/1971886167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c0197ae0 con 0x7f43c0100800 2024-09-20T18:51:07.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.136+0000 7f43bdffb640 1 -- 172.21.15.17:0/1971886167 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f43b4004bb0 con 0x7f43c0100800 2024-09-20T18:51:07.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.136+0000 7f43c7132640 1 -- 172.21.15.17:0/1971886167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c0198040 con 0x7f43c0100800 2024-09-20T18:51:07.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.137+0000 7f43c7132640 1 -- 172.21.15.17:0/1971886167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c0101f40 con 0x7f43c0100800 2024-09-20T18:51:07.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.138+0000 7f43bdffb640 1 -- 172.21.15.17:0/1971886167 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f43b4004e60 con 0x7f43c0100800 2024-09-20T18:51:07.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.138+0000 7f43bdffb640 1 --2- 172.21.15.17:0/1971886167 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43b007af30 0x7f43b007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:07.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.138+0000 7f43bdffb640 1 -- 172.21.15.17:0/1971886167 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f43b409dc50 con 0x7f43c0100800 2024-09-20T18:51:07.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.139+0000 7f43bffff640 1 --2- 172.21.15.17:0/1971886167 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43b007af30 0x7f43b007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:07.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.139+0000 7f43bffff640 1 --2- 172.21.15.17:0/1971886167 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43b007af30 0x7f43b007d3f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f43c0198b40 tx=0x7f43ac031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:07.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.143+0000 7f43bdffb640 1 -- 172.21.15.17:0/1971886167 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43b4069250 con 0x7f43c0100800 2024-09-20T18:51:07.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.406+0000 7f43c7132640 1 -- 172.21.15.17:0/1971886167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f43c0109d80 con 0x7f43c0100800 2024-09-20T18:51:07.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.407+0000 7f43bdffb640 1 -- 172.21.15.17:0/1971886167 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f43b406e100 con 0x7f43c0100800 2024-09-20T18:51:07.424 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:51:07.424 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:51:07.424 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:51:07.424 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:51:07.424 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:51:07.424 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:51:07.424 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:51:07.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.409+0000 7f43c7132640 1 -- 172.21.15.17:0/1971886167 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43b007af30 msgr2=0x7f43b007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:07.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.409+0000 7f43c7132640 1 --2- 172.21.15.17:0/1971886167 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43b007af30 0x7f43b007d3f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f43c0198b40 tx=0x7f43ac031400 comp rx=0 tx=0).stop 2024-09-20T18:51:07.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.409+0000 7f43c7132640 1 -- 172.21.15.17:0/1971886167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43c0100800 msgr2=0x7f43c019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:07.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.409+0000 7f43c7132640 1 --2- 172.21.15.17:0/1971886167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43c0100800 0x7f43c019d670 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f43b400d6f0 tx=0x7f43b400dbb0 comp rx=0 tx=0).stop 2024-09-20T18:51:07.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.409+0000 7f43c7132640 1 -- 172.21.15.17:0/1971886167 shutdown_connections 2024-09-20T18:51:07.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.409+0000 7f43c7132640 1 --2- 172.21.15.17:0/1971886167 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43b007af30 0x7f43b007d3f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:07.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.409+0000 7f43c7132640 1 --2- 172.21.15.17:0/1971886167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43c0106800 0x7f43c019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:07.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.409+0000 7f43c7132640 1 --2- 172.21.15.17:0/1971886167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43c0100800 0x7f43c019d670 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:07.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.409+0000 7f43c7132640 1 -- 172.21.15.17:0/1971886167 >> 172.21.15.17:0/1971886167 conn(0x7f43c00fc520 msgr2=0x7f43c006a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:07.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.409+0000 7f43c7132640 1 -- 172.21.15.17:0/1971886167 shutdown_connections 2024-09-20T18:51:07.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:07.409+0000 7f43c7132640 1 -- 172.21.15.17:0/1971886167 wait complete. 2024-09-20T18:51:07.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:07 smithi172 ceph-mon[80431]: from='client.34714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:51:07.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:07 smithi172 ceph-mon[80431]: pgmap v471: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:07.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:07 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2582621306' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:51:07.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:51:07.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:07 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1971886167' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:51:08.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:07 smithi017 ceph-mon[108970]: from='client.34714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:51:08.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:07 smithi017 ceph-mon[108970]: pgmap v471: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:08.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:07 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2582621306' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:51:08.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:51:08.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:07 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1971886167' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:51:08.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:08 smithi172 ceph-mon[80431]: from='client.34726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:51:09.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:08 smithi017 ceph-mon[108970]: from='client.34726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:51:09.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:09 smithi172 ceph-mon[80431]: pgmap v472: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:10.059 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:09 smithi017 ceph-mon[108970]: pgmap v472: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:11.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:11 smithi172 ceph-mon[80431]: pgmap v473: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:11.967 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:11 smithi017 ceph-mon[108970]: pgmap v473: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:13.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:13 smithi017 ceph-mon[108970]: pgmap v474: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:13.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:13 smithi172 ceph-mon[80431]: pgmap v474: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:16.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:15 smithi017 ceph-mon[108970]: pgmap v475: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:16.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:15 smithi172 ceph-mon[80431]: pgmap v475: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:18.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:17 smithi017 ceph-mon[108970]: pgmap v476: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:18.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:17 smithi172 ceph-mon[80431]: pgmap v476: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:19.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:19 smithi017 ceph-mon[108970]: pgmap v477: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:20.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:19 smithi172 ceph-mon[80431]: pgmap v477: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:22.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:21 smithi017 ceph-mon[108970]: pgmap v478: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:22.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:21 smithi172 ceph-mon[80431]: pgmap v478: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:22.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:51:23.002 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:51:24.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:23 smithi017 ceph-mon[108970]: pgmap v479: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:24.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:23 smithi172 ceph-mon[80431]: pgmap v479: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:25.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:25 smithi017 ceph-mon[108970]: pgmap v480: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:26.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:25 smithi172 ceph-mon[80431]: pgmap v480: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:28.078 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:27 smithi172 ceph-mon[80431]: pgmap v481: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:28.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:27 smithi017 ceph-mon[108970]: pgmap v481: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:30.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:29 smithi017 ceph-mon[108970]: pgmap v482: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:30.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:29 smithi172 ceph-mon[80431]: pgmap v482: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:31.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:31 smithi017 ceph-mon[108970]: pgmap v483: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:32.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:31 smithi172 ceph-mon[80431]: pgmap v483: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:34.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:33 smithi017 ceph-mon[108970]: pgmap v484: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:34.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:33 smithi172 ceph-mon[80431]: pgmap v484: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:36.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:35 smithi017 ceph-mon[108970]: pgmap v485: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:36.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:35 smithi172 ceph-mon[80431]: pgmap v485: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:37.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.506+0000 7fb210ae7640 1 -- 172.21.15.17:0/3561939881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb20c100650 msgr2=0x7fb20c100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:37.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.506+0000 7fb210ae7640 1 --2- 172.21.15.17:0/3561939881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb20c100650 0x7fb20c100a30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009880 tx=0x7fb1fc02a490 comp rx=0 tx=0).stop 2024-09-20T18:51:37.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.506+0000 7fb210ae7640 1 -- 172.21.15.17:0/3561939881 shutdown_connections 2024-09-20T18:51:37.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.507+0000 7fb210ae7640 1 --2- 172.21.15.17:0/3561939881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb20c101000 0x7fb20c10dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:37.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.507+0000 7fb210ae7640 1 --2- 172.21.15.17:0/3561939881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb20c100650 0x7fb20c100a30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:37.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.507+0000 7fb210ae7640 1 -- 172.21.15.17:0/3561939881 >> 172.21.15.17:0/3561939881 conn(0x7fb20c0fc520 msgr2=0x7fb20c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:37.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.507+0000 7fb210ae7640 1 -- 172.21.15.17:0/3561939881 shutdown_connections 2024-09-20T18:51:37.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.507+0000 7fb210ae7640 1 -- 172.21.15.17:0/3561939881 wait complete. 2024-09-20T18:51:37.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.507+0000 7fb210ae7640 1 Processor -- start 2024-09-20T18:51:37.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.507+0000 7fb210ae7640 1 -- start start 2024-09-20T18:51:37.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.508+0000 7fb210ae7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb20c100650 0x7fb20c19f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:37.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.508+0000 7fb210ae7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb20c101000 0x7fb20c19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:37.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.508+0000 7fb210ae7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c110f90 con 0x7fb20c101000 2024-09-20T18:51:37.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.508+0000 7fb210ae7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c110e10 con 0x7fb20c100650 2024-09-20T18:51:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.508+0000 7fb209d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb20c101000 0x7fb20c19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.508+0000 7fb209d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb20c101000 0x7fb20c19fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36120/0 (socket says 172.21.15.17:36120) 2024-09-20T18:51:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.508+0000 7fb209d9b640 1 -- 172.21.15.17:0/2481476085 learned_addr learned my addr 172.21.15.17:0/2481476085 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:51:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.508+0000 7fb209d9b640 1 -- 172.21.15.17:0/2481476085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb20c100650 msgr2=0x7fb20c19f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.508+0000 7fb209d9b640 1 --2- 172.21.15.17:0/2481476085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb20c100650 0x7fb20c19f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.508+0000 7fb209d9b640 1 -- 172.21.15.17:0/2481476085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20c199980 con 0x7fb20c101000 2024-09-20T18:51:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.508+0000 7fb209d9b640 1 --2- 172.21.15.17:0/2481476085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb20c101000 0x7fb20c19fd00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400e970 tx=0x7fb1f400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.509+0000 7fb2037fe640 1 -- 172.21.15.17:0/2481476085 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1f400cac0 con 0x7fb20c101000 2024-09-20T18:51:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.509+0000 7fb2037fe640 1 -- 172.21.15.17:0/2481476085 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb1f400cc60 con 0x7fb20c101000 2024-09-20T18:51:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.509+0000 7fb210ae7640 1 -- 172.21.15.17:0/2481476085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb20c199c70 con 0x7fb20c101000 2024-09-20T18:51:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.509+0000 7fb2037fe640 1 -- 172.21.15.17:0/2481476085 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1f4018720 con 0x7fb20c101000 2024-09-20T18:51:37.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.509+0000 7fb210ae7640 1 -- 172.21.15.17:0/2481476085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb20c19a200 con 0x7fb20c101000 2024-09-20T18:51:37.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.510+0000 7fb210ae7640 1 -- 172.21.15.17:0/2481476085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb20c06aa90 con 0x7fb20c101000 2024-09-20T18:51:37.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.511+0000 7fb2037fe640 1 -- 172.21.15.17:0/2481476085 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb1f4010430 con 0x7fb20c101000 2024-09-20T18:51:37.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.511+0000 7fb2037fe640 1 --2- 172.21.15.17:0/2481476085 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb1f807af40 0x7fb1f807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:37.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.511+0000 7fb2037fe640 1 -- 172.21.15.17:0/2481476085 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fb1f409e6d0 con 0x7fb20c101000 2024-09-20T18:51:37.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.511+0000 7fb20a59c640 1 --2- 172.21.15.17:0/2481476085 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb1f807af40 0x7fb1f807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.512+0000 7fb20a59c640 1 --2- 172.21.15.17:0/2481476085 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb1f807af40 0x7fb1f807d400 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0096c0 tx=0x7fb1fc000bc0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:37.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.516+0000 7fb2037fe640 1 -- 172.21.15.17:0/2481476085 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb1f4069cd0 con 0x7fb20c101000 2024-09-20T18:51:37.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.724+0000 7fb210ae7640 1 -- 172.21.15.17:0/2481476085 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb20c19aeb0 con 0x7fb1f807af40 2024-09-20T18:51:37.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.725+0000 7fb2037fe640 1 -- 172.21.15.17:0/2481476085 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fb20c19aeb0 con 0x7fb1f807af40 2024-09-20T18:51:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.727+0000 7fb210ae7640 1 -- 172.21.15.17:0/2481476085 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb1f807af40 msgr2=0x7fb1f807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.727+0000 7fb210ae7640 1 --2- 172.21.15.17:0/2481476085 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb1f807af40 0x7fb1f807d400 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0096c0 tx=0x7fb1fc000bc0 comp rx=0 tx=0).stop 2024-09-20T18:51:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.727+0000 7fb210ae7640 1 -- 172.21.15.17:0/2481476085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb20c101000 msgr2=0x7fb20c19fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.727+0000 7fb210ae7640 1 --2- 172.21.15.17:0/2481476085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb20c101000 0x7fb20c19fd00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400e970 tx=0x7fb1f400ee30 comp rx=0 tx=0).stop 2024-09-20T18:51:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.727+0000 7fb210ae7640 1 -- 172.21.15.17:0/2481476085 shutdown_connections 2024-09-20T18:51:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.727+0000 7fb210ae7640 1 --2- 172.21.15.17:0/2481476085 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb1f807af40 0x7fb1f807d400 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.727+0000 7fb210ae7640 1 --2- 172.21.15.17:0/2481476085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb20c101000 0x7fb20c19fd00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.727+0000 7fb210ae7640 1 --2- 172.21.15.17:0/2481476085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb20c100650 0x7fb20c19f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.727+0000 7fb210ae7640 1 -- 172.21.15.17:0/2481476085 >> 172.21.15.17:0/2481476085 conn(0x7fb20c0fc520 msgr2=0x7fb20c0fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:37.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.727+0000 7fb210ae7640 1 -- 172.21.15.17:0/2481476085 shutdown_connections 2024-09-20T18:51:37.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.727+0000 7fb210ae7640 1 -- 172.21.15.17:0/2481476085 wait complete. 2024-09-20T18:51:37.754 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:51:37.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.813+0000 7f3a2e24b640 1 -- 172.21.15.17:0/1518856846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a28100800 msgr2=0x7f3a28100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:37.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.813+0000 7f3a2e24b640 1 --2- 172.21.15.17:0/1518856846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a28100800 0x7f3a28100c60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009880 tx=0x7f3a1002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:51:37.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.814+0000 7f3a2e24b640 1 -- 172.21.15.17:0/1518856846 shutdown_connections 2024-09-20T18:51:37.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.814+0000 7f3a2e24b640 1 --2- 172.21.15.17:0/1518856846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a28100800 0x7f3a28100c60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:37.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.814+0000 7f3a2e24b640 1 --2- 172.21.15.17:0/1518856846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a28106800 0x7f3a28106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:37.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.814+0000 7f3a2e24b640 1 -- 172.21.15.17:0/1518856846 >> 172.21.15.17:0/1518856846 conn(0x7f3a280fc520 msgr2=0x7f3a280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:37.832 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:37 smithi017 ceph-mon[108970]: pgmap v486: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:37.832 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:51:37.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.814+0000 7f3a2e24b640 1 -- 172.21.15.17:0/1518856846 shutdown_connections 2024-09-20T18:51:37.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.814+0000 7f3a2e24b640 1 -- 172.21.15.17:0/1518856846 wait complete. 2024-09-20T18:51:37.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.814+0000 7f3a2e24b640 1 Processor -- start 2024-09-20T18:51:37.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.814+0000 7f3a2e24b640 1 -- start start 2024-09-20T18:51:37.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.815+0000 7f3a2e24b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a28100800 0x7f3a2819f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:37.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.815+0000 7f3a2e24b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a28106800 0x7f3a2819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:37.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.815+0000 7f3a2e24b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2810dcd0 con 0x7f3a28106800 2024-09-20T18:51:37.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.815+0000 7f3a2e24b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2810db50 con 0x7f3a28100800 2024-09-20T18:51:37.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.815+0000 7f3a1ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a28106800 0x7f3a2819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:37.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.815+0000 7f3a1ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a28106800 0x7f3a2819fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36126/0 (socket says 172.21.15.17:36126) 2024-09-20T18:51:37.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.815+0000 7f3a1ffff640 1 -- 172.21.15.17:0/1160302962 learned_addr learned my addr 172.21.15.17:0/1160302962 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:51:37.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.815+0000 7f3a277fe640 1 --2- 172.21.15.17:0/1160302962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a28100800 0x7f3a2819f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:37.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.815+0000 7f3a1ffff640 1 -- 172.21.15.17:0/1160302962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a28100800 msgr2=0x7f3a2819f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:37.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.815+0000 7f3a1ffff640 1 --2- 172.21.15.17:0/1160302962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a28100800 0x7f3a2819f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:37.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.815+0000 7f3a1ffff640 1 -- 172.21.15.17:0/1160302962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a281999a0 con 0x7f3a28106800 2024-09-20T18:51:37.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.815+0000 7f3a1ffff640 1 --2- 172.21.15.17:0/1160302962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a28106800 0x7f3a2819fd20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3a10031460 tx=0x7f3a10004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:37.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.815+0000 7f3a257fa640 1 -- 172.21.15.17:0/1160302962 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a1003f070 con 0x7f3a28106800 2024-09-20T18:51:37.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.815+0000 7f3a257fa640 1 -- 172.21.15.17:0/1160302962 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a10004a90 con 0x7f3a28106800 2024-09-20T18:51:37.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.816+0000 7f3a2e24b640 1 -- 172.21.15.17:0/1160302962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a28199c30 con 0x7f3a28106800 2024-09-20T18:51:37.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.816+0000 7f3a257fa640 1 -- 172.21.15.17:0/1160302962 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a10035030 con 0x7f3a28106800 2024-09-20T18:51:37.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.816+0000 7f3a2e24b640 1 -- 172.21.15.17:0/1160302962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a2819a160 con 0x7f3a28106800 2024-09-20T18:51:37.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.817+0000 7f3a2e24b640 1 -- 172.21.15.17:0/1160302962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a28101f40 con 0x7f3a28106800 2024-09-20T18:51:37.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.817+0000 7f3a257fa640 1 -- 172.21.15.17:0/1160302962 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3a10042070 con 0x7f3a28106800 2024-09-20T18:51:37.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.818+0000 7f3a257fa640 1 --2- 172.21.15.17:0/1160302962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a1407af90 0x7f3a1407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:37.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.818+0000 7f3a257fa640 1 -- 172.21.15.17:0/1160302962 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f3a100be980 con 0x7f3a28106800 2024-09-20T18:51:37.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.818+0000 7f3a277fe640 1 --2- 172.21.15.17:0/1160302962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a1407af90 0x7f3a1407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:37.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.819+0000 7f3a277fe640 1 --2- 172.21.15.17:0/1160302962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a1407af90 0x7f3a1407d450 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3a2819aae0 tx=0x7f3a18005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:37.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:37.822+0000 7f3a257fa640 1 -- 172.21.15.17:0/1160302962 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3a1008a000 con 0x7f3a28106800 2024-09-20T18:51:38.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.031+0000 7f3a2e24b640 1 -- 172.21.15.17:0/1160302962 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3a2819a410 con 0x7f3a1407af90 2024-09-20T18:51:38.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.032+0000 7f3a257fa640 1 -- 172.21.15.17:0/1160302962 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f3a2819a410 con 0x7f3a1407af90 2024-09-20T18:51:38.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.035+0000 7f3a2e24b640 1 -- 172.21.15.17:0/1160302962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a1407af90 msgr2=0x7f3a1407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:38.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.035+0000 7f3a2e24b640 1 --2- 172.21.15.17:0/1160302962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a1407af90 0x7f3a1407d450 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3a2819aae0 tx=0x7f3a18005f90 comp rx=0 tx=0).stop 2024-09-20T18:51:38.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.035+0000 7f3a2e24b640 1 -- 172.21.15.17:0/1160302962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a28106800 msgr2=0x7f3a2819fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:38.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.035+0000 7f3a2e24b640 1 --2- 172.21.15.17:0/1160302962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a28106800 0x7f3a2819fd20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3a10031460 tx=0x7f3a10004530 comp rx=0 tx=0).stop 2024-09-20T18:51:38.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.035+0000 7f3a2e24b640 1 -- 172.21.15.17:0/1160302962 shutdown_connections 2024-09-20T18:51:38.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.035+0000 7f3a2e24b640 1 --2- 172.21.15.17:0/1160302962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a1407af90 0x7f3a1407d450 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.035+0000 7f3a2e24b640 1 --2- 172.21.15.17:0/1160302962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a28106800 0x7f3a2819fd20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.035+0000 7f3a2e24b640 1 --2- 172.21.15.17:0/1160302962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a28100800 0x7f3a2819f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.035+0000 7f3a2e24b640 1 -- 172.21.15.17:0/1160302962 >> 172.21.15.17:0/1160302962 conn(0x7f3a280fc520 msgr2=0x7f3a280fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:38.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.035+0000 7f3a2e24b640 1 -- 172.21.15.17:0/1160302962 shutdown_connections 2024-09-20T18:51:38.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.035+0000 7f3a2e24b640 1 -- 172.21.15.17:0/1160302962 wait complete. 2024-09-20T18:51:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.119+0000 7f565497b640 1 -- 172.21.15.17:0/1419165222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5650074f40 msgr2=0x7f565010dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.119+0000 7f565497b640 1 --2- 172.21.15.17:0/1419165222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5650074f40 0x7f565010dc00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5644009880 tx=0x7f564402a530 comp rx=0 tx=0).stop 2024-09-20T18:51:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.120+0000 7f565497b640 1 -- 172.21.15.17:0/1419165222 shutdown_connections 2024-09-20T18:51:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.120+0000 7f565497b640 1 --2- 172.21.15.17:0/1419165222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5650074f40 0x7f565010dc00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.120+0000 7f565497b640 1 --2- 172.21.15.17:0/1419165222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5650074620 0x7f5650074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.120+0000 7f565497b640 1 -- 172.21.15.17:0/1419165222 >> 172.21.15.17:0/1419165222 conn(0x7f56500fd600 msgr2=0x7f56500ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.120+0000 7f565497b640 1 -- 172.21.15.17:0/1419165222 shutdown_connections 2024-09-20T18:51:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.120+0000 7f565497b640 1 -- 172.21.15.17:0/1419165222 wait complete. 2024-09-20T18:51:38.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.120+0000 7f565497b640 1 Processor -- start 2024-09-20T18:51:38.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.120+0000 7f565497b640 1 -- start start 2024-09-20T18:51:38.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.121+0000 7f565497b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5650074620 0x7f565019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:38.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.121+0000 7f565497b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5650074f40 0x7f565019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:38.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.121+0000 7f565497b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5650110ff0 con 0x7f5650074f40 2024-09-20T18:51:38.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.121+0000 7f565497b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5650110e70 con 0x7f5650074620 2024-09-20T18:51:38.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.121+0000 7f564dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5650074f40 0x7f565019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:38.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.121+0000 7f564dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5650074f40 0x7f565019fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36154/0 (socket says 172.21.15.17:36154) 2024-09-20T18:51:38.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.121+0000 7f564dd9b640 1 -- 172.21.15.17:0/3233331510 learned_addr learned my addr 172.21.15.17:0/3233331510 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:51:38.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.121+0000 7f564e59c640 1 --2- 172.21.15.17:0/3233331510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5650074620 0x7f565019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:38.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.121+0000 7f564dd9b640 1 -- 172.21.15.17:0/3233331510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5650074620 msgr2=0x7f565019f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.121+0000 7f564dd9b640 1 --2- 172.21.15.17:0/3233331510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5650074620 0x7f565019f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.121+0000 7f564dd9b640 1 -- 172.21.15.17:0/3233331510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5650199a20 con 0x7f5650074f40 2024-09-20T18:51:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.121+0000 7f564dd9b640 1 --2- 172.21.15.17:0/3233331510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5650074f40 0x7f565019fda0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5644031460 tx=0x7f5644004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.122+0000 7f563f7fe640 1 -- 172.21.15.17:0/3233331510 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f564403f070 con 0x7f5650074f40 2024-09-20T18:51:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.122+0000 7f563f7fe640 1 -- 172.21.15.17:0/3233331510 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f56440035f0 con 0x7f5650074f40 2024-09-20T18:51:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.122+0000 7f565497b640 1 -- 172.21.15.17:0/3233331510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5650199cb0 con 0x7f5650074f40 2024-09-20T18:51:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.122+0000 7f563f7fe640 1 -- 172.21.15.17:0/3233331510 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5644035030 con 0x7f5650074f40 2024-09-20T18:51:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.122+0000 7f565497b640 1 -- 172.21.15.17:0/3233331510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f565019a1e0 con 0x7f5650074f40 2024-09-20T18:51:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.123+0000 7f565497b640 1 -- 172.21.15.17:0/3233331510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5650075cd0 con 0x7f5650074f40 2024-09-20T18:51:38.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.124+0000 7f563f7fe640 1 -- 172.21.15.17:0/3233331510 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5644042070 con 0x7f5650074f40 2024-09-20T18:51:38.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.124+0000 7f563f7fe640 1 --2- 172.21.15.17:0/3233331510 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f563807af80 0x7f563807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:38.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.124+0000 7f564e59c640 1 --2- 172.21.15.17:0/3233331510 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f563807af80 0x7f563807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:38.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.125+0000 7f563f7fe640 1 -- 172.21.15.17:0/3233331510 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f56440be830 con 0x7f5650074f40 2024-09-20T18:51:38.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.125+0000 7f564e59c640 1 --2- 172.21.15.17:0/3233331510 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f563807af80 0x7f563807d440 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f565019ab60 tx=0x7f5640005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:38.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.129+0000 7f563f7fe640 1 -- 172.21.15.17:0/3233331510 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5644089eb0 con 0x7f5650074f40 2024-09-20T18:51:38.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:37 smithi172 ceph-mon[80431]: pgmap v486: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:38.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:51:38.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.327+0000 7f565497b640 1 -- 172.21.15.17:0/3233331510 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f565019af50 con 0x7f563807af80 2024-09-20T18:51:38.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.336+0000 7f563f7fe640 1 -- 172.21.15.17:0/3233331510 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f565019af50 con 0x7f563807af80 2024-09-20T18:51:38.354 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:51:38.354 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (12m) 7m ago 23m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:51:38.354 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (16m) 7m ago 24m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:51:38.355 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (15m) 6m ago 23m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:51:38.355 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (11m) 7m ago 24m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:51:38.355 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (11m) 6m ago 23m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:51:38.355 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (12m) 7m ago 23m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:51:38.355 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (7m) 7m ago 18m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:51:38.355 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (7m) 7m ago 18m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:51:38.355 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (18m) 6m ago 18m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:51:38.355 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (7m) 6m ago 18m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:51:38.355 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (15m) 7m ago 25m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:51:38.355 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (14m) 6m ago 23m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:51:38.355 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (11m) 7m ago 25m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:51:38.355 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (11m) 6m ago 23m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:51:38.355 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (13m) 7m ago 24m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:51:38.355 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (13m) 6m ago 23m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:51:38.356 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (10m) 7m ago 22m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:51:38.356 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (10m) 7m ago 21m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:51:38.356 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (9m) 7m ago 21m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:51:38.356 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (8m) 6m ago 20m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:51:38.356 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (8m) 6m ago 20m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:51:38.356 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (7m) 6m ago 19m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:51:38.357 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (13m) 7m ago 23m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:51:38.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.338+0000 7f565497b640 1 -- 172.21.15.17:0/3233331510 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f563807af80 msgr2=0x7f563807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:38.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.339+0000 7f565497b640 1 --2- 172.21.15.17:0/3233331510 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f563807af80 0x7f563807d440 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f565019ab60 tx=0x7f5640005f90 comp rx=0 tx=0).stop 2024-09-20T18:51:38.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.339+0000 7f565497b640 1 -- 172.21.15.17:0/3233331510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5650074f40 msgr2=0x7f565019fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:38.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.339+0000 7f565497b640 1 --2- 172.21.15.17:0/3233331510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5650074f40 0x7f565019fda0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5644031460 tx=0x7f5644004530 comp rx=0 tx=0).stop 2024-09-20T18:51:38.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.339+0000 7f565497b640 1 -- 172.21.15.17:0/3233331510 shutdown_connections 2024-09-20T18:51:38.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.339+0000 7f565497b640 1 --2- 172.21.15.17:0/3233331510 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f563807af80 0x7f563807d440 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.339+0000 7f565497b640 1 --2- 172.21.15.17:0/3233331510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5650074f40 0x7f565019fda0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.339+0000 7f565497b640 1 --2- 172.21.15.17:0/3233331510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5650074620 0x7f565019f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.339+0000 7f565497b640 1 -- 172.21.15.17:0/3233331510 >> 172.21.15.17:0/3233331510 conn(0x7f56500fd600 msgr2=0x7f565010b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:38.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.339+0000 7f565497b640 1 -- 172.21.15.17:0/3233331510 shutdown_connections 2024-09-20T18:51:38.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.339+0000 7f565497b640 1 -- 172.21.15.17:0/3233331510 wait complete. 2024-09-20T18:51:38.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.422+0000 7fe4733a2640 1 -- 172.21.15.17:0/960465619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe46c107750 msgr2=0x7fe46c107b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:38.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.422+0000 7fe4733a2640 1 --2- 172.21.15.17:0/960465619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe46c107750 0x7fe46c107b30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe468009880 tx=0x7fe46802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.422+0000 7fe4733a2640 1 -- 172.21.15.17:0/960465619 shutdown_connections 2024-09-20T18:51:38.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.422+0000 7fe4733a2640 1 --2- 172.21.15.17:0/960465619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe46c101750 0x7fe46c101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.422+0000 7fe4733a2640 1 --2- 172.21.15.17:0/960465619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe46c107750 0x7fe46c107b30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.422+0000 7fe4733a2640 1 -- 172.21.15.17:0/960465619 >> 172.21.15.17:0/960465619 conn(0x7fe46c0fd470 msgr2=0x7fe46c0ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.422+0000 7fe4733a2640 1 -- 172.21.15.17:0/960465619 shutdown_connections 2024-09-20T18:51:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.422+0000 7fe4733a2640 1 -- 172.21.15.17:0/960465619 wait complete. 2024-09-20T18:51:38.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.423+0000 7fe4733a2640 1 Processor -- start 2024-09-20T18:51:38.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.423+0000 7fe4733a2640 1 -- start start 2024-09-20T18:51:38.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.423+0000 7fe4733a2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe46c101750 0x7fe46c19d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:38.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.423+0000 7fe4733a2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe46c107750 0x7fe46c19d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:38.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.423+0000 7fe4733a2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe46c10ec20 con 0x7fe46c101750 2024-09-20T18:51:38.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.423+0000 7fe4733a2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe46c10eaa0 con 0x7fe46c107750 2024-09-20T18:51:38.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.423+0000 7fe4723a0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe46c101750 0x7fe46c19d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:38.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.423+0000 7fe4723a0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe46c101750 0x7fe46c19d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36174/0 (socket says 172.21.15.17:36174) 2024-09-20T18:51:38.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.423+0000 7fe4723a0640 1 -- 172.21.15.17:0/2507546219 learned_addr learned my addr 172.21.15.17:0/2507546219 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:51:38.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.423+0000 7fe471b9f640 1 --2- 172.21.15.17:0/2507546219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe46c107750 0x7fe46c19d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:38.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.424+0000 7fe4723a0640 1 -- 172.21.15.17:0/2507546219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe46c107750 msgr2=0x7fe46c19d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:38.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.424+0000 7fe4723a0640 1 --2- 172.21.15.17:0/2507546219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe46c107750 0x7fe46c19d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.424+0000 7fe4723a0640 1 -- 172.21.15.17:0/2507546219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe46c1975e0 con 0x7fe46c101750 2024-09-20T18:51:38.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.424+0000 7fe4723a0640 1 --2- 172.21.15.17:0/2507546219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe46c101750 0x7fe46c19d420 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe468031460 tx=0x7fe4680045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.424+0000 7fe4637fe640 1 -- 172.21.15.17:0/2507546219 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe46803f070 con 0x7fe46c101750 2024-09-20T18:51:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.424+0000 7fe4733a2640 1 -- 172.21.15.17:0/2507546219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe46c197870 con 0x7fe46c101750 2024-09-20T18:51:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.424+0000 7fe4637fe640 1 -- 172.21.15.17:0/2507546219 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe4680035f0 con 0x7fe46c101750 2024-09-20T18:51:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.424+0000 7fe4637fe640 1 -- 172.21.15.17:0/2507546219 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe468035030 con 0x7fe46c101750 2024-09-20T18:51:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.424+0000 7fe4733a2640 1 -- 172.21.15.17:0/2507546219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe46c197da0 con 0x7fe46c101750 2024-09-20T18:51:38.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.425+0000 7fe4733a2640 1 -- 172.21.15.17:0/2507546219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe46c102e90 con 0x7fe46c101750 2024-09-20T18:51:38.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.426+0000 7fe4637fe640 1 -- 172.21.15.17:0/2507546219 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe468042070 con 0x7fe46c101750 2024-09-20T18:51:38.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.426+0000 7fe4637fe640 1 --2- 172.21.15.17:0/2507546219 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe45807af30 0x7fe45807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:38.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.426+0000 7fe4637fe640 1 -- 172.21.15.17:0/2507546219 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fe4680be970 con 0x7fe46c101750 2024-09-20T18:51:38.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.426+0000 7fe471b9f640 1 --2- 172.21.15.17:0/2507546219 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe45807af30 0x7fe45807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:38.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.427+0000 7fe471b9f640 1 --2- 172.21.15.17:0/2507546219 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe45807af30 0x7fe45807d3f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0ffa80 tx=0x7fe45c00b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:38.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.431+0000 7fe4637fe640 1 -- 172.21.15.17:0/2507546219 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe4680c0e20 con 0x7fe46c101750 2024-09-20T18:51:38.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.696+0000 7fe4733a2640 1 -- 172.21.15.17:0/2507546219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe46c198b10 con 0x7fe46c101750 2024-09-20T18:51:38.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.697+0000 7fe4637fe640 1 -- 172.21.15.17:0/2507546219 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fe46808c490 con 0x7fe46c101750 2024-09-20T18:51:38.715 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:51:38.715 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:51:38.715 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:51:38.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:51:38.715 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:51:38.715 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:51:38.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:51:38.716 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:51:38.716 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:51:38.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:51:38.716 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:51:38.716 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:51:38.716 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:51:38.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:51:38.716 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:51:38.716 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:51:38.717 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:51:38.717 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:51:38.717 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:51:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.699+0000 7fe4733a2640 1 -- 172.21.15.17:0/2507546219 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe45807af30 msgr2=0x7fe45807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.699+0000 7fe4733a2640 1 --2- 172.21.15.17:0/2507546219 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe45807af30 0x7fe45807d3f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0ffa80 tx=0x7fe45c00b390 comp rx=0 tx=0).stop 2024-09-20T18:51:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.699+0000 7fe4733a2640 1 -- 172.21.15.17:0/2507546219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe46c101750 msgr2=0x7fe46c19d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.699+0000 7fe4733a2640 1 --2- 172.21.15.17:0/2507546219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe46c101750 0x7fe46c19d420 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe468031460 tx=0x7fe4680045e0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.699+0000 7fe4733a2640 1 -- 172.21.15.17:0/2507546219 shutdown_connections 2024-09-20T18:51:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.699+0000 7fe4733a2640 1 --2- 172.21.15.17:0/2507546219 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe45807af30 0x7fe45807d3f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.699+0000 7fe4733a2640 1 --2- 172.21.15.17:0/2507546219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe46c107750 0x7fe46c19d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.699+0000 7fe4733a2640 1 --2- 172.21.15.17:0/2507546219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe46c101750 0x7fe46c19d420 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.699+0000 7fe4733a2640 1 -- 172.21.15.17:0/2507546219 >> 172.21.15.17:0/2507546219 conn(0x7fe46c0fd470 msgr2=0x7fe46c0fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.699+0000 7fe4733a2640 1 -- 172.21.15.17:0/2507546219 shutdown_connections 2024-09-20T18:51:38.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.699+0000 7fe4733a2640 1 -- 172.21.15.17:0/2507546219 wait complete. 2024-09-20T18:51:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.786+0000 7f15a614a640 1 -- 172.21.15.17:0/3861454696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a01067f0 msgr2=0x7f15a0106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.787+0000 7f15a614a640 1 --2- 172.21.15.17:0/3861454696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a01067f0 0x7f15a0106bd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1590009880 tx=0x7f159002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.787+0000 7f15a614a640 1 -- 172.21.15.17:0/3861454696 shutdown_connections 2024-09-20T18:51:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.787+0000 7f15a614a640 1 --2- 172.21.15.17:0/3861454696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15a01007f0 0x7f15a0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.787+0000 7f15a614a640 1 --2- 172.21.15.17:0/3861454696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a01067f0 0x7f15a0106bd0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.787+0000 7f15a614a640 1 -- 172.21.15.17:0/3861454696 >> 172.21.15.17:0/3861454696 conn(0x7f15a00fc550 msgr2=0x7f15a00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.787+0000 7f15a614a640 1 -- 172.21.15.17:0/3861454696 shutdown_connections 2024-09-20T18:51:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.787+0000 7f15a614a640 1 -- 172.21.15.17:0/3861454696 wait complete. 2024-09-20T18:51:38.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.787+0000 7f15a614a640 1 Processor -- start 2024-09-20T18:51:38.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.787+0000 7f15a614a640 1 -- start start 2024-09-20T18:51:38.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.788+0000 7f15a614a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15a01007f0 0x7f15a019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:38.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.788+0000 7f15a614a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a01067f0 0x7f15a019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:38.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.788+0000 7f15a614a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f15a010dcc0 con 0x7f15a01067f0 2024-09-20T18:51:38.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.788+0000 7f15a614a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f15a010db40 con 0x7f15a01007f0 2024-09-20T18:51:38.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.788+0000 7f159effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a01067f0 0x7f15a019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:38.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.788+0000 7f159effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a01067f0 0x7f15a019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36186/0 (socket says 172.21.15.17:36186) 2024-09-20T18:51:38.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.788+0000 7f159effd640 1 -- 172.21.15.17:0/3008507638 learned_addr learned my addr 172.21.15.17:0/3008507638 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:51:38.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.788+0000 7f159f7fe640 1 --2- 172.21.15.17:0/3008507638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15a01007f0 0x7f15a019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:38.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.788+0000 7f159effd640 1 -- 172.21.15.17:0/3008507638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15a01007f0 msgr2=0x7f15a019d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:38.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.788+0000 7f159effd640 1 --2- 172.21.15.17:0/3008507638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15a01007f0 0x7f15a019d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:38.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.788+0000 7f159effd640 1 -- 172.21.15.17:0/3008507638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a01977b0 con 0x7f15a01067f0 2024-09-20T18:51:38.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.788+0000 7f159effd640 1 --2- 172.21.15.17:0/3008507638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a01067f0 0x7f15a019db70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f159400d6f0 tx=0x7f159400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:38.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.788+0000 7f159cff9640 1 -- 172.21.15.17:0/3008507638 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1594017070 con 0x7f15a01067f0 2024-09-20T18:51:38.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.789+0000 7f159cff9640 1 -- 172.21.15.17:0/3008507638 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f159400de00 con 0x7f15a01067f0 2024-09-20T18:51:38.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.789+0000 7f15a614a640 1 -- 172.21.15.17:0/3008507638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a0197aa0 con 0x7f15a01067f0 2024-09-20T18:51:38.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.789+0000 7f159cff9640 1 -- 172.21.15.17:0/3008507638 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1594004bb0 con 0x7f15a01067f0 2024-09-20T18:51:38.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.789+0000 7f15a614a640 1 -- 172.21.15.17:0/3008507638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a0198030 con 0x7f15a01067f0 2024-09-20T18:51:38.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.790+0000 7f15a614a640 1 -- 172.21.15.17:0/3008507638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15a0101f30 con 0x7f15a01067f0 2024-09-20T18:51:38.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.790+0000 7f159cff9640 1 -- 172.21.15.17:0/3008507638 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1594004e60 con 0x7f15a01067f0 2024-09-20T18:51:38.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.791+0000 7f159cff9640 1 --2- 172.21.15.17:0/3008507638 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f158807af30 0x7f158807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:38.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.791+0000 7f159cff9640 1 -- 172.21.15.17:0/3008507638 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f159409dba0 con 0x7f15a01067f0 2024-09-20T18:51:38.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.791+0000 7f159f7fe640 1 --2- 172.21.15.17:0/3008507638 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f158807af30 0x7f158807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:38.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.791+0000 7f159f7fe640 1 --2- 172.21.15.17:0/3008507638 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f158807af30 0x7f158807d3f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f15900096c0 tx=0x7f1590031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:38.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:38.795+0000 7f159cff9640 1 -- 172.21.15.17:0/3008507638 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f15940691a0 con 0x7f15a01067f0 2024-09-20T18:51:39.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.023+0000 7f15a614a640 1 -- 172.21.15.17:0/3008507638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f15a0109d70 con 0x7f15a01067f0 2024-09-20T18:51:39.041 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:38 smithi017 ceph-mon[108970]: from='client.34734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:51:39.041 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:38 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2507546219' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:51:39.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.023+0000 7f159cff9640 1 -- 172.21.15.17:0/3008507638 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f159406e050 con 0x7f15a01067f0 2024-09-20T18:51:39.042 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:51:39.042 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:51:39.042 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:51:39.042 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:51:39.042 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:51:39.042 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:51:39.042 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:51:39.042 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:51:39.042 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:51:39.042 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:51:39.042 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:51:39.042 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:51:39.042 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:51:39.043 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:51:39.043 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:51:39.043 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:51:39.043 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:51:39.043 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:51:39.043 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:51:39.043 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:51:39.043 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:51:39.043 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:51:39.043 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:51:39.043 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:51:39.043 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:51:39.043 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:51:39.043 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:51:39.044 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:51:39.044 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:51:39.044 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:51:39.044 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:51:39.044 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:51:39.044 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:51:39.044 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:51:39.044 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:51:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:51:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:51:39.044 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:51:39.044 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:51:39.044 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:51:39.044 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:51:39.045 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:51:39.045 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:51:39.045 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:51:39.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.026+0000 7f15a614a640 1 -- 172.21.15.17:0/3008507638 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f158807af30 msgr2=0x7f158807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:39.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.026+0000 7f15a614a640 1 --2- 172.21.15.17:0/3008507638 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f158807af30 0x7f158807d3f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f15900096c0 tx=0x7f1590031400 comp rx=0 tx=0).stop 2024-09-20T18:51:39.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.026+0000 7f15a614a640 1 -- 172.21.15.17:0/3008507638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a01067f0 msgr2=0x7f15a019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:39.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.026+0000 7f15a614a640 1 --2- 172.21.15.17:0/3008507638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a01067f0 0x7f15a019db70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f159400d6f0 tx=0x7f159400dbb0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.026+0000 7f15a614a640 1 -- 172.21.15.17:0/3008507638 shutdown_connections 2024-09-20T18:51:39.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.026+0000 7f15a614a640 1 --2- 172.21.15.17:0/3008507638 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f158807af30 0x7f158807d3f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.026+0000 7f15a614a640 1 --2- 172.21.15.17:0/3008507638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a01067f0 0x7f15a019db70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.026+0000 7f15a614a640 1 --2- 172.21.15.17:0/3008507638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15a01007f0 0x7f15a019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.026+0000 7f15a614a640 1 -- 172.21.15.17:0/3008507638 >> 172.21.15.17:0/3008507638 conn(0x7f15a00fc550 msgr2=0x7f15a0069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:39.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.027+0000 7f15a614a640 1 -- 172.21.15.17:0/3008507638 shutdown_connections 2024-09-20T18:51:39.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.027+0000 7f15a614a640 1 -- 172.21.15.17:0/3008507638 wait complete. 2024-09-20T18:51:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.112+0000 7f2078a39640 1 -- 172.21.15.17:0/767347763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2074101900 msgr2=0x7f2074101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.112+0000 7f2078a39640 1 --2- 172.21.15.17:0/767347763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2074101900 0x7f2074101d60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2068009880 tx=0x7f206802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.112+0000 7f2078a39640 1 -- 172.21.15.17:0/767347763 shutdown_connections 2024-09-20T18:51:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.112+0000 7f2078a39640 1 --2- 172.21.15.17:0/767347763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2074101900 0x7f2074101d60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.112+0000 7f2078a39640 1 --2- 172.21.15.17:0/767347763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2074107900 0x7f2074107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.112+0000 7f2078a39640 1 -- 172.21.15.17:0/767347763 >> 172.21.15.17:0/767347763 conn(0x7f20740fd600 msgr2=0x7f20740ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.112+0000 7f2078a39640 1 -- 172.21.15.17:0/767347763 shutdown_connections 2024-09-20T18:51:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.112+0000 7f2078a39640 1 -- 172.21.15.17:0/767347763 wait complete. 2024-09-20T18:51:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.113+0000 7f2078a39640 1 Processor -- start 2024-09-20T18:51:39.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.113+0000 7f2078a39640 1 -- start start 2024-09-20T18:51:39.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.113+0000 7f2078a39640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2074101900 0x7f207419f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:39.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.113+0000 7f2078a39640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2074107900 0x7f207419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:39.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.113+0000 7f2078a39640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f207410edd0 con 0x7f2074101900 2024-09-20T18:51:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.113+0000 7f2078a39640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f207410ec50 con 0x7f2074107900 2024-09-20T18:51:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.114+0000 7f207259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2074101900 0x7f207419f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.114+0000 7f207259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2074101900 0x7f207419f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36212/0 (socket says 172.21.15.17:36212) 2024-09-20T18:51:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.114+0000 7f207259c640 1 -- 172.21.15.17:0/2022172992 learned_addr learned my addr 172.21.15.17:0/2022172992 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:51:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.114+0000 7f2071d9b640 1 --2- 172.21.15.17:0/2022172992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2074107900 0x7f207419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.114+0000 7f207259c640 1 -- 172.21.15.17:0/2022172992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2074107900 msgr2=0x7f207419fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.114+0000 7f207259c640 1 --2- 172.21.15.17:0/2022172992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2074107900 0x7f207419fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.114+0000 7f207259c640 1 -- 172.21.15.17:0/2022172992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2074199a10 con 0x7f2074101900 2024-09-20T18:51:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.114+0000 7f2071d9b640 1 --2- 172.21.15.17:0/2022172992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2074107900 0x7f207419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:51:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.114+0000 7f207259c640 1 --2- 172.21.15.17:0/2022172992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2074101900 0x7f207419f850 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f206400d6f0 tx=0x7f206400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.114+0000 7f20637fe640 1 -- 172.21.15.17:0/2022172992 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2064017070 con 0x7f2074101900 2024-09-20T18:51:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.114+0000 7f20637fe640 1 -- 172.21.15.17:0/2022172992 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f206400de00 con 0x7f2074101900 2024-09-20T18:51:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.114+0000 7f2078a39640 1 -- 172.21.15.17:0/2022172992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2074199d00 con 0x7f2074101900 2024-09-20T18:51:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.114+0000 7f20637fe640 1 -- 172.21.15.17:0/2022172992 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2064004bb0 con 0x7f2074101900 2024-09-20T18:51:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.114+0000 7f2078a39640 1 -- 172.21.15.17:0/2022172992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f207419a260 con 0x7f2074101900 2024-09-20T18:51:39.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.116+0000 7f2078a39640 1 -- 172.21.15.17:0/2022172992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2074103040 con 0x7f2074101900 2024-09-20T18:51:39.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.116+0000 7f20637fe640 1 -- 172.21.15.17:0/2022172992 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2064009a30 con 0x7f2074101900 2024-09-20T18:51:39.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.117+0000 7f20637fe640 1 --2- 172.21.15.17:0/2022172992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f205c07af80 0x7f205c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:39.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.117+0000 7f20637fe640 1 -- 172.21.15.17:0/2022172992 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f206409db70 con 0x7f2074101900 2024-09-20T18:51:39.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.117+0000 7f2071d9b640 1 --2- 172.21.15.17:0/2022172992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f205c07af80 0x7f205c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:39.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.117+0000 7f2071d9b640 1 --2- 172.21.15.17:0/2022172992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f205c07af80 0x7f205c07d440 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f207419b200 tx=0x7f2068031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:39.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.121+0000 7f20637fe640 1 -- 172.21.15.17:0/2022172992 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f20640691f0 con 0x7f2074101900 2024-09-20T18:51:39.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:38 smithi172 ceph-mon[80431]: from='client.34734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:51:39.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:38 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2507546219' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:51:39.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.325+0000 7f2078a39640 1 -- 172.21.15.17:0/2022172992 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f207419afb0 con 0x7f205c07af80 2024-09-20T18:51:39.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.327+0000 7f20637fe640 1 -- 172.21.15.17:0/2022172992 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f207419afb0 con 0x7f205c07af80 2024-09-20T18:51:39.344 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:51:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:51:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:51:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:51:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:51:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:51:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:51:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:51:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:51:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:51:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:51:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:51:39.345 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:51:39.346 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:51:39.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.329+0000 7f2078a39640 1 -- 172.21.15.17:0/2022172992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f205c07af80 msgr2=0x7f205c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:39.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.329+0000 7f2078a39640 1 --2- 172.21.15.17:0/2022172992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f205c07af80 0x7f205c07d440 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f207419b200 tx=0x7f2068031400 comp rx=0 tx=0).stop 2024-09-20T18:51:39.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.329+0000 7f2078a39640 1 -- 172.21.15.17:0/2022172992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2074101900 msgr2=0x7f207419f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:39.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.329+0000 7f2078a39640 1 --2- 172.21.15.17:0/2022172992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2074101900 0x7f207419f850 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f206400d6f0 tx=0x7f206400dbb0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.329+0000 7f2078a39640 1 -- 172.21.15.17:0/2022172992 shutdown_connections 2024-09-20T18:51:39.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.329+0000 7f2078a39640 1 --2- 172.21.15.17:0/2022172992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f205c07af80 0x7f205c07d440 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.329+0000 7f2078a39640 1 --2- 172.21.15.17:0/2022172992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2074107900 0x7f207419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.329+0000 7f2078a39640 1 --2- 172.21.15.17:0/2022172992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2074101900 0x7f207419f850 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.329+0000 7f2078a39640 1 -- 172.21.15.17:0/2022172992 >> 172.21.15.17:0/2022172992 conn(0x7f20740fd600 msgr2=0x7f2074074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:39.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.329+0000 7f2078a39640 1 -- 172.21.15.17:0/2022172992 shutdown_connections 2024-09-20T18:51:39.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.329+0000 7f2078a39640 1 -- 172.21.15.17:0/2022172992 wait complete. 2024-09-20T18:51:39.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.413+0000 7f766e184640 1 -- 172.21.15.17:0/4198763861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7668100a90 msgr2=0x7f76681065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:39.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.413+0000 7f766e184640 1 --2- 172.21.15.17:0/4198763861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7668100a90 0x7f76681065d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f765c009880 tx=0x7f765c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.413+0000 7f766e184640 1 -- 172.21.15.17:0/4198763861 shutdown_connections 2024-09-20T18:51:39.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.413+0000 7f766e184640 1 --2- 172.21.15.17:0/4198763861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7668100a90 0x7f76681065d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.413+0000 7f766e184640 1 --2- 172.21.15.17:0/4198763861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76681000e0 0x7f76681004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.413+0000 7f766e184640 1 -- 172.21.15.17:0/4198763861 >> 172.21.15.17:0/4198763861 conn(0x7f76680fbc90 msgr2=0x7f76680fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:39.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.413+0000 7f766e184640 1 -- 172.21.15.17:0/4198763861 shutdown_connections 2024-09-20T18:51:39.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.413+0000 7f766e184640 1 -- 172.21.15.17:0/4198763861 wait complete. 2024-09-20T18:51:39.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.413+0000 7f766e184640 1 Processor -- start 2024-09-20T18:51:39.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.414+0000 7f766e184640 1 -- start start 2024-09-20T18:51:39.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.414+0000 7f766e184640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76681000e0 0x7f7668101060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:39.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.414+0000 7f766e184640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7668100a90 0x7f76681015a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:39.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.414+0000 7f766e184640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f766810ee50 con 0x7f76681000e0 2024-09-20T18:51:39.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.414+0000 7f766e184640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f766810ecd0 con 0x7f7668100a90 2024-09-20T18:51:39.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.414+0000 7f76677fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76681000e0 0x7f7668101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.414+0000 7f76677fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76681000e0 0x7f7668101060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36234/0 (socket says 172.21.15.17:36234) 2024-09-20T18:51:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.414+0000 7f76677fe640 1 -- 172.21.15.17:0/4175788058 learned_addr learned my addr 172.21.15.17:0/4175788058 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:51:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.414+0000 7f7666ffd640 1 --2- 172.21.15.17:0/4175788058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7668100a90 0x7f76681015a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.414+0000 7f76677fe640 1 -- 172.21.15.17:0/4175788058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7668100a90 msgr2=0x7f76681015a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.414+0000 7f76677fe640 1 --2- 172.21.15.17:0/4175788058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7668100a90 0x7f76681015a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.414+0000 7f76677fe640 1 -- 172.21.15.17:0/4175788058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7668101ae0 con 0x7f76681000e0 2024-09-20T18:51:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.415+0000 7f76677fe640 1 --2- 172.21.15.17:0/4175788058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76681000e0 0x7f7668101060 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f765800cc60 tx=0x7f765800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.415+0000 7f7664ff9640 1 -- 172.21.15.17:0/4175788058 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f765800ad30 con 0x7f76681000e0 2024-09-20T18:51:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.415+0000 7f7664ff9640 1 -- 172.21.15.17:0/4175788058 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7658005020 con 0x7f76681000e0 2024-09-20T18:51:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.415+0000 7f766e184640 1 -- 172.21.15.17:0/4175788058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7668101dd0 con 0x7f76681000e0 2024-09-20T18:51:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.415+0000 7f7664ff9640 1 -- 172.21.15.17:0/4175788058 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f765800f640 con 0x7f76681000e0 2024-09-20T18:51:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.415+0000 7f766e184640 1 -- 172.21.15.17:0/4175788058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76681a3f80 con 0x7f76681000e0 2024-09-20T18:51:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.416+0000 7f766e184640 1 -- 172.21.15.17:0/4175788058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76681031a0 con 0x7f76681000e0 2024-09-20T18:51:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.417+0000 7f7664ff9640 1 -- 172.21.15.17:0/4175788058 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f76580051d0 con 0x7f76681000e0 2024-09-20T18:51:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.417+0000 7f7664ff9640 1 --2- 172.21.15.17:0/4175788058 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f765007af30 0x7f765007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:51:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.417+0000 7f7666ffd640 1 --2- 172.21.15.17:0/4175788058 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f765007af30 0x7f765007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:51:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.417+0000 7f7664ff9640 1 -- 172.21.15.17:0/4175788058 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f765809e2b0 con 0x7f76681000e0 2024-09-20T18:51:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.418+0000 7f7666ffd640 1 --2- 172.21.15.17:0/4175788058 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f765007af30 0x7f765007d3f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7668102af0 tx=0x7f765c031420 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:51:39.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.422+0000 7f7664ff9640 1 -- 172.21.15.17:0/4175788058 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7658014030 con 0x7f76681000e0 2024-09-20T18:51:39.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.688+0000 7f766e184640 1 -- 172.21.15.17:0/4175788058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f76681004c0 con 0x7f76681000e0 2024-09-20T18:51:39.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.688+0000 7f7664ff9640 1 -- 172.21.15.17:0/4175788058 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f76580698b0 con 0x7f76681000e0 2024-09-20T18:51:39.706 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:51:39.706 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:51:39.706 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:51:39.706 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:51:39.707 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:51:39.707 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:51:39.707 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:51:39.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.690+0000 7f766e184640 1 -- 172.21.15.17:0/4175788058 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f765007af30 msgr2=0x7f765007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:39.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.690+0000 7f766e184640 1 --2- 172.21.15.17:0/4175788058 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f765007af30 0x7f765007d3f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7668102af0 tx=0x7f765c031420 comp rx=0 tx=0).stop 2024-09-20T18:51:39.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.690+0000 7f766e184640 1 -- 172.21.15.17:0/4175788058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76681000e0 msgr2=0x7f7668101060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:51:39.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.690+0000 7f766e184640 1 --2- 172.21.15.17:0/4175788058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76681000e0 0x7f7668101060 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f765800cc60 tx=0x7f765800a620 comp rx=0 tx=0).stop 2024-09-20T18:51:39.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.691+0000 7f766e184640 1 -- 172.21.15.17:0/4175788058 shutdown_connections 2024-09-20T18:51:39.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.691+0000 7f766e184640 1 --2- 172.21.15.17:0/4175788058 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f765007af30 0x7f765007d3f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.691+0000 7f766e184640 1 --2- 172.21.15.17:0/4175788058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7668100a90 0x7f76681015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.691+0000 7f766e184640 1 --2- 172.21.15.17:0/4175788058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76681000e0 0x7f7668101060 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:51:39.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.691+0000 7f766e184640 1 -- 172.21.15.17:0/4175788058 >> 172.21.15.17:0/4175788058 conn(0x7f76680fbc90 msgr2=0x7f76680fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:51:39.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.691+0000 7f766e184640 1 -- 172.21.15.17:0/4175788058 shutdown_connections 2024-09-20T18:51:39.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:51:39.691+0000 7f766e184640 1 -- 172.21.15.17:0/4175788058 wait complete. 2024-09-20T18:51:40.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:39 smithi017 ceph-mon[108970]: from='client.34738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:51:40.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:39 smithi017 ceph-mon[108970]: from='client.34742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:51:40.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:39 smithi017 ceph-mon[108970]: pgmap v487: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:40.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:39 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3008507638' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:51:40.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:39 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4175788058' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:51:40.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:39 smithi172 ceph-mon[80431]: from='client.34738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:51:40.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:39 smithi172 ceph-mon[80431]: from='client.34742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:51:40.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:39 smithi172 ceph-mon[80431]: pgmap v487: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:40.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:39 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3008507638' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:51:40.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:39 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4175788058' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:51:40.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:40 smithi017 ceph-mon[108970]: from='client.34754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:51:41.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:40 smithi172 ceph-mon[80431]: from='client.34754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:51:42.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:41 smithi017 ceph-mon[108970]: pgmap v488: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:42.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:41 smithi172 ceph-mon[80431]: pgmap v488: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:43.301 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:42 smithi172 ceph-mon[80431]: pgmap v489: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:43.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:42 smithi017 ceph-mon[108970]: pgmap v489: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:45.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:45 smithi017 ceph-mon[108970]: pgmap v490: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:45.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:45 smithi172 ceph-mon[80431]: pgmap v490: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:47.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:47 smithi017 ceph-mon[108970]: pgmap v491: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:47.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:47 smithi172 ceph-mon[80431]: pgmap v491: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:49.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:49 smithi017 ceph-mon[108970]: pgmap v492: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:49.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:49 smithi172 ceph-mon[80431]: pgmap v492: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:51.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:51 smithi017 ceph-mon[108970]: pgmap v493: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:51.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:51 smithi172 ceph-mon[80431]: pgmap v493: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:52.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:51:52.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:51:53.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:53 smithi172 ceph-mon[80431]: pgmap v494: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:53.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:53 smithi017 ceph-mon[108970]: pgmap v494: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:55 smithi017 ceph-mon[108970]: pgmap v495: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:55.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:55 smithi172 ceph-mon[80431]: pgmap v495: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:57.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:57 smithi017 ceph-mon[108970]: pgmap v496: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:57.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:57 smithi172 ceph-mon[80431]: pgmap v496: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:59.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:51:59 smithi017 ceph-mon[108970]: pgmap v497: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:51:59.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:51:59 smithi172 ceph-mon[80431]: pgmap v497: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:01.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:01 smithi017 ceph-mon[108970]: pgmap v498: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:01.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:01 smithi172 ceph-mon[80431]: pgmap v498: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:03.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:03 smithi017 ceph-mon[108970]: pgmap v499: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:03.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:03 smithi172 ceph-mon[80431]: pgmap v499: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:05.892 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:05 smithi017 ceph-mon[108970]: pgmap v500: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:05.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:05 smithi172 ceph-mon[80431]: pgmap v500: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:07.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:07 smithi017 ceph-mon[108970]: pgmap v501: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:07.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:52:07.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:07 smithi172 ceph-mon[80431]: pgmap v501: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:07.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:52:09.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.790+0000 7f602a89e640 1 -- 172.21.15.17:0/686491488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024102b70 msgr2=0x7f6024102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:09.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.790+0000 7f602a89e640 1 --2- 172.21.15.17:0/686491488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024102b70 0x7f6024102f50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6014009880 tx=0x7f601402a530 comp rx=0 tx=0).stop 2024-09-20T18:52:09.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.790+0000 7f602a89e640 1 -- 172.21.15.17:0/686491488 shutdown_connections 2024-09-20T18:52:09.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.790+0000 7f602a89e640 1 --2- 172.21.15.17:0/686491488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6024103490 0x7f602410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:09.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.790+0000 7f602a89e640 1 --2- 172.21.15.17:0/686491488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024102b70 0x7f6024102f50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:09.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.790+0000 7f602a89e640 1 -- 172.21.15.17:0/686491488 >> 172.21.15.17:0/686491488 conn(0x7f60240fc550 msgr2=0x7f60240fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:09.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.790+0000 7f602a89e640 1 -- 172.21.15.17:0/686491488 shutdown_connections 2024-09-20T18:52:09.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.790+0000 7f602a89e640 1 -- 172.21.15.17:0/686491488 wait complete. 2024-09-20T18:52:09.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.791+0000 7f602a89e640 1 Processor -- start 2024-09-20T18:52:09.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.791+0000 7f602a89e640 1 -- start start 2024-09-20T18:52:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.791+0000 7f602a89e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6024102b70 0x7f602419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.791+0000 7f602a89e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024103490 0x7f602419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.791+0000 7f602a89e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f602410edc0 con 0x7f6024103490 2024-09-20T18:52:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.791+0000 7f602a89e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f602410ec40 con 0x7f6024102b70 2024-09-20T18:52:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.792+0000 7f60237fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024103490 0x7f602419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.792+0000 7f60237fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024103490 0x7f602419db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34344/0 (socket says 172.21.15.17:34344) 2024-09-20T18:52:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.792+0000 7f60237fe640 1 -- 172.21.15.17:0/2383681075 learned_addr learned my addr 172.21.15.17:0/2383681075 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:52:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.792+0000 7f6023fff640 1 --2- 172.21.15.17:0/2383681075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6024102b70 0x7f602419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.792+0000 7f60237fe640 1 -- 172.21.15.17:0/2383681075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6024102b70 msgr2=0x7f602419d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.792+0000 7f60237fe640 1 --2- 172.21.15.17:0/2383681075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6024102b70 0x7f602419d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.792+0000 7f60237fe640 1 -- 172.21.15.17:0/2383681075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60241977b0 con 0x7f6024103490 2024-09-20T18:52:09.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.792+0000 7f6023fff640 1 --2- 172.21.15.17:0/2383681075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6024102b70 0x7f602419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:52:09.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.792+0000 7f60237fe640 1 --2- 172.21.15.17:0/2383681075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024103490 0x7f602419db70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f601800d8d0 tx=0x7f601800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:09.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.792+0000 7f60217fa640 1 -- 172.21.15.17:0/2383681075 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6018017070 con 0x7f6024103490 2024-09-20T18:52:09.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.792+0000 7f60217fa640 1 -- 172.21.15.17:0/2383681075 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6018010460 con 0x7f6024103490 2024-09-20T18:52:09.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.792+0000 7f602a89e640 1 -- 172.21.15.17:0/2383681075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6024197aa0 con 0x7f6024103490 2024-09-20T18:52:09.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.792+0000 7f60217fa640 1 -- 172.21.15.17:0/2383681075 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f601800f5f0 con 0x7f6024103490 2024-09-20T18:52:09.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.792+0000 7f602a89e640 1 -- 172.21.15.17:0/2383681075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6024198030 con 0x7f6024103490 2024-09-20T18:52:09.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.794+0000 7f602a89e640 1 -- 172.21.15.17:0/2383681075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f602406a4c0 con 0x7f6024103490 2024-09-20T18:52:09.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.794+0000 7f60217fa640 1 -- 172.21.15.17:0/2383681075 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6018009a30 con 0x7f6024103490 2024-09-20T18:52:09.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.795+0000 7f60217fa640 1 --2- 172.21.15.17:0/2383681075 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f600c07af40 0x7f600c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:09.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.795+0000 7f60217fa640 1 -- 172.21.15.17:0/2383681075 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f601809dee0 con 0x7f6024103490 2024-09-20T18:52:09.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.795+0000 7f6023fff640 1 --2- 172.21.15.17:0/2383681075 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f600c07af40 0x7f600c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:09.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.796+0000 7f6023fff640 1 --2- 172.21.15.17:0/2383681075 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f600c07af40 0x7f600c07d400 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6014000c00 tx=0x7f6014004f30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:09.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:09.799+0000 7f60217fa640 1 -- 172.21.15.17:0/2383681075 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60180694e0 con 0x7f6024103490 2024-09-20T18:52:09.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:09 smithi017 ceph-mon[108970]: pgmap v502: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:09.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:09 smithi172 ceph-mon[80431]: pgmap v502: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:10.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.006+0000 7f602a89e640 1 -- 172.21.15.17:0/2383681075 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f60241982e0 con 0x7f600c07af40 2024-09-20T18:52:10.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.007+0000 7f60217fa640 1 -- 172.21.15.17:0/2383681075 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f60241982e0 con 0x7f600c07af40 2024-09-20T18:52:10.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.009+0000 7f602a89e640 1 -- 172.21.15.17:0/2383681075 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f600c07af40 msgr2=0x7f600c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:10.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.009+0000 7f602a89e640 1 --2- 172.21.15.17:0/2383681075 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f600c07af40 0x7f600c07d400 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6014000c00 tx=0x7f6014004f30 comp rx=0 tx=0).stop 2024-09-20T18:52:10.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.009+0000 7f602a89e640 1 -- 172.21.15.17:0/2383681075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024103490 msgr2=0x7f602419db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:10.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.009+0000 7f602a89e640 1 --2- 172.21.15.17:0/2383681075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024103490 0x7f602419db70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f601800d8d0 tx=0x7f601800dd90 comp rx=0 tx=0).stop 2024-09-20T18:52:10.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.010+0000 7f602a89e640 1 -- 172.21.15.17:0/2383681075 shutdown_connections 2024-09-20T18:52:10.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.010+0000 7f602a89e640 1 --2- 172.21.15.17:0/2383681075 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f600c07af40 0x7f600c07d400 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.010+0000 7f602a89e640 1 --2- 172.21.15.17:0/2383681075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024103490 0x7f602419db70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.010+0000 7f602a89e640 1 --2- 172.21.15.17:0/2383681075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6024102b70 0x7f602419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.010+0000 7f602a89e640 1 -- 172.21.15.17:0/2383681075 >> 172.21.15.17:0/2383681075 conn(0x7f60240fc550 msgr2=0x7f6024108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:10.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.010+0000 7f602a89e640 1 -- 172.21.15.17:0/2383681075 shutdown_connections 2024-09-20T18:52:10.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.010+0000 7f602a89e640 1 -- 172.21.15.17:0/2383681075 wait complete. 2024-09-20T18:52:10.036 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:52:10.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.096+0000 7faf832cb640 1 -- 172.21.15.17:0/2947501817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c100800 msgr2=0x7faf7c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.096+0000 7faf832cb640 1 --2- 172.21.15.17:0/2947501817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c100800 0x7faf7c100c60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009880 tx=0x7faf6c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.096+0000 7faf832cb640 1 -- 172.21.15.17:0/2947501817 shutdown_connections 2024-09-20T18:52:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.096+0000 7faf832cb640 1 --2- 172.21.15.17:0/2947501817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c100800 0x7faf7c100c60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.096+0000 7faf832cb640 1 --2- 172.21.15.17:0/2947501817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf7c106800 0x7faf7c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.096+0000 7faf832cb640 1 -- 172.21.15.17:0/2947501817 >> 172.21.15.17:0/2947501817 conn(0x7faf7c0fc520 msgr2=0x7faf7c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.096+0000 7faf832cb640 1 -- 172.21.15.17:0/2947501817 shutdown_connections 2024-09-20T18:52:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.096+0000 7faf832cb640 1 -- 172.21.15.17:0/2947501817 wait complete. 2024-09-20T18:52:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.097+0000 7faf832cb640 1 Processor -- start 2024-09-20T18:52:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.097+0000 7faf832cb640 1 -- start start 2024-09-20T18:52:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.097+0000 7faf832cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c100800 0x7faf7c10b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.097+0000 7faf832cb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf7c106800 0x7faf7c10bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.097+0000 7faf832cb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c10edd0 con 0x7faf7c100800 2024-09-20T18:52:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.097+0000 7faf832cb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c10ec50 con 0x7faf7c106800 2024-09-20T18:52:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.097+0000 7faf81067640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c100800 0x7faf7c10b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.097+0000 7faf81067640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c100800 0x7faf7c10b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34366/0 (socket says 172.21.15.17:34366) 2024-09-20T18:52:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.097+0000 7faf81067640 1 -- 172.21.15.17:0/1654960496 learned_addr learned my addr 172.21.15.17:0/1654960496 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:52:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.097+0000 7faf80866640 1 --2- 172.21.15.17:0/1654960496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf7c106800 0x7faf7c10bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.097+0000 7faf81067640 1 -- 172.21.15.17:0/1654960496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf7c106800 msgr2=0x7faf7c10bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.097+0000 7faf81067640 1 --2- 172.21.15.17:0/1654960496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf7c106800 0x7faf7c10bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.097+0000 7faf81067640 1 -- 172.21.15.17:0/1654960496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7c10c210 con 0x7faf7c100800 2024-09-20T18:52:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.097+0000 7faf80866640 1 --2- 172.21.15.17:0/1654960496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf7c106800 0x7faf7c10bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:52:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.098+0000 7faf81067640 1 --2- 172.21.15.17:0/1654960496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c100800 0x7faf7c10b790 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faf7800d6f0 tx=0x7faf7800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.098+0000 7faf727fc640 1 -- 172.21.15.17:0/1654960496 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf78017070 con 0x7faf7c100800 2024-09-20T18:52:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.098+0000 7faf727fc640 1 -- 172.21.15.17:0/1654960496 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf7800de00 con 0x7faf7c100800 2024-09-20T18:52:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.098+0000 7faf832cb640 1 -- 172.21.15.17:0/1654960496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf7c10c500 con 0x7faf7c100800 2024-09-20T18:52:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.098+0000 7faf727fc640 1 -- 172.21.15.17:0/1654960496 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf78004bb0 con 0x7faf7c100800 2024-09-20T18:52:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.098+0000 7faf832cb640 1 -- 172.21.15.17:0/1654960496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf7c1a3e20 con 0x7faf7c100800 2024-09-20T18:52:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.099+0000 7faf832cb640 1 -- 172.21.15.17:0/1654960496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf7c101f40 con 0x7faf7c100800 2024-09-20T18:52:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.100+0000 7faf727fc640 1 -- 172.21.15.17:0/1654960496 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7faf78009a30 con 0x7faf7c100800 2024-09-20T18:52:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.100+0000 7faf727fc640 1 --2- 172.21.15.17:0/1654960496 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faf6807af80 0x7faf6807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.100+0000 7faf727fc640 1 -- 172.21.15.17:0/1654960496 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7faf7809db80 con 0x7faf7c100800 2024-09-20T18:52:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.100+0000 7faf80866640 1 --2- 172.21.15.17:0/1654960496 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faf6807af80 0x7faf6807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.101+0000 7faf80866640 1 --2- 172.21.15.17:0/1654960496 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faf6807af80 0x7faf6807d440 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faf7c10d220 tx=0x7faf6c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.105+0000 7faf727fc640 1 -- 172.21.15.17:0/1654960496 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faf78069200 con 0x7faf7c100800 2024-09-20T18:52:10.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.312+0000 7faf832cb640 1 -- 172.21.15.17:0/1654960496 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7faf7c062630 con 0x7faf6807af80 2024-09-20T18:52:10.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.314+0000 7faf727fc640 1 -- 172.21.15.17:0/1654960496 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7faf7c062630 con 0x7faf6807af80 2024-09-20T18:52:10.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.316+0000 7faf832cb640 1 -- 172.21.15.17:0/1654960496 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faf6807af80 msgr2=0x7faf6807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:10.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.316+0000 7faf832cb640 1 --2- 172.21.15.17:0/1654960496 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faf6807af80 0x7faf6807d440 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faf7c10d220 tx=0x7faf6c031400 comp rx=0 tx=0).stop 2024-09-20T18:52:10.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.317+0000 7faf832cb640 1 -- 172.21.15.17:0/1654960496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c100800 msgr2=0x7faf7c10b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:10.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.317+0000 7faf832cb640 1 --2- 172.21.15.17:0/1654960496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c100800 0x7faf7c10b790 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faf7800d6f0 tx=0x7faf7800dbb0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.317+0000 7faf832cb640 1 -- 172.21.15.17:0/1654960496 shutdown_connections 2024-09-20T18:52:10.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.317+0000 7faf832cb640 1 --2- 172.21.15.17:0/1654960496 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faf6807af80 0x7faf6807d440 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.317+0000 7faf832cb640 1 --2- 172.21.15.17:0/1654960496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf7c106800 0x7faf7c10bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.317+0000 7faf832cb640 1 --2- 172.21.15.17:0/1654960496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c100800 0x7faf7c10b790 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.317+0000 7faf832cb640 1 -- 172.21.15.17:0/1654960496 >> 172.21.15.17:0/1654960496 conn(0x7faf7c0fc520 msgr2=0x7faf7c0fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:10.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.317+0000 7faf832cb640 1 -- 172.21.15.17:0/1654960496 shutdown_connections 2024-09-20T18:52:10.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.317+0000 7faf832cb640 1 -- 172.21.15.17:0/1654960496 wait complete. 2024-09-20T18:52:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.400+0000 7f24d5138640 1 -- 172.21.15.17:0/2209833879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24d0107900 msgr2=0x7f24d0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.400+0000 7f24d5138640 1 --2- 172.21.15.17:0/2209833879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24d0107900 0x7f24d0107ce0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009880 tx=0x7f24c002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.400+0000 7f24d5138640 1 -- 172.21.15.17:0/2209833879 shutdown_connections 2024-09-20T18:52:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.400+0000 7f24d5138640 1 --2- 172.21.15.17:0/2209833879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24d0101900 0x7f24d0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.400+0000 7f24d5138640 1 --2- 172.21.15.17:0/2209833879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24d0107900 0x7f24d0107ce0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.400+0000 7f24d5138640 1 -- 172.21.15.17:0/2209833879 >> 172.21.15.17:0/2209833879 conn(0x7f24d00fd600 msgr2=0x7f24d00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:10.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.401+0000 7f24d5138640 1 -- 172.21.15.17:0/2209833879 shutdown_connections 2024-09-20T18:52:10.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.401+0000 7f24d5138640 1 -- 172.21.15.17:0/2209833879 wait complete. 2024-09-20T18:52:10.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.401+0000 7f24d5138640 1 Processor -- start 2024-09-20T18:52:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.401+0000 7f24d5138640 1 -- start start 2024-09-20T18:52:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.402+0000 7f24d5138640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24d0101900 0x7f24d019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.402+0000 7f24d5138640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24d0107900 0x7f24d019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.402+0000 7f24d5138640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f24d010edd0 con 0x7f24d0107900 2024-09-20T18:52:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.402+0000 7f24d5138640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f24d010ec50 con 0x7f24d0101900 2024-09-20T18:52:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.402+0000 7f24ce59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24d0107900 0x7f24d019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:10.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.402+0000 7f24ce59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24d0107900 0x7f24d019db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34382/0 (socket says 172.21.15.17:34382) 2024-09-20T18:52:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.402+0000 7f24ce59c640 1 -- 172.21.15.17:0/4021118260 learned_addr learned my addr 172.21.15.17:0/4021118260 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:52:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.402+0000 7f24ced9d640 1 --2- 172.21.15.17:0/4021118260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24d0101900 0x7f24d019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.402+0000 7f24ce59c640 1 -- 172.21.15.17:0/4021118260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24d0101900 msgr2=0x7f24d019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.402+0000 7f24ce59c640 1 --2- 172.21.15.17:0/4021118260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24d0101900 0x7f24d019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.402+0000 7f24ce59c640 1 -- 172.21.15.17:0/4021118260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d01977a0 con 0x7f24d0107900 2024-09-20T18:52:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.402+0000 7f24ce59c640 1 --2- 172.21.15.17:0/4021118260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24d0107900 0x7f24d019db60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f24c400e970 tx=0x7f24c400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.403+0000 7f24b7fff640 1 -- 172.21.15.17:0/4021118260 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24c400cac0 con 0x7f24d0107900 2024-09-20T18:52:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.403+0000 7f24d5138640 1 -- 172.21.15.17:0/4021118260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d0197a90 con 0x7f24d0107900 2024-09-20T18:52:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.403+0000 7f24b7fff640 1 -- 172.21.15.17:0/4021118260 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f24c40054e0 con 0x7f24d0107900 2024-09-20T18:52:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.403+0000 7f24b7fff640 1 -- 172.21.15.17:0/4021118260 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24c4010430 con 0x7f24d0107900 2024-09-20T18:52:10.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.403+0000 7f24d5138640 1 -- 172.21.15.17:0/4021118260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d0198020 con 0x7f24d0107900 2024-09-20T18:52:10.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.404+0000 7f24d5138640 1 -- 172.21.15.17:0/4021118260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d0103040 con 0x7f24d0107900 2024-09-20T18:52:10.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.404+0000 7f24b7fff640 1 -- 172.21.15.17:0/4021118260 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f24c4004f00 con 0x7f24d0107900 2024-09-20T18:52:10.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.405+0000 7f24b7fff640 1 --2- 172.21.15.17:0/4021118260 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24b807af30 0x7f24b807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:10.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.405+0000 7f24b7fff640 1 -- 172.21.15.17:0/4021118260 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f24c409e770 con 0x7f24d0107900 2024-09-20T18:52:10.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.405+0000 7f24ced9d640 1 --2- 172.21.15.17:0/4021118260 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24b807af30 0x7f24b807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:10.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.405+0000 7f24ced9d640 1 --2- 172.21.15.17:0/4021118260 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24b807af30 0x7f24b807d3f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f24c00096c0 tx=0x7f24c0031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:10.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.409+0000 7f24b7fff640 1 -- 172.21.15.17:0/4021118260 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24c4069d70 con 0x7f24d0107900 2024-09-20T18:52:10.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.608+0000 7f24d5138640 1 -- 172.21.15.17:0/4021118260 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f24d0198330 con 0x7f24b807af30 2024-09-20T18:52:10.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.618+0000 7f24b7fff640 1 -- 172.21.15.17:0/4021118260 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f24d0198330 con 0x7f24b807af30 2024-09-20T18:52:10.837 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:52:10.837 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (13m) 7m ago 24m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:52:10.837 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (16m) 7m ago 24m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:52:10.837 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (16m) 7m ago 23m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:52:10.837 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (11m) 7m ago 24m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:52:10.837 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (11m) 7m ago 23m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:52:10.837 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (13m) 7m ago 24m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:52:10.837 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (8m) 7m ago 19m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:52:10.837 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (7m) 7m ago 19m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:52:10.837 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (19m) 7m ago 19m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:52:10.838 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (7m) 7m ago 19m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:52:10.838 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (15m) 7m ago 25m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:52:10.838 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (14m) 7m ago 23m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:52:10.838 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (12m) 7m ago 25m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:52:10.838 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (12m) 7m ago 23m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:52:10.838 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (14m) 7m ago 24m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:52:10.838 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (14m) 7m ago 23m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:52:10.838 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (11m) 7m ago 22m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:52:10.838 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (10m) 7m ago 22m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:52:10.838 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (10m) 7m ago 21m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:52:10.838 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (9m) 7m ago 21m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:52:10.839 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (8m) 7m ago 20m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:52:10.839 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (8m) 7m ago 20m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:52:10.839 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (13m) 7m ago 24m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:52:10.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.620+0000 7f24d5138640 1 -- 172.21.15.17:0/4021118260 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24b807af30 msgr2=0x7f24b807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:10.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.620+0000 7f24d5138640 1 --2- 172.21.15.17:0/4021118260 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24b807af30 0x7f24b807d3f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f24c00096c0 tx=0x7f24c0031400 comp rx=0 tx=0).stop 2024-09-20T18:52:10.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.620+0000 7f24d5138640 1 -- 172.21.15.17:0/4021118260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24d0107900 msgr2=0x7f24d019db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:10.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.620+0000 7f24d5138640 1 --2- 172.21.15.17:0/4021118260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24d0107900 0x7f24d019db60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f24c400e970 tx=0x7f24c400ed70 comp rx=0 tx=0).stop 2024-09-20T18:52:10.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.620+0000 7f24d5138640 1 -- 172.21.15.17:0/4021118260 shutdown_connections 2024-09-20T18:52:10.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.620+0000 7f24d5138640 1 --2- 172.21.15.17:0/4021118260 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24b807af30 0x7f24b807d3f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.620+0000 7f24d5138640 1 --2- 172.21.15.17:0/4021118260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24d0107900 0x7f24d019db60 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.620+0000 7f24d5138640 1 --2- 172.21.15.17:0/4021118260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24d0101900 0x7f24d019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.620+0000 7f24d5138640 1 -- 172.21.15.17:0/4021118260 >> 172.21.15.17:0/4021118260 conn(0x7f24d00fd600 msgr2=0x7f24d00fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:10.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.620+0000 7f24d5138640 1 -- 172.21.15.17:0/4021118260 shutdown_connections 2024-09-20T18:52:10.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.620+0000 7f24d5138640 1 -- 172.21.15.17:0/4021118260 wait complete. 2024-09-20T18:52:10.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.704+0000 7f5a74bd5640 1 -- 172.21.15.17:0/865593919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a701007f0 msgr2=0x7f5a70100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:10.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.704+0000 7f5a74bd5640 1 --2- 172.21.15.17:0/865593919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a701007f0 0x7f5a70100c50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5a64009880 tx=0x7f5a6402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.704+0000 7f5a74bd5640 1 -- 172.21.15.17:0/865593919 shutdown_connections 2024-09-20T18:52:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.704+0000 7f5a74bd5640 1 --2- 172.21.15.17:0/865593919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a701007f0 0x7f5a70100c50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.704+0000 7f5a74bd5640 1 --2- 172.21.15.17:0/865593919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a701067f0 0x7f5a70106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.704+0000 7f5a74bd5640 1 -- 172.21.15.17:0/865593919 >> 172.21.15.17:0/865593919 conn(0x7f5a700fc550 msgr2=0x7f5a700fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.704+0000 7f5a74bd5640 1 -- 172.21.15.17:0/865593919 shutdown_connections 2024-09-20T18:52:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.704+0000 7f5a74bd5640 1 -- 172.21.15.17:0/865593919 wait complete. 2024-09-20T18:52:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.705+0000 7f5a74bd5640 1 Processor -- start 2024-09-20T18:52:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.705+0000 7f5a74bd5640 1 -- start start 2024-09-20T18:52:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.705+0000 7f5a74bd5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a701007f0 0x7f5a7019c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:10.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.705+0000 7f5a74bd5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a701067f0 0x7f5a7019cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.705+0000 7f5a74bd5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7010dcc0 con 0x7f5a701067f0 2024-09-20T18:52:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.705+0000 7f5a74bd5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7010db40 con 0x7f5a701007f0 2024-09-20T18:52:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.705+0000 7f5a6dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a701067f0 0x7f5a7019cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.705+0000 7f5a6dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a701067f0 0x7f5a7019cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50124/0 (socket says 172.21.15.17:50124) 2024-09-20T18:52:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.705+0000 7f5a6dd9b640 1 -- 172.21.15.17:0/1598582425 learned_addr learned my addr 172.21.15.17:0/1598582425 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:52:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.705+0000 7f5a6e59c640 1 --2- 172.21.15.17:0/1598582425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a701007f0 0x7f5a7019c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.705+0000 7f5a6dd9b640 1 -- 172.21.15.17:0/1598582425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a701007f0 msgr2=0x7f5a7019c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.705+0000 7f5a6dd9b640 1 --2- 172.21.15.17:0/1598582425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a701007f0 0x7f5a7019c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:10.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.705+0000 7f5a6dd9b640 1 -- 172.21.15.17:0/1598582425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a701966b0 con 0x7f5a701067f0 2024-09-20T18:52:10.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.706+0000 7f5a6dd9b640 1 --2- 172.21.15.17:0/1598582425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a701067f0 0x7f5a7019cb20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5a64031460 tx=0x7f5a640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:10.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.706+0000 7f5a5f7fe640 1 -- 172.21.15.17:0/1598582425 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a6403f070 con 0x7f5a701067f0 2024-09-20T18:52:10.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.706+0000 7f5a74bd5640 1 -- 172.21.15.17:0/1598582425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a70196940 con 0x7f5a701067f0 2024-09-20T18:52:10.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.706+0000 7f5a5f7fe640 1 -- 172.21.15.17:0/1598582425 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5a64004cf0 con 0x7f5a701067f0 2024-09-20T18:52:10.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.706+0000 7f5a5f7fe640 1 -- 172.21.15.17:0/1598582425 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a64035030 con 0x7f5a701067f0 2024-09-20T18:52:10.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.706+0000 7f5a74bd5640 1 -- 172.21.15.17:0/1598582425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a70196e40 con 0x7f5a701067f0 2024-09-20T18:52:10.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.707+0000 7f5a74bd5640 1 -- 172.21.15.17:0/1598582425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a70101f30 con 0x7f5a701067f0 2024-09-20T18:52:10.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.708+0000 7f5a5f7fe640 1 -- 172.21.15.17:0/1598582425 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5a64042070 con 0x7f5a701067f0 2024-09-20T18:52:10.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.708+0000 7f5a5f7fe640 1 --2- 172.21.15.17:0/1598582425 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5a5807af30 0x7f5a5807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:10.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.709+0000 7f5a5f7fe640 1 -- 172.21.15.17:0/1598582425 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f5a640bf100 con 0x7f5a701067f0 2024-09-20T18:52:10.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.709+0000 7f5a6e59c640 1 --2- 172.21.15.17:0/1598582425 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5a5807af30 0x7f5a5807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:10.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.709+0000 7f5a6e59c640 1 --2- 172.21.15.17:0/1598582425 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5a5807af30 0x7f5a5807d3f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5a600058c0 tx=0x7f5a6000a250 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:10.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.712+0000 7f5a5f7fe640 1 -- 172.21.15.17:0/1598582425 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5a6408a6e0 con 0x7f5a701067f0 2024-09-20T18:52:11.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.996+0000 7f5a74bd5640 1 -- 172.21.15.17:0/1598582425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5a70108d60 con 0x7f5a701067f0 2024-09-20T18:52:11.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.997+0000 7f5a5f7fe640 1 -- 172.21.15.17:0/1598582425 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f5a6408f590 con 0x7f5a701067f0 2024-09-20T18:52:11.015 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:52:11.015 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:52:11.015 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:52:11.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:52:11.015 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:52:11.015 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:52:11.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:52:11.015 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:52:11.015 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:52:11.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:52:11.016 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:52:11.016 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:52:11.016 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:52:11.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:52:11.016 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:52:11.016 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:52:11.016 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:52:11.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:52:11.016 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:52:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.999+0000 7f5a74bd5640 1 -- 172.21.15.17:0/1598582425 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5a5807af30 msgr2=0x7f5a5807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.999+0000 7f5a74bd5640 1 --2- 172.21.15.17:0/1598582425 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5a5807af30 0x7f5a5807d3f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5a600058c0 tx=0x7f5a6000a250 comp rx=0 tx=0).stop 2024-09-20T18:52:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.999+0000 7f5a74bd5640 1 -- 172.21.15.17:0/1598582425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a701067f0 msgr2=0x7f5a7019cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.999+0000 7f5a74bd5640 1 --2- 172.21.15.17:0/1598582425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a701067f0 0x7f5a7019cb20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5a64031460 tx=0x7f5a640048f0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.999+0000 7f5a74bd5640 1 -- 172.21.15.17:0/1598582425 shutdown_connections 2024-09-20T18:52:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.999+0000 7f5a74bd5640 1 --2- 172.21.15.17:0/1598582425 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5a5807af30 0x7f5a5807d3f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.999+0000 7f5a74bd5640 1 --2- 172.21.15.17:0/1598582425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a701067f0 0x7f5a7019cb20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.999+0000 7f5a74bd5640 1 --2- 172.21.15.17:0/1598582425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a701007f0 0x7f5a7019c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.999+0000 7f5a74bd5640 1 -- 172.21.15.17:0/1598582425 >> 172.21.15.17:0/1598582425 conn(0x7f5a700fc550 msgr2=0x7f5a700fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:11.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.999+0000 7f5a74bd5640 1 -- 172.21.15.17:0/1598582425 shutdown_connections 2024-09-20T18:52:11.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:10.999+0000 7f5a74bd5640 1 -- 172.21.15.17:0/1598582425 wait complete. 2024-09-20T18:52:11.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.084+0000 7fa6b89c3640 1 -- 172.21.15.17:0/806547295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6b41033e0 msgr2=0x7fa6b410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:11.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.084+0000 7fa6b89c3640 1 --2- 172.21.15.17:0/806547295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6b41033e0 0x7fa6b410b8d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009880 tx=0x7fa6a402a530 comp rx=0 tx=0).stop 2024-09-20T18:52:11.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.084+0000 7fa6b89c3640 1 -- 172.21.15.17:0/806547295 shutdown_connections 2024-09-20T18:52:11.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.084+0000 7fa6b89c3640 1 --2- 172.21.15.17:0/806547295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6b41033e0 0x7fa6b410b8d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.084+0000 7fa6b89c3640 1 --2- 172.21.15.17:0/806547295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6b4102ac0 0x7fa6b4102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.084+0000 7fa6b89c3640 1 -- 172.21.15.17:0/806547295 >> 172.21.15.17:0/806547295 conn(0x7fa6b40fc520 msgr2=0x7fa6b40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:11.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.084+0000 7fa6b89c3640 1 -- 172.21.15.17:0/806547295 shutdown_connections 2024-09-20T18:52:11.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.084+0000 7fa6b89c3640 1 -- 172.21.15.17:0/806547295 wait complete. 2024-09-20T18:52:11.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.085+0000 7fa6b89c3640 1 Processor -- start 2024-09-20T18:52:11.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.085+0000 7fa6b89c3640 1 -- start start 2024-09-20T18:52:11.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.085+0000 7fa6b89c3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6b4102ac0 0x7fa6b419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:11.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.085+0000 7fa6b89c3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6b41033e0 0x7fa6b419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:11.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.085+0000 7fa6b89c3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b410edf0 con 0x7fa6b4102ac0 2024-09-20T18:52:11.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.085+0000 7fa6b89c3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b410ec70 con 0x7fa6b41033e0 2024-09-20T18:52:11.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.086+0000 7fa6b259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6b4102ac0 0x7fa6b419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:11.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.086+0000 7fa6b259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6b4102ac0 0x7fa6b419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50134/0 (socket says 172.21.15.17:50134) 2024-09-20T18:52:11.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.086+0000 7fa6b259c640 1 -- 172.21.15.17:0/3990062613 learned_addr learned my addr 172.21.15.17:0/3990062613 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:52:11.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.086+0000 7fa6b1d9b640 1 --2- 172.21.15.17:0/3990062613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6b41033e0 0x7fa6b419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:11.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.086+0000 7fa6b259c640 1 -- 172.21.15.17:0/3990062613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6b41033e0 msgr2=0x7fa6b419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:11.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.086+0000 7fa6b259c640 1 --2- 172.21.15.17:0/3990062613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6b41033e0 0x7fa6b419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.086+0000 7fa6b259c640 1 -- 172.21.15.17:0/3990062613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b4197800 con 0x7fa6b4102ac0 2024-09-20T18:52:11.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.086+0000 7fa6b259c640 1 --2- 172.21.15.17:0/3990062613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6b4102ac0 0x7fa6b419d680 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa69c00c8f0 tx=0x7fa69c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:11.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.086+0000 7fa6ab7fe640 1 -- 172.21.15.17:0/3990062613 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa69c0079b0 con 0x7fa6b4102ac0 2024-09-20T18:52:11.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.086+0000 7fa6b89c3640 1 -- 172.21.15.17:0/3990062613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6b4197af0 con 0x7fa6b4102ac0 2024-09-20T18:52:11.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.086+0000 7fa6ab7fe640 1 -- 172.21.15.17:0/3990062613 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa69c0054e0 con 0x7fa6b4102ac0 2024-09-20T18:52:11.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.086+0000 7fa6ab7fe640 1 -- 172.21.15.17:0/3990062613 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa69c004dd0 con 0x7fa6b4102ac0 2024-09-20T18:52:11.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.086+0000 7fa6b89c3640 1 -- 172.21.15.17:0/3990062613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6b4198050 con 0x7fa6b4102ac0 2024-09-20T18:52:11.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.088+0000 7fa6b89c3640 1 -- 172.21.15.17:0/3990062613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6b406aa90 con 0x7fa6b4102ac0 2024-09-20T18:52:11.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.088+0000 7fa6ab7fe640 1 -- 172.21.15.17:0/3990062613 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa69c005020 con 0x7fa6b4102ac0 2024-09-20T18:52:11.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.089+0000 7fa6ab7fe640 1 --2- 172.21.15.17:0/3990062613 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6a007aed0 0x7fa6a007d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:11.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.089+0000 7fa6ab7fe640 1 -- 172.21.15.17:0/3990062613 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fa69c09dfc0 con 0x7fa6b4102ac0 2024-09-20T18:52:11.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.089+0000 7fa6b1d9b640 1 --2- 172.21.15.17:0/3990062613 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6a007aed0 0x7fa6a007d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:11.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.089+0000 7fa6b1d9b640 1 --2- 172.21.15.17:0/3990062613 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6a007aed0 0x7fa6a007d390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4198b50 tx=0x7fa6a4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:11.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.093+0000 7fa6ab7fe640 1 -- 172.21.15.17:0/3990062613 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa69c014030 con 0x7fa6b4102ac0 2024-09-20T18:52:11.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.315+0000 7fa6b89c3640 1 -- 172.21.15.17:0/3990062613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa6b4105f60 con 0x7fa6b4102ac0 2024-09-20T18:52:11.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.316+0000 7fa6ab7fe640 1 -- 172.21.15.17:0/3990062613 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7fa69c069520 con 0x7fa6b4102ac0 2024-09-20T18:52:11.333 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:52:11.333 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:52:11.333 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:52:11.334 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:52:11.334 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:52:11.334 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:52:11.334 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:52:11.334 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:52:11.334 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:52:11.334 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:52:11.334 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:52:11.334 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:52:11.334 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:52:11.334 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:52:11.334 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:52:11.335 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:52:11.335 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:52:11.335 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:52:11.335 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:52:11.335 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:52:11.335 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:52:11.335 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:52:11.335 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:52:11.335 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:52:11.335 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:52:11.335 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:52:11.335 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:52:11.335 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:52:11.336 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:52:11.336 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:52:11.336 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:52:11.336 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:52:11.336 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:52:11.336 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:52:11.336 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:52:11.336 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:52:11.336 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:52:11.336 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:52:11.336 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:52:11.336 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:52:11.336 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:52:11.336 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:52:11.337 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:52:11.337 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:52:11.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.318+0000 7fa6b89c3640 1 -- 172.21.15.17:0/3990062613 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6a007aed0 msgr2=0x7fa6a007d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:11.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.318+0000 7fa6b89c3640 1 --2- 172.21.15.17:0/3990062613 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6a007aed0 0x7fa6a007d390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4198b50 tx=0x7fa6a4031400 comp rx=0 tx=0).stop 2024-09-20T18:52:11.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.318+0000 7fa6b89c3640 1 -- 172.21.15.17:0/3990062613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6b4102ac0 msgr2=0x7fa6b419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:11.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.318+0000 7fa6b89c3640 1 --2- 172.21.15.17:0/3990062613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6b4102ac0 0x7fa6b419d680 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa69c00c8f0 tx=0x7fa69c00cdb0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.318+0000 7fa6b89c3640 1 -- 172.21.15.17:0/3990062613 shutdown_connections 2024-09-20T18:52:11.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.318+0000 7fa6b89c3640 1 --2- 172.21.15.17:0/3990062613 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6a007aed0 0x7fa6a007d390 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.318+0000 7fa6b89c3640 1 --2- 172.21.15.17:0/3990062613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6b41033e0 0x7fa6b419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.318+0000 7fa6b89c3640 1 --2- 172.21.15.17:0/3990062613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6b4102ac0 0x7fa6b419d680 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.318+0000 7fa6b89c3640 1 -- 172.21.15.17:0/3990062613 >> 172.21.15.17:0/3990062613 conn(0x7fa6b40fc520 msgr2=0x7fa6b4108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:11.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.318+0000 7fa6b89c3640 1 -- 172.21.15.17:0/3990062613 shutdown_connections 2024-09-20T18:52:11.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.318+0000 7fa6b89c3640 1 -- 172.21.15.17:0/3990062613 wait complete. 2024-09-20T18:52:11.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.403+0000 7fac27eec640 1 -- 172.21.15.17:0/1931641913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac20100c00 msgr2=0x7fac20104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:11.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.403+0000 7fac27eec640 1 --2- 172.21.15.17:0/1931641913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac20100c00 0x7fac20104c50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fac10009880 tx=0x7fac1002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.403+0000 7fac27eec640 1 -- 172.21.15.17:0/1931641913 shutdown_connections 2024-09-20T18:52:11.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.403+0000 7fac27eec640 1 --2- 172.21.15.17:0/1931641913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac20100c00 0x7fac20104c50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.403+0000 7fac27eec640 1 --2- 172.21.15.17:0/1931641913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac20100250 0x7fac20100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.403+0000 7fac27eec640 1 -- 172.21.15.17:0/1931641913 >> 172.21.15.17:0/1931641913 conn(0x7fac200fbc90 msgr2=0x7fac200fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:11.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.404+0000 7fac27eec640 1 -- 172.21.15.17:0/1931641913 shutdown_connections 2024-09-20T18:52:11.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.404+0000 7fac27eec640 1 -- 172.21.15.17:0/1931641913 wait complete. 2024-09-20T18:52:11.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.404+0000 7fac27eec640 1 Processor -- start 2024-09-20T18:52:11.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.404+0000 7fac27eec640 1 -- start start 2024-09-20T18:52:11.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.404+0000 7fac27eec640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac20100250 0x7fac2019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:11.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.404+0000 7fac27eec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac20100c00 0x7fac2019dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:11.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.404+0000 7fac27eec640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fac2010d4d0 con 0x7fac20100c00 2024-09-20T18:52:11.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.404+0000 7fac27eec640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fac2010d350 con 0x7fac20100250 2024-09-20T18:52:11.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.405+0000 7fac25487640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac20100c00 0x7fac2019dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:11.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.405+0000 7fac25487640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac20100c00 0x7fac2019dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50140/0 (socket says 172.21.15.17:50140) 2024-09-20T18:52:11.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.405+0000 7fac25487640 1 -- 172.21.15.17:0/3182016980 learned_addr learned my addr 172.21.15.17:0/3182016980 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:52:11.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.405+0000 7fac25c88640 1 --2- 172.21.15.17:0/3182016980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac20100250 0x7fac2019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:11.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.405+0000 7fac25487640 1 -- 172.21.15.17:0/3182016980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac20100250 msgr2=0x7fac2019d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:11.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.405+0000 7fac25487640 1 --2- 172.21.15.17:0/3182016980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac20100250 0x7fac2019d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.405+0000 7fac25487640 1 -- 172.21.15.17:0/3182016980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac20197890 con 0x7fac20100c00 2024-09-20T18:52:11.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.405+0000 7fac25c88640 1 --2- 172.21.15.17:0/3182016980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac20100250 0x7fac2019d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:52:11.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.405+0000 7fac25487640 1 --2- 172.21.15.17:0/3182016980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac20100c00 0x7fac2019dc10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fac10031460 tx=0x7fac100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:11.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.405+0000 7fac16ffd640 1 -- 172.21.15.17:0/3182016980 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac1003f070 con 0x7fac20100c00 2024-09-20T18:52:11.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.405+0000 7fac16ffd640 1 -- 172.21.15.17:0/3182016980 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fac10004cf0 con 0x7fac20100c00 2024-09-20T18:52:11.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.405+0000 7fac27eec640 1 -- 172.21.15.17:0/3182016980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac20197b20 con 0x7fac20100c00 2024-09-20T18:52:11.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.405+0000 7fac16ffd640 1 -- 172.21.15.17:0/3182016980 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac10035030 con 0x7fac20100c00 2024-09-20T18:52:11.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.405+0000 7fac27eec640 1 -- 172.21.15.17:0/3182016980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac20198050 con 0x7fac20100c00 2024-09-20T18:52:11.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.406+0000 7fac27eec640 1 -- 172.21.15.17:0/3182016980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac20101730 con 0x7fac20100c00 2024-09-20T18:52:11.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.407+0000 7fac16ffd640 1 -- 172.21.15.17:0/3182016980 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fac10042070 con 0x7fac20100c00 2024-09-20T18:52:11.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.408+0000 7fac16ffd640 1 --2- 172.21.15.17:0/3182016980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac0c07af30 0x7fac0c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:11.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.408+0000 7fac16ffd640 1 -- 172.21.15.17:0/3182016980 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fac100beac0 con 0x7fac20100c00 2024-09-20T18:52:11.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.408+0000 7fac25c88640 1 --2- 172.21.15.17:0/3182016980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac0c07af30 0x7fac0c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:11.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.408+0000 7fac25c88640 1 --2- 172.21.15.17:0/3182016980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac0c07af30 0x7fac0c07d3f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fac1c005fd0 tx=0x7fac1c005ea0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:11.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.412+0000 7fac16ffd640 1 -- 172.21.15.17:0/3182016980 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fac1008a0c0 con 0x7fac20100c00 2024-09-20T18:52:11.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.617+0000 7fac27eec640 1 -- 172.21.15.17:0/3182016980 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fac20198dc0 con 0x7fac0c07af30 2024-09-20T18:52:11.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.618+0000 7fac16ffd640 1 -- 172.21.15.17:0/3182016980 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fac20198dc0 con 0x7fac0c07af30 2024-09-20T18:52:11.635 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:52:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:52:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:52:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:52:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:52:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:52:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:52:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:52:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:52:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:52:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:52:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:52:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:52:11.636 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:52:11.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.620+0000 7fac27eec640 1 -- 172.21.15.17:0/3182016980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac0c07af30 msgr2=0x7fac0c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:11.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.620+0000 7fac27eec640 1 --2- 172.21.15.17:0/3182016980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac0c07af30 0x7fac0c07d3f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fac1c005fd0 tx=0x7fac1c005ea0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.620+0000 7fac27eec640 1 -- 172.21.15.17:0/3182016980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac20100c00 msgr2=0x7fac2019dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:11.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.620+0000 7fac27eec640 1 --2- 172.21.15.17:0/3182016980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac20100c00 0x7fac2019dc10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fac10031460 tx=0x7fac100048f0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.620+0000 7fac27eec640 1 -- 172.21.15.17:0/3182016980 shutdown_connections 2024-09-20T18:52:11.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.620+0000 7fac27eec640 1 --2- 172.21.15.17:0/3182016980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac0c07af30 0x7fac0c07d3f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.620+0000 7fac27eec640 1 --2- 172.21.15.17:0/3182016980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac20100c00 0x7fac2019dc10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.620+0000 7fac27eec640 1 --2- 172.21.15.17:0/3182016980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac20100250 0x7fac2019d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.620+0000 7fac27eec640 1 -- 172.21.15.17:0/3182016980 >> 172.21.15.17:0/3182016980 conn(0x7fac200fbc90 msgr2=0x7fac20103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:11.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.620+0000 7fac27eec640 1 -- 172.21.15.17:0/3182016980 shutdown_connections 2024-09-20T18:52:11.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.620+0000 7fac27eec640 1 -- 172.21.15.17:0/3182016980 wait complete. 2024-09-20T18:52:11.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.705+0000 7f75d513d640 1 -- 172.21.15.17:0/2350713725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d01003c0 msgr2=0x7f75d01007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:11.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.705+0000 7f75d513d640 1 --2- 172.21.15.17:0/2350713725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d01003c0 0x7f75d01007a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f75c0009880 tx=0x7f75c002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.705+0000 7f75d513d640 1 -- 172.21.15.17:0/2350713725 shutdown_connections 2024-09-20T18:52:11.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.705+0000 7f75d513d640 1 --2- 172.21.15.17:0/2350713725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75d0100d70 0x7f75d01065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.705+0000 7f75d513d640 1 --2- 172.21.15.17:0/2350713725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d01003c0 0x7f75d01007a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.705+0000 7f75d513d640 1 -- 172.21.15.17:0/2350713725 >> 172.21.15.17:0/2350713725 conn(0x7f75d0077150 msgr2=0x7f75d0077560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:11.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.705+0000 7f75d513d640 1 -- 172.21.15.17:0/2350713725 shutdown_connections 2024-09-20T18:52:11.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.705+0000 7f75d513d640 1 -- 172.21.15.17:0/2350713725 wait complete. 2024-09-20T18:52:11.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.706+0000 7f75d513d640 1 Processor -- start 2024-09-20T18:52:11.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.706+0000 7f75d513d640 1 -- start start 2024-09-20T18:52:11.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.706+0000 7f75d513d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75d01003c0 0x7f75d019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:11.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.706+0000 7f75d513d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d0100d70 0x7f75d019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:11.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.706+0000 7f75d513d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f75d010edc0 con 0x7f75d0100d70 2024-09-20T18:52:11.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.706+0000 7f75d513d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f75d010ec40 con 0x7f75d01003c0 2024-09-20T18:52:11.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.706+0000 7f75ce59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d0100d70 0x7f75d019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:11.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.706+0000 7f75ce59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d0100d70 0x7f75d019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50164/0 (socket says 172.21.15.17:50164) 2024-09-20T18:52:11.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.706+0000 7f75ce59c640 1 -- 172.21.15.17:0/119617180 learned_addr learned my addr 172.21.15.17:0/119617180 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:52:11.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.707+0000 7f75ced9d640 1 --2- 172.21.15.17:0/119617180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75d01003c0 0x7f75d019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:11.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.707+0000 7f75ce59c640 1 -- 172.21.15.17:0/119617180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75d01003c0 msgr2=0x7f75d019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:11.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.707+0000 7f75ce59c640 1 --2- 172.21.15.17:0/119617180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75d01003c0 0x7f75d019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.707+0000 7f75ce59c640 1 -- 172.21.15.17:0/119617180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d0197770 con 0x7f75d0100d70 2024-09-20T18:52:11.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.707+0000 7f75ce59c640 1 --2- 172.21.15.17:0/119617180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d0100d70 0x7f75d019dbe0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f75c400d6f0 tx=0x7f75c400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:11.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.707+0000 7f75b7fff640 1 -- 172.21.15.17:0/119617180 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f75c4017070 con 0x7f75d0100d70 2024-09-20T18:52:11.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.707+0000 7f75b7fff640 1 -- 172.21.15.17:0/119617180 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f75c400de00 con 0x7f75d0100d70 2024-09-20T18:52:11.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.707+0000 7f75d513d640 1 -- 172.21.15.17:0/119617180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d0197a60 con 0x7f75d0100d70 2024-09-20T18:52:11.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.707+0000 7f75b7fff640 1 -- 172.21.15.17:0/119617180 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f75c400f3c0 con 0x7f75d0100d70 2024-09-20T18:52:11.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.707+0000 7f75d513d640 1 -- 172.21.15.17:0/119617180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d0197fc0 con 0x7f75d0100d70 2024-09-20T18:52:11.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.708+0000 7f75d513d640 1 -- 172.21.15.17:0/119617180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d0069d90 con 0x7f75d0100d70 2024-09-20T18:52:11.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.709+0000 7f75b7fff640 1 -- 172.21.15.17:0/119617180 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f75c401a070 con 0x7f75d0100d70 2024-09-20T18:52:11.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.709+0000 7f75b7fff640 1 --2- 172.21.15.17:0/119617180 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f75b807af80 0x7f75b807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:11.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.710+0000 7f75b7fff640 1 -- 172.21.15.17:0/119617180 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f75c409dad0 con 0x7f75d0100d70 2024-09-20T18:52:11.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.710+0000 7f75ced9d640 1 --2- 172.21.15.17:0/119617180 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f75b807af80 0x7f75b807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:11.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.710+0000 7f75ced9d640 1 --2- 172.21.15.17:0/119617180 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f75b807af80 0x7f75b807d440 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f75c00096c0 tx=0x7f75c0031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.714+0000 7f75b7fff640 1 -- 172.21.15.17:0/119617180 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f75c4021030 con 0x7f75d0100d70 2024-09-20T18:52:11.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:11 smithi017 ceph-mon[108970]: from='client.34762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:52:11.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:11 smithi017 ceph-mon[108970]: from='client.34766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:52:11.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:11 smithi017 ceph-mon[108970]: pgmap v503: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:11.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:11 smithi017 ceph-mon[108970]: from='client.34770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:52:11.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:11 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1598582425' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:52:11.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:11 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3990062613' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:52:11.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:11 smithi172 ceph-mon[80431]: from='client.34762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:52:11.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:11 smithi172 ceph-mon[80431]: from='client.34766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:52:11.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:11 smithi172 ceph-mon[80431]: pgmap v503: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:11.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:11 smithi172 ceph-mon[80431]: from='client.34770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:52:11.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:11 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1598582425' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:52:11.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:11 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3990062613' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:52:11.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.975+0000 7f75d513d640 1 -- 172.21.15.17:0/119617180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f75d0198ca0 con 0x7f75d0100d70 2024-09-20T18:52:11.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.975+0000 7f75b7fff640 1 -- 172.21.15.17:0/119617180 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f75c4069150 con 0x7f75d0100d70 2024-09-20T18:52:11.992 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:52:11.992 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:52:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:52:11.992 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:52:11.992 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:52:11.992 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:52:11.993 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:52:11.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.977+0000 7f75d513d640 1 -- 172.21.15.17:0/119617180 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f75b807af80 msgr2=0x7f75b807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:11.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.977+0000 7f75d513d640 1 --2- 172.21.15.17:0/119617180 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f75b807af80 0x7f75b807d440 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f75c00096c0 tx=0x7f75c0031400 comp rx=0 tx=0).stop 2024-09-20T18:52:11.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.977+0000 7f75d513d640 1 -- 172.21.15.17:0/119617180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d0100d70 msgr2=0x7f75d019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:11.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.977+0000 7f75d513d640 1 --2- 172.21.15.17:0/119617180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d0100d70 0x7f75d019dbe0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f75c400d6f0 tx=0x7f75c400dbb0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.977+0000 7f75d513d640 1 -- 172.21.15.17:0/119617180 shutdown_connections 2024-09-20T18:52:11.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.977+0000 7f75d513d640 1 --2- 172.21.15.17:0/119617180 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f75b807af80 0x7f75b807d440 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.977+0000 7f75d513d640 1 --2- 172.21.15.17:0/119617180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75d0100d70 0x7f75d019dbe0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.977+0000 7f75d513d640 1 --2- 172.21.15.17:0/119617180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75d01003c0 0x7f75d019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:11.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.977+0000 7f75d513d640 1 -- 172.21.15.17:0/119617180 >> 172.21.15.17:0/119617180 conn(0x7f75d0077150 msgr2=0x7f75d00fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:11.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.977+0000 7f75d513d640 1 -- 172.21.15.17:0/119617180 shutdown_connections 2024-09-20T18:52:11.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:11.977+0000 7f75d513d640 1 -- 172.21.15.17:0/119617180 wait complete. 2024-09-20T18:52:12.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:12 smithi017 ceph-mon[108970]: from='client.34782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:52:12.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:12 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/119617180' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:52:12.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:12 smithi172 ceph-mon[80431]: from='client.34782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:52:12.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:12 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/119617180' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:52:13.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:13 smithi017 ceph-mon[108970]: pgmap v504: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:13.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:13 smithi172 ceph-mon[80431]: pgmap v504: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:15.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:15 smithi017 ceph-mon[108970]: pgmap v505: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:15.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:15 smithi172 ceph-mon[80431]: pgmap v505: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:17.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:17 smithi017 ceph-mon[108970]: pgmap v506: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:17.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:17 smithi172 ceph-mon[80431]: pgmap v506: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:19.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:19 smithi017 ceph-mon[108970]: pgmap v507: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:19.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:19 smithi172 ceph-mon[80431]: pgmap v507: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:21.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:21 smithi017 ceph-mon[108970]: pgmap v508: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:21.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:21 smithi172 ceph-mon[80431]: pgmap v508: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:22.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:52:22.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:52:23.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:23 smithi017 ceph-mon[108970]: pgmap v509: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:23.908 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:23 smithi172 ceph-mon[80431]: pgmap v509: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:25.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:25 smithi017 ceph-mon[108970]: pgmap v510: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:25.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:25 smithi172 ceph-mon[80431]: pgmap v510: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:27.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:27 smithi017 ceph-mon[108970]: pgmap v511: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:27.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:27 smithi172 ceph-mon[80431]: pgmap v511: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:29.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:29 smithi017 ceph-mon[108970]: pgmap v512: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:29.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:29 smithi172 ceph-mon[80431]: pgmap v512: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:31.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:31 smithi017 ceph-mon[108970]: pgmap v513: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:31.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:31 smithi172 ceph-mon[80431]: pgmap v513: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:33.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:33 smithi017 ceph-mon[108970]: pgmap v514: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:33.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:33 smithi172 ceph-mon[80431]: pgmap v514: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:35.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:35 smithi017 ceph-mon[108970]: pgmap v515: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:35.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:35 smithi172 ceph-mon[80431]: pgmap v515: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:37.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:37 smithi017 ceph-mon[108970]: pgmap v516: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:37.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:52:37.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:37 smithi172 ceph-mon[80431]: pgmap v516: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:37.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:52:39.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:39 smithi017 ceph-mon[108970]: pgmap v517: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:39.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:39 smithi172 ceph-mon[80431]: pgmap v517: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:41.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:41 smithi017 ceph-mon[108970]: pgmap v518: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:41.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:41 smithi172 ceph-mon[80431]: pgmap v518: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:42.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.074+0000 7f25f1095640 1 -- 172.21.15.17:0/1393023494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ec100640 msgr2=0x7f25ec100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:42.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.074+0000 7f25f1095640 1 --2- 172.21.15.17:0/1393023494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ec100640 0x7f25ec100a20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f25dc009880 tx=0x7f25dc02a490 comp rx=0 tx=0).stop 2024-09-20T18:52:42.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.074+0000 7f25f1095640 1 -- 172.21.15.17:0/1393023494 shutdown_connections 2024-09-20T18:52:42.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.074+0000 7f25f1095640 1 --2- 172.21.15.17:0/1393023494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25ec100ff0 0x7f25ec10dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.074+0000 7f25f1095640 1 --2- 172.21.15.17:0/1393023494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ec100640 0x7f25ec100a20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.074+0000 7f25f1095640 1 -- 172.21.15.17:0/1393023494 >> 172.21.15.17:0/1393023494 conn(0x7f25ec0fc550 msgr2=0x7f25ec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:42.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.074+0000 7f25f1095640 1 -- 172.21.15.17:0/1393023494 shutdown_connections 2024-09-20T18:52:42.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.074+0000 7f25f1095640 1 -- 172.21.15.17:0/1393023494 wait complete. 2024-09-20T18:52:42.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.075+0000 7f25f1095640 1 Processor -- start 2024-09-20T18:52:42.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.075+0000 7f25f1095640 1 -- start start 2024-09-20T18:52:42.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.076+0000 7f25f1095640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ec100640 0x7f25ec19f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:42.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.076+0000 7f25f1095640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25ec100ff0 0x7f25ec19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:42.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.076+0000 7f25f1095640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec110f80 con 0x7f25ec100640 2024-09-20T18:52:42.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.076+0000 7f25f1095640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec110e00 con 0x7f25ec100ff0 2024-09-20T18:52:42.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.076+0000 7f25ead9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ec100640 0x7f25ec19f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:42.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.076+0000 7f25ead9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ec100640 0x7f25ec19f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45090/0 (socket says 172.21.15.17:45090) 2024-09-20T18:52:42.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.076+0000 7f25ead9d640 1 -- 172.21.15.17:0/1021104872 learned_addr learned my addr 172.21.15.17:0/1021104872 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:52:42.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.076+0000 7f25ea59c640 1 --2- 172.21.15.17:0/1021104872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25ec100ff0 0x7f25ec19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:42.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.076+0000 7f25ead9d640 1 -- 172.21.15.17:0/1021104872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25ec100ff0 msgr2=0x7f25ec19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:42.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.076+0000 7f25ead9d640 1 --2- 172.21.15.17:0/1021104872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25ec100ff0 0x7f25ec19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.076+0000 7f25ead9d640 1 -- 172.21.15.17:0/1021104872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ec199970 con 0x7f25ec100640 2024-09-20T18:52:42.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.076+0000 7f25ea59c640 1 --2- 172.21.15.17:0/1021104872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25ec100ff0 0x7f25ec19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:52:42.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.077+0000 7f25ead9d640 1 --2- 172.21.15.17:0/1021104872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ec100640 0x7f25ec19f7b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f25dc031460 tx=0x7f25dc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:42.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.077+0000 7f25d3fff640 1 -- 172.21.15.17:0/1021104872 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25dc03f070 con 0x7f25ec100640 2024-09-20T18:52:42.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.077+0000 7f25f1095640 1 -- 172.21.15.17:0/1021104872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25ec199c00 con 0x7f25ec100640 2024-09-20T18:52:42.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.077+0000 7f25d3fff640 1 -- 172.21.15.17:0/1021104872 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f25dc004cf0 con 0x7f25ec100640 2024-09-20T18:52:42.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.077+0000 7f25d3fff640 1 -- 172.21.15.17:0/1021104872 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25dc035030 con 0x7f25ec100640 2024-09-20T18:52:42.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.077+0000 7f25f1095640 1 -- 172.21.15.17:0/1021104872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25ec19a190 con 0x7f25ec100640 2024-09-20T18:52:42.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.078+0000 7f25f1095640 1 -- 172.21.15.17:0/1021104872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25ec06a580 con 0x7f25ec100640 2024-09-20T18:52:42.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.079+0000 7f25d3fff640 1 -- 172.21.15.17:0/1021104872 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f25dc042070 con 0x7f25ec100640 2024-09-20T18:52:42.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.079+0000 7f25d3fff640 1 --2- 172.21.15.17:0/1021104872 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f25d407af30 0x7f25d407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:42.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.079+0000 7f25d3fff640 1 -- 172.21.15.17:0/1021104872 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f25dc0beac0 con 0x7f25ec100640 2024-09-20T18:52:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.079+0000 7f25ea59c640 1 --2- 172.21.15.17:0/1021104872 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f25d407af30 0x7f25d407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.080+0000 7f25ea59c640 1 --2- 172.21.15.17:0/1021104872 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f25d407af30 0x7f25d407d3f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f25e0005fd0 tx=0x7f25e0005ea0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:42.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.084+0000 7f25d3fff640 1 -- 172.21.15.17:0/1021104872 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25dc08a0c0 con 0x7f25ec100640 2024-09-20T18:52:42.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.293+0000 7f25f1095640 1 -- 172.21.15.17:0/1021104872 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f25ec19aea0 con 0x7f25d407af30 2024-09-20T18:52:42.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.295+0000 7f25d3fff640 1 -- 172.21.15.17:0/1021104872 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f25ec19aea0 con 0x7f25d407af30 2024-09-20T18:52:42.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.297+0000 7f25f1095640 1 -- 172.21.15.17:0/1021104872 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f25d407af30 msgr2=0x7f25d407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:42.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.297+0000 7f25f1095640 1 --2- 172.21.15.17:0/1021104872 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f25d407af30 0x7f25d407d3f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f25e0005fd0 tx=0x7f25e0005ea0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.297+0000 7f25f1095640 1 -- 172.21.15.17:0/1021104872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ec100640 msgr2=0x7f25ec19f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:42.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.297+0000 7f25f1095640 1 --2- 172.21.15.17:0/1021104872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ec100640 0x7f25ec19f7b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f25dc031460 tx=0x7f25dc0048f0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.297+0000 7f25f1095640 1 -- 172.21.15.17:0/1021104872 shutdown_connections 2024-09-20T18:52:42.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.297+0000 7f25f1095640 1 --2- 172.21.15.17:0/1021104872 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f25d407af30 0x7f25d407d3f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.297+0000 7f25f1095640 1 --2- 172.21.15.17:0/1021104872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25ec100ff0 0x7f25ec19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.297+0000 7f25f1095640 1 --2- 172.21.15.17:0/1021104872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ec100640 0x7f25ec19f7b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.297+0000 7f25f1095640 1 -- 172.21.15.17:0/1021104872 >> 172.21.15.17:0/1021104872 conn(0x7f25ec0fc550 msgr2=0x7f25ec0fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:42.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.297+0000 7f25f1095640 1 -- 172.21.15.17:0/1021104872 shutdown_connections 2024-09-20T18:52:42.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.298+0000 7f25f1095640 1 -- 172.21.15.17:0/1021104872 wait complete. 2024-09-20T18:52:42.323 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:52:42.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.383+0000 7f8e9fcfd640 1 -- 172.21.15.17:0/1699349845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e981011d0 msgr2=0x7f8e981056a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:42.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.383+0000 7f8e9fcfd640 1 --2- 172.21.15.17:0/1699349845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e981011d0 0x7f8e981056a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009880 tx=0x7f8e8802a530 comp rx=0 tx=0).stop 2024-09-20T18:52:42.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.383+0000 7f8e9fcfd640 1 -- 172.21.15.17:0/1699349845 shutdown_connections 2024-09-20T18:52:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.383+0000 7f8e9fcfd640 1 --2- 172.21.15.17:0/1699349845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e981011d0 0x7f8e981056a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.383+0000 7f8e9fcfd640 1 --2- 172.21.15.17:0/1699349845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e981008b0 0x7f8e98100c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.383+0000 7f8e9fcfd640 1 -- 172.21.15.17:0/1699349845 >> 172.21.15.17:0/1699349845 conn(0x7f8e980fc520 msgr2=0x7f8e980fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.383+0000 7f8e9fcfd640 1 -- 172.21.15.17:0/1699349845 shutdown_connections 2024-09-20T18:52:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.383+0000 7f8e9fcfd640 1 -- 172.21.15.17:0/1699349845 wait complete. 2024-09-20T18:52:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.384+0000 7f8e9fcfd640 1 Processor -- start 2024-09-20T18:52:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.384+0000 7f8e9fcfd640 1 -- start start 2024-09-20T18:52:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.384+0000 7f8e9fcfd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e981008b0 0x7f8e9819dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.384+0000 7f8e9fcfd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e981011d0 0x7f8e9819e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.384+0000 7f8e9fcfd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8e981153f0 con 0x7f8e981008b0 2024-09-20T18:52:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.384+0000 7f8e9fcfd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e98115270 con 0x7f8e981011d0 2024-09-20T18:52:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.384+0000 7f8e9da99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e981008b0 0x7f8e9819dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.384+0000 7f8e9da99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e981008b0 0x7f8e9819dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45106/0 (socket says 172.21.15.17:45106) 2024-09-20T18:52:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.384+0000 7f8e9da99640 1 -- 172.21.15.17:0/1234438605 learned_addr learned my addr 172.21.15.17:0/1234438605 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:52:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.385+0000 7f8e9d298640 1 --2- 172.21.15.17:0/1234438605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e981011d0 0x7f8e9819e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.385+0000 7f8e9da99640 1 -- 172.21.15.17:0/1234438605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e981011d0 msgr2=0x7f8e9819e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.385+0000 7f8e9da99640 1 --2- 172.21.15.17:0/1234438605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e981011d0 0x7f8e9819e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.385+0000 7f8e9da99640 1 -- 172.21.15.17:0/1234438605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e981a28a0 con 0x7f8e981008b0 2024-09-20T18:52:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.385+0000 7f8e9d298640 1 --2- 172.21.15.17:0/1234438605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e981011d0 0x7f8e9819e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:52:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.385+0000 7f8e9da99640 1 --2- 172.21.15.17:0/1234438605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e981008b0 0x7f8e9819dfd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400e970 tx=0x7f8e9400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.385+0000 7f8e8effd640 1 -- 172.21.15.17:0/1234438605 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e9400cac0 con 0x7f8e981008b0 2024-09-20T18:52:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.385+0000 7f8e8effd640 1 -- 172.21.15.17:0/1234438605 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e940054e0 con 0x7f8e981008b0 2024-09-20T18:52:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.385+0000 7f8e9fcfd640 1 -- 172.21.15.17:0/1234438605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e981a2b90 con 0x7f8e981008b0 2024-09-20T18:52:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.385+0000 7f8e8effd640 1 -- 172.21.15.17:0/1234438605 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e94010430 con 0x7f8e981008b0 2024-09-20T18:52:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.385+0000 7f8e9fcfd640 1 -- 172.21.15.17:0/1234438605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e981a3120 con 0x7f8e981008b0 2024-09-20T18:52:42.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.386+0000 7f8e9fcfd640 1 -- 172.21.15.17:0/1234438605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e9806aa90 con 0x7f8e981008b0 2024-09-20T18:52:42.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.387+0000 7f8e8effd640 1 -- 172.21.15.17:0/1234438605 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8e94004ee0 con 0x7f8e981008b0 2024-09-20T18:52:42.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.387+0000 7f8e8effd640 1 --2- 172.21.15.17:0/1234438605 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e8407af40 0x7f8e8407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:42.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.388+0000 7f8e8effd640 1 -- 172.21.15.17:0/1234438605 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f8e9409e710 con 0x7f8e981008b0 2024-09-20T18:52:42.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.388+0000 7f8e9d298640 1 --2- 172.21.15.17:0/1234438605 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e8407af40 0x7f8e8407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:42.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.388+0000 7f8e9d298640 1 --2- 172.21.15.17:0/1234438605 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e8407af40 0x7f8e8407d400 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8e981124f0 tx=0x7f8e88031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:42.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.392+0000 7f8e8effd640 1 -- 172.21.15.17:0/1234438605 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8e94069d10 con 0x7f8e981008b0 2024-09-20T18:52:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.599+0000 7f8e9fcfd640 1 -- 172.21.15.17:0/1234438605 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8e981a3430 con 0x7f8e8407af40 2024-09-20T18:52:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.600+0000 7f8e8effd640 1 -- 172.21.15.17:0/1234438605 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f8e981a3430 con 0x7f8e8407af40 2024-09-20T18:52:42.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.604+0000 7f8e9fcfd640 1 -- 172.21.15.17:0/1234438605 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e8407af40 msgr2=0x7f8e8407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:42.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.604+0000 7f8e9fcfd640 1 --2- 172.21.15.17:0/1234438605 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e8407af40 0x7f8e8407d400 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8e981124f0 tx=0x7f8e88031400 comp rx=0 tx=0).stop 2024-09-20T18:52:42.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.604+0000 7f8e9fcfd640 1 -- 172.21.15.17:0/1234438605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e981008b0 msgr2=0x7f8e9819dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:42.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.604+0000 7f8e9fcfd640 1 --2- 172.21.15.17:0/1234438605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e981008b0 0x7f8e9819dfd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400e970 tx=0x7f8e9400ed70 comp rx=0 tx=0).stop 2024-09-20T18:52:42.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.604+0000 7f8e9fcfd640 1 -- 172.21.15.17:0/1234438605 shutdown_connections 2024-09-20T18:52:42.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.604+0000 7f8e9fcfd640 1 --2- 172.21.15.17:0/1234438605 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e8407af40 0x7f8e8407d400 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.604+0000 7f8e9fcfd640 1 --2- 172.21.15.17:0/1234438605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e981011d0 0x7f8e9819e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.604+0000 7f8e9fcfd640 1 --2- 172.21.15.17:0/1234438605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e981008b0 0x7f8e9819dfd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.604+0000 7f8e9fcfd640 1 -- 172.21.15.17:0/1234438605 >> 172.21.15.17:0/1234438605 conn(0x7f8e980fc520 msgr2=0x7f8e98112be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:42.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.604+0000 7f8e9fcfd640 1 -- 172.21.15.17:0/1234438605 shutdown_connections 2024-09-20T18:52:42.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.604+0000 7f8e9fcfd640 1 -- 172.21.15.17:0/1234438605 wait complete. 2024-09-20T18:52:42.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.690+0000 7f0e80a52640 1 -- 172.21.15.17:0/3646116791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c101900 msgr2=0x7f0e7c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:42.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.690+0000 7f0e80a52640 1 --2- 172.21.15.17:0/3646116791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c101900 0x7f0e7c101d60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0e64009880 tx=0x7f0e6402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.690+0000 7f0e80a52640 1 -- 172.21.15.17:0/3646116791 shutdown_connections 2024-09-20T18:52:42.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.690+0000 7f0e80a52640 1 --2- 172.21.15.17:0/3646116791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c101900 0x7f0e7c101d60 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.690+0000 7f0e80a52640 1 --2- 172.21.15.17:0/3646116791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e7c107900 0x7f0e7c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.690+0000 7f0e80a52640 1 -- 172.21.15.17:0/3646116791 >> 172.21.15.17:0/3646116791 conn(0x7f0e7c0fd600 msgr2=0x7f0e7c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:42.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.690+0000 7f0e80a52640 1 -- 172.21.15.17:0/3646116791 shutdown_connections 2024-09-20T18:52:42.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.690+0000 7f0e80a52640 1 -- 172.21.15.17:0/3646116791 wait complete. 2024-09-20T18:52:42.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.691+0000 7f0e80a52640 1 Processor -- start 2024-09-20T18:52:42.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.691+0000 7f0e80a52640 1 -- start start 2024-09-20T18:52:42.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.691+0000 7f0e80a52640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e7c101900 0x7f0e7c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:42.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.691+0000 7f0e80a52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c107900 0x7f0e7c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:42.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.691+0000 7f0e80a52640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c10edd0 con 0x7f0e7c107900 2024-09-20T18:52:42.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.691+0000 7f0e80a52640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c10ec50 con 0x7f0e7c101900 2024-09-20T18:52:42.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.691+0000 7f0e73fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c107900 0x7f0e7c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:42.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.691+0000 7f0e73fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c107900 0x7f0e7c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45130/0 (socket says 172.21.15.17:45130) 2024-09-20T18:52:42.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.691+0000 7f0e73fff640 1 -- 172.21.15.17:0/2866973077 learned_addr learned my addr 172.21.15.17:0/2866973077 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:52:42.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.691+0000 7f0e7a59c640 1 --2- 172.21.15.17:0/2866973077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e7c101900 0x7f0e7c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:42.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.691+0000 7f0e73fff640 1 -- 172.21.15.17:0/2866973077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e7c101900 msgr2=0x7f0e7c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:42.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.691+0000 7f0e73fff640 1 --2- 172.21.15.17:0/2866973077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e7c101900 0x7f0e7c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.691+0000 7f0e73fff640 1 -- 172.21.15.17:0/2866973077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e7c197800 con 0x7f0e7c107900 2024-09-20T18:52:42.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.692+0000 7f0e73fff640 1 --2- 172.21.15.17:0/2866973077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c107900 0x7f0e7c19dbc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0e64031460 tx=0x7f0e640045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:42.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.692+0000 7f0e737fe640 1 -- 172.21.15.17:0/2866973077 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e6403f070 con 0x7f0e7c107900 2024-09-20T18:52:42.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.692+0000 7f0e737fe640 1 -- 172.21.15.17:0/2866973077 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0e640035f0 con 0x7f0e7c107900 2024-09-20T18:52:42.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.692+0000 7f0e80a52640 1 -- 172.21.15.17:0/2866973077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e7c197a90 con 0x7f0e7c107900 2024-09-20T18:52:42.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.692+0000 7f0e737fe640 1 -- 172.21.15.17:0/2866973077 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e64035030 con 0x7f0e7c107900 2024-09-20T18:52:42.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.692+0000 7f0e80a52640 1 -- 172.21.15.17:0/2866973077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e7c197fc0 con 0x7f0e7c107900 2024-09-20T18:52:42.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.693+0000 7f0e80a52640 1 -- 172.21.15.17:0/2866973077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e7c103040 con 0x7f0e7c107900 2024-09-20T18:52:42.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.694+0000 7f0e737fe640 1 -- 172.21.15.17:0/2866973077 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0e64042070 con 0x7f0e7c107900 2024-09-20T18:52:42.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.694+0000 7f0e737fe640 1 --2- 172.21.15.17:0/2866973077 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0e6807af30 0x7f0e6807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:42.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.695+0000 7f0e7a59c640 1 --2- 172.21.15.17:0/2866973077 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0e6807af30 0x7f0e6807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:42.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.695+0000 7f0e737fe640 1 -- 172.21.15.17:0/2866973077 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f0e640be970 con 0x7f0e7c107900 2024-09-20T18:52:42.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.695+0000 7f0e7a59c640 1 --2- 172.21.15.17:0/2866973077 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0e6807af30 0x7f0e6807d3f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c005fd0 tx=0x7f0e6c00b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:42.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.699+0000 7f0e737fe640 1 -- 172.21.15.17:0/2866973077 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e640c0e20 con 0x7f0e7c107900 2024-09-20T18:52:42.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.893+0000 7f0e80a52640 1 -- 172.21.15.17:0/2866973077 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0e7c198270 con 0x7f0e6807af30 2024-09-20T18:52:42.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.903+0000 7f0e737fe640 1 -- 172.21.15.17:0/2866973077 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f0e7c198270 con 0x7f0e6807af30 2024-09-20T18:52:42.920 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:52:42.920 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (14m) 8m ago 25m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:52:42.921 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (17m) 8m ago 25m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:52:42.921 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (16m) 8m ago 24m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:52:42.921 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (12m) 8m ago 25m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:52:42.921 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (12m) 8m ago 24m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:52:42.921 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (13m) 8m ago 24m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:52:42.921 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (8m) 8m ago 19m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:52:42.921 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (8m) 8m ago 19m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:52:42.921 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (19m) 8m ago 19m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:52:42.921 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (8m) 8m ago 19m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:52:42.921 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (16m) 8m ago 26m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:52:42.921 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (15m) 8m ago 24m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:52:42.921 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (12m) 8m ago 26m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:52:42.921 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (12m) 8m ago 24m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:52:42.922 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (14m) 8m ago 25m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:52:42.922 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (14m) 8m ago 24m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:52:42.922 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (11m) 8m ago 23m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:52:42.922 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (11m) 8m ago 22m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:52:42.922 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (10m) 8m ago 22m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:52:42.922 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (10m) 8m ago 21m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:52:42.922 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (9m) 8m ago 21m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:52:42.922 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (8m) 8m ago 20m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:52:42.922 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (14m) 8m ago 24m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:52:42.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.905+0000 7f0e80a52640 1 -- 172.21.15.17:0/2866973077 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0e6807af30 msgr2=0x7f0e6807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:42.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.905+0000 7f0e80a52640 1 --2- 172.21.15.17:0/2866973077 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0e6807af30 0x7f0e6807d3f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c005fd0 tx=0x7f0e6c00b390 comp rx=0 tx=0).stop 2024-09-20T18:52:42.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.905+0000 7f0e80a52640 1 -- 172.21.15.17:0/2866973077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c107900 msgr2=0x7f0e7c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:42.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.905+0000 7f0e80a52640 1 --2- 172.21.15.17:0/2866973077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c107900 0x7f0e7c19dbc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0e64031460 tx=0x7f0e640045e0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.906+0000 7f0e80a52640 1 -- 172.21.15.17:0/2866973077 shutdown_connections 2024-09-20T18:52:42.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.906+0000 7f0e80a52640 1 --2- 172.21.15.17:0/2866973077 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0e6807af30 0x7f0e6807d3f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.906+0000 7f0e80a52640 1 --2- 172.21.15.17:0/2866973077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c107900 0x7f0e7c19dbc0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.906+0000 7f0e80a52640 1 --2- 172.21.15.17:0/2866973077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e7c101900 0x7f0e7c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:42.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.906+0000 7f0e80a52640 1 -- 172.21.15.17:0/2866973077 >> 172.21.15.17:0/2866973077 conn(0x7f0e7c0fd600 msgr2=0x7f0e7c0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:42.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.906+0000 7f0e80a52640 1 -- 172.21.15.17:0/2866973077 shutdown_connections 2024-09-20T18:52:42.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.906+0000 7f0e80a52640 1 -- 172.21.15.17:0/2866973077 wait complete. 2024-09-20T18:52:43.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.988+0000 7f89d1e9f640 1 -- 172.21.15.17:0/3795704010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89cc1033e0 msgr2=0x7f89cc10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:43.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.988+0000 7f89d1e9f640 1 --2- 172.21.15.17:0/3795704010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89cc1033e0 0x7f89cc10b8d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f89c0009880 tx=0x7f89c002a530 comp rx=0 tx=0).stop 2024-09-20T18:52:43.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.988+0000 7f89d1e9f640 1 -- 172.21.15.17:0/3795704010 shutdown_connections 2024-09-20T18:52:43.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.988+0000 7f89d1e9f640 1 --2- 172.21.15.17:0/3795704010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89cc1033e0 0x7f89cc10b8d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.988+0000 7f89d1e9f640 1 --2- 172.21.15.17:0/3795704010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89cc102ac0 0x7f89cc102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.988+0000 7f89d1e9f640 1 -- 172.21.15.17:0/3795704010 >> 172.21.15.17:0/3795704010 conn(0x7f89cc0fc520 msgr2=0x7f89cc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:43.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.988+0000 7f89d1e9f640 1 -- 172.21.15.17:0/3795704010 shutdown_connections 2024-09-20T18:52:43.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.989+0000 7f89d1e9f640 1 -- 172.21.15.17:0/3795704010 wait complete. 2024-09-20T18:52:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.989+0000 7f89d1e9f640 1 Processor -- start 2024-09-20T18:52:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.989+0000 7f89d1e9f640 1 -- start start 2024-09-20T18:52:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.989+0000 7f89d1e9f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89cc102ac0 0x7f89cc19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.989+0000 7f89d1e9f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89cc1033e0 0x7f89cc19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.989+0000 7f89d1e9f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc10edf0 con 0x7f89cc1033e0 2024-09-20T18:52:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.990+0000 7f89d1e9f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc10ec70 con 0x7f89cc102ac0 2024-09-20T18:52:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.990+0000 7f89caffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89cc1033e0 0x7f89cc19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.990+0000 7f89caffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89cc1033e0 0x7f89cc19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45154/0 (socket says 172.21.15.17:45154) 2024-09-20T18:52:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.990+0000 7f89caffd640 1 -- 172.21.15.17:0/2359976713 learned_addr learned my addr 172.21.15.17:0/2359976713 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:52:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.990+0000 7f89cb7fe640 1 --2- 172.21.15.17:0/2359976713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89cc102ac0 0x7f89cc19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.990+0000 7f89caffd640 1 -- 172.21.15.17:0/2359976713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89cc102ac0 msgr2=0x7f89cc19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:43.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.990+0000 7f89caffd640 1 --2- 172.21.15.17:0/2359976713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89cc102ac0 0x7f89cc19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.990+0000 7f89caffd640 1 -- 172.21.15.17:0/2359976713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc197800 con 0x7f89cc1033e0 2024-09-20T18:52:43.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.990+0000 7f89cb7fe640 1 --2- 172.21.15.17:0/2359976713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89cc102ac0 0x7f89cc19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:52:43.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.990+0000 7f89caffd640 1 --2- 172.21.15.17:0/2359976713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89cc1033e0 0x7f89cc19dbc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f89c0031460 tx=0x7f89c0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:43.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.990+0000 7f89c8ff9640 1 -- 172.21.15.17:0/2359976713 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f89c003f070 con 0x7f89cc1033e0 2024-09-20T18:52:43.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.990+0000 7f89d1e9f640 1 -- 172.21.15.17:0/2359976713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89cc197a90 con 0x7f89cc1033e0 2024-09-20T18:52:43.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.990+0000 7f89c8ff9640 1 -- 172.21.15.17:0/2359976713 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f89c0004a90 con 0x7f89cc1033e0 2024-09-20T18:52:43.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.990+0000 7f89c8ff9640 1 -- 172.21.15.17:0/2359976713 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f89c0035030 con 0x7f89cc1033e0 2024-09-20T18:52:43.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.990+0000 7f89d1e9f640 1 -- 172.21.15.17:0/2359976713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89cc197fc0 con 0x7f89cc1033e0 2024-09-20T18:52:43.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.991+0000 7f89d1e9f640 1 -- 172.21.15.17:0/2359976713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89cc06aa90 con 0x7f89cc1033e0 2024-09-20T18:52:43.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.992+0000 7f89c8ff9640 1 -- 172.21.15.17:0/2359976713 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f89c0042070 con 0x7f89cc1033e0 2024-09-20T18:52:43.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.993+0000 7f89c8ff9640 1 --2- 172.21.15.17:0/2359976713 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f89b407af40 0x7f89b407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:43.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.993+0000 7f89c8ff9640 1 -- 172.21.15.17:0/2359976713 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f89c00beb00 con 0x7f89cc1033e0 2024-09-20T18:52:43.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.993+0000 7f89cb7fe640 1 --2- 172.21.15.17:0/2359976713 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f89b407af40 0x7f89b407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:43.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.993+0000 7f89cb7fe640 1 --2- 172.21.15.17:0/2359976713 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f89b407af40 0x7f89b407d400 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009b40 tx=0x7f89bc005e50 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:43.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:42.997+0000 7f89c8ff9640 1 -- 172.21.15.17:0/2359976713 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f89c008a100 con 0x7f89cc1033e0 2024-09-20T18:52:43.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.261+0000 7f89d1e9f640 1 -- 172.21.15.17:0/2359976713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f89cc105f60 con 0x7f89cc1033e0 2024-09-20T18:52:43.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.261+0000 7f89c8ff9640 1 -- 172.21.15.17:0/2359976713 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f89c008efb0 con 0x7f89cc1033e0 2024-09-20T18:52:43.279 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:52:43.279 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:52:43.279 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:52:43.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:52:43.279 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:52:43.279 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:52:43.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:52:43.279 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:52:43.279 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:52:43.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:52:43.279 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:52:43.279 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:52:43.279 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:52:43.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:52:43.280 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:52:43.280 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:52:43.280 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:52:43.280 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:52:43.280 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:52:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.263+0000 7f89d1e9f640 1 -- 172.21.15.17:0/2359976713 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f89b407af40 msgr2=0x7f89b407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.263+0000 7f89d1e9f640 1 --2- 172.21.15.17:0/2359976713 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f89b407af40 0x7f89b407d400 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009b40 tx=0x7f89bc005e50 comp rx=0 tx=0).stop 2024-09-20T18:52:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.263+0000 7f89d1e9f640 1 -- 172.21.15.17:0/2359976713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89cc1033e0 msgr2=0x7f89cc19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.263+0000 7f89d1e9f640 1 --2- 172.21.15.17:0/2359976713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89cc1033e0 0x7f89cc19dbc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f89c0031460 tx=0x7f89c0004530 comp rx=0 tx=0).stop 2024-09-20T18:52:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.264+0000 7f89d1e9f640 1 -- 172.21.15.17:0/2359976713 shutdown_connections 2024-09-20T18:52:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.264+0000 7f89d1e9f640 1 --2- 172.21.15.17:0/2359976713 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f89b407af40 0x7f89b407d400 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.264+0000 7f89d1e9f640 1 --2- 172.21.15.17:0/2359976713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89cc1033e0 0x7f89cc19dbc0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.264+0000 7f89d1e9f640 1 --2- 172.21.15.17:0/2359976713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89cc102ac0 0x7f89cc19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.264+0000 7f89d1e9f640 1 -- 172.21.15.17:0/2359976713 >> 172.21.15.17:0/2359976713 conn(0x7f89cc0fc520 msgr2=0x7f89cc108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.264+0000 7f89d1e9f640 1 -- 172.21.15.17:0/2359976713 shutdown_connections 2024-09-20T18:52:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.264+0000 7f89d1e9f640 1 -- 172.21.15.17:0/2359976713 wait complete. 2024-09-20T18:52:43.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.348+0000 7f4f30f80640 1 -- 172.21.15.17:0/3760974234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2c101900 msgr2=0x7f4f2c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:43.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.348+0000 7f4f30f80640 1 --2- 172.21.15.17:0/3760974234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2c101900 0x7f4f2c101d60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009880 tx=0x7f4f2002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.348+0000 7f4f30f80640 1 -- 172.21.15.17:0/3760974234 shutdown_connections 2024-09-20T18:52:43.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.348+0000 7f4f30f80640 1 --2- 172.21.15.17:0/3760974234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2c101900 0x7f4f2c101d60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.348+0000 7f4f30f80640 1 --2- 172.21.15.17:0/3760974234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f2c107900 0x7f4f2c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.348+0000 7f4f30f80640 1 -- 172.21.15.17:0/3760974234 >> 172.21.15.17:0/3760974234 conn(0x7f4f2c0fd600 msgr2=0x7f4f2c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:43.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.348+0000 7f4f30f80640 1 -- 172.21.15.17:0/3760974234 shutdown_connections 2024-09-20T18:52:43.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.348+0000 7f4f30f80640 1 -- 172.21.15.17:0/3760974234 wait complete. 2024-09-20T18:52:43.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.349+0000 7f4f30f80640 1 Processor -- start 2024-09-20T18:52:43.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.349+0000 7f4f30f80640 1 -- start start 2024-09-20T18:52:43.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.349+0000 7f4f30f80640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f2c101900 0x7f4f2c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:43.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.349+0000 7f4f30f80640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2c107900 0x7f4f2c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:43.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.349+0000 7f4f30f80640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c10edb0 con 0x7f4f2c107900 2024-09-20T18:52:43.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.349+0000 7f4f30f80640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c10ec30 con 0x7f4f2c101900 2024-09-20T18:52:43.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.349+0000 7f4f29d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2c107900 0x7f4f2c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:43.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.349+0000 7f4f29d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2c107900 0x7f4f2c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45170/0 (socket says 172.21.15.17:45170) 2024-09-20T18:52:43.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.349+0000 7f4f29d9b640 1 -- 172.21.15.17:0/3252811652 learned_addr learned my addr 172.21.15.17:0/3252811652 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:52:43.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.350+0000 7f4f2a59c640 1 --2- 172.21.15.17:0/3252811652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f2c101900 0x7f4f2c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:43.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.350+0000 7f4f29d9b640 1 -- 172.21.15.17:0/3252811652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f2c101900 msgr2=0x7f4f2c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:43.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.350+0000 7f4f29d9b640 1 --2- 172.21.15.17:0/3252811652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f2c101900 0x7f4f2c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.350+0000 7f4f29d9b640 1 -- 172.21.15.17:0/3252811652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2c197800 con 0x7f4f2c107900 2024-09-20T18:52:43.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.350+0000 7f4f29d9b640 1 --2- 172.21.15.17:0/3252811652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2c107900 0x7f4f2c19dbc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4f20031460 tx=0x7f4f200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:43.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.350+0000 7f4f1b7fe640 1 -- 172.21.15.17:0/3252811652 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f2003f070 con 0x7f4f2c107900 2024-09-20T18:52:43.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.350+0000 7f4f1b7fe640 1 -- 172.21.15.17:0/3252811652 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f20004cf0 con 0x7f4f2c107900 2024-09-20T18:52:43.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.350+0000 7f4f30f80640 1 -- 172.21.15.17:0/3252811652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2c197a90 con 0x7f4f2c107900 2024-09-20T18:52:43.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.350+0000 7f4f1b7fe640 1 -- 172.21.15.17:0/3252811652 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f20035030 con 0x7f4f2c107900 2024-09-20T18:52:43.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.350+0000 7f4f30f80640 1 -- 172.21.15.17:0/3252811652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f2c197fc0 con 0x7f4f2c107900 2024-09-20T18:52:43.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.351+0000 7f4f30f80640 1 -- 172.21.15.17:0/3252811652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f2c103040 con 0x7f4f2c107900 2024-09-20T18:52:43.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.352+0000 7f4f1b7fe640 1 -- 172.21.15.17:0/3252811652 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4f20042070 con 0x7f4f2c107900 2024-09-20T18:52:43.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.352+0000 7f4f1b7fe640 1 --2- 172.21.15.17:0/3252811652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4f1407af30 0x7f4f1407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:43.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.352+0000 7f4f1b7fe640 1 -- 172.21.15.17:0/3252811652 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f4f200beac0 con 0x7f4f2c107900 2024-09-20T18:52:43.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.352+0000 7f4f2a59c640 1 --2- 172.21.15.17:0/3252811652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4f1407af30 0x7f4f1407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:43.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.353+0000 7f4f2a59c640 1 --2- 172.21.15.17:0/3252811652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4f1407af30 0x7f4f1407d3f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0058c0 tx=0x7f4f1c00a4c0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:43.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.357+0000 7f4f1b7fe640 1 -- 172.21.15.17:0/3252811652 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f2008a0c0 con 0x7f4f2c107900 2024-09-20T18:52:43.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.584+0000 7f4f30f80640 1 -- 172.21.15.17:0/3252811652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4f2c109e90 con 0x7f4f2c107900 2024-09-20T18:52:43.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.584+0000 7f4f1b7fe640 1 -- 172.21.15.17:0/3252811652 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f4f2008ef70 con 0x7f4f2c107900 2024-09-20T18:52:43.602 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:52:43.602 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:52:43.602 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:52:43.602 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:52:43.602 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:52:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:52:43.602 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:52:43.602 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:52:43.602 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:52:43.602 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:52:43.603 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:52:43.603 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:52:43.603 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:52:43.603 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:52:43.603 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:52:43.603 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:52:43.603 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:52:43.603 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:52:43.603 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:52:43.603 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:52:43.603 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:52:43.603 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:52:43.603 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:52:43.603 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:52:43.604 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:52:43.604 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:52:43.604 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:52:43.604 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:52:43.604 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:52:43.604 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:52:43.604 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:52:43.604 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:52:43.604 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:52:43.604 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:52:43.604 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:52:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:52:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:52:43.604 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:52:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:52:43.605 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:52:43.605 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:52:43.605 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:52:43.605 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:52:43.605 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:52:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.586+0000 7f4f30f80640 1 -- 172.21.15.17:0/3252811652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4f1407af30 msgr2=0x7f4f1407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.586+0000 7f4f30f80640 1 --2- 172.21.15.17:0/3252811652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4f1407af30 0x7f4f1407d3f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0058c0 tx=0x7f4f1c00a4c0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.586+0000 7f4f30f80640 1 -- 172.21.15.17:0/3252811652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2c107900 msgr2=0x7f4f2c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.586+0000 7f4f30f80640 1 --2- 172.21.15.17:0/3252811652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2c107900 0x7f4f2c19dbc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4f20031460 tx=0x7f4f200048f0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.586+0000 7f4f30f80640 1 -- 172.21.15.17:0/3252811652 shutdown_connections 2024-09-20T18:52:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.586+0000 7f4f30f80640 1 --2- 172.21.15.17:0/3252811652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4f1407af30 0x7f4f1407d3f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.586+0000 7f4f30f80640 1 --2- 172.21.15.17:0/3252811652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f2c107900 0x7f4f2c19dbc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.586+0000 7f4f30f80640 1 --2- 172.21.15.17:0/3252811652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f2c101900 0x7f4f2c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.586+0000 7f4f30f80640 1 -- 172.21.15.17:0/3252811652 >> 172.21.15.17:0/3252811652 conn(0x7f4f2c0fd600 msgr2=0x7f4f2c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.586+0000 7f4f30f80640 1 -- 172.21.15.17:0/3252811652 shutdown_connections 2024-09-20T18:52:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.586+0000 7f4f30f80640 1 -- 172.21.15.17:0/3252811652 wait complete. 2024-09-20T18:52:43.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.673+0000 7f4a98ee0640 1 -- 172.21.15.17:0/1225062010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a94100800 msgr2=0x7f4a94100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:43.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.673+0000 7f4a98ee0640 1 --2- 172.21.15.17:0/1225062010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a94100800 0x7f4a94100c60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009880 tx=0x7f4a7c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.673+0000 7f4a98ee0640 1 -- 172.21.15.17:0/1225062010 shutdown_connections 2024-09-20T18:52:43.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.673+0000 7f4a98ee0640 1 --2- 172.21.15.17:0/1225062010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a94100800 0x7f4a94100c60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.673+0000 7f4a98ee0640 1 --2- 172.21.15.17:0/1225062010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a94106800 0x7f4a94106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.673+0000 7f4a98ee0640 1 -- 172.21.15.17:0/1225062010 >> 172.21.15.17:0/1225062010 conn(0x7f4a940fc520 msgr2=0x7f4a940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:43.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.673+0000 7f4a98ee0640 1 -- 172.21.15.17:0/1225062010 shutdown_connections 2024-09-20T18:52:43.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.673+0000 7f4a98ee0640 1 -- 172.21.15.17:0/1225062010 wait complete. 2024-09-20T18:52:43.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.674+0000 7f4a98ee0640 1 Processor -- start 2024-09-20T18:52:43.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.674+0000 7f4a98ee0640 1 -- start start 2024-09-20T18:52:43.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.674+0000 7f4a98ee0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a94100800 0x7f4a940fcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:43.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.674+0000 7f4a98ee0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a94106800 0x7f4a940fd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:43.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.674+0000 7f4a98ee0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9410dd30 con 0x7f4a94106800 2024-09-20T18:52:43.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.674+0000 7f4a98ee0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9410dbb0 con 0x7f4a94100800 2024-09-20T18:52:43.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.675+0000 7f4a91d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a94106800 0x7f4a940fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:43.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.675+0000 7f4a91d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a94106800 0x7f4a940fd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45180/0 (socket says 172.21.15.17:45180) 2024-09-20T18:52:43.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.675+0000 7f4a91d9b640 1 -- 172.21.15.17:0/2617550200 learned_addr learned my addr 172.21.15.17:0/2617550200 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:52:43.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.675+0000 7f4a9259c640 1 --2- 172.21.15.17:0/2617550200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a94100800 0x7f4a940fcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:43.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.675+0000 7f4a91d9b640 1 -- 172.21.15.17:0/2617550200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a94100800 msgr2=0x7f4a940fcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:43.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.675+0000 7f4a91d9b640 1 --2- 172.21.15.17:0/2617550200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a94100800 0x7f4a940fcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.675+0000 7f4a91d9b640 1 -- 172.21.15.17:0/2617550200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a940fd680 con 0x7f4a94106800 2024-09-20T18:52:43.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.675+0000 7f4a9259c640 1 --2- 172.21.15.17:0/2617550200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a94100800 0x7f4a940fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:52:43.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.675+0000 7f4a91d9b640 1 --2- 172.21.15.17:0/2617550200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a94106800 0x7f4a940fd140 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c031460 tx=0x7f4a7c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:43.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.675+0000 7f4a8b7fe640 1 -- 172.21.15.17:0/2617550200 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a7c03f070 con 0x7f4a94106800 2024-09-20T18:52:43.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.675+0000 7f4a98ee0640 1 -- 172.21.15.17:0/2617550200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a940fd910 con 0x7f4a94106800 2024-09-20T18:52:43.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.675+0000 7f4a8b7fe640 1 -- 172.21.15.17:0/2617550200 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4a7c0044d0 con 0x7f4a94106800 2024-09-20T18:52:43.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.675+0000 7f4a8b7fe640 1 -- 172.21.15.17:0/2617550200 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a7c035030 con 0x7f4a94106800 2024-09-20T18:52:43.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.675+0000 7f4a98ee0640 1 -- 172.21.15.17:0/2617550200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a941a3e10 con 0x7f4a94106800 2024-09-20T18:52:43.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.677+0000 7f4a98ee0640 1 -- 172.21.15.17:0/2617550200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a94101f40 con 0x7f4a94106800 2024-09-20T18:52:43.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.677+0000 7f4a8b7fe640 1 -- 172.21.15.17:0/2617550200 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4a7c042070 con 0x7f4a94106800 2024-09-20T18:52:43.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.678+0000 7f4a8b7fe640 1 --2- 172.21.15.17:0/2617550200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4a8007af40 0x7f4a8007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:43.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.678+0000 7f4a8b7fe640 1 -- 172.21.15.17:0/2617550200 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f4a7c0bebe0 con 0x7f4a94106800 2024-09-20T18:52:43.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.678+0000 7f4a9259c640 1 --2- 172.21.15.17:0/2617550200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4a8007af40 0x7f4a8007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:43.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.678+0000 7f4a9259c640 1 --2- 172.21.15.17:0/2617550200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4a8007af40 0x7f4a8007d400 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4a84006fd0 tx=0x7f4a84008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:43.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.682+0000 7f4a8b7fe640 1 -- 172.21.15.17:0/2617550200 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4a7c004cf0 con 0x7f4a94106800 2024-09-20T18:52:43.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:43 smithi017 ceph-mon[108970]: from='client.34790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:52:43.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:43 smithi017 ceph-mon[108970]: pgmap v519: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:43.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:43 smithi017 ceph-mon[108970]: from='client.34794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:52:43.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:43 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2359976713' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:52:43.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:43 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3252811652' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:52:43.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.886+0000 7f4a98ee0640 1 -- 172.21.15.17:0/2617550200 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4a94062630 con 0x7f4a8007af40 2024-09-20T18:52:43.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.888+0000 7f4a8b7fe640 1 -- 172.21.15.17:0/2617550200 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f4a94062630 con 0x7f4a8007af40 2024-09-20T18:52:43.905 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:52:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:52:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:52:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:52:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:52:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:52:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:52:43.905 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:52:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:52:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:52:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:52:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:52:43.906 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:52:43.906 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:52:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.890+0000 7f4a98ee0640 1 -- 172.21.15.17:0/2617550200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4a8007af40 msgr2=0x7f4a8007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.890+0000 7f4a98ee0640 1 --2- 172.21.15.17:0/2617550200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4a8007af40 0x7f4a8007d400 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4a84006fd0 tx=0x7f4a84008040 comp rx=0 tx=0).stop 2024-09-20T18:52:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.890+0000 7f4a98ee0640 1 -- 172.21.15.17:0/2617550200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a94106800 msgr2=0x7f4a940fd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.890+0000 7f4a98ee0640 1 --2- 172.21.15.17:0/2617550200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a94106800 0x7f4a940fd140 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c031460 tx=0x7f4a7c0048f0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.890+0000 7f4a98ee0640 1 -- 172.21.15.17:0/2617550200 shutdown_connections 2024-09-20T18:52:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.890+0000 7f4a98ee0640 1 --2- 172.21.15.17:0/2617550200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4a8007af40 0x7f4a8007d400 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.890+0000 7f4a98ee0640 1 --2- 172.21.15.17:0/2617550200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a94106800 0x7f4a940fd140 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.890+0000 7f4a98ee0640 1 --2- 172.21.15.17:0/2617550200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a94100800 0x7f4a940fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.890+0000 7f4a98ee0640 1 -- 172.21.15.17:0/2617550200 >> 172.21.15.17:0/2617550200 conn(0x7f4a940fc520 msgr2=0x7f4a9406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.890+0000 7f4a98ee0640 1 -- 172.21.15.17:0/2617550200 shutdown_connections 2024-09-20T18:52:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.890+0000 7f4a98ee0640 1 -- 172.21.15.17:0/2617550200 wait complete. 2024-09-20T18:52:43.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:43 smithi172 ceph-mon[80431]: from='client.34790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:52:43.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:43 smithi172 ceph-mon[80431]: pgmap v519: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:43.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:43 smithi172 ceph-mon[80431]: from='client.34794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:52:43.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:43 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2359976713' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:52:43.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:43 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3252811652' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:52:43.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.974+0000 7f4e313e4640 1 -- 172.21.15.17:0/738942090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e2c102ac0 msgr2=0x7f4e2c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:43.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.974+0000 7f4e313e4640 1 --2- 172.21.15.17:0/738942090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e2c102ac0 0x7f4e2c102ea0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009880 tx=0x7f4e1c02a530 comp rx=0 tx=0).stop 2024-09-20T18:52:43.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.974+0000 7f4e313e4640 1 -- 172.21.15.17:0/738942090 shutdown_connections 2024-09-20T18:52:43.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.974+0000 7f4e313e4640 1 --2- 172.21.15.17:0/738942090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e2c1033e0 0x7f4e2c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.974+0000 7f4e313e4640 1 --2- 172.21.15.17:0/738942090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e2c102ac0 0x7f4e2c102ea0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.974+0000 7f4e313e4640 1 -- 172.21.15.17:0/738942090 >> 172.21.15.17:0/738942090 conn(0x7f4e2c0fc520 msgr2=0x7f4e2c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:43.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.974+0000 7f4e313e4640 1 -- 172.21.15.17:0/738942090 shutdown_connections 2024-09-20T18:52:43.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.974+0000 7f4e313e4640 1 -- 172.21.15.17:0/738942090 wait complete. 2024-09-20T18:52:43.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.975+0000 7f4e313e4640 1 Processor -- start 2024-09-20T18:52:43.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.975+0000 7f4e313e4640 1 -- start start 2024-09-20T18:52:43.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.975+0000 7f4e313e4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e2c102ac0 0x7f4e2c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:43.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.975+0000 7f4e313e4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e2c1033e0 0x7f4e2c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:43.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.975+0000 7f4e313e4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c10edf0 con 0x7f4e2c1033e0 2024-09-20T18:52:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.975+0000 7f4e313e4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c10ec70 con 0x7f4e2c102ac0 2024-09-20T18:52:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.976+0000 7f4e2a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e2c1033e0 0x7f4e2c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.976+0000 7f4e2a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e2c1033e0 0x7f4e2c19dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45202/0 (socket says 172.21.15.17:45202) 2024-09-20T18:52:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.976+0000 7f4e2a7fc640 1 -- 172.21.15.17:0/997053702 learned_addr learned my addr 172.21.15.17:0/997053702 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:52:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.976+0000 7f4e2affd640 1 --2- 172.21.15.17:0/997053702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e2c102ac0 0x7f4e2c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.976+0000 7f4e2a7fc640 1 -- 172.21.15.17:0/997053702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e2c102ac0 msgr2=0x7f4e2c19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.976+0000 7f4e2a7fc640 1 --2- 172.21.15.17:0/997053702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e2c102ac0 0x7f4e2c19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.976+0000 7f4e2a7fc640 1 -- 172.21.15.17:0/997053702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2c1977e0 con 0x7f4e2c1033e0 2024-09-20T18:52:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.976+0000 7f4e2affd640 1 --2- 172.21.15.17:0/997053702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e2c102ac0 0x7f4e2c19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:52:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.976+0000 7f4e2a7fc640 1 --2- 172.21.15.17:0/997053702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e2c1033e0 0x7f4e2c19dba0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000c8f0 tx=0x7f4e2000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.976+0000 7f4e13fff640 1 -- 172.21.15.17:0/997053702 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e2000ae50 con 0x7f4e2c1033e0 2024-09-20T18:52:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.976+0000 7f4e313e4640 1 -- 172.21.15.17:0/997053702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2c197ad0 con 0x7f4e2c1033e0 2024-09-20T18:52:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.976+0000 7f4e13fff640 1 -- 172.21.15.17:0/997053702 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4e20005020 con 0x7f4e2c1033e0 2024-09-20T18:52:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.976+0000 7f4e13fff640 1 -- 172.21.15.17:0/997053702 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e20004d70 con 0x7f4e2c1033e0 2024-09-20T18:52:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.976+0000 7f4e313e4640 1 -- 172.21.15.17:0/997053702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2c198060 con 0x7f4e2c1033e0 2024-09-20T18:52:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.978+0000 7f4e313e4640 1 -- 172.21.15.17:0/997053702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e2c06aa90 con 0x7f4e2c1033e0 2024-09-20T18:52:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.978+0000 7f4e13fff640 1 -- 172.21.15.17:0/997053702 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4e200051d0 con 0x7f4e2c1033e0 2024-09-20T18:52:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.979+0000 7f4e13fff640 1 --2- 172.21.15.17:0/997053702 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4e1407b0e0 0x7f4e1407d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:52:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.979+0000 7f4e13fff640 1 -- 172.21.15.17:0/997053702 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f4e2009de20 con 0x7f4e2c1033e0 2024-09-20T18:52:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.979+0000 7f4e2affd640 1 --2- 172.21.15.17:0/997053702 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4e1407b0e0 0x7f4e1407d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:52:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.979+0000 7f4e2affd640 1 --2- 172.21.15.17:0/997053702 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4e1407b0e0 0x7f4e1407d5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c006010 tx=0x7f4e1c0095f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:52:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:43.983+0000 7f4e13fff640 1 -- 172.21.15.17:0/997053702 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4e20014030 con 0x7f4e2c1033e0 2024-09-20T18:52:44.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:44.244+0000 7f4e313e4640 1 -- 172.21.15.17:0/997053702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f4e2c105f90 con 0x7f4e2c1033e0 2024-09-20T18:52:44.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:44.245+0000 7f4e13fff640 1 -- 172.21.15.17:0/997053702 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f4e20069420 con 0x7f4e2c1033e0 2024-09-20T18:52:44.262 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:52:44.262 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:52:44.262 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:52:44.262 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:52:44.262 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:52:44.262 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:52:44.263 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:52:44.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:44.248+0000 7f4e313e4640 1 -- 172.21.15.17:0/997053702 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4e1407b0e0 msgr2=0x7f4e1407d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:44.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:44.248+0000 7f4e313e4640 1 --2- 172.21.15.17:0/997053702 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4e1407b0e0 0x7f4e1407d5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c006010 tx=0x7f4e1c0095f0 comp rx=0 tx=0).stop 2024-09-20T18:52:44.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:44.248+0000 7f4e313e4640 1 -- 172.21.15.17:0/997053702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e2c1033e0 msgr2=0x7f4e2c19dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:52:44.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:44.248+0000 7f4e313e4640 1 --2- 172.21.15.17:0/997053702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e2c1033e0 0x7f4e2c19dba0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000c8f0 tx=0x7f4e2000cdb0 comp rx=0 tx=0).stop 2024-09-20T18:52:44.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:44.248+0000 7f4e313e4640 1 -- 172.21.15.17:0/997053702 shutdown_connections 2024-09-20T18:52:44.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:44.248+0000 7f4e313e4640 1 --2- 172.21.15.17:0/997053702 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4e1407b0e0 0x7f4e1407d5a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:44.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:44.248+0000 7f4e313e4640 1 --2- 172.21.15.17:0/997053702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e2c1033e0 0x7f4e2c19dba0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:44.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:44.248+0000 7f4e313e4640 1 --2- 172.21.15.17:0/997053702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e2c102ac0 0x7f4e2c19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:52:44.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:44.248+0000 7f4e313e4640 1 -- 172.21.15.17:0/997053702 >> 172.21.15.17:0/997053702 conn(0x7f4e2c0fc520 msgr2=0x7f4e2c108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:52:44.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:44.248+0000 7f4e313e4640 1 -- 172.21.15.17:0/997053702 shutdown_connections 2024-09-20T18:52:44.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:52:44.248+0000 7f4e313e4640 1 -- 172.21.15.17:0/997053702 wait complete. 2024-09-20T18:52:44.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:44 smithi172 ceph-mon[80431]: from='client.34798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:52:44.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:44 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/997053702' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:52:45.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:44 smithi017 ceph-mon[108970]: from='client.34798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:52:45.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:44 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/997053702' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:52:45.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:45 smithi172 ceph-mon[80431]: from='client.34810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:52:45.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:45 smithi172 ceph-mon[80431]: pgmap v520: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:46.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:45 smithi017 ceph-mon[108970]: from='client.34810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:52:46.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:45 smithi017 ceph-mon[108970]: pgmap v520: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:47.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:47 smithi172 ceph-mon[80431]: pgmap v521: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:48.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:47 smithi017 ceph-mon[108970]: pgmap v521: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:49.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:49 smithi017 ceph-mon[108970]: pgmap v522: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:49.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:49 smithi172 ceph-mon[80431]: pgmap v522: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:51.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:51 smithi017 ceph-mon[108970]: pgmap v523: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:51.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:51 smithi172 ceph-mon[80431]: pgmap v523: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:52.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:52:52.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:52:53.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:53 smithi172 ceph-mon[80431]: pgmap v524: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:54.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:53 smithi017 ceph-mon[108970]: pgmap v524: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:55 smithi017 ceph-mon[108970]: pgmap v525: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:55.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:55 smithi172 ceph-mon[80431]: pgmap v525: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:57.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:57 smithi172 ceph-mon[80431]: pgmap v526: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:58.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:57 smithi017 ceph-mon[108970]: pgmap v526: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:52:59.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:52:59 smithi172 ceph-mon[80431]: pgmap v527: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:00.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:52:59 smithi017 ceph-mon[108970]: pgmap v527: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:01.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:01 smithi017 ceph-mon[108970]: pgmap v528: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:01.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:01 smithi172 ceph-mon[80431]: pgmap v528: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:03.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:03 smithi172 ceph-mon[80431]: pgmap v529: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:04.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:03 smithi017 ceph-mon[108970]: pgmap v529: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:05.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:05 smithi172 ceph-mon[80431]: pgmap v530: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:06.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:05 smithi017 ceph-mon[108970]: pgmap v530: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:07.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:07 smithi017 ceph-mon[108970]: pgmap v531: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:07.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:53:07.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:07 smithi172 ceph-mon[80431]: pgmap v531: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:07.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:53:09.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:09 smithi172 ceph-mon[80431]: pgmap v532: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:10.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:09 smithi017 ceph-mon[108970]: pgmap v532: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:11.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:11 smithi172 ceph-mon[80431]: pgmap v533: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:11.967 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:11 smithi017 ceph-mon[108970]: pgmap v533: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:13.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:13 smithi017 ceph-mon[108970]: pgmap v534: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:13.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:13 smithi172 ceph-mon[80431]: pgmap v534: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:14.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.345+0000 7f13acdde640 1 -- 172.21.15.17:0/3908143428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13a8102ac0 msgr2=0x7f13a8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:14.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.345+0000 7f13acdde640 1 --2- 172.21.15.17:0/3908143428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13a8102ac0 0x7f13a8102ea0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1398009c20 tx=0x7f139802aa00 comp rx=0 tx=0).stop 2024-09-20T18:53:14.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.346+0000 7f13acdde640 1 -- 172.21.15.17:0/3908143428 shutdown_connections 2024-09-20T18:53:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.346+0000 7f13acdde640 1 --2- 172.21.15.17:0/3908143428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a81033e0 0x7f13a810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.346+0000 7f13acdde640 1 --2- 172.21.15.17:0/3908143428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13a8102ac0 0x7f13a8102ea0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.346+0000 7f13acdde640 1 -- 172.21.15.17:0/3908143428 >> 172.21.15.17:0/3908143428 conn(0x7f13a80fc520 msgr2=0x7f13a80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.346+0000 7f13acdde640 1 -- 172.21.15.17:0/3908143428 shutdown_connections 2024-09-20T18:53:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.346+0000 7f13acdde640 1 -- 172.21.15.17:0/3908143428 wait complete. 2024-09-20T18:53:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.346+0000 7f13acdde640 1 Processor -- start 2024-09-20T18:53:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.347+0000 7f13acdde640 1 -- start start 2024-09-20T18:53:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.347+0000 7f13acdde640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a8102ac0 0x7f13a819f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.347+0000 7f13acdde640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13a81033e0 0x7f13a819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.347+0000 7f13acdde640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f13a810edd0 con 0x7f13a81033e0 2024-09-20T18:53:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.347+0000 7f13acdde640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f13a810ec50 con 0x7f13a8102ac0 2024-09-20T18:53:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.347+0000 7f13a5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13a81033e0 0x7f13a819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.347+0000 7f13a5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13a81033e0 0x7f13a819fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35716/0 (socket says 172.21.15.17:35716) 2024-09-20T18:53:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.347+0000 7f13a5d9b640 1 -- 172.21.15.17:0/1737538452 learned_addr learned my addr 172.21.15.17:0/1737538452 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:53:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.347+0000 7f13a659c640 1 --2- 172.21.15.17:0/1737538452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a8102ac0 0x7f13a819f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.347+0000 7f13a5d9b640 1 -- 172.21.15.17:0/1737538452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a8102ac0 msgr2=0x7f13a819f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:14.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.347+0000 7f13a5d9b640 1 --2- 172.21.15.17:0/1737538452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a8102ac0 0x7f13a819f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:14.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.347+0000 7f13a5d9b640 1 -- 172.21.15.17:0/1737538452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a8199a80 con 0x7f13a81033e0 2024-09-20T18:53:14.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.347+0000 7f13a659c640 1 --2- 172.21.15.17:0/1737538452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a8102ac0 0x7f13a819f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:53:14.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.348+0000 7f13a5d9b640 1 --2- 172.21.15.17:0/1737538452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13a81033e0 0x7f13a819fd60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f139c00c8f0 tx=0x7f139c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:14.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.348+0000 7f13977fe640 1 -- 172.21.15.17:0/1737538452 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f139c0079b0 con 0x7f13a81033e0 2024-09-20T18:53:14.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.348+0000 7f13977fe640 1 -- 172.21.15.17:0/1737538452 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f139c007b50 con 0x7f13a81033e0 2024-09-20T18:53:14.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.348+0000 7f13acdde640 1 -- 172.21.15.17:0/1737538452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a8199d10 con 0x7f13a81033e0 2024-09-20T18:53:14.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.348+0000 7f13977fe640 1 -- 172.21.15.17:0/1737538452 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f139c018610 con 0x7f13a81033e0 2024-09-20T18:53:14.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.348+0000 7f13acdde640 1 -- 172.21.15.17:0/1737538452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a819a2a0 con 0x7f13a81033e0 2024-09-20T18:53:14.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.349+0000 7f13acdde640 1 -- 172.21.15.17:0/1737538452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a81a0460 con 0x7f13a81033e0 2024-09-20T18:53:14.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.350+0000 7f13977fe640 1 -- 172.21.15.17:0/1737538452 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f139c007d00 con 0x7f13a81033e0 2024-09-20T18:53:14.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.350+0000 7f13977fe640 1 --2- 172.21.15.17:0/1737538452 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f139007af40 0x7f139007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:14.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.350+0000 7f13977fe640 1 -- 172.21.15.17:0/1737538452 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f139c09e200 con 0x7f13a81033e0 2024-09-20T18:53:14.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.350+0000 7f13a659c640 1 --2- 172.21.15.17:0/1737538452 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f139007af40 0x7f139007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:14.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.351+0000 7f13a659c640 1 --2- 172.21.15.17:0/1737538452 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f139007af40 0x7f139007d400 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1398005e30 tx=0x7f139803a040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.355+0000 7f13977fe640 1 -- 172.21.15.17:0/1737538452 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f139c014030 con 0x7f13a81033e0 2024-09-20T18:53:14.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.560+0000 7f13acdde640 1 -- 172.21.15.17:0/1737538452 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f13a819af10 con 0x7f139007af40 2024-09-20T18:53:14.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.561+0000 7f13977fe640 1 -- 172.21.15.17:0/1737538452 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f13980481b0 con 0x7f139007af40 2024-09-20T18:53:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.564+0000 7f13acdde640 1 -- 172.21.15.17:0/1737538452 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f139007af40 msgr2=0x7f139007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.564+0000 7f13acdde640 1 --2- 172.21.15.17:0/1737538452 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f139007af40 0x7f139007d400 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1398005e30 tx=0x7f139803a040 comp rx=0 tx=0).stop 2024-09-20T18:53:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.564+0000 7f13acdde640 1 -- 172.21.15.17:0/1737538452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13a81033e0 msgr2=0x7f13a819fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.564+0000 7f13acdde640 1 --2- 172.21.15.17:0/1737538452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13a81033e0 0x7f13a819fd60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f139c00c8f0 tx=0x7f139c00cdb0 comp rx=0 tx=0).stop 2024-09-20T18:53:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.564+0000 7f13acdde640 1 -- 172.21.15.17:0/1737538452 shutdown_connections 2024-09-20T18:53:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.564+0000 7f13acdde640 1 --2- 172.21.15.17:0/1737538452 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f139007af40 0x7f139007d400 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.564+0000 7f13acdde640 1 --2- 172.21.15.17:0/1737538452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13a81033e0 0x7f13a819fd60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.564+0000 7f13acdde640 1 --2- 172.21.15.17:0/1737538452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a8102ac0 0x7f13a819f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.564+0000 7f13acdde640 1 -- 172.21.15.17:0/1737538452 >> 172.21.15.17:0/1737538452 conn(0x7f13a80fc520 msgr2=0x7f13a8100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.564+0000 7f13acdde640 1 -- 172.21.15.17:0/1737538452 shutdown_connections 2024-09-20T18:53:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.564+0000 7f13acdde640 1 -- 172.21.15.17:0/1737538452 wait complete. 2024-09-20T18:53:14.591 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:53:14.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.648+0000 7fdf315d7640 1 -- 172.21.15.17:0/1293257420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf2c102ab0 msgr2=0x7fdf2c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:14.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.648+0000 7fdf315d7640 1 --2- 172.21.15.17:0/1293257420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf2c102ab0 0x7fdf2c102e90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c009880 tx=0x7fdf1c02a530 comp rx=0 tx=0).stop 2024-09-20T18:53:14.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.649+0000 7fdf315d7640 1 -- 172.21.15.17:0/1293257420 shutdown_connections 2024-09-20T18:53:14.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.649+0000 7fdf315d7640 1 --2- 172.21.15.17:0/1293257420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf2c1033d0 0x7fdf2c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:14.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.649+0000 7fdf315d7640 1 --2- 172.21.15.17:0/1293257420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf2c102ab0 0x7fdf2c102e90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:14.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.649+0000 7fdf315d7640 1 -- 172.21.15.17:0/1293257420 >> 172.21.15.17:0/1293257420 conn(0x7fdf2c0fc4d0 msgr2=0x7fdf2c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:14.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.649+0000 7fdf315d7640 1 -- 172.21.15.17:0/1293257420 shutdown_connections 2024-09-20T18:53:14.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.649+0000 7fdf315d7640 1 -- 172.21.15.17:0/1293257420 wait complete. 2024-09-20T18:53:14.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.649+0000 7fdf315d7640 1 Processor -- start 2024-09-20T18:53:14.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.649+0000 7fdf315d7640 1 -- start start 2024-09-20T18:53:14.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.650+0000 7fdf315d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf2c102ab0 0x7fdf2c19d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:14.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.650+0000 7fdf315d7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf2c1033d0 0x7fdf2c19dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:14.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.650+0000 7fdf315d7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c10ede0 con 0x7fdf2c102ab0 2024-09-20T18:53:14.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.650+0000 7fdf315d7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c10ec60 con 0x7fdf2c1033d0 2024-09-20T18:53:14.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.650+0000 7fdf2affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf2c102ab0 0x7fdf2c19d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:14.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.650+0000 7fdf2affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf2c102ab0 0x7fdf2c19d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35728/0 (socket says 172.21.15.17:35728) 2024-09-20T18:53:14.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.650+0000 7fdf2affd640 1 -- 172.21.15.17:0/19341887 learned_addr learned my addr 172.21.15.17:0/19341887 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:53:14.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.650+0000 7fdf2a7fc640 1 --2- 172.21.15.17:0/19341887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf2c1033d0 0x7fdf2c19dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:14.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.650+0000 7fdf2affd640 1 -- 172.21.15.17:0/19341887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf2c1033d0 msgr2=0x7fdf2c19dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:14.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.650+0000 7fdf2affd640 1 --2- 172.21.15.17:0/19341887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf2c1033d0 0x7fdf2c19dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:14.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.650+0000 7fdf2affd640 1 -- 172.21.15.17:0/19341887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2c1978f0 con 0x7fdf2c102ab0 2024-09-20T18:53:14.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.650+0000 7fdf2affd640 1 --2- 172.21.15.17:0/19341887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf2c102ab0 0x7fdf2c19d730 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c031460 tx=0x7fdf1c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:14.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.650+0000 7fdf13fff640 1 -- 172.21.15.17:0/19341887 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf1c03f070 con 0x7fdf2c102ab0 2024-09-20T18:53:14.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.651+0000 7fdf315d7640 1 -- 172.21.15.17:0/19341887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2c197b80 con 0x7fdf2c102ab0 2024-09-20T18:53:14.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.651+0000 7fdf13fff640 1 -- 172.21.15.17:0/19341887 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdf1c0035f0 con 0x7fdf2c102ab0 2024-09-20T18:53:14.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.651+0000 7fdf13fff640 1 -- 172.21.15.17:0/19341887 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf1c035030 con 0x7fdf2c102ab0 2024-09-20T18:53:14.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.651+0000 7fdf315d7640 1 -- 172.21.15.17:0/19341887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf2c1980b0 con 0x7fdf2c102ab0 2024-09-20T18:53:14.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.652+0000 7fdf315d7640 1 -- 172.21.15.17:0/19341887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf2c06ada0 con 0x7fdf2c102ab0 2024-09-20T18:53:14.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.652+0000 7fdf13fff640 1 -- 172.21.15.17:0/19341887 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdf1c042070 con 0x7fdf2c102ab0 2024-09-20T18:53:14.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.653+0000 7fdf13fff640 1 --2- 172.21.15.17:0/19341887 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf1407af30 0x7fdf1407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:14.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.653+0000 7fdf13fff640 1 -- 172.21.15.17:0/19341887 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fdf1c0be900 con 0x7fdf2c102ab0 2024-09-20T18:53:14.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.653+0000 7fdf2a7fc640 1 --2- 172.21.15.17:0/19341887 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf1407af30 0x7fdf1407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:14.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.653+0000 7fdf2a7fc640 1 --2- 172.21.15.17:0/19341887 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf1407af30 0x7fdf1407d3f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0fee70 tx=0x7fdf20005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:14.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.657+0000 7fdf13fff640 1 -- 172.21.15.17:0/19341887 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdf1c089f00 con 0x7fdf2c102ab0 2024-09-20T18:53:14.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.862+0000 7fdf315d7640 1 -- 172.21.15.17:0/19341887 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fdf2c105ff0 con 0x7fdf1407af30 2024-09-20T18:53:14.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.863+0000 7fdf13fff640 1 -- 172.21.15.17:0/19341887 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fdf2001b3f0 con 0x7fdf1407af30 2024-09-20T18:53:14.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.866+0000 7fdf315d7640 1 -- 172.21.15.17:0/19341887 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf1407af30 msgr2=0x7fdf1407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:14.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.866+0000 7fdf315d7640 1 --2- 172.21.15.17:0/19341887 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf1407af30 0x7fdf1407d3f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0fee70 tx=0x7fdf20005f90 comp rx=0 tx=0).stop 2024-09-20T18:53:14.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.866+0000 7fdf315d7640 1 -- 172.21.15.17:0/19341887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf2c102ab0 msgr2=0x7fdf2c19d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:14.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.866+0000 7fdf315d7640 1 --2- 172.21.15.17:0/19341887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf2c102ab0 0x7fdf2c19d730 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c031460 tx=0x7fdf1c004530 comp rx=0 tx=0).stop 2024-09-20T18:53:14.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.866+0000 7fdf315d7640 1 -- 172.21.15.17:0/19341887 shutdown_connections 2024-09-20T18:53:14.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.866+0000 7fdf315d7640 1 --2- 172.21.15.17:0/19341887 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf1407af30 0x7fdf1407d3f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:14.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.866+0000 7fdf315d7640 1 --2- 172.21.15.17:0/19341887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf2c1033d0 0x7fdf2c19dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:14.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.866+0000 7fdf315d7640 1 --2- 172.21.15.17:0/19341887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf2c102ab0 0x7fdf2c19d730 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:14.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.866+0000 7fdf315d7640 1 -- 172.21.15.17:0/19341887 >> 172.21.15.17:0/19341887 conn(0x7fdf2c0fc4d0 msgr2=0x7fdf2c108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:14.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.866+0000 7fdf315d7640 1 -- 172.21.15.17:0/19341887 shutdown_connections 2024-09-20T18:53:14.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.866+0000 7fdf315d7640 1 -- 172.21.15.17:0/19341887 wait complete. 2024-09-20T18:53:14.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.950+0000 7f56c6c97640 1 -- 172.21.15.17:0/1217848517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c0101250 msgr2=0x7f56c0101630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:14.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.950+0000 7f56c6c97640 1 --2- 172.21.15.17:0/1217848517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c0101250 0x7f56c0101630 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f56b4009880 tx=0x7f56b402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:53:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.950+0000 7f56c6c97640 1 -- 172.21.15.17:0/1217848517 shutdown_connections 2024-09-20T18:53:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.950+0000 7f56c6c97640 1 --2- 172.21.15.17:0/1217848517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56c0101c00 0x7f56c0105520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.950+0000 7f56c6c97640 1 --2- 172.21.15.17:0/1217848517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c0101250 0x7f56c0101630 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.950+0000 7f56c6c97640 1 -- 172.21.15.17:0/1217848517 >> 172.21.15.17:0/1217848517 conn(0x7f56c00fbc90 msgr2=0x7f56c00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.950+0000 7f56c6c97640 1 -- 172.21.15.17:0/1217848517 shutdown_connections 2024-09-20T18:53:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.950+0000 7f56c6c97640 1 -- 172.21.15.17:0/1217848517 wait complete. 2024-09-20T18:53:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.951+0000 7f56c6c97640 1 Processor -- start 2024-09-20T18:53:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.951+0000 7f56c6c97640 1 -- start start 2024-09-20T18:53:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.951+0000 7f56c6c97640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56c0101250 0x7f56c019d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.951+0000 7f56c6c97640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c0101c00 0x7f56c019dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.951+0000 7f56c6c97640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f56c010dde0 con 0x7f56c0101c00 2024-09-20T18:53:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.951+0000 7f56c6c97640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f56c010dc60 con 0x7f56c0101250 2024-09-20T18:53:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.951+0000 7f56bffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c0101c00 0x7f56c019dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.951+0000 7f56bffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c0101c00 0x7f56c019dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35736/0 (socket says 172.21.15.17:35736) 2024-09-20T18:53:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.951+0000 7f56bffff640 1 -- 172.21.15.17:0/3304755002 learned_addr learned my addr 172.21.15.17:0/3304755002 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:53:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.951+0000 7f56c4a33640 1 --2- 172.21.15.17:0/3304755002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56c0101250 0x7f56c019d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.951+0000 7f56bffff640 1 -- 172.21.15.17:0/3304755002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56c0101250 msgr2=0x7f56c019d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.951+0000 7f56bffff640 1 --2- 172.21.15.17:0/3304755002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56c0101250 0x7f56c019d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.951+0000 7f56bffff640 1 -- 172.21.15.17:0/3304755002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c0197930 con 0x7f56c0101c00 2024-09-20T18:53:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.952+0000 7f56bffff640 1 --2- 172.21.15.17:0/3304755002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c0101c00 0x7f56c019dcb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00d6f0 tx=0x7f56ac00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.952+0000 7f56bdffb640 1 -- 172.21.15.17:0/3304755002 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f56ac017070 con 0x7f56c0101c00 2024-09-20T18:53:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.952+0000 7f56bdffb640 1 -- 172.21.15.17:0/3304755002 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f56ac00de00 con 0x7f56c0101c00 2024-09-20T18:53:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.952+0000 7f56c6c97640 1 -- 172.21.15.17:0/3304755002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56c0197c20 con 0x7f56c0101c00 2024-09-20T18:53:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.952+0000 7f56bdffb640 1 -- 172.21.15.17:0/3304755002 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f56ac004bb0 con 0x7f56c0101c00 2024-09-20T18:53:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.952+0000 7f56c6c97640 1 -- 172.21.15.17:0/3304755002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56c01981b0 con 0x7f56c0101c00 2024-09-20T18:53:14.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.953+0000 7f56c6c97640 1 -- 172.21.15.17:0/3304755002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56c0102000 con 0x7f56c0101c00 2024-09-20T18:53:14.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.954+0000 7f56bdffb640 1 -- 172.21.15.17:0/3304755002 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f56ac004e60 con 0x7f56c0101c00 2024-09-20T18:53:14.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.954+0000 7f56bdffb640 1 --2- 172.21.15.17:0/3304755002 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f56b007af30 0x7f56b007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:14.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.954+0000 7f56bdffb640 1 -- 172.21.15.17:0/3304755002 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f56ac09dba0 con 0x7f56c0101c00 2024-09-20T18:53:14.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.954+0000 7f56c4a33640 1 --2- 172.21.15.17:0/3304755002 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f56b007af30 0x7f56b007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.955+0000 7f56c4a33640 1 --2- 172.21.15.17:0/3304755002 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f56b007af30 0x7f56b007d3f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f56b4000c00 tx=0x7f56b4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:14.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:14.959+0000 7f56bdffb640 1 -- 172.21.15.17:0/3304755002 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f56ac0691a0 con 0x7f56c0101c00 2024-09-20T18:53:15.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.159+0000 7f56c6c97640 1 -- 172.21.15.17:0/3304755002 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f56c0198e60 con 0x7f56b007af30 2024-09-20T18:53:15.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.169+0000 7f56bdffb640 1 -- 172.21.15.17:0/3304755002 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f56c0198e60 con 0x7f56b007af30 2024-09-20T18:53:15.187 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:53:15.187 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (14m) 8m ago 25m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:53:15.187 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (17m) 8m ago 25m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:53:15.187 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (17m) 8m ago 24m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:53:15.187 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (12m) 8m ago 25m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:53:15.187 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (12m) 8m ago 24m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:53:15.187 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (14m) 8m ago 25m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:53:15.188 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (9m) 8m ago 20m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:53:15.188 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (8m) 8m ago 20m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:53:15.188 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (20m) 8m ago 20m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:53:15.188 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (8m) 8m ago 20m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:53:15.188 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (16m) 8m ago 26m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:53:15.188 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (15m) 8m ago 24m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:53:15.188 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (13m) 8m ago 26m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:53:15.188 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (13m) 8m ago 24m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:53:15.188 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (15m) 8m ago 25m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:53:15.188 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (15m) 8m ago 24m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:53:15.188 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (12m) 8m ago 23m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:53:15.188 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (11m) 8m ago 23m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:53:15.188 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (11m) 8m ago 22m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:53:15.188 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (10m) 8m ago 22m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:53:15.189 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (10m) 8m ago 21m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:53:15.189 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (9m) 8m ago 21m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:53:15.189 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (14m) 8m ago 25m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:53:15.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.171+0000 7f56c6c97640 1 -- 172.21.15.17:0/3304755002 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f56b007af30 msgr2=0x7f56b007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.171+0000 7f56c6c97640 1 --2- 172.21.15.17:0/3304755002 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f56b007af30 0x7f56b007d3f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f56b4000c00 tx=0x7f56b4031400 comp rx=0 tx=0).stop 2024-09-20T18:53:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.171+0000 7f56c6c97640 1 -- 172.21.15.17:0/3304755002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c0101c00 msgr2=0x7f56c019dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.171+0000 7f56c6c97640 1 --2- 172.21.15.17:0/3304755002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c0101c00 0x7f56c019dcb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00d6f0 tx=0x7f56ac00dbb0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.171+0000 7f56c6c97640 1 -- 172.21.15.17:0/3304755002 shutdown_connections 2024-09-20T18:53:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.171+0000 7f56c6c97640 1 --2- 172.21.15.17:0/3304755002 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f56b007af30 0x7f56b007d3f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.171+0000 7f56c6c97640 1 --2- 172.21.15.17:0/3304755002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c0101c00 0x7f56c019dcb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.171+0000 7f56c6c97640 1 --2- 172.21.15.17:0/3304755002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56c0101250 0x7f56c019d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.171+0000 7f56c6c97640 1 -- 172.21.15.17:0/3304755002 >> 172.21.15.17:0/3304755002 conn(0x7f56c00fbc90 msgr2=0x7f56c0100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.171+0000 7f56c6c97640 1 -- 172.21.15.17:0/3304755002 shutdown_connections 2024-09-20T18:53:15.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.171+0000 7f56c6c97640 1 -- 172.21.15.17:0/3304755002 wait complete. 2024-09-20T18:53:15.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.254+0000 7fc65a6e3640 1 -- 172.21.15.17:0/2138265576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6541067f0 msgr2=0x7fc654106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:15.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.254+0000 7fc65a6e3640 1 --2- 172.21.15.17:0/2138265576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6541067f0 0x7fc654106bd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc644009880 tx=0x7fc64402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.254+0000 7fc65a6e3640 1 -- 172.21.15.17:0/2138265576 shutdown_connections 2024-09-20T18:53:15.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.254+0000 7fc65a6e3640 1 --2- 172.21.15.17:0/2138265576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6541007f0 0x7fc654100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.254+0000 7fc65a6e3640 1 --2- 172.21.15.17:0/2138265576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6541067f0 0x7fc654106bd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.254+0000 7fc65a6e3640 1 -- 172.21.15.17:0/2138265576 >> 172.21.15.17:0/2138265576 conn(0x7fc6540fc550 msgr2=0x7fc6540fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:15.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.254+0000 7fc65a6e3640 1 -- 172.21.15.17:0/2138265576 shutdown_connections 2024-09-20T18:53:15.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.254+0000 7fc65a6e3640 1 -- 172.21.15.17:0/2138265576 wait complete. 2024-09-20T18:53:15.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.255+0000 7fc65a6e3640 1 Processor -- start 2024-09-20T18:53:15.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.255+0000 7fc65a6e3640 1 -- start start 2024-09-20T18:53:15.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.255+0000 7fc65a6e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6541007f0 0x7fc65419c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:15.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.255+0000 7fc65a6e3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6541067f0 0x7fc65419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.255+0000 7fc65a6e3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc65410dd20 con 0x7fc6541007f0 2024-09-20T18:53:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.255+0000 7fc65a6e3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc65410dba0 con 0x7fc6541067f0 2024-09-20T18:53:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.255+0000 7fc653fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6541007f0 0x7fc65419c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.255+0000 7fc653fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6541007f0 0x7fc65419c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35760/0 (socket says 172.21.15.17:35760) 2024-09-20T18:53:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.255+0000 7fc653fff640 1 -- 172.21.15.17:0/2009991201 learned_addr learned my addr 172.21.15.17:0/2009991201 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:53:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.255+0000 7fc6537fe640 1 --2- 172.21.15.17:0/2009991201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6541067f0 0x7fc65419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.256+0000 7fc653fff640 1 -- 172.21.15.17:0/2009991201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6541067f0 msgr2=0x7fc65419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.256+0000 7fc653fff640 1 --2- 172.21.15.17:0/2009991201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6541067f0 0x7fc65419cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.256+0000 7fc653fff640 1 -- 172.21.15.17:0/2009991201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc654196830 con 0x7fc6541007f0 2024-09-20T18:53:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.256+0000 7fc6537fe640 1 --2- 172.21.15.17:0/2009991201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6541067f0 0x7fc65419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:53:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.256+0000 7fc653fff640 1 --2- 172.21.15.17:0/2009991201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6541007f0 0x7fc65419c6b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc644031460 tx=0x7fc6440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.256+0000 7fc6517fa640 1 -- 172.21.15.17:0/2009991201 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc64403f070 con 0x7fc6541007f0 2024-09-20T18:53:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.256+0000 7fc6517fa640 1 -- 172.21.15.17:0/2009991201 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc644004cf0 con 0x7fc6541007f0 2024-09-20T18:53:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.256+0000 7fc65a6e3640 1 -- 172.21.15.17:0/2009991201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc654196ac0 con 0x7fc6541007f0 2024-09-20T18:53:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.256+0000 7fc65a6e3640 1 -- 172.21.15.17:0/2009991201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc654196ff0 con 0x7fc6541007f0 2024-09-20T18:53:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.256+0000 7fc6517fa640 1 -- 172.21.15.17:0/2009991201 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc644035030 con 0x7fc6541007f0 2024-09-20T18:53:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.257+0000 7fc65a6e3640 1 -- 172.21.15.17:0/2009991201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc654101f30 con 0x7fc6541007f0 2024-09-20T18:53:15.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.258+0000 7fc6517fa640 1 -- 172.21.15.17:0/2009991201 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc644042070 con 0x7fc6541007f0 2024-09-20T18:53:15.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.259+0000 7fc6517fa640 1 --2- 172.21.15.17:0/2009991201 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc63c07af30 0x7fc63c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:15.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.259+0000 7fc6517fa640 1 -- 172.21.15.17:0/2009991201 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fc6440beb00 con 0x7fc6541007f0 2024-09-20T18:53:15.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.259+0000 7fc6537fe640 1 --2- 172.21.15.17:0/2009991201 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc63c07af30 0x7fc63c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:15.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.259+0000 7fc6537fe640 1 --2- 172.21.15.17:0/2009991201 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc63c07af30 0x7fc63c07d3f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc654105ea0 tx=0x7fc648008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:15.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.263+0000 7fc6517fa640 1 -- 172.21.15.17:0/2009991201 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc64408a100 con 0x7fc6541007f0 2024-09-20T18:53:15.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.527+0000 7fc65a6e3640 1 -- 172.21.15.17:0/2009991201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc654197d60 con 0x7fc6541007f0 2024-09-20T18:53:15.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.527+0000 7fc6517fa640 1 -- 172.21.15.17:0/2009991201 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fc64408c620 con 0x7fc6541007f0 2024-09-20T18:53:15.546 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:53:15.546 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:53:15.546 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:53:15.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:53:15.546 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:53:15.546 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:53:15.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:53:15.546 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:53:15.546 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:53:15.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:53:15.547 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:53:15.547 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:53:15.547 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:53:15.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:53:15.547 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:53:15.547 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:53:15.547 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:53:15.547 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:53:15.547 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:53:15.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.530+0000 7fc65a6e3640 1 -- 172.21.15.17:0/2009991201 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc63c07af30 msgr2=0x7fc63c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:15.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.530+0000 7fc65a6e3640 1 --2- 172.21.15.17:0/2009991201 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc63c07af30 0x7fc63c07d3f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc654105ea0 tx=0x7fc648008040 comp rx=0 tx=0).stop 2024-09-20T18:53:15.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.530+0000 7fc65a6e3640 1 -- 172.21.15.17:0/2009991201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6541007f0 msgr2=0x7fc65419c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:15.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.530+0000 7fc65a6e3640 1 --2- 172.21.15.17:0/2009991201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6541007f0 0x7fc65419c6b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc644031460 tx=0x7fc6440048f0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.530+0000 7fc65a6e3640 1 -- 172.21.15.17:0/2009991201 shutdown_connections 2024-09-20T18:53:15.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.530+0000 7fc65a6e3640 1 --2- 172.21.15.17:0/2009991201 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc63c07af30 0x7fc63c07d3f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.530+0000 7fc65a6e3640 1 --2- 172.21.15.17:0/2009991201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6541067f0 0x7fc65419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.530+0000 7fc65a6e3640 1 --2- 172.21.15.17:0/2009991201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6541007f0 0x7fc65419c6b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.530+0000 7fc65a6e3640 1 -- 172.21.15.17:0/2009991201 >> 172.21.15.17:0/2009991201 conn(0x7fc6540fc550 msgr2=0x7fc6540fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:15.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.530+0000 7fc65a6e3640 1 -- 172.21.15.17:0/2009991201 shutdown_connections 2024-09-20T18:53:15.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.530+0000 7fc65a6e3640 1 -- 172.21.15.17:0/2009991201 wait complete. 2024-09-20T18:53:15.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.614+0000 7f60ad8fc640 1 -- 172.21.15.17:0/989288248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a81033e0 msgr2=0x7f60a810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:15.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.614+0000 7f60ad8fc640 1 --2- 172.21.15.17:0/989288248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a81033e0 0x7f60a810b8d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f609c009880 tx=0x7f609c02a530 comp rx=0 tx=0).stop 2024-09-20T18:53:15.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.614+0000 7f60ad8fc640 1 -- 172.21.15.17:0/989288248 shutdown_connections 2024-09-20T18:53:15.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.614+0000 7f60ad8fc640 1 --2- 172.21.15.17:0/989288248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a81033e0 0x7f60a810b8d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.614+0000 7f60ad8fc640 1 --2- 172.21.15.17:0/989288248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60a8102ac0 0x7f60a8102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.614+0000 7f60ad8fc640 1 -- 172.21.15.17:0/989288248 >> 172.21.15.17:0/989288248 conn(0x7f60a80fc520 msgr2=0x7f60a80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:15.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.614+0000 7f60ad8fc640 1 -- 172.21.15.17:0/989288248 shutdown_connections 2024-09-20T18:53:15.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.614+0000 7f60ad8fc640 1 -- 172.21.15.17:0/989288248 wait complete. 2024-09-20T18:53:15.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.615+0000 7f60ad8fc640 1 Processor -- start 2024-09-20T18:53:15.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.615+0000 7f60ad8fc640 1 -- start start 2024-09-20T18:53:15.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.615+0000 7f60ad8fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a8102ac0 0x7f60a819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:15.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.615+0000 7f60ad8fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60a81033e0 0x7f60a819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:15.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.615+0000 7f60ad8fc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f60a810edd0 con 0x7f60a8102ac0 2024-09-20T18:53:15.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.615+0000 7f60ad8fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f60a810ec50 con 0x7f60a81033e0 2024-09-20T18:53:15.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.616+0000 7f60a6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a8102ac0 0x7f60a819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:15.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.616+0000 7f60a6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a8102ac0 0x7f60a819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35776/0 (socket says 172.21.15.17:35776) 2024-09-20T18:53:15.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.616+0000 7f60a6ffd640 1 -- 172.21.15.17:0/1852396403 learned_addr learned my addr 172.21.15.17:0/1852396403 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:53:15.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.616+0000 7f60a67fc640 1 --2- 172.21.15.17:0/1852396403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60a81033e0 0x7f60a819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:15.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.616+0000 7f60a6ffd640 1 -- 172.21.15.17:0/1852396403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60a81033e0 msgr2=0x7f60a819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:15.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.616+0000 7f60a6ffd640 1 --2- 172.21.15.17:0/1852396403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60a81033e0 0x7f60a819dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.616+0000 7f60a6ffd640 1 -- 172.21.15.17:0/1852396403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a81977e0 con 0x7f60a8102ac0 2024-09-20T18:53:15.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.616+0000 7f60a67fc640 1 --2- 172.21.15.17:0/1852396403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60a81033e0 0x7f60a819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:53:15.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.616+0000 7f60a6ffd640 1 --2- 172.21.15.17:0/1852396403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a8102ac0 0x7f60a819d660 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f609800d8d0 tx=0x7f609800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:15.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.616+0000 7f60ac8fa640 1 -- 172.21.15.17:0/1852396403 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6098017070 con 0x7f60a8102ac0 2024-09-20T18:53:15.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.616+0000 7f60ad8fc640 1 -- 172.21.15.17:0/1852396403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a8197ad0 con 0x7f60a8102ac0 2024-09-20T18:53:15.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.616+0000 7f60ac8fa640 1 -- 172.21.15.17:0/1852396403 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6098010460 con 0x7f60a8102ac0 2024-09-20T18:53:15.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.616+0000 7f60ac8fa640 1 -- 172.21.15.17:0/1852396403 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f609800f5f0 con 0x7f60a8102ac0 2024-09-20T18:53:15.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.616+0000 7f60ad8fc640 1 -- 172.21.15.17:0/1852396403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a8198030 con 0x7f60a8102ac0 2024-09-20T18:53:15.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.617+0000 7f60ad8fc640 1 -- 172.21.15.17:0/1852396403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60a806aa90 con 0x7f60a8102ac0 2024-09-20T18:53:15.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.618+0000 7f60ac8fa640 1 -- 172.21.15.17:0/1852396403 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6098009a30 con 0x7f60a8102ac0 2024-09-20T18:53:15.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.619+0000 7f60ac8fa640 1 --2- 172.21.15.17:0/1852396403 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f609007af30 0x7f609007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:15.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.619+0000 7f60a67fc640 1 --2- 172.21.15.17:0/1852396403 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f609007af30 0x7f609007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:15.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.619+0000 7f60ac8fa640 1 -- 172.21.15.17:0/1852396403 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f609809df80 con 0x7f60a8102ac0 2024-09-20T18:53:15.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.619+0000 7f60a67fc640 1 --2- 172.21.15.17:0/1852396403 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f609007af30 0x7f609007d3f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f60a8198b30 tx=0x7f609c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:15.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.623+0000 7f60ac8fa640 1 -- 172.21.15.17:0/1852396403 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60980694e0 con 0x7f60a8102ac0 2024-09-20T18:53:15.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.851+0000 7f60ad8fc640 1 -- 172.21.15.17:0/1852396403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f60a8105f60 con 0x7f60a8102ac0 2024-09-20T18:53:15.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:15 smithi017 ceph-mon[108970]: pgmap v535: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:15.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:15 smithi017 ceph-mon[108970]: from='client.34818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:53:15.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:15 smithi017 ceph-mon[108970]: from='client.34822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:53:15.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:15 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2009991201' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:53:15.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.852+0000 7f60ac8fa640 1 -- 172.21.15.17:0/1852396403 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f609806e390 con 0x7f60a8102ac0 2024-09-20T18:53:15.871 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:53:15.871 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:53:15.871 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:53:15.871 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:53:15.871 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:53:15.871 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:53:15.871 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:53:15.871 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:53:15.872 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:53:15.872 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:53:15.872 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:53:15.872 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:53:15.872 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:53:15.872 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:53:15.872 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:53:15.872 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:53:15.872 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:53:15.872 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:53:15.872 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:53:15.872 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:53:15.872 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:53:15.872 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:53:15.873 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:53:15.873 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:53:15.873 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:53:15.873 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:53:15.873 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:53:15.873 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:53:15.873 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:53:15.873 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:53:15.873 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:53:15.873 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:53:15.873 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:53:15.873 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:53:15.873 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:53:15.873 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:53:15.874 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:53:15.874 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:53:15.874 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:53:15.874 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:53:15.874 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:53:15.874 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:53:15.874 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:53:15.875 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:53:15.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.854+0000 7f60ad8fc640 1 -- 172.21.15.17:0/1852396403 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f609007af30 msgr2=0x7f609007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:15.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.854+0000 7f60ad8fc640 1 --2- 172.21.15.17:0/1852396403 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f609007af30 0x7f609007d3f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f60a8198b30 tx=0x7f609c031400 comp rx=0 tx=0).stop 2024-09-20T18:53:15.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.854+0000 7f60ad8fc640 1 -- 172.21.15.17:0/1852396403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a8102ac0 msgr2=0x7f60a819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:15.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.854+0000 7f60ad8fc640 1 --2- 172.21.15.17:0/1852396403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a8102ac0 0x7f60a819d660 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f609800d8d0 tx=0x7f609800dd90 comp rx=0 tx=0).stop 2024-09-20T18:53:15.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.854+0000 7f60ad8fc640 1 -- 172.21.15.17:0/1852396403 shutdown_connections 2024-09-20T18:53:15.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.854+0000 7f60ad8fc640 1 --2- 172.21.15.17:0/1852396403 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f609007af30 0x7f609007d3f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.854+0000 7f60ad8fc640 1 --2- 172.21.15.17:0/1852396403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60a81033e0 0x7f60a819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.854+0000 7f60ad8fc640 1 --2- 172.21.15.17:0/1852396403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60a8102ac0 0x7f60a819d660 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.854+0000 7f60ad8fc640 1 -- 172.21.15.17:0/1852396403 >> 172.21.15.17:0/1852396403 conn(0x7f60a80fc520 msgr2=0x7f60a8108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:15.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.854+0000 7f60ad8fc640 1 -- 172.21.15.17:0/1852396403 shutdown_connections 2024-09-20T18:53:15.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.854+0000 7f60ad8fc640 1 -- 172.21.15.17:0/1852396403 wait complete. 2024-09-20T18:53:15.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.939+0000 7f1bc9543640 1 -- 172.21.15.17:0/2919659506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bc4101900 msgr2=0x7f1bc4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:15.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.939+0000 7f1bc9543640 1 --2- 172.21.15.17:0/2919659506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bc4101900 0x7f1bc4101d60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009880 tx=0x7f1bac02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.939+0000 7f1bc9543640 1 -- 172.21.15.17:0/2919659506 shutdown_connections 2024-09-20T18:53:15.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.939+0000 7f1bc9543640 1 --2- 172.21.15.17:0/2919659506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bc4101900 0x7f1bc4101d60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.939+0000 7f1bc9543640 1 --2- 172.21.15.17:0/2919659506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc4107900 0x7f1bc4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.939+0000 7f1bc9543640 1 -- 172.21.15.17:0/2919659506 >> 172.21.15.17:0/2919659506 conn(0x7f1bc40fd600 msgr2=0x7f1bc40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:15.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.939+0000 7f1bc9543640 1 -- 172.21.15.17:0/2919659506 shutdown_connections 2024-09-20T18:53:15.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.939+0000 7f1bc9543640 1 -- 172.21.15.17:0/2919659506 wait complete. 2024-09-20T18:53:15.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.940+0000 7f1bc9543640 1 Processor -- start 2024-09-20T18:53:15.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.940+0000 7f1bc9543640 1 -- start start 2024-09-20T18:53:15.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.940+0000 7f1bc9543640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bc4101900 0x7f1bc419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:15.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.940+0000 7f1bc9543640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc4107900 0x7f1bc419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:15.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.940+0000 7f1bc9543640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc410ee30 con 0x7f1bc4101900 2024-09-20T18:53:15.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.940+0000 7f1bc9543640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc410ecb0 con 0x7f1bc4107900 2024-09-20T18:53:15.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.940+0000 7f1bc2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bc4101900 0x7f1bc419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:15.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.941+0000 7f1bc2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bc4101900 0x7f1bc419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35796/0 (socket says 172.21.15.17:35796) 2024-09-20T18:53:15.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.941+0000 7f1bc2ffd640 1 -- 172.21.15.17:0/3572677680 learned_addr learned my addr 172.21.15.17:0/3572677680 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:53:15.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.941+0000 7f1bc27fc640 1 --2- 172.21.15.17:0/3572677680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc4107900 0x7f1bc419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:15.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.941+0000 7f1bc2ffd640 1 -- 172.21.15.17:0/3572677680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc4107900 msgr2=0x7f1bc419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:15.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.941+0000 7f1bc2ffd640 1 --2- 172.21.15.17:0/3572677680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc4107900 0x7f1bc419dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:15.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.941+0000 7f1bc2ffd640 1 -- 172.21.15.17:0/3572677680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc4197840 con 0x7f1bc4101900 2024-09-20T18:53:15.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.941+0000 7f1bc2ffd640 1 --2- 172.21.15.17:0/3572677680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bc4101900 0x7f1bc419d6c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400ba50 tx=0x7f1bb400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:15.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.941+0000 7f1bbbfff640 1 -- 172.21.15.17:0/3572677680 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1bb4019070 con 0x7f1bc4101900 2024-09-20T18:53:15.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.941+0000 7f1bbbfff640 1 -- 172.21.15.17:0/3572677680 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1bb400ce20 con 0x7f1bc4101900 2024-09-20T18:53:15.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.941+0000 7f1bc9543640 1 -- 172.21.15.17:0/3572677680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc4197b30 con 0x7f1bc4101900 2024-09-20T18:53:15.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.941+0000 7f1bbbfff640 1 -- 172.21.15.17:0/3572677680 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1bb40075a0 con 0x7f1bc4101900 2024-09-20T18:53:15.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.941+0000 7f1bc9543640 1 -- 172.21.15.17:0/3572677680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc4198090 con 0x7f1bc4101900 2024-09-20T18:53:15.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.942+0000 7f1bc9543640 1 -- 172.21.15.17:0/3572677680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc4103040 con 0x7f1bc4101900 2024-09-20T18:53:15.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.943+0000 7f1bbbfff640 1 -- 172.21.15.17:0/3572677680 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1bb401c070 con 0x7f1bc4101900 2024-09-20T18:53:15.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.943+0000 7f1bbbfff640 1 --2- 172.21.15.17:0/3572677680 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1bb007af30 0x7f1bb007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:15.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.943+0000 7f1bbbfff640 1 -- 172.21.15.17:0/3572677680 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f1bb409d990 con 0x7f1bc4101900 2024-09-20T18:53:15.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.944+0000 7f1bc27fc640 1 --2- 172.21.15.17:0/3572677680 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1bb007af30 0x7f1bb007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:15.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:15 smithi172 ceph-mon[80431]: pgmap v535: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:15.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:15 smithi172 ceph-mon[80431]: from='client.34818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:53:15.963 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:15 smithi172 ceph-mon[80431]: from='client.34822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:53:15.963 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:15 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2009991201' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:53:15.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.944+0000 7f1bc27fc640 1 --2- 172.21.15.17:0/3572677680 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1bb007af30 0x7f1bb007d3f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4198b90 tx=0x7f1bac031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:15.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:15.948+0000 7f1bbbfff640 1 -- 172.21.15.17:0/3572677680 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1bb4068ef0 con 0x7f1bc4101900 2024-09-20T18:53:16.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.154+0000 7f1bc9543640 1 -- 172.21.15.17:0/3572677680 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1bc41983a0 con 0x7f1bb007af30 2024-09-20T18:53:16.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.156+0000 7f1bbbfff640 1 -- 172.21.15.17:0/3572677680 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f1bc41983a0 con 0x7f1bb007af30 2024-09-20T18:53:16.174 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:53:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:53:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:53:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:53:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:53:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:53:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:53:16.174 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:53:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:53:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:53:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:53:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:53:16.175 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:53:16.175 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:53:16.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.158+0000 7f1bc9543640 1 -- 172.21.15.17:0/3572677680 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1bb007af30 msgr2=0x7f1bb007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:16.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.158+0000 7f1bc9543640 1 --2- 172.21.15.17:0/3572677680 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1bb007af30 0x7f1bb007d3f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4198b90 tx=0x7f1bac031400 comp rx=0 tx=0).stop 2024-09-20T18:53:16.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.158+0000 7f1bc9543640 1 -- 172.21.15.17:0/3572677680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bc4101900 msgr2=0x7f1bc419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:16.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.158+0000 7f1bc9543640 1 --2- 172.21.15.17:0/3572677680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bc4101900 0x7f1bc419d6c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400ba50 tx=0x7f1bb400bf10 comp rx=0 tx=0).stop 2024-09-20T18:53:16.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.158+0000 7f1bc9543640 1 -- 172.21.15.17:0/3572677680 shutdown_connections 2024-09-20T18:53:16.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.158+0000 7f1bc9543640 1 --2- 172.21.15.17:0/3572677680 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1bb007af30 0x7f1bb007d3f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:16.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.158+0000 7f1bc9543640 1 --2- 172.21.15.17:0/3572677680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc4107900 0x7f1bc419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:16.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.158+0000 7f1bc9543640 1 --2- 172.21.15.17:0/3572677680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bc4101900 0x7f1bc419d6c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:16.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.158+0000 7f1bc9543640 1 -- 172.21.15.17:0/3572677680 >> 172.21.15.17:0/3572677680 conn(0x7f1bc40fd600 msgr2=0x7f1bc40fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:16.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.158+0000 7f1bc9543640 1 -- 172.21.15.17:0/3572677680 shutdown_connections 2024-09-20T18:53:16.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.158+0000 7f1bc9543640 1 -- 172.21.15.17:0/3572677680 wait complete. 2024-09-20T18:53:16.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.242+0000 7f2125550640 1 -- 172.21.15.17:0/4255780984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21201033e0 msgr2=0x7f212010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:16.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.242+0000 7f2125550640 1 --2- 172.21.15.17:0/4255780984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21201033e0 0x7f212010b8d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2114009880 tx=0x7f211402a530 comp rx=0 tx=0).stop 2024-09-20T18:53:16.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.242+0000 7f2125550640 1 -- 172.21.15.17:0/4255780984 shutdown_connections 2024-09-20T18:53:16.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.242+0000 7f2125550640 1 --2- 172.21.15.17:0/4255780984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21201033e0 0x7f212010b8d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:16.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.242+0000 7f2125550640 1 --2- 172.21.15.17:0/4255780984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120102ac0 0x7f2120102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:16.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.242+0000 7f2125550640 1 -- 172.21.15.17:0/4255780984 >> 172.21.15.17:0/4255780984 conn(0x7f21200fc520 msgr2=0x7f21200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:16.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.242+0000 7f2125550640 1 -- 172.21.15.17:0/4255780984 shutdown_connections 2024-09-20T18:53:16.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.242+0000 7f2125550640 1 -- 172.21.15.17:0/4255780984 wait complete. 2024-09-20T18:53:16.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.243+0000 7f2125550640 1 Processor -- start 2024-09-20T18:53:16.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.243+0000 7f2125550640 1 -- start start 2024-09-20T18:53:16.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.243+0000 7f2125550640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120102ac0 0x7f2120100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:16.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.243+0000 7f2125550640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21201033e0 0x7f2120100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:16.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.243+0000 7f2125550640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f212010edd0 con 0x7f21201033e0 2024-09-20T18:53:16.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.243+0000 7f2125550640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f212010ec50 con 0x7f2120102ac0 2024-09-20T18:53:16.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.243+0000 7f211e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21201033e0 0x7f2120100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:16.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.243+0000 7f211e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21201033e0 0x7f2120100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35820/0 (socket says 172.21.15.17:35820) 2024-09-20T18:53:16.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.243+0000 7f211e7fc640 1 -- 172.21.15.17:0/1254977128 learned_addr learned my addr 172.21.15.17:0/1254977128 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:53:16.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.244+0000 7f211effd640 1 --2- 172.21.15.17:0/1254977128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120102ac0 0x7f2120100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:16.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.244+0000 7f211e7fc640 1 -- 172.21.15.17:0/1254977128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120102ac0 msgr2=0x7f2120100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:16.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.244+0000 7f211e7fc640 1 --2- 172.21.15.17:0/1254977128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120102ac0 0x7f2120100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:16.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.244+0000 7f211e7fc640 1 -- 172.21.15.17:0/1254977128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21201011a0 con 0x7f21201033e0 2024-09-20T18:53:16.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.244+0000 7f211e7fc640 1 --2- 172.21.15.17:0/1254977128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21201033e0 0x7f2120100c60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2114031460 tx=0x7f2114004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:16.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.244+0000 7f2107fff640 1 -- 172.21.15.17:0/1254977128 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f211403f070 con 0x7f21201033e0 2024-09-20T18:53:16.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.244+0000 7f2107fff640 1 -- 172.21.15.17:0/1254977128 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f21140035f0 con 0x7f21201033e0 2024-09-20T18:53:16.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.244+0000 7f2125550640 1 -- 172.21.15.17:0/1254977128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2120101430 con 0x7f21201033e0 2024-09-20T18:53:16.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.244+0000 7f2107fff640 1 -- 172.21.15.17:0/1254977128 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2114035030 con 0x7f21201033e0 2024-09-20T18:53:16.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.244+0000 7f2125550640 1 -- 172.21.15.17:0/1254977128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21201a3da0 con 0x7f21201033e0 2024-09-20T18:53:16.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.245+0000 7f2125550640 1 -- 172.21.15.17:0/1254977128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f212006aa90 con 0x7f21201033e0 2024-09-20T18:53:16.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.246+0000 7f2107fff640 1 -- 172.21.15.17:0/1254977128 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2114042070 con 0x7f21201033e0 2024-09-20T18:53:16.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.246+0000 7f2107fff640 1 --2- 172.21.15.17:0/1254977128 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f210807af30 0x7f210807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:16.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.246+0000 7f2107fff640 1 -- 172.21.15.17:0/1254977128 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f21140be9b0 con 0x7f21201033e0 2024-09-20T18:53:16.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.246+0000 7f211effd640 1 --2- 172.21.15.17:0/1254977128 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f210807af30 0x7f210807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:16.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.247+0000 7f211effd640 1 --2- 172.21.15.17:0/1254977128 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f210807af30 0x7f210807d3f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2110005fd0 tx=0x7f2110005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:16.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.251+0000 7f2107fff640 1 -- 172.21.15.17:0/1254977128 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2114089fb0 con 0x7f21201033e0 2024-09-20T18:53:16.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.517+0000 7f2125550640 1 -- 172.21.15.17:0/1254977128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f2120102ea0 con 0x7f21201033e0 2024-09-20T18:53:16.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.517+0000 7f2107fff640 1 -- 172.21.15.17:0/1254977128 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f211408ee60 con 0x7f21201033e0 2024-09-20T18:53:16.535 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:53:16.536 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:53:16.536 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:53:16.536 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:53:16.536 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:53:16.536 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:53:16.536 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:53:16.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.520+0000 7f2125550640 1 -- 172.21.15.17:0/1254977128 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f210807af30 msgr2=0x7f210807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:16.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.520+0000 7f2125550640 1 --2- 172.21.15.17:0/1254977128 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f210807af30 0x7f210807d3f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2110005fd0 tx=0x7f2110005850 comp rx=0 tx=0).stop 2024-09-20T18:53:16.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.520+0000 7f2125550640 1 -- 172.21.15.17:0/1254977128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21201033e0 msgr2=0x7f2120100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:16.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.520+0000 7f2125550640 1 --2- 172.21.15.17:0/1254977128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21201033e0 0x7f2120100c60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2114031460 tx=0x7f2114004530 comp rx=0 tx=0).stop 2024-09-20T18:53:16.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.520+0000 7f2125550640 1 -- 172.21.15.17:0/1254977128 shutdown_connections 2024-09-20T18:53:16.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.520+0000 7f2125550640 1 --2- 172.21.15.17:0/1254977128 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f210807af30 0x7f210807d3f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:16.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.520+0000 7f2125550640 1 --2- 172.21.15.17:0/1254977128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21201033e0 0x7f2120100c60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:16.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.520+0000 7f2125550640 1 --2- 172.21.15.17:0/1254977128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120102ac0 0x7f2120100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:16.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.520+0000 7f2125550640 1 -- 172.21.15.17:0/1254977128 >> 172.21.15.17:0/1254977128 conn(0x7f21200fc520 msgr2=0x7f2120108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:16.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.520+0000 7f2125550640 1 -- 172.21.15.17:0/1254977128 shutdown_connections 2024-09-20T18:53:16.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:16.520+0000 7f2125550640 1 -- 172.21.15.17:0/1254977128 wait complete. 2024-09-20T18:53:16.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:16 smithi017 ceph-mon[108970]: from='client.34826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:53:16.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:16 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1852396403' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:53:16.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:16 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1254977128' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:53:17.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:16 smithi172 ceph-mon[80431]: from='client.34826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:53:17.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:16 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1852396403' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:53:17.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:16 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1254977128' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:53:18.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:17 smithi017 ceph-mon[108970]: from='client.34838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:53:18.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:17 smithi017 ceph-mon[108970]: pgmap v536: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:18.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:17 smithi172 ceph-mon[80431]: from='client.34838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:53:18.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:17 smithi172 ceph-mon[80431]: pgmap v536: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:19.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:19 smithi017 ceph-mon[108970]: pgmap v537: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:20.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:19 smithi172 ceph-mon[80431]: pgmap v537: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:22.041 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:21 smithi017 ceph-mon[108970]: pgmap v538: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:22.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:21 smithi172 ceph-mon[80431]: pgmap v538: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:22.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:53:23.113 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:53:24.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:23 smithi017 ceph-mon[108970]: pgmap v539: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:24.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:23 smithi172 ceph-mon[80431]: pgmap v539: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:25.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:25 smithi017 ceph-mon[108970]: pgmap v540: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:26.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:25 smithi172 ceph-mon[80431]: pgmap v540: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:28.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:27 smithi017 ceph-mon[108970]: pgmap v541: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:28.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:27 smithi172 ceph-mon[80431]: pgmap v541: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:30.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:29 smithi017 ceph-mon[108970]: pgmap v542: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:30.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:29 smithi172 ceph-mon[80431]: pgmap v542: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:31.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:31 smithi017 ceph-mon[108970]: pgmap v543: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:32.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:31 smithi172 ceph-mon[80431]: pgmap v543: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:34.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:33 smithi017 ceph-mon[108970]: pgmap v544: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:34.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:33 smithi172 ceph-mon[80431]: pgmap v544: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:36.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:35 smithi017 ceph-mon[108970]: pgmap v545: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:36.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:35 smithi172 ceph-mon[80431]: pgmap v545: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:37.906 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:37 smithi017 ceph-mon[108970]: pgmap v546: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:37.906 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:53:38.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:37 smithi172 ceph-mon[80431]: pgmap v546: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:38.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:53:40.045 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:39 smithi172 ceph-mon[80431]: pgmap v547: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:40.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:39 smithi017 ceph-mon[108970]: pgmap v547: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:42.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:41 smithi017 ceph-mon[108970]: pgmap v548: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:42.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:41 smithi172 ceph-mon[80431]: pgmap v548: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:43.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:43 smithi017 ceph-mon[108970]: pgmap v549: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:44.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:43 smithi172 ceph-mon[80431]: pgmap v549: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:46.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:45 smithi017 ceph-mon[108970]: pgmap v550: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:46.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:45 smithi172 ceph-mon[80431]: pgmap v550: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:46.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.620+0000 7ff9b3e5d640 1 -- 172.21.15.17:0/2106775811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9ac107910 msgr2=0x7ff9ac107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:46.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.620+0000 7ff9b3e5d640 1 --2- 172.21.15.17:0/2106775811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9ac107910 0x7ff9ac107cf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009880 tx=0x7ff9a802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:53:46.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.620+0000 7ff9b3e5d640 1 -- 172.21.15.17:0/2106775811 shutdown_connections 2024-09-20T18:53:46.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.620+0000 7ff9b3e5d640 1 --2- 172.21.15.17:0/2106775811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9ac101910 0x7ff9ac101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:46.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.620+0000 7ff9b3e5d640 1 --2- 172.21.15.17:0/2106775811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9ac107910 0x7ff9ac107cf0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:46.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.620+0000 7ff9b3e5d640 1 -- 172.21.15.17:0/2106775811 >> 172.21.15.17:0/2106775811 conn(0x7ff9ac0fd630 msgr2=0x7ff9ac0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:46.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.620+0000 7ff9b3e5d640 1 -- 172.21.15.17:0/2106775811 shutdown_connections 2024-09-20T18:53:46.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.620+0000 7ff9b3e5d640 1 -- 172.21.15.17:0/2106775811 wait complete. 2024-09-20T18:53:46.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.621+0000 7ff9b3e5d640 1 Processor -- start 2024-09-20T18:53:46.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.621+0000 7ff9b3e5d640 1 -- start start 2024-09-20T18:53:46.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.621+0000 7ff9b3e5d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9ac101910 0x7ff9ac19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:46.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.621+0000 7ff9b3e5d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9ac107910 0x7ff9ac19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:46.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.621+0000 7ff9b3e5d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac10edc0 con 0x7ff9ac101910 2024-09-20T18:53:46.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.621+0000 7ff9b3e5d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac10ec40 con 0x7ff9ac107910 2024-09-20T18:53:46.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.621+0000 7ff9b1bf9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9ac101910 0x7ff9ac19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:46.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.621+0000 7ff9b1bf9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9ac101910 0x7ff9ac19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41178/0 (socket says 172.21.15.17:41178) 2024-09-20T18:53:46.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.621+0000 7ff9b1bf9640 1 -- 172.21.15.17:0/4192203296 learned_addr learned my addr 172.21.15.17:0/4192203296 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:53:46.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.621+0000 7ff9b13f8640 1 --2- 172.21.15.17:0/4192203296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9ac107910 0x7ff9ac19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:46.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.622+0000 7ff9b1bf9640 1 -- 172.21.15.17:0/4192203296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9ac107910 msgr2=0x7ff9ac19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:46.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.622+0000 7ff9b1bf9640 1 --2- 172.21.15.17:0/4192203296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9ac107910 0x7ff9ac19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:46.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.622+0000 7ff9b1bf9640 1 -- 172.21.15.17:0/4192203296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac197770 con 0x7ff9ac101910 2024-09-20T18:53:46.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.622+0000 7ff9b1bf9640 1 --2- 172.21.15.17:0/4192203296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9ac101910 0x7ff9ac19d6a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8031460 tx=0x7ff9a80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:46.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.622+0000 7ff9a2ffd640 1 -- 172.21.15.17:0/4192203296 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9a803f070 con 0x7ff9ac101910 2024-09-20T18:53:46.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.622+0000 7ff9a2ffd640 1 -- 172.21.15.17:0/4192203296 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9a80035f0 con 0x7ff9ac101910 2024-09-20T18:53:46.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.622+0000 7ff9b3e5d640 1 -- 172.21.15.17:0/4192203296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ac197a00 con 0x7ff9ac101910 2024-09-20T18:53:46.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.622+0000 7ff9a2ffd640 1 -- 172.21.15.17:0/4192203296 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9a8035030 con 0x7ff9ac101910 2024-09-20T18:53:46.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.622+0000 7ff9b3e5d640 1 -- 172.21.15.17:0/4192203296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ac197f00 con 0x7ff9ac101910 2024-09-20T18:53:46.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.623+0000 7ff9b3e5d640 1 -- 172.21.15.17:0/4192203296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ac103050 con 0x7ff9ac101910 2024-09-20T18:53:46.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.624+0000 7ff9a2ffd640 1 -- 172.21.15.17:0/4192203296 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff9a8042070 con 0x7ff9ac101910 2024-09-20T18:53:46.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.625+0000 7ff9a2ffd640 1 --2- 172.21.15.17:0/4192203296 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff99807af80 0x7ff99807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:46.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.625+0000 7ff9a2ffd640 1 -- 172.21.15.17:0/4192203296 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7ff9a80be900 con 0x7ff9ac101910 2024-09-20T18:53:46.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.625+0000 7ff9b13f8640 1 --2- 172.21.15.17:0/4192203296 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff99807af80 0x7ff99807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:46.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.625+0000 7ff9b13f8640 1 --2- 172.21.15.17:0/4192203296 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff99807af80 0x7ff99807d440 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac198fc0 tx=0x7ff99c00b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:46.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.629+0000 7ff9a2ffd640 1 -- 172.21.15.17:0/4192203296 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff9a8089ee0 con 0x7ff9ac101910 2024-09-20T18:53:46.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.837+0000 7ff9b3e5d640 1 -- 172.21.15.17:0/4192203296 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff9ac198270 con 0x7ff99807af80 2024-09-20T18:53:46.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.838+0000 7ff9a2ffd640 1 -- 172.21.15.17:0/4192203296 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7ff9ac198270 con 0x7ff99807af80 2024-09-20T18:53:46.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.840+0000 7ff9b3e5d640 1 -- 172.21.15.17:0/4192203296 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff99807af80 msgr2=0x7ff99807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:46.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.840+0000 7ff9b3e5d640 1 --2- 172.21.15.17:0/4192203296 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff99807af80 0x7ff99807d440 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac198fc0 tx=0x7ff99c00b390 comp rx=0 tx=0).stop 2024-09-20T18:53:46.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.840+0000 7ff9b3e5d640 1 -- 172.21.15.17:0/4192203296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9ac101910 msgr2=0x7ff9ac19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:46.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.840+0000 7ff9b3e5d640 1 --2- 172.21.15.17:0/4192203296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9ac101910 0x7ff9ac19d6a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8031460 tx=0x7ff9a80045e0 comp rx=0 tx=0).stop 2024-09-20T18:53:46.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.840+0000 7ff9b3e5d640 1 -- 172.21.15.17:0/4192203296 shutdown_connections 2024-09-20T18:53:46.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.840+0000 7ff9b3e5d640 1 --2- 172.21.15.17:0/4192203296 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff99807af80 0x7ff99807d440 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:46.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.840+0000 7ff9b3e5d640 1 --2- 172.21.15.17:0/4192203296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9ac107910 0x7ff9ac19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:46.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.840+0000 7ff9b3e5d640 1 --2- 172.21.15.17:0/4192203296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9ac101910 0x7ff9ac19d6a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:46.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.840+0000 7ff9b3e5d640 1 -- 172.21.15.17:0/4192203296 >> 172.21.15.17:0/4192203296 conn(0x7ff9ac0fd630 msgr2=0x7ff9ac0fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:46.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.840+0000 7ff9b3e5d640 1 -- 172.21.15.17:0/4192203296 shutdown_connections 2024-09-20T18:53:46.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.840+0000 7ff9b3e5d640 1 -- 172.21.15.17:0/4192203296 wait complete. 2024-09-20T18:53:46.867 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:53:46.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.926+0000 7f90beb6e640 1 -- 172.21.15.17:0/3717614767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b81033e0 msgr2=0x7f90b810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:46.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.926+0000 7f90beb6e640 1 --2- 172.21.15.17:0/3717614767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b81033e0 0x7f90b810b8d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f90a8009880 tx=0x7f90a802a530 comp rx=0 tx=0).stop 2024-09-20T18:53:46.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.926+0000 7f90beb6e640 1 -- 172.21.15.17:0/3717614767 shutdown_connections 2024-09-20T18:53:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.926+0000 7f90beb6e640 1 --2- 172.21.15.17:0/3717614767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b81033e0 0x7f90b810b8d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.926+0000 7f90beb6e640 1 --2- 172.21.15.17:0/3717614767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90b8102ac0 0x7f90b8102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.926+0000 7f90beb6e640 1 -- 172.21.15.17:0/3717614767 >> 172.21.15.17:0/3717614767 conn(0x7f90b80fc520 msgr2=0x7f90b80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.926+0000 7f90beb6e640 1 -- 172.21.15.17:0/3717614767 shutdown_connections 2024-09-20T18:53:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.926+0000 7f90beb6e640 1 -- 172.21.15.17:0/3717614767 wait complete. 2024-09-20T18:53:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.927+0000 7f90beb6e640 1 Processor -- start 2024-09-20T18:53:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.927+0000 7f90beb6e640 1 -- start start 2024-09-20T18:53:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.927+0000 7f90beb6e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b8102ac0 0x7f90b8100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.927+0000 7f90beb6e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90b81033e0 0x7f90b8100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.927+0000 7f90beb6e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f90b810edf0 con 0x7f90b8102ac0 2024-09-20T18:53:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.927+0000 7f90beb6e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f90b810ec70 con 0x7f90b81033e0 2024-09-20T18:53:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.927+0000 7f90bc90a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b8102ac0 0x7f90b8100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.927+0000 7f90bc90a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b8102ac0 0x7f90b8100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41198/0 (socket says 172.21.15.17:41198) 2024-09-20T18:53:46.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.927+0000 7f90bc90a640 1 -- 172.21.15.17:0/2705819002 learned_addr learned my addr 172.21.15.17:0/2705819002 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:53:46.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.927+0000 7f90b7fff640 1 --2- 172.21.15.17:0/2705819002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90b81033e0 0x7f90b8100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:46.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.927+0000 7f90bc90a640 1 -- 172.21.15.17:0/2705819002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90b81033e0 msgr2=0x7f90b8100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:46.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.928+0000 7f90bc90a640 1 --2- 172.21.15.17:0/2705819002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90b81033e0 0x7f90b8100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:46.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.928+0000 7f90bc90a640 1 -- 172.21.15.17:0/2705819002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b81011a0 con 0x7f90b8102ac0 2024-09-20T18:53:46.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.928+0000 7f90b7fff640 1 --2- 172.21.15.17:0/2705819002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90b81033e0 0x7f90b8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:53:46.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.928+0000 7f90bc90a640 1 --2- 172.21.15.17:0/2705819002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b8102ac0 0x7f90b8100720 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f90a000d6f0 tx=0x7f90a000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:46.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.928+0000 7f90b5ffb640 1 -- 172.21.15.17:0/2705819002 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90a0017070 con 0x7f90b8102ac0 2024-09-20T18:53:46.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.928+0000 7f90b5ffb640 1 -- 172.21.15.17:0/2705819002 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f90a000de00 con 0x7f90b8102ac0 2024-09-20T18:53:46.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.928+0000 7f90b5ffb640 1 -- 172.21.15.17:0/2705819002 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90a0004bb0 con 0x7f90b8102ac0 2024-09-20T18:53:46.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.928+0000 7f90beb6e640 1 -- 172.21.15.17:0/2705819002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b8101490 con 0x7f90b8102ac0 2024-09-20T18:53:46.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.928+0000 7f90beb6e640 1 -- 172.21.15.17:0/2705819002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b81a3ea0 con 0x7f90b8102ac0 2024-09-20T18:53:46.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.929+0000 7f90beb6e640 1 -- 172.21.15.17:0/2705819002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b806aa90 con 0x7f90b8102ac0 2024-09-20T18:53:46.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.930+0000 7f90b5ffb640 1 -- 172.21.15.17:0/2705819002 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f90a0009a30 con 0x7f90b8102ac0 2024-09-20T18:53:46.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.930+0000 7f90b5ffb640 1 --2- 172.21.15.17:0/2705819002 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f90a407af80 0x7f90a407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:46.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.930+0000 7f90b5ffb640 1 -- 172.21.15.17:0/2705819002 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f90a009db80 con 0x7f90b8102ac0 2024-09-20T18:53:46.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.930+0000 7f90b7fff640 1 --2- 172.21.15.17:0/2705819002 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f90a407af80 0x7f90a407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:46.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.931+0000 7f90b7fff640 1 --2- 172.21.15.17:0/2705819002 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f90a407af80 0x7f90a407d440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f90a8006010 tx=0x7f90a80095f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:46.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:46.935+0000 7f90b5ffb640 1 -- 172.21.15.17:0/2705819002 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90a0069200 con 0x7f90b8102ac0 2024-09-20T18:53:47.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.142+0000 7f90beb6e640 1 -- 172.21.15.17:0/2705819002 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f90b8062630 con 0x7f90a407af80 2024-09-20T18:53:47.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.144+0000 7f90b5ffb640 1 -- 172.21.15.17:0/2705819002 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f90b8062630 con 0x7f90a407af80 2024-09-20T18:53:47.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.146+0000 7f90beb6e640 1 -- 172.21.15.17:0/2705819002 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f90a407af80 msgr2=0x7f90a407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:47.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.146+0000 7f90beb6e640 1 --2- 172.21.15.17:0/2705819002 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f90a407af80 0x7f90a407d440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f90a8006010 tx=0x7f90a80095f0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.146+0000 7f90beb6e640 1 -- 172.21.15.17:0/2705819002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b8102ac0 msgr2=0x7f90b8100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:47.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.146+0000 7f90beb6e640 1 --2- 172.21.15.17:0/2705819002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b8102ac0 0x7f90b8100720 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f90a000d6f0 tx=0x7f90a000dbb0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.146+0000 7f90beb6e640 1 -- 172.21.15.17:0/2705819002 shutdown_connections 2024-09-20T18:53:47.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.146+0000 7f90beb6e640 1 --2- 172.21.15.17:0/2705819002 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f90a407af80 0x7f90a407d440 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.146+0000 7f90beb6e640 1 --2- 172.21.15.17:0/2705819002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90b81033e0 0x7f90b8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.146+0000 7f90beb6e640 1 --2- 172.21.15.17:0/2705819002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b8102ac0 0x7f90b8100720 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.146+0000 7f90beb6e640 1 -- 172.21.15.17:0/2705819002 >> 172.21.15.17:0/2705819002 conn(0x7f90b80fc520 msgr2=0x7f90b8108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:47.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.146+0000 7f90beb6e640 1 -- 172.21.15.17:0/2705819002 shutdown_connections 2024-09-20T18:53:47.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.146+0000 7f90beb6e640 1 -- 172.21.15.17:0/2705819002 wait complete. 2024-09-20T18:53:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.230+0000 7fcff3072640 1 -- 172.21.15.17:0/2581679873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfec1007f0 msgr2=0x7fcfec100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.230+0000 7fcff3072640 1 --2- 172.21.15.17:0/2581679873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfec1007f0 0x7fcfec100c50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009880 tx=0x7fcfe002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.230+0000 7fcff3072640 1 -- 172.21.15.17:0/2581679873 shutdown_connections 2024-09-20T18:53:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.230+0000 7fcff3072640 1 --2- 172.21.15.17:0/2581679873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfec1007f0 0x7fcfec100c50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.230+0000 7fcff3072640 1 --2- 172.21.15.17:0/2581679873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfec1067f0 0x7fcfec106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.230+0000 7fcff3072640 1 -- 172.21.15.17:0/2581679873 >> 172.21.15.17:0/2581679873 conn(0x7fcfec0fc550 msgr2=0x7fcfec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.230+0000 7fcff3072640 1 -- 172.21.15.17:0/2581679873 shutdown_connections 2024-09-20T18:53:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.230+0000 7fcff3072640 1 -- 172.21.15.17:0/2581679873 wait complete. 2024-09-20T18:53:47.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.230+0000 7fcff3072640 1 Processor -- start 2024-09-20T18:53:47.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.230+0000 7fcff3072640 1 -- start start 2024-09-20T18:53:47.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.231+0000 7fcff3072640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfec1007f0 0x7fcfec1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.231+0000 7fcff3072640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfec1067f0 0x7fcfec198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.231+0000 7fcff3072640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec10dcc0 con 0x7fcfec1067f0 2024-09-20T18:53:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.231+0000 7fcff3072640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec10db40 con 0x7fcfec1007f0 2024-09-20T18:53:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.231+0000 7fcfebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfec1067f0 0x7fcfec198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.231+0000 7fcfebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfec1067f0 0x7fcfec198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41206/0 (socket says 172.21.15.17:41206) 2024-09-20T18:53:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.231+0000 7fcfebfff640 1 -- 172.21.15.17:0/4242958469 learned_addr learned my addr 172.21.15.17:0/4242958469 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:53:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.231+0000 7fcff0e0e640 1 --2- 172.21.15.17:0/4242958469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfec1007f0 0x7fcfec1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.231+0000 7fcfebfff640 1 -- 172.21.15.17:0/4242958469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfec1007f0 msgr2=0x7fcfec1987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.231+0000 7fcfebfff640 1 --2- 172.21.15.17:0/4242958469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfec1007f0 0x7fcfec1987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.231+0000 7fcfebfff640 1 -- 172.21.15.17:0/4242958469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfec199330 con 0x7fcfec1067f0 2024-09-20T18:53:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.231+0000 7fcfebfff640 1 --2- 172.21.15.17:0/4242958469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfec1067f0 0x7fcfec198d30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0031460 tx=0x7fcfe00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.232+0000 7fcfe9ffb640 1 -- 172.21.15.17:0/4242958469 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcfe003f070 con 0x7fcfec1067f0 2024-09-20T18:53:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.232+0000 7fcfe9ffb640 1 -- 172.21.15.17:0/4242958469 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcfe0004b10 con 0x7fcfec1067f0 2024-09-20T18:53:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.232+0000 7fcff3072640 1 -- 172.21.15.17:0/4242958469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfec1995c0 con 0x7fcfec1067f0 2024-09-20T18:53:47.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.232+0000 7fcfe9ffb640 1 -- 172.21.15.17:0/4242958469 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcfe0035030 con 0x7fcfec1067f0 2024-09-20T18:53:47.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.232+0000 7fcff3072640 1 -- 172.21.15.17:0/4242958469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfec1a1b70 con 0x7fcfec1067f0 2024-09-20T18:53:47.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.233+0000 7fcff3072640 1 -- 172.21.15.17:0/4242958469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfec101f30 con 0x7fcfec1067f0 2024-09-20T18:53:47.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.234+0000 7fcfe9ffb640 1 -- 172.21.15.17:0/4242958469 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fcfe0042070 con 0x7fcfec1067f0 2024-09-20T18:53:47.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.234+0000 7fcfe9ffb640 1 --2- 172.21.15.17:0/4242958469 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcfd407af40 0x7fcfd407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:47.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.235+0000 7fcff0e0e640 1 --2- 172.21.15.17:0/4242958469 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcfd407af40 0x7fcfd407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:47.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.235+0000 7fcfe9ffb640 1 -- 172.21.15.17:0/4242958469 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fcfe00beb50 con 0x7fcfec1067f0 2024-09-20T18:53:47.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.235+0000 7fcff0e0e640 1 --2- 172.21.15.17:0/4242958469 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcfd407af40 0x7fcfd407d400 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc005fd0 tx=0x7fcfdc005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:47.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.239+0000 7fcfe9ffb640 1 -- 172.21.15.17:0/4242958469 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcfe008a150 con 0x7fcfec1067f0 2024-09-20T18:53:47.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.441+0000 7fcff3072640 1 -- 172.21.15.17:0/4242958469 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fcfec062630 con 0x7fcfd407af40 2024-09-20T18:53:47.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.451+0000 7fcfe9ffb640 1 -- 172.21.15.17:0/4242958469 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fcfec062630 con 0x7fcfd407af40 2024-09-20T18:53:47.468 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:53:47.468 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (15m) 9m ago 26m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:53:47.468 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (18m) 9m ago 26m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:53:47.468 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (17m) 9m ago 25m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:53:47.468 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (13m) 9m ago 26m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:53:47.468 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (13m) 9m ago 25m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:53:47.468 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (14m) 9m ago 25m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:53:47.469 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (9m) 9m ago 20m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:53:47.469 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (9m) 9m ago 20m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:53:47.469 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (20m) 9m ago 20m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:53:47.469 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (9m) 9m ago 20m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:53:47.469 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (17m) 9m ago 27m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:53:47.469 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (16m) 9m ago 25m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:53:47.469 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (13m) 9m ago 27m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:53:47.469 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (13m) 9m ago 25m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:53:47.469 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (15m) 9m ago 26m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:53:47.469 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (15m) 9m ago 25m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:53:47.469 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (13m) 9m ago 24m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:53:47.469 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (12m) 9m ago 23m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:53:47.469 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (11m) 9m ago 23m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:53:47.469 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (11m) 9m ago 22m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:53:47.470 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (10m) 9m ago 22m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:53:47.470 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (10m) 9m ago 21m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:53:47.470 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (15m) 9m ago 25m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:53:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.453+0000 7fcff3072640 1 -- 172.21.15.17:0/4242958469 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcfd407af40 msgr2=0x7fcfd407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.453+0000 7fcff3072640 1 --2- 172.21.15.17:0/4242958469 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcfd407af40 0x7fcfd407d400 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc005fd0 tx=0x7fcfdc005850 comp rx=0 tx=0).stop 2024-09-20T18:53:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.453+0000 7fcff3072640 1 -- 172.21.15.17:0/4242958469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfec1067f0 msgr2=0x7fcfec198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.453+0000 7fcff3072640 1 --2- 172.21.15.17:0/4242958469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfec1067f0 0x7fcfec198d30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0031460 tx=0x7fcfe00045e0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.453+0000 7fcff3072640 1 -- 172.21.15.17:0/4242958469 shutdown_connections 2024-09-20T18:53:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.453+0000 7fcff3072640 1 --2- 172.21.15.17:0/4242958469 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcfd407af40 0x7fcfd407d400 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.453+0000 7fcff3072640 1 --2- 172.21.15.17:0/4242958469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfec1067f0 0x7fcfec198d30 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.453+0000 7fcff3072640 1 --2- 172.21.15.17:0/4242958469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfec1007f0 0x7fcfec1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.453+0000 7fcff3072640 1 -- 172.21.15.17:0/4242958469 >> 172.21.15.17:0/4242958469 conn(0x7fcfec0fc550 msgr2=0x7fcfec0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.453+0000 7fcff3072640 1 -- 172.21.15.17:0/4242958469 shutdown_connections 2024-09-20T18:53:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.453+0000 7fcff3072640 1 -- 172.21.15.17:0/4242958469 wait complete. 2024-09-20T18:53:47.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.537+0000 7fc11f69a640 1 -- 172.21.15.17:0/3972185467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc118101900 msgr2=0x7fc118101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:47.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.537+0000 7fc11f69a640 1 --2- 172.21.15.17:0/3972185467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc118101900 0x7fc118101d60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc108009880 tx=0x7fc10802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.537+0000 7fc11f69a640 1 -- 172.21.15.17:0/3972185467 shutdown_connections 2024-09-20T18:53:47.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.537+0000 7fc11f69a640 1 --2- 172.21.15.17:0/3972185467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc118101900 0x7fc118101d60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.537+0000 7fc11f69a640 1 --2- 172.21.15.17:0/3972185467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc118107900 0x7fc118107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.537+0000 7fc11f69a640 1 -- 172.21.15.17:0/3972185467 >> 172.21.15.17:0/3972185467 conn(0x7fc1180fd600 msgr2=0x7fc1180ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:47.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.538+0000 7fc11f69a640 1 -- 172.21.15.17:0/3972185467 shutdown_connections 2024-09-20T18:53:47.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.538+0000 7fc11f69a640 1 -- 172.21.15.17:0/3972185467 wait complete. 2024-09-20T18:53:47.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.538+0000 7fc11f69a640 1 Processor -- start 2024-09-20T18:53:47.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.538+0000 7fc11f69a640 1 -- start start 2024-09-20T18:53:47.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.538+0000 7fc11f69a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc118101900 0x7fc1180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:47.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.538+0000 7fc11f69a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc118107900 0x7fc118074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:47.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.538+0000 7fc11f69a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc11810edd0 con 0x7fc118107900 2024-09-20T18:53:47.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.538+0000 7fc11f69a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc11810ec50 con 0x7fc118101900 2024-09-20T18:53:47.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.539+0000 7fc11cc35640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc118107900 0x7fc118074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:47.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.539+0000 7fc11cc35640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc118107900 0x7fc118074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41238/0 (socket says 172.21.15.17:41238) 2024-09-20T18:53:47.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.539+0000 7fc11cc35640 1 -- 172.21.15.17:0/3507902406 learned_addr learned my addr 172.21.15.17:0/3507902406 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:53:47.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.539+0000 7fc11d436640 1 --2- 172.21.15.17:0/3507902406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc118101900 0x7fc1180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:47.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.539+0000 7fc11cc35640 1 -- 172.21.15.17:0/3507902406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc118101900 msgr2=0x7fc1180744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:47.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.539+0000 7fc11cc35640 1 --2- 172.21.15.17:0/3507902406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc118101900 0x7fc1180744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.539+0000 7fc11cc35640 1 -- 172.21.15.17:0/3507902406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc118074f70 con 0x7fc118107900 2024-09-20T18:53:47.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.539+0000 7fc11d436640 1 --2- 172.21.15.17:0/3507902406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc118101900 0x7fc1180744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:53:47.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.539+0000 7fc11cc35640 1 --2- 172.21.15.17:0/3507902406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc118107900 0x7fc118074a30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc108031460 tx=0x7fc108004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:47.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.539+0000 7fc10e7fc640 1 -- 172.21.15.17:0/3507902406 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc10803f070 con 0x7fc118107900 2024-09-20T18:53:47.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.539+0000 7fc10e7fc640 1 -- 172.21.15.17:0/3507902406 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc1080035f0 con 0x7fc118107900 2024-09-20T18:53:47.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.539+0000 7fc11f69a640 1 -- 172.21.15.17:0/3507902406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc118075200 con 0x7fc118107900 2024-09-20T18:53:47.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.539+0000 7fc10e7fc640 1 -- 172.21.15.17:0/3507902406 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc108035030 con 0x7fc118107900 2024-09-20T18:53:47.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.539+0000 7fc11f69a640 1 -- 172.21.15.17:0/3507902406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1181a3dc0 con 0x7fc118107900 2024-09-20T18:53:47.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.540+0000 7fc11f69a640 1 -- 172.21.15.17:0/3507902406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc118103040 con 0x7fc118107900 2024-09-20T18:53:47.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.541+0000 7fc10e7fc640 1 -- 172.21.15.17:0/3507902406 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc108042070 con 0x7fc118107900 2024-09-20T18:53:47.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.542+0000 7fc10e7fc640 1 --2- 172.21.15.17:0/3507902406 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc10407af30 0x7fc10407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:47.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.542+0000 7fc11d436640 1 --2- 172.21.15.17:0/3507902406 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc10407af30 0x7fc10407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:47.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.542+0000 7fc10e7fc640 1 -- 172.21.15.17:0/3507902406 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fc1080bea50 con 0x7fc118107900 2024-09-20T18:53:47.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.542+0000 7fc11d436640 1 --2- 172.21.15.17:0/3507902406 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc10407af30 0x7fc10407d3f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc114009c20 tx=0x7fc114005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:47.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.546+0000 7fc10e7fc640 1 -- 172.21.15.17:0/3507902406 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc108089fb0 con 0x7fc118107900 2024-09-20T18:53:47.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.810+0000 7fc11f69a640 1 -- 172.21.15.17:0/3507902406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc118109e70 con 0x7fc118107900 2024-09-20T18:53:47.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.810+0000 7fc10e7fc640 1 -- 172.21.15.17:0/3507902406 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fc10808ee60 con 0x7fc118107900 2024-09-20T18:53:47.828 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:53:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:53:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:53:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:53:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:53:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:53:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:53:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:53:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:53:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:53:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:53:47.828 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:53:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:53:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:53:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:53:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:53:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:53:47.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:53:47.829 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:53:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.812+0000 7fc11f69a640 1 -- 172.21.15.17:0/3507902406 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc10407af30 msgr2=0x7fc10407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.812+0000 7fc11f69a640 1 --2- 172.21.15.17:0/3507902406 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc10407af30 0x7fc10407d3f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc114009c20 tx=0x7fc114005f90 comp rx=0 tx=0).stop 2024-09-20T18:53:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.812+0000 7fc11f69a640 1 -- 172.21.15.17:0/3507902406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc118107900 msgr2=0x7fc118074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.812+0000 7fc11f69a640 1 --2- 172.21.15.17:0/3507902406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc118107900 0x7fc118074a30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc108031460 tx=0x7fc108004530 comp rx=0 tx=0).stop 2024-09-20T18:53:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.812+0000 7fc11f69a640 1 -- 172.21.15.17:0/3507902406 shutdown_connections 2024-09-20T18:53:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.812+0000 7fc11f69a640 1 --2- 172.21.15.17:0/3507902406 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc10407af30 0x7fc10407d3f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.812+0000 7fc11f69a640 1 --2- 172.21.15.17:0/3507902406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc118107900 0x7fc118074a30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.812+0000 7fc11f69a640 1 --2- 172.21.15.17:0/3507902406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc118101900 0x7fc1180744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.812+0000 7fc11f69a640 1 -- 172.21.15.17:0/3507902406 >> 172.21.15.17:0/3507902406 conn(0x7fc1180fd600 msgr2=0x7fc1180fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.812+0000 7fc11f69a640 1 -- 172.21.15.17:0/3507902406 shutdown_connections 2024-09-20T18:53:47.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.812+0000 7fc11f69a640 1 -- 172.21.15.17:0/3507902406 wait complete. 2024-09-20T18:53:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.897+0000 7f3fc9bbc640 1 -- 172.21.15.17:0/2768682474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fc4101900 msgr2=0x7f3fc4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.897+0000 7f3fc9bbc640 1 --2- 172.21.15.17:0/2768682474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fc4101900 0x7f3fc4101d60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009880 tx=0x7f3fac02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.897+0000 7f3fc9bbc640 1 -- 172.21.15.17:0/2768682474 shutdown_connections 2024-09-20T18:53:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.897+0000 7f3fc9bbc640 1 --2- 172.21.15.17:0/2768682474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fc4101900 0x7f3fc4101d60 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.897+0000 7f3fc9bbc640 1 --2- 172.21.15.17:0/2768682474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fc4107900 0x7f3fc4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.897+0000 7f3fc9bbc640 1 -- 172.21.15.17:0/2768682474 >> 172.21.15.17:0/2768682474 conn(0x7f3fc40fd600 msgr2=0x7f3fc40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.897+0000 7f3fc9bbc640 1 -- 172.21.15.17:0/2768682474 shutdown_connections 2024-09-20T18:53:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.897+0000 7f3fc9bbc640 1 -- 172.21.15.17:0/2768682474 wait complete. 2024-09-20T18:53:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.898+0000 7f3fc9bbc640 1 Processor -- start 2024-09-20T18:53:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.898+0000 7f3fc9bbc640 1 -- start start 2024-09-20T18:53:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.898+0000 7f3fc9bbc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fc4101900 0x7f3fc419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.898+0000 7f3fc9bbc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fc4107900 0x7f3fc419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.898+0000 7f3fc9bbc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc410edb0 con 0x7f3fc4101900 2024-09-20T18:53:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.898+0000 7f3fc9bbc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc410ec30 con 0x7f3fc4107900 2024-09-20T18:53:47.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.898+0000 7f3fc37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fc4101900 0x7f3fc419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:47.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.898+0000 7f3fc37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fc4101900 0x7f3fc419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41250/0 (socket says 172.21.15.17:41250) 2024-09-20T18:53:47.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.898+0000 7f3fc37fe640 1 -- 172.21.15.17:0/524065887 learned_addr learned my addr 172.21.15.17:0/524065887 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:53:47.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.898+0000 7f3fc2ffd640 1 --2- 172.21.15.17:0/524065887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fc4107900 0x7f3fc419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:47.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.899+0000 7f3fc37fe640 1 -- 172.21.15.17:0/524065887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fc4107900 msgr2=0x7f3fc419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:47.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.899+0000 7f3fc37fe640 1 --2- 172.21.15.17:0/524065887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fc4107900 0x7f3fc419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.899+0000 7f3fc37fe640 1 -- 172.21.15.17:0/524065887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc4197800 con 0x7f3fc4101900 2024-09-20T18:53:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.899+0000 7f3fc37fe640 1 --2- 172.21.15.17:0/524065887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fc4101900 0x7f3fc419d680 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400d8d0 tx=0x7f3fb400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.899+0000 7f3fc0ff9640 1 -- 172.21.15.17:0/524065887 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3fb4017070 con 0x7f3fc4101900 2024-09-20T18:53:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.899+0000 7f3fc0ff9640 1 -- 172.21.15.17:0/524065887 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3fb4010460 con 0x7f3fc4101900 2024-09-20T18:53:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.899+0000 7f3fc9bbc640 1 -- 172.21.15.17:0/524065887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc4197af0 con 0x7f3fc4101900 2024-09-20T18:53:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.899+0000 7f3fc0ff9640 1 -- 172.21.15.17:0/524065887 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3fb400f5f0 con 0x7f3fc4101900 2024-09-20T18:53:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.899+0000 7f3fc9bbc640 1 -- 172.21.15.17:0/524065887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc4198050 con 0x7f3fc4101900 2024-09-20T18:53:47.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.900+0000 7f3fc9bbc640 1 -- 172.21.15.17:0/524065887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc4103040 con 0x7f3fc4101900 2024-09-20T18:53:47.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.901+0000 7f3fc0ff9640 1 -- 172.21.15.17:0/524065887 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3fb4009a30 con 0x7f3fc4101900 2024-09-20T18:53:47.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.902+0000 7f3fc0ff9640 1 --2- 172.21.15.17:0/524065887 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3fb007af30 0x7f3fb007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:47.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.902+0000 7f3fc0ff9640 1 -- 172.21.15.17:0/524065887 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f3fb409de30 con 0x7f3fc4101900 2024-09-20T18:53:47.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.902+0000 7f3fc2ffd640 1 --2- 172.21.15.17:0/524065887 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3fb007af30 0x7f3fb007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:47.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.902+0000 7f3fc2ffd640 1 --2- 172.21.15.17:0/524065887 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3fb007af30 0x7f3fb007d3f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4198b50 tx=0x7f3fac031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:47.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:47.906+0000 7f3fc0ff9640 1 -- 172.21.15.17:0/524065887 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3fb4069430 con 0x7f3fc4101900 2024-09-20T18:53:48.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.134+0000 7f3fc9bbc640 1 -- 172.21.15.17:0/524065887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3fc4109e90 con 0x7f3fc4101900 2024-09-20T18:53:48.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:47 smithi017 ceph-mon[108970]: pgmap v551: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:48.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:47 smithi017 ceph-mon[108970]: from='client.34846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:53:48.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.134+0000 7f3fc0ff9640 1 -- 172.21.15.17:0/524065887 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f3fb406e2e0 con 0x7f3fc4101900 2024-09-20T18:53:48.152 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:53:48.152 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:53:48.152 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:53:48.152 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:53:48.152 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:53:48.152 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:53:48.153 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:53:48.153 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:53:48.153 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:53:48.153 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:53:48.153 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:53:48.153 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:53:48.153 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:53:48.153 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:53:48.153 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:53:48.153 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:53:48.153 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:53:48.153 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:53:48.153 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:53:48.154 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:53:48.154 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:53:48.154 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:53:48.154 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:53:48.154 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:53:48.154 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:53:48.154 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:53:48.154 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:53:48.154 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:53:48.154 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:53:48.154 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:53:48.155 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:53:48.155 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:53:48.155 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:53:48.155 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:53:48.155 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:53:48.155 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:53:48.155 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:53:48.155 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:53:48.155 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:53:48.155 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:53:48.155 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:53:48.155 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:53:48.155 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:53:48.156 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:53:48.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.136+0000 7f3fc9bbc640 1 -- 172.21.15.17:0/524065887 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3fb007af30 msgr2=0x7f3fb007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:48.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.136+0000 7f3fc9bbc640 1 --2- 172.21.15.17:0/524065887 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3fb007af30 0x7f3fb007d3f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4198b50 tx=0x7f3fac031400 comp rx=0 tx=0).stop 2024-09-20T18:53:48.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.136+0000 7f3fc9bbc640 1 -- 172.21.15.17:0/524065887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fc4101900 msgr2=0x7f3fc419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:48.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.136+0000 7f3fc9bbc640 1 --2- 172.21.15.17:0/524065887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fc4101900 0x7f3fc419d680 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400d8d0 tx=0x7f3fb400dd90 comp rx=0 tx=0).stop 2024-09-20T18:53:48.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.137+0000 7f3fc9bbc640 1 -- 172.21.15.17:0/524065887 shutdown_connections 2024-09-20T18:53:48.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.137+0000 7f3fc9bbc640 1 --2- 172.21.15.17:0/524065887 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3fb007af30 0x7f3fb007d3f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.137+0000 7f3fc9bbc640 1 --2- 172.21.15.17:0/524065887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fc4107900 0x7f3fc419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.137+0000 7f3fc9bbc640 1 --2- 172.21.15.17:0/524065887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fc4101900 0x7f3fc419d680 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.137+0000 7f3fc9bbc640 1 -- 172.21.15.17:0/524065887 >> 172.21.15.17:0/524065887 conn(0x7f3fc40fd600 msgr2=0x7f3fc40fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:48.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.137+0000 7f3fc9bbc640 1 -- 172.21.15.17:0/524065887 shutdown_connections 2024-09-20T18:53:48.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.137+0000 7f3fc9bbc640 1 -- 172.21.15.17:0/524065887 wait complete. 2024-09-20T18:53:48.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:47 smithi172 ceph-mon[80431]: pgmap v551: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:48.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:47 smithi172 ceph-mon[80431]: from='client.34846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:53:48.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.222+0000 7f0429cf4640 1 -- 172.21.15.17:0/434171324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0424101900 msgr2=0x7f0424101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:48.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.222+0000 7f0429cf4640 1 --2- 172.21.15.17:0/434171324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0424101900 0x7f0424101d60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0418009880 tx=0x7f041802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.222+0000 7f0429cf4640 1 -- 172.21.15.17:0/434171324 shutdown_connections 2024-09-20T18:53:48.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.222+0000 7f0429cf4640 1 --2- 172.21.15.17:0/434171324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0424101900 0x7f0424101d60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.222+0000 7f0429cf4640 1 --2- 172.21.15.17:0/434171324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0424107900 0x7f0424107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.222+0000 7f0429cf4640 1 -- 172.21.15.17:0/434171324 >> 172.21.15.17:0/434171324 conn(0x7f04240fd600 msgr2=0x7f04240ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:48.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.222+0000 7f0429cf4640 1 -- 172.21.15.17:0/434171324 shutdown_connections 2024-09-20T18:53:48.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.222+0000 7f0429cf4640 1 -- 172.21.15.17:0/434171324 wait complete. 2024-09-20T18:53:48.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.223+0000 7f0429cf4640 1 Processor -- start 2024-09-20T18:53:48.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.223+0000 7f0429cf4640 1 -- start start 2024-09-20T18:53:48.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.223+0000 7f0429cf4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0424101900 0x7f04240744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:48.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.223+0000 7f0429cf4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0424107900 0x7f0424074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:48.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.223+0000 7f0429cf4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f042410edb0 con 0x7f0424107900 2024-09-20T18:53:48.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.223+0000 7f0429cf4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f042410ec30 con 0x7f0424101900 2024-09-20T18:53:48.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.223+0000 7f0422ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0424107900 0x7f0424074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:48.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.223+0000 7f0422ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0424107900 0x7f0424074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41258/0 (socket says 172.21.15.17:41258) 2024-09-20T18:53:48.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.223+0000 7f0422ffd640 1 -- 172.21.15.17:0/2965326073 learned_addr learned my addr 172.21.15.17:0/2965326073 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:53:48.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.223+0000 7f04237fe640 1 --2- 172.21.15.17:0/2965326073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0424101900 0x7f04240744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:48.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.223+0000 7f0422ffd640 1 -- 172.21.15.17:0/2965326073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0424101900 msgr2=0x7f04240744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:48.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.223+0000 7f0422ffd640 1 --2- 172.21.15.17:0/2965326073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0424101900 0x7f04240744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.223+0000 7f0422ffd640 1 -- 172.21.15.17:0/2965326073 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0424074f70 con 0x7f0424107900 2024-09-20T18:53:48.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.224+0000 7f0422ffd640 1 --2- 172.21.15.17:0/2965326073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0424107900 0x7f0424074a30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0418031460 tx=0x7f04180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:48.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.224+0000 7f0420ff9640 1 -- 172.21.15.17:0/2965326073 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f041803f070 con 0x7f0424107900 2024-09-20T18:53:48.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.224+0000 7f0429cf4640 1 -- 172.21.15.17:0/2965326073 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0424075200 con 0x7f0424107900 2024-09-20T18:53:48.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.224+0000 7f0420ff9640 1 -- 172.21.15.17:0/2965326073 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0418004cf0 con 0x7f0424107900 2024-09-20T18:53:48.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.224+0000 7f0420ff9640 1 -- 172.21.15.17:0/2965326073 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0418035030 con 0x7f0424107900 2024-09-20T18:53:48.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.224+0000 7f0429cf4640 1 -- 172.21.15.17:0/2965326073 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04241a3d40 con 0x7f0424107900 2024-09-20T18:53:48.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.225+0000 7f0429cf4640 1 -- 172.21.15.17:0/2965326073 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0424103040 con 0x7f0424107900 2024-09-20T18:53:48.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.226+0000 7f0420ff9640 1 -- 172.21.15.17:0/2965326073 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0418042070 con 0x7f0424107900 2024-09-20T18:53:48.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.226+0000 7f0420ff9640 1 --2- 172.21.15.17:0/2965326073 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f040c07af30 0x7f040c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:48.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.227+0000 7f04237fe640 1 --2- 172.21.15.17:0/2965326073 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f040c07af30 0x7f040c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:48.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.227+0000 7f0420ff9640 1 -- 172.21.15.17:0/2965326073 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f04180bea90 con 0x7f0424107900 2024-09-20T18:53:48.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.227+0000 7f04237fe640 1 --2- 172.21.15.17:0/2965326073 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f040c07af30 0x7f040c07d3f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f041400ba40 tx=0x7f0414005cc0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:48.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.231+0000 7f0420ff9640 1 -- 172.21.15.17:0/2965326073 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f041808a090 con 0x7f0424107900 2024-09-20T18:53:48.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.437+0000 7f0429cf4640 1 -- 172.21.15.17:0/2965326073 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0424062630 con 0x7f040c07af30 2024-09-20T18:53:48.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.438+0000 7f0420ff9640 1 -- 172.21.15.17:0/2965326073 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f0424062630 con 0x7f040c07af30 2024-09-20T18:53:48.456 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:53:48.456 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:53:48.456 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:53:48.456 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:53:48.456 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:53:48.456 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:53:48.456 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:53:48.456 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:53:48.456 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:53:48.456 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:53:48.456 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:53:48.456 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:53:48.456 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:53:48.457 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:53:48.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.440+0000 7f0429cf4640 1 -- 172.21.15.17:0/2965326073 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f040c07af30 msgr2=0x7f040c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:48.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.440+0000 7f0429cf4640 1 --2- 172.21.15.17:0/2965326073 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f040c07af30 0x7f040c07d3f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f041400ba40 tx=0x7f0414005cc0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.440+0000 7f0429cf4640 1 -- 172.21.15.17:0/2965326073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0424107900 msgr2=0x7f0424074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:48.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.440+0000 7f0429cf4640 1 --2- 172.21.15.17:0/2965326073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0424107900 0x7f0424074a30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0418031460 tx=0x7f04180048f0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.440+0000 7f0429cf4640 1 -- 172.21.15.17:0/2965326073 shutdown_connections 2024-09-20T18:53:48.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.440+0000 7f0429cf4640 1 --2- 172.21.15.17:0/2965326073 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f040c07af30 0x7f040c07d3f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.440+0000 7f0429cf4640 1 --2- 172.21.15.17:0/2965326073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0424107900 0x7f0424074a30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.440+0000 7f0429cf4640 1 --2- 172.21.15.17:0/2965326073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0424101900 0x7f04240744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.440+0000 7f0429cf4640 1 -- 172.21.15.17:0/2965326073 >> 172.21.15.17:0/2965326073 conn(0x7f04240fd600 msgr2=0x7f04240fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:48.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.441+0000 7f0429cf4640 1 -- 172.21.15.17:0/2965326073 shutdown_connections 2024-09-20T18:53:48.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.441+0000 7f0429cf4640 1 -- 172.21.15.17:0/2965326073 wait complete. 2024-09-20T18:53:48.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.524+0000 7fc158953640 1 -- 172.21.15.17:0/1474221118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc154102ab0 msgr2=0x7fc154102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:48.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.524+0000 7fc158953640 1 --2- 172.21.15.17:0/1474221118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc154102ab0 0x7fc154102e90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc144009880 tx=0x7fc14402a530 comp rx=0 tx=0).stop 2024-09-20T18:53:48.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.524+0000 7fc158953640 1 -- 172.21.15.17:0/1474221118 shutdown_connections 2024-09-20T18:53:48.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.524+0000 7fc158953640 1 --2- 172.21.15.17:0/1474221118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1541033d0 0x7fc15410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.524+0000 7fc158953640 1 --2- 172.21.15.17:0/1474221118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc154102ab0 0x7fc154102e90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.524+0000 7fc158953640 1 -- 172.21.15.17:0/1474221118 >> 172.21.15.17:0/1474221118 conn(0x7fc1540fc550 msgr2=0x7fc1540fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:48.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.524+0000 7fc158953640 1 -- 172.21.15.17:0/1474221118 shutdown_connections 2024-09-20T18:53:48.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.524+0000 7fc158953640 1 -- 172.21.15.17:0/1474221118 wait complete. 2024-09-20T18:53:48.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.525+0000 7fc158953640 1 Processor -- start 2024-09-20T18:53:48.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.525+0000 7fc158953640 1 -- start start 2024-09-20T18:53:48.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.525+0000 7fc158953640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc154102ab0 0x7fc15419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:48.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.525+0000 7fc158953640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1541033d0 0x7fc15419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:48.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.525+0000 7fc158953640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc15410ede0 con 0x7fc154102ab0 2024-09-20T18:53:48.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.525+0000 7fc158953640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc15410ec60 con 0x7fc1541033d0 2024-09-20T18:53:48.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.526+0000 7fc15259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc154102ab0 0x7fc15419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:48.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.526+0000 7fc15259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc154102ab0 0x7fc15419d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41286/0 (socket says 172.21.15.17:41286) 2024-09-20T18:53:48.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.526+0000 7fc15259c640 1 -- 172.21.15.17:0/1259061361 learned_addr learned my addr 172.21.15.17:0/1259061361 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:53:48.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.526+0000 7fc151d9b640 1 --2- 172.21.15.17:0/1259061361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1541033d0 0x7fc15419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:48.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.526+0000 7fc15259c640 1 -- 172.21.15.17:0/1259061361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1541033d0 msgr2=0x7fc15419db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:48.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.526+0000 7fc15259c640 1 --2- 172.21.15.17:0/1259061361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1541033d0 0x7fc15419db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.526+0000 7fc15259c640 1 -- 172.21.15.17:0/1259061361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1541977b0 con 0x7fc154102ab0 2024-09-20T18:53:48.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.526+0000 7fc15259c640 1 --2- 172.21.15.17:0/1259061361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc154102ab0 0x7fc15419d630 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc144031460 tx=0x7fc1440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:48.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.526+0000 7fc1437fe640 1 -- 172.21.15.17:0/1259061361 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc14403f070 con 0x7fc154102ab0 2024-09-20T18:53:48.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.526+0000 7fc1437fe640 1 -- 172.21.15.17:0/1259061361 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc144004cf0 con 0x7fc154102ab0 2024-09-20T18:53:48.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.526+0000 7fc158953640 1 -- 172.21.15.17:0/1259061361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc154197a40 con 0x7fc154102ab0 2024-09-20T18:53:48.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.526+0000 7fc1437fe640 1 -- 172.21.15.17:0/1259061361 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc144035030 con 0x7fc154102ab0 2024-09-20T18:53:48.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.526+0000 7fc158953640 1 -- 172.21.15.17:0/1259061361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc154197f70 con 0x7fc154102ab0 2024-09-20T18:53:48.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.527+0000 7fc158953640 1 -- 172.21.15.17:0/1259061361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc15406a580 con 0x7fc154102ab0 2024-09-20T18:53:48.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.528+0000 7fc1437fe640 1 -- 172.21.15.17:0/1259061361 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc144042070 con 0x7fc154102ab0 2024-09-20T18:53:48.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.528+0000 7fc1437fe640 1 --2- 172.21.15.17:0/1259061361 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc13c07af80 0x7fc13c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:53:48.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.529+0000 7fc1437fe640 1 -- 172.21.15.17:0/1259061361 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fc1440be9d0 con 0x7fc154102ab0 2024-09-20T18:53:48.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.529+0000 7fc151d9b640 1 --2- 172.21.15.17:0/1259061361 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc13c07af80 0x7fc13c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:53:48.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.529+0000 7fc151d9b640 1 --2- 172.21.15.17:0/1259061361 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc13c07af80 0x7fc13c07d440 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc1541088f0 tx=0x7fc148005f50 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:53:48.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.533+0000 7fc1437fe640 1 -- 172.21.15.17:0/1259061361 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc144089fb0 con 0x7fc154102ab0 2024-09-20T18:53:48.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.795+0000 7fc158953640 1 -- 172.21.15.17:0/1259061361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fc154198220 con 0x7fc154102ab0 2024-09-20T18:53:48.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.796+0000 7fc1437fe640 1 -- 172.21.15.17:0/1259061361 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fc14408ee60 con 0x7fc154102ab0 2024-09-20T18:53:48.813 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:53:48.813 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:53:48.813 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:53:48.814 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:53:48.814 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:53:48.814 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:53:48.814 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:53:48.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.798+0000 7fc158953640 1 -- 172.21.15.17:0/1259061361 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc13c07af80 msgr2=0x7fc13c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:48.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.798+0000 7fc158953640 1 --2- 172.21.15.17:0/1259061361 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc13c07af80 0x7fc13c07d440 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc1541088f0 tx=0x7fc148005f50 comp rx=0 tx=0).stop 2024-09-20T18:53:48.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.798+0000 7fc158953640 1 -- 172.21.15.17:0/1259061361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc154102ab0 msgr2=0x7fc15419d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:53:48.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.798+0000 7fc158953640 1 --2- 172.21.15.17:0/1259061361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc154102ab0 0x7fc15419d630 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc144031460 tx=0x7fc1440048f0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.798+0000 7fc158953640 1 -- 172.21.15.17:0/1259061361 shutdown_connections 2024-09-20T18:53:48.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.798+0000 7fc158953640 1 --2- 172.21.15.17:0/1259061361 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc13c07af80 0x7fc13c07d440 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.798+0000 7fc158953640 1 --2- 172.21.15.17:0/1259061361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1541033d0 0x7fc15419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.798+0000 7fc158953640 1 --2- 172.21.15.17:0/1259061361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc154102ab0 0x7fc15419d630 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:53:48.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.798+0000 7fc158953640 1 -- 172.21.15.17:0/1259061361 >> 172.21.15.17:0/1259061361 conn(0x7fc1540fc550 msgr2=0x7fc15410aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:53:48.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.798+0000 7fc158953640 1 -- 172.21.15.17:0/1259061361 shutdown_connections 2024-09-20T18:53:48.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:53:48.798+0000 7fc158953640 1 -- 172.21.15.17:0/1259061361 wait complete. 2024-09-20T18:53:49.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:48 smithi017 ceph-mon[108970]: from='client.34850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:53:49.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:48 smithi017 ceph-mon[108970]: from='client.34854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:53:49.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:48 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3507902406' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:53:49.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:48 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/524065887' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:53:49.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:48 smithi172 ceph-mon[80431]: from='client.34850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:53:49.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:48 smithi172 ceph-mon[80431]: from='client.34854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:53:49.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:48 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3507902406' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:53:49.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:48 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/524065887' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:53:49.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:49 smithi017 ceph-mon[108970]: from='client.34866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:53:49.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:49 smithi017 ceph-mon[108970]: pgmap v552: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:49.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:49 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1259061361' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:53:50.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:49 smithi172 ceph-mon[80431]: from='client.34866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:53:50.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:49 smithi172 ceph-mon[80431]: pgmap v552: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:50.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:49 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1259061361' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:53:52.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:51 smithi017 ceph-mon[108970]: pgmap v553: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:52.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:51 smithi172 ceph-mon[80431]: pgmap v553: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:53.114 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:53:53.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:53:54.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:53 smithi017 ceph-mon[108970]: pgmap v554: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:54.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:53 smithi172 ceph-mon[80431]: pgmap v554: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:55.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:55 smithi017 ceph-mon[108970]: pgmap v555: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:56.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:55 smithi172 ceph-mon[80431]: pgmap v555: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:57.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:57 smithi017 ceph-mon[108970]: pgmap v556: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:53:58.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:57 smithi172 ceph-mon[80431]: pgmap v556: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:00.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:53:59 smithi017 ceph-mon[108970]: pgmap v557: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:00.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:53:59 smithi172 ceph-mon[80431]: pgmap v557: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:01.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:01 smithi017 ceph-mon[108970]: pgmap v558: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:02.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:01 smithi172 ceph-mon[80431]: pgmap v558: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:04.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:03 smithi017 ceph-mon[108970]: pgmap v559: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:04.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:03 smithi172 ceph-mon[80431]: pgmap v559: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:06.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:05 smithi017 ceph-mon[108970]: pgmap v560: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:06.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:05 smithi172 ceph-mon[80431]: pgmap v560: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:07.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:07 smithi017 ceph-mon[108970]: pgmap v561: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:07.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:54:08.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:07 smithi172 ceph-mon[80431]: pgmap v561: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:08.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:54:10.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:09 smithi017 ceph-mon[108970]: pgmap v562: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:10.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:09 smithi172 ceph-mon[80431]: pgmap v562: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:12.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:11 smithi017 ceph-mon[108970]: pgmap v563: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:12.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:11 smithi172 ceph-mon[80431]: pgmap v563: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:13.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:13 smithi017 ceph-mon[108970]: pgmap v564: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:14.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:13 smithi172 ceph-mon[80431]: pgmap v564: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:15.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:15 smithi172 ceph-mon[80431]: pgmap v565: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:16.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:15 smithi017 ceph-mon[108970]: pgmap v565: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:18.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:17 smithi017 ceph-mon[108970]: pgmap v566: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:18.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:17 smithi172 ceph-mon[80431]: pgmap v566: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:18.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.896+0000 7f6705793640 1 -- 172.21.15.17:0/2789301729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67001033e0 msgr2=0x7f670010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:18.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.896+0000 7f6705793640 1 --2- 172.21.15.17:0/2789301729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67001033e0 0x7f670010b8d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009880 tx=0x7f66f402a530 comp rx=0 tx=0).stop 2024-09-20T18:54:18.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.896+0000 7f6705793640 1 -- 172.21.15.17:0/2789301729 shutdown_connections 2024-09-20T18:54:18.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.896+0000 7f6705793640 1 --2- 172.21.15.17:0/2789301729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67001033e0 0x7f670010b8d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:18.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.896+0000 7f6705793640 1 --2- 172.21.15.17:0/2789301729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6700102ac0 0x7f6700102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:18.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.896+0000 7f6705793640 1 -- 172.21.15.17:0/2789301729 >> 172.21.15.17:0/2789301729 conn(0x7f67000fc520 msgr2=0x7f67000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:18.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.896+0000 7f6705793640 1 -- 172.21.15.17:0/2789301729 shutdown_connections 2024-09-20T18:54:18.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.896+0000 7f6705793640 1 -- 172.21.15.17:0/2789301729 wait complete. 2024-09-20T18:54:18.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.897+0000 7f6705793640 1 Processor -- start 2024-09-20T18:54:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.897+0000 7f6705793640 1 -- start start 2024-09-20T18:54:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.897+0000 7f6705793640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6700102ac0 0x7f6700100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.897+0000 7f6705793640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67001033e0 0x7f6700100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.897+0000 7f6705793640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f670010edd0 con 0x7f67001033e0 2024-09-20T18:54:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.897+0000 7f6705793640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f670010ec50 con 0x7f6700102ac0 2024-09-20T18:54:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.897+0000 7f66fe7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67001033e0 0x7f6700100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.898+0000 7f66fe7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67001033e0 0x7f6700100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47718/0 (socket says 172.21.15.17:47718) 2024-09-20T18:54:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.898+0000 7f66fe7fc640 1 -- 172.21.15.17:0/2328205216 learned_addr learned my addr 172.21.15.17:0/2328205216 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:54:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.898+0000 7f66feffd640 1 --2- 172.21.15.17:0/2328205216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6700102ac0 0x7f6700100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:18.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.898+0000 7f66fe7fc640 1 -- 172.21.15.17:0/2328205216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6700102ac0 msgr2=0x7f6700100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:18.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.898+0000 7f66fe7fc640 1 --2- 172.21.15.17:0/2328205216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6700102ac0 0x7f6700100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:18.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.898+0000 7f66fe7fc640 1 -- 172.21.15.17:0/2328205216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67001011a0 con 0x7f67001033e0 2024-09-20T18:54:18.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.898+0000 7f66fe7fc640 1 --2- 172.21.15.17:0/2328205216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67001033e0 0x7f6700100c60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f66f4031460 tx=0x7f66f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:18.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.898+0000 7f66e7fff640 1 -- 172.21.15.17:0/2328205216 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66f403f070 con 0x7f67001033e0 2024-09-20T18:54:18.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.898+0000 7f6705793640 1 -- 172.21.15.17:0/2328205216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6700101430 con 0x7f67001033e0 2024-09-20T18:54:18.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.898+0000 7f66e7fff640 1 -- 172.21.15.17:0/2328205216 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f66f4004ac0 con 0x7f67001033e0 2024-09-20T18:54:18.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.898+0000 7f66e7fff640 1 -- 172.21.15.17:0/2328205216 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66f4035030 con 0x7f67001033e0 2024-09-20T18:54:18.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.898+0000 7f6705793640 1 -- 172.21.15.17:0/2328205216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67001a3d50 con 0x7f67001033e0 2024-09-20T18:54:18.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.900+0000 7f6705793640 1 -- 172.21.15.17:0/2328205216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f670006aa90 con 0x7f67001033e0 2024-09-20T18:54:18.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.900+0000 7f66e7fff640 1 -- 172.21.15.17:0/2328205216 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f66f4042070 con 0x7f67001033e0 2024-09-20T18:54:18.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.901+0000 7f66e7fff640 1 --2- 172.21.15.17:0/2328205216 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66e807af80 0x7f66e807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:18.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.901+0000 7f66e7fff640 1 -- 172.21.15.17:0/2328205216 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f66f40be870 con 0x7f67001033e0 2024-09-20T18:54:18.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.901+0000 7f66feffd640 1 --2- 172.21.15.17:0/2328205216 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66e807af80 0x7f66e807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:18.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.902+0000 7f66feffd640 1 --2- 172.21.15.17:0/2328205216 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66e807af80 0x7f66e807d440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f66f000abe0 tx=0x7f66f000a2d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:18.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:18.906+0000 7f66e7fff640 1 -- 172.21.15.17:0/2328205216 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f66f4089ef0 con 0x7f67001033e0 2024-09-20T18:54:19.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.112+0000 7f6705793640 1 -- 172.21.15.17:0/2328205216 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6700062630 con 0x7f66e807af80 2024-09-20T18:54:19.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.113+0000 7f66e7fff640 1 -- 172.21.15.17:0/2328205216 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f6700062630 con 0x7f66e807af80 2024-09-20T18:54:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.115+0000 7f6705793640 1 -- 172.21.15.17:0/2328205216 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66e807af80 msgr2=0x7f66e807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.115+0000 7f6705793640 1 --2- 172.21.15.17:0/2328205216 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66e807af80 0x7f66e807d440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f66f000abe0 tx=0x7f66f000a2d0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.115+0000 7f6705793640 1 -- 172.21.15.17:0/2328205216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67001033e0 msgr2=0x7f6700100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.115+0000 7f6705793640 1 --2- 172.21.15.17:0/2328205216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67001033e0 0x7f6700100c60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f66f4031460 tx=0x7f66f40046c0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.115+0000 7f6705793640 1 -- 172.21.15.17:0/2328205216 shutdown_connections 2024-09-20T18:54:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.115+0000 7f6705793640 1 --2- 172.21.15.17:0/2328205216 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66e807af80 0x7f66e807d440 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.115+0000 7f6705793640 1 --2- 172.21.15.17:0/2328205216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67001033e0 0x7f6700100c60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.115+0000 7f6705793640 1 --2- 172.21.15.17:0/2328205216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6700102ac0 0x7f6700100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.115+0000 7f6705793640 1 -- 172.21.15.17:0/2328205216 >> 172.21.15.17:0/2328205216 conn(0x7f67000fc520 msgr2=0x7f6700108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.116+0000 7f6705793640 1 -- 172.21.15.17:0/2328205216 shutdown_connections 2024-09-20T18:54:19.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.116+0000 7f6705793640 1 -- 172.21.15.17:0/2328205216 wait complete. 2024-09-20T18:54:19.142 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:54:19.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.201+0000 7f7233d3f640 1 -- 172.21.15.17:0/1578091927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f722c107900 msgr2=0x7f722c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:19.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.201+0000 7f7233d3f640 1 --2- 172.21.15.17:0/1578091927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f722c107900 0x7f722c107ce0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7228009880 tx=0x7f722802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.201+0000 7f7233d3f640 1 -- 172.21.15.17:0/1578091927 shutdown_connections 2024-09-20T18:54:19.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.201+0000 7f7233d3f640 1 --2- 172.21.15.17:0/1578091927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f722c101900 0x7f722c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.201+0000 7f7233d3f640 1 --2- 172.21.15.17:0/1578091927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f722c107900 0x7f722c107ce0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.201+0000 7f7233d3f640 1 -- 172.21.15.17:0/1578091927 >> 172.21.15.17:0/1578091927 conn(0x7f722c0fd600 msgr2=0x7f722c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:19.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.201+0000 7f7233d3f640 1 -- 172.21.15.17:0/1578091927 shutdown_connections 2024-09-20T18:54:19.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.201+0000 7f7233d3f640 1 -- 172.21.15.17:0/1578091927 wait complete. 2024-09-20T18:54:19.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.202+0000 7f7233d3f640 1 Processor -- start 2024-09-20T18:54:19.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.202+0000 7f7233d3f640 1 -- start start 2024-09-20T18:54:19.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.202+0000 7f7233d3f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f722c101900 0x7f722c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:19.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.202+0000 7f7233d3f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f722c107900 0x7f722c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:19.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.202+0000 7f7233d3f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f722c10edd0 con 0x7f722c101900 2024-09-20T18:54:19.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.202+0000 7f7233d3f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f722c10ec50 con 0x7f722c107900 2024-09-20T18:54:19.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.202+0000 7f7231adb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f722c101900 0x7f722c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:19.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.202+0000 7f7231adb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f722c101900 0x7f722c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47738/0 (socket says 172.21.15.17:47738) 2024-09-20T18:54:19.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.202+0000 7f7231adb640 1 -- 172.21.15.17:0/3050680744 learned_addr learned my addr 172.21.15.17:0/3050680744 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:54:19.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.202+0000 7f72312da640 1 --2- 172.21.15.17:0/3050680744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f722c107900 0x7f722c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:19.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.203+0000 7f7231adb640 1 -- 172.21.15.17:0/3050680744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f722c107900 msgr2=0x7f722c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:19.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.203+0000 7f7231adb640 1 --2- 172.21.15.17:0/3050680744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f722c107900 0x7f722c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.203+0000 7f7231adb640 1 -- 172.21.15.17:0/3050680744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722c074f70 con 0x7f722c101900 2024-09-20T18:54:19.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.203+0000 7f7231adb640 1 --2- 172.21.15.17:0/3050680744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f722c101900 0x7f722c0744f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7228031460 tx=0x7f72280045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:19.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.203+0000 7f7222ffd640 1 -- 172.21.15.17:0/3050680744 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f722803f070 con 0x7f722c101900 2024-09-20T18:54:19.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.203+0000 7f7222ffd640 1 -- 172.21.15.17:0/3050680744 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f72280035f0 con 0x7f722c101900 2024-09-20T18:54:19.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.203+0000 7f7222ffd640 1 -- 172.21.15.17:0/3050680744 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7228035030 con 0x7f722c101900 2024-09-20T18:54:19.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.203+0000 7f7233d3f640 1 -- 172.21.15.17:0/3050680744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f722c075200 con 0x7f722c101900 2024-09-20T18:54:19.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.203+0000 7f7233d3f640 1 -- 172.21.15.17:0/3050680744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f722c1a3d80 con 0x7f722c101900 2024-09-20T18:54:19.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.204+0000 7f7233d3f640 1 -- 172.21.15.17:0/3050680744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f722c103040 con 0x7f722c101900 2024-09-20T18:54:19.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.205+0000 7f7222ffd640 1 -- 172.21.15.17:0/3050680744 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7228042070 con 0x7f722c101900 2024-09-20T18:54:19.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.206+0000 7f7222ffd640 1 --2- 172.21.15.17:0/3050680744 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f721807af80 0x7f721807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:19.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.206+0000 7f7222ffd640 1 -- 172.21.15.17:0/3050680744 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f72280bee40 con 0x7f722c101900 2024-09-20T18:54:19.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.206+0000 7f72312da640 1 --2- 172.21.15.17:0/3050680744 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f721807af80 0x7f721807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:19.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.206+0000 7f72312da640 1 --2- 172.21.15.17:0/3050680744 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f721807af80 0x7f721807d440 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f722c075f80 tx=0x7f721c00b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:19.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.209+0000 7f7222ffd640 1 -- 172.21.15.17:0/3050680744 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f722808a560 con 0x7f722c101900 2024-09-20T18:54:19.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.413+0000 7f7233d3f640 1 -- 172.21.15.17:0/3050680744 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f722c062630 con 0x7f721807af80 2024-09-20T18:54:19.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.415+0000 7f7222ffd640 1 -- 172.21.15.17:0/3050680744 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f722c062630 con 0x7f721807af80 2024-09-20T18:54:19.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.417+0000 7f7233d3f640 1 -- 172.21.15.17:0/3050680744 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f721807af80 msgr2=0x7f721807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:19.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.417+0000 7f7233d3f640 1 --2- 172.21.15.17:0/3050680744 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f721807af80 0x7f721807d440 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f722c075f80 tx=0x7f721c00b390 comp rx=0 tx=0).stop 2024-09-20T18:54:19.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.417+0000 7f7233d3f640 1 -- 172.21.15.17:0/3050680744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f722c101900 msgr2=0x7f722c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:19.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.417+0000 7f7233d3f640 1 --2- 172.21.15.17:0/3050680744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f722c101900 0x7f722c0744f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7228031460 tx=0x7f72280045e0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.417+0000 7f7233d3f640 1 -- 172.21.15.17:0/3050680744 shutdown_connections 2024-09-20T18:54:19.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.417+0000 7f7233d3f640 1 --2- 172.21.15.17:0/3050680744 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f721807af80 0x7f721807d440 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.417+0000 7f7233d3f640 1 --2- 172.21.15.17:0/3050680744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f722c107900 0x7f722c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.417+0000 7f7233d3f640 1 --2- 172.21.15.17:0/3050680744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f722c101900 0x7f722c0744f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.417+0000 7f7233d3f640 1 -- 172.21.15.17:0/3050680744 >> 172.21.15.17:0/3050680744 conn(0x7f722c0fd600 msgr2=0x7f722c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:19.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.417+0000 7f7233d3f640 1 -- 172.21.15.17:0/3050680744 shutdown_connections 2024-09-20T18:54:19.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.417+0000 7f7233d3f640 1 -- 172.21.15.17:0/3050680744 wait complete. 2024-09-20T18:54:19.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.501+0000 7f3fbb8c1640 1 -- 172.21.15.17:0/938970553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb4100d70 msgr2=0x7f3fb41065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:19.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.501+0000 7f3fbb8c1640 1 --2- 172.21.15.17:0/938970553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb4100d70 0x7f3fb41065c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4009880 tx=0x7f3fa402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.501+0000 7f3fbb8c1640 1 -- 172.21.15.17:0/938970553 shutdown_connections 2024-09-20T18:54:19.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.501+0000 7f3fbb8c1640 1 --2- 172.21.15.17:0/938970553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb4100d70 0x7f3fb41065c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.501+0000 7f3fbb8c1640 1 --2- 172.21.15.17:0/938970553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fb41003c0 0x7f3fb41007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.501+0000 7f3fbb8c1640 1 -- 172.21.15.17:0/938970553 >> 172.21.15.17:0/938970553 conn(0x7f3fb4077150 msgr2=0x7f3fb4077560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:19.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.501+0000 7f3fbb8c1640 1 -- 172.21.15.17:0/938970553 shutdown_connections 2024-09-20T18:54:19.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.501+0000 7f3fbb8c1640 1 -- 172.21.15.17:0/938970553 wait complete. 2024-09-20T18:54:19.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.502+0000 7f3fbb8c1640 1 Processor -- start 2024-09-20T18:54:19.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.502+0000 7f3fbb8c1640 1 -- start start 2024-09-20T18:54:19.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.502+0000 7f3fbb8c1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fb41003c0 0x7f3fb4101340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:19.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.502+0000 7f3fbb8c1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb4100d70 0x7f3fb4101880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:19.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.502+0000 7f3fbb8c1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb410edc0 con 0x7f3fb4100d70 2024-09-20T18:54:19.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.502+0000 7f3fbb8c1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb410ec40 con 0x7f3fb41003c0 2024-09-20T18:54:19.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.502+0000 7f3fb8e5c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb4100d70 0x7f3fb4101880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:19.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.502+0000 7f3fb8e5c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb4100d70 0x7f3fb4101880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47758/0 (socket says 172.21.15.17:47758) 2024-09-20T18:54:19.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.502+0000 7f3fb8e5c640 1 -- 172.21.15.17:0/925062134 learned_addr learned my addr 172.21.15.17:0/925062134 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:54:19.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.503+0000 7f3fb965d640 1 --2- 172.21.15.17:0/925062134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fb41003c0 0x7f3fb4101340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:19.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.503+0000 7f3fb8e5c640 1 -- 172.21.15.17:0/925062134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fb41003c0 msgr2=0x7f3fb4101340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:19.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.503+0000 7f3fb8e5c640 1 --2- 172.21.15.17:0/925062134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fb41003c0 0x7f3fb4101340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.503+0000 7f3fb8e5c640 1 -- 172.21.15.17:0/925062134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb4101dc0 con 0x7f3fb4100d70 2024-09-20T18:54:19.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.503+0000 7f3fb8e5c640 1 --2- 172.21.15.17:0/925062134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb4100d70 0x7f3fb4101880 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40045e0 tx=0x7f3fa4004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:19.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.503+0000 7f3faa7fc640 1 -- 172.21.15.17:0/925062134 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3fa403f070 con 0x7f3fb4100d70 2024-09-20T18:54:19.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.503+0000 7f3faa7fc640 1 -- 172.21.15.17:0/925062134 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3fa40035f0 con 0x7f3fb4100d70 2024-09-20T18:54:19.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.503+0000 7f3faa7fc640 1 -- 172.21.15.17:0/925062134 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3fa4035030 con 0x7f3fb4100d70 2024-09-20T18:54:19.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.503+0000 7f3fbb8c1640 1 -- 172.21.15.17:0/925062134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb4102050 con 0x7f3fb4100d70 2024-09-20T18:54:19.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.503+0000 7f3fbb8c1640 1 -- 172.21.15.17:0/925062134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb41a3e10 con 0x7f3fb4100d70 2024-09-20T18:54:19.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.505+0000 7f3fbb8c1640 1 -- 172.21.15.17:0/925062134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fb4069d90 con 0x7f3fb4100d70 2024-09-20T18:54:19.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.505+0000 7f3faa7fc640 1 -- 172.21.15.17:0/925062134 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3fa4042070 con 0x7f3fb4100d70 2024-09-20T18:54:19.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.506+0000 7f3faa7fc640 1 --2- 172.21.15.17:0/925062134 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3fa007af90 0x7f3fa007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:19.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.506+0000 7f3faa7fc640 1 -- 172.21.15.17:0/925062134 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f3fa40be9e0 con 0x7f3fb4100d70 2024-09-20T18:54:19.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.506+0000 7f3fb965d640 1 --2- 172.21.15.17:0/925062134 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3fa007af90 0x7f3fa007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:19.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.506+0000 7f3fb965d640 1 --2- 172.21.15.17:0/925062134 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3fa007af90 0x7f3fa007d450 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0005fd0 tx=0x7f3fb0005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:19.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.510+0000 7f3faa7fc640 1 -- 172.21.15.17:0/925062134 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3fa408a060 con 0x7f3fb4100d70 2024-09-20T18:54:19.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.708+0000 7f3fbb8c1640 1 -- 172.21.15.17:0/925062134 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3fb4062630 con 0x7f3fa007af90 2024-09-20T18:54:19.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.718+0000 7f3faa7fc640 1 -- 172.21.15.17:0/925062134 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f3fb4062630 con 0x7f3fa007af90 2024-09-20T18:54:19.735 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:54:19.735 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (15m) 9m ago 26m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:54:19.735 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (18m) 9m ago 26m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:54:19.735 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (18m) 9m ago 26m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:54:19.736 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (14m) 9m ago 26m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:54:19.736 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (13m) 9m ago 25m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:54:19.736 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (15m) 9m ago 26m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:54:19.736 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (10m) 9m ago 21m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:54:19.736 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (9m) 9m ago 21m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:54:19.736 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (21m) 9m ago 21m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:54:19.736 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (9m) 9m ago 21m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:54:19.736 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (17m) 9m ago 27m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:54:19.736 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (16m) 9m ago 25m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:54:19.736 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (14m) 9m ago 28m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:54:19.736 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (14m) 9m ago 25m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:54:19.736 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (16m) 9m ago 26m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:54:19.736 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (16m) 9m ago 25m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:54:19.736 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (13m) 9m ago 24m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:54:19.737 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (12m) 9m ago 24m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:54:19.737 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (12m) 9m ago 23m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:54:19.737 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (11m) 9m ago 23m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:54:19.737 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (11m) 9m ago 22m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:54:19.737 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (10m) 9m ago 22m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:54:19.737 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (16m) 9m ago 26m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:54:19.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.721+0000 7f3fbb8c1640 1 -- 172.21.15.17:0/925062134 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3fa007af90 msgr2=0x7f3fa007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.721+0000 7f3fbb8c1640 1 --2- 172.21.15.17:0/925062134 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3fa007af90 0x7f3fa007d450 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0005fd0 tx=0x7f3fb0005850 comp rx=0 tx=0).stop 2024-09-20T18:54:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.721+0000 7f3fbb8c1640 1 -- 172.21.15.17:0/925062134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb4100d70 msgr2=0x7f3fb4101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.721+0000 7f3fbb8c1640 1 --2- 172.21.15.17:0/925062134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb4100d70 0x7f3fb4101880 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40045e0 tx=0x7f3fa4004610 comp rx=0 tx=0).stop 2024-09-20T18:54:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.721+0000 7f3fbb8c1640 1 -- 172.21.15.17:0/925062134 shutdown_connections 2024-09-20T18:54:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.721+0000 7f3fbb8c1640 1 --2- 172.21.15.17:0/925062134 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3fa007af90 0x7f3fa007d450 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.721+0000 7f3fbb8c1640 1 --2- 172.21.15.17:0/925062134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb4100d70 0x7f3fb4101880 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.721+0000 7f3fbb8c1640 1 --2- 172.21.15.17:0/925062134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fb41003c0 0x7f3fb4101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.721+0000 7f3fbb8c1640 1 -- 172.21.15.17:0/925062134 >> 172.21.15.17:0/925062134 conn(0x7f3fb4077150 msgr2=0x7f3fb40fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.721+0000 7f3fbb8c1640 1 -- 172.21.15.17:0/925062134 shutdown_connections 2024-09-20T18:54:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.721+0000 7f3fbb8c1640 1 -- 172.21.15.17:0/925062134 wait complete. 2024-09-20T18:54:19.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.805+0000 7fa0a08cb640 1 -- 172.21.15.17:0/235349207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa09c1007f0 msgr2=0x7fa09c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:19.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.805+0000 7fa0a08cb640 1 --2- 172.21.15.17:0/235349207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa09c1007f0 0x7fa09c100c50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa084009880 tx=0x7fa08402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.805+0000 7fa0a08cb640 1 -- 172.21.15.17:0/235349207 shutdown_connections 2024-09-20T18:54:19.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.805+0000 7fa0a08cb640 1 --2- 172.21.15.17:0/235349207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa09c1007f0 0x7fa09c100c50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.805+0000 7fa0a08cb640 1 --2- 172.21.15.17:0/235349207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa09c1067f0 0x7fa09c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.805+0000 7fa0a08cb640 1 -- 172.21.15.17:0/235349207 >> 172.21.15.17:0/235349207 conn(0x7fa09c0fc550 msgr2=0x7fa09c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:19.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.805+0000 7fa0a08cb640 1 -- 172.21.15.17:0/235349207 shutdown_connections 2024-09-20T18:54:19.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.805+0000 7fa0a08cb640 1 -- 172.21.15.17:0/235349207 wait complete. 2024-09-20T18:54:19.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.806+0000 7fa0a08cb640 1 Processor -- start 2024-09-20T18:54:19.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.806+0000 7fa0a08cb640 1 -- start start 2024-09-20T18:54:19.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.806+0000 7fa0a08cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa09c1007f0 0x7fa09c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:19.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.806+0000 7fa0a08cb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa09c1067f0 0x7fa09c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:19.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.806+0000 7fa0a08cb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c10dcc0 con 0x7fa09c1007f0 2024-09-20T18:54:19.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.806+0000 7fa0a08cb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c10db40 con 0x7fa09c1067f0 2024-09-20T18:54:19.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.806+0000 7fa09a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa09c1007f0 0x7fa09c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:19.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.806+0000 7fa09a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa09c1007f0 0x7fa09c19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47786/0 (socket says 172.21.15.17:47786) 2024-09-20T18:54:19.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.806+0000 7fa09a59c640 1 -- 172.21.15.17:0/3248847245 learned_addr learned my addr 172.21.15.17:0/3248847245 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:54:19.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.806+0000 7fa093fff640 1 --2- 172.21.15.17:0/3248847245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa09c1067f0 0x7fa09c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:19.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.806+0000 7fa09a59c640 1 -- 172.21.15.17:0/3248847245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa09c1067f0 msgr2=0x7fa09c19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:19.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.806+0000 7fa09a59c640 1 --2- 172.21.15.17:0/3248847245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa09c1067f0 0x7fa09c19dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:19.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.806+0000 7fa09a59c640 1 -- 172.21.15.17:0/3248847245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09c1977e0 con 0x7fa09c1007f0 2024-09-20T18:54:19.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.807+0000 7fa09a59c640 1 --2- 172.21.15.17:0/3248847245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa09c1007f0 0x7fa09c19d660 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00e970 tx=0x7fa08c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:19.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.807+0000 7fa0937fe640 1 -- 172.21.15.17:0/3248847245 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa08c00cac0 con 0x7fa09c1007f0 2024-09-20T18:54:19.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.807+0000 7fa0937fe640 1 -- 172.21.15.17:0/3248847245 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa08c0054e0 con 0x7fa09c1007f0 2024-09-20T18:54:19.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.807+0000 7fa0a08cb640 1 -- 172.21.15.17:0/3248847245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa09c197ad0 con 0x7fa09c1007f0 2024-09-20T18:54:19.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.807+0000 7fa0937fe640 1 -- 172.21.15.17:0/3248847245 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa08c010430 con 0x7fa09c1007f0 2024-09-20T18:54:19.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.807+0000 7fa0a08cb640 1 -- 172.21.15.17:0/3248847245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa09c198060 con 0x7fa09c1007f0 2024-09-20T18:54:19.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.808+0000 7fa0a08cb640 1 -- 172.21.15.17:0/3248847245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa09c101f30 con 0x7fa09c1007f0 2024-09-20T18:54:19.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.809+0000 7fa0937fe640 1 -- 172.21.15.17:0/3248847245 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa08c004f00 con 0x7fa09c1007f0 2024-09-20T18:54:19.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.809+0000 7fa0937fe640 1 --2- 172.21.15.17:0/3248847245 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa08807af80 0x7fa08807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:19.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.809+0000 7fa0937fe640 1 -- 172.21.15.17:0/3248847245 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fa08c09e650 con 0x7fa09c1007f0 2024-09-20T18:54:19.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.809+0000 7fa093fff640 1 --2- 172.21.15.17:0/3248847245 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa08807af80 0x7fa08807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:19.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.810+0000 7fa093fff640 1 --2- 172.21.15.17:0/3248847245 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa08807af80 0x7fa08807d440 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa084031460 tx=0x7fa084009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:19.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:19.814+0000 7fa0937fe640 1 -- 172.21.15.17:0/3248847245 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa08c069cd0 con 0x7fa09c1007f0 2024-09-20T18:54:20.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.082+0000 7fa0a08cb640 1 -- 172.21.15.17:0/3248847245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa09c109d70 con 0x7fa09c1007f0 2024-09-20T18:54:20.100 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:19 smithi017 ceph-mon[108970]: pgmap v567: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:20.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.083+0000 7fa0937fe640 1 -- 172.21.15.17:0/3248847245 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fa08c06eb80 con 0x7fa09c1007f0 2024-09-20T18:54:20.100 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:54:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:54:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:54:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:54:20.100 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:54:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:54:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:54:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:54:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:54:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:54:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:54:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:54:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:54:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:54:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:54:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:54:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:54:20.101 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:54:20.102 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:54:20.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.085+0000 7fa0a08cb640 1 -- 172.21.15.17:0/3248847245 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa08807af80 msgr2=0x7fa08807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:20.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.085+0000 7fa0a08cb640 1 --2- 172.21.15.17:0/3248847245 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa08807af80 0x7fa08807d440 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa084031460 tx=0x7fa084009560 comp rx=0 tx=0).stop 2024-09-20T18:54:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.085+0000 7fa0a08cb640 1 -- 172.21.15.17:0/3248847245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa09c1007f0 msgr2=0x7fa09c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.085+0000 7fa0a08cb640 1 --2- 172.21.15.17:0/3248847245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa09c1007f0 0x7fa09c19d660 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00e970 tx=0x7fa08c00ed70 comp rx=0 tx=0).stop 2024-09-20T18:54:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.086+0000 7fa0a08cb640 1 -- 172.21.15.17:0/3248847245 shutdown_connections 2024-09-20T18:54:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.086+0000 7fa0a08cb640 1 --2- 172.21.15.17:0/3248847245 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa08807af80 0x7fa08807d440 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.086+0000 7fa0a08cb640 1 --2- 172.21.15.17:0/3248847245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa09c1067f0 0x7fa09c19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.086+0000 7fa0a08cb640 1 --2- 172.21.15.17:0/3248847245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa09c1007f0 0x7fa09c19d660 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.086+0000 7fa0a08cb640 1 -- 172.21.15.17:0/3248847245 >> 172.21.15.17:0/3248847245 conn(0x7fa09c0fc550 msgr2=0x7fa09c069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.086+0000 7fa0a08cb640 1 -- 172.21.15.17:0/3248847245 shutdown_connections 2024-09-20T18:54:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.086+0000 7fa0a08cb640 1 -- 172.21.15.17:0/3248847245 wait complete. 2024-09-20T18:54:20.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.170+0000 7f1aaa4ee640 1 -- 172.21.15.17:0/2610682077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa4100800 msgr2=0x7f1aa4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:20.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.170+0000 7f1aaa4ee640 1 --2- 172.21.15.17:0/2610682077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa4100800 0x7f1aa4100c60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009880 tx=0x7f1a9802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.170+0000 7f1aaa4ee640 1 -- 172.21.15.17:0/2610682077 shutdown_connections 2024-09-20T18:54:20.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.170+0000 7f1aaa4ee640 1 --2- 172.21.15.17:0/2610682077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa4100800 0x7f1aa4100c60 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.170+0000 7f1aaa4ee640 1 --2- 172.21.15.17:0/2610682077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aa4106800 0x7f1aa4106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.170+0000 7f1aaa4ee640 1 -- 172.21.15.17:0/2610682077 >> 172.21.15.17:0/2610682077 conn(0x7f1aa40fc520 msgr2=0x7f1aa40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:20.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.170+0000 7f1aaa4ee640 1 -- 172.21.15.17:0/2610682077 shutdown_connections 2024-09-20T18:54:20.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.170+0000 7f1aaa4ee640 1 -- 172.21.15.17:0/2610682077 wait complete. 2024-09-20T18:54:20.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.171+0000 7f1aaa4ee640 1 Processor -- start 2024-09-20T18:54:20.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.171+0000 7f1aaa4ee640 1 -- start start 2024-09-20T18:54:20.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.171+0000 7f1aaa4ee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa4100800 0x7f1aa40fcc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:20.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.171+0000 7f1aaa4ee640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aa4106800 0x7f1aa40fd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:20.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.171+0000 7f1aaa4ee640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa410dcd0 con 0x7f1aa4100800 2024-09-20T18:54:20.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.171+0000 7f1aaa4ee640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa410db50 con 0x7f1aa4106800 2024-09-20T18:54:20.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.171+0000 7f1aa3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa4100800 0x7f1aa40fcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:20.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.171+0000 7f1aa3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa4100800 0x7f1aa40fcc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47814/0 (socket says 172.21.15.17:47814) 2024-09-20T18:54:20.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.171+0000 7f1aa3fff640 1 -- 172.21.15.17:0/3593959009 learned_addr learned my addr 172.21.15.17:0/3593959009 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:54:20.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.171+0000 7f1aa37fe640 1 --2- 172.21.15.17:0/3593959009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aa4106800 0x7f1aa40fd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:20.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.171+0000 7f1aa3fff640 1 -- 172.21.15.17:0/3593959009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aa4106800 msgr2=0x7f1aa40fd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:20.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.171+0000 7f1aa3fff640 1 --2- 172.21.15.17:0/3593959009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aa4106800 0x7f1aa40fd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.171+0000 7f1aa3fff640 1 -- 172.21.15.17:0/3593959009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa40fd6b0 con 0x7f1aa4100800 2024-09-20T18:54:20.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.172+0000 7f1aa3fff640 1 --2- 172.21.15.17:0/3593959009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa4100800 0x7f1aa40fcc30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400d6f0 tx=0x7f1a9400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:20.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.172+0000 7f1aa17fa640 1 -- 172.21.15.17:0/3593959009 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a94017070 con 0x7f1aa4100800 2024-09-20T18:54:20.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.172+0000 7f1aaa4ee640 1 -- 172.21.15.17:0/3593959009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa40fd9a0 con 0x7f1aa4100800 2024-09-20T18:54:20.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.172+0000 7f1aa17fa640 1 -- 172.21.15.17:0/3593959009 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1a9400de00 con 0x7f1aa4100800 2024-09-20T18:54:20.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.172+0000 7f1aa17fa640 1 -- 172.21.15.17:0/3593959009 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a94004bb0 con 0x7f1aa4100800 2024-09-20T18:54:20.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.172+0000 7f1aaa4ee640 1 -- 172.21.15.17:0/3593959009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa41a3e70 con 0x7f1aa4100800 2024-09-20T18:54:20.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.173+0000 7f1aaa4ee640 1 -- 172.21.15.17:0/3593959009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa4101f40 con 0x7f1aa4100800 2024-09-20T18:54:20.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.174+0000 7f1aa17fa640 1 -- 172.21.15.17:0/3593959009 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1a94004e60 con 0x7f1aa4100800 2024-09-20T18:54:20.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.174+0000 7f1aa17fa640 1 --2- 172.21.15.17:0/3593959009 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1a8c07af30 0x7f1a8c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:20.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.175+0000 7f1aa17fa640 1 -- 172.21.15.17:0/3593959009 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f1a9409dcd0 con 0x7f1aa4100800 2024-09-20T18:54:20.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.175+0000 7f1aa37fe640 1 --2- 172.21.15.17:0/3593959009 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1a8c07af30 0x7f1a8c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:20.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.175+0000 7f1aa37fe640 1 --2- 172.21.15.17:0/3593959009 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1a8c07af30 0x7f1a8c07d3f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40fe6c0 tx=0x7f1a98031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:20.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.179+0000 7f1aa17fa640 1 -- 172.21.15.17:0/3593959009 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1a94069230 con 0x7f1aa4100800 2024-09-20T18:54:20.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:19 smithi172 ceph-mon[80431]: pgmap v567: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:20.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.408+0000 7f1aaa4ee640 1 -- 172.21.15.17:0/3593959009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1aa4109d80 con 0x7f1aa4100800 2024-09-20T18:54:20.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.408+0000 7f1aa17fa640 1 -- 172.21.15.17:0/3593959009 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f1a9406e0e0 con 0x7f1aa4100800 2024-09-20T18:54:20.425 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:54:20.425 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:54:20.425 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:54:20.425 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:54:20.426 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:54:20.426 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:54:20.426 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:54:20.426 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:54:20.426 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:54:20.426 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:54:20.426 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:54:20.426 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:54:20.426 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:54:20.426 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:54:20.426 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:54:20.426 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:54:20.426 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:54:20.426 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:54:20.427 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:54:20.427 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:54:20.427 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:54:20.427 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:54:20.427 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:54:20.427 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:54:20.427 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:54:20.427 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:54:20.427 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:54:20.427 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:54:20.427 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:54:20.427 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:54:20.428 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:54:20.428 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:54:20.428 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:54:20.428 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:54:20.428 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:54:20.428 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:54:20.428 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:54:20.428 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:54:20.428 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:54:20.428 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:54:20.428 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:54:20.428 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:54:20.428 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:54:20.429 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:54:20.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.411+0000 7f1aaa4ee640 1 -- 172.21.15.17:0/3593959009 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1a8c07af30 msgr2=0x7f1a8c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:20.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.411+0000 7f1aaa4ee640 1 --2- 172.21.15.17:0/3593959009 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1a8c07af30 0x7f1a8c07d3f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40fe6c0 tx=0x7f1a98031400 comp rx=0 tx=0).stop 2024-09-20T18:54:20.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.411+0000 7f1aaa4ee640 1 -- 172.21.15.17:0/3593959009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa4100800 msgr2=0x7f1aa40fcc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:20.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.411+0000 7f1aaa4ee640 1 --2- 172.21.15.17:0/3593959009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa4100800 0x7f1aa40fcc30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400d6f0 tx=0x7f1a9400dbb0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.411+0000 7f1aaa4ee640 1 -- 172.21.15.17:0/3593959009 shutdown_connections 2024-09-20T18:54:20.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.411+0000 7f1aaa4ee640 1 --2- 172.21.15.17:0/3593959009 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1a8c07af30 0x7f1a8c07d3f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.411+0000 7f1aaa4ee640 1 --2- 172.21.15.17:0/3593959009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aa4106800 0x7f1aa40fd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.411+0000 7f1aaa4ee640 1 --2- 172.21.15.17:0/3593959009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aa4100800 0x7f1aa40fcc30 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.411+0000 7f1aaa4ee640 1 -- 172.21.15.17:0/3593959009 >> 172.21.15.17:0/3593959009 conn(0x7f1aa40fc520 msgr2=0x7f1aa406a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:20.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.412+0000 7f1aaa4ee640 1 -- 172.21.15.17:0/3593959009 shutdown_connections 2024-09-20T18:54:20.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.412+0000 7f1aaa4ee640 1 -- 172.21.15.17:0/3593959009 wait complete. 2024-09-20T18:54:20.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.496+0000 7fd06593e640 1 -- 172.21.15.17:0/126548268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0601033d0 msgr2=0x7fd06010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:20.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.496+0000 7fd06593e640 1 --2- 172.21.15.17:0/126548268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0601033d0 0x7fd06010b8c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd054009880 tx=0x7fd05402a530 comp rx=0 tx=0).stop 2024-09-20T18:54:20.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.497+0000 7fd06593e640 1 -- 172.21.15.17:0/126548268 shutdown_connections 2024-09-20T18:54:20.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.497+0000 7fd06593e640 1 --2- 172.21.15.17:0/126548268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0601033d0 0x7fd06010b8c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.497+0000 7fd06593e640 1 --2- 172.21.15.17:0/126548268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd060102ab0 0x7fd060102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.497+0000 7fd06593e640 1 -- 172.21.15.17:0/126548268 >> 172.21.15.17:0/126548268 conn(0x7fd0600fc550 msgr2=0x7fd0600fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:20.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.497+0000 7fd06593e640 1 -- 172.21.15.17:0/126548268 shutdown_connections 2024-09-20T18:54:20.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.497+0000 7fd06593e640 1 -- 172.21.15.17:0/126548268 wait complete. 2024-09-20T18:54:20.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.497+0000 7fd06593e640 1 Processor -- start 2024-09-20T18:54:20.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.498+0000 7fd06593e640 1 -- start start 2024-09-20T18:54:20.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.498+0000 7fd06593e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd060102ab0 0x7fd060100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:20.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.498+0000 7fd06593e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0601033d0 0x7fd060100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:20.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.498+0000 7fd06593e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd06010ede0 con 0x7fd0601033d0 2024-09-20T18:54:20.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.498+0000 7fd06593e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd06010ec60 con 0x7fd060102ab0 2024-09-20T18:54:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.498+0000 7fd05e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0601033d0 0x7fd060100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.498+0000 7fd05e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0601033d0 0x7fd060100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50272/0 (socket says 172.21.15.17:50272) 2024-09-20T18:54:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.498+0000 7fd05e7fc640 1 -- 172.21.15.17:0/90287320 learned_addr learned my addr 172.21.15.17:0/90287320 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:54:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.498+0000 7fd05effd640 1 --2- 172.21.15.17:0/90287320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd060102ab0 0x7fd060100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.498+0000 7fd05e7fc640 1 -- 172.21.15.17:0/90287320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd060102ab0 msgr2=0x7fd060100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.498+0000 7fd05e7fc640 1 --2- 172.21.15.17:0/90287320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd060102ab0 0x7fd060100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.498+0000 7fd05e7fc640 1 -- 172.21.15.17:0/90287320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd060101190 con 0x7fd0601033d0 2024-09-20T18:54:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.498+0000 7fd05effd640 1 --2- 172.21.15.17:0/90287320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd060102ab0 0x7fd060100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:54:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.499+0000 7fd05e7fc640 1 --2- 172.21.15.17:0/90287320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0601033d0 0x7fd060100c50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd054031460 tx=0x7fd054004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.499+0000 7fd06493c640 1 -- 172.21.15.17:0/90287320 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd05403f070 con 0x7fd0601033d0 2024-09-20T18:54:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.499+0000 7fd06493c640 1 -- 172.21.15.17:0/90287320 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd0540035f0 con 0x7fd0601033d0 2024-09-20T18:54:20.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.499+0000 7fd06593e640 1 -- 172.21.15.17:0/90287320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd060101420 con 0x7fd0601033d0 2024-09-20T18:54:20.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.499+0000 7fd06493c640 1 -- 172.21.15.17:0/90287320 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd054035030 con 0x7fd0601033d0 2024-09-20T18:54:20.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.499+0000 7fd06593e640 1 -- 172.21.15.17:0/90287320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0601a3dd0 con 0x7fd0601033d0 2024-09-20T18:54:20.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.500+0000 7fd06593e640 1 -- 172.21.15.17:0/90287320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd06006a580 con 0x7fd0601033d0 2024-09-20T18:54:20.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.500+0000 7fd06493c640 1 -- 172.21.15.17:0/90287320 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd054042070 con 0x7fd0601033d0 2024-09-20T18:54:20.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.501+0000 7fd06493c640 1 --2- 172.21.15.17:0/90287320 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd04807af80 0x7fd04807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:20.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.501+0000 7fd06493c640 1 -- 172.21.15.17:0/90287320 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fd0540be8e0 con 0x7fd0601033d0 2024-09-20T18:54:20.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.501+0000 7fd05effd640 1 --2- 172.21.15.17:0/90287320 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd04807af80 0x7fd04807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:20.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.502+0000 7fd05effd640 1 --2- 172.21.15.17:0/90287320 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd04807af80 0x7fd04807d440 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd0500058c0 tx=0x7fd050005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:20.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.505+0000 7fd06493c640 1 -- 172.21.15.17:0/90287320 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd054089f60 con 0x7fd0601033d0 2024-09-20T18:54:20.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.709+0000 7fd06593e640 1 -- 172.21.15.17:0/90287320 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd060062630 con 0x7fd04807af80 2024-09-20T18:54:20.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.710+0000 7fd06493c640 1 -- 172.21.15.17:0/90287320 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fd060062630 con 0x7fd04807af80 2024-09-20T18:54:20.727 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:54:20.727 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:54:20.727 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:54:20.727 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:54:20.727 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:54:20.727 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:54:20.727 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:54:20.727 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:54:20.727 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:54:20.727 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:54:20.728 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:54:20.728 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:54:20.728 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:54:20.728 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:54:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.712+0000 7fd06593e640 1 -- 172.21.15.17:0/90287320 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd04807af80 msgr2=0x7fd04807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.712+0000 7fd06593e640 1 --2- 172.21.15.17:0/90287320 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd04807af80 0x7fd04807d440 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd0500058c0 tx=0x7fd050005850 comp rx=0 tx=0).stop 2024-09-20T18:54:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.712+0000 7fd06593e640 1 -- 172.21.15.17:0/90287320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0601033d0 msgr2=0x7fd060100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.712+0000 7fd06593e640 1 --2- 172.21.15.17:0/90287320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0601033d0 0x7fd060100c50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd054031460 tx=0x7fd054004530 comp rx=0 tx=0).stop 2024-09-20T18:54:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.712+0000 7fd06593e640 1 -- 172.21.15.17:0/90287320 shutdown_connections 2024-09-20T18:54:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.712+0000 7fd06593e640 1 --2- 172.21.15.17:0/90287320 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd04807af80 0x7fd04807d440 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.712+0000 7fd06593e640 1 --2- 172.21.15.17:0/90287320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0601033d0 0x7fd060100c50 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.712+0000 7fd06593e640 1 --2- 172.21.15.17:0/90287320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd060102ab0 0x7fd060100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.712+0000 7fd06593e640 1 -- 172.21.15.17:0/90287320 >> 172.21.15.17:0/90287320 conn(0x7fd0600fc550 msgr2=0x7fd060108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:20.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.713+0000 7fd06593e640 1 -- 172.21.15.17:0/90287320 shutdown_connections 2024-09-20T18:54:20.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.713+0000 7fd06593e640 1 -- 172.21.15.17:0/90287320 wait complete. 2024-09-20T18:54:20.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.796+0000 7fdb36547640 1 -- 172.21.15.17:0/4280098104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb30102b70 msgr2=0x7fdb30102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:20.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.796+0000 7fdb36547640 1 --2- 172.21.15.17:0/4280098104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb30102b70 0x7fdb30102f50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009880 tx=0x7fdb2002a530 comp rx=0 tx=0).stop 2024-09-20T18:54:20.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.797+0000 7fdb36547640 1 -- 172.21.15.17:0/4280098104 shutdown_connections 2024-09-20T18:54:20.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.797+0000 7fdb36547640 1 --2- 172.21.15.17:0/4280098104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb30103490 0x7fdb3010b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.797+0000 7fdb36547640 1 --2- 172.21.15.17:0/4280098104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb30102b70 0x7fdb30102f50 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.797+0000 7fdb36547640 1 -- 172.21.15.17:0/4280098104 >> 172.21.15.17:0/4280098104 conn(0x7fdb300fc550 msgr2=0x7fdb300fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:20.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.797+0000 7fdb36547640 1 -- 172.21.15.17:0/4280098104 shutdown_connections 2024-09-20T18:54:20.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.797+0000 7fdb36547640 1 -- 172.21.15.17:0/4280098104 wait complete. 2024-09-20T18:54:20.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.797+0000 7fdb36547640 1 Processor -- start 2024-09-20T18:54:20.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.797+0000 7fdb36547640 1 -- start start 2024-09-20T18:54:20.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.798+0000 7fdb36547640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb30102b70 0x7fdb3019f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:20.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.798+0000 7fdb36547640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb30103490 0x7fdb3019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:20.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.798+0000 7fdb36547640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3010edc0 con 0x7fdb30102b70 2024-09-20T18:54:20.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.798+0000 7fdb36547640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3010ec40 con 0x7fdb30103490 2024-09-20T18:54:20.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.798+0000 7fdb2ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb30102b70 0x7fdb3019f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:20.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.798+0000 7fdb2ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb30102b70 0x7fdb3019f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50300/0 (socket says 172.21.15.17:50300) 2024-09-20T18:54:20.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.798+0000 7fdb2ffff640 1 -- 172.21.15.17:0/3714362426 learned_addr learned my addr 172.21.15.17:0/3714362426 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:54:20.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.798+0000 7fdb2f7fe640 1 --2- 172.21.15.17:0/3714362426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb30103490 0x7fdb3019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:20.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.798+0000 7fdb2ffff640 1 -- 172.21.15.17:0/3714362426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb30103490 msgr2=0x7fdb3019fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:20.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.798+0000 7fdb2ffff640 1 --2- 172.21.15.17:0/3714362426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb30103490 0x7fdb3019fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:20.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.798+0000 7fdb2ffff640 1 -- 172.21.15.17:0/3714362426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb30199970 con 0x7fdb30102b70 2024-09-20T18:54:20.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.798+0000 7fdb2ffff640 1 --2- 172.21.15.17:0/3714362426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb30102b70 0x7fdb3019f7b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdb20004f90 tx=0x7fdb200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:20.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.799+0000 7fdb2d7fa640 1 -- 172.21.15.17:0/3714362426 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb2003f070 con 0x7fdb30102b70 2024-09-20T18:54:20.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.799+0000 7fdb2d7fa640 1 -- 172.21.15.17:0/3714362426 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb20004cf0 con 0x7fdb30102b70 2024-09-20T18:54:20.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.799+0000 7fdb36547640 1 -- 172.21.15.17:0/3714362426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb30199c00 con 0x7fdb30102b70 2024-09-20T18:54:20.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.799+0000 7fdb2d7fa640 1 -- 172.21.15.17:0/3714362426 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb20035030 con 0x7fdb30102b70 2024-09-20T18:54:20.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.799+0000 7fdb36547640 1 -- 172.21.15.17:0/3714362426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb3019a130 con 0x7fdb30102b70 2024-09-20T18:54:20.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.800+0000 7fdb36547640 1 -- 172.21.15.17:0/3714362426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb3006a4c0 con 0x7fdb30102b70 2024-09-20T18:54:20.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.801+0000 7fdb2d7fa640 1 -- 172.21.15.17:0/3714362426 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdb20042070 con 0x7fdb30102b70 2024-09-20T18:54:20.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.801+0000 7fdb2d7fa640 1 --2- 172.21.15.17:0/3714362426 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdb1807af90 0x7fdb1807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:20.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.801+0000 7fdb2d7fa640 1 -- 172.21.15.17:0/3714362426 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fdb200beaa0 con 0x7fdb30102b70 2024-09-20T18:54:20.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.801+0000 7fdb2f7fe640 1 --2- 172.21.15.17:0/3714362426 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdb1807af90 0x7fdb1807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:20.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.802+0000 7fdb2f7fe640 1 --2- 172.21.15.17:0/3714362426 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdb1807af90 0x7fdb1807d450 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdb300fe500 tx=0x7fdb2400a4c0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:20.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:20.807+0000 7fdb2d7fa640 1 -- 172.21.15.17:0/3714362426 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb2008a120 con 0x7fdb30102b70 2024-09-20T18:54:20.961 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:20 smithi172 ceph-mon[80431]: from='client.34874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:54:20.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:20 smithi172 ceph-mon[80431]: from='client.34878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:54:20.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:20 smithi172 ceph-mon[80431]: from='client.34882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:54:20.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:20 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3248847245' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:54:20.962 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:20 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3593959009' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:54:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:21.069+0000 7fdb36547640 1 -- 172.21.15.17:0/3714362426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fdb3019aea0 con 0x7fdb30102b70 2024-09-20T18:54:21.086 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:20 smithi017 ceph-mon[108970]: from='client.34874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:54:21.086 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:20 smithi017 ceph-mon[108970]: from='client.34878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:54:21.086 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:20 smithi017 ceph-mon[108970]: from='client.34882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:54:21.086 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:20 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3248847245' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:54:21.086 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:20 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3593959009' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:54:21.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:21.069+0000 7fdb2d7fa640 1 -- 172.21.15.17:0/3714362426 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fdb2008efd0 con 0x7fdb30102b70 2024-09-20T18:54:21.087 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:54:21.087 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:54:21.087 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:54:21.087 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:54:21.087 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:54:21.087 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:54:21.087 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:54:21.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:21.073+0000 7fdb36547640 1 -- 172.21.15.17:0/3714362426 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdb1807af90 msgr2=0x7fdb1807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:21.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:21.073+0000 7fdb36547640 1 --2- 172.21.15.17:0/3714362426 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdb1807af90 0x7fdb1807d450 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdb300fe500 tx=0x7fdb2400a4c0 comp rx=0 tx=0).stop 2024-09-20T18:54:21.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:21.073+0000 7fdb36547640 1 -- 172.21.15.17:0/3714362426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb30102b70 msgr2=0x7fdb3019f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:21.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:21.073+0000 7fdb36547640 1 --2- 172.21.15.17:0/3714362426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb30102b70 0x7fdb3019f7b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdb20004f90 tx=0x7fdb200048f0 comp rx=0 tx=0).stop 2024-09-20T18:54:21.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:21.073+0000 7fdb36547640 1 -- 172.21.15.17:0/3714362426 shutdown_connections 2024-09-20T18:54:21.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:21.073+0000 7fdb36547640 1 --2- 172.21.15.17:0/3714362426 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdb1807af90 0x7fdb1807d450 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:21.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:21.073+0000 7fdb36547640 1 --2- 172.21.15.17:0/3714362426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb30103490 0x7fdb3019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:21.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:21.073+0000 7fdb36547640 1 --2- 172.21.15.17:0/3714362426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb30102b70 0x7fdb3019f7b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:21.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:21.073+0000 7fdb36547640 1 -- 172.21.15.17:0/3714362426 >> 172.21.15.17:0/3714362426 conn(0x7fdb300fc550 msgr2=0x7fdb30100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:21.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:21.073+0000 7fdb36547640 1 -- 172.21.15.17:0/3714362426 shutdown_connections 2024-09-20T18:54:21.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:21.073+0000 7fdb36547640 1 -- 172.21.15.17:0/3714362426 wait complete. 2024-09-20T18:54:22.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:21 smithi017 ceph-mon[108970]: pgmap v568: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:22.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:21 smithi017 ceph-mon[108970]: from='client.34894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:54:22.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:21 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3714362426' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:54:22.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:21 smithi172 ceph-mon[80431]: pgmap v568: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:22.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:21 smithi172 ceph-mon[80431]: from='client.34894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:54:22.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:21 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3714362426' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:54:23.113 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:54:23.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:54:24.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:23 smithi017 ceph-mon[108970]: pgmap v569: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:24.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:23 smithi172 ceph-mon[80431]: pgmap v569: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:26.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:25 smithi017 ceph-mon[108970]: pgmap v570: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:26.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:25 smithi172 ceph-mon[80431]: pgmap v570: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:28.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:27 smithi017 ceph-mon[108970]: pgmap v571: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:28.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:27 smithi172 ceph-mon[80431]: pgmap v571: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:30.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:29 smithi017 ceph-mon[108970]: pgmap v572: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:30.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:29 smithi172 ceph-mon[80431]: pgmap v572: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:32.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:31 smithi017 ceph-mon[108970]: pgmap v573: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:32.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:31 smithi172 ceph-mon[80431]: pgmap v573: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:34.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:33 smithi017 ceph-mon[108970]: pgmap v574: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:34.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:33 smithi172 ceph-mon[80431]: pgmap v574: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:36.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:35 smithi017 ceph-mon[108970]: pgmap v575: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:36.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:35 smithi172 ceph-mon[80431]: pgmap v575: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:38.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:37 smithi017 ceph-mon[108970]: pgmap v576: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:38.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:54:38.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:37 smithi172 ceph-mon[80431]: pgmap v576: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:38.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:54:40.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:39 smithi017 ceph-mon[108970]: pgmap v577: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:40.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:39 smithi172 ceph-mon[80431]: pgmap v577: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:42.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:41 smithi017 ceph-mon[108970]: pgmap v578: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:42.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:41 smithi172 ceph-mon[80431]: pgmap v578: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:44.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:43 smithi017 ceph-mon[108970]: pgmap v579: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:44.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:43 smithi172 ceph-mon[80431]: pgmap v579: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:46.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:45 smithi017 ceph-mon[108970]: pgmap v580: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:46.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:45 smithi172 ceph-mon[80431]: pgmap v580: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:48.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:47 smithi017 ceph-mon[108970]: pgmap v581: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:48.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:47 smithi172 ceph-mon[80431]: pgmap v581: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:50.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:49 smithi017 ceph-mon[108970]: pgmap v582: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:50.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:49 smithi172 ceph-mon[80431]: pgmap v582: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:51.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.170+0000 7ff4f8294640 1 -- 172.21.15.17:0/1494618024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f0100fb0 msgr2=0x7ff4f0101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:51.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.170+0000 7ff4f8294640 1 --2- 172.21.15.17:0/1494618024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f0100fb0 0x7ff4f0101410 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009880 tx=0x7ff4e002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.170+0000 7ff4f8294640 1 -- 172.21.15.17:0/1494618024 shutdown_connections 2024-09-20T18:54:51.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.170+0000 7ff4f8294640 1 --2- 172.21.15.17:0/1494618024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f0100fb0 0x7ff4f0101410 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.170+0000 7ff4f8294640 1 --2- 172.21.15.17:0/1494618024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f0106a90 0x7ff4f0106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.170+0000 7ff4f8294640 1 -- 172.21.15.17:0/1494618024 >> 172.21.15.17:0/1494618024 conn(0x7ff4f00fbc90 msgr2=0x7ff4f00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:51.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.170+0000 7ff4f8294640 1 -- 172.21.15.17:0/1494618024 shutdown_connections 2024-09-20T18:54:51.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.170+0000 7ff4f8294640 1 -- 172.21.15.17:0/1494618024 wait complete. 2024-09-20T18:54:51.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.170+0000 7ff4f8294640 1 Processor -- start 2024-09-20T18:54:51.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.171+0000 7ff4f8294640 1 -- start start 2024-09-20T18:54:51.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.171+0000 7ff4f8294640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f0100fb0 0x7ff4f01968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:51.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.171+0000 7ff4f8294640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f0106a90 0x7ff4f0196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:51.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.171+0000 7ff4f8294640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f010df60 con 0x7ff4f0106a90 2024-09-20T18:54:51.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.171+0000 7ff4f8294640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f010dde0 con 0x7ff4f0100fb0 2024-09-20T18:54:51.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.171+0000 7ff4f582f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f0106a90 0x7ff4f0196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:51.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.171+0000 7ff4f582f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f0106a90 0x7ff4f0196e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55882/0 (socket says 172.21.15.17:55882) 2024-09-20T18:54:51.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.171+0000 7ff4f582f640 1 -- 172.21.15.17:0/154217804 learned_addr learned my addr 172.21.15.17:0/154217804 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:54:51.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.171+0000 7ff4f6030640 1 --2- 172.21.15.17:0/154217804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f0100fb0 0x7ff4f01968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:51.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.171+0000 7ff4f582f640 1 -- 172.21.15.17:0/154217804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f0100fb0 msgr2=0x7ff4f01968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:51.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.171+0000 7ff4f582f640 1 --2- 172.21.15.17:0/154217804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f0100fb0 0x7ff4f01968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.171+0000 7ff4f582f640 1 -- 172.21.15.17:0/154217804 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f0197340 con 0x7ff4f0106a90 2024-09-20T18:54:51.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.172+0000 7ff4f582f640 1 --2- 172.21.15.17:0/154217804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f0106a90 0x7ff4f0196e00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0031460 tx=0x7ff4e00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:51.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.172+0000 7ff4e77fe640 1 -- 172.21.15.17:0/154217804 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4e003f070 con 0x7ff4f0106a90 2024-09-20T18:54:51.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.172+0000 7ff4e77fe640 1 -- 172.21.15.17:0/154217804 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff4e0004b10 con 0x7ff4f0106a90 2024-09-20T18:54:51.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.172+0000 7ff4f8294640 1 -- 172.21.15.17:0/154217804 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f01975d0 con 0x7ff4f0106a90 2024-09-20T18:54:51.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.172+0000 7ff4e77fe640 1 -- 172.21.15.17:0/154217804 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4e0035030 con 0x7ff4f0106a90 2024-09-20T18:54:51.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.172+0000 7ff4f8294640 1 -- 172.21.15.17:0/154217804 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f01a4100 con 0x7ff4f0106a90 2024-09-20T18:54:51.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.173+0000 7ff4f8294640 1 -- 172.21.15.17:0/154217804 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4f01021d0 con 0x7ff4f0106a90 2024-09-20T18:54:51.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.174+0000 7ff4e77fe640 1 -- 172.21.15.17:0/154217804 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff4e0042070 con 0x7ff4f0106a90 2024-09-20T18:54:51.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.174+0000 7ff4e77fe640 1 --2- 172.21.15.17:0/154217804 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4dc07af40 0x7ff4dc07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:51.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.174+0000 7ff4e77fe640 1 -- 172.21.15.17:0/154217804 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7ff4e00bea80 con 0x7ff4f0106a90 2024-09-20T18:54:51.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.174+0000 7ff4f6030640 1 --2- 172.21.15.17:0/154217804 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4dc07af40 0x7ff4dc07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:51.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.175+0000 7ff4f6030640 1 --2- 172.21.15.17:0/154217804 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4dc07af40 0x7ff4dc07d400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec005fd0 tx=0x7ff4ec00b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:51.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.179+0000 7ff4e77fe640 1 -- 172.21.15.17:0/154217804 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff4e008a080 con 0x7ff4f0106a90 2024-09-20T18:54:51.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.385+0000 7ff4f8294640 1 -- 172.21.15.17:0/154217804 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff4f0069f90 con 0x7ff4dc07af40 2024-09-20T18:54:51.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.386+0000 7ff4e77fe640 1 -- 172.21.15.17:0/154217804 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7ff4f0069f90 con 0x7ff4dc07af40 2024-09-20T18:54:51.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.388+0000 7ff4f8294640 1 -- 172.21.15.17:0/154217804 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4dc07af40 msgr2=0x7ff4dc07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:51.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.388+0000 7ff4f8294640 1 --2- 172.21.15.17:0/154217804 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4dc07af40 0x7ff4dc07d400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec005fd0 tx=0x7ff4ec00b390 comp rx=0 tx=0).stop 2024-09-20T18:54:51.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.389+0000 7ff4f8294640 1 -- 172.21.15.17:0/154217804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f0106a90 msgr2=0x7ff4f0196e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:51.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.389+0000 7ff4f8294640 1 --2- 172.21.15.17:0/154217804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f0106a90 0x7ff4f0196e00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0031460 tx=0x7ff4e00045e0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.389+0000 7ff4f8294640 1 -- 172.21.15.17:0/154217804 shutdown_connections 2024-09-20T18:54:51.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.389+0000 7ff4f8294640 1 --2- 172.21.15.17:0/154217804 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4dc07af40 0x7ff4dc07d400 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.389+0000 7ff4f8294640 1 --2- 172.21.15.17:0/154217804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f0106a90 0x7ff4f0196e00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.389+0000 7ff4f8294640 1 --2- 172.21.15.17:0/154217804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f0100fb0 0x7ff4f01968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.389+0000 7ff4f8294640 1 -- 172.21.15.17:0/154217804 >> 172.21.15.17:0/154217804 conn(0x7ff4f00fbc90 msgr2=0x7ff4f00fc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:51.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.389+0000 7ff4f8294640 1 -- 172.21.15.17:0/154217804 shutdown_connections 2024-09-20T18:54:51.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.389+0000 7ff4f8294640 1 -- 172.21.15.17:0/154217804 wait complete. 2024-09-20T18:54:51.414 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:54:51.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.474+0000 7f2e6c7f7640 1 -- 172.21.15.17:0/1361951280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e641033e0 msgr2=0x7f2e6410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:51.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.474+0000 7f2e6c7f7640 1 --2- 172.21.15.17:0/1361951280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e641033e0 0x7f2e6410b8d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009880 tx=0x7f2e5402a530 comp rx=0 tx=0).stop 2024-09-20T18:54:51.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.474+0000 7f2e6c7f7640 1 -- 172.21.15.17:0/1361951280 shutdown_connections 2024-09-20T18:54:51.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.474+0000 7f2e6c7f7640 1 --2- 172.21.15.17:0/1361951280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e641033e0 0x7f2e6410b8d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.474+0000 7f2e6c7f7640 1 --2- 172.21.15.17:0/1361951280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e64102ac0 0x7f2e64102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.474+0000 7f2e6c7f7640 1 -- 172.21.15.17:0/1361951280 >> 172.21.15.17:0/1361951280 conn(0x7f2e640fc520 msgr2=0x7f2e640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:51.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.474+0000 7f2e6c7f7640 1 -- 172.21.15.17:0/1361951280 shutdown_connections 2024-09-20T18:54:51.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.474+0000 7f2e6c7f7640 1 -- 172.21.15.17:0/1361951280 wait complete. 2024-09-20T18:54:51.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.474+0000 7f2e6c7f7640 1 Processor -- start 2024-09-20T18:54:51.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.475+0000 7f2e6c7f7640 1 -- start start 2024-09-20T18:54:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.475+0000 7f2e6c7f7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e64102ac0 0x7f2e64100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.475+0000 7f2e6c7f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e641033e0 0x7f2e64100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.475+0000 7f2e6c7f7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6410ee50 con 0x7f2e64102ac0 2024-09-20T18:54:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.475+0000 7f2e6c7f7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6410ecd0 con 0x7f2e641033e0 2024-09-20T18:54:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.475+0000 7f2e6a593640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e64102ac0 0x7f2e64100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.475+0000 7f2e6a593640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e64102ac0 0x7f2e64100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55888/0 (socket says 172.21.15.17:55888) 2024-09-20T18:54:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.475+0000 7f2e6a593640 1 -- 172.21.15.17:0/4161587118 learned_addr learned my addr 172.21.15.17:0/4161587118 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:54:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.475+0000 7f2e69d92640 1 --2- 172.21.15.17:0/4161587118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e641033e0 0x7f2e64100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.475+0000 7f2e6a593640 1 -- 172.21.15.17:0/4161587118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e641033e0 msgr2=0x7f2e64100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.475+0000 7f2e6a593640 1 --2- 172.21.15.17:0/4161587118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e641033e0 0x7f2e64100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.475+0000 7f2e6a593640 1 -- 172.21.15.17:0/4161587118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e641011a0 con 0x7f2e64102ac0 2024-09-20T18:54:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.475+0000 7f2e6a593640 1 --2- 172.21.15.17:0/4161587118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e64102ac0 0x7f2e64100720 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000b420 tx=0x7f2e6000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.476+0000 7f2e5b7fe640 1 -- 172.21.15.17:0/4161587118 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e60011630 con 0x7f2e64102ac0 2024-09-20T18:54:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.476+0000 7f2e5b7fe640 1 -- 172.21.15.17:0/4161587118 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e60016070 con 0x7f2e64102ac0 2024-09-20T18:54:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.476+0000 7f2e6c7f7640 1 -- 172.21.15.17:0/4161587118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e64101490 con 0x7f2e64102ac0 2024-09-20T18:54:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.476+0000 7f2e5b7fe640 1 -- 172.21.15.17:0/4161587118 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e60010d40 con 0x7f2e64102ac0 2024-09-20T18:54:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.476+0000 7f2e6c7f7640 1 -- 172.21.15.17:0/4161587118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e641a3ec0 con 0x7f2e64102ac0 2024-09-20T18:54:51.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.477+0000 7f2e6c7f7640 1 -- 172.21.15.17:0/4161587118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e6406aa90 con 0x7f2e64102ac0 2024-09-20T18:54:51.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.478+0000 7f2e5b7fe640 1 -- 172.21.15.17:0/4161587118 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2e6001b460 con 0x7f2e64102ac0 2024-09-20T18:54:51.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.478+0000 7f2e5b7fe640 1 --2- 172.21.15.17:0/4161587118 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2e5007af30 0x7f2e5007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:51.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.478+0000 7f2e5b7fe640 1 -- 172.21.15.17:0/4161587118 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f2e6009d7b0 con 0x7f2e64102ac0 2024-09-20T18:54:51.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.478+0000 7f2e69d92640 1 --2- 172.21.15.17:0/4161587118 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2e5007af30 0x7f2e5007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:51.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.479+0000 7f2e69d92640 1 --2- 172.21.15.17:0/4161587118 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2e5007af30 0x7f2e5007d3f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2e641021b0 tx=0x7f2e54031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:51.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.483+0000 7f2e5b7fe640 1 -- 172.21.15.17:0/4161587118 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2e60021250 con 0x7f2e64102ac0 2024-09-20T18:54:51.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.689+0000 7f2e6c7f7640 1 -- 172.21.15.17:0/4161587118 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2e64062630 con 0x7f2e5007af30 2024-09-20T18:54:51.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.690+0000 7f2e5b7fe640 1 -- 172.21.15.17:0/4161587118 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f2e64062630 con 0x7f2e5007af30 2024-09-20T18:54:51.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.692+0000 7f2e6c7f7640 1 -- 172.21.15.17:0/4161587118 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2e5007af30 msgr2=0x7f2e5007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:51.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.692+0000 7f2e6c7f7640 1 --2- 172.21.15.17:0/4161587118 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2e5007af30 0x7f2e5007d3f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2e641021b0 tx=0x7f2e54031400 comp rx=0 tx=0).stop 2024-09-20T18:54:51.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.692+0000 7f2e6c7f7640 1 -- 172.21.15.17:0/4161587118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e64102ac0 msgr2=0x7f2e64100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:51.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.692+0000 7f2e6c7f7640 1 --2- 172.21.15.17:0/4161587118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e64102ac0 0x7f2e64100720 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000b420 tx=0x7f2e6000b8e0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.692+0000 7f2e6c7f7640 1 -- 172.21.15.17:0/4161587118 shutdown_connections 2024-09-20T18:54:51.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.693+0000 7f2e6c7f7640 1 --2- 172.21.15.17:0/4161587118 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2e5007af30 0x7f2e5007d3f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.693+0000 7f2e6c7f7640 1 --2- 172.21.15.17:0/4161587118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e641033e0 0x7f2e64100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.693+0000 7f2e6c7f7640 1 --2- 172.21.15.17:0/4161587118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e64102ac0 0x7f2e64100720 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.693+0000 7f2e6c7f7640 1 -- 172.21.15.17:0/4161587118 >> 172.21.15.17:0/4161587118 conn(0x7f2e640fc520 msgr2=0x7f2e64108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:51.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.693+0000 7f2e6c7f7640 1 -- 172.21.15.17:0/4161587118 shutdown_connections 2024-09-20T18:54:51.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.693+0000 7f2e6c7f7640 1 -- 172.21.15.17:0/4161587118 wait complete. 2024-09-20T18:54:51.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.776+0000 7fec6699f640 1 -- 172.21.15.17:0/1797581556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec60102ac0 msgr2=0x7fec60102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:51.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.776+0000 7fec6699f640 1 --2- 172.21.15.17:0/1797581556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec60102ac0 0x7fec60102ea0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fec50009880 tx=0x7fec5002a530 comp rx=0 tx=0).stop 2024-09-20T18:54:51.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.777+0000 7fec6699f640 1 -- 172.21.15.17:0/1797581556 shutdown_connections 2024-09-20T18:54:51.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.777+0000 7fec6699f640 1 --2- 172.21.15.17:0/1797581556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec601033e0 0x7fec6010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.777+0000 7fec6699f640 1 --2- 172.21.15.17:0/1797581556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec60102ac0 0x7fec60102ea0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.777+0000 7fec6699f640 1 -- 172.21.15.17:0/1797581556 >> 172.21.15.17:0/1797581556 conn(0x7fec600fc520 msgr2=0x7fec600fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:51.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.777+0000 7fec6699f640 1 -- 172.21.15.17:0/1797581556 shutdown_connections 2024-09-20T18:54:51.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.777+0000 7fec6699f640 1 -- 172.21.15.17:0/1797581556 wait complete. 2024-09-20T18:54:51.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.777+0000 7fec6699f640 1 Processor -- start 2024-09-20T18:54:51.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.777+0000 7fec6699f640 1 -- start start 2024-09-20T18:54:51.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.778+0000 7fec6699f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec60102ac0 0x7fec60100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:51.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.778+0000 7fec6699f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec601033e0 0x7fec60100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:51.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.778+0000 7fec6699f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fec6010edd0 con 0x7fec60102ac0 2024-09-20T18:54:51.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.778+0000 7fec6699f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fec6010ec50 con 0x7fec601033e0 2024-09-20T18:54:51.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.778+0000 7fec5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec60102ac0 0x7fec60100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:51.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.778+0000 7fec5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec60102ac0 0x7fec60100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55908/0 (socket says 172.21.15.17:55908) 2024-09-20T18:54:51.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.778+0000 7fec5ffff640 1 -- 172.21.15.17:0/1539153792 learned_addr learned my addr 172.21.15.17:0/1539153792 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:54:51.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.778+0000 7fec5f7fe640 1 --2- 172.21.15.17:0/1539153792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec601033e0 0x7fec60100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:51.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.778+0000 7fec5ffff640 1 -- 172.21.15.17:0/1539153792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec601033e0 msgr2=0x7fec60100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:51.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.778+0000 7fec5ffff640 1 --2- 172.21.15.17:0/1539153792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec601033e0 0x7fec60100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:51.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.778+0000 7fec5ffff640 1 -- 172.21.15.17:0/1539153792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec601011a0 con 0x7fec60102ac0 2024-09-20T18:54:51.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.779+0000 7fec5ffff640 1 --2- 172.21.15.17:0/1539153792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec60102ac0 0x7fec60100720 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fec50031460 tx=0x7fec500045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:51.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.779+0000 7fec5d7fa640 1 -- 172.21.15.17:0/1539153792 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec5003f070 con 0x7fec60102ac0 2024-09-20T18:54:51.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.779+0000 7fec5d7fa640 1 -- 172.21.15.17:0/1539153792 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fec500035f0 con 0x7fec60102ac0 2024-09-20T18:54:51.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.779+0000 7fec5d7fa640 1 -- 172.21.15.17:0/1539153792 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec50035030 con 0x7fec60102ac0 2024-09-20T18:54:51.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.779+0000 7fec6699f640 1 -- 172.21.15.17:0/1539153792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec60101430 con 0x7fec60102ac0 2024-09-20T18:54:51.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.779+0000 7fec6699f640 1 -- 172.21.15.17:0/1539153792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec601a3d80 con 0x7fec60102ac0 2024-09-20T18:54:51.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.780+0000 7fec6699f640 1 -- 172.21.15.17:0/1539153792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec6006aa90 con 0x7fec60102ac0 2024-09-20T18:54:51.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.781+0000 7fec5d7fa640 1 -- 172.21.15.17:0/1539153792 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fec50042070 con 0x7fec60102ac0 2024-09-20T18:54:51.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.781+0000 7fec5d7fa640 1 --2- 172.21.15.17:0/1539153792 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec4807af30 0x7fec4807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:51.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.781+0000 7fec5d7fa640 1 -- 172.21.15.17:0/1539153792 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fec500be970 con 0x7fec60102ac0 2024-09-20T18:54:51.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.781+0000 7fec5f7fe640 1 --2- 172.21.15.17:0/1539153792 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec4807af30 0x7fec4807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:51.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.782+0000 7fec5f7fe640 1 --2- 172.21.15.17:0/1539153792 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec4807af30 0x7fec4807d3f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fec601021b0 tx=0x7fec5400b2e0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:51.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.786+0000 7fec5d7fa640 1 -- 172.21.15.17:0/1539153792 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fec500c0e20 con 0x7fec60102ac0 2024-09-20T18:54:51.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.982+0000 7fec6699f640 1 -- 172.21.15.17:0/1539153792 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fec60062630 con 0x7fec4807af30 2024-09-20T18:54:52.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.992+0000 7fec5d7fa640 1 -- 172.21.15.17:0/1539153792 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fec60062630 con 0x7fec4807af30 2024-09-20T18:54:52.009 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:54:52.009 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (16m) 10m ago 27m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:54:52.009 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (19m) 10m ago 27m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:54:52.009 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (18m) 10m ago 26m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:54:52.009 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (14m) 10m ago 27m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:54:52.009 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (14m) 10m ago 26m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:54:52.009 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (15m) 10m ago 27m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:54:52.009 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (10m) 10m ago 21m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:54:52.009 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (10m) 10m ago 21m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:54:52.009 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (21m) 10m ago 21m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:54:52.010 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (10m) 10m ago 21m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:54:52.010 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (18m) 10m ago 28m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:54:52.010 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (17m) 10m ago 26m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:54:52.010 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (15m) 10m ago 28m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:54:52.010 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (14m) 10m ago 26m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:54:52.010 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (17m) 10m ago 27m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:54:52.010 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (16m) 10m ago 26m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:54:52.010 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (14m) 10m ago 25m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:54:52.010 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (13m) 10m ago 24m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:54:52.010 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (12m) 10m ago 24m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:54:52.010 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (12m) 10m ago 23m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:54:52.010 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (11m) 10m ago 23m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:54:52.010 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (11m) 10m ago 22m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:54:52.011 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (16m) 10m ago 26m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:54:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.994+0000 7fec6699f640 1 -- 172.21.15.17:0/1539153792 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec4807af30 msgr2=0x7fec4807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.994+0000 7fec6699f640 1 --2- 172.21.15.17:0/1539153792 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec4807af30 0x7fec4807d3f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fec601021b0 tx=0x7fec5400b2e0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.994+0000 7fec6699f640 1 -- 172.21.15.17:0/1539153792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec60102ac0 msgr2=0x7fec60100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.994+0000 7fec6699f640 1 --2- 172.21.15.17:0/1539153792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec60102ac0 0x7fec60100720 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fec50031460 tx=0x7fec500045e0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.994+0000 7fec6699f640 1 -- 172.21.15.17:0/1539153792 shutdown_connections 2024-09-20T18:54:52.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.994+0000 7fec6699f640 1 --2- 172.21.15.17:0/1539153792 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec4807af30 0x7fec4807d3f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.994+0000 7fec6699f640 1 --2- 172.21.15.17:0/1539153792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec601033e0 0x7fec60100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.994+0000 7fec6699f640 1 --2- 172.21.15.17:0/1539153792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec60102ac0 0x7fec60100720 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.994+0000 7fec6699f640 1 -- 172.21.15.17:0/1539153792 >> 172.21.15.17:0/1539153792 conn(0x7fec600fc520 msgr2=0x7fec60108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:52.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.994+0000 7fec6699f640 1 -- 172.21.15.17:0/1539153792 shutdown_connections 2024-09-20T18:54:52.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:51.994+0000 7fec6699f640 1 -- 172.21.15.17:0/1539153792 wait complete. 2024-09-20T18:54:52.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.079+0000 7f12d857a640 1 -- 172.21.15.17:0/1636004724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12d01007f0 msgr2=0x7f12d0100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:52.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.079+0000 7f12d857a640 1 --2- 172.21.15.17:0/1636004724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12d01007f0 0x7f12d0100c50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f12c0009880 tx=0x7f12c002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.097 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:51 smithi017 ceph-mon[108970]: pgmap v583: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.079+0000 7f12d857a640 1 -- 172.21.15.17:0/1636004724 shutdown_connections 2024-09-20T18:54:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.079+0000 7f12d857a640 1 --2- 172.21.15.17:0/1636004724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12d01007f0 0x7f12d0100c50 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.079+0000 7f12d857a640 1 --2- 172.21.15.17:0/1636004724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12d01067f0 0x7f12d0106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.079+0000 7f12d857a640 1 -- 172.21.15.17:0/1636004724 >> 172.21.15.17:0/1636004724 conn(0x7f12d00fc550 msgr2=0x7f12d00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.079+0000 7f12d857a640 1 -- 172.21.15.17:0/1636004724 shutdown_connections 2024-09-20T18:54:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.080+0000 7f12d857a640 1 -- 172.21.15.17:0/1636004724 wait complete. 2024-09-20T18:54:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.080+0000 7f12d857a640 1 Processor -- start 2024-09-20T18:54:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.080+0000 7f12d857a640 1 -- start start 2024-09-20T18:54:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.080+0000 7f12d857a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12d01007f0 0x7f12d01965e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.080+0000 7f12d857a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12d01067f0 0x7f12d0196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.080+0000 7f12d857a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f12d010dcc0 con 0x7f12d01067f0 2024-09-20T18:54:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.080+0000 7f12d857a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f12d010db40 con 0x7f12d01007f0 2024-09-20T18:54:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.081+0000 7f12d5b15640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12d01067f0 0x7f12d0196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.081+0000 7f12d5b15640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12d01067f0 0x7f12d0196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55930/0 (socket says 172.21.15.17:55930) 2024-09-20T18:54:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.081+0000 7f12d5b15640 1 -- 172.21.15.17:0/2221707533 learned_addr learned my addr 172.21.15.17:0/2221707533 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:54:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.081+0000 7f12d6316640 1 --2- 172.21.15.17:0/2221707533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12d01007f0 0x7f12d01965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:52.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.081+0000 7f12d5b15640 1 -- 172.21.15.17:0/2221707533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12d01007f0 msgr2=0x7f12d01965e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:52.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.081+0000 7f12d5b15640 1 --2- 172.21.15.17:0/2221707533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12d01007f0 0x7f12d01965e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.081+0000 7f12d5b15640 1 -- 172.21.15.17:0/2221707533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d0197060 con 0x7f12d01067f0 2024-09-20T18:54:52.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.081+0000 7f12d6316640 1 --2- 172.21.15.17:0/2221707533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12d01007f0 0x7f12d01965e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:54:52.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.081+0000 7f12d5b15640 1 --2- 172.21.15.17:0/2221707533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12d01067f0 0x7f12d0196b20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f12c0031460 tx=0x7f12c0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:52.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.082+0000 7f12c77fe640 1 -- 172.21.15.17:0/2221707533 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f12c003f070 con 0x7f12d01067f0 2024-09-20T18:54:52.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.082+0000 7f12c77fe640 1 -- 172.21.15.17:0/2221707533 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f12c00035f0 con 0x7f12d01067f0 2024-09-20T18:54:52.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.082+0000 7f12d857a640 1 -- 172.21.15.17:0/2221707533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d01972f0 con 0x7f12d01067f0 2024-09-20T18:54:52.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.082+0000 7f12c77fe640 1 -- 172.21.15.17:0/2221707533 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f12c0035030 con 0x7f12d01067f0 2024-09-20T18:54:52.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.082+0000 7f12d857a640 1 -- 172.21.15.17:0/2221707533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d01a3e20 con 0x7f12d01067f0 2024-09-20T18:54:52.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.083+0000 7f12d857a640 1 -- 172.21.15.17:0/2221707533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12d0101f30 con 0x7f12d01067f0 2024-09-20T18:54:52.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.083+0000 7f12c77fe640 1 -- 172.21.15.17:0/2221707533 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f12c0042070 con 0x7f12d01067f0 2024-09-20T18:54:52.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.084+0000 7f12c77fe640 1 --2- 172.21.15.17:0/2221707533 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f12bc07af80 0x7f12bc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:52.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.084+0000 7f12c77fe640 1 -- 172.21.15.17:0/2221707533 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f12c00be8e0 con 0x7f12d01067f0 2024-09-20T18:54:52.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.084+0000 7f12d6316640 1 --2- 172.21.15.17:0/2221707533 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f12bc07af80 0x7f12bc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:52.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.085+0000 7f12d6316640 1 --2- 172.21.15.17:0/2221707533 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f12bc07af80 0x7f12bc07d440 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009c20 tx=0x7f12cc005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:52.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.089+0000 7f12c77fe640 1 -- 172.21.15.17:0/2221707533 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f12c0089f60 con 0x7f12d01067f0 2024-09-20T18:54:52.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:51 smithi172 ceph-mon[80431]: pgmap v583: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:52.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.355+0000 7f12d857a640 1 -- 172.21.15.17:0/2221707533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f12d0108d60 con 0x7f12d01067f0 2024-09-20T18:54:52.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.355+0000 7f12c77fe640 1 -- 172.21.15.17:0/2221707533 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f12c008ee10 con 0x7f12d01067f0 2024-09-20T18:54:52.372 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:54:52.372 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:54:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:54:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:54:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:54:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:54:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:54:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:54:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:54:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:54:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:54:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:54:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:54:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:54:52.373 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:54:52.374 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:54:52.374 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:54:52.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:54:52.374 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:54:52.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.358+0000 7f12d857a640 1 -- 172.21.15.17:0/2221707533 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f12bc07af80 msgr2=0x7f12bc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:52.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.358+0000 7f12d857a640 1 --2- 172.21.15.17:0/2221707533 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f12bc07af80 0x7f12bc07d440 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009c20 tx=0x7f12cc005f90 comp rx=0 tx=0).stop 2024-09-20T18:54:52.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.358+0000 7f12d857a640 1 -- 172.21.15.17:0/2221707533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12d01067f0 msgr2=0x7f12d0196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:52.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.358+0000 7f12d857a640 1 --2- 172.21.15.17:0/2221707533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12d01067f0 0x7f12d0196b20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f12c0031460 tx=0x7f12c0004530 comp rx=0 tx=0).stop 2024-09-20T18:54:52.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.358+0000 7f12d857a640 1 -- 172.21.15.17:0/2221707533 shutdown_connections 2024-09-20T18:54:52.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.358+0000 7f12d857a640 1 --2- 172.21.15.17:0/2221707533 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f12bc07af80 0x7f12bc07d440 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.358+0000 7f12d857a640 1 --2- 172.21.15.17:0/2221707533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12d01067f0 0x7f12d0196b20 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.358+0000 7f12d857a640 1 --2- 172.21.15.17:0/2221707533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12d01007f0 0x7f12d01965e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.358+0000 7f12d857a640 1 -- 172.21.15.17:0/2221707533 >> 172.21.15.17:0/2221707533 conn(0x7f12d00fc550 msgr2=0x7f12d00fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:52.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.358+0000 7f12d857a640 1 -- 172.21.15.17:0/2221707533 shutdown_connections 2024-09-20T18:54:52.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.358+0000 7f12d857a640 1 -- 172.21.15.17:0/2221707533 wait complete. 2024-09-20T18:54:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.442+0000 7f69352bd640 1 -- 172.21.15.17:0/283172144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6930100c00 msgr2=0x7f6930104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.442+0000 7f69352bd640 1 --2- 172.21.15.17:0/283172144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6930100c00 0x7f6930104c50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f692400a990 tx=0x7f692402b7d0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.442+0000 7f69352bd640 1 -- 172.21.15.17:0/283172144 shutdown_connections 2024-09-20T18:54:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.442+0000 7f69352bd640 1 --2- 172.21.15.17:0/283172144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6930100c00 0x7f6930104c50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.442+0000 7f69352bd640 1 --2- 172.21.15.17:0/283172144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6930100250 0x7f6930100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.442+0000 7f69352bd640 1 -- 172.21.15.17:0/283172144 >> 172.21.15.17:0/283172144 conn(0x7f69300fbc90 msgr2=0x7f69300fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.442+0000 7f69352bd640 1 -- 172.21.15.17:0/283172144 shutdown_connections 2024-09-20T18:54:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.442+0000 7f69352bd640 1 -- 172.21.15.17:0/283172144 wait complete. 2024-09-20T18:54:52.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.442+0000 7f69352bd640 1 Processor -- start 2024-09-20T18:54:52.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.443+0000 7f69352bd640 1 -- start start 2024-09-20T18:54:52.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.443+0000 7f69352bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6930100250 0x7f693019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:52.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.443+0000 7f69352bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6930100c00 0x7f693019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:52.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.443+0000 7f69352bd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f693010cbd0 con 0x7f6930100c00 2024-09-20T18:54:52.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.443+0000 7f69352bd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f693010ca50 con 0x7f6930100250 2024-09-20T18:54:52.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.443+0000 7f692e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6930100c00 0x7f693019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:52.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.443+0000 7f692e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6930100c00 0x7f693019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55948/0 (socket says 172.21.15.17:55948) 2024-09-20T18:54:52.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.443+0000 7f692e7fc640 1 -- 172.21.15.17:0/651397178 learned_addr learned my addr 172.21.15.17:0/651397178 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:54:52.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.443+0000 7f692effd640 1 --2- 172.21.15.17:0/651397178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6930100250 0x7f693019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:52.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.443+0000 7f692e7fc640 1 -- 172.21.15.17:0/651397178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6930100250 msgr2=0x7f693019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.443+0000 7f692e7fc640 1 --2- 172.21.15.17:0/651397178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6930100250 0x7f693019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.443+0000 7f692e7fc640 1 -- 172.21.15.17:0/651397178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6930197810 con 0x7f6930100c00 2024-09-20T18:54:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.444+0000 7f692e7fc640 1 --2- 172.21.15.17:0/651397178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6930100c00 0x7f693019dbd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6924006010 tx=0x7f6924004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.444+0000 7f6917fff640 1 -- 172.21.15.17:0/651397178 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6924042070 con 0x7f6930100c00 2024-09-20T18:54:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.444+0000 7f6917fff640 1 -- 172.21.15.17:0/651397178 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6924004b80 con 0x7f6930100c00 2024-09-20T18:54:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.444+0000 7f69352bd640 1 -- 172.21.15.17:0/651397178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6930197aa0 con 0x7f6930100c00 2024-09-20T18:54:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.444+0000 7f6917fff640 1 -- 172.21.15.17:0/651397178 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69240035f0 con 0x7f6930100c00 2024-09-20T18:54:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.444+0000 7f69352bd640 1 -- 172.21.15.17:0/651397178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6930198030 con 0x7f6930100c00 2024-09-20T18:54:52.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.445+0000 7f69352bd640 1 -- 172.21.15.17:0/651397178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6930101730 con 0x7f6930100c00 2024-09-20T18:54:52.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.446+0000 7f6917fff640 1 -- 172.21.15.17:0/651397178 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6924045070 con 0x7f6930100c00 2024-09-20T18:54:52.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.446+0000 7f6917fff640 1 --2- 172.21.15.17:0/651397178 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f691807af30 0x7f691807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:52.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.446+0000 7f6917fff640 1 -- 172.21.15.17:0/651397178 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f69240befc0 con 0x7f6930100c00 2024-09-20T18:54:52.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.446+0000 7f692effd640 1 --2- 172.21.15.17:0/651397178 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f691807af30 0x7f691807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:52.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.447+0000 7f692effd640 1 --2- 172.21.15.17:0/651397178 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f691807af30 0x7f691807d3f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6920009bd0 tx=0x7f6920005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:52.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.451+0000 7f6917fff640 1 -- 172.21.15.17:0/651397178 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f692408a5c0 con 0x7f6930100c00 2024-09-20T18:54:52.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.680+0000 7f69352bd640 1 -- 172.21.15.17:0/651397178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6930108560 con 0x7f6930100c00 2024-09-20T18:54:52.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.680+0000 7f6917fff640 1 -- 172.21.15.17:0/651397178 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f692408f470 con 0x7f6930100c00 2024-09-20T18:54:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:54:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:54:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:54:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:54:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:54:52.697 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:54:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:54:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:54:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:54:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:54:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:54:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:54:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:54:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:54:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:54:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:54:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:54:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:54:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:54:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:54:52.699 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:54:52.699 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:54:52.699 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:54:52.699 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:54:52.699 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:54:52.699 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:54:52.699 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:54:52.699 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:54:52.699 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:54:52.699 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:54:52.699 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:54:52.699 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:54:52.699 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:54:52.700 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:54:52.700 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:54:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:54:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:54:52.700 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:54:52.700 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:54:52.700 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:54:52.700 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:54:52.700 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:54:52.700 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:54:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:54:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.682+0000 7f69352bd640 1 -- 172.21.15.17:0/651397178 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f691807af30 msgr2=0x7f691807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.682+0000 7f69352bd640 1 --2- 172.21.15.17:0/651397178 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f691807af30 0x7f691807d3f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6920009bd0 tx=0x7f6920005f90 comp rx=0 tx=0).stop 2024-09-20T18:54:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.682+0000 7f69352bd640 1 -- 172.21.15.17:0/651397178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6930100c00 msgr2=0x7f693019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.682+0000 7f69352bd640 1 --2- 172.21.15.17:0/651397178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6930100c00 0x7f693019dbd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6924006010 tx=0x7f6924004270 comp rx=0 tx=0).stop 2024-09-20T18:54:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.682+0000 7f69352bd640 1 -- 172.21.15.17:0/651397178 shutdown_connections 2024-09-20T18:54:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.682+0000 7f69352bd640 1 --2- 172.21.15.17:0/651397178 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f691807af30 0x7f691807d3f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.682+0000 7f69352bd640 1 --2- 172.21.15.17:0/651397178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6930100c00 0x7f693019dbd0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.682+0000 7f69352bd640 1 --2- 172.21.15.17:0/651397178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6930100250 0x7f693019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.682+0000 7f69352bd640 1 -- 172.21.15.17:0/651397178 >> 172.21.15.17:0/651397178 conn(0x7f69300fbc90 msgr2=0x7f69300fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:52.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.682+0000 7f69352bd640 1 -- 172.21.15.17:0/651397178 shutdown_connections 2024-09-20T18:54:52.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.682+0000 7f69352bd640 1 -- 172.21.15.17:0/651397178 wait complete. 2024-09-20T18:54:52.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.768+0000 7f9582060640 1 -- 172.21.15.17:0/709889074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f957c107910 msgr2=0x7f957c107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:52.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.768+0000 7f9582060640 1 --2- 172.21.15.17:0/709889074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f957c107910 0x7f957c107cf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f956c009880 tx=0x7f956c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.768+0000 7f9582060640 1 -- 172.21.15.17:0/709889074 shutdown_connections 2024-09-20T18:54:52.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.768+0000 7f9582060640 1 --2- 172.21.15.17:0/709889074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f957c101910 0x7f957c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.768+0000 7f9582060640 1 --2- 172.21.15.17:0/709889074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f957c107910 0x7f957c107cf0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.768+0000 7f9582060640 1 -- 172.21.15.17:0/709889074 >> 172.21.15.17:0/709889074 conn(0x7f957c0fd630 msgr2=0x7f957c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:52.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.768+0000 7f9582060640 1 -- 172.21.15.17:0/709889074 shutdown_connections 2024-09-20T18:54:52.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.769+0000 7f9582060640 1 -- 172.21.15.17:0/709889074 wait complete. 2024-09-20T18:54:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.769+0000 7f9582060640 1 Processor -- start 2024-09-20T18:54:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.769+0000 7f9582060640 1 -- start start 2024-09-20T18:54:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.770+0000 7f9582060640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f957c101910 0x7f957c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.770+0000 7f9582060640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f957c107910 0x7f957c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.770+0000 7f9582060640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f957c10edc0 con 0x7f957c107910 2024-09-20T18:54:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.770+0000 7f9582060640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f957c10ec40 con 0x7f957c101910 2024-09-20T18:54:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.770+0000 7f9572ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f957c107910 0x7f957c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.770+0000 7f9572ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f957c107910 0x7f957c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55968/0 (socket says 172.21.15.17:55968) 2024-09-20T18:54:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.770+0000 7f9572ffd640 1 -- 172.21.15.17:0/2610669720 learned_addr learned my addr 172.21.15.17:0/2610669720 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:54:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.770+0000 7f957b7fe640 1 --2- 172.21.15.17:0/2610669720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f957c101910 0x7f957c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.770+0000 7f9572ffd640 1 -- 172.21.15.17:0/2610669720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f957c101910 msgr2=0x7f957c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.770+0000 7f9572ffd640 1 --2- 172.21.15.17:0/2610669720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f957c101910 0x7f957c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.770+0000 7f9572ffd640 1 -- 172.21.15.17:0/2610669720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f957c074f70 con 0x7f957c107910 2024-09-20T18:54:52.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.770+0000 7f9572ffd640 1 --2- 172.21.15.17:0/2610669720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f957c107910 0x7f957c074a30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f956400d8d0 tx=0x7f956400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:52.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.770+0000 7f95797fa640 1 -- 172.21.15.17:0/2610669720 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9564017070 con 0x7f957c107910 2024-09-20T18:54:52.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.770+0000 7f95797fa640 1 -- 172.21.15.17:0/2610669720 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9564010460 con 0x7f957c107910 2024-09-20T18:54:52.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.770+0000 7f9582060640 1 -- 172.21.15.17:0/2610669720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f957c075260 con 0x7f957c107910 2024-09-20T18:54:52.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.770+0000 7f95797fa640 1 -- 172.21.15.17:0/2610669720 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f956400f5f0 con 0x7f957c107910 2024-09-20T18:54:52.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.771+0000 7f9582060640 1 -- 172.21.15.17:0/2610669720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f957c1a3df0 con 0x7f957c107910 2024-09-20T18:54:52.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.772+0000 7f9582060640 1 -- 172.21.15.17:0/2610669720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f957c103050 con 0x7f957c107910 2024-09-20T18:54:52.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.772+0000 7f95797fa640 1 -- 172.21.15.17:0/2610669720 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9564009a30 con 0x7f957c107910 2024-09-20T18:54:52.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.773+0000 7f95797fa640 1 --2- 172.21.15.17:0/2610669720 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f956807af90 0x7f956807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:52.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.773+0000 7f957b7fe640 1 --2- 172.21.15.17:0/2610669720 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f956807af90 0x7f956807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:52.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.773+0000 7f95797fa640 1 -- 172.21.15.17:0/2610669720 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f956409dd60 con 0x7f957c107910 2024-09-20T18:54:52.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.774+0000 7f957b7fe640 1 --2- 172.21.15.17:0/2610669720 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f956807af90 0x7f956807d450 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f956c0096c0 tx=0x7f956c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:52.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.778+0000 7f95797fa640 1 -- 172.21.15.17:0/2610669720 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f95640693e0 con 0x7f957c107910 2024-09-20T18:54:53.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.986+0000 7f9582060640 1 -- 172.21.15.17:0/2610669720 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f957c062630 con 0x7f956807af90 2024-09-20T18:54:53.003 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:52 smithi017 ceph-mon[108970]: from='client.34902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:54:53.003 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:52 smithi017 ceph-mon[108970]: from='client.34906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:54:53.003 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:54:53.003 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:52 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2221707533' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:54:53.003 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:52 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/651397178' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:54:53.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.987+0000 7f95797fa640 1 -- 172.21.15.17:0/2610669720 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f957c062630 con 0x7f956807af90 2024-09-20T18:54:53.004 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:54:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:54:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:54:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:54:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:54:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:54:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:54:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:54:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:54:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:54:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:54:53.004 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:54:53.005 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:54:53.005 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:54:53.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.989+0000 7f9582060640 1 -- 172.21.15.17:0/2610669720 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f956807af90 msgr2=0x7f956807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:53.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.989+0000 7f9582060640 1 --2- 172.21.15.17:0/2610669720 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f956807af90 0x7f956807d450 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f956c0096c0 tx=0x7f956c031400 comp rx=0 tx=0).stop 2024-09-20T18:54:53.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.989+0000 7f9582060640 1 -- 172.21.15.17:0/2610669720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f957c107910 msgr2=0x7f957c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:53.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.989+0000 7f9582060640 1 --2- 172.21.15.17:0/2610669720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f957c107910 0x7f957c074a30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f956400d8d0 tx=0x7f956400dd90 comp rx=0 tx=0).stop 2024-09-20T18:54:53.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.989+0000 7f9582060640 1 -- 172.21.15.17:0/2610669720 shutdown_connections 2024-09-20T18:54:53.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.989+0000 7f9582060640 1 --2- 172.21.15.17:0/2610669720 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f956807af90 0x7f956807d450 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:53.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.989+0000 7f9582060640 1 --2- 172.21.15.17:0/2610669720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f957c107910 0x7f957c074a30 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:53.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.989+0000 7f9582060640 1 --2- 172.21.15.17:0/2610669720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f957c101910 0x7f957c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:53.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.989+0000 7f9582060640 1 -- 172.21.15.17:0/2610669720 >> 172.21.15.17:0/2610669720 conn(0x7f957c0fd630 msgr2=0x7f957c0fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:53.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.989+0000 7f9582060640 1 -- 172.21.15.17:0/2610669720 shutdown_connections 2024-09-20T18:54:53.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:52.989+0000 7f9582060640 1 -- 172.21.15.17:0/2610669720 wait complete. 2024-09-20T18:54:53.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.073+0000 7f979c249640 1 -- 172.21.15.17:0/2116219826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9794100650 msgr2=0x7f9794100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:53.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.073+0000 7f979c249640 1 --2- 172.21.15.17:0/2116219826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9794100650 0x7f9794100a30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9790009880 tx=0x7f979002a490 comp rx=0 tx=0).stop 2024-09-20T18:54:53.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.073+0000 7f979c249640 1 -- 172.21.15.17:0/2116219826 shutdown_connections 2024-09-20T18:54:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.073+0000 7f979c249640 1 --2- 172.21.15.17:0/2116219826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9794101000 0x7f979410dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.073+0000 7f979c249640 1 --2- 172.21.15.17:0/2116219826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9794100650 0x7f9794100a30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.073+0000 7f979c249640 1 -- 172.21.15.17:0/2116219826 >> 172.21.15.17:0/2116219826 conn(0x7f97940fc520 msgr2=0x7f97940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.073+0000 7f979c249640 1 -- 172.21.15.17:0/2116219826 shutdown_connections 2024-09-20T18:54:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.073+0000 7f979c249640 1 -- 172.21.15.17:0/2116219826 wait complete. 2024-09-20T18:54:53.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.074+0000 7f979c249640 1 Processor -- start 2024-09-20T18:54:53.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.074+0000 7f979c249640 1 -- start start 2024-09-20T18:54:53.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.074+0000 7f979c249640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9794100650 0x7f979419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:53.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.074+0000 7f979c249640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9794101000 0x7f979419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:53.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.074+0000 7f979c249640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9794110fb0 con 0x7f9794100650 2024-09-20T18:54:53.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.074+0000 7f979c249640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9794110e30 con 0x7f9794101000 2024-09-20T18:54:53.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.075+0000 7f9799fe5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9794100650 0x7f979419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:53.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.075+0000 7f9799fe5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9794100650 0x7f979419f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55996/0 (socket says 172.21.15.17:55996) 2024-09-20T18:54:53.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.075+0000 7f9799fe5640 1 -- 172.21.15.17:0/4089225345 learned_addr learned my addr 172.21.15.17:0/4089225345 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:54:53.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.075+0000 7f97997e4640 1 --2- 172.21.15.17:0/4089225345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9794101000 0x7f979419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:53.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.075+0000 7f9799fe5640 1 -- 172.21.15.17:0/4089225345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9794101000 msgr2=0x7f979419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:53.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.075+0000 7f9799fe5640 1 --2- 172.21.15.17:0/4089225345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9794101000 0x7f979419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:53.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.075+0000 7f9799fe5640 1 -- 172.21.15.17:0/4089225345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9794199a40 con 0x7f9794100650 2024-09-20T18:54:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.075+0000 7f97997e4640 1 --2- 172.21.15.17:0/4089225345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9794101000 0x7f979419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:54:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.075+0000 7f9799fe5640 1 --2- 172.21.15.17:0/4089225345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9794100650 0x7f979419f880 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9790031460 tx=0x7f97900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.075+0000 7f978affd640 1 -- 172.21.15.17:0/4089225345 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f979003f070 con 0x7f9794100650 2024-09-20T18:54:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.075+0000 7f978affd640 1 -- 172.21.15.17:0/4089225345 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9790004cf0 con 0x7f9794100650 2024-09-20T18:54:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.075+0000 7f979c249640 1 -- 172.21.15.17:0/4089225345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9794199cd0 con 0x7f9794100650 2024-09-20T18:54:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.075+0000 7f978affd640 1 -- 172.21.15.17:0/4089225345 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9790035030 con 0x7f9794100650 2024-09-20T18:54:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.075+0000 7f979c249640 1 -- 172.21.15.17:0/4089225345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f979419a260 con 0x7f9794100650 2024-09-20T18:54:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.076+0000 7f979c249640 1 -- 172.21.15.17:0/4089225345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f979406aa90 con 0x7f9794100650 2024-09-20T18:54:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.077+0000 7f978affd640 1 -- 172.21.15.17:0/4089225345 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9790042070 con 0x7f9794100650 2024-09-20T18:54:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.078+0000 7f978affd640 1 --2- 172.21.15.17:0/4089225345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f978007af80 0x7f978007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:54:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.078+0000 7f978affd640 1 -- 172.21.15.17:0/4089225345 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f97900be9e0 con 0x7f9794100650 2024-09-20T18:54:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.078+0000 7f97997e4640 1 --2- 172.21.15.17:0/4089225345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f978007af80 0x7f978007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:54:53.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.078+0000 7f97997e4640 1 --2- 172.21.15.17:0/4089225345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f978007af80 0x7f978007d440 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9794102520 tx=0x7f9784005d30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:54:53.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.082+0000 7f978affd640 1 -- 172.21.15.17:0/4089225345 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f979008a060 con 0x7f9794100650 2024-09-20T18:54:53.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:52 smithi172 ceph-mon[80431]: from='client.34902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:54:53.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:52 smithi172 ceph-mon[80431]: from='client.34906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:54:53.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:54:53.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:52 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2221707533' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:54:53.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:52 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/651397178' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:54:53.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.344+0000 7f979c249640 1 -- 172.21.15.17:0/4089225345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f979419af70 con 0x7f9794100650 2024-09-20T18:54:53.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.345+0000 7f978affd640 1 -- 172.21.15.17:0/4089225345 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f979008ef10 con 0x7f9794100650 2024-09-20T18:54:53.362 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:54:53.362 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:54:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:54:53.362 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:54:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:54:53.362 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:54:53.362 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:54:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.347+0000 7f979c249640 1 -- 172.21.15.17:0/4089225345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f978007af80 msgr2=0x7f978007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.347+0000 7f979c249640 1 --2- 172.21.15.17:0/4089225345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f978007af80 0x7f978007d440 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9794102520 tx=0x7f9784005d30 comp rx=0 tx=0).stop 2024-09-20T18:54:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.347+0000 7f979c249640 1 -- 172.21.15.17:0/4089225345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9794100650 msgr2=0x7f979419f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:54:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.347+0000 7f979c249640 1 --2- 172.21.15.17:0/4089225345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9794100650 0x7f979419f880 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9790031460 tx=0x7f97900048f0 comp rx=0 tx=0).stop 2024-09-20T18:54:53.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.347+0000 7f979c249640 1 -- 172.21.15.17:0/4089225345 shutdown_connections 2024-09-20T18:54:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.347+0000 7f979c249640 1 --2- 172.21.15.17:0/4089225345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f978007af80 0x7f978007d440 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.347+0000 7f979c249640 1 --2- 172.21.15.17:0/4089225345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9794101000 0x7f979419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.347+0000 7f979c249640 1 --2- 172.21.15.17:0/4089225345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9794100650 0x7f979419f880 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:54:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.347+0000 7f979c249640 1 -- 172.21.15.17:0/4089225345 >> 172.21.15.17:0/4089225345 conn(0x7f97940fc520 msgr2=0x7f97940fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:54:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.347+0000 7f979c249640 1 -- 172.21.15.17:0/4089225345 shutdown_connections 2024-09-20T18:54:53.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:54:53.348+0000 7f979c249640 1 -- 172.21.15.17:0/4089225345 wait complete. 2024-09-20T18:54:54.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:53 smithi017 ceph-mon[108970]: from='client.34910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:54:54.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:53 smithi017 ceph-mon[108970]: pgmap v584: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:54.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:53 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4089225345' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:54:54.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:53 smithi172 ceph-mon[80431]: from='client.34910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:54:54.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:53 smithi172 ceph-mon[80431]: pgmap v584: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:54.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:53 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4089225345' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:54:55.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:54 smithi017 ceph-mon[108970]: from='client.34922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:54:55.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:54 smithi172 ceph-mon[80431]: from='client.34922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:54:56.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:55 smithi017 ceph-mon[108970]: pgmap v585: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:56.177 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:55 smithi172 ceph-mon[80431]: pgmap v585: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:58.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:57 smithi017 ceph-mon[108970]: pgmap v586: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:54:58.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:57 smithi172 ceph-mon[80431]: pgmap v586: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:00.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:54:59 smithi017 ceph-mon[108970]: pgmap v587: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:00.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:54:59 smithi172 ceph-mon[80431]: pgmap v587: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:02.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:01 smithi017 ceph-mon[108970]: pgmap v588: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:02.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:01 smithi172 ceph-mon[80431]: pgmap v588: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:04.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:03 smithi017 ceph-mon[108970]: pgmap v589: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:04.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:03 smithi172 ceph-mon[80431]: pgmap v589: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:06.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:05 smithi172 ceph-mon[80431]: pgmap v590: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:06.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:05 smithi017 ceph-mon[108970]: pgmap v590: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:08.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:07 smithi172 ceph-mon[80431]: pgmap v591: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:08.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:55:08.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:07 smithi017 ceph-mon[108970]: pgmap v591: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:08.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:55:09.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:08 smithi172 ceph-mon[80431]: pgmap v592: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:09.401 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:08 smithi017 ceph-mon[108970]: pgmap v592: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:11.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:11 smithi172 ceph-mon[80431]: pgmap v593: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:11.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:11 smithi017 ceph-mon[108970]: pgmap v593: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:13.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:13 smithi017 ceph-mon[108970]: pgmap v594: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:13.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:13 smithi172 ceph-mon[80431]: pgmap v594: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:15.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:15 smithi017 ceph-mon[108970]: pgmap v595: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:15.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:15 smithi172 ceph-mon[80431]: pgmap v595: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:17.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:17 smithi017 ceph-mon[108970]: pgmap v596: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:17.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:17 smithi172 ceph-mon[80431]: pgmap v596: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:19.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:19 smithi017 ceph-mon[108970]: pgmap v597: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:19.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:19 smithi172 ceph-mon[80431]: pgmap v597: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:21.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:21 smithi017 ceph-mon[108970]: pgmap v598: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:21.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:21 smithi172 ceph-mon[80431]: pgmap v598: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:22.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:55:22.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:55:23.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.448+0000 7f0d09f58640 1 -- 172.21.15.17:0/230469538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d041033e0 msgr2=0x7f0d0410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:23.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.448+0000 7f0d09f58640 1 --2- 172.21.15.17:0/230469538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d041033e0 0x7f0d0410b8d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009880 tx=0x7f0cf802a530 comp rx=0 tx=0).stop 2024-09-20T18:55:23.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.448+0000 7f0d09f58640 1 -- 172.21.15.17:0/230469538 shutdown_connections 2024-09-20T18:55:23.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.448+0000 7f0d09f58640 1 --2- 172.21.15.17:0/230469538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d041033e0 0x7f0d0410b8d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:23.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.448+0000 7f0d09f58640 1 --2- 172.21.15.17:0/230469538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d04102ac0 0x7f0d04102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:23.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.448+0000 7f0d09f58640 1 -- 172.21.15.17:0/230469538 >> 172.21.15.17:0/230469538 conn(0x7f0d040fc520 msgr2=0x7f0d040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:23.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.449+0000 7f0d09f58640 1 -- 172.21.15.17:0/230469538 shutdown_connections 2024-09-20T18:55:23.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.449+0000 7f0d09f58640 1 -- 172.21.15.17:0/230469538 wait complete. 2024-09-20T18:55:23.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.449+0000 7f0d09f58640 1 Processor -- start 2024-09-20T18:55:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.449+0000 7f0d09f58640 1 -- start start 2024-09-20T18:55:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.450+0000 7f0d09f58640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d04102ac0 0x7f0d0419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.450+0000 7f0d09f58640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d041033e0 0x7f0d0419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.450+0000 7f0d09f58640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0d04101910 con 0x7f0d04102ac0 2024-09-20T18:55:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.450+0000 7f0d09f58640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0d04101790 con 0x7f0d041033e0 2024-09-20T18:55:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.450+0000 7f0d037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d04102ac0 0x7f0d0419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.450+0000 7f0d037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d04102ac0 0x7f0d0419f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47652/0 (socket says 172.21.15.17:47652) 2024-09-20T18:55:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.450+0000 7f0d037fe640 1 -- 172.21.15.17:0/2683956188 learned_addr learned my addr 172.21.15.17:0/2683956188 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:55:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.450+0000 7f0d02ffd640 1 --2- 172.21.15.17:0/2683956188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d041033e0 0x7f0d0419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.450+0000 7f0d037fe640 1 -- 172.21.15.17:0/2683956188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d041033e0 msgr2=0x7f0d0419fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:23.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.450+0000 7f0d037fe640 1 --2- 172.21.15.17:0/2683956188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d041033e0 0x7f0d0419fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:23.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.450+0000 7f0d037fe640 1 -- 172.21.15.17:0/2683956188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d041999e0 con 0x7f0d04102ac0 2024-09-20T18:55:23.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.450+0000 7f0d037fe640 1 --2- 172.21.15.17:0/2683956188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d04102ac0 0x7f0d0419f820 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400d8d0 tx=0x7f0cf400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:23.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.451+0000 7f0d00ff9640 1 -- 172.21.15.17:0/2683956188 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0cf4017030 con 0x7f0d04102ac0 2024-09-20T18:55:23.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.451+0000 7f0d00ff9640 1 -- 172.21.15.17:0/2683956188 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0cf4004020 con 0x7f0d04102ac0 2024-09-20T18:55:23.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.451+0000 7f0d09f58640 1 -- 172.21.15.17:0/2683956188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d04199cd0 con 0x7f0d04102ac0 2024-09-20T18:55:23.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.451+0000 7f0d00ff9640 1 -- 172.21.15.17:0/2683956188 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0cf40047a0 con 0x7f0d04102ac0 2024-09-20T18:55:23.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.451+0000 7f0d09f58640 1 -- 172.21.15.17:0/2683956188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d0419a230 con 0x7f0d04102ac0 2024-09-20T18:55:23.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.452+0000 7f0d09f58640 1 -- 172.21.15.17:0/2683956188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d0406aa90 con 0x7f0d04102ac0 2024-09-20T18:55:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.453+0000 7f0d00ff9640 1 -- 172.21.15.17:0/2683956188 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0cf40041d0 con 0x7f0d04102ac0 2024-09-20T18:55:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.453+0000 7f0d00ff9640 1 --2- 172.21.15.17:0/2683956188 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0cec07af30 0x7f0cec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.453+0000 7f0d00ff9640 1 -- 172.21.15.17:0/2683956188 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f0cf4018070 con 0x7f0d04102ac0 2024-09-20T18:55:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.453+0000 7f0d02ffd640 1 --2- 172.21.15.17:0/2683956188 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0cec07af30 0x7f0cec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:23.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.454+0000 7f0d02ffd640 1 --2- 172.21.15.17:0/2683956188 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0cec07af30 0x7f0cec07d3f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0d0419b1d0 tx=0x7f0cf8031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:23.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.458+0000 7f0d00ff9640 1 -- 172.21.15.17:0/2683956188 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0cf4069350 con 0x7f0d04102ac0 2024-09-20T18:55:23.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.668+0000 7f0d09f58640 1 -- 172.21.15.17:0/2683956188 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0d0419a540 con 0x7f0cec07af30 2024-09-20T18:55:23.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.669+0000 7f0d00ff9640 1 -- 172.21.15.17:0/2683956188 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f0d0419a540 con 0x7f0cec07af30 2024-09-20T18:55:23.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.672+0000 7f0d09f58640 1 -- 172.21.15.17:0/2683956188 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0cec07af30 msgr2=0x7f0cec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:23.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.672+0000 7f0d09f58640 1 --2- 172.21.15.17:0/2683956188 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0cec07af30 0x7f0cec07d3f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0d0419b1d0 tx=0x7f0cf8031400 comp rx=0 tx=0).stop 2024-09-20T18:55:23.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.672+0000 7f0d09f58640 1 -- 172.21.15.17:0/2683956188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d04102ac0 msgr2=0x7f0d0419f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:23.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.672+0000 7f0d09f58640 1 --2- 172.21.15.17:0/2683956188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d04102ac0 0x7f0d0419f820 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400d8d0 tx=0x7f0cf400dd90 comp rx=0 tx=0).stop 2024-09-20T18:55:23.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.672+0000 7f0d09f58640 1 -- 172.21.15.17:0/2683956188 shutdown_connections 2024-09-20T18:55:23.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.672+0000 7f0d09f58640 1 --2- 172.21.15.17:0/2683956188 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0cec07af30 0x7f0cec07d3f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:23.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.672+0000 7f0d09f58640 1 --2- 172.21.15.17:0/2683956188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d041033e0 0x7f0d0419fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:23.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.672+0000 7f0d09f58640 1 --2- 172.21.15.17:0/2683956188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d04102ac0 0x7f0d0419f820 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:23.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.672+0000 7f0d09f58640 1 -- 172.21.15.17:0/2683956188 >> 172.21.15.17:0/2683956188 conn(0x7f0d040fc520 msgr2=0x7f0d040fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:23.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.672+0000 7f0d09f58640 1 -- 172.21.15.17:0/2683956188 shutdown_connections 2024-09-20T18:55:23.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.672+0000 7f0d09f58640 1 -- 172.21.15.17:0/2683956188 wait complete. 2024-09-20T18:55:23.696 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:55:23.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.757+0000 7f5c6ef9d640 1 -- 172.21.15.17:0/1266509922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c68102ac0 msgr2=0x7f5c68102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:23.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.757+0000 7f5c6ef9d640 1 --2- 172.21.15.17:0/1266509922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c68102ac0 0x7f5c68102ea0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009880 tx=0x7f5c5c02a530 comp rx=0 tx=0).stop 2024-09-20T18:55:23.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.757+0000 7f5c6ef9d640 1 -- 172.21.15.17:0/1266509922 shutdown_connections 2024-09-20T18:55:23.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.757+0000 7f5c6ef9d640 1 --2- 172.21.15.17:0/1266509922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c681033e0 0x7f5c6810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:23.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.757+0000 7f5c6ef9d640 1 --2- 172.21.15.17:0/1266509922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c68102ac0 0x7f5c68102ea0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:23.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.757+0000 7f5c6ef9d640 1 -- 172.21.15.17:0/1266509922 >> 172.21.15.17:0/1266509922 conn(0x7f5c680fc520 msgr2=0x7f5c680fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:23.774 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:23 smithi017 ceph-mon[108970]: pgmap v599: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:23.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.757+0000 7f5c6ef9d640 1 -- 172.21.15.17:0/1266509922 shutdown_connections 2024-09-20T18:55:23.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.757+0000 7f5c6ef9d640 1 -- 172.21.15.17:0/1266509922 wait complete. 2024-09-20T18:55:23.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.758+0000 7f5c6ef9d640 1 Processor -- start 2024-09-20T18:55:23.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.758+0000 7f5c6ef9d640 1 -- start start 2024-09-20T18:55:23.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.758+0000 7f5c6ef9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c68102ac0 0x7f5c6819d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:23.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.758+0000 7f5c6ef9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c681033e0 0x7f5c6819dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:23.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.758+0000 7f5c6ef9d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6810ee50 con 0x7f5c681033e0 2024-09-20T18:55:23.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.758+0000 7f5c6ef9d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6810ecd0 con 0x7f5c68102ac0 2024-09-20T18:55:23.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.759+0000 7f5c67fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c681033e0 0x7f5c6819dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:23.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.759+0000 7f5c67fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c681033e0 0x7f5c6819dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47670/0 (socket says 172.21.15.17:47670) 2024-09-20T18:55:23.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.759+0000 7f5c67fff640 1 -- 172.21.15.17:0/209469625 learned_addr learned my addr 172.21.15.17:0/209469625 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:55:23.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.759+0000 7f5c6cd39640 1 --2- 172.21.15.17:0/209469625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c68102ac0 0x7f5c6819d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:23.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.759+0000 7f5c67fff640 1 -- 172.21.15.17:0/209469625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c68102ac0 msgr2=0x7f5c6819d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:23.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.759+0000 7f5c67fff640 1 --2- 172.21.15.17:0/209469625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c68102ac0 0x7f5c6819d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:23.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.759+0000 7f5c67fff640 1 -- 172.21.15.17:0/209469625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c68197960 con 0x7f5c681033e0 2024-09-20T18:55:23.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.759+0000 7f5c6cd39640 1 --2- 172.21.15.17:0/209469625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c68102ac0 0x7f5c6819d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:55:23.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.759+0000 7f5c67fff640 1 --2- 172.21.15.17:0/209469625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c681033e0 0x7f5c6819dce0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400b370 tx=0x7f5c5400b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:23.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.759+0000 7f5c65ffb640 1 -- 172.21.15.17:0/209469625 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c54015020 con 0x7f5c681033e0 2024-09-20T18:55:23.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.759+0000 7f5c6ef9d640 1 -- 172.21.15.17:0/209469625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c68197c50 con 0x7f5c681033e0 2024-09-20T18:55:23.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.759+0000 7f5c65ffb640 1 -- 172.21.15.17:0/209469625 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c54011af0 con 0x7f5c681033e0 2024-09-20T18:55:23.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.759+0000 7f5c65ffb640 1 -- 172.21.15.17:0/209469625 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c54010d60 con 0x7f5c681033e0 2024-09-20T18:55:23.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.760+0000 7f5c6ef9d640 1 -- 172.21.15.17:0/209469625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c681981e0 con 0x7f5c681033e0 2024-09-20T18:55:23.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.761+0000 7f5c6ef9d640 1 -- 172.21.15.17:0/209469625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c6806aa90 con 0x7f5c681033e0 2024-09-20T18:55:23.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.762+0000 7f5c65ffb640 1 -- 172.21.15.17:0/209469625 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5c54018020 con 0x7f5c681033e0 2024-09-20T18:55:23.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.762+0000 7f5c65ffb640 1 --2- 172.21.15.17:0/209469625 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c5807af30 0x7f5c5807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:23.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.762+0000 7f5c65ffb640 1 -- 172.21.15.17:0/209469625 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f5c5409d940 con 0x7f5c681033e0 2024-09-20T18:55:23.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.762+0000 7f5c6cd39640 1 --2- 172.21.15.17:0/209469625 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c5807af30 0x7f5c5807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:23.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.763+0000 7f5c6cd39640 1 --2- 172.21.15.17:0/209469625 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c5807af30 0x7f5c5807d3f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c000c00 tx=0x7f5c5c031420 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:23.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.767+0000 7f5c65ffb640 1 -- 172.21.15.17:0/209469625 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5c5401f020 con 0x7f5c681033e0 2024-09-20T18:55:23.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:23 smithi172 ceph-mon[80431]: pgmap v599: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:23.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.980+0000 7f5c6ef9d640 1 -- 172.21.15.17:0/209469625 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5c68106000 con 0x7f5c5807af30 2024-09-20T18:55:23.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.981+0000 7f5c65ffb640 1 -- 172.21.15.17:0/209469625 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f5c5c004420 con 0x7f5c5807af30 2024-09-20T18:55:23.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.983+0000 7f5c6ef9d640 1 -- 172.21.15.17:0/209469625 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c5807af30 msgr2=0x7f5c5807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:23.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.983+0000 7f5c6ef9d640 1 --2- 172.21.15.17:0/209469625 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c5807af30 0x7f5c5807d3f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c000c00 tx=0x7f5c5c031420 comp rx=0 tx=0).stop 2024-09-20T18:55:23.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.983+0000 7f5c6ef9d640 1 -- 172.21.15.17:0/209469625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c681033e0 msgr2=0x7f5c6819dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:23.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.983+0000 7f5c6ef9d640 1 --2- 172.21.15.17:0/209469625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c681033e0 0x7f5c6819dce0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400b370 tx=0x7f5c5400b830 comp rx=0 tx=0).stop 2024-09-20T18:55:23.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.983+0000 7f5c6ef9d640 1 -- 172.21.15.17:0/209469625 shutdown_connections 2024-09-20T18:55:23.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.983+0000 7f5c6ef9d640 1 --2- 172.21.15.17:0/209469625 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c5807af30 0x7f5c5807d3f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:23.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.983+0000 7f5c6ef9d640 1 --2- 172.21.15.17:0/209469625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c681033e0 0x7f5c6819dce0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:23.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.983+0000 7f5c6ef9d640 1 --2- 172.21.15.17:0/209469625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c68102ac0 0x7f5c6819d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:23.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.983+0000 7f5c6ef9d640 1 -- 172.21.15.17:0/209469625 >> 172.21.15.17:0/209469625 conn(0x7f5c680fc520 msgr2=0x7f5c68108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:23.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.983+0000 7f5c6ef9d640 1 -- 172.21.15.17:0/209469625 shutdown_connections 2024-09-20T18:55:23.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:23.983+0000 7f5c6ef9d640 1 -- 172.21.15.17:0/209469625 wait complete. 2024-09-20T18:55:24.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.068+0000 7f8862780640 1 -- 172.21.15.17:0/3679837836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c101900 msgr2=0x7f885c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:24.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.068+0000 7f8862780640 1 --2- 172.21.15.17:0/3679837836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c101900 0x7f885c101d60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8850009880 tx=0x7f885002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.068+0000 7f8862780640 1 -- 172.21.15.17:0/3679837836 shutdown_connections 2024-09-20T18:55:24.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.068+0000 7f8862780640 1 --2- 172.21.15.17:0/3679837836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c101900 0x7f885c101d60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.068+0000 7f8862780640 1 --2- 172.21.15.17:0/3679837836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f885c107900 0x7f885c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.068+0000 7f8862780640 1 -- 172.21.15.17:0/3679837836 >> 172.21.15.17:0/3679837836 conn(0x7f885c0fd600 msgr2=0x7f885c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:24.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.069+0000 7f8862780640 1 -- 172.21.15.17:0/3679837836 shutdown_connections 2024-09-20T18:55:24.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.069+0000 7f8862780640 1 -- 172.21.15.17:0/3679837836 wait complete. 2024-09-20T18:55:24.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.069+0000 7f8862780640 1 Processor -- start 2024-09-20T18:55:24.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.069+0000 7f8862780640 1 -- start start 2024-09-20T18:55:24.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.070+0000 7f8862780640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c101900 0x7f885c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:24.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.070+0000 7f8862780640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f885c107900 0x7f885c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:24.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.070+0000 7f8862780640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f885c10edd0 con 0x7f885c101900 2024-09-20T18:55:24.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.070+0000 7f8862780640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f885c10ec50 con 0x7f885c107900 2024-09-20T18:55:24.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.070+0000 7f885bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c101900 0x7f885c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:24.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.070+0000 7f885bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c101900 0x7f885c19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47680/0 (socket says 172.21.15.17:47680) 2024-09-20T18:55:24.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.070+0000 7f885bfff640 1 -- 172.21.15.17:0/825912117 learned_addr learned my addr 172.21.15.17:0/825912117 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:55:24.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.070+0000 7f885b7fe640 1 --2- 172.21.15.17:0/825912117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f885c107900 0x7f885c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:24.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.070+0000 7f885bfff640 1 -- 172.21.15.17:0/825912117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f885c107900 msgr2=0x7f885c19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:24.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.070+0000 7f885bfff640 1 --2- 172.21.15.17:0/825912117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f885c107900 0x7f885c19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.070+0000 7f885bfff640 1 -- 172.21.15.17:0/825912117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885c197800 con 0x7f885c101900 2024-09-20T18:55:24.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.070+0000 7f885bfff640 1 --2- 172.21.15.17:0/825912117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c101900 0x7f885c19d680 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f884c00e970 tx=0x7f884c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:24.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.071+0000 7f88597fa640 1 -- 172.21.15.17:0/825912117 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f884c00cac0 con 0x7f885c101900 2024-09-20T18:55:24.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.071+0000 7f88597fa640 1 -- 172.21.15.17:0/825912117 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f884c0054e0 con 0x7f885c101900 2024-09-20T18:55:24.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.071+0000 7f8862780640 1 -- 172.21.15.17:0/825912117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885c197af0 con 0x7f885c101900 2024-09-20T18:55:24.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.071+0000 7f88597fa640 1 -- 172.21.15.17:0/825912117 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f884c010430 con 0x7f885c101900 2024-09-20T18:55:24.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.071+0000 7f8862780640 1 -- 172.21.15.17:0/825912117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885c198050 con 0x7f885c101900 2024-09-20T18:55:24.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.072+0000 7f8862780640 1 -- 172.21.15.17:0/825912117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f885c103040 con 0x7f885c101900 2024-09-20T18:55:24.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.073+0000 7f88597fa640 1 -- 172.21.15.17:0/825912117 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f884c004ea0 con 0x7f885c101900 2024-09-20T18:55:24.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.073+0000 7f88597fa640 1 --2- 172.21.15.17:0/825912117 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f884407af30 0x7f884407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:24.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.073+0000 7f88597fa640 1 -- 172.21.15.17:0/825912117 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f884c09e8e0 con 0x7f885c101900 2024-09-20T18:55:24.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.074+0000 7f885b7fe640 1 --2- 172.21.15.17:0/825912117 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f884407af30 0x7f884407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:24.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.074+0000 7f885b7fe640 1 --2- 172.21.15.17:0/825912117 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f884407af30 0x7f884407d3f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f885c198b50 tx=0x7f8850031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:24.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.077+0000 7f88597fa640 1 -- 172.21.15.17:0/825912117 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f884c069ec0 con 0x7f885c101900 2024-09-20T18:55:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.273+0000 7f8862780640 1 -- 172.21.15.17:0/825912117 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f885c1983c0 con 0x7f884407af30 2024-09-20T18:55:24.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.283+0000 7f88597fa640 1 -- 172.21.15.17:0/825912117 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f885c1983c0 con 0x7f884407af30 2024-09-20T18:55:24.298 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:55:24.299 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (16m) 10m ago 27m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:55:24.299 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (19m) 10m ago 27m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:55:24.299 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (19m) 10m ago 27m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:55:24.299 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (15m) 10m ago 27m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:55:24.299 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (15m) 10m ago 27m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:55:24.299 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (16m) 10m ago 27m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:55:24.299 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (11m) 10m ago 22m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:55:24.299 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (11m) 10m ago 22m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:55:24.299 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (22m) 10m ago 22m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:55:24.299 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (10m) 10m ago 22m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:55:24.299 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (18m) 10m ago 29m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:55:24.299 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (17m) 10m ago 26m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:55:24.299 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (15m) 10m ago 29m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:55:24.300 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (15m) 10m ago 26m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:55:24.300 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (17m) 10m ago 27m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:55:24.300 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (17m) 10m ago 26m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:55:24.300 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (14m) 10m ago 25m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:55:24.300 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (14m) 10m ago 25m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:55:24.300 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (13m) 10m ago 24m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:55:24.300 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (12m) 10m ago 24m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:55:24.300 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (12m) 10m ago 23m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:55:24.300 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (11m) 10m ago 23m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:55:24.300 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (17m) 10m ago 27m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:55:24.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.285+0000 7f8862780640 1 -- 172.21.15.17:0/825912117 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f884407af30 msgr2=0x7f884407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:24.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.285+0000 7f8862780640 1 --2- 172.21.15.17:0/825912117 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f884407af30 0x7f884407d3f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f885c198b50 tx=0x7f8850031400 comp rx=0 tx=0).stop 2024-09-20T18:55:24.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.285+0000 7f8862780640 1 -- 172.21.15.17:0/825912117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c101900 msgr2=0x7f885c19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:24.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.285+0000 7f8862780640 1 --2- 172.21.15.17:0/825912117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c101900 0x7f885c19d680 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f884c00e970 tx=0x7f884c00ed70 comp rx=0 tx=0).stop 2024-09-20T18:55:24.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.286+0000 7f8862780640 1 -- 172.21.15.17:0/825912117 shutdown_connections 2024-09-20T18:55:24.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.286+0000 7f8862780640 1 --2- 172.21.15.17:0/825912117 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f884407af30 0x7f884407d3f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.286+0000 7f8862780640 1 --2- 172.21.15.17:0/825912117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f885c107900 0x7f885c19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.286+0000 7f8862780640 1 --2- 172.21.15.17:0/825912117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c101900 0x7f885c19d680 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.286+0000 7f8862780640 1 -- 172.21.15.17:0/825912117 >> 172.21.15.17:0/825912117 conn(0x7f885c0fd600 msgr2=0x7f885c0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:24.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.286+0000 7f8862780640 1 -- 172.21.15.17:0/825912117 shutdown_connections 2024-09-20T18:55:24.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.286+0000 7f8862780640 1 -- 172.21.15.17:0/825912117 wait complete. 2024-09-20T18:55:24.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.368+0000 7f1487b05640 1 -- 172.21.15.17:0/581754477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14801033e0 msgr2=0x7f148010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:24.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.368+0000 7f1487b05640 1 --2- 172.21.15.17:0/581754477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14801033e0 0x7f148010b8d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f147c009880 tx=0x7f147c02a530 comp rx=0 tx=0).stop 2024-09-20T18:55:24.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.368+0000 7f1487b05640 1 -- 172.21.15.17:0/581754477 shutdown_connections 2024-09-20T18:55:24.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.368+0000 7f1487b05640 1 --2- 172.21.15.17:0/581754477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14801033e0 0x7f148010b8d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.368+0000 7f1487b05640 1 --2- 172.21.15.17:0/581754477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1480102ac0 0x7f1480102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.368+0000 7f1487b05640 1 -- 172.21.15.17:0/581754477 >> 172.21.15.17:0/581754477 conn(0x7f14800fc520 msgr2=0x7f14800fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:24.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.368+0000 7f1487b05640 1 -- 172.21.15.17:0/581754477 shutdown_connections 2024-09-20T18:55:24.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.368+0000 7f1487b05640 1 -- 172.21.15.17:0/581754477 wait complete. 2024-09-20T18:55:24.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.369+0000 7f1487b05640 1 Processor -- start 2024-09-20T18:55:24.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.369+0000 7f1487b05640 1 -- start start 2024-09-20T18:55:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.370+0000 7f1487b05640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1480102ac0 0x7f1480100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.370+0000 7f1487b05640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14801033e0 0x7f1480100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.370+0000 7f1487b05640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f148010edf0 con 0x7f1480102ac0 2024-09-20T18:55:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.370+0000 7f1487b05640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f148010ec70 con 0x7f14801033e0 2024-09-20T18:55:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.370+0000 7f14858a1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1480102ac0 0x7f1480100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.370+0000 7f14858a1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1480102ac0 0x7f1480100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47696/0 (socket says 172.21.15.17:47696) 2024-09-20T18:55:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.370+0000 7f14858a1640 1 -- 172.21.15.17:0/3217695255 learned_addr learned my addr 172.21.15.17:0/3217695255 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:55:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.370+0000 7f14850a0640 1 --2- 172.21.15.17:0/3217695255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14801033e0 0x7f1480100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.370+0000 7f14858a1640 1 -- 172.21.15.17:0/3217695255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14801033e0 msgr2=0x7f1480100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.370+0000 7f14858a1640 1 --2- 172.21.15.17:0/3217695255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14801033e0 0x7f1480100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.370+0000 7f14858a1640 1 -- 172.21.15.17:0/3217695255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14801011a0 con 0x7f1480102ac0 2024-09-20T18:55:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.370+0000 7f14858a1640 1 --2- 172.21.15.17:0/3217695255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1480102ac0 0x7f1480100720 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f147000d6f0 tx=0x7f147000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.370+0000 7f1476ffd640 1 -- 172.21.15.17:0/3217695255 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1470017070 con 0x7f1480102ac0 2024-09-20T18:55:24.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.371+0000 7f1487b05640 1 -- 172.21.15.17:0/3217695255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1480101490 con 0x7f1480102ac0 2024-09-20T18:55:24.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.371+0000 7f1476ffd640 1 -- 172.21.15.17:0/3217695255 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f147000de00 con 0x7f1480102ac0 2024-09-20T18:55:24.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.371+0000 7f1476ffd640 1 -- 172.21.15.17:0/3217695255 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1470004bb0 con 0x7f1480102ac0 2024-09-20T18:55:24.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.371+0000 7f1487b05640 1 -- 172.21.15.17:0/3217695255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14801a3e80 con 0x7f1480102ac0 2024-09-20T18:55:24.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.372+0000 7f1487b05640 1 -- 172.21.15.17:0/3217695255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f148006aa90 con 0x7f1480102ac0 2024-09-20T18:55:24.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.372+0000 7f1476ffd640 1 -- 172.21.15.17:0/3217695255 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1470004e60 con 0x7f1480102ac0 2024-09-20T18:55:24.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.373+0000 7f1476ffd640 1 --2- 172.21.15.17:0/3217695255 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f146c07af30 0x7f146c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:24.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.373+0000 7f1476ffd640 1 -- 172.21.15.17:0/3217695255 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f147009dba0 con 0x7f1480102ac0 2024-09-20T18:55:24.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.373+0000 7f14850a0640 1 --2- 172.21.15.17:0/3217695255 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f146c07af30 0x7f146c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:24.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.374+0000 7f14850a0640 1 --2- 172.21.15.17:0/3217695255 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f146c07af30 0x7f146c07d3f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f14801021b0 tx=0x7f147c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:24.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.377+0000 7f1476ffd640 1 -- 172.21.15.17:0/3217695255 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f14700691a0 con 0x7f1480102ac0 2024-09-20T18:55:24.650 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:24 smithi017 ceph-mon[108970]: from='client.34930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:55:24.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.641+0000 7f1487b05640 1 -- 172.21.15.17:0/3217695255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1480105f60 con 0x7f1480102ac0 2024-09-20T18:55:24.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.641+0000 7f1476ffd640 1 -- 172.21.15.17:0/3217695255 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f147006e050 con 0x7f1480102ac0 2024-09-20T18:55:24.656 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:55:24.656 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:55:24.657 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:55:24.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:55:24.657 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:55:24.657 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:55:24.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:55:24.657 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:55:24.657 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:55:24.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:55:24.657 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:55:24.657 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:55:24.657 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:55:24.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:55:24.657 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:55:24.657 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:55:24.658 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:55:24.658 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:55:24.658 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:55:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.644+0000 7f1487b05640 1 -- 172.21.15.17:0/3217695255 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f146c07af30 msgr2=0x7f146c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.644+0000 7f1487b05640 1 --2- 172.21.15.17:0/3217695255 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f146c07af30 0x7f146c07d3f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f14801021b0 tx=0x7f147c031400 comp rx=0 tx=0).stop 2024-09-20T18:55:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.644+0000 7f1487b05640 1 -- 172.21.15.17:0/3217695255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1480102ac0 msgr2=0x7f1480100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.644+0000 7f1487b05640 1 --2- 172.21.15.17:0/3217695255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1480102ac0 0x7f1480100720 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f147000d6f0 tx=0x7f147000dbb0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.644+0000 7f1487b05640 1 -- 172.21.15.17:0/3217695255 shutdown_connections 2024-09-20T18:55:24.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.644+0000 7f1487b05640 1 --2- 172.21.15.17:0/3217695255 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f146c07af30 0x7f146c07d3f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.644+0000 7f1487b05640 1 --2- 172.21.15.17:0/3217695255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14801033e0 0x7f1480100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.644+0000 7f1487b05640 1 --2- 172.21.15.17:0/3217695255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1480102ac0 0x7f1480100720 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.644+0000 7f1487b05640 1 -- 172.21.15.17:0/3217695255 >> 172.21.15.17:0/3217695255 conn(0x7f14800fc520 msgr2=0x7f1480108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:24.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.644+0000 7f1487b05640 1 -- 172.21.15.17:0/3217695255 shutdown_connections 2024-09-20T18:55:24.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.644+0000 7f1487b05640 1 -- 172.21.15.17:0/3217695255 wait complete. 2024-09-20T18:55:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.728+0000 7f18a3ce1640 1 -- 172.21.15.17:0/4127018354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f189c107900 msgr2=0x7f189c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.728+0000 7f18a3ce1640 1 --2- 172.21.15.17:0/4127018354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f189c107900 0x7f189c107ce0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1898009880 tx=0x7f189802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.728+0000 7f18a3ce1640 1 -- 172.21.15.17:0/4127018354 shutdown_connections 2024-09-20T18:55:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.728+0000 7f18a3ce1640 1 --2- 172.21.15.17:0/4127018354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f189c101900 0x7f189c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.728+0000 7f18a3ce1640 1 --2- 172.21.15.17:0/4127018354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f189c107900 0x7f189c107ce0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.728+0000 7f18a3ce1640 1 -- 172.21.15.17:0/4127018354 >> 172.21.15.17:0/4127018354 conn(0x7f189c0fd600 msgr2=0x7f189c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.728+0000 7f18a3ce1640 1 -- 172.21.15.17:0/4127018354 shutdown_connections 2024-09-20T18:55:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.728+0000 7f18a3ce1640 1 -- 172.21.15.17:0/4127018354 wait complete. 2024-09-20T18:55:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.729+0000 7f18a3ce1640 1 Processor -- start 2024-09-20T18:55:24.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.729+0000 7f18a3ce1640 1 -- start start 2024-09-20T18:55:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.729+0000 7f18a3ce1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f189c101900 0x7f189c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.729+0000 7f18a3ce1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f189c107900 0x7f189c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.729+0000 7f18a3ce1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f189c10edd0 con 0x7f189c107900 2024-09-20T18:55:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.729+0000 7f18a3ce1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f189c10ec50 con 0x7f189c101900 2024-09-20T18:55:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.729+0000 7f18a127c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f189c107900 0x7f189c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.729+0000 7f18a127c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f189c107900 0x7f189c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47708/0 (socket says 172.21.15.17:47708) 2024-09-20T18:55:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.729+0000 7f18a127c640 1 -- 172.21.15.17:0/3891604874 learned_addr learned my addr 172.21.15.17:0/3891604874 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:55:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.729+0000 7f18a1a7d640 1 --2- 172.21.15.17:0/3891604874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f189c101900 0x7f189c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.730+0000 7f18a127c640 1 -- 172.21.15.17:0/3891604874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f189c101900 msgr2=0x7f189c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.730+0000 7f18a127c640 1 --2- 172.21.15.17:0/3891604874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f189c101900 0x7f189c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.730+0000 7f18a127c640 1 -- 172.21.15.17:0/3891604874 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f189c074f70 con 0x7f189c107900 2024-09-20T18:55:24.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.730+0000 7f18a127c640 1 --2- 172.21.15.17:0/3891604874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f189c107900 0x7f189c074a30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f188c00d6f0 tx=0x7f188c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.730+0000 7f1892ffd640 1 -- 172.21.15.17:0/3891604874 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f188c017070 con 0x7f189c107900 2024-09-20T18:55:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.730+0000 7f1892ffd640 1 -- 172.21.15.17:0/3891604874 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f188c00de00 con 0x7f189c107900 2024-09-20T18:55:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.730+0000 7f18a3ce1640 1 -- 172.21.15.17:0/3891604874 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f189c075260 con 0x7f189c107900 2024-09-20T18:55:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.730+0000 7f1892ffd640 1 -- 172.21.15.17:0/3891604874 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f188c004bb0 con 0x7f189c107900 2024-09-20T18:55:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.730+0000 7f18a3ce1640 1 -- 172.21.15.17:0/3891604874 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f189c1a3e20 con 0x7f189c107900 2024-09-20T18:55:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.731+0000 7f18a3ce1640 1 -- 172.21.15.17:0/3891604874 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f189c103040 con 0x7f189c107900 2024-09-20T18:55:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.732+0000 7f1892ffd640 1 -- 172.21.15.17:0/3891604874 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f188c009a30 con 0x7f189c107900 2024-09-20T18:55:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.733+0000 7f1892ffd640 1 --2- 172.21.15.17:0/3891604874 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f188807af80 0x7f188807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.733+0000 7f1892ffd640 1 -- 172.21.15.17:0/3891604874 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f188c09db70 con 0x7f189c107900 2024-09-20T18:55:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.733+0000 7f18a1a7d640 1 --2- 172.21.15.17:0/3891604874 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f188807af80 0x7f188807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:24.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.733+0000 7f18a1a7d640 1 --2- 172.21.15.17:0/3891604874 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f188807af80 0x7f188807d440 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f18980096c0 tx=0x7f1898031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:24.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.737+0000 7f1892ffd640 1 -- 172.21.15.17:0/3891604874 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f188c069150 con 0x7f189c107900 2024-09-20T18:55:24.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:24 smithi172 ceph-mon[80431]: from='client.34930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:55:24.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.967+0000 7f18a3ce1640 1 -- 172.21.15.17:0/3891604874 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f189c075a50 con 0x7f189c107900 2024-09-20T18:55:24.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.967+0000 7f1892ffd640 1 -- 172.21.15.17:0/3891604874 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f189c075a50 con 0x7f189c107900 2024-09-20T18:55:24.982 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:55:24.982 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:55:24.982 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:55:24.982 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:55:24.982 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:55:24.983 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:55:24.983 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:55:24.983 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:55:24.983 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:55:24.983 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:55:24.983 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:55:24.983 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:55:24.983 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:55:24.983 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:55:24.983 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:55:24.983 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:55:24.983 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:55:24.983 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:55:24.983 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:55:24.984 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:55:24.984 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:55:24.984 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:55:24.984 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:55:24.984 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:55:24.984 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:55:24.984 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:55:24.984 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:55:24.984 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:55:24.984 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:55:24.984 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:55:24.984 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:55:24.984 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:55:24.984 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:55:24.984 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:55:24.985 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:55:24.985 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:55:24.985 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:55:24.985 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:55:24.985 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:55:24.985 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:55:24.985 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:55:24.985 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:55:24.985 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:55:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:55:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.970+0000 7f18a3ce1640 1 -- 172.21.15.17:0/3891604874 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f188807af80 msgr2=0x7f188807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.970+0000 7f18a3ce1640 1 --2- 172.21.15.17:0/3891604874 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f188807af80 0x7f188807d440 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f18980096c0 tx=0x7f1898031400 comp rx=0 tx=0).stop 2024-09-20T18:55:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.970+0000 7f18a3ce1640 1 -- 172.21.15.17:0/3891604874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f189c107900 msgr2=0x7f189c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.970+0000 7f18a3ce1640 1 --2- 172.21.15.17:0/3891604874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f189c107900 0x7f189c074a30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f188c00d6f0 tx=0x7f188c00dbb0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.970+0000 7f18a3ce1640 1 -- 172.21.15.17:0/3891604874 shutdown_connections 2024-09-20T18:55:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.970+0000 7f18a3ce1640 1 --2- 172.21.15.17:0/3891604874 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f188807af80 0x7f188807d440 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.970+0000 7f18a3ce1640 1 --2- 172.21.15.17:0/3891604874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f189c107900 0x7f189c074a30 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.970+0000 7f18a3ce1640 1 --2- 172.21.15.17:0/3891604874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f189c101900 0x7f189c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.970+0000 7f18a3ce1640 1 -- 172.21.15.17:0/3891604874 >> 172.21.15.17:0/3891604874 conn(0x7f189c0fd600 msgr2=0x7f189c0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:24.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.970+0000 7f18a3ce1640 1 -- 172.21.15.17:0/3891604874 shutdown_connections 2024-09-20T18:55:24.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:24.970+0000 7f18a3ce1640 1 -- 172.21.15.17:0/3891604874 wait complete. 2024-09-20T18:55:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.057+0000 7f670717a640 1 -- 172.21.15.17:0/323527272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6700102ac0 msgr2=0x7f6700102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.057+0000 7f670717a640 1 --2- 172.21.15.17:0/323527272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6700102ac0 0x7f6700102ea0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009880 tx=0x7f66f402a530 comp rx=0 tx=0).stop 2024-09-20T18:55:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.057+0000 7f670717a640 1 -- 172.21.15.17:0/323527272 shutdown_connections 2024-09-20T18:55:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.057+0000 7f670717a640 1 --2- 172.21.15.17:0/323527272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67001033e0 0x7f670010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.057+0000 7f670717a640 1 --2- 172.21.15.17:0/323527272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6700102ac0 0x7f6700102ea0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.057+0000 7f670717a640 1 -- 172.21.15.17:0/323527272 >> 172.21.15.17:0/323527272 conn(0x7f67000fc520 msgr2=0x7f67000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.057+0000 7f670717a640 1 -- 172.21.15.17:0/323527272 shutdown_connections 2024-09-20T18:55:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.057+0000 7f670717a640 1 -- 172.21.15.17:0/323527272 wait complete. 2024-09-20T18:55:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.058+0000 7f670717a640 1 Processor -- start 2024-09-20T18:55:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.058+0000 7f670717a640 1 -- start start 2024-09-20T18:55:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.058+0000 7f670717a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6700102ac0 0x7f670019f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.058+0000 7f670717a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67001033e0 0x7f670019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.058+0000 7f670717a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f670010edf0 con 0x7f6700102ac0 2024-09-20T18:55:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.058+0000 7f670717a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f670010ec70 con 0x7f67001033e0 2024-09-20T18:55:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.058+0000 7f6704f16640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6700102ac0 0x7f670019f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.058+0000 7f6704f16640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6700102ac0 0x7f670019f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47740/0 (socket says 172.21.15.17:47740) 2024-09-20T18:55:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.058+0000 7f6704f16640 1 -- 172.21.15.17:0/1713675315 learned_addr learned my addr 172.21.15.17:0/1713675315 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:55:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.059+0000 7f66fffff640 1 --2- 172.21.15.17:0/1713675315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67001033e0 0x7f670019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.059+0000 7f6704f16640 1 -- 172.21.15.17:0/1713675315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67001033e0 msgr2=0x7f670019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.059+0000 7f6704f16640 1 --2- 172.21.15.17:0/1713675315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67001033e0 0x7f670019fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.059+0000 7f6704f16640 1 -- 172.21.15.17:0/1713675315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6700199a10 con 0x7f6700102ac0 2024-09-20T18:55:25.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.059+0000 7f6704f16640 1 --2- 172.21.15.17:0/1713675315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6700102ac0 0x7f670019f800 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f66f4031460 tx=0x7f66f40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:25.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.059+0000 7f66fdffb640 1 -- 172.21.15.17:0/1713675315 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66f403f070 con 0x7f6700102ac0 2024-09-20T18:55:25.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.059+0000 7f66fdffb640 1 -- 172.21.15.17:0/1713675315 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f66f4004cf0 con 0x7f6700102ac0 2024-09-20T18:55:25.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.059+0000 7f670717a640 1 -- 172.21.15.17:0/1713675315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6700199ca0 con 0x7f6700102ac0 2024-09-20T18:55:25.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.059+0000 7f66fdffb640 1 -- 172.21.15.17:0/1713675315 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66f4035030 con 0x7f6700102ac0 2024-09-20T18:55:25.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.059+0000 7f670717a640 1 -- 172.21.15.17:0/1713675315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f670019a1d0 con 0x7f6700102ac0 2024-09-20T18:55:25.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.060+0000 7f670717a640 1 -- 172.21.15.17:0/1713675315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f670006aa90 con 0x7f6700102ac0 2024-09-20T18:55:25.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.061+0000 7f66fdffb640 1 -- 172.21.15.17:0/1713675315 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f66f4042070 con 0x7f6700102ac0 2024-09-20T18:55:25.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.062+0000 7f66fdffb640 1 --2- 172.21.15.17:0/1713675315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66f007af80 0x7f66f007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:25.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.062+0000 7f66fdffb640 1 -- 172.21.15.17:0/1713675315 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f66f40be9e0 con 0x7f6700102ac0 2024-09-20T18:55:25.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.062+0000 7f66fffff640 1 --2- 172.21.15.17:0/1713675315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66f007af80 0x7f66f007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:25.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.062+0000 7f66fffff640 1 --2- 172.21.15.17:0/1713675315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66f007af80 0x7f66f007d440 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f66ec005fd0 tx=0x7f66ec005d00 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:25.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.066+0000 7f66fdffb640 1 -- 172.21.15.17:0/1713675315 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f66f408a060 con 0x7f6700102ac0 2024-09-20T18:55:25.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.270+0000 7f670717a640 1 -- 172.21.15.17:0/1713675315 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f670019aef0 con 0x7f66f007af80 2024-09-20T18:55:25.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.271+0000 7f66fdffb640 1 -- 172.21.15.17:0/1713675315 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f670019aef0 con 0x7f66f007af80 2024-09-20T18:55:25.286 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:55:25.286 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:55:25.287 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:55:25.287 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:55:25.287 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:55:25.287 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:55:25.287 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:55:25.287 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:55:25.287 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:55:25.287 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:55:25.287 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:55:25.287 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:55:25.287 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:55:25.287 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:55:25.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.274+0000 7f670717a640 1 -- 172.21.15.17:0/1713675315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66f007af80 msgr2=0x7f66f007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:25.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.274+0000 7f670717a640 1 --2- 172.21.15.17:0/1713675315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66f007af80 0x7f66f007d440 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f66ec005fd0 tx=0x7f66ec005d00 comp rx=0 tx=0).stop 2024-09-20T18:55:25.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.274+0000 7f670717a640 1 -- 172.21.15.17:0/1713675315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6700102ac0 msgr2=0x7f670019f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:25.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.274+0000 7f670717a640 1 --2- 172.21.15.17:0/1713675315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6700102ac0 0x7f670019f800 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f66f4031460 tx=0x7f66f40048f0 comp rx=0 tx=0).stop 2024-09-20T18:55:25.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.274+0000 7f670717a640 1 -- 172.21.15.17:0/1713675315 shutdown_connections 2024-09-20T18:55:25.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.274+0000 7f670717a640 1 --2- 172.21.15.17:0/1713675315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66f007af80 0x7f66f007d440 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:25.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.274+0000 7f670717a640 1 --2- 172.21.15.17:0/1713675315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67001033e0 0x7f670019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:25.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.274+0000 7f670717a640 1 --2- 172.21.15.17:0/1713675315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6700102ac0 0x7f670019f800 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:25.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.274+0000 7f670717a640 1 -- 172.21.15.17:0/1713675315 >> 172.21.15.17:0/1713675315 conn(0x7f67000fc520 msgr2=0x7f6700100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:25.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.274+0000 7f670717a640 1 -- 172.21.15.17:0/1713675315 shutdown_connections 2024-09-20T18:55:25.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.274+0000 7f670717a640 1 -- 172.21.15.17:0/1713675315 wait complete. 2024-09-20T18:55:25.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.358+0000 7f69407d5640 1 -- 172.21.15.17:0/2255728608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6938102b50 msgr2=0x7f6938102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:25.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.358+0000 7f69407d5640 1 --2- 172.21.15.17:0/2255728608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6938102b50 0x7f6938102f30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6934009880 tx=0x7f693402a530 comp rx=0 tx=0).stop 2024-09-20T18:55:25.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.359+0000 7f69407d5640 1 -- 172.21.15.17:0/2255728608 shutdown_connections 2024-09-20T18:55:25.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.359+0000 7f69407d5640 1 --2- 172.21.15.17:0/2255728608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6938103470 0x7f693810b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:25.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.359+0000 7f69407d5640 1 --2- 172.21.15.17:0/2255728608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6938102b50 0x7f6938102f30 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:25.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.359+0000 7f69407d5640 1 -- 172.21.15.17:0/2255728608 >> 172.21.15.17:0/2255728608 conn(0x7f69380fc550 msgr2=0x7f69380fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:25.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.359+0000 7f69407d5640 1 -- 172.21.15.17:0/2255728608 shutdown_connections 2024-09-20T18:55:25.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.359+0000 7f69407d5640 1 -- 172.21.15.17:0/2255728608 wait complete. 2024-09-20T18:55:25.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.359+0000 7f69407d5640 1 Processor -- start 2024-09-20T18:55:25.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.359+0000 7f69407d5640 1 -- start start 2024-09-20T18:55:25.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.359+0000 7f69407d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6938102b50 0x7f693819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:25.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.360+0000 7f69407d5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6938103470 0x7f693819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:25.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.360+0000 7f69407d5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f693810ee40 con 0x7f6938103470 2024-09-20T18:55:25.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.360+0000 7f69407d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f693810ecc0 con 0x7f6938102b50 2024-09-20T18:55:25.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.360+0000 7f693dd70640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6938103470 0x7f693819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:25.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.360+0000 7f693dd70640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6938103470 0x7f693819dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47768/0 (socket says 172.21.15.17:47768) 2024-09-20T18:55:25.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.360+0000 7f693dd70640 1 -- 172.21.15.17:0/2263274464 learned_addr learned my addr 172.21.15.17:0/2263274464 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:55:25.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.360+0000 7f693e571640 1 --2- 172.21.15.17:0/2263274464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6938102b50 0x7f693819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:25.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.360+0000 7f693dd70640 1 -- 172.21.15.17:0/2263274464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6938102b50 msgr2=0x7f693819d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:25.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.360+0000 7f693dd70640 1 --2- 172.21.15.17:0/2263274464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6938102b50 0x7f693819d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:25.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.360+0000 7f693dd70640 1 -- 172.21.15.17:0/2263274464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6938197830 con 0x7f6938103470 2024-09-20T18:55:25.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.360+0000 7f693dd70640 1 --2- 172.21.15.17:0/2263274464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6938103470 0x7f693819dbf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f692800b420 tx=0x7f692800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:25.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.360+0000 7f692f7fe640 1 -- 172.21.15.17:0/2263274464 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6928011630 con 0x7f6938103470 2024-09-20T18:55:25.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.360+0000 7f692f7fe640 1 -- 172.21.15.17:0/2263274464 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6928016070 con 0x7f6938103470 2024-09-20T18:55:25.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.360+0000 7f692f7fe640 1 -- 172.21.15.17:0/2263274464 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6928010d40 con 0x7f6938103470 2024-09-20T18:55:25.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.360+0000 7f69407d5640 1 -- 172.21.15.17:0/2263274464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6938197b20 con 0x7f6938103470 2024-09-20T18:55:25.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.360+0000 7f69407d5640 1 -- 172.21.15.17:0/2263274464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69381980b0 con 0x7f6938103470 2024-09-20T18:55:25.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.361+0000 7f69407d5640 1 -- 172.21.15.17:0/2263274464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f693806a4e0 con 0x7f6938103470 2024-09-20T18:55:25.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.362+0000 7f692f7fe640 1 -- 172.21.15.17:0/2263274464 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f692801b460 con 0x7f6938103470 2024-09-20T18:55:25.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.363+0000 7f692f7fe640 1 --2- 172.21.15.17:0/2263274464 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f692407af30 0x7f692407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:25.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.363+0000 7f692f7fe640 1 -- 172.21.15.17:0/2263274464 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f692809d7b0 con 0x7f6938103470 2024-09-20T18:55:25.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.363+0000 7f693e571640 1 --2- 172.21.15.17:0/2263274464 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f692407af30 0x7f692407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:25.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.363+0000 7f693e571640 1 --2- 172.21.15.17:0/2263274464 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f692407af30 0x7f692407d3f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f69340096c0 tx=0x7f6934004f30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:25.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.367+0000 7f692f7fe640 1 -- 172.21.15.17:0/2263274464 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6928021250 con 0x7f6938103470 2024-09-20T18:55:25.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.631+0000 7f69407d5640 1 -- 172.21.15.17:0/2263274464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6938105fb0 con 0x7f6938103470 2024-09-20T18:55:25.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.631+0000 7f692f7fe640 1 -- 172.21.15.17:0/2263274464 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f6928068db0 con 0x7f6938103470 2024-09-20T18:55:25.646 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:55:25.646 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:55:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:55:25.647 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:55:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:55:25.647 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:55:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:55:25.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.633+0000 7f69407d5640 1 -- 172.21.15.17:0/2263274464 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f692407af30 msgr2=0x7f692407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:25.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.633+0000 7f69407d5640 1 --2- 172.21.15.17:0/2263274464 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f692407af30 0x7f692407d3f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f69340096c0 tx=0x7f6934004f30 comp rx=0 tx=0).stop 2024-09-20T18:55:25.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.633+0000 7f69407d5640 1 -- 172.21.15.17:0/2263274464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6938103470 msgr2=0x7f693819dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:25.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.633+0000 7f69407d5640 1 --2- 172.21.15.17:0/2263274464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6938103470 0x7f693819dbf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f692800b420 tx=0x7f692800b8e0 comp rx=0 tx=0).stop 2024-09-20T18:55:25.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.633+0000 7f69407d5640 1 -- 172.21.15.17:0/2263274464 shutdown_connections 2024-09-20T18:55:25.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.633+0000 7f69407d5640 1 --2- 172.21.15.17:0/2263274464 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f692407af30 0x7f692407d3f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:25.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.633+0000 7f69407d5640 1 --2- 172.21.15.17:0/2263274464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6938103470 0x7f693819dbf0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:25.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.633+0000 7f69407d5640 1 --2- 172.21.15.17:0/2263274464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6938102b50 0x7f693819d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:25.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.633+0000 7f69407d5640 1 -- 172.21.15.17:0/2263274464 >> 172.21.15.17:0/2263274464 conn(0x7f69380fc550 msgr2=0x7f6938108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:25.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.634+0000 7f69407d5640 1 -- 172.21.15.17:0/2263274464 shutdown_connections 2024-09-20T18:55:25.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:25.634+0000 7f69407d5640 1 -- 172.21.15.17:0/2263274464 wait complete. 2024-09-20T18:55:25.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:25 smithi017 ceph-mon[108970]: from='client.34934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:55:25.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:25 smithi017 ceph-mon[108970]: from='client.34938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:55:25.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:25 smithi017 ceph-mon[108970]: pgmap v600: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:25.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:25 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3217695255' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:55:25.901 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:25 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3891604874' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:55:25.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:25 smithi172 ceph-mon[80431]: from='client.34934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:55:25.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:25 smithi172 ceph-mon[80431]: from='client.34938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:55:25.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:25 smithi172 ceph-mon[80431]: pgmap v600: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:25.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:25 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3217695255' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:55:25.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:25 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3891604874' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:55:26.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:26 smithi017 ceph-mon[108970]: from='client.34950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:55:26.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:26 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2263274464' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:55:26.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:26 smithi172 ceph-mon[80431]: from='client.34950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:55:26.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:26 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2263274464' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:55:27.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:27 smithi017 ceph-mon[108970]: pgmap v601: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:27.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:27 smithi172 ceph-mon[80431]: pgmap v601: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:29.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:29 smithi017 ceph-mon[108970]: pgmap v602: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:29.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:29 smithi172 ceph-mon[80431]: pgmap v602: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:31.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:31 smithi017 ceph-mon[108970]: pgmap v603: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:31.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:31 smithi172 ceph-mon[80431]: pgmap v603: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:33.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:33 smithi017 ceph-mon[108970]: pgmap v604: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:33.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:33 smithi172 ceph-mon[80431]: pgmap v604: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:35.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:35 smithi017 ceph-mon[108970]: pgmap v605: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:35.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:35 smithi172 ceph-mon[80431]: pgmap v605: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:37.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:37 smithi017 ceph-mon[108970]: pgmap v606: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:37.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:55:37.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:37 smithi172 ceph-mon[80431]: pgmap v606: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:37.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:55:39.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:39 smithi172 ceph-mon[80431]: pgmap v607: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:40.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:39 smithi017 ceph-mon[108970]: pgmap v607: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:41.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:41 smithi172 ceph-mon[80431]: pgmap v608: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:41.965 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:41 smithi017 ceph-mon[108970]: pgmap v608: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:43.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:43 smithi017 ceph-mon[108970]: pgmap v609: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:43.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:43 smithi172 ceph-mon[80431]: pgmap v609: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:45.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:45 smithi172 ceph-mon[80431]: pgmap v610: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:46.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:45 smithi017 ceph-mon[108970]: pgmap v610: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:47.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:47 smithi172 ceph-mon[80431]: pgmap v611: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:48.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:47 smithi017 ceph-mon[108970]: pgmap v611: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:49.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:49 smithi017 ceph-mon[108970]: pgmap v612: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:49.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:49 smithi172 ceph-mon[80431]: pgmap v612: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:51.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:51 smithi172 ceph-mon[80431]: pgmap v613: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:51.964 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:51 smithi017 ceph-mon[108970]: pgmap v613: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:52.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:55:52.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:55:53.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:53 smithi172 ceph-mon[80431]: pgmap v614: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:54.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:53 smithi017 ceph-mon[108970]: pgmap v614: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.730+0000 7fdd4e251640 1 -- 172.21.15.17:0/3374293552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd48106800 msgr2=0x7fdd48106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.730+0000 7fdd4e251640 1 --2- 172.21.15.17:0/3374293552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd48106800 0x7fdd48106be0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdd38009880 tx=0x7fdd3802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:55:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.730+0000 7fdd4e251640 1 -- 172.21.15.17:0/3374293552 shutdown_connections 2024-09-20T18:55:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.730+0000 7fdd4e251640 1 --2- 172.21.15.17:0/3374293552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48100800 0x7fdd48100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.730+0000 7fdd4e251640 1 --2- 172.21.15.17:0/3374293552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd48106800 0x7fdd48106be0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.730+0000 7fdd4e251640 1 -- 172.21.15.17:0/3374293552 >> 172.21.15.17:0/3374293552 conn(0x7fdd480fc520 msgr2=0x7fdd480fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.730+0000 7fdd4e251640 1 -- 172.21.15.17:0/3374293552 shutdown_connections 2024-09-20T18:55:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.730+0000 7fdd4e251640 1 -- 172.21.15.17:0/3374293552 wait complete. 2024-09-20T18:55:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.731+0000 7fdd4e251640 1 Processor -- start 2024-09-20T18:55:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.731+0000 7fdd4e251640 1 -- start start 2024-09-20T18:55:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.732+0000 7fdd4e251640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd48100800 0x7fdd4819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.732+0000 7fdd4e251640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48106800 0x7fdd4819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.732+0000 7fdd4e251640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4810dcb0 con 0x7fdd48100800 2024-09-20T18:55:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.732+0000 7fdd4e251640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4810db30 con 0x7fdd48106800 2024-09-20T18:55:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.732+0000 7fdd477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd48100800 0x7fdd4819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.732+0000 7fdd477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd48100800 0x7fdd4819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50124/0 (socket says 172.21.15.17:50124) 2024-09-20T18:55:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.732+0000 7fdd477fe640 1 -- 172.21.15.17:0/2588798569 learned_addr learned my addr 172.21.15.17:0/2588798569 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:55:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.732+0000 7fdd46ffd640 1 --2- 172.21.15.17:0/2588798569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48106800 0x7fdd4819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.732+0000 7fdd477fe640 1 -- 172.21.15.17:0/2588798569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48106800 msgr2=0x7fdd4819dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.732+0000 7fdd477fe640 1 --2- 172.21.15.17:0/2588798569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48106800 0x7fdd4819dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.732+0000 7fdd477fe640 1 -- 172.21.15.17:0/2588798569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd48197820 con 0x7fdd48100800 2024-09-20T18:55:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.732+0000 7fdd477fe640 1 --2- 172.21.15.17:0/2588798569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd48100800 0x7fdd4819d6a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fdd38031460 tx=0x7fdd380045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:55.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.733+0000 7fdd44ff9640 1 -- 172.21.15.17:0/2588798569 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdd3803f070 con 0x7fdd48100800 2024-09-20T18:55:55.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.733+0000 7fdd44ff9640 1 -- 172.21.15.17:0/2588798569 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdd380035f0 con 0x7fdd48100800 2024-09-20T18:55:55.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.733+0000 7fdd4e251640 1 -- 172.21.15.17:0/2588798569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd48197ab0 con 0x7fdd48100800 2024-09-20T18:55:55.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.733+0000 7fdd44ff9640 1 -- 172.21.15.17:0/2588798569 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdd38035030 con 0x7fdd48100800 2024-09-20T18:55:55.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.733+0000 7fdd4e251640 1 -- 172.21.15.17:0/2588798569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd48197fe0 con 0x7fdd48100800 2024-09-20T18:55:55.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.734+0000 7fdd4e251640 1 -- 172.21.15.17:0/2588798569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd48101f40 con 0x7fdd48100800 2024-09-20T18:55:55.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.735+0000 7fdd44ff9640 1 -- 172.21.15.17:0/2588798569 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdd38042070 con 0x7fdd48100800 2024-09-20T18:55:55.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.735+0000 7fdd44ff9640 1 --2- 172.21.15.17:0/2588798569 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdd3007af30 0x7fdd3007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:55.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.735+0000 7fdd44ff9640 1 -- 172.21.15.17:0/2588798569 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fdd380bea20 con 0x7fdd48100800 2024-09-20T18:55:55.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.735+0000 7fdd46ffd640 1 --2- 172.21.15.17:0/2588798569 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdd3007af30 0x7fdd3007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:55.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.736+0000 7fdd46ffd640 1 --2- 172.21.15.17:0/2588798569 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdd3007af30 0x7fdd3007d3f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c005fd0 tx=0x7fdd3c005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:55.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.740+0000 7fdd44ff9640 1 -- 172.21.15.17:0/2588798569 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdd3808a020 con 0x7fdd48100800 2024-09-20T18:55:55.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:55 smithi017 ceph-mon[108970]: pgmap v615: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:55.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:55 smithi172 ceph-mon[80431]: pgmap v615: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:55.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.947+0000 7fdd4e251640 1 -- 172.21.15.17:0/2588798569 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fdd48198d50 con 0x7fdd3007af30 2024-09-20T18:55:55.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.948+0000 7fdd44ff9640 1 -- 172.21.15.17:0/2588798569 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fdd48198d50 con 0x7fdd3007af30 2024-09-20T18:55:55.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.950+0000 7fdd4e251640 1 -- 172.21.15.17:0/2588798569 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdd3007af30 msgr2=0x7fdd3007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:55.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.950+0000 7fdd4e251640 1 --2- 172.21.15.17:0/2588798569 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdd3007af30 0x7fdd3007d3f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c005fd0 tx=0x7fdd3c005850 comp rx=0 tx=0).stop 2024-09-20T18:55:55.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.950+0000 7fdd4e251640 1 -- 172.21.15.17:0/2588798569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd48100800 msgr2=0x7fdd4819d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:55.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.950+0000 7fdd4e251640 1 --2- 172.21.15.17:0/2588798569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd48100800 0x7fdd4819d6a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fdd38031460 tx=0x7fdd380045e0 comp rx=0 tx=0).stop 2024-09-20T18:55:55.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.950+0000 7fdd4e251640 1 -- 172.21.15.17:0/2588798569 shutdown_connections 2024-09-20T18:55:55.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.950+0000 7fdd4e251640 1 --2- 172.21.15.17:0/2588798569 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdd3007af30 0x7fdd3007d3f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:55.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.950+0000 7fdd4e251640 1 --2- 172.21.15.17:0/2588798569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48106800 0x7fdd4819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:55.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.950+0000 7fdd4e251640 1 --2- 172.21.15.17:0/2588798569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd48100800 0x7fdd4819d6a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:55.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.950+0000 7fdd4e251640 1 -- 172.21.15.17:0/2588798569 >> 172.21.15.17:0/2588798569 conn(0x7fdd480fc520 msgr2=0x7fdd4806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:55.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.950+0000 7fdd4e251640 1 -- 172.21.15.17:0/2588798569 shutdown_connections 2024-09-20T18:55:55.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:55.950+0000 7fdd4e251640 1 -- 172.21.15.17:0/2588798569 wait complete. 2024-09-20T18:55:55.973 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:55:56.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.036+0000 7f5c399e3640 1 -- 172.21.15.17:0/1729762801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c34102ac0 msgr2=0x7f5c34102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:56.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.036+0000 7f5c399e3640 1 --2- 172.21.15.17:0/1729762801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c34102ac0 0x7f5c34102ea0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5c24009880 tx=0x7f5c2402a530 comp rx=0 tx=0).stop 2024-09-20T18:55:56.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.036+0000 7f5c399e3640 1 -- 172.21.15.17:0/1729762801 shutdown_connections 2024-09-20T18:55:56.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.036+0000 7f5c399e3640 1 --2- 172.21.15.17:0/1729762801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c341033e0 0x7f5c3410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.036+0000 7f5c399e3640 1 --2- 172.21.15.17:0/1729762801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c34102ac0 0x7f5c34102ea0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.036+0000 7f5c399e3640 1 -- 172.21.15.17:0/1729762801 >> 172.21.15.17:0/1729762801 conn(0x7f5c340fc520 msgr2=0x7f5c340fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:56.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.036+0000 7f5c399e3640 1 -- 172.21.15.17:0/1729762801 shutdown_connections 2024-09-20T18:55:56.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.036+0000 7f5c399e3640 1 -- 172.21.15.17:0/1729762801 wait complete. 2024-09-20T18:55:56.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.037+0000 7f5c399e3640 1 Processor -- start 2024-09-20T18:55:56.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.037+0000 7f5c399e3640 1 -- start start 2024-09-20T18:55:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.037+0000 7f5c399e3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c34102ac0 0x7f5c34100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.037+0000 7f5c399e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c341033e0 0x7f5c34100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.037+0000 7f5c399e3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3410ee50 con 0x7f5c341033e0 2024-09-20T18:55:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.037+0000 7f5c399e3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3410ecd0 con 0x7f5c34102ac0 2024-09-20T18:55:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.037+0000 7f5c327fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c341033e0 0x7f5c34100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.038+0000 7f5c327fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c341033e0 0x7f5c34100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50146/0 (socket says 172.21.15.17:50146) 2024-09-20T18:55:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.038+0000 7f5c327fc640 1 -- 172.21.15.17:0/3849496588 learned_addr learned my addr 172.21.15.17:0/3849496588 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:55:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.038+0000 7f5c32ffd640 1 --2- 172.21.15.17:0/3849496588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c34102ac0 0x7f5c34100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.038+0000 7f5c327fc640 1 -- 172.21.15.17:0/3849496588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c34102ac0 msgr2=0x7f5c34100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.038+0000 7f5c327fc640 1 --2- 172.21.15.17:0/3849496588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c34102ac0 0x7f5c34100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.038+0000 7f5c327fc640 1 -- 172.21.15.17:0/3849496588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c341024a0 con 0x7f5c341033e0 2024-09-20T18:55:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.038+0000 7f5c327fc640 1 --2- 172.21.15.17:0/3849496588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c341033e0 0x7f5c34100c60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00b370 tx=0x7f5c1c00b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.038+0000 7f5c389e1640 1 -- 172.21.15.17:0/3849496588 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c1c015020 con 0x7f5c341033e0 2024-09-20T18:55:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.038+0000 7f5c389e1640 1 -- 172.21.15.17:0/3849496588 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c1c011af0 con 0x7f5c341033e0 2024-09-20T18:55:56.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.038+0000 7f5c399e3640 1 -- 172.21.15.17:0/3849496588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c341011a0 con 0x7f5c341033e0 2024-09-20T18:55:56.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.038+0000 7f5c389e1640 1 -- 172.21.15.17:0/3849496588 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c1c010d60 con 0x7f5c341033e0 2024-09-20T18:55:56.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.038+0000 7f5c399e3640 1 -- 172.21.15.17:0/3849496588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c341a84d0 con 0x7f5c341033e0 2024-09-20T18:55:56.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.039+0000 7f5c399e3640 1 -- 172.21.15.17:0/3849496588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c3406aa90 con 0x7f5c341033e0 2024-09-20T18:55:56.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.040+0000 7f5c389e1640 1 -- 172.21.15.17:0/3849496588 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5c1c018020 con 0x7f5c341033e0 2024-09-20T18:55:56.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.041+0000 7f5c389e1640 1 --2- 172.21.15.17:0/3849496588 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c2007af90 0x7f5c2007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:56.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.041+0000 7f5c32ffd640 1 --2- 172.21.15.17:0/3849496588 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c2007af90 0x7f5c2007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:56.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.041+0000 7f5c389e1640 1 -- 172.21.15.17:0/3849496588 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f5c1c09d8c0 con 0x7f5c341033e0 2024-09-20T18:55:56.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.042+0000 7f5c32ffd640 1 --2- 172.21.15.17:0/3849496588 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c2007af90 0x7f5c2007d450 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5c240096c0 tx=0x7f5c24031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:56.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.046+0000 7f5c389e1640 1 -- 172.21.15.17:0/3849496588 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5c1c01f020 con 0x7f5c341033e0 2024-09-20T18:55:56.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.251+0000 7f5c399e3640 1 -- 172.21.15.17:0/3849496588 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5c34062630 con 0x7f5c2007af90 2024-09-20T18:55:56.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.252+0000 7f5c389e1640 1 -- 172.21.15.17:0/3849496588 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f5c34062630 con 0x7f5c2007af90 2024-09-20T18:55:56.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.254+0000 7f5c399e3640 1 -- 172.21.15.17:0/3849496588 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c2007af90 msgr2=0x7f5c2007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:56.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.254+0000 7f5c399e3640 1 --2- 172.21.15.17:0/3849496588 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c2007af90 0x7f5c2007d450 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5c240096c0 tx=0x7f5c24031400 comp rx=0 tx=0).stop 2024-09-20T18:55:56.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.254+0000 7f5c399e3640 1 -- 172.21.15.17:0/3849496588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c341033e0 msgr2=0x7f5c34100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:56.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.254+0000 7f5c399e3640 1 --2- 172.21.15.17:0/3849496588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c341033e0 0x7f5c34100c60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00b370 tx=0x7f5c1c00b830 comp rx=0 tx=0).stop 2024-09-20T18:55:56.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.254+0000 7f5c399e3640 1 -- 172.21.15.17:0/3849496588 shutdown_connections 2024-09-20T18:55:56.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.254+0000 7f5c399e3640 1 --2- 172.21.15.17:0/3849496588 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5c2007af90 0x7f5c2007d450 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.254+0000 7f5c399e3640 1 --2- 172.21.15.17:0/3849496588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c341033e0 0x7f5c34100c60 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.254+0000 7f5c399e3640 1 --2- 172.21.15.17:0/3849496588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c34102ac0 0x7f5c34100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.254+0000 7f5c399e3640 1 -- 172.21.15.17:0/3849496588 >> 172.21.15.17:0/3849496588 conn(0x7f5c340fc520 msgr2=0x7f5c34108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:56.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.254+0000 7f5c399e3640 1 -- 172.21.15.17:0/3849496588 shutdown_connections 2024-09-20T18:55:56.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.254+0000 7f5c399e3640 1 -- 172.21.15.17:0/3849496588 wait complete. 2024-09-20T18:55:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.338+0000 7fded318d640 1 -- 172.21.15.17:0/3319923524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdecc102b10 msgr2=0x7fdecc102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.338+0000 7fded318d640 1 --2- 172.21.15.17:0/3319923524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdecc102b10 0x7fdecc102ef0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdec00098b0 tx=0x7fdec002a560 comp rx=0 tx=0).stop 2024-09-20T18:55:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.339+0000 7fded318d640 1 -- 172.21.15.17:0/3319923524 shutdown_connections 2024-09-20T18:55:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.339+0000 7fded318d640 1 --2- 172.21.15.17:0/3319923524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdecc103430 0x7fdecc10b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.339+0000 7fded318d640 1 --2- 172.21.15.17:0/3319923524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdecc102b10 0x7fdecc102ef0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.339+0000 7fded318d640 1 -- 172.21.15.17:0/3319923524 >> 172.21.15.17:0/3319923524 conn(0x7fdecc0fc550 msgr2=0x7fdecc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.339+0000 7fded318d640 1 -- 172.21.15.17:0/3319923524 shutdown_connections 2024-09-20T18:55:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.339+0000 7fded318d640 1 -- 172.21.15.17:0/3319923524 wait complete. 2024-09-20T18:55:56.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.339+0000 7fded318d640 1 Processor -- start 2024-09-20T18:55:56.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.339+0000 7fded318d640 1 -- start start 2024-09-20T18:55:56.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.339+0000 7fded318d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdecc102b10 0x7fdecc19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:56.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.339+0000 7fded318d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdecc103430 0x7fdecc19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:56.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.339+0000 7fded318d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc10edc0 con 0x7fdecc102b10 2024-09-20T18:55:56.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.339+0000 7fded318d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc10ec40 con 0x7fdecc103430 2024-09-20T18:55:56.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.340+0000 7fded0f29640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdecc102b10 0x7fdecc19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:56.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.340+0000 7fded0f29640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdecc102b10 0x7fdecc19d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50164/0 (socket says 172.21.15.17:50164) 2024-09-20T18:55:56.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.340+0000 7fded0f29640 1 -- 172.21.15.17:0/985344763 learned_addr learned my addr 172.21.15.17:0/985344763 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:55:56.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.340+0000 7fdecbfff640 1 --2- 172.21.15.17:0/985344763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdecc103430 0x7fdecc19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:56.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.340+0000 7fded0f29640 1 -- 172.21.15.17:0/985344763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdecc103430 msgr2=0x7fdecc19db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:56.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.340+0000 7fded0f29640 1 --2- 172.21.15.17:0/985344763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdecc103430 0x7fdecc19db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.340+0000 7fded0f29640 1 -- 172.21.15.17:0/985344763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdecc1977d0 con 0x7fdecc102b10 2024-09-20T18:55:56.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.340+0000 7fdecbfff640 1 --2- 172.21.15.17:0/985344763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdecc103430 0x7fdecc19db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:55:56.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.340+0000 7fded0f29640 1 --2- 172.21.15.17:0/985344763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdecc102b10 0x7fdecc19d650 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdec0031460 tx=0x7fdec00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:56.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.340+0000 7fdec9ffb640 1 -- 172.21.15.17:0/985344763 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdec003f070 con 0x7fdecc102b10 2024-09-20T18:55:56.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.340+0000 7fdec9ffb640 1 -- 172.21.15.17:0/985344763 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdec00044d0 con 0x7fdecc102b10 2024-09-20T18:55:56.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.340+0000 7fded318d640 1 -- 172.21.15.17:0/985344763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdecc197a60 con 0x7fdecc102b10 2024-09-20T18:55:56.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.340+0000 7fdec9ffb640 1 -- 172.21.15.17:0/985344763 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdec0035030 con 0x7fdecc102b10 2024-09-20T18:55:56.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.341+0000 7fded318d640 1 -- 172.21.15.17:0/985344763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdecc197f90 con 0x7fdecc102b10 2024-09-20T18:55:56.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.342+0000 7fded318d640 1 -- 172.21.15.17:0/985344763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdecc06a520 con 0x7fdecc102b10 2024-09-20T18:55:56.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.342+0000 7fdec9ffb640 1 -- 172.21.15.17:0/985344763 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdec0042070 con 0x7fdecc102b10 2024-09-20T18:55:56.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.343+0000 7fdec9ffb640 1 --2- 172.21.15.17:0/985344763 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdebc07af80 0x7fdebc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:56.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.343+0000 7fdec9ffb640 1 -- 172.21.15.17:0/985344763 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fdec00be990 con 0x7fdecc102b10 2024-09-20T18:55:56.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.343+0000 7fdecbfff640 1 --2- 172.21.15.17:0/985344763 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdebc07af80 0x7fdebc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:56.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.343+0000 7fdecbfff640 1 --2- 172.21.15.17:0/985344763 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdebc07af80 0x7fdebc07d440 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdecc108970 tx=0x7fdeb8005ec0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:56.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.347+0000 7fdec9ffb640 1 -- 172.21.15.17:0/985344763 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdec0004cf0 con 0x7fdecc102b10 2024-09-20T18:55:56.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.545+0000 7fded318d640 1 -- 172.21.15.17:0/985344763 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fdecc198240 con 0x7fdebc07af80 2024-09-20T18:55:56.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.555+0000 7fdec9ffb640 1 -- 172.21.15.17:0/985344763 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fdecc198240 con 0x7fdebc07af80 2024-09-20T18:55:56.569 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:55:56.569 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (17m) 11m ago 28m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:55:56.569 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (20m) 11m ago 28m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:55:56.570 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (19m) 11m ago 27m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:55:56.570 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (15m) 11m ago 28m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:55:56.570 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (15m) 11m ago 27m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:55:56.570 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (16m) 11m ago 28m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:55:56.570 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (11m) 11m ago 23m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:55:56.570 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (11m) 11m ago 22m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:55:56.570 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (22m) 11m ago 22m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:55:56.570 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (11m) 11m ago 23m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:55:56.570 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (19m) 11m ago 29m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:55:56.570 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (18m) 11m ago 27m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:55:56.570 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (16m) 11m ago 29m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:55:56.570 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (15m) 11m ago 27m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:55:56.570 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (18m) 11m ago 28m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:55:56.571 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (18m) 11m ago 27m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:55:56.571 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (15m) 11m ago 26m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:55:56.571 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (14m) 11m ago 25m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:55:56.571 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (13m) 11m ago 25m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:55:56.571 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (13m) 11m ago 24m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:55:56.571 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (12m) 11m ago 24m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:55:56.571 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (12m) 11m ago 24m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:55:56.571 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (17m) 11m ago 27m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:55:56.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.557+0000 7fded318d640 1 -- 172.21.15.17:0/985344763 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdebc07af80 msgr2=0x7fdebc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:56.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.557+0000 7fded318d640 1 --2- 172.21.15.17:0/985344763 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdebc07af80 0x7fdebc07d440 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdecc108970 tx=0x7fdeb8005ec0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.557+0000 7fded318d640 1 -- 172.21.15.17:0/985344763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdecc102b10 msgr2=0x7fdecc19d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:56.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.557+0000 7fded318d640 1 --2- 172.21.15.17:0/985344763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdecc102b10 0x7fdecc19d650 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdec0031460 tx=0x7fdec00048f0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.557+0000 7fded318d640 1 -- 172.21.15.17:0/985344763 shutdown_connections 2024-09-20T18:55:56.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.557+0000 7fded318d640 1 --2- 172.21.15.17:0/985344763 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdebc07af80 0x7fdebc07d440 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.557+0000 7fded318d640 1 --2- 172.21.15.17:0/985344763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdecc103430 0x7fdecc19db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.557+0000 7fded318d640 1 --2- 172.21.15.17:0/985344763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdecc102b10 0x7fdecc19d650 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.557+0000 7fded318d640 1 -- 172.21.15.17:0/985344763 >> 172.21.15.17:0/985344763 conn(0x7fdecc0fc550 msgr2=0x7fdecc107e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:56.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.558+0000 7fded318d640 1 -- 172.21.15.17:0/985344763 shutdown_connections 2024-09-20T18:55:56.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.558+0000 7fded318d640 1 -- 172.21.15.17:0/985344763 wait complete. 2024-09-20T18:55:56.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.641+0000 7fa715ab1640 1 -- 172.21.15.17:0/2345232593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa710106800 msgr2=0x7fa710106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:56.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.641+0000 7fa715ab1640 1 --2- 172.21.15.17:0/2345232593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa710106800 0x7fa710106be0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa700009880 tx=0x7fa70002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.641+0000 7fa715ab1640 1 -- 172.21.15.17:0/2345232593 shutdown_connections 2024-09-20T18:55:56.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.641+0000 7fa715ab1640 1 --2- 172.21.15.17:0/2345232593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa710100800 0x7fa710100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.642+0000 7fa715ab1640 1 --2- 172.21.15.17:0/2345232593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa710106800 0x7fa710106be0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.642+0000 7fa715ab1640 1 -- 172.21.15.17:0/2345232593 >> 172.21.15.17:0/2345232593 conn(0x7fa7100fc520 msgr2=0x7fa7100fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:56.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.642+0000 7fa715ab1640 1 -- 172.21.15.17:0/2345232593 shutdown_connections 2024-09-20T18:55:56.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.642+0000 7fa715ab1640 1 -- 172.21.15.17:0/2345232593 wait complete. 2024-09-20T18:55:56.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.642+0000 7fa715ab1640 1 Processor -- start 2024-09-20T18:55:56.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.642+0000 7fa715ab1640 1 -- start start 2024-09-20T18:55:56.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.643+0000 7fa715ab1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa710100800 0x7fa71019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:56.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.643+0000 7fa715ab1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa710106800 0x7fa71019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:56.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.643+0000 7fa715ab1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa71010dcd0 con 0x7fa710106800 2024-09-20T18:55:56.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.643+0000 7fa715ab1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa71010db50 con 0x7fa710100800 2024-09-20T18:55:56.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.643+0000 7fa70effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa710106800 0x7fa71019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:56.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.643+0000 7fa70effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa710106800 0x7fa71019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50176/0 (socket says 172.21.15.17:50176) 2024-09-20T18:55:56.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.643+0000 7fa70effd640 1 -- 172.21.15.17:0/3317534928 learned_addr learned my addr 172.21.15.17:0/3317534928 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:55:56.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.643+0000 7fa70f7fe640 1 --2- 172.21.15.17:0/3317534928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa710100800 0x7fa71019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:56.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.643+0000 7fa70effd640 1 -- 172.21.15.17:0/3317534928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa710100800 msgr2=0x7fa71019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:56.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.643+0000 7fa70effd640 1 --2- 172.21.15.17:0/3317534928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa710100800 0x7fa71019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.643+0000 7fa70effd640 1 -- 172.21.15.17:0/3317534928 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7101977c0 con 0x7fa710106800 2024-09-20T18:55:56.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.643+0000 7fa70f7fe640 1 --2- 172.21.15.17:0/3317534928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa710100800 0x7fa71019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:55:56.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.643+0000 7fa70effd640 1 --2- 172.21.15.17:0/3317534928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa710106800 0x7fa71019db80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa70400e970 tx=0x7fa70400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:56.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.643+0000 7fa70cff9640 1 -- 172.21.15.17:0/3317534928 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa70400cac0 con 0x7fa710106800 2024-09-20T18:55:56.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.644+0000 7fa70cff9640 1 -- 172.21.15.17:0/3317534928 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa7040054e0 con 0x7fa710106800 2024-09-20T18:55:56.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.644+0000 7fa70cff9640 1 -- 172.21.15.17:0/3317534928 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa704010430 con 0x7fa710106800 2024-09-20T18:55:56.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.644+0000 7fa715ab1640 1 -- 172.21.15.17:0/3317534928 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa710197ab0 con 0x7fa710106800 2024-09-20T18:55:56.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.644+0000 7fa715ab1640 1 -- 172.21.15.17:0/3317534928 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa710198040 con 0x7fa710106800 2024-09-20T18:55:56.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.645+0000 7fa715ab1640 1 -- 172.21.15.17:0/3317534928 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa710101f40 con 0x7fa710106800 2024-09-20T18:55:56.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.645+0000 7fa70cff9640 1 -- 172.21.15.17:0/3317534928 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa704004e80 con 0x7fa710106800 2024-09-20T18:55:56.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.646+0000 7fa70cff9640 1 --2- 172.21.15.17:0/3317534928 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6f807af40 0x7fa6f807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:56.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.646+0000 7fa70f7fe640 1 --2- 172.21.15.17:0/3317534928 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6f807af40 0x7fa6f807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:56.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.646+0000 7fa70cff9640 1 -- 172.21.15.17:0/3317534928 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fa70409e7a0 con 0x7fa710106800 2024-09-20T18:55:56.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.647+0000 7fa70f7fe640 1 --2- 172.21.15.17:0/3317534928 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6f807af40 0x7fa6f807d400 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa700000c00 tx=0x7fa700031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.650+0000 7fa70cff9640 1 -- 172.21.15.17:0/3317534928 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa704069d00 con 0x7fa710106800 2024-09-20T18:55:56.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.917+0000 7fa715ab1640 1 -- 172.21.15.17:0/3317534928 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa710109d80 con 0x7fa710106800 2024-09-20T18:55:56.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.918+0000 7fa70cff9640 1 -- 172.21.15.17:0/3317534928 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fa70406ebb0 con 0x7fa710106800 2024-09-20T18:55:56.932 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:55:56.932 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:55:56.932 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:55:56.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:55:56.932 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:55:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:55:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:55:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:55:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:55:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:55:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:55:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:55:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:55:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:55:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:55:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:55:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:55:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:55:56.933 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:55:56.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.920+0000 7fa715ab1640 1 -- 172.21.15.17:0/3317534928 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6f807af40 msgr2=0x7fa6f807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:56.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.920+0000 7fa715ab1640 1 --2- 172.21.15.17:0/3317534928 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6f807af40 0x7fa6f807d400 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa700000c00 tx=0x7fa700031400 comp rx=0 tx=0).stop 2024-09-20T18:55:56.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.920+0000 7fa715ab1640 1 -- 172.21.15.17:0/3317534928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa710106800 msgr2=0x7fa71019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:56.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.920+0000 7fa715ab1640 1 --2- 172.21.15.17:0/3317534928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa710106800 0x7fa71019db80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa70400e970 tx=0x7fa70400ed70 comp rx=0 tx=0).stop 2024-09-20T18:55:56.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.920+0000 7fa715ab1640 1 -- 172.21.15.17:0/3317534928 shutdown_connections 2024-09-20T18:55:56.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.920+0000 7fa715ab1640 1 --2- 172.21.15.17:0/3317534928 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6f807af40 0x7fa6f807d400 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.920+0000 7fa715ab1640 1 --2- 172.21.15.17:0/3317534928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa710106800 0x7fa71019db80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.920+0000 7fa715ab1640 1 --2- 172.21.15.17:0/3317534928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa710100800 0x7fa71019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:56.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.920+0000 7fa715ab1640 1 -- 172.21.15.17:0/3317534928 >> 172.21.15.17:0/3317534928 conn(0x7fa7100fc520 msgr2=0x7fa71006a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:56.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.920+0000 7fa715ab1640 1 -- 172.21.15.17:0/3317534928 shutdown_connections 2024-09-20T18:55:56.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:56.920+0000 7fa715ab1640 1 -- 172.21.15.17:0/3317534928 wait complete. 2024-09-20T18:55:57.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.005+0000 7f2596058640 1 -- 172.21.15.17:0/3177699312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2590100250 msgr2=0x7f2590100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:57.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.005+0000 7f2596058640 1 --2- 172.21.15.17:0/3177699312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2590100250 0x7f2590100630 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2580009880 tx=0x7f258002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.005+0000 7f2596058640 1 -- 172.21.15.17:0/3177699312 shutdown_connections 2024-09-20T18:55:57.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.005+0000 7f2596058640 1 --2- 172.21.15.17:0/3177699312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2590100c00 0x7f2590104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.005+0000 7f2596058640 1 --2- 172.21.15.17:0/3177699312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2590100250 0x7f2590100630 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.005+0000 7f2596058640 1 -- 172.21.15.17:0/3177699312 >> 172.21.15.17:0/3177699312 conn(0x7f25900fbc90 msgr2=0x7f25900fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:57.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.005+0000 7f2596058640 1 -- 172.21.15.17:0/3177699312 shutdown_connections 2024-09-20T18:55:57.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.005+0000 7f2596058640 1 -- 172.21.15.17:0/3177699312 wait complete. 2024-09-20T18:55:57.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.006+0000 7f2596058640 1 Processor -- start 2024-09-20T18:55:57.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.006+0000 7f2596058640 1 -- start start 2024-09-20T18:55:57.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.006+0000 7f2596058640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2590100250 0x7f2590101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:57.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.006+0000 7f2596058640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2590100c00 0x7f2590102230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:57.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.006+0000 7f2596058640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f259010cc40 con 0x7f2590100250 2024-09-20T18:55:57.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.006+0000 7f2596058640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f259010cac0 con 0x7f2590100c00 2024-09-20T18:55:57.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.006+0000 7f258f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2590100250 0x7f2590101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.006+0000 7f258f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2590100250 0x7f2590101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50192/0 (socket says 172.21.15.17:50192) 2024-09-20T18:55:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.006+0000 7f258f7fe640 1 -- 172.21.15.17:0/2611081240 learned_addr learned my addr 172.21.15.17:0/2611081240 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:55:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.006+0000 7f258effd640 1 --2- 172.21.15.17:0/2611081240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2590100c00 0x7f2590102230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.007+0000 7f258f7fe640 1 -- 172.21.15.17:0/2611081240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2590100c00 msgr2=0x7f2590102230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.007+0000 7f258f7fe640 1 --2- 172.21.15.17:0/2611081240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2590100c00 0x7f2590102230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.007+0000 7f258f7fe640 1 -- 172.21.15.17:0/2611081240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2590102770 con 0x7f2590100250 2024-09-20T18:55:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.007+0000 7f258f7fe640 1 --2- 172.21.15.17:0/2611081240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2590100250 0x7f2590101cf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2580031460 tx=0x7f2580004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.007+0000 7f258cff9640 1 -- 172.21.15.17:0/2611081240 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f258003f070 con 0x7f2590100250 2024-09-20T18:55:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.007+0000 7f2596058640 1 -- 172.21.15.17:0/2611081240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2590102a00 con 0x7f2590100250 2024-09-20T18:55:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.007+0000 7f258cff9640 1 -- 172.21.15.17:0/2611081240 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f25800035f0 con 0x7f2590100250 2024-09-20T18:55:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.007+0000 7f258cff9640 1 -- 172.21.15.17:0/2611081240 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2580035030 con 0x7f2590100250 2024-09-20T18:55:57.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.007+0000 7f2596058640 1 -- 172.21.15.17:0/2611081240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25901a3e00 con 0x7f2590100250 2024-09-20T18:55:57.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.008+0000 7f2596058640 1 -- 172.21.15.17:0/2611081240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2590101730 con 0x7f2590100250 2024-09-20T18:55:57.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.009+0000 7f258cff9640 1 -- 172.21.15.17:0/2611081240 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2580042070 con 0x7f2590100250 2024-09-20T18:55:57.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.009+0000 7f258cff9640 1 --2- 172.21.15.17:0/2611081240 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f257807af30 0x7f257807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:57.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.009+0000 7f258cff9640 1 -- 172.21.15.17:0/2611081240 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f25800be900 con 0x7f2590100250 2024-09-20T18:55:57.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.009+0000 7f258effd640 1 --2- 172.21.15.17:0/2611081240 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f257807af30 0x7f257807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:57.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.010+0000 7f258effd640 1 --2- 172.21.15.17:0/2611081240 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f257807af30 0x7f257807d3f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2590103780 tx=0x7f2584010040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:57.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.014+0000 7f258cff9640 1 -- 172.21.15.17:0/2611081240 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2580089f00 con 0x7f2590100250 2024-09-20T18:55:57.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.240+0000 7f2596058640 1 -- 172.21.15.17:0/2611081240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f259010a570 con 0x7f2590100250 2024-09-20T18:55:57.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.240+0000 7f258cff9640 1 -- 172.21.15.17:0/2611081240 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f258008edb0 con 0x7f2590100250 2024-09-20T18:55:57.255 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:55:57.255 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:55:57.255 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:55:57.255 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:55:57.255 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:55:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:55:57.255 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:55:57.255 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:55:57.255 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:55:57.255 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:55:57.255 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:55:57.255 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:55:57.255 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:55:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:55:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:55:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:55:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:55:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:55:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:55:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:55:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:55:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:55:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:55:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:55:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:55:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:55:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:55:57.256 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:55:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:55:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:55:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:55:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:55:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:55:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:55:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:55:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:55:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:55:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:55:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:55:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:55:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:55:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:55:57.257 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:55:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:55:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.243+0000 7f2596058640 1 -- 172.21.15.17:0/2611081240 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f257807af30 msgr2=0x7f257807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.243+0000 7f2596058640 1 --2- 172.21.15.17:0/2611081240 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f257807af30 0x7f257807d3f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2590103780 tx=0x7f2584010040 comp rx=0 tx=0).stop 2024-09-20T18:55:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.243+0000 7f2596058640 1 -- 172.21.15.17:0/2611081240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2590100250 msgr2=0x7f2590101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.243+0000 7f2596058640 1 --2- 172.21.15.17:0/2611081240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2590100250 0x7f2590101cf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2580031460 tx=0x7f2580004530 comp rx=0 tx=0).stop 2024-09-20T18:55:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.243+0000 7f2596058640 1 -- 172.21.15.17:0/2611081240 shutdown_connections 2024-09-20T18:55:57.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.243+0000 7f2596058640 1 --2- 172.21.15.17:0/2611081240 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f257807af30 0x7f257807d3f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.243+0000 7f2596058640 1 --2- 172.21.15.17:0/2611081240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2590100c00 0x7f2590102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.243+0000 7f2596058640 1 --2- 172.21.15.17:0/2611081240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2590100250 0x7f2590101cf0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.243+0000 7f2596058640 1 -- 172.21.15.17:0/2611081240 >> 172.21.15.17:0/2611081240 conn(0x7f25900fbc90 msgr2=0x7f25900fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.243+0000 7f2596058640 1 -- 172.21.15.17:0/2611081240 shutdown_connections 2024-09-20T18:55:57.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.243+0000 7f2596058640 1 -- 172.21.15.17:0/2611081240 wait complete. 2024-09-20T18:55:57.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.328+0000 7fa690122640 1 -- 172.21.15.17:0/3207791436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa688100800 msgr2=0x7fa688100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:57.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.328+0000 7fa690122640 1 --2- 172.21.15.17:0/3207791436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa688100800 0x7fa688100c60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa678009880 tx=0x7fa67802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.328+0000 7fa690122640 1 -- 172.21.15.17:0/3207791436 shutdown_connections 2024-09-20T18:55:57.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.328+0000 7fa690122640 1 --2- 172.21.15.17:0/3207791436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa688100800 0x7fa688100c60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.328+0000 7fa690122640 1 --2- 172.21.15.17:0/3207791436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa688106800 0x7fa688106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.328+0000 7fa690122640 1 -- 172.21.15.17:0/3207791436 >> 172.21.15.17:0/3207791436 conn(0x7fa6880fc520 msgr2=0x7fa6880fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:57.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.328+0000 7fa690122640 1 -- 172.21.15.17:0/3207791436 shutdown_connections 2024-09-20T18:55:57.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.328+0000 7fa690122640 1 -- 172.21.15.17:0/3207791436 wait complete. 2024-09-20T18:55:57.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.329+0000 7fa690122640 1 Processor -- start 2024-09-20T18:55:57.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.329+0000 7fa690122640 1 -- start start 2024-09-20T18:55:57.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.329+0000 7fa690122640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa688100800 0x7fa6881965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.329+0000 7fa690122640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa688106800 0x7fa688196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.329+0000 7fa690122640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa68810dcd0 con 0x7fa688100800 2024-09-20T18:55:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.329+0000 7fa690122640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa68810db50 con 0x7fa688106800 2024-09-20T18:55:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.329+0000 7fa68debe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa688100800 0x7fa6881965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.329+0000 7fa68debe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa688100800 0x7fa6881965d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50218/0 (socket says 172.21.15.17:50218) 2024-09-20T18:55:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.329+0000 7fa68debe640 1 -- 172.21.15.17:0/572159110 learned_addr learned my addr 172.21.15.17:0/572159110 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:55:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.329+0000 7fa68d6bd640 1 --2- 172.21.15.17:0/572159110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa688106800 0x7fa688196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.329+0000 7fa68debe640 1 -- 172.21.15.17:0/572159110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa688106800 msgr2=0x7fa688196b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.329+0000 7fa68debe640 1 --2- 172.21.15.17:0/572159110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa688106800 0x7fa688196b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.329+0000 7fa68debe640 1 -- 172.21.15.17:0/572159110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa688197050 con 0x7fa688100800 2024-09-20T18:55:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.330+0000 7fa68debe640 1 --2- 172.21.15.17:0/572159110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa688100800 0x7fa6881965d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa68400d6f0 tx=0x7fa68400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.330+0000 7fa67effd640 1 -- 172.21.15.17:0/572159110 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa684017070 con 0x7fa688100800 2024-09-20T18:55:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.330+0000 7fa67effd640 1 -- 172.21.15.17:0/572159110 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa68400de00 con 0x7fa688100800 2024-09-20T18:55:57.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.330+0000 7fa690122640 1 -- 172.21.15.17:0/572159110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa688197340 con 0x7fa688100800 2024-09-20T18:55:57.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.330+0000 7fa67effd640 1 -- 172.21.15.17:0/572159110 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa684004bb0 con 0x7fa688100800 2024-09-20T18:55:57.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.330+0000 7fa690122640 1 -- 172.21.15.17:0/572159110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6881a3e10 con 0x7fa688100800 2024-09-20T18:55:57.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.331+0000 7fa690122640 1 -- 172.21.15.17:0/572159110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa688101f40 con 0x7fa688100800 2024-09-20T18:55:57.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.332+0000 7fa67effd640 1 -- 172.21.15.17:0/572159110 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa684004e60 con 0x7fa688100800 2024-09-20T18:55:57.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.332+0000 7fa67effd640 1 --2- 172.21.15.17:0/572159110 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa67407af30 0x7fa67407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:57.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.332+0000 7fa68d6bd640 1 --2- 172.21.15.17:0/572159110 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa67407af30 0x7fa67407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:57.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.332+0000 7fa67effd640 1 -- 172.21.15.17:0/572159110 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fa68409dbb0 con 0x7fa688100800 2024-09-20T18:55:57.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.333+0000 7fa68d6bd640 1 --2- 172.21.15.17:0/572159110 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa67407af30 0x7fa67407d3f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa688198730 tx=0x7fa678031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:57.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.336+0000 7fa67effd640 1 -- 172.21.15.17:0/572159110 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6840a4080 con 0x7fa688100800 2024-09-20T18:55:57.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.540+0000 7fa690122640 1 -- 172.21.15.17:0/572159110 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa688108da0 con 0x7fa67407af30 2024-09-20T18:55:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.541+0000 7fa67effd640 1 -- 172.21.15.17:0/572159110 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fa688108da0 con 0x7fa67407af30 2024-09-20T18:55:57.555 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:55:57.556 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:55:57.556 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:55:57.556 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:55:57.556 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:55:57.556 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:55:57.556 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:55:57.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:55:57.556 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:55:57.556 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:55:57.556 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:55:57.556 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:55:57.556 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:55:57.556 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:55:57.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.543+0000 7fa690122640 1 -- 172.21.15.17:0/572159110 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa67407af30 msgr2=0x7fa67407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:57.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.543+0000 7fa690122640 1 --2- 172.21.15.17:0/572159110 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa67407af30 0x7fa67407d3f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa688198730 tx=0x7fa678031400 comp rx=0 tx=0).stop 2024-09-20T18:55:57.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.543+0000 7fa690122640 1 -- 172.21.15.17:0/572159110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa688100800 msgr2=0x7fa6881965d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:57.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.543+0000 7fa690122640 1 --2- 172.21.15.17:0/572159110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa688100800 0x7fa6881965d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa68400d6f0 tx=0x7fa68400dbb0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.544+0000 7fa690122640 1 -- 172.21.15.17:0/572159110 shutdown_connections 2024-09-20T18:55:57.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.544+0000 7fa690122640 1 --2- 172.21.15.17:0/572159110 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa67407af30 0x7fa67407d3f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.544+0000 7fa690122640 1 --2- 172.21.15.17:0/572159110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa688106800 0x7fa688196b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.544+0000 7fa690122640 1 --2- 172.21.15.17:0/572159110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa688100800 0x7fa6881965d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.544+0000 7fa690122640 1 -- 172.21.15.17:0/572159110 >> 172.21.15.17:0/572159110 conn(0x7fa6880fc520 msgr2=0x7fa6880fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:57.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.544+0000 7fa690122640 1 -- 172.21.15.17:0/572159110 shutdown_connections 2024-09-20T18:55:57.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.544+0000 7fa690122640 1 -- 172.21.15.17:0/572159110 wait complete. 2024-09-20T18:55:57.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.628+0000 7f0731d1b640 1 -- 172.21.15.17:0/1342939618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072c1067f0 msgr2=0x7f072c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:57.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.628+0000 7f0731d1b640 1 --2- 172.21.15.17:0/1342939618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072c1067f0 0x7f072c106bd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f071c009880 tx=0x7f071c02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.628+0000 7f0731d1b640 1 -- 172.21.15.17:0/1342939618 shutdown_connections 2024-09-20T18:55:57.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.628+0000 7f0731d1b640 1 --2- 172.21.15.17:0/1342939618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f072c1007f0 0x7f072c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.628+0000 7f0731d1b640 1 --2- 172.21.15.17:0/1342939618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072c1067f0 0x7f072c106bd0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.628+0000 7f0731d1b640 1 -- 172.21.15.17:0/1342939618 >> 172.21.15.17:0/1342939618 conn(0x7f072c0fc550 msgr2=0x7f072c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:57.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.628+0000 7f0731d1b640 1 -- 172.21.15.17:0/1342939618 shutdown_connections 2024-09-20T18:55:57.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.628+0000 7f0731d1b640 1 -- 172.21.15.17:0/1342939618 wait complete. 2024-09-20T18:55:57.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.629+0000 7f0731d1b640 1 Processor -- start 2024-09-20T18:55:57.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.629+0000 7f0731d1b640 1 -- start start 2024-09-20T18:55:57.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.629+0000 7f0731d1b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072c1007f0 0x7f072c198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:57.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.629+0000 7f0731d1b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f072c1067f0 0x7f072c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.629+0000 7f0731d1b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f072c10dcc0 con 0x7f072c1007f0 2024-09-20T18:55:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.629+0000 7f0731d1b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f072c10db40 con 0x7f072c1067f0 2024-09-20T18:55:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.630+0000 7f072b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072c1007f0 0x7f072c198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.630+0000 7f072b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072c1007f0 0x7f072c198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50234/0 (socket says 172.21.15.17:50234) 2024-09-20T18:55:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.630+0000 7f072b7fe640 1 -- 172.21.15.17:0/3035006451 learned_addr learned my addr 172.21.15.17:0/3035006451 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:55:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.630+0000 7f072affd640 1 --2- 172.21.15.17:0/3035006451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f072c1067f0 0x7f072c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.630+0000 7f072b7fe640 1 -- 172.21.15.17:0/3035006451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f072c1067f0 msgr2=0x7f072c198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.630+0000 7f072b7fe640 1 --2- 172.21.15.17:0/3035006451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f072c1067f0 0x7f072c198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.630+0000 7f072b7fe640 1 -- 172.21.15.17:0/3035006451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072c199350 con 0x7f072c1007f0 2024-09-20T18:55:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.630+0000 7f072b7fe640 1 --2- 172.21.15.17:0/3035006451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072c1007f0 0x7f072c198810 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f071c031460 tx=0x7f071c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.630+0000 7f0728ff9640 1 -- 172.21.15.17:0/3035006451 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f071c03f070 con 0x7f072c1007f0 2024-09-20T18:55:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.630+0000 7f0728ff9640 1 -- 172.21.15.17:0/3035006451 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f071c0035f0 con 0x7f072c1007f0 2024-09-20T18:55:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.630+0000 7f0731d1b640 1 -- 172.21.15.17:0/3035006451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072c1995e0 con 0x7f072c1007f0 2024-09-20T18:55:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.630+0000 7f0728ff9640 1 -- 172.21.15.17:0/3035006451 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f071c035030 con 0x7f072c1007f0 2024-09-20T18:55:57.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.630+0000 7f0731d1b640 1 -- 172.21.15.17:0/3035006451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f072c1a1b90 con 0x7f072c1007f0 2024-09-20T18:55:57.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.631+0000 7f0731d1b640 1 -- 172.21.15.17:0/3035006451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f072c101f30 con 0x7f072c1007f0 2024-09-20T18:55:57.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.632+0000 7f0728ff9640 1 -- 172.21.15.17:0/3035006451 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f071c042070 con 0x7f072c1007f0 2024-09-20T18:55:57.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.632+0000 7f0728ff9640 1 --2- 172.21.15.17:0/3035006451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f071407af30 0x7f071407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:55:57.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.633+0000 7f0728ff9640 1 -- 172.21.15.17:0/3035006451 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f071c0bea10 con 0x7f072c1007f0 2024-09-20T18:55:57.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.633+0000 7f072affd640 1 --2- 172.21.15.17:0/3035006451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f071407af30 0x7f071407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:55:57.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.633+0000 7f072affd640 1 --2- 172.21.15.17:0/3035006451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f071407af30 0x7f071407d3f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f072c06a7f0 tx=0x7f072000b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:55:57.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.637+0000 7f0728ff9640 1 -- 172.21.15.17:0/3035006451 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f071c089f70 con 0x7f072c1007f0 2024-09-20T18:55:57.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:57 smithi017 ceph-mon[108970]: from='client.34958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:55:57.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:57 smithi017 ceph-mon[108970]: from='client.34962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:55:57.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:57 smithi017 ceph-mon[108970]: pgmap v616: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:57.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:57 smithi017 ceph-mon[108970]: from='client.34966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:55:57.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:57 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3317534928' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:55:57.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:57 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2611081240' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:55:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.898+0000 7f0731d1b640 1 -- 172.21.15.17:0/3035006451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f072c108d60 con 0x7f072c1007f0 2024-09-20T18:55:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.898+0000 7f0728ff9640 1 -- 172.21.15.17:0/3035006451 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f071c08ee20 con 0x7f072c1007f0 2024-09-20T18:55:57.913 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:55:57.913 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:55:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:55:57.913 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:55:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:55:57.913 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:55:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:55:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.901+0000 7f0731d1b640 1 -- 172.21.15.17:0/3035006451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f071407af30 msgr2=0x7f071407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.901+0000 7f0731d1b640 1 --2- 172.21.15.17:0/3035006451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f071407af30 0x7f071407d3f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f072c06a7f0 tx=0x7f072000b390 comp rx=0 tx=0).stop 2024-09-20T18:55:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.901+0000 7f0731d1b640 1 -- 172.21.15.17:0/3035006451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072c1007f0 msgr2=0x7f072c198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:55:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.901+0000 7f0731d1b640 1 --2- 172.21.15.17:0/3035006451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072c1007f0 0x7f072c198810 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f071c031460 tx=0x7f071c0045e0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.901+0000 7f0731d1b640 1 -- 172.21.15.17:0/3035006451 shutdown_connections 2024-09-20T18:55:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.901+0000 7f0731d1b640 1 --2- 172.21.15.17:0/3035006451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f071407af30 0x7f071407d3f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.901+0000 7f0731d1b640 1 --2- 172.21.15.17:0/3035006451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f072c1067f0 0x7f072c198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.901+0000 7f0731d1b640 1 --2- 172.21.15.17:0/3035006451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072c1007f0 0x7f072c198810 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:55:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.901+0000 7f0731d1b640 1 -- 172.21.15.17:0/3035006451 >> 172.21.15.17:0/3035006451 conn(0x7f072c0fc550 msgr2=0x7f072c0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:55:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.901+0000 7f0731d1b640 1 -- 172.21.15.17:0/3035006451 shutdown_connections 2024-09-20T18:55:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:55:57.901+0000 7f0731d1b640 1 -- 172.21.15.17:0/3035006451 wait complete. 2024-09-20T18:55:57.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:57 smithi172 ceph-mon[80431]: from='client.34958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:55:57.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:57 smithi172 ceph-mon[80431]: from='client.34962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:55:57.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:57 smithi172 ceph-mon[80431]: pgmap v616: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:55:57.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:57 smithi172 ceph-mon[80431]: from='client.34966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:55:57.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:57 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3317534928' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:55:57.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:57 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2611081240' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:55:58.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:58 smithi017 ceph-mon[108970]: from='client.34978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:55:58.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:58 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3035006451' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:55:58.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:58 smithi172 ceph-mon[80431]: from='client.34978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:55:58.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:58 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3035006451' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:55:59.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:55:59 smithi172 ceph-mon[80431]: pgmap v617: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:00.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:55:59 smithi017 ceph-mon[108970]: pgmap v617: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:01.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:01 smithi017 ceph-mon[108970]: pgmap v618: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:01.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:01 smithi172 ceph-mon[80431]: pgmap v618: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:03.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:03 smithi172 ceph-mon[80431]: pgmap v619: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:04.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:03 smithi017 ceph-mon[108970]: pgmap v619: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:05.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:05 smithi172 ceph-mon[80431]: pgmap v620: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:06.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:05 smithi017 ceph-mon[108970]: pgmap v620: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:07.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:07 smithi017 ceph-mon[108970]: pgmap v621: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:07.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:56:07.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:07 smithi172 ceph-mon[80431]: pgmap v621: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:07.959 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:56:09.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:09 smithi017 ceph-mon[108970]: pgmap v622: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:09.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:09 smithi172 ceph-mon[80431]: pgmap v622: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:11.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:11 smithi172 ceph-mon[80431]: pgmap v623: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:11.964 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:11 smithi017 ceph-mon[108970]: pgmap v623: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:13.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:13 smithi017 ceph-mon[108970]: pgmap v624: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:14.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:13 smithi172 ceph-mon[80431]: pgmap v624: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:16.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:15 smithi017 ceph-mon[108970]: pgmap v625: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:16.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:15 smithi172 ceph-mon[80431]: pgmap v625: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:18.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:17 smithi017 ceph-mon[108970]: pgmap v626: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:18.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:17 smithi172 ceph-mon[80431]: pgmap v626: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:19.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:19 smithi017 ceph-mon[108970]: pgmap v627: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:20.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:19 smithi172 ceph-mon[80431]: pgmap v627: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:22.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:21 smithi017 ceph-mon[108970]: pgmap v628: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:22.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:21 smithi172 ceph-mon[80431]: pgmap v628: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:22.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:56:23.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:56:24.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:23 smithi017 ceph-mon[108970]: pgmap v629: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:24.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:23 smithi172 ceph-mon[80431]: pgmap v629: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:25.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:25 smithi017 ceph-mon[108970]: pgmap v630: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:26.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:25 smithi172 ceph-mon[80431]: pgmap v630: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:27.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:27 smithi172 ceph-mon[80431]: pgmap v631: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:28.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:27.998+0000 7f4c41fc4640 1 -- 172.21.15.17:0/1563003116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c3c100a90 msgr2=0x7f4c3c1065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:28.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:27.998+0000 7f4c41fc4640 1 --2- 172.21.15.17:0/1563003116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c3c100a90 0x7f4c3c1065d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4c30009880 tx=0x7f4c3002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:27.998+0000 7f4c41fc4640 1 -- 172.21.15.17:0/1563003116 shutdown_connections 2024-09-20T18:56:28.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:27.998+0000 7f4c41fc4640 1 --2- 172.21.15.17:0/1563003116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c3c100a90 0x7f4c3c1065d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:27.998+0000 7f4c41fc4640 1 --2- 172.21.15.17:0/1563003116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c3c1000e0 0x7f4c3c1004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:27.998+0000 7f4c41fc4640 1 -- 172.21.15.17:0/1563003116 >> 172.21.15.17:0/1563003116 conn(0x7f4c3c0fbc90 msgr2=0x7f4c3c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:56:28.014 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:27 smithi017 ceph-mon[108970]: pgmap v631: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:28.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:27.998+0000 7f4c41fc4640 1 -- 172.21.15.17:0/1563003116 shutdown_connections 2024-09-20T18:56:28.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:27.998+0000 7f4c41fc4640 1 -- 172.21.15.17:0/1563003116 wait complete. 2024-09-20T18:56:28.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:27.999+0000 7f4c41fc4640 1 Processor -- start 2024-09-20T18:56:28.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:27.999+0000 7f4c41fc4640 1 -- start start 2024-09-20T18:56:28.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.000+0000 7f4c41fc4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c3c1000e0 0x7f4c3c19d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:28.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.000+0000 7f4c41fc4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c3c100a90 0x7f4c3c19dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:28.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.000+0000 7f4c41fc4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c10ee30 con 0x7f4c3c100a90 2024-09-20T18:56:28.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.000+0000 7f4c41fc4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c10ecb0 con 0x7f4c3c1000e0 2024-09-20T18:56:28.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.000+0000 7f4c3affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c3c100a90 0x7f4c3c19dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:28.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.000+0000 7f4c3affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c3c100a90 0x7f4c3c19dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54780/0 (socket says 172.21.15.17:54780) 2024-09-20T18:56:28.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.000+0000 7f4c3affd640 1 -- 172.21.15.17:0/550986314 learned_addr learned my addr 172.21.15.17:0/550986314 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:56:28.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.000+0000 7f4c3b7fe640 1 --2- 172.21.15.17:0/550986314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c3c1000e0 0x7f4c3c19d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:28.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.000+0000 7f4c3affd640 1 -- 172.21.15.17:0/550986314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c3c1000e0 msgr2=0x7f4c3c19d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:28.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.000+0000 7f4c3affd640 1 --2- 172.21.15.17:0/550986314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c3c1000e0 0x7f4c3c19d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.000+0000 7f4c3affd640 1 -- 172.21.15.17:0/550986314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c3c1978a0 con 0x7f4c3c100a90 2024-09-20T18:56:28.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.000+0000 7f4c3affd640 1 --2- 172.21.15.17:0/550986314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c3c100a90 0x7f4c3c19dc20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4c30031460 tx=0x7f4c300045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:56:28.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.001+0000 7f4c38ff9640 1 -- 172.21.15.17:0/550986314 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c3003f070 con 0x7f4c3c100a90 2024-09-20T18:56:28.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.001+0000 7f4c38ff9640 1 -- 172.21.15.17:0/550986314 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4c300035f0 con 0x7f4c3c100a90 2024-09-20T18:56:28.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.001+0000 7f4c41fc4640 1 -- 172.21.15.17:0/550986314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c3c197b30 con 0x7f4c3c100a90 2024-09-20T18:56:28.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.001+0000 7f4c38ff9640 1 -- 172.21.15.17:0/550986314 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c30035030 con 0x7f4c3c100a90 2024-09-20T18:56:28.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.001+0000 7f4c41fc4640 1 -- 172.21.15.17:0/550986314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c3c198060 con 0x7f4c3c100a90 2024-09-20T18:56:28.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.002+0000 7f4c41fc4640 1 -- 172.21.15.17:0/550986314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c3c1031a0 con 0x7f4c3c100a90 2024-09-20T18:56:28.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.003+0000 7f4c38ff9640 1 -- 172.21.15.17:0/550986314 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4c30042070 con 0x7f4c3c100a90 2024-09-20T18:56:28.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.003+0000 7f4c38ff9640 1 --2- 172.21.15.17:0/550986314 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c2407af30 0x7f4c2407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:28.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.004+0000 7f4c38ff9640 1 -- 172.21.15.17:0/550986314 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f4c300bea10 con 0x7f4c3c100a90 2024-09-20T18:56:28.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.004+0000 7f4c3b7fe640 1 --2- 172.21.15.17:0/550986314 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c2407af30 0x7f4c2407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:28.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.004+0000 7f4c3b7fe640 1 --2- 172.21.15.17:0/550986314 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c2407af30 0x7f4c2407d3f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c1989e0 tx=0x7f4c2c00b410 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:56:28.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.008+0000 7f4c38ff9640 1 -- 172.21.15.17:0/550986314 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c30089f70 con 0x7f4c3c100a90 2024-09-20T18:56:28.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.216+0000 7f4c41fc4640 1 -- 172.21.15.17:0/550986314 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4c3c109f50 con 0x7f4c2407af30 2024-09-20T18:56:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.217+0000 7f4c38ff9640 1 -- 172.21.15.17:0/550986314 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f4c2c00bc40 con 0x7f4c2407af30 2024-09-20T18:56:28.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.219+0000 7f4c41fc4640 1 -- 172.21.15.17:0/550986314 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c2407af30 msgr2=0x7f4c2407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:28.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.219+0000 7f4c41fc4640 1 --2- 172.21.15.17:0/550986314 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c2407af30 0x7f4c2407d3f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c1989e0 tx=0x7f4c2c00b410 comp rx=0 tx=0).stop 2024-09-20T18:56:28.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.219+0000 7f4c41fc4640 1 -- 172.21.15.17:0/550986314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c3c100a90 msgr2=0x7f4c3c19dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:28.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.219+0000 7f4c41fc4640 1 --2- 172.21.15.17:0/550986314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c3c100a90 0x7f4c3c19dc20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4c30031460 tx=0x7f4c300045e0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.220+0000 7f4c41fc4640 1 -- 172.21.15.17:0/550986314 shutdown_connections 2024-09-20T18:56:28.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.220+0000 7f4c41fc4640 1 --2- 172.21.15.17:0/550986314 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c2407af30 0x7f4c2407d3f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.220+0000 7f4c41fc4640 1 --2- 172.21.15.17:0/550986314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c3c100a90 0x7f4c3c19dc20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.220+0000 7f4c41fc4640 1 --2- 172.21.15.17:0/550986314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c3c1000e0 0x7f4c3c19d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.220+0000 7f4c41fc4640 1 -- 172.21.15.17:0/550986314 >> 172.21.15.17:0/550986314 conn(0x7f4c3c0fbc90 msgr2=0x7f4c3c0fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:56:28.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.220+0000 7f4c41fc4640 1 -- 172.21.15.17:0/550986314 shutdown_connections 2024-09-20T18:56:28.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.220+0000 7f4c41fc4640 1 -- 172.21.15.17:0/550986314 wait complete. 2024-09-20T18:56:28.243 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:56:28.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.305+0000 7f7340b8c640 1 -- 172.21.15.17:0/383806941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c1007f0 msgr2=0x7f733c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:28.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.305+0000 7f7340b8c640 1 --2- 172.21.15.17:0/383806941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c1007f0 0x7f733c100c50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7324009880 tx=0x7f732402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.305+0000 7f7340b8c640 1 -- 172.21.15.17:0/383806941 shutdown_connections 2024-09-20T18:56:28.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.305+0000 7f7340b8c640 1 --2- 172.21.15.17:0/383806941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c1007f0 0x7f733c100c50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.305+0000 7f7340b8c640 1 --2- 172.21.15.17:0/383806941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f733c1067f0 0x7f733c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.305+0000 7f7340b8c640 1 -- 172.21.15.17:0/383806941 >> 172.21.15.17:0/383806941 conn(0x7f733c0fc550 msgr2=0x7f733c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:56:28.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.306+0000 7f7340b8c640 1 -- 172.21.15.17:0/383806941 shutdown_connections 2024-09-20T18:56:28.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.306+0000 7f7340b8c640 1 -- 172.21.15.17:0/383806941 wait complete. 2024-09-20T18:56:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.307+0000 7f7340b8c640 1 Processor -- start 2024-09-20T18:56:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.307+0000 7f7340b8c640 1 -- start start 2024-09-20T18:56:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.307+0000 7f7340b8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c1007f0 0x7f733c19d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.307+0000 7f7340b8c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f733c1067f0 0x7f733c19dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.307+0000 7f7340b8c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f733c10dd20 con 0x7f733c1007f0 2024-09-20T18:56:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.307+0000 7f7340b8c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f733c10dba0 con 0x7f733c1067f0 2024-09-20T18:56:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.307+0000 7f733a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c1007f0 0x7f733c19d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.307+0000 7f733a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c1007f0 0x7f733c19d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54794/0 (socket says 172.21.15.17:54794) 2024-09-20T18:56:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.307+0000 7f733a59c640 1 -- 172.21.15.17:0/3252465373 learned_addr learned my addr 172.21.15.17:0/3252465373 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:56:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.308+0000 7f7331d9b640 1 --2- 172.21.15.17:0/3252465373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f733c1067f0 0x7f733c19dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:28.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.308+0000 7f733a59c640 1 -- 172.21.15.17:0/3252465373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f733c1067f0 msgr2=0x7f733c19dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:28.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.308+0000 7f733a59c640 1 --2- 172.21.15.17:0/3252465373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f733c1067f0 0x7f733c19dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.308+0000 7f733a59c640 1 -- 172.21.15.17:0/3252465373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f733c1978d0 con 0x7f733c1007f0 2024-09-20T18:56:28.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.308+0000 7f7331d9b640 1 --2- 172.21.15.17:0/3252465373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f733c1067f0 0x7f733c19dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:56:28.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.308+0000 7f733a59c640 1 --2- 172.21.15.17:0/3252465373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c1007f0 0x7f733c19d710 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f732c00b420 tx=0x7f732c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:56:28.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.308+0000 7f7333fff640 1 -- 172.21.15.17:0/3252465373 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f732c011630 con 0x7f733c1007f0 2024-09-20T18:56:28.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.308+0000 7f7340b8c640 1 -- 172.21.15.17:0/3252465373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f733c197bc0 con 0x7f733c1007f0 2024-09-20T18:56:28.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.308+0000 7f7333fff640 1 -- 172.21.15.17:0/3252465373 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f732c016070 con 0x7f733c1007f0 2024-09-20T18:56:28.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.308+0000 7f7333fff640 1 -- 172.21.15.17:0/3252465373 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f732c010d40 con 0x7f733c1007f0 2024-09-20T18:56:28.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.308+0000 7f7340b8c640 1 -- 172.21.15.17:0/3252465373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f733c198120 con 0x7f733c1007f0 2024-09-20T18:56:28.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.310+0000 7f7340b8c640 1 -- 172.21.15.17:0/3252465373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f733c101f30 con 0x7f733c1007f0 2024-09-20T18:56:28.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.310+0000 7f7333fff640 1 -- 172.21.15.17:0/3252465373 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f732c01b460 con 0x7f733c1007f0 2024-09-20T18:56:28.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.311+0000 7f7333fff640 1 --2- 172.21.15.17:0/3252465373 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f732807af30 0x7f732807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:28.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.311+0000 7f7331d9b640 1 --2- 172.21.15.17:0/3252465373 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f732807af30 0x7f732807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:28.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.311+0000 7f7333fff640 1 -- 172.21.15.17:0/3252465373 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f732c09d7a0 con 0x7f733c1007f0 2024-09-20T18:56:28.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.311+0000 7f7331d9b640 1 --2- 172.21.15.17:0/3252465373 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f732807af30 0x7f732807d3f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f733c1990c0 tx=0x7f7324031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:56:28.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.315+0000 7f7333fff640 1 -- 172.21.15.17:0/3252465373 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f732c021250 con 0x7f733c1007f0 2024-09-20T18:56:28.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.521+0000 7f7340b8c640 1 -- 172.21.15.17:0/3252465373 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f733c198e00 con 0x7f732807af30 2024-09-20T18:56:28.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.522+0000 7f7333fff640 1 -- 172.21.15.17:0/3252465373 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f733c198e00 con 0x7f732807af30 2024-09-20T18:56:28.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.524+0000 7f7340b8c640 1 -- 172.21.15.17:0/3252465373 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f732807af30 msgr2=0x7f732807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.524+0000 7f7340b8c640 1 --2- 172.21.15.17:0/3252465373 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f732807af30 0x7f732807d3f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f733c1990c0 tx=0x7f7324031400 comp rx=0 tx=0).stop 2024-09-20T18:56:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.524+0000 7f7340b8c640 1 -- 172.21.15.17:0/3252465373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c1007f0 msgr2=0x7f733c19d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.524+0000 7f7340b8c640 1 --2- 172.21.15.17:0/3252465373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c1007f0 0x7f733c19d710 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f732c00b420 tx=0x7f732c00b8e0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.524+0000 7f7340b8c640 1 -- 172.21.15.17:0/3252465373 shutdown_connections 2024-09-20T18:56:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.524+0000 7f7340b8c640 1 --2- 172.21.15.17:0/3252465373 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f732807af30 0x7f732807d3f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.524+0000 7f7340b8c640 1 --2- 172.21.15.17:0/3252465373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f733c1067f0 0x7f733c19dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.524+0000 7f7340b8c640 1 --2- 172.21.15.17:0/3252465373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c1007f0 0x7f733c19d710 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.524+0000 7f7340b8c640 1 -- 172.21.15.17:0/3252465373 >> 172.21.15.17:0/3252465373 conn(0x7f733c0fc550 msgr2=0x7f733c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:56:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.524+0000 7f7340b8c640 1 -- 172.21.15.17:0/3252465373 shutdown_connections 2024-09-20T18:56:28.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.524+0000 7f7340b8c640 1 -- 172.21.15.17:0/3252465373 wait complete. 2024-09-20T18:56:28.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.617+0000 7f3bde12a640 1 -- 172.21.15.17:0/1799091129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bd8102ac0 msgr2=0x7f3bd8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:28.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.617+0000 7f3bde12a640 1 --2- 172.21.15.17:0/1799091129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bd8102ac0 0x7f3bd8102ea0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8009880 tx=0x7f3bc802a530 comp rx=0 tx=0).stop 2024-09-20T18:56:28.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.617+0000 7f3bde12a640 1 -- 172.21.15.17:0/1799091129 shutdown_connections 2024-09-20T18:56:28.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.617+0000 7f3bde12a640 1 --2- 172.21.15.17:0/1799091129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bd81033e0 0x7f3bd810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.617+0000 7f3bde12a640 1 --2- 172.21.15.17:0/1799091129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bd8102ac0 0x7f3bd8102ea0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.617+0000 7f3bde12a640 1 -- 172.21.15.17:0/1799091129 >> 172.21.15.17:0/1799091129 conn(0x7f3bd80fc520 msgr2=0x7f3bd80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:56:28.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.617+0000 7f3bde12a640 1 -- 172.21.15.17:0/1799091129 shutdown_connections 2024-09-20T18:56:28.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.617+0000 7f3bde12a640 1 -- 172.21.15.17:0/1799091129 wait complete. 2024-09-20T18:56:28.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.618+0000 7f3bde12a640 1 Processor -- start 2024-09-20T18:56:28.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.618+0000 7f3bde12a640 1 -- start start 2024-09-20T18:56:28.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.618+0000 7f3bde12a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bd8102ac0 0x7f3bd819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:28.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.618+0000 7f3bde12a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bd81033e0 0x7f3bd819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:28.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.618+0000 7f3bde12a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd810edd0 con 0x7f3bd8102ac0 2024-09-20T18:56:28.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.618+0000 7f3bde12a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd810ec50 con 0x7f3bd81033e0 2024-09-20T18:56:28.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.618+0000 7f3bd77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bd8102ac0 0x7f3bd819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:28.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.618+0000 7f3bd77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bd8102ac0 0x7f3bd819d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54812/0 (socket says 172.21.15.17:54812) 2024-09-20T18:56:28.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.618+0000 7f3bd77fe640 1 -- 172.21.15.17:0/1353382565 learned_addr learned my addr 172.21.15.17:0/1353382565 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:56:28.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.619+0000 7f3bd6ffd640 1 --2- 172.21.15.17:0/1353382565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bd81033e0 0x7f3bd819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:28.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.619+0000 7f3bd77fe640 1 -- 172.21.15.17:0/1353382565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bd81033e0 msgr2=0x7f3bd819db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:28.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.619+0000 7f3bd77fe640 1 --2- 172.21.15.17:0/1353382565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bd81033e0 0x7f3bd819db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.619+0000 7f3bd77fe640 1 -- 172.21.15.17:0/1353382565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd81977c0 con 0x7f3bd8102ac0 2024-09-20T18:56:28.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.619+0000 7f3bd77fe640 1 --2- 172.21.15.17:0/1353382565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bd8102ac0 0x7f3bd819d640 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8031460 tx=0x7f3bc80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:56:28.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.619+0000 7f3bd4ff9640 1 -- 172.21.15.17:0/1353382565 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3bc803f070 con 0x7f3bd8102ac0 2024-09-20T18:56:28.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.619+0000 7f3bde12a640 1 -- 172.21.15.17:0/1353382565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd8197a50 con 0x7f3bd8102ac0 2024-09-20T18:56:28.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.619+0000 7f3bd4ff9640 1 -- 172.21.15.17:0/1353382565 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3bc8004cf0 con 0x7f3bd8102ac0 2024-09-20T18:56:28.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.619+0000 7f3bd4ff9640 1 -- 172.21.15.17:0/1353382565 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3bc8035030 con 0x7f3bd8102ac0 2024-09-20T18:56:28.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.619+0000 7f3bde12a640 1 -- 172.21.15.17:0/1353382565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd8197f80 con 0x7f3bd8102ac0 2024-09-20T18:56:28.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.620+0000 7f3bde12a640 1 -- 172.21.15.17:0/1353382565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd806aa90 con 0x7f3bd8102ac0 2024-09-20T18:56:28.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.621+0000 7f3bd4ff9640 1 -- 172.21.15.17:0/1353382565 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3bc8042070 con 0x7f3bd8102ac0 2024-09-20T18:56:28.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.621+0000 7f3bd4ff9640 1 --2- 172.21.15.17:0/1353382565 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3bc007af30 0x7f3bc007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:28.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.622+0000 7f3bd4ff9640 1 -- 172.21.15.17:0/1353382565 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f3bc80beac0 con 0x7f3bd8102ac0 2024-09-20T18:56:28.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.622+0000 7f3bd6ffd640 1 --2- 172.21.15.17:0/1353382565 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3bc007af30 0x7f3bc007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:28.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.622+0000 7f3bd6ffd640 1 --2- 172.21.15.17:0/1353382565 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3bc007af30 0x7f3bc007d3f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc005fd0 tx=0x7f3bcc005d60 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:56:28.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.626+0000 7f3bd4ff9640 1 -- 172.21.15.17:0/1353382565 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3bc808a0c0 con 0x7f3bd8102ac0 2024-09-20T18:56:28.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.823+0000 7f3bde12a640 1 -- 172.21.15.17:0/1353382565 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3bd8198cf0 con 0x7f3bc007af30 2024-09-20T18:56:28.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.833+0000 7f3bd4ff9640 1 -- 172.21.15.17:0/1353382565 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f3bd8198cf0 con 0x7f3bc007af30 2024-09-20T18:56:28.848 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:56:28.848 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (17m) 12m ago 28m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:56:28.848 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (20m) 12m ago 29m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:56:28.848 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (20m) 11m ago 28m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:56:28.848 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (16m) 12m ago 29m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:56:28.848 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (16m) 11m ago 28m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:56:28.848 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (17m) 12m ago 28m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:56:28.848 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (12m) 12m ago 23m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:56:28.848 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (12m) 12m ago 23m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:56:28.849 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (23m) 11m ago 23m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:56:28.849 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (11m) 11m ago 23m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:56:28.849 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (20m) 12m ago 30m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:56:28.849 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (19m) 11m ago 28m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:56:28.849 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (16m) 12m ago 30m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:56:28.849 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (16m) 11m ago 27m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:56:28.849 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (18m) 12m ago 28m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:56:28.849 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (18m) 11m ago 28m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:56:28.849 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (15m) 12m ago 26m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:56:28.849 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (15m) 12m ago 26m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:56:28.849 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (14m) 12m ago 25m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:56:28.849 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (13m) 11m ago 25m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:56:28.849 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (13m) 11m ago 25m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:56:28.849 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (12m) 11m ago 24m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:56:28.850 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (18m) 12m ago 28m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:56:28.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.835+0000 7f3bde12a640 1 -- 172.21.15.17:0/1353382565 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3bc007af30 msgr2=0x7f3bc007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:28.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.835+0000 7f3bde12a640 1 --2- 172.21.15.17:0/1353382565 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3bc007af30 0x7f3bc007d3f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc005fd0 tx=0x7f3bcc005d60 comp rx=0 tx=0).stop 2024-09-20T18:56:28.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.835+0000 7f3bde12a640 1 -- 172.21.15.17:0/1353382565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bd8102ac0 msgr2=0x7f3bd819d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:28.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.835+0000 7f3bde12a640 1 --2- 172.21.15.17:0/1353382565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bd8102ac0 0x7f3bd819d640 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8031460 tx=0x7f3bc80048f0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.835+0000 7f3bde12a640 1 -- 172.21.15.17:0/1353382565 shutdown_connections 2024-09-20T18:56:28.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.835+0000 7f3bde12a640 1 --2- 172.21.15.17:0/1353382565 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3bc007af30 0x7f3bc007d3f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.835+0000 7f3bde12a640 1 --2- 172.21.15.17:0/1353382565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bd81033e0 0x7f3bd819db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.835+0000 7f3bde12a640 1 --2- 172.21.15.17:0/1353382565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bd8102ac0 0x7f3bd819d640 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.835+0000 7f3bde12a640 1 -- 172.21.15.17:0/1353382565 >> 172.21.15.17:0/1353382565 conn(0x7f3bd80fc520 msgr2=0x7f3bd8108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:56:28.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.836+0000 7f3bde12a640 1 -- 172.21.15.17:0/1353382565 shutdown_connections 2024-09-20T18:56:28.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.836+0000 7f3bde12a640 1 -- 172.21.15.17:0/1353382565 wait complete. 2024-09-20T18:56:28.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.919+0000 7f7bdc4db640 1 -- 172.21.15.17:0/675409952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bd41069a0 msgr2=0x7f7bd4106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:28.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.919+0000 7f7bdc4db640 1 --2- 172.21.15.17:0/675409952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bd41069a0 0x7f7bd4106d80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009880 tx=0x7f7bd002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.919+0000 7f7bdc4db640 1 -- 172.21.15.17:0/675409952 shutdown_connections 2024-09-20T18:56:28.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.919+0000 7f7bdc4db640 1 --2- 172.21.15.17:0/675409952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bd40ffdc0 0x7f7bd4100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.919+0000 7f7bdc4db640 1 --2- 172.21.15.17:0/675409952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bd41069a0 0x7f7bd4106d80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.919+0000 7f7bdc4db640 1 -- 172.21.15.17:0/675409952 >> 172.21.15.17:0/675409952 conn(0x7f7bd40fbc90 msgr2=0x7f7bd40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:56:28.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.919+0000 7f7bdc4db640 1 -- 172.21.15.17:0/675409952 shutdown_connections 2024-09-20T18:56:28.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.920+0000 7f7bdc4db640 1 -- 172.21.15.17:0/675409952 wait complete. 2024-09-20T18:56:28.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.920+0000 7f7bdc4db640 1 Processor -- start 2024-09-20T18:56:28.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.920+0000 7f7bdc4db640 1 -- start start 2024-09-20T18:56:28.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.920+0000 7f7bdc4db640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bd40ffdc0 0x7f7bd419f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:28.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.920+0000 7f7bdc4db640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bd41069a0 0x7f7bd419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:28.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.920+0000 7f7bdc4db640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd410ef20 con 0x7f7bd41069a0 2024-09-20T18:56:28.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.920+0000 7f7bdc4db640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd410eda0 con 0x7f7bd40ffdc0 2024-09-20T18:56:28.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.921+0000 7f7bd9a76640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bd41069a0 0x7f7bd419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:28.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.921+0000 7f7bd9a76640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bd41069a0 0x7f7bd419fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54820/0 (socket says 172.21.15.17:54820) 2024-09-20T18:56:28.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.921+0000 7f7bd9a76640 1 -- 172.21.15.17:0/4044745256 learned_addr learned my addr 172.21.15.17:0/4044745256 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:56:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.921+0000 7f7bda277640 1 --2- 172.21.15.17:0/4044745256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bd40ffdc0 0x7f7bd419f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.921+0000 7f7bd9a76640 1 -- 172.21.15.17:0/4044745256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bd40ffdc0 msgr2=0x7f7bd419f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.921+0000 7f7bd9a76640 1 --2- 172.21.15.17:0/4044745256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bd40ffdc0 0x7f7bd419f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.921+0000 7f7bd9a76640 1 -- 172.21.15.17:0/4044745256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd4199a60 con 0x7f7bd41069a0 2024-09-20T18:56:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.921+0000 7f7bd9a76640 1 --2- 172.21.15.17:0/4044745256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bd41069a0 0x7f7bd419fde0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400d8d0 tx=0x7f7bc400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:56:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.921+0000 7f7bcb7fe640 1 -- 172.21.15.17:0/4044745256 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7bc4017070 con 0x7f7bd41069a0 2024-09-20T18:56:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.921+0000 7f7bcb7fe640 1 -- 172.21.15.17:0/4044745256 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7bc4010460 con 0x7f7bd41069a0 2024-09-20T18:56:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.921+0000 7f7bdc4db640 1 -- 172.21.15.17:0/4044745256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd4199d50 con 0x7f7bd41069a0 2024-09-20T18:56:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.921+0000 7f7bcb7fe640 1 -- 172.21.15.17:0/4044745256 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7bc400f5f0 con 0x7f7bd41069a0 2024-09-20T18:56:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.921+0000 7f7bdc4db640 1 -- 172.21.15.17:0/4044745256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd419a2e0 con 0x7f7bd41069a0 2024-09-20T18:56:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.923+0000 7f7bdc4db640 1 -- 172.21.15.17:0/4044745256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd41030e0 con 0x7f7bd41069a0 2024-09-20T18:56:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.923+0000 7f7bcb7fe640 1 -- 172.21.15.17:0/4044745256 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7bc4009a30 con 0x7f7bd41069a0 2024-09-20T18:56:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.924+0000 7f7bcb7fe640 1 --2- 172.21.15.17:0/4044745256 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7bc007af30 0x7f7bc007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.924+0000 7f7bcb7fe640 1 -- 172.21.15.17:0/4044745256 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f7bc409de30 con 0x7f7bd41069a0 2024-09-20T18:56:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.924+0000 7f7bda277640 1 --2- 172.21.15.17:0/4044745256 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7bc007af30 0x7f7bc007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.924+0000 7f7bda277640 1 --2- 172.21.15.17:0/4044745256 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7bc007af30 0x7f7bc007d3f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0000c00 tx=0x7f7bd0031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:56:28.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:28.928+0000 7f7bcb7fe640 1 -- 172.21.15.17:0/4044745256 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7bc4069430 con 0x7f7bd41069a0 2024-09-20T18:56:29.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.193+0000 7f7bdc4db640 1 -- 172.21.15.17:0/4044745256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7bd419af90 con 0x7f7bd41069a0 2024-09-20T18:56:29.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.193+0000 7f7bcb7fe640 1 -- 172.21.15.17:0/4044745256 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f7bc406e2e0 con 0x7f7bd41069a0 2024-09-20T18:56:29.208 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:56:29.208 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:56:29.208 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:56:29.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:56:29.208 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:56:29.208 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:56:29.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:56:29.209 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:56:29.209 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:56:29.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:56:29.209 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:56:29.209 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:56:29.209 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:56:29.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:56:29.209 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:56:29.209 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:56:29.209 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:56:29.209 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:56:29.209 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:56:29.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.195+0000 7f7bdc4db640 1 -- 172.21.15.17:0/4044745256 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7bc007af30 msgr2=0x7f7bc007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:29.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.195+0000 7f7bdc4db640 1 --2- 172.21.15.17:0/4044745256 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7bc007af30 0x7f7bc007d3f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0000c00 tx=0x7f7bd0031400 comp rx=0 tx=0).stop 2024-09-20T18:56:29.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.195+0000 7f7bdc4db640 1 -- 172.21.15.17:0/4044745256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bd41069a0 msgr2=0x7f7bd419fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:29.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.195+0000 7f7bdc4db640 1 --2- 172.21.15.17:0/4044745256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bd41069a0 0x7f7bd419fde0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400d8d0 tx=0x7f7bc400dd90 comp rx=0 tx=0).stop 2024-09-20T18:56:29.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.196+0000 7f7bdc4db640 1 -- 172.21.15.17:0/4044745256 shutdown_connections 2024-09-20T18:56:29.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.196+0000 7f7bdc4db640 1 --2- 172.21.15.17:0/4044745256 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7bc007af30 0x7f7bc007d3f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.196+0000 7f7bdc4db640 1 --2- 172.21.15.17:0/4044745256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bd41069a0 0x7f7bd419fde0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.196+0000 7f7bdc4db640 1 --2- 172.21.15.17:0/4044745256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bd40ffdc0 0x7f7bd419f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.196+0000 7f7bdc4db640 1 -- 172.21.15.17:0/4044745256 >> 172.21.15.17:0/4044745256 conn(0x7f7bd40fbc90 msgr2=0x7f7bd4100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:56:29.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.196+0000 7f7bdc4db640 1 -- 172.21.15.17:0/4044745256 shutdown_connections 2024-09-20T18:56:29.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.196+0000 7f7bdc4db640 1 -- 172.21.15.17:0/4044745256 wait complete. 2024-09-20T18:56:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.280+0000 7f688524a640 1 -- 172.21.15.17:0/2099129744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6880102b60 msgr2=0x7f6880102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.280+0000 7f688524a640 1 --2- 172.21.15.17:0/2099129744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6880102b60 0x7f6880102f40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6870009880 tx=0x7f687002a530 comp rx=0 tx=0).stop 2024-09-20T18:56:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.280+0000 7f688524a640 1 -- 172.21.15.17:0/2099129744 shutdown_connections 2024-09-20T18:56:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.280+0000 7f688524a640 1 --2- 172.21.15.17:0/2099129744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6880103480 0x7f688010b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.280+0000 7f688524a640 1 --2- 172.21.15.17:0/2099129744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6880102b60 0x7f6880102f40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.280+0000 7f688524a640 1 -- 172.21.15.17:0/2099129744 >> 172.21.15.17:0/2099129744 conn(0x7f68800fc520 msgr2=0x7f68800fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:56:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.280+0000 7f688524a640 1 -- 172.21.15.17:0/2099129744 shutdown_connections 2024-09-20T18:56:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.280+0000 7f688524a640 1 -- 172.21.15.17:0/2099129744 wait complete. 2024-09-20T18:56:29.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.281+0000 7f688524a640 1 Processor -- start 2024-09-20T18:56:29.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.281+0000 7f688524a640 1 -- start start 2024-09-20T18:56:29.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.281+0000 7f688524a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6880102b60 0x7f688019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:29.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.281+0000 7f688524a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6880103480 0x7f688019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:29.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.281+0000 7f688524a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f688010edd0 con 0x7f6880102b60 2024-09-20T18:56:29.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.281+0000 7f688524a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f688010ec50 con 0x7f6880103480 2024-09-20T18:56:29.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.282+0000 7f687ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6880102b60 0x7f688019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:29.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.282+0000 7f687ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6880102b60 0x7f688019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54840/0 (socket says 172.21.15.17:54840) 2024-09-20T18:56:29.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.282+0000 7f687ed9d640 1 -- 172.21.15.17:0/2743370967 learned_addr learned my addr 172.21.15.17:0/2743370967 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:56:29.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.282+0000 7f687e59c640 1 --2- 172.21.15.17:0/2743370967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6880103480 0x7f688019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:29.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.282+0000 7f687ed9d640 1 -- 172.21.15.17:0/2743370967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6880103480 msgr2=0x7f688019dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:29.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.282+0000 7f687ed9d640 1 --2- 172.21.15.17:0/2743370967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6880103480 0x7f688019dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.282+0000 7f687ed9d640 1 -- 172.21.15.17:0/2743370967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68801977e0 con 0x7f6880102b60 2024-09-20T18:56:29.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.282+0000 7f687ed9d640 1 --2- 172.21.15.17:0/2743370967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6880102b60 0x7f688019d660 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6870004f90 tx=0x7f68700048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:56:29.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.282+0000 7f6867fff640 1 -- 172.21.15.17:0/2743370967 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f687003f070 con 0x7f6880102b60 2024-09-20T18:56:29.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.282+0000 7f6867fff640 1 -- 172.21.15.17:0/2743370967 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6870004c70 con 0x7f6880102b60 2024-09-20T18:56:29.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.282+0000 7f6867fff640 1 -- 172.21.15.17:0/2743370967 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6870035030 con 0x7f6880102b60 2024-09-20T18:56:29.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.282+0000 7f688524a640 1 -- 172.21.15.17:0/2743370967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6880197a70 con 0x7f6880102b60 2024-09-20T18:56:29.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.282+0000 7f688524a640 1 -- 172.21.15.17:0/2743370967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6880197fa0 con 0x7f6880102b60 2024-09-20T18:56:29.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.284+0000 7f688524a640 1 -- 172.21.15.17:0/2743370967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f688006a9f0 con 0x7f6880102b60 2024-09-20T18:56:29.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.284+0000 7f6867fff640 1 -- 172.21.15.17:0/2743370967 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6870042070 con 0x7f6880102b60 2024-09-20T18:56:29.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.285+0000 7f6867fff640 1 --2- 172.21.15.17:0/2743370967 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f686807af30 0x7f686807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:29.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.285+0000 7f687e59c640 1 --2- 172.21.15.17:0/2743370967 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f686807af30 0x7f686807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:29.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.285+0000 7f6867fff640 1 -- 172.21.15.17:0/2743370967 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f68700bea30 con 0x7f6880102b60 2024-09-20T18:56:29.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.285+0000 7f687e59c640 1 --2- 172.21.15.17:0/2743370967 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f686807af30 0x7f686807d3f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6874005fd0 tx=0x7f6874005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:56:29.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.289+0000 7f6867fff640 1 -- 172.21.15.17:0/2743370967 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f687008a030 con 0x7f6880102b60 2024-09-20T18:56:29.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.515+0000 7f688524a640 1 -- 172.21.15.17:0/2743370967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6880105fc0 con 0x7f6880102b60 2024-09-20T18:56:29.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.516+0000 7f6867fff640 1 -- 172.21.15.17:0/2743370967 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f687008eee0 con 0x7f6880102b60 2024-09-20T18:56:29.530 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:56:29.530 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:56:29.530 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:56:29.530 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:56:29.531 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:56:29.531 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:56:29.531 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:56:29.531 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:56:29.531 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:56:29.531 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:56:29.531 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:56:29.531 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:56:29.531 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:56:29.531 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:56:29.531 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:56:29.531 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:56:29.531 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:56:29.531 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:56:29.532 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:56:29.532 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:56:29.532 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:56:29.532 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:56:29.532 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:56:29.532 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:56:29.532 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:56:29.532 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:56:29.532 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:56:29.532 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:56:29.532 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:56:29.532 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:56:29.532 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:56:29.532 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:56:29.533 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:56:29.533 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:56:29.533 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:56:29.533 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:56:29.533 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:56:29.533 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:56:29.533 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:56:29.533 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:56:29.533 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:56:29.533 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:56:29.533 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:56:29.534 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:56:29.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.518+0000 7f688524a640 1 -- 172.21.15.17:0/2743370967 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f686807af30 msgr2=0x7f686807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:29.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.518+0000 7f688524a640 1 --2- 172.21.15.17:0/2743370967 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f686807af30 0x7f686807d3f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6874005fd0 tx=0x7f6874005850 comp rx=0 tx=0).stop 2024-09-20T18:56:29.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.518+0000 7f688524a640 1 -- 172.21.15.17:0/2743370967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6880102b60 msgr2=0x7f688019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:29.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.518+0000 7f688524a640 1 --2- 172.21.15.17:0/2743370967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6880102b60 0x7f688019d660 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6870004f90 tx=0x7f68700048f0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.518+0000 7f688524a640 1 -- 172.21.15.17:0/2743370967 shutdown_connections 2024-09-20T18:56:29.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.518+0000 7f688524a640 1 --2- 172.21.15.17:0/2743370967 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f686807af30 0x7f686807d3f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.518+0000 7f688524a640 1 --2- 172.21.15.17:0/2743370967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6880103480 0x7f688019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.518+0000 7f688524a640 1 --2- 172.21.15.17:0/2743370967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6880102b60 0x7f688019d660 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.518+0000 7f688524a640 1 -- 172.21.15.17:0/2743370967 >> 172.21.15.17:0/2743370967 conn(0x7f68800fc520 msgr2=0x7f6880108f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:56:29.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.518+0000 7f688524a640 1 -- 172.21.15.17:0/2743370967 shutdown_connections 2024-09-20T18:56:29.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.518+0000 7f688524a640 1 -- 172.21.15.17:0/2743370967 wait complete. 2024-09-20T18:56:29.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.604+0000 7fc36daef640 1 -- 172.21.15.17:0/2402864844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc368102ac0 msgr2=0x7fc368102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:29.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.604+0000 7fc36daef640 1 --2- 172.21.15.17:0/2402864844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc368102ac0 0x7fc368102ea0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc358009880 tx=0x7fc35802a530 comp rx=0 tx=0).stop 2024-09-20T18:56:29.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.604+0000 7fc36daef640 1 -- 172.21.15.17:0/2402864844 shutdown_connections 2024-09-20T18:56:29.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.604+0000 7fc36daef640 1 --2- 172.21.15.17:0/2402864844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3681033e0 0x7fc36810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.604+0000 7fc36daef640 1 --2- 172.21.15.17:0/2402864844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc368102ac0 0x7fc368102ea0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.604+0000 7fc36daef640 1 -- 172.21.15.17:0/2402864844 >> 172.21.15.17:0/2402864844 conn(0x7fc3680fc520 msgr2=0x7fc3680fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:56:29.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.604+0000 7fc36daef640 1 -- 172.21.15.17:0/2402864844 shutdown_connections 2024-09-20T18:56:29.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.604+0000 7fc36daef640 1 -- 172.21.15.17:0/2402864844 wait complete. 2024-09-20T18:56:29.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.604+0000 7fc36daef640 1 Processor -- start 2024-09-20T18:56:29.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.605+0000 7fc36daef640 1 -- start start 2024-09-20T18:56:29.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.605+0000 7fc36daef640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc368102ac0 0x7fc36819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:29.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.605+0000 7fc36daef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3681033e0 0x7fc36819dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:29.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.605+0000 7fc36daef640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc36810edd0 con 0x7fc3681033e0 2024-09-20T18:56:29.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.605+0000 7fc36daef640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc36810ec50 con 0x7fc368102ac0 2024-09-20T18:56:29.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.605+0000 7fc366ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3681033e0 0x7fc36819dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:29.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.605+0000 7fc366ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3681033e0 0x7fc36819dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54860/0 (socket says 172.21.15.17:54860) 2024-09-20T18:56:29.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.605+0000 7fc366ffd640 1 -- 172.21.15.17:0/232156564 learned_addr learned my addr 172.21.15.17:0/232156564 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:56:29.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.605+0000 7fc3677fe640 1 --2- 172.21.15.17:0/232156564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc368102ac0 0x7fc36819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:29.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.605+0000 7fc366ffd640 1 -- 172.21.15.17:0/232156564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc368102ac0 msgr2=0x7fc36819d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:29.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.605+0000 7fc366ffd640 1 --2- 172.21.15.17:0/232156564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc368102ac0 0x7fc36819d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.605+0000 7fc366ffd640 1 -- 172.21.15.17:0/232156564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3681978e0 con 0x7fc3681033e0 2024-09-20T18:56:29.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.605+0000 7fc366ffd640 1 --2- 172.21.15.17:0/232156564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3681033e0 0x7fc36819dc60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc35c00d6c0 tx=0x7fc35c00db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:56:29.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.606+0000 7fc364ff9640 1 -- 172.21.15.17:0/232156564 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc35c017070 con 0x7fc3681033e0 2024-09-20T18:56:29.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.606+0000 7fc36daef640 1 -- 172.21.15.17:0/232156564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc368197bd0 con 0x7fc3681033e0 2024-09-20T18:56:29.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.606+0000 7fc364ff9640 1 -- 172.21.15.17:0/232156564 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc35c009ce0 con 0x7fc3681033e0 2024-09-20T18:56:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.606+0000 7fc364ff9640 1 -- 172.21.15.17:0/232156564 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc35c00f3c0 con 0x7fc3681033e0 2024-09-20T18:56:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.606+0000 7fc36daef640 1 -- 172.21.15.17:0/232156564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc368198160 con 0x7fc3681033e0 2024-09-20T18:56:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.607+0000 7fc36daef640 1 -- 172.21.15.17:0/232156564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc36806aa90 con 0x7fc3681033e0 2024-09-20T18:56:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.607+0000 7fc364ff9640 1 -- 172.21.15.17:0/232156564 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc35c010460 con 0x7fc3681033e0 2024-09-20T18:56:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.608+0000 7fc364ff9640 1 --2- 172.21.15.17:0/232156564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc35007af40 0x7fc35007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.608+0000 7fc3677fe640 1 --2- 172.21.15.17:0/232156564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc35007af40 0x7fc35007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.608+0000 7fc364ff9640 1 -- 172.21.15.17:0/232156564 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fc35c09dde0 con 0x7fc3681033e0 2024-09-20T18:56:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.609+0000 7fc3677fe640 1 --2- 172.21.15.17:0/232156564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc35007af40 0x7fc35007d400 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc358000c00 tx=0x7fc358031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:56:29.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.612+0000 7fc364ff9640 1 -- 172.21.15.17:0/232156564 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc35c0693e0 con 0x7fc3681033e0 2024-09-20T18:56:29.825 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:29 smithi017 ceph-mon[108970]: from='client.34986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:56:29.825 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:29 smithi017 ceph-mon[108970]: from='client.34990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:56:29.825 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:29 smithi017 ceph-mon[108970]: pgmap v632: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:29.825 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:29 smithi017 ceph-mon[108970]: from='client.34994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:56:29.825 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:29 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4044745256' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:56:29.825 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:29 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2743370967' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:56:29.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.820+0000 7fc36daef640 1 -- 172.21.15.17:0/232156564 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc368106000 con 0x7fc35007af40 2024-09-20T18:56:29.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.821+0000 7fc364ff9640 1 -- 172.21.15.17:0/232156564 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fc358004360 con 0x7fc35007af40 2024-09-20T18:56:29.835 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:56:29.835 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:56:29.835 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:56:29.835 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:56:29.835 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:56:29.836 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:56:29.836 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:56:29.836 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:56:29.836 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:56:29.836 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:56:29.836 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:56:29.836 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:56:29.836 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:56:29.836 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:56:29.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.823+0000 7fc36daef640 1 -- 172.21.15.17:0/232156564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc35007af40 msgr2=0x7fc35007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.823+0000 7fc36daef640 1 --2- 172.21.15.17:0/232156564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc35007af40 0x7fc35007d400 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc358000c00 tx=0x7fc358031400 comp rx=0 tx=0).stop 2024-09-20T18:56:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.823+0000 7fc36daef640 1 -- 172.21.15.17:0/232156564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3681033e0 msgr2=0x7fc36819dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.823+0000 7fc36daef640 1 --2- 172.21.15.17:0/232156564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3681033e0 0x7fc36819dc60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc35c00d6c0 tx=0x7fc35c00db80 comp rx=0 tx=0).stop 2024-09-20T18:56:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.823+0000 7fc36daef640 1 -- 172.21.15.17:0/232156564 shutdown_connections 2024-09-20T18:56:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.823+0000 7fc36daef640 1 --2- 172.21.15.17:0/232156564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc35007af40 0x7fc35007d400 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.823+0000 7fc36daef640 1 --2- 172.21.15.17:0/232156564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3681033e0 0x7fc36819dc60 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.823+0000 7fc36daef640 1 --2- 172.21.15.17:0/232156564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc368102ac0 0x7fc36819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.823+0000 7fc36daef640 1 -- 172.21.15.17:0/232156564 >> 172.21.15.17:0/232156564 conn(0x7fc3680fc520 msgr2=0x7fc368108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:56:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.823+0000 7fc36daef640 1 -- 172.21.15.17:0/232156564 shutdown_connections 2024-09-20T18:56:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.823+0000 7fc36daef640 1 -- 172.21.15.17:0/232156564 wait complete. 2024-09-20T18:56:29.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.910+0000 7f750f691640 1 -- 172.21.15.17:0/2587808306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75081007f0 msgr2=0x7f7508100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:29.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.910+0000 7f750f691640 1 --2- 172.21.15.17:0/2587808306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75081007f0 0x7f7508100c50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f74f8009880 tx=0x7f74f802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.910+0000 7f750f691640 1 -- 172.21.15.17:0/2587808306 shutdown_connections 2024-09-20T18:56:29.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.910+0000 7f750f691640 1 --2- 172.21.15.17:0/2587808306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75081007f0 0x7f7508100c50 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.910+0000 7f750f691640 1 --2- 172.21.15.17:0/2587808306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75081067f0 0x7f7508106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.910+0000 7f750f691640 1 -- 172.21.15.17:0/2587808306 >> 172.21.15.17:0/2587808306 conn(0x7f75080fc550 msgr2=0x7f75080fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:56:29.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.911+0000 7f750f691640 1 -- 172.21.15.17:0/2587808306 shutdown_connections 2024-09-20T18:56:29.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.911+0000 7f750f691640 1 -- 172.21.15.17:0/2587808306 wait complete. 2024-09-20T18:56:29.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.911+0000 7f750f691640 1 Processor -- start 2024-09-20T18:56:29.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.911+0000 7f750f691640 1 -- start start 2024-09-20T18:56:29.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.911+0000 7f750f691640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75081007f0 0x7f75081987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:29.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.911+0000 7f750f691640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75081067f0 0x7f7508198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:29.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.911+0000 7f750f691640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f750810dcc0 con 0x7f75081067f0 2024-09-20T18:56:29.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.911+0000 7f750f691640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f750810db40 con 0x7f75081007f0 2024-09-20T18:56:29.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.912+0000 7f750cc2c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75081067f0 0x7f7508198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:29.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.912+0000 7f750cc2c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75081067f0 0x7f7508198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54870/0 (socket says 172.21.15.17:54870) 2024-09-20T18:56:29.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.912+0000 7f750cc2c640 1 -- 172.21.15.17:0/645278475 learned_addr learned my addr 172.21.15.17:0/645278475 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:56:29.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.912+0000 7f750d42d640 1 --2- 172.21.15.17:0/645278475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75081007f0 0x7f75081987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:29.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.912+0000 7f750cc2c640 1 -- 172.21.15.17:0/645278475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75081007f0 msgr2=0x7f75081987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:29.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.912+0000 7f750cc2c640 1 --2- 172.21.15.17:0/645278475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75081007f0 0x7f75081987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:29.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.912+0000 7f750cc2c640 1 -- 172.21.15.17:0/645278475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7508199340 con 0x7f75081067f0 2024-09-20T18:56:29.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.912+0000 7f750cc2c640 1 --2- 172.21.15.17:0/645278475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75081067f0 0x7f7508198cf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f74f8031460 tx=0x7f74f80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:56:29.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.912+0000 7f74fe7fc640 1 -- 172.21.15.17:0/645278475 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f74f803f070 con 0x7f75081067f0 2024-09-20T18:56:29.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.912+0000 7f74fe7fc640 1 -- 172.21.15.17:0/645278475 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f74f80035f0 con 0x7f75081067f0 2024-09-20T18:56:29.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.912+0000 7f750f691640 1 -- 172.21.15.17:0/645278475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75081995d0 con 0x7f75081067f0 2024-09-20T18:56:29.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.912+0000 7f74fe7fc640 1 -- 172.21.15.17:0/645278475 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f74f8035030 con 0x7f75081067f0 2024-09-20T18:56:29.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.912+0000 7f750f691640 1 -- 172.21.15.17:0/645278475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75081a1b80 con 0x7f75081067f0 2024-09-20T18:56:29.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.913+0000 7f750f691640 1 -- 172.21.15.17:0/645278475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7508101f30 con 0x7f75081067f0 2024-09-20T18:56:29.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.914+0000 7f74fe7fc640 1 -- 172.21.15.17:0/645278475 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f74f8042070 con 0x7f75081067f0 2024-09-20T18:56:29.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.915+0000 7f74fe7fc640 1 --2- 172.21.15.17:0/645278475 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f74f407af80 0x7f74f407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:56:29.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.915+0000 7f74fe7fc640 1 -- 172.21.15.17:0/645278475 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f74f80be860 con 0x7f75081067f0 2024-09-20T18:56:29.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.915+0000 7f750d42d640 1 --2- 172.21.15.17:0/645278475 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f74f407af80 0x7f74f407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:56:29.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.915+0000 7f750d42d640 1 --2- 172.21.15.17:0/645278475 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f74f407af80 0x7f74f407d440 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7504005fd0 tx=0x7f750400b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:56:29.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:29.919+0000 7f74fe7fc640 1 -- 172.21.15.17:0/645278475 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f74f8089ee0 con 0x7f75081067f0 2024-09-20T18:56:30.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:30.182+0000 7f750f691640 1 -- 172.21.15.17:0/645278475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f7508108d60 con 0x7f75081067f0 2024-09-20T18:56:30.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:30.182+0000 7f74fe7fc640 1 -- 172.21.15.17:0/645278475 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f74f808ed90 con 0x7f75081067f0 2024-09-20T18:56:30.197 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:56:30.197 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:56:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:56:30.197 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:56:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:56:30.197 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:56:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:56:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:30.185+0000 7f750f691640 1 -- 172.21.15.17:0/645278475 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f74f407af80 msgr2=0x7f74f407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:30.185+0000 7f750f691640 1 --2- 172.21.15.17:0/645278475 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f74f407af80 0x7f74f407d440 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7504005fd0 tx=0x7f750400b390 comp rx=0 tx=0).stop 2024-09-20T18:56:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:30.185+0000 7f750f691640 1 -- 172.21.15.17:0/645278475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75081067f0 msgr2=0x7f7508198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:56:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:30.185+0000 7f750f691640 1 --2- 172.21.15.17:0/645278475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75081067f0 0x7f7508198cf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f74f8031460 tx=0x7f74f80045e0 comp rx=0 tx=0).stop 2024-09-20T18:56:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:30.185+0000 7f750f691640 1 -- 172.21.15.17:0/645278475 shutdown_connections 2024-09-20T18:56:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:30.185+0000 7f750f691640 1 --2- 172.21.15.17:0/645278475 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f74f407af80 0x7f74f407d440 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:30.185+0000 7f750f691640 1 --2- 172.21.15.17:0/645278475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75081067f0 0x7f7508198cf0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:30.185+0000 7f750f691640 1 --2- 172.21.15.17:0/645278475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75081007f0 0x7f75081987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:56:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:30.185+0000 7f750f691640 1 -- 172.21.15.17:0/645278475 >> 172.21.15.17:0/645278475 conn(0x7f75080fc550 msgr2=0x7f75080fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:56:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:30.185+0000 7f750f691640 1 -- 172.21.15.17:0/645278475 shutdown_connections 2024-09-20T18:56:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:56:30.185+0000 7f750f691640 1 -- 172.21.15.17:0/645278475 wait complete. 2024-09-20T18:56:30.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:29 smithi172 ceph-mon[80431]: from='client.34986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:56:30.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:29 smithi172 ceph-mon[80431]: from='client.34990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:56:30.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:29 smithi172 ceph-mon[80431]: pgmap v632: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:30.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:29 smithi172 ceph-mon[80431]: from='client.34994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:56:30.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:29 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4044745256' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:56:30.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:29 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2743370967' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:56:31.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:30 smithi017 ceph-mon[108970]: from='client.35006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:56:31.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:30 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/645278475' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:56:31.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:30 smithi172 ceph-mon[80431]: from='client.35006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:56:31.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:30 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/645278475' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:56:31.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:31 smithi017 ceph-mon[108970]: pgmap v633: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:32.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:31 smithi172 ceph-mon[80431]: pgmap v633: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:34.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:33 smithi017 ceph-mon[108970]: pgmap v634: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:34.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:33 smithi172 ceph-mon[80431]: pgmap v634: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:36.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:35 smithi017 ceph-mon[108970]: pgmap v635: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:36.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:35 smithi172 ceph-mon[80431]: pgmap v635: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:37.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:37 smithi017 ceph-mon[108970]: pgmap v636: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:37.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:56:37.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:37 smithi172 ceph-mon[80431]: pgmap v636: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:37.958 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:56:40.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:39 smithi017 ceph-mon[108970]: pgmap v637: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:40.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:39 smithi172 ceph-mon[80431]: pgmap v637: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:42.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:41 smithi017 ceph-mon[108970]: pgmap v638: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:42.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:41 smithi172 ceph-mon[80431]: pgmap v638: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:43.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:43 smithi017 ceph-mon[108970]: pgmap v639: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:44.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:43 smithi172 ceph-mon[80431]: pgmap v639: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:46.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:45 smithi017 ceph-mon[108970]: pgmap v640: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:46.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:45 smithi172 ceph-mon[80431]: pgmap v640: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:48.149 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:47 smithi017 ceph-mon[108970]: pgmap v641: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:48.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:47 smithi172 ceph-mon[80431]: pgmap v641: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:49.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:49 smithi017 ceph-mon[108970]: pgmap v642: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:50.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:49 smithi172 ceph-mon[80431]: pgmap v642: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:52.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:51 smithi017 ceph-mon[108970]: pgmap v643: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:52.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:51 smithi172 ceph-mon[80431]: pgmap v643: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:52.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:56:53.109 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:56:54.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:53 smithi017 ceph-mon[108970]: pgmap v644: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:54.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:53 smithi172 ceph-mon[80431]: pgmap v644: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:55.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:55 smithi017 ceph-mon[108970]: pgmap v645: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:56.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:55 smithi172 ceph-mon[80431]: pgmap v645: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:58.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:57 smithi017 ceph-mon[108970]: pgmap v646: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:56:58.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:57 smithi172 ceph-mon[80431]: pgmap v646: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:00.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:56:59 smithi017 ceph-mon[108970]: pgmap v647: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:00.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:56:59 smithi172 ceph-mon[80431]: pgmap v647: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:00.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.285+0000 7f4b9867e640 1 -- 172.21.15.17:0/1287976614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b901007f0 msgr2=0x7f4b90100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:00.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.285+0000 7f4b9867e640 1 --2- 172.21.15.17:0/1287976614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b901007f0 0x7f4b90100c50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009880 tx=0x7f4b8002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:57:00.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.285+0000 7f4b9867e640 1 -- 172.21.15.17:0/1287976614 shutdown_connections 2024-09-20T18:57:00.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.285+0000 7f4b9867e640 1 --2- 172.21.15.17:0/1287976614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b901007f0 0x7f4b90100c50 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:00.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.285+0000 7f4b9867e640 1 --2- 172.21.15.17:0/1287976614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b901067f0 0x7f4b90106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:00.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.285+0000 7f4b9867e640 1 -- 172.21.15.17:0/1287976614 >> 172.21.15.17:0/1287976614 conn(0x7f4b900fc550 msgr2=0x7f4b900fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:00.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.285+0000 7f4b9867e640 1 -- 172.21.15.17:0/1287976614 shutdown_connections 2024-09-20T18:57:00.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.285+0000 7f4b9867e640 1 -- 172.21.15.17:0/1287976614 wait complete. 2024-09-20T18:57:00.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.286+0000 7f4b9867e640 1 Processor -- start 2024-09-20T18:57:00.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.286+0000 7f4b9867e640 1 -- start start 2024-09-20T18:57:00.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.286+0000 7f4b9867e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b901007f0 0x7f4b9019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:00.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.286+0000 7f4b9867e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b901067f0 0x7f4b9019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:00.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.286+0000 7f4b9867e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9010dcc0 con 0x7f4b901007f0 2024-09-20T18:57:00.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.286+0000 7f4b9867e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9010db40 con 0x7f4b901067f0 2024-09-20T18:57:00.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.286+0000 7f4b9641a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b901007f0 0x7f4b9019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:00.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.286+0000 7f4b9641a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b901007f0 0x7f4b9019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38864/0 (socket says 172.21.15.17:38864) 2024-09-20T18:57:00.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.286+0000 7f4b9641a640 1 -- 172.21.15.17:0/240304912 learned_addr learned my addr 172.21.15.17:0/240304912 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:57:00.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.286+0000 7f4b95c19640 1 --2- 172.21.15.17:0/240304912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b901067f0 0x7f4b9019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:00.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.286+0000 7f4b9641a640 1 -- 172.21.15.17:0/240304912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b901067f0 msgr2=0x7f4b9019dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:00.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.286+0000 7f4b9641a640 1 --2- 172.21.15.17:0/240304912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b901067f0 0x7f4b9019dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:00.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.286+0000 7f4b9641a640 1 -- 172.21.15.17:0/240304912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b901977e0 con 0x7f4b901007f0 2024-09-20T18:57:00.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.287+0000 7f4b9641a640 1 --2- 172.21.15.17:0/240304912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b901007f0 0x7f4b9019d660 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00d6f0 tx=0x7f4b8c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:00.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.287+0000 7f4b877fe640 1 -- 172.21.15.17:0/240304912 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b8c017070 con 0x7f4b901007f0 2024-09-20T18:57:00.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.287+0000 7f4b877fe640 1 -- 172.21.15.17:0/240304912 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b8c00de00 con 0x7f4b901007f0 2024-09-20T18:57:00.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.287+0000 7f4b9867e640 1 -- 172.21.15.17:0/240304912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b90197ad0 con 0x7f4b901007f0 2024-09-20T18:57:00.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.287+0000 7f4b877fe640 1 -- 172.21.15.17:0/240304912 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b8c004bb0 con 0x7f4b901007f0 2024-09-20T18:57:00.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.287+0000 7f4b9867e640 1 -- 172.21.15.17:0/240304912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b90198030 con 0x7f4b901007f0 2024-09-20T18:57:00.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.288+0000 7f4b9867e640 1 -- 172.21.15.17:0/240304912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b90101f30 con 0x7f4b901007f0 2024-09-20T18:57:00.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.289+0000 7f4b877fe640 1 -- 172.21.15.17:0/240304912 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4b8c009a30 con 0x7f4b901007f0 2024-09-20T18:57:00.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.289+0000 7f4b877fe640 1 --2- 172.21.15.17:0/240304912 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4b7c07af80 0x7f4b7c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:00.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.290+0000 7f4b877fe640 1 -- 172.21.15.17:0/240304912 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f4b8c09db40 con 0x7f4b901007f0 2024-09-20T18:57:00.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.290+0000 7f4b95c19640 1 --2- 172.21.15.17:0/240304912 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4b7c07af80 0x7f4b7c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:00.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.290+0000 7f4b95c19640 1 --2- 172.21.15.17:0/240304912 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4b7c07af80 0x7f4b7c07d440 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4b90198b30 tx=0x7f4b80031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:00.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.295+0000 7f4b877fe640 1 -- 172.21.15.17:0/240304912 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b8c069120 con 0x7f4b901007f0 2024-09-20T18:57:00.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.515+0000 7f4b9867e640 1 -- 172.21.15.17:0/240304912 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4b901983a0 con 0x7f4b7c07af80 2024-09-20T18:57:00.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.516+0000 7f4b877fe640 1 -- 172.21.15.17:0/240304912 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f4b901983a0 con 0x7f4b7c07af80 2024-09-20T18:57:00.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.518+0000 7f4b9867e640 1 -- 172.21.15.17:0/240304912 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4b7c07af80 msgr2=0x7f4b7c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:00.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.518+0000 7f4b9867e640 1 --2- 172.21.15.17:0/240304912 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4b7c07af80 0x7f4b7c07d440 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4b90198b30 tx=0x7f4b80031400 comp rx=0 tx=0).stop 2024-09-20T18:57:00.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.518+0000 7f4b9867e640 1 -- 172.21.15.17:0/240304912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b901007f0 msgr2=0x7f4b9019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:00.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.518+0000 7f4b9867e640 1 --2- 172.21.15.17:0/240304912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b901007f0 0x7f4b9019d660 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00d6f0 tx=0x7f4b8c00dbb0 comp rx=0 tx=0).stop 2024-09-20T18:57:00.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.518+0000 7f4b9867e640 1 -- 172.21.15.17:0/240304912 shutdown_connections 2024-09-20T18:57:00.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.518+0000 7f4b9867e640 1 --2- 172.21.15.17:0/240304912 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4b7c07af80 0x7f4b7c07d440 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:00.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.518+0000 7f4b9867e640 1 --2- 172.21.15.17:0/240304912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b901067f0 0x7f4b9019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:00.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.518+0000 7f4b9867e640 1 --2- 172.21.15.17:0/240304912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b901007f0 0x7f4b9019d660 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:00.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.518+0000 7f4b9867e640 1 -- 172.21.15.17:0/240304912 >> 172.21.15.17:0/240304912 conn(0x7f4b900fc550 msgr2=0x7f4b90069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:00.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.518+0000 7f4b9867e640 1 -- 172.21.15.17:0/240304912 shutdown_connections 2024-09-20T18:57:00.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.518+0000 7f4b9867e640 1 -- 172.21.15.17:0/240304912 wait complete. 2024-09-20T18:57:00.539 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:57:00.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.604+0000 7f80b39c3640 1 -- 172.21.15.17:0/1935921079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac1033d0 msgr2=0x7f80ac10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:00.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.604+0000 7f80b39c3640 1 --2- 172.21.15.17:0/1935921079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac1033d0 0x7f80ac10b8c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f809c009880 tx=0x7f809c02a530 comp rx=0 tx=0).stop 2024-09-20T18:57:00.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.604+0000 7f80b39c3640 1 -- 172.21.15.17:0/1935921079 shutdown_connections 2024-09-20T18:57:00.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.604+0000 7f80b39c3640 1 --2- 172.21.15.17:0/1935921079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac1033d0 0x7f80ac10b8c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:00.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.604+0000 7f80b39c3640 1 --2- 172.21.15.17:0/1935921079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80ac102ab0 0x7f80ac102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:00.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.604+0000 7f80b39c3640 1 -- 172.21.15.17:0/1935921079 >> 172.21.15.17:0/1935921079 conn(0x7f80ac0fc550 msgr2=0x7f80ac0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:00.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.604+0000 7f80b39c3640 1 -- 172.21.15.17:0/1935921079 shutdown_connections 2024-09-20T18:57:00.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.604+0000 7f80b39c3640 1 -- 172.21.15.17:0/1935921079 wait complete. 2024-09-20T18:57:00.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.604+0000 7f80b39c3640 1 Processor -- start 2024-09-20T18:57:00.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.604+0000 7f80b39c3640 1 -- start start 2024-09-20T18:57:00.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.605+0000 7f80b39c3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80ac102ab0 0x7f80ac100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:00.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.605+0000 7f80b39c3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac1033d0 0x7f80ac100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:00.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.605+0000 7f80b39c3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac10ede0 con 0x7f80ac1033d0 2024-09-20T18:57:00.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.605+0000 7f80b39c3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac10ec60 con 0x7f80ac102ab0 2024-09-20T18:57:00.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.605+0000 7f80b0f5e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac1033d0 0x7f80ac100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:00.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.605+0000 7f80b0f5e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac1033d0 0x7f80ac100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50706/0 (socket says 172.21.15.17:50706) 2024-09-20T18:57:00.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.605+0000 7f80b0f5e640 1 -- 172.21.15.17:0/1954666206 learned_addr learned my addr 172.21.15.17:0/1954666206 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:57:00.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.605+0000 7f80b175f640 1 --2- 172.21.15.17:0/1954666206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80ac102ab0 0x7f80ac100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:00.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.605+0000 7f80b0f5e640 1 -- 172.21.15.17:0/1954666206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80ac102ab0 msgr2=0x7f80ac100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:00.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.605+0000 7f80b0f5e640 1 --2- 172.21.15.17:0/1954666206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80ac102ab0 0x7f80ac100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:00.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.605+0000 7f80b0f5e640 1 -- 172.21.15.17:0/1954666206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ac101190 con 0x7f80ac1033d0 2024-09-20T18:57:00.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.605+0000 7f80b0f5e640 1 --2- 172.21.15.17:0/1954666206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac1033d0 0x7f80ac100c50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f809c031460 tx=0x7f809c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:00.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.606+0000 7f80a27fc640 1 -- 172.21.15.17:0/1954666206 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f809c03f070 con 0x7f80ac1033d0 2024-09-20T18:57:00.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.606+0000 7f80b39c3640 1 -- 172.21.15.17:0/1954666206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80ac101420 con 0x7f80ac1033d0 2024-09-20T18:57:00.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.606+0000 7f80a27fc640 1 -- 172.21.15.17:0/1954666206 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f809c0035f0 con 0x7f80ac1033d0 2024-09-20T18:57:00.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.606+0000 7f80a27fc640 1 -- 172.21.15.17:0/1954666206 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f809c035030 con 0x7f80ac1033d0 2024-09-20T18:57:00.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.606+0000 7f80b39c3640 1 -- 172.21.15.17:0/1954666206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80ac1a3dd0 con 0x7f80ac1033d0 2024-09-20T18:57:00.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.607+0000 7f80b39c3640 1 -- 172.21.15.17:0/1954666206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80ac06a580 con 0x7f80ac1033d0 2024-09-20T18:57:00.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.607+0000 7f80a27fc640 1 -- 172.21.15.17:0/1954666206 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f809c042070 con 0x7f80ac1033d0 2024-09-20T18:57:00.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.608+0000 7f80a27fc640 1 --2- 172.21.15.17:0/1954666206 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f809807af30 0x7f809807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:00.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.608+0000 7f80b175f640 1 --2- 172.21.15.17:0/1954666206 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f809807af30 0x7f809807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:00.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.608+0000 7f80a27fc640 1 -- 172.21.15.17:0/1954666206 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f809c0be9b0 con 0x7f80ac1033d0 2024-09-20T18:57:00.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.608+0000 7f80b175f640 1 --2- 172.21.15.17:0/1954666206 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f809807af30 0x7f809807d3f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f80a8005fd0 tx=0x7f80a8005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:00.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.612+0000 7f80a27fc640 1 -- 172.21.15.17:0/1954666206 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f809c089fb0 con 0x7f80ac1033d0 2024-09-20T18:57:00.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.819+0000 7f80b39c3640 1 -- 172.21.15.17:0/1954666206 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f80ac062630 con 0x7f809807af30 2024-09-20T18:57:00.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.820+0000 7f80a27fc640 1 -- 172.21.15.17:0/1954666206 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f80ac062630 con 0x7f809807af30 2024-09-20T18:57:00.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.823+0000 7f80b39c3640 1 -- 172.21.15.17:0/1954666206 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f809807af30 msgr2=0x7f809807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:00.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.823+0000 7f80b39c3640 1 --2- 172.21.15.17:0/1954666206 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f809807af30 0x7f809807d3f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f80a8005fd0 tx=0x7f80a8005850 comp rx=0 tx=0).stop 2024-09-20T18:57:00.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.823+0000 7f80b39c3640 1 -- 172.21.15.17:0/1954666206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac1033d0 msgr2=0x7f80ac100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:00.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.823+0000 7f80b39c3640 1 --2- 172.21.15.17:0/1954666206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac1033d0 0x7f80ac100c50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f809c031460 tx=0x7f809c004530 comp rx=0 tx=0).stop 2024-09-20T18:57:00.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.823+0000 7f80b39c3640 1 -- 172.21.15.17:0/1954666206 shutdown_connections 2024-09-20T18:57:00.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.823+0000 7f80b39c3640 1 --2- 172.21.15.17:0/1954666206 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f809807af30 0x7f809807d3f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:00.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.823+0000 7f80b39c3640 1 --2- 172.21.15.17:0/1954666206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80ac1033d0 0x7f80ac100c50 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:00.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.823+0000 7f80b39c3640 1 --2- 172.21.15.17:0/1954666206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80ac102ab0 0x7f80ac100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:00.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.823+0000 7f80b39c3640 1 -- 172.21.15.17:0/1954666206 >> 172.21.15.17:0/1954666206 conn(0x7f80ac0fc550 msgr2=0x7f80ac108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:00.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.823+0000 7f80b39c3640 1 -- 172.21.15.17:0/1954666206 shutdown_connections 2024-09-20T18:57:00.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.823+0000 7f80b39c3640 1 -- 172.21.15.17:0/1954666206 wait complete. 2024-09-20T18:57:00.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.907+0000 7f2509f95640 1 -- 172.21.15.17:0/2898907771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2504074f40 msgr2=0x7f250410dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:00.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.907+0000 7f2509f95640 1 --2- 172.21.15.17:0/2898907771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2504074f40 0x7f250410dc00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009880 tx=0x7f24f802a530 comp rx=0 tx=0).stop 2024-09-20T18:57:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.907+0000 7f2509f95640 1 -- 172.21.15.17:0/2898907771 shutdown_connections 2024-09-20T18:57:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.907+0000 7f2509f95640 1 --2- 172.21.15.17:0/2898907771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2504074f40 0x7f250410dc00 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.907+0000 7f2509f95640 1 --2- 172.21.15.17:0/2898907771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2504074620 0x7f2504074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.907+0000 7f2509f95640 1 -- 172.21.15.17:0/2898907771 >> 172.21.15.17:0/2898907771 conn(0x7f25040fd600 msgr2=0x7f25040ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.907+0000 7f2509f95640 1 -- 172.21.15.17:0/2898907771 shutdown_connections 2024-09-20T18:57:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.907+0000 7f2509f95640 1 -- 172.21.15.17:0/2898907771 wait complete. 2024-09-20T18:57:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.908+0000 7f2509f95640 1 Processor -- start 2024-09-20T18:57:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.908+0000 7f2509f95640 1 -- start start 2024-09-20T18:57:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.908+0000 7f2509f95640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2504074620 0x7f250419f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.908+0000 7f2509f95640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2504074f40 0x7f250419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.908+0000 7f2509f95640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2504110fd0 con 0x7f2504074f40 2024-09-20T18:57:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.908+0000 7f2509f95640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2504110e50 con 0x7f2504074620 2024-09-20T18:57:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.908+0000 7f2502ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2504074f40 0x7f250419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.908+0000 7f2502ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2504074f40 0x7f250419fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50734/0 (socket says 172.21.15.17:50734) 2024-09-20T18:57:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.908+0000 7f2502ffd640 1 -- 172.21.15.17:0/1689014515 learned_addr learned my addr 172.21.15.17:0/1689014515 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:57:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.908+0000 7f25037fe640 1 --2- 172.21.15.17:0/1689014515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2504074620 0x7f250419f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.909+0000 7f2502ffd640 1 -- 172.21.15.17:0/1689014515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2504074620 msgr2=0x7f250419f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.909+0000 7f2502ffd640 1 --2- 172.21.15.17:0/1689014515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2504074620 0x7f250419f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:00.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.909+0000 7f2502ffd640 1 -- 172.21.15.17:0/1689014515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25041999c0 con 0x7f2504074f40 2024-09-20T18:57:00.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.909+0000 7f25037fe640 1 --2- 172.21.15.17:0/1689014515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2504074620 0x7f250419f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:57:00.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.909+0000 7f2502ffd640 1 --2- 172.21.15.17:0/1689014515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2504074f40 0x7f250419fd40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f24f8031460 tx=0x7f24f80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:00.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.909+0000 7f2500ff9640 1 -- 172.21.15.17:0/1689014515 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24f803f070 con 0x7f2504074f40 2024-09-20T18:57:00.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.909+0000 7f2500ff9640 1 -- 172.21.15.17:0/1689014515 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f24f80035f0 con 0x7f2504074f40 2024-09-20T18:57:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.909+0000 7f2509f95640 1 -- 172.21.15.17:0/1689014515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2504199c50 con 0x7f2504074f40 2024-09-20T18:57:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.909+0000 7f2500ff9640 1 -- 172.21.15.17:0/1689014515 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24f8035030 con 0x7f2504074f40 2024-09-20T18:57:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.909+0000 7f2509f95640 1 -- 172.21.15.17:0/1689014515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f250419a180 con 0x7f2504074f40 2024-09-20T18:57:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.910+0000 7f2509f95640 1 -- 172.21.15.17:0/1689014515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2504075cd0 con 0x7f2504074f40 2024-09-20T18:57:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.911+0000 7f2500ff9640 1 -- 172.21.15.17:0/1689014515 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f24f8042070 con 0x7f2504074f40 2024-09-20T18:57:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.911+0000 7f2500ff9640 1 --2- 172.21.15.17:0/1689014515 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24ec07af30 0x7f24ec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.911+0000 7f2500ff9640 1 -- 172.21.15.17:0/1689014515 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f24f80bea20 con 0x7f2504074f40 2024-09-20T18:57:00.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.911+0000 7f25037fe640 1 --2- 172.21.15.17:0/1689014515 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24ec07af30 0x7f24ec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:00.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.912+0000 7f25037fe640 1 --2- 172.21.15.17:0/1689014515 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24ec07af30 0x7f24ec07d3f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f24f4005fd0 tx=0x7f24f4005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:00.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:00.916+0000 7f2500ff9640 1 -- 172.21.15.17:0/1689014515 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24f808a020 con 0x7f2504074f40 2024-09-20T18:57:01.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.111+0000 7f2509f95640 1 -- 172.21.15.17:0/1689014515 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f250419aef0 con 0x7f24ec07af30 2024-09-20T18:57:01.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.122+0000 7f2500ff9640 1 -- 172.21.15.17:0/1689014515 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f250419aef0 con 0x7f24ec07af30 2024-09-20T18:57:01.134 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:57:01.134 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (18m) 12m ago 29m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:57:01.135 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (21m) 12m ago 29m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:57:01.135 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (20m) 12m ago 28m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:57:01.135 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (16m) 12m ago 29m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:57:01.135 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (16m) 12m ago 28m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:57:01.135 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (17m) 12m ago 29m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:57:01.135 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (12m) 12m ago 24m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:57:01.135 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (12m) 12m ago 24m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:57:01.135 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (24m) 12m ago 23m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:57:01.135 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (12m) 12m ago 24m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:57:01.135 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (20m) 12m ago 30m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:57:01.135 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (19m) 12m ago 28m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:57:01.135 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (17m) 12m ago 30m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:57:01.135 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (16m) 12m ago 28m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:57:01.136 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (19m) 12m ago 29m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:57:01.136 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (19m) 12m ago 28m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:57:01.136 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (16m) 12m ago 27m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:57:01.136 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (15m) 12m ago 26m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:57:01.136 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (14m) 12m ago 26m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:57:01.136 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (14m) 12m ago 25m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:57:01.136 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (13m) 12m ago 25m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:57:01.136 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (13m) 12m ago 25m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:57:01.136 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (18m) 12m ago 28m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:57:01.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.124+0000 7f2509f95640 1 -- 172.21.15.17:0/1689014515 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24ec07af30 msgr2=0x7f24ec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:01.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.124+0000 7f2509f95640 1 --2- 172.21.15.17:0/1689014515 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24ec07af30 0x7f24ec07d3f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f24f4005fd0 tx=0x7f24f4005850 comp rx=0 tx=0).stop 2024-09-20T18:57:01.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.124+0000 7f2509f95640 1 -- 172.21.15.17:0/1689014515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2504074f40 msgr2=0x7f250419fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:01.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.124+0000 7f2509f95640 1 --2- 172.21.15.17:0/1689014515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2504074f40 0x7f250419fd40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f24f8031460 tx=0x7f24f80045e0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.124+0000 7f2509f95640 1 -- 172.21.15.17:0/1689014515 shutdown_connections 2024-09-20T18:57:01.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.124+0000 7f2509f95640 1 --2- 172.21.15.17:0/1689014515 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24ec07af30 0x7f24ec07d3f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.124+0000 7f2509f95640 1 --2- 172.21.15.17:0/1689014515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2504074f40 0x7f250419fd40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.124+0000 7f2509f95640 1 --2- 172.21.15.17:0/1689014515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2504074620 0x7f250419f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.124+0000 7f2509f95640 1 -- 172.21.15.17:0/1689014515 >> 172.21.15.17:0/1689014515 conn(0x7f25040fd600 msgr2=0x7f250410b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:01.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.124+0000 7f2509f95640 1 -- 172.21.15.17:0/1689014515 shutdown_connections 2024-09-20T18:57:01.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.124+0000 7f2509f95640 1 -- 172.21.15.17:0/1689014515 wait complete. 2024-09-20T18:57:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.207+0000 7f91fb86e640 1 -- 172.21.15.17:0/1061600368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91f4102ac0 msgr2=0x7f91f4102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.207+0000 7f91fb86e640 1 --2- 172.21.15.17:0/1061600368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91f4102ac0 0x7f91f4102ea0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f91f0009880 tx=0x7f91f002a530 comp rx=0 tx=0).stop 2024-09-20T18:57:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.207+0000 7f91fb86e640 1 -- 172.21.15.17:0/1061600368 shutdown_connections 2024-09-20T18:57:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.207+0000 7f91fb86e640 1 --2- 172.21.15.17:0/1061600368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91f41033e0 0x7f91f410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.207+0000 7f91fb86e640 1 --2- 172.21.15.17:0/1061600368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91f4102ac0 0x7f91f4102ea0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.207+0000 7f91fb86e640 1 -- 172.21.15.17:0/1061600368 >> 172.21.15.17:0/1061600368 conn(0x7f91f40fc520 msgr2=0x7f91f40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.207+0000 7f91fb86e640 1 -- 172.21.15.17:0/1061600368 shutdown_connections 2024-09-20T18:57:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.207+0000 7f91fb86e640 1 -- 172.21.15.17:0/1061600368 wait complete. 2024-09-20T18:57:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.208+0000 7f91fb86e640 1 Processor -- start 2024-09-20T18:57:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.208+0000 7f91fb86e640 1 -- start start 2024-09-20T18:57:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.208+0000 7f91fb86e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91f4102ac0 0x7f91f4100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.208+0000 7f91fb86e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91f41033e0 0x7f91f4100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.208+0000 7f91fb86e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f91f410edf0 con 0x7f91f4102ac0 2024-09-20T18:57:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.208+0000 7f91fb86e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f91f410ec70 con 0x7f91f41033e0 2024-09-20T18:57:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.208+0000 7f91f960a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91f4102ac0 0x7f91f4100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.208+0000 7f91f960a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91f4102ac0 0x7f91f4100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50752/0 (socket says 172.21.15.17:50752) 2024-09-20T18:57:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.208+0000 7f91f960a640 1 -- 172.21.15.17:0/2897815559 learned_addr learned my addr 172.21.15.17:0/2897815559 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:57:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.209+0000 7f91f8e09640 1 --2- 172.21.15.17:0/2897815559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91f41033e0 0x7f91f4100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.209+0000 7f91f960a640 1 -- 172.21.15.17:0/2897815559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91f41033e0 msgr2=0x7f91f4100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.209+0000 7f91f960a640 1 --2- 172.21.15.17:0/2897815559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91f41033e0 0x7f91f4100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.209+0000 7f91f960a640 1 -- 172.21.15.17:0/2897815559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f41011a0 con 0x7f91f4102ac0 2024-09-20T18:57:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.209+0000 7f91f960a640 1 --2- 172.21.15.17:0/2897815559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91f4102ac0 0x7f91f4100720 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f91f0031460 tx=0x7f91f00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.209+0000 7f91ea7fc640 1 -- 172.21.15.17:0/2897815559 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f91f003f070 con 0x7f91f4102ac0 2024-09-20T18:57:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.209+0000 7f91fb86e640 1 -- 172.21.15.17:0/2897815559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91f4101430 con 0x7f91f4102ac0 2024-09-20T18:57:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.209+0000 7f91ea7fc640 1 -- 172.21.15.17:0/2897815559 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f91f00035f0 con 0x7f91f4102ac0 2024-09-20T18:57:01.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.209+0000 7f91ea7fc640 1 -- 172.21.15.17:0/2897815559 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f91f0035030 con 0x7f91f4102ac0 2024-09-20T18:57:01.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.209+0000 7f91fb86e640 1 -- 172.21.15.17:0/2897815559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91f41a3d60 con 0x7f91f4102ac0 2024-09-20T18:57:01.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.210+0000 7f91fb86e640 1 -- 172.21.15.17:0/2897815559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91f406aa90 con 0x7f91f4102ac0 2024-09-20T18:57:01.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.211+0000 7f91ea7fc640 1 -- 172.21.15.17:0/2897815559 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f91f0042070 con 0x7f91f4102ac0 2024-09-20T18:57:01.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.211+0000 7f91ea7fc640 1 --2- 172.21.15.17:0/2897815559 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f91e007af30 0x7f91e007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:01.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.212+0000 7f91ea7fc640 1 -- 172.21.15.17:0/2897815559 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f91f00bea20 con 0x7f91f4102ac0 2024-09-20T18:57:01.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.212+0000 7f91f8e09640 1 --2- 172.21.15.17:0/2897815559 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f91e007af30 0x7f91e007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:01.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.212+0000 7f91f8e09640 1 --2- 172.21.15.17:0/2897815559 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f91e007af30 0x7f91e007d3f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f91e40058c0 tx=0x7f91e4005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:01.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.216+0000 7f91ea7fc640 1 -- 172.21.15.17:0/2897815559 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f91f008a020 con 0x7f91f4102ac0 2024-09-20T18:57:01.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.485+0000 7f91fb86e640 1 -- 172.21.15.17:0/2897815559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f91f4105f90 con 0x7f91f4102ac0 2024-09-20T18:57:01.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.485+0000 7f91ea7fc640 1 -- 172.21.15.17:0/2897815559 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f91f008c070 con 0x7f91f4102ac0 2024-09-20T18:57:01.498 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:57:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:57:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:57:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:57:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:57:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:57:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:57:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:57:01.498 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:57:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:57:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:57:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:57:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:57:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:57:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:57:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:57:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:57:01.499 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:57:01.499 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:57:01.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.488+0000 7f91fb86e640 1 -- 172.21.15.17:0/2897815559 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f91e007af30 msgr2=0x7f91e007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:01.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.488+0000 7f91fb86e640 1 --2- 172.21.15.17:0/2897815559 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f91e007af30 0x7f91e007d3f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f91e40058c0 tx=0x7f91e4005850 comp rx=0 tx=0).stop 2024-09-20T18:57:01.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.488+0000 7f91fb86e640 1 -- 172.21.15.17:0/2897815559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91f4102ac0 msgr2=0x7f91f4100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:01.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.488+0000 7f91fb86e640 1 --2- 172.21.15.17:0/2897815559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91f4102ac0 0x7f91f4100720 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f91f0031460 tx=0x7f91f00045e0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.488+0000 7f91fb86e640 1 -- 172.21.15.17:0/2897815559 shutdown_connections 2024-09-20T18:57:01.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.488+0000 7f91fb86e640 1 --2- 172.21.15.17:0/2897815559 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f91e007af30 0x7f91e007d3f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.488+0000 7f91fb86e640 1 --2- 172.21.15.17:0/2897815559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91f41033e0 0x7f91f4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.488+0000 7f91fb86e640 1 --2- 172.21.15.17:0/2897815559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91f4102ac0 0x7f91f4100720 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.488+0000 7f91fb86e640 1 -- 172.21.15.17:0/2897815559 >> 172.21.15.17:0/2897815559 conn(0x7f91f40fc520 msgr2=0x7f91f4108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:01.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.488+0000 7f91fb86e640 1 -- 172.21.15.17:0/2897815559 shutdown_connections 2024-09-20T18:57:01.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.488+0000 7f91fb86e640 1 -- 172.21.15.17:0/2897815559 wait complete. 2024-09-20T18:57:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.575+0000 7f5642cdc640 1 -- 172.21.15.17:0/1400568796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f563c100de0 msgr2=0x7f563c1065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.575+0000 7f5642cdc640 1 --2- 172.21.15.17:0/1400568796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f563c100de0 0x7f563c1065c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5628009880 tx=0x7f562802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.575+0000 7f5642cdc640 1 -- 172.21.15.17:0/1400568796 shutdown_connections 2024-09-20T18:57:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.575+0000 7f5642cdc640 1 --2- 172.21.15.17:0/1400568796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f563c100de0 0x7f563c1065c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.575+0000 7f5642cdc640 1 --2- 172.21.15.17:0/1400568796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f563c100430 0x7f563c100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.575+0000 7f5642cdc640 1 -- 172.21.15.17:0/1400568796 >> 172.21.15.17:0/1400568796 conn(0x7f563c0771e0 msgr2=0x7f563c0775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.575+0000 7f5642cdc640 1 -- 172.21.15.17:0/1400568796 shutdown_connections 2024-09-20T18:57:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.575+0000 7f5642cdc640 1 -- 172.21.15.17:0/1400568796 wait complete. 2024-09-20T18:57:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.575+0000 7f5642cdc640 1 Processor -- start 2024-09-20T18:57:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.575+0000 7f5642cdc640 1 -- start start 2024-09-20T18:57:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.576+0000 7f5642cdc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f563c100430 0x7f563c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.576+0000 7f5642cdc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f563c100de0 0x7f563c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.576+0000 7f5642cdc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f563c10edc0 con 0x7f563c100de0 2024-09-20T18:57:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.576+0000 7f5642cdc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f563c10ec40 con 0x7f563c100430 2024-09-20T18:57:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.576+0000 7f563bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f563c100de0 0x7f563c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.576+0000 7f563bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f563c100de0 0x7f563c19dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50774/0 (socket says 172.21.15.17:50774) 2024-09-20T18:57:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.576+0000 7f563bfff640 1 -- 172.21.15.17:0/1148947938 learned_addr learned my addr 172.21.15.17:0/1148947938 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:57:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.576+0000 7f5640a78640 1 --2- 172.21.15.17:0/1148947938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f563c100430 0x7f563c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.576+0000 7f563bfff640 1 -- 172.21.15.17:0/1148947938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f563c100430 msgr2=0x7f563c19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.576+0000 7f563bfff640 1 --2- 172.21.15.17:0/1148947938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f563c100430 0x7f563c19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.576+0000 7f563bfff640 1 -- 172.21.15.17:0/1148947938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563c197770 con 0x7f563c100de0 2024-09-20T18:57:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.576+0000 7f563bfff640 1 --2- 172.21.15.17:0/1148947938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f563c100de0 0x7f563c19dbe0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5628031460 tx=0x7f56280045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.576+0000 7f5639ffb640 1 -- 172.21.15.17:0/1148947938 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f562803f070 con 0x7f563c100de0 2024-09-20T18:57:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.576+0000 7f5639ffb640 1 -- 172.21.15.17:0/1148947938 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f56280035f0 con 0x7f563c100de0 2024-09-20T18:57:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.576+0000 7f5642cdc640 1 -- 172.21.15.17:0/1148947938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f563c197a00 con 0x7f563c100de0 2024-09-20T18:57:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.577+0000 7f5639ffb640 1 -- 172.21.15.17:0/1148947938 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5628035030 con 0x7f563c100de0 2024-09-20T18:57:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.577+0000 7f5642cdc640 1 -- 172.21.15.17:0/1148947938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f563c197f00 con 0x7f563c100de0 2024-09-20T18:57:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.578+0000 7f5642cdc640 1 -- 172.21.15.17:0/1148947938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f563c06a000 con 0x7f563c100de0 2024-09-20T18:57:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.578+0000 7f5639ffb640 1 -- 172.21.15.17:0/1148947938 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5628042070 con 0x7f563c100de0 2024-09-20T18:57:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.579+0000 7f5639ffb640 1 --2- 172.21.15.17:0/1148947938 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f562c07af80 0x7f562c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.579+0000 7f5639ffb640 1 -- 172.21.15.17:0/1148947938 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f56280be8b0 con 0x7f563c100de0 2024-09-20T18:57:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.579+0000 7f5640a78640 1 --2- 172.21.15.17:0/1148947938 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f562c07af80 0x7f562c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.580+0000 7f5640a78640 1 --2- 172.21.15.17:0/1148947938 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f562c07af80 0x7f562c07d440 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5630005fd0 tx=0x7f563000b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:01.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.583+0000 7f5639ffb640 1 -- 172.21.15.17:0/1148947938 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5628089f30 con 0x7f563c100de0 2024-09-20T18:57:01.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.809+0000 7f5642cdc640 1 -- 172.21.15.17:0/1148947938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f563c109ea0 con 0x7f563c100de0 2024-09-20T18:57:01.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.809+0000 7f5639ffb640 1 -- 172.21.15.17:0/1148947938 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f562808ede0 con 0x7f563c100de0 2024-09-20T18:57:01.822 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:57:01.822 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:57:01.822 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:57:01.822 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:57:01.822 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:57:01.823 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:57:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:57:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:57:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:57:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:57:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:57:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:57:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:57:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:57:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:57:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:57:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:57:01.823 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:57:01.824 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:57:01.824 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:57:01.824 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:57:01.824 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:57:01.824 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:57:01.824 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:57:01.824 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:57:01.824 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:57:01.824 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:57:01.824 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:57:01.824 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:57:01.824 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:57:01.824 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:57:01.824 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:57:01.825 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:57:01.825 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:57:01.825 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:57:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:57:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:57:01.825 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:57:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:57:01.825 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:57:01.825 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:57:01.825 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:57:01.825 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:57:01.826 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:57:01.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.811+0000 7f5642cdc640 1 -- 172.21.15.17:0/1148947938 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f562c07af80 msgr2=0x7f562c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:01.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.812+0000 7f5642cdc640 1 --2- 172.21.15.17:0/1148947938 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f562c07af80 0x7f562c07d440 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5630005fd0 tx=0x7f563000b390 comp rx=0 tx=0).stop 2024-09-20T18:57:01.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.812+0000 7f5642cdc640 1 -- 172.21.15.17:0/1148947938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f563c100de0 msgr2=0x7f563c19dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:01.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.812+0000 7f5642cdc640 1 --2- 172.21.15.17:0/1148947938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f563c100de0 0x7f563c19dbe0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5628031460 tx=0x7f56280045e0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.812+0000 7f5642cdc640 1 -- 172.21.15.17:0/1148947938 shutdown_connections 2024-09-20T18:57:01.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.812+0000 7f5642cdc640 1 --2- 172.21.15.17:0/1148947938 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f562c07af80 0x7f562c07d440 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.812+0000 7f5642cdc640 1 --2- 172.21.15.17:0/1148947938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f563c100de0 0x7f563c19dbe0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.812+0000 7f5642cdc640 1 --2- 172.21.15.17:0/1148947938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f563c100430 0x7f563c19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.812+0000 7f5642cdc640 1 -- 172.21.15.17:0/1148947938 >> 172.21.15.17:0/1148947938 conn(0x7f563c0771e0 msgr2=0x7f563c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:01.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.812+0000 7f5642cdc640 1 -- 172.21.15.17:0/1148947938 shutdown_connections 2024-09-20T18:57:01.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.812+0000 7f5642cdc640 1 -- 172.21.15.17:0/1148947938 wait complete. 2024-09-20T18:57:01.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.897+0000 7f1ec3886640 1 -- 172.21.15.17:0/1225706208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ebc107900 msgr2=0x7f1ebc107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:01.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.897+0000 7f1ec3886640 1 --2- 172.21.15.17:0/1225706208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ebc107900 0x7f1ebc107ce0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009880 tx=0x7f1eb802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.897+0000 7f1ec3886640 1 -- 172.21.15.17:0/1225706208 shutdown_connections 2024-09-20T18:57:01.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.897+0000 7f1ec3886640 1 --2- 172.21.15.17:0/1225706208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ebc101900 0x7f1ebc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.897+0000 7f1ec3886640 1 --2- 172.21.15.17:0/1225706208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ebc107900 0x7f1ebc107ce0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.897+0000 7f1ec3886640 1 -- 172.21.15.17:0/1225706208 >> 172.21.15.17:0/1225706208 conn(0x7f1ebc0fd600 msgr2=0x7f1ebc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:01.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.897+0000 7f1ec3886640 1 -- 172.21.15.17:0/1225706208 shutdown_connections 2024-09-20T18:57:01.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.897+0000 7f1ec3886640 1 -- 172.21.15.17:0/1225706208 wait complete. 2024-09-20T18:57:01.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.897+0000 7f1ec3886640 1 Processor -- start 2024-09-20T18:57:01.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.898+0000 7f1ec3886640 1 -- start start 2024-09-20T18:57:01.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.898+0000 7f1ec3886640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ebc101900 0x7f1ebc19f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:01.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.898+0000 7f1ec3886640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ebc107900 0x7f1ebc19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:01.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.898+0000 7f1ec3886640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc10edb0 con 0x7f1ebc107900 2024-09-20T18:57:01.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.898+0000 7f1ec3886640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc10ec30 con 0x7f1ebc101900 2024-09-20T18:57:01.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.898+0000 7f1ec0e21640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ebc107900 0x7f1ebc19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:01.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.898+0000 7f1ec0e21640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ebc107900 0x7f1ebc19fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50806/0 (socket says 172.21.15.17:50806) 2024-09-20T18:57:01.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.898+0000 7f1ec0e21640 1 -- 172.21.15.17:0/4129729516 learned_addr learned my addr 172.21.15.17:0/4129729516 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:57:01.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.898+0000 7f1ec1622640 1 --2- 172.21.15.17:0/4129729516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ebc101900 0x7f1ebc19f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:01.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.898+0000 7f1ec0e21640 1 -- 172.21.15.17:0/4129729516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ebc101900 msgr2=0x7f1ebc19f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:01.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.898+0000 7f1ec0e21640 1 --2- 172.21.15.17:0/4129729516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ebc101900 0x7f1ebc19f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:01.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.898+0000 7f1ec0e21640 1 -- 172.21.15.17:0/4129729516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ebc1a03e0 con 0x7f1ebc107900 2024-09-20T18:57:01.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.899+0000 7f1ec0e21640 1 --2- 172.21.15.17:0/4129729516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ebc107900 0x7f1ebc19fd30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00c8a0 tx=0x7f1eac00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:01.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.899+0000 7f1eb27fc640 1 -- 172.21.15.17:0/4129729516 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1eac0079b0 con 0x7f1ebc107900 2024-09-20T18:57:01.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.899+0000 7f1eb27fc640 1 -- 172.21.15.17:0/4129729516 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1eac007b50 con 0x7f1ebc107900 2024-09-20T18:57:01.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.899+0000 7f1ec3886640 1 -- 172.21.15.17:0/4129729516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ebc199ad0 con 0x7f1ebc107900 2024-09-20T18:57:01.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.899+0000 7f1eb27fc640 1 -- 172.21.15.17:0/4129729516 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1eac018700 con 0x7f1ebc107900 2024-09-20T18:57:01.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.899+0000 7f1ec3886640 1 -- 172.21.15.17:0/4129729516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ebc19a030 con 0x7f1ebc107900 2024-09-20T18:57:01.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.900+0000 7f1ec3886640 1 -- 172.21.15.17:0/4129729516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ebc103040 con 0x7f1ebc107900 2024-09-20T18:57:01.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.900+0000 7f1eb27fc640 1 -- 172.21.15.17:0/4129729516 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1eac007d00 con 0x7f1ebc107900 2024-09-20T18:57:01.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.901+0000 7f1eb27fc640 1 --2- 172.21.15.17:0/4129729516 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1ea807af30 0x7f1ea807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:01.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.901+0000 7f1eb27fc640 1 -- 172.21.15.17:0/4129729516 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f1eac09e310 con 0x7f1ebc107900 2024-09-20T18:57:01.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.901+0000 7f1ec1622640 1 --2- 172.21.15.17:0/4129729516 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1ea807af30 0x7f1ea807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:01.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.902+0000 7f1ec1622640 1 --2- 172.21.15.17:0/4129729516 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1ea807af30 0x7f1ea807d3f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8000c00 tx=0x7f1eb8004120 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:01.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:01.905+0000 7f1eb27fc640 1 -- 172.21.15.17:0/4129729516 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1eac014030 con 0x7f1ebc107900 2024-09-20T18:57:02.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.112+0000 7f1ec3886640 1 -- 172.21.15.17:0/4129729516 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1ebc19a340 con 0x7f1ea807af30 2024-09-20T18:57:02.125 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:01 smithi017 ceph-mon[108970]: from='client.35014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:02.125 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:01 smithi017 ceph-mon[108970]: pgmap v648: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:02.125 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:01 smithi017 ceph-mon[108970]: from='client.35018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:02.125 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:01 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2897815559' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:57:02.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.113+0000 7f1eb27fc640 1 -- 172.21.15.17:0/4129729516 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f1ebc19a340 con 0x7f1ea807af30 2024-09-20T18:57:02.126 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:57:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:57:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:57:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:57:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:57:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:57:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:57:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:57:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:57:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:57:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:57:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:57:02.127 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:57:02.127 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:57:02.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.116+0000 7f1ec3886640 1 -- 172.21.15.17:0/4129729516 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1ea807af30 msgr2=0x7f1ea807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:02.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.116+0000 7f1ec3886640 1 --2- 172.21.15.17:0/4129729516 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1ea807af30 0x7f1ea807d3f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8000c00 tx=0x7f1eb8004120 comp rx=0 tx=0).stop 2024-09-20T18:57:02.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.116+0000 7f1ec3886640 1 -- 172.21.15.17:0/4129729516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ebc107900 msgr2=0x7f1ebc19fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:02.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.116+0000 7f1ec3886640 1 --2- 172.21.15.17:0/4129729516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ebc107900 0x7f1ebc19fd30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00c8a0 tx=0x7f1eac00cd60 comp rx=0 tx=0).stop 2024-09-20T18:57:02.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.116+0000 7f1ec3886640 1 -- 172.21.15.17:0/4129729516 shutdown_connections 2024-09-20T18:57:02.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.116+0000 7f1ec3886640 1 --2- 172.21.15.17:0/4129729516 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1ea807af30 0x7f1ea807d3f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:02.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.116+0000 7f1ec3886640 1 --2- 172.21.15.17:0/4129729516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ebc107900 0x7f1ebc19fd30 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:02.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.116+0000 7f1ec3886640 1 --2- 172.21.15.17:0/4129729516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ebc101900 0x7f1ebc19f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:02.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.116+0000 7f1ec3886640 1 -- 172.21.15.17:0/4129729516 >> 172.21.15.17:0/4129729516 conn(0x7f1ebc0fd600 msgr2=0x7f1ebc0fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:02.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.116+0000 7f1ec3886640 1 -- 172.21.15.17:0/4129729516 shutdown_connections 2024-09-20T18:57:02.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.116+0000 7f1ec3886640 1 -- 172.21.15.17:0/4129729516 wait complete. 2024-09-20T18:57:02.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:01 smithi172 ceph-mon[80431]: from='client.35014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:02.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:01 smithi172 ceph-mon[80431]: pgmap v648: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:02.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:01 smithi172 ceph-mon[80431]: from='client.35018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:02.208 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:01 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2897815559' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:57:02.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.201+0000 7f90b3085640 1 -- 172.21.15.17:0/667619025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90ac101250 msgr2=0x7f90ac101630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.201+0000 7f90b3085640 1 --2- 172.21.15.17:0/667619025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90ac101250 0x7f90ac101630 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009880 tx=0x7f90a002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:57:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.201+0000 7f90b3085640 1 -- 172.21.15.17:0/667619025 shutdown_connections 2024-09-20T18:57:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.201+0000 7f90b3085640 1 --2- 172.21.15.17:0/667619025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ac101c00 0x7f90ac105520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.201+0000 7f90b3085640 1 --2- 172.21.15.17:0/667619025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90ac101250 0x7f90ac101630 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.201+0000 7f90b3085640 1 -- 172.21.15.17:0/667619025 >> 172.21.15.17:0/667619025 conn(0x7f90ac0fbc90 msgr2=0x7f90ac0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.201+0000 7f90b3085640 1 -- 172.21.15.17:0/667619025 shutdown_connections 2024-09-20T18:57:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.201+0000 7f90b3085640 1 -- 172.21.15.17:0/667619025 wait complete. 2024-09-20T18:57:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.201+0000 7f90b3085640 1 Processor -- start 2024-09-20T18:57:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.201+0000 7f90b3085640 1 -- start start 2024-09-20T18:57:02.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.202+0000 7f90b3085640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ac101250 0x7f90ac1025c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:02.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.202+0000 7f90b3085640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90ac101c00 0x7f90ac102b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.202+0000 7f90b3085640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac10ddc0 con 0x7f90ac101c00 2024-09-20T18:57:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.202+0000 7f90b3085640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac10dc40 con 0x7f90ac101250 2024-09-20T18:57:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.202+0000 7f90abfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90ac101c00 0x7f90ac102b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.202+0000 7f90abfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90ac101c00 0x7f90ac102b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50824/0 (socket says 172.21.15.17:50824) 2024-09-20T18:57:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.202+0000 7f90abfff640 1 -- 172.21.15.17:0/1526071319 learned_addr learned my addr 172.21.15.17:0/1526071319 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:57:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.202+0000 7f90b0e21640 1 --2- 172.21.15.17:0/1526071319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ac101250 0x7f90ac1025c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.202+0000 7f90abfff640 1 -- 172.21.15.17:0/1526071319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ac101250 msgr2=0x7f90ac1025c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.202+0000 7f90abfff640 1 --2- 172.21.15.17:0/1526071319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ac101250 0x7f90ac1025c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.202+0000 7f90abfff640 1 -- 172.21.15.17:0/1526071319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac103040 con 0x7f90ac101c00 2024-09-20T18:57:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.202+0000 7f90abfff640 1 --2- 172.21.15.17:0/1526071319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90ac101c00 0x7f90ac102b00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f909800c8a0 tx=0x7f909800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.202+0000 7f90a9ffb640 1 -- 172.21.15.17:0/1526071319 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90980079b0 con 0x7f90ac101c00 2024-09-20T18:57:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.202+0000 7f90a9ffb640 1 -- 172.21.15.17:0/1526071319 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9098007b50 con 0x7f90ac101c00 2024-09-20T18:57:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.202+0000 7f90b3085640 1 -- 172.21.15.17:0/1526071319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ac103330 con 0x7f90ac101c00 2024-09-20T18:57:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.202+0000 7f90a9ffb640 1 -- 172.21.15.17:0/1526071319 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9098018700 con 0x7f90ac101c00 2024-09-20T18:57:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.203+0000 7f90b3085640 1 -- 172.21.15.17:0/1526071319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ac1a3f30 con 0x7f90ac101c00 2024-09-20T18:57:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.204+0000 7f90b3085640 1 -- 172.21.15.17:0/1526071319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ac102000 con 0x7f90ac101c00 2024-09-20T18:57:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.204+0000 7f90a9ffb640 1 -- 172.21.15.17:0/1526071319 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9098007d00 con 0x7f90ac101c00 2024-09-20T18:57:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.205+0000 7f90a9ffb640 1 --2- 172.21.15.17:0/1526071319 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f909c07af90 0x7f909c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.205+0000 7f90a9ffb640 1 -- 172.21.15.17:0/1526071319 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f909809e1a0 con 0x7f90ac101c00 2024-09-20T18:57:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.205+0000 7f90b0e21640 1 --2- 172.21.15.17:0/1526071319 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f909c07af90 0x7f909c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.205+0000 7f90b0e21640 1 --2- 172.21.15.17:0/1526071319 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f909c07af90 0x7f909c07d450 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f90a0000c00 tx=0x7f90a0031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:02.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.209+0000 7f90a9ffb640 1 -- 172.21.15.17:0/1526071319 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9098014030 con 0x7f90ac101c00 2024-09-20T18:57:02.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.476+0000 7f90b3085640 1 -- 172.21.15.17:0/1526071319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f90ac1a4220 con 0x7f90ac101c00 2024-09-20T18:57:02.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.476+0000 7f90a9ffb640 1 -- 172.21.15.17:0/1526071319 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f9098069820 con 0x7f90ac101c00 2024-09-20T18:57:02.489 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:57:02.489 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:57:02.489 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:57:02.489 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:57:02.489 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:57:02.489 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:57:02.489 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:57:02.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.479+0000 7f90b3085640 1 -- 172.21.15.17:0/1526071319 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f909c07af90 msgr2=0x7f909c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:02.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.479+0000 7f90b3085640 1 --2- 172.21.15.17:0/1526071319 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f909c07af90 0x7f909c07d450 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f90a0000c00 tx=0x7f90a0031400 comp rx=0 tx=0).stop 2024-09-20T18:57:02.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.479+0000 7f90b3085640 1 -- 172.21.15.17:0/1526071319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90ac101c00 msgr2=0x7f90ac102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:02.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.479+0000 7f90b3085640 1 --2- 172.21.15.17:0/1526071319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90ac101c00 0x7f90ac102b00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f909800c8a0 tx=0x7f909800cd60 comp rx=0 tx=0).stop 2024-09-20T18:57:02.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.479+0000 7f90b3085640 1 -- 172.21.15.17:0/1526071319 shutdown_connections 2024-09-20T18:57:02.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.479+0000 7f90b3085640 1 --2- 172.21.15.17:0/1526071319 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f909c07af90 0x7f909c07d450 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:02.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.479+0000 7f90b3085640 1 --2- 172.21.15.17:0/1526071319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90ac101c00 0x7f90ac102b00 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:02.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.479+0000 7f90b3085640 1 --2- 172.21.15.17:0/1526071319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ac101250 0x7f90ac1025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:02.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.479+0000 7f90b3085640 1 -- 172.21.15.17:0/1526071319 >> 172.21.15.17:0/1526071319 conn(0x7f90ac0fbc90 msgr2=0x7f90ac100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:02.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.479+0000 7f90b3085640 1 -- 172.21.15.17:0/1526071319 shutdown_connections 2024-09-20T18:57:02.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:02.479+0000 7f90b3085640 1 -- 172.21.15.17:0/1526071319 wait complete. 2024-09-20T18:57:03.060 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:02 smithi172 ceph-mon[80431]: from='client.35022 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:03.060 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:02 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1148947938' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:57:03.060 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:02 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1526071319' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:57:03.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:02 smithi017 ceph-mon[108970]: from='client.35022 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:03.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:02 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1148947938' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:57:03.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:02 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1526071319' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:57:04.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:03 smithi017 ceph-mon[108970]: from='client.35034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:04.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:03 smithi017 ceph-mon[108970]: pgmap v649: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:04.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:03 smithi172 ceph-mon[80431]: from='client.35034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:04.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:03 smithi172 ceph-mon[80431]: pgmap v649: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:06.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:05 smithi017 ceph-mon[108970]: pgmap v650: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:06.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:05 smithi172 ceph-mon[80431]: pgmap v650: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:07.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:07 smithi017 ceph-mon[108970]: pgmap v651: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:07.898 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:57:08.135 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:07 smithi172 ceph-mon[80431]: pgmap v651: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:08.135 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:57:10.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:09 smithi017 ceph-mon[108970]: pgmap v652: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:10.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:09 smithi172 ceph-mon[80431]: pgmap v652: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:12.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:11 smithi017 ceph-mon[108970]: pgmap v653: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:12.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:11 smithi172 ceph-mon[80431]: pgmap v653: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:13.897 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:13 smithi017 ceph-mon[108970]: pgmap v654: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:14.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:13 smithi172 ceph-mon[80431]: pgmap v654: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:16.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:15 smithi017 ceph-mon[108970]: pgmap v655: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:16.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:15 smithi172 ceph-mon[80431]: pgmap v655: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:18.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:17 smithi017 ceph-mon[108970]: pgmap v656: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:18.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:17 smithi172 ceph-mon[80431]: pgmap v656: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:19.897 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:19 smithi017 ceph-mon[108970]: pgmap v657: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:20.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:19 smithi172 ceph-mon[80431]: pgmap v657: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:22.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:21 smithi017 ceph-mon[108970]: pgmap v658: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:22.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:21 smithi172 ceph-mon[80431]: pgmap v658: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:23.108 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:57:23.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:57:24.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:23 smithi017 ceph-mon[108970]: pgmap v659: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:24.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:23 smithi172 ceph-mon[80431]: pgmap v659: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:26.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:25 smithi017 ceph-mon[108970]: pgmap v660: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:26.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:25 smithi172 ceph-mon[80431]: pgmap v660: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:28.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:27 smithi017 ceph-mon[108970]: pgmap v661: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:28.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:27 smithi172 ceph-mon[80431]: pgmap v661: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:30.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:29 smithi017 ceph-mon[108970]: pgmap v662: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:30.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:29 smithi172 ceph-mon[80431]: pgmap v662: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:32.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:31 smithi017 ceph-mon[108970]: pgmap v663: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:32.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:31 smithi172 ceph-mon[80431]: pgmap v663: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:32.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.577+0000 7fdec137e640 1 -- 172.21.15.17:0/216514062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc102b50 msgr2=0x7fdebc102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:32.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.577+0000 7fdec137e640 1 --2- 172.21.15.17:0/216514062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc102b50 0x7fdebc102f30 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdeac009880 tx=0x7fdeac02a530 comp rx=0 tx=0).stop 2024-09-20T18:57:32.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.577+0000 7fdec137e640 1 -- 172.21.15.17:0/216514062 shutdown_connections 2024-09-20T18:57:32.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.577+0000 7fdec137e640 1 --2- 172.21.15.17:0/216514062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdebc103470 0x7fdebc10b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:32.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.577+0000 7fdec137e640 1 --2- 172.21.15.17:0/216514062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc102b50 0x7fdebc102f30 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:32.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.577+0000 7fdec137e640 1 -- 172.21.15.17:0/216514062 >> 172.21.15.17:0/216514062 conn(0x7fdebc0fc550 msgr2=0x7fdebc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:32.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.577+0000 7fdec137e640 1 -- 172.21.15.17:0/216514062 shutdown_connections 2024-09-20T18:57:32.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.577+0000 7fdec137e640 1 -- 172.21.15.17:0/216514062 wait complete. 2024-09-20T18:57:32.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.577+0000 7fdec137e640 1 Processor -- start 2024-09-20T18:57:32.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.578+0000 7fdec137e640 1 -- start start 2024-09-20T18:57:32.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.578+0000 7fdec137e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc102b50 0x7fdebc19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:32.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.578+0000 7fdec137e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdebc103470 0x7fdebc19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:32.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.578+0000 7fdec137e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdebc10edc0 con 0x7fdebc102b50 2024-09-20T18:57:32.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.578+0000 7fdec137e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdebc10ec40 con 0x7fdebc103470 2024-09-20T18:57:32.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.578+0000 7fdebaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc102b50 0x7fdebc19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:32.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.578+0000 7fdebaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc102b50 0x7fdebc19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45200/0 (socket says 172.21.15.17:45200) 2024-09-20T18:57:32.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.578+0000 7fdebaffd640 1 -- 172.21.15.17:0/93702163 learned_addr learned my addr 172.21.15.17:0/93702163 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:57:32.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.578+0000 7fdeba7fc640 1 --2- 172.21.15.17:0/93702163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdebc103470 0x7fdebc19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:32.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.578+0000 7fdebaffd640 1 -- 172.21.15.17:0/93702163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdebc103470 msgr2=0x7fdebc19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:32.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.578+0000 7fdebaffd640 1 --2- 172.21.15.17:0/93702163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdebc103470 0x7fdebc19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:32.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.578+0000 7fdebaffd640 1 -- 172.21.15.17:0/93702163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdebc1977b0 con 0x7fdebc102b50 2024-09-20T18:57:32.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.579+0000 7fdebaffd640 1 --2- 172.21.15.17:0/93702163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc102b50 0x7fdebc19d630 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdeac004f90 tx=0x7fdeac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:32.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.579+0000 7fdeb3fff640 1 -- 172.21.15.17:0/93702163 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdeac03f070 con 0x7fdebc102b50 2024-09-20T18:57:32.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.579+0000 7fdeb3fff640 1 -- 172.21.15.17:0/93702163 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdeac004cf0 con 0x7fdebc102b50 2024-09-20T18:57:32.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.579+0000 7fdec137e640 1 -- 172.21.15.17:0/93702163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdebc197a40 con 0x7fdebc102b50 2024-09-20T18:57:32.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.579+0000 7fdeb3fff640 1 -- 172.21.15.17:0/93702163 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdeac035030 con 0x7fdebc102b50 2024-09-20T18:57:32.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.579+0000 7fdec137e640 1 -- 172.21.15.17:0/93702163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdebc197f70 con 0x7fdebc102b50 2024-09-20T18:57:32.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.580+0000 7fdec137e640 1 -- 172.21.15.17:0/93702163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdebc06a4e0 con 0x7fdebc102b50 2024-09-20T18:57:32.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.581+0000 7fdeb3fff640 1 -- 172.21.15.17:0/93702163 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdeac042070 con 0x7fdebc102b50 2024-09-20T18:57:32.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.581+0000 7fdeb3fff640 1 --2- 172.21.15.17:0/93702163 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdea807af80 0x7fdea807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:32.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.582+0000 7fdeb3fff640 1 -- 172.21.15.17:0/93702163 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fdeac0be960 con 0x7fdebc102b50 2024-09-20T18:57:32.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.582+0000 7fdeba7fc640 1 --2- 172.21.15.17:0/93702163 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdea807af80 0x7fdea807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:32.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.582+0000 7fdeba7fc640 1 --2- 172.21.15.17:0/93702163 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdea807af80 0x7fdea807d440 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdebc108920 tx=0x7fdea400a2d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:32.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.586+0000 7fdeb3fff640 1 -- 172.21.15.17:0/93702163 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdeac089fe0 con 0x7fdebc102b50 2024-09-20T18:57:32.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.793+0000 7fdec137e640 1 -- 172.21.15.17:0/93702163 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fdebc198ce0 con 0x7fdea807af80 2024-09-20T18:57:32.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.794+0000 7fdeb3fff640 1 -- 172.21.15.17:0/93702163 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fdebc198ce0 con 0x7fdea807af80 2024-09-20T18:57:32.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.796+0000 7fdec137e640 1 -- 172.21.15.17:0/93702163 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdea807af80 msgr2=0x7fdea807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:32.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.796+0000 7fdec137e640 1 --2- 172.21.15.17:0/93702163 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdea807af80 0x7fdea807d440 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdebc108920 tx=0x7fdea400a2d0 comp rx=0 tx=0).stop 2024-09-20T18:57:32.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.796+0000 7fdec137e640 1 -- 172.21.15.17:0/93702163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc102b50 msgr2=0x7fdebc19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:32.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.796+0000 7fdec137e640 1 --2- 172.21.15.17:0/93702163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc102b50 0x7fdebc19d630 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdeac004f90 tx=0x7fdeac0048f0 comp rx=0 tx=0).stop 2024-09-20T18:57:32.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.796+0000 7fdec137e640 1 -- 172.21.15.17:0/93702163 shutdown_connections 2024-09-20T18:57:32.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.796+0000 7fdec137e640 1 --2- 172.21.15.17:0/93702163 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdea807af80 0x7fdea807d440 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:32.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.796+0000 7fdec137e640 1 --2- 172.21.15.17:0/93702163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdebc103470 0x7fdebc19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:32.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.796+0000 7fdec137e640 1 --2- 172.21.15.17:0/93702163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc102b50 0x7fdebc19d630 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:32.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.796+0000 7fdec137e640 1 -- 172.21.15.17:0/93702163 >> 172.21.15.17:0/93702163 conn(0x7fdebc0fc550 msgr2=0x7fdebc108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:32.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.796+0000 7fdec137e640 1 -- 172.21.15.17:0/93702163 shutdown_connections 2024-09-20T18:57:32.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.796+0000 7fdec137e640 1 -- 172.21.15.17:0/93702163 wait complete. 2024-09-20T18:57:32.817 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:57:32.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.882+0000 7f07d1f0c640 1 -- 172.21.15.17:0/2223331937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07cc106800 msgr2=0x7f07cc106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:32.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.882+0000 7f07d1f0c640 1 --2- 172.21.15.17:0/2223331937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07cc106800 0x7f07cc106be0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009880 tx=0x7f07bc02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:57:32.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.882+0000 7f07d1f0c640 1 -- 172.21.15.17:0/2223331937 shutdown_connections 2024-09-20T18:57:32.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.882+0000 7f07d1f0c640 1 --2- 172.21.15.17:0/2223331937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07cc100800 0x7f07cc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:32.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.882+0000 7f07d1f0c640 1 --2- 172.21.15.17:0/2223331937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07cc106800 0x7f07cc106be0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:32.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.882+0000 7f07d1f0c640 1 -- 172.21.15.17:0/2223331937 >> 172.21.15.17:0/2223331937 conn(0x7f07cc0fc520 msgr2=0x7f07cc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:32.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.882+0000 7f07d1f0c640 1 -- 172.21.15.17:0/2223331937 shutdown_connections 2024-09-20T18:57:32.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.882+0000 7f07d1f0c640 1 -- 172.21.15.17:0/2223331937 wait complete. 2024-09-20T18:57:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.883+0000 7f07d1f0c640 1 Processor -- start 2024-09-20T18:57:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.883+0000 7f07d1f0c640 1 -- start start 2024-09-20T18:57:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.883+0000 7f07d1f0c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07cc100800 0x7f07cc0fcc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.883+0000 7f07d1f0c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07cc106800 0x7f07cc0fd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:32.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.883+0000 7f07d1f0c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc10dcd0 con 0x7f07cc100800 2024-09-20T18:57:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.883+0000 7f07d1f0c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc10db50 con 0x7f07cc106800 2024-09-20T18:57:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.883+0000 7f07cb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07cc100800 0x7f07cc0fcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.883+0000 7f07cb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07cc100800 0x7f07cc0fcc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45218/0 (socket says 172.21.15.17:45218) 2024-09-20T18:57:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.883+0000 7f07cb7fe640 1 -- 172.21.15.17:0/578344162 learned_addr learned my addr 172.21.15.17:0/578344162 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:57:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.884+0000 7f07caffd640 1 --2- 172.21.15.17:0/578344162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07cc106800 0x7f07cc0fd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.884+0000 7f07cb7fe640 1 -- 172.21.15.17:0/578344162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07cc106800 msgr2=0x7f07cc0fd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.884+0000 7f07cb7fe640 1 --2- 172.21.15.17:0/578344162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07cc106800 0x7f07cc0fd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.884+0000 7f07cb7fe640 1 -- 172.21.15.17:0/578344162 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07cc0fd6e0 con 0x7f07cc100800 2024-09-20T18:57:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.884+0000 7f07cb7fe640 1 --2- 172.21.15.17:0/578344162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07cc100800 0x7f07cc0fcc60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f07bc031460 tx=0x7f07bc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.884+0000 7f07c8ff9640 1 -- 172.21.15.17:0/578344162 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07bc03f070 con 0x7f07cc100800 2024-09-20T18:57:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.884+0000 7f07c8ff9640 1 -- 172.21.15.17:0/578344162 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07bc0035f0 con 0x7f07cc100800 2024-09-20T18:57:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.884+0000 7f07d1f0c640 1 -- 172.21.15.17:0/578344162 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07cc0fd970 con 0x7f07cc100800 2024-09-20T18:57:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.884+0000 7f07c8ff9640 1 -- 172.21.15.17:0/578344162 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07bc035030 con 0x7f07cc100800 2024-09-20T18:57:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.884+0000 7f07d1f0c640 1 -- 172.21.15.17:0/578344162 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07cc1a3da0 con 0x7f07cc100800 2024-09-20T18:57:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.885+0000 7f07d1f0c640 1 -- 172.21.15.17:0/578344162 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07cc101f40 con 0x7f07cc100800 2024-09-20T18:57:32.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.887+0000 7f07c8ff9640 1 -- 172.21.15.17:0/578344162 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f07bc042070 con 0x7f07cc100800 2024-09-20T18:57:32.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.887+0000 7f07c8ff9640 1 --2- 172.21.15.17:0/578344162 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f07b407af80 0x7f07b407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:32.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.887+0000 7f07c8ff9640 1 -- 172.21.15.17:0/578344162 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f07bc0be480 con 0x7f07cc100800 2024-09-20T18:57:32.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.887+0000 7f07caffd640 1 --2- 172.21.15.17:0/578344162 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f07b407af80 0x7f07b407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:32.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.888+0000 7f07caffd640 1 --2- 172.21.15.17:0/578344162 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f07b407af80 0x7f07b407d440 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0fe6f0 tx=0x7f07c000b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:32.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:32.892+0000 7f07c8ff9640 1 -- 172.21.15.17:0/578344162 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f07bc089b00 con 0x7f07cc100800 2024-09-20T18:57:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.095+0000 7f07d1f0c640 1 -- 172.21.15.17:0/578344162 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f07cc062630 con 0x7f07b407af80 2024-09-20T18:57:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.096+0000 7f07c8ff9640 1 -- 172.21.15.17:0/578344162 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f07cc062630 con 0x7f07b407af80 2024-09-20T18:57:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.098+0000 7f07d1f0c640 1 -- 172.21.15.17:0/578344162 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f07b407af80 msgr2=0x7f07b407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.098+0000 7f07d1f0c640 1 --2- 172.21.15.17:0/578344162 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f07b407af80 0x7f07b407d440 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0fe6f0 tx=0x7f07c000b390 comp rx=0 tx=0).stop 2024-09-20T18:57:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.098+0000 7f07d1f0c640 1 -- 172.21.15.17:0/578344162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07cc100800 msgr2=0x7f07cc0fcc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.098+0000 7f07d1f0c640 1 --2- 172.21.15.17:0/578344162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07cc100800 0x7f07cc0fcc60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f07bc031460 tx=0x7f07bc0045e0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.098+0000 7f07d1f0c640 1 -- 172.21.15.17:0/578344162 shutdown_connections 2024-09-20T18:57:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.098+0000 7f07d1f0c640 1 --2- 172.21.15.17:0/578344162 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f07b407af80 0x7f07b407d440 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.098+0000 7f07d1f0c640 1 --2- 172.21.15.17:0/578344162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07cc106800 0x7f07cc0fd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.098+0000 7f07d1f0c640 1 --2- 172.21.15.17:0/578344162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07cc100800 0x7f07cc0fcc60 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.098+0000 7f07d1f0c640 1 -- 172.21.15.17:0/578344162 >> 172.21.15.17:0/578344162 conn(0x7f07cc0fc520 msgr2=0x7f07cc06a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.098+0000 7f07d1f0c640 1 -- 172.21.15.17:0/578344162 shutdown_connections 2024-09-20T18:57:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.098+0000 7f07d1f0c640 1 -- 172.21.15.17:0/578344162 wait complete. 2024-09-20T18:57:33.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.183+0000 7ff4f2cd3640 1 -- 172.21.15.17:0/3227901197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4ec1067f0 msgr2=0x7ff4ec106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.183+0000 7ff4f2cd3640 1 --2- 172.21.15.17:0/3227901197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4ec1067f0 0x7ff4ec106bd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009880 tx=0x7ff4dc02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.183+0000 7ff4f2cd3640 1 -- 172.21.15.17:0/3227901197 shutdown_connections 2024-09-20T18:57:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.183+0000 7ff4f2cd3640 1 --2- 172.21.15.17:0/3227901197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4ec1007f0 0x7ff4ec100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.183+0000 7ff4f2cd3640 1 --2- 172.21.15.17:0/3227901197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4ec1067f0 0x7ff4ec106bd0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.183+0000 7ff4f2cd3640 1 -- 172.21.15.17:0/3227901197 >> 172.21.15.17:0/3227901197 conn(0x7ff4ec0fc550 msgr2=0x7ff4ec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.183+0000 7ff4f2cd3640 1 -- 172.21.15.17:0/3227901197 shutdown_connections 2024-09-20T18:57:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.183+0000 7ff4f2cd3640 1 -- 172.21.15.17:0/3227901197 wait complete. 2024-09-20T18:57:33.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.183+0000 7ff4f2cd3640 1 Processor -- start 2024-09-20T18:57:33.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.183+0000 7ff4f2cd3640 1 -- start start 2024-09-20T18:57:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.184+0000 7ff4f2cd3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4ec1007f0 0x7ff4ec1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.184+0000 7ff4f2cd3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4ec1067f0 0x7ff4ec198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.184+0000 7ff4f2cd3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec10dca0 con 0x7ff4ec1067f0 2024-09-20T18:57:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.184+0000 7ff4f2cd3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec10db20 con 0x7ff4ec1007f0 2024-09-20T18:57:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.184+0000 7ff4ebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4ec1067f0 0x7ff4ec198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.184+0000 7ff4ebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4ec1067f0 0x7ff4ec198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45230/0 (socket says 172.21.15.17:45230) 2024-09-20T18:57:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.184+0000 7ff4ebfff640 1 -- 172.21.15.17:0/2041177064 learned_addr learned my addr 172.21.15.17:0/2041177064 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:57:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.184+0000 7ff4f0a6f640 1 --2- 172.21.15.17:0/2041177064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4ec1007f0 0x7ff4ec1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.184+0000 7ff4ebfff640 1 -- 172.21.15.17:0/2041177064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4ec1007f0 msgr2=0x7ff4ec1988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.184+0000 7ff4ebfff640 1 --2- 172.21.15.17:0/2041177064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4ec1007f0 0x7ff4ec1988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.184+0000 7ff4ebfff640 1 -- 172.21.15.17:0/2041177064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec199410 con 0x7ff4ec1067f0 2024-09-20T18:57:33.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.184+0000 7ff4f0a6f640 1 --2- 172.21.15.17:0/2041177064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4ec1007f0 0x7ff4ec1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:57:33.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.184+0000 7ff4ebfff640 1 --2- 172.21.15.17:0/2041177064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4ec1067f0 0x7ff4ec198e10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000d8d0 tx=0x7ff4e000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:33.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.184+0000 7ff4e9ffb640 1 -- 172.21.15.17:0/2041177064 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4e0017070 con 0x7ff4ec1067f0 2024-09-20T18:57:33.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.184+0000 7ff4e9ffb640 1 -- 172.21.15.17:0/2041177064 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff4e0010460 con 0x7ff4ec1067f0 2024-09-20T18:57:33.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.184+0000 7ff4f2cd3640 1 -- 172.21.15.17:0/2041177064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4ec199700 con 0x7ff4ec1067f0 2024-09-20T18:57:33.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.184+0000 7ff4e9ffb640 1 -- 172.21.15.17:0/2041177064 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4e000f5f0 con 0x7ff4ec1067f0 2024-09-20T18:57:33.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.185+0000 7ff4f2cd3640 1 -- 172.21.15.17:0/2041177064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4ec1a1d00 con 0x7ff4ec1067f0 2024-09-20T18:57:33.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.186+0000 7ff4f2cd3640 1 -- 172.21.15.17:0/2041177064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4ec101f30 con 0x7ff4ec1067f0 2024-09-20T18:57:33.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.186+0000 7ff4e9ffb640 1 -- 172.21.15.17:0/2041177064 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff4e0009a30 con 0x7ff4ec1067f0 2024-09-20T18:57:33.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.187+0000 7ff4e9ffb640 1 --2- 172.21.15.17:0/2041177064 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4d407af80 0x7ff4d407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:33.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.187+0000 7ff4f0a6f640 1 --2- 172.21.15.17:0/2041177064 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4d407af80 0x7ff4d407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:33.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.187+0000 7ff4e9ffb640 1 -- 172.21.15.17:0/2041177064 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7ff4e009ddf0 con 0x7ff4ec1067f0 2024-09-20T18:57:33.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.188+0000 7ff4f0a6f640 1 --2- 172.21.15.17:0/2041177064 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4d407af80 0x7ff4d407d440 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc000c00 tx=0x7ff4dc031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:33.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.192+0000 7ff4e9ffb640 1 -- 172.21.15.17:0/2041177064 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff4ec199700 con 0x7ff4ec1067f0 2024-09-20T18:57:33.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.390+0000 7ff4f2cd3640 1 -- 172.21.15.17:0/2041177064 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff4ec062630 con 0x7ff4d407af80 2024-09-20T18:57:33.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.400+0000 7ff4e9ffb640 1 -- 172.21.15.17:0/2041177064 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ff4ec062630 con 0x7ff4d407af80 2024-09-20T18:57:33.411 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:57:33.412 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (18m) 13m ago 29m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:57:33.412 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (22m) 13m ago 30m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:57:33.412 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (21m) 12m ago 29m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:57:33.412 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (17m) 13m ago 30m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:57:33.412 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (17m) 12m ago 29m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:57:33.412 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (18m) 13m ago 29m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:57:33.412 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (13m) 13m ago 24m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:57:33.412 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (13m) 13m ago 24m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:57:33.412 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (24m) 12m ago 24m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:57:33.412 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (12m) 12m ago 24m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:57:33.412 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (21m) 13m ago 31m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:57:33.412 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (20m) 12m ago 29m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:57:33.412 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (17m) 13m ago 31m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:57:33.413 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (17m) 12m ago 29m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:57:33.413 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (19m) 13m ago 30m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:57:33.413 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (19m) 12m ago 29m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:57:33.413 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (16m) 13m ago 27m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:57:33.413 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (16m) 13m ago 27m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:57:33.413 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (15m) 13m ago 26m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:57:33.413 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (14m) 12m ago 26m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:57:33.413 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (14m) 12m ago 26m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:57:33.413 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (13m) 12m ago 25m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:57:33.413 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (19m) 13m ago 29m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:57:33.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.402+0000 7ff4f2cd3640 1 -- 172.21.15.17:0/2041177064 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4d407af80 msgr2=0x7ff4d407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:33.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.402+0000 7ff4f2cd3640 1 --2- 172.21.15.17:0/2041177064 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4d407af80 0x7ff4d407d440 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc000c00 tx=0x7ff4dc031400 comp rx=0 tx=0).stop 2024-09-20T18:57:33.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.402+0000 7ff4f2cd3640 1 -- 172.21.15.17:0/2041177064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4ec1067f0 msgr2=0x7ff4ec198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:33.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.402+0000 7ff4f2cd3640 1 --2- 172.21.15.17:0/2041177064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4ec1067f0 0x7ff4ec198e10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000d8d0 tx=0x7ff4e000dd90 comp rx=0 tx=0).stop 2024-09-20T18:57:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.402+0000 7ff4f2cd3640 1 -- 172.21.15.17:0/2041177064 shutdown_connections 2024-09-20T18:57:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.402+0000 7ff4f2cd3640 1 --2- 172.21.15.17:0/2041177064 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4d407af80 0x7ff4d407d440 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.402+0000 7ff4f2cd3640 1 --2- 172.21.15.17:0/2041177064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4ec1067f0 0x7ff4ec198e10 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.402+0000 7ff4f2cd3640 1 --2- 172.21.15.17:0/2041177064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4ec1007f0 0x7ff4ec1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.402+0000 7ff4f2cd3640 1 -- 172.21.15.17:0/2041177064 >> 172.21.15.17:0/2041177064 conn(0x7ff4ec0fc550 msgr2=0x7ff4ec0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.402+0000 7ff4f2cd3640 1 -- 172.21.15.17:0/2041177064 shutdown_connections 2024-09-20T18:57:33.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.402+0000 7ff4f2cd3640 1 -- 172.21.15.17:0/2041177064 wait complete. 2024-09-20T18:57:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.485+0000 7f76d3fab640 1 -- 172.21.15.17:0/3244752351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76cc100650 msgr2=0x7f76cc100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.485+0000 7f76d3fab640 1 --2- 172.21.15.17:0/3244752351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76cc100650 0x7f76cc100a30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009880 tx=0x7f76c802a490 comp rx=0 tx=0).stop 2024-09-20T18:57:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.485+0000 7f76d3fab640 1 -- 172.21.15.17:0/3244752351 shutdown_connections 2024-09-20T18:57:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.485+0000 7f76d3fab640 1 --2- 172.21.15.17:0/3244752351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76cc101000 0x7f76cc10dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.485+0000 7f76d3fab640 1 --2- 172.21.15.17:0/3244752351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76cc100650 0x7f76cc100a30 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.485+0000 7f76d3fab640 1 -- 172.21.15.17:0/3244752351 >> 172.21.15.17:0/3244752351 conn(0x7f76cc0fc520 msgr2=0x7f76cc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.485+0000 7f76d3fab640 1 -- 172.21.15.17:0/3244752351 shutdown_connections 2024-09-20T18:57:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.485+0000 7f76d3fab640 1 -- 172.21.15.17:0/3244752351 wait complete. 2024-09-20T18:57:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.485+0000 7f76d3fab640 1 Processor -- start 2024-09-20T18:57:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.486+0000 7f76d3fab640 1 -- start start 2024-09-20T18:57:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.486+0000 7f76d3fab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76cc100650 0x7f76cc19f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.486+0000 7f76d3fab640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76cc101000 0x7f76cc19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.486+0000 7f76d3fab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc110f90 con 0x7f76cc100650 2024-09-20T18:57:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.486+0000 7f76d3fab640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc110e10 con 0x7f76cc101000 2024-09-20T18:57:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.486+0000 7f76d1d47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76cc100650 0x7f76cc19f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:33.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.486+0000 7f76d1d47640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76cc100650 0x7f76cc19f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45236/0 (socket says 172.21.15.17:45236) 2024-09-20T18:57:33.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.486+0000 7f76d1d47640 1 -- 172.21.15.17:0/3287285066 learned_addr learned my addr 172.21.15.17:0/3287285066 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:57:33.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.486+0000 7f76d1546640 1 --2- 172.21.15.17:0/3287285066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76cc101000 0x7f76cc19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:33.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.486+0000 7f76d1d47640 1 -- 172.21.15.17:0/3287285066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76cc101000 msgr2=0x7f76cc19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:33.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.486+0000 7f76d1d47640 1 --2- 172.21.15.17:0/3287285066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76cc101000 0x7f76cc19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.486+0000 7f76d1d47640 1 -- 172.21.15.17:0/3287285066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76cc199980 con 0x7f76cc100650 2024-09-20T18:57:33.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.486+0000 7f76d1d47640 1 --2- 172.21.15.17:0/3287285066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76cc100650 0x7f76cc19f7c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f76c8031460 tx=0x7f76c80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:33.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.487+0000 7f76c2ffd640 1 -- 172.21.15.17:0/3287285066 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76c803f070 con 0x7f76cc100650 2024-09-20T18:57:33.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.487+0000 7f76d3fab640 1 -- 172.21.15.17:0/3287285066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76cc199c10 con 0x7f76cc100650 2024-09-20T18:57:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.487+0000 7f76c2ffd640 1 -- 172.21.15.17:0/3287285066 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76c8004b10 con 0x7f76cc100650 2024-09-20T18:57:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.487+0000 7f76c2ffd640 1 -- 172.21.15.17:0/3287285066 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76c8035030 con 0x7f76cc100650 2024-09-20T18:57:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.487+0000 7f76d3fab640 1 -- 172.21.15.17:0/3287285066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76cc19a1a0 con 0x7f76cc100650 2024-09-20T18:57:33.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.488+0000 7f76d3fab640 1 -- 172.21.15.17:0/3287285066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76cc06aa90 con 0x7f76cc100650 2024-09-20T18:57:33.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.489+0000 7f76c2ffd640 1 -- 172.21.15.17:0/3287285066 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f76c8042070 con 0x7f76cc100650 2024-09-20T18:57:33.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.489+0000 7f76c2ffd640 1 --2- 172.21.15.17:0/3287285066 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f76b807af90 0x7f76b807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:33.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.489+0000 7f76c2ffd640 1 -- 172.21.15.17:0/3287285066 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f76c80be9c0 con 0x7f76cc100650 2024-09-20T18:57:33.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.489+0000 7f76d1546640 1 --2- 172.21.15.17:0/3287285066 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f76b807af90 0x7f76b807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:33.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.490+0000 7f76d1546640 1 --2- 172.21.15.17:0/3287285066 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f76b807af90 0x7f76b807d450 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f76cc102530 tx=0x7f76bc00b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:33.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.494+0000 7f76c2ffd640 1 -- 172.21.15.17:0/3287285066 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f76c808a040 con 0x7f76cc100650 2024-09-20T18:57:33.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.759+0000 7f76d3fab640 1 -- 172.21.15.17:0/3287285066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f76cc19aeb0 con 0x7f76cc100650 2024-09-20T18:57:33.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.760+0000 7f76c2ffd640 1 -- 172.21.15.17:0/3287285066 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f76c808c560 con 0x7f76cc100650 2024-09-20T18:57:33.771 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:57:33.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:57:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:57:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:57:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:57:33.773 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:57:33.773 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:57:33.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.762+0000 7f76d3fab640 1 -- 172.21.15.17:0/3287285066 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f76b807af90 msgr2=0x7f76b807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:33.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.762+0000 7f76d3fab640 1 --2- 172.21.15.17:0/3287285066 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f76b807af90 0x7f76b807d450 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f76cc102530 tx=0x7f76bc00b390 comp rx=0 tx=0).stop 2024-09-20T18:57:33.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.762+0000 7f76d3fab640 1 -- 172.21.15.17:0/3287285066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76cc100650 msgr2=0x7f76cc19f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:33.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.762+0000 7f76d3fab640 1 --2- 172.21.15.17:0/3287285066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76cc100650 0x7f76cc19f7c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f76c8031460 tx=0x7f76c80045e0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.762+0000 7f76d3fab640 1 -- 172.21.15.17:0/3287285066 shutdown_connections 2024-09-20T18:57:33.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.762+0000 7f76d3fab640 1 --2- 172.21.15.17:0/3287285066 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f76b807af90 0x7f76b807d450 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.762+0000 7f76d3fab640 1 --2- 172.21.15.17:0/3287285066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76cc101000 0x7f76cc19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.762+0000 7f76d3fab640 1 --2- 172.21.15.17:0/3287285066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76cc100650 0x7f76cc19f7c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.762+0000 7f76d3fab640 1 -- 172.21.15.17:0/3287285066 >> 172.21.15.17:0/3287285066 conn(0x7f76cc0fc520 msgr2=0x7f76cc0fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:33.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.763+0000 7f76d3fab640 1 -- 172.21.15.17:0/3287285066 shutdown_connections 2024-09-20T18:57:33.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.763+0000 7f76d3fab640 1 -- 172.21.15.17:0/3287285066 wait complete. 2024-09-20T18:57:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.847+0000 7ffa093ee640 1 -- 172.21.15.17:0/2911757027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa04107900 msgr2=0x7ffa04107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.847+0000 7ffa093ee640 1 --2- 172.21.15.17:0/2911757027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa04107900 0x7ffa04107ce0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009880 tx=0x7ff9f402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.847+0000 7ffa093ee640 1 -- 172.21.15.17:0/2911757027 shutdown_connections 2024-09-20T18:57:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.847+0000 7ffa093ee640 1 --2- 172.21.15.17:0/2911757027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa04101900 0x7ffa04101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.847+0000 7ffa093ee640 1 --2- 172.21.15.17:0/2911757027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa04107900 0x7ffa04107ce0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.847+0000 7ffa093ee640 1 -- 172.21.15.17:0/2911757027 >> 172.21.15.17:0/2911757027 conn(0x7ffa040fd5e0 msgr2=0x7ffa040ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.847+0000 7ffa093ee640 1 -- 172.21.15.17:0/2911757027 shutdown_connections 2024-09-20T18:57:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.847+0000 7ffa093ee640 1 -- 172.21.15.17:0/2911757027 wait complete. 2024-09-20T18:57:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.847+0000 7ffa093ee640 1 Processor -- start 2024-09-20T18:57:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.848+0000 7ffa093ee640 1 -- start start 2024-09-20T18:57:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.848+0000 7ffa093ee640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa04101900 0x7ffa0419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.848+0000 7ffa093ee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa04107900 0x7ffa0419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.848+0000 7ffa093ee640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0410edb0 con 0x7ffa04107900 2024-09-20T18:57:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.848+0000 7ffa093ee640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0410ec30 con 0x7ffa04101900 2024-09-20T18:57:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.848+0000 7ffa027fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa04107900 0x7ffa0419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.848+0000 7ffa027fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa04107900 0x7ffa0419db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45260/0 (socket says 172.21.15.17:45260) 2024-09-20T18:57:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.848+0000 7ffa027fc640 1 -- 172.21.15.17:0/2734114115 learned_addr learned my addr 172.21.15.17:0/2734114115 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:57:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.848+0000 7ffa02ffd640 1 --2- 172.21.15.17:0/2734114115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa04101900 0x7ffa0419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.848+0000 7ffa027fc640 1 -- 172.21.15.17:0/2734114115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa04101900 msgr2=0x7ffa0419d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:33.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.848+0000 7ffa027fc640 1 --2- 172.21.15.17:0/2734114115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa04101900 0x7ffa0419d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.848+0000 7ffa027fc640 1 -- 172.21.15.17:0/2734114115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa041977a0 con 0x7ffa04107900 2024-09-20T18:57:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.848+0000 7ffa02ffd640 1 --2- 172.21.15.17:0/2734114115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa04101900 0x7ffa0419d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:57:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.848+0000 7ffa027fc640 1 --2- 172.21.15.17:0/2734114115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa04107900 0x7ffa0419db60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800e970 tx=0x7ff9f800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.849+0000 7ff9ebfff640 1 -- 172.21.15.17:0/2734114115 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9f800cac0 con 0x7ffa04107900 2024-09-20T18:57:33.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.849+0000 7ff9ebfff640 1 -- 172.21.15.17:0/2734114115 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9f800cc60 con 0x7ffa04107900 2024-09-20T18:57:33.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.849+0000 7ffa093ee640 1 -- 172.21.15.17:0/2734114115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa04197a90 con 0x7ffa04107900 2024-09-20T18:57:33.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.849+0000 7ff9ebfff640 1 -- 172.21.15.17:0/2734114115 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9f8018720 con 0x7ffa04107900 2024-09-20T18:57:33.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.849+0000 7ffa093ee640 1 -- 172.21.15.17:0/2734114115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa04198020 con 0x7ffa04107900 2024-09-20T18:57:33.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.850+0000 7ffa093ee640 1 -- 172.21.15.17:0/2734114115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa04103040 con 0x7ffa04107900 2024-09-20T18:57:33.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.851+0000 7ff9ebfff640 1 -- 172.21.15.17:0/2734114115 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff9f80188e0 con 0x7ffa04107900 2024-09-20T18:57:33.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.851+0000 7ff9ebfff640 1 --2- 172.21.15.17:0/2734114115 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff9ec07af80 0x7ff9ec07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:33.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.851+0000 7ffa02ffd640 1 --2- 172.21.15.17:0/2734114115 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff9ec07af80 0x7ff9ec07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:33.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.851+0000 7ff9ebfff640 1 -- 172.21.15.17:0/2734114115 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7ff9f809e5c0 con 0x7ffa04107900 2024-09-20T18:57:33.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.852+0000 7ffa02ffd640 1 --2- 172.21.15.17:0/2734114115 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff9ec07af80 0x7ff9ec07d440 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4000c00 tx=0x7ff9f4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:33.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:33.855+0000 7ff9ebfff640 1 -- 172.21.15.17:0/2734114115 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff9f8069c40 con 0x7ffa04107900 2024-09-20T18:57:34.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.079+0000 7ffa093ee640 1 -- 172.21.15.17:0/2734114115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ffa04104b10 con 0x7ffa04107900 2024-09-20T18:57:34.091 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:33 smithi017 ceph-mon[108970]: pgmap v664: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:34.091 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:33 smithi017 ceph-mon[108970]: from='client.35042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:34.091 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:33 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3287285066' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:57:34.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.079+0000 7ff9ebfff640 1 -- 172.21.15.17:0/2734114115 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7ff9f806eaf0 con 0x7ffa04107900 2024-09-20T18:57:34.092 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:57:34.092 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:57:34.092 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:57:34.092 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:57:34.092 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:57:34.092 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:57:34.093 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:57:34.093 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:57:34.093 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:57:34.093 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:57:34.093 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:57:34.093 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:57:34.093 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:57:34.093 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:57:34.093 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:57:34.094 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:57:34.094 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:57:34.094 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:57:34.094 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:57:34.094 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:57:34.094 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:57:34.094 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:57:34.094 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:57:34.094 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:57:34.094 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:57:34.095 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:57:34.095 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:57:34.095 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:57:34.095 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:57:34.095 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:57:34.095 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:57:34.095 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:57:34.095 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:57:34.095 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:57:34.095 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:57:34.095 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:57:34.095 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:57:34.096 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:57:34.096 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:57:34.096 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:57:34.096 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:57:34.096 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:57:34.096 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:57:34.096 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:57:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.081+0000 7ffa093ee640 1 -- 172.21.15.17:0/2734114115 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff9ec07af80 msgr2=0x7ff9ec07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.081+0000 7ffa093ee640 1 --2- 172.21.15.17:0/2734114115 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff9ec07af80 0x7ff9ec07d440 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4000c00 tx=0x7ff9f4031400 comp rx=0 tx=0).stop 2024-09-20T18:57:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.082+0000 7ffa093ee640 1 -- 172.21.15.17:0/2734114115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa04107900 msgr2=0x7ffa0419db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.082+0000 7ffa093ee640 1 --2- 172.21.15.17:0/2734114115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa04107900 0x7ffa0419db60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800e970 tx=0x7ff9f800ee30 comp rx=0 tx=0).stop 2024-09-20T18:57:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.082+0000 7ffa093ee640 1 -- 172.21.15.17:0/2734114115 shutdown_connections 2024-09-20T18:57:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.082+0000 7ffa093ee640 1 --2- 172.21.15.17:0/2734114115 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff9ec07af80 0x7ff9ec07d440 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.082+0000 7ffa093ee640 1 --2- 172.21.15.17:0/2734114115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa04107900 0x7ffa0419db60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.082+0000 7ffa093ee640 1 --2- 172.21.15.17:0/2734114115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa04101900 0x7ffa0419d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.082+0000 7ffa093ee640 1 -- 172.21.15.17:0/2734114115 >> 172.21.15.17:0/2734114115 conn(0x7ffa040fd5e0 msgr2=0x7ffa040feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.082+0000 7ffa093ee640 1 -- 172.21.15.17:0/2734114115 shutdown_connections 2024-09-20T18:57:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.082+0000 7ffa093ee640 1 -- 172.21.15.17:0/2734114115 wait complete. 2024-09-20T18:57:34.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.168+0000 7f5bb7fa9640 1 -- 172.21.15.17:0/2936802350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bb01033e0 msgr2=0x7f5bb010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:34.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.168+0000 7f5bb7fa9640 1 --2- 172.21.15.17:0/2936802350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bb01033e0 0x7f5bb010b8d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009880 tx=0x7f5ba002a530 comp rx=0 tx=0).stop 2024-09-20T18:57:34.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.168+0000 7f5bb7fa9640 1 -- 172.21.15.17:0/2936802350 shutdown_connections 2024-09-20T18:57:34.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.168+0000 7f5bb7fa9640 1 --2- 172.21.15.17:0/2936802350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bb01033e0 0x7f5bb010b8d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:34.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.168+0000 7f5bb7fa9640 1 --2- 172.21.15.17:0/2936802350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bb0102ac0 0x7f5bb0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:34.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.168+0000 7f5bb7fa9640 1 -- 172.21.15.17:0/2936802350 >> 172.21.15.17:0/2936802350 conn(0x7f5bb00fc520 msgr2=0x7f5bb00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:34.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.168+0000 7f5bb7fa9640 1 -- 172.21.15.17:0/2936802350 shutdown_connections 2024-09-20T18:57:34.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.168+0000 7f5bb7fa9640 1 -- 172.21.15.17:0/2936802350 wait complete. 2024-09-20T18:57:34.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.169+0000 7f5bb7fa9640 1 Processor -- start 2024-09-20T18:57:34.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.169+0000 7f5bb7fa9640 1 -- start start 2024-09-20T18:57:34.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.169+0000 7f5bb7fa9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bb0102ac0 0x7f5bb019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:34.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.169+0000 7f5bb7fa9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bb01033e0 0x7f5bb019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:34.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.169+0000 7f5bb7fa9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb010ee50 con 0x7f5bb01033e0 2024-09-20T18:57:34.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.169+0000 7f5bb7fa9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb010ecd0 con 0x7f5bb0102ac0 2024-09-20T18:57:34.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.169+0000 7f5bb5544640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bb01033e0 0x7f5bb019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:34.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.169+0000 7f5bb5544640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bb01033e0 0x7f5bb019dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45270/0 (socket says 172.21.15.17:45270) 2024-09-20T18:57:34.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.169+0000 7f5bb5544640 1 -- 172.21.15.17:0/1729144358 learned_addr learned my addr 172.21.15.17:0/1729144358 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:57:34.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.170+0000 7f5bb5d45640 1 --2- 172.21.15.17:0/1729144358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bb0102ac0 0x7f5bb019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:34.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.170+0000 7f5bb5544640 1 -- 172.21.15.17:0/1729144358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bb0102ac0 msgr2=0x7f5bb019d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:34.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.170+0000 7f5bb5544640 1 --2- 172.21.15.17:0/1729144358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bb0102ac0 0x7f5bb019d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:34.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.170+0000 7f5bb5544640 1 -- 172.21.15.17:0/1729144358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb0197880 con 0x7f5bb01033e0 2024-09-20T18:57:34.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.170+0000 7f5bb5544640 1 --2- 172.21.15.17:0/1729144358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bb01033e0 0x7f5bb019dc00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0031460 tx=0x7f5ba00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:34.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.170+0000 7f5ba6ffd640 1 -- 172.21.15.17:0/1729144358 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ba003f070 con 0x7f5bb01033e0 2024-09-20T18:57:34.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.170+0000 7f5ba6ffd640 1 -- 172.21.15.17:0/1729144358 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5ba0004ac0 con 0x7f5bb01033e0 2024-09-20T18:57:34.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.170+0000 7f5bb7fa9640 1 -- 172.21.15.17:0/1729144358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb0197b10 con 0x7f5bb01033e0 2024-09-20T18:57:34.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.170+0000 7f5ba6ffd640 1 -- 172.21.15.17:0/1729144358 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ba0035030 con 0x7f5bb01033e0 2024-09-20T18:57:34.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.170+0000 7f5bb7fa9640 1 -- 172.21.15.17:0/1729144358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb0198040 con 0x7f5bb01033e0 2024-09-20T18:57:34.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.171+0000 7f5bb7fa9640 1 -- 172.21.15.17:0/1729144358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb006aa90 con 0x7f5bb01033e0 2024-09-20T18:57:34.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.172+0000 7f5ba6ffd640 1 -- 172.21.15.17:0/1729144358 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5ba0042070 con 0x7f5bb01033e0 2024-09-20T18:57:34.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.173+0000 7f5ba6ffd640 1 --2- 172.21.15.17:0/1729144358 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b9c07af80 0x7f5b9c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:34.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.173+0000 7f5ba6ffd640 1 -- 172.21.15.17:0/1729144358 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f5ba00bea90 con 0x7f5bb01033e0 2024-09-20T18:57:34.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.173+0000 7f5bb5d45640 1 --2- 172.21.15.17:0/1729144358 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b9c07af80 0x7f5b9c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:34.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.173+0000 7f5bb5d45640 1 --2- 172.21.15.17:0/1729144358 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b9c07af80 0x7f5b9c07d440 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5bb01989c0 tx=0x7f5bac008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:34.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.177+0000 7f5ba6ffd640 1 -- 172.21.15.17:0/1729144358 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5ba008a070 con 0x7f5bb01033e0 2024-09-20T18:57:34.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:33 smithi172 ceph-mon[80431]: pgmap v664: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:34.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:33 smithi172 ceph-mon[80431]: from='client.35042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:34.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:33 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3287285066' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:57:34.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.385+0000 7f5bb7fa9640 1 -- 172.21.15.17:0/1729144358 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5bb0198db0 con 0x7f5b9c07af80 2024-09-20T18:57:34.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.387+0000 7f5ba6ffd640 1 -- 172.21.15.17:0/1729144358 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f5bb0198db0 con 0x7f5b9c07af80 2024-09-20T18:57:34.399 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:57:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:57:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:57:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:57:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:57:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:57:34.399 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:57:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:57:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:57:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:57:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:57:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:57:34.400 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:57:34.400 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:57:34.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.389+0000 7f5bb7fa9640 1 -- 172.21.15.17:0/1729144358 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b9c07af80 msgr2=0x7f5b9c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:34.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.389+0000 7f5bb7fa9640 1 --2- 172.21.15.17:0/1729144358 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b9c07af80 0x7f5b9c07d440 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5bb01989c0 tx=0x7f5bac008040 comp rx=0 tx=0).stop 2024-09-20T18:57:34.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.389+0000 7f5bb7fa9640 1 -- 172.21.15.17:0/1729144358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bb01033e0 msgr2=0x7f5bb019dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:34.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.389+0000 7f5bb7fa9640 1 --2- 172.21.15.17:0/1729144358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bb01033e0 0x7f5bb019dc00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0031460 tx=0x7f5ba00046c0 comp rx=0 tx=0).stop 2024-09-20T18:57:34.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.389+0000 7f5bb7fa9640 1 -- 172.21.15.17:0/1729144358 shutdown_connections 2024-09-20T18:57:34.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.389+0000 7f5bb7fa9640 1 --2- 172.21.15.17:0/1729144358 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b9c07af80 0x7f5b9c07d440 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:34.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.390+0000 7f5bb7fa9640 1 --2- 172.21.15.17:0/1729144358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bb01033e0 0x7f5bb019dc00 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:34.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.390+0000 7f5bb7fa9640 1 --2- 172.21.15.17:0/1729144358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bb0102ac0 0x7f5bb019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:34.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.390+0000 7f5bb7fa9640 1 -- 172.21.15.17:0/1729144358 >> 172.21.15.17:0/1729144358 conn(0x7f5bb00fc520 msgr2=0x7f5bb0108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:34.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.390+0000 7f5bb7fa9640 1 -- 172.21.15.17:0/1729144358 shutdown_connections 2024-09-20T18:57:34.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.390+0000 7f5bb7fa9640 1 -- 172.21.15.17:0/1729144358 wait complete. 2024-09-20T18:57:34.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.474+0000 7f9355e88640 1 -- 172.21.15.17:0/3485184325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9350103490 msgr2=0x7f935010b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:34.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.474+0000 7f9355e88640 1 --2- 172.21.15.17:0/3485184325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9350103490 0x7f935010b980 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9344009880 tx=0x7f934402a530 comp rx=0 tx=0).stop 2024-09-20T18:57:34.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.474+0000 7f9355e88640 1 -- 172.21.15.17:0/3485184325 shutdown_connections 2024-09-20T18:57:34.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.474+0000 7f9355e88640 1 --2- 172.21.15.17:0/3485184325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9350103490 0x7f935010b980 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:34.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.474+0000 7f9355e88640 1 --2- 172.21.15.17:0/3485184325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9350102b70 0x7f9350102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:34.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.474+0000 7f9355e88640 1 -- 172.21.15.17:0/3485184325 >> 172.21.15.17:0/3485184325 conn(0x7f93500fc550 msgr2=0x7f93500fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:34.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.474+0000 7f9355e88640 1 -- 172.21.15.17:0/3485184325 shutdown_connections 2024-09-20T18:57:34.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.474+0000 7f9355e88640 1 -- 172.21.15.17:0/3485184325 wait complete. 2024-09-20T18:57:34.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.474+0000 7f9355e88640 1 Processor -- start 2024-09-20T18:57:34.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.475+0000 7f9355e88640 1 -- start start 2024-09-20T18:57:34.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.475+0000 7f9355e88640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9350102b70 0x7f935019d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:34.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.475+0000 7f9355e88640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9350103490 0x7f935019db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:34.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.475+0000 7f9355e88640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f935010edc0 con 0x7f9350102b70 2024-09-20T18:57:34.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.475+0000 7f9355e88640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f935010ec40 con 0x7f9350103490 2024-09-20T18:57:34.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.475+0000 7f934f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9350102b70 0x7f935019d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:34.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.475+0000 7f934f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9350102b70 0x7f935019d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45288/0 (socket says 172.21.15.17:45288) 2024-09-20T18:57:34.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.475+0000 7f934f7fe640 1 -- 172.21.15.17:0/1098367323 learned_addr learned my addr 172.21.15.17:0/1098367323 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:57:34.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.475+0000 7f934effd640 1 --2- 172.21.15.17:0/1098367323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9350103490 0x7f935019db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:34.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.475+0000 7f934f7fe640 1 -- 172.21.15.17:0/1098367323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9350103490 msgr2=0x7f935019db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:34.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.475+0000 7f934f7fe640 1 --2- 172.21.15.17:0/1098367323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9350103490 0x7f935019db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:34.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.475+0000 7f934f7fe640 1 -- 172.21.15.17:0/1098367323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9350197790 con 0x7f9350102b70 2024-09-20T18:57:34.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.476+0000 7f934f7fe640 1 --2- 172.21.15.17:0/1098367323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9350102b70 0x7f935019d610 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f934000c810 tx=0x7f934000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:34.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.476+0000 7f934cff9640 1 -- 172.21.15.17:0/1098367323 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9340004020 con 0x7f9350102b70 2024-09-20T18:57:34.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.476+0000 7f9355e88640 1 -- 172.21.15.17:0/1098367323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9350197a80 con 0x7f9350102b70 2024-09-20T18:57:34.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.476+0000 7f934cff9640 1 -- 172.21.15.17:0/1098367323 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f93400041c0 con 0x7f9350102b70 2024-09-20T18:57:34.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.476+0000 7f934cff9640 1 -- 172.21.15.17:0/1098367323 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93400047a0 con 0x7f9350102b70 2024-09-20T18:57:34.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.476+0000 7f9355e88640 1 -- 172.21.15.17:0/1098367323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9350197fe0 con 0x7f9350102b70 2024-09-20T18:57:34.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.477+0000 7f9355e88640 1 -- 172.21.15.17:0/1098367323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f935006a4c0 con 0x7f9350102b70 2024-09-20T18:57:34.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.478+0000 7f934cff9640 1 -- 172.21.15.17:0/1098367323 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f93400079b0 con 0x7f9350102b70 2024-09-20T18:57:34.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.478+0000 7f934cff9640 1 --2- 172.21.15.17:0/1098367323 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f933807af30 0x7f933807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:57:34.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.478+0000 7f934cff9640 1 -- 172.21.15.17:0/1098367323 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f934009deb0 con 0x7f9350102b70 2024-09-20T18:57:34.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.478+0000 7f934effd640 1 --2- 172.21.15.17:0/1098367323 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f933807af30 0x7f933807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:57:34.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.479+0000 7f934effd640 1 --2- 172.21.15.17:0/1098367323 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f933807af30 0x7f933807d3f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9350198ae0 tx=0x7f9344004f30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:57:34.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.482+0000 7f934cff9640 1 -- 172.21.15.17:0/1098367323 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9340014030 con 0x7f9350102b70 2024-09-20T18:57:34.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.743+0000 7f9355e88640 1 -- 172.21.15.17:0/1098367323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f9350106000 con 0x7f9350102b70 2024-09-20T18:57:34.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.743+0000 7f934cff9640 1 -- 172.21.15.17:0/1098367323 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f93400694b0 con 0x7f9350102b70 2024-09-20T18:57:34.755 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:57:34.756 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:57:34.756 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:57:34.756 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:57:34.756 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:57:34.756 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:57:34.756 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:57:34.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.746+0000 7f9355e88640 1 -- 172.21.15.17:0/1098367323 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f933807af30 msgr2=0x7f933807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:34.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.746+0000 7f9355e88640 1 --2- 172.21.15.17:0/1098367323 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f933807af30 0x7f933807d3f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9350198ae0 tx=0x7f9344004f30 comp rx=0 tx=0).stop 2024-09-20T18:57:34.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.746+0000 7f9355e88640 1 -- 172.21.15.17:0/1098367323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9350102b70 msgr2=0x7f935019d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:57:34.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.746+0000 7f9355e88640 1 --2- 172.21.15.17:0/1098367323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9350102b70 0x7f935019d610 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f934000c810 tx=0x7f934000ccd0 comp rx=0 tx=0).stop 2024-09-20T18:57:34.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.746+0000 7f9355e88640 1 -- 172.21.15.17:0/1098367323 shutdown_connections 2024-09-20T18:57:34.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.746+0000 7f9355e88640 1 --2- 172.21.15.17:0/1098367323 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f933807af30 0x7f933807d3f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:34.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.746+0000 7f9355e88640 1 --2- 172.21.15.17:0/1098367323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9350103490 0x7f935019db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:34.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.746+0000 7f9355e88640 1 --2- 172.21.15.17:0/1098367323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9350102b70 0x7f935019d610 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:57:34.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.746+0000 7f9355e88640 1 -- 172.21.15.17:0/1098367323 >> 172.21.15.17:0/1098367323 conn(0x7f93500fc550 msgr2=0x7f9350103d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:57:34.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.746+0000 7f9355e88640 1 -- 172.21.15.17:0/1098367323 shutdown_connections 2024-09-20T18:57:34.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:57:34.746+0000 7f9355e88640 1 -- 172.21.15.17:0/1098367323 wait complete. 2024-09-20T18:57:35.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:34 smithi017 ceph-mon[108970]: from='client.35046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:35.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:34 smithi017 ceph-mon[108970]: from='client.35050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:35.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:34 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2734114115' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:57:35.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:34 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1098367323' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:57:35.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:34 smithi172 ceph-mon[80431]: from='client.35046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:35.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:34 smithi172 ceph-mon[80431]: from='client.35050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:35.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:34 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2734114115' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:57:35.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:34 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1098367323' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:57:36.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:35 smithi017 ceph-mon[108970]: from='client.35062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:36.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:35 smithi017 ceph-mon[108970]: pgmap v665: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:36.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:35 smithi172 ceph-mon[80431]: from='client.35062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:57:36.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:35 smithi172 ceph-mon[80431]: pgmap v665: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:38.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:37 smithi017 ceph-mon[108970]: pgmap v666: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:38.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:57:38.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:37 smithi172 ceph-mon[80431]: pgmap v666: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:38.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:57:40.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:39 smithi017 ceph-mon[108970]: pgmap v667: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:40.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:39 smithi172 ceph-mon[80431]: pgmap v667: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:42.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:41 smithi017 ceph-mon[108970]: pgmap v668: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:42.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:41 smithi172 ceph-mon[80431]: pgmap v668: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:43.956 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:43 smithi172 ceph-mon[80431]: pgmap v669: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:44.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:43 smithi017 ceph-mon[108970]: pgmap v669: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:46.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:45 smithi017 ceph-mon[108970]: pgmap v670: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:46.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:45 smithi172 ceph-mon[80431]: pgmap v670: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:48.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:47 smithi017 ceph-mon[108970]: pgmap v671: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:48.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:47 smithi172 ceph-mon[80431]: pgmap v671: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:50.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:49 smithi017 ceph-mon[108970]: pgmap v672: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:50.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:49 smithi172 ceph-mon[80431]: pgmap v672: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:52.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:51 smithi017 ceph-mon[108970]: pgmap v673: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:52.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:51 smithi172 ceph-mon[80431]: pgmap v673: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:53.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:57:53.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:57:54.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:53 smithi017 ceph-mon[108970]: pgmap v674: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:54.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:53 smithi172 ceph-mon[80431]: pgmap v674: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:56.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:55 smithi017 ceph-mon[108970]: pgmap v675: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:56.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:55 smithi172 ceph-mon[80431]: pgmap v675: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:58.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:57 smithi017 ceph-mon[108970]: pgmap v676: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:57:58.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:57 smithi172 ceph-mon[80431]: pgmap v676: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:00.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:57:59 smithi172 ceph-mon[80431]: pgmap v677: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:00.397 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:57:59 smithi017 ceph-mon[108970]: pgmap v677: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:02.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:01 smithi172 ceph-mon[80431]: pgmap v678: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:02.397 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:01 smithi017 ceph-mon[108970]: pgmap v678: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:04.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:03 smithi172 ceph-mon[80431]: pgmap v679: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:04.397 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:03 smithi017 ceph-mon[108970]: pgmap v679: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:04.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.843+0000 7f44034d4640 1 -- 172.21.15.17:0/3105429356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc102ab0 msgr2=0x7f43fc102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:04.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.843+0000 7f44034d4640 1 --2- 172.21.15.17:0/3105429356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc102ab0 0x7f43fc102e90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009880 tx=0x7f43f802a530 comp rx=0 tx=0).stop 2024-09-20T18:58:04.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.843+0000 7f44034d4640 1 -- 172.21.15.17:0/3105429356 shutdown_connections 2024-09-20T18:58:04.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.843+0000 7f44034d4640 1 --2- 172.21.15.17:0/3105429356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc1033d0 0x7f43fc10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:04.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.843+0000 7f44034d4640 1 --2- 172.21.15.17:0/3105429356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc102ab0 0x7f43fc102e90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:04.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.843+0000 7f44034d4640 1 -- 172.21.15.17:0/3105429356 >> 172.21.15.17:0/3105429356 conn(0x7f43fc0fc550 msgr2=0x7f43fc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:04.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.843+0000 7f44034d4640 1 -- 172.21.15.17:0/3105429356 shutdown_connections 2024-09-20T18:58:04.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.843+0000 7f44034d4640 1 -- 172.21.15.17:0/3105429356 wait complete. 2024-09-20T18:58:04.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.844+0000 7f44034d4640 1 Processor -- start 2024-09-20T18:58:04.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.844+0000 7f44034d4640 1 -- start start 2024-09-20T18:58:04.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.845+0000 7f44034d4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc102ab0 0x7f43fc19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:04.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.845+0000 7f44034d4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc1033d0 0x7f43fc19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:04.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.845+0000 7f44034d4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc10ede0 con 0x7f43fc102ab0 2024-09-20T18:58:04.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.845+0000 7f44034d4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc10ec60 con 0x7f43fc1033d0 2024-09-20T18:58:04.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.845+0000 7f4401270640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc102ab0 0x7f43fc19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:04.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.845+0000 7f4401270640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc102ab0 0x7f43fc19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33628/0 (socket says 172.21.15.17:33628) 2024-09-20T18:58:04.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.845+0000 7f4401270640 1 -- 172.21.15.17:0/1680698020 learned_addr learned my addr 172.21.15.17:0/1680698020 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:58:04.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.845+0000 7f4400a6f640 1 --2- 172.21.15.17:0/1680698020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc1033d0 0x7f43fc19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:04.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.845+0000 7f4401270640 1 -- 172.21.15.17:0/1680698020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc1033d0 msgr2=0x7f43fc19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:04.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.845+0000 7f4401270640 1 --2- 172.21.15.17:0/1680698020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc1033d0 0x7f43fc19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:04.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.845+0000 7f4401270640 1 -- 172.21.15.17:0/1680698020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc1977b0 con 0x7f43fc102ab0 2024-09-20T18:58:04.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.845+0000 7f4401270640 1 --2- 172.21.15.17:0/1680698020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc102ab0 0x7f43fc19d630 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f43f8031460 tx=0x7f43f80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:04.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.846+0000 7f43f27fc640 1 -- 172.21.15.17:0/1680698020 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f43f803f070 con 0x7f43fc102ab0 2024-09-20T18:58:04.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.846+0000 7f43f27fc640 1 -- 172.21.15.17:0/1680698020 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f43f8004cf0 con 0x7f43fc102ab0 2024-09-20T18:58:04.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.846+0000 7f44034d4640 1 -- 172.21.15.17:0/1680698020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43fc197a40 con 0x7f43fc102ab0 2024-09-20T18:58:04.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.846+0000 7f43f27fc640 1 -- 172.21.15.17:0/1680698020 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f43f8035030 con 0x7f43fc102ab0 2024-09-20T18:58:04.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.846+0000 7f44034d4640 1 -- 172.21.15.17:0/1680698020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43fc197f70 con 0x7f43fc102ab0 2024-09-20T18:58:04.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.847+0000 7f44034d4640 1 -- 172.21.15.17:0/1680698020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43fc06a580 con 0x7f43fc102ab0 2024-09-20T18:58:04.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.848+0000 7f43f27fc640 1 -- 172.21.15.17:0/1680698020 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f43f8042070 con 0x7f43fc102ab0 2024-09-20T18:58:04.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.848+0000 7f43f27fc640 1 --2- 172.21.15.17:0/1680698020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43e807af30 0x7f43e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:04.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.848+0000 7f43f27fc640 1 -- 172.21.15.17:0/1680698020 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f43f80bea10 con 0x7f43fc102ab0 2024-09-20T18:58:04.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.848+0000 7f4400a6f640 1 --2- 172.21.15.17:0/1680698020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43e807af30 0x7f43e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.849+0000 7f4400a6f640 1 --2- 172.21.15.17:0/1680698020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43e807af30 0x7f43e807d3f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f43fc1088f0 tx=0x7f43ec005f50 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:04.853+0000 7f43f27fc640 1 -- 172.21.15.17:0/1680698020 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43f808a010 con 0x7f43fc102ab0 2024-09-20T18:58:05.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.062+0000 7f44034d4640 1 -- 172.21.15.17:0/1680698020 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f43fc1982e0 con 0x7f43e807af30 2024-09-20T18:58:05.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.063+0000 7f43f27fc640 1 -- 172.21.15.17:0/1680698020 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f43fc1982e0 con 0x7f43e807af30 2024-09-20T18:58:05.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.065+0000 7f44034d4640 1 -- 172.21.15.17:0/1680698020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43e807af30 msgr2=0x7f43e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:05.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.065+0000 7f44034d4640 1 --2- 172.21.15.17:0/1680698020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43e807af30 0x7f43e807d3f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f43fc1088f0 tx=0x7f43ec005f50 comp rx=0 tx=0).stop 2024-09-20T18:58:05.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.065+0000 7f44034d4640 1 -- 172.21.15.17:0/1680698020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc102ab0 msgr2=0x7f43fc19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:05.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.065+0000 7f44034d4640 1 --2- 172.21.15.17:0/1680698020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc102ab0 0x7f43fc19d630 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f43f8031460 tx=0x7f43f80048f0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.065+0000 7f44034d4640 1 -- 172.21.15.17:0/1680698020 shutdown_connections 2024-09-20T18:58:05.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.065+0000 7f44034d4640 1 --2- 172.21.15.17:0/1680698020 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43e807af30 0x7f43e807d3f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.065+0000 7f44034d4640 1 --2- 172.21.15.17:0/1680698020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc1033d0 0x7f43fc19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.065+0000 7f44034d4640 1 --2- 172.21.15.17:0/1680698020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc102ab0 0x7f43fc19d630 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.065+0000 7f44034d4640 1 -- 172.21.15.17:0/1680698020 >> 172.21.15.17:0/1680698020 conn(0x7f43fc0fc550 msgr2=0x7f43fc10aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:05.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.066+0000 7f44034d4640 1 -- 172.21.15.17:0/1680698020 shutdown_connections 2024-09-20T18:58:05.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.066+0000 7f44034d4640 1 -- 172.21.15.17:0/1680698020 wait complete. 2024-09-20T18:58:05.087 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:58:05.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.151+0000 7f3b0567c640 1 -- 172.21.15.17:0/227118835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b001033d0 msgr2=0x7f3b0010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:05.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.151+0000 7f3b0567c640 1 --2- 172.21.15.17:0/227118835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b001033d0 0x7f3b0010b8c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009880 tx=0x7f3af402a530 comp rx=0 tx=0).stop 2024-09-20T18:58:05.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.151+0000 7f3b0567c640 1 -- 172.21.15.17:0/227118835 shutdown_connections 2024-09-20T18:58:05.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.151+0000 7f3b0567c640 1 --2- 172.21.15.17:0/227118835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b001033d0 0x7f3b0010b8c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.151+0000 7f3b0567c640 1 --2- 172.21.15.17:0/227118835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b00102ab0 0x7f3b00102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.151+0000 7f3b0567c640 1 -- 172.21.15.17:0/227118835 >> 172.21.15.17:0/227118835 conn(0x7f3b000fc550 msgr2=0x7f3b000fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:05.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.152+0000 7f3b0567c640 1 -- 172.21.15.17:0/227118835 shutdown_connections 2024-09-20T18:58:05.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.152+0000 7f3b0567c640 1 -- 172.21.15.17:0/227118835 wait complete. 2024-09-20T18:58:05.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.152+0000 7f3b0567c640 1 Processor -- start 2024-09-20T18:58:05.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.152+0000 7f3b0567c640 1 -- start start 2024-09-20T18:58:05.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.153+0000 7f3b0567c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b00102ab0 0x7f3b0019f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:05.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.153+0000 7f3b0567c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b001033d0 0x7f3b0019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:05.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.153+0000 7f3b0567c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0010ede0 con 0x7f3b00102ab0 2024-09-20T18:58:05.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.153+0000 7f3b0567c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0010ec60 con 0x7f3b001033d0 2024-09-20T18:58:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.153+0000 7f3afeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b00102ab0 0x7f3b0019f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.153+0000 7f3afeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b00102ab0 0x7f3b0019f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33638/0 (socket says 172.21.15.17:33638) 2024-09-20T18:58:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.153+0000 7f3afeffd640 1 -- 172.21.15.17:0/2116398718 learned_addr learned my addr 172.21.15.17:0/2116398718 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:58:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.153+0000 7f3afe7fc640 1 --2- 172.21.15.17:0/2116398718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b001033d0 0x7f3b0019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.153+0000 7f3afeffd640 1 -- 172.21.15.17:0/2116398718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b001033d0 msgr2=0x7f3b0019fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.153+0000 7f3afeffd640 1 --2- 172.21.15.17:0/2116398718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b001033d0 0x7f3b0019fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.153+0000 7f3afeffd640 1 -- 172.21.15.17:0/2116398718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b001999e0 con 0x7f3b00102ab0 2024-09-20T18:58:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.153+0000 7f3afeffd640 1 --2- 172.21.15.17:0/2116398718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b00102ab0 0x7f3b0019f820 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3af000cc60 tx=0x7f3af000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.153+0000 7f3ae7fff640 1 -- 172.21.15.17:0/2116398718 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3af000ad30 con 0x7f3b00102ab0 2024-09-20T18:58:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.153+0000 7f3ae7fff640 1 -- 172.21.15.17:0/2116398718 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3af0005020 con 0x7f3b00102ab0 2024-09-20T18:58:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.153+0000 7f3b0567c640 1 -- 172.21.15.17:0/2116398718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b00199cd0 con 0x7f3b00102ab0 2024-09-20T18:58:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.153+0000 7f3ae7fff640 1 -- 172.21.15.17:0/2116398718 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3af000f640 con 0x7f3b00102ab0 2024-09-20T18:58:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.154+0000 7f3b0567c640 1 -- 172.21.15.17:0/2116398718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b0019a230 con 0x7f3b00102ab0 2024-09-20T18:58:05.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.154+0000 7f3b0567c640 1 -- 172.21.15.17:0/2116398718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b0006a580 con 0x7f3b00102ab0 2024-09-20T18:58:05.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.155+0000 7f3ae7fff640 1 -- 172.21.15.17:0/2116398718 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3af00051d0 con 0x7f3b00102ab0 2024-09-20T18:58:05.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.156+0000 7f3ae7fff640 1 --2- 172.21.15.17:0/2116398718 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3ae807af30 0x7f3ae807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:05.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.156+0000 7f3afe7fc640 1 --2- 172.21.15.17:0/2116398718 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3ae807af30 0x7f3ae807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:05.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.156+0000 7f3ae7fff640 1 -- 172.21.15.17:0/2116398718 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f3af009e280 con 0x7f3b00102ab0 2024-09-20T18:58:05.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.156+0000 7f3afe7fc640 1 --2- 172.21.15.17:0/2116398718 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3ae807af30 0x7f3ae807d3f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3b0019b1d0 tx=0x7f3af4031420 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:05.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.160+0000 7f3ae7fff640 1 -- 172.21.15.17:0/2116398718 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3af0014030 con 0x7f3b00102ab0 2024-09-20T18:58:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.364+0000 7f3b0567c640 1 -- 172.21.15.17:0/2116398718 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3b0019af10 con 0x7f3ae807af30 2024-09-20T18:58:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.365+0000 7f3ae7fff640 1 -- 172.21.15.17:0/2116398718 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f3b0019af10 con 0x7f3ae807af30 2024-09-20T18:58:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.367+0000 7f3b0567c640 1 -- 172.21.15.17:0/2116398718 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3ae807af30 msgr2=0x7f3ae807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.367+0000 7f3b0567c640 1 --2- 172.21.15.17:0/2116398718 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3ae807af30 0x7f3ae807d3f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3b0019b1d0 tx=0x7f3af4031420 comp rx=0 tx=0).stop 2024-09-20T18:58:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.367+0000 7f3b0567c640 1 -- 172.21.15.17:0/2116398718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b00102ab0 msgr2=0x7f3b0019f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.367+0000 7f3b0567c640 1 --2- 172.21.15.17:0/2116398718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b00102ab0 0x7f3b0019f820 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3af000cc60 tx=0x7f3af000a620 comp rx=0 tx=0).stop 2024-09-20T18:58:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.368+0000 7f3b0567c640 1 -- 172.21.15.17:0/2116398718 shutdown_connections 2024-09-20T18:58:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.368+0000 7f3b0567c640 1 --2- 172.21.15.17:0/2116398718 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3ae807af30 0x7f3ae807d3f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.368+0000 7f3b0567c640 1 --2- 172.21.15.17:0/2116398718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b001033d0 0x7f3b0019fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.368+0000 7f3b0567c640 1 --2- 172.21.15.17:0/2116398718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b00102ab0 0x7f3b0019f820 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.368+0000 7f3b0567c640 1 -- 172.21.15.17:0/2116398718 >> 172.21.15.17:0/2116398718 conn(0x7f3b000fc550 msgr2=0x7f3b00100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.368+0000 7f3b0567c640 1 -- 172.21.15.17:0/2116398718 shutdown_connections 2024-09-20T18:58:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.368+0000 7f3b0567c640 1 -- 172.21.15.17:0/2116398718 wait complete. 2024-09-20T18:58:05.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.452+0000 7f28157f5640 1 -- 172.21.15.17:0/594587020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2810100800 msgr2=0x7f2810100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:05.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.452+0000 7f28157f5640 1 --2- 172.21.15.17:0/594587020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2810100800 0x7f2810100c60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2804009880 tx=0x7f280402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.452+0000 7f28157f5640 1 -- 172.21.15.17:0/594587020 shutdown_connections 2024-09-20T18:58:05.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.452+0000 7f28157f5640 1 --2- 172.21.15.17:0/594587020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2810100800 0x7f2810100c60 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.452+0000 7f28157f5640 1 --2- 172.21.15.17:0/594587020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2810106800 0x7f2810106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.452+0000 7f28157f5640 1 -- 172.21.15.17:0/594587020 >> 172.21.15.17:0/594587020 conn(0x7f28100fc520 msgr2=0x7f28100fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:05.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.452+0000 7f28157f5640 1 -- 172.21.15.17:0/594587020 shutdown_connections 2024-09-20T18:58:05.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.452+0000 7f28157f5640 1 -- 172.21.15.17:0/594587020 wait complete. 2024-09-20T18:58:05.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.453+0000 7f28157f5640 1 Processor -- start 2024-09-20T18:58:05.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.453+0000 7f28157f5640 1 -- start start 2024-09-20T18:58:05.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.453+0000 7f28157f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2810100800 0x7f28101987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:05.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.453+0000 7f28157f5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2810106800 0x7f2810198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:05.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.454+0000 7f28157f5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f281010dcd0 con 0x7f2810106800 2024-09-20T18:58:05.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.454+0000 7f28157f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f281010db50 con 0x7f2810100800 2024-09-20T18:58:05.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.454+0000 7f280e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2810106800 0x7f2810198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:05.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.454+0000 7f280e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2810106800 0x7f2810198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33650/0 (socket says 172.21.15.17:33650) 2024-09-20T18:58:05.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.454+0000 7f280e7fc640 1 -- 172.21.15.17:0/2666337506 learned_addr learned my addr 172.21.15.17:0/2666337506 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:58:05.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.454+0000 7f280effd640 1 --2- 172.21.15.17:0/2666337506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2810100800 0x7f28101987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:05.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.454+0000 7f280e7fc640 1 -- 172.21.15.17:0/2666337506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2810100800 msgr2=0x7f28101987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:05.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.454+0000 7f280e7fc640 1 --2- 172.21.15.17:0/2666337506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2810100800 0x7f28101987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.454+0000 7f280e7fc640 1 -- 172.21.15.17:0/2666337506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2810199370 con 0x7f2810106800 2024-09-20T18:58:05.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.454+0000 7f280e7fc640 1 --2- 172.21.15.17:0/2666337506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2810106800 0x7f2810198d20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2804031460 tx=0x7f28040045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:05.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.454+0000 7f27f7fff640 1 -- 172.21.15.17:0/2666337506 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f280403f070 con 0x7f2810106800 2024-09-20T18:58:05.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.455+0000 7f28157f5640 1 -- 172.21.15.17:0/2666337506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2810199600 con 0x7f2810106800 2024-09-20T18:58:05.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.455+0000 7f27f7fff640 1 -- 172.21.15.17:0/2666337506 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f28040035f0 con 0x7f2810106800 2024-09-20T18:58:05.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.455+0000 7f27f7fff640 1 -- 172.21.15.17:0/2666337506 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2804035030 con 0x7f2810106800 2024-09-20T18:58:05.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.455+0000 7f28157f5640 1 -- 172.21.15.17:0/2666337506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28101a1bb0 con 0x7f2810106800 2024-09-20T18:58:05.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.456+0000 7f28157f5640 1 -- 172.21.15.17:0/2666337506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2810101f40 con 0x7f2810106800 2024-09-20T18:58:05.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.457+0000 7f27f7fff640 1 -- 172.21.15.17:0/2666337506 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2804042070 con 0x7f2810106800 2024-09-20T18:58:05.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.457+0000 7f27f7fff640 1 --2- 172.21.15.17:0/2666337506 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f27f807af30 0x7f27f807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:05.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.457+0000 7f27f7fff640 1 -- 172.21.15.17:0/2666337506 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f28040be970 con 0x7f2810106800 2024-09-20T18:58:05.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.457+0000 7f280effd640 1 --2- 172.21.15.17:0/2666337506 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f27f807af30 0x7f27f807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:05.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.458+0000 7f280effd640 1 --2- 172.21.15.17:0/2666337506 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f27f807af30 0x7f27f807d3f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2800005fd0 tx=0x7f280000b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:05.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.462+0000 7f27f7fff640 1 -- 172.21.15.17:0/2666337506 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f28040c0e20 con 0x7f2810106800 2024-09-20T18:58:05.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.657+0000 7f28157f5640 1 -- 172.21.15.17:0/2666337506 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2810062630 con 0x7f27f807af30 2024-09-20T18:58:05.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.666+0000 7f27f7fff640 1 -- 172.21.15.17:0/2666337506 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f2810062630 con 0x7f27f807af30 2024-09-20T18:58:05.678 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:58:05.678 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (19m) 13m ago 30m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:58:05.678 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (22m) 13m ago 30m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:58:05.679 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (22m) 13m ago 29m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:58:05.679 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (17m) 13m ago 30m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:58:05.679 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (17m) 13m ago 29m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:58:05.679 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (19m) 13m ago 30m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:58:05.679 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (14m) 13m ago 25m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:58:05.679 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (13m) 13m ago 25m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:58:05.679 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (25m) 13m ago 25m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:58:05.679 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (13m) 13m ago 25m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:58:05.679 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (21m) 13m ago 31m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:58:05.679 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (20m) 13m ago 29m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:58:05.679 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (18m) 13m ago 31m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:58:05.679 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (17m) 13m ago 29m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:58:05.679 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (20m) 13m ago 30m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:58:05.679 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (20m) 13m ago 29m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:58:05.680 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (17m) 13m ago 28m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:58:05.680 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (16m) 13m ago 27m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:58:05.680 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (16m) 13m ago 27m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:58:05.680 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (15m) 13m ago 27m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:58:05.680 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (14m) 13m ago 26m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:58:05.680 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (14m) 13m ago 26m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:58:05.680 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (19m) 13m ago 30m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:58:05.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.668+0000 7f28157f5640 1 -- 172.21.15.17:0/2666337506 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f27f807af30 msgr2=0x7f27f807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:05.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.668+0000 7f28157f5640 1 --2- 172.21.15.17:0/2666337506 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f27f807af30 0x7f27f807d3f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2800005fd0 tx=0x7f280000b390 comp rx=0 tx=0).stop 2024-09-20T18:58:05.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.668+0000 7f28157f5640 1 -- 172.21.15.17:0/2666337506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2810106800 msgr2=0x7f2810198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:05.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.668+0000 7f28157f5640 1 --2- 172.21.15.17:0/2666337506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2810106800 0x7f2810198d20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2804031460 tx=0x7f28040045e0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.668+0000 7f28157f5640 1 -- 172.21.15.17:0/2666337506 shutdown_connections 2024-09-20T18:58:05.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.668+0000 7f28157f5640 1 --2- 172.21.15.17:0/2666337506 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f27f807af30 0x7f27f807d3f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.668+0000 7f28157f5640 1 --2- 172.21.15.17:0/2666337506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2810106800 0x7f2810198d20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.668+0000 7f28157f5640 1 --2- 172.21.15.17:0/2666337506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2810100800 0x7f28101987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.668+0000 7f28157f5640 1 -- 172.21.15.17:0/2666337506 >> 172.21.15.17:0/2666337506 conn(0x7f28100fc520 msgr2=0x7f28100fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:05.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.668+0000 7f28157f5640 1 -- 172.21.15.17:0/2666337506 shutdown_connections 2024-09-20T18:58:05.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.668+0000 7f28157f5640 1 -- 172.21.15.17:0/2666337506 wait complete. 2024-09-20T18:58:05.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.752+0000 7f8f89374640 1 -- 172.21.15.17:0/2937539758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f84101900 msgr2=0x7f8f84101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:05.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.752+0000 7f8f89374640 1 --2- 172.21.15.17:0/2937539758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f84101900 0x7f8f84101d60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009880 tx=0x7f8f7802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.752+0000 7f8f89374640 1 -- 172.21.15.17:0/2937539758 shutdown_connections 2024-09-20T18:58:05.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.752+0000 7f8f89374640 1 --2- 172.21.15.17:0/2937539758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f84101900 0x7f8f84101d60 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.752+0000 7f8f89374640 1 --2- 172.21.15.17:0/2937539758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f84107900 0x7f8f84107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.752+0000 7f8f89374640 1 -- 172.21.15.17:0/2937539758 >> 172.21.15.17:0/2937539758 conn(0x7f8f840fd600 msgr2=0x7f8f840ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:05.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.752+0000 7f8f89374640 1 -- 172.21.15.17:0/2937539758 shutdown_connections 2024-09-20T18:58:05.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.752+0000 7f8f89374640 1 -- 172.21.15.17:0/2937539758 wait complete. 2024-09-20T18:58:05.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.753+0000 7f8f89374640 1 Processor -- start 2024-09-20T18:58:05.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.753+0000 7f8f89374640 1 -- start start 2024-09-20T18:58:05.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.753+0000 7f8f89374640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f84101900 0x7f8f840744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:05.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.753+0000 7f8f89374640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f84107900 0x7f8f84074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:05.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.753+0000 7f8f89374640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8410edb0 con 0x7f8f84107900 2024-09-20T18:58:05.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.753+0000 7f8f89374640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8410ec30 con 0x7f8f84101900 2024-09-20T18:58:05.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.753+0000 7f8f827fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f84107900 0x7f8f84074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:05.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.753+0000 7f8f827fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f84107900 0x7f8f84074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33676/0 (socket says 172.21.15.17:33676) 2024-09-20T18:58:05.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.753+0000 7f8f827fc640 1 -- 172.21.15.17:0/2179851991 learned_addr learned my addr 172.21.15.17:0/2179851991 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:58:05.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.753+0000 7f8f82ffd640 1 --2- 172.21.15.17:0/2179851991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f84101900 0x7f8f840744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:05.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.754+0000 7f8f827fc640 1 -- 172.21.15.17:0/2179851991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f84101900 msgr2=0x7f8f840744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:05.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.754+0000 7f8f827fc640 1 --2- 172.21.15.17:0/2179851991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f84101900 0x7f8f840744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:05.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.754+0000 7f8f827fc640 1 -- 172.21.15.17:0/2179851991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f84074f70 con 0x7f8f84107900 2024-09-20T18:58:05.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.754+0000 7f8f827fc640 1 --2- 172.21.15.17:0/2179851991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f84107900 0x7f8f84074a30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8f78031460 tx=0x7f8f780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:05.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.754+0000 7f8f6bfff640 1 -- 172.21.15.17:0/2179851991 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f7803f070 con 0x7f8f84107900 2024-09-20T18:58:05.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.754+0000 7f8f89374640 1 -- 172.21.15.17:0/2179851991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f84075200 con 0x7f8f84107900 2024-09-20T18:58:05.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.754+0000 7f8f6bfff640 1 -- 172.21.15.17:0/2179851991 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f78004cf0 con 0x7f8f84107900 2024-09-20T18:58:05.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.754+0000 7f8f6bfff640 1 -- 172.21.15.17:0/2179851991 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f78035030 con 0x7f8f84107900 2024-09-20T18:58:05.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.754+0000 7f8f89374640 1 -- 172.21.15.17:0/2179851991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f841a3d70 con 0x7f8f84107900 2024-09-20T18:58:05.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.755+0000 7f8f89374640 1 -- 172.21.15.17:0/2179851991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f84103040 con 0x7f8f84107900 2024-09-20T18:58:05.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.756+0000 7f8f6bfff640 1 -- 172.21.15.17:0/2179851991 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8f78042070 con 0x7f8f84107900 2024-09-20T18:58:05.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.757+0000 7f8f6bfff640 1 --2- 172.21.15.17:0/2179851991 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f6c07af30 0x7f8f6c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:05.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.757+0000 7f8f6bfff640 1 -- 172.21.15.17:0/2179851991 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f8f780bf040 con 0x7f8f84107900 2024-09-20T18:58:05.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.757+0000 7f8f82ffd640 1 --2- 172.21.15.17:0/2179851991 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f6c07af30 0x7f8f6c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:05.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.757+0000 7f8f82ffd640 1 --2- 172.21.15.17:0/2179851991 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f6c07af30 0x7f8f6c07d3f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400abe0 tx=0x7f8f7400a2d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:05.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:05.761+0000 7f8f6bfff640 1 -- 172.21.15.17:0/2179851991 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8f7808a6c0 con 0x7f8f84107900 2024-09-20T18:58:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.025+0000 7f8f89374640 1 -- 172.21.15.17:0/2179851991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8f84109e90 con 0x7f8f84107900 2024-09-20T18:58:06.038 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:05 smithi017 ceph-mon[108970]: pgmap v680: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:06.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.026+0000 7f8f6bfff640 1 -- 172.21.15.17:0/2179851991 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f8f7808f570 con 0x7f8f84107900 2024-09-20T18:58:06.038 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:58:06.038 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:58:06.038 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:58:06.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:58:06.039 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:58:06.039 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:58:06.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:58:06.039 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:58:06.039 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:58:06.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:58:06.039 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:58:06.039 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:58:06.039 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:58:06.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:58:06.039 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:58:06.039 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:58:06.039 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:58:06.039 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:58:06.040 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:58:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.028+0000 7f8f89374640 1 -- 172.21.15.17:0/2179851991 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f6c07af30 msgr2=0x7f8f6c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.028+0000 7f8f89374640 1 --2- 172.21.15.17:0/2179851991 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f6c07af30 0x7f8f6c07d3f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400abe0 tx=0x7f8f7400a2d0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.028+0000 7f8f89374640 1 -- 172.21.15.17:0/2179851991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f84107900 msgr2=0x7f8f84074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.028+0000 7f8f89374640 1 --2- 172.21.15.17:0/2179851991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f84107900 0x7f8f84074a30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8f78031460 tx=0x7f8f780048f0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.028+0000 7f8f89374640 1 -- 172.21.15.17:0/2179851991 shutdown_connections 2024-09-20T18:58:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.028+0000 7f8f89374640 1 --2- 172.21.15.17:0/2179851991 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8f6c07af30 0x7f8f6c07d3f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.028+0000 7f8f89374640 1 --2- 172.21.15.17:0/2179851991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f84107900 0x7f8f84074a30 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.028+0000 7f8f89374640 1 --2- 172.21.15.17:0/2179851991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f84101900 0x7f8f840744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.028+0000 7f8f89374640 1 -- 172.21.15.17:0/2179851991 >> 172.21.15.17:0/2179851991 conn(0x7f8f840fd600 msgr2=0x7f8f840fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.029+0000 7f8f89374640 1 -- 172.21.15.17:0/2179851991 shutdown_connections 2024-09-20T18:58:06.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.029+0000 7f8f89374640 1 -- 172.21.15.17:0/2179851991 wait complete. 2024-09-20T18:58:06.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.112+0000 7f7a77b8d640 1 -- 172.21.15.17:0/2795971751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a701033e0 msgr2=0x7f7a7010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:06.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.112+0000 7f7a77b8d640 1 --2- 172.21.15.17:0/2795971751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a701033e0 0x7f7a7010b8d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7a60009880 tx=0x7f7a6002a530 comp rx=0 tx=0).stop 2024-09-20T18:58:06.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.112+0000 7f7a77b8d640 1 -- 172.21.15.17:0/2795971751 shutdown_connections 2024-09-20T18:58:06.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.112+0000 7f7a77b8d640 1 --2- 172.21.15.17:0/2795971751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a701033e0 0x7f7a7010b8d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.112+0000 7f7a77b8d640 1 --2- 172.21.15.17:0/2795971751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a70102ac0 0x7f7a70102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.112+0000 7f7a77b8d640 1 -- 172.21.15.17:0/2795971751 >> 172.21.15.17:0/2795971751 conn(0x7f7a700fc520 msgr2=0x7f7a700fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:06.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.112+0000 7f7a77b8d640 1 -- 172.21.15.17:0/2795971751 shutdown_connections 2024-09-20T18:58:06.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.112+0000 7f7a77b8d640 1 -- 172.21.15.17:0/2795971751 wait complete. 2024-09-20T18:58:06.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.113+0000 7f7a77b8d640 1 Processor -- start 2024-09-20T18:58:06.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.113+0000 7f7a77b8d640 1 -- start start 2024-09-20T18:58:06.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.113+0000 7f7a77b8d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a70102ac0 0x7f7a7019f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:06.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.113+0000 7f7a77b8d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a701033e0 0x7f7a7019fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:06.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.113+0000 7f7a77b8d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7010edf0 con 0x7f7a70102ac0 2024-09-20T18:58:06.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.113+0000 7f7a77b8d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7010ec70 con 0x7f7a701033e0 2024-09-20T18:58:06.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.113+0000 7f7a75929640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a70102ac0 0x7f7a7019f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:06.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.113+0000 7f7a75929640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a70102ac0 0x7f7a7019f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33700/0 (socket says 172.21.15.17:33700) 2024-09-20T18:58:06.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.113+0000 7f7a75929640 1 -- 172.21.15.17:0/395333937 learned_addr learned my addr 172.21.15.17:0/395333937 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:58:06.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.114+0000 7f7a75128640 1 --2- 172.21.15.17:0/395333937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a701033e0 0x7f7a7019fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:06.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.114+0000 7f7a75929640 1 -- 172.21.15.17:0/395333937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a701033e0 msgr2=0x7f7a7019fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:06.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.114+0000 7f7a75929640 1 --2- 172.21.15.17:0/395333937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a701033e0 0x7f7a7019fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.114+0000 7f7a75929640 1 -- 172.21.15.17:0/395333937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a70199ab0 con 0x7f7a70102ac0 2024-09-20T18:58:06.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.114+0000 7f7a75929640 1 --2- 172.21.15.17:0/395333937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a70102ac0 0x7f7a7019f8f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00d6f0 tx=0x7f7a6c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:06.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.114+0000 7f7a66ffd640 1 -- 172.21.15.17:0/395333937 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a6c017070 con 0x7f7a70102ac0 2024-09-20T18:58:06.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.114+0000 7f7a66ffd640 1 -- 172.21.15.17:0/395333937 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7a6c00de00 con 0x7f7a70102ac0 2024-09-20T18:58:06.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.114+0000 7f7a77b8d640 1 -- 172.21.15.17:0/395333937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a70199da0 con 0x7f7a70102ac0 2024-09-20T18:58:06.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.114+0000 7f7a66ffd640 1 -- 172.21.15.17:0/395333937 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a6c004bb0 con 0x7f7a70102ac0 2024-09-20T18:58:06.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.114+0000 7f7a77b8d640 1 -- 172.21.15.17:0/395333937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a7019a300 con 0x7f7a70102ac0 2024-09-20T18:58:06.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.115+0000 7f7a77b8d640 1 -- 172.21.15.17:0/395333937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a7006aa90 con 0x7f7a70102ac0 2024-09-20T18:58:06.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.116+0000 7f7a66ffd640 1 -- 172.21.15.17:0/395333937 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7a6c009a30 con 0x7f7a70102ac0 2024-09-20T18:58:06.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.117+0000 7f7a66ffd640 1 --2- 172.21.15.17:0/395333937 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7a5c07af80 0x7f7a5c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:06.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.117+0000 7f7a66ffd640 1 -- 172.21.15.17:0/395333937 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f7a6c09db70 con 0x7f7a70102ac0 2024-09-20T18:58:06.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.117+0000 7f7a75128640 1 --2- 172.21.15.17:0/395333937 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7a5c07af80 0x7f7a5c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:06.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.117+0000 7f7a75128640 1 --2- 172.21.15.17:0/395333937 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7a5c07af80 0x7f7a5c07d440 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7a7019b2a0 tx=0x7f7a60031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:06.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.121+0000 7f7a66ffd640 1 -- 172.21.15.17:0/395333937 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7a6c0691f0 con 0x7f7a70102ac0 2024-09-20T18:58:06.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:05 smithi172 ceph-mon[80431]: pgmap v680: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:06.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.350+0000 7f7a77b8d640 1 -- 172.21.15.17:0/395333937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7a7019afe0 con 0x7f7a70102ac0 2024-09-20T18:58:06.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.351+0000 7f7a66ffd640 1 -- 172.21.15.17:0/395333937 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f7a6c06e0a0 con 0x7f7a70102ac0 2024-09-20T18:58:06.363 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:58:06.363 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:58:06.363 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:58:06.364 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:58:06.364 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:58:06.364 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:58:06.364 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:58:06.364 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:58:06.364 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:58:06.364 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:58:06.364 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:58:06.364 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:58:06.364 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:58:06.364 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:58:06.364 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:58:06.364 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:58:06.364 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:58:06.365 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:58:06.365 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:58:06.365 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:58:06.365 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:58:06.365 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:58:06.365 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:58:06.365 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:58:06.365 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:58:06.365 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:58:06.366 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:58:06.366 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:58:06.366 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:58:06.366 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:58:06.366 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:58:06.366 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:58:06.366 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:58:06.366 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:58:06.366 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:58:06.367 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:58:06.367 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:58:06.367 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:58:06.367 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:58:06.367 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:58:06.367 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:58:06.367 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:58:06.367 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:58:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:58:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.354+0000 7f7a77b8d640 1 -- 172.21.15.17:0/395333937 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7a5c07af80 msgr2=0x7f7a5c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.354+0000 7f7a77b8d640 1 --2- 172.21.15.17:0/395333937 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7a5c07af80 0x7f7a5c07d440 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7a7019b2a0 tx=0x7f7a60031400 comp rx=0 tx=0).stop 2024-09-20T18:58:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.354+0000 7f7a77b8d640 1 -- 172.21.15.17:0/395333937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a70102ac0 msgr2=0x7f7a7019f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.354+0000 7f7a77b8d640 1 --2- 172.21.15.17:0/395333937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a70102ac0 0x7f7a7019f8f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00d6f0 tx=0x7f7a6c00dbb0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.354+0000 7f7a77b8d640 1 -- 172.21.15.17:0/395333937 shutdown_connections 2024-09-20T18:58:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.354+0000 7f7a77b8d640 1 --2- 172.21.15.17:0/395333937 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7a5c07af80 0x7f7a5c07d440 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.354+0000 7f7a77b8d640 1 --2- 172.21.15.17:0/395333937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a701033e0 0x7f7a7019fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.354+0000 7f7a77b8d640 1 --2- 172.21.15.17:0/395333937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a70102ac0 0x7f7a7019f8f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.354+0000 7f7a77b8d640 1 -- 172.21.15.17:0/395333937 >> 172.21.15.17:0/395333937 conn(0x7f7a700fc520 msgr2=0x7f7a70100a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:06.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.354+0000 7f7a77b8d640 1 -- 172.21.15.17:0/395333937 shutdown_connections 2024-09-20T18:58:06.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.354+0000 7f7a77b8d640 1 -- 172.21.15.17:0/395333937 wait complete. 2024-09-20T18:58:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.440+0000 7f845a498640 1 -- 172.21.15.17:0/3535300129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84541007f0 msgr2=0x7f8454100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.440+0000 7f845a498640 1 --2- 172.21.15.17:0/3535300129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84541007f0 0x7f8454100c50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8448009880 tx=0x7f844802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.440+0000 7f845a498640 1 -- 172.21.15.17:0/3535300129 shutdown_connections 2024-09-20T18:58:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.440+0000 7f845a498640 1 --2- 172.21.15.17:0/3535300129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84541007f0 0x7f8454100c50 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.440+0000 7f845a498640 1 --2- 172.21.15.17:0/3535300129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84541067f0 0x7f8454106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.440+0000 7f845a498640 1 -- 172.21.15.17:0/3535300129 >> 172.21.15.17:0/3535300129 conn(0x7f84540fc550 msgr2=0x7f84540fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.440+0000 7f845a498640 1 -- 172.21.15.17:0/3535300129 shutdown_connections 2024-09-20T18:58:06.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.440+0000 7f845a498640 1 -- 172.21.15.17:0/3535300129 wait complete. 2024-09-20T18:58:06.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.440+0000 7f845a498640 1 Processor -- start 2024-09-20T18:58:06.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.440+0000 7f845a498640 1 -- start start 2024-09-20T18:58:06.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.441+0000 7f845a498640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84541007f0 0x7f845419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:06.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.441+0000 7f845a498640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84541067f0 0x7f845419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:06.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.441+0000 7f845a498640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f845410dcc0 con 0x7f84541007f0 2024-09-20T18:58:06.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.441+0000 7f845a498640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f845410db40 con 0x7f84541067f0 2024-09-20T18:58:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.441+0000 7f8453fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84541007f0 0x7f845419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.441+0000 7f8453fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84541007f0 0x7f845419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33716/0 (socket says 172.21.15.17:33716) 2024-09-20T18:58:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.441+0000 7f8453fff640 1 -- 172.21.15.17:0/3688365428 learned_addr learned my addr 172.21.15.17:0/3688365428 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:58:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.441+0000 7f84537fe640 1 --2- 172.21.15.17:0/3688365428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84541067f0 0x7f845419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.441+0000 7f8453fff640 1 -- 172.21.15.17:0/3688365428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84541067f0 msgr2=0x7f845419dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.441+0000 7f8453fff640 1 --2- 172.21.15.17:0/3688365428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84541067f0 0x7f845419dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.441+0000 7f8453fff640 1 -- 172.21.15.17:0/3688365428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84541977e0 con 0x7f84541007f0 2024-09-20T18:58:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.441+0000 7f8453fff640 1 --2- 172.21.15.17:0/3688365428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84541007f0 0x7f845419d660 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f844400e970 tx=0x7f844400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.442+0000 7f84517fa640 1 -- 172.21.15.17:0/3688365428 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f844400cac0 con 0x7f84541007f0 2024-09-20T18:58:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.442+0000 7f845a498640 1 -- 172.21.15.17:0/3688365428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8454197ad0 con 0x7f84541007f0 2024-09-20T18:58:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.442+0000 7f84517fa640 1 -- 172.21.15.17:0/3688365428 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f84440054e0 con 0x7f84541007f0 2024-09-20T18:58:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.442+0000 7f84517fa640 1 -- 172.21.15.17:0/3688365428 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8444010430 con 0x7f84541007f0 2024-09-20T18:58:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.442+0000 7f845a498640 1 -- 172.21.15.17:0/3688365428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8454198030 con 0x7f84541007f0 2024-09-20T18:58:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.443+0000 7f845a498640 1 -- 172.21.15.17:0/3688365428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8454101f30 con 0x7f84541007f0 2024-09-20T18:58:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.444+0000 7f84517fa640 1 -- 172.21.15.17:0/3688365428 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8444004f00 con 0x7f84541007f0 2024-09-20T18:58:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.444+0000 7f84517fa640 1 --2- 172.21.15.17:0/3688365428 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f843c07af80 0x7f843c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.444+0000 7f84517fa640 1 -- 172.21.15.17:0/3688365428 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f844409e650 con 0x7f84541007f0 2024-09-20T18:58:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.444+0000 7f84537fe640 1 --2- 172.21.15.17:0/3688365428 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f843c07af80 0x7f843c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:06.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.445+0000 7f84537fe640 1 --2- 172.21.15.17:0/3688365428 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f843c07af80 0x7f843c07d440 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8454198b30 tx=0x7f8448031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:06.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.448+0000 7f84517fa640 1 -- 172.21.15.17:0/3688365428 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8444069cd0 con 0x7f84541007f0 2024-09-20T18:58:06.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.657+0000 7f845a498640 1 -- 172.21.15.17:0/3688365428 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8454198340 con 0x7f843c07af80 2024-09-20T18:58:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.658+0000 7f84517fa640 1 -- 172.21.15.17:0/3688365428 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f8454198340 con 0x7f843c07af80 2024-09-20T18:58:06.671 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:58:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:58:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:58:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:58:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:58:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:58:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:58:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:58:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:58:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:58:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:58:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:58:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:58:06.672 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:58:06.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.660+0000 7f845a498640 1 -- 172.21.15.17:0/3688365428 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f843c07af80 msgr2=0x7f843c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:06.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.660+0000 7f845a498640 1 --2- 172.21.15.17:0/3688365428 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f843c07af80 0x7f843c07d440 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8454198b30 tx=0x7f8448031400 comp rx=0 tx=0).stop 2024-09-20T18:58:06.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.660+0000 7f845a498640 1 -- 172.21.15.17:0/3688365428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84541007f0 msgr2=0x7f845419d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:06.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.660+0000 7f845a498640 1 --2- 172.21.15.17:0/3688365428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84541007f0 0x7f845419d660 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f844400e970 tx=0x7f844400ed70 comp rx=0 tx=0).stop 2024-09-20T18:58:06.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.661+0000 7f845a498640 1 -- 172.21.15.17:0/3688365428 shutdown_connections 2024-09-20T18:58:06.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.661+0000 7f845a498640 1 --2- 172.21.15.17:0/3688365428 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f843c07af80 0x7f843c07d440 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.661+0000 7f845a498640 1 --2- 172.21.15.17:0/3688365428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84541067f0 0x7f845419dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.661+0000 7f845a498640 1 --2- 172.21.15.17:0/3688365428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84541007f0 0x7f845419d660 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.661+0000 7f845a498640 1 -- 172.21.15.17:0/3688365428 >> 172.21.15.17:0/3688365428 conn(0x7f84540fc550 msgr2=0x7f8454069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:06.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.661+0000 7f845a498640 1 -- 172.21.15.17:0/3688365428 shutdown_connections 2024-09-20T18:58:06.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.661+0000 7f845a498640 1 -- 172.21.15.17:0/3688365428 wait complete. 2024-09-20T18:58:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.744+0000 7fda2c536640 1 -- 172.21.15.17:0/404011627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda241033e0 msgr2=0x7fda2410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.744+0000 7fda2c536640 1 --2- 172.21.15.17:0/404011627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda241033e0 0x7fda2410b8d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fda20009880 tx=0x7fda2002a530 comp rx=0 tx=0).stop 2024-09-20T18:58:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.744+0000 7fda2c536640 1 -- 172.21.15.17:0/404011627 shutdown_connections 2024-09-20T18:58:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.744+0000 7fda2c536640 1 --2- 172.21.15.17:0/404011627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda241033e0 0x7fda2410b8d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.744+0000 7fda2c536640 1 --2- 172.21.15.17:0/404011627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda24102ac0 0x7fda24102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.744+0000 7fda2c536640 1 -- 172.21.15.17:0/404011627 >> 172.21.15.17:0/404011627 conn(0x7fda240fc520 msgr2=0x7fda240fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.744+0000 7fda2c536640 1 -- 172.21.15.17:0/404011627 shutdown_connections 2024-09-20T18:58:06.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.744+0000 7fda2c536640 1 -- 172.21.15.17:0/404011627 wait complete. 2024-09-20T18:58:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.745+0000 7fda2c536640 1 Processor -- start 2024-09-20T18:58:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.745+0000 7fda2c536640 1 -- start start 2024-09-20T18:58:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.745+0000 7fda2c536640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda24102ac0 0x7fda2419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.745+0000 7fda2c536640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda241033e0 0x7fda2419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.745+0000 7fda2c536640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fda2410edf0 con 0x7fda241033e0 2024-09-20T18:58:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.745+0000 7fda2c536640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fda2410ec70 con 0x7fda24102ac0 2024-09-20T18:58:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.746+0000 7fda29ad1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda241033e0 0x7fda2419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.746+0000 7fda29ad1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda241033e0 0x7fda2419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33738/0 (socket says 172.21.15.17:33738) 2024-09-20T18:58:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.746+0000 7fda29ad1640 1 -- 172.21.15.17:0/2793097401 learned_addr learned my addr 172.21.15.17:0/2793097401 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:58:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.746+0000 7fda2a2d2640 1 --2- 172.21.15.17:0/2793097401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda24102ac0 0x7fda2419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.746+0000 7fda29ad1640 1 -- 172.21.15.17:0/2793097401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda24102ac0 msgr2=0x7fda2419d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.746+0000 7fda29ad1640 1 --2- 172.21.15.17:0/2793097401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda24102ac0 0x7fda2419d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.746+0000 7fda29ad1640 1 -- 172.21.15.17:0/2793097401 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda241977e0 con 0x7fda241033e0 2024-09-20T18:58:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.746+0000 7fda2a2d2640 1 --2- 172.21.15.17:0/2793097401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda24102ac0 0x7fda2419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:58:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.746+0000 7fda29ad1640 1 --2- 172.21.15.17:0/2793097401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda241033e0 0x7fda2419dba0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fda20031460 tx=0x7fda200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.746+0000 7fda1b7fe640 1 -- 172.21.15.17:0/2793097401 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda2003f070 con 0x7fda241033e0 2024-09-20T18:58:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.746+0000 7fda1b7fe640 1 -- 172.21.15.17:0/2793097401 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda20004ac0 con 0x7fda241033e0 2024-09-20T18:58:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.746+0000 7fda2c536640 1 -- 172.21.15.17:0/2793097401 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda24197a70 con 0x7fda241033e0 2024-09-20T18:58:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.746+0000 7fda1b7fe640 1 -- 172.21.15.17:0/2793097401 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda20035030 con 0x7fda241033e0 2024-09-20T18:58:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.746+0000 7fda2c536640 1 -- 172.21.15.17:0/2793097401 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda24197fa0 con 0x7fda241033e0 2024-09-20T18:58:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.747+0000 7fda2c536640 1 -- 172.21.15.17:0/2793097401 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda2406aa90 con 0x7fda241033e0 2024-09-20T18:58:06.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.748+0000 7fda1b7fe640 1 -- 172.21.15.17:0/2793097401 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fda20042070 con 0x7fda241033e0 2024-09-20T18:58:06.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.749+0000 7fda1b7fe640 1 --2- 172.21.15.17:0/2793097401 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda1007af90 0x7fda1007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:06.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.749+0000 7fda1b7fe640 1 -- 172.21.15.17:0/2793097401 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fda200be990 con 0x7fda241033e0 2024-09-20T18:58:06.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.749+0000 7fda2a2d2640 1 --2- 172.21.15.17:0/2793097401 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda1007af90 0x7fda1007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:06.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.749+0000 7fda2a2d2640 1 --2- 172.21.15.17:0/2793097401 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda1007af90 0x7fda1007d450 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fda140058c0 tx=0x7fda14005d30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:06.753+0000 7fda1b7fe640 1 -- 172.21.15.17:0/2793097401 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fda2008a010 con 0x7fda241033e0 2024-09-20T18:58:07.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:07.016+0000 7fda2c536640 1 -- 172.21.15.17:0/2793097401 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fda24105f60 con 0x7fda241033e0 2024-09-20T18:58:07.029 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:06 smithi017 ceph-mon[108970]: from='client.35070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:58:07.029 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:06 smithi017 ceph-mon[108970]: from='client.35074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:58:07.029 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:06 smithi017 ceph-mon[108970]: from='client.35078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:58:07.029 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:06 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2179851991' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:58:07.029 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:06 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/395333937' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:58:07.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:07.016+0000 7fda1b7fe640 1 -- 172.21.15.17:0/2793097401 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fda2008eec0 con 0x7fda241033e0 2024-09-20T18:58:07.029 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:58:07.030 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:58:07.030 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:58:07.030 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:58:07.030 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:58:07.030 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:58:07.030 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:58:07.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:07.019+0000 7fda2c536640 1 -- 172.21.15.17:0/2793097401 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda1007af90 msgr2=0x7fda1007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:07.019+0000 7fda2c536640 1 --2- 172.21.15.17:0/2793097401 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda1007af90 0x7fda1007d450 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fda140058c0 tx=0x7fda14005d30 comp rx=0 tx=0).stop 2024-09-20T18:58:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:07.019+0000 7fda2c536640 1 -- 172.21.15.17:0/2793097401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda241033e0 msgr2=0x7fda2419dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:07.019+0000 7fda2c536640 1 --2- 172.21.15.17:0/2793097401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda241033e0 0x7fda2419dba0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fda20031460 tx=0x7fda200046c0 comp rx=0 tx=0).stop 2024-09-20T18:58:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:07.019+0000 7fda2c536640 1 -- 172.21.15.17:0/2793097401 shutdown_connections 2024-09-20T18:58:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:07.019+0000 7fda2c536640 1 --2- 172.21.15.17:0/2793097401 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda1007af90 0x7fda1007d450 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:07.019+0000 7fda2c536640 1 --2- 172.21.15.17:0/2793097401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda241033e0 0x7fda2419dba0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:07.019+0000 7fda2c536640 1 --2- 172.21.15.17:0/2793097401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda24102ac0 0x7fda2419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:07.019+0000 7fda2c536640 1 -- 172.21.15.17:0/2793097401 >> 172.21.15.17:0/2793097401 conn(0x7fda240fc520 msgr2=0x7fda24108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:07.019+0000 7fda2c536640 1 -- 172.21.15.17:0/2793097401 shutdown_connections 2024-09-20T18:58:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:07.019+0000 7fda2c536640 1 -- 172.21.15.17:0/2793097401 wait complete. 2024-09-20T18:58:07.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:06 smithi172 ceph-mon[80431]: from='client.35070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:58:07.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:06 smithi172 ceph-mon[80431]: from='client.35074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:58:07.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:06 smithi172 ceph-mon[80431]: from='client.35078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:58:07.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:06 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2179851991' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:58:07.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:06 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/395333937' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:58:08.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:07 smithi172 ceph-mon[80431]: pgmap v681: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:08.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:07 smithi172 ceph-mon[80431]: from='client.35090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:58:08.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:07 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2793097401' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:58:08.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:58:08.397 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:07 smithi017 ceph-mon[108970]: pgmap v681: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:08.397 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:07 smithi017 ceph-mon[108970]: from='client.35090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:58:08.397 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:07 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2793097401' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:58:08.397 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:58:10.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:09 smithi172 ceph-mon[80431]: pgmap v682: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:10.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:09 smithi017 ceph-mon[108970]: pgmap v682: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:12.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:11 smithi172 ceph-mon[80431]: pgmap v683: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:12.397 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:11 smithi017 ceph-mon[108970]: pgmap v683: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:14.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:13 smithi172 ceph-mon[80431]: pgmap v684: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:14.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:13 smithi017 ceph-mon[108970]: pgmap v684: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:16.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:15 smithi172 ceph-mon[80431]: pgmap v685: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:16.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:15 smithi017 ceph-mon[108970]: pgmap v685: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:18.206 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:17 smithi172 ceph-mon[80431]: pgmap v686: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:18.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:17 smithi017 ceph-mon[108970]: pgmap v686: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:20.207 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:19 smithi172 ceph-mon[80431]: pgmap v687: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:20.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:19 smithi017 ceph-mon[108970]: pgmap v687: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:21.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:20 smithi017 ceph-mon[108970]: pgmap v688: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:21.456 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:20 smithi172 ceph-mon[80431]: pgmap v688: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:22.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:58:22.455 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:58:23.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:23 smithi017 ceph-mon[108970]: pgmap v689: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:23.455 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:23 smithi172 ceph-mon[80431]: pgmap v689: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:25.896 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:25 smithi017 ceph-mon[108970]: pgmap v690: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:25.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:25 smithi172 ceph-mon[80431]: pgmap v690: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:27.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:27 smithi172 ceph-mon[80431]: pgmap v691: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:28.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:27 smithi017 ceph-mon[108970]: pgmap v691: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:29.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:29 smithi172 ceph-mon[80431]: pgmap v692: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:30.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:29 smithi017 ceph-mon[108970]: pgmap v692: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:31.896 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:31 smithi017 ceph-mon[108970]: pgmap v693: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:31.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:31 smithi172 ceph-mon[80431]: pgmap v693: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:33.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:33 smithi172 ceph-mon[80431]: pgmap v694: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:34.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:33 smithi017 ceph-mon[108970]: pgmap v694: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:35.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:35 smithi172 ceph-mon[80431]: pgmap v695: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:36.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:35 smithi017 ceph-mon[108970]: pgmap v695: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:37.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.119+0000 7f9d0b04c640 1 -- 172.21.15.17:0/2169457930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d04101900 msgr2=0x7f9d04101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:37.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.119+0000 7f9d0b04c640 1 --2- 172.21.15.17:0/2169457930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d04101900 0x7f9d04101d60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009880 tx=0x7f9cf802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.119+0000 7f9d0b04c640 1 -- 172.21.15.17:0/2169457930 shutdown_connections 2024-09-20T18:58:37.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.119+0000 7f9d0b04c640 1 --2- 172.21.15.17:0/2169457930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d04101900 0x7f9d04101d60 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.119+0000 7f9d0b04c640 1 --2- 172.21.15.17:0/2169457930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d04107900 0x7f9d04107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.119+0000 7f9d0b04c640 1 -- 172.21.15.17:0/2169457930 >> 172.21.15.17:0/2169457930 conn(0x7f9d040fd600 msgr2=0x7f9d040ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:37.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.119+0000 7f9d0b04c640 1 -- 172.21.15.17:0/2169457930 shutdown_connections 2024-09-20T18:58:37.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.119+0000 7f9d0b04c640 1 -- 172.21.15.17:0/2169457930 wait complete. 2024-09-20T18:58:37.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.119+0000 7f9d0b04c640 1 Processor -- start 2024-09-20T18:58:37.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.119+0000 7f9d0b04c640 1 -- start start 2024-09-20T18:58:37.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.120+0000 7f9d0b04c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d04101900 0x7f9d0419f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:37.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.120+0000 7f9d0b04c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d04107900 0x7f9d0419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:37.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.120+0000 7f9d0b04c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0410edd0 con 0x7f9d04107900 2024-09-20T18:58:37.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.120+0000 7f9d0b04c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0410ec50 con 0x7f9d04101900 2024-09-20T18:58:37.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.120+0000 7f9d03fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d04107900 0x7f9d0419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:37.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.120+0000 7f9d03fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d04107900 0x7f9d0419fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34024/0 (socket says 172.21.15.17:34024) 2024-09-20T18:58:37.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.120+0000 7f9d03fff640 1 -- 172.21.15.17:0/818215317 learned_addr learned my addr 172.21.15.17:0/818215317 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:58:37.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.120+0000 7f9d08de8640 1 --2- 172.21.15.17:0/818215317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d04101900 0x7f9d0419f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:37.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.120+0000 7f9d03fff640 1 -- 172.21.15.17:0/818215317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d04101900 msgr2=0x7f9d0419f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:37.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.120+0000 7f9d03fff640 1 --2- 172.21.15.17:0/818215317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d04101900 0x7f9d0419f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.120+0000 7f9d03fff640 1 -- 172.21.15.17:0/818215317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d041999d0 con 0x7f9d04107900 2024-09-20T18:58:37.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.120+0000 7f9d08de8640 1 --2- 172.21.15.17:0/818215317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d04101900 0x7f9d0419f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:58:37.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.120+0000 7f9d03fff640 1 --2- 172.21.15.17:0/818215317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d04107900 0x7f9d0419fd50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8031460 tx=0x7f9cf80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:37.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.121+0000 7f9d01ffb640 1 -- 172.21.15.17:0/818215317 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9cf803f070 con 0x7f9d04107900 2024-09-20T18:58:37.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.121+0000 7f9d0b04c640 1 -- 172.21.15.17:0/818215317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d04199c60 con 0x7f9d04107900 2024-09-20T18:58:37.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.121+0000 7f9d01ffb640 1 -- 172.21.15.17:0/818215317 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9cf8004cf0 con 0x7f9d04107900 2024-09-20T18:58:37.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.121+0000 7f9d01ffb640 1 -- 172.21.15.17:0/818215317 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9cf8035030 con 0x7f9d04107900 2024-09-20T18:58:37.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.121+0000 7f9d0b04c640 1 -- 172.21.15.17:0/818215317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d0419a190 con 0x7f9d04107900 2024-09-20T18:58:37.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.122+0000 7f9d0b04c640 1 -- 172.21.15.17:0/818215317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d04103040 con 0x7f9d04107900 2024-09-20T18:58:37.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.123+0000 7f9d01ffb640 1 -- 172.21.15.17:0/818215317 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9cf8042070 con 0x7f9d04107900 2024-09-20T18:58:37.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.123+0000 7f9d01ffb640 1 --2- 172.21.15.17:0/818215317 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9cec07af30 0x7f9cec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:37.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.123+0000 7f9d01ffb640 1 -- 172.21.15.17:0/818215317 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f9cf80beb20 con 0x7f9d04107900 2024-09-20T18:58:37.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.123+0000 7f9d08de8640 1 --2- 172.21.15.17:0/818215317 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9cec07af30 0x7f9cec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:37.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.124+0000 7f9d08de8640 1 --2- 172.21.15.17:0/818215317 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9cec07af30 0x7f9cec07d3f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4005fd0 tx=0x7f9cf4005ea0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:37.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.128+0000 7f9d01ffb640 1 -- 172.21.15.17:0/818215317 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9cf808a120 con 0x7f9d04107900 2024-09-20T18:58:37.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.334+0000 7f9d0b04c640 1 -- 172.21.15.17:0/818215317 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9d0419afa0 con 0x7f9cec07af30 2024-09-20T18:58:37.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.336+0000 7f9d01ffb640 1 -- 172.21.15.17:0/818215317 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f9d0419afa0 con 0x7f9cec07af30 2024-09-20T18:58:37.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.338+0000 7f9d0b04c640 1 -- 172.21.15.17:0/818215317 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9cec07af30 msgr2=0x7f9cec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:37.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.338+0000 7f9d0b04c640 1 --2- 172.21.15.17:0/818215317 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9cec07af30 0x7f9cec07d3f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4005fd0 tx=0x7f9cf4005ea0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.338+0000 7f9d0b04c640 1 -- 172.21.15.17:0/818215317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d04107900 msgr2=0x7f9d0419fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:37.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.338+0000 7f9d0b04c640 1 --2- 172.21.15.17:0/818215317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d04107900 0x7f9d0419fd50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8031460 tx=0x7f9cf80048f0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.338+0000 7f9d0b04c640 1 -- 172.21.15.17:0/818215317 shutdown_connections 2024-09-20T18:58:37.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.338+0000 7f9d0b04c640 1 --2- 172.21.15.17:0/818215317 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f9cec07af30 0x7f9cec07d3f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.338+0000 7f9d0b04c640 1 --2- 172.21.15.17:0/818215317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d04107900 0x7f9d0419fd50 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.338+0000 7f9d0b04c640 1 --2- 172.21.15.17:0/818215317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d04101900 0x7f9d0419f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.338+0000 7f9d0b04c640 1 -- 172.21.15.17:0/818215317 >> 172.21.15.17:0/818215317 conn(0x7f9d040fd600 msgr2=0x7f9d04074440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:37.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.338+0000 7f9d0b04c640 1 -- 172.21.15.17:0/818215317 shutdown_connections 2024-09-20T18:58:37.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.338+0000 7f9d0b04c640 1 -- 172.21.15.17:0/818215317 wait complete. 2024-09-20T18:58:37.358 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:58:37.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.424+0000 7f2a16152640 1 -- 172.21.15.17:0/3008442836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a10106800 msgr2=0x7f2a10106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:37.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.424+0000 7f2a16152640 1 --2- 172.21.15.17:0/3008442836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a10106800 0x7f2a10106be0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009880 tx=0x7f2a0002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.424+0000 7f2a16152640 1 -- 172.21.15.17:0/3008442836 shutdown_connections 2024-09-20T18:58:37.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.424+0000 7f2a16152640 1 --2- 172.21.15.17:0/3008442836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a10100800 0x7f2a10100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.424+0000 7f2a16152640 1 --2- 172.21.15.17:0/3008442836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a10106800 0x7f2a10106be0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.424+0000 7f2a16152640 1 -- 172.21.15.17:0/3008442836 >> 172.21.15.17:0/3008442836 conn(0x7f2a100fc520 msgr2=0x7f2a100fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:37.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.424+0000 7f2a16152640 1 -- 172.21.15.17:0/3008442836 shutdown_connections 2024-09-20T18:58:37.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.424+0000 7f2a16152640 1 -- 172.21.15.17:0/3008442836 wait complete. 2024-09-20T18:58:37.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.425+0000 7f2a16152640 1 Processor -- start 2024-09-20T18:58:37.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.425+0000 7f2a16152640 1 -- start start 2024-09-20T18:58:37.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.425+0000 7f2a16152640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a10100800 0x7f2a1019d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:37.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.425+0000 7f2a16152640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a10106800 0x7f2a1019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:37.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.425+0000 7f2a16152640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1010dcd0 con 0x7f2a10100800 2024-09-20T18:58:37.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.425+0000 7f2a16152640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1010db50 con 0x7f2a10106800 2024-09-20T18:58:37.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.425+0000 7f2a0f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a10100800 0x7f2a1019d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:37.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.426+0000 7f2a0f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a10100800 0x7f2a1019d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34048/0 (socket says 172.21.15.17:34048) 2024-09-20T18:58:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.426+0000 7f2a0f7fe640 1 -- 172.21.15.17:0/2976441924 learned_addr learned my addr 172.21.15.17:0/2976441924 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:58:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.426+0000 7f2a0effd640 1 --2- 172.21.15.17:0/2976441924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a10106800 0x7f2a1019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.426+0000 7f2a0f7fe640 1 -- 172.21.15.17:0/2976441924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a10106800 msgr2=0x7f2a1019db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.426+0000 7f2a0f7fe640 1 --2- 172.21.15.17:0/2976441924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a10106800 0x7f2a1019db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.426+0000 7f2a0f7fe640 1 -- 172.21.15.17:0/2976441924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a10197780 con 0x7f2a10100800 2024-09-20T18:58:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.426+0000 7f2a0f7fe640 1 --2- 172.21.15.17:0/2976441924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a10100800 0x7f2a1019d600 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2a00031460 tx=0x7f2a000045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.426+0000 7f2a0cff9640 1 -- 172.21.15.17:0/2976441924 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a0003f070 con 0x7f2a10100800 2024-09-20T18:58:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.426+0000 7f2a16152640 1 -- 172.21.15.17:0/2976441924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a10197a10 con 0x7f2a10100800 2024-09-20T18:58:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.426+0000 7f2a0cff9640 1 -- 172.21.15.17:0/2976441924 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a000035f0 con 0x7f2a10100800 2024-09-20T18:58:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.426+0000 7f2a0cff9640 1 -- 172.21.15.17:0/2976441924 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a00035030 con 0x7f2a10100800 2024-09-20T18:58:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.426+0000 7f2a16152640 1 -- 172.21.15.17:0/2976441924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a10197f40 con 0x7f2a10100800 2024-09-20T18:58:37.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.427+0000 7f2a16152640 1 -- 172.21.15.17:0/2976441924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a10101f40 con 0x7f2a10100800 2024-09-20T18:58:37.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.428+0000 7f2a0cff9640 1 -- 172.21.15.17:0/2976441924 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2a00042070 con 0x7f2a10100800 2024-09-20T18:58:37.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.429+0000 7f2a0cff9640 1 --2- 172.21.15.17:0/2976441924 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f29f807af30 0x7f29f807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:37.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.429+0000 7f2a0effd640 1 --2- 172.21.15.17:0/2976441924 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f29f807af30 0x7f29f807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:37.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.429+0000 7f2a0cff9640 1 -- 172.21.15.17:0/2976441924 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f2a000be970 con 0x7f2a10100800 2024-09-20T18:58:37.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.429+0000 7f2a0effd640 1 --2- 172.21.15.17:0/2976441924 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f29f807af30 0x7f29f807d3f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2a1006b290 tx=0x7f2a0400b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:37.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.433+0000 7f2a0cff9640 1 -- 172.21.15.17:0/2976441924 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a000c0e20 con 0x7f2a10100800 2024-09-20T18:58:37.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.642+0000 7f2a16152640 1 -- 172.21.15.17:0/2976441924 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2a101982b0 con 0x7f29f807af30 2024-09-20T18:58:37.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.643+0000 7f2a0cff9640 1 -- 172.21.15.17:0/2976441924 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f2a101982b0 con 0x7f29f807af30 2024-09-20T18:58:37.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.645+0000 7f2a16152640 1 -- 172.21.15.17:0/2976441924 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f29f807af30 msgr2=0x7f29f807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:37.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.645+0000 7f2a16152640 1 --2- 172.21.15.17:0/2976441924 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f29f807af30 0x7f29f807d3f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2a1006b290 tx=0x7f2a0400b390 comp rx=0 tx=0).stop 2024-09-20T18:58:37.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.645+0000 7f2a16152640 1 -- 172.21.15.17:0/2976441924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a10100800 msgr2=0x7f2a1019d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:37.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.645+0000 7f2a16152640 1 --2- 172.21.15.17:0/2976441924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a10100800 0x7f2a1019d600 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2a00031460 tx=0x7f2a000045e0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.645+0000 7f2a16152640 1 -- 172.21.15.17:0/2976441924 shutdown_connections 2024-09-20T18:58:37.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.645+0000 7f2a16152640 1 --2- 172.21.15.17:0/2976441924 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f29f807af30 0x7f29f807d3f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.645+0000 7f2a16152640 1 --2- 172.21.15.17:0/2976441924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a10106800 0x7f2a1019db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.645+0000 7f2a16152640 1 --2- 172.21.15.17:0/2976441924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a10100800 0x7f2a1019d600 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.645+0000 7f2a16152640 1 -- 172.21.15.17:0/2976441924 >> 172.21.15.17:0/2976441924 conn(0x7f2a100fc520 msgr2=0x7f2a101045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:37.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.646+0000 7f2a16152640 1 -- 172.21.15.17:0/2976441924 shutdown_connections 2024-09-20T18:58:37.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.646+0000 7f2a16152640 1 -- 172.21.15.17:0/2976441924 wait complete. 2024-09-20T18:58:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.730+0000 7fe68b827640 1 -- 172.21.15.17:0/1245838135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6841067f0 msgr2=0x7fe684106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.730+0000 7fe68b827640 1 --2- 172.21.15.17:0/1245838135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6841067f0 0x7fe684106bd0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe680009880 tx=0x7fe68002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.730+0000 7fe68b827640 1 -- 172.21.15.17:0/1245838135 shutdown_connections 2024-09-20T18:58:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.730+0000 7fe68b827640 1 --2- 172.21.15.17:0/1245838135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6841007f0 0x7fe684100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.730+0000 7fe68b827640 1 --2- 172.21.15.17:0/1245838135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6841067f0 0x7fe684106bd0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.730+0000 7fe68b827640 1 -- 172.21.15.17:0/1245838135 >> 172.21.15.17:0/1245838135 conn(0x7fe6840fc4d0 msgr2=0x7fe6840fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:37.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.731+0000 7fe68b827640 1 -- 172.21.15.17:0/1245838135 shutdown_connections 2024-09-20T18:58:37.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.731+0000 7fe68b827640 1 -- 172.21.15.17:0/1245838135 wait complete. 2024-09-20T18:58:37.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.731+0000 7fe68b827640 1 Processor -- start 2024-09-20T18:58:37.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.731+0000 7fe68b827640 1 -- start start 2024-09-20T18:58:37.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.731+0000 7fe68b827640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6841007f0 0x7fe684107720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:37.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.732+0000 7fe68b827640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6841067f0 0x7fe684107c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:37.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.732+0000 7fe68b827640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe68410dca0 con 0x7fe6841007f0 2024-09-20T18:58:37.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.732+0000 7fe68b827640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe68410db20 con 0x7fe6841067f0 2024-09-20T18:58:37.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.732+0000 7fe6895c3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6841007f0 0x7fe684107720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:37.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.732+0000 7fe6895c3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6841007f0 0x7fe684107720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34064/0 (socket says 172.21.15.17:34064) 2024-09-20T18:58:37.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.732+0000 7fe6895c3640 1 -- 172.21.15.17:0/3434011915 learned_addr learned my addr 172.21.15.17:0/3434011915 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:58:37.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.732+0000 7fe688dc2640 1 --2- 172.21.15.17:0/3434011915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6841067f0 0x7fe684107c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.732+0000 7fe6895c3640 1 -- 172.21.15.17:0/3434011915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6841067f0 msgr2=0x7fe684107c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.732+0000 7fe6895c3640 1 --2- 172.21.15.17:0/3434011915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6841067f0 0x7fe684107c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.732+0000 7fe6895c3640 1 -- 172.21.15.17:0/3434011915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6841081a0 con 0x7fe6841007f0 2024-09-20T18:58:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.732+0000 7fe6895c3640 1 --2- 172.21.15.17:0/3434011915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6841007f0 0x7fe684107720 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe680031460 tx=0x7fe6800045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.732+0000 7fe6767fc640 1 -- 172.21.15.17:0/3434011915 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe68003f070 con 0x7fe6841007f0 2024-09-20T18:58:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.732+0000 7fe6767fc640 1 -- 172.21.15.17:0/3434011915 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe6800035f0 con 0x7fe6841007f0 2024-09-20T18:58:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.732+0000 7fe68b827640 1 -- 172.21.15.17:0/3434011915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe684108430 con 0x7fe6841007f0 2024-09-20T18:58:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.732+0000 7fe6767fc640 1 -- 172.21.15.17:0/3434011915 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe680035030 con 0x7fe6841007f0 2024-09-20T18:58:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.733+0000 7fe68b827640 1 -- 172.21.15.17:0/3434011915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6841a3d40 con 0x7fe6841007f0 2024-09-20T18:58:37.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.733+0000 7fe68b827640 1 -- 172.21.15.17:0/3434011915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe684101f30 con 0x7fe6841007f0 2024-09-20T18:58:37.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.734+0000 7fe6767fc640 1 -- 172.21.15.17:0/3434011915 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe680042070 con 0x7fe6841007f0 2024-09-20T18:58:37.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.735+0000 7fe6767fc640 1 --2- 172.21.15.17:0/3434011915 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe67007af30 0x7fe67007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:37.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.735+0000 7fe6767fc640 1 -- 172.21.15.17:0/3434011915 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fe6800be970 con 0x7fe6841007f0 2024-09-20T18:58:37.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.735+0000 7fe688dc2640 1 --2- 172.21.15.17:0/3434011915 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe67007af30 0x7fe67007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:37.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.735+0000 7fe688dc2640 1 --2- 172.21.15.17:0/3434011915 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe67007af30 0x7fe67007d3f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe6841091b0 tx=0x7fe67800b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:37.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.739+0000 7fe6767fc640 1 -- 172.21.15.17:0/3434011915 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe6800c0e20 con 0x7fe6841007f0 2024-09-20T18:58:37.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.935+0000 7fe68b827640 1 -- 172.21.15.17:0/3434011915 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe68406acd0 con 0x7fe67007af30 2024-09-20T18:58:37.945 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:37 smithi017 ceph-mon[108970]: pgmap v696: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:37.946 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:58:37.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:37 smithi172 ceph-mon[80431]: pgmap v696: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:37.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:58:37.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.945+0000 7fe6767fc640 1 -- 172.21.15.17:0/3434011915 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fe68406acd0 con 0x7fe67007af30 2024-09-20T18:58:37.956 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:58:37.956 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (19m) 14m ago 30m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:58:37.956 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (23m) 14m ago 31m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:58:37.956 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (22m) 13m ago 30m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:58:37.956 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (18m) 14m ago 31m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:58:37.956 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (18m) 13m ago 30m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:58:37.956 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (19m) 14m ago 30m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:58:37.957 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (14m) 14m ago 25m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:58:37.957 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (14m) 14m ago 25m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:58:37.957 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (25m) 13m ago 25m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:58:37.957 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (14m) 13m ago 25m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:58:37.957 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (22m) 14m ago 32m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:58:37.957 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (21m) 13m ago 30m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:58:37.957 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (18m) 14m ago 32m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:58:37.957 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (18m) 13m ago 30m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:58:37.957 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (20m) 14m ago 31m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:58:37.957 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (20m) 13m ago 30m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:58:37.957 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (17m) 14m ago 28m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:58:37.957 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (17m) 14m ago 28m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:58:37.957 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (16m) 14m ago 28m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:58:37.957 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (15m) 13m ago 27m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:58:37.957 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (15m) 13m ago 27m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:58:37.958 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (14m) 13m ago 26m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:58:37.958 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (20m) 14m ago 30m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:58:37.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.947+0000 7fe68b827640 1 -- 172.21.15.17:0/3434011915 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe67007af30 msgr2=0x7fe67007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:37.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.947+0000 7fe68b827640 1 --2- 172.21.15.17:0/3434011915 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe67007af30 0x7fe67007d3f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe6841091b0 tx=0x7fe67800b390 comp rx=0 tx=0).stop 2024-09-20T18:58:37.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.947+0000 7fe68b827640 1 -- 172.21.15.17:0/3434011915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6841007f0 msgr2=0x7fe684107720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:37.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.947+0000 7fe68b827640 1 --2- 172.21.15.17:0/3434011915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6841007f0 0x7fe684107720 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe680031460 tx=0x7fe6800045e0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.947+0000 7fe68b827640 1 -- 172.21.15.17:0/3434011915 shutdown_connections 2024-09-20T18:58:37.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.947+0000 7fe68b827640 1 --2- 172.21.15.17:0/3434011915 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe67007af30 0x7fe67007d3f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.947+0000 7fe68b827640 1 --2- 172.21.15.17:0/3434011915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6841067f0 0x7fe684107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.947+0000 7fe68b827640 1 --2- 172.21.15.17:0/3434011915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6841007f0 0x7fe684107720 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:37.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.947+0000 7fe68b827640 1 -- 172.21.15.17:0/3434011915 >> 172.21.15.17:0/3434011915 conn(0x7fe6840fc4d0 msgr2=0x7fe68406a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:37.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.947+0000 7fe68b827640 1 -- 172.21.15.17:0/3434011915 shutdown_connections 2024-09-20T18:58:37.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:37.947+0000 7fe68b827640 1 -- 172.21.15.17:0/3434011915 wait complete. 2024-09-20T18:58:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.030+0000 7f2c7d28d640 1 -- 172.21.15.17:0/4286456016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c781033e0 msgr2=0x7f2c7810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.030+0000 7f2c7d28d640 1 --2- 172.21.15.17:0/4286456016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c781033e0 0x7f2c7810b8d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009880 tx=0x7f2c6002a530 comp rx=0 tx=0).stop 2024-09-20T18:58:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.030+0000 7f2c7d28d640 1 -- 172.21.15.17:0/4286456016 shutdown_connections 2024-09-20T18:58:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.030+0000 7f2c7d28d640 1 --2- 172.21.15.17:0/4286456016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c781033e0 0x7f2c7810b8d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.030+0000 7f2c7d28d640 1 --2- 172.21.15.17:0/4286456016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c78102ac0 0x7f2c78102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.030+0000 7f2c7d28d640 1 -- 172.21.15.17:0/4286456016 >> 172.21.15.17:0/4286456016 conn(0x7f2c780fc520 msgr2=0x7f2c780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.030+0000 7f2c7d28d640 1 -- 172.21.15.17:0/4286456016 shutdown_connections 2024-09-20T18:58:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.030+0000 7f2c7d28d640 1 -- 172.21.15.17:0/4286456016 wait complete. 2024-09-20T18:58:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.031+0000 7f2c7d28d640 1 Processor -- start 2024-09-20T18:58:38.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.031+0000 7f2c7d28d640 1 -- start start 2024-09-20T18:58:38.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.031+0000 7f2c7d28d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c78102ac0 0x7f2c78100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:38.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.031+0000 7f2c7d28d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c781033e0 0x7f2c78100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:38.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.031+0000 7f2c7d28d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7810edf0 con 0x7f2c78102ac0 2024-09-20T18:58:38.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.031+0000 7f2c7d28d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7810ec70 con 0x7f2c781033e0 2024-09-20T18:58:38.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.031+0000 7f2c76ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c78102ac0 0x7f2c78100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:38.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.031+0000 7f2c76ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c78102ac0 0x7f2c78100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34086/0 (socket says 172.21.15.17:34086) 2024-09-20T18:58:38.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.031+0000 7f2c76ffd640 1 -- 172.21.15.17:0/1573804786 learned_addr learned my addr 172.21.15.17:0/1573804786 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:58:38.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.032+0000 7f2c6ffff640 1 --2- 172.21.15.17:0/1573804786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c781033e0 0x7f2c78100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:38.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.032+0000 7f2c76ffd640 1 -- 172.21.15.17:0/1573804786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c781033e0 msgr2=0x7f2c78100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:38.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.032+0000 7f2c76ffd640 1 --2- 172.21.15.17:0/1573804786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c781033e0 0x7f2c78100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.032+0000 7f2c76ffd640 1 -- 172.21.15.17:0/1573804786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c781011a0 con 0x7f2c78102ac0 2024-09-20T18:58:38.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.032+0000 7f2c76ffd640 1 --2- 172.21.15.17:0/1573804786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c78102ac0 0x7f2c78100720 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800d6f0 tx=0x7f2c6800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:38.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.032+0000 7f2c74ff9640 1 -- 172.21.15.17:0/1573804786 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c68017070 con 0x7f2c78102ac0 2024-09-20T18:58:38.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.032+0000 7f2c74ff9640 1 -- 172.21.15.17:0/1573804786 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2c6800de00 con 0x7f2c78102ac0 2024-09-20T18:58:38.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.032+0000 7f2c7d28d640 1 -- 172.21.15.17:0/1573804786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c78101490 con 0x7f2c78102ac0 2024-09-20T18:58:38.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.032+0000 7f2c74ff9640 1 -- 172.21.15.17:0/1573804786 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c68004bb0 con 0x7f2c78102ac0 2024-09-20T18:58:38.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.032+0000 7f2c7d28d640 1 -- 172.21.15.17:0/1573804786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c781a3e80 con 0x7f2c78102ac0 2024-09-20T18:58:38.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.033+0000 7f2c7d28d640 1 -- 172.21.15.17:0/1573804786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c7806aa90 con 0x7f2c78102ac0 2024-09-20T18:58:38.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.034+0000 7f2c74ff9640 1 -- 172.21.15.17:0/1573804786 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2c68009a30 con 0x7f2c78102ac0 2024-09-20T18:58:38.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.035+0000 7f2c74ff9640 1 --2- 172.21.15.17:0/1573804786 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2c6407af90 0x7f2c6407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:38.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.035+0000 7f2c6ffff640 1 --2- 172.21.15.17:0/1573804786 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2c6407af90 0x7f2c6407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:38.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.035+0000 7f2c74ff9640 1 -- 172.21.15.17:0/1573804786 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f2c6809dc10 con 0x7f2c78102ac0 2024-09-20T18:58:38.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.035+0000 7f2c6ffff640 1 --2- 172.21.15.17:0/1573804786 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2c6407af90 0x7f2c6407d450 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2c600096c0 tx=0x7f2c60000bc0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:38.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.039+0000 7f2c74ff9640 1 -- 172.21.15.17:0/1573804786 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2c680691f0 con 0x7f2c78102ac0 2024-09-20T18:58:38.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.301+0000 7f2c7d28d640 1 -- 172.21.15.17:0/1573804786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f2c78101c80 con 0x7f2c78102ac0 2024-09-20T18:58:38.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.301+0000 7f2c74ff9640 1 -- 172.21.15.17:0/1573804786 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f2c78101c80 con 0x7f2c78102ac0 2024-09-20T18:58:38.312 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:58:38.312 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:58:38.312 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:58:38.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:58:38.312 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:58:38.312 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:58:38.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:58:38.312 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:58:38.313 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:58:38.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:58:38.313 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:58:38.313 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:58:38.313 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:58:38.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:58:38.313 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:58:38.313 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:58:38.313 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:58:38.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:58:38.313 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:58:38.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.304+0000 7f2c7d28d640 1 -- 172.21.15.17:0/1573804786 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2c6407af90 msgr2=0x7f2c6407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:38.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.304+0000 7f2c7d28d640 1 --2- 172.21.15.17:0/1573804786 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2c6407af90 0x7f2c6407d450 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2c600096c0 tx=0x7f2c60000bc0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.304+0000 7f2c7d28d640 1 -- 172.21.15.17:0/1573804786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c78102ac0 msgr2=0x7f2c78100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:38.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.304+0000 7f2c7d28d640 1 --2- 172.21.15.17:0/1573804786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c78102ac0 0x7f2c78100720 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800d6f0 tx=0x7f2c6800dbb0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.304+0000 7f2c7d28d640 1 -- 172.21.15.17:0/1573804786 shutdown_connections 2024-09-20T18:58:38.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.304+0000 7f2c7d28d640 1 --2- 172.21.15.17:0/1573804786 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2c6407af90 0x7f2c6407d450 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.304+0000 7f2c7d28d640 1 --2- 172.21.15.17:0/1573804786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c781033e0 0x7f2c78100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.304+0000 7f2c7d28d640 1 --2- 172.21.15.17:0/1573804786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c78102ac0 0x7f2c78100720 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.304+0000 7f2c7d28d640 1 -- 172.21.15.17:0/1573804786 >> 172.21.15.17:0/1573804786 conn(0x7f2c780fc520 msgr2=0x7f2c78108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:38.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.304+0000 7f2c7d28d640 1 -- 172.21.15.17:0/1573804786 shutdown_connections 2024-09-20T18:58:38.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.304+0000 7f2c7d28d640 1 -- 172.21.15.17:0/1573804786 wait complete. 2024-09-20T18:58:38.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.388+0000 7fbfffc85640 1 -- 172.21.15.17:0/2704980685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff81033e0 msgr2=0x7fbff810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:38.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.388+0000 7fbfffc85640 1 --2- 172.21.15.17:0/2704980685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff81033e0 0x7fbff810b8d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009880 tx=0x7fbfe802a530 comp rx=0 tx=0).stop 2024-09-20T18:58:38.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.388+0000 7fbfffc85640 1 -- 172.21.15.17:0/2704980685 shutdown_connections 2024-09-20T18:58:38.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.388+0000 7fbfffc85640 1 --2- 172.21.15.17:0/2704980685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff81033e0 0x7fbff810b8d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.388+0000 7fbfffc85640 1 --2- 172.21.15.17:0/2704980685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbff8102ac0 0x7fbff8102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.388+0000 7fbfffc85640 1 -- 172.21.15.17:0/2704980685 >> 172.21.15.17:0/2704980685 conn(0x7fbff80fc520 msgr2=0x7fbff80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:38.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.388+0000 7fbfffc85640 1 -- 172.21.15.17:0/2704980685 shutdown_connections 2024-09-20T18:58:38.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.388+0000 7fbfffc85640 1 -- 172.21.15.17:0/2704980685 wait complete. 2024-09-20T18:58:38.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.389+0000 7fbfffc85640 1 Processor -- start 2024-09-20T18:58:38.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.389+0000 7fbfffc85640 1 -- start start 2024-09-20T18:58:38.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.389+0000 7fbfffc85640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbff8102ac0 0x7fbff8100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:38.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.389+0000 7fbfffc85640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff81033e0 0x7fbff8100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:38.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.389+0000 7fbfffc85640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbff810ee50 con 0x7fbff81033e0 2024-09-20T18:58:38.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.389+0000 7fbfffc85640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbff810ecd0 con 0x7fbff8102ac0 2024-09-20T18:58:38.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.389+0000 7fbffd220640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff81033e0 0x7fbff8100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:38.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.389+0000 7fbffd220640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff81033e0 0x7fbff8100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34118/0 (socket says 172.21.15.17:34118) 2024-09-20T18:58:38.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.389+0000 7fbffd220640 1 -- 172.21.15.17:0/3670281782 learned_addr learned my addr 172.21.15.17:0/3670281782 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:58:38.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.390+0000 7fbffda21640 1 --2- 172.21.15.17:0/3670281782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbff8102ac0 0x7fbff8100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:38.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.390+0000 7fbffd220640 1 -- 172.21.15.17:0/3670281782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbff8102ac0 msgr2=0x7fbff8100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:38.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.390+0000 7fbffd220640 1 --2- 172.21.15.17:0/3670281782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbff8102ac0 0x7fbff8100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.390+0000 7fbffd220640 1 -- 172.21.15.17:0/3670281782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff81011a0 con 0x7fbff81033e0 2024-09-20T18:58:38.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.390+0000 7fbffda21640 1 --2- 172.21.15.17:0/3670281782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbff8102ac0 0x7fbff8100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:58:38.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.390+0000 7fbffd220640 1 --2- 172.21.15.17:0/3670281782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff81033e0 0x7fbff8100c60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8031460 tx=0x7fbfe80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:38.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.390+0000 7fbfeeffd640 1 -- 172.21.15.17:0/3670281782 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbfe803f070 con 0x7fbff81033e0 2024-09-20T18:58:38.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.390+0000 7fbfffc85640 1 -- 172.21.15.17:0/3670281782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff8101430 con 0x7fbff81033e0 2024-09-20T18:58:38.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.390+0000 7fbfeeffd640 1 -- 172.21.15.17:0/3670281782 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbfe8004ac0 con 0x7fbff81033e0 2024-09-20T18:58:38.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.390+0000 7fbfeeffd640 1 -- 172.21.15.17:0/3670281782 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbfe8035030 con 0x7fbff81033e0 2024-09-20T18:58:38.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.390+0000 7fbfffc85640 1 -- 172.21.15.17:0/3670281782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff81a3e20 con 0x7fbff81033e0 2024-09-20T18:58:38.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.391+0000 7fbfffc85640 1 -- 172.21.15.17:0/3670281782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff806aa90 con 0x7fbff81033e0 2024-09-20T18:58:38.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.392+0000 7fbfeeffd640 1 -- 172.21.15.17:0/3670281782 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fbfe8042070 con 0x7fbff81033e0 2024-09-20T18:58:38.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.392+0000 7fbfeeffd640 1 --2- 172.21.15.17:0/3670281782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbfe407af40 0x7fbfe407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:38.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.392+0000 7fbfeeffd640 1 -- 172.21.15.17:0/3670281782 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fbfe80beae0 con 0x7fbff81033e0 2024-09-20T18:58:38.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.392+0000 7fbffda21640 1 --2- 172.21.15.17:0/3670281782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbfe407af40 0x7fbfe407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:38.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.393+0000 7fbffda21640 1 --2- 172.21.15.17:0/3670281782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbfe407af40 0x7fbfe407d400 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbff4006fd0 tx=0x7fbff4008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.397+0000 7fbfeeffd640 1 -- 172.21.15.17:0/3670281782 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbfe808a0e0 con 0x7fbff81033e0 2024-09-20T18:58:38.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.620+0000 7fbfffc85640 1 -- 172.21.15.17:0/3670281782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbff8105f60 con 0x7fbff81033e0 2024-09-20T18:58:38.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.620+0000 7fbfeeffd640 1 -- 172.21.15.17:0/3670281782 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7fbfe808ef90 con 0x7fbff81033e0 2024-09-20T18:58:38.631 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:58:38.631 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:58:38.631 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:58:38.632 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:58:38.632 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:58:38.632 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:58:38.632 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:58:38.632 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:58:38.632 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:58:38.632 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:58:38.632 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:58:38.632 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:58:38.632 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:58:38.632 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:58:38.632 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:58:38.632 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:58:38.632 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:58:38.633 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:58:38.633 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:58:38.633 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:58:38.633 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:58:38.633 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:58:38.633 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:58:38.633 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:58:38.633 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:58:38.633 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:58:38.633 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:58:38.633 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:58:38.633 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:58:38.633 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:58:38.633 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:58:38.634 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:58:38.634 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:58:38.634 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:58:38.634 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:58:38.634 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:58:38.634 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:58:38.634 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:58:38.634 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:58:38.634 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:58:38.634 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:58:38.634 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:58:38.634 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:58:38.635 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:58:38.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.623+0000 7fbfffc85640 1 -- 172.21.15.17:0/3670281782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbfe407af40 msgr2=0x7fbfe407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:38.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.623+0000 7fbfffc85640 1 --2- 172.21.15.17:0/3670281782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbfe407af40 0x7fbfe407d400 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbff4006fd0 tx=0x7fbff4008040 comp rx=0 tx=0).stop 2024-09-20T18:58:38.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.623+0000 7fbfffc85640 1 -- 172.21.15.17:0/3670281782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff81033e0 msgr2=0x7fbff8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:38.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.623+0000 7fbfffc85640 1 --2- 172.21.15.17:0/3670281782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff81033e0 0x7fbff8100c60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8031460 tx=0x7fbfe80046c0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.624+0000 7fbfffc85640 1 -- 172.21.15.17:0/3670281782 shutdown_connections 2024-09-20T18:58:38.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.624+0000 7fbfffc85640 1 --2- 172.21.15.17:0/3670281782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbfe407af40 0x7fbfe407d400 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.624+0000 7fbfffc85640 1 --2- 172.21.15.17:0/3670281782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbff81033e0 0x7fbff8100c60 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.624+0000 7fbfffc85640 1 --2- 172.21.15.17:0/3670281782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbff8102ac0 0x7fbff8100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.624+0000 7fbfffc85640 1 -- 172.21.15.17:0/3670281782 >> 172.21.15.17:0/3670281782 conn(0x7fbff80fc520 msgr2=0x7fbff8108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:38.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.624+0000 7fbfffc85640 1 -- 172.21.15.17:0/3670281782 shutdown_connections 2024-09-20T18:58:38.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.624+0000 7fbfffc85640 1 -- 172.21.15.17:0/3670281782 wait complete. 2024-09-20T18:58:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.709+0000 7f93e27cd640 1 -- 172.21.15.17:0/629532203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93dc106800 msgr2=0x7f93dc106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.709+0000 7f93e27cd640 1 --2- 172.21.15.17:0/629532203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93dc106800 0x7f93dc106be0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009880 tx=0x7f93cc02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.709+0000 7f93e27cd640 1 -- 172.21.15.17:0/629532203 shutdown_connections 2024-09-20T18:58:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.709+0000 7f93e27cd640 1 --2- 172.21.15.17:0/629532203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93dc100800 0x7f93dc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.709+0000 7f93e27cd640 1 --2- 172.21.15.17:0/629532203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93dc106800 0x7f93dc106be0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.709+0000 7f93e27cd640 1 -- 172.21.15.17:0/629532203 >> 172.21.15.17:0/629532203 conn(0x7f93dc0fc520 msgr2=0x7f93dc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.709+0000 7f93e27cd640 1 -- 172.21.15.17:0/629532203 shutdown_connections 2024-09-20T18:58:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.709+0000 7f93e27cd640 1 -- 172.21.15.17:0/629532203 wait complete. 2024-09-20T18:58:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.709+0000 7f93e27cd640 1 Processor -- start 2024-09-20T18:58:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.710+0000 7f93e27cd640 1 -- start start 2024-09-20T18:58:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.710+0000 7f93e27cd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93dc100800 0x7f93dc0fcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.710+0000 7f93e27cd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93dc106800 0x7f93dc0fd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.710+0000 7f93e27cd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc10dcd0 con 0x7f93dc100800 2024-09-20T18:58:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.710+0000 7f93e27cd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc10db50 con 0x7f93dc106800 2024-09-20T18:58:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.710+0000 7f93dbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93dc100800 0x7f93dc0fcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:38.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.710+0000 7f93dbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93dc100800 0x7f93dc0fcc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34148/0 (socket says 172.21.15.17:34148) 2024-09-20T18:58:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.710+0000 7f93dbfff640 1 -- 172.21.15.17:0/3845511298 learned_addr learned my addr 172.21.15.17:0/3845511298 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:58:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.710+0000 7f93db7fe640 1 --2- 172.21.15.17:0/3845511298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93dc106800 0x7f93dc0fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.710+0000 7f93dbfff640 1 -- 172.21.15.17:0/3845511298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93dc106800 msgr2=0x7f93dc0fd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.710+0000 7f93dbfff640 1 --2- 172.21.15.17:0/3845511298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93dc106800 0x7f93dc0fd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.710+0000 7f93dbfff640 1 -- 172.21.15.17:0/3845511298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93dc0fd680 con 0x7f93dc100800 2024-09-20T18:58:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.711+0000 7f93dbfff640 1 --2- 172.21.15.17:0/3845511298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93dc100800 0x7f93dc0fcc00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f93cc031460 tx=0x7f93cc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.711+0000 7f93d97fa640 1 -- 172.21.15.17:0/3845511298 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93cc03f070 con 0x7f93dc100800 2024-09-20T18:58:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.711+0000 7f93e27cd640 1 -- 172.21.15.17:0/3845511298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93dc0fd910 con 0x7f93dc100800 2024-09-20T18:58:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.711+0000 7f93d97fa640 1 -- 172.21.15.17:0/3845511298 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f93cc0035f0 con 0x7f93dc100800 2024-09-20T18:58:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.711+0000 7f93d97fa640 1 -- 172.21.15.17:0/3845511298 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93cc035030 con 0x7f93dc100800 2024-09-20T18:58:38.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.711+0000 7f93e27cd640 1 -- 172.21.15.17:0/3845511298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93dc1a3da0 con 0x7f93dc100800 2024-09-20T18:58:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.712+0000 7f93e27cd640 1 -- 172.21.15.17:0/3845511298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93dc101f40 con 0x7f93dc100800 2024-09-20T18:58:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.713+0000 7f93d97fa640 1 -- 172.21.15.17:0/3845511298 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f93cc042070 con 0x7f93dc100800 2024-09-20T18:58:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.713+0000 7f93d97fa640 1 --2- 172.21.15.17:0/3845511298 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93c407af30 0x7f93c407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.713+0000 7f93d97fa640 1 -- 172.21.15.17:0/3845511298 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f93cc0be970 con 0x7f93dc100800 2024-09-20T18:58:38.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.713+0000 7f93db7fe640 1 --2- 172.21.15.17:0/3845511298 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93c407af30 0x7f93c407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:38.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.714+0000 7f93db7fe640 1 --2- 172.21.15.17:0/3845511298 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93c407af30 0x7f93c407d3f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0fe690 tx=0x7f93d000b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.717+0000 7f93d97fa640 1 -- 172.21.15.17:0/3845511298 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f93cc0c0e20 con 0x7f93dc100800 2024-09-20T18:58:38.896 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:38 smithi017 ceph-mon[108970]: from='client.35098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:58:38.896 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:38 smithi017 ceph-mon[108970]: from='client.35102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:58:38.896 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:38 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1573804786' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:58:38.896 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:38 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3670281782' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:58:38.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.922+0000 7f93e27cd640 1 -- 172.21.15.17:0/3845511298 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f93dc062630 con 0x7f93c407af30 2024-09-20T18:58:38.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.924+0000 7f93d97fa640 1 -- 172.21.15.17:0/3845511298 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f93dc062630 con 0x7f93c407af30 2024-09-20T18:58:38.934 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:58:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:58:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:58:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:58:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:58:38.934 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:58:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:58:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:58:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:58:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:58:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:58:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:58:38.935 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:58:38.935 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:58:38.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.926+0000 7f93e27cd640 1 -- 172.21.15.17:0/3845511298 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93c407af30 msgr2=0x7f93c407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:38.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.926+0000 7f93e27cd640 1 --2- 172.21.15.17:0/3845511298 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93c407af30 0x7f93c407d3f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0fe690 tx=0x7f93d000b390 comp rx=0 tx=0).stop 2024-09-20T18:58:38.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.926+0000 7f93e27cd640 1 -- 172.21.15.17:0/3845511298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93dc100800 msgr2=0x7f93dc0fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:38.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.926+0000 7f93e27cd640 1 --2- 172.21.15.17:0/3845511298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93dc100800 0x7f93dc0fcc00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f93cc031460 tx=0x7f93cc0045e0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.926+0000 7f93e27cd640 1 -- 172.21.15.17:0/3845511298 shutdown_connections 2024-09-20T18:58:38.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.926+0000 7f93e27cd640 1 --2- 172.21.15.17:0/3845511298 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93c407af30 0x7f93c407d3f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.926+0000 7f93e27cd640 1 --2- 172.21.15.17:0/3845511298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93dc106800 0x7f93dc0fd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.926+0000 7f93e27cd640 1 --2- 172.21.15.17:0/3845511298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93dc100800 0x7f93dc0fcc00 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:38.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.926+0000 7f93e27cd640 1 -- 172.21.15.17:0/3845511298 >> 172.21.15.17:0/3845511298 conn(0x7f93dc0fc520 msgr2=0x7f93dc06a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:38.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.926+0000 7f93e27cd640 1 -- 172.21.15.17:0/3845511298 shutdown_connections 2024-09-20T18:58:38.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:38.926+0000 7f93e27cd640 1 -- 172.21.15.17:0/3845511298 wait complete. 2024-09-20T18:58:38.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:38 smithi172 ceph-mon[80431]: from='client.35098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:58:38.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:38 smithi172 ceph-mon[80431]: from='client.35102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:58:38.956 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:38 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1573804786' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:58:38.956 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:38 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3670281782' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:58:39.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.010+0000 7fed934f7640 1 -- 172.21.15.17:0/2725778555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed8c1033e0 msgr2=0x7fed8c10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:39.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.010+0000 7fed934f7640 1 --2- 172.21.15.17:0/2725778555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed8c1033e0 0x7fed8c10b8d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fed80009880 tx=0x7fed8002a530 comp rx=0 tx=0).stop 2024-09-20T18:58:39.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.010+0000 7fed934f7640 1 -- 172.21.15.17:0/2725778555 shutdown_connections 2024-09-20T18:58:39.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.010+0000 7fed934f7640 1 --2- 172.21.15.17:0/2725778555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed8c1033e0 0x7fed8c10b8d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:39.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.010+0000 7fed934f7640 1 --2- 172.21.15.17:0/2725778555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed8c102ac0 0x7fed8c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:39.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.010+0000 7fed934f7640 1 -- 172.21.15.17:0/2725778555 >> 172.21.15.17:0/2725778555 conn(0x7fed8c0fc520 msgr2=0x7fed8c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:39.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.010+0000 7fed934f7640 1 -- 172.21.15.17:0/2725778555 shutdown_connections 2024-09-20T18:58:39.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.010+0000 7fed934f7640 1 -- 172.21.15.17:0/2725778555 wait complete. 2024-09-20T18:58:39.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.010+0000 7fed934f7640 1 Processor -- start 2024-09-20T18:58:39.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.011+0000 7fed934f7640 1 -- start start 2024-09-20T18:58:39.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.011+0000 7fed934f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed8c102ac0 0x7fed8c100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:39.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.011+0000 7fed934f7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed8c1033e0 0x7fed8c100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:39.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.011+0000 7fed934f7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c10ee50 con 0x7fed8c1033e0 2024-09-20T18:58:39.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.011+0000 7fed934f7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c10ecd0 con 0x7fed8c102ac0 2024-09-20T18:58:39.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.011+0000 7fed90a92640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed8c1033e0 0x7fed8c100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:39.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.011+0000 7fed90a92640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed8c1033e0 0x7fed8c100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34166/0 (socket says 172.21.15.17:34166) 2024-09-20T18:58:39.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.011+0000 7fed90a92640 1 -- 172.21.15.17:0/3660627666 learned_addr learned my addr 172.21.15.17:0/3660627666 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:58:39.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.011+0000 7fed91293640 1 --2- 172.21.15.17:0/3660627666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed8c102ac0 0x7fed8c100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:39.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.011+0000 7fed90a92640 1 -- 172.21.15.17:0/3660627666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed8c102ac0 msgr2=0x7fed8c100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:39.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.011+0000 7fed90a92640 1 --2- 172.21.15.17:0/3660627666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed8c102ac0 0x7fed8c100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:39.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.011+0000 7fed90a92640 1 -- 172.21.15.17:0/3660627666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8c1011a0 con 0x7fed8c1033e0 2024-09-20T18:58:39.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.011+0000 7fed90a92640 1 --2- 172.21.15.17:0/3660627666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed8c1033e0 0x7fed8c100c60 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fed80031460 tx=0x7fed800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:39.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.012+0000 7fed7e7fc640 1 -- 172.21.15.17:0/3660627666 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed8003f070 con 0x7fed8c1033e0 2024-09-20T18:58:39.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.012+0000 7fed7e7fc640 1 -- 172.21.15.17:0/3660627666 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed80004ac0 con 0x7fed8c1033e0 2024-09-20T18:58:39.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.012+0000 7fed934f7640 1 -- 172.21.15.17:0/3660627666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed8c101430 con 0x7fed8c1033e0 2024-09-20T18:58:39.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.012+0000 7fed7e7fc640 1 -- 172.21.15.17:0/3660627666 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed80035030 con 0x7fed8c1033e0 2024-09-20T18:58:39.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.012+0000 7fed934f7640 1 -- 172.21.15.17:0/3660627666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed8c1a3e20 con 0x7fed8c1033e0 2024-09-20T18:58:39.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.013+0000 7fed934f7640 1 -- 172.21.15.17:0/3660627666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed8c06aa90 con 0x7fed8c1033e0 2024-09-20T18:58:39.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.013+0000 7fed7e7fc640 1 -- 172.21.15.17:0/3660627666 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fed80042070 con 0x7fed8c1033e0 2024-09-20T18:58:39.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.014+0000 7fed7e7fc640 1 --2- 172.21.15.17:0/3660627666 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed7807af80 0x7fed7807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:58:39.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.014+0000 7fed7e7fc640 1 -- 172.21.15.17:0/3660627666 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fed800be930 con 0x7fed8c1033e0 2024-09-20T18:58:39.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.014+0000 7fed91293640 1 --2- 172.21.15.17:0/3660627666 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed7807af80 0x7fed7807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:58:39.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.014+0000 7fed91293640 1 --2- 172.21.15.17:0/3660627666 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed7807af80 0x7fed7807d440 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fed88009990 tx=0x7fed88009110 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:58:39.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.018+0000 7fed7e7fc640 1 -- 172.21.15.17:0/3660627666 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fed80089fb0 con 0x7fed8c1033e0 2024-09-20T18:58:39.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.280+0000 7fed934f7640 1 -- 172.21.15.17:0/3660627666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fed8c105f60 con 0x7fed8c1033e0 2024-09-20T18:58:39.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.281+0000 7fed7e7fc640 1 -- 172.21.15.17:0/3660627666 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fed8008ee60 con 0x7fed8c1033e0 2024-09-20T18:58:39.291 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:58:39.291 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:58:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:58:39.292 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:58:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:58:39.292 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:58:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:58:39.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.283+0000 7fed934f7640 1 -- 172.21.15.17:0/3660627666 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed7807af80 msgr2=0x7fed7807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:39.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.283+0000 7fed934f7640 1 --2- 172.21.15.17:0/3660627666 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed7807af80 0x7fed7807d440 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fed88009990 tx=0x7fed88009110 comp rx=0 tx=0).stop 2024-09-20T18:58:39.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.283+0000 7fed934f7640 1 -- 172.21.15.17:0/3660627666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed8c1033e0 msgr2=0x7fed8c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:58:39.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.283+0000 7fed934f7640 1 --2- 172.21.15.17:0/3660627666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed8c1033e0 0x7fed8c100c60 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fed80031460 tx=0x7fed800046c0 comp rx=0 tx=0).stop 2024-09-20T18:58:39.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.283+0000 7fed934f7640 1 -- 172.21.15.17:0/3660627666 shutdown_connections 2024-09-20T18:58:39.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.283+0000 7fed934f7640 1 --2- 172.21.15.17:0/3660627666 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed7807af80 0x7fed7807d440 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:39.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.283+0000 7fed934f7640 1 --2- 172.21.15.17:0/3660627666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed8c1033e0 0x7fed8c100c60 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:39.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.283+0000 7fed934f7640 1 --2- 172.21.15.17:0/3660627666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed8c102ac0 0x7fed8c100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:58:39.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.283+0000 7fed934f7640 1 -- 172.21.15.17:0/3660627666 >> 172.21.15.17:0/3660627666 conn(0x7fed8c0fc520 msgr2=0x7fed8c108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:58:39.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.283+0000 7fed934f7640 1 -- 172.21.15.17:0/3660627666 shutdown_connections 2024-09-20T18:58:39.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:58:39.283+0000 7fed934f7640 1 -- 172.21.15.17:0/3660627666 wait complete. 2024-09-20T18:58:39.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:39 smithi172 ceph-mon[80431]: from='client.35106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:58:39.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:39 smithi172 ceph-mon[80431]: pgmap v697: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:39.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:39 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3660627666' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:58:40.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:39 smithi017 ceph-mon[108970]: from='client.35106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:58:40.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:39 smithi017 ceph-mon[108970]: pgmap v697: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:40.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:39 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3660627666' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:58:40.896 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:40 smithi017 ceph-mon[108970]: from='client.35118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:58:40.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:40 smithi172 ceph-mon[80431]: from='client.35118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:58:41.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:41 smithi172 ceph-mon[80431]: pgmap v698: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:41.961 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:41 smithi017 ceph-mon[108970]: pgmap v698: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:43.896 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:43 smithi017 ceph-mon[108970]: pgmap v699: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:43.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:43 smithi172 ceph-mon[80431]: pgmap v699: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:45.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:45 smithi172 ceph-mon[80431]: pgmap v700: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:46.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:45 smithi017 ceph-mon[108970]: pgmap v700: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:47.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:47 smithi172 ceph-mon[80431]: pgmap v701: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:48.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:47 smithi017 ceph-mon[108970]: pgmap v701: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:49.896 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:49 smithi017 ceph-mon[108970]: pgmap v702: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:49.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:49 smithi172 ceph-mon[80431]: pgmap v702: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:51.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:51 smithi172 ceph-mon[80431]: pgmap v703: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:51.962 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:51 smithi017 ceph-mon[108970]: pgmap v703: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:52.896 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:58:52.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:58:53.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:53 smithi172 ceph-mon[80431]: pgmap v704: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:54.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:53 smithi017 ceph-mon[108970]: pgmap v704: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:55.896 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:55 smithi017 ceph-mon[108970]: pgmap v705: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:55.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:55 smithi172 ceph-mon[80431]: pgmap v705: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:58.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:57 smithi017 ceph-mon[108970]: pgmap v706: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:58:58.205 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:57 smithi172 ceph-mon[80431]: pgmap v706: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:00.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:58:59 smithi017 ceph-mon[108970]: pgmap v707: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:00.205 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:58:59 smithi172 ceph-mon[80431]: pgmap v707: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:01.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:01 smithi017 ceph-mon[108970]: pgmap v708: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:02.205 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:01 smithi172 ceph-mon[80431]: pgmap v708: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:03.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:03 smithi017 ceph-mon[108970]: pgmap v709: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:03.455 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:03 smithi172 ceph-mon[80431]: pgmap v709: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:05.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:05 smithi172 ceph-mon[80431]: pgmap v710: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:06.145 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:05 smithi017 ceph-mon[108970]: pgmap v710: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:07.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:07 smithi017 ceph-mon[108970]: pgmap v711: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:07.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:59:07.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:07 smithi172 ceph-mon[80431]: pgmap v711: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:07.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:59:09.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.382+0000 7f3c6d28c640 1 -- 172.21.15.17:0/1660082044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c681067f0 msgr2=0x7f3c68106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:09.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.382+0000 7f3c6d28c640 1 --2- 172.21.15.17:0/1660082044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c681067f0 0x7f3c68106bd0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009c20 tx=0x7f3c5802a970 comp rx=0 tx=0).stop 2024-09-20T18:59:09.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.382+0000 7f3c6d28c640 1 -- 172.21.15.17:0/1660082044 shutdown_connections 2024-09-20T18:59:09.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.382+0000 7f3c6d28c640 1 --2- 172.21.15.17:0/1660082044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c681007f0 0x7f3c68100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.382+0000 7f3c6d28c640 1 --2- 172.21.15.17:0/1660082044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c681067f0 0x7f3c68106bd0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.382+0000 7f3c6d28c640 1 -- 172.21.15.17:0/1660082044 >> 172.21.15.17:0/1660082044 conn(0x7f3c680fc550 msgr2=0x7f3c680fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:09.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.382+0000 7f3c6d28c640 1 -- 172.21.15.17:0/1660082044 shutdown_connections 2024-09-20T18:59:09.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.382+0000 7f3c6d28c640 1 -- 172.21.15.17:0/1660082044 wait complete. 2024-09-20T18:59:09.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.382+0000 7f3c6d28c640 1 Processor -- start 2024-09-20T18:59:09.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.383+0000 7f3c6d28c640 1 -- start start 2024-09-20T18:59:09.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.383+0000 7f3c6d28c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c681007f0 0x7f3c680fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:09.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.383+0000 7f3c6d28c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c681067f0 0x7f3c680fd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:09.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.383+0000 7f3c6d28c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6810dd20 con 0x7f3c681067f0 2024-09-20T18:59:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.383+0000 7f3c6d28c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6810dba0 con 0x7f3c681007f0 2024-09-20T18:59:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.383+0000 7f3c667fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c681067f0 0x7f3c680fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.383+0000 7f3c667fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c681067f0 0x7f3c680fd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49120/0 (socket says 172.21.15.17:49120) 2024-09-20T18:59:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.383+0000 7f3c667fc640 1 -- 172.21.15.17:0/3087162522 learned_addr learned my addr 172.21.15.17:0/3087162522 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:59:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.383+0000 7f3c667fc640 1 -- 172.21.15.17:0/3087162522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c681007f0 msgr2=0x7f3c680fcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.383+0000 7f3c667fc640 1 --2- 172.21.15.17:0/3087162522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c681007f0 0x7f3c680fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.383+0000 7f3c667fc640 1 -- 172.21.15.17:0/3087162522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c680fd840 con 0x7f3c681067f0 2024-09-20T18:59:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.384+0000 7f3c667fc640 1 --2- 172.21.15.17:0/3087162522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c681067f0 0x7f3c680fd300 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c00b420 tx=0x7f3c5c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.384+0000 7f3c4ffff640 1 -- 172.21.15.17:0/3087162522 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c5c011630 con 0x7f3c681067f0 2024-09-20T18:59:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.384+0000 7f3c6d28c640 1 -- 172.21.15.17:0/3087162522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c680fdb30 con 0x7f3c681067f0 2024-09-20T18:59:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.384+0000 7f3c4ffff640 1 -- 172.21.15.17:0/3087162522 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c5c016070 con 0x7f3c681067f0 2024-09-20T18:59:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.384+0000 7f3c4ffff640 1 -- 172.21.15.17:0/3087162522 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c5c010d40 con 0x7f3c681067f0 2024-09-20T18:59:09.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.384+0000 7f3c6d28c640 1 -- 172.21.15.17:0/3087162522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c681a3ef0 con 0x7f3c681067f0 2024-09-20T18:59:09.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.385+0000 7f3c6d28c640 1 -- 172.21.15.17:0/3087162522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c68101f30 con 0x7f3c681067f0 2024-09-20T18:59:09.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.386+0000 7f3c4ffff640 1 -- 172.21.15.17:0/3087162522 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3c5c01b460 con 0x7f3c681067f0 2024-09-20T18:59:09.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.386+0000 7f3c4ffff640 1 --2- 172.21.15.17:0/3087162522 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c5007af40 0x7f3c5007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:09.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.386+0000 7f3c4ffff640 1 -- 172.21.15.17:0/3087162522 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f3c5c09d7d0 con 0x7f3c681067f0 2024-09-20T18:59:09.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.387+0000 7f3c66ffd640 1 --2- 172.21.15.17:0/3087162522 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c5007af40 0x7f3c5007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:09.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.387+0000 7f3c66ffd640 1 --2- 172.21.15.17:0/3087162522 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c5007af40 0x7f3c5007d400 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3c58006010 tx=0x7f3c5802f9d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.391+0000 7f3c4ffff640 1 -- 172.21.15.17:0/3087162522 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c5c021250 con 0x7f3c681067f0 2024-09-20T18:59:09.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.598+0000 7f3c6d28c640 1 -- 172.21.15.17:0/3087162522 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3c68062630 con 0x7f3c5007af40 2024-09-20T18:59:09.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.599+0000 7f3c4ffff640 1 -- 172.21.15.17:0/3087162522 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f3c68062630 con 0x7f3c5007af40 2024-09-20T18:59:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.601+0000 7f3c6d28c640 1 -- 172.21.15.17:0/3087162522 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c5007af40 msgr2=0x7f3c5007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.602+0000 7f3c6d28c640 1 --2- 172.21.15.17:0/3087162522 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c5007af40 0x7f3c5007d400 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3c58006010 tx=0x7f3c5802f9d0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.602+0000 7f3c6d28c640 1 -- 172.21.15.17:0/3087162522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c681067f0 msgr2=0x7f3c680fd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.602+0000 7f3c6d28c640 1 --2- 172.21.15.17:0/3087162522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c681067f0 0x7f3c680fd300 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c00b420 tx=0x7f3c5c00b8e0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.602+0000 7f3c6d28c640 1 -- 172.21.15.17:0/3087162522 shutdown_connections 2024-09-20T18:59:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.602+0000 7f3c6d28c640 1 --2- 172.21.15.17:0/3087162522 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c5007af40 0x7f3c5007d400 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.602+0000 7f3c6d28c640 1 --2- 172.21.15.17:0/3087162522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c681067f0 0x7f3c680fd300 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.602+0000 7f3c6d28c640 1 --2- 172.21.15.17:0/3087162522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c681007f0 0x7f3c680fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.602+0000 7f3c6d28c640 1 -- 172.21.15.17:0/3087162522 >> 172.21.15.17:0/3087162522 conn(0x7f3c680fc550 msgr2=0x7f3c6806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.602+0000 7f3c6d28c640 1 -- 172.21.15.17:0/3087162522 shutdown_connections 2024-09-20T18:59:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.602+0000 7f3c6d28c640 1 -- 172.21.15.17:0/3087162522 wait complete. 2024-09-20T18:59:09.621 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:59:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.688+0000 7f3d9939e640 1 -- 172.21.15.17:0/1596129092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d941028d0 msgr2=0x7f3d94102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.688+0000 7f3d9939e640 1 --2- 172.21.15.17:0/1596129092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d941028d0 0x7f3d94102cb0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009880 tx=0x7f3d8402a530 comp rx=0 tx=0).stop 2024-09-20T18:59:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.688+0000 7f3d9939e640 1 -- 172.21.15.17:0/1596129092 shutdown_connections 2024-09-20T18:59:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.688+0000 7f3d9939e640 1 --2- 172.21.15.17:0/1596129092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d941031f0 0x7f3d9410b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.688+0000 7f3d9939e640 1 --2- 172.21.15.17:0/1596129092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d941028d0 0x7f3d94102cb0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.688+0000 7f3d9939e640 1 -- 172.21.15.17:0/1596129092 >> 172.21.15.17:0/1596129092 conn(0x7f3d940fc310 msgr2=0x7f3d940fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.688+0000 7f3d9939e640 1 -- 172.21.15.17:0/1596129092 shutdown_connections 2024-09-20T18:59:09.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.688+0000 7f3d9939e640 1 -- 172.21.15.17:0/1596129092 wait complete. 2024-09-20T18:59:09.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.689+0000 7f3d9939e640 1 Processor -- start 2024-09-20T18:59:09.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.689+0000 7f3d9939e640 1 -- start start 2024-09-20T18:59:09.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.689+0000 7f3d9939e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d941028d0 0x7f3d94100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:09.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.689+0000 7f3d9939e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d941031f0 0x7f3d94100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:09.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.689+0000 7f3d9939e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9410ec00 con 0x7f3d941028d0 2024-09-20T18:59:09.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.689+0000 7f3d9939e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9410ea80 con 0x7f3d941031f0 2024-09-20T18:59:09.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.689+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d941028d0 0x7f3d94100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:09.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.689+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d941028d0 0x7f3d94100530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49148/0 (socket says 172.21.15.17:49148) 2024-09-20T18:59:09.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.689+0000 7f3d93fff640 1 -- 172.21.15.17:0/2726171677 learned_addr learned my addr 172.21.15.17:0/2726171677 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:59:09.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.689+0000 7f3d937fe640 1 --2- 172.21.15.17:0/2726171677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d941031f0 0x7f3d94100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.690+0000 7f3d93fff640 1 -- 172.21.15.17:0/2726171677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d941031f0 msgr2=0x7f3d94100a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.690+0000 7f3d93fff640 1 --2- 172.21.15.17:0/2726171677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d941031f0 0x7f3d94100a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.690+0000 7f3d93fff640 1 -- 172.21.15.17:0/2726171677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d94100fb0 con 0x7f3d941028d0 2024-09-20T18:59:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.690+0000 7f3d93fff640 1 --2- 172.21.15.17:0/2726171677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d941028d0 0x7f3d94100530 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3d84031460 tx=0x7f3d840045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.690+0000 7f3d917fa640 1 -- 172.21.15.17:0/2726171677 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d8403f070 con 0x7f3d941028d0 2024-09-20T18:59:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.690+0000 7f3d9939e640 1 -- 172.21.15.17:0/2726171677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d94101240 con 0x7f3d941028d0 2024-09-20T18:59:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.690+0000 7f3d917fa640 1 -- 172.21.15.17:0/2726171677 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3d84004b10 con 0x7f3d941028d0 2024-09-20T18:59:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.690+0000 7f3d917fa640 1 -- 172.21.15.17:0/2726171677 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d84035030 con 0x7f3d941028d0 2024-09-20T18:59:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.690+0000 7f3d9939e640 1 -- 172.21.15.17:0/2726171677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d941a3bd0 con 0x7f3d941028d0 2024-09-20T18:59:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.691+0000 7f3d9939e640 1 -- 172.21.15.17:0/2726171677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d9406a580 con 0x7f3d941028d0 2024-09-20T18:59:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.692+0000 7f3d917fa640 1 -- 172.21.15.17:0/2726171677 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3d84042070 con 0x7f3d941028d0 2024-09-20T18:59:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.692+0000 7f3d917fa640 1 --2- 172.21.15.17:0/2726171677 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3d7c07af40 0x7f3d7c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.692+0000 7f3d917fa640 1 -- 172.21.15.17:0/2726171677 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f3d840beaa0 con 0x7f3d941028d0 2024-09-20T18:59:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.692+0000 7f3d937fe640 1 --2- 172.21.15.17:0/2726171677 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3d7c07af40 0x7f3d7c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:09.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.693+0000 7f3d937fe640 1 --2- 172.21.15.17:0/2726171677 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3d7c07af40 0x7f3d7c07d400 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3d94101fc0 tx=0x7f3d8800b2e0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:09.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.697+0000 7f3d917fa640 1 -- 172.21.15.17:0/2726171677 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3d8408a0a0 con 0x7f3d941028d0 2024-09-20T18:59:09.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.901+0000 7f3d9939e640 1 -- 172.21.15.17:0/2726171677 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3d94062630 con 0x7f3d7c07af40 2024-09-20T18:59:09.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.902+0000 7f3d917fa640 1 -- 172.21.15.17:0/2726171677 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f3d94062630 con 0x7f3d7c07af40 2024-09-20T18:59:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.905+0000 7f3d9939e640 1 -- 172.21.15.17:0/2726171677 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3d7c07af40 msgr2=0x7f3d7c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.905+0000 7f3d9939e640 1 --2- 172.21.15.17:0/2726171677 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3d7c07af40 0x7f3d7c07d400 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3d94101fc0 tx=0x7f3d8800b2e0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.905+0000 7f3d9939e640 1 -- 172.21.15.17:0/2726171677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d941028d0 msgr2=0x7f3d94100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.905+0000 7f3d9939e640 1 --2- 172.21.15.17:0/2726171677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d941028d0 0x7f3d94100530 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3d84031460 tx=0x7f3d840045e0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.905+0000 7f3d9939e640 1 -- 172.21.15.17:0/2726171677 shutdown_connections 2024-09-20T18:59:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.905+0000 7f3d9939e640 1 --2- 172.21.15.17:0/2726171677 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3d7c07af40 0x7f3d7c07d400 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.905+0000 7f3d9939e640 1 --2- 172.21.15.17:0/2726171677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d941031f0 0x7f3d94100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.905+0000 7f3d9939e640 1 --2- 172.21.15.17:0/2726171677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d941028d0 0x7f3d94100530 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.905+0000 7f3d9939e640 1 -- 172.21.15.17:0/2726171677 >> 172.21.15.17:0/2726171677 conn(0x7f3d940fc310 msgr2=0x7f3d94108d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.905+0000 7f3d9939e640 1 -- 172.21.15.17:0/2726171677 shutdown_connections 2024-09-20T18:59:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.905+0000 7f3d9939e640 1 -- 172.21.15.17:0/2726171677 wait complete. 2024-09-20T18:59:09.916 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:09 smithi017 ceph-mon[108970]: pgmap v712: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:09.947 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:09 smithi172 ceph-mon[80431]: pgmap v712: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:10.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.989+0000 7f1d02793640 1 -- 172.21.15.17:0/2362244127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cfc107900 msgr2=0x7f1cfc107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:10.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.989+0000 7f1d02793640 1 --2- 172.21.15.17:0/2362244127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cfc107900 0x7f1cfc107ce0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1cec009880 tx=0x7f1cec02a4a0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.989+0000 7f1d02793640 1 -- 172.21.15.17:0/2362244127 shutdown_connections 2024-09-20T18:59:10.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.989+0000 7f1d02793640 1 --2- 172.21.15.17:0/2362244127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc101900 0x7f1cfc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.989+0000 7f1d02793640 1 --2- 172.21.15.17:0/2362244127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cfc107900 0x7f1cfc107ce0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.989+0000 7f1d02793640 1 -- 172.21.15.17:0/2362244127 >> 172.21.15.17:0/2362244127 conn(0x7f1cfc0fd600 msgr2=0x7f1cfc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:10.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.989+0000 7f1d02793640 1 -- 172.21.15.17:0/2362244127 shutdown_connections 2024-09-20T18:59:10.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.989+0000 7f1d02793640 1 -- 172.21.15.17:0/2362244127 wait complete. 2024-09-20T18:59:10.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.990+0000 7f1d02793640 1 Processor -- start 2024-09-20T18:59:10.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.990+0000 7f1d02793640 1 -- start start 2024-09-20T18:59:10.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.990+0000 7f1d02793640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc101900 0x7f1cfc19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:10.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.990+0000 7f1d02793640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cfc107900 0x7f1cfc19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:10.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.990+0000 7f1d02793640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc10edd0 con 0x7f1cfc107900 2024-09-20T18:59:10.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.990+0000 7f1d02793640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc10ec50 con 0x7f1cfc101900 2024-09-20T18:59:10.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.991+0000 7f1cfb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cfc107900 0x7f1cfc19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:10.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.991+0000 7f1cfb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cfc107900 0x7f1cfc19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49162/0 (socket says 172.21.15.17:49162) 2024-09-20T18:59:10.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.991+0000 7f1cfb7fe640 1 -- 172.21.15.17:0/2424738322 learned_addr learned my addr 172.21.15.17:0/2424738322 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:59:10.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.991+0000 7f1cfbfff640 1 --2- 172.21.15.17:0/2424738322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc101900 0x7f1cfc19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:10.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.991+0000 7f1cfb7fe640 1 -- 172.21.15.17:0/2424738322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc101900 msgr2=0x7f1cfc19d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:10.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.991+0000 7f1cfb7fe640 1 --2- 172.21.15.17:0/2424738322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc101900 0x7f1cfc19d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.991+0000 7f1cfb7fe640 1 -- 172.21.15.17:0/2424738322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cfc1977a0 con 0x7f1cfc107900 2024-09-20T18:59:10.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.991+0000 7f1cfb7fe640 1 --2- 172.21.15.17:0/2424738322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cfc107900 0x7f1cfc19db60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000e970 tx=0x7f1cf000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:10.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.991+0000 7f1cf97fa640 1 -- 172.21.15.17:0/2424738322 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cf000cac0 con 0x7f1cfc107900 2024-09-20T18:59:10.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.991+0000 7f1cf97fa640 1 -- 172.21.15.17:0/2424738322 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1cf00054e0 con 0x7f1cfc107900 2024-09-20T18:59:10.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.991+0000 7f1d02793640 1 -- 172.21.15.17:0/2424738322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cfc197a90 con 0x7f1cfc107900 2024-09-20T18:59:10.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.991+0000 7f1cf97fa640 1 -- 172.21.15.17:0/2424738322 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cf0010430 con 0x7f1cfc107900 2024-09-20T18:59:10.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.991+0000 7f1d02793640 1 -- 172.21.15.17:0/2424738322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cfc198020 con 0x7f1cfc107900 2024-09-20T18:59:10.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.993+0000 7f1d02793640 1 -- 172.21.15.17:0/2424738322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cfc103040 con 0x7f1cfc107900 2024-09-20T18:59:10.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.993+0000 7f1cf97fa640 1 -- 172.21.15.17:0/2424738322 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1cf0004e80 con 0x7f1cfc107900 2024-09-20T18:59:10.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.994+0000 7f1cf97fa640 1 --2- 172.21.15.17:0/2424738322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1ce407af30 0x7f1ce407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:10.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.994+0000 7f1cf97fa640 1 -- 172.21.15.17:0/2424738322 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f1cf009e630 con 0x7f1cfc107900 2024-09-20T18:59:10.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.994+0000 7f1cfbfff640 1 --2- 172.21.15.17:0/2424738322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1ce407af30 0x7f1ce407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:10.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.994+0000 7f1cfbfff640 1 --2- 172.21.15.17:0/2424738322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1ce407af30 0x7f1ce407d3f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1cec0096c0 tx=0x7f1cec031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:10.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:09.998+0000 7f1cf97fa640 1 -- 172.21.15.17:0/2424738322 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1cf0069c30 con 0x7f1cfc107900 2024-09-20T18:59:10.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.193+0000 7f1d02793640 1 -- 172.21.15.17:0/2424738322 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1cfc198330 con 0x7f1ce407af30 2024-09-20T18:59:10.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.203+0000 7f1cf97fa640 1 -- 172.21.15.17:0/2424738322 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f1cfc198330 con 0x7f1ce407af30 2024-09-20T18:59:10.213 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:59:10.213 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (20m) 14m ago 31m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:59:10.213 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (23m) 14m ago 31m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:59:10.213 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (23m) 14m ago 30m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:59:10.213 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (18m) 14m ago 31m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:59:10.213 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (18m) 14m ago 30m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:59:10.213 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (20m) 14m ago 31m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:59:10.214 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (15m) 14m ago 26m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:59:10.214 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (14m) 14m ago 26m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:59:10.214 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (26m) 14m ago 26m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:59:10.214 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (14m) 14m ago 26m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:59:10.214 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (22m) 14m ago 32m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:59:10.214 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (21m) 14m ago 30m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:59:10.214 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (19m) 14m ago 32m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:59:10.214 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (19m) 14m ago 30m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:59:10.214 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (21m) 14m ago 31m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:59:10.214 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (21m) 14m ago 30m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:59:10.214 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (18m) 14m ago 29m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:59:10.214 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (17m) 14m ago 29m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:59:10.214 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (17m) 14m ago 28m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:59:10.214 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (16m) 14m ago 28m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:59:10.215 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (15m) 14m ago 27m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:59:10.215 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (15m) 14m ago 27m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:59:10.215 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (20m) 14m ago 31m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:59:10.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.205+0000 7f1d02793640 1 -- 172.21.15.17:0/2424738322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1ce407af30 msgr2=0x7f1ce407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:10.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.205+0000 7f1d02793640 1 --2- 172.21.15.17:0/2424738322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1ce407af30 0x7f1ce407d3f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1cec0096c0 tx=0x7f1cec031400 comp rx=0 tx=0).stop 2024-09-20T18:59:10.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.205+0000 7f1d02793640 1 -- 172.21.15.17:0/2424738322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cfc107900 msgr2=0x7f1cfc19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:10.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.205+0000 7f1d02793640 1 --2- 172.21.15.17:0/2424738322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cfc107900 0x7f1cfc19db60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000e970 tx=0x7f1cf000ed70 comp rx=0 tx=0).stop 2024-09-20T18:59:10.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.205+0000 7f1d02793640 1 -- 172.21.15.17:0/2424738322 shutdown_connections 2024-09-20T18:59:10.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.205+0000 7f1d02793640 1 --2- 172.21.15.17:0/2424738322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1ce407af30 0x7f1ce407d3f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.205+0000 7f1d02793640 1 --2- 172.21.15.17:0/2424738322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cfc107900 0x7f1cfc19db60 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.205+0000 7f1d02793640 1 --2- 172.21.15.17:0/2424738322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc101900 0x7f1cfc19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.205+0000 7f1d02793640 1 -- 172.21.15.17:0/2424738322 >> 172.21.15.17:0/2424738322 conn(0x7f1cfc0fd600 msgr2=0x7f1cfc0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:10.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.205+0000 7f1d02793640 1 -- 172.21.15.17:0/2424738322 shutdown_connections 2024-09-20T18:59:10.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.205+0000 7f1d02793640 1 -- 172.21.15.17:0/2424738322 wait complete. 2024-09-20T18:59:10.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.288+0000 7f0f6a573640 1 -- 172.21.15.17:0/636363184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f641007f0 msgr2=0x7f0f64100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:10.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.288+0000 7f0f6a573640 1 --2- 172.21.15.17:0/636363184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f641007f0 0x7f0f64100c50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009880 tx=0x7f0f5802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.289+0000 7f0f6a573640 1 -- 172.21.15.17:0/636363184 shutdown_connections 2024-09-20T18:59:10.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.289+0000 7f0f6a573640 1 --2- 172.21.15.17:0/636363184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f641007f0 0x7f0f64100c50 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.289+0000 7f0f6a573640 1 --2- 172.21.15.17:0/636363184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f641067f0 0x7f0f64106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.289+0000 7f0f6a573640 1 -- 172.21.15.17:0/636363184 >> 172.21.15.17:0/636363184 conn(0x7f0f640fc550 msgr2=0x7f0f640fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:10.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.289+0000 7f0f6a573640 1 -- 172.21.15.17:0/636363184 shutdown_connections 2024-09-20T18:59:10.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.289+0000 7f0f6a573640 1 -- 172.21.15.17:0/636363184 wait complete. 2024-09-20T18:59:10.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.289+0000 7f0f6a573640 1 Processor -- start 2024-09-20T18:59:10.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.289+0000 7f0f6a573640 1 -- start start 2024-09-20T18:59:10.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.290+0000 7f0f6a573640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f641007f0 0x7f0f64198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:10.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.290+0000 7f0f6a573640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f641067f0 0x7f0f64198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:10.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.290+0000 7f0f6a573640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6410dd20 con 0x7f0f641067f0 2024-09-20T18:59:10.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.290+0000 7f0f6a573640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6410dba0 con 0x7f0f641007f0 2024-09-20T18:59:10.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.290+0000 7f0f637fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f641067f0 0x7f0f64198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:10.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.290+0000 7f0f637fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f641067f0 0x7f0f64198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49172/0 (socket says 172.21.15.17:49172) 2024-09-20T18:59:10.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.290+0000 7f0f637fe640 1 -- 172.21.15.17:0/264836257 learned_addr learned my addr 172.21.15.17:0/264836257 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:59:10.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.290+0000 7f0f63fff640 1 --2- 172.21.15.17:0/264836257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f641007f0 0x7f0f64198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:10.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.290+0000 7f0f637fe640 1 -- 172.21.15.17:0/264836257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f641007f0 msgr2=0x7f0f64198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:10.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.290+0000 7f0f637fe640 1 --2- 172.21.15.17:0/264836257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f641007f0 0x7f0f64198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.290+0000 7f0f637fe640 1 -- 172.21.15.17:0/264836257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f641994b0 con 0x7f0f641067f0 2024-09-20T18:59:10.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.290+0000 7f0f63fff640 1 --2- 172.21.15.17:0/264836257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f641007f0 0x7f0f64198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:59:10.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.291+0000 7f0f637fe640 1 --2- 172.21.15.17:0/264836257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f641067f0 0x7f0f64198eb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0f58031460 tx=0x7f0f580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:10.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.291+0000 7f0f617fa640 1 -- 172.21.15.17:0/264836257 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f5803f070 con 0x7f0f641067f0 2024-09-20T18:59:10.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.291+0000 7f0f617fa640 1 -- 172.21.15.17:0/264836257 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f58004cf0 con 0x7f0f641067f0 2024-09-20T18:59:10.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.291+0000 7f0f6a573640 1 -- 172.21.15.17:0/264836257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f64199740 con 0x7f0f641067f0 2024-09-20T18:59:10.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.291+0000 7f0f617fa640 1 -- 172.21.15.17:0/264836257 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f58035030 con 0x7f0f641067f0 2024-09-20T18:59:10.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.291+0000 7f0f6a573640 1 -- 172.21.15.17:0/264836257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f641a1cf0 con 0x7f0f641067f0 2024-09-20T18:59:10.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.292+0000 7f0f6a573640 1 -- 172.21.15.17:0/264836257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f64101f30 con 0x7f0f641067f0 2024-09-20T18:59:10.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.292+0000 7f0f617fa640 1 -- 172.21.15.17:0/264836257 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0f58042070 con 0x7f0f641067f0 2024-09-20T18:59:10.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.293+0000 7f0f617fa640 1 --2- 172.21.15.17:0/264836257 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0f4c07af80 0x7f0f4c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:10.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.293+0000 7f0f63fff640 1 --2- 172.21.15.17:0/264836257 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0f4c07af80 0x7f0f4c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:10.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.293+0000 7f0f617fa640 1 -- 172.21.15.17:0/264836257 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f0f580be9e0 con 0x7f0f641067f0 2024-09-20T18:59:10.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.294+0000 7f0f63fff640 1 --2- 172.21.15.17:0/264836257 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0f4c07af80 0x7f0f4c07d440 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009930 tx=0x7f0f54008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:10.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.297+0000 7f0f617fa640 1 -- 172.21.15.17:0/264836257 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f5808a060 con 0x7f0f641067f0 2024-09-20T18:59:10.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.560+0000 7f0f6a573640 1 -- 172.21.15.17:0/264836257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0f6406a290 con 0x7f0f641067f0 2024-09-20T18:59:10.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.560+0000 7f0f617fa640 1 -- 172.21.15.17:0/264836257 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f0f5808ef10 con 0x7f0f641067f0 2024-09-20T18:59:10.570 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:59:10.570 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:59:10.570 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:59:10.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:59:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:59:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:59:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:59:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:59:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:59:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:59:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:59:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:59:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:59:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:59:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:59:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.1-369-ged8ee0f2 (ed8ee0f26ef720e6504cefa8be1a2d0872192de7) squid (stable)": 1, 2024-09-20T18:59:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:59:10.571 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:59:10.572 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:59:10.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.563+0000 7f0f6a573640 1 -- 172.21.15.17:0/264836257 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0f4c07af80 msgr2=0x7f0f4c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:10.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.563+0000 7f0f6a573640 1 --2- 172.21.15.17:0/264836257 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0f4c07af80 0x7f0f4c07d440 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009930 tx=0x7f0f54008040 comp rx=0 tx=0).stop 2024-09-20T18:59:10.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.563+0000 7f0f6a573640 1 -- 172.21.15.17:0/264836257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f641067f0 msgr2=0x7f0f64198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:10.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.563+0000 7f0f6a573640 1 --2- 172.21.15.17:0/264836257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f641067f0 0x7f0f64198eb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0f58031460 tx=0x7f0f580048f0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.563+0000 7f0f6a573640 1 -- 172.21.15.17:0/264836257 shutdown_connections 2024-09-20T18:59:10.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.563+0000 7f0f6a573640 1 --2- 172.21.15.17:0/264836257 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0f4c07af80 0x7f0f4c07d440 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.563+0000 7f0f6a573640 1 --2- 172.21.15.17:0/264836257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f641067f0 0x7f0f64198eb0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.563+0000 7f0f6a573640 1 --2- 172.21.15.17:0/264836257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f641007f0 0x7f0f64198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.563+0000 7f0f6a573640 1 -- 172.21.15.17:0/264836257 >> 172.21.15.17:0/264836257 conn(0x7f0f640fc550 msgr2=0x7f0f640fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:10.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.563+0000 7f0f6a573640 1 -- 172.21.15.17:0/264836257 shutdown_connections 2024-09-20T18:59:10.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.563+0000 7f0f6a573640 1 -- 172.21.15.17:0/264836257 wait complete. 2024-09-20T18:59:10.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.650+0000 7f6783cf8640 1 -- 172.21.15.17:0/3820932841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f677c1028b0 msgr2=0x7f677c0ffdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:10.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.650+0000 7f6783cf8640 1 --2- 172.21.15.17:0/3820932841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f677c1028b0 0x7f677c0ffdc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6778009880 tx=0x7f677802a530 comp rx=0 tx=0).stop 2024-09-20T18:59:10.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.650+0000 7f6783cf8640 1 -- 172.21.15.17:0/3820932841 shutdown_connections 2024-09-20T18:59:10.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.650+0000 7f6783cf8640 1 --2- 172.21.15.17:0/3820932841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c102c90 0x7f677c100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.650+0000 7f6783cf8640 1 --2- 172.21.15.17:0/3820932841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f677c1028b0 0x7f677c0ffdc0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.650+0000 7f6783cf8640 1 -- 172.21.15.17:0/3820932841 >> 172.21.15.17:0/3820932841 conn(0x7f677c0fbc90 msgr2=0x7f677c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:10.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.650+0000 7f6783cf8640 1 -- 172.21.15.17:0/3820932841 shutdown_connections 2024-09-20T18:59:10.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.650+0000 7f6783cf8640 1 -- 172.21.15.17:0/3820932841 wait complete. 2024-09-20T18:59:10.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.651+0000 7f6783cf8640 1 Processor -- start 2024-09-20T18:59:10.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.651+0000 7f6783cf8640 1 -- start start 2024-09-20T18:59:10.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.651+0000 7f6783cf8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c1028b0 0x7f677c19f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:10.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.651+0000 7f6783cf8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f677c102c90 0x7f677c19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:10.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.651+0000 7f6783cf8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f677c111020 con 0x7f677c102c90 2024-09-20T18:59:10.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.651+0000 7f6783cf8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f677c110ea0 con 0x7f677c1028b0 2024-09-20T18:59:10.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.651+0000 7f6781293640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f677c102c90 0x7f677c19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:10.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.651+0000 7f6781293640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f677c102c90 0x7f677c19fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48508/0 (socket says 172.21.15.17:48508) 2024-09-20T18:59:10.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.651+0000 7f6781293640 1 -- 172.21.15.17:0/2357357493 learned_addr learned my addr 172.21.15.17:0/2357357493 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:59:10.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.651+0000 7f6781293640 1 -- 172.21.15.17:0/2357357493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c1028b0 msgr2=0x7f677c19f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:10.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.651+0000 7f6781293640 1 --2- 172.21.15.17:0/2357357493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c1028b0 0x7f677c19f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.651+0000 7f6781293640 1 -- 172.21.15.17:0/2357357493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677c1999f0 con 0x7f677c102c90 2024-09-20T18:59:10.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.652+0000 7f6781293640 1 --2- 172.21.15.17:0/2357357493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f677c102c90 0x7f677c19fd70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f676c00c8f0 tx=0x7f676c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:10.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.652+0000 7f6772ffd640 1 -- 172.21.15.17:0/2357357493 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f676c0079b0 con 0x7f677c102c90 2024-09-20T18:59:10.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.652+0000 7f6772ffd640 1 -- 172.21.15.17:0/2357357493 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f676c007b50 con 0x7f677c102c90 2024-09-20T18:59:10.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.652+0000 7f6783cf8640 1 -- 172.21.15.17:0/2357357493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f677c199ce0 con 0x7f677c102c90 2024-09-20T18:59:10.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.652+0000 7f6772ffd640 1 -- 172.21.15.17:0/2357357493 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f676c018630 con 0x7f677c102c90 2024-09-20T18:59:10.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.652+0000 7f6783cf8640 1 -- 172.21.15.17:0/2357357493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f677c19a270 con 0x7f677c102c90 2024-09-20T18:59:10.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.653+0000 7f6783cf8640 1 -- 172.21.15.17:0/2357357493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f677c100fe0 con 0x7f677c102c90 2024-09-20T18:59:10.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.654+0000 7f6772ffd640 1 -- 172.21.15.17:0/2357357493 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f676c00f9a0 con 0x7f677c102c90 2024-09-20T18:59:10.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.654+0000 7f6772ffd640 1 --2- 172.21.15.17:0/2357357493 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f676807af30 0x7f676807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:10.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.655+0000 7f6772ffd640 1 -- 172.21.15.17:0/2357357493 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f676c09e300 con 0x7f677c102c90 2024-09-20T18:59:10.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.655+0000 7f6781a94640 1 --2- 172.21.15.17:0/2357357493 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f676807af30 0x7f676807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:10.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.655+0000 7f6781a94640 1 --2- 172.21.15.17:0/2357357493 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f676807af30 0x7f676807d3f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f67780096c0 tx=0x7f6778000bc0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:10.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.659+0000 7f6772ffd640 1 -- 172.21.15.17:0/2357357493 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f676c014030 con 0x7f677c102c90 2024-09-20T18:59:10.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:10 smithi017 ceph-mon[108970]: from='client.35126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:10.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:10 smithi017 ceph-mon[108970]: from='client.35130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:10.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:10 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/264836257' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:59:10.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.887+0000 7f6783cf8640 1 -- 172.21.15.17:0/2357357493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f677c19af20 con 0x7f677c102c90 2024-09-20T18:59:10.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.887+0000 7f6772ffd640 1 -- 172.21.15.17:0/2357357493 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+1998 (secure 0 0 0) 0x7f676c069860 con 0x7f677c102c90 2024-09-20T18:59:10.897 INFO:teuthology.orchestra.run.smithi017.stdout:e24 2024-09-20T18:59:10.897 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:44:37:466428+0000 2024-09-20T18:59:10.898 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:59:10.898 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:59:10.898 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:59:10.898 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:59:10.898 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:59:10.898 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:59:10.898 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:59:10.898 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:59:10.898 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:59:10.898 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:59:10.898 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:59:10.898 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:59:10.899 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:59:10.899 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:59:10.899 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:59:10.899 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:59:10.899 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:59:10.899 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:59:10.899 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:59:10.899 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:59:10.899 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:59:10.899 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:59:10.899 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:59:10.899 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:59:10.899 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:59:10.900 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:59:10.900 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:59:10.900 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:59:10.900 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:59:10.900 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:59:10.900 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:59:10.900 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:59:10.900 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:59:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:59:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:59:10.900 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:59:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:59:10.900 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:59:10.900 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:59:10.900 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44285} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/3829314266,v1:172.21.15.172:6827/3829314266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:59:10.901 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:59:10.901 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T18:59:10.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.890+0000 7f6783cf8640 1 -- 172.21.15.17:0/2357357493 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f676807af30 msgr2=0x7f676807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:10.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.890+0000 7f6783cf8640 1 --2- 172.21.15.17:0/2357357493 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f676807af30 0x7f676807d3f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f67780096c0 tx=0x7f6778000bc0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.890+0000 7f6783cf8640 1 -- 172.21.15.17:0/2357357493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f677c102c90 msgr2=0x7f677c19fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:10.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.890+0000 7f6783cf8640 1 --2- 172.21.15.17:0/2357357493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f677c102c90 0x7f677c19fd70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f676c00c8f0 tx=0x7f676c00cdb0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.890+0000 7f6783cf8640 1 -- 172.21.15.17:0/2357357493 shutdown_connections 2024-09-20T18:59:10.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.890+0000 7f6783cf8640 1 --2- 172.21.15.17:0/2357357493 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f676807af30 0x7f676807d3f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.890+0000 7f6783cf8640 1 --2- 172.21.15.17:0/2357357493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f677c102c90 0x7f677c19fd70 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.890+0000 7f6783cf8640 1 --2- 172.21.15.17:0/2357357493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f677c1028b0 0x7f677c19f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.890+0000 7f6783cf8640 1 -- 172.21.15.17:0/2357357493 >> 172.21.15.17:0/2357357493 conn(0x7f677c0fbc90 msgr2=0x7f677c0fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:10.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.890+0000 7f6783cf8640 1 -- 172.21.15.17:0/2357357493 shutdown_connections 2024-09-20T18:59:10.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.890+0000 7f6783cf8640 1 -- 172.21.15.17:0/2357357493 wait complete. 2024-09-20T18:59:10.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:10 smithi172 ceph-mon[80431]: from='client.35126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:10.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:10 smithi172 ceph-mon[80431]: from='client.35130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:10.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:10 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/264836257' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:59:10.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.975+0000 7f309582f640 1 -- 172.21.15.17:0/1949801809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3090102b50 msgr2=0x7f3090102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:10.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.975+0000 7f309582f640 1 --2- 172.21.15.17:0/1949801809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3090102b50 0x7f3090102f30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3080009c20 tx=0x7f308002aa00 comp rx=0 tx=0).stop 2024-09-20T18:59:10.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.976+0000 7f309582f640 1 -- 172.21.15.17:0/1949801809 shutdown_connections 2024-09-20T18:59:10.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.976+0000 7f309582f640 1 --2- 172.21.15.17:0/1949801809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3090103470 0x7f309010b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.976+0000 7f309582f640 1 --2- 172.21.15.17:0/1949801809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3090102b50 0x7f3090102f30 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.976+0000 7f309582f640 1 -- 172.21.15.17:0/1949801809 >> 172.21.15.17:0/1949801809 conn(0x7f30900fc550 msgr2=0x7f30900fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:10.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.976+0000 7f309582f640 1 -- 172.21.15.17:0/1949801809 shutdown_connections 2024-09-20T18:59:10.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.976+0000 7f309582f640 1 -- 172.21.15.17:0/1949801809 wait complete. 2024-09-20T18:59:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.976+0000 7f309582f640 1 Processor -- start 2024-09-20T18:59:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.976+0000 7f309582f640 1 -- start start 2024-09-20T18:59:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.977+0000 7f309582f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3090102b50 0x7f30901007b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.977+0000 7f309582f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3090103470 0x7f3090100cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.977+0000 7f309582f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f309010ede0 con 0x7f3090103470 2024-09-20T18:59:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.977+0000 7f309582f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f309010ec60 con 0x7f3090102b50 2024-09-20T18:59:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.977+0000 7f308e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3090103470 0x7f3090100cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.977+0000 7f308e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3090103470 0x7f3090100cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48524/0 (socket says 172.21.15.17:48524) 2024-09-20T18:59:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.977+0000 7f308e7fc640 1 -- 172.21.15.17:0/1801927065 learned_addr learned my addr 172.21.15.17:0/1801927065 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:59:10.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.977+0000 7f308effd640 1 --2- 172.21.15.17:0/1801927065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3090102b50 0x7f30901007b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:10.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.977+0000 7f308e7fc640 1 -- 172.21.15.17:0/1801927065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3090102b50 msgr2=0x7f30901007b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:10.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.977+0000 7f308e7fc640 1 --2- 172.21.15.17:0/1801927065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3090102b50 0x7f30901007b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:10.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.977+0000 7f308e7fc640 1 -- 172.21.15.17:0/1801927065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3090101230 con 0x7f3090103470 2024-09-20T18:59:10.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.977+0000 7f308e7fc640 1 --2- 172.21.15.17:0/1801927065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3090103470 0x7f3090100cf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f308400d6f0 tx=0x7f308400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:10.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.978+0000 7f309482d640 1 -- 172.21.15.17:0/1801927065 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3084017070 con 0x7f3090103470 2024-09-20T18:59:10.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.978+0000 7f309582f640 1 -- 172.21.15.17:0/1801927065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3090101520 con 0x7f3090103470 2024-09-20T18:59:10.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.978+0000 7f309482d640 1 -- 172.21.15.17:0/1801927065 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f308400de00 con 0x7f3090103470 2024-09-20T18:59:10.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.978+0000 7f309482d640 1 -- 172.21.15.17:0/1801927065 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3084004bb0 con 0x7f3090103470 2024-09-20T18:59:10.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.978+0000 7f309582f640 1 -- 172.21.15.17:0/1801927065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30901a3e50 con 0x7f3090103470 2024-09-20T18:59:10.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.979+0000 7f309582f640 1 -- 172.21.15.17:0/1801927065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f309006a4e0 con 0x7f3090103470 2024-09-20T18:59:10.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.979+0000 7f309482d640 1 -- 172.21.15.17:0/1801927065 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3084004e60 con 0x7f3090103470 2024-09-20T18:59:10.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.980+0000 7f309482d640 1 --2- 172.21.15.17:0/1801927065 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f307807af30 0x7f307807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:10.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.980+0000 7f309482d640 1 -- 172.21.15.17:0/1801927065 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7f308409db90 con 0x7f3090103470 2024-09-20T18:59:10.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.980+0000 7f308effd640 1 --2- 172.21.15.17:0/1801927065 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f307807af30 0x7f307807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:10.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.980+0000 7f308effd640 1 --2- 172.21.15.17:0/1801927065 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f307807af30 0x7f307807d3f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3080009430 tx=0x7f308003a040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:10.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:10.984+0000 7f309482d640 1 -- 172.21.15.17:0/1801927065 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3084069190 con 0x7f3090103470 2024-09-20T18:59:11.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.191+0000 7f309582f640 1 -- 172.21.15.17:0/1801927065 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3090062630 con 0x7f307807af30 2024-09-20T18:59:11.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.192+0000 7f309482d640 1 -- 172.21.15.17:0/1801927065 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f3090062630 con 0x7f307807af30 2024-09-20T18:59:11.202 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:59:11.202 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:59:11.202 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:59:11.202 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:59:11.203 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:59:11.203 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:59:11.203 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:59:11.203 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:59:11.203 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:59:11.203 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:59:11.203 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:59:11.203 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:59:11.203 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:59:11.203 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:59:11.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.195+0000 7f309582f640 1 -- 172.21.15.17:0/1801927065 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f307807af30 msgr2=0x7f307807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:11.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.195+0000 7f309582f640 1 --2- 172.21.15.17:0/1801927065 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f307807af30 0x7f307807d3f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3080009430 tx=0x7f308003a040 comp rx=0 tx=0).stop 2024-09-20T18:59:11.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.195+0000 7f309582f640 1 -- 172.21.15.17:0/1801927065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3090103470 msgr2=0x7f3090100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:11.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.195+0000 7f309582f640 1 --2- 172.21.15.17:0/1801927065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3090103470 0x7f3090100cf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f308400d6f0 tx=0x7f308400dbb0 comp rx=0 tx=0).stop 2024-09-20T18:59:11.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.195+0000 7f309582f640 1 -- 172.21.15.17:0/1801927065 shutdown_connections 2024-09-20T18:59:11.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.195+0000 7f309582f640 1 --2- 172.21.15.17:0/1801927065 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f307807af30 0x7f307807d3f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:11.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.195+0000 7f309582f640 1 --2- 172.21.15.17:0/1801927065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3090103470 0x7f3090100cf0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:11.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.195+0000 7f309582f640 1 --2- 172.21.15.17:0/1801927065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3090102b50 0x7f30901007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:11.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.195+0000 7f309582f640 1 -- 172.21.15.17:0/1801927065 >> 172.21.15.17:0/1801927065 conn(0x7f30900fc550 msgr2=0x7f3090108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:11.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.195+0000 7f309582f640 1 -- 172.21.15.17:0/1801927065 shutdown_connections 2024-09-20T18:59:11.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.195+0000 7f309582f640 1 -- 172.21.15.17:0/1801927065 wait complete. 2024-09-20T18:59:11.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.279+0000 7fc269974640 1 -- 172.21.15.17:0/3588465267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc264100800 msgr2=0x7fc264100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:11.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.279+0000 7fc269974640 1 --2- 172.21.15.17:0/3588465267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc264100800 0x7fc264100c60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc258009880 tx=0x7fc25802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:59:11.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.279+0000 7fc269974640 1 -- 172.21.15.17:0/3588465267 shutdown_connections 2024-09-20T18:59:11.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.279+0000 7fc269974640 1 --2- 172.21.15.17:0/3588465267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc264100800 0x7fc264100c60 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:11.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.279+0000 7fc269974640 1 --2- 172.21.15.17:0/3588465267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc264106800 0x7fc264106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:11.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.279+0000 7fc269974640 1 -- 172.21.15.17:0/3588465267 >> 172.21.15.17:0/3588465267 conn(0x7fc2640fc520 msgr2=0x7fc2640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:11.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.279+0000 7fc269974640 1 -- 172.21.15.17:0/3588465267 shutdown_connections 2024-09-20T18:59:11.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.279+0000 7fc269974640 1 -- 172.21.15.17:0/3588465267 wait complete. 2024-09-20T18:59:11.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.280+0000 7fc269974640 1 Processor -- start 2024-09-20T18:59:11.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.280+0000 7fc269974640 1 -- start start 2024-09-20T18:59:11.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.280+0000 7fc269974640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc264100800 0x7fc26419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:11.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.280+0000 7fc269974640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc264106800 0x7fc26419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:11.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.280+0000 7fc269974640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc26410dcd0 con 0x7fc264106800 2024-09-20T18:59:11.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.280+0000 7fc269974640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc26410db50 con 0x7fc264100800 2024-09-20T18:59:11.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.280+0000 7fc2627fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc264106800 0x7fc26419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:11.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.280+0000 7fc2627fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc264106800 0x7fc26419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48536/0 (socket says 172.21.15.17:48536) 2024-09-20T18:59:11.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.280+0000 7fc2627fc640 1 -- 172.21.15.17:0/359780350 learned_addr learned my addr 172.21.15.17:0/359780350 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:59:11.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.280+0000 7fc262ffd640 1 --2- 172.21.15.17:0/359780350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc264100800 0x7fc26419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:11.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.280+0000 7fc2627fc640 1 -- 172.21.15.17:0/359780350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc264100800 msgr2=0x7fc26419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:11.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.280+0000 7fc2627fc640 1 --2- 172.21.15.17:0/359780350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc264100800 0x7fc26419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:11.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.281+0000 7fc2627fc640 1 -- 172.21.15.17:0/359780350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2641977f0 con 0x7fc264106800 2024-09-20T18:59:11.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.281+0000 7fc262ffd640 1 --2- 172.21.15.17:0/359780350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc264100800 0x7fc26419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T18:59:11.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.281+0000 7fc2627fc640 1 --2- 172.21.15.17:0/359780350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc264106800 0x7fc26419dbb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc258031460 tx=0x7fc2580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:11.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.281+0000 7fc268972640 1 -- 172.21.15.17:0/359780350 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc25803f070 con 0x7fc264106800 2024-09-20T18:59:11.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.281+0000 7fc268972640 1 -- 172.21.15.17:0/359780350 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc258004cf0 con 0x7fc264106800 2024-09-20T18:59:11.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.281+0000 7fc269974640 1 -- 172.21.15.17:0/359780350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc264197a80 con 0x7fc264106800 2024-09-20T18:59:11.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.281+0000 7fc268972640 1 -- 172.21.15.17:0/359780350 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc258035030 con 0x7fc264106800 2024-09-20T18:59:11.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.281+0000 7fc269974640 1 -- 172.21.15.17:0/359780350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc264197fb0 con 0x7fc264106800 2024-09-20T18:59:11.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.282+0000 7fc269974640 1 -- 172.21.15.17:0/359780350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc264101f40 con 0x7fc264106800 2024-09-20T18:59:11.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.283+0000 7fc268972640 1 -- 172.21.15.17:0/359780350 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc258042070 con 0x7fc264106800 2024-09-20T18:59:11.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.283+0000 7fc268972640 1 --2- 172.21.15.17:0/359780350 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc24c07af30 0x7fc24c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:11.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.283+0000 7fc268972640 1 -- 172.21.15.17:0/359780350 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6156+0+0 (secure 0 0 0) 0x7fc2580beac0 con 0x7fc264106800 2024-09-20T18:59:11.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.283+0000 7fc262ffd640 1 --2- 172.21.15.17:0/359780350 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc24c07af30 0x7fc24c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:11.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.284+0000 7fc262ffd640 1 --2- 172.21.15.17:0/359780350 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc24c07af30 0x7fc24c07d3f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc2540058c0 tx=0x7fc254005d30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:11.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.288+0000 7fc268972640 1 -- 172.21.15.17:0/359780350 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc25808a0c0 con 0x7fc264106800 2024-09-20T18:59:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.548+0000 7fc269974640 1 -- 172.21.15.17:0/359780350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fc264109d80 con 0x7fc264106800 2024-09-20T18:59:11.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.549+0000 7fc268972640 1 -- 172.21.15.17:0/359780350 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fc25808ef70 con 0x7fc264106800 2024-09-20T18:59:11.559 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:59:11.559 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:59:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:59:11.559 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:59:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:59:11.560 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:59:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:59:11.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.551+0000 7fc269974640 1 -- 172.21.15.17:0/359780350 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc24c07af30 msgr2=0x7fc24c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:11.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.551+0000 7fc269974640 1 --2- 172.21.15.17:0/359780350 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc24c07af30 0x7fc24c07d3f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc2540058c0 tx=0x7fc254005d30 comp rx=0 tx=0).stop 2024-09-20T18:59:11.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.551+0000 7fc269974640 1 -- 172.21.15.17:0/359780350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc264106800 msgr2=0x7fc26419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:11.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.551+0000 7fc269974640 1 --2- 172.21.15.17:0/359780350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc264106800 0x7fc26419dbb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc258031460 tx=0x7fc2580048f0 comp rx=0 tx=0).stop 2024-09-20T18:59:11.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.551+0000 7fc269974640 1 -- 172.21.15.17:0/359780350 shutdown_connections 2024-09-20T18:59:11.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.551+0000 7fc269974640 1 --2- 172.21.15.17:0/359780350 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc24c07af30 0x7fc24c07d3f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:11.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.551+0000 7fc269974640 1 --2- 172.21.15.17:0/359780350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc264106800 0x7fc26419dbb0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:11.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.551+0000 7fc269974640 1 --2- 172.21.15.17:0/359780350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc264100800 0x7fc26419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:11.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.551+0000 7fc269974640 1 -- 172.21.15.17:0/359780350 >> 172.21.15.17:0/359780350 conn(0x7fc2640fc520 msgr2=0x7fc26406a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:11.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.552+0000 7fc269974640 1 -- 172.21.15.17:0/359780350 shutdown_connections 2024-09-20T18:59:11.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:11.552+0000 7fc269974640 1 -- 172.21.15.17:0/359780350 wait complete. 2024-09-20T18:59:11.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:11 smithi017 ceph-mon[108970]: from='client.35134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:11.896 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:11 smithi017 ceph-mon[108970]: pgmap v713: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:11.896 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:11 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2357357493' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:59:11.896 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:11 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/359780350' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:59:11.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:11 smithi172 ceph-mon[80431]: from='client.35134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:11.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:11 smithi172 ceph-mon[80431]: pgmap v713: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:11.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:11 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2357357493' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:59:11.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:11 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/359780350' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:59:12.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:12 smithi172 ceph-mon[80431]: from='client.35146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:13.145 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:12 smithi017 ceph-mon[108970]: from='client.35146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:13.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:13 smithi017 ceph-mon[108970]: pgmap v714: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:13.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:13 smithi172 ceph-mon[80431]: pgmap v714: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:15.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:15 smithi172 ceph-mon[80431]: pgmap v715: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:16.145 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:15 smithi017 ceph-mon[108970]: pgmap v715: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:17.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:17 smithi172 ceph-mon[80431]: pgmap v716: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:18.145 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:17 smithi017 ceph-mon[108970]: pgmap v716: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:19.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:19 smithi017 ceph-mon[108970]: pgmap v717: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:19.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:19 smithi172 ceph-mon[80431]: pgmap v717: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:21.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:21 smithi172 ceph-mon[80431]: pgmap v718: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:21.960 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:21 smithi017 ceph-mon[108970]: pgmap v718: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:22.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:59:23.145 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:59:23.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:23 smithi172 ceph-mon[80431]: pgmap v719: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:24.145 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:23 smithi017 ceph-mon[108970]: pgmap v719: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:25.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:25 smithi017 ceph-mon[108970]: pgmap v720: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:25.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:25 smithi172 ceph-mon[80431]: pgmap v720: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:27.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:27 smithi017 ceph-mon[108970]: pgmap v721: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:28.204 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:27 smithi172 ceph-mon[80431]: pgmap v721: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:30.145 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:29 smithi017 ceph-mon[108970]: pgmap v722: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:30.204 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:29 smithi172 ceph-mon[80431]: pgmap v722: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:31.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:31 smithi017 ceph-mon[108970]: pgmap v723: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:32.204 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:31 smithi172 ceph-mon[80431]: pgmap v723: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:34.145 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:33 smithi017 ceph-mon[108970]: pgmap v724: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:34.204 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:33 smithi172 ceph-mon[80431]: pgmap v724: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:36.145 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:35 smithi017 ceph-mon[108970]: pgmap v725: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:36.204 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:35 smithi172 ceph-mon[80431]: pgmap v725: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:37.031 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:36 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:59:37.031 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:36 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:59:37.031 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:36 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:37.032 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:36 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:59:37.032 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:36 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:59:37.032 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:36 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:59:37.032 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:36 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:59:37.032 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:36 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:59:37.045 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:36 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:59:37.045 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:36 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T18:59:37.045 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:36 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:37.045 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:36 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:59:37.046 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:36 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:59:37.046 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:36 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:59:37.046 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:36 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:59:37.046 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:36 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:59:37.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:37 smithi017 ceph-mon[108970]: pgmap v726: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:37.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:37 smithi017 ceph-mon[108970]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-20T18:59:37.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:37.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:59:38.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:37 smithi172 ceph-mon[80431]: pgmap v726: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:38.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:37 smithi172 ceph-mon[80431]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-20T18:59:38.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:38.095 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:59:39.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:39 smithi017 ceph-mon[108970]: Upgrade: Updating mds.cephfs.smithi172.liatxm 2024-09-20T18:59:39.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:39 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:39.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:39 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.liatxm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-20T18:59:39.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:39 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:59:39.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:39 smithi017 ceph-mon[108970]: Deploying daemon mds.cephfs.smithi172.liatxm on smithi172 2024-09-20T18:59:39.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:39 smithi017 ceph-mon[108970]: pgmap v727: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:39.454 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:39 smithi172 ceph-mon[80431]: Upgrade: Updating mds.cephfs.smithi172.liatxm 2024-09-20T18:59:39.454 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:39 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:39.455 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:39 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi172.liatxm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-20T18:59:39.455 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:39 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T18:59:39.455 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:39 smithi172 ceph-mon[80431]: Deploying daemon mds.cephfs.smithi172.liatxm on smithi172 2024-09-20T18:59:39.455 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:39 smithi172 ceph-mon[80431]: pgmap v727: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:41.455 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:41 smithi172 ceph-mon[80431]: osdmap e80: 6 total, 6 up, 6 in 2024-09-20T18:59:41.455 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:41 smithi172 ceph-mon[80431]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-20T18:59:41.455 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:41 smithi172 ceph-mon[80431]: pgmap v729: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:41.645 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:41 smithi017 ceph-mon[108970]: osdmap e80: 6 total, 6 up, 6 in 2024-09-20T18:59:41.645 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:41 smithi017 ceph-mon[108970]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-20T18:59:41.645 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:41 smithi017 ceph-mon[108970]: pgmap v729: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:41.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.648+0000 7f63eeedf640 1 -- 172.21.15.17:0/3498856244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e8102ac0 msgr2=0x7f63e8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:41.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.648+0000 7f63eeedf640 1 --2- 172.21.15.17:0/3498856244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e8102ac0 0x7f63e8102ea0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f63dc009880 tx=0x7f63dc02a530 comp rx=0 tx=0).stop 2024-09-20T18:59:41.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.648+0000 7f63eeedf640 1 -- 172.21.15.17:0/3498856244 shutdown_connections 2024-09-20T18:59:41.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.648+0000 7f63eeedf640 1 --2- 172.21.15.17:0/3498856244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e81033e0 0x7f63e810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:41.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.648+0000 7f63eeedf640 1 --2- 172.21.15.17:0/3498856244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e8102ac0 0x7f63e8102ea0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:41.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.648+0000 7f63eeedf640 1 -- 172.21.15.17:0/3498856244 >> 172.21.15.17:0/3498856244 conn(0x7f63e80fc520 msgr2=0x7f63e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:41.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.649+0000 7f63eeedf640 1 -- 172.21.15.17:0/3498856244 shutdown_connections 2024-09-20T18:59:41.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.649+0000 7f63eeedf640 1 -- 172.21.15.17:0/3498856244 wait complete. 2024-09-20T18:59:41.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.649+0000 7f63eeedf640 1 Processor -- start 2024-09-20T18:59:41.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.649+0000 7f63eeedf640 1 -- start start 2024-09-20T18:59:41.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.650+0000 7f63eeedf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e8102ac0 0x7f63e819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:41.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.650+0000 7f63eeedf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e81033e0 0x7f63e819dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:41.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.650+0000 7f63eeedf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f63e810edd0 con 0x7f63e81033e0 2024-09-20T18:59:41.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.650+0000 7f63eeedf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f63e810ec50 con 0x7f63e8102ac0 2024-09-20T18:59:41.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.650+0000 7f63e7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e81033e0 0x7f63e819dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:41.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.650+0000 7f63e7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e81033e0 0x7f63e819dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60478/0 (socket says 172.21.15.17:60478) 2024-09-20T18:59:41.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.650+0000 7f63e7fff640 1 -- 172.21.15.17:0/2636345339 learned_addr learned my addr 172.21.15.17:0/2636345339 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:59:41.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.650+0000 7f63ecc7b640 1 --2- 172.21.15.17:0/2636345339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e8102ac0 0x7f63e819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:41.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.650+0000 7f63e7fff640 1 -- 172.21.15.17:0/2636345339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e8102ac0 msgr2=0x7f63e819d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:41.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.650+0000 7f63e7fff640 1 --2- 172.21.15.17:0/2636345339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e8102ac0 0x7f63e819d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:41.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.650+0000 7f63e7fff640 1 -- 172.21.15.17:0/2636345339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e81978e0 con 0x7f63e81033e0 2024-09-20T18:59:41.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.650+0000 7f63ecc7b640 1 --2- 172.21.15.17:0/2636345339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e8102ac0 0x7f63e819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T18:59:41.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.651+0000 7f63e7fff640 1 --2- 172.21.15.17:0/2636345339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e81033e0 0x7f63e819dc60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f63d400d6c0 tx=0x7f63d400db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:41.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.651+0000 7f63e5ffb640 1 -- 172.21.15.17:0/2636345339 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f63d4017070 con 0x7f63e81033e0 2024-09-20T18:59:41.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.651+0000 7f63e5ffb640 1 -- 172.21.15.17:0/2636345339 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f63d4009ce0 con 0x7f63e81033e0 2024-09-20T18:59:41.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.651+0000 7f63eeedf640 1 -- 172.21.15.17:0/2636345339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e8197bd0 con 0x7f63e81033e0 2024-09-20T18:59:41.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.651+0000 7f63e5ffb640 1 -- 172.21.15.17:0/2636345339 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f63d400f3c0 con 0x7f63e81033e0 2024-09-20T18:59:41.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.651+0000 7f63eeedf640 1 -- 172.21.15.17:0/2636345339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e8198160 con 0x7f63e81033e0 2024-09-20T18:59:41.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.652+0000 7f63eeedf640 1 -- 172.21.15.17:0/2636345339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e806aa90 con 0x7f63e81033e0 2024-09-20T18:59:41.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.653+0000 7f63e5ffb640 1 -- 172.21.15.17:0/2636345339 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f63d4010460 con 0x7f63e81033e0 2024-09-20T18:59:41.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.654+0000 7f63e5ffb640 1 --2- 172.21.15.17:0/2636345339 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f63d807af90 0x7f63d807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:41.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.654+0000 7f63e5ffb640 1 -- 172.21.15.17:0/2636345339 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f63d409dd00 con 0x7f63e81033e0 2024-09-20T18:59:41.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.654+0000 7f63ecc7b640 1 --2- 172.21.15.17:0/2636345339 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f63d807af90 0x7f63d807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:41.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.654+0000 7f63ecc7b640 1 --2- 172.21.15.17:0/2636345339 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f63d807af90 0x7f63d807d450 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f63dc000c00 tx=0x7f63dc031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:41.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.658+0000 7f63e5ffb640 1 -- 172.21.15.17:0/2636345339 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f63d40a1030 con 0x7f63e81033e0 2024-09-20T18:59:41.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.863+0000 7f63eeedf640 1 -- 172.21.15.17:0/2636345339 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f63e8106000 con 0x7f63d807af90 2024-09-20T18:59:41.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.864+0000 7f63e5ffb640 1 -- 172.21.15.17:0/2636345339 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f63dc004420 con 0x7f63d807af90 2024-09-20T18:59:41.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.866+0000 7f63eeedf640 1 -- 172.21.15.17:0/2636345339 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f63d807af90 msgr2=0x7f63d807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:41.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.866+0000 7f63eeedf640 1 --2- 172.21.15.17:0/2636345339 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f63d807af90 0x7f63d807d450 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f63dc000c00 tx=0x7f63dc031400 comp rx=0 tx=0).stop 2024-09-20T18:59:41.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.866+0000 7f63eeedf640 1 -- 172.21.15.17:0/2636345339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e81033e0 msgr2=0x7f63e819dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:41.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.866+0000 7f63eeedf640 1 --2- 172.21.15.17:0/2636345339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e81033e0 0x7f63e819dc60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f63d400d6c0 tx=0x7f63d400db80 comp rx=0 tx=0).stop 2024-09-20T18:59:41.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.866+0000 7f63eeedf640 1 -- 172.21.15.17:0/2636345339 shutdown_connections 2024-09-20T18:59:41.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.866+0000 7f63eeedf640 1 --2- 172.21.15.17:0/2636345339 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f63d807af90 0x7f63d807d450 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:41.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.866+0000 7f63eeedf640 1 --2- 172.21.15.17:0/2636345339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e81033e0 0x7f63e819dc60 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:41.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.866+0000 7f63eeedf640 1 --2- 172.21.15.17:0/2636345339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e8102ac0 0x7f63e819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:41.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.866+0000 7f63eeedf640 1 -- 172.21.15.17:0/2636345339 >> 172.21.15.17:0/2636345339 conn(0x7f63e80fc520 msgr2=0x7f63e8108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:41.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.867+0000 7f63eeedf640 1 -- 172.21.15.17:0/2636345339 shutdown_connections 2024-09-20T18:59:41.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.867+0000 7f63eeedf640 1 -- 172.21.15.17:0/2636345339 wait complete. 2024-09-20T18:59:41.886 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T18:59:41.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.953+0000 7fcaaf352640 1 -- 172.21.15.17:0/497427740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaa81033d0 msgr2=0x7fcaa810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:41.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.953+0000 7fcaaf352640 1 --2- 172.21.15.17:0/497427740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaa81033d0 0x7fcaa810b8c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fca98009880 tx=0x7fca9802a530 comp rx=0 tx=0).stop 2024-09-20T18:59:41.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.953+0000 7fcaaf352640 1 -- 172.21.15.17:0/497427740 shutdown_connections 2024-09-20T18:59:41.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.953+0000 7fcaaf352640 1 --2- 172.21.15.17:0/497427740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaa81033d0 0x7fcaa810b8c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:41.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.953+0000 7fcaaf352640 1 --2- 172.21.15.17:0/497427740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaa8102ab0 0x7fcaa8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:41.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.953+0000 7fcaaf352640 1 -- 172.21.15.17:0/497427740 >> 172.21.15.17:0/497427740 conn(0x7fcaa80fc550 msgr2=0x7fcaa80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:41.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.953+0000 7fcaaf352640 1 -- 172.21.15.17:0/497427740 shutdown_connections 2024-09-20T18:59:41.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.953+0000 7fcaaf352640 1 -- 172.21.15.17:0/497427740 wait complete. 2024-09-20T18:59:41.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.954+0000 7fcaaf352640 1 Processor -- start 2024-09-20T18:59:41.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.954+0000 7fcaaf352640 1 -- start start 2024-09-20T18:59:41.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.954+0000 7fcaaf352640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaa8102ab0 0x7fcaa8100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:41.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.954+0000 7fcaaf352640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaa81033d0 0x7fcaa8100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:41.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.954+0000 7fcaaf352640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa810ede0 con 0x7fcaa81033d0 2024-09-20T18:59:41.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.954+0000 7fcaaf352640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa810ec60 con 0x7fcaa8102ab0 2024-09-20T18:59:41.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.954+0000 7fcaac8ed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaa81033d0 0x7fcaa8100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:41.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.954+0000 7fcaac8ed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaa81033d0 0x7fcaa8100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60498/0 (socket says 172.21.15.17:60498) 2024-09-20T18:59:41.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.954+0000 7fcaac8ed640 1 -- 172.21.15.17:0/2270048386 learned_addr learned my addr 172.21.15.17:0/2270048386 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:59:41.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.954+0000 7fcaad0ee640 1 --2- 172.21.15.17:0/2270048386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaa8102ab0 0x7fcaa8100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:41.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.954+0000 7fcaac8ed640 1 -- 172.21.15.17:0/2270048386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaa8102ab0 msgr2=0x7fcaa8100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:41.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.954+0000 7fcaac8ed640 1 --2- 172.21.15.17:0/2270048386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaa8102ab0 0x7fcaa8100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:41.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.954+0000 7fcaac8ed640 1 -- 172.21.15.17:0/2270048386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa8101190 con 0x7fcaa81033d0 2024-09-20T18:59:41.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.955+0000 7fcaac8ed640 1 --2- 172.21.15.17:0/2270048386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaa81033d0 0x7fcaa8100c50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fca98031460 tx=0x7fca980045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:41.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.955+0000 7fca9e7fc640 1 -- 172.21.15.17:0/2270048386 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca9803f070 con 0x7fcaa81033d0 2024-09-20T18:59:41.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.955+0000 7fca9e7fc640 1 -- 172.21.15.17:0/2270048386 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca980035f0 con 0x7fcaa81033d0 2024-09-20T18:59:41.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.955+0000 7fcaaf352640 1 -- 172.21.15.17:0/2270048386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa8101420 con 0x7fcaa81033d0 2024-09-20T18:59:41.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.955+0000 7fca9e7fc640 1 -- 172.21.15.17:0/2270048386 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca98035030 con 0x7fcaa81033d0 2024-09-20T18:59:41.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.955+0000 7fcaaf352640 1 -- 172.21.15.17:0/2270048386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa81a3dd0 con 0x7fcaa81033d0 2024-09-20T18:59:41.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.956+0000 7fcaaf352640 1 -- 172.21.15.17:0/2270048386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa806a580 con 0x7fcaa81033d0 2024-09-20T18:59:41.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.957+0000 7fca9e7fc640 1 -- 172.21.15.17:0/2270048386 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fca98042070 con 0x7fcaa81033d0 2024-09-20T18:59:41.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.957+0000 7fca9e7fc640 1 --2- 172.21.15.17:0/2270048386 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fca9407af90 0x7fca9407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:41.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.957+0000 7fca9e7fc640 1 -- 172.21.15.17:0/2270048386 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fca980be860 con 0x7fcaa81033d0 2024-09-20T18:59:41.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.957+0000 7fcaad0ee640 1 --2- 172.21.15.17:0/2270048386 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fca9407af90 0x7fca9407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:41.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.958+0000 7fcaad0ee640 1 --2- 172.21.15.17:0/2270048386 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fca9407af90 0x7fca9407d450 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4009bd0 tx=0x7fcaa4005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:41.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:41.962+0000 7fca9e7fc640 1 -- 172.21.15.17:0/2270048386 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca98089ee0 con 0x7fcaa81033d0 2024-09-20T18:59:42.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.165+0000 7fcaaf352640 1 -- 172.21.15.17:0/2270048386 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcaa8062630 con 0x7fca9407af90 2024-09-20T18:59:42.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.167+0000 7fca9e7fc640 1 -- 172.21.15.17:0/2270048386 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fcaa8062630 con 0x7fca9407af90 2024-09-20T18:59:42.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.169+0000 7fcaaf352640 1 -- 172.21.15.17:0/2270048386 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fca9407af90 msgr2=0x7fca9407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:42.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.169+0000 7fcaaf352640 1 --2- 172.21.15.17:0/2270048386 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fca9407af90 0x7fca9407d450 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4009bd0 tx=0x7fcaa4005f90 comp rx=0 tx=0).stop 2024-09-20T18:59:42.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.169+0000 7fcaaf352640 1 -- 172.21.15.17:0/2270048386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaa81033d0 msgr2=0x7fcaa8100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:42.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.169+0000 7fcaaf352640 1 --2- 172.21.15.17:0/2270048386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaa81033d0 0x7fcaa8100c50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fca98031460 tx=0x7fca980045e0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.169+0000 7fcaaf352640 1 -- 172.21.15.17:0/2270048386 shutdown_connections 2024-09-20T18:59:42.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.169+0000 7fcaaf352640 1 --2- 172.21.15.17:0/2270048386 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fca9407af90 0x7fca9407d450 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.169+0000 7fcaaf352640 1 --2- 172.21.15.17:0/2270048386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaa81033d0 0x7fcaa8100c50 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.169+0000 7fcaaf352640 1 --2- 172.21.15.17:0/2270048386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaa8102ab0 0x7fcaa8100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.169+0000 7fcaaf352640 1 -- 172.21.15.17:0/2270048386 >> 172.21.15.17:0/2270048386 conn(0x7fcaa80fc550 msgr2=0x7fcaa8108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:42.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.169+0000 7fcaaf352640 1 -- 172.21.15.17:0/2270048386 shutdown_connections 2024-09-20T18:59:42.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.169+0000 7fcaaf352640 1 -- 172.21.15.17:0/2270048386 wait complete. 2024-09-20T18:59:42.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.253+0000 7f537d1cc640 1 -- 172.21.15.17:0/1031165706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5378103490 msgr2=0x7f537810b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:42.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.253+0000 7f537d1cc640 1 --2- 172.21.15.17:0/1031165706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5378103490 0x7f537810b980 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f536c009880 tx=0x7f536c02a530 comp rx=0 tx=0).stop 2024-09-20T18:59:42.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.253+0000 7f537d1cc640 1 -- 172.21.15.17:0/1031165706 shutdown_connections 2024-09-20T18:59:42.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.253+0000 7f537d1cc640 1 --2- 172.21.15.17:0/1031165706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5378103490 0x7f537810b980 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.253+0000 7f537d1cc640 1 --2- 172.21.15.17:0/1031165706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5378102b70 0x7f5378102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.254+0000 7f537d1cc640 1 -- 172.21.15.17:0/1031165706 >> 172.21.15.17:0/1031165706 conn(0x7f53780fc510 msgr2=0x7f53780fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:42.265 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:42 smithi017 ceph-mon[108970]: from='client.35154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:42.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.254+0000 7f537d1cc640 1 -- 172.21.15.17:0/1031165706 shutdown_connections 2024-09-20T18:59:42.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.254+0000 7f537d1cc640 1 -- 172.21.15.17:0/1031165706 wait complete. 2024-09-20T18:59:42.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.254+0000 7f537d1cc640 1 Processor -- start 2024-09-20T18:59:42.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.255+0000 7f537d1cc640 1 -- start start 2024-09-20T18:59:42.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.255+0000 7f537d1cc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5378102b70 0x7f537819f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.255+0000 7f537d1cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5378103490 0x7f537819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.255+0000 7f537d1cc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f537810ee00 con 0x7f5378103490 2024-09-20T18:59:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.255+0000 7f537d1cc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f537810ec80 con 0x7f5378102b70 2024-09-20T18:59:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.255+0000 7f537659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5378103490 0x7f537819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.255+0000 7f537659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5378103490 0x7f537819fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60520/0 (socket says 172.21.15.17:60520) 2024-09-20T18:59:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.255+0000 7f537659c640 1 -- 172.21.15.17:0/2115200477 learned_addr learned my addr 172.21.15.17:0/2115200477 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:59:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.255+0000 7f5376d9d640 1 --2- 172.21.15.17:0/2115200477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5378102b70 0x7f537819f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.255+0000 7f537659c640 1 -- 172.21.15.17:0/2115200477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5378102b70 msgr2=0x7f537819f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.255+0000 7f537659c640 1 --2- 172.21.15.17:0/2115200477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5378102b70 0x7f537819f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.255+0000 7f537659c640 1 -- 172.21.15.17:0/2115200477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5378199a80 con 0x7f5378103490 2024-09-20T18:59:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.256+0000 7f537659c640 1 --2- 172.21.15.17:0/2115200477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5378103490 0x7f537819fe00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f536c004f90 tx=0x7f536c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.256+0000 7f535ffff640 1 -- 172.21.15.17:0/2115200477 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f536c03f070 con 0x7f5378103490 2024-09-20T18:59:42.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.256+0000 7f535ffff640 1 -- 172.21.15.17:0/2115200477 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f536c004c70 con 0x7f5378103490 2024-09-20T18:59:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.256+0000 7f537d1cc640 1 -- 172.21.15.17:0/2115200477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5378199d10 con 0x7f5378103490 2024-09-20T18:59:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.256+0000 7f535ffff640 1 -- 172.21.15.17:0/2115200477 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f536c035030 con 0x7f5378103490 2024-09-20T18:59:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.256+0000 7f537d1cc640 1 -- 172.21.15.17:0/2115200477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f537819a240 con 0x7f5378103490 2024-09-20T18:59:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.257+0000 7f537d1cc640 1 -- 172.21.15.17:0/2115200477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f537806ad00 con 0x7f5378103490 2024-09-20T18:59:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.258+0000 7f535ffff640 1 -- 172.21.15.17:0/2115200477 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f536c042070 con 0x7f5378103490 2024-09-20T18:59:42.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.259+0000 7f535ffff640 1 --2- 172.21.15.17:0/2115200477 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f536007af30 0x7f536007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:42.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.259+0000 7f535ffff640 1 -- 172.21.15.17:0/2115200477 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f536c0bef70 con 0x7f5378103490 2024-09-20T18:59:42.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.259+0000 7f5376d9d640 1 --2- 172.21.15.17:0/2115200477 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f536007af30 0x7f536007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:42.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.259+0000 7f5376d9d640 1 --2- 172.21.15.17:0/2115200477 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f536007af30 0x7f536007d3f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f537819abc0 tx=0x7f536800b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:42.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.263+0000 7f535ffff640 1 -- 172.21.15.17:0/2115200477 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f536c08a5f0 con 0x7f5378103490 2024-09-20T18:59:42.454 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:42 smithi172 ceph-mon[80431]: from='client.35154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:42.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.460+0000 7f537d1cc640 1 -- 172.21.15.17:0/2115200477 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f537810b410 con 0x7f536007af30 2024-09-20T18:59:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.470+0000 7f535ffff640 1 -- 172.21.15.17:0/2115200477 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5368003890 con 0x7f536007af30 2024-09-20T18:59:42.480 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T18:59:42.480 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (21m) 15m ago 32m 20.0M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T18:59:42.480 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (24m) 15m ago 32m 9269k - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T18:59:42.480 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (23m) 15m ago 31m 9080k - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T18:59:42.480 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (19m) 15m ago 32m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T18:59:42.481 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (19m) 15m ago 31m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T18:59:42.481 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (20m) 15m ago 31m 78.5M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T18:59:42.481 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (15m) 15m ago 26m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T18:59:42.481 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (15m) 15m ago 26m 13.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T18:59:42.481 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (26m) 15m ago 26m 12.3M - 19.1.1-369-ged8ee0f2 6acb0a031eab 1b8a1c540e92 2024-09-20T18:59:42.481 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (15m) 15m ago 26m 13.9M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T18:59:42.481 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (23m) 15m ago 33m 528M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T18:59:42.481 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (22m) 15m ago 31m 459M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T18:59:42.481 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (19m) 15m ago 33m 48.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T18:59:42.481 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (19m) 15m ago 31m 38.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T18:59:42.481 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (21m) 15m ago 32m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T18:59:42.481 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (21m) 15m ago 31m 11.2M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T18:59:42.482 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (18m) 15m ago 30m 87.0M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T18:59:42.482 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (18m) 15m ago 29m 90.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T18:59:42.482 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (17m) 15m ago 29m 83.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T18:59:42.482 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (17m) 15m ago 28m 100M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T18:59:42.482 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (16m) 15m ago 28m 86.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T18:59:42.482 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (15m) 15m ago 27m 77.1M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T18:59:42.482 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (21m) 15m ago 31m 55.8M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T18:59:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.472+0000 7f537d1cc640 1 -- 172.21.15.17:0/2115200477 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f536007af30 msgr2=0x7f536007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.472+0000 7f537d1cc640 1 --2- 172.21.15.17:0/2115200477 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f536007af30 0x7f536007d3f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f537819abc0 tx=0x7f536800b390 comp rx=0 tx=0).stop 2024-09-20T18:59:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.472+0000 7f537d1cc640 1 -- 172.21.15.17:0/2115200477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5378103490 msgr2=0x7f537819fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.472+0000 7f537d1cc640 1 --2- 172.21.15.17:0/2115200477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5378103490 0x7f537819fe00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f536c004f90 tx=0x7f536c0048f0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.472+0000 7f537d1cc640 1 -- 172.21.15.17:0/2115200477 shutdown_connections 2024-09-20T18:59:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.472+0000 7f537d1cc640 1 --2- 172.21.15.17:0/2115200477 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f536007af30 0x7f536007d3f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.472+0000 7f537d1cc640 1 --2- 172.21.15.17:0/2115200477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5378103490 0x7f537819fe00 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.472+0000 7f537d1cc640 1 --2- 172.21.15.17:0/2115200477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5378102b70 0x7f537819f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.472+0000 7f537d1cc640 1 -- 172.21.15.17:0/2115200477 >> 172.21.15.17:0/2115200477 conn(0x7f53780fc510 msgr2=0x7f5378100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.472+0000 7f537d1cc640 1 -- 172.21.15.17:0/2115200477 shutdown_connections 2024-09-20T18:59:42.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.472+0000 7f537d1cc640 1 -- 172.21.15.17:0/2115200477 wait complete. 2024-09-20T18:59:42.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.555+0000 7f8a430a8640 1 -- 172.21.15.17:0/2704133076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a3c101900 msgr2=0x7f8a3c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:42.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.555+0000 7f8a430a8640 1 --2- 172.21.15.17:0/2704133076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a3c101900 0x7f8a3c101d60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009880 tx=0x7f8a2802a4a0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.555+0000 7f8a430a8640 1 -- 172.21.15.17:0/2704133076 shutdown_connections 2024-09-20T18:59:42.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.555+0000 7f8a430a8640 1 --2- 172.21.15.17:0/2704133076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a3c101900 0x7f8a3c101d60 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.555+0000 7f8a430a8640 1 --2- 172.21.15.17:0/2704133076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a3c107900 0x7f8a3c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.555+0000 7f8a430a8640 1 -- 172.21.15.17:0/2704133076 >> 172.21.15.17:0/2704133076 conn(0x7f8a3c0fd600 msgr2=0x7f8a3c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:42.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.555+0000 7f8a430a8640 1 -- 172.21.15.17:0/2704133076 shutdown_connections 2024-09-20T18:59:42.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.555+0000 7f8a430a8640 1 -- 172.21.15.17:0/2704133076 wait complete. 2024-09-20T18:59:42.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.556+0000 7f8a430a8640 1 Processor -- start 2024-09-20T18:59:42.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.556+0000 7f8a430a8640 1 -- start start 2024-09-20T18:59:42.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.557+0000 7f8a430a8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a3c101900 0x7f8a3c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.557+0000 7f8a430a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a3c107900 0x7f8a3c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.557+0000 7f8a430a8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c10edd0 con 0x7f8a3c107900 2024-09-20T18:59:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.557+0000 7f8a430a8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c10ec50 con 0x7f8a3c101900 2024-09-20T18:59:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.557+0000 7f8a3bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a3c107900 0x7f8a3c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.557+0000 7f8a3bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a3c107900 0x7f8a3c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60538/0 (socket says 172.21.15.17:60538) 2024-09-20T18:59:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.557+0000 7f8a3bfff640 1 -- 172.21.15.17:0/1321978778 learned_addr learned my addr 172.21.15.17:0/1321978778 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:59:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.557+0000 7f8a40e44640 1 --2- 172.21.15.17:0/1321978778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a3c101900 0x7f8a3c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.557+0000 7f8a3bfff640 1 -- 172.21.15.17:0/1321978778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a3c101900 msgr2=0x7f8a3c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.557+0000 7f8a3bfff640 1 --2- 172.21.15.17:0/1321978778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a3c101900 0x7f8a3c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.557+0000 7f8a3bfff640 1 -- 172.21.15.17:0/1321978778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3c197800 con 0x7f8a3c107900 2024-09-20T18:59:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.557+0000 7f8a3bfff640 1 --2- 172.21.15.17:0/1321978778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a3c107900 0x7f8a3c19dbc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8a28031460 tx=0x7f8a280045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:42.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.557+0000 7f8a39ffb640 1 -- 172.21.15.17:0/1321978778 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a2803f070 con 0x7f8a3c107900 2024-09-20T18:59:42.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.558+0000 7f8a430a8640 1 -- 172.21.15.17:0/1321978778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a3c197a90 con 0x7f8a3c107900 2024-09-20T18:59:42.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.558+0000 7f8a39ffb640 1 -- 172.21.15.17:0/1321978778 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a280035f0 con 0x7f8a3c107900 2024-09-20T18:59:42.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.558+0000 7f8a39ffb640 1 -- 172.21.15.17:0/1321978778 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a28035030 con 0x7f8a3c107900 2024-09-20T18:59:42.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.558+0000 7f8a430a8640 1 -- 172.21.15.17:0/1321978778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a3c197fc0 con 0x7f8a3c107900 2024-09-20T18:59:42.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.559+0000 7f8a430a8640 1 -- 172.21.15.17:0/1321978778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a3c103040 con 0x7f8a3c107900 2024-09-20T18:59:42.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.560+0000 7f8a39ffb640 1 -- 172.21.15.17:0/1321978778 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8a28042070 con 0x7f8a3c107900 2024-09-20T18:59:42.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.560+0000 7f8a39ffb640 1 --2- 172.21.15.17:0/1321978778 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8a2c07af80 0x7f8a2c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:42.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.560+0000 7f8a39ffb640 1 -- 172.21.15.17:0/1321978778 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f8a280be910 con 0x7f8a3c107900 2024-09-20T18:59:42.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.560+0000 7f8a40e44640 1 --2- 172.21.15.17:0/1321978778 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8a2c07af80 0x7f8a2c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:42.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.561+0000 7f8a40e44640 1 --2- 172.21.15.17:0/1321978778 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8a2c07af80 0x7f8a2c07d440 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8a30005fd0 tx=0x7f8a30005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:42.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.565+0000 7f8a39ffb640 1 -- 172.21.15.17:0/1321978778 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8a28089f90 con 0x7f8a3c107900 2024-09-20T18:59:42.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.835+0000 7f8a430a8640 1 -- 172.21.15.17:0/1321978778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8a3c198d30 con 0x7f8a3c107900 2024-09-20T18:59:42.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.836+0000 7f8a39ffb640 1 -- 172.21.15.17:0/1321978778 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f8a2808ee40 con 0x7f8a3c107900 2024-09-20T18:59:42.847 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:59:42.847 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T18:59:42.847 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:59:42.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:59:42.847 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T18:59:42.847 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T18:59:42.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:59:42.847 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T18:59:42.847 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T18:59:42.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:59:42.848 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T18:59:42.848 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 3 2024-09-20T18:59:42.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T18:59:42.848 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T18:59:42.848 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 13 2024-09-20T18:59:42.848 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T18:59:42.848 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:59:42.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.838+0000 7f8a430a8640 1 -- 172.21.15.17:0/1321978778 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8a2c07af80 msgr2=0x7f8a2c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:42.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.838+0000 7f8a430a8640 1 --2- 172.21.15.17:0/1321978778 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8a2c07af80 0x7f8a2c07d440 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8a30005fd0 tx=0x7f8a30005850 comp rx=0 tx=0).stop 2024-09-20T18:59:42.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.838+0000 7f8a430a8640 1 -- 172.21.15.17:0/1321978778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a3c107900 msgr2=0x7f8a3c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:42.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.838+0000 7f8a430a8640 1 --2- 172.21.15.17:0/1321978778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a3c107900 0x7f8a3c19dbc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8a28031460 tx=0x7f8a280045e0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.838+0000 7f8a430a8640 1 -- 172.21.15.17:0/1321978778 shutdown_connections 2024-09-20T18:59:42.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.838+0000 7f8a430a8640 1 --2- 172.21.15.17:0/1321978778 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8a2c07af80 0x7f8a2c07d440 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.838+0000 7f8a430a8640 1 --2- 172.21.15.17:0/1321978778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a3c107900 0x7f8a3c19dbc0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.838+0000 7f8a430a8640 1 --2- 172.21.15.17:0/1321978778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a3c101900 0x7f8a3c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.838+0000 7f8a430a8640 1 -- 172.21.15.17:0/1321978778 >> 172.21.15.17:0/1321978778 conn(0x7f8a3c0fd600 msgr2=0x7f8a3c0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:42.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.838+0000 7f8a430a8640 1 -- 172.21.15.17:0/1321978778 shutdown_connections 2024-09-20T18:59:42.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.838+0000 7f8a430a8640 1 -- 172.21.15.17:0/1321978778 wait complete. 2024-09-20T18:59:42.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.923+0000 7f3401237640 1 -- 172.21.15.17:0/1265108370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33fc1007f0 msgr2=0x7f33fc100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:42.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.923+0000 7f3401237640 1 --2- 172.21.15.17:0/1265108370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33fc1007f0 0x7f33fc100c50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009880 tx=0x7f33e402a4a0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.923+0000 7f3401237640 1 -- 172.21.15.17:0/1265108370 shutdown_connections 2024-09-20T18:59:42.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.923+0000 7f3401237640 1 --2- 172.21.15.17:0/1265108370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33fc1007f0 0x7f33fc100c50 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.923+0000 7f3401237640 1 --2- 172.21.15.17:0/1265108370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33fc1067f0 0x7f33fc106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.923+0000 7f3401237640 1 -- 172.21.15.17:0/1265108370 >> 172.21.15.17:0/1265108370 conn(0x7f33fc0fc550 msgr2=0x7f33fc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:42.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.923+0000 7f3401237640 1 -- 172.21.15.17:0/1265108370 shutdown_connections 2024-09-20T18:59:42.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.923+0000 7f3401237640 1 -- 172.21.15.17:0/1265108370 wait complete. 2024-09-20T18:59:42.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.923+0000 7f3401237640 1 Processor -- start 2024-09-20T18:59:42.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.923+0000 7f3401237640 1 -- start start 2024-09-20T18:59:42.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.924+0000 7f3401237640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33fc1007f0 0x7f33fc19f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:42.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.924+0000 7f3401237640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33fc1067f0 0x7f33fc19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:42.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.924+0000 7f3401237640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc10dca0 con 0x7f33fc1007f0 2024-09-20T18:59:42.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.924+0000 7f3401237640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc10db20 con 0x7f33fc1067f0 2024-09-20T18:59:42.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.924+0000 7f33fad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33fc1007f0 0x7f33fc19f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:42.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.924+0000 7f33fad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33fc1007f0 0x7f33fc19f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60554/0 (socket says 172.21.15.17:60554) 2024-09-20T18:59:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.924+0000 7f33fad9d640 1 -- 172.21.15.17:0/411035839 learned_addr learned my addr 172.21.15.17:0/411035839 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:59:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.924+0000 7f33f3fff640 1 --2- 172.21.15.17:0/411035839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33fc1067f0 0x7f33fc19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.924+0000 7f33fad9d640 1 -- 172.21.15.17:0/411035839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33fc1067f0 msgr2=0x7f33fc19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.924+0000 7f33fad9d640 1 --2- 172.21.15.17:0/411035839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33fc1067f0 0x7f33fc19fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.924+0000 7f33fad9d640 1 -- 172.21.15.17:0/411035839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33fc199990 con 0x7f33fc1007f0 2024-09-20T18:59:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.924+0000 7f33fad9d640 1 --2- 172.21.15.17:0/411035839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33fc1007f0 0x7f33fc19f7d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00d8d0 tx=0x7f33ec00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.925+0000 7f33f8d99640 1 -- 172.21.15.17:0/411035839 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f33ec017030 con 0x7f33fc1007f0 2024-09-20T18:59:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.925+0000 7f33f8d99640 1 -- 172.21.15.17:0/411035839 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f33ec004020 con 0x7f33fc1007f0 2024-09-20T18:59:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.925+0000 7f3401237640 1 -- 172.21.15.17:0/411035839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33fc199c80 con 0x7f33fc1007f0 2024-09-20T18:59:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.925+0000 7f33f8d99640 1 -- 172.21.15.17:0/411035839 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f33ec0047a0 con 0x7f33fc1007f0 2024-09-20T18:59:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.925+0000 7f3401237640 1 -- 172.21.15.17:0/411035839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33fc19a1e0 con 0x7f33fc1007f0 2024-09-20T18:59:42.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.926+0000 7f3401237640 1 -- 172.21.15.17:0/411035839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33fc101f30 con 0x7f33fc1007f0 2024-09-20T18:59:42.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.926+0000 7f33f8d99640 1 -- 172.21.15.17:0/411035839 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f33ec0041d0 con 0x7f33fc1007f0 2024-09-20T18:59:42.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.927+0000 7f33f8d99640 1 --2- 172.21.15.17:0/411035839 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f33e807af90 0x7f33e807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:42.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.927+0000 7f33f8d99640 1 -- 172.21.15.17:0/411035839 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f33ec018070 con 0x7f33fc1007f0 2024-09-20T18:59:42.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.927+0000 7f33f3fff640 1 --2- 172.21.15.17:0/411035839 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f33e807af90 0x7f33e807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:42.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.927+0000 7f33f3fff640 1 --2- 172.21.15.17:0/411035839 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f33e807af90 0x7f33e807d450 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f33fc19b180 tx=0x7f33e4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:42.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:42.931+0000 7f33f8d99640 1 -- 172.21.15.17:0/411035839 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f33ec069370 con 0x7f33fc1007f0 2024-09-20T18:59:43.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.159+0000 7f3401237640 1 -- 172.21.15.17:0/411035839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f33fc19a4f0 con 0x7f33fc1007f0 2024-09-20T18:59:43.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.159+0000 7f33f8d99640 1 -- 172.21.15.17:0/411035839 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+1819 (secure 0 0 0) 0x7f33ec06e220 con 0x7f33fc1007f0 2024-09-20T18:59:43.170 INFO:teuthology.orchestra.run.smithi017.stdout:e25 2024-09-20T18:59:43.170 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:40:133284+0000 2024-09-20T18:59:43.170 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T18:59:43.170 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:59:43.171 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T18:59:43.171 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:59:43.171 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T18:59:43.171 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T18:59:43.171 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T18:59:43.171 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T18:59:43.171 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T18:59:43.171 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T18:59:43.171 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T18:59:43.171 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T18:59:43.171 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T18:59:43.171 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T18:59:43.172 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T18:59:43.172 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T18:59:43.172 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T18:59:43.172 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T18:59:43.172 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T18:59:43.172 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T18:59:43.172 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T18:59:43.172 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T18:59:43.172 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T18:59:43.173 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T18:59:43.173 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T18:59:43.173 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T18:59:43.173 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T18:59:43.173 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T18:59:43.173 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T18:59:43.173 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T18:59:43.173 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T18:59:43.173 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T18:59:43.173 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T18:59:43.174 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:59:43.174 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:59:43.174 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T18:59:43.174 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T18:59:43.174 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:59:43.174 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:59:43.174 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T18:59:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 25 2024-09-20T18:59:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.161+0000 7f3401237640 1 -- 172.21.15.17:0/411035839 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f33e807af90 msgr2=0x7f33e807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.161+0000 7f3401237640 1 --2- 172.21.15.17:0/411035839 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f33e807af90 0x7f33e807d450 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f33fc19b180 tx=0x7f33e4031400 comp rx=0 tx=0).stop 2024-09-20T18:59:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.161+0000 7f3401237640 1 -- 172.21.15.17:0/411035839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33fc1007f0 msgr2=0x7f33fc19f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.161+0000 7f3401237640 1 --2- 172.21.15.17:0/411035839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33fc1007f0 0x7f33fc19f7d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00d8d0 tx=0x7f33ec00dd90 comp rx=0 tx=0).stop 2024-09-20T18:59:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.161+0000 7f3401237640 1 -- 172.21.15.17:0/411035839 shutdown_connections 2024-09-20T18:59:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.161+0000 7f3401237640 1 --2- 172.21.15.17:0/411035839 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f33e807af90 0x7f33e807d450 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.161+0000 7f3401237640 1 --2- 172.21.15.17:0/411035839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33fc1067f0 0x7f33fc19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.161+0000 7f3401237640 1 --2- 172.21.15.17:0/411035839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33fc1007f0 0x7f33fc19f7d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.161+0000 7f3401237640 1 -- 172.21.15.17:0/411035839 >> 172.21.15.17:0/411035839 conn(0x7f33fc0fc550 msgr2=0x7f33fc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.161+0000 7f3401237640 1 -- 172.21.15.17:0/411035839 shutdown_connections 2024-09-20T18:59:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.161+0000 7f3401237640 1 -- 172.21.15.17:0/411035839 wait complete. 2024-09-20T18:59:43.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.246+0000 7fece8389640 1 -- 172.21.15.17:0/1796276263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece0101900 msgr2=0x7fece0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:43.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.246+0000 7fece8389640 1 --2- 172.21.15.17:0/1796276263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece0101900 0x7fece0101d60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009880 tx=0x7fecd002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.246+0000 7fece8389640 1 -- 172.21.15.17:0/1796276263 shutdown_connections 2024-09-20T18:59:43.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.246+0000 7fece8389640 1 --2- 172.21.15.17:0/1796276263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece0101900 0x7fece0101d60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.246+0000 7fece8389640 1 --2- 172.21.15.17:0/1796276263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fece0107900 0x7fece0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.246+0000 7fece8389640 1 -- 172.21.15.17:0/1796276263 >> 172.21.15.17:0/1796276263 conn(0x7fece00fd600 msgr2=0x7fece00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:43.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.246+0000 7fece8389640 1 -- 172.21.15.17:0/1796276263 shutdown_connections 2024-09-20T18:59:43.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.246+0000 7fece8389640 1 -- 172.21.15.17:0/1796276263 wait complete. 2024-09-20T18:59:43.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.247+0000 7fece8389640 1 Processor -- start 2024-09-20T18:59:43.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.247+0000 7fece8389640 1 -- start start 2024-09-20T18:59:43.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.247+0000 7fece8389640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fece0101900 0x7fece00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:43.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.247+0000 7fece8389640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece0107900 0x7fece0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:43.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.247+0000 7fece8389640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fece010ee30 con 0x7fece0107900 2024-09-20T18:59:43.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.247+0000 7fece8389640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fece010ecb0 con 0x7fece0101900 2024-09-20T18:59:43.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.247+0000 7fece5924640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece0107900 0x7fece0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:43.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.247+0000 7fece5924640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece0107900 0x7fece0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60566/0 (socket says 172.21.15.17:60566) 2024-09-20T18:59:43.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.247+0000 7fece5924640 1 -- 172.21.15.17:0/2552476035 learned_addr learned my addr 172.21.15.17:0/2552476035 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:59:43.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.248+0000 7fece6125640 1 --2- 172.21.15.17:0/2552476035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fece0101900 0x7fece00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:43.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.248+0000 7fece5924640 1 -- 172.21.15.17:0/2552476035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fece0101900 msgr2=0x7fece00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:43.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.248+0000 7fece5924640 1 --2- 172.21.15.17:0/2552476035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fece0101900 0x7fece00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.248+0000 7fece5924640 1 -- 172.21.15.17:0/2552476035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece0074f70 con 0x7fece0107900 2024-09-20T18:59:43.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.248+0000 7fece5924640 1 --2- 172.21.15.17:0/2552476035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece0107900 0x7fece0074a30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fecd0031460 tx=0x7fecd00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:43.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.248+0000 7fecd77fe640 1 -- 172.21.15.17:0/2552476035 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fecd003f070 con 0x7fece0107900 2024-09-20T18:59:43.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.248+0000 7fecd77fe640 1 -- 172.21.15.17:0/2552476035 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fecd0004cf0 con 0x7fece0107900 2024-09-20T18:59:43.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.248+0000 7fece8389640 1 -- 172.21.15.17:0/2552476035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fece0075200 con 0x7fece0107900 2024-09-20T18:59:43.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.248+0000 7fecd77fe640 1 -- 172.21.15.17:0/2552476035 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fecd0035030 con 0x7fece0107900 2024-09-20T18:59:43.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.248+0000 7fece8389640 1 -- 172.21.15.17:0/2552476035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fece01a3e00 con 0x7fece0107900 2024-09-20T18:59:43.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.249+0000 7fece8389640 1 -- 172.21.15.17:0/2552476035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fece0103040 con 0x7fece0107900 2024-09-20T18:59:43.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.250+0000 7fecd77fe640 1 -- 172.21.15.17:0/2552476035 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fecd0042070 con 0x7fece0107900 2024-09-20T18:59:43.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.250+0000 7fecd77fe640 1 --2- 172.21.15.17:0/2552476035 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feccc07af30 0x7feccc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:43.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.250+0000 7fece6125640 1 --2- 172.21.15.17:0/2552476035 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feccc07af30 0x7feccc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:43.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.251+0000 7fecd77fe640 1 -- 172.21.15.17:0/2552476035 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fecd00beb00 con 0x7fece0107900 2024-09-20T18:59:43.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.251+0000 7fece6125640 1 --2- 172.21.15.17:0/2552476035 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feccc07af30 0x7feccc07d3f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009890 tx=0x7fecdc008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:43.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.255+0000 7fecd77fe640 1 -- 172.21.15.17:0/2552476035 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fecd008a100 con 0x7fece0107900 2024-09-20T18:59:43.313 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:43 smithi172 ceph-mon[80431]: from='client.35158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:43.313 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:43 smithi172 ceph-mon[80431]: from='client.35162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:43.313 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:43 smithi172 ceph-mon[80431]: pgmap v730: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:43.313 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:43 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1321978778' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:59:43.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.462+0000 7fece8389640 1 -- 172.21.15.17:0/2552476035 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fece0062630 con 0x7feccc07af30 2024-09-20T18:59:43.473 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:43 smithi017 ceph-mon[108970]: from='client.35158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:43.473 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:43 smithi017 ceph-mon[108970]: from='client.35162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:43.473 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:43 smithi017 ceph-mon[108970]: pgmap v730: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:43.473 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:43 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1321978778' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T18:59:43.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.464+0000 7fecd77fe640 1 -- 172.21.15.17:0/2552476035 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fece0062630 con 0x7feccc07af30 2024-09-20T18:59:43.474 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T18:59:43.474 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T18:59:43.474 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T18:59:43.474 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T18:59:43.475 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T18:59:43.475 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T18:59:43.475 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T18:59:43.475 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T18:59:43.475 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T18:59:43.475 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T18:59:43.475 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-09-20T18:59:43.475 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T18:59:43.475 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T18:59:43.475 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T18:59:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.466+0000 7fece8389640 1 -- 172.21.15.17:0/2552476035 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feccc07af30 msgr2=0x7feccc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.466+0000 7fece8389640 1 --2- 172.21.15.17:0/2552476035 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feccc07af30 0x7feccc07d3f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009890 tx=0x7fecdc008040 comp rx=0 tx=0).stop 2024-09-20T18:59:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.466+0000 7fece8389640 1 -- 172.21.15.17:0/2552476035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece0107900 msgr2=0x7fece0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.466+0000 7fece8389640 1 --2- 172.21.15.17:0/2552476035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece0107900 0x7fece0074a30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fecd0031460 tx=0x7fecd00048f0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.467+0000 7fece8389640 1 -- 172.21.15.17:0/2552476035 shutdown_connections 2024-09-20T18:59:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.467+0000 7fece8389640 1 --2- 172.21.15.17:0/2552476035 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feccc07af30 0x7feccc07d3f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.467+0000 7fece8389640 1 --2- 172.21.15.17:0/2552476035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fece0107900 0x7fece0074a30 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.467+0000 7fece8389640 1 --2- 172.21.15.17:0/2552476035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fece0101900 0x7fece00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.467+0000 7fece8389640 1 -- 172.21.15.17:0/2552476035 >> 172.21.15.17:0/2552476035 conn(0x7fece00fd600 msgr2=0x7fece00fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:43.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.467+0000 7fece8389640 1 -- 172.21.15.17:0/2552476035 shutdown_connections 2024-09-20T18:59:43.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.467+0000 7fece8389640 1 -- 172.21.15.17:0/2552476035 wait complete. 2024-09-20T18:59:43.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.551+0000 7fda1b52b640 1 -- 172.21.15.17:0/204491937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda14106800 msgr2=0x7fda14106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:43.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.551+0000 7fda1b52b640 1 --2- 172.21.15.17:0/204491937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda14106800 0x7fda14106be0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fda10009880 tx=0x7fda1002a4a0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.551+0000 7fda1b52b640 1 -- 172.21.15.17:0/204491937 shutdown_connections 2024-09-20T18:59:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.551+0000 7fda1b52b640 1 --2- 172.21.15.17:0/204491937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda14100800 0x7fda14100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.551+0000 7fda1b52b640 1 --2- 172.21.15.17:0/204491937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda14106800 0x7fda14106be0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.551+0000 7fda1b52b640 1 -- 172.21.15.17:0/204491937 >> 172.21.15.17:0/204491937 conn(0x7fda140fc520 msgr2=0x7fda140fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.551+0000 7fda1b52b640 1 -- 172.21.15.17:0/204491937 shutdown_connections 2024-09-20T18:59:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.551+0000 7fda1b52b640 1 -- 172.21.15.17:0/204491937 wait complete. 2024-09-20T18:59:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.552+0000 7fda1b52b640 1 Processor -- start 2024-09-20T18:59:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.552+0000 7fda1b52b640 1 -- start start 2024-09-20T18:59:43.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.552+0000 7fda1b52b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda14100800 0x7fda140fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.552+0000 7fda1b52b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda14106800 0x7fda140fd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.552+0000 7fda1b52b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fda1410dd30 con 0x7fda14100800 2024-09-20T18:59:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.552+0000 7fda1b52b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fda1410dbb0 con 0x7fda14106800 2024-09-20T18:59:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.552+0000 7fda192c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda14100800 0x7fda140fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.552+0000 7fda192c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda14100800 0x7fda140fcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60576/0 (socket says 172.21.15.17:60576) 2024-09-20T18:59:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.552+0000 7fda192c7640 1 -- 172.21.15.17:0/2405830764 learned_addr learned my addr 172.21.15.17:0/2405830764 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T18:59:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.553+0000 7fda18ac6640 1 --2- 172.21.15.17:0/2405830764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda14106800 0x7fda140fd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.553+0000 7fda192c7640 1 -- 172.21.15.17:0/2405830764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda14106800 msgr2=0x7fda140fd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.553+0000 7fda192c7640 1 --2- 172.21.15.17:0/2405830764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda14106800 0x7fda140fd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.553+0000 7fda192c7640 1 -- 172.21.15.17:0/2405830764 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda140fd6d0 con 0x7fda14100800 2024-09-20T18:59:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.553+0000 7fda192c7640 1 --2- 172.21.15.17:0/2405830764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda14100800 0x7fda140fcc50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fda10031460 tx=0x7fda100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.553+0000 7fda0a7fc640 1 -- 172.21.15.17:0/2405830764 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda1003f070 con 0x7fda14100800 2024-09-20T18:59:43.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.553+0000 7fda0a7fc640 1 -- 172.21.15.17:0/2405830764 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda10004cf0 con 0x7fda14100800 2024-09-20T18:59:43.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.553+0000 7fda1b52b640 1 -- 172.21.15.17:0/2405830764 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda140fd960 con 0x7fda14100800 2024-09-20T18:59:43.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.553+0000 7fda0a7fc640 1 -- 172.21.15.17:0/2405830764 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda10035030 con 0x7fda14100800 2024-09-20T18:59:43.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.553+0000 7fda1b52b640 1 -- 172.21.15.17:0/2405830764 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda141a3e40 con 0x7fda14100800 2024-09-20T18:59:43.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.555+0000 7fda1b52b640 1 -- 172.21.15.17:0/2405830764 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda14101f40 con 0x7fda14100800 2024-09-20T18:59:43.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.555+0000 7fda0a7fc640 1 -- 172.21.15.17:0/2405830764 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fda10042070 con 0x7fda14100800 2024-09-20T18:59:43.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.556+0000 7fda0a7fc640 1 --2- 172.21.15.17:0/2405830764 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda0007af80 0x7fda0007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T18:59:43.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.556+0000 7fda0a7fc640 1 -- 172.21.15.17:0/2405830764 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fda100be9e0 con 0x7fda14100800 2024-09-20T18:59:43.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.556+0000 7fda18ac6640 1 --2- 172.21.15.17:0/2405830764 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda0007af80 0x7fda0007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T18:59:43.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.556+0000 7fda18ac6640 1 --2- 172.21.15.17:0/2405830764 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda0007af80 0x7fda0007d440 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fda140fe6e0 tx=0x7fda04008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T18:59:43.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.560+0000 7fda0a7fc640 1 -- 172.21.15.17:0/2405830764 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fda1008a060 con 0x7fda14100800 2024-09-20T18:59:43.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.822+0000 7fda1b52b640 1 -- 172.21.15.17:0/2405830764 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fda14109d80 con 0x7fda14100800 2024-09-20T18:59:43.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.822+0000 7fda0a7fc640 1 -- 172.21.15.17:0/2405830764 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fda1008ef10 con 0x7fda14100800 2024-09-20T18:59:43.833 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T18:59:43.833 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T18:59:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T18:59:43.833 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T18:59:43.833 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T18:59:43.833 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T18:59:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T18:59:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T18:59:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T18:59:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T18:59:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T18:59:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T18:59:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T18:59:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T18:59:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T18:59:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T18:59:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T18:59:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T18:59:43.834 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T18:59:43.834 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T18:59:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T18:59:43.834 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T18:59:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T18:59:43.835 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T18:59:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T18:59:43.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.824+0000 7fda1b52b640 1 -- 172.21.15.17:0/2405830764 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda0007af80 msgr2=0x7fda0007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:43.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.824+0000 7fda1b52b640 1 --2- 172.21.15.17:0/2405830764 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda0007af80 0x7fda0007d440 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fda140fe6e0 tx=0x7fda04008040 comp rx=0 tx=0).stop 2024-09-20T18:59:43.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.824+0000 7fda1b52b640 1 -- 172.21.15.17:0/2405830764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda14100800 msgr2=0x7fda140fcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T18:59:43.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.824+0000 7fda1b52b640 1 --2- 172.21.15.17:0/2405830764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda14100800 0x7fda140fcc50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fda10031460 tx=0x7fda100048f0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.824+0000 7fda1b52b640 1 -- 172.21.15.17:0/2405830764 shutdown_connections 2024-09-20T18:59:43.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.824+0000 7fda1b52b640 1 --2- 172.21.15.17:0/2405830764 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda0007af80 0x7fda0007d440 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.824+0000 7fda1b52b640 1 --2- 172.21.15.17:0/2405830764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda14106800 0x7fda140fd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.824+0000 7fda1b52b640 1 --2- 172.21.15.17:0/2405830764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda14100800 0x7fda140fcc50 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T18:59:43.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.824+0000 7fda1b52b640 1 -- 172.21.15.17:0/2405830764 >> 172.21.15.17:0/2405830764 conn(0x7fda140fc520 msgr2=0x7fda1406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T18:59:43.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.825+0000 7fda1b52b640 1 -- 172.21.15.17:0/2405830764 shutdown_connections 2024-09-20T18:59:43.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T18:59:43.825+0000 7fda1b52b640 1 -- 172.21.15.17:0/2405830764 wait complete. 2024-09-20T18:59:44.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:44 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/411035839' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:59:44.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:44 smithi172 ceph-mon[80431]: from='client.35174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:44.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:44 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2405830764' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:59:44.645 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:44 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/411035839' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T18:59:44.645 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:44 smithi017 ceph-mon[108970]: from='client.35174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T18:59:44.645 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:44 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2405830764' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T18:59:45.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:45 smithi017 ceph-mon[108970]: pgmap v731: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:45.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:45.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:45.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:59:45.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:45.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:45.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:45.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:45.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:45 smithi017 ceph-mon[108970]: mds.? [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] up:boot 2024-09-20T18:59:45.896 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:45 smithi017 ceph-mon[108970]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-20T18:59:45.896 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi172.liatxm"} : dispatch 2024-09-20T18:59:45.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:45 smithi172 ceph-mon[80431]: pgmap v731: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:45.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:45.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:45.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T18:59:45.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:45.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:45.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:45.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:45.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:45 smithi172 ceph-mon[80431]: mds.? [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] up:boot 2024-09-20T18:59:45.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:45 smithi172 ceph-mon[80431]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-20T18:59:45.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "mds metadata", "who": "cephfs.smithi172.liatxm"} : dispatch 2024-09-20T18:59:48.022 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:47 smithi017 ceph-mon[108970]: pgmap v732: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:48.022 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:47 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:48.022 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:47 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:48.204 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:47 smithi172 ceph-mon[80431]: pgmap v732: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:48.204 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:47 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:48.204 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:47 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:49.574 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:49 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:49.574 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:49 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:49.574 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:49 smithi017 ceph-mon[108970]: pgmap v733: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:49.704 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:49 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:49.704 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:49 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:49.704 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:49 smithi172 ceph-mon[80431]: pgmap v733: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:51.394 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:50 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:51.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:50 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:51.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:50 smithi017 ceph-mon[108970]: pgmap v734: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:51.454 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:50 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:51.454 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:50 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T18:59:51.454 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:50 smithi172 ceph-mon[80431]: pgmap v734: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:52.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:59:52.454 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T18:59:53.454 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:53 smithi172 ceph-mon[80431]: pgmap v735: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:53.644 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:53 smithi017 ceph-mon[108970]: pgmap v735: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:55.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:55 smithi017 ceph-mon[108970]: pgmap v736: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:55.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:55 smithi172 ceph-mon[80431]: pgmap v736: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:57.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:57 smithi017 ceph-mon[108970]: pgmap v737: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:57.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:57 smithi172 ceph-mon[80431]: pgmap v737: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:59.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 18:59:59 smithi017 ceph-mon[108970]: pgmap v738: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T18:59:59.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 18:59:59 smithi172 ceph-mon[80431]: pgmap v738: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:00.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:00:00.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:00:00.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:00:00.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : /usr/bin/podman: timeout after 895 seconds 2024-09-20T19:00:00.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:00:00.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : Traceback (most recent call last): 2024-09-20T19:00:00.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:00:00.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : return _run_code(code, main_globals, None, 2024-09-20T19:00:00.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:00:00.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : exec(code, run_globals) 2024-09-20T19:00:00.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:00:00.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:00:00.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:00:00.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:00:00.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:00:00.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:00:00.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:00:00.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:00:00.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:00:00.396 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:00:00.397 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2024-09-20T19:00:00.397 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:00:00.397 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:00:00.397 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:00:00.397 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T18:59:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2024-09-20T19:00:00.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: Health detail: HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:00:00.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: [WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:00:00.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: /usr/bin/podman: timeout after 895 seconds 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: Traceback (most recent call last): 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: return _run_code(code, main_globals, None, 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: exec(code, run_globals) 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:00:00.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:00:00.956 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:00:00.956 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:00:00.956 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:00:00.956 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:00:00.956 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:00:00.956 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: fs cephfs is degraded 2024-09-20T19:00:00.956 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:00:00.956 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:00:00.956 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:00:00.956 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:00 smithi172 ceph-mon[80431]: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:00:01.145 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: Health detail: HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:00:01.145 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: [WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:00:01.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:00:01.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: /usr/bin/podman: timeout after 895 seconds 2024-09-20T19:00:01.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:00:01.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: Traceback (most recent call last): 2024-09-20T19:00:01.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:00:01.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: return _run_code(code, main_globals, None, 2024-09-20T19:00:01.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:00:01.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: exec(code, run_globals) 2024-09-20T19:00:01.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:00:01.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:00:01.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:00:01.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:00:01.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:00:01.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:00:01.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:00:01.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:00:01.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:00:01.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:00:01.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: fs cephfs is degraded 2024-09-20T19:00:01.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:00:01.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:00:01.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:00:01.148 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:00 smithi017 ceph-mon[108970]: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:00:01.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:01 smithi017 ceph-mon[108970]: pgmap v739: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:01.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:01 smithi172 ceph-mon[80431]: pgmap v739: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:03.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:03 smithi172 ceph-mon[80431]: pgmap v740: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:04.144 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:03 smithi017 ceph-mon[108970]: pgmap v740: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:05.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:05 smithi172 ceph-mon[80431]: pgmap v741: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:06.144 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:05 smithi017 ceph-mon[108970]: pgmap v741: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:07.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:07 smithi017 ceph-mon[108970]: pgmap v742: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:07.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:00:07.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:07 smithi172 ceph-mon[80431]: pgmap v742: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:07.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:00:09.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:09 smithi172 ceph-mon[80431]: pgmap v743: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:10.145 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:09 smithi017 ceph-mon[108970]: pgmap v743: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:11.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:11 smithi172 ceph-mon[80431]: pgmap v744: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:11.959 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:11 smithi017 ceph-mon[108970]: pgmap v744: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:13.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:13 smithi017 ceph-mon[108970]: pgmap v745: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:13.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.925+0000 7f8abea28640 1 -- 172.21.15.17:0/3388665685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab8100120 msgr2=0x7f8ab8100500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:13.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.925+0000 7f8abea28640 1 --2- 172.21.15.17:0/3388665685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab8100120 0x7f8ab8100500 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009880 tx=0x7f8aa802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:00:13.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.925+0000 7f8abea28640 1 -- 172.21.15.17:0/3388665685 shutdown_connections 2024-09-20T19:00:13.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.925+0000 7f8abea28640 1 --2- 172.21.15.17:0/3388665685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab8100ad0 0x7f8ab8106610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:13.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.925+0000 7f8abea28640 1 --2- 172.21.15.17:0/3388665685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab8100120 0x7f8ab8100500 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:13.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.925+0000 7f8abea28640 1 -- 172.21.15.17:0/3388665685 >> 172.21.15.17:0/3388665685 conn(0x7f8ab80fbc90 msgr2=0x7f8ab80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:13.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.925+0000 7f8abea28640 1 -- 172.21.15.17:0/3388665685 shutdown_connections 2024-09-20T19:00:13.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.925+0000 7f8abea28640 1 -- 172.21.15.17:0/3388665685 wait complete. 2024-09-20T19:00:13.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.926+0000 7f8abea28640 1 Processor -- start 2024-09-20T19:00:13.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.926+0000 7f8abea28640 1 -- start start 2024-09-20T19:00:13.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.926+0000 7f8abea28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab8100120 0x7f8ab819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:13.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.926+0000 7f8abea28640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab8100ad0 0x7f8ab819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.926+0000 7f8abea28640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab810ee60 con 0x7f8ab8100120 2024-09-20T19:00:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.926+0000 7f8abea28640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab810ece0 con 0x7f8ab8100ad0 2024-09-20T19:00:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.926+0000 7f8ab7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab8100120 0x7f8ab819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.926+0000 7f8ab7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab8100120 0x7f8ab819d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37336/0 (socket says 172.21.15.17:37336) 2024-09-20T19:00:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.926+0000 7f8ab7fff640 1 -- 172.21.15.17:0/460565097 learned_addr learned my addr 172.21.15.17:0/460565097 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:00:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.927+0000 7f8aaffff640 1 --2- 172.21.15.17:0/460565097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab8100ad0 0x7f8ab819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.927+0000 7f8ab7fff640 1 -- 172.21.15.17:0/460565097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab8100ad0 msgr2=0x7f8ab819dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.927+0000 7f8ab7fff640 1 --2- 172.21.15.17:0/460565097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab8100ad0 0x7f8ab819dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.927+0000 7f8ab7fff640 1 -- 172.21.15.17:0/460565097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab8197890 con 0x7f8ab8100120 2024-09-20T19:00:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.927+0000 7f8ab7fff640 1 --2- 172.21.15.17:0/460565097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab8100120 0x7f8ab819d6d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8031460 tx=0x7f8aa80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.927+0000 7f8ab5ffb640 1 -- 172.21.15.17:0/460565097 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8aa803f070 con 0x7f8ab8100120 2024-09-20T19:00:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.927+0000 7f8ab5ffb640 1 -- 172.21.15.17:0/460565097 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8aa80035f0 con 0x7f8ab8100120 2024-09-20T19:00:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.927+0000 7f8abea28640 1 -- 172.21.15.17:0/460565097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab8197b20 con 0x7f8ab8100120 2024-09-20T19:00:13.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.927+0000 7f8ab5ffb640 1 -- 172.21.15.17:0/460565097 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8aa8035030 con 0x7f8ab8100120 2024-09-20T19:00:13.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.927+0000 7f8abea28640 1 -- 172.21.15.17:0/460565097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab8198050 con 0x7f8ab8100120 2024-09-20T19:00:13.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.929+0000 7f8abea28640 1 -- 172.21.15.17:0/460565097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab81031e0 con 0x7f8ab8100120 2024-09-20T19:00:13.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.929+0000 7f8ab5ffb640 1 -- 172.21.15.17:0/460565097 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8aa8042070 con 0x7f8ab8100120 2024-09-20T19:00:13.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.930+0000 7f8ab5ffb640 1 --2- 172.21.15.17:0/460565097 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8aa407af30 0x7f8aa407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:13.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.930+0000 7f8ab5ffb640 1 -- 172.21.15.17:0/460565097 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f8aa80be970 con 0x7f8ab8100120 2024-09-20T19:00:13.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.930+0000 7f8aaffff640 1 --2- 172.21.15.17:0/460565097 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8aa407af30 0x7f8aa407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:13.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.930+0000 7f8aaffff640 1 --2- 172.21.15.17:0/460565097 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8aa407af30 0x7f8aa407d3f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80fe200 tx=0x7f8aa000b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:13.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:13.934+0000 7f8ab5ffb640 1 -- 172.21.15.17:0/460565097 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8aa80c0e20 con 0x7f8ab8100120 2024-09-20T19:00:13.953 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:13 smithi172 ceph-mon[80431]: pgmap v745: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.139+0000 7f8abea28640 1 -- 172.21.15.17:0/460565097 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8ab8198dc0 con 0x7f8aa407af30 2024-09-20T19:00:14.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.140+0000 7f8ab5ffb640 1 -- 172.21.15.17:0/460565097 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8ab8198dc0 con 0x7f8aa407af30 2024-09-20T19:00:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.142+0000 7f8abea28640 1 -- 172.21.15.17:0/460565097 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8aa407af30 msgr2=0x7f8aa407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.142+0000 7f8abea28640 1 --2- 172.21.15.17:0/460565097 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8aa407af30 0x7f8aa407d3f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80fe200 tx=0x7f8aa000b390 comp rx=0 tx=0).stop 2024-09-20T19:00:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.142+0000 7f8abea28640 1 -- 172.21.15.17:0/460565097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab8100120 msgr2=0x7f8ab819d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.142+0000 7f8abea28640 1 --2- 172.21.15.17:0/460565097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab8100120 0x7f8ab819d6d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8031460 tx=0x7f8aa80045e0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.142+0000 7f8abea28640 1 -- 172.21.15.17:0/460565097 shutdown_connections 2024-09-20T19:00:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.142+0000 7f8abea28640 1 --2- 172.21.15.17:0/460565097 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8aa407af30 0x7f8aa407d3f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.142+0000 7f8abea28640 1 --2- 172.21.15.17:0/460565097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab8100ad0 0x7f8ab819dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.142+0000 7f8abea28640 1 --2- 172.21.15.17:0/460565097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab8100120 0x7f8ab819d6d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.142+0000 7f8abea28640 1 -- 172.21.15.17:0/460565097 >> 172.21.15.17:0/460565097 conn(0x7f8ab80fbc90 msgr2=0x7f8ab80fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:14.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.142+0000 7f8abea28640 1 -- 172.21.15.17:0/460565097 shutdown_connections 2024-09-20T19:00:14.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.142+0000 7f8abea28640 1 -- 172.21.15.17:0/460565097 wait complete. 2024-09-20T19:00:14.160 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:00:14.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.227+0000 7fede2674640 1 -- 172.21.15.17:0/626009995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feddc102b40 msgr2=0x7feddc102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:14.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.227+0000 7fede2674640 1 --2- 172.21.15.17:0/626009995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feddc102b40 0x7feddc102f20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009880 tx=0x7fedcc02a530 comp rx=0 tx=0).stop 2024-09-20T19:00:14.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.227+0000 7fede2674640 1 -- 172.21.15.17:0/626009995 shutdown_connections 2024-09-20T19:00:14.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.227+0000 7fede2674640 1 --2- 172.21.15.17:0/626009995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feddc103460 0x7feddc10b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.227+0000 7fede2674640 1 --2- 172.21.15.17:0/626009995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feddc102b40 0x7feddc102f20 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.227+0000 7fede2674640 1 -- 172.21.15.17:0/626009995 >> 172.21.15.17:0/626009995 conn(0x7feddc0fc520 msgr2=0x7feddc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:14.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.227+0000 7fede2674640 1 -- 172.21.15.17:0/626009995 shutdown_connections 2024-09-20T19:00:14.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.227+0000 7fede2674640 1 -- 172.21.15.17:0/626009995 wait complete. 2024-09-20T19:00:14.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.228+0000 7fede2674640 1 Processor -- start 2024-09-20T19:00:14.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.228+0000 7fede2674640 1 -- start start 2024-09-20T19:00:14.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.228+0000 7fede2674640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feddc102b40 0x7feddc1007a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:14.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.228+0000 7fede2674640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feddc103460 0x7feddc100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:14.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.228+0000 7fede2674640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7feddc10ee50 con 0x7feddc102b40 2024-09-20T19:00:14.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.228+0000 7fede2674640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feddc10ecd0 con 0x7feddc103460 2024-09-20T19:00:14.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.229+0000 7feddbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feddc102b40 0x7feddc1007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:14.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.229+0000 7feddbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feddc102b40 0x7feddc1007a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37352/0 (socket says 172.21.15.17:37352) 2024-09-20T19:00:14.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.229+0000 7feddbfff640 1 -- 172.21.15.17:0/646142389 learned_addr learned my addr 172.21.15.17:0/646142389 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:00:14.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.229+0000 7feddb7fe640 1 --2- 172.21.15.17:0/646142389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feddc103460 0x7feddc100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.229+0000 7feddbfff640 1 -- 172.21.15.17:0/646142389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feddc103460 msgr2=0x7feddc100ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.229+0000 7feddbfff640 1 --2- 172.21.15.17:0/646142389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feddc103460 0x7feddc100ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.229+0000 7feddbfff640 1 -- 172.21.15.17:0/646142389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feddc101220 con 0x7feddc102b40 2024-09-20T19:00:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.229+0000 7feddb7fe640 1 --2- 172.21.15.17:0/646142389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feddc103460 0x7feddc100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:00:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.229+0000 7feddbfff640 1 --2- 172.21.15.17:0/646142389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feddc102b40 0x7feddc1007a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fedcc004f90 tx=0x7fedcc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.229+0000 7fedd97fa640 1 -- 172.21.15.17:0/646142389 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedcc03f070 con 0x7feddc102b40 2024-09-20T19:00:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.229+0000 7fede2674640 1 -- 172.21.15.17:0/646142389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feddc1014b0 con 0x7feddc102b40 2024-09-20T19:00:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.229+0000 7fedd97fa640 1 -- 172.21.15.17:0/646142389 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fedcc004cf0 con 0x7feddc102b40 2024-09-20T19:00:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.229+0000 7fedd97fa640 1 -- 172.21.15.17:0/646142389 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedcc035030 con 0x7feddc102b40 2024-09-20T19:00:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.230+0000 7fede2674640 1 -- 172.21.15.17:0/646142389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feddc1a3de0 con 0x7feddc102b40 2024-09-20T19:00:14.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.231+0000 7fede2674640 1 -- 172.21.15.17:0/646142389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feddc06aa10 con 0x7feddc102b40 2024-09-20T19:00:14.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.231+0000 7fedd97fa640 1 -- 172.21.15.17:0/646142389 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fedcc042070 con 0x7feddc102b40 2024-09-20T19:00:14.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.232+0000 7fedd97fa640 1 --2- 172.21.15.17:0/646142389 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fedc407af30 0x7fedc407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:14.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.232+0000 7fedd97fa640 1 -- 172.21.15.17:0/646142389 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fedcc0beb50 con 0x7feddc102b40 2024-09-20T19:00:14.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.232+0000 7feddb7fe640 1 --2- 172.21.15.17:0/646142389 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fedc407af30 0x7fedc407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:14.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.233+0000 7feddb7fe640 1 --2- 172.21.15.17:0/646142389 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fedc407af30 0x7fedc407d3f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fedd0006fd0 tx=0x7fedd0008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:14.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.236+0000 7fedd97fa640 1 -- 172.21.15.17:0/646142389 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fedcc08a150 con 0x7feddc102b40 2024-09-20T19:00:14.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.440+0000 7fede2674640 1 -- 172.21.15.17:0/646142389 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7feddc062630 con 0x7fedc407af30 2024-09-20T19:00:14.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.441+0000 7fedd97fa640 1 -- 172.21.15.17:0/646142389 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7feddc062630 con 0x7fedc407af30 2024-09-20T19:00:14.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.443+0000 7fede2674640 1 -- 172.21.15.17:0/646142389 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fedc407af30 msgr2=0x7fedc407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:14.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.443+0000 7fede2674640 1 --2- 172.21.15.17:0/646142389 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fedc407af30 0x7fedc407d3f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fedd0006fd0 tx=0x7fedd0008040 comp rx=0 tx=0).stop 2024-09-20T19:00:14.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.443+0000 7fede2674640 1 -- 172.21.15.17:0/646142389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feddc102b40 msgr2=0x7feddc1007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:14.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.443+0000 7fede2674640 1 --2- 172.21.15.17:0/646142389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feddc102b40 0x7feddc1007a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fedcc004f90 tx=0x7fedcc0048f0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.443+0000 7fede2674640 1 -- 172.21.15.17:0/646142389 shutdown_connections 2024-09-20T19:00:14.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.443+0000 7fede2674640 1 --2- 172.21.15.17:0/646142389 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fedc407af30 0x7fedc407d3f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.443+0000 7fede2674640 1 --2- 172.21.15.17:0/646142389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feddc103460 0x7feddc100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.443+0000 7fede2674640 1 --2- 172.21.15.17:0/646142389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feddc102b40 0x7feddc1007a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.443+0000 7fede2674640 1 -- 172.21.15.17:0/646142389 >> 172.21.15.17:0/646142389 conn(0x7feddc0fc520 msgr2=0x7feddc108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:14.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.443+0000 7fede2674640 1 -- 172.21.15.17:0/646142389 shutdown_connections 2024-09-20T19:00:14.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.443+0000 7fede2674640 1 -- 172.21.15.17:0/646142389 wait complete. 2024-09-20T19:00:14.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.527+0000 7f4c9b8e5640 1 -- 172.21.15.17:0/1520301388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c94101900 msgr2=0x7f4c94101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:14.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.527+0000 7f4c9b8e5640 1 --2- 172.21.15.17:0/1520301388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c94101900 0x7f4c94101d60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009880 tx=0x7f4c9002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.527+0000 7f4c9b8e5640 1 -- 172.21.15.17:0/1520301388 shutdown_connections 2024-09-20T19:00:14.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.527+0000 7f4c9b8e5640 1 --2- 172.21.15.17:0/1520301388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c94101900 0x7f4c94101d60 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.527+0000 7f4c9b8e5640 1 --2- 172.21.15.17:0/1520301388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c94107900 0x7f4c94107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.527+0000 7f4c9b8e5640 1 -- 172.21.15.17:0/1520301388 >> 172.21.15.17:0/1520301388 conn(0x7f4c940fd600 msgr2=0x7f4c940ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.527+0000 7f4c9b8e5640 1 -- 172.21.15.17:0/1520301388 shutdown_connections 2024-09-20T19:00:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.527+0000 7f4c9b8e5640 1 -- 172.21.15.17:0/1520301388 wait complete. 2024-09-20T19:00:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.528+0000 7f4c9b8e5640 1 Processor -- start 2024-09-20T19:00:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.528+0000 7f4c9b8e5640 1 -- start start 2024-09-20T19:00:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.528+0000 7f4c9b8e5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c94101900 0x7f4c9419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.528+0000 7f4c9b8e5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c94107900 0x7f4c9419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.528+0000 7f4c9b8e5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9410edd0 con 0x7f4c94107900 2024-09-20T19:00:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.528+0000 7f4c9b8e5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9410ec50 con 0x7f4c94101900 2024-09-20T19:00:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.528+0000 7f4c98e80640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c94107900 0x7f4c9419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:14.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.528+0000 7f4c98e80640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c94107900 0x7f4c9419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37364/0 (socket says 172.21.15.17:37364) 2024-09-20T19:00:14.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.528+0000 7f4c98e80640 1 -- 172.21.15.17:0/1244819592 learned_addr learned my addr 172.21.15.17:0/1244819592 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:00:14.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.528+0000 7f4c99681640 1 --2- 172.21.15.17:0/1244819592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c94101900 0x7f4c9419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:14.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.528+0000 7f4c98e80640 1 -- 172.21.15.17:0/1244819592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c94101900 msgr2=0x7f4c9419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:14.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.528+0000 7f4c98e80640 1 --2- 172.21.15.17:0/1244819592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c94101900 0x7f4c9419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.528+0000 7f4c98e80640 1 -- 172.21.15.17:0/1244819592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c94197800 con 0x7f4c94107900 2024-09-20T19:00:14.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.528+0000 7f4c99681640 1 --2- 172.21.15.17:0/1244819592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c94101900 0x7f4c9419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:00:14.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.529+0000 7f4c98e80640 1 --2- 172.21.15.17:0/1244819592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c94107900 0x7f4c9419dbc0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4c90031460 tx=0x7f4c900045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:14.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.529+0000 7f4c8a7fc640 1 -- 172.21.15.17:0/1244819592 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c9003f070 con 0x7f4c94107900 2024-09-20T19:00:14.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.529+0000 7f4c8a7fc640 1 -- 172.21.15.17:0/1244819592 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4c90004b10 con 0x7f4c94107900 2024-09-20T19:00:14.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.529+0000 7f4c9b8e5640 1 -- 172.21.15.17:0/1244819592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c94197a90 con 0x7f4c94107900 2024-09-20T19:00:14.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.529+0000 7f4c8a7fc640 1 -- 172.21.15.17:0/1244819592 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c90035030 con 0x7f4c94107900 2024-09-20T19:00:14.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.529+0000 7f4c9b8e5640 1 -- 172.21.15.17:0/1244819592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c94197fc0 con 0x7f4c94107900 2024-09-20T19:00:14.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.530+0000 7f4c9b8e5640 1 -- 172.21.15.17:0/1244819592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c94103040 con 0x7f4c94107900 2024-09-20T19:00:14.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.531+0000 7f4c8a7fc640 1 -- 172.21.15.17:0/1244819592 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4c90042070 con 0x7f4c94107900 2024-09-20T19:00:14.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.532+0000 7f4c8a7fc640 1 --2- 172.21.15.17:0/1244819592 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c8007af40 0x7f4c8007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:14.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.532+0000 7f4c8a7fc640 1 -- 172.21.15.17:0/1244819592 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f4c900beb50 con 0x7f4c94107900 2024-09-20T19:00:14.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.532+0000 7f4c99681640 1 --2- 172.21.15.17:0/1244819592 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c8007af40 0x7f4c8007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:14.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.532+0000 7f4c99681640 1 --2- 172.21.15.17:0/1244819592 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c8007af40 0x7f4c8007d400 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4c840058c0 tx=0x7f4c84005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:14.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.536+0000 7f4c8a7fc640 1 -- 172.21.15.17:0/1244819592 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c9008a150 con 0x7f4c94107900 2024-09-20T19:00:14.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.734+0000 7f4c9b8e5640 1 -- 172.21.15.17:0/1244819592 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4c94198270 con 0x7f4c8007af40 2024-09-20T19:00:14.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.744+0000 7f4c8a7fc640 1 -- 172.21.15.17:0/1244819592 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f4c94198270 con 0x7f4c8007af40 2024-09-20T19:00:14.753 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:00:14.753 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (21m) 24s ago 32m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:00:14.753 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (24m) 24s ago 32m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:00:14.753 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (24m) 27s ago 31m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:00:14.753 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (19m) 24s ago 32m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:00:14.753 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (19m) 27s ago 31m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:00:14.753 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (21m) 24s ago 32m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:00:14.753 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (16m) 24s ago 27m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:00:14.753 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (15m) 24s ago 27m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:00:14.753 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (30s) 27s ago 27m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:00:14.754 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (15m) 27s ago 27m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:00:14.754 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (23m) 24s ago 33m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:00:14.754 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (22m) 27s ago 31m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:00:14.754 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (20m) 24s ago 33m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:00:14.754 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (20m) 27s ago 31m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:00:14.754 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (22m) 24s ago 32m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:00:14.754 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (22m) 27s ago 31m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:00:14.754 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (19m) 24s ago 30m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:00:14.754 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (18m) 24s ago 30m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:00:14.754 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (18m) 24s ago 29m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:00:14.754 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (17m) 27s ago 29m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:00:14.754 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (17m) 27s ago 28m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:00:14.754 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (16m) 27s ago 28m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:00:14.754 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (21m) 24s ago 32m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:00:14.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.746+0000 7f4c9b8e5640 1 -- 172.21.15.17:0/1244819592 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c8007af40 msgr2=0x7f4c8007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:14.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.746+0000 7f4c9b8e5640 1 --2- 172.21.15.17:0/1244819592 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c8007af40 0x7f4c8007d400 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4c840058c0 tx=0x7f4c84005850 comp rx=0 tx=0).stop 2024-09-20T19:00:14.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.746+0000 7f4c9b8e5640 1 -- 172.21.15.17:0/1244819592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c94107900 msgr2=0x7f4c9419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:14.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.746+0000 7f4c9b8e5640 1 --2- 172.21.15.17:0/1244819592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c94107900 0x7f4c9419dbc0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4c90031460 tx=0x7f4c900045e0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.746+0000 7f4c9b8e5640 1 -- 172.21.15.17:0/1244819592 shutdown_connections 2024-09-20T19:00:14.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.746+0000 7f4c9b8e5640 1 --2- 172.21.15.17:0/1244819592 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c8007af40 0x7f4c8007d400 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.746+0000 7f4c9b8e5640 1 --2- 172.21.15.17:0/1244819592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c94107900 0x7f4c9419dbc0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.746+0000 7f4c9b8e5640 1 --2- 172.21.15.17:0/1244819592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c94101900 0x7f4c9419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.746+0000 7f4c9b8e5640 1 -- 172.21.15.17:0/1244819592 >> 172.21.15.17:0/1244819592 conn(0x7f4c940fd600 msgr2=0x7f4c940fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:14.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.746+0000 7f4c9b8e5640 1 -- 172.21.15.17:0/1244819592 shutdown_connections 2024-09-20T19:00:14.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.746+0000 7f4c9b8e5640 1 -- 172.21.15.17:0/1244819592 wait complete. 2024-09-20T19:00:14.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.829+0000 7fb7b4f8f640 1 -- 172.21.15.17:0/1752689966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7b0100800 msgr2=0x7fb7b0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:14.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.829+0000 7fb7b4f8f640 1 --2- 172.21.15.17:0/1752689966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7b0100800 0x7fb7b0100c60 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4009880 tx=0x7fb7a402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.830+0000 7fb7b4f8f640 1 -- 172.21.15.17:0/1752689966 shutdown_connections 2024-09-20T19:00:14.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.830+0000 7fb7b4f8f640 1 --2- 172.21.15.17:0/1752689966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7b0100800 0x7fb7b0100c60 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.830+0000 7fb7b4f8f640 1 --2- 172.21.15.17:0/1752689966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7b0106800 0x7fb7b0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.830+0000 7fb7b4f8f640 1 -- 172.21.15.17:0/1752689966 >> 172.21.15.17:0/1752689966 conn(0x7fb7b00fc520 msgr2=0x7fb7b00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:14.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.830+0000 7fb7b4f8f640 1 -- 172.21.15.17:0/1752689966 shutdown_connections 2024-09-20T19:00:14.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.830+0000 7fb7b4f8f640 1 -- 172.21.15.17:0/1752689966 wait complete. 2024-09-20T19:00:14.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.830+0000 7fb7b4f8f640 1 Processor -- start 2024-09-20T19:00:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.830+0000 7fb7b4f8f640 1 -- start start 2024-09-20T19:00:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.831+0000 7fb7b4f8f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7b0100800 0x7fb7b0198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.831+0000 7fb7b4f8f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7b0106800 0x7fb7b0198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.831+0000 7fb7b4f8f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b010dd30 con 0x7fb7b0106800 2024-09-20T19:00:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.831+0000 7fb7b4f8f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b010dbb0 con 0x7fb7b0100800 2024-09-20T19:00:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.831+0000 7fb7add9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7b0106800 0x7fb7b0198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.831+0000 7fb7ae59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7b0100800 0x7fb7b0198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:14.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.831+0000 7fb7ae59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7b0100800 0x7fb7b0198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:34788/0 (socket says 172.21.15.17:34788) 2024-09-20T19:00:14.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.831+0000 7fb7add9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7b0106800 0x7fb7b0198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37384/0 (socket says 172.21.15.17:37384) 2024-09-20T19:00:14.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.831+0000 7fb7ae59c640 1 -- 172.21.15.17:0/334520590 learned_addr learned my addr 172.21.15.17:0/334520590 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:00:14.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.831+0000 7fb7add9b640 1 -- 172.21.15.17:0/334520590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7b0100800 msgr2=0x7fb7b0198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:14.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.831+0000 7fb7add9b640 1 --2- 172.21.15.17:0/334520590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7b0100800 0x7fb7b0198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:14.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.831+0000 7fb7add9b640 1 -- 172.21.15.17:0/334520590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b01993c0 con 0x7fb7b0106800 2024-09-20T19:00:14.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.832+0000 7fb7add9b640 1 --2- 172.21.15.17:0/334520590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7b0106800 0x7fb7b0198dc0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb7a402a9c0 tx=0x7fb7a40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:14.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.832+0000 7fb79f7fe640 1 -- 172.21.15.17:0/334520590 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7a403f070 con 0x7fb7b0106800 2024-09-20T19:00:14.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.832+0000 7fb79f7fe640 1 -- 172.21.15.17:0/334520590 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7a40035f0 con 0x7fb7b0106800 2024-09-20T19:00:14.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.832+0000 7fb7b4f8f640 1 -- 172.21.15.17:0/334520590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b0199650 con 0x7fb7b0106800 2024-09-20T19:00:14.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.832+0000 7fb79f7fe640 1 -- 172.21.15.17:0/334520590 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7a4035030 con 0x7fb7b0106800 2024-09-20T19:00:14.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.832+0000 7fb7b4f8f640 1 -- 172.21.15.17:0/334520590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b01a1c00 con 0x7fb7b0106800 2024-09-20T19:00:14.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.833+0000 7fb7b4f8f640 1 -- 172.21.15.17:0/334520590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7b0101f40 con 0x7fb7b0106800 2024-09-20T19:00:14.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.834+0000 7fb79f7fe640 1 -- 172.21.15.17:0/334520590 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb7a4042070 con 0x7fb7b0106800 2024-09-20T19:00:14.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.834+0000 7fb79f7fe640 1 --2- 172.21.15.17:0/334520590 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb79807af90 0x7fb79807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:14.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.835+0000 7fb79f7fe640 1 -- 172.21.15.17:0/334520590 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fb7a40be9f0 con 0x7fb7b0106800 2024-09-20T19:00:14.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.835+0000 7fb7ae59c640 1 --2- 172.21.15.17:0/334520590 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb79807af90 0x7fb79807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:14.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.835+0000 7fb7ae59c640 1 --2- 172.21.15.17:0/334520590 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb79807af90 0x7fb79807d450 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009a40 tx=0x7fb7a00091c0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:14.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:14.839+0000 7fb79f7fe640 1 -- 172.21.15.17:0/334520590 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7a408a070 con 0x7fb7b0106800 2024-09-20T19:00:15.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.101+0000 7fb7b4f8f640 1 -- 172.21.15.17:0/334520590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb7b006a7a0 con 0x7fb7b0106800 2024-09-20T19:00:15.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.101+0000 7fb79f7fe640 1 -- 172.21.15.17:0/334520590 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fb7a408ef20 con 0x7fb7b0106800 2024-09-20T19:00:15.110 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:00:15.110 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:00:15.111 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:00:15.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:00:15.111 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:00:15.111 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:00:15.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:00:15.111 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:00:15.111 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:00:15.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:00:15.111 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:00:15.111 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:00:15.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:00:15.111 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:00:15.111 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:00:15.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:00:15.111 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:00:15.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.103+0000 7fb7b4f8f640 1 -- 172.21.15.17:0/334520590 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb79807af90 msgr2=0x7fb79807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:15.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.104+0000 7fb7b4f8f640 1 --2- 172.21.15.17:0/334520590 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb79807af90 0x7fb79807d450 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009a40 tx=0x7fb7a00091c0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.104+0000 7fb7b4f8f640 1 -- 172.21.15.17:0/334520590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7b0106800 msgr2=0x7fb7b0198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:15.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.104+0000 7fb7b4f8f640 1 --2- 172.21.15.17:0/334520590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7b0106800 0x7fb7b0198dc0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb7a402a9c0 tx=0x7fb7a40045e0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.104+0000 7fb7b4f8f640 1 -- 172.21.15.17:0/334520590 shutdown_connections 2024-09-20T19:00:15.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.104+0000 7fb7b4f8f640 1 --2- 172.21.15.17:0/334520590 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb79807af90 0x7fb79807d450 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.104+0000 7fb7b4f8f640 1 --2- 172.21.15.17:0/334520590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7b0106800 0x7fb7b0198dc0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.104+0000 7fb7b4f8f640 1 --2- 172.21.15.17:0/334520590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7b0100800 0x7fb7b0198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.104+0000 7fb7b4f8f640 1 -- 172.21.15.17:0/334520590 >> 172.21.15.17:0/334520590 conn(0x7fb7b00fc520 msgr2=0x7fb7b00fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:15.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.104+0000 7fb7b4f8f640 1 -- 172.21.15.17:0/334520590 shutdown_connections 2024-09-20T19:00:15.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.104+0000 7fb7b4f8f640 1 -- 172.21.15.17:0/334520590 wait complete. 2024-09-20T19:00:15.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.187+0000 7f6933cd0640 1 -- 172.21.15.17:0/2422928336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f692c101010 msgr2=0x7f692c101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:15.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.187+0000 7f6933cd0640 1 --2- 172.21.15.17:0/2422928336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f692c101010 0x7f692c101450 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6920009880 tx=0x7f692002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.187+0000 7f6933cd0640 1 -- 172.21.15.17:0/2422928336 shutdown_connections 2024-09-20T19:00:15.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.187+0000 7f6933cd0640 1 --2- 172.21.15.17:0/2422928336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f692c101010 0x7f692c101450 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.187+0000 7f6933cd0640 1 --2- 172.21.15.17:0/2422928336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f692c105860 0x7f692c105c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.188+0000 7f6933cd0640 1 -- 172.21.15.17:0/2422928336 >> 172.21.15.17:0/2422928336 conn(0x7f692c0fbc90 msgr2=0x7f692c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:15.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.188+0000 7f6933cd0640 1 -- 172.21.15.17:0/2422928336 shutdown_connections 2024-09-20T19:00:15.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.188+0000 7f6933cd0640 1 -- 172.21.15.17:0/2422928336 wait complete. 2024-09-20T19:00:15.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.188+0000 7f6933cd0640 1 Processor -- start 2024-09-20T19:00:15.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.188+0000 7f6933cd0640 1 -- start start 2024-09-20T19:00:15.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.189+0000 7f6933cd0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f692c101010 0x7f692c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:15.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.189+0000 7f6933cd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f692c105860 0x7f692c198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:15.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.189+0000 7f6933cd0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f692c10de40 con 0x7f692c105860 2024-09-20T19:00:15.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.189+0000 7f6933cd0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f692c10dcc0 con 0x7f692c101010 2024-09-20T19:00:15.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.189+0000 7f693126b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f692c105860 0x7f692c198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:15.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.189+0000 7f693126b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f692c105860 0x7f692c198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37408/0 (socket says 172.21.15.17:37408) 2024-09-20T19:00:15.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.189+0000 7f693126b640 1 -- 172.21.15.17:0/3531914585 learned_addr learned my addr 172.21.15.17:0/3531914585 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:00:15.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.189+0000 7f6931a6c640 1 --2- 172.21.15.17:0/3531914585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f692c101010 0x7f692c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:15.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.189+0000 7f693126b640 1 -- 172.21.15.17:0/3531914585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f692c101010 msgr2=0x7f692c198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:15.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.189+0000 7f693126b640 1 --2- 172.21.15.17:0/3531914585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f692c101010 0x7f692c198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.189+0000 7f693126b640 1 -- 172.21.15.17:0/3531914585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692c1994d0 con 0x7f692c105860 2024-09-20T19:00:15.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.189+0000 7f693126b640 1 --2- 172.21.15.17:0/3531914585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f692c105860 0x7f692c198ed0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6920031460 tx=0x7f69200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:15.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.189+0000 7f692affd640 1 -- 172.21.15.17:0/3531914585 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f692003f070 con 0x7f692c105860 2024-09-20T19:00:15.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.189+0000 7f6933cd0640 1 -- 172.21.15.17:0/3531914585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f692c199760 con 0x7f692c105860 2024-09-20T19:00:15.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.189+0000 7f692affd640 1 -- 172.21.15.17:0/3531914585 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f69200035f0 con 0x7f692c105860 2024-09-20T19:00:15.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.190+0000 7f692affd640 1 -- 172.21.15.17:0/3531914585 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6920035030 con 0x7f692c105860 2024-09-20T19:00:15.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.190+0000 7f6933cd0640 1 -- 172.21.15.17:0/3531914585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f692c1a1d10 con 0x7f692c105860 2024-09-20T19:00:15.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.191+0000 7f6933cd0640 1 -- 172.21.15.17:0/3531914585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f692c102020 con 0x7f692c105860 2024-09-20T19:00:15.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.191+0000 7f692affd640 1 -- 172.21.15.17:0/3531914585 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6920042070 con 0x7f692c105860 2024-09-20T19:00:15.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.192+0000 7f692affd640 1 --2- 172.21.15.17:0/3531914585 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f691407af30 0x7f691407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:15.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.192+0000 7f692affd640 1 -- 172.21.15.17:0/3531914585 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f69200be970 con 0x7f692c105860 2024-09-20T19:00:15.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.192+0000 7f6931a6c640 1 --2- 172.21.15.17:0/3531914585 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f691407af30 0x7f691407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:15.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.192+0000 7f6931a6c640 1 --2- 172.21.15.17:0/3531914585 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f691407af30 0x7f691407d3f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6924005fd0 tx=0x7f692400b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:15.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.196+0000 7f692affd640 1 -- 172.21.15.17:0/3531914585 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69200c0e20 con 0x7f692c105860 2024-09-20T19:00:15.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.424+0000 7f6933cd0640 1 -- 172.21.15.17:0/3531914585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f692c108d80 con 0x7f692c105860 2024-09-20T19:00:15.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.425+0000 7f692affd640 1 -- 172.21.15.17:0/3531914585 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7f6920089f70 con 0x7f692c105860 2024-09-20T19:00:15.434 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:00:15.434 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:00:15.434 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:00:15.434 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:00:15.434 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:00:15.434 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:00:15.434 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:00:15.435 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:00:15.435 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:00:15.435 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:00:15.435 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:00:15.435 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:00:15.435 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:00:15.435 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:00:15.435 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:00:15.435 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:00:15.435 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:00:15.435 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:00:15.436 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:00:15.436 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:00:15.436 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:00:15.436 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:00:15.436 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:00:15.436 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:00:15.436 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:00:15.437 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:00:15.437 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:00:15.437 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:00:15.437 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:00:15.437 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:00:15.437 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:00:15.437 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:00:15.437 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:00:15.437 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:00:15.437 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:00:15.437 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:00:15.437 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:00:15.437 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:00:15.438 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:00:15.438 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:00:15.438 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:00:15.438 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:00:15.438 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:00:15.438 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:00:15.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.427+0000 7f6933cd0640 1 -- 172.21.15.17:0/3531914585 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f691407af30 msgr2=0x7f691407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:15.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.427+0000 7f6933cd0640 1 --2- 172.21.15.17:0/3531914585 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f691407af30 0x7f691407d3f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6924005fd0 tx=0x7f692400b390 comp rx=0 tx=0).stop 2024-09-20T19:00:15.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.427+0000 7f6933cd0640 1 -- 172.21.15.17:0/3531914585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f692c105860 msgr2=0x7f692c198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:15.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.427+0000 7f6933cd0640 1 --2- 172.21.15.17:0/3531914585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f692c105860 0x7f692c198ed0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6920031460 tx=0x7f69200045e0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.427+0000 7f6933cd0640 1 -- 172.21.15.17:0/3531914585 shutdown_connections 2024-09-20T19:00:15.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.427+0000 7f6933cd0640 1 --2- 172.21.15.17:0/3531914585 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f691407af30 0x7f691407d3f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.427+0000 7f6933cd0640 1 --2- 172.21.15.17:0/3531914585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f692c105860 0x7f692c198ed0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.427+0000 7f6933cd0640 1 --2- 172.21.15.17:0/3531914585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f692c101010 0x7f692c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.427+0000 7f6933cd0640 1 -- 172.21.15.17:0/3531914585 >> 172.21.15.17:0/3531914585 conn(0x7f692c0fbc90 msgr2=0x7f692c0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:15.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.427+0000 7f6933cd0640 1 -- 172.21.15.17:0/3531914585 shutdown_connections 2024-09-20T19:00:15.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.427+0000 7f6933cd0640 1 -- 172.21.15.17:0/3531914585 wait complete. 2024-09-20T19:00:15.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.512+0000 7fd557820640 1 -- 172.21.15.17:0/3852819022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5501007f0 msgr2=0x7fd550100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:15.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.512+0000 7fd557820640 1 --2- 172.21.15.17:0/3852819022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5501007f0 0x7fd550100c50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd544009880 tx=0x7fd54402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.513+0000 7fd557820640 1 -- 172.21.15.17:0/3852819022 shutdown_connections 2024-09-20T19:00:15.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.513+0000 7fd557820640 1 --2- 172.21.15.17:0/3852819022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5501007f0 0x7fd550100c50 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.513+0000 7fd557820640 1 --2- 172.21.15.17:0/3852819022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5501067f0 0x7fd550106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.513+0000 7fd557820640 1 -- 172.21.15.17:0/3852819022 >> 172.21.15.17:0/3852819022 conn(0x7fd5500fc550 msgr2=0x7fd5500fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:15.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.513+0000 7fd557820640 1 -- 172.21.15.17:0/3852819022 shutdown_connections 2024-09-20T19:00:15.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.513+0000 7fd557820640 1 -- 172.21.15.17:0/3852819022 wait complete. 2024-09-20T19:00:15.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.513+0000 7fd557820640 1 Processor -- start 2024-09-20T19:00:15.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.513+0000 7fd557820640 1 -- start start 2024-09-20T19:00:15.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.514+0000 7fd557820640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5501007f0 0x7fd5500fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:15.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.514+0000 7fd557820640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5501067f0 0x7fd5500fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:15.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.514+0000 7fd557820640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd55010dca0 con 0x7fd5501067f0 2024-09-20T19:00:15.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.514+0000 7fd557820640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd55010db20 con 0x7fd5501007f0 2024-09-20T19:00:15.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.514+0000 7fd554dbb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5501067f0 0x7fd5500fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:15.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.514+0000 7fd554dbb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5501067f0 0x7fd5500fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37424/0 (socket says 172.21.15.17:37424) 2024-09-20T19:00:15.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.514+0000 7fd554dbb640 1 -- 172.21.15.17:0/2551694962 learned_addr learned my addr 172.21.15.17:0/2551694962 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:00:15.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.514+0000 7fd5555bc640 1 --2- 172.21.15.17:0/2551694962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5501007f0 0x7fd5500fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:15.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.514+0000 7fd554dbb640 1 -- 172.21.15.17:0/2551694962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5501007f0 msgr2=0x7fd5500fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:15.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.514+0000 7fd554dbb640 1 --2- 172.21.15.17:0/2551694962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5501007f0 0x7fd5500fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.514+0000 7fd554dbb640 1 -- 172.21.15.17:0/2551694962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5500fd700 con 0x7fd5501067f0 2024-09-20T19:00:15.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.514+0000 7fd554dbb640 1 --2- 172.21.15.17:0/2551694962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5501067f0 0x7fd5500fd1c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd544031460 tx=0x7fd5440045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:15.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.514+0000 7fd54e7fc640 1 -- 172.21.15.17:0/2551694962 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd54403f070 con 0x7fd5501067f0 2024-09-20T19:00:15.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.514+0000 7fd54e7fc640 1 -- 172.21.15.17:0/2551694962 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd5440035f0 con 0x7fd5501067f0 2024-09-20T19:00:15.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.514+0000 7fd557820640 1 -- 172.21.15.17:0/2551694962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5500fd990 con 0x7fd5501067f0 2024-09-20T19:00:15.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.514+0000 7fd54e7fc640 1 -- 172.21.15.17:0/2551694962 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd544035030 con 0x7fd5501067f0 2024-09-20T19:00:15.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.515+0000 7fd557820640 1 -- 172.21.15.17:0/2551694962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5501a3d40 con 0x7fd5501067f0 2024-09-20T19:00:15.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.516+0000 7fd557820640 1 -- 172.21.15.17:0/2551694962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd550101f30 con 0x7fd5501067f0 2024-09-20T19:00:15.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.516+0000 7fd54e7fc640 1 -- 172.21.15.17:0/2551694962 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd544042070 con 0x7fd5501067f0 2024-09-20T19:00:15.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.517+0000 7fd54e7fc640 1 --2- 172.21.15.17:0/2551694962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd53807af30 0x7fd53807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:15.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.517+0000 7fd54e7fc640 1 -- 172.21.15.17:0/2551694962 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fd5440bea20 con 0x7fd5501067f0 2024-09-20T19:00:15.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.517+0000 7fd5555bc640 1 --2- 172.21.15.17:0/2551694962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd53807af30 0x7fd53807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:15.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.517+0000 7fd5555bc640 1 --2- 172.21.15.17:0/2551694962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd53807af30 0x7fd53807d3f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd548005fd0 tx=0x7fd548005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:15.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.521+0000 7fd54e7fc640 1 -- 172.21.15.17:0/2551694962 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd54408a020 con 0x7fd5501067f0 2024-09-20T19:00:15.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.727+0000 7fd557820640 1 -- 172.21.15.17:0/2551694962 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd550062630 con 0x7fd53807af30 2024-09-20T19:00:15.736 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:15 smithi017 ceph-mon[108970]: from='client.35184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:15.736 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:15 smithi017 ceph-mon[108970]: from='client.35188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:15.736 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:15 smithi017 ceph-mon[108970]: pgmap v746: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:15.736 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:15 smithi017 ceph-mon[108970]: from='client.35192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:15.736 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:15 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/334520590' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:00:15.736 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:15 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3531914585' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:00:15.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.728+0000 7fd54e7fc640 1 -- 172.21.15.17:0/2551694962 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fd550062630 con 0x7fd53807af30 2024-09-20T19:00:15.737 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:00:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:00:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:00:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:00:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:00:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:00:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:00:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:00:15.737 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:00:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:00:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:00:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:00:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:00:15.738 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:00:15.738 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:00:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.731+0000 7fd557820640 1 -- 172.21.15.17:0/2551694962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd53807af30 msgr2=0x7fd53807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.731+0000 7fd557820640 1 --2- 172.21.15.17:0/2551694962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd53807af30 0x7fd53807d3f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd548005fd0 tx=0x7fd548005850 comp rx=0 tx=0).stop 2024-09-20T19:00:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.731+0000 7fd557820640 1 -- 172.21.15.17:0/2551694962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5501067f0 msgr2=0x7fd5500fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.731+0000 7fd557820640 1 --2- 172.21.15.17:0/2551694962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5501067f0 0x7fd5500fd1c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd544031460 tx=0x7fd5440045e0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.731+0000 7fd557820640 1 -- 172.21.15.17:0/2551694962 shutdown_connections 2024-09-20T19:00:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.731+0000 7fd557820640 1 --2- 172.21.15.17:0/2551694962 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd53807af30 0x7fd53807d3f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.731+0000 7fd557820640 1 --2- 172.21.15.17:0/2551694962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5501067f0 0x7fd5500fd1c0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.731+0000 7fd557820640 1 --2- 172.21.15.17:0/2551694962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5501007f0 0x7fd5500fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.731+0000 7fd557820640 1 -- 172.21.15.17:0/2551694962 >> 172.21.15.17:0/2551694962 conn(0x7fd5500fc550 msgr2=0x7fd550069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.731+0000 7fd557820640 1 -- 172.21.15.17:0/2551694962 shutdown_connections 2024-09-20T19:00:15.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.731+0000 7fd557820640 1 -- 172.21.15.17:0/2551694962 wait complete. 2024-09-20T19:00:15.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.815+0000 7f3c8e6dc640 1 -- 172.21.15.17:0/770435770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c88102ab0 msgr2=0x7f3c88102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:15.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.815+0000 7f3c8e6dc640 1 --2- 172.21.15.17:0/770435770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c88102ab0 0x7f3c88102e90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009880 tx=0x7f3c7802a530 comp rx=0 tx=0).stop 2024-09-20T19:00:15.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.815+0000 7f3c8e6dc640 1 -- 172.21.15.17:0/770435770 shutdown_connections 2024-09-20T19:00:15.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.815+0000 7f3c8e6dc640 1 --2- 172.21.15.17:0/770435770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c881033d0 0x7f3c8810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.816+0000 7f3c8e6dc640 1 --2- 172.21.15.17:0/770435770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c88102ab0 0x7f3c88102e90 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.816+0000 7f3c8e6dc640 1 -- 172.21.15.17:0/770435770 >> 172.21.15.17:0/770435770 conn(0x7f3c880fc550 msgr2=0x7f3c880fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:15.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.816+0000 7f3c8e6dc640 1 -- 172.21.15.17:0/770435770 shutdown_connections 2024-09-20T19:00:15.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.816+0000 7f3c8e6dc640 1 -- 172.21.15.17:0/770435770 wait complete. 2024-09-20T19:00:15.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.816+0000 7f3c8e6dc640 1 Processor -- start 2024-09-20T19:00:15.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.816+0000 7f3c8e6dc640 1 -- start start 2024-09-20T19:00:15.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.817+0000 7f3c8e6dc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c88102ab0 0x7f3c8819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:15.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.817+0000 7f3c8e6dc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c881033d0 0x7f3c8819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.817+0000 7f3c8e6dc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8810ede0 con 0x7f3c88102ab0 2024-09-20T19:00:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.817+0000 7f3c8e6dc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8810ec60 con 0x7f3c881033d0 2024-09-20T19:00:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.817+0000 7f3c87fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c88102ab0 0x7f3c8819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.817+0000 7f3c87fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c88102ab0 0x7f3c8819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37440/0 (socket says 172.21.15.17:37440) 2024-09-20T19:00:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.817+0000 7f3c87fff640 1 -- 172.21.15.17:0/3576366219 learned_addr learned my addr 172.21.15.17:0/3576366219 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:00:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.817+0000 7f3c877fe640 1 --2- 172.21.15.17:0/3576366219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c881033d0 0x7f3c8819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.817+0000 7f3c87fff640 1 -- 172.21.15.17:0/3576366219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c881033d0 msgr2=0x7f3c8819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.817+0000 7f3c87fff640 1 --2- 172.21.15.17:0/3576366219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c881033d0 0x7f3c8819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.817+0000 7f3c87fff640 1 -- 172.21.15.17:0/3576366219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c881977b0 con 0x7f3c88102ab0 2024-09-20T19:00:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.817+0000 7f3c87fff640 1 --2- 172.21.15.17:0/3576366219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c88102ab0 0x7f3c8819d630 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3c78031460 tx=0x7f3c780045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.818+0000 7f3c857fa640 1 -- 172.21.15.17:0/3576366219 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c7803f070 con 0x7f3c88102ab0 2024-09-20T19:00:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.818+0000 7f3c8e6dc640 1 -- 172.21.15.17:0/3576366219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c88197a40 con 0x7f3c88102ab0 2024-09-20T19:00:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.818+0000 7f3c857fa640 1 -- 172.21.15.17:0/3576366219 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c780035f0 con 0x7f3c88102ab0 2024-09-20T19:00:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.818+0000 7f3c857fa640 1 -- 172.21.15.17:0/3576366219 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c78035030 con 0x7f3c88102ab0 2024-09-20T19:00:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.818+0000 7f3c8e6dc640 1 -- 172.21.15.17:0/3576366219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c88197f70 con 0x7f3c88102ab0 2024-09-20T19:00:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.819+0000 7f3c8e6dc640 1 -- 172.21.15.17:0/3576366219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c8806a580 con 0x7f3c88102ab0 2024-09-20T19:00:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.819+0000 7f3c857fa640 1 -- 172.21.15.17:0/3576366219 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3c78042070 con 0x7f3c88102ab0 2024-09-20T19:00:15.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.820+0000 7f3c857fa640 1 --2- 172.21.15.17:0/3576366219 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c7007af30 0x7f3c7007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:15.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.820+0000 7f3c857fa640 1 -- 172.21.15.17:0/3576366219 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f3c780bea20 con 0x7f3c88102ab0 2024-09-20T19:00:15.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.820+0000 7f3c877fe640 1 --2- 172.21.15.17:0/3576366219 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c7007af30 0x7f3c7007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:15.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.821+0000 7f3c877fe640 1 --2- 172.21.15.17:0/3576366219 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c7007af30 0x7f3c7007d3f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0058c0 tx=0x7f3c7c005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:15.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:15.825+0000 7f3c857fa640 1 -- 172.21.15.17:0/3576366219 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c7808a020 con 0x7f3c88102ab0 2024-09-20T19:00:15.923 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:15 smithi172 ceph-mon[80431]: from='client.35184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:15.923 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:15 smithi172 ceph-mon[80431]: from='client.35188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:15.924 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:15 smithi172 ceph-mon[80431]: pgmap v746: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:15.924 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:15 smithi172 ceph-mon[80431]: from='client.35192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:15.924 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:15 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/334520590' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:00:15.924 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:15 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3531914585' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:00:16.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:16.086+0000 7f3c8e6dc640 1 -- 172.21.15.17:0/3576366219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f3c88198220 con 0x7f3c88102ab0 2024-09-20T19:00:16.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:16.086+0000 7f3c857fa640 1 -- 172.21.15.17:0/3576366219 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f3c7808c020 con 0x7f3c88102ab0 2024-09-20T19:00:16.095 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:00:16.095 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:00:16.095 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:00:16.095 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:00:16.095 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:00:16.096 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:00:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:00:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:00:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:00:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:00:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:00:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:00:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:00:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:00:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:00:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:00:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:00:16.096 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:00:16.096 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:00:16.097 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:00:16.097 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:00:16.097 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:00:16.097 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:00:16.097 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:00:16.097 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:00:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:16.089+0000 7f3c8e6dc640 1 -- 172.21.15.17:0/3576366219 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c7007af30 msgr2=0x7f3c7007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:16.089+0000 7f3c8e6dc640 1 --2- 172.21.15.17:0/3576366219 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c7007af30 0x7f3c7007d3f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0058c0 tx=0x7f3c7c005850 comp rx=0 tx=0).stop 2024-09-20T19:00:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:16.089+0000 7f3c8e6dc640 1 -- 172.21.15.17:0/3576366219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c88102ab0 msgr2=0x7f3c8819d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:16.089+0000 7f3c8e6dc640 1 --2- 172.21.15.17:0/3576366219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c88102ab0 0x7f3c8819d630 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3c78031460 tx=0x7f3c780045e0 comp rx=0 tx=0).stop 2024-09-20T19:00:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:16.089+0000 7f3c8e6dc640 1 -- 172.21.15.17:0/3576366219 shutdown_connections 2024-09-20T19:00:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:16.089+0000 7f3c8e6dc640 1 --2- 172.21.15.17:0/3576366219 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c7007af30 0x7f3c7007d3f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:16.089+0000 7f3c8e6dc640 1 --2- 172.21.15.17:0/3576366219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c881033d0 0x7f3c8819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:16.089+0000 7f3c8e6dc640 1 --2- 172.21.15.17:0/3576366219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c88102ab0 0x7f3c8819d630 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:16.089+0000 7f3c8e6dc640 1 -- 172.21.15.17:0/3576366219 >> 172.21.15.17:0/3576366219 conn(0x7f3c880fc550 msgr2=0x7f3c8810aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:16.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:16.089+0000 7f3c8e6dc640 1 -- 172.21.15.17:0/3576366219 shutdown_connections 2024-09-20T19:00:16.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:16.089+0000 7f3c8e6dc640 1 -- 172.21.15.17:0/3576366219 wait complete. 2024-09-20T19:00:16.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:16 smithi017 ceph-mon[108970]: from='client.35204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:16.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:16 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3576366219' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:00:16.953 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:16 smithi172 ceph-mon[80431]: from='client.35204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:16.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:16 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3576366219' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:00:17.953 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:17 smithi172 ceph-mon[80431]: pgmap v747: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:18.144 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:17 smithi017 ceph-mon[108970]: pgmap v747: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:19.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:19 smithi017 ceph-mon[108970]: pgmap v748: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:19.953 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:19 smithi172 ceph-mon[80431]: pgmap v748: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:21.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:21 smithi172 ceph-mon[80431]: pgmap v749: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:21.959 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:21 smithi017 ceph-mon[108970]: pgmap v749: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:22.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:00:22.953 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:00:23.953 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:23 smithi172 ceph-mon[80431]: pgmap v750: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:24.144 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:23 smithi017 ceph-mon[108970]: pgmap v750: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:25.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:25 smithi017 ceph-mon[108970]: pgmap v751: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:25.953 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:25 smithi172 ceph-mon[80431]: pgmap v751: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:27.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:27 smithi172 ceph-mon[80431]: pgmap v752: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:28.144 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:27 smithi017 ceph-mon[108970]: pgmap v752: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:29.953 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:29 smithi172 ceph-mon[80431]: pgmap v753: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:30.144 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:29 smithi017 ceph-mon[108970]: pgmap v753: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:31.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:31 smithi017 ceph-mon[108970]: pgmap v754: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:31.954 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:31 smithi172 ceph-mon[80431]: pgmap v754: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:33.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:33 smithi017 ceph-mon[108970]: pgmap v755: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:34.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:33 smithi172 ceph-mon[80431]: pgmap v755: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:36.144 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:35 smithi017 ceph-mon[108970]: pgmap v756: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:36.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:35 smithi172 ceph-mon[80431]: pgmap v756: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:37.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:37 smithi017 ceph-mon[108970]: pgmap v757: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:37.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:00:38.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:37 smithi172 ceph-mon[80431]: pgmap v757: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:38.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:00:40.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:39 smithi017 ceph-mon[108970]: pgmap v758: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:40.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:39 smithi172 ceph-mon[80431]: pgmap v758: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:42.144 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:41 smithi017 ceph-mon[108970]: pgmap v759: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:42.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:41 smithi172 ceph-mon[80431]: pgmap v759: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:43.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:43 smithi017 ceph-mon[108970]: pgmap v760: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:44.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:43 smithi172 ceph-mon[80431]: pgmap v760: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:46.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:45 smithi017 ceph-mon[108970]: pgmap v761: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:46.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.187+0000 7f072edb6640 1 -- 172.21.15.17:0/4127119334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728103b00 msgr2=0x7f0728103f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:46.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.187+0000 7f072edb6640 1 --2- 172.21.15.17:0/4127119334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728103b00 0x7f0728103f60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f071c009880 tx=0x7f071c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.187+0000 7f072edb6640 1 -- 172.21.15.17:0/4127119334 shutdown_connections 2024-09-20T19:00:46.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.187+0000 7f072edb6640 1 --2- 172.21.15.17:0/4127119334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728103b00 0x7f0728103f60 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.187+0000 7f072edb6640 1 --2- 172.21.15.17:0/4127119334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0728109b90 0x7f0728109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.187+0000 7f072edb6640 1 -- 172.21.15.17:0/4127119334 >> 172.21.15.17:0/4127119334 conn(0x7f07280ff840 msgr2=0x7f0728101c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:46.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.187+0000 7f072edb6640 1 -- 172.21.15.17:0/4127119334 shutdown_connections 2024-09-20T19:00:46.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.187+0000 7f072edb6640 1 -- 172.21.15.17:0/4127119334 wait complete. 2024-09-20T19:00:46.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.188+0000 7f072edb6640 1 Processor -- start 2024-09-20T19:00:46.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.188+0000 7f072edb6640 1 -- start start 2024-09-20T19:00:46.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.188+0000 7f072edb6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728103b00 0x7f072819f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:46.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.188+0000 7f072edb6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0728109b90 0x7f072819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:46.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.188+0000 7f072edb6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0728110fd0 con 0x7f0728103b00 2024-09-20T19:00:46.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.188+0000 7f072edb6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0728110e50 con 0x7f0728109b90 2024-09-20T19:00:46.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.188+0000 7f072cb52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728103b00 0x7f072819f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:46.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.188+0000 7f072cb52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728103b00 0x7f072819f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36718/0 (socket says 172.21.15.17:36718) 2024-09-20T19:00:46.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.188+0000 7f072cb52640 1 -- 172.21.15.17:0/1750593656 learned_addr learned my addr 172.21.15.17:0/1750593656 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:00:46.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.189+0000 7f0727fff640 1 --2- 172.21.15.17:0/1750593656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0728109b90 0x7f072819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.189+0000 7f072cb52640 1 -- 172.21.15.17:0/1750593656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0728109b90 msgr2=0x7f072819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.189+0000 7f072cb52640 1 --2- 172.21.15.17:0/1750593656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0728109b90 0x7f072819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.189+0000 7f072cb52640 1 -- 172.21.15.17:0/1750593656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0728199a20 con 0x7f0728103b00 2024-09-20T19:00:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.189+0000 7f072cb52640 1 --2- 172.21.15.17:0/1750593656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728103b00 0x7f072819f860 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f071800d6f0 tx=0x7f071800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.189+0000 7f0725ffb640 1 -- 172.21.15.17:0/1750593656 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0718017070 con 0x7f0728103b00 2024-09-20T19:00:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.189+0000 7f072edb6640 1 -- 172.21.15.17:0/1750593656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0728199d10 con 0x7f0728103b00 2024-09-20T19:00:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.189+0000 7f0725ffb640 1 -- 172.21.15.17:0/1750593656 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f071800de00 con 0x7f0728103b00 2024-09-20T19:00:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.189+0000 7f0725ffb640 1 -- 172.21.15.17:0/1750593656 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0718004bb0 con 0x7f0728103b00 2024-09-20T19:00:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.190+0000 7f072edb6640 1 -- 172.21.15.17:0/1750593656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f072819a270 con 0x7f0728103b00 2024-09-20T19:00:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.191+0000 7f072edb6640 1 -- 172.21.15.17:0/1750593656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0728105200 con 0x7f0728103b00 2024-09-20T19:00:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.191+0000 7f0725ffb640 1 -- 172.21.15.17:0/1750593656 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0718004e60 con 0x7f0728103b00 2024-09-20T19:00:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.192+0000 7f0725ffb640 1 --2- 172.21.15.17:0/1750593656 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f071007af30 0x7f071007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.192+0000 7f0725ffb640 1 -- 172.21.15.17:0/1750593656 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f071809dba0 con 0x7f0728103b00 2024-09-20T19:00:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.192+0000 7f0727fff640 1 --2- 172.21.15.17:0/1750593656 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f071007af30 0x7f071007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.192+0000 7f0727fff640 1 --2- 172.21.15.17:0/1750593656 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f071007af30 0x7f071007d3f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f072819b210 tx=0x7f071c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:46.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:45 smithi172 ceph-mon[80431]: pgmap v761: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:46.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.196+0000 7f0725ffb640 1 -- 172.21.15.17:0/1750593656 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f07180691a0 con 0x7f0728103b00 2024-09-20T19:00:46.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.405+0000 7f072edb6640 1 -- 172.21.15.17:0/1750593656 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f072819af50 con 0x7f071007af30 2024-09-20T19:00:46.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.406+0000 7f0725ffb640 1 -- 172.21.15.17:0/1750593656 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f072819af50 con 0x7f071007af30 2024-09-20T19:00:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.409+0000 7f072edb6640 1 -- 172.21.15.17:0/1750593656 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f071007af30 msgr2=0x7f071007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.409+0000 7f072edb6640 1 --2- 172.21.15.17:0/1750593656 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f071007af30 0x7f071007d3f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f072819b210 tx=0x7f071c031400 comp rx=0 tx=0).stop 2024-09-20T19:00:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.409+0000 7f072edb6640 1 -- 172.21.15.17:0/1750593656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728103b00 msgr2=0x7f072819f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.409+0000 7f072edb6640 1 --2- 172.21.15.17:0/1750593656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728103b00 0x7f072819f860 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f071800d6f0 tx=0x7f071800dbb0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.409+0000 7f072edb6640 1 -- 172.21.15.17:0/1750593656 shutdown_connections 2024-09-20T19:00:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.409+0000 7f072edb6640 1 --2- 172.21.15.17:0/1750593656 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f071007af30 0x7f071007d3f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.409+0000 7f072edb6640 1 --2- 172.21.15.17:0/1750593656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0728109b90 0x7f072819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.409+0000 7f072edb6640 1 --2- 172.21.15.17:0/1750593656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0728103b00 0x7f072819f860 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.409+0000 7f072edb6640 1 -- 172.21.15.17:0/1750593656 >> 172.21.15.17:0/1750593656 conn(0x7f07280ff840 msgr2=0x7f0728100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.409+0000 7f072edb6640 1 -- 172.21.15.17:0/1750593656 shutdown_connections 2024-09-20T19:00:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.409+0000 7f072edb6640 1 -- 172.21.15.17:0/1750593656 wait complete. 2024-09-20T19:00:46.426 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:00:46.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.495+0000 7fbb75664640 1 -- 172.21.15.17:0/954411416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb70102ac0 msgr2=0x7fbb70102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:46.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.495+0000 7fbb75664640 1 --2- 172.21.15.17:0/954411416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb70102ac0 0x7fbb70102ea0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009c20 tx=0x7fbb6002aa00 comp rx=0 tx=0).stop 2024-09-20T19:00:46.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.495+0000 7fbb75664640 1 -- 172.21.15.17:0/954411416 shutdown_connections 2024-09-20T19:00:46.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.495+0000 7fbb75664640 1 --2- 172.21.15.17:0/954411416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb701033e0 0x7fbb7010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.495+0000 7fbb75664640 1 --2- 172.21.15.17:0/954411416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb70102ac0 0x7fbb70102ea0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.495+0000 7fbb75664640 1 -- 172.21.15.17:0/954411416 >> 172.21.15.17:0/954411416 conn(0x7fbb700fc520 msgr2=0x7fbb700fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:46.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.495+0000 7fbb75664640 1 -- 172.21.15.17:0/954411416 shutdown_connections 2024-09-20T19:00:46.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.495+0000 7fbb75664640 1 -- 172.21.15.17:0/954411416 wait complete. 2024-09-20T19:00:46.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.496+0000 7fbb75664640 1 Processor -- start 2024-09-20T19:00:46.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.496+0000 7fbb75664640 1 -- start start 2024-09-20T19:00:46.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.496+0000 7fbb75664640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb70102ac0 0x7fbb7019f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:46.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.496+0000 7fbb75664640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb701033e0 0x7fbb7019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:46.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.496+0000 7fbb75664640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7010edd0 con 0x7fbb70102ac0 2024-09-20T19:00:46.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.496+0000 7fbb75664640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7010ec50 con 0x7fbb701033e0 2024-09-20T19:00:46.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.496+0000 7fbb6effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb70102ac0 0x7fbb7019f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:46.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.496+0000 7fbb6effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb70102ac0 0x7fbb7019f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36734/0 (socket says 172.21.15.17:36734) 2024-09-20T19:00:46.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.496+0000 7fbb6effd640 1 -- 172.21.15.17:0/1964568262 learned_addr learned my addr 172.21.15.17:0/1964568262 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:00:46.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.497+0000 7fbb6e7fc640 1 --2- 172.21.15.17:0/1964568262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb701033e0 0x7fbb7019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:46.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.497+0000 7fbb6effd640 1 -- 172.21.15.17:0/1964568262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb701033e0 msgr2=0x7fbb7019fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:46.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.497+0000 7fbb6effd640 1 --2- 172.21.15.17:0/1964568262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb701033e0 0x7fbb7019fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.497+0000 7fbb6effd640 1 -- 172.21.15.17:0/1964568262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb70199a80 con 0x7fbb70102ac0 2024-09-20T19:00:46.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.497+0000 7fbb6effd640 1 --2- 172.21.15.17:0/1964568262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb70102ac0 0x7fbb7019f820 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fbb60005cc0 tx=0x7fbb6002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:46.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.497+0000 7fbb67fff640 1 -- 172.21.15.17:0/1964568262 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb60047070 con 0x7fbb70102ac0 2024-09-20T19:00:46.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.497+0000 7fbb75664640 1 -- 172.21.15.17:0/1964568262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb70199cb0 con 0x7fbb70102ac0 2024-09-20T19:00:46.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.497+0000 7fbb67fff640 1 -- 172.21.15.17:0/1964568262 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb60003e30 con 0x7fbb70102ac0 2024-09-20T19:00:46.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.497+0000 7fbb67fff640 1 -- 172.21.15.17:0/1964568262 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb60033050 con 0x7fbb70102ac0 2024-09-20T19:00:46.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.497+0000 7fbb75664640 1 -- 172.21.15.17:0/1964568262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb7019a1e0 con 0x7fbb70102ac0 2024-09-20T19:00:46.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.499+0000 7fbb75664640 1 -- 172.21.15.17:0/1964568262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb7006aa90 con 0x7fbb70102ac0 2024-09-20T19:00:46.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.499+0000 7fbb67fff640 1 -- 172.21.15.17:0/1964568262 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fbb6004a070 con 0x7fbb70102ac0 2024-09-20T19:00:46.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.500+0000 7fbb67fff640 1 --2- 172.21.15.17:0/1964568262 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbb5c07af90 0x7fbb5c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:46.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.500+0000 7fbb67fff640 1 -- 172.21.15.17:0/1964568262 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fbb6003e030 con 0x7fbb70102ac0 2024-09-20T19:00:46.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.500+0000 7fbb6e7fc640 1 --2- 172.21.15.17:0/1964568262 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbb5c07af90 0x7fbb5c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:46.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.500+0000 7fbb6e7fc640 1 --2- 172.21.15.17:0/1964568262 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbb5c07af90 0x7fbb5c07d450 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbb700fecc0 tx=0x7fbb58005f70 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:46.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.504+0000 7fbb67fff640 1 -- 172.21.15.17:0/1964568262 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbb6008a740 con 0x7fbb70102ac0 2024-09-20T19:00:46.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.708+0000 7fbb75664640 1 -- 172.21.15.17:0/1964568262 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbb7019af10 con 0x7fbb5c07af90 2024-09-20T19:00:46.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.710+0000 7fbb67fff640 1 -- 172.21.15.17:0/1964568262 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fbb7019af10 con 0x7fbb5c07af90 2024-09-20T19:00:46.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.712+0000 7fbb75664640 1 -- 172.21.15.17:0/1964568262 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbb5c07af90 msgr2=0x7fbb5c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:46.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.712+0000 7fbb75664640 1 --2- 172.21.15.17:0/1964568262 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbb5c07af90 0x7fbb5c07d450 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbb700fecc0 tx=0x7fbb58005f70 comp rx=0 tx=0).stop 2024-09-20T19:00:46.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.712+0000 7fbb75664640 1 -- 172.21.15.17:0/1964568262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb70102ac0 msgr2=0x7fbb7019f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:46.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.712+0000 7fbb75664640 1 --2- 172.21.15.17:0/1964568262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb70102ac0 0x7fbb7019f820 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fbb60005cc0 tx=0x7fbb6002ee60 comp rx=0 tx=0).stop 2024-09-20T19:00:46.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.712+0000 7fbb75664640 1 -- 172.21.15.17:0/1964568262 shutdown_connections 2024-09-20T19:00:46.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.712+0000 7fbb75664640 1 --2- 172.21.15.17:0/1964568262 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbb5c07af90 0x7fbb5c07d450 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.712+0000 7fbb75664640 1 --2- 172.21.15.17:0/1964568262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb701033e0 0x7fbb7019fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.712+0000 7fbb75664640 1 --2- 172.21.15.17:0/1964568262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb70102ac0 0x7fbb7019f820 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.712+0000 7fbb75664640 1 -- 172.21.15.17:0/1964568262 >> 172.21.15.17:0/1964568262 conn(0x7fbb700fc520 msgr2=0x7fbb70100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:46.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.712+0000 7fbb75664640 1 -- 172.21.15.17:0/1964568262 shutdown_connections 2024-09-20T19:00:46.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.712+0000 7fbb75664640 1 -- 172.21.15.17:0/1964568262 wait complete. 2024-09-20T19:00:46.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.797+0000 7fcdbc65d640 1 -- 172.21.15.17:0/3318775126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdb4101910 msgr2=0x7fcdb4101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:46.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.797+0000 7fcdbc65d640 1 --2- 172.21.15.17:0/3318775126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdb4101910 0x7fcdb4101d70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fcda4009880 tx=0x7fcda402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.797+0000 7fcdbc65d640 1 -- 172.21.15.17:0/3318775126 shutdown_connections 2024-09-20T19:00:46.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.797+0000 7fcdbc65d640 1 --2- 172.21.15.17:0/3318775126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdb4101910 0x7fcdb4101d70 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.797+0000 7fcdbc65d640 1 --2- 172.21.15.17:0/3318775126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb4107910 0x7fcdb4107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.797+0000 7fcdbc65d640 1 -- 172.21.15.17:0/3318775126 >> 172.21.15.17:0/3318775126 conn(0x7fcdb40fd630 msgr2=0x7fcdb40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:46.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.797+0000 7fcdbc65d640 1 -- 172.21.15.17:0/3318775126 shutdown_connections 2024-09-20T19:00:46.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.797+0000 7fcdbc65d640 1 -- 172.21.15.17:0/3318775126 wait complete. 2024-09-20T19:00:46.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.797+0000 7fcdbc65d640 1 Processor -- start 2024-09-20T19:00:46.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.797+0000 7fcdbc65d640 1 -- start start 2024-09-20T19:00:46.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.798+0000 7fcdbc65d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdb4101910 0x7fcdb419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:46.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.798+0000 7fcdbc65d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb4107910 0x7fcdb419db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:46.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.798+0000 7fcdbc65d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb410ede0 con 0x7fcdb4101910 2024-09-20T19:00:46.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.798+0000 7fcdbc65d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb410ec60 con 0x7fcdb4107910 2024-09-20T19:00:46.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.798+0000 7fcdba3f9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdb4101910 0x7fcdb419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:46.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.798+0000 7fcdba3f9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdb4101910 0x7fcdb419d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36746/0 (socket says 172.21.15.17:36746) 2024-09-20T19:00:46.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.798+0000 7fcdba3f9640 1 -- 172.21.15.17:0/2233409126 learned_addr learned my addr 172.21.15.17:0/2233409126 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:00:46.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.798+0000 7fcdb9bf8640 1 --2- 172.21.15.17:0/2233409126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb4107910 0x7fcdb419db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:46.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.798+0000 7fcdba3f9640 1 -- 172.21.15.17:0/2233409126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb4107910 msgr2=0x7fcdb419db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:46.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.798+0000 7fcdba3f9640 1 --2- 172.21.15.17:0/2233409126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb4107910 0x7fcdb419db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:46.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.798+0000 7fcdba3f9640 1 -- 172.21.15.17:0/2233409126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb4197780 con 0x7fcdb4101910 2024-09-20T19:00:46.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.798+0000 7fcdba3f9640 1 --2- 172.21.15.17:0/2233409126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdb4101910 0x7fcdb419d600 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000d6f0 tx=0x7fcdb000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:46.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.799+0000 7fcdab7fe640 1 -- 172.21.15.17:0/2233409126 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcdb0017070 con 0x7fcdb4101910 2024-09-20T19:00:46.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.799+0000 7fcdbc65d640 1 -- 172.21.15.17:0/2233409126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb4197a70 con 0x7fcdb4101910 2024-09-20T19:00:46.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.799+0000 7fcdab7fe640 1 -- 172.21.15.17:0/2233409126 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcdb000de00 con 0x7fcdb4101910 2024-09-20T19:00:46.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.799+0000 7fcdab7fe640 1 -- 172.21.15.17:0/2233409126 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcdb0004bb0 con 0x7fcdb4101910 2024-09-20T19:00:46.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.799+0000 7fcdbc65d640 1 -- 172.21.15.17:0/2233409126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb4197fd0 con 0x7fcdb4101910 2024-09-20T19:00:46.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.800+0000 7fcdbc65d640 1 -- 172.21.15.17:0/2233409126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd98005290 con 0x7fcdb4101910 2024-09-20T19:00:46.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.800+0000 7fcdab7fe640 1 -- 172.21.15.17:0/2233409126 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fcdb0009a30 con 0x7fcdb4101910 2024-09-20T19:00:46.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.801+0000 7fcdab7fe640 1 --2- 172.21.15.17:0/2233409126 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcda007af30 0x7fcda007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:46.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.801+0000 7fcdb9bf8640 1 --2- 172.21.15.17:0/2233409126 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcda007af30 0x7fcda007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:46.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.801+0000 7fcdab7fe640 1 -- 172.21.15.17:0/2233409126 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fcdb009db40 con 0x7fcdb4101910 2024-09-20T19:00:46.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.802+0000 7fcdb9bf8640 1 --2- 172.21.15.17:0/2233409126 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcda007af30 0x7fcda007d3f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4198ad0 tx=0x7fcda4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:46.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:46.806+0000 7fcdab7fe640 1 -- 172.21.15.17:0/2233409126 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcdb0069140 con 0x7fcdb4101910 2024-09-20T19:00:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.003+0000 7fcdbc65d640 1 -- 172.21.15.17:0/2233409126 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fcd98000bc0 con 0x7fcda007af30 2024-09-20T19:00:47.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.013+0000 7fcdab7fe640 1 -- 172.21.15.17:0/2233409126 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fcd98000bc0 con 0x7fcda007af30 2024-09-20T19:00:47.021 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:00:47.022 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (22m) 57s ago 33m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:00:47.022 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (25m) 57s ago 33m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:00:47.022 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (24m) 59s ago 32m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:00:47.022 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (20m) 57s ago 33m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:00:47.022 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (20m) 59s ago 32m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:00:47.022 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (21m) 57s ago 32m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:00:47.022 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (16m) 57s ago 27m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:00:47.022 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (16m) 57s ago 27m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:00:47.022 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (62s) 59s ago 27m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:00:47.022 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (16m) 59s ago 27m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:00:47.022 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (24m) 57s ago 34m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:00:47.022 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (23m) 59s ago 32m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:00:47.023 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (20m) 57s ago 34m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:00:47.023 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (20m) 59s ago 32m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:00:47.023 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (22m) 57s ago 33m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:00:47.023 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (22m) 59s ago 32m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:00:47.023 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (20m) 57s ago 31m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:00:47.023 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (19m) 57s ago 30m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:00:47.023 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (18m) 57s ago 30m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:00:47.023 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (18m) 59s ago 29m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:00:47.023 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (17m) 59s ago 29m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:00:47.023 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (17m) 59s ago 28m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:00:47.023 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (22m) 57s ago 32m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:00:47.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.015+0000 7fcdbc65d640 1 -- 172.21.15.17:0/2233409126 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcda007af30 msgr2=0x7fcda007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:47.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.015+0000 7fcdbc65d640 1 --2- 172.21.15.17:0/2233409126 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcda007af30 0x7fcda007d3f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4198ad0 tx=0x7fcda4031400 comp rx=0 tx=0).stop 2024-09-20T19:00:47.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.015+0000 7fcdbc65d640 1 -- 172.21.15.17:0/2233409126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdb4101910 msgr2=0x7fcdb419d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:47.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.015+0000 7fcdbc65d640 1 --2- 172.21.15.17:0/2233409126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdb4101910 0x7fcdb419d600 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000d6f0 tx=0x7fcdb000dbb0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.015+0000 7fcdbc65d640 1 -- 172.21.15.17:0/2233409126 shutdown_connections 2024-09-20T19:00:47.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.016+0000 7fcdbc65d640 1 --2- 172.21.15.17:0/2233409126 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcda007af30 0x7fcda007d3f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.016+0000 7fcdbc65d640 1 --2- 172.21.15.17:0/2233409126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb4107910 0x7fcdb419db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.016+0000 7fcdbc65d640 1 --2- 172.21.15.17:0/2233409126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdb4101910 0x7fcdb419d600 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.016+0000 7fcdbc65d640 1 -- 172.21.15.17:0/2233409126 >> 172.21.15.17:0/2233409126 conn(0x7fcdb40fd630 msgr2=0x7fcdb40fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:47.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.016+0000 7fcdbc65d640 1 -- 172.21.15.17:0/2233409126 shutdown_connections 2024-09-20T19:00:47.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.016+0000 7fcdbc65d640 1 -- 172.21.15.17:0/2233409126 wait complete. 2024-09-20T19:00:47.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.099+0000 7efe80896640 1 -- 172.21.15.17:0/3101452972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe7c107900 msgr2=0x7efe7c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:47.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.099+0000 7efe80896640 1 --2- 172.21.15.17:0/3101452972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe7c107900 0x7efe7c107ce0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009880 tx=0x7efe6c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.099+0000 7efe80896640 1 -- 172.21.15.17:0/3101452972 shutdown_connections 2024-09-20T19:00:47.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.099+0000 7efe80896640 1 --2- 172.21.15.17:0/3101452972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe7c101900 0x7efe7c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.099+0000 7efe80896640 1 --2- 172.21.15.17:0/3101452972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe7c107900 0x7efe7c107ce0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.099+0000 7efe80896640 1 -- 172.21.15.17:0/3101452972 >> 172.21.15.17:0/3101452972 conn(0x7efe7c0fd600 msgr2=0x7efe7c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:47.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.099+0000 7efe80896640 1 -- 172.21.15.17:0/3101452972 shutdown_connections 2024-09-20T19:00:47.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.099+0000 7efe80896640 1 -- 172.21.15.17:0/3101452972 wait complete. 2024-09-20T19:00:47.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.100+0000 7efe80896640 1 Processor -- start 2024-09-20T19:00:47.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.100+0000 7efe80896640 1 -- start start 2024-09-20T19:00:47.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.100+0000 7efe80896640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe7c101900 0x7efe7c19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:47.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.101+0000 7efe80896640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe7c107900 0x7efe7c19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:47.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.101+0000 7efe80896640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efe7c10edd0 con 0x7efe7c107900 2024-09-20T19:00:47.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.101+0000 7efe80896640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efe7c10ec50 con 0x7efe7c101900 2024-09-20T19:00:47.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.101+0000 7efe79d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe7c107900 0x7efe7c19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:47.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.101+0000 7efe79d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe7c107900 0x7efe7c19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36758/0 (socket says 172.21.15.17:36758) 2024-09-20T19:00:47.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.101+0000 7efe79d9b640 1 -- 172.21.15.17:0/4110256652 learned_addr learned my addr 172.21.15.17:0/4110256652 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:00:47.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.101+0000 7efe7a59c640 1 --2- 172.21.15.17:0/4110256652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe7c101900 0x7efe7c19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:47.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.101+0000 7efe79d9b640 1 -- 172.21.15.17:0/4110256652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe7c101900 msgr2=0x7efe7c19d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:47.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.101+0000 7efe79d9b640 1 --2- 172.21.15.17:0/4110256652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe7c101900 0x7efe7c19d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.101+0000 7efe79d9b640 1 -- 172.21.15.17:0/4110256652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7c1977a0 con 0x7efe7c107900 2024-09-20T19:00:47.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.101+0000 7efe79d9b640 1 --2- 172.21.15.17:0/4110256652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe7c107900 0x7efe7c19db60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efe6400e970 tx=0x7efe6400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:47.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.101+0000 7efe737fe640 1 -- 172.21.15.17:0/4110256652 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe6400cac0 con 0x7efe7c107900 2024-09-20T19:00:47.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.102+0000 7efe80896640 1 -- 172.21.15.17:0/4110256652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe7c197a90 con 0x7efe7c107900 2024-09-20T19:00:47.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.102+0000 7efe737fe640 1 -- 172.21.15.17:0/4110256652 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe640054e0 con 0x7efe7c107900 2024-09-20T19:00:47.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.102+0000 7efe737fe640 1 -- 172.21.15.17:0/4110256652 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe64010430 con 0x7efe7c107900 2024-09-20T19:00:47.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.102+0000 7efe80896640 1 -- 172.21.15.17:0/4110256652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe7c198020 con 0x7efe7c107900 2024-09-20T19:00:47.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.103+0000 7efe80896640 1 -- 172.21.15.17:0/4110256652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe7c103040 con 0x7efe7c107900 2024-09-20T19:00:47.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.103+0000 7efe737fe640 1 -- 172.21.15.17:0/4110256652 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7efe64004f00 con 0x7efe7c107900 2024-09-20T19:00:47.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.104+0000 7efe737fe640 1 --2- 172.21.15.17:0/4110256652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efe6807af80 0x7efe6807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:47.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.104+0000 7efe737fe640 1 -- 172.21.15.17:0/4110256652 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7efe6409e640 con 0x7efe7c107900 2024-09-20T19:00:47.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.104+0000 7efe7a59c640 1 --2- 172.21.15.17:0/4110256652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efe6807af80 0x7efe6807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:47.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.105+0000 7efe7a59c640 1 --2- 172.21.15.17:0/4110256652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efe6807af80 0x7efe6807d440 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0096c0 tx=0x7efe6c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:47.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.109+0000 7efe737fe640 1 -- 172.21.15.17:0/4110256652 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efe64069c20 con 0x7efe7c107900 2024-09-20T19:00:47.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.371+0000 7efe80896640 1 -- 172.21.15.17:0/4110256652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7efe7c109e70 con 0x7efe7c107900 2024-09-20T19:00:47.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.372+0000 7efe737fe640 1 -- 172.21.15.17:0/4110256652 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7efe6406ead0 con 0x7efe7c107900 2024-09-20T19:00:47.380 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:00:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:00:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:00:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:00:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:00:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:00:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:00:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:00:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:00:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:00:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:00:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:00:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:00:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:00:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:00:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:00:47.382 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:00:47.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.374+0000 7efe80896640 1 -- 172.21.15.17:0/4110256652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efe6807af80 msgr2=0x7efe6807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:47.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.374+0000 7efe80896640 1 --2- 172.21.15.17:0/4110256652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efe6807af80 0x7efe6807d440 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0096c0 tx=0x7efe6c031400 comp rx=0 tx=0).stop 2024-09-20T19:00:47.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.374+0000 7efe80896640 1 -- 172.21.15.17:0/4110256652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe7c107900 msgr2=0x7efe7c19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:47.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.374+0000 7efe80896640 1 --2- 172.21.15.17:0/4110256652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe7c107900 0x7efe7c19db60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efe6400e970 tx=0x7efe6400ed70 comp rx=0 tx=0).stop 2024-09-20T19:00:47.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.374+0000 7efe80896640 1 -- 172.21.15.17:0/4110256652 shutdown_connections 2024-09-20T19:00:47.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.374+0000 7efe80896640 1 --2- 172.21.15.17:0/4110256652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efe6807af80 0x7efe6807d440 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.374+0000 7efe80896640 1 --2- 172.21.15.17:0/4110256652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe7c107900 0x7efe7c19db60 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.374+0000 7efe80896640 1 --2- 172.21.15.17:0/4110256652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe7c101900 0x7efe7c19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.374+0000 7efe80896640 1 -- 172.21.15.17:0/4110256652 >> 172.21.15.17:0/4110256652 conn(0x7efe7c0fd600 msgr2=0x7efe7c0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:47.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.374+0000 7efe80896640 1 -- 172.21.15.17:0/4110256652 shutdown_connections 2024-09-20T19:00:47.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.374+0000 7efe80896640 1 -- 172.21.15.17:0/4110256652 wait complete. 2024-09-20T19:00:47.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.459+0000 7f633d209640 1 -- 172.21.15.17:0/1926879361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6338100800 msgr2=0x7f6338100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:47.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.459+0000 7f633d209640 1 --2- 172.21.15.17:0/1926879361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6338100800 0x7f6338100c60 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f632c009880 tx=0x7f632c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.459+0000 7f633d209640 1 -- 172.21.15.17:0/1926879361 shutdown_connections 2024-09-20T19:00:47.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.459+0000 7f633d209640 1 --2- 172.21.15.17:0/1926879361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6338100800 0x7f6338100c60 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.459+0000 7f633d209640 1 --2- 172.21.15.17:0/1926879361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6338106800 0x7f6338106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.459+0000 7f633d209640 1 -- 172.21.15.17:0/1926879361 >> 172.21.15.17:0/1926879361 conn(0x7f63380fc520 msgr2=0x7f63380fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:47.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.459+0000 7f633d209640 1 -- 172.21.15.17:0/1926879361 shutdown_connections 2024-09-20T19:00:47.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.459+0000 7f633d209640 1 -- 172.21.15.17:0/1926879361 wait complete. 2024-09-20T19:00:47.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.459+0000 7f633d209640 1 Processor -- start 2024-09-20T19:00:47.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.460+0000 7f633d209640 1 -- start start 2024-09-20T19:00:47.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.460+0000 7f633d209640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6338100800 0x7f6338198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:47.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.460+0000 7f633d209640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6338106800 0x7f6338198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:47.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.460+0000 7f633d209640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f633810dcd0 con 0x7f6338100800 2024-09-20T19:00:47.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.460+0000 7f633d209640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f633810db50 con 0x7f6338106800 2024-09-20T19:00:47.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.460+0000 7f6336d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6338100800 0x7f6338198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:47.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.460+0000 7f6336d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6338100800 0x7f6338198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36790/0 (socket says 172.21.15.17:36790) 2024-09-20T19:00:47.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.460+0000 7f6336d9d640 1 -- 172.21.15.17:0/4006630700 learned_addr learned my addr 172.21.15.17:0/4006630700 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:00:47.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.460+0000 7f633659c640 1 --2- 172.21.15.17:0/4006630700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6338106800 0x7f6338198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:47.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.460+0000 7f6336d9d640 1 -- 172.21.15.17:0/4006630700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6338106800 msgr2=0x7f6338198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:47.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.460+0000 7f6336d9d640 1 --2- 172.21.15.17:0/4006630700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6338106800 0x7f6338198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.460+0000 7f6336d9d640 1 -- 172.21.15.17:0/4006630700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6338199360 con 0x7f6338100800 2024-09-20T19:00:47.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.461+0000 7f6336d9d640 1 --2- 172.21.15.17:0/4006630700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6338100800 0x7f6338198820 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f632800c8f0 tx=0x7f632800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:47.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.461+0000 7f631ffff640 1 -- 172.21.15.17:0/4006630700 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f63280079b0 con 0x7f6338100800 2024-09-20T19:00:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.461+0000 7f633d209640 1 -- 172.21.15.17:0/4006630700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6338199650 con 0x7f6338100800 2024-09-20T19:00:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.461+0000 7f631ffff640 1 -- 172.21.15.17:0/4006630700 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f63280054e0 con 0x7f6338100800 2024-09-20T19:00:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.461+0000 7f631ffff640 1 -- 172.21.15.17:0/4006630700 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6328004dd0 con 0x7f6338100800 2024-09-20T19:00:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.461+0000 7f633d209640 1 -- 172.21.15.17:0/4006630700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63381a1c50 con 0x7f6338100800 2024-09-20T19:00:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.462+0000 7f633d209640 1 -- 172.21.15.17:0/4006630700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6338101f40 con 0x7f6338100800 2024-09-20T19:00:47.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.463+0000 7f631ffff640 1 -- 172.21.15.17:0/4006630700 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6328005020 con 0x7f6338100800 2024-09-20T19:00:47.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.463+0000 7f631ffff640 1 --2- 172.21.15.17:0/4006630700 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f632007af30 0x7f632007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:47.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.463+0000 7f631ffff640 1 -- 172.21.15.17:0/4006630700 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f632809dea0 con 0x7f6338100800 2024-09-20T19:00:47.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.463+0000 7f633659c640 1 --2- 172.21.15.17:0/4006630700 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f632007af30 0x7f632007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:47.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.464+0000 7f633659c640 1 --2- 172.21.15.17:0/4006630700 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f632007af30 0x7f632007d3f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f633806ad00 tx=0x7f632c031420 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:47.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.467+0000 7f631ffff640 1 -- 172.21.15.17:0/4006630700 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6338199650 con 0x7f6338100800 2024-09-20T19:00:47.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.698+0000 7f633d209640 1 -- 172.21.15.17:0/4006630700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6338108d70 con 0x7f6338100800 2024-09-20T19:00:47.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.699+0000 7f631ffff640 1 -- 172.21.15.17:0/4006630700 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7f6328014030 con 0x7f6338100800 2024-09-20T19:00:47.707 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:00:47.707 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:00:47.707 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:00:47.708 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:00:47.708 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:00:47.708 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:00:47.708 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:00:47.708 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:00:47.708 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:00:47.708 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:00:47.708 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:00:47.708 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:00:47.708 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:00:47.708 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:00:47.708 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:00:47.708 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:00:47.709 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:00:47.709 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:00:47.709 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:00:47.709 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:00:47.709 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:00:47.709 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:00:47.709 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:00:47.709 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:00:47.709 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:00:47.709 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:00:47.709 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:00:47.709 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:00:47.709 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:00:47.709 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:00:47.710 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:00:47.710 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:00:47.710 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:00:47.710 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:00:47.710 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:00:47.710 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:00:47.710 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:00:47.710 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:00:47.710 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:00:47.710 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:00:47.710 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:00:47.710 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:00:47.711 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:00:47.711 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:00:47.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.702+0000 7f633d209640 1 -- 172.21.15.17:0/4006630700 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f632007af30 msgr2=0x7f632007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:47.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.702+0000 7f633d209640 1 --2- 172.21.15.17:0/4006630700 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f632007af30 0x7f632007d3f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f633806ad00 tx=0x7f632c031420 comp rx=0 tx=0).stop 2024-09-20T19:00:47.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.702+0000 7f633d209640 1 -- 172.21.15.17:0/4006630700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6338100800 msgr2=0x7f6338198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:47.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.702+0000 7f633d209640 1 --2- 172.21.15.17:0/4006630700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6338100800 0x7f6338198820 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f632800c8f0 tx=0x7f632800cdb0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.702+0000 7f633d209640 1 -- 172.21.15.17:0/4006630700 shutdown_connections 2024-09-20T19:00:47.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.702+0000 7f633d209640 1 --2- 172.21.15.17:0/4006630700 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f632007af30 0x7f632007d3f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.702+0000 7f633d209640 1 --2- 172.21.15.17:0/4006630700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6338106800 0x7f6338198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.702+0000 7f633d209640 1 --2- 172.21.15.17:0/4006630700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6338100800 0x7f6338198820 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.702+0000 7f633d209640 1 -- 172.21.15.17:0/4006630700 >> 172.21.15.17:0/4006630700 conn(0x7f63380fc520 msgr2=0x7f63380fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:47.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.702+0000 7f633d209640 1 -- 172.21.15.17:0/4006630700 shutdown_connections 2024-09-20T19:00:47.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.702+0000 7f633d209640 1 -- 172.21.15.17:0/4006630700 wait complete. 2024-09-20T19:00:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.788+0000 7f171c9cd640 1 -- 172.21.15.17:0/1530980373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1718100800 msgr2=0x7f1718100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.788+0000 7f171c9cd640 1 --2- 172.21.15.17:0/1530980373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1718100800 0x7f1718100c60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f170c009880 tx=0x7f170c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.788+0000 7f171c9cd640 1 -- 172.21.15.17:0/1530980373 shutdown_connections 2024-09-20T19:00:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.788+0000 7f171c9cd640 1 --2- 172.21.15.17:0/1530980373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1718100800 0x7f1718100c60 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.788+0000 7f171c9cd640 1 --2- 172.21.15.17:0/1530980373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1718106800 0x7f1718106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.788+0000 7f171c9cd640 1 -- 172.21.15.17:0/1530980373 >> 172.21.15.17:0/1530980373 conn(0x7f17180fc520 msgr2=0x7f17180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:47.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.788+0000 7f171c9cd640 1 -- 172.21.15.17:0/1530980373 shutdown_connections 2024-09-20T19:00:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.788+0000 7f171c9cd640 1 -- 172.21.15.17:0/1530980373 wait complete. 2024-09-20T19:00:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.789+0000 7f171c9cd640 1 Processor -- start 2024-09-20T19:00:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.789+0000 7f171c9cd640 1 -- start start 2024-09-20T19:00:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.789+0000 7f171c9cd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1718100800 0x7f171819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.789+0000 7f171c9cd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1718106800 0x7f171819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.789+0000 7f171c9cd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f171810dcd0 con 0x7f1718100800 2024-09-20T19:00:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.789+0000 7f171c9cd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f171810db50 con 0x7f1718106800 2024-09-20T19:00:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.789+0000 7f171659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1718100800 0x7f171819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.789+0000 7f171659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1718100800 0x7f171819d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36794/0 (socket says 172.21.15.17:36794) 2024-09-20T19:00:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.789+0000 7f171659c640 1 -- 172.21.15.17:0/3084780035 learned_addr learned my addr 172.21.15.17:0/3084780035 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:00:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.789+0000 7f1715d9b640 1 --2- 172.21.15.17:0/3084780035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1718106800 0x7f171819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.790+0000 7f171659c640 1 -- 172.21.15.17:0/3084780035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1718106800 msgr2=0x7f171819db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:47.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.790+0000 7f171659c640 1 --2- 172.21.15.17:0/3084780035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1718106800 0x7f171819db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:47.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.790+0000 7f171659c640 1 -- 172.21.15.17:0/3084780035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17181977c0 con 0x7f1718100800 2024-09-20T19:00:47.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.790+0000 7f171659c640 1 --2- 172.21.15.17:0/3084780035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1718100800 0x7f171819d640 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f170800c8f0 tx=0x7f170800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:47.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.790+0000 7f17077fe640 1 -- 172.21.15.17:0/3084780035 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f17080079b0 con 0x7f1718100800 2024-09-20T19:00:47.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.790+0000 7f17077fe640 1 -- 172.21.15.17:0/3084780035 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f17080054e0 con 0x7f1718100800 2024-09-20T19:00:47.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.790+0000 7f171c9cd640 1 -- 172.21.15.17:0/3084780035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1718197ab0 con 0x7f1718100800 2024-09-20T19:00:47.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.790+0000 7f17077fe640 1 -- 172.21.15.17:0/3084780035 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1708004dd0 con 0x7f1718100800 2024-09-20T19:00:47.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.790+0000 7f171c9cd640 1 -- 172.21.15.17:0/3084780035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1718198010 con 0x7f1718100800 2024-09-20T19:00:47.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.791+0000 7f171c9cd640 1 -- 172.21.15.17:0/3084780035 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1718101f40 con 0x7f1718100800 2024-09-20T19:00:47.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.792+0000 7f17077fe640 1 -- 172.21.15.17:0/3084780035 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1708005020 con 0x7f1718100800 2024-09-20T19:00:47.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.792+0000 7f17077fe640 1 --2- 172.21.15.17:0/3084780035 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f170007aed0 0x7f170007d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:47.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.792+0000 7f17077fe640 1 -- 172.21.15.17:0/3084780035 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f170809e0c0 con 0x7f1718100800 2024-09-20T19:00:47.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.792+0000 7f1715d9b640 1 --2- 172.21.15.17:0/3084780035 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f170007aed0 0x7f170007d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:47.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.793+0000 7f1715d9b640 1 --2- 172.21.15.17:0/3084780035 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f170007aed0 0x7f170007d390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1718198b10 tx=0x7f170c031420 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:47.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:47.797+0000 7f17077fe640 1 -- 172.21.15.17:0/3084780035 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1708014030 con 0x7f1718100800 2024-09-20T19:00:48.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.002+0000 7f171c9cd640 1 -- 172.21.15.17:0/3084780035 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1718198320 con 0x7f170007aed0 2024-09-20T19:00:48.010 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:47 smithi017 ceph-mon[108970]: from='client.35212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:48.010 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:47 smithi017 ceph-mon[108970]: pgmap v762: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:48.011 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:47 smithi017 ceph-mon[108970]: from='client.35216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:48.011 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:47 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4110256652' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:00:48.011 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:47 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4006630700' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:00:48.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.003+0000 7f17077fe640 1 -- 172.21.15.17:0/3084780035 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f1718198320 con 0x7f170007aed0 2024-09-20T19:00:48.011 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:00:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:00:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:00:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:00:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:00:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:00:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:00:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:00:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:00:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:00:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:00:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:00:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:00:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:00:48.012 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:00:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.005+0000 7f171c9cd640 1 -- 172.21.15.17:0/3084780035 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f170007aed0 msgr2=0x7f170007d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.005+0000 7f171c9cd640 1 --2- 172.21.15.17:0/3084780035 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f170007aed0 0x7f170007d390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1718198b10 tx=0x7f170c031420 comp rx=0 tx=0).stop 2024-09-20T19:00:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.005+0000 7f171c9cd640 1 -- 172.21.15.17:0/3084780035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1718100800 msgr2=0x7f171819d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.005+0000 7f171c9cd640 1 --2- 172.21.15.17:0/3084780035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1718100800 0x7f171819d640 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f170800c8f0 tx=0x7f170800cdb0 comp rx=0 tx=0).stop 2024-09-20T19:00:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.005+0000 7f171c9cd640 1 -- 172.21.15.17:0/3084780035 shutdown_connections 2024-09-20T19:00:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.005+0000 7f171c9cd640 1 --2- 172.21.15.17:0/3084780035 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f170007aed0 0x7f170007d390 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.005+0000 7f171c9cd640 1 --2- 172.21.15.17:0/3084780035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1718106800 0x7f171819db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.005+0000 7f171c9cd640 1 --2- 172.21.15.17:0/3084780035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1718100800 0x7f171819d640 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.005+0000 7f171c9cd640 1 -- 172.21.15.17:0/3084780035 >> 172.21.15.17:0/3084780035 conn(0x7f17180fc520 msgr2=0x7f171806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.005+0000 7f171c9cd640 1 -- 172.21.15.17:0/3084780035 shutdown_connections 2024-09-20T19:00:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.005+0000 7f171c9cd640 1 -- 172.21.15.17:0/3084780035 wait complete. 2024-09-20T19:00:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.089+0000 7ff4ef108640 1 -- 172.21.15.17:0/1367347644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e8102b20 msgr2=0x7ff4e8102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.089+0000 7ff4ef108640 1 --2- 172.21.15.17:0/1367347644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e8102b20 0x7ff4e8102f00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80098b0 tx=0x7ff4d802a560 comp rx=0 tx=0).stop 2024-09-20T19:00:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.089+0000 7ff4ef108640 1 -- 172.21.15.17:0/1367347644 shutdown_connections 2024-09-20T19:00:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.089+0000 7ff4ef108640 1 --2- 172.21.15.17:0/1367347644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4e8103440 0x7ff4e810b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.089+0000 7ff4ef108640 1 --2- 172.21.15.17:0/1367347644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e8102b20 0x7ff4e8102f00 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.089+0000 7ff4ef108640 1 -- 172.21.15.17:0/1367347644 >> 172.21.15.17:0/1367347644 conn(0x7ff4e80fc520 msgr2=0x7ff4e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.089+0000 7ff4ef108640 1 -- 172.21.15.17:0/1367347644 shutdown_connections 2024-09-20T19:00:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.089+0000 7ff4ef108640 1 -- 172.21.15.17:0/1367347644 wait complete. 2024-09-20T19:00:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.090+0000 7ff4ef108640 1 Processor -- start 2024-09-20T19:00:48.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.090+0000 7ff4ef108640 1 -- start start 2024-09-20T19:00:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.090+0000 7ff4ef108640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4e8102b20 0x7ff4e819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.090+0000 7ff4ef108640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e8103440 0x7ff4e819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.090+0000 7ff4ef108640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e810edf0 con 0x7ff4e8103440 2024-09-20T19:00:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.090+0000 7ff4ef108640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e810ec70 con 0x7ff4e8102b20 2024-09-20T19:00:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.090+0000 7ff4e7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e8103440 0x7ff4e819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.090+0000 7ff4e7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e8103440 0x7ff4e819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36810/0 (socket says 172.21.15.17:36810) 2024-09-20T19:00:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.090+0000 7ff4e7fff640 1 -- 172.21.15.17:0/3309672542 learned_addr learned my addr 172.21.15.17:0/3309672542 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:00:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.090+0000 7ff4ecea4640 1 --2- 172.21.15.17:0/3309672542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4e8102b20 0x7ff4e819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.090+0000 7ff4e7fff640 1 -- 172.21.15.17:0/3309672542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4e8102b20 msgr2=0x7ff4e819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.090+0000 7ff4e7fff640 1 --2- 172.21.15.17:0/3309672542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4e8102b20 0x7ff4e819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.090+0000 7ff4e7fff640 1 -- 172.21.15.17:0/3309672542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e8197820 con 0x7ff4e8103440 2024-09-20T19:00:48.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.091+0000 7ff4e7fff640 1 --2- 172.21.15.17:0/3309672542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e8103440 0x7ff4e819dbe0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000d6f0 tx=0x7ff4d000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.091+0000 7ff4e5ffb640 1 -- 172.21.15.17:0/3309672542 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4d0017070 con 0x7ff4e8103440 2024-09-20T19:00:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.091+0000 7ff4ef108640 1 -- 172.21.15.17:0/3309672542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e8197b10 con 0x7ff4e8103440 2024-09-20T19:00:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.091+0000 7ff4e5ffb640 1 -- 172.21.15.17:0/3309672542 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff4d000de00 con 0x7ff4e8103440 2024-09-20T19:00:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.091+0000 7ff4e5ffb640 1 -- 172.21.15.17:0/3309672542 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4d0004bb0 con 0x7ff4e8103440 2024-09-20T19:00:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.091+0000 7ff4ef108640 1 -- 172.21.15.17:0/3309672542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e81980a0 con 0x7ff4e8103440 2024-09-20T19:00:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.092+0000 7ff4ef108640 1 -- 172.21.15.17:0/3309672542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4e806aa30 con 0x7ff4e8103440 2024-09-20T19:00:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.093+0000 7ff4e5ffb640 1 -- 172.21.15.17:0/3309672542 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff4d0004e60 con 0x7ff4e8103440 2024-09-20T19:00:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.093+0000 7ff4e5ffb640 1 --2- 172.21.15.17:0/3309672542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4d407af30 0x7ff4d407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:00:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.093+0000 7ff4e5ffb640 1 -- 172.21.15.17:0/3309672542 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7ff4d009dc50 con 0x7ff4e8103440 2024-09-20T19:00:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.093+0000 7ff4ecea4640 1 --2- 172.21.15.17:0/3309672542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4d407af30 0x7ff4d407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:00:48.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.094+0000 7ff4ecea4640 1 --2- 172.21.15.17:0/3309672542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4d407af30 0x7ff4d407d3f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8031460 tx=0x7ff4d8009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:00:48.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.098+0000 7ff4e5ffb640 1 -- 172.21.15.17:0/3309672542 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff4d0069250 con 0x7ff4e8103440 2024-09-20T19:00:48.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:47 smithi172 ceph-mon[80431]: from='client.35212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:48.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:47 smithi172 ceph-mon[80431]: pgmap v762: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:48.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:47 smithi172 ceph-mon[80431]: from='client.35216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:48.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:47 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4110256652' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:00:48.204 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:47 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4006630700' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:00:48.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.361+0000 7ff4ef108640 1 -- 172.21.15.17:0/3309672542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff4e8105ff0 con 0x7ff4e8103440 2024-09-20T19:00:48.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.361+0000 7ff4e5ffb640 1 -- 172.21.15.17:0/3309672542 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7ff4d006e100 con 0x7ff4e8103440 2024-09-20T19:00:48.370 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:00:48.370 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:00:48.370 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:00:48.370 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:00:48.370 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:00:48.370 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:00:48.370 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:00:48.370 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:00:48.370 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:00:48.370 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:00:48.370 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:00:48.370 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:00:48.371 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:00:48.371 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:00:48.371 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:00:48.371 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:00:48.371 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:00:48.371 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:00:48.371 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:00:48.371 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:00:48.371 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:00:48.371 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:00:48.371 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:00:48.371 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:00:48.371 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:00:48.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.364+0000 7ff4ef108640 1 -- 172.21.15.17:0/3309672542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4d407af30 msgr2=0x7ff4d407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:48.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.364+0000 7ff4ef108640 1 --2- 172.21.15.17:0/3309672542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4d407af30 0x7ff4d407d3f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8031460 tx=0x7ff4d8009560 comp rx=0 tx=0).stop 2024-09-20T19:00:48.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.364+0000 7ff4ef108640 1 -- 172.21.15.17:0/3309672542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e8103440 msgr2=0x7ff4e819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:00:48.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.364+0000 7ff4ef108640 1 --2- 172.21.15.17:0/3309672542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e8103440 0x7ff4e819dbe0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000d6f0 tx=0x7ff4d000dbb0 comp rx=0 tx=0).stop 2024-09-20T19:00:48.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.364+0000 7ff4ef108640 1 -- 172.21.15.17:0/3309672542 shutdown_connections 2024-09-20T19:00:48.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.364+0000 7ff4ef108640 1 --2- 172.21.15.17:0/3309672542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff4d407af30 0x7ff4d407d3f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:48.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.364+0000 7ff4ef108640 1 --2- 172.21.15.17:0/3309672542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e8103440 0x7ff4e819dbe0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:48.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.364+0000 7ff4ef108640 1 --2- 172.21.15.17:0/3309672542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4e8102b20 0x7ff4e819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:00:48.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.364+0000 7ff4ef108640 1 -- 172.21.15.17:0/3309672542 >> 172.21.15.17:0/3309672542 conn(0x7ff4e80fc520 msgr2=0x7ff4e8103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:00:48.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.364+0000 7ff4ef108640 1 -- 172.21.15.17:0/3309672542 shutdown_connections 2024-09-20T19:00:48.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:00:48.364+0000 7ff4ef108640 1 -- 172.21.15.17:0/3309672542 wait complete. 2024-09-20T19:00:49.144 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:48 smithi017 ceph-mon[108970]: from='client.35220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:49.144 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:48 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3309672542' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:00:49.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:48 smithi172 ceph-mon[80431]: from='client.35220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:49.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:48 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3309672542' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:00:49.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:49 smithi017 ceph-mon[108970]: from='client.35232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:49.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:49 smithi017 ceph-mon[108970]: pgmap v763: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:50.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:49 smithi172 ceph-mon[80431]: from='client.35232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:00:50.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:49 smithi172 ceph-mon[80431]: pgmap v763: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:52.144 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:51 smithi017 ceph-mon[108970]: pgmap v764: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:52.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:51 smithi172 ceph-mon[80431]: pgmap v764: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:52.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:00:53.104 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:00:54.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:53 smithi017 ceph-mon[108970]: pgmap v765: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:54.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:53 smithi172 ceph-mon[80431]: pgmap v765: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:55.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:55 smithi017 ceph-mon[108970]: pgmap v766: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:56.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:55 smithi172 ceph-mon[80431]: pgmap v766: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:58.144 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:57 smithi017 ceph-mon[108970]: pgmap v767: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:00:58.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:57 smithi172 ceph-mon[80431]: pgmap v767: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:00.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:00:59 smithi017 ceph-mon[108970]: pgmap v768: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:00.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:00:59 smithi172 ceph-mon[80431]: pgmap v768: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:01.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:01 smithi017 ceph-mon[108970]: pgmap v769: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:01.953 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:01 smithi172 ceph-mon[80431]: pgmap v769: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:04.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:03 smithi017 ceph-mon[108970]: pgmap v770: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:04.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:03 smithi172 ceph-mon[80431]: pgmap v770: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:06.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:05 smithi017 ceph-mon[108970]: pgmap v771: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:06.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:05 smithi172 ceph-mon[80431]: pgmap v771: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:07.893 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:07 smithi017 ceph-mon[108970]: pgmap v772: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:07.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:01:08.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:07 smithi172 ceph-mon[80431]: pgmap v772: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:08.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:01:10.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:09 smithi017 ceph-mon[108970]: pgmap v773: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:10.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:09 smithi172 ceph-mon[80431]: pgmap v773: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:12.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:11 smithi017 ceph-mon[108970]: pgmap v774: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:12.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:11 smithi172 ceph-mon[80431]: pgmap v774: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:13.893 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:13 smithi017 ceph-mon[108970]: pgmap v775: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:14.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:13 smithi172 ceph-mon[80431]: pgmap v775: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:16.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:15 smithi017 ceph-mon[108970]: pgmap v776: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:16.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:15 smithi172 ceph-mon[80431]: pgmap v776: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:18.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:17 smithi017 ceph-mon[108970]: pgmap v777: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:18.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:17 smithi172 ceph-mon[80431]: pgmap v777: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:18.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.461+0000 7fcb3d5ac640 1 -- 172.21.15.17:0/4084236997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb381033e0 msgr2=0x7fcb3810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.461+0000 7fcb3d5ac640 1 --2- 172.21.15.17:0/4084236997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb381033e0 0x7fcb3810b8d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009880 tx=0x7fcb2002a530 comp rx=0 tx=0).stop 2024-09-20T19:01:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.461+0000 7fcb3d5ac640 1 -- 172.21.15.17:0/4084236997 shutdown_connections 2024-09-20T19:01:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.461+0000 7fcb3d5ac640 1 --2- 172.21.15.17:0/4084236997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb381033e0 0x7fcb3810b8d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.461+0000 7fcb3d5ac640 1 --2- 172.21.15.17:0/4084236997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb38102ac0 0x7fcb38102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.461+0000 7fcb3d5ac640 1 -- 172.21.15.17:0/4084236997 >> 172.21.15.17:0/4084236997 conn(0x7fcb380fc520 msgr2=0x7fcb380fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:18.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.461+0000 7fcb3d5ac640 1 -- 172.21.15.17:0/4084236997 shutdown_connections 2024-09-20T19:01:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.461+0000 7fcb3d5ac640 1 -- 172.21.15.17:0/4084236997 wait complete. 2024-09-20T19:01:18.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.462+0000 7fcb3d5ac640 1 Processor -- start 2024-09-20T19:01:18.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.462+0000 7fcb3d5ac640 1 -- start start 2024-09-20T19:01:18.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.462+0000 7fcb3d5ac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb38102ac0 0x7fcb38100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:18.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.462+0000 7fcb3d5ac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb381033e0 0x7fcb38100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:18.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.462+0000 7fcb3d5ac640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3810edf0 con 0x7fcb381033e0 2024-09-20T19:01:18.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.462+0000 7fcb3d5ac640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3810ec70 con 0x7fcb38102ac0 2024-09-20T19:01:18.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.463+0000 7fcb2e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb381033e0 0x7fcb38100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:18.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.463+0000 7fcb2e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb381033e0 0x7fcb38100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33504/0 (socket says 172.21.15.17:33504) 2024-09-20T19:01:18.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.463+0000 7fcb2e7fc640 1 -- 172.21.15.17:0/2038766866 learned_addr learned my addr 172.21.15.17:0/2038766866 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:01:18.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.463+0000 7fcb36ffd640 1 --2- 172.21.15.17:0/2038766866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb38102ac0 0x7fcb38100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.463+0000 7fcb2e7fc640 1 -- 172.21.15.17:0/2038766866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb38102ac0 msgr2=0x7fcb38100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.463+0000 7fcb2e7fc640 1 --2- 172.21.15.17:0/2038766866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb38102ac0 0x7fcb38100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.463+0000 7fcb2e7fc640 1 -- 172.21.15.17:0/2038766866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb381011a0 con 0x7fcb381033e0 2024-09-20T19:01:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.463+0000 7fcb36ffd640 1 --2- 172.21.15.17:0/2038766866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb38102ac0 0x7fcb38100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:01:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.463+0000 7fcb2e7fc640 1 --2- 172.21.15.17:0/2038766866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb381033e0 0x7fcb38100c60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcb20031460 tx=0x7fcb20004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.463+0000 7fcb34ff9640 1 -- 172.21.15.17:0/2038766866 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb2003f070 con 0x7fcb381033e0 2024-09-20T19:01:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.464+0000 7fcb34ff9640 1 -- 172.21.15.17:0/2038766866 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcb200035f0 con 0x7fcb381033e0 2024-09-20T19:01:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.464+0000 7fcb3d5ac640 1 -- 172.21.15.17:0/2038766866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb38101430 con 0x7fcb381033e0 2024-09-20T19:01:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.464+0000 7fcb34ff9640 1 -- 172.21.15.17:0/2038766866 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb20035030 con 0x7fcb381033e0 2024-09-20T19:01:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.464+0000 7fcb3d5ac640 1 -- 172.21.15.17:0/2038766866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb381a3de0 con 0x7fcb381033e0 2024-09-20T19:01:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.465+0000 7fcb3d5ac640 1 -- 172.21.15.17:0/2038766866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb3806aa90 con 0x7fcb381033e0 2024-09-20T19:01:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.466+0000 7fcb34ff9640 1 -- 172.21.15.17:0/2038766866 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fcb20042070 con 0x7fcb381033e0 2024-09-20T19:01:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.466+0000 7fcb34ff9640 1 --2- 172.21.15.17:0/2038766866 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb2407af80 0x7fcb2407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.466+0000 7fcb34ff9640 1 -- 172.21.15.17:0/2038766866 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fcb200be8e0 con 0x7fcb381033e0 2024-09-20T19:01:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.466+0000 7fcb36ffd640 1 --2- 172.21.15.17:0/2038766866 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb2407af80 0x7fcb2407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.467+0000 7fcb36ffd640 1 --2- 172.21.15.17:0/2038766866 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb2407af80 0x7fcb2407d440 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcb280058c0 tx=0x7fcb28005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.471+0000 7fcb34ff9640 1 -- 172.21.15.17:0/2038766866 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb20089f60 con 0x7fcb381033e0 2024-09-20T19:01:18.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.676+0000 7fcb3d5ac640 1 -- 172.21.15.17:0/2038766866 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcb38105fd0 con 0x7fcb2407af80 2024-09-20T19:01:18.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.677+0000 7fcb34ff9640 1 -- 172.21.15.17:0/2038766866 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fcb2800bca0 con 0x7fcb2407af80 2024-09-20T19:01:18.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.679+0000 7fcb3d5ac640 1 -- 172.21.15.17:0/2038766866 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb2407af80 msgr2=0x7fcb2407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:18.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.679+0000 7fcb3d5ac640 1 --2- 172.21.15.17:0/2038766866 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb2407af80 0x7fcb2407d440 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcb280058c0 tx=0x7fcb28005850 comp rx=0 tx=0).stop 2024-09-20T19:01:18.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.679+0000 7fcb3d5ac640 1 -- 172.21.15.17:0/2038766866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb381033e0 msgr2=0x7fcb38100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:18.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.679+0000 7fcb3d5ac640 1 --2- 172.21.15.17:0/2038766866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb381033e0 0x7fcb38100c60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcb20031460 tx=0x7fcb20004530 comp rx=0 tx=0).stop 2024-09-20T19:01:18.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.679+0000 7fcb3d5ac640 1 -- 172.21.15.17:0/2038766866 shutdown_connections 2024-09-20T19:01:18.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.679+0000 7fcb3d5ac640 1 --2- 172.21.15.17:0/2038766866 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb2407af80 0x7fcb2407d440 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:18.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.679+0000 7fcb3d5ac640 1 --2- 172.21.15.17:0/2038766866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb381033e0 0x7fcb38100c60 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:18.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.680+0000 7fcb3d5ac640 1 --2- 172.21.15.17:0/2038766866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb38102ac0 0x7fcb38100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:18.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.680+0000 7fcb3d5ac640 1 -- 172.21.15.17:0/2038766866 >> 172.21.15.17:0/2038766866 conn(0x7fcb380fc520 msgr2=0x7fcb38108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:18.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.680+0000 7fcb3d5ac640 1 -- 172.21.15.17:0/2038766866 shutdown_connections 2024-09-20T19:01:18.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.680+0000 7fcb3d5ac640 1 -- 172.21.15.17:0/2038766866 wait complete. 2024-09-20T19:01:18.697 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:01:18.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.765+0000 7fc94e612640 1 -- 172.21.15.17:0/3185557275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc948106800 msgr2=0x7fc948106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:18.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.765+0000 7fc94e612640 1 --2- 172.21.15.17:0/3185557275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc948106800 0x7fc948106be0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc938009880 tx=0x7fc93802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:01:18.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.765+0000 7fc94e612640 1 -- 172.21.15.17:0/3185557275 shutdown_connections 2024-09-20T19:01:18.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.765+0000 7fc94e612640 1 --2- 172.21.15.17:0/3185557275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc948100800 0x7fc948100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:18.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.765+0000 7fc94e612640 1 --2- 172.21.15.17:0/3185557275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc948106800 0x7fc948106be0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:18.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.765+0000 7fc94e612640 1 -- 172.21.15.17:0/3185557275 >> 172.21.15.17:0/3185557275 conn(0x7fc9480fc520 msgr2=0x7fc9480fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:18.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.765+0000 7fc94e612640 1 -- 172.21.15.17:0/3185557275 shutdown_connections 2024-09-20T19:01:18.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.765+0000 7fc94e612640 1 -- 172.21.15.17:0/3185557275 wait complete. 2024-09-20T19:01:18.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.766+0000 7fc94e612640 1 Processor -- start 2024-09-20T19:01:18.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.766+0000 7fc94e612640 1 -- start start 2024-09-20T19:01:18.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.766+0000 7fc94e612640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc948100800 0x7fc94819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:18.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.766+0000 7fc94e612640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc948106800 0x7fc94819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:18.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.766+0000 7fc94e612640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc94810dcd0 con 0x7fc948100800 2024-09-20T19:01:18.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.766+0000 7fc94e612640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc94810db50 con 0x7fc948106800 2024-09-20T19:01:18.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.766+0000 7fc947fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc948100800 0x7fc94819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:18.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.766+0000 7fc947fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc948100800 0x7fc94819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33532/0 (socket says 172.21.15.17:33532) 2024-09-20T19:01:18.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.766+0000 7fc947fff640 1 -- 172.21.15.17:0/1890410746 learned_addr learned my addr 172.21.15.17:0/1890410746 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:01:18.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.767+0000 7fc9477fe640 1 --2- 172.21.15.17:0/1890410746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc948106800 0x7fc94819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:18.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.767+0000 7fc947fff640 1 -- 172.21.15.17:0/1890410746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc948106800 msgr2=0x7fc94819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:18.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.767+0000 7fc947fff640 1 --2- 172.21.15.17:0/1890410746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc948106800 0x7fc94819dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:18.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.767+0000 7fc947fff640 1 -- 172.21.15.17:0/1890410746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9481977e0 con 0x7fc948100800 2024-09-20T19:01:18.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.767+0000 7fc947fff640 1 --2- 172.21.15.17:0/1890410746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc948100800 0x7fc94819d660 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc938031460 tx=0x7fc938004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:18.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.767+0000 7fc9457fa640 1 -- 172.21.15.17:0/1890410746 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc93803f070 con 0x7fc948100800 2024-09-20T19:01:18.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.767+0000 7fc94e612640 1 -- 172.21.15.17:0/1890410746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc948197a70 con 0x7fc948100800 2024-09-20T19:01:18.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.767+0000 7fc9457fa640 1 -- 172.21.15.17:0/1890410746 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc9380035f0 con 0x7fc948100800 2024-09-20T19:01:18.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.767+0000 7fc9457fa640 1 -- 172.21.15.17:0/1890410746 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc938035030 con 0x7fc948100800 2024-09-20T19:01:18.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.767+0000 7fc94e612640 1 -- 172.21.15.17:0/1890410746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc948197fa0 con 0x7fc948100800 2024-09-20T19:01:18.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.768+0000 7fc94e612640 1 -- 172.21.15.17:0/1890410746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc948101f40 con 0x7fc948100800 2024-09-20T19:01:18.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.770+0000 7fc9457fa640 1 -- 172.21.15.17:0/1890410746 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc938042070 con 0x7fc948100800 2024-09-20T19:01:18.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.771+0000 7fc9457fa640 1 --2- 172.21.15.17:0/1890410746 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc93007af80 0x7fc93007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:18.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.771+0000 7fc9457fa640 1 -- 172.21.15.17:0/1890410746 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fc9380beea0 con 0x7fc948100800 2024-09-20T19:01:18.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.771+0000 7fc9477fe640 1 --2- 172.21.15.17:0/1890410746 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc93007af80 0x7fc93007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:18.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.772+0000 7fc9477fe640 1 --2- 172.21.15.17:0/1890410746 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc93007af80 0x7fc93007d440 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc948104f70 tx=0x7fc93c005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:18.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.776+0000 7fc9457fa640 1 -- 172.21.15.17:0/1890410746 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc93808a5c0 con 0x7fc948100800 2024-09-20T19:01:18.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.981+0000 7fc94e612640 1 -- 172.21.15.17:0/1890410746 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc948198310 con 0x7fc93007af80 2024-09-20T19:01:18.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.982+0000 7fc9457fa640 1 -- 172.21.15.17:0/1890410746 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc948198310 con 0x7fc93007af80 2024-09-20T19:01:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.985+0000 7fc94e612640 1 -- 172.21.15.17:0/1890410746 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc93007af80 msgr2=0x7fc93007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.985+0000 7fc94e612640 1 --2- 172.21.15.17:0/1890410746 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc93007af80 0x7fc93007d440 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc948104f70 tx=0x7fc93c005f90 comp rx=0 tx=0).stop 2024-09-20T19:01:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.985+0000 7fc94e612640 1 -- 172.21.15.17:0/1890410746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc948100800 msgr2=0x7fc94819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.985+0000 7fc94e612640 1 --2- 172.21.15.17:0/1890410746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc948100800 0x7fc94819d660 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc938031460 tx=0x7fc938004530 comp rx=0 tx=0).stop 2024-09-20T19:01:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.985+0000 7fc94e612640 1 -- 172.21.15.17:0/1890410746 shutdown_connections 2024-09-20T19:01:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.985+0000 7fc94e612640 1 --2- 172.21.15.17:0/1890410746 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc93007af80 0x7fc93007d440 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.985+0000 7fc94e612640 1 --2- 172.21.15.17:0/1890410746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc948106800 0x7fc94819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.985+0000 7fc94e612640 1 --2- 172.21.15.17:0/1890410746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc948100800 0x7fc94819d660 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.985+0000 7fc94e612640 1 -- 172.21.15.17:0/1890410746 >> 172.21.15.17:0/1890410746 conn(0x7fc9480fc520 msgr2=0x7fc94806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.985+0000 7fc94e612640 1 -- 172.21.15.17:0/1890410746 shutdown_connections 2024-09-20T19:01:18.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:18.985+0000 7fc94e612640 1 -- 172.21.15.17:0/1890410746 wait complete. 2024-09-20T19:01:19.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.069+0000 7fc4a68fb640 1 -- 172.21.15.17:0/3056993514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4a0100800 msgr2=0x7fc4a0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:19.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.069+0000 7fc4a68fb640 1 --2- 172.21.15.17:0/3056993514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4a0100800 0x7fc4a0100c60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc494009880 tx=0x7fc49402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.069+0000 7fc4a68fb640 1 -- 172.21.15.17:0/3056993514 shutdown_connections 2024-09-20T19:01:19.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.069+0000 7fc4a68fb640 1 --2- 172.21.15.17:0/3056993514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4a0100800 0x7fc4a0100c60 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.069+0000 7fc4a68fb640 1 --2- 172.21.15.17:0/3056993514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4a0106800 0x7fc4a0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.069+0000 7fc4a68fb640 1 -- 172.21.15.17:0/3056993514 >> 172.21.15.17:0/3056993514 conn(0x7fc4a00fc520 msgr2=0x7fc4a00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:19.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.070+0000 7fc4a68fb640 1 -- 172.21.15.17:0/3056993514 shutdown_connections 2024-09-20T19:01:19.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.070+0000 7fc4a68fb640 1 -- 172.21.15.17:0/3056993514 wait complete. 2024-09-20T19:01:19.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.070+0000 7fc4a68fb640 1 Processor -- start 2024-09-20T19:01:19.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.070+0000 7fc4a68fb640 1 -- start start 2024-09-20T19:01:19.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.071+0000 7fc4a68fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4a0100800 0x7fc4a019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:19.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.071+0000 7fc4a68fb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4a0106800 0x7fc4a019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:19.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.071+0000 7fc4a68fb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a010dcd0 con 0x7fc4a0100800 2024-09-20T19:01:19.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.071+0000 7fc4a68fb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a010db50 con 0x7fc4a0106800 2024-09-20T19:01:19.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.071+0000 7fc49ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4a0100800 0x7fc4a019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:19.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.071+0000 7fc49ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4a0100800 0x7fc4a019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33542/0 (socket says 172.21.15.17:33542) 2024-09-20T19:01:19.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.071+0000 7fc49ffff640 1 -- 172.21.15.17:0/3827757050 learned_addr learned my addr 172.21.15.17:0/3827757050 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:01:19.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.071+0000 7fc49f7fe640 1 --2- 172.21.15.17:0/3827757050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4a0106800 0x7fc4a019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:19.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.071+0000 7fc49ffff640 1 -- 172.21.15.17:0/3827757050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4a0106800 msgr2=0x7fc4a019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:19.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.071+0000 7fc49ffff640 1 --2- 172.21.15.17:0/3827757050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4a0106800 0x7fc4a019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.071+0000 7fc49ffff640 1 -- 172.21.15.17:0/3827757050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a0197800 con 0x7fc4a0100800 2024-09-20T19:01:19.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.071+0000 7fc49ffff640 1 --2- 172.21.15.17:0/3827757050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4a0100800 0x7fc4a019d680 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c8f0 tx=0x7fc49000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:19.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.072+0000 7fc49d7fa640 1 -- 172.21.15.17:0/3827757050 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc4900079b0 con 0x7fc4a0100800 2024-09-20T19:01:19.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.072+0000 7fc4a68fb640 1 -- 172.21.15.17:0/3827757050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a0197af0 con 0x7fc4a0100800 2024-09-20T19:01:19.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.072+0000 7fc49d7fa640 1 -- 172.21.15.17:0/3827757050 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc4900054e0 con 0x7fc4a0100800 2024-09-20T19:01:19.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.072+0000 7fc49d7fa640 1 -- 172.21.15.17:0/3827757050 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc490004dd0 con 0x7fc4a0100800 2024-09-20T19:01:19.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.072+0000 7fc4a68fb640 1 -- 172.21.15.17:0/3827757050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a0198050 con 0x7fc4a0100800 2024-09-20T19:01:19.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.073+0000 7fc4a68fb640 1 -- 172.21.15.17:0/3827757050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a0101f40 con 0x7fc4a0100800 2024-09-20T19:01:19.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.074+0000 7fc49d7fa640 1 -- 172.21.15.17:0/3827757050 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc490005020 con 0x7fc4a0100800 2024-09-20T19:01:19.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.074+0000 7fc49d7fa640 1 --2- 172.21.15.17:0/3827757050 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc48807af30 0x7fc48807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:19.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.074+0000 7fc49d7fa640 1 -- 172.21.15.17:0/3827757050 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fc49009df10 con 0x7fc4a0100800 2024-09-20T19:01:19.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.074+0000 7fc49f7fe640 1 --2- 172.21.15.17:0/3827757050 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc48807af30 0x7fc48807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:19.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.075+0000 7fc49f7fe640 1 --2- 172.21.15.17:0/3827757050 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc48807af30 0x7fc48807d3f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0198b50 tx=0x7fc494031420 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:19.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.078+0000 7fc49d7fa640 1 -- 172.21.15.17:0/3827757050 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc490014030 con 0x7fc4a0100800 2024-09-20T19:01:19.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.282+0000 7fc4a68fb640 1 -- 172.21.15.17:0/3827757050 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc4a01983c0 con 0x7fc48807af30 2024-09-20T19:01:19.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.291+0000 7fc49d7fa640 1 -- 172.21.15.17:0/3827757050 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fc4a01983c0 con 0x7fc48807af30 2024-09-20T19:01:19.300 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:01:19.300 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (22m) 89s ago 33m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:01:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (25m) 89s ago 33m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:01:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (25m) 91s ago 33m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:01:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (21m) 89s ago 33m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:01:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (20m) 91s ago 32m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:01:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (22m) 89s ago 33m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:01:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (17m) 89s ago 28m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:01:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (16m) 89s ago 28m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:01:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (95s) 91s ago 28m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:01:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (16m) 91s ago 28m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:01:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (24m) 89s ago 34m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:01:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (23m) 91s ago 32m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:01:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (21m) 89s ago 35m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:01:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (21m) 91s ago 32m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:01:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (23m) 89s ago 33m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:01:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (23m) 91s ago 32m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:01:19.302 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (20m) 89s ago 31m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:01:19.302 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (19m) 89s ago 31m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:01:19.302 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (19m) 89s ago 30m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:01:19.302 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (18m) 91s ago 30m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:01:19.302 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (18m) 91s ago 29m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:01:19.302 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (17m) 91s ago 29m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:01:19.302 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (22m) 89s ago 33m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:01:19.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.294+0000 7fc4a68fb640 1 -- 172.21.15.17:0/3827757050 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc48807af30 msgr2=0x7fc48807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:19.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.294+0000 7fc4a68fb640 1 --2- 172.21.15.17:0/3827757050 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc48807af30 0x7fc48807d3f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0198b50 tx=0x7fc494031420 comp rx=0 tx=0).stop 2024-09-20T19:01:19.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.294+0000 7fc4a68fb640 1 -- 172.21.15.17:0/3827757050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4a0100800 msgr2=0x7fc4a019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:19.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.294+0000 7fc4a68fb640 1 --2- 172.21.15.17:0/3827757050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4a0100800 0x7fc4a019d680 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c8f0 tx=0x7fc49000cdb0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.294+0000 7fc4a68fb640 1 -- 172.21.15.17:0/3827757050 shutdown_connections 2024-09-20T19:01:19.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.294+0000 7fc4a68fb640 1 --2- 172.21.15.17:0/3827757050 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc48807af30 0x7fc48807d3f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.294+0000 7fc4a68fb640 1 --2- 172.21.15.17:0/3827757050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4a0106800 0x7fc4a019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.294+0000 7fc4a68fb640 1 --2- 172.21.15.17:0/3827757050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4a0100800 0x7fc4a019d680 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.294+0000 7fc4a68fb640 1 -- 172.21.15.17:0/3827757050 >> 172.21.15.17:0/3827757050 conn(0x7fc4a00fc520 msgr2=0x7fc4a006a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:19.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.294+0000 7fc4a68fb640 1 -- 172.21.15.17:0/3827757050 shutdown_connections 2024-09-20T19:01:19.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.294+0000 7fc4a68fb640 1 -- 172.21.15.17:0/3827757050 wait complete. 2024-09-20T19:01:19.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.376+0000 7f2f51d44640 1 -- 172.21.15.17:0/382573832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f4c1007f0 msgr2=0x7f2f4c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:19.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.376+0000 7f2f51d44640 1 --2- 172.21.15.17:0/382573832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f4c1007f0 0x7f2f4c100c50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009880 tx=0x7f2f4002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.377+0000 7f2f51d44640 1 -- 172.21.15.17:0/382573832 shutdown_connections 2024-09-20T19:01:19.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.377+0000 7f2f51d44640 1 --2- 172.21.15.17:0/382573832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f4c1007f0 0x7f2f4c100c50 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.377+0000 7f2f51d44640 1 --2- 172.21.15.17:0/382573832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f4c1067f0 0x7f2f4c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.377+0000 7f2f51d44640 1 -- 172.21.15.17:0/382573832 >> 172.21.15.17:0/382573832 conn(0x7f2f4c0fc550 msgr2=0x7f2f4c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:19.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.377+0000 7f2f51d44640 1 -- 172.21.15.17:0/382573832 shutdown_connections 2024-09-20T19:01:19.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.377+0000 7f2f51d44640 1 -- 172.21.15.17:0/382573832 wait complete. 2024-09-20T19:01:19.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.377+0000 7f2f51d44640 1 Processor -- start 2024-09-20T19:01:19.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.378+0000 7f2f51d44640 1 -- start start 2024-09-20T19:01:19.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.378+0000 7f2f51d44640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f4c1007f0 0x7f2f4c0fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:19.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.378+0000 7f2f51d44640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f4c1067f0 0x7f2f4c0fd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:19.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.378+0000 7f2f51d44640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c10dcc0 con 0x7f2f4c1007f0 2024-09-20T19:01:19.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.378+0000 7f2f51d44640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c10db40 con 0x7f2f4c1067f0 2024-09-20T19:01:19.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.378+0000 7f2f4b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f4c1007f0 0x7f2f4c0fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:19.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.378+0000 7f2f4b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f4c1007f0 0x7f2f4c0fccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33562/0 (socket says 172.21.15.17:33562) 2024-09-20T19:01:19.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.378+0000 7f2f4b7fe640 1 -- 172.21.15.17:0/1406286663 learned_addr learned my addr 172.21.15.17:0/1406286663 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:01:19.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.378+0000 7f2f4affd640 1 --2- 172.21.15.17:0/1406286663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f4c1067f0 0x7f2f4c0fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:19.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.378+0000 7f2f4b7fe640 1 -- 172.21.15.17:0/1406286663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f4c1067f0 msgr2=0x7f2f4c0fd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:19.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.378+0000 7f2f4b7fe640 1 --2- 172.21.15.17:0/1406286663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f4c1067f0 0x7f2f4c0fd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.378+0000 7f2f4b7fe640 1 -- 172.21.15.17:0/1406286663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4c0fd750 con 0x7f2f4c1007f0 2024-09-20T19:01:19.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.378+0000 7f2f4affd640 1 --2- 172.21.15.17:0/1406286663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f4c1067f0 0x7f2f4c0fd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:01:19.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.379+0000 7f2f4b7fe640 1 --2- 172.21.15.17:0/1406286663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f4c1007f0 0x7f2f4c0fccd0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00d6f0 tx=0x7f2f3c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:19.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.379+0000 7f2f48ff9640 1 -- 172.21.15.17:0/1406286663 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f3c017070 con 0x7f2f4c1007f0 2024-09-20T19:01:19.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.379+0000 7f2f48ff9640 1 -- 172.21.15.17:0/1406286663 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f3c00de00 con 0x7f2f4c1007f0 2024-09-20T19:01:19.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.379+0000 7f2f51d44640 1 -- 172.21.15.17:0/1406286663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f4c0fda40 con 0x7f2f4c1007f0 2024-09-20T19:01:19.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.379+0000 7f2f48ff9640 1 -- 172.21.15.17:0/1406286663 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f3c004bb0 con 0x7f2f4c1007f0 2024-09-20T19:01:19.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.379+0000 7f2f51d44640 1 -- 172.21.15.17:0/1406286663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f4c1a3e60 con 0x7f2f4c1007f0 2024-09-20T19:01:19.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.380+0000 7f2f51d44640 1 -- 172.21.15.17:0/1406286663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f4c101f30 con 0x7f2f4c1007f0 2024-09-20T19:01:19.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.381+0000 7f2f48ff9640 1 -- 172.21.15.17:0/1406286663 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2f3c004e60 con 0x7f2f4c1007f0 2024-09-20T19:01:19.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.382+0000 7f2f48ff9640 1 --2- 172.21.15.17:0/1406286663 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2f3407af30 0x7f2f3407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.382+0000 7f2f4affd640 1 --2- 172.21.15.17:0/1406286663 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2f3407af30 0x7f2f3407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.382+0000 7f2f48ff9640 1 -- 172.21.15.17:0/1406286663 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f2f3c09dc30 con 0x7f2f4c1007f0 2024-09-20T19:01:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.382+0000 7f2f4affd640 1 --2- 172.21.15.17:0/1406286663 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2f3407af30 0x7f2f3407d3f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0fe760 tx=0x7f2f40031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:19.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.386+0000 7f2f48ff9640 1 -- 172.21.15.17:0/1406286663 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2f3c069230 con 0x7f2f4c1007f0 2024-09-20T19:01:19.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.651+0000 7f2f51d44640 1 -- 172.21.15.17:0/1406286663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f2f4c109d70 con 0x7f2f4c1007f0 2024-09-20T19:01:19.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.652+0000 7f2f48ff9640 1 -- 172.21.15.17:0/1406286663 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f2f3c06e0e0 con 0x7f2f4c1007f0 2024-09-20T19:01:19.661 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:01:19.661 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:01:19.661 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:01:19.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:01:19.662 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:01:19.662 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:01:19.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:01:19.662 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:01:19.662 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:01:19.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:01:19.662 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:01:19.663 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:01:19.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:01:19.663 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:01:19.663 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:01:19.663 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:01:19.663 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:01:19.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.654+0000 7f2f51d44640 1 -- 172.21.15.17:0/1406286663 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2f3407af30 msgr2=0x7f2f3407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:19.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.654+0000 7f2f51d44640 1 --2- 172.21.15.17:0/1406286663 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2f3407af30 0x7f2f3407d3f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0fe760 tx=0x7f2f40031400 comp rx=0 tx=0).stop 2024-09-20T19:01:19.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.654+0000 7f2f51d44640 1 -- 172.21.15.17:0/1406286663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f4c1007f0 msgr2=0x7f2f4c0fccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:19.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.654+0000 7f2f51d44640 1 --2- 172.21.15.17:0/1406286663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f4c1007f0 0x7f2f4c0fccd0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00d6f0 tx=0x7f2f3c00dbb0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.654+0000 7f2f51d44640 1 -- 172.21.15.17:0/1406286663 shutdown_connections 2024-09-20T19:01:19.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.654+0000 7f2f51d44640 1 --2- 172.21.15.17:0/1406286663 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2f3407af30 0x7f2f3407d3f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.654+0000 7f2f51d44640 1 --2- 172.21.15.17:0/1406286663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f4c1067f0 0x7f2f4c0fd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.654+0000 7f2f51d44640 1 --2- 172.21.15.17:0/1406286663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f4c1007f0 0x7f2f4c0fccd0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.654+0000 7f2f51d44640 1 -- 172.21.15.17:0/1406286663 >> 172.21.15.17:0/1406286663 conn(0x7f2f4c0fc550 msgr2=0x7f2f4c069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:19.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.654+0000 7f2f51d44640 1 -- 172.21.15.17:0/1406286663 shutdown_connections 2024-09-20T19:01:19.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.654+0000 7f2f51d44640 1 -- 172.21.15.17:0/1406286663 wait complete. 2024-09-20T19:01:19.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.739+0000 7f0809f87640 1 -- 172.21.15.17:0/1992456507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0804102b60 msgr2=0x7f0804102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:19.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.739+0000 7f0809f87640 1 --2- 172.21.15.17:0/1992456507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0804102b60 0x7f0804102f40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009880 tx=0x7f07f402a530 comp rx=0 tx=0).stop 2024-09-20T19:01:19.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.739+0000 7f0809f87640 1 -- 172.21.15.17:0/1992456507 shutdown_connections 2024-09-20T19:01:19.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.739+0000 7f0809f87640 1 --2- 172.21.15.17:0/1992456507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0804103480 0x7f080410b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.739+0000 7f0809f87640 1 --2- 172.21.15.17:0/1992456507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0804102b60 0x7f0804102f40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.739+0000 7f0809f87640 1 -- 172.21.15.17:0/1992456507 >> 172.21.15.17:0/1992456507 conn(0x7f08040fc520 msgr2=0x7f08040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:19.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.739+0000 7f0809f87640 1 -- 172.21.15.17:0/1992456507 shutdown_connections 2024-09-20T19:01:19.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.739+0000 7f0809f87640 1 -- 172.21.15.17:0/1992456507 wait complete. 2024-09-20T19:01:19.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.739+0000 7f0809f87640 1 Processor -- start 2024-09-20T19:01:19.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.740+0000 7f0809f87640 1 -- start start 2024-09-20T19:01:19.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.740+0000 7f0809f87640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0804102b60 0x7f080419f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:19.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.740+0000 7f0809f87640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0804103480 0x7f080419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:19.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.740+0000 7f0809f87640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f080410edf0 con 0x7f0804102b60 2024-09-20T19:01:19.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.740+0000 7f0809f87640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f080410ec70 con 0x7f0804103480 2024-09-20T19:01:19.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.740+0000 7f08037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0804102b60 0x7f080419f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:19.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.740+0000 7f08037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0804102b60 0x7f080419f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33572/0 (socket says 172.21.15.17:33572) 2024-09-20T19:01:19.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.740+0000 7f08037fe640 1 -- 172.21.15.17:0/3049673390 learned_addr learned my addr 172.21.15.17:0/3049673390 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:01:19.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.740+0000 7f0802ffd640 1 --2- 172.21.15.17:0/3049673390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0804103480 0x7f080419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:19.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.740+0000 7f08037fe640 1 -- 172.21.15.17:0/3049673390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0804103480 msgr2=0x7f080419fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:19.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.740+0000 7f08037fe640 1 --2- 172.21.15.17:0/3049673390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0804103480 0x7f080419fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.740+0000 7f08037fe640 1 -- 172.21.15.17:0/3049673390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08041999f0 con 0x7f0804102b60 2024-09-20T19:01:19.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.741+0000 7f08037fe640 1 --2- 172.21.15.17:0/3049673390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0804102b60 0x7f080419f830 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f07f4004f90 tx=0x7f07f40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:19.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.741+0000 7f0800ff9640 1 -- 172.21.15.17:0/3049673390 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07f403f070 con 0x7f0804102b60 2024-09-20T19:01:19.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.741+0000 7f0800ff9640 1 -- 172.21.15.17:0/3049673390 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07f4004c70 con 0x7f0804102b60 2024-09-20T19:01:19.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.741+0000 7f0809f87640 1 -- 172.21.15.17:0/3049673390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0804199c80 con 0x7f0804102b60 2024-09-20T19:01:19.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.741+0000 7f0800ff9640 1 -- 172.21.15.17:0/3049673390 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07f4035030 con 0x7f0804102b60 2024-09-20T19:01:19.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.741+0000 7f0809f87640 1 -- 172.21.15.17:0/3049673390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f080419a1b0 con 0x7f0804102b60 2024-09-20T19:01:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.742+0000 7f0809f87640 1 -- 172.21.15.17:0/3049673390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f080406a9f0 con 0x7f0804102b60 2024-09-20T19:01:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.742+0000 7f0800ff9640 1 -- 172.21.15.17:0/3049673390 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f07f4042070 con 0x7f0804102b60 2024-09-20T19:01:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.743+0000 7f0800ff9640 1 --2- 172.21.15.17:0/3049673390 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f07ec07af80 0x7f07ec07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.743+0000 7f0800ff9640 1 -- 172.21.15.17:0/3049673390 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f07f40be940 con 0x7f0804102b60 2024-09-20T19:01:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.743+0000 7f0802ffd640 1 --2- 172.21.15.17:0/3049673390 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f07ec07af80 0x7f07ec07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.743+0000 7f0802ffd640 1 --2- 172.21.15.17:0/3049673390 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f07ec07af80 0x7f07ec07d440 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f07f8005fd0 tx=0x7f07f8005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:19.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.747+0000 7f0800ff9640 1 -- 172.21.15.17:0/3049673390 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f07f4089fc0 con 0x7f0804102b60 2024-09-20T19:01:19.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.974+0000 7f0809f87640 1 -- 172.21.15.17:0/3049673390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f080419af20 con 0x7f0804102b60 2024-09-20T19:01:19.983 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:19 smithi017 ceph-mon[108970]: pgmap v778: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:19.983 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:19 smithi017 ceph-mon[108970]: from='client.35240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:19.983 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:19 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1406286663' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:01:19.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.974+0000 7f0800ff9640 1 -- 172.21.15.17:0/3049673390 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7f07f408ee70 con 0x7f0804102b60 2024-09-20T19:01:19.984 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:01:19.984 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:01:19.984 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:01:19.984 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:01:19.984 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:01:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:01:19.984 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:01:19.984 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:01:19.984 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:01:19.985 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:01:19.985 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:01:19.985 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:01:19.985 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:01:19.985 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:01:19.985 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:01:19.985 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:01:19.985 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:01:19.985 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:01:19.985 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:01:19.985 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:01:19.986 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:01:19.986 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:01:19.986 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:01:19.986 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:01:19.986 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:01:19.986 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:01:19.986 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:01:19.986 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:01:19.986 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:01:19.986 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:01:19.986 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:01:19.987 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:01:19.987 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:01:19.987 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:01:19.987 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:01:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:01:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:01:19.987 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:01:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:01:19.987 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:01:19.987 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:01:19.987 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:01:19.987 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:01:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:01:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.977+0000 7f0809f87640 1 -- 172.21.15.17:0/3049673390 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f07ec07af80 msgr2=0x7f07ec07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.977+0000 7f0809f87640 1 --2- 172.21.15.17:0/3049673390 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f07ec07af80 0x7f07ec07d440 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f07f8005fd0 tx=0x7f07f8005850 comp rx=0 tx=0).stop 2024-09-20T19:01:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.977+0000 7f0809f87640 1 -- 172.21.15.17:0/3049673390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0804102b60 msgr2=0x7f080419f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.977+0000 7f0809f87640 1 --2- 172.21.15.17:0/3049673390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0804102b60 0x7f080419f830 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f07f4004f90 tx=0x7f07f40048f0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.977+0000 7f0809f87640 1 -- 172.21.15.17:0/3049673390 shutdown_connections 2024-09-20T19:01:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.977+0000 7f0809f87640 1 --2- 172.21.15.17:0/3049673390 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f07ec07af80 0x7f07ec07d440 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.977+0000 7f0809f87640 1 --2- 172.21.15.17:0/3049673390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0804103480 0x7f080419fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.977+0000 7f0809f87640 1 --2- 172.21.15.17:0/3049673390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0804102b60 0x7f080419f830 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:19.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.977+0000 7f0809f87640 1 -- 172.21.15.17:0/3049673390 >> 172.21.15.17:0/3049673390 conn(0x7f08040fc520 msgr2=0x7f0804100ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:19.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.977+0000 7f0809f87640 1 -- 172.21.15.17:0/3049673390 shutdown_connections 2024-09-20T19:01:19.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:19.977+0000 7f0809f87640 1 -- 172.21.15.17:0/3049673390 wait complete. 2024-09-20T19:01:20.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.063+0000 7f4c35da0640 1 -- 172.21.15.17:0/390716490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c30100610 msgr2=0x7f4c30100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:20.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.063+0000 7f4c35da0640 1 --2- 172.21.15.17:0/390716490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c30100610 0x7f4c30100a90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009880 tx=0x7f4c2402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:01:20.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.064+0000 7f4c35da0640 1 -- 172.21.15.17:0/390716490 shutdown_connections 2024-09-20T19:01:20.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.064+0000 7f4c35da0640 1 --2- 172.21.15.17:0/390716490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c30100610 0x7f4c30100a90 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:20.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.064+0000 7f4c35da0640 1 --2- 172.21.15.17:0/390716490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c301066a0 0x7f4c30106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:20.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.064+0000 7f4c35da0640 1 -- 172.21.15.17:0/390716490 >> 172.21.15.17:0/390716490 conn(0x7f4c300fc310 msgr2=0x7f4c300fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.064+0000 7f4c35da0640 1 -- 172.21.15.17:0/390716490 shutdown_connections 2024-09-20T19:01:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.064+0000 7f4c35da0640 1 -- 172.21.15.17:0/390716490 wait complete. 2024-09-20T19:01:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.064+0000 7f4c35da0640 1 Processor -- start 2024-09-20T19:01:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.064+0000 7f4c35da0640 1 -- start start 2024-09-20T19:01:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.065+0000 7f4c35da0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c30100610 0x7f4c30196690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.065+0000 7f4c35da0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c301066a0 0x7f4c30196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.065+0000 7f4c35da0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3010dad0 con 0x7f4c30100610 2024-09-20T19:01:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.065+0000 7f4c35da0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3010d950 con 0x7f4c301066a0 2024-09-20T19:01:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.065+0000 7f4c34d9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c30100610 0x7f4c30196690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.065+0000 7f4c34d9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c30100610 0x7f4c30196690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33594/0 (socket says 172.21.15.17:33594) 2024-09-20T19:01:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.065+0000 7f4c34d9e640 1 -- 172.21.15.17:0/3200809980 learned_addr learned my addr 172.21.15.17:0/3200809980 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:01:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.065+0000 7f4c34d9e640 1 -- 172.21.15.17:0/3200809980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c301066a0 msgr2=0x7f4c30196bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.065+0000 7f4c2ffff640 1 --2- 172.21.15.17:0/3200809980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c301066a0 0x7f4c30196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.065+0000 7f4c34d9e640 1 --2- 172.21.15.17:0/3200809980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c301066a0 0x7f4c30196bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.065+0000 7f4c34d9e640 1 -- 172.21.15.17:0/3200809980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c3019af60 con 0x7f4c30100610 2024-09-20T19:01:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.065+0000 7f4c2ffff640 1 --2- 172.21.15.17:0/3200809980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c301066a0 0x7f4c30196bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:01:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.065+0000 7f4c34d9e640 1 --2- 172.21.15.17:0/3200809980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c30100610 0x7f4c30196690 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000d6f0 tx=0x7f4c2000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.065+0000 7f4c2dffb640 1 -- 172.21.15.17:0/3200809980 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c20017070 con 0x7f4c30100610 2024-09-20T19:01:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.065+0000 7f4c2dffb640 1 -- 172.21.15.17:0/3200809980 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4c2000de00 con 0x7f4c30100610 2024-09-20T19:01:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.066+0000 7f4c35da0640 1 -- 172.21.15.17:0/3200809980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c3019b250 con 0x7f4c30100610 2024-09-20T19:01:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.066+0000 7f4c2dffb640 1 -- 172.21.15.17:0/3200809980 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c20004bb0 con 0x7f4c30100610 2024-09-20T19:01:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.066+0000 7f4c35da0640 1 -- 172.21.15.17:0/3200809980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c3019b7e0 con 0x7f4c30100610 2024-09-20T19:01:20.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.067+0000 7f4c35da0640 1 -- 172.21.15.17:0/3200809980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c30101d50 con 0x7f4c30100610 2024-09-20T19:01:20.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.067+0000 7f4c2dffb640 1 -- 172.21.15.17:0/3200809980 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4c20009a30 con 0x7f4c30100610 2024-09-20T19:01:20.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.068+0000 7f4c2dffb640 1 --2- 172.21.15.17:0/3200809980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c1807af80 0x7f4c1807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:20.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.068+0000 7f4c2dffb640 1 -- 172.21.15.17:0/3200809980 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f4c2009db70 con 0x7f4c30100610 2024-09-20T19:01:20.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.068+0000 7f4c2ffff640 1 --2- 172.21.15.17:0/3200809980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c1807af80 0x7f4c1807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:20.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.068+0000 7f4c2ffff640 1 --2- 172.21.15.17:0/3200809980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c1807af80 0x7f4c1807d440 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4c24006010 tx=0x7f4c240095f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:20.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.072+0000 7f4c2dffb640 1 -- 172.21.15.17:0/3200809980 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c200691f0 con 0x7f4c30100610 2024-09-20T19:01:20.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:19 smithi172 ceph-mon[80431]: pgmap v778: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:20.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:19 smithi172 ceph-mon[80431]: from='client.35240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:20.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:19 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1406286663' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:01:20.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.279+0000 7f4c35da0640 1 -- 172.21.15.17:0/3200809980 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4c3019ba90 con 0x7f4c1807af80 2024-09-20T19:01:20.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.280+0000 7f4c2dffb640 1 -- 172.21.15.17:0/3200809980 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f4c3019ba90 con 0x7f4c1807af80 2024-09-20T19:01:20.289 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:01:20.289 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:01:20.289 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:01:20.289 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:01:20.289 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:01:20.290 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:01:20.290 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:01:20.290 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:01:20.290 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:01:20.290 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:01:20.290 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:01:20.290 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:01:20.290 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:01:20.290 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:01:20.290 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:01:20.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.283+0000 7f4c35da0640 1 -- 172.21.15.17:0/3200809980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c1807af80 msgr2=0x7f4c1807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:20.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.283+0000 7f4c35da0640 1 --2- 172.21.15.17:0/3200809980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c1807af80 0x7f4c1807d440 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4c24006010 tx=0x7f4c240095f0 comp rx=0 tx=0).stop 2024-09-20T19:01:20.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.283+0000 7f4c35da0640 1 -- 172.21.15.17:0/3200809980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c30100610 msgr2=0x7f4c30196690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:20.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.283+0000 7f4c35da0640 1 --2- 172.21.15.17:0/3200809980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c30100610 0x7f4c30196690 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000d6f0 tx=0x7f4c2000dbb0 comp rx=0 tx=0).stop 2024-09-20T19:01:20.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.283+0000 7f4c35da0640 1 -- 172.21.15.17:0/3200809980 shutdown_connections 2024-09-20T19:01:20.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.283+0000 7f4c35da0640 1 --2- 172.21.15.17:0/3200809980 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4c1807af80 0x7f4c1807d440 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:20.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.283+0000 7f4c35da0640 1 --2- 172.21.15.17:0/3200809980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c301066a0 0x7f4c30196bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:20.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.283+0000 7f4c35da0640 1 --2- 172.21.15.17:0/3200809980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c30100610 0x7f4c30196690 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:20.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.283+0000 7f4c35da0640 1 -- 172.21.15.17:0/3200809980 >> 172.21.15.17:0/3200809980 conn(0x7f4c300fc310 msgr2=0x7f4c300fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:20.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.283+0000 7f4c35da0640 1 -- 172.21.15.17:0/3200809980 shutdown_connections 2024-09-20T19:01:20.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.283+0000 7f4c35da0640 1 -- 172.21.15.17:0/3200809980 wait complete. 2024-09-20T19:01:20.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.367+0000 7fad0dbda640 1 -- 172.21.15.17:0/1171714297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad08102b20 msgr2=0x7fad08102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:20.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.367+0000 7fad0dbda640 1 --2- 172.21.15.17:0/1171714297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad08102b20 0x7fad08102f00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7facf80098b0 tx=0x7facf802a560 comp rx=0 tx=0).stop 2024-09-20T19:01:20.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.367+0000 7fad0dbda640 1 -- 172.21.15.17:0/1171714297 shutdown_connections 2024-09-20T19:01:20.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.367+0000 7fad0dbda640 1 --2- 172.21.15.17:0/1171714297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad08103440 0x7fad0810b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:20.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.367+0000 7fad0dbda640 1 --2- 172.21.15.17:0/1171714297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad08102b20 0x7fad08102f00 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:20.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.367+0000 7fad0dbda640 1 -- 172.21.15.17:0/1171714297 >> 172.21.15.17:0/1171714297 conn(0x7fad080fc520 msgr2=0x7fad080fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:20.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.367+0000 7fad0dbda640 1 -- 172.21.15.17:0/1171714297 shutdown_connections 2024-09-20T19:01:20.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.367+0000 7fad0dbda640 1 -- 172.21.15.17:0/1171714297 wait complete. 2024-09-20T19:01:20.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.368+0000 7fad0dbda640 1 Processor -- start 2024-09-20T19:01:20.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.368+0000 7fad0dbda640 1 -- start start 2024-09-20T19:01:20.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.368+0000 7fad0dbda640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad08102b20 0x7fad0819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.368+0000 7fad0dbda640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad08103440 0x7fad0819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.368+0000 7fad0dbda640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fad0810edd0 con 0x7fad08103440 2024-09-20T19:01:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.368+0000 7fad0dbda640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad0810ec50 con 0x7fad08102b20 2024-09-20T19:01:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.369+0000 7fad06ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad08103440 0x7fad0819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.369+0000 7fad06ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad08103440 0x7fad0819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33604/0 (socket says 172.21.15.17:33604) 2024-09-20T19:01:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.369+0000 7fad06ffd640 1 -- 172.21.15.17:0/4259528420 learned_addr learned my addr 172.21.15.17:0/4259528420 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:01:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.369+0000 7fad077fe640 1 --2- 172.21.15.17:0/4259528420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad08102b20 0x7fad0819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.369+0000 7fad06ffd640 1 -- 172.21.15.17:0/4259528420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad08102b20 msgr2=0x7fad0819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.369+0000 7fad06ffd640 1 --2- 172.21.15.17:0/4259528420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad08102b20 0x7fad0819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.369+0000 7fad06ffd640 1 -- 172.21.15.17:0/4259528420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad08197800 con 0x7fad08103440 2024-09-20T19:01:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.369+0000 7fad06ffd640 1 --2- 172.21.15.17:0/4259528420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad08103440 0x7fad0819dbc0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7facfc00c8a0 tx=0x7facfc00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.369+0000 7fad04ff9640 1 -- 172.21.15.17:0/4259528420 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7facfc0079b0 con 0x7fad08103440 2024-09-20T19:01:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.369+0000 7fad0dbda640 1 -- 172.21.15.17:0/4259528420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad08197af0 con 0x7fad08103440 2024-09-20T19:01:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.369+0000 7fad04ff9640 1 -- 172.21.15.17:0/4259528420 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7facfc007b50 con 0x7fad08103440 2024-09-20T19:01:20.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.369+0000 7fad04ff9640 1 -- 172.21.15.17:0/4259528420 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7facfc018700 con 0x7fad08103440 2024-09-20T19:01:20.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.369+0000 7fad0dbda640 1 -- 172.21.15.17:0/4259528420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad08198080 con 0x7fad08103440 2024-09-20T19:01:20.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.370+0000 7fad0dbda640 1 -- 172.21.15.17:0/4259528420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad0806aa30 con 0x7fad08103440 2024-09-20T19:01:20.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.371+0000 7fad04ff9640 1 -- 172.21.15.17:0/4259528420 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7facfc007d00 con 0x7fad08103440 2024-09-20T19:01:20.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.371+0000 7fad04ff9640 1 --2- 172.21.15.17:0/4259528420 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7facf007af40 0x7facf007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:20.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.372+0000 7fad04ff9640 1 -- 172.21.15.17:0/4259528420 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7facfc09e310 con 0x7fad08103440 2024-09-20T19:01:20.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.372+0000 7fad077fe640 1 --2- 172.21.15.17:0/4259528420 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7facf007af40 0x7facf007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:20.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.372+0000 7fad077fe640 1 --2- 172.21.15.17:0/4259528420 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7facf007af40 0x7facf007d400 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7facf80096c0 tx=0x7facf8000bc0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:20.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.376+0000 7fad04ff9640 1 -- 172.21.15.17:0/4259528420 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7facfc014030 con 0x7fad08103440 2024-09-20T19:01:20.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.636+0000 7fad0dbda640 1 -- 172.21.15.17:0/4259528420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fad08198d60 con 0x7fad08103440 2024-09-20T19:01:20.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.636+0000 7fad04ff9640 1 -- 172.21.15.17:0/4259528420 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fad08198d60 con 0x7fad08103440 2024-09-20T19:01:20.645 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:01:20.645 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:01:20.645 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:01:20.645 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:01:20.645 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:01:20.646 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:01:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:01:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:01:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:01:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:01:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:01:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:01:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:01:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:01:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:01:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:01:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:01:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:01:20.646 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:01:20.647 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:01:20.647 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:01:20.647 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:01:20.647 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:01:20.647 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:01:20.647 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:01:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.638+0000 7fad0dbda640 1 -- 172.21.15.17:0/4259528420 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7facf007af40 msgr2=0x7facf007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.638+0000 7fad0dbda640 1 --2- 172.21.15.17:0/4259528420 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7facf007af40 0x7facf007d400 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7facf80096c0 tx=0x7facf8000bc0 comp rx=0 tx=0).stop 2024-09-20T19:01:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.638+0000 7fad0dbda640 1 -- 172.21.15.17:0/4259528420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad08103440 msgr2=0x7fad0819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.638+0000 7fad0dbda640 1 --2- 172.21.15.17:0/4259528420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad08103440 0x7fad0819dbc0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7facfc00c8a0 tx=0x7facfc00cd60 comp rx=0 tx=0).stop 2024-09-20T19:01:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.638+0000 7fad0dbda640 1 -- 172.21.15.17:0/4259528420 shutdown_connections 2024-09-20T19:01:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.638+0000 7fad0dbda640 1 --2- 172.21.15.17:0/4259528420 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7facf007af40 0x7facf007d400 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.638+0000 7fad0dbda640 1 --2- 172.21.15.17:0/4259528420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad08103440 0x7fad0819dbc0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.638+0000 7fad0dbda640 1 --2- 172.21.15.17:0/4259528420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad08102b20 0x7fad0819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.638+0000 7fad0dbda640 1 -- 172.21.15.17:0/4259528420 >> 172.21.15.17:0/4259528420 conn(0x7fad080fc520 msgr2=0x7fad08103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.639+0000 7fad0dbda640 1 -- 172.21.15.17:0/4259528420 shutdown_connections 2024-09-20T19:01:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:20.639+0000 7fad0dbda640 1 -- 172.21.15.17:0/4259528420 wait complete. 2024-09-20T19:01:21.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:20 smithi017 ceph-mon[108970]: from='client.35244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:21.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:20 smithi017 ceph-mon[108970]: from='client.35248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:21.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:20 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3049673390' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:01:21.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:20 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4259528420' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:01:21.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:20 smithi172 ceph-mon[80431]: from='client.35244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:21.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:20 smithi172 ceph-mon[80431]: from='client.35248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:21.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:20 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3049673390' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:01:21.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:20 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4259528420' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:01:22.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:21 smithi017 ceph-mon[108970]: from='client.35260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:22.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:21 smithi017 ceph-mon[108970]: pgmap v779: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:22.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:21 smithi172 ceph-mon[80431]: from='client.35260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:22.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:21 smithi172 ceph-mon[80431]: pgmap v779: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:22.893 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:01:23.104 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:01:24.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:23 smithi172 ceph-mon[80431]: pgmap v780: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:24.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:23 smithi017 ceph-mon[108970]: pgmap v780: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:25.893 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:25 smithi017 ceph-mon[108970]: pgmap v781: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:26.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:25 smithi172 ceph-mon[80431]: pgmap v781: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:28.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:27 smithi017 ceph-mon[108970]: pgmap v782: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:28.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:27 smithi172 ceph-mon[80431]: pgmap v782: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:30.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:29 smithi017 ceph-mon[108970]: pgmap v783: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:30.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:29 smithi172 ceph-mon[80431]: pgmap v783: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:31.893 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:31 smithi017 ceph-mon[108970]: pgmap v784: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:32.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:31 smithi172 ceph-mon[80431]: pgmap v784: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:34.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:33 smithi017 ceph-mon[108970]: pgmap v785: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:34.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:33 smithi172 ceph-mon[80431]: pgmap v785: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:36.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:35 smithi017 ceph-mon[108970]: pgmap v786: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:36.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:35 smithi172 ceph-mon[80431]: pgmap v786: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:37.893 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:37 smithi017 ceph-mon[108970]: pgmap v787: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:37.893 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:01:38.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:37 smithi172 ceph-mon[80431]: pgmap v787: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:38.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:01:40.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:39 smithi017 ceph-mon[108970]: pgmap v788: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:40.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:39 smithi172 ceph-mon[80431]: pgmap v788: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:42.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:41 smithi017 ceph-mon[108970]: pgmap v789: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:42.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:41 smithi172 ceph-mon[80431]: pgmap v789: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:43.893 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:43 smithi017 ceph-mon[108970]: pgmap v790: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:44.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:43 smithi172 ceph-mon[80431]: pgmap v790: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:46.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:45 smithi017 ceph-mon[108970]: pgmap v791: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:46.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:45 smithi172 ceph-mon[80431]: pgmap v791: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:48.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:47 smithi017 ceph-mon[108970]: pgmap v792: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:48.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:47 smithi172 ceph-mon[80431]: pgmap v792: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:50.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:49 smithi017 ceph-mon[108970]: pgmap v793: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:50.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:49 smithi172 ceph-mon[80431]: pgmap v793: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:50.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.737+0000 7f2b3888d640 1 -- 172.21.15.17:0/4171141991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b341006d0 msgr2=0x7f2b34100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:50.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.737+0000 7f2b3888d640 1 --2- 172.21.15.17:0/4171141991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b341006d0 0x7f2b34100ab0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009880 tx=0x7f2b2402a490 comp rx=0 tx=0).stop 2024-09-20T19:01:50.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.737+0000 7f2b3888d640 1 -- 172.21.15.17:0/4171141991 shutdown_connections 2024-09-20T19:01:50.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.737+0000 7f2b3888d640 1 --2- 172.21.15.17:0/4171141991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b34101080 0x7f2b3410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:50.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.737+0000 7f2b3888d640 1 --2- 172.21.15.17:0/4171141991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b341006d0 0x7f2b34100ab0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:50.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.737+0000 7f2b3888d640 1 -- 172.21.15.17:0/4171141991 >> 172.21.15.17:0/4171141991 conn(0x7f2b340fc520 msgr2=0x7f2b340fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:50.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.737+0000 7f2b3888d640 1 -- 172.21.15.17:0/4171141991 shutdown_connections 2024-09-20T19:01:50.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.738+0000 7f2b3888d640 1 -- 172.21.15.17:0/4171141991 wait complete. 2024-09-20T19:01:50.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.738+0000 7f2b3888d640 1 Processor -- start 2024-09-20T19:01:50.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.739+0000 7f2b3888d640 1 -- start start 2024-09-20T19:01:50.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.739+0000 7f2b3888d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b341006d0 0x7f2b3419f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:50.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.739+0000 7f2b3888d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b34101080 0x7f2b3419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:50.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.739+0000 7f2b3888d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2b34110f90 con 0x7f2b341006d0 2024-09-20T19:01:50.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.739+0000 7f2b3888d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2b34110e10 con 0x7f2b34101080 2024-09-20T19:01:50.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.739+0000 7f2b3259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b341006d0 0x7f2b3419f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:50.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.739+0000 7f2b3259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b341006d0 0x7f2b3419f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53984/0 (socket says 172.21.15.17:53984) 2024-09-20T19:01:50.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.739+0000 7f2b3259c640 1 -- 172.21.15.17:0/17966062 learned_addr learned my addr 172.21.15.17:0/17966062 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:01:50.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.739+0000 7f2b29d9b640 1 --2- 172.21.15.17:0/17966062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b34101080 0x7f2b3419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:50.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.739+0000 7f2b3259c640 1 -- 172.21.15.17:0/17966062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b34101080 msgr2=0x7f2b3419fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:50.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.739+0000 7f2b3259c640 1 --2- 172.21.15.17:0/17966062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b34101080 0x7f2b3419fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:50.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.739+0000 7f2b3259c640 1 -- 172.21.15.17:0/17966062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b34199a00 con 0x7f2b341006d0 2024-09-20T19:01:50.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.740+0000 7f2b3259c640 1 --2- 172.21.15.17:0/17966062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b341006d0 0x7f2b3419f840 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2b24031460 tx=0x7f2b240045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:50.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.740+0000 7f2b2bfff640 1 -- 172.21.15.17:0/17966062 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2b2403f070 con 0x7f2b341006d0 2024-09-20T19:01:50.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.740+0000 7f2b2bfff640 1 -- 172.21.15.17:0/17966062 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2b24004b10 con 0x7f2b341006d0 2024-09-20T19:01:50.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.740+0000 7f2b3888d640 1 -- 172.21.15.17:0/17966062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b34199c90 con 0x7f2b341006d0 2024-09-20T19:01:50.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.740+0000 7f2b2bfff640 1 -- 172.21.15.17:0/17966062 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2b24035030 con 0x7f2b341006d0 2024-09-20T19:01:50.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.740+0000 7f2b3888d640 1 -- 172.21.15.17:0/17966062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b3419a220 con 0x7f2b341006d0 2024-09-20T19:01:50.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.741+0000 7f2b3888d640 1 -- 172.21.15.17:0/17966062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b3406aa10 con 0x7f2b341006d0 2024-09-20T19:01:50.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.742+0000 7f2b2bfff640 1 -- 172.21.15.17:0/17966062 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2b24042070 con 0x7f2b341006d0 2024-09-20T19:01:50.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.742+0000 7f2b2bfff640 1 --2- 172.21.15.17:0/17966062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2b2007af90 0x7f2b2007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:50.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.743+0000 7f2b2bfff640 1 -- 172.21.15.17:0/17966062 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f2b240bea10 con 0x7f2b341006d0 2024-09-20T19:01:50.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.743+0000 7f2b29d9b640 1 --2- 172.21.15.17:0/17966062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2b2007af90 0x7f2b2007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:50.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.743+0000 7f2b29d9b640 1 --2- 172.21.15.17:0/17966062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2b2007af90 0x7f2b2007d450 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2b340fef60 tx=0x7f2b1c00b410 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:50.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.747+0000 7f2b2bfff640 1 -- 172.21.15.17:0/17966062 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2b2408a090 con 0x7f2b341006d0 2024-09-20T19:01:50.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.952+0000 7f2b3888d640 1 -- 172.21.15.17:0/17966062 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2b3419af30 con 0x7f2b2007af90 2024-09-20T19:01:50.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.953+0000 7f2b2bfff640 1 -- 172.21.15.17:0/17966062 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2b3419af30 con 0x7f2b2007af90 2024-09-20T19:01:50.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.955+0000 7f2b3888d640 1 -- 172.21.15.17:0/17966062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2b2007af90 msgr2=0x7f2b2007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:50.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.955+0000 7f2b3888d640 1 --2- 172.21.15.17:0/17966062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2b2007af90 0x7f2b2007d450 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2b340fef60 tx=0x7f2b1c00b410 comp rx=0 tx=0).stop 2024-09-20T19:01:50.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.955+0000 7f2b3888d640 1 -- 172.21.15.17:0/17966062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b341006d0 msgr2=0x7f2b3419f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:50.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.955+0000 7f2b3888d640 1 --2- 172.21.15.17:0/17966062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b341006d0 0x7f2b3419f840 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2b24031460 tx=0x7f2b240045e0 comp rx=0 tx=0).stop 2024-09-20T19:01:50.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.955+0000 7f2b3888d640 1 -- 172.21.15.17:0/17966062 shutdown_connections 2024-09-20T19:01:50.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.955+0000 7f2b3888d640 1 --2- 172.21.15.17:0/17966062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2b2007af90 0x7f2b2007d450 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:50.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.955+0000 7f2b3888d640 1 --2- 172.21.15.17:0/17966062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b34101080 0x7f2b3419fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:50.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.955+0000 7f2b3888d640 1 --2- 172.21.15.17:0/17966062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b341006d0 0x7f2b3419f840 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:50.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.955+0000 7f2b3888d640 1 -- 172.21.15.17:0/17966062 >> 172.21.15.17:0/17966062 conn(0x7f2b340fc520 msgr2=0x7f2b340fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:50.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.956+0000 7f2b3888d640 1 -- 172.21.15.17:0/17966062 shutdown_connections 2024-09-20T19:01:50.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:50.956+0000 7f2b3888d640 1 -- 172.21.15.17:0/17966062 wait complete. 2024-09-20T19:01:50.972 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:01:51.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.040+0000 7f36b3d22640 1 -- 172.21.15.17:0/3579685417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36ac1033d0 msgr2=0x7f36ac10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:51.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.040+0000 7f36b3d22640 1 --2- 172.21.15.17:0/3579685417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36ac1033d0 0x7f36ac10b8c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f369c009880 tx=0x7f369c02a530 comp rx=0 tx=0).stop 2024-09-20T19:01:51.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.040+0000 7f36b3d22640 1 -- 172.21.15.17:0/3579685417 shutdown_connections 2024-09-20T19:01:51.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.040+0000 7f36b3d22640 1 --2- 172.21.15.17:0/3579685417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36ac1033d0 0x7f36ac10b8c0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.040+0000 7f36b3d22640 1 --2- 172.21.15.17:0/3579685417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36ac102ab0 0x7f36ac102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.040+0000 7f36b3d22640 1 -- 172.21.15.17:0/3579685417 >> 172.21.15.17:0/3579685417 conn(0x7f36ac0fc550 msgr2=0x7f36ac0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:51.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.041+0000 7f36b3d22640 1 -- 172.21.15.17:0/3579685417 shutdown_connections 2024-09-20T19:01:51.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.041+0000 7f36b3d22640 1 -- 172.21.15.17:0/3579685417 wait complete. 2024-09-20T19:01:51.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.041+0000 7f36b3d22640 1 Processor -- start 2024-09-20T19:01:51.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.041+0000 7f36b3d22640 1 -- start start 2024-09-20T19:01:51.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.042+0000 7f36b3d22640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36ac102ab0 0x7f36ac19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:51.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.042+0000 7f36b3d22640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36ac1033d0 0x7f36ac19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:51.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.042+0000 7f36b3d22640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac10ede0 con 0x7f36ac102ab0 2024-09-20T19:01:51.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.042+0000 7f36b3d22640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac10ec60 con 0x7f36ac1033d0 2024-09-20T19:01:51.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.042+0000 7f36b1abe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36ac102ab0 0x7f36ac19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:51.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.042+0000 7f36b1abe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36ac102ab0 0x7f36ac19d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53988/0 (socket says 172.21.15.17:53988) 2024-09-20T19:01:51.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.042+0000 7f36b1abe640 1 -- 172.21.15.17:0/3296531381 learned_addr learned my addr 172.21.15.17:0/3296531381 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:01:51.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.042+0000 7f36b1abe640 1 -- 172.21.15.17:0/3296531381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36ac1033d0 msgr2=0x7f36ac19dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:51.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.042+0000 7f36b12bd640 1 --2- 172.21.15.17:0/3296531381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36ac1033d0 0x7f36ac19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:51.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.042+0000 7f36b1abe640 1 --2- 172.21.15.17:0/3296531381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36ac1033d0 0x7f36ac19dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.042+0000 7f36b1abe640 1 -- 172.21.15.17:0/3296531381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ac197810 con 0x7f36ac102ab0 2024-09-20T19:01:51.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.042+0000 7f36b1abe640 1 --2- 172.21.15.17:0/3296531381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36ac102ab0 0x7f36ac19d690 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f36a800e970 tx=0x7f36a800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:51.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.042+0000 7f36a2ffd640 1 -- 172.21.15.17:0/3296531381 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36a800cac0 con 0x7f36ac102ab0 2024-09-20T19:01:51.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.042+0000 7f36a2ffd640 1 -- 172.21.15.17:0/3296531381 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f36a80054e0 con 0x7f36ac102ab0 2024-09-20T19:01:51.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.042+0000 7f36b3d22640 1 -- 172.21.15.17:0/3296531381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ac197b00 con 0x7f36ac102ab0 2024-09-20T19:01:51.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.042+0000 7f36a2ffd640 1 -- 172.21.15.17:0/3296531381 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36a8010430 con 0x7f36ac102ab0 2024-09-20T19:01:51.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.043+0000 7f36b3d22640 1 -- 172.21.15.17:0/3296531381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ac198090 con 0x7f36ac102ab0 2024-09-20T19:01:51.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.043+0000 7f36b3d22640 1 -- 172.21.15.17:0/3296531381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36ac06a580 con 0x7f36ac102ab0 2024-09-20T19:01:51.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.044+0000 7f36a2ffd640 1 -- 172.21.15.17:0/3296531381 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f36a8004ea0 con 0x7f36ac102ab0 2024-09-20T19:01:51.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.045+0000 7f36a2ffd640 1 --2- 172.21.15.17:0/3296531381 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f369807af30 0x7f369807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:51.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.045+0000 7f36a2ffd640 1 -- 172.21.15.17:0/3296531381 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f36a809e740 con 0x7f36ac102ab0 2024-09-20T19:01:51.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.045+0000 7f36b12bd640 1 --2- 172.21.15.17:0/3296531381 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f369807af30 0x7f369807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:51.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.045+0000 7f36b12bd640 1 --2- 172.21.15.17:0/3296531381 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f369807af30 0x7f369807d3f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f369c031460 tx=0x7f369c009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:51.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.049+0000 7f36a2ffd640 1 -- 172.21.15.17:0/3296531381 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36a8069d40 con 0x7f36ac102ab0 2024-09-20T19:01:51.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.252+0000 7f36b3d22640 1 -- 172.21.15.17:0/3296531381 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f36ac198400 con 0x7f369807af30 2024-09-20T19:01:51.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.254+0000 7f36a2ffd640 1 -- 172.21.15.17:0/3296531381 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f36ac198400 con 0x7f369807af30 2024-09-20T19:01:51.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.256+0000 7f36b3d22640 1 -- 172.21.15.17:0/3296531381 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f369807af30 msgr2=0x7f369807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:51.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.256+0000 7f36b3d22640 1 --2- 172.21.15.17:0/3296531381 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f369807af30 0x7f369807d3f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f369c031460 tx=0x7f369c009560 comp rx=0 tx=0).stop 2024-09-20T19:01:51.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.256+0000 7f36b3d22640 1 -- 172.21.15.17:0/3296531381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36ac102ab0 msgr2=0x7f36ac19d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:51.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.256+0000 7f36b3d22640 1 --2- 172.21.15.17:0/3296531381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36ac102ab0 0x7f36ac19d690 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f36a800e970 tx=0x7f36a800ed70 comp rx=0 tx=0).stop 2024-09-20T19:01:51.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.256+0000 7f36b3d22640 1 -- 172.21.15.17:0/3296531381 shutdown_connections 2024-09-20T19:01:51.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.256+0000 7f36b3d22640 1 --2- 172.21.15.17:0/3296531381 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f369807af30 0x7f369807d3f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.256+0000 7f36b3d22640 1 --2- 172.21.15.17:0/3296531381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36ac1033d0 0x7f36ac19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.256+0000 7f36b3d22640 1 --2- 172.21.15.17:0/3296531381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36ac102ab0 0x7f36ac19d690 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.256+0000 7f36b3d22640 1 -- 172.21.15.17:0/3296531381 >> 172.21.15.17:0/3296531381 conn(0x7f36ac0fc550 msgr2=0x7f36ac108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:51.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.256+0000 7f36b3d22640 1 -- 172.21.15.17:0/3296531381 shutdown_connections 2024-09-20T19:01:51.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.256+0000 7f36b3d22640 1 -- 172.21.15.17:0/3296531381 wait complete. 2024-09-20T19:01:51.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.341+0000 7fe1adb72640 1 -- 172.21.15.17:0/2295749686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a8103450 msgr2=0x7fe1a810b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:51.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.341+0000 7fe1adb72640 1 --2- 172.21.15.17:0/2295749686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a8103450 0x7fe1a810b940 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0098b0 tx=0x7fe19c02a560 comp rx=0 tx=0).stop 2024-09-20T19:01:51.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.341+0000 7fe1adb72640 1 -- 172.21.15.17:0/2295749686 shutdown_connections 2024-09-20T19:01:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.341+0000 7fe1adb72640 1 --2- 172.21.15.17:0/2295749686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a8103450 0x7fe1a810b940 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.341+0000 7fe1adb72640 1 --2- 172.21.15.17:0/2295749686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a8102b30 0x7fe1a8102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.341+0000 7fe1adb72640 1 -- 172.21.15.17:0/2295749686 >> 172.21.15.17:0/2295749686 conn(0x7fe1a80fc510 msgr2=0x7fe1a80fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.341+0000 7fe1adb72640 1 -- 172.21.15.17:0/2295749686 shutdown_connections 2024-09-20T19:01:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.341+0000 7fe1adb72640 1 -- 172.21.15.17:0/2295749686 wait complete. 2024-09-20T19:01:51.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.341+0000 7fe1adb72640 1 Processor -- start 2024-09-20T19:01:51.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.342+0000 7fe1adb72640 1 -- start start 2024-09-20T19:01:51.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.342+0000 7fe1adb72640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a8102b30 0x7fe1a819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:51.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.342+0000 7fe1adb72640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a8103450 0x7fe1a819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:51.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.342+0000 7fe1adb72640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a810ede0 con 0x7fe1a8103450 2024-09-20T19:01:51.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.342+0000 7fe1adb72640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a810ec60 con 0x7fe1a8102b30 2024-09-20T19:01:51.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.342+0000 7fe1a6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a8103450 0x7fe1a819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:51.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.342+0000 7fe1a77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a8102b30 0x7fe1a819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:51.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.342+0000 7fe1a6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a8103450 0x7fe1a819dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54018/0 (socket says 172.21.15.17:54018) 2024-09-20T19:01:51.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.342+0000 7fe1a6ffd640 1 -- 172.21.15.17:0/1793356147 learned_addr learned my addr 172.21.15.17:0/1793356147 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:01:51.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.342+0000 7fe1a6ffd640 1 -- 172.21.15.17:0/1793356147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a8102b30 msgr2=0x7fe1a819d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:51.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.342+0000 7fe1a6ffd640 1 --2- 172.21.15.17:0/1793356147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a8102b30 0x7fe1a819d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.342+0000 7fe1a6ffd640 1 -- 172.21.15.17:0/1793356147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a8197830 con 0x7fe1a8103450 2024-09-20T19:01:51.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.343+0000 7fe1a6ffd640 1 --2- 172.21.15.17:0/1793356147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a8103450 0x7fe1a819dbf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe19c031460 tx=0x7fe19c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:51.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.343+0000 7fe1a4ff9640 1 -- 172.21.15.17:0/1793356147 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe19c03f070 con 0x7fe1a8103450 2024-09-20T19:01:51.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.343+0000 7fe1adb72640 1 -- 172.21.15.17:0/1793356147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a8197ac0 con 0x7fe1a8103450 2024-09-20T19:01:51.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.343+0000 7fe1a4ff9640 1 -- 172.21.15.17:0/1793356147 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe19c0044d0 con 0x7fe1a8103450 2024-09-20T19:01:51.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.343+0000 7fe1a4ff9640 1 -- 172.21.15.17:0/1793356147 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe19c035030 con 0x7fe1a8103450 2024-09-20T19:01:51.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.343+0000 7fe1adb72640 1 -- 172.21.15.17:0/1793356147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a8197ff0 con 0x7fe1a8103450 2024-09-20T19:01:51.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.344+0000 7fe1adb72640 1 -- 172.21.15.17:0/1793356147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a806ad40 con 0x7fe1a8103450 2024-09-20T19:01:51.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.345+0000 7fe1a4ff9640 1 -- 172.21.15.17:0/1793356147 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe19c042070 con 0x7fe1a8103450 2024-09-20T19:01:51.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.345+0000 7fe1a4ff9640 1 --2- 172.21.15.17:0/1793356147 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe19007af30 0x7fe19007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:51.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.346+0000 7fe1a4ff9640 1 -- 172.21.15.17:0/1793356147 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fe19c0be970 con 0x7fe1a8103450 2024-09-20T19:01:51.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.346+0000 7fe1a77fe640 1 --2- 172.21.15.17:0/1793356147 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe19007af30 0x7fe19007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:51.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.346+0000 7fe1a77fe640 1 --2- 172.21.15.17:0/1793356147 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe19007af30 0x7fe19007d3f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe19800abe0 tx=0x7fe19800a2d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:51.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.351+0000 7fe1a4ff9640 1 -- 172.21.15.17:0/1793356147 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe19c0c0e20 con 0x7fe1a8103450 2024-09-20T19:01:51.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.544+0000 7fe1adb72640 1 -- 172.21.15.17:0/1793356147 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe1a8198360 con 0x7fe19007af30 2024-09-20T19:01:51.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.554+0000 7fe1a4ff9640 1 -- 172.21.15.17:0/1793356147 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fe1a8198360 con 0x7fe19007af30 2024-09-20T19:01:51.561 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:01:51.561 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (23m) 2m ago 34m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:01:51.562 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (26m) 2m ago 34m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:01:51.562 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (25m) 2m ago 33m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:01:51.562 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (21m) 2m ago 34m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:01:51.562 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (21m) 2m ago 33m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:01:51.562 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (22m) 2m ago 34m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:01:51.562 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (17m) 2m ago 28m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:01:51.562 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (17m) 2m ago 28m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:01:51.562 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (2m) 2m ago 28m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:01:51.562 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (17m) 2m ago 28m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:01:51.562 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (25m) 2m ago 35m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:01:51.562 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (24m) 2m ago 33m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:01:51.562 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (22m) 2m ago 35m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:01:51.562 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (21m) 2m ago 33m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:01:51.563 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (24m) 2m ago 34m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:01:51.563 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (23m) 2m ago 33m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:01:51.563 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (21m) 2m ago 32m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:01:51.563 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (20m) 2m ago 31m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:01:51.563 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (19m) 2m ago 31m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:01:51.563 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (19m) 2m ago 30m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:01:51.563 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (18m) 2m ago 30m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:01:51.563 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (18m) 2m ago 29m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:01:51.563 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (23m) 2m ago 33m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:01:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.556+0000 7fe1adb72640 1 -- 172.21.15.17:0/1793356147 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe19007af30 msgr2=0x7fe19007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.556+0000 7fe1adb72640 1 --2- 172.21.15.17:0/1793356147 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe19007af30 0x7fe19007d3f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe19800abe0 tx=0x7fe19800a2d0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.556+0000 7fe1adb72640 1 -- 172.21.15.17:0/1793356147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a8103450 msgr2=0x7fe1a819dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.556+0000 7fe1adb72640 1 --2- 172.21.15.17:0/1793356147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a8103450 0x7fe1a819dbf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe19c031460 tx=0x7fe19c0048f0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.556+0000 7fe1adb72640 1 -- 172.21.15.17:0/1793356147 shutdown_connections 2024-09-20T19:01:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.556+0000 7fe1adb72640 1 --2- 172.21.15.17:0/1793356147 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe19007af30 0x7fe19007d3f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.556+0000 7fe1adb72640 1 --2- 172.21.15.17:0/1793356147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a8103450 0x7fe1a819dbf0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.556+0000 7fe1adb72640 1 --2- 172.21.15.17:0/1793356147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a8102b30 0x7fe1a819d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.556+0000 7fe1adb72640 1 -- 172.21.15.17:0/1793356147 >> 172.21.15.17:0/1793356147 conn(0x7fe1a80fc510 msgr2=0x7fe1a8103d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.556+0000 7fe1adb72640 1 -- 172.21.15.17:0/1793356147 shutdown_connections 2024-09-20T19:01:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.556+0000 7fe1adb72640 1 -- 172.21.15.17:0/1793356147 wait complete. 2024-09-20T19:01:51.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.639+0000 7fdbcea9b640 1 -- 172.21.15.17:0/355970615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbc81067f0 msgr2=0x7fdbc8106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:51.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.639+0000 7fdbcea9b640 1 --2- 172.21.15.17:0/355970615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbc81067f0 0x7fdbc8106bd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc009880 tx=0x7fdbbc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.639+0000 7fdbcea9b640 1 -- 172.21.15.17:0/355970615 shutdown_connections 2024-09-20T19:01:51.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.639+0000 7fdbcea9b640 1 --2- 172.21.15.17:0/355970615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc81007f0 0x7fdbc8100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.639+0000 7fdbcea9b640 1 --2- 172.21.15.17:0/355970615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbc81067f0 0x7fdbc8106bd0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.640+0000 7fdbcea9b640 1 -- 172.21.15.17:0/355970615 >> 172.21.15.17:0/355970615 conn(0x7fdbc80fc550 msgr2=0x7fdbc80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:51.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.640+0000 7fdbcea9b640 1 -- 172.21.15.17:0/355970615 shutdown_connections 2024-09-20T19:01:51.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.640+0000 7fdbcea9b640 1 -- 172.21.15.17:0/355970615 wait complete. 2024-09-20T19:01:51.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.640+0000 7fdbcea9b640 1 Processor -- start 2024-09-20T19:01:51.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.640+0000 7fdbcea9b640 1 -- start start 2024-09-20T19:01:51.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.641+0000 7fdbcea9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc81007f0 0x7fdbc819c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:51.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.641+0000 7fdbcea9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbc81067f0 0x7fdbc819cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.641+0000 7fdbcea9b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc810dca0 con 0x7fdbc81067f0 2024-09-20T19:01:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.641+0000 7fdbcea9b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc810db20 con 0x7fdbc81007f0 2024-09-20T19:01:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.641+0000 7fdbc7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbc81067f0 0x7fdbc819cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.641+0000 7fdbc7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbc81067f0 0x7fdbc819cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54032/0 (socket says 172.21.15.17:54032) 2024-09-20T19:01:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.641+0000 7fdbc7fff640 1 -- 172.21.15.17:0/3710483421 learned_addr learned my addr 172.21.15.17:0/3710483421 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:01:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.641+0000 7fdbcc837640 1 --2- 172.21.15.17:0/3710483421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc81007f0 0x7fdbc819c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.641+0000 7fdbc7fff640 1 -- 172.21.15.17:0/3710483421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc81007f0 msgr2=0x7fdbc819c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.641+0000 7fdbc7fff640 1 --2- 172.21.15.17:0/3710483421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc81007f0 0x7fdbc819c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.641+0000 7fdbc7fff640 1 -- 172.21.15.17:0/3710483421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc8196790 con 0x7fdbc81067f0 2024-09-20T19:01:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.641+0000 7fdbc7fff640 1 --2- 172.21.15.17:0/3710483421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbc81067f0 0x7fdbc819cb50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400d8d0 tx=0x7fdbb400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.641+0000 7fdbc5ffb640 1 -- 172.21.15.17:0/3710483421 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdbb4017030 con 0x7fdbc81067f0 2024-09-20T19:01:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.642+0000 7fdbc5ffb640 1 -- 172.21.15.17:0/3710483421 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdbb4004020 con 0x7fdbc81067f0 2024-09-20T19:01:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.642+0000 7fdbcea9b640 1 -- 172.21.15.17:0/3710483421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc8196a80 con 0x7fdbc81067f0 2024-09-20T19:01:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.642+0000 7fdbc5ffb640 1 -- 172.21.15.17:0/3710483421 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdbb40047a0 con 0x7fdbc81067f0 2024-09-20T19:01:51.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.642+0000 7fdbcea9b640 1 -- 172.21.15.17:0/3710483421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc8197010 con 0x7fdbc81067f0 2024-09-20T19:01:51.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.643+0000 7fdbcea9b640 1 -- 172.21.15.17:0/3710483421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc8101f30 con 0x7fdbc81067f0 2024-09-20T19:01:51.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.643+0000 7fdbc5ffb640 1 -- 172.21.15.17:0/3710483421 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdbb40041d0 con 0x7fdbc81067f0 2024-09-20T19:01:51.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.644+0000 7fdbc5ffb640 1 --2- 172.21.15.17:0/3710483421 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdbb807af90 0x7fdbb807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:51.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.644+0000 7fdbcc837640 1 --2- 172.21.15.17:0/3710483421 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdbb807af90 0x7fdbb807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:51.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.644+0000 7fdbc5ffb640 1 -- 172.21.15.17:0/3710483421 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fdbb4018070 con 0x7fdbc81067f0 2024-09-20T19:01:51.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.645+0000 7fdbcc837640 1 --2- 172.21.15.17:0/3710483421 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdbb807af90 0x7fdbb807d450 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0096c0 tx=0x7fdbbc031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:51.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.649+0000 7fdbc5ffb640 1 -- 172.21.15.17:0/3710483421 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdbb4069370 con 0x7fdbc81067f0 2024-09-20T19:01:51.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.915+0000 7fdbcea9b640 1 -- 172.21.15.17:0/3710483421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fdbc8197cc0 con 0x7fdbc81067f0 2024-09-20T19:01:51.923 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:51 smithi017 ceph-mon[108970]: pgmap v794: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:51.923 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:51 smithi017 ceph-mon[108970]: from='client.35268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.916+0000 7fdbc5ffb640 1 -- 172.21.15.17:0/3710483421 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fdbb406e220 con 0x7fdbc81067f0 2024-09-20T19:01:51.924 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:01:51.924 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:01:51.924 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:01:51.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:01:51.924 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:01:51.924 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:01:51.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:01:51.924 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:01:51.924 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:01:51.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:01:51.924 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:01:51.924 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:01:51.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:01:51.924 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:01:51.925 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:01:51.925 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:01:51.925 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:01:51.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.918+0000 7fdbcea9b640 1 -- 172.21.15.17:0/3710483421 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdbb807af90 msgr2=0x7fdbb807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:51.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.918+0000 7fdbcea9b640 1 --2- 172.21.15.17:0/3710483421 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdbb807af90 0x7fdbb807d450 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0096c0 tx=0x7fdbbc031400 comp rx=0 tx=0).stop 2024-09-20T19:01:51.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.918+0000 7fdbcea9b640 1 -- 172.21.15.17:0/3710483421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbc81067f0 msgr2=0x7fdbc819cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:51.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.918+0000 7fdbcea9b640 1 --2- 172.21.15.17:0/3710483421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbc81067f0 0x7fdbc819cb50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400d8d0 tx=0x7fdbb400dd90 comp rx=0 tx=0).stop 2024-09-20T19:01:51.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.918+0000 7fdbcea9b640 1 -- 172.21.15.17:0/3710483421 shutdown_connections 2024-09-20T19:01:51.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.918+0000 7fdbcea9b640 1 --2- 172.21.15.17:0/3710483421 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdbb807af90 0x7fdbb807d450 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.918+0000 7fdbcea9b640 1 --2- 172.21.15.17:0/3710483421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbc81067f0 0x7fdbc819cb50 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.918+0000 7fdbcea9b640 1 --2- 172.21.15.17:0/3710483421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbc81007f0 0x7fdbc819c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:51.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.918+0000 7fdbcea9b640 1 -- 172.21.15.17:0/3710483421 >> 172.21.15.17:0/3710483421 conn(0x7fdbc80fc550 msgr2=0x7fdbc80fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:51.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.918+0000 7fdbcea9b640 1 -- 172.21.15.17:0/3710483421 shutdown_connections 2024-09-20T19:01:51.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:51.918+0000 7fdbcea9b640 1 -- 172.21.15.17:0/3710483421 wait complete. 2024-09-20T19:01:52.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.003+0000 7fae4d5eb640 1 -- 172.21.15.17:0/3451665989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae48100a90 msgr2=0x7fae481065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:52.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.003+0000 7fae4d5eb640 1 --2- 172.21.15.17:0/3451665989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae48100a90 0x7fae481065d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fae3c009880 tx=0x7fae3c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.003+0000 7fae4d5eb640 1 -- 172.21.15.17:0/3451665989 shutdown_connections 2024-09-20T19:01:52.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.003+0000 7fae4d5eb640 1 --2- 172.21.15.17:0/3451665989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae48100a90 0x7fae481065d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.003+0000 7fae4d5eb640 1 --2- 172.21.15.17:0/3451665989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae481000e0 0x7fae481004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.003+0000 7fae4d5eb640 1 -- 172.21.15.17:0/3451665989 >> 172.21.15.17:0/3451665989 conn(0x7fae480fbc90 msgr2=0x7fae480fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.003+0000 7fae4d5eb640 1 -- 172.21.15.17:0/3451665989 shutdown_connections 2024-09-20T19:01:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.003+0000 7fae4d5eb640 1 -- 172.21.15.17:0/3451665989 wait complete. 2024-09-20T19:01:52.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.003+0000 7fae4d5eb640 1 Processor -- start 2024-09-20T19:01:52.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.004+0000 7fae4d5eb640 1 -- start start 2024-09-20T19:01:52.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.004+0000 7fae4d5eb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae481000e0 0x7fae48101060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.004+0000 7fae4d5eb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae48100a90 0x7fae481015a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.004+0000 7fae4d5eb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fae4810ee50 con 0x7fae481000e0 2024-09-20T19:01:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.004+0000 7fae4d5eb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae4810ecd0 con 0x7fae48100a90 2024-09-20T19:01:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.004+0000 7fae46ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae481000e0 0x7fae48101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.004+0000 7fae46ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae481000e0 0x7fae48101060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54050/0 (socket says 172.21.15.17:54050) 2024-09-20T19:01:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.004+0000 7fae46ffd640 1 -- 172.21.15.17:0/369216433 learned_addr learned my addr 172.21.15.17:0/369216433 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:01:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.004+0000 7fae467fc640 1 --2- 172.21.15.17:0/369216433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae48100a90 0x7fae481015a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.004+0000 7fae46ffd640 1 -- 172.21.15.17:0/369216433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae48100a90 msgr2=0x7fae481015a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.004+0000 7fae46ffd640 1 --2- 172.21.15.17:0/369216433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae48100a90 0x7fae481015a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.004+0000 7fae46ffd640 1 -- 172.21.15.17:0/369216433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae48101ae0 con 0x7fae481000e0 2024-09-20T19:01:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.005+0000 7fae46ffd640 1 --2- 172.21.15.17:0/369216433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae481000e0 0x7fae48101060 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fae3800eb10 tx=0x7fae3800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.005+0000 7fae2ffff640 1 -- 172.21.15.17:0/369216433 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae3800cce0 con 0x7fae481000e0 2024-09-20T19:01:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.005+0000 7fae2ffff640 1 -- 172.21.15.17:0/369216433 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fae38005020 con 0x7fae481000e0 2024-09-20T19:01:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.005+0000 7fae4d5eb640 1 -- 172.21.15.17:0/369216433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae48101dd0 con 0x7fae481000e0 2024-09-20T19:01:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.005+0000 7fae2ffff640 1 -- 172.21.15.17:0/369216433 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae38010660 con 0x7fae481000e0 2024-09-20T19:01:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.005+0000 7fae4d5eb640 1 -- 172.21.15.17:0/369216433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae481a3f80 con 0x7fae481000e0 2024-09-20T19:01:52.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.006+0000 7fae4d5eb640 1 -- 172.21.15.17:0/369216433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae481031a0 con 0x7fae481000e0 2024-09-20T19:01:52.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.006+0000 7fae2ffff640 1 -- 172.21.15.17:0/369216433 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fae380051d0 con 0x7fae481000e0 2024-09-20T19:01:52.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.007+0000 7fae2ffff640 1 --2- 172.21.15.17:0/369216433 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae3007af80 0x7fae3007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:52.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.007+0000 7fae2ffff640 1 -- 172.21.15.17:0/369216433 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fae3809e760 con 0x7fae481000e0 2024-09-20T19:01:52.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.007+0000 7fae467fc640 1 --2- 172.21.15.17:0/369216433 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae3007af80 0x7fae3007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:52.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.008+0000 7fae467fc640 1 --2- 172.21.15.17:0/369216433 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae3007af80 0x7fae3007d440 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fae48102af0 tx=0x7fae3c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:52.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.011+0000 7fae2ffff640 1 -- 172.21.15.17:0/369216433 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fae38069de0 con 0x7fae481000e0 2024-09-20T19:01:52.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:51 smithi172 ceph-mon[80431]: pgmap v794: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:52.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:51 smithi172 ceph-mon[80431]: from='client.35268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:52.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.244+0000 7fae4d5eb640 1 -- 172.21.15.17:0/369216433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fae48102590 con 0x7fae481000e0 2024-09-20T19:01:52.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.244+0000 7fae2ffff640 1 -- 172.21.15.17:0/369216433 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7fae3806ec90 con 0x7fae481000e0 2024-09-20T19:01:52.252 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:01:52.252 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:01:52.252 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:01:52.252 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:01:52.252 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:01:52.252 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:01:52.252 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:01:52.252 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:01:52.252 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:01:52.252 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:01:52.252 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:01:52.252 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:01:52.253 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:01:52.253 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:01:52.253 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:01:52.253 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:01:52.253 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:01:52.253 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:01:52.253 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:01:52.253 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:01:52.253 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:01:52.253 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:01:52.253 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:01:52.253 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:01:52.253 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:01:52.254 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:01:52.254 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:01:52.254 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:01:52.254 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:01:52.254 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:01:52.254 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:01:52.254 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:01:52.254 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:01:52.254 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:01:52.254 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:01:52.254 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:01:52.254 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:01:52.254 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:01:52.254 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:01:52.255 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:01:52.255 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:01:52.255 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:01:52.255 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:01:52.255 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:01:52.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.246+0000 7fae4d5eb640 1 -- 172.21.15.17:0/369216433 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae3007af80 msgr2=0x7fae3007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:52.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.246+0000 7fae4d5eb640 1 --2- 172.21.15.17:0/369216433 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae3007af80 0x7fae3007d440 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fae48102af0 tx=0x7fae3c031400 comp rx=0 tx=0).stop 2024-09-20T19:01:52.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.246+0000 7fae4d5eb640 1 -- 172.21.15.17:0/369216433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae481000e0 msgr2=0x7fae48101060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:52.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.246+0000 7fae4d5eb640 1 --2- 172.21.15.17:0/369216433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae481000e0 0x7fae48101060 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fae3800eb10 tx=0x7fae3800c2d0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.246+0000 7fae4d5eb640 1 -- 172.21.15.17:0/369216433 shutdown_connections 2024-09-20T19:01:52.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.246+0000 7fae4d5eb640 1 --2- 172.21.15.17:0/369216433 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae3007af80 0x7fae3007d440 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.246+0000 7fae4d5eb640 1 --2- 172.21.15.17:0/369216433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae48100a90 0x7fae481015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.246+0000 7fae4d5eb640 1 --2- 172.21.15.17:0/369216433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae481000e0 0x7fae48101060 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.246+0000 7fae4d5eb640 1 -- 172.21.15.17:0/369216433 >> 172.21.15.17:0/369216433 conn(0x7fae480fbc90 msgr2=0x7fae480fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:52.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.247+0000 7fae4d5eb640 1 -- 172.21.15.17:0/369216433 shutdown_connections 2024-09-20T19:01:52.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.247+0000 7fae4d5eb640 1 -- 172.21.15.17:0/369216433 wait complete. 2024-09-20T19:01:52.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.331+0000 7f65a55b3640 1 -- 172.21.15.17:0/1802136508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65a0107900 msgr2=0x7f65a0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:52.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.331+0000 7f65a55b3640 1 --2- 172.21.15.17:0/1802136508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65a0107900 0x7f65a0107ce0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6590009880 tx=0x7f659002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.331+0000 7f65a55b3640 1 -- 172.21.15.17:0/1802136508 shutdown_connections 2024-09-20T19:01:52.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.331+0000 7f65a55b3640 1 --2- 172.21.15.17:0/1802136508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65a0101900 0x7f65a0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.331+0000 7f65a55b3640 1 --2- 172.21.15.17:0/1802136508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65a0107900 0x7f65a0107ce0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.331+0000 7f65a55b3640 1 -- 172.21.15.17:0/1802136508 >> 172.21.15.17:0/1802136508 conn(0x7f65a00fd600 msgr2=0x7f65a00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:52.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.331+0000 7f65a55b3640 1 -- 172.21.15.17:0/1802136508 shutdown_connections 2024-09-20T19:01:52.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.331+0000 7f65a55b3640 1 -- 172.21.15.17:0/1802136508 wait complete. 2024-09-20T19:01:52.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.332+0000 7f65a55b3640 1 Processor -- start 2024-09-20T19:01:52.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.332+0000 7f65a55b3640 1 -- start start 2024-09-20T19:01:52.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.332+0000 7f65a55b3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65a0101900 0x7f65a019f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:52.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.332+0000 7f65a55b3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65a0107900 0x7f65a019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:52.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.332+0000 7f65a55b3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f65a010edb0 con 0x7f65a0101900 2024-09-20T19:01:52.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.332+0000 7f65a55b3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f65a010ec30 con 0x7f65a0107900 2024-09-20T19:01:52.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.333+0000 7f659effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65a0101900 0x7f65a019f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:52.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.333+0000 7f659e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65a0107900 0x7f65a019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:52.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.333+0000 7f659effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65a0101900 0x7f65a019f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54068/0 (socket says 172.21.15.17:54068) 2024-09-20T19:01:52.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.333+0000 7f659effd640 1 -- 172.21.15.17:0/2648148292 learned_addr learned my addr 172.21.15.17:0/2648148292 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:01:52.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.333+0000 7f659e7fc640 1 -- 172.21.15.17:0/2648148292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65a0101900 msgr2=0x7f65a019f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:52.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.333+0000 7f659e7fc640 1 --2- 172.21.15.17:0/2648148292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65a0101900 0x7f65a019f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.333+0000 7f659e7fc640 1 -- 172.21.15.17:0/2648148292 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a0199990 con 0x7f65a0107900 2024-09-20T19:01:52.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.333+0000 7f659effd640 1 --2- 172.21.15.17:0/2648148292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65a0101900 0x7f65a019f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T19:01:52.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.333+0000 7f659e7fc640 1 --2- 172.21.15.17:0/2648148292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65a0107900 0x7f65a019fd10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f659400d6d0 tx=0x7f659400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:52.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.333+0000 7f6587fff640 1 -- 172.21.15.17:0/2648148292 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6594017070 con 0x7f65a0107900 2024-09-20T19:01:52.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.333+0000 7f6587fff640 1 -- 172.21.15.17:0/2648148292 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f65940054e0 con 0x7f65a0107900 2024-09-20T19:01:52.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.333+0000 7f65a55b3640 1 -- 172.21.15.17:0/2648148292 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a0199c80 con 0x7f65a0107900 2024-09-20T19:01:52.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.333+0000 7f6587fff640 1 -- 172.21.15.17:0/2648148292 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6594009a60 con 0x7f65a0107900 2024-09-20T19:01:52.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.333+0000 7f65a55b3640 1 -- 172.21.15.17:0/2648148292 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a019a210 con 0x7f65a0107900 2024-09-20T19:01:52.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.334+0000 7f65a55b3640 1 -- 172.21.15.17:0/2648148292 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a0103040 con 0x7f65a0107900 2024-09-20T19:01:52.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.335+0000 7f6587fff640 1 -- 172.21.15.17:0/2648148292 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6594005000 con 0x7f65a0107900 2024-09-20T19:01:52.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.336+0000 7f6587fff640 1 --2- 172.21.15.17:0/2648148292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f658807af30 0x7f658807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:52.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.336+0000 7f6587fff640 1 -- 172.21.15.17:0/2648148292 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f659409ddd0 con 0x7f65a0107900 2024-09-20T19:01:52.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.336+0000 7f659effd640 1 --2- 172.21.15.17:0/2648148292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f658807af30 0x7f658807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:52.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.336+0000 7f659effd640 1 --2- 172.21.15.17:0/2648148292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f658807af30 0x7f658807d3f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6590009230 tx=0x7f65900058d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:52.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.340+0000 7f6587fff640 1 -- 172.21.15.17:0/2648148292 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6594069330 con 0x7f65a0107900 2024-09-20T19:01:52.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.544+0000 7f65a55b3640 1 -- 172.21.15.17:0/2648148292 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f65a019a4c0 con 0x7f658807af30 2024-09-20T19:01:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.546+0000 7f6587fff640 1 -- 172.21.15.17:0/2648148292 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f65a019a4c0 con 0x7f658807af30 2024-09-20T19:01:52.553 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:01:52.553 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:01:52.553 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:01:52.553 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:01:52.553 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:01:52.553 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:01:52.554 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:01:52.554 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:01:52.554 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:01:52.554 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:01:52.554 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:01:52.554 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:01:52.554 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:01:52.554 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:01:52.554 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:01:52.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.548+0000 7f65a55b3640 1 -- 172.21.15.17:0/2648148292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f658807af30 msgr2=0x7f658807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.548+0000 7f65a55b3640 1 --2- 172.21.15.17:0/2648148292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f658807af30 0x7f658807d3f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6590009230 tx=0x7f65900058d0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.548+0000 7f65a55b3640 1 -- 172.21.15.17:0/2648148292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65a0107900 msgr2=0x7f65a019fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.548+0000 7f65a55b3640 1 --2- 172.21.15.17:0/2648148292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65a0107900 0x7f65a019fd10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f659400d6d0 tx=0x7f659400db90 comp rx=0 tx=0).stop 2024-09-20T19:01:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.548+0000 7f65a55b3640 1 -- 172.21.15.17:0/2648148292 shutdown_connections 2024-09-20T19:01:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.548+0000 7f65a55b3640 1 --2- 172.21.15.17:0/2648148292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f658807af30 0x7f658807d3f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.548+0000 7f65a55b3640 1 --2- 172.21.15.17:0/2648148292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65a0107900 0x7f65a019fd10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.548+0000 7f65a55b3640 1 --2- 172.21.15.17:0/2648148292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65a0101900 0x7f65a019f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.548+0000 7f65a55b3640 1 -- 172.21.15.17:0/2648148292 >> 172.21.15.17:0/2648148292 conn(0x7f65a00fd600 msgr2=0x7f65a00feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.548+0000 7f65a55b3640 1 -- 172.21.15.17:0/2648148292 shutdown_connections 2024-09-20T19:01:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.548+0000 7f65a55b3640 1 -- 172.21.15.17:0/2648148292 wait complete. 2024-09-20T19:01:52.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.632+0000 7f55c4271640 1 -- 172.21.15.17:0/699402370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55bc1067f0 msgr2=0x7f55bc106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:52.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.632+0000 7f55c4271640 1 --2- 172.21.15.17:0/699402370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55bc1067f0 0x7f55bc106bd0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f55b8009880 tx=0x7f55b802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.632+0000 7f55c4271640 1 -- 172.21.15.17:0/699402370 shutdown_connections 2024-09-20T19:01:52.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.632+0000 7f55c4271640 1 --2- 172.21.15.17:0/699402370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55bc1007f0 0x7f55bc100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.632+0000 7f55c4271640 1 --2- 172.21.15.17:0/699402370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55bc1067f0 0x7f55bc106bd0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.632+0000 7f55c4271640 1 -- 172.21.15.17:0/699402370 >> 172.21.15.17:0/699402370 conn(0x7f55bc0fc550 msgr2=0x7f55bc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:52.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.632+0000 7f55c4271640 1 -- 172.21.15.17:0/699402370 shutdown_connections 2024-09-20T19:01:52.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.632+0000 7f55c4271640 1 -- 172.21.15.17:0/699402370 wait complete. 2024-09-20T19:01:52.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.633+0000 7f55c4271640 1 Processor -- start 2024-09-20T19:01:52.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.633+0000 7f55c4271640 1 -- start start 2024-09-20T19:01:52.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.633+0000 7f55c4271640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55bc1007f0 0x7f55bc19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:52.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.633+0000 7f55c4271640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55bc1067f0 0x7f55bc19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:52.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.633+0000 7f55c4271640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc10eda0 con 0x7f55bc1007f0 2024-09-20T19:01:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.633+0000 7f55c4271640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc10ec20 con 0x7f55bc1067f0 2024-09-20T19:01:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.633+0000 7f55c200d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55bc1007f0 0x7f55bc19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.633+0000 7f55c200d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55bc1007f0 0x7f55bc19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54078/0 (socket says 172.21.15.17:54078) 2024-09-20T19:01:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.633+0000 7f55c200d640 1 -- 172.21.15.17:0/703025896 learned_addr learned my addr 172.21.15.17:0/703025896 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:01:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.633+0000 7f55c180c640 1 --2- 172.21.15.17:0/703025896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55bc1067f0 0x7f55bc19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.633+0000 7f55c200d640 1 -- 172.21.15.17:0/703025896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55bc1067f0 msgr2=0x7f55bc19dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.633+0000 7f55c200d640 1 --2- 172.21.15.17:0/703025896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55bc1067f0 0x7f55bc19dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.633+0000 7f55c200d640 1 -- 172.21.15.17:0/703025896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc197890 con 0x7f55bc1007f0 2024-09-20T19:01:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.634+0000 7f55c200d640 1 --2- 172.21.15.17:0/703025896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55bc1007f0 0x7f55bc19d6d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f55b8031460 tx=0x7f55b80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.634+0000 7f55b37fe640 1 -- 172.21.15.17:0/703025896 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f55b803f070 con 0x7f55bc1007f0 2024-09-20T19:01:52.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.634+0000 7f55b37fe640 1 -- 172.21.15.17:0/703025896 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f55b80035f0 con 0x7f55bc1007f0 2024-09-20T19:01:52.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.634+0000 7f55b37fe640 1 -- 172.21.15.17:0/703025896 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f55b8035030 con 0x7f55bc1007f0 2024-09-20T19:01:52.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.634+0000 7f55c4271640 1 -- 172.21.15.17:0/703025896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55bc197b20 con 0x7f55bc1007f0 2024-09-20T19:01:52.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.634+0000 7f55c4271640 1 -- 172.21.15.17:0/703025896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55bc198050 con 0x7f55bc1007f0 2024-09-20T19:01:52.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.635+0000 7f55c4271640 1 -- 172.21.15.17:0/703025896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55bc101f30 con 0x7f55bc1007f0 2024-09-20T19:01:52.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.636+0000 7f55b37fe640 1 -- 172.21.15.17:0/703025896 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f55b8042070 con 0x7f55bc1007f0 2024-09-20T19:01:52.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.636+0000 7f55b37fe640 1 --2- 172.21.15.17:0/703025896 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f55a807af80 0x7f55a807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:01:52.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.636+0000 7f55b37fe640 1 -- 172.21.15.17:0/703025896 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f55b80be910 con 0x7f55bc1007f0 2024-09-20T19:01:52.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.636+0000 7f55c180c640 1 --2- 172.21.15.17:0/703025896 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f55a807af80 0x7f55a807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:01:52.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.637+0000 7f55c180c640 1 --2- 172.21.15.17:0/703025896 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f55a807af80 0x7f55a807d440 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f55ac005fd0 tx=0x7f55ac009470 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:01:52.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.641+0000 7f55b37fe640 1 -- 172.21.15.17:0/703025896 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55b8089f90 con 0x7f55bc1007f0 2024-09-20T19:01:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.904+0000 7f55c4271640 1 -- 172.21.15.17:0/703025896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f55bc103a30 con 0x7f55bc1007f0 2024-09-20T19:01:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.904+0000 7f55b37fe640 1 -- 172.21.15.17:0/703025896 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f55b808ee40 con 0x7f55bc1007f0 2024-09-20T19:01:52.912 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:01:52.912 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:01:52.912 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:01:52.912 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:01:52.912 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:01:52.912 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:01:52.912 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:01:52.912 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:01:52.912 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:01:52.912 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:01:52.912 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:01:52.912 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:01:52.912 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:01:52.912 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:01:52.913 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:01:52.913 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:01:52.913 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:01:52.913 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:01:52.913 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:01:52.913 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:01:52.913 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:01:52.913 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:01:52.913 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:01:52.913 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:01:52.913 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:01:52.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.906+0000 7f55c4271640 1 -- 172.21.15.17:0/703025896 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f55a807af80 msgr2=0x7f55a807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:52.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.907+0000 7f55c4271640 1 --2- 172.21.15.17:0/703025896 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f55a807af80 0x7f55a807d440 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f55ac005fd0 tx=0x7f55ac009470 comp rx=0 tx=0).stop 2024-09-20T19:01:52.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.907+0000 7f55c4271640 1 -- 172.21.15.17:0/703025896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55bc1007f0 msgr2=0x7f55bc19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:01:52.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.907+0000 7f55c4271640 1 --2- 172.21.15.17:0/703025896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55bc1007f0 0x7f55bc19d6d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f55b8031460 tx=0x7f55b80045e0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.907+0000 7f55c4271640 1 -- 172.21.15.17:0/703025896 shutdown_connections 2024-09-20T19:01:52.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.907+0000 7f55c4271640 1 --2- 172.21.15.17:0/703025896 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f55a807af80 0x7f55a807d440 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.907+0000 7f55c4271640 1 --2- 172.21.15.17:0/703025896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55bc1067f0 0x7f55bc19dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.907+0000 7f55c4271640 1 --2- 172.21.15.17:0/703025896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55bc1007f0 0x7f55bc19d6d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:01:52.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.907+0000 7f55c4271640 1 -- 172.21.15.17:0/703025896 >> 172.21.15.17:0/703025896 conn(0x7f55bc0fc550 msgr2=0x7f55bc0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:01:52.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.907+0000 7f55c4271640 1 -- 172.21.15.17:0/703025896 shutdown_connections 2024-09-20T19:01:52.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:01:52.907+0000 7f55c4271640 1 -- 172.21.15.17:0/703025896 wait complete. 2024-09-20T19:01:53.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:52 smithi017 ceph-mon[108970]: from='client.35272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:53.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:52 smithi017 ceph-mon[108970]: from='client.35276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:53.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:52 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3710483421' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:01:53.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:01:53.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:52 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/369216433' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:01:53.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:52 smithi172 ceph-mon[80431]: from='client.35272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:53.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:52 smithi172 ceph-mon[80431]: from='client.35276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:53.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:52 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3710483421' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:01:53.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:01:53.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:52 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/369216433' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:01:54.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:53 smithi017 ceph-mon[108970]: from='client.45003 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:54.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:53 smithi017 ceph-mon[108970]: pgmap v795: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:54.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:53 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/703025896' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:01:54.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:53 smithi172 ceph-mon[80431]: from='client.45003 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:01:54.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:53 smithi172 ceph-mon[80431]: pgmap v795: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:54.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:53 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/703025896' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:01:56.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:55 smithi017 ceph-mon[108970]: pgmap v796: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:56.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:55 smithi172 ceph-mon[80431]: pgmap v796: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:58.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:57 smithi017 ceph-mon[108970]: pgmap v797: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:01:58.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:57 smithi172 ceph-mon[80431]: pgmap v797: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:00.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:01:59 smithi017 ceph-mon[108970]: pgmap v798: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:00.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:01:59 smithi172 ceph-mon[80431]: pgmap v798: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:02.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:01 smithi017 ceph-mon[108970]: pgmap v799: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:02.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:01 smithi172 ceph-mon[80431]: pgmap v799: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:04.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:03 smithi017 ceph-mon[108970]: pgmap v800: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:04.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:03 smithi172 ceph-mon[80431]: pgmap v800: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:06.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:05 smithi017 ceph-mon[108970]: pgmap v801: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:06.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:05 smithi172 ceph-mon[80431]: pgmap v801: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:08.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:07 smithi017 ceph-mon[108970]: pgmap v802: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:08.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:02:08.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:07 smithi172 ceph-mon[80431]: pgmap v802: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:08.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:02:10.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:09 smithi017 ceph-mon[108970]: pgmap v803: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:10.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:09 smithi172 ceph-mon[80431]: pgmap v803: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:12.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:11 smithi017 ceph-mon[108970]: pgmap v804: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:12.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:11 smithi172 ceph-mon[80431]: pgmap v804: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:14.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:13 smithi017 ceph-mon[108970]: pgmap v805: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:14.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:13 smithi172 ceph-mon[80431]: pgmap v805: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:16.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:15 smithi017 ceph-mon[108970]: pgmap v806: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:16.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:15 smithi172 ceph-mon[80431]: pgmap v806: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:18.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:17 smithi017 ceph-mon[108970]: pgmap v807: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:18.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:17 smithi172 ceph-mon[80431]: pgmap v807: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:20.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:19 smithi017 ceph-mon[108970]: pgmap v808: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:20.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:19 smithi172 ceph-mon[80431]: pgmap v808: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:22.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:21 smithi017 ceph-mon[108970]: pgmap v809: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:22.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:21 smithi172 ceph-mon[80431]: pgmap v809: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:23.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.004+0000 7fe33175f640 1 -- 172.21.15.17:0/4167729598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe32c107900 msgr2=0x7fe32c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:23.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.004+0000 7fe33175f640 1 --2- 172.21.15.17:0/4167729598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe32c107900 0x7fe32c107ce0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009880 tx=0x7fe31c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.004+0000 7fe33175f640 1 -- 172.21.15.17:0/4167729598 shutdown_connections 2024-09-20T19:02:23.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.004+0000 7fe33175f640 1 --2- 172.21.15.17:0/4167729598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe32c101900 0x7fe32c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.004+0000 7fe33175f640 1 --2- 172.21.15.17:0/4167729598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe32c107900 0x7fe32c107ce0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.004+0000 7fe33175f640 1 -- 172.21.15.17:0/4167729598 >> 172.21.15.17:0/4167729598 conn(0x7fe32c0fd600 msgr2=0x7fe32c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:23.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.004+0000 7fe33175f640 1 -- 172.21.15.17:0/4167729598 shutdown_connections 2024-09-20T19:02:23.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.004+0000 7fe33175f640 1 -- 172.21.15.17:0/4167729598 wait complete. 2024-09-20T19:02:23.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.005+0000 7fe33175f640 1 Processor -- start 2024-09-20T19:02:23.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.005+0000 7fe33175f640 1 -- start start 2024-09-20T19:02:23.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.006+0000 7fe33175f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe32c101900 0x7fe32c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:23.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.006+0000 7fe33175f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe32c107900 0x7fe32c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:23.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.006+0000 7fe33175f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c10edd0 con 0x7fe32c107900 2024-09-20T19:02:23.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.006+0000 7fe33175f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c10ec50 con 0x7fe32c101900 2024-09-20T19:02:23.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.006+0000 7fe3227fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe32c107900 0x7fe32c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:23.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.006+0000 7fe3227fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe32c107900 0x7fe32c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44970/0 (socket says 172.21.15.17:44970) 2024-09-20T19:02:23.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.006+0000 7fe3227fc640 1 -- 172.21.15.17:0/3594294346 learned_addr learned my addr 172.21.15.17:0/3594294346 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:02:23.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.006+0000 7fe32affd640 1 --2- 172.21.15.17:0/3594294346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe32c101900 0x7fe32c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:23.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.006+0000 7fe3227fc640 1 -- 172.21.15.17:0/3594294346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe32c101900 msgr2=0x7fe32c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:23.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.006+0000 7fe3227fc640 1 --2- 172.21.15.17:0/3594294346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe32c101900 0x7fe32c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.006+0000 7fe3227fc640 1 -- 172.21.15.17:0/3594294346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32c074f70 con 0x7fe32c107900 2024-09-20T19:02:23.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.006+0000 7fe32affd640 1 --2- 172.21.15.17:0/3594294346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe32c101900 0x7fe32c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:02:23.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.006+0000 7fe3227fc640 1 --2- 172.21.15.17:0/3594294346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe32c107900 0x7fe32c074a30 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe31400e970 tx=0x7fe31400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:23.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.007+0000 7fe328ff9640 1 -- 172.21.15.17:0/3594294346 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe31400cac0 con 0x7fe32c107900 2024-09-20T19:02:23.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.007+0000 7fe33175f640 1 -- 172.21.15.17:0/3594294346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32c075260 con 0x7fe32c107900 2024-09-20T19:02:23.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.007+0000 7fe328ff9640 1 -- 172.21.15.17:0/3594294346 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe3140054e0 con 0x7fe32c107900 2024-09-20T19:02:23.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.007+0000 7fe328ff9640 1 -- 172.21.15.17:0/3594294346 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe314010430 con 0x7fe32c107900 2024-09-20T19:02:23.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.007+0000 7fe33175f640 1 -- 172.21.15.17:0/3594294346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe32c1a3e40 con 0x7fe32c107900 2024-09-20T19:02:23.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.008+0000 7fe33175f640 1 -- 172.21.15.17:0/3594294346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe32c103040 con 0x7fe32c107900 2024-09-20T19:02:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.008+0000 7fe328ff9640 1 -- 172.21.15.17:0/3594294346 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe314004f00 con 0x7fe32c107900 2024-09-20T19:02:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.009+0000 7fe328ff9640 1 --2- 172.21.15.17:0/3594294346 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe31807af40 0x7fe31807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.009+0000 7fe328ff9640 1 -- 172.21.15.17:0/3594294346 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fe31409e740 con 0x7fe32c107900 2024-09-20T19:02:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.009+0000 7fe32affd640 1 --2- 172.21.15.17:0/3594294346 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe31807af40 0x7fe31807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:23.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.010+0000 7fe32affd640 1 --2- 172.21.15.17:0/3594294346 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe31807af40 0x7fe31807d400 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe31c000c00 tx=0x7fe31c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:23.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.014+0000 7fe328ff9640 1 -- 172.21.15.17:0/3594294346 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe314069d40 con 0x7fe32c107900 2024-09-20T19:02:23.103 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:02:23.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:02:23.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.224+0000 7fe33175f640 1 -- 172.21.15.17:0/3594294346 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe32c062630 con 0x7fe31807af40 2024-09-20T19:02:23.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.226+0000 7fe328ff9640 1 -- 172.21.15.17:0/3594294346 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe32c062630 con 0x7fe31807af40 2024-09-20T19:02:23.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.228+0000 7fe33175f640 1 -- 172.21.15.17:0/3594294346 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe31807af40 msgr2=0x7fe31807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:23.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.228+0000 7fe33175f640 1 --2- 172.21.15.17:0/3594294346 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe31807af40 0x7fe31807d400 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe31c000c00 tx=0x7fe31c031400 comp rx=0 tx=0).stop 2024-09-20T19:02:23.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.228+0000 7fe33175f640 1 -- 172.21.15.17:0/3594294346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe32c107900 msgr2=0x7fe32c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:23.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.228+0000 7fe33175f640 1 --2- 172.21.15.17:0/3594294346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe32c107900 0x7fe32c074a30 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe31400e970 tx=0x7fe31400ed70 comp rx=0 tx=0).stop 2024-09-20T19:02:23.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.228+0000 7fe33175f640 1 -- 172.21.15.17:0/3594294346 shutdown_connections 2024-09-20T19:02:23.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.228+0000 7fe33175f640 1 --2- 172.21.15.17:0/3594294346 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe31807af40 0x7fe31807d400 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.228+0000 7fe33175f640 1 --2- 172.21.15.17:0/3594294346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe32c107900 0x7fe32c074a30 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.228+0000 7fe33175f640 1 --2- 172.21.15.17:0/3594294346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe32c101900 0x7fe32c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.228+0000 7fe33175f640 1 -- 172.21.15.17:0/3594294346 >> 172.21.15.17:0/3594294346 conn(0x7fe32c0fd600 msgr2=0x7fe32c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:23.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.228+0000 7fe33175f640 1 -- 172.21.15.17:0/3594294346 shutdown_connections 2024-09-20T19:02:23.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.228+0000 7fe33175f640 1 -- 172.21.15.17:0/3594294346 wait complete. 2024-09-20T19:02:23.244 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:02:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.313+0000 7f6ee4f45640 1 -- 172.21.15.17:0/33271252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee0074510 msgr2=0x7f6ee00748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.313+0000 7f6ee4f45640 1 --2- 172.21.15.17:0/33271252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee0074510 0x7f6ee00748f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009880 tx=0x7f6ed002a530 comp rx=0 tx=0).stop 2024-09-20T19:02:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.314+0000 7f6ee4f45640 1 -- 172.21.15.17:0/33271252 shutdown_connections 2024-09-20T19:02:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.314+0000 7f6ee4f45640 1 --2- 172.21.15.17:0/33271252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ee0074e30 0x7f6ee010dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.314+0000 7f6ee4f45640 1 --2- 172.21.15.17:0/33271252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee0074510 0x7f6ee00748f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.314+0000 7f6ee4f45640 1 -- 172.21.15.17:0/33271252 >> 172.21.15.17:0/33271252 conn(0x7f6ee00fd5e0 msgr2=0x7f6ee00ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.314+0000 7f6ee4f45640 1 -- 172.21.15.17:0/33271252 shutdown_connections 2024-09-20T19:02:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.314+0000 7f6ee4f45640 1 -- 172.21.15.17:0/33271252 wait complete. 2024-09-20T19:02:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.314+0000 7f6ee4f45640 1 Processor -- start 2024-09-20T19:02:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.314+0000 7f6ee4f45640 1 -- start start 2024-09-20T19:02:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.315+0000 7f6ee4f45640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ee0074510 0x7f6ee019f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.315+0000 7f6ee4f45640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee0074e30 0x7f6ee019fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.315+0000 7f6ee4f45640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee0110fe0 con 0x7f6ee0074e30 2024-09-20T19:02:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.315+0000 7f6ee4f45640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee0110e60 con 0x7f6ee0074510 2024-09-20T19:02:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.315+0000 7f6eddd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee0074e30 0x7f6ee019fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.315+0000 7f6eddd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee0074e30 0x7f6ee019fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44984/0 (socket says 172.21.15.17:44984) 2024-09-20T19:02:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.315+0000 7f6eddd9b640 1 -- 172.21.15.17:0/567843981 learned_addr learned my addr 172.21.15.17:0/567843981 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:02:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.315+0000 7f6ede59c640 1 --2- 172.21.15.17:0/567843981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ee0074510 0x7f6ee019f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.315+0000 7f6eddd9b640 1 -- 172.21.15.17:0/567843981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ee0074510 msgr2=0x7f6ee019f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.315+0000 7f6eddd9b640 1 --2- 172.21.15.17:0/567843981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ee0074510 0x7f6ee019f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.315+0000 7f6eddd9b640 1 -- 172.21.15.17:0/567843981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee0199a90 con 0x7f6ee0074e30 2024-09-20T19:02:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.315+0000 7f6eddd9b640 1 --2- 172.21.15.17:0/567843981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee0074e30 0x7f6ee019fe10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400d6f0 tx=0x7f6ed400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.315+0000 7f6ecf7fe640 1 -- 172.21.15.17:0/567843981 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ed4017070 con 0x7f6ee0074e30 2024-09-20T19:02:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.315+0000 7f6ecf7fe640 1 -- 172.21.15.17:0/567843981 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ed400de00 con 0x7f6ee0074e30 2024-09-20T19:02:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.315+0000 7f6ee4f45640 1 -- 172.21.15.17:0/567843981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee0199d80 con 0x7f6ee0074e30 2024-09-20T19:02:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.316+0000 7f6ecf7fe640 1 -- 172.21.15.17:0/567843981 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ed4004bb0 con 0x7f6ee0074e30 2024-09-20T19:02:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.316+0000 7f6ee4f45640 1 -- 172.21.15.17:0/567843981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee019a310 con 0x7f6ee0074e30 2024-09-20T19:02:23.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.317+0000 7f6ee4f45640 1 -- 172.21.15.17:0/567843981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee0075c50 con 0x7f6ee0074e30 2024-09-20T19:02:23.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.317+0000 7f6ecf7fe640 1 -- 172.21.15.17:0/567843981 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6ed4009a30 con 0x7f6ee0074e30 2024-09-20T19:02:23.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.318+0000 7f6ecf7fe640 1 --2- 172.21.15.17:0/567843981 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ec807af40 0x7f6ec807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:23.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.318+0000 7f6ecf7fe640 1 -- 172.21.15.17:0/567843981 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f6ed409dbb0 con 0x7f6ee0074e30 2024-09-20T19:02:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.318+0000 7f6ede59c640 1 --2- 172.21.15.17:0/567843981 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ec807af40 0x7f6ec807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.318+0000 7f6ede59c640 1 --2- 172.21.15.17:0/567843981 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ec807af40 0x7f6ec807d400 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0000c00 tx=0x7f6ed0031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.322+0000 7f6ecf7fe640 1 -- 172.21.15.17:0/567843981 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ed40a4080 con 0x7f6ee0074e30 2024-09-20T19:02:23.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.527+0000 7f6ee4f45640 1 -- 172.21.15.17:0/567843981 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6ee019afc0 con 0x7f6ec807af40 2024-09-20T19:02:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.528+0000 7f6ecf7fe640 1 -- 172.21.15.17:0/567843981 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6ee019afc0 con 0x7f6ec807af40 2024-09-20T19:02:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.530+0000 7f6ee4f45640 1 -- 172.21.15.17:0/567843981 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ec807af40 msgr2=0x7f6ec807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.530+0000 7f6ee4f45640 1 --2- 172.21.15.17:0/567843981 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ec807af40 0x7f6ec807d400 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0000c00 tx=0x7f6ed0031400 comp rx=0 tx=0).stop 2024-09-20T19:02:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.530+0000 7f6ee4f45640 1 -- 172.21.15.17:0/567843981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee0074e30 msgr2=0x7f6ee019fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.530+0000 7f6ee4f45640 1 --2- 172.21.15.17:0/567843981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee0074e30 0x7f6ee019fe10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400d6f0 tx=0x7f6ed400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.530+0000 7f6ee4f45640 1 -- 172.21.15.17:0/567843981 shutdown_connections 2024-09-20T19:02:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.530+0000 7f6ee4f45640 1 --2- 172.21.15.17:0/567843981 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ec807af40 0x7f6ec807d400 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.530+0000 7f6ee4f45640 1 --2- 172.21.15.17:0/567843981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ee0074e30 0x7f6ee019fe10 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.530+0000 7f6ee4f45640 1 --2- 172.21.15.17:0/567843981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ee0074510 0x7f6ee019f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.530+0000 7f6ee4f45640 1 -- 172.21.15.17:0/567843981 >> 172.21.15.17:0/567843981 conn(0x7f6ee00fd5e0 msgr2=0x7f6ee010b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.531+0000 7f6ee4f45640 1 -- 172.21.15.17:0/567843981 shutdown_connections 2024-09-20T19:02:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.531+0000 7f6ee4f45640 1 -- 172.21.15.17:0/567843981 wait complete. 2024-09-20T19:02:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.615+0000 7f5d1e13b640 1 -- 172.21.15.17:0/463392279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d18100800 msgr2=0x7f5d18100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.615+0000 7f5d1e13b640 1 --2- 172.21.15.17:0/463392279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d18100800 0x7f5d18100c60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c009880 tx=0x7f5d0c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.615+0000 7f5d1e13b640 1 -- 172.21.15.17:0/463392279 shutdown_connections 2024-09-20T19:02:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.615+0000 7f5d1e13b640 1 --2- 172.21.15.17:0/463392279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d18100800 0x7f5d18100c60 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.615+0000 7f5d1e13b640 1 --2- 172.21.15.17:0/463392279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d18106800 0x7f5d18106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.615+0000 7f5d1e13b640 1 -- 172.21.15.17:0/463392279 >> 172.21.15.17:0/463392279 conn(0x7f5d180fc520 msgr2=0x7f5d180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.616+0000 7f5d1e13b640 1 -- 172.21.15.17:0/463392279 shutdown_connections 2024-09-20T19:02:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.616+0000 7f5d1e13b640 1 -- 172.21.15.17:0/463392279 wait complete. 2024-09-20T19:02:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.616+0000 7f5d1e13b640 1 Processor -- start 2024-09-20T19:02:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.616+0000 7f5d1e13b640 1 -- start start 2024-09-20T19:02:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.617+0000 7f5d1e13b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d18100800 0x7f5d180fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.617+0000 7f5d1e13b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d18106800 0x7f5d180fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.617+0000 7f5d1e13b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1810dcb0 con 0x7f5d18106800 2024-09-20T19:02:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.617+0000 7f5d1e13b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1810db30 con 0x7f5d18100800 2024-09-20T19:02:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.617+0000 7f5d16ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d18106800 0x7f5d180fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.617+0000 7f5d16ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d18106800 0x7f5d180fd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45000/0 (socket says 172.21.15.17:45000) 2024-09-20T19:02:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.617+0000 7f5d16ffd640 1 -- 172.21.15.17:0/1595266383 learned_addr learned my addr 172.21.15.17:0/1595266383 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:02:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.617+0000 7f5d177fe640 1 --2- 172.21.15.17:0/1595266383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d18100800 0x7f5d180fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.617+0000 7f5d16ffd640 1 -- 172.21.15.17:0/1595266383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d18100800 msgr2=0x7f5d180fcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.617+0000 7f5d16ffd640 1 --2- 172.21.15.17:0/1595266383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d18100800 0x7f5d180fcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.617+0000 7f5d16ffd640 1 -- 172.21.15.17:0/1595266383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d180fd690 con 0x7f5d18106800 2024-09-20T19:02:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.617+0000 7f5d177fe640 1 --2- 172.21.15.17:0/1595266383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d18100800 0x7f5d180fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:02:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.617+0000 7f5d16ffd640 1 --2- 172.21.15.17:0/1595266383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d18106800 0x7f5d180fd150 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c031460 tx=0x7f5d0c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.617+0000 7f5d14ff9640 1 -- 172.21.15.17:0/1595266383 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d0c03f070 con 0x7f5d18106800 2024-09-20T19:02:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.617+0000 7f5d1e13b640 1 -- 172.21.15.17:0/1595266383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d180fd920 con 0x7f5d18106800 2024-09-20T19:02:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.617+0000 7f5d14ff9640 1 -- 172.21.15.17:0/1595266383 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5d0c004cf0 con 0x7f5d18106800 2024-09-20T19:02:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.618+0000 7f5d14ff9640 1 -- 172.21.15.17:0/1595266383 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d0c035030 con 0x7f5d18106800 2024-09-20T19:02:23.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.618+0000 7f5d1e13b640 1 -- 172.21.15.17:0/1595266383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d181a3d60 con 0x7f5d18106800 2024-09-20T19:02:23.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.619+0000 7f5d1e13b640 1 -- 172.21.15.17:0/1595266383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d18101f40 con 0x7f5d18106800 2024-09-20T19:02:23.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.619+0000 7f5d14ff9640 1 -- 172.21.15.17:0/1595266383 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5d0c042070 con 0x7f5d18106800 2024-09-20T19:02:23.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.620+0000 7f5d14ff9640 1 --2- 172.21.15.17:0/1595266383 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5d0007af30 0x7f5d0007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:23.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.620+0000 7f5d14ff9640 1 -- 172.21.15.17:0/1595266383 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f5d0c0beb20 con 0x7f5d18106800 2024-09-20T19:02:23.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.620+0000 7f5d177fe640 1 --2- 172.21.15.17:0/1595266383 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5d0007af30 0x7f5d0007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:23.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.620+0000 7f5d177fe640 1 --2- 172.21.15.17:0/1595266383 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5d0007af30 0x7f5d0007d3f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800baa0 tx=0x7f5d08005d90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:23.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.624+0000 7f5d14ff9640 1 -- 172.21.15.17:0/1595266383 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5d0c08a120 con 0x7f5d18106800 2024-09-20T19:02:23.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.821+0000 7f5d1e13b640 1 -- 172.21.15.17:0/1595266383 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5d18062630 con 0x7f5d0007af30 2024-09-20T19:02:23.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.831+0000 7f5d14ff9640 1 -- 172.21.15.17:0/1595266383 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5d18062630 con 0x7f5d0007af30 2024-09-20T19:02:23.839 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:02:23.839 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (23m) 2m ago 34m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:02:23.839 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (26m) 2m ago 34m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:02:23.839 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (26m) 2m ago 34m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:02:23.839 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (22m) 2m ago 34m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:02:23.839 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (22m) 2m ago 34m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:02:23.839 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (23m) 2m ago 34m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:02:23.839 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (18m) 2m ago 29m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:02:23.839 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (18m) 2m ago 29m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:02:23.839 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (2m) 2m ago 29m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:02:23.839 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (17m) 2m ago 29m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:02:23.839 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (25m) 2m ago 36m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:02:23.840 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (24m) 2m ago 33m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:02:23.840 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (22m) 2m ago 36m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:02:23.840 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (22m) 2m ago 33m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:02:23.840 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (24m) 2m ago 34m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:02:23.840 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (24m) 2m ago 33m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:02:23.840 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (21m) 2m ago 32m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:02:23.840 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (21m) 2m ago 32m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:02:23.840 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (20m) 2m ago 31m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:02:23.840 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (19m) 2m ago 31m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:02:23.840 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (19m) 2m ago 30m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:02:23.840 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (18m) 2m ago 30m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:02:23.840 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (24m) 2m ago 34m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:02:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.834+0000 7f5d1e13b640 1 -- 172.21.15.17:0/1595266383 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5d0007af30 msgr2=0x7f5d0007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.834+0000 7f5d1e13b640 1 --2- 172.21.15.17:0/1595266383 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5d0007af30 0x7f5d0007d3f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800baa0 tx=0x7f5d08005d90 comp rx=0 tx=0).stop 2024-09-20T19:02:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.834+0000 7f5d1e13b640 1 -- 172.21.15.17:0/1595266383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d18106800 msgr2=0x7f5d180fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.834+0000 7f5d1e13b640 1 --2- 172.21.15.17:0/1595266383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d18106800 0x7f5d180fd150 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c031460 tx=0x7f5d0c0048f0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.834+0000 7f5d1e13b640 1 -- 172.21.15.17:0/1595266383 shutdown_connections 2024-09-20T19:02:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.834+0000 7f5d1e13b640 1 --2- 172.21.15.17:0/1595266383 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5d0007af30 0x7f5d0007d3f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.834+0000 7f5d1e13b640 1 --2- 172.21.15.17:0/1595266383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d18106800 0x7f5d180fd150 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.834+0000 7f5d1e13b640 1 --2- 172.21.15.17:0/1595266383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d18100800 0x7f5d180fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.834+0000 7f5d1e13b640 1 -- 172.21.15.17:0/1595266383 >> 172.21.15.17:0/1595266383 conn(0x7f5d180fc520 msgr2=0x7f5d1806a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.834+0000 7f5d1e13b640 1 -- 172.21.15.17:0/1595266383 shutdown_connections 2024-09-20T19:02:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.834+0000 7f5d1e13b640 1 -- 172.21.15.17:0/1595266383 wait complete. 2024-09-20T19:02:23.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.918+0000 7f7d2dacf640 1 -- 172.21.15.17:0/1173000041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d28100ad0 msgr2=0x7f7d28106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:23.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.918+0000 7f7d2dacf640 1 --2- 172.21.15.17:0/1173000041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d28100ad0 0x7f7d28106610 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7d14009880 tx=0x7f7d1402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.918+0000 7f7d2dacf640 1 -- 172.21.15.17:0/1173000041 shutdown_connections 2024-09-20T19:02:23.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.918+0000 7f7d2dacf640 1 --2- 172.21.15.17:0/1173000041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d28100ad0 0x7f7d28106610 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.918+0000 7f7d2dacf640 1 --2- 172.21.15.17:0/1173000041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d28100120 0x7f7d28100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.918+0000 7f7d2dacf640 1 -- 172.21.15.17:0/1173000041 >> 172.21.15.17:0/1173000041 conn(0x7f7d280fbc90 msgr2=0x7f7d280fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:23.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.918+0000 7f7d2dacf640 1 -- 172.21.15.17:0/1173000041 shutdown_connections 2024-09-20T19:02:23.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.918+0000 7f7d2dacf640 1 -- 172.21.15.17:0/1173000041 wait complete. 2024-09-20T19:02:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.919+0000 7f7d2dacf640 1 Processor -- start 2024-09-20T19:02:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.919+0000 7f7d2dacf640 1 -- start start 2024-09-20T19:02:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.920+0000 7f7d2dacf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d28100120 0x7f7d2819d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.920+0000 7f7d2dacf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d28100ad0 0x7f7d2819dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.920+0000 7f7d2dacf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2810ee60 con 0x7f7d28100120 2024-09-20T19:02:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.920+0000 7f7d2dacf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2810ece0 con 0x7f7d28100ad0 2024-09-20T19:02:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.920+0000 7f7d277fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d28100120 0x7f7d2819d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.920+0000 7f7d277fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d28100120 0x7f7d2819d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45008/0 (socket says 172.21.15.17:45008) 2024-09-20T19:02:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.920+0000 7f7d277fe640 1 -- 172.21.15.17:0/341421700 learned_addr learned my addr 172.21.15.17:0/341421700 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:02:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.920+0000 7f7d26ffd640 1 --2- 172.21.15.17:0/341421700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d28100ad0 0x7f7d2819dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:23.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.920+0000 7f7d277fe640 1 -- 172.21.15.17:0/341421700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d28100ad0 msgr2=0x7f7d2819dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:23.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.920+0000 7f7d277fe640 1 --2- 172.21.15.17:0/341421700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d28100ad0 0x7f7d2819dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:23.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.920+0000 7f7d277fe640 1 -- 172.21.15.17:0/341421700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d281978c0 con 0x7f7d28100120 2024-09-20T19:02:23.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.920+0000 7f7d277fe640 1 --2- 172.21.15.17:0/341421700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d28100120 0x7f7d2819d700 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800d6f0 tx=0x7f7d1800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:23.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.920+0000 7f7d24ff9640 1 -- 172.21.15.17:0/341421700 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d18017070 con 0x7f7d28100120 2024-09-20T19:02:23.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.920+0000 7f7d2dacf640 1 -- 172.21.15.17:0/341421700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d28197bb0 con 0x7f7d28100120 2024-09-20T19:02:23.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.920+0000 7f7d24ff9640 1 -- 172.21.15.17:0/341421700 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7d1800de00 con 0x7f7d28100120 2024-09-20T19:02:23.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.920+0000 7f7d24ff9640 1 -- 172.21.15.17:0/341421700 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d18004bb0 con 0x7f7d28100120 2024-09-20T19:02:23.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.921+0000 7f7d2dacf640 1 -- 172.21.15.17:0/341421700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d28198110 con 0x7f7d28100120 2024-09-20T19:02:23.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.922+0000 7f7d2dacf640 1 -- 172.21.15.17:0/341421700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d281031e0 con 0x7f7d28100120 2024-09-20T19:02:23.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.922+0000 7f7d24ff9640 1 -- 172.21.15.17:0/341421700 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7d18004e60 con 0x7f7d28100120 2024-09-20T19:02:23.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.923+0000 7f7d24ff9640 1 --2- 172.21.15.17:0/341421700 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7d0c07af30 0x7f7d0c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:23.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.923+0000 7f7d26ffd640 1 --2- 172.21.15.17:0/341421700 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7d0c07af30 0x7f7d0c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:23.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.923+0000 7f7d24ff9640 1 -- 172.21.15.17:0/341421700 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f7d1809dba0 con 0x7f7d28100120 2024-09-20T19:02:23.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.923+0000 7f7d26ffd640 1 --2- 172.21.15.17:0/341421700 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7d0c07af30 0x7f7d0c07d3f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7d14000c00 tx=0x7f7d14031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:23.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:23.927+0000 7f7d24ff9640 1 -- 172.21.15.17:0/341421700 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d180691a0 con 0x7f7d28100120 2024-09-20T19:02:24.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:23 smithi017 ceph-mon[108970]: pgmap v810: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:24.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.191+0000 7f7d2dacf640 1 -- 172.21.15.17:0/341421700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7d28109ef0 con 0x7f7d28100120 2024-09-20T19:02:24.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.192+0000 7f7d24ff9640 1 -- 172.21.15.17:0/341421700 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f7d1806e050 con 0x7f7d28100120 2024-09-20T19:02:24.199 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:02:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:02:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:02:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:02:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:02:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:02:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:02:24.199 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:02:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:02:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:02:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:02:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:02:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:02:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:02:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:02:24.200 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:02:24.200 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:02:24.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.194+0000 7f7d2dacf640 1 -- 172.21.15.17:0/341421700 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7d0c07af30 msgr2=0x7f7d0c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:24.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.194+0000 7f7d2dacf640 1 --2- 172.21.15.17:0/341421700 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7d0c07af30 0x7f7d0c07d3f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7d14000c00 tx=0x7f7d14031400 comp rx=0 tx=0).stop 2024-09-20T19:02:24.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.194+0000 7f7d2dacf640 1 -- 172.21.15.17:0/341421700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d28100120 msgr2=0x7f7d2819d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:24.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.194+0000 7f7d2dacf640 1 --2- 172.21.15.17:0/341421700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d28100120 0x7f7d2819d700 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800d6f0 tx=0x7f7d1800dbb0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.194+0000 7f7d2dacf640 1 -- 172.21.15.17:0/341421700 shutdown_connections 2024-09-20T19:02:24.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.194+0000 7f7d2dacf640 1 --2- 172.21.15.17:0/341421700 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7d0c07af30 0x7f7d0c07d3f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.194+0000 7f7d2dacf640 1 --2- 172.21.15.17:0/341421700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d28100ad0 0x7f7d2819dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.194+0000 7f7d2dacf640 1 --2- 172.21.15.17:0/341421700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d28100120 0x7f7d2819d700 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.194+0000 7f7d2dacf640 1 -- 172.21.15.17:0/341421700 >> 172.21.15.17:0/341421700 conn(0x7f7d280fbc90 msgr2=0x7f7d280fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:24.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.194+0000 7f7d2dacf640 1 -- 172.21.15.17:0/341421700 shutdown_connections 2024-09-20T19:02:24.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.194+0000 7f7d2dacf640 1 -- 172.21.15.17:0/341421700 wait complete. 2024-09-20T19:02:24.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:23 smithi172 ceph-mon[80431]: pgmap v810: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:24.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.278+0000 7fb1d9b7b640 1 -- 172.21.15.17:0/2781338216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1d4102ab0 msgr2=0x7fb1d4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:24.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.278+0000 7fb1d9b7b640 1 --2- 172.21.15.17:0/2781338216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1d4102ab0 0x7fb1d4102e90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009880 tx=0x7fb1c402a530 comp rx=0 tx=0).stop 2024-09-20T19:02:24.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.278+0000 7fb1d9b7b640 1 -- 172.21.15.17:0/2781338216 shutdown_connections 2024-09-20T19:02:24.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.278+0000 7fb1d9b7b640 1 --2- 172.21.15.17:0/2781338216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1d41033d0 0x7fb1d410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.278+0000 7fb1d9b7b640 1 --2- 172.21.15.17:0/2781338216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1d4102ab0 0x7fb1d4102e90 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.278+0000 7fb1d9b7b640 1 -- 172.21.15.17:0/2781338216 >> 172.21.15.17:0/2781338216 conn(0x7fb1d40fc550 msgr2=0x7fb1d40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:24.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.278+0000 7fb1d9b7b640 1 -- 172.21.15.17:0/2781338216 shutdown_connections 2024-09-20T19:02:24.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.278+0000 7fb1d9b7b640 1 -- 172.21.15.17:0/2781338216 wait complete. 2024-09-20T19:02:24.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.279+0000 7fb1d9b7b640 1 Processor -- start 2024-09-20T19:02:24.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.279+0000 7fb1d9b7b640 1 -- start start 2024-09-20T19:02:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.279+0000 7fb1d9b7b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1d4102ab0 0x7fb1d419f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.279+0000 7fb1d9b7b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1d41033d0 0x7fb1d419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.279+0000 7fb1d9b7b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d410ede0 con 0x7fb1d4102ab0 2024-09-20T19:02:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.279+0000 7fb1d9b7b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d410ec60 con 0x7fb1d41033d0 2024-09-20T19:02:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.279+0000 7fb1d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1d4102ab0 0x7fb1d419f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.279+0000 7fb1d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1d4102ab0 0x7fb1d419f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45020/0 (socket says 172.21.15.17:45020) 2024-09-20T19:02:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.279+0000 7fb1d37fe640 1 -- 172.21.15.17:0/3269286973 learned_addr learned my addr 172.21.15.17:0/3269286973 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:02:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.279+0000 7fb1d2ffd640 1 --2- 172.21.15.17:0/3269286973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1d41033d0 0x7fb1d419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:24.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.280+0000 7fb1d37fe640 1 -- 172.21.15.17:0/3269286973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1d41033d0 msgr2=0x7fb1d419fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:24.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.280+0000 7fb1d37fe640 1 --2- 172.21.15.17:0/3269286973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1d41033d0 0x7fb1d419fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.280+0000 7fb1d37fe640 1 -- 172.21.15.17:0/3269286973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d4199a20 con 0x7fb1d4102ab0 2024-09-20T19:02:24.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.280+0000 7fb1d2ffd640 1 --2- 172.21.15.17:0/3269286973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1d41033d0 0x7fb1d419fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:02:24.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.280+0000 7fb1d37fe640 1 --2- 172.21.15.17:0/3269286973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1d4102ab0 0x7fb1d419f810 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4031460 tx=0x7fb1c40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:24.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.280+0000 7fb1d0ff9640 1 -- 172.21.15.17:0/3269286973 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1c403f070 con 0x7fb1d4102ab0 2024-09-20T19:02:24.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.280+0000 7fb1d0ff9640 1 -- 172.21.15.17:0/3269286973 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb1c4004cf0 con 0x7fb1d4102ab0 2024-09-20T19:02:24.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.280+0000 7fb1d9b7b640 1 -- 172.21.15.17:0/3269286973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d4199cb0 con 0x7fb1d4102ab0 2024-09-20T19:02:24.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.280+0000 7fb1d0ff9640 1 -- 172.21.15.17:0/3269286973 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1c4035030 con 0x7fb1d4102ab0 2024-09-20T19:02:24.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.280+0000 7fb1d9b7b640 1 -- 172.21.15.17:0/3269286973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d419a1e0 con 0x7fb1d4102ab0 2024-09-20T19:02:24.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.281+0000 7fb1d9b7b640 1 -- 172.21.15.17:0/3269286973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d406a580 con 0x7fb1d4102ab0 2024-09-20T19:02:24.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.282+0000 7fb1d0ff9640 1 -- 172.21.15.17:0/3269286973 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb1c4042070 con 0x7fb1d4102ab0 2024-09-20T19:02:24.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.282+0000 7fb1d0ff9640 1 --2- 172.21.15.17:0/3269286973 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb1bc07af30 0x7fb1bc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:24.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.282+0000 7fb1d0ff9640 1 -- 172.21.15.17:0/3269286973 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fb1c40beac0 con 0x7fb1d4102ab0 2024-09-20T19:02:24.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.282+0000 7fb1d2ffd640 1 --2- 172.21.15.17:0/3269286973 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb1bc07af30 0x7fb1bc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:24.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.283+0000 7fb1d2ffd640 1 --2- 172.21.15.17:0/3269286973 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb1bc07af30 0x7fb1bc07d3f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40feeb0 tx=0x7fb1c8005dd0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:24.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.287+0000 7fb1d0ff9640 1 -- 172.21.15.17:0/3269286973 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb1c408a0c0 con 0x7fb1d4102ab0 2024-09-20T19:02:24.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.515+0000 7fb1d9b7b640 1 -- 172.21.15.17:0/3269286973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb1d419af00 con 0x7fb1d4102ab0 2024-09-20T19:02:24.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.515+0000 7fb1d0ff9640 1 -- 172.21.15.17:0/3269286973 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7fb1c408ef70 con 0x7fb1d4102ab0 2024-09-20T19:02:24.523 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:02:24.523 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:02:24.523 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:02:24.523 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:02:24.523 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:02:24.523 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:02:24.523 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:02:24.523 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:02:24.523 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:02:24.523 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:02:24.523 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:02:24.524 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:02:24.524 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:02:24.524 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:02:24.524 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:02:24.524 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:02:24.524 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:02:24.524 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:02:24.524 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:02:24.524 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:02:24.524 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:02:24.524 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:02:24.524 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:02:24.525 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:02:24.525 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:02:24.525 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:02:24.525 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:02:24.525 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:02:24.525 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:02:24.525 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:02:24.525 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:02:24.525 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:02:24.525 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:02:24.525 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:02:24.525 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:02:24.525 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:02:24.525 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:02:24.525 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:02:24.526 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:02:24.526 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:02:24.526 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:02:24.526 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:02:24.526 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:02:24.527 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:02:24.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.518+0000 7fb1d9b7b640 1 -- 172.21.15.17:0/3269286973 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb1bc07af30 msgr2=0x7fb1bc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:24.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.518+0000 7fb1d9b7b640 1 --2- 172.21.15.17:0/3269286973 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb1bc07af30 0x7fb1bc07d3f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40feeb0 tx=0x7fb1c8005dd0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.518+0000 7fb1d9b7b640 1 -- 172.21.15.17:0/3269286973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1d4102ab0 msgr2=0x7fb1d419f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:24.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.518+0000 7fb1d9b7b640 1 --2- 172.21.15.17:0/3269286973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1d4102ab0 0x7fb1d419f810 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4031460 tx=0x7fb1c40048f0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.518+0000 7fb1d9b7b640 1 -- 172.21.15.17:0/3269286973 shutdown_connections 2024-09-20T19:02:24.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.518+0000 7fb1d9b7b640 1 --2- 172.21.15.17:0/3269286973 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb1bc07af30 0x7fb1bc07d3f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.518+0000 7fb1d9b7b640 1 --2- 172.21.15.17:0/3269286973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1d41033d0 0x7fb1d419fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.518+0000 7fb1d9b7b640 1 --2- 172.21.15.17:0/3269286973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1d4102ab0 0x7fb1d419f810 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.518+0000 7fb1d9b7b640 1 -- 172.21.15.17:0/3269286973 >> 172.21.15.17:0/3269286973 conn(0x7fb1d40fc550 msgr2=0x7fb1d4100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:24.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.518+0000 7fb1d9b7b640 1 -- 172.21.15.17:0/3269286973 shutdown_connections 2024-09-20T19:02:24.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.518+0000 7fb1d9b7b640 1 -- 172.21.15.17:0/3269286973 wait complete. 2024-09-20T19:02:24.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.604+0000 7f806f59e640 1 -- 172.21.15.17:0/4116999536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070103230 msgr2=0x7f807010b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:24.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.604+0000 7f806f59e640 1 --2- 172.21.15.17:0/4116999536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070103230 0x7f807010b720 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8064009880 tx=0x7f806402a530 comp rx=0 tx=0).stop 2024-09-20T19:02:24.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.604+0000 7f806f59e640 1 -- 172.21.15.17:0/4116999536 shutdown_connections 2024-09-20T19:02:24.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.604+0000 7f806f59e640 1 --2- 172.21.15.17:0/4116999536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070103230 0x7f807010b720 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.604+0000 7f806f59e640 1 --2- 172.21.15.17:0/4116999536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8070102910 0x7f8070102cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.604+0000 7f806f59e640 1 -- 172.21.15.17:0/4116999536 >> 172.21.15.17:0/4116999536 conn(0x7f80700fc350 msgr2=0x7f80700fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:24.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.604+0000 7f806f59e640 1 -- 172.21.15.17:0/4116999536 shutdown_connections 2024-09-20T19:02:24.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.604+0000 7f806f59e640 1 -- 172.21.15.17:0/4116999536 wait complete. 2024-09-20T19:02:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.605+0000 7f806f59e640 1 Processor -- start 2024-09-20T19:02:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.605+0000 7f806f59e640 1 -- start start 2024-09-20T19:02:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.605+0000 7f806f59e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070102910 0x7f8070100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.605+0000 7f806f59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8070103230 0x7f8070100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.605+0000 7f806f59e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f807010ec20 con 0x7f8070102910 2024-09-20T19:02:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.605+0000 7f806f59e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f807010eaa0 con 0x7f8070103230 2024-09-20T19:02:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.605+0000 7f806e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070102910 0x7f8070100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.605+0000 7f806e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070102910 0x7f8070100570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45046/0 (socket says 172.21.15.17:45046) 2024-09-20T19:02:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.605+0000 7f806e59c640 1 -- 172.21.15.17:0/3980706712 learned_addr learned my addr 172.21.15.17:0/3980706712 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:02:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.605+0000 7f806dd9b640 1 --2- 172.21.15.17:0/3980706712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8070103230 0x7f8070100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.606+0000 7f806e59c640 1 -- 172.21.15.17:0/3980706712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8070103230 msgr2=0x7f8070100ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.606+0000 7f806e59c640 1 --2- 172.21.15.17:0/3980706712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8070103230 0x7f8070100ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.606+0000 7f806e59c640 1 -- 172.21.15.17:0/3980706712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8070100ff0 con 0x7f8070102910 2024-09-20T19:02:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.606+0000 7f806e59c640 1 --2- 172.21.15.17:0/3980706712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070102910 0x7f8070100570 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f806000d8d0 tx=0x7f806000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.606+0000 7f805f7fe640 1 -- 172.21.15.17:0/3980706712 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8060017030 con 0x7f8070102910 2024-09-20T19:02:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.606+0000 7f805f7fe640 1 -- 172.21.15.17:0/3980706712 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8060004020 con 0x7f8070102910 2024-09-20T19:02:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.606+0000 7f806f59e640 1 -- 172.21.15.17:0/3980706712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80701012e0 con 0x7f8070102910 2024-09-20T19:02:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.606+0000 7f805f7fe640 1 -- 172.21.15.17:0/3980706712 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80600047a0 con 0x7f8070102910 2024-09-20T19:02:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.606+0000 7f806f59e640 1 -- 172.21.15.17:0/3980706712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80701a3c90 con 0x7f8070102910 2024-09-20T19:02:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.607+0000 7f806f59e640 1 -- 172.21.15.17:0/3980706712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f807006aa90 con 0x7f8070102910 2024-09-20T19:02:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.608+0000 7f805f7fe640 1 -- 172.21.15.17:0/3980706712 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f80600041d0 con 0x7f8070102910 2024-09-20T19:02:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.608+0000 7f805f7fe640 1 --2- 172.21.15.17:0/3980706712 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f805807af90 0x7f805807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.608+0000 7f805f7fe640 1 -- 172.21.15.17:0/3980706712 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f8060018070 con 0x7f8070102910 2024-09-20T19:02:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.609+0000 7f806dd9b640 1 --2- 172.21.15.17:0/3980706712 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f805807af90 0x7f805807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.609+0000 7f806dd9b640 1 --2- 172.21.15.17:0/3980706712 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f805807af90 0x7f805807d450 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8070102000 tx=0x7f8064031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:24.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.613+0000 7f805f7fe640 1 -- 172.21.15.17:0/3980706712 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8060069370 con 0x7f8070102910 2024-09-20T19:02:24.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.818+0000 7f806f59e640 1 -- 172.21.15.17:0/3980706712 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8070105e20 con 0x7f805807af90 2024-09-20T19:02:24.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.819+0000 7f805f7fe640 1 -- 172.21.15.17:0/3980706712 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8064004260 con 0x7f805807af90 2024-09-20T19:02:24.826 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:02:24.826 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:02:24.826 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:02:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:02:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:02:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:02:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:02:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:02:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:02:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:02:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:02:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:02:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:02:24.827 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:02:24.827 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:02:24.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.821+0000 7f806f59e640 1 -- 172.21.15.17:0/3980706712 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f805807af90 msgr2=0x7f805807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:24.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.821+0000 7f806f59e640 1 --2- 172.21.15.17:0/3980706712 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f805807af90 0x7f805807d450 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8070102000 tx=0x7f8064031400 comp rx=0 tx=0).stop 2024-09-20T19:02:24.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.821+0000 7f806f59e640 1 -- 172.21.15.17:0/3980706712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070102910 msgr2=0x7f8070100570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:24.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.821+0000 7f806f59e640 1 --2- 172.21.15.17:0/3980706712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070102910 0x7f8070100570 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f806000d8d0 tx=0x7f806000dd90 comp rx=0 tx=0).stop 2024-09-20T19:02:24.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.821+0000 7f806f59e640 1 -- 172.21.15.17:0/3980706712 shutdown_connections 2024-09-20T19:02:24.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.821+0000 7f806f59e640 1 --2- 172.21.15.17:0/3980706712 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f805807af90 0x7f805807d450 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.821+0000 7f806f59e640 1 --2- 172.21.15.17:0/3980706712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8070103230 0x7f8070100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.821+0000 7f806f59e640 1 --2- 172.21.15.17:0/3980706712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8070102910 0x7f8070100570 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.821+0000 7f806f59e640 1 -- 172.21.15.17:0/3980706712 >> 172.21.15.17:0/3980706712 conn(0x7f80700fc350 msgr2=0x7f8070108d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:24.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.822+0000 7f806f59e640 1 -- 172.21.15.17:0/3980706712 shutdown_connections 2024-09-20T19:02:24.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.822+0000 7f806f59e640 1 -- 172.21.15.17:0/3980706712 wait complete. 2024-09-20T19:02:24.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.907+0000 7fd256aac640 1 -- 172.21.15.17:0/3003030842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd250101900 msgr2=0x7fd250101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:24.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.907+0000 7fd256aac640 1 --2- 172.21.15.17:0/3003030842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd250101900 0x7fd250101d60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd238009880 tx=0x7fd23802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.907+0000 7fd256aac640 1 -- 172.21.15.17:0/3003030842 shutdown_connections 2024-09-20T19:02:24.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.907+0000 7fd256aac640 1 --2- 172.21.15.17:0/3003030842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd250101900 0x7fd250101d60 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.907+0000 7fd256aac640 1 --2- 172.21.15.17:0/3003030842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd250107900 0x7fd250107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.907+0000 7fd256aac640 1 -- 172.21.15.17:0/3003030842 >> 172.21.15.17:0/3003030842 conn(0x7fd2500fd600 msgr2=0x7fd2500ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:24.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.907+0000 7fd256aac640 1 -- 172.21.15.17:0/3003030842 shutdown_connections 2024-09-20T19:02:24.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.907+0000 7fd256aac640 1 -- 172.21.15.17:0/3003030842 wait complete. 2024-09-20T19:02:24.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.908+0000 7fd256aac640 1 Processor -- start 2024-09-20T19:02:24.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.908+0000 7fd256aac640 1 -- start start 2024-09-20T19:02:24.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.908+0000 7fd256aac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd250101900 0x7fd2500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:24.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.908+0000 7fd256aac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd250107900 0x7fd250074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:24.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.908+0000 7fd256aac640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd25010edb0 con 0x7fd250101900 2024-09-20T19:02:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.908+0000 7fd256aac640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd25010ec30 con 0x7fd250107900 2024-09-20T19:02:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.908+0000 7fd254848640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd250101900 0x7fd2500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.908+0000 7fd254848640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd250101900 0x7fd2500744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45062/0 (socket says 172.21.15.17:45062) 2024-09-20T19:02:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.908+0000 7fd254848640 1 -- 172.21.15.17:0/1854927782 learned_addr learned my addr 172.21.15.17:0/1854927782 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:02:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.908+0000 7fd24ffff640 1 --2- 172.21.15.17:0/1854927782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd250107900 0x7fd250074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.908+0000 7fd254848640 1 -- 172.21.15.17:0/1854927782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd250107900 msgr2=0x7fd250074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.908+0000 7fd254848640 1 --2- 172.21.15.17:0/1854927782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd250107900 0x7fd250074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.908+0000 7fd254848640 1 -- 172.21.15.17:0/1854927782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd250074f70 con 0x7fd250101900 2024-09-20T19:02:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.908+0000 7fd254848640 1 --2- 172.21.15.17:0/1854927782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd250101900 0x7fd2500744f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd24000c810 tx=0x7fd24000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.909+0000 7fd24dffb640 1 -- 172.21.15.17:0/1854927782 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd240004020 con 0x7fd250101900 2024-09-20T19:02:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.909+0000 7fd24dffb640 1 -- 172.21.15.17:0/1854927782 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd2400041c0 con 0x7fd250101900 2024-09-20T19:02:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.909+0000 7fd256aac640 1 -- 172.21.15.17:0/1854927782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd250075260 con 0x7fd250101900 2024-09-20T19:02:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.909+0000 7fd24dffb640 1 -- 172.21.15.17:0/1854927782 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2400047a0 con 0x7fd250101900 2024-09-20T19:02:24.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.909+0000 7fd256aac640 1 -- 172.21.15.17:0/1854927782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2501a3e80 con 0x7fd250101900 2024-09-20T19:02:24.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.910+0000 7fd256aac640 1 -- 172.21.15.17:0/1854927782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd250103040 con 0x7fd250101900 2024-09-20T19:02:24.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.910+0000 7fd24dffb640 1 -- 172.21.15.17:0/1854927782 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd2400079b0 con 0x7fd250101900 2024-09-20T19:02:24.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.911+0000 7fd24dffb640 1 --2- 172.21.15.17:0/1854927782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd23c07af80 0x7fd23c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:24.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.911+0000 7fd24dffb640 1 -- 172.21.15.17:0/1854927782 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fd24009ddb0 con 0x7fd250101900 2024-09-20T19:02:24.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.911+0000 7fd24ffff640 1 --2- 172.21.15.17:0/1854927782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd23c07af80 0x7fd23c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:24.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.912+0000 7fd24ffff640 1 --2- 172.21.15.17:0/1854927782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd23c07af80 0x7fd23c07d440 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd250075f80 tx=0x7fd238031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:24.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:24.915+0000 7fd24dffb640 1 -- 172.21.15.17:0/1854927782 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd240014030 con 0x7fd250101900 2024-09-20T19:02:25.120 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:24 smithi017 ceph-mon[108970]: from='client.35296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:25.120 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:24 smithi017 ceph-mon[108970]: from='client.35300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:25.120 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:24 smithi017 ceph-mon[108970]: from='client.35304 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:25.120 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:24 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/341421700' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:02:25.120 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:24 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3269286973' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:02:25.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:25.181+0000 7fd256aac640 1 -- 172.21.15.17:0/1854927782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fd250101d60 con 0x7fd250101900 2024-09-20T19:02:25.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:25.181+0000 7fd24dffb640 1 -- 172.21.15.17:0/1854927782 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fd240069430 con 0x7fd250101900 2024-09-20T19:02:25.188 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:02:25.188 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:02:25.188 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:02:25.189 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:02:25.189 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:02:25.189 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:02:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:02:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:02:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:02:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:02:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:02:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:02:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:02:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:02:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:02:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:02:25.189 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:02:25.190 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:02:25.190 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:02:25.190 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:02:25.190 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:02:25.190 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:02:25.190 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:02:25.190 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:02:25.190 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:02:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:25.184+0000 7fd256aac640 1 -- 172.21.15.17:0/1854927782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd23c07af80 msgr2=0x7fd23c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:25.184+0000 7fd256aac640 1 --2- 172.21.15.17:0/1854927782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd23c07af80 0x7fd23c07d440 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd250075f80 tx=0x7fd238031400 comp rx=0 tx=0).stop 2024-09-20T19:02:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:25.184+0000 7fd256aac640 1 -- 172.21.15.17:0/1854927782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd250101900 msgr2=0x7fd2500744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:25.184+0000 7fd256aac640 1 --2- 172.21.15.17:0/1854927782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd250101900 0x7fd2500744f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd24000c810 tx=0x7fd24000ccd0 comp rx=0 tx=0).stop 2024-09-20T19:02:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:25.184+0000 7fd256aac640 1 -- 172.21.15.17:0/1854927782 shutdown_connections 2024-09-20T19:02:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:25.184+0000 7fd256aac640 1 --2- 172.21.15.17:0/1854927782 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd23c07af80 0x7fd23c07d440 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:25.184+0000 7fd256aac640 1 --2- 172.21.15.17:0/1854927782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd250107900 0x7fd250074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:25.184+0000 7fd256aac640 1 --2- 172.21.15.17:0/1854927782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd250101900 0x7fd2500744f0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:25.184+0000 7fd256aac640 1 -- 172.21.15.17:0/1854927782 >> 172.21.15.17:0/1854927782 conn(0x7fd2500fd600 msgr2=0x7fd2500fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:25.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:25.184+0000 7fd256aac640 1 -- 172.21.15.17:0/1854927782 shutdown_connections 2024-09-20T19:02:25.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:25.184+0000 7fd256aac640 1 -- 172.21.15.17:0/1854927782 wait complete. 2024-09-20T19:02:25.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:24 smithi172 ceph-mon[80431]: from='client.35296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:25.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:24 smithi172 ceph-mon[80431]: from='client.35300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:25.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:24 smithi172 ceph-mon[80431]: from='client.35304 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:25.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:24 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/341421700' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:02:25.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:24 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3269286973' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:02:26.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:25 smithi172 ceph-mon[80431]: pgmap v811: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:26.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:25 smithi172 ceph-mon[80431]: from='client.35316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:26.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:25 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1854927782' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:02:26.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:25 smithi017 ceph-mon[108970]: pgmap v811: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:26.393 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:25 smithi017 ceph-mon[108970]: from='client.35316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:26.393 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:25 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1854927782' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:02:28.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:27 smithi172 ceph-mon[80431]: pgmap v812: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:28.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:27 smithi017 ceph-mon[108970]: pgmap v812: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:30.195 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:29 smithi017 ceph-mon[108970]: pgmap v813: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:30.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:29 smithi172 ceph-mon[80431]: pgmap v813: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:32.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:31 smithi172 ceph-mon[80431]: pgmap v814: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:32.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:31 smithi017 ceph-mon[108970]: pgmap v814: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:34.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:33 smithi172 ceph-mon[80431]: pgmap v815: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:34.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:33 smithi017 ceph-mon[108970]: pgmap v815: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:36.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:35 smithi172 ceph-mon[80431]: pgmap v816: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:36.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:35 smithi017 ceph-mon[108970]: pgmap v816: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:38.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:37 smithi172 ceph-mon[80431]: pgmap v817: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:38.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:02:38.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:37 smithi017 ceph-mon[108970]: pgmap v817: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:38.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:02:40.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:39 smithi172 ceph-mon[80431]: pgmap v818: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:40.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:39 smithi017 ceph-mon[108970]: pgmap v818: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:42.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:41 smithi172 ceph-mon[80431]: pgmap v819: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:42.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:41 smithi017 ceph-mon[108970]: pgmap v819: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:44.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:43 smithi172 ceph-mon[80431]: pgmap v820: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:44.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:43 smithi017 ceph-mon[108970]: pgmap v820: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:46.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:45 smithi172 ceph-mon[80431]: pgmap v821: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:46.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:45 smithi017 ceph-mon[108970]: pgmap v821: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:48.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:47 smithi172 ceph-mon[80431]: pgmap v822: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:48.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:47 smithi017 ceph-mon[108970]: pgmap v822: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:50.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:49 smithi172 ceph-mon[80431]: pgmap v823: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:50.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:49 smithi017 ceph-mon[108970]: pgmap v823: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:52.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:51 smithi172 ceph-mon[80431]: pgmap v824: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:52.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:51 smithi017 ceph-mon[108970]: pgmap v824: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:53.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:02:53.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:02:54.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:53 smithi172 ceph-mon[80431]: pgmap v825: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:54.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:53 smithi017 ceph-mon[108970]: pgmap v825: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.281+0000 7f60c0e78640 1 -- 172.21.15.17:0/4143910847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60bc102ab0 msgr2=0x7f60bc102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.281+0000 7f60c0e78640 1 --2- 172.21.15.17:0/4143910847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60bc102ab0 0x7f60bc102e90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009c20 tx=0x7f60ac02aa00 comp rx=0 tx=0).stop 2024-09-20T19:02:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.281+0000 7f60c0e78640 1 -- 172.21.15.17:0/4143910847 shutdown_connections 2024-09-20T19:02:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.281+0000 7f60c0e78640 1 --2- 172.21.15.17:0/4143910847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60bc1033d0 0x7f60bc10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.281+0000 7f60c0e78640 1 --2- 172.21.15.17:0/4143910847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60bc102ab0 0x7f60bc102e90 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.281+0000 7f60c0e78640 1 -- 172.21.15.17:0/4143910847 >> 172.21.15.17:0/4143910847 conn(0x7f60bc0fc550 msgr2=0x7f60bc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.281+0000 7f60c0e78640 1 -- 172.21.15.17:0/4143910847 shutdown_connections 2024-09-20T19:02:55.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.281+0000 7f60c0e78640 1 -- 172.21.15.17:0/4143910847 wait complete. 2024-09-20T19:02:55.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.282+0000 7f60c0e78640 1 Processor -- start 2024-09-20T19:02:55.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.282+0000 7f60c0e78640 1 -- start start 2024-09-20T19:02:55.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.282+0000 7f60c0e78640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60bc102ab0 0x7f60bc19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:55.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.282+0000 7f60c0e78640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60bc1033d0 0x7f60bc19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:55.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.282+0000 7f60c0e78640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc10ede0 con 0x7f60bc102ab0 2024-09-20T19:02:55.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.282+0000 7f60c0e78640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc10ec60 con 0x7f60bc1033d0 2024-09-20T19:02:55.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.282+0000 7f60ba59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60bc102ab0 0x7f60bc19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:55.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.283+0000 7f60ba59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60bc102ab0 0x7f60bc19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39396/0 (socket says 172.21.15.17:39396) 2024-09-20T19:02:55.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.283+0000 7f60ba59c640 1 -- 172.21.15.17:0/3018697987 learned_addr learned my addr 172.21.15.17:0/3018697987 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:02:55.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.283+0000 7f60b9d9b640 1 --2- 172.21.15.17:0/3018697987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60bc1033d0 0x7f60bc19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:55.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.283+0000 7f60ba59c640 1 -- 172.21.15.17:0/3018697987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60bc1033d0 msgr2=0x7f60bc19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:55.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.283+0000 7f60ba59c640 1 --2- 172.21.15.17:0/3018697987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60bc1033d0 0x7f60bc19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.283+0000 7f60ba59c640 1 -- 172.21.15.17:0/3018697987 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60bc1977b0 con 0x7f60bc102ab0 2024-09-20T19:02:55.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.283+0000 7f60ba59c640 1 --2- 172.21.15.17:0/3018697987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60bc102ab0 0x7f60bc19d630 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f60ac02af20 tx=0x7f60ac02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:55.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.283+0000 7f60ab7fe640 1 -- 172.21.15.17:0/3018697987 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60ac047070 con 0x7f60bc102ab0 2024-09-20T19:02:55.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.283+0000 7f60ab7fe640 1 -- 172.21.15.17:0/3018697987 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f60ac003e30 con 0x7f60bc102ab0 2024-09-20T19:02:55.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.283+0000 7f60c0e78640 1 -- 172.21.15.17:0/3018697987 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60bc197a40 con 0x7f60bc102ab0 2024-09-20T19:02:55.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.283+0000 7f60ab7fe640 1 -- 172.21.15.17:0/3018697987 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60ac033050 con 0x7f60bc102ab0 2024-09-20T19:02:55.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.284+0000 7f60c0e78640 1 -- 172.21.15.17:0/3018697987 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60bc197f70 con 0x7f60bc102ab0 2024-09-20T19:02:55.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.285+0000 7f60c0e78640 1 -- 172.21.15.17:0/3018697987 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60bc06a580 con 0x7f60bc102ab0 2024-09-20T19:02:55.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.286+0000 7f60ab7fe640 1 -- 172.21.15.17:0/3018697987 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f60ac04a070 con 0x7f60bc102ab0 2024-09-20T19:02:55.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.286+0000 7f60ab7fe640 1 --2- 172.21.15.17:0/3018697987 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f60a407af90 0x7f60a407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:55.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.287+0000 7f60b9d9b640 1 --2- 172.21.15.17:0/3018697987 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f60a407af90 0x7f60a407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:55.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.287+0000 7f60ab7fe640 1 -- 172.21.15.17:0/3018697987 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f60ac03e030 con 0x7f60bc102ab0 2024-09-20T19:02:55.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.287+0000 7f60b9d9b640 1 --2- 172.21.15.17:0/3018697987 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f60a407af90 0x7f60a407d450 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f60b00058c0 tx=0x7f60b0005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:55.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.291+0000 7f60ab7fe640 1 -- 172.21.15.17:0/3018697987 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60ac08a630 con 0x7f60bc102ab0 2024-09-20T19:02:55.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.498+0000 7f60c0e78640 1 -- 172.21.15.17:0/3018697987 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f60bc198220 con 0x7f60a407af90 2024-09-20T19:02:55.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.499+0000 7f60ab7fe640 1 -- 172.21.15.17:0/3018697987 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f60bc198220 con 0x7f60a407af90 2024-09-20T19:02:55.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.501+0000 7f60c0e78640 1 -- 172.21.15.17:0/3018697987 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f60a407af90 msgr2=0x7f60a407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:55.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.501+0000 7f60c0e78640 1 --2- 172.21.15.17:0/3018697987 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f60a407af90 0x7f60a407d450 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f60b00058c0 tx=0x7f60b0005850 comp rx=0 tx=0).stop 2024-09-20T19:02:55.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.501+0000 7f60c0e78640 1 -- 172.21.15.17:0/3018697987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60bc102ab0 msgr2=0x7f60bc19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:55.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.501+0000 7f60c0e78640 1 --2- 172.21.15.17:0/3018697987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60bc102ab0 0x7f60bc19d630 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f60ac02af20 tx=0x7f60ac02ee60 comp rx=0 tx=0).stop 2024-09-20T19:02:55.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.501+0000 7f60c0e78640 1 -- 172.21.15.17:0/3018697987 shutdown_connections 2024-09-20T19:02:55.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.501+0000 7f60c0e78640 1 --2- 172.21.15.17:0/3018697987 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f60a407af90 0x7f60a407d450 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.501+0000 7f60c0e78640 1 --2- 172.21.15.17:0/3018697987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60bc1033d0 0x7f60bc19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.501+0000 7f60c0e78640 1 --2- 172.21.15.17:0/3018697987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60bc102ab0 0x7f60bc19d630 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.501+0000 7f60c0e78640 1 -- 172.21.15.17:0/3018697987 >> 172.21.15.17:0/3018697987 conn(0x7f60bc0fc550 msgr2=0x7f60bc10aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:55.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.501+0000 7f60c0e78640 1 -- 172.21.15.17:0/3018697987 shutdown_connections 2024-09-20T19:02:55.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.502+0000 7f60c0e78640 1 -- 172.21.15.17:0/3018697987 wait complete. 2024-09-20T19:02:55.519 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:02:55.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.590+0000 7faeb756a640 1 -- 172.21.15.17:0/4032995426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faeb0101000 msgr2=0x7faeb010dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:55.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.590+0000 7faeb756a640 1 --2- 172.21.15.17:0/4032995426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faeb0101000 0x7faeb010dcc0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7faea0009880 tx=0x7faea002a490 comp rx=0 tx=0).stop 2024-09-20T19:02:55.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.590+0000 7faeb756a640 1 -- 172.21.15.17:0/4032995426 shutdown_connections 2024-09-20T19:02:55.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.590+0000 7faeb756a640 1 --2- 172.21.15.17:0/4032995426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faeb0101000 0x7faeb010dcc0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.590+0000 7faeb756a640 1 --2- 172.21.15.17:0/4032995426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faeb0100650 0x7faeb0100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.590+0000 7faeb756a640 1 -- 172.21.15.17:0/4032995426 >> 172.21.15.17:0/4032995426 conn(0x7faeb00fc520 msgr2=0x7faeb00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:55.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.590+0000 7faeb756a640 1 -- 172.21.15.17:0/4032995426 shutdown_connections 2024-09-20T19:02:55.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.591+0000 7faeb756a640 1 -- 172.21.15.17:0/4032995426 wait complete. 2024-09-20T19:02:55.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.591+0000 7faeb756a640 1 Processor -- start 2024-09-20T19:02:55.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.591+0000 7faeb756a640 1 -- start start 2024-09-20T19:02:55.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.592+0000 7faeb756a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faeb0100650 0x7faeb019f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:55.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.592+0000 7faeb756a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faeb0101000 0x7faeb019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:55.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.592+0000 7faeb756a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faeb0110f70 con 0x7faeb0101000 2024-09-20T19:02:55.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.592+0000 7faeb756a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faeb0110df0 con 0x7faeb0100650 2024-09-20T19:02:55.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.592+0000 7faeb4b05640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faeb0101000 0x7faeb019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:55.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.592+0000 7faeb4b05640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faeb0101000 0x7faeb019fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39410/0 (socket says 172.21.15.17:39410) 2024-09-20T19:02:55.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.592+0000 7faeb4b05640 1 -- 172.21.15.17:0/2066237345 learned_addr learned my addr 172.21.15.17:0/2066237345 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:02:55.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.592+0000 7faeb5306640 1 --2- 172.21.15.17:0/2066237345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faeb0100650 0x7faeb019f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:55.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.592+0000 7faeb4b05640 1 -- 172.21.15.17:0/2066237345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faeb0100650 msgr2=0x7faeb019f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:55.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.592+0000 7faeb4b05640 1 --2- 172.21.15.17:0/2066237345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faeb0100650 0x7faeb019f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.592+0000 7faeb4b05640 1 -- 172.21.15.17:0/2066237345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb01a0410 con 0x7faeb0101000 2024-09-20T19:02:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.592+0000 7faeb4b05640 1 --2- 172.21.15.17:0/2066237345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faeb0101000 0x7faeb019fd60 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7faea0031460 tx=0x7faea00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.593+0000 7faea67fc640 1 -- 172.21.15.17:0/2066237345 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faea003f070 con 0x7faeb0101000 2024-09-20T19:02:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.593+0000 7faea67fc640 1 -- 172.21.15.17:0/2066237345 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faea0004cf0 con 0x7faeb0101000 2024-09-20T19:02:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.593+0000 7faeb756a640 1 -- 172.21.15.17:0/2066237345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb0199aa0 con 0x7faeb0101000 2024-09-20T19:02:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.593+0000 7faea67fc640 1 -- 172.21.15.17:0/2066237345 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faea0035030 con 0x7faeb0101000 2024-09-20T19:02:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.593+0000 7faeb756a640 1 -- 172.21.15.17:0/2066237345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb019a000 con 0x7faeb0101000 2024-09-20T19:02:55.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.594+0000 7faea67fc640 1 -- 172.21.15.17:0/2066237345 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7faea0042070 con 0x7faeb0101000 2024-09-20T19:02:55.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.594+0000 7faeb756a640 1 -- 172.21.15.17:0/2066237345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeb006aa90 con 0x7faeb0101000 2024-09-20T19:02:55.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.595+0000 7faea67fc640 1 --2- 172.21.15.17:0/2066237345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae9c07af80 0x7fae9c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:55.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.595+0000 7faeb5306640 1 --2- 172.21.15.17:0/2066237345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae9c07af80 0x7fae9c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:55.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.595+0000 7faea67fc640 1 -- 172.21.15.17:0/2066237345 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7faea00bdf20 con 0x7faeb0101000 2024-09-20T19:02:55.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.596+0000 7faeb5306640 1 --2- 172.21.15.17:0/2066237345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae9c07af80 0x7fae9c07d440 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faeac005e10 tx=0x7faeac005da0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:55.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.599+0000 7faea67fc640 1 -- 172.21.15.17:0/2066237345 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faea0089510 con 0x7faeb0101000 2024-09-20T19:02:55.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.806+0000 7faeb756a640 1 -- 172.21.15.17:0/2066237345 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7faeb019a280 con 0x7fae9c07af80 2024-09-20T19:02:55.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.808+0000 7faea67fc640 1 -- 172.21.15.17:0/2066237345 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7faeb019a280 con 0x7fae9c07af80 2024-09-20T19:02:55.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.810+0000 7faeb756a640 1 -- 172.21.15.17:0/2066237345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae9c07af80 msgr2=0x7fae9c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:55.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.810+0000 7faeb756a640 1 --2- 172.21.15.17:0/2066237345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae9c07af80 0x7fae9c07d440 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faeac005e10 tx=0x7faeac005da0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.810+0000 7faeb756a640 1 -- 172.21.15.17:0/2066237345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faeb0101000 msgr2=0x7faeb019fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:55.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.810+0000 7faeb756a640 1 --2- 172.21.15.17:0/2066237345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faeb0101000 0x7faeb019fd60 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7faea0031460 tx=0x7faea00048f0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.810+0000 7faeb756a640 1 -- 172.21.15.17:0/2066237345 shutdown_connections 2024-09-20T19:02:55.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.810+0000 7faeb756a640 1 --2- 172.21.15.17:0/2066237345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fae9c07af80 0x7fae9c07d440 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.810+0000 7faeb756a640 1 --2- 172.21.15.17:0/2066237345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faeb0101000 0x7faeb019fd60 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.810+0000 7faeb756a640 1 --2- 172.21.15.17:0/2066237345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faeb0100650 0x7faeb019f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.810+0000 7faeb756a640 1 -- 172.21.15.17:0/2066237345 >> 172.21.15.17:0/2066237345 conn(0x7faeb00fc520 msgr2=0x7faeb00fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:55.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.810+0000 7faeb756a640 1 -- 172.21.15.17:0/2066237345 shutdown_connections 2024-09-20T19:02:55.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.810+0000 7faeb756a640 1 -- 172.21.15.17:0/2066237345 wait complete. 2024-09-20T19:02:55.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.895+0000 7fb9b7c26640 1 -- 172.21.15.17:0/290878760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0101900 msgr2=0x7fb9b0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:55.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.895+0000 7fb9b7c26640 1 --2- 172.21.15.17:0/290878760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0101900 0x7fb9b0101d60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009880 tx=0x7fb9a002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.895+0000 7fb9b7c26640 1 -- 172.21.15.17:0/290878760 shutdown_connections 2024-09-20T19:02:55.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.895+0000 7fb9b7c26640 1 --2- 172.21.15.17:0/290878760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0101900 0x7fb9b0101d60 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.895+0000 7fb9b7c26640 1 --2- 172.21.15.17:0/290878760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b0107900 0x7fb9b0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.895+0000 7fb9b7c26640 1 -- 172.21.15.17:0/290878760 >> 172.21.15.17:0/290878760 conn(0x7fb9b00fd600 msgr2=0x7fb9b00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:55.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.895+0000 7fb9b7c26640 1 -- 172.21.15.17:0/290878760 shutdown_connections 2024-09-20T19:02:55.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.895+0000 7fb9b7c26640 1 -- 172.21.15.17:0/290878760 wait complete. 2024-09-20T19:02:55.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.896+0000 7fb9b7c26640 1 Processor -- start 2024-09-20T19:02:55.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.896+0000 7fb9b7c26640 1 -- start start 2024-09-20T19:02:55.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.896+0000 7fb9b7c26640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0101900 0x7fb9b00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:55.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.896+0000 7fb9b7c26640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b0107900 0x7fb9b0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:55.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.896+0000 7fb9b7c26640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b010edb0 con 0x7fb9b0101900 2024-09-20T19:02:55.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.896+0000 7fb9b7c26640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b010ec30 con 0x7fb9b0107900 2024-09-20T19:02:55.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.896+0000 7fb9b59c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0101900 0x7fb9b00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:55.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.896+0000 7fb9b59c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0101900 0x7fb9b00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39414/0 (socket says 172.21.15.17:39414) 2024-09-20T19:02:55.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.896+0000 7fb9b59c2640 1 -- 172.21.15.17:0/2084177961 learned_addr learned my addr 172.21.15.17:0/2084177961 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:02:55.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.896+0000 7fb9b51c1640 1 --2- 172.21.15.17:0/2084177961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b0107900 0x7fb9b0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:55.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.897+0000 7fb9b59c2640 1 -- 172.21.15.17:0/2084177961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b0107900 msgr2=0x7fb9b0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:55.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.897+0000 7fb9b59c2640 1 --2- 172.21.15.17:0/2084177961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b0107900 0x7fb9b0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:55.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.897+0000 7fb9b59c2640 1 -- 172.21.15.17:0/2084177961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b0074f70 con 0x7fb9b0101900 2024-09-20T19:02:55.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.897+0000 7fb9b51c1640 1 --2- 172.21.15.17:0/2084177961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b0107900 0x7fb9b0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:02:55.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.897+0000 7fb9b59c2640 1 --2- 172.21.15.17:0/2084177961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0101900 0x7fb9b00744f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00d8d0 tx=0x7fb9ac00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:55.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.897+0000 7fb9a6ffd640 1 -- 172.21.15.17:0/2084177961 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9ac017030 con 0x7fb9b0101900 2024-09-20T19:02:55.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.897+0000 7fb9a6ffd640 1 -- 172.21.15.17:0/2084177961 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb9ac004020 con 0x7fb9b0101900 2024-09-20T19:02:55.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.897+0000 7fb9b7c26640 1 -- 172.21.15.17:0/2084177961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b0075260 con 0x7fb9b0101900 2024-09-20T19:02:55.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.897+0000 7fb9a6ffd640 1 -- 172.21.15.17:0/2084177961 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9ac0047a0 con 0x7fb9b0101900 2024-09-20T19:02:55.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.897+0000 7fb9b7c26640 1 -- 172.21.15.17:0/2084177961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b01a3e80 con 0x7fb9b0101900 2024-09-20T19:02:55.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.898+0000 7fb9b7c26640 1 -- 172.21.15.17:0/2084177961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b0103040 con 0x7fb9b0101900 2024-09-20T19:02:55.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.899+0000 7fb9a6ffd640 1 -- 172.21.15.17:0/2084177961 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb9ac0041d0 con 0x7fb9b0101900 2024-09-20T19:02:55.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.899+0000 7fb9a6ffd640 1 --2- 172.21.15.17:0/2084177961 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb99c07af30 0x7fb99c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:55.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.899+0000 7fb9a6ffd640 1 -- 172.21.15.17:0/2084177961 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fb9ac018070 con 0x7fb9b0101900 2024-09-20T19:02:55.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.899+0000 7fb9b51c1640 1 --2- 172.21.15.17:0/2084177961 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb99c07af30 0x7fb99c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:55.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.900+0000 7fb9b51c1640 1 --2- 172.21.15.17:0/2084177961 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb99c07af30 0x7fb99c07d3f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0075f80 tx=0x7fb9a0031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:55.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:55.903+0000 7fb9a6ffd640 1 -- 172.21.15.17:0/2084177961 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb9ac069430 con 0x7fb9b0101900 2024-09-20T19:02:56.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.102+0000 7fb9b7c26640 1 -- 172.21.15.17:0/2084177961 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb9b0062630 con 0x7fb99c07af30 2024-09-20T19:02:56.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.112+0000 7fb9a6ffd640 1 -- 172.21.15.17:0/2084177961 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb9b0062630 con 0x7fb99c07af30 2024-09-20T19:02:56.120 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:02:56.120 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (24m) 3m ago 35m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:02:56.120 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (27m) 3m ago 35m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:02:56.120 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (26m) 3m ago 34m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:02:56.120 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (22m) 3m ago 35m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:02:56.120 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (22m) 3m ago 34m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:02:56.120 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (23m) 3m ago 35m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:02:56.120 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (18m) 3m ago 30m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:02:56.120 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (18m) 3m ago 29m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:02:56.121 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (3m) 3m ago 29m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:02:56.121 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (18m) 3m ago 30m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:02:56.121 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (26m) 3m ago 36m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:02:56.121 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (25m) 3m ago 34m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:02:56.121 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (23m) 3m ago 36m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:02:56.121 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (22m) 3m ago 34m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:02:56.121 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (25m) 3m ago 35m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:02:56.121 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (25m) 3m ago 34m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:02:56.121 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (22m) 3m ago 33m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:02:56.121 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (21m) 3m ago 32m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:02:56.121 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (20m) 3m ago 32m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:02:56.121 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (20m) 3m ago 31m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:02:56.121 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (19m) 3m ago 31m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:02:56.122 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (19m) 3m ago 31m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:02:56.122 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (24m) 3m ago 34m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:02:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.115+0000 7fb9b7c26640 1 -- 172.21.15.17:0/2084177961 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb99c07af30 msgr2=0x7fb99c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.115+0000 7fb9b7c26640 1 --2- 172.21.15.17:0/2084177961 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb99c07af30 0x7fb99c07d3f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0075f80 tx=0x7fb9a0031400 comp rx=0 tx=0).stop 2024-09-20T19:02:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.115+0000 7fb9b7c26640 1 -- 172.21.15.17:0/2084177961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0101900 msgr2=0x7fb9b00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.115+0000 7fb9b7c26640 1 --2- 172.21.15.17:0/2084177961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0101900 0x7fb9b00744f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00d8d0 tx=0x7fb9ac00dd90 comp rx=0 tx=0).stop 2024-09-20T19:02:56.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.115+0000 7fb9b7c26640 1 -- 172.21.15.17:0/2084177961 shutdown_connections 2024-09-20T19:02:56.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.115+0000 7fb9b7c26640 1 --2- 172.21.15.17:0/2084177961 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb99c07af30 0x7fb99c07d3f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.115+0000 7fb9b7c26640 1 --2- 172.21.15.17:0/2084177961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b0107900 0x7fb9b0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.115+0000 7fb9b7c26640 1 --2- 172.21.15.17:0/2084177961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0101900 0x7fb9b00744f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.115+0000 7fb9b7c26640 1 -- 172.21.15.17:0/2084177961 >> 172.21.15.17:0/2084177961 conn(0x7fb9b00fd600 msgr2=0x7fb9b00fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:56.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.115+0000 7fb9b7c26640 1 -- 172.21.15.17:0/2084177961 shutdown_connections 2024-09-20T19:02:56.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.115+0000 7fb9b7c26640 1 -- 172.21.15.17:0/2084177961 wait complete. 2024-09-20T19:02:56.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:55 smithi172 ceph-mon[80431]: pgmap v826: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:56.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.198+0000 7f3c9537b640 1 -- 172.21.15.17:0/4236261896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c90101900 msgr2=0x7f3c90101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.198+0000 7f3c9537b640 1 --2- 172.21.15.17:0/4236261896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c90101900 0x7f3c90101d60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009880 tx=0x7f3c7802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.198+0000 7f3c9537b640 1 -- 172.21.15.17:0/4236261896 shutdown_connections 2024-09-20T19:02:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.198+0000 7f3c9537b640 1 --2- 172.21.15.17:0/4236261896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c90101900 0x7f3c90101d60 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.198+0000 7f3c9537b640 1 --2- 172.21.15.17:0/4236261896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c90107900 0x7f3c90107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.198+0000 7f3c9537b640 1 -- 172.21.15.17:0/4236261896 >> 172.21.15.17:0/4236261896 conn(0x7f3c900fd600 msgr2=0x7f3c900ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:56.206 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:55 smithi017 ceph-mon[108970]: pgmap v826: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.198+0000 7f3c9537b640 1 -- 172.21.15.17:0/4236261896 shutdown_connections 2024-09-20T19:02:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.198+0000 7f3c9537b640 1 -- 172.21.15.17:0/4236261896 wait complete. 2024-09-20T19:02:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.199+0000 7f3c9537b640 1 Processor -- start 2024-09-20T19:02:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.199+0000 7f3c9537b640 1 -- start start 2024-09-20T19:02:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.199+0000 7f3c9537b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c90101900 0x7f3c9019f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.199+0000 7f3c9537b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c90107900 0x7f3c9019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.199+0000 7f3c9537b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9010edd0 con 0x7f3c90107900 2024-09-20T19:02:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.199+0000 7f3c9537b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9010ec50 con 0x7f3c90101900 2024-09-20T19:02:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.199+0000 7f3c867fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c90107900 0x7f3c9019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.200+0000 7f3c867fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c90107900 0x7f3c9019fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39436/0 (socket says 172.21.15.17:39436) 2024-09-20T19:02:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.200+0000 7f3c867fc640 1 -- 172.21.15.17:0/3307951793 learned_addr learned my addr 172.21.15.17:0/3307951793 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:02:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.200+0000 7f3c8effd640 1 --2- 172.21.15.17:0/3307951793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c90101900 0x7f3c9019f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.200+0000 7f3c867fc640 1 -- 172.21.15.17:0/3307951793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c90101900 msgr2=0x7f3c9019f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.200+0000 7f3c867fc640 1 --2- 172.21.15.17:0/3307951793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c90101900 0x7f3c9019f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.200+0000 7f3c867fc640 1 -- 172.21.15.17:0/3307951793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c90199a10 con 0x7f3c90107900 2024-09-20T19:02:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.200+0000 7f3c867fc640 1 --2- 172.21.15.17:0/3307951793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c90107900 0x7f3c9019fd90 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3c78031460 tx=0x7f3c780045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.200+0000 7f3c8cff9640 1 -- 172.21.15.17:0/3307951793 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c7803f070 con 0x7f3c90107900 2024-09-20T19:02:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.200+0000 7f3c8cff9640 1 -- 172.21.15.17:0/3307951793 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c780035f0 con 0x7f3c90107900 2024-09-20T19:02:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.200+0000 7f3c9537b640 1 -- 172.21.15.17:0/3307951793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c90199ca0 con 0x7f3c90107900 2024-09-20T19:02:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.200+0000 7f3c8cff9640 1 -- 172.21.15.17:0/3307951793 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c78035030 con 0x7f3c90107900 2024-09-20T19:02:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.200+0000 7f3c9537b640 1 -- 172.21.15.17:0/3307951793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c9019a1d0 con 0x7f3c90107900 2024-09-20T19:02:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.202+0000 7f3c9537b640 1 -- 172.21.15.17:0/3307951793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c90103040 con 0x7f3c90107900 2024-09-20T19:02:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.202+0000 7f3c8cff9640 1 -- 172.21.15.17:0/3307951793 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3c78042070 con 0x7f3c90107900 2024-09-20T19:02:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.203+0000 7f3c8cff9640 1 --2- 172.21.15.17:0/3307951793 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c7c07af30 0x7f3c7c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.203+0000 7f3c8cff9640 1 -- 172.21.15.17:0/3307951793 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f3c780be970 con 0x7f3c90107900 2024-09-20T19:02:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.203+0000 7f3c8effd640 1 --2- 172.21.15.17:0/3307951793 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c7c07af30 0x7f3c7c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.203+0000 7f3c8effd640 1 --2- 172.21.15.17:0/3307951793 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c7c07af30 0x7f3c7c07d3f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3c9019ab50 tx=0x7f3c8000b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:56.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.207+0000 7f3c8cff9640 1 -- 172.21.15.17:0/3307951793 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c780c0e20 con 0x7f3c90107900 2024-09-20T19:02:56.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.472+0000 7f3c9537b640 1 -- 172.21.15.17:0/3307951793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3c9019b010 con 0x7f3c90107900 2024-09-20T19:02:56.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.473+0000 7f3c8cff9640 1 -- 172.21.15.17:0/3307951793 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f3c78089f70 con 0x7f3c90107900 2024-09-20T19:02:56.481 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:02:56.481 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:02:56.481 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:02:56.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:02:56.482 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:02:56.482 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:02:56.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:02:56.482 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:02:56.482 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:02:56.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:02:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:02:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:02:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:02:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:02:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:02:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:02:56.484 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:02:56.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.476+0000 7f3c9537b640 1 -- 172.21.15.17:0/3307951793 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c7c07af30 msgr2=0x7f3c7c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:56.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.476+0000 7f3c9537b640 1 --2- 172.21.15.17:0/3307951793 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c7c07af30 0x7f3c7c07d3f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3c9019ab50 tx=0x7f3c8000b390 comp rx=0 tx=0).stop 2024-09-20T19:02:56.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.476+0000 7f3c9537b640 1 -- 172.21.15.17:0/3307951793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c90107900 msgr2=0x7f3c9019fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:56.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.476+0000 7f3c9537b640 1 --2- 172.21.15.17:0/3307951793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c90107900 0x7f3c9019fd90 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3c78031460 tx=0x7f3c780045e0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.476+0000 7f3c9537b640 1 -- 172.21.15.17:0/3307951793 shutdown_connections 2024-09-20T19:02:56.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.476+0000 7f3c9537b640 1 --2- 172.21.15.17:0/3307951793 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c7c07af30 0x7f3c7c07d3f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.476+0000 7f3c9537b640 1 --2- 172.21.15.17:0/3307951793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c90107900 0x7f3c9019fd90 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.476+0000 7f3c9537b640 1 --2- 172.21.15.17:0/3307951793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c90101900 0x7f3c9019f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.476+0000 7f3c9537b640 1 -- 172.21.15.17:0/3307951793 >> 172.21.15.17:0/3307951793 conn(0x7f3c900fd600 msgr2=0x7f3c90074460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:56.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.476+0000 7f3c9537b640 1 -- 172.21.15.17:0/3307951793 shutdown_connections 2024-09-20T19:02:56.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.476+0000 7f3c9537b640 1 -- 172.21.15.17:0/3307951793 wait complete. 2024-09-20T19:02:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.560+0000 7fb8f3d6a640 1 -- 172.21.15.17:0/2575504258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec1033d0 msgr2=0x7fb8ec10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.560+0000 7fb8f3d6a640 1 --2- 172.21.15.17:0/2575504258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec1033d0 0x7fb8ec10b8c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009880 tx=0x7fb8e002a530 comp rx=0 tx=0).stop 2024-09-20T19:02:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.560+0000 7fb8f3d6a640 1 -- 172.21.15.17:0/2575504258 shutdown_connections 2024-09-20T19:02:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.560+0000 7fb8f3d6a640 1 --2- 172.21.15.17:0/2575504258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec1033d0 0x7fb8ec10b8c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.560+0000 7fb8f3d6a640 1 --2- 172.21.15.17:0/2575504258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ec102ab0 0x7fb8ec102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.560+0000 7fb8f3d6a640 1 -- 172.21.15.17:0/2575504258 >> 172.21.15.17:0/2575504258 conn(0x7fb8ec0fc550 msgr2=0x7fb8ec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.560+0000 7fb8f3d6a640 1 -- 172.21.15.17:0/2575504258 shutdown_connections 2024-09-20T19:02:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.560+0000 7fb8f3d6a640 1 -- 172.21.15.17:0/2575504258 wait complete. 2024-09-20T19:02:56.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.560+0000 7fb8f3d6a640 1 Processor -- start 2024-09-20T19:02:56.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.560+0000 7fb8f3d6a640 1 -- start start 2024-09-20T19:02:56.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.561+0000 7fb8f3d6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ec102ab0 0x7fb8ec100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:56.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.561+0000 7fb8f3d6a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec1033d0 0x7fb8ec100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:56.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.561+0000 7fb8f3d6a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec10ede0 con 0x7fb8ec1033d0 2024-09-20T19:02:56.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.561+0000 7fb8f3d6a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec10ec60 con 0x7fb8ec102ab0 2024-09-20T19:02:56.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.561+0000 7fb8f1305640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec1033d0 0x7fb8ec100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:56.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.561+0000 7fb8f1305640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec1033d0 0x7fb8ec100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39458/0 (socket says 172.21.15.17:39458) 2024-09-20T19:02:56.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.561+0000 7fb8f1305640 1 -- 172.21.15.17:0/3437073943 learned_addr learned my addr 172.21.15.17:0/3437073943 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:02:56.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.561+0000 7fb8f1b06640 1 --2- 172.21.15.17:0/3437073943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ec102ab0 0x7fb8ec100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:56.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.561+0000 7fb8f1305640 1 -- 172.21.15.17:0/3437073943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ec102ab0 msgr2=0x7fb8ec100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:56.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.561+0000 7fb8f1305640 1 --2- 172.21.15.17:0/3437073943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ec102ab0 0x7fb8ec100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.561+0000 7fb8f1305640 1 -- 172.21.15.17:0/3437073943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ec101190 con 0x7fb8ec1033d0 2024-09-20T19:02:56.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.561+0000 7fb8f1305640 1 --2- 172.21.15.17:0/3437073943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec1033d0 0x7fb8ec100c50 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0031460 tx=0x7fb8e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:56.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.562+0000 7fb8eaffd640 1 -- 172.21.15.17:0/3437073943 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb8e003f070 con 0x7fb8ec1033d0 2024-09-20T19:02:56.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.562+0000 7fb8eaffd640 1 -- 172.21.15.17:0/3437073943 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb8e0004ac0 con 0x7fb8ec1033d0 2024-09-20T19:02:56.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.562+0000 7fb8eaffd640 1 -- 172.21.15.17:0/3437073943 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb8e0035030 con 0x7fb8ec1033d0 2024-09-20T19:02:56.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.562+0000 7fb8f3d6a640 1 -- 172.21.15.17:0/3437073943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8ec101420 con 0x7fb8ec1033d0 2024-09-20T19:02:56.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.562+0000 7fb8f3d6a640 1 -- 172.21.15.17:0/3437073943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8ec1a3dd0 con 0x7fb8ec1033d0 2024-09-20T19:02:56.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.563+0000 7fb8f3d6a640 1 -- 172.21.15.17:0/3437073943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8ec06a580 con 0x7fb8ec1033d0 2024-09-20T19:02:56.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.563+0000 7fb8eaffd640 1 -- 172.21.15.17:0/3437073943 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb8e0042070 con 0x7fb8ec1033d0 2024-09-20T19:02:56.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.564+0000 7fb8eaffd640 1 --2- 172.21.15.17:0/3437073943 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb8d407af80 0x7fb8d407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:56.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.564+0000 7fb8eaffd640 1 -- 172.21.15.17:0/3437073943 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fb8e00be8b0 con 0x7fb8ec1033d0 2024-09-20T19:02:56.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.564+0000 7fb8f1b06640 1 --2- 172.21.15.17:0/3437073943 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb8d407af80 0x7fb8d407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:56.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.564+0000 7fb8f1b06640 1 --2- 172.21.15.17:0/3437073943 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb8d407af80 0x7fb8d407d440 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc005c40 tx=0x7fb8dc00a570 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:56.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.568+0000 7fb8eaffd640 1 -- 172.21.15.17:0/3437073943 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb8e0089f30 con 0x7fb8ec1033d0 2024-09-20T19:02:56.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.794+0000 7fb8f3d6a640 1 -- 172.21.15.17:0/3437073943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb8ec105f50 con 0x7fb8ec1033d0 2024-09-20T19:02:56.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.794+0000 7fb8eaffd640 1 -- 172.21.15.17:0/3437073943 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7fb8e008ede0 con 0x7fb8ec1033d0 2024-09-20T19:02:56.802 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:02:56.803 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:02:56.803 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:02:56.803 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:02:56.803 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:02:56.803 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:02:56.803 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:02:56.803 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:02:56.803 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:02:56.803 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:02:56.804 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:02:56.804 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:02:56.804 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:02:56.804 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:02:56.804 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:02:56.804 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:02:56.804 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:02:56.804 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:02:56.804 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:02:56.805 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:02:56.805 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:02:56.805 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:02:56.805 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:02:56.805 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:02:56.805 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:02:56.805 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:02:56.805 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:02:56.805 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:02:56.805 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:02:56.806 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:02:56.806 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:02:56.806 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:02:56.806 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:02:56.806 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:02:56.806 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:02:56.806 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:02:56.806 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:02:56.806 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:02:56.807 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:02:56.807 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:02:56.807 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:02:56.807 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:02:56.807 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:02:56.808 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:02:56.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.797+0000 7fb8f3d6a640 1 -- 172.21.15.17:0/3437073943 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb8d407af80 msgr2=0x7fb8d407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:56.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.797+0000 7fb8f3d6a640 1 --2- 172.21.15.17:0/3437073943 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb8d407af80 0x7fb8d407d440 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc005c40 tx=0x7fb8dc00a570 comp rx=0 tx=0).stop 2024-09-20T19:02:56.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.797+0000 7fb8f3d6a640 1 -- 172.21.15.17:0/3437073943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec1033d0 msgr2=0x7fb8ec100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:56.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.797+0000 7fb8f3d6a640 1 --2- 172.21.15.17:0/3437073943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec1033d0 0x7fb8ec100c50 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0031460 tx=0x7fb8e00046c0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.797+0000 7fb8f3d6a640 1 -- 172.21.15.17:0/3437073943 shutdown_connections 2024-09-20T19:02:56.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.797+0000 7fb8f3d6a640 1 --2- 172.21.15.17:0/3437073943 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb8d407af80 0x7fb8d407d440 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.797+0000 7fb8f3d6a640 1 --2- 172.21.15.17:0/3437073943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec1033d0 0x7fb8ec100c50 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.797+0000 7fb8f3d6a640 1 --2- 172.21.15.17:0/3437073943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ec102ab0 0x7fb8ec100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.797+0000 7fb8f3d6a640 1 -- 172.21.15.17:0/3437073943 >> 172.21.15.17:0/3437073943 conn(0x7fb8ec0fc550 msgr2=0x7fb8ec108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:56.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.797+0000 7fb8f3d6a640 1 -- 172.21.15.17:0/3437073943 shutdown_connections 2024-09-20T19:02:56.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.797+0000 7fb8f3d6a640 1 -- 172.21.15.17:0/3437073943 wait complete. 2024-09-20T19:02:56.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.883+0000 7f3277c31640 1 -- 172.21.15.17:0/2007883850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3270074590 msgr2=0x7f3270074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:56.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.883+0000 7f3277c31640 1 --2- 172.21.15.17:0/2007883850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3270074590 0x7f3270074970 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f326c009880 tx=0x7f326c02a530 comp rx=0 tx=0).stop 2024-09-20T19:02:56.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.883+0000 7f3277c31640 1 -- 172.21.15.17:0/2007883850 shutdown_connections 2024-09-20T19:02:56.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.883+0000 7f3277c31640 1 --2- 172.21.15.17:0/2007883850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3270074eb0 0x7f32701123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.883+0000 7f3277c31640 1 --2- 172.21.15.17:0/2007883850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3270074590 0x7f3270074970 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.883+0000 7f3277c31640 1 -- 172.21.15.17:0/2007883850 >> 172.21.15.17:0/2007883850 conn(0x7f32700fd600 msgr2=0x7f32700ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:56.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.883+0000 7f3277c31640 1 -- 172.21.15.17:0/2007883850 shutdown_connections 2024-09-20T19:02:56.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.883+0000 7f3277c31640 1 -- 172.21.15.17:0/2007883850 wait complete. 2024-09-20T19:02:56.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.884+0000 7f3277c31640 1 Processor -- start 2024-09-20T19:02:56.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.884+0000 7f3277c31640 1 -- start start 2024-09-20T19:02:56.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.884+0000 7f3277c31640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3270074590 0x7f327019e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:56.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.884+0000 7f3277c31640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3270074eb0 0x7f327019e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:56.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.884+0000 7f3277c31640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f32701153f0 con 0x7f3270074eb0 2024-09-20T19:02:56.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.884+0000 7f3277c31640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3270115270 con 0x7f3270074590 2024-09-20T19:02:56.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.884+0000 7f32751cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3270074eb0 0x7f327019e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:56.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.884+0000 7f32751cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3270074eb0 0x7f327019e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39466/0 (socket says 172.21.15.17:39466) 2024-09-20T19:02:56.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.884+0000 7f32751cc640 1 -- 172.21.15.17:0/1880813076 learned_addr learned my addr 172.21.15.17:0/1880813076 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:02:56.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.885+0000 7f32751cc640 1 -- 172.21.15.17:0/1880813076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3270074590 msgr2=0x7f327019e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:56.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.885+0000 7f32759cd640 1 --2- 172.21.15.17:0/1880813076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3270074590 0x7f327019e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:56.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.885+0000 7f32751cc640 1 --2- 172.21.15.17:0/1880813076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3270074590 0x7f327019e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:56.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.885+0000 7f32751cc640 1 -- 172.21.15.17:0/1880813076 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32701a2900 con 0x7f3270074eb0 2024-09-20T19:02:56.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.885+0000 7f32751cc640 1 --2- 172.21.15.17:0/1880813076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3270074eb0 0x7f327019e570 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f326000d6f0 tx=0x7f326000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:56.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.885+0000 7f3266ffd640 1 -- 172.21.15.17:0/1880813076 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3260017070 con 0x7f3270074eb0 2024-09-20T19:02:56.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.885+0000 7f3266ffd640 1 -- 172.21.15.17:0/1880813076 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f326000de00 con 0x7f3270074eb0 2024-09-20T19:02:56.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.885+0000 7f3277c31640 1 -- 172.21.15.17:0/1880813076 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32701a2bf0 con 0x7f3270074eb0 2024-09-20T19:02:56.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.885+0000 7f3266ffd640 1 -- 172.21.15.17:0/1880813076 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3260004bb0 con 0x7f3270074eb0 2024-09-20T19:02:56.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.885+0000 7f3277c31640 1 -- 172.21.15.17:0/1880813076 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32701a3180 con 0x7f3270074eb0 2024-09-20T19:02:56.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.886+0000 7f3277c31640 1 -- 172.21.15.17:0/1880813076 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3270075cd0 con 0x7f3270074eb0 2024-09-20T19:02:56.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.887+0000 7f3266ffd640 1 -- 172.21.15.17:0/1880813076 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3260009a30 con 0x7f3270074eb0 2024-09-20T19:02:56.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.887+0000 7f3266ffd640 1 --2- 172.21.15.17:0/1880813076 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f325c07af80 0x7f325c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:56.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.887+0000 7f3266ffd640 1 -- 172.21.15.17:0/1880813076 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f326009db70 con 0x7f3270074eb0 2024-09-20T19:02:56.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.887+0000 7f32759cd640 1 --2- 172.21.15.17:0/1880813076 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f325c07af80 0x7f325c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:56.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.888+0000 7f32759cd640 1 --2- 172.21.15.17:0/1880813076 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f325c07af80 0x7f325c07d440 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f326c031460 tx=0x7f326c009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:56.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:56.892+0000 7f3266ffd640 1 -- 172.21.15.17:0/1880813076 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f32600691f0 con 0x7f3270074eb0 2024-09-20T19:02:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.103+0000 7f3277c31640 1 -- 172.21.15.17:0/1880813076 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f32701a3430 con 0x7f325c07af80 2024-09-20T19:02:57.111 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:56 smithi017 ceph-mon[108970]: from='client.35324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:57.111 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:56 smithi017 ceph-mon[108970]: from='client.35328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:57.111 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:56 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3307951793' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:02:57.111 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:56 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3437073943' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:02:57.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.104+0000 7f3266ffd640 1 -- 172.21.15.17:0/1880813076 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f32701a3430 con 0x7f325c07af80 2024-09-20T19:02:57.112 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:02:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:02:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:02:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:02:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:02:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:02:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:02:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:02:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:02:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:02:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:02:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:02:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:02:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:02:57.113 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:02:57.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.107+0000 7f3277c31640 1 -- 172.21.15.17:0/1880813076 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f325c07af80 msgr2=0x7f325c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.107+0000 7f3277c31640 1 --2- 172.21.15.17:0/1880813076 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f325c07af80 0x7f325c07d440 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f326c031460 tx=0x7f326c009560 comp rx=0 tx=0).stop 2024-09-20T19:02:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.107+0000 7f3277c31640 1 -- 172.21.15.17:0/1880813076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3270074eb0 msgr2=0x7f327019e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.107+0000 7f3277c31640 1 --2- 172.21.15.17:0/1880813076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3270074eb0 0x7f327019e570 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f326000d6f0 tx=0x7f326000dbb0 comp rx=0 tx=0).stop 2024-09-20T19:02:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.107+0000 7f3277c31640 1 -- 172.21.15.17:0/1880813076 shutdown_connections 2024-09-20T19:02:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.107+0000 7f3277c31640 1 --2- 172.21.15.17:0/1880813076 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f325c07af80 0x7f325c07d440 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.107+0000 7f3277c31640 1 --2- 172.21.15.17:0/1880813076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3270074eb0 0x7f327019e570 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.107+0000 7f3277c31640 1 --2- 172.21.15.17:0/1880813076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3270074590 0x7f327019e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.107+0000 7f3277c31640 1 -- 172.21.15.17:0/1880813076 >> 172.21.15.17:0/1880813076 conn(0x7f32700fd600 msgr2=0x7f3270104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.107+0000 7f3277c31640 1 -- 172.21.15.17:0/1880813076 shutdown_connections 2024-09-20T19:02:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.107+0000 7f3277c31640 1 -- 172.21.15.17:0/1880813076 wait complete. 2024-09-20T19:02:57.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.191+0000 7f4d75185640 1 -- 172.21.15.17:0/3155577697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d70102ac0 msgr2=0x7f4d70102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:57.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.191+0000 7f4d75185640 1 --2- 172.21.15.17:0/3155577697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d70102ac0 0x7f4d70102ea0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009880 tx=0x7f4d6002a530 comp rx=0 tx=0).stop 2024-09-20T19:02:57.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.191+0000 7f4d75185640 1 -- 172.21.15.17:0/3155577697 shutdown_connections 2024-09-20T19:02:57.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.191+0000 7f4d75185640 1 --2- 172.21.15.17:0/3155577697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d701033e0 0x7f4d7010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:57.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.191+0000 7f4d75185640 1 --2- 172.21.15.17:0/3155577697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d70102ac0 0x7f4d70102ea0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:57.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.191+0000 7f4d75185640 1 -- 172.21.15.17:0/3155577697 >> 172.21.15.17:0/3155577697 conn(0x7f4d700fc520 msgr2=0x7f4d700fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:57.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.191+0000 7f4d75185640 1 -- 172.21.15.17:0/3155577697 shutdown_connections 2024-09-20T19:02:57.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.191+0000 7f4d75185640 1 -- 172.21.15.17:0/3155577697 wait complete. 2024-09-20T19:02:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.192+0000 7f4d75185640 1 Processor -- start 2024-09-20T19:02:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.192+0000 7f4d75185640 1 -- start start 2024-09-20T19:02:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.192+0000 7f4d75185640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d70102ac0 0x7f4d7019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.192+0000 7f4d75185640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d701033e0 0x7f4d7019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.192+0000 7f4d75185640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7010edd0 con 0x7f4d701033e0 2024-09-20T19:02:57.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.192+0000 7f4d75185640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7010ec50 con 0x7f4d70102ac0 2024-09-20T19:02:57.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.192+0000 7f4d6e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d701033e0 0x7f4d7019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:57.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.193+0000 7f4d6e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d701033e0 0x7f4d7019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39486/0 (socket says 172.21.15.17:39486) 2024-09-20T19:02:57.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.193+0000 7f4d6e59c640 1 -- 172.21.15.17:0/731807737 learned_addr learned my addr 172.21.15.17:0/731807737 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:02:57.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.193+0000 7f4d6ed9d640 1 --2- 172.21.15.17:0/731807737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d70102ac0 0x7f4d7019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:57.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.193+0000 7f4d6e59c640 1 -- 172.21.15.17:0/731807737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d70102ac0 msgr2=0x7f4d7019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:57.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.193+0000 7f4d6e59c640 1 --2- 172.21.15.17:0/731807737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d70102ac0 0x7f4d7019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:57.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.193+0000 7f4d6e59c640 1 -- 172.21.15.17:0/731807737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d701977c0 con 0x7f4d701033e0 2024-09-20T19:02:57.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.193+0000 7f4d6ed9d640 1 --2- 172.21.15.17:0/731807737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d70102ac0 0x7f4d7019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:02:57.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.193+0000 7f4d6e59c640 1 --2- 172.21.15.17:0/731807737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d701033e0 0x7f4d7019db80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400d8d0 tx=0x7f4d6400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:57.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.193+0000 7f4d57fff640 1 -- 172.21.15.17:0/731807737 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d64017030 con 0x7f4d701033e0 2024-09-20T19:02:57.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.193+0000 7f4d75185640 1 -- 172.21.15.17:0/731807737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d70197ab0 con 0x7f4d701033e0 2024-09-20T19:02:57.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.193+0000 7f4d57fff640 1 -- 172.21.15.17:0/731807737 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4d6400be10 con 0x7f4d701033e0 2024-09-20T19:02:57.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.193+0000 7f4d57fff640 1 -- 172.21.15.17:0/731807737 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d64005580 con 0x7f4d701033e0 2024-09-20T19:02:57.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.193+0000 7f4d75185640 1 -- 172.21.15.17:0/731807737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d70198040 con 0x7f4d701033e0 2024-09-20T19:02:57.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.194+0000 7f4d75185640 1 -- 172.21.15.17:0/731807737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d7006aa90 con 0x7f4d701033e0 2024-09-20T19:02:57.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.195+0000 7f4d57fff640 1 -- 172.21.15.17:0/731807737 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4d64004020 con 0x7f4d701033e0 2024-09-20T19:02:57.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.196+0000 7f4d57fff640 1 --2- 172.21.15.17:0/731807737 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4d5807af30 0x7f4d5807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:02:57.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.196+0000 7f4d6ed9d640 1 --2- 172.21.15.17:0/731807737 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4d5807af30 0x7f4d5807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:02:57.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.196+0000 7f4d57fff640 1 -- 172.21.15.17:0/731807737 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f4d64018070 con 0x7f4d701033e0 2024-09-20T19:02:57.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.196+0000 7f4d6ed9d640 1 --2- 172.21.15.17:0/731807737 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4d5807af30 0x7f4d5807d3f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4d60006010 tx=0x7f4d600095f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:02:57.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.200+0000 7f4d57fff640 1 -- 172.21.15.17:0/731807737 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4d640a4080 con 0x7f4d701033e0 2024-09-20T19:02:57.451 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:56 smithi172 ceph-mon[80431]: from='client.35324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:57.452 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:56 smithi172 ceph-mon[80431]: from='client.35328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:57.452 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:56 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3307951793' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:02:57.452 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:56 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3437073943' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:02:57.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.463+0000 7f4d75185640 1 -- 172.21.15.17:0/731807737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f4d70105f90 con 0x7f4d701033e0 2024-09-20T19:02:57.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.464+0000 7f4d57fff640 1 -- 172.21.15.17:0/731807737 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f4d640693b0 con 0x7f4d701033e0 2024-09-20T19:02:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:02:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:02:57.472 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:02:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:02:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:02:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:02:57.472 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:02:57.472 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:02:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:02:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:02:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:02:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:02:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:02:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:02:57.474 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:02:57.474 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:02:57.474 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:02:57.474 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:02:57.474 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:02:57.474 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:02:57.475 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:02:57.475 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:02:57.475 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:02:57.475 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:02:57.475 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:02:57.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.466+0000 7f4d75185640 1 -- 172.21.15.17:0/731807737 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4d5807af30 msgr2=0x7f4d5807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:57.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.466+0000 7f4d75185640 1 --2- 172.21.15.17:0/731807737 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4d5807af30 0x7f4d5807d3f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4d60006010 tx=0x7f4d600095f0 comp rx=0 tx=0).stop 2024-09-20T19:02:57.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.466+0000 7f4d75185640 1 -- 172.21.15.17:0/731807737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d701033e0 msgr2=0x7f4d7019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:02:57.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.466+0000 7f4d75185640 1 --2- 172.21.15.17:0/731807737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d701033e0 0x7f4d7019db80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400d8d0 tx=0x7f4d6400dd90 comp rx=0 tx=0).stop 2024-09-20T19:02:57.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.466+0000 7f4d75185640 1 -- 172.21.15.17:0/731807737 shutdown_connections 2024-09-20T19:02:57.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.466+0000 7f4d75185640 1 --2- 172.21.15.17:0/731807737 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4d5807af30 0x7f4d5807d3f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:57.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.466+0000 7f4d75185640 1 --2- 172.21.15.17:0/731807737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d701033e0 0x7f4d7019db80 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:57.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.466+0000 7f4d75185640 1 --2- 172.21.15.17:0/731807737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d70102ac0 0x7f4d7019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:02:57.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.466+0000 7f4d75185640 1 -- 172.21.15.17:0/731807737 >> 172.21.15.17:0/731807737 conn(0x7f4d700fc520 msgr2=0x7f4d70108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:02:57.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.466+0000 7f4d75185640 1 -- 172.21.15.17:0/731807737 shutdown_connections 2024-09-20T19:02:57.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:02:57.466+0000 7f4d75185640 1 -- 172.21.15.17:0/731807737 wait complete. 2024-09-20T19:02:58.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:57 smithi172 ceph-mon[80431]: from='client.35332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:58.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:57 smithi172 ceph-mon[80431]: pgmap v827: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:58.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:57 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/731807737' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:02:58.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:57 smithi017 ceph-mon[108970]: from='client.35332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:58.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:57 smithi017 ceph-mon[108970]: pgmap v827: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:02:58.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:57 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/731807737' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:02:59.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:58 smithi017 ceph-mon[108970]: from='client.35344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:02:59.451 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:58 smithi172 ceph-mon[80431]: from='client.35344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:00.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:02:59 smithi017 ceph-mon[108970]: pgmap v828: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:00.451 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:02:59 smithi172 ceph-mon[80431]: pgmap v828: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:02.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:01 smithi017 ceph-mon[108970]: pgmap v829: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:02.451 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:01 smithi172 ceph-mon[80431]: pgmap v829: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:04.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:03 smithi017 ceph-mon[108970]: pgmap v830: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:04.451 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:03 smithi172 ceph-mon[80431]: pgmap v830: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:06.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:05 smithi017 ceph-mon[108970]: pgmap v831: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:06.451 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:05 smithi172 ceph-mon[80431]: pgmap v831: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:08.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:07 smithi017 ceph-mon[108970]: pgmap v832: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:08.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:03:08.451 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:07 smithi172 ceph-mon[80431]: pgmap v832: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:08.451 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:03:10.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:09 smithi017 ceph-mon[108970]: pgmap v833: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:10.451 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:09 smithi172 ceph-mon[80431]: pgmap v833: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:12.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:11 smithi017 ceph-mon[108970]: pgmap v834: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:12.451 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:11 smithi172 ceph-mon[80431]: pgmap v834: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:13.392 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:12 smithi017 ceph-mon[108970]: pgmap v835: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:13.451 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:12 smithi172 ceph-mon[80431]: pgmap v835: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:15.951 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:15 smithi172 ceph-mon[80431]: pgmap v836: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:16.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:15 smithi017 ceph-mon[108970]: pgmap v836: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:17.951 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:17 smithi172 ceph-mon[80431]: pgmap v837: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:18.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:17 smithi017 ceph-mon[108970]: pgmap v837: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:19.892 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:19 smithi017 ceph-mon[108970]: pgmap v838: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:19.951 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:19 smithi172 ceph-mon[80431]: pgmap v838: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:21.957 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:21 smithi017 ceph-mon[108970]: pgmap v839: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:22.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:21 smithi172 ceph-mon[80431]: pgmap v839: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:22.892 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:03:23.102 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:03:24.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:23 smithi017 ceph-mon[108970]: pgmap v840: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:24.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:23 smithi172 ceph-mon[80431]: pgmap v840: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:25.892 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:25 smithi017 ceph-mon[108970]: pgmap v841: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:26.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:25 smithi172 ceph-mon[80431]: pgmap v841: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:27.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.566+0000 7fbe545ab640 1 -- 172.21.15.17:0/1976290443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe4c074620 msgr2=0x7fbe4c074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:27.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.566+0000 7fbe545ab640 1 --2- 172.21.15.17:0/1976290443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe4c074620 0x7fbe4c074a00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fbe44009880 tx=0x7fbe4402a530 comp rx=0 tx=0).stop 2024-09-20T19:03:27.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.566+0000 7fbe545ab640 1 -- 172.21.15.17:0/1976290443 shutdown_connections 2024-09-20T19:03:27.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.566+0000 7fbe545ab640 1 --2- 172.21.15.17:0/1976290443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c074f40 0x7fbe4c10dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:27.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.566+0000 7fbe545ab640 1 --2- 172.21.15.17:0/1976290443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe4c074620 0x7fbe4c074a00 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:27.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.566+0000 7fbe545ab640 1 -- 172.21.15.17:0/1976290443 >> 172.21.15.17:0/1976290443 conn(0x7fbe4c0fd600 msgr2=0x7fbe4c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:27.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.566+0000 7fbe545ab640 1 -- 172.21.15.17:0/1976290443 shutdown_connections 2024-09-20T19:03:27.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.566+0000 7fbe545ab640 1 -- 172.21.15.17:0/1976290443 wait complete. 2024-09-20T19:03:27.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.567+0000 7fbe545ab640 1 Processor -- start 2024-09-20T19:03:27.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.567+0000 7fbe545ab640 1 -- start start 2024-09-20T19:03:27.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.567+0000 7fbe545ab640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c074620 0x7fbe4c19f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:27.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.567+0000 7fbe545ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe4c074f40 0x7fbe4c19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:27.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.567+0000 7fbe545ab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4c110fd0 con 0x7fbe4c074f40 2024-09-20T19:03:27.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.567+0000 7fbe545ab640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4c110e50 con 0x7fbe4c074620 2024-09-20T19:03:27.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.567+0000 7fbe51b46640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe4c074f40 0x7fbe4c19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:27.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.567+0000 7fbe51b46640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe4c074f40 0x7fbe4c19fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54990/0 (socket says 172.21.15.17:54990) 2024-09-20T19:03:27.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.567+0000 7fbe51b46640 1 -- 172.21.15.17:0/2959075123 learned_addr learned my addr 172.21.15.17:0/2959075123 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:03:27.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.567+0000 7fbe52347640 1 --2- 172.21.15.17:0/2959075123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c074620 0x7fbe4c19f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:27.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.567+0000 7fbe51b46640 1 -- 172.21.15.17:0/2959075123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c074620 msgr2=0x7fbe4c19f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:27.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.567+0000 7fbe51b46640 1 --2- 172.21.15.17:0/2959075123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c074620 0x7fbe4c19f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:27.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.567+0000 7fbe51b46640 1 -- 172.21.15.17:0/2959075123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe4c199a00 con 0x7fbe4c074f40 2024-09-20T19:03:27.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.568+0000 7fbe51b46640 1 --2- 172.21.15.17:0/2959075123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe4c074f40 0x7fbe4c19fd80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000d8d0 tx=0x7fbe4000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:27.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.568+0000 7fbe4b7fe640 1 -- 172.21.15.17:0/2959075123 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe40017070 con 0x7fbe4c074f40 2024-09-20T19:03:27.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.568+0000 7fbe4b7fe640 1 -- 172.21.15.17:0/2959075123 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbe40010460 con 0x7fbe4c074f40 2024-09-20T19:03:27.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.568+0000 7fbe545ab640 1 -- 172.21.15.17:0/2959075123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe4c199cf0 con 0x7fbe4c074f40 2024-09-20T19:03:27.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.568+0000 7fbe4b7fe640 1 -- 172.21.15.17:0/2959075123 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe4000f5f0 con 0x7fbe4c074f40 2024-09-20T19:03:27.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.568+0000 7fbe545ab640 1 -- 172.21.15.17:0/2959075123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe4c19a280 con 0x7fbe4c074f40 2024-09-20T19:03:27.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.569+0000 7fbe545ab640 1 -- 172.21.15.17:0/2959075123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe4c075cd0 con 0x7fbe4c074f40 2024-09-20T19:03:27.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.570+0000 7fbe4b7fe640 1 -- 172.21.15.17:0/2959075123 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fbe40009a30 con 0x7fbe4c074f40 2024-09-20T19:03:27.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.570+0000 7fbe4b7fe640 1 --2- 172.21.15.17:0/2959075123 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbe3407af40 0x7fbe3407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:27.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.570+0000 7fbe4b7fe640 1 -- 172.21.15.17:0/2959075123 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fbe4009de30 con 0x7fbe4c074f40 2024-09-20T19:03:27.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.571+0000 7fbe52347640 1 --2- 172.21.15.17:0/2959075123 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbe3407af40 0x7fbe3407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:27.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.571+0000 7fbe52347640 1 --2- 172.21.15.17:0/2959075123 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbe3407af40 0x7fbe3407d400 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbe44000c00 tx=0x7fbe44031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:27.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.575+0000 7fbe4b7fe640 1 -- 172.21.15.17:0/2959075123 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbe40069430 con 0x7fbe4c074f40 2024-09-20T19:03:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.782+0000 7fbe545ab640 1 -- 172.21.15.17:0/2959075123 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbe4c19af30 con 0x7fbe3407af40 2024-09-20T19:03:27.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.783+0000 7fbe4b7fe640 1 -- 172.21.15.17:0/2959075123 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fbe4c19af30 con 0x7fbe3407af40 2024-09-20T19:03:27.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.785+0000 7fbe545ab640 1 -- 172.21.15.17:0/2959075123 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbe3407af40 msgr2=0x7fbe3407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:27.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.785+0000 7fbe545ab640 1 --2- 172.21.15.17:0/2959075123 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbe3407af40 0x7fbe3407d400 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbe44000c00 tx=0x7fbe44031400 comp rx=0 tx=0).stop 2024-09-20T19:03:27.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.785+0000 7fbe545ab640 1 -- 172.21.15.17:0/2959075123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe4c074f40 msgr2=0x7fbe4c19fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:27.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.785+0000 7fbe545ab640 1 --2- 172.21.15.17:0/2959075123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe4c074f40 0x7fbe4c19fd80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000d8d0 tx=0x7fbe4000dd90 comp rx=0 tx=0).stop 2024-09-20T19:03:27.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.786+0000 7fbe545ab640 1 -- 172.21.15.17:0/2959075123 shutdown_connections 2024-09-20T19:03:27.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.786+0000 7fbe545ab640 1 --2- 172.21.15.17:0/2959075123 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbe3407af40 0x7fbe3407d400 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:27.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.786+0000 7fbe545ab640 1 --2- 172.21.15.17:0/2959075123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe4c074f40 0x7fbe4c19fd80 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:27.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.786+0000 7fbe545ab640 1 --2- 172.21.15.17:0/2959075123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c074620 0x7fbe4c19f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:27.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.786+0000 7fbe545ab640 1 -- 172.21.15.17:0/2959075123 >> 172.21.15.17:0/2959075123 conn(0x7fbe4c0fd600 msgr2=0x7fbe4c10b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:27.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.786+0000 7fbe545ab640 1 -- 172.21.15.17:0/2959075123 shutdown_connections 2024-09-20T19:03:27.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.786+0000 7fbe545ab640 1 -- 172.21.15.17:0/2959075123 wait complete. 2024-09-20T19:03:27.801 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:03:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.871+0000 7f66d1e67640 1 -- 172.21.15.17:0/3372999936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66cc102ac0 msgr2=0x7f66cc102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.871+0000 7f66d1e67640 1 --2- 172.21.15.17:0/3372999936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66cc102ac0 0x7f66cc102ea0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009880 tx=0x7f66bc02a530 comp rx=0 tx=0).stop 2024-09-20T19:03:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.871+0000 7f66d1e67640 1 -- 172.21.15.17:0/3372999936 shutdown_connections 2024-09-20T19:03:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.871+0000 7f66d1e67640 1 --2- 172.21.15.17:0/3372999936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66cc1033e0 0x7f66cc10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.871+0000 7f66d1e67640 1 --2- 172.21.15.17:0/3372999936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66cc102ac0 0x7f66cc102ea0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.871+0000 7f66d1e67640 1 -- 172.21.15.17:0/3372999936 >> 172.21.15.17:0/3372999936 conn(0x7f66cc0fc520 msgr2=0x7f66cc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:27.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:27 smithi017 ceph-mon[108970]: pgmap v842: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:27.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.871+0000 7f66d1e67640 1 -- 172.21.15.17:0/3372999936 shutdown_connections 2024-09-20T19:03:27.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.871+0000 7f66d1e67640 1 -- 172.21.15.17:0/3372999936 wait complete. 2024-09-20T19:03:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.872+0000 7f66d1e67640 1 Processor -- start 2024-09-20T19:03:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.872+0000 7f66d1e67640 1 -- start start 2024-09-20T19:03:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.873+0000 7f66d1e67640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66cc102ac0 0x7f66cc100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.873+0000 7f66d1e67640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66cc1033e0 0x7f66cc100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.873+0000 7f66d1e67640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc10ee50 con 0x7f66cc102ac0 2024-09-20T19:03:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.873+0000 7f66d1e67640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc10ecd0 con 0x7f66cc1033e0 2024-09-20T19:03:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.873+0000 7f66cb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66cc102ac0 0x7f66cc100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.873+0000 7f66cb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66cc102ac0 0x7f66cc100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55010/0 (socket says 172.21.15.17:55010) 2024-09-20T19:03:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.873+0000 7f66cb7fe640 1 -- 172.21.15.17:0/2300012158 learned_addr learned my addr 172.21.15.17:0/2300012158 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:03:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.873+0000 7f66caffd640 1 --2- 172.21.15.17:0/2300012158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66cc1033e0 0x7f66cc100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.873+0000 7f66cb7fe640 1 -- 172.21.15.17:0/2300012158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66cc1033e0 msgr2=0x7f66cc100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.873+0000 7f66cb7fe640 1 --2- 172.21.15.17:0/2300012158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66cc1033e0 0x7f66cc100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.873+0000 7f66cb7fe640 1 -- 172.21.15.17:0/2300012158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66cc1011a0 con 0x7f66cc102ac0 2024-09-20T19:03:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.873+0000 7f66cb7fe640 1 --2- 172.21.15.17:0/2300012158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66cc102ac0 0x7f66cc100720 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f66bc031460 tx=0x7f66bc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:27.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.873+0000 7f66c8ff9640 1 -- 172.21.15.17:0/2300012158 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66bc03f070 con 0x7f66cc102ac0 2024-09-20T19:03:27.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.873+0000 7f66c8ff9640 1 -- 172.21.15.17:0/2300012158 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f66bc004cf0 con 0x7f66cc102ac0 2024-09-20T19:03:27.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.873+0000 7f66c8ff9640 1 -- 172.21.15.17:0/2300012158 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66bc035030 con 0x7f66cc102ac0 2024-09-20T19:03:27.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.873+0000 7f66d1e67640 1 -- 172.21.15.17:0/2300012158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66cc101430 con 0x7f66cc102ac0 2024-09-20T19:03:27.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.874+0000 7f66d1e67640 1 -- 172.21.15.17:0/2300012158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66cc1a3f20 con 0x7f66cc102ac0 2024-09-20T19:03:27.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.875+0000 7f66d1e67640 1 -- 172.21.15.17:0/2300012158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66cc06aa90 con 0x7f66cc102ac0 2024-09-20T19:03:27.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.876+0000 7f66c8ff9640 1 -- 172.21.15.17:0/2300012158 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f66bc042070 con 0x7f66cc102ac0 2024-09-20T19:03:27.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.876+0000 7f66c8ff9640 1 --2- 172.21.15.17:0/2300012158 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66b407af30 0x7f66b407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:27.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.876+0000 7f66c8ff9640 1 -- 172.21.15.17:0/2300012158 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f66bc0beb00 con 0x7f66cc102ac0 2024-09-20T19:03:27.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.876+0000 7f66caffd640 1 --2- 172.21.15.17:0/2300012158 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66b407af30 0x7f66b407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:27.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.877+0000 7f66caffd640 1 --2- 172.21.15.17:0/2300012158 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66b407af30 0x7f66b407d3f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f66cc1021b0 tx=0x7f66c0008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:27.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:27.881+0000 7f66c8ff9640 1 -- 172.21.15.17:0/2300012158 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f66bc08a100 con 0x7f66cc102ac0 2024-09-20T19:03:28.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.086+0000 7f66d1e67640 1 -- 172.21.15.17:0/2300012158 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f66cc062630 con 0x7f66b407af30 2024-09-20T19:03:28.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.088+0000 7f66c8ff9640 1 -- 172.21.15.17:0/2300012158 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f66cc062630 con 0x7f66b407af30 2024-09-20T19:03:28.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.090+0000 7f66d1e67640 1 -- 172.21.15.17:0/2300012158 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66b407af30 msgr2=0x7f66b407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:28.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.090+0000 7f66d1e67640 1 --2- 172.21.15.17:0/2300012158 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66b407af30 0x7f66b407d3f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f66cc1021b0 tx=0x7f66c0008040 comp rx=0 tx=0).stop 2024-09-20T19:03:28.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.090+0000 7f66d1e67640 1 -- 172.21.15.17:0/2300012158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66cc102ac0 msgr2=0x7f66cc100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:28.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.090+0000 7f66d1e67640 1 --2- 172.21.15.17:0/2300012158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66cc102ac0 0x7f66cc100720 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f66bc031460 tx=0x7f66bc0048f0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.090+0000 7f66d1e67640 1 -- 172.21.15.17:0/2300012158 shutdown_connections 2024-09-20T19:03:28.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.090+0000 7f66d1e67640 1 --2- 172.21.15.17:0/2300012158 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f66b407af30 0x7f66b407d3f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.090+0000 7f66d1e67640 1 --2- 172.21.15.17:0/2300012158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66cc1033e0 0x7f66cc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.090+0000 7f66d1e67640 1 --2- 172.21.15.17:0/2300012158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66cc102ac0 0x7f66cc100720 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.090+0000 7f66d1e67640 1 -- 172.21.15.17:0/2300012158 >> 172.21.15.17:0/2300012158 conn(0x7f66cc0fc520 msgr2=0x7f66cc108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:28.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.090+0000 7f66d1e67640 1 -- 172.21.15.17:0/2300012158 shutdown_connections 2024-09-20T19:03:28.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.090+0000 7f66d1e67640 1 -- 172.21.15.17:0/2300012158 wait complete. 2024-09-20T19:03:28.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.175+0000 7eff10cd6640 1 -- 172.21.15.17:0/902176986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff0c106800 msgr2=0x7eff0c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:28.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.175+0000 7eff10cd6640 1 --2- 172.21.15.17:0/902176986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff0c106800 0x7eff0c106be0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7efefc009880 tx=0x7efefc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.175+0000 7eff10cd6640 1 -- 172.21.15.17:0/902176986 shutdown_connections 2024-09-20T19:03:28.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.175+0000 7eff10cd6640 1 --2- 172.21.15.17:0/902176986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff0c100800 0x7eff0c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.175+0000 7eff10cd6640 1 --2- 172.21.15.17:0/902176986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff0c106800 0x7eff0c106be0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.175+0000 7eff10cd6640 1 -- 172.21.15.17:0/902176986 >> 172.21.15.17:0/902176986 conn(0x7eff0c0fc520 msgr2=0x7eff0c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:28.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.175+0000 7eff10cd6640 1 -- 172.21.15.17:0/902176986 shutdown_connections 2024-09-20T19:03:28.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.175+0000 7eff10cd6640 1 -- 172.21.15.17:0/902176986 wait complete. 2024-09-20T19:03:28.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.176+0000 7eff10cd6640 1 Processor -- start 2024-09-20T19:03:28.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.176+0000 7eff10cd6640 1 -- start start 2024-09-20T19:03:28.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.176+0000 7eff10cd6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff0c100800 0x7eff0c19c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:28.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.176+0000 7eff10cd6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff0c106800 0x7eff0c19cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:28.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.176+0000 7eff10cd6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c10dcd0 con 0x7eff0c106800 2024-09-20T19:03:28.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.176+0000 7eff10cd6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c10db50 con 0x7eff0c100800 2024-09-20T19:03:28.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.176+0000 7eff09d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff0c106800 0x7eff0c19cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:28.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.177+0000 7eff09d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff0c106800 0x7eff0c19cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55026/0 (socket says 172.21.15.17:55026) 2024-09-20T19:03:28.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.177+0000 7eff09d9b640 1 -- 172.21.15.17:0/2773376015 learned_addr learned my addr 172.21.15.17:0/2773376015 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:03:28.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.177+0000 7eff0a59c640 1 --2- 172.21.15.17:0/2773376015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff0c100800 0x7eff0c19c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:28.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.177+0000 7eff09d9b640 1 -- 172.21.15.17:0/2773376015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff0c100800 msgr2=0x7eff0c19c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:28.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.177+0000 7eff09d9b640 1 --2- 172.21.15.17:0/2773376015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff0c100800 0x7eff0c19c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.177+0000 7eff09d9b640 1 -- 172.21.15.17:0/2773376015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0c1966d0 con 0x7eff0c106800 2024-09-20T19:03:28.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.177+0000 7eff09d9b640 1 --2- 172.21.15.17:0/2773376015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff0c106800 0x7eff0c19cb40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7eff0000c8f0 tx=0x7eff0000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:28.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.177+0000 7efefb7fe640 1 -- 172.21.15.17:0/2773376015 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff000079b0 con 0x7eff0c106800 2024-09-20T19:03:28.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.177+0000 7efefb7fe640 1 -- 172.21.15.17:0/2773376015 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7eff000054e0 con 0x7eff0c106800 2024-09-20T19:03:28.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.177+0000 7eff10cd6640 1 -- 172.21.15.17:0/2773376015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff0c1969c0 con 0x7eff0c106800 2024-09-20T19:03:28.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.177+0000 7efefb7fe640 1 -- 172.21.15.17:0/2773376015 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff00004dd0 con 0x7eff0c106800 2024-09-20T19:03:28.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.177+0000 7eff10cd6640 1 -- 172.21.15.17:0/2773376015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff0c196f20 con 0x7eff0c106800 2024-09-20T19:03:28.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.178+0000 7eff10cd6640 1 -- 172.21.15.17:0/2773376015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff0c101f40 con 0x7eff0c106800 2024-09-20T19:03:28.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.179+0000 7efefb7fe640 1 -- 172.21.15.17:0/2773376015 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7eff00005020 con 0x7eff0c106800 2024-09-20T19:03:28.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.179+0000 7efefb7fe640 1 --2- 172.21.15.17:0/2773376015 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efef407af40 0x7efef407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:28.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.180+0000 7efefb7fe640 1 -- 172.21.15.17:0/2773376015 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7eff0009dfd0 con 0x7eff0c106800 2024-09-20T19:03:28.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.180+0000 7eff0a59c640 1 --2- 172.21.15.17:0/2773376015 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efef407af40 0x7efef407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:28.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.180+0000 7eff0a59c640 1 --2- 172.21.15.17:0/2773376015 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efef407af40 0x7efef407d400 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7efefc031460 tx=0x7efefc009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:28.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.184+0000 7efefb7fe640 1 -- 172.21.15.17:0/2773376015 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7eff00014030 con 0x7eff0c106800 2024-09-20T19:03:28.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:27 smithi172 ceph-mon[80431]: pgmap v842: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:28.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.379+0000 7eff10cd6640 1 -- 172.21.15.17:0/2773376015 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7eff0c197290 con 0x7efef407af40 2024-09-20T19:03:28.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.389+0000 7efefb7fe640 1 -- 172.21.15.17:0/2773376015 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7eff0c197290 con 0x7efef407af40 2024-09-20T19:03:28.395 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:03:28.395 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (24m) 3m ago 35m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:03:28.395 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (27m) 3m ago 36m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:03:28.395 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (27m) 3m ago 35m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:03:28.395 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (23m) 3m ago 36m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:03:28.396 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (23m) 3m ago 35m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:03:28.396 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (24m) 3m ago 35m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:03:28.396 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (19m) 3m ago 30m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:03:28.396 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (19m) 3m ago 30m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:03:28.396 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (3m) 3m ago 30m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:03:28.396 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (18m) 3m ago 30m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:03:28.396 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (27m) 3m ago 37m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:03:28.396 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (26m) 3m ago 35m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:03:28.396 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (23m) 3m ago 37m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:03:28.396 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (23m) 3m ago 34m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:03:28.396 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (25m) 3m ago 35m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:03:28.396 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (25m) 3m ago 35m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:03:28.396 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (22m) 3m ago 33m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:03:28.396 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (22m) 3m ago 33m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:03:28.397 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (21m) 3m ago 32m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:03:28.397 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (20m) 3m ago 32m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:03:28.397 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (20m) 3m ago 32m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:03:28.397 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (19m) 3m ago 31m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:03:28.397 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (25m) 3m ago 35m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:03:28.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.391+0000 7eff10cd6640 1 -- 172.21.15.17:0/2773376015 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efef407af40 msgr2=0x7efef407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:28.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.391+0000 7eff10cd6640 1 --2- 172.21.15.17:0/2773376015 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efef407af40 0x7efef407d400 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7efefc031460 tx=0x7efefc009560 comp rx=0 tx=0).stop 2024-09-20T19:03:28.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.391+0000 7eff10cd6640 1 -- 172.21.15.17:0/2773376015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff0c106800 msgr2=0x7eff0c19cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:28.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.391+0000 7eff10cd6640 1 --2- 172.21.15.17:0/2773376015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff0c106800 0x7eff0c19cb40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7eff0000c8f0 tx=0x7eff0000cdb0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.391+0000 7eff10cd6640 1 -- 172.21.15.17:0/2773376015 shutdown_connections 2024-09-20T19:03:28.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.391+0000 7eff10cd6640 1 --2- 172.21.15.17:0/2773376015 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efef407af40 0x7efef407d400 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.391+0000 7eff10cd6640 1 --2- 172.21.15.17:0/2773376015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff0c106800 0x7eff0c19cb40 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.391+0000 7eff10cd6640 1 --2- 172.21.15.17:0/2773376015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff0c100800 0x7eff0c19c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.391+0000 7eff10cd6640 1 -- 172.21.15.17:0/2773376015 >> 172.21.15.17:0/2773376015 conn(0x7eff0c0fc520 msgr2=0x7eff0c0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:28.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.392+0000 7eff10cd6640 1 -- 172.21.15.17:0/2773376015 shutdown_connections 2024-09-20T19:03:28.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.392+0000 7eff10cd6640 1 -- 172.21.15.17:0/2773376015 wait complete. 2024-09-20T19:03:28.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.475+0000 7f73096b5640 1 -- 172.21.15.17:0/3893707193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73040ffdc0 msgr2=0x7f7304100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:28.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.475+0000 7f73096b5640 1 --2- 172.21.15.17:0/3893707193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73040ffdc0 0x7f7304100220 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009880 tx=0x7f72f802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.475+0000 7f73096b5640 1 -- 172.21.15.17:0/3893707193 shutdown_connections 2024-09-20T19:03:28.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.475+0000 7f73096b5640 1 --2- 172.21.15.17:0/3893707193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73040ffdc0 0x7f7304100220 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.475+0000 7f73096b5640 1 --2- 172.21.15.17:0/3893707193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73041069a0 0x7f7304106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.475+0000 7f73096b5640 1 -- 172.21.15.17:0/3893707193 >> 172.21.15.17:0/3893707193 conn(0x7f73040fbc90 msgr2=0x7f73040fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:28.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.475+0000 7f73096b5640 1 -- 172.21.15.17:0/3893707193 shutdown_connections 2024-09-20T19:03:28.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.475+0000 7f73096b5640 1 -- 172.21.15.17:0/3893707193 wait complete. 2024-09-20T19:03:28.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.476+0000 7f73096b5640 1 Processor -- start 2024-09-20T19:03:28.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.476+0000 7f73096b5640 1 -- start start 2024-09-20T19:03:28.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.477+0000 7f73096b5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73040ffdc0 0x7f730419d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:28.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.477+0000 7f73096b5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73041069a0 0x7f730419dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:28.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.477+0000 7f73096b5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f730410ef40 con 0x7f73041069a0 2024-09-20T19:03:28.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.477+0000 7f73096b5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f730410edc0 con 0x7f73040ffdc0 2024-09-20T19:03:28.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.477+0000 7f73027fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73041069a0 0x7f730419dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:28.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.477+0000 7f73027fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73041069a0 0x7f730419dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55038/0 (socket says 172.21.15.17:55038) 2024-09-20T19:03:28.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.477+0000 7f73027fc640 1 -- 172.21.15.17:0/806236345 learned_addr learned my addr 172.21.15.17:0/806236345 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:03:28.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.477+0000 7f7302ffd640 1 --2- 172.21.15.17:0/806236345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73040ffdc0 0x7f730419d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.477+0000 7f73027fc640 1 -- 172.21.15.17:0/806236345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73040ffdc0 msgr2=0x7f730419d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.477+0000 7f73027fc640 1 --2- 172.21.15.17:0/806236345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73040ffdc0 0x7f730419d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.477+0000 7f73027fc640 1 -- 172.21.15.17:0/806236345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73041978d0 con 0x7f73041069a0 2024-09-20T19:03:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.477+0000 7f7302ffd640 1 --2- 172.21.15.17:0/806236345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73040ffdc0 0x7f730419d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:03:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.477+0000 7f73027fc640 1 --2- 172.21.15.17:0/806236345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73041069a0 0x7f730419dc50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f72f8031460 tx=0x7f72f80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.478+0000 7f72ebfff640 1 -- 172.21.15.17:0/806236345 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f72f803f070 con 0x7f73041069a0 2024-09-20T19:03:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.478+0000 7f73096b5640 1 -- 172.21.15.17:0/806236345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7304197b60 con 0x7f73041069a0 2024-09-20T19:03:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.478+0000 7f72ebfff640 1 -- 172.21.15.17:0/806236345 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f72f80035f0 con 0x7f73041069a0 2024-09-20T19:03:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.478+0000 7f72ebfff640 1 -- 172.21.15.17:0/806236345 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f72f8035030 con 0x7f73041069a0 2024-09-20T19:03:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.478+0000 7f73096b5640 1 -- 172.21.15.17:0/806236345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7304198090 con 0x7f73041069a0 2024-09-20T19:03:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.479+0000 7f73096b5640 1 -- 172.21.15.17:0/806236345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73041030e0 con 0x7f73041069a0 2024-09-20T19:03:28.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.480+0000 7f72ebfff640 1 -- 172.21.15.17:0/806236345 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f72f8042070 con 0x7f73041069a0 2024-09-20T19:03:28.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.481+0000 7f72ebfff640 1 --2- 172.21.15.17:0/806236345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f72ec07af30 0x7f72ec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:28.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.481+0000 7f72ebfff640 1 -- 172.21.15.17:0/806236345 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f72f80bea20 con 0x7f73041069a0 2024-09-20T19:03:28.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.481+0000 7f7302ffd640 1 --2- 172.21.15.17:0/806236345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f72ec07af30 0x7f72ec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:28.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.481+0000 7f7302ffd640 1 --2- 172.21.15.17:0/806236345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f72ec07af30 0x7f72ec07d3f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f72f4005fd0 tx=0x7f72f4005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:28.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.485+0000 7f72ebfff640 1 -- 172.21.15.17:0/806236345 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72f808a020 con 0x7f73041069a0 2024-09-20T19:03:28.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.748+0000 7f73096b5640 1 -- 172.21.15.17:0/806236345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7304198e00 con 0x7f73041069a0 2024-09-20T19:03:28.755 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:28 smithi017 ceph-mon[108970]: from='client.35352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:28.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.748+0000 7f72ebfff640 1 -- 172.21.15.17:0/806236345 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f72f808c070 con 0x7f73041069a0 2024-09-20T19:03:28.755 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:03:28.755 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:03:28.755 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:03:28.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:03:28.756 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:03:28.756 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:03:28.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:03:28.756 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:03:28.756 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:03:28.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:03:28.756 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:03:28.756 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:03:28.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:03:28.756 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:03:28.756 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:03:28.756 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:03:28.756 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:03:28.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.751+0000 7f73096b5640 1 -- 172.21.15.17:0/806236345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f72ec07af30 msgr2=0x7f72ec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:28.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.751+0000 7f73096b5640 1 --2- 172.21.15.17:0/806236345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f72ec07af30 0x7f72ec07d3f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f72f4005fd0 tx=0x7f72f4005850 comp rx=0 tx=0).stop 2024-09-20T19:03:28.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.751+0000 7f73096b5640 1 -- 172.21.15.17:0/806236345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73041069a0 msgr2=0x7f730419dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:28.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.751+0000 7f73096b5640 1 --2- 172.21.15.17:0/806236345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73041069a0 0x7f730419dc50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f72f8031460 tx=0x7f72f80045e0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.751+0000 7f73096b5640 1 -- 172.21.15.17:0/806236345 shutdown_connections 2024-09-20T19:03:28.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.751+0000 7f73096b5640 1 --2- 172.21.15.17:0/806236345 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f72ec07af30 0x7f72ec07d3f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.751+0000 7f73096b5640 1 --2- 172.21.15.17:0/806236345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73041069a0 0x7f730419dc50 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.751+0000 7f73096b5640 1 --2- 172.21.15.17:0/806236345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73040ffdc0 0x7f730419d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.751+0000 7f73096b5640 1 -- 172.21.15.17:0/806236345 >> 172.21.15.17:0/806236345 conn(0x7f73040fbc90 msgr2=0x7f73040fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:28.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.751+0000 7f73096b5640 1 -- 172.21.15.17:0/806236345 shutdown_connections 2024-09-20T19:03:28.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.751+0000 7f73096b5640 1 -- 172.21.15.17:0/806236345 wait complete. 2024-09-20T19:03:28.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.834+0000 7fdcb1543640 1 -- 172.21.15.17:0/2259930809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcac107900 msgr2=0x7fdcac107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:28.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.834+0000 7fdcb1543640 1 --2- 172.21.15.17:0/2259930809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcac107900 0x7fdcac107ce0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009880 tx=0x7fdc9c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.834+0000 7fdcb1543640 1 -- 172.21.15.17:0/2259930809 shutdown_connections 2024-09-20T19:03:28.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.834+0000 7fdcb1543640 1 --2- 172.21.15.17:0/2259930809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcac101900 0x7fdcac101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.834+0000 7fdcb1543640 1 --2- 172.21.15.17:0/2259930809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcac107900 0x7fdcac107ce0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.834+0000 7fdcb1543640 1 -- 172.21.15.17:0/2259930809 >> 172.21.15.17:0/2259930809 conn(0x7fdcac0fd600 msgr2=0x7fdcac0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:28.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.834+0000 7fdcb1543640 1 -- 172.21.15.17:0/2259930809 shutdown_connections 2024-09-20T19:03:28.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.834+0000 7fdcb1543640 1 -- 172.21.15.17:0/2259930809 wait complete. 2024-09-20T19:03:28.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.835+0000 7fdcb1543640 1 Processor -- start 2024-09-20T19:03:28.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.835+0000 7fdcb1543640 1 -- start start 2024-09-20T19:03:28.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.835+0000 7fdcb1543640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcac101900 0x7fdcac0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:28.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.835+0000 7fdcb1543640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcac107900 0x7fdcac074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:28.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.835+0000 7fdcb1543640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac10edd0 con 0x7fdcac101900 2024-09-20T19:03:28.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.835+0000 7fdcb1543640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac10ec50 con 0x7fdcac107900 2024-09-20T19:03:28.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.836+0000 7fdcaaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcac101900 0x7fdcac0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:28.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.836+0000 7fdcaaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcac101900 0x7fdcac0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55056/0 (socket says 172.21.15.17:55056) 2024-09-20T19:03:28.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.836+0000 7fdcaaffd640 1 -- 172.21.15.17:0/3830444769 learned_addr learned my addr 172.21.15.17:0/3830444769 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:03:28.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.836+0000 7fdcaa7fc640 1 --2- 172.21.15.17:0/3830444769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcac107900 0x7fdcac074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:28.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.836+0000 7fdcaaffd640 1 -- 172.21.15.17:0/3830444769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcac107900 msgr2=0x7fdcac074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:28.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.836+0000 7fdcaaffd640 1 --2- 172.21.15.17:0/3830444769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcac107900 0x7fdcac074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:28.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.836+0000 7fdcaaffd640 1 -- 172.21.15.17:0/3830444769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcac074f70 con 0x7fdcac101900 2024-09-20T19:03:28.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.836+0000 7fdcaaffd640 1 --2- 172.21.15.17:0/3830444769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcac101900 0x7fdcac0744f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c031460 tx=0x7fdc9c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:28.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.836+0000 7fdc93fff640 1 -- 172.21.15.17:0/3830444769 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdc9c03f070 con 0x7fdcac101900 2024-09-20T19:03:28.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.836+0000 7fdc93fff640 1 -- 172.21.15.17:0/3830444769 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdc9c004b10 con 0x7fdcac101900 2024-09-20T19:03:28.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.836+0000 7fdcb1543640 1 -- 172.21.15.17:0/3830444769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcac075200 con 0x7fdcac101900 2024-09-20T19:03:28.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.836+0000 7fdc93fff640 1 -- 172.21.15.17:0/3830444769 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdc9c035030 con 0x7fdcac101900 2024-09-20T19:03:28.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.836+0000 7fdcb1543640 1 -- 172.21.15.17:0/3830444769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcac1a3d60 con 0x7fdcac101900 2024-09-20T19:03:28.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.837+0000 7fdcb1543640 1 -- 172.21.15.17:0/3830444769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcac103040 con 0x7fdcac101900 2024-09-20T19:03:28.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.838+0000 7fdc93fff640 1 -- 172.21.15.17:0/3830444769 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdc9c042070 con 0x7fdcac101900 2024-09-20T19:03:28.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.839+0000 7fdc93fff640 1 --2- 172.21.15.17:0/3830444769 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdc9407af40 0x7fdc9407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:28.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.839+0000 7fdc93fff640 1 -- 172.21.15.17:0/3830444769 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fdc9c0beb40 con 0x7fdcac101900 2024-09-20T19:03:28.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.839+0000 7fdcaa7fc640 1 --2- 172.21.15.17:0/3830444769 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdc9407af40 0x7fdc9407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:28.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.839+0000 7fdcaa7fc640 1 --2- 172.21.15.17:0/3830444769 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdc9407af40 0x7fdc9407d400 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdcac075f80 tx=0x7fdca000b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:28.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:28.843+0000 7fdc93fff640 1 -- 172.21.15.17:0/3830444769 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc9c08a0a0 con 0x7fdcac101900 2024-09-20T19:03:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.067+0000 7fdcb1543640 1 -- 172.21.15.17:0/3830444769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fdcac109e70 con 0x7fdcac101900 2024-09-20T19:03:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.067+0000 7fdc93fff640 1 -- 172.21.15.17:0/3830444769 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7fdc9c08ef50 con 0x7fdcac101900 2024-09-20T19:03:29.074 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:03:29.074 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:03:29.074 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:03:29.074 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:03:29.074 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:03:29.074 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:03:29.074 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:03:29.074 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:03:29.074 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:03:29.074 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:03:29.075 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:03:29.075 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:03:29.075 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:03:29.075 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:03:29.075 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:03:29.075 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:03:29.075 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:03:29.075 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:03:29.075 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:03:29.075 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:03:29.075 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:03:29.075 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:03:29.075 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:03:29.075 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:03:29.076 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:03:29.076 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:03:29.076 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:03:29.076 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:03:29.076 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:03:29.076 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:03:29.076 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:03:29.076 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:03:29.076 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:03:29.076 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:03:29.076 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:03:29.076 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:03:29.076 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:03:29.076 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:03:29.077 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:03:29.077 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:03:29.077 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:03:29.077 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:03:29.077 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:03:29.077 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:03:29.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.070+0000 7fdcb1543640 1 -- 172.21.15.17:0/3830444769 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdc9407af40 msgr2=0x7fdc9407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:29.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.070+0000 7fdcb1543640 1 --2- 172.21.15.17:0/3830444769 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdc9407af40 0x7fdc9407d400 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdcac075f80 tx=0x7fdca000b390 comp rx=0 tx=0).stop 2024-09-20T19:03:29.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.070+0000 7fdcb1543640 1 -- 172.21.15.17:0/3830444769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcac101900 msgr2=0x7fdcac0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:29.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.070+0000 7fdcb1543640 1 --2- 172.21.15.17:0/3830444769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcac101900 0x7fdcac0744f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c031460 tx=0x7fdc9c0045e0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.070+0000 7fdcb1543640 1 -- 172.21.15.17:0/3830444769 shutdown_connections 2024-09-20T19:03:29.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.070+0000 7fdcb1543640 1 --2- 172.21.15.17:0/3830444769 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdc9407af40 0x7fdc9407d400 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.070+0000 7fdcb1543640 1 --2- 172.21.15.17:0/3830444769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcac107900 0x7fdcac074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.070+0000 7fdcb1543640 1 --2- 172.21.15.17:0/3830444769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcac101900 0x7fdcac0744f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.070+0000 7fdcb1543640 1 -- 172.21.15.17:0/3830444769 >> 172.21.15.17:0/3830444769 conn(0x7fdcac0fd600 msgr2=0x7fdcac0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:29.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.070+0000 7fdcb1543640 1 -- 172.21.15.17:0/3830444769 shutdown_connections 2024-09-20T19:03:29.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.070+0000 7fdcb1543640 1 -- 172.21.15.17:0/3830444769 wait complete. 2024-09-20T19:03:29.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.155+0000 7fe390438640 1 -- 172.21.15.17:0/2680465797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe388102ab0 msgr2=0x7fe388102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:29.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.155+0000 7fe390438640 1 --2- 172.21.15.17:0/2680465797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe388102ab0 0x7fe388102e90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe384009880 tx=0x7fe38402a530 comp rx=0 tx=0).stop 2024-09-20T19:03:29.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.156+0000 7fe390438640 1 -- 172.21.15.17:0/2680465797 shutdown_connections 2024-09-20T19:03:29.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.156+0000 7fe390438640 1 --2- 172.21.15.17:0/2680465797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3881033d0 0x7fe38810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.156+0000 7fe390438640 1 --2- 172.21.15.17:0/2680465797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe388102ab0 0x7fe388102e90 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.156+0000 7fe390438640 1 -- 172.21.15.17:0/2680465797 >> 172.21.15.17:0/2680465797 conn(0x7fe3880fc550 msgr2=0x7fe3880fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:29.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.156+0000 7fe390438640 1 -- 172.21.15.17:0/2680465797 shutdown_connections 2024-09-20T19:03:29.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.156+0000 7fe390438640 1 -- 172.21.15.17:0/2680465797 wait complete. 2024-09-20T19:03:29.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.156+0000 7fe390438640 1 Processor -- start 2024-09-20T19:03:29.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.156+0000 7fe390438640 1 -- start start 2024-09-20T19:03:29.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.156+0000 7fe390438640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe388102ab0 0x7fe38819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:29.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.156+0000 7fe390438640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3881033d0 0x7fe38819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:29.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.156+0000 7fe390438640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe38810ede0 con 0x7fe3881033d0 2024-09-20T19:03:29.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.156+0000 7fe390438640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe38810ec60 con 0x7fe388102ab0 2024-09-20T19:03:29.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.157+0000 7fe38d9d3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3881033d0 0x7fe38819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:29.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.157+0000 7fe38d9d3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3881033d0 0x7fe38819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55074/0 (socket says 172.21.15.17:55074) 2024-09-20T19:03:29.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.157+0000 7fe38d9d3640 1 -- 172.21.15.17:0/3428408292 learned_addr learned my addr 172.21.15.17:0/3428408292 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:03:29.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.157+0000 7fe38e1d4640 1 --2- 172.21.15.17:0/3428408292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe388102ab0 0x7fe38819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:29.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.157+0000 7fe38d9d3640 1 -- 172.21.15.17:0/3428408292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe388102ab0 msgr2=0x7fe38819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:29.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.157+0000 7fe38d9d3640 1 --2- 172.21.15.17:0/3428408292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe388102ab0 0x7fe38819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.157+0000 7fe38d9d3640 1 -- 172.21.15.17:0/3428408292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3881977b0 con 0x7fe3881033d0 2024-09-20T19:03:29.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.157+0000 7fe38d9d3640 1 --2- 172.21.15.17:0/3428408292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3881033d0 0x7fe38819db70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe37800d6d0 tx=0x7fe37800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:29.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.157+0000 7fe37f7fe640 1 -- 172.21.15.17:0/3428408292 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe378017070 con 0x7fe3881033d0 2024-09-20T19:03:29.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.157+0000 7fe37f7fe640 1 -- 172.21.15.17:0/3428408292 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe3780054e0 con 0x7fe3881033d0 2024-09-20T19:03:29.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.157+0000 7fe37f7fe640 1 -- 172.21.15.17:0/3428408292 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe378004ae0 con 0x7fe3881033d0 2024-09-20T19:03:29.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.157+0000 7fe390438640 1 -- 172.21.15.17:0/3428408292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe388197aa0 con 0x7fe3881033d0 2024-09-20T19:03:29.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.157+0000 7fe390438640 1 -- 172.21.15.17:0/3428408292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe388198030 con 0x7fe3881033d0 2024-09-20T19:03:29.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.158+0000 7fe390438640 1 -- 172.21.15.17:0/3428408292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe38806a580 con 0x7fe3881033d0 2024-09-20T19:03:29.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.159+0000 7fe37f7fe640 1 -- 172.21.15.17:0/3428408292 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe378004de0 con 0x7fe3881033d0 2024-09-20T19:03:29.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.160+0000 7fe37f7fe640 1 --2- 172.21.15.17:0/3428408292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe37407af30 0x7fe37407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:29.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.160+0000 7fe37f7fe640 1 -- 172.21.15.17:0/3428408292 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fe37809dbf0 con 0x7fe3881033d0 2024-09-20T19:03:29.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.160+0000 7fe38e1d4640 1 --2- 172.21.15.17:0/3428408292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe37407af30 0x7fe37407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:29.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.160+0000 7fe38e1d4640 1 --2- 172.21.15.17:0/3428408292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe37407af30 0x7fe37407d3f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe3840096c0 tx=0x7fe384031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:29.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.164+0000 7fe37f7fe640 1 -- 172.21.15.17:0/3428408292 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe3780691f0 con 0x7fe3881033d0 2024-09-20T19:03:29.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:28 smithi172 ceph-mon[80431]: from='client.35352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:29.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.369+0000 7fe390438640 1 -- 172.21.15.17:0/3428408292 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe3881982e0 con 0x7fe37407af30 2024-09-20T19:03:29.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.370+0000 7fe37f7fe640 1 -- 172.21.15.17:0/3428408292 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe3881982e0 con 0x7fe37407af30 2024-09-20T19:03:29.376 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:03:29.377 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:03:29.377 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:03:29.377 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:03:29.377 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:03:29.377 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:03:29.377 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:03:29.377 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:03:29.377 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:03:29.377 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:03:29.377 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:03:29.377 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:03:29.377 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:03:29.377 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:03:29.377 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:03:29.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.373+0000 7fe390438640 1 -- 172.21.15.17:0/3428408292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe37407af30 msgr2=0x7fe37407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:29.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.373+0000 7fe390438640 1 --2- 172.21.15.17:0/3428408292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe37407af30 0x7fe37407d3f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe3840096c0 tx=0x7fe384031400 comp rx=0 tx=0).stop 2024-09-20T19:03:29.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.373+0000 7fe390438640 1 -- 172.21.15.17:0/3428408292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3881033d0 msgr2=0x7fe38819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:29.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.373+0000 7fe390438640 1 --2- 172.21.15.17:0/3428408292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3881033d0 0x7fe38819db70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe37800d6d0 tx=0x7fe37800db90 comp rx=0 tx=0).stop 2024-09-20T19:03:29.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.373+0000 7fe390438640 1 -- 172.21.15.17:0/3428408292 shutdown_connections 2024-09-20T19:03:29.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.373+0000 7fe390438640 1 --2- 172.21.15.17:0/3428408292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe37407af30 0x7fe37407d3f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.373+0000 7fe390438640 1 --2- 172.21.15.17:0/3428408292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3881033d0 0x7fe38819db70 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.373+0000 7fe390438640 1 --2- 172.21.15.17:0/3428408292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe388102ab0 0x7fe38819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.373+0000 7fe390438640 1 -- 172.21.15.17:0/3428408292 >> 172.21.15.17:0/3428408292 conn(0x7fe3880fc550 msgr2=0x7fe38810aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:29.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.373+0000 7fe390438640 1 -- 172.21.15.17:0/3428408292 shutdown_connections 2024-09-20T19:03:29.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.373+0000 7fe390438640 1 -- 172.21.15.17:0/3428408292 wait complete. 2024-09-20T19:03:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.457+0000 7efe8ce4a640 1 -- 172.21.15.17:0/1355110723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe881067f0 msgr2=0x7efe88106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.457+0000 7efe8ce4a640 1 --2- 172.21.15.17:0/1355110723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe881067f0 0x7efe88106bd0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7efe78009880 tx=0x7efe7802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.457+0000 7efe8ce4a640 1 -- 172.21.15.17:0/1355110723 shutdown_connections 2024-09-20T19:03:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.457+0000 7efe8ce4a640 1 --2- 172.21.15.17:0/1355110723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe881007f0 0x7efe88100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.457+0000 7efe8ce4a640 1 --2- 172.21.15.17:0/1355110723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe881067f0 0x7efe88106bd0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.457+0000 7efe8ce4a640 1 -- 172.21.15.17:0/1355110723 >> 172.21.15.17:0/1355110723 conn(0x7efe880fc550 msgr2=0x7efe880fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.457+0000 7efe8ce4a640 1 -- 172.21.15.17:0/1355110723 shutdown_connections 2024-09-20T19:03:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.457+0000 7efe8ce4a640 1 -- 172.21.15.17:0/1355110723 wait complete. 2024-09-20T19:03:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.458+0000 7efe8ce4a640 1 Processor -- start 2024-09-20T19:03:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.458+0000 7efe8ce4a640 1 -- start start 2024-09-20T19:03:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.458+0000 7efe8ce4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe881007f0 0x7efe8819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.458+0000 7efe8ce4a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe881067f0 0x7efe8819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.458+0000 7efe8ce4a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efe8810dcc0 con 0x7efe881007f0 2024-09-20T19:03:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.458+0000 7efe8ce4a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efe8810db40 con 0x7efe881067f0 2024-09-20T19:03:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.459+0000 7efe8659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe881007f0 0x7efe8819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.459+0000 7efe8659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe881007f0 0x7efe8819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55096/0 (socket says 172.21.15.17:55096) 2024-09-20T19:03:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.459+0000 7efe8659c640 1 -- 172.21.15.17:0/1946277758 learned_addr learned my addr 172.21.15.17:0/1946277758 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:03:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.459+0000 7efe85d9b640 1 --2- 172.21.15.17:0/1946277758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe881067f0 0x7efe8819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.459+0000 7efe8659c640 1 -- 172.21.15.17:0/1946277758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe881067f0 msgr2=0x7efe8819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.459+0000 7efe8659c640 1 --2- 172.21.15.17:0/1946277758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe881067f0 0x7efe8819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.459+0000 7efe8659c640 1 -- 172.21.15.17:0/1946277758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe881977b0 con 0x7efe881007f0 2024-09-20T19:03:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.459+0000 7efe85d9b640 1 --2- 172.21.15.17:0/1946277758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe881067f0 0x7efe8819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:03:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.459+0000 7efe8659c640 1 --2- 172.21.15.17:0/1946277758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe881007f0 0x7efe8819d630 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7efe78031460 tx=0x7efe780045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.459+0000 7efe777fe640 1 -- 172.21.15.17:0/1946277758 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe7803f070 con 0x7efe881007f0 2024-09-20T19:03:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.459+0000 7efe777fe640 1 -- 172.21.15.17:0/1946277758 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe780035f0 con 0x7efe881007f0 2024-09-20T19:03:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.459+0000 7efe8ce4a640 1 -- 172.21.15.17:0/1946277758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe88197a40 con 0x7efe881007f0 2024-09-20T19:03:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.459+0000 7efe777fe640 1 -- 172.21.15.17:0/1946277758 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe78035030 con 0x7efe881007f0 2024-09-20T19:03:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.459+0000 7efe8ce4a640 1 -- 172.21.15.17:0/1946277758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe88197f70 con 0x7efe881007f0 2024-09-20T19:03:29.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.460+0000 7efe8ce4a640 1 -- 172.21.15.17:0/1946277758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe88101f30 con 0x7efe881007f0 2024-09-20T19:03:29.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.461+0000 7efe777fe640 1 -- 172.21.15.17:0/1946277758 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7efe78042070 con 0x7efe881007f0 2024-09-20T19:03:29.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.462+0000 7efe777fe640 1 --2- 172.21.15.17:0/1946277758 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efe7007af80 0x7efe7007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:29.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.462+0000 7efe777fe640 1 -- 172.21.15.17:0/1946277758 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7efe780be910 con 0x7efe881007f0 2024-09-20T19:03:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.462+0000 7efe85d9b640 1 --2- 172.21.15.17:0/1946277758 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efe7007af80 0x7efe7007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.462+0000 7efe85d9b640 1 --2- 172.21.15.17:0/1946277758 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efe7007af80 0x7efe7007d440 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7efe88104fd0 tx=0x7efe7c005e50 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:29.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.466+0000 7efe777fe640 1 -- 172.21.15.17:0/1946277758 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efe78089f90 con 0x7efe881007f0 2024-09-20T19:03:29.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.729+0000 7efe8ce4a640 1 -- 172.21.15.17:0/1946277758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7efe88109d70 con 0x7efe881007f0 2024-09-20T19:03:29.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.730+0000 7efe777fe640 1 -- 172.21.15.17:0/1946277758 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7efe7808ee40 con 0x7efe881007f0 2024-09-20T19:03:29.736 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:03:29.736 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:03:29.736 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:03:29.736 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:03:29.737 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:03:29.737 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:03:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:03:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:03:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:03:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:03:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:03:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:03:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:03:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:03:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:03:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:03:29.737 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:03:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:03:29.738 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:03:29.738 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:03:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:03:29.738 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:03:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:03:29.738 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:03:29.738 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:03:29.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.732+0000 7efe8ce4a640 1 -- 172.21.15.17:0/1946277758 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efe7007af80 msgr2=0x7efe7007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:29.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.732+0000 7efe8ce4a640 1 --2- 172.21.15.17:0/1946277758 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efe7007af80 0x7efe7007d440 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7efe88104fd0 tx=0x7efe7c005e50 comp rx=0 tx=0).stop 2024-09-20T19:03:29.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.732+0000 7efe8ce4a640 1 -- 172.21.15.17:0/1946277758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe881007f0 msgr2=0x7efe8819d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:29.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.732+0000 7efe8ce4a640 1 --2- 172.21.15.17:0/1946277758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe881007f0 0x7efe8819d630 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7efe78031460 tx=0x7efe780045e0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.732+0000 7efe8ce4a640 1 -- 172.21.15.17:0/1946277758 shutdown_connections 2024-09-20T19:03:29.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.732+0000 7efe8ce4a640 1 --2- 172.21.15.17:0/1946277758 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efe7007af80 0x7efe7007d440 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.732+0000 7efe8ce4a640 1 --2- 172.21.15.17:0/1946277758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe881067f0 0x7efe8819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.732+0000 7efe8ce4a640 1 --2- 172.21.15.17:0/1946277758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe881007f0 0x7efe8819d630 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:29.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.732+0000 7efe8ce4a640 1 -- 172.21.15.17:0/1946277758 >> 172.21.15.17:0/1946277758 conn(0x7efe880fc550 msgr2=0x7efe88069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:29.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.732+0000 7efe8ce4a640 1 -- 172.21.15.17:0/1946277758 shutdown_connections 2024-09-20T19:03:29.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:29.732+0000 7efe8ce4a640 1 -- 172.21.15.17:0/1946277758 wait complete. 2024-09-20T19:03:30.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:29 smithi017 ceph-mon[108970]: from='client.35356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:30.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:29 smithi017 ceph-mon[108970]: from='client.35360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:30.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:29 smithi017 ceph-mon[108970]: pgmap v843: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:30.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:29 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/806236345' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:03:30.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:29 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3830444769' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:03:30.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:29 smithi172 ceph-mon[80431]: from='client.35356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:30.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:29 smithi172 ceph-mon[80431]: from='client.35360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:30.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:29 smithi172 ceph-mon[80431]: pgmap v843: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:30.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:29 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/806236345' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:03:30.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:29 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3830444769' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:03:31.102 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:30 smithi017 ceph-mon[108970]: from='client.35372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:31.102 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:30 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1946277758' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:03:31.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:30 smithi172 ceph-mon[80431]: from='client.35372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:03:31.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:30 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1946277758' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:03:31.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:31 smithi017 ceph-mon[108970]: pgmap v844: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:32.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:31 smithi172 ceph-mon[80431]: pgmap v844: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:34.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:33 smithi017 ceph-mon[108970]: pgmap v845: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:34.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:33 smithi172 ceph-mon[80431]: pgmap v845: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:36.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:35 smithi017 ceph-mon[108970]: pgmap v846: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:36.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:35 smithi172 ceph-mon[80431]: pgmap v846: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:37.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:37 smithi017 ceph-mon[108970]: pgmap v847: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:37.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:03:38.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:37 smithi172 ceph-mon[80431]: pgmap v847: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:38.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:03:40.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:39 smithi017 ceph-mon[108970]: pgmap v848: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:40.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:39 smithi172 ceph-mon[80431]: pgmap v848: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:42.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:41 smithi017 ceph-mon[108970]: pgmap v849: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:42.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:41 smithi172 ceph-mon[80431]: pgmap v849: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:43.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:43 smithi017 ceph-mon[108970]: pgmap v850: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:44.014 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:43 smithi172 ceph-mon[80431]: pgmap v850: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:46.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:45 smithi017 ceph-mon[108970]: pgmap v851: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:46.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:45 smithi172 ceph-mon[80431]: pgmap v851: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:48.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:47 smithi017 ceph-mon[108970]: pgmap v852: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:48.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:47 smithi172 ceph-mon[80431]: pgmap v852: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:49.892 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:49 smithi017 ceph-mon[108970]: pgmap v853: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:50.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:49 smithi172 ceph-mon[80431]: pgmap v853: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:52.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:51 smithi017 ceph-mon[108970]: pgmap v854: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:52.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:51 smithi172 ceph-mon[80431]: pgmap v854: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:52.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:03:53.102 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:03:54.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:53 smithi017 ceph-mon[108970]: pgmap v855: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:54.165 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:53 smithi172 ceph-mon[80431]: pgmap v855: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:55.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:55 smithi017 ceph-mon[108970]: pgmap v856: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:56.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:55 smithi172 ceph-mon[80431]: pgmap v856: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:58.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:57 smithi017 ceph-mon[108970]: pgmap v857: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:58.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:57 smithi172 ceph-mon[80431]: pgmap v857: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:03:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.830+0000 7f3c43289640 1 -- 172.21.15.17:0/2815571828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c3c100650 msgr2=0x7f3c3c100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.830+0000 7f3c43289640 1 --2- 172.21.15.17:0/2815571828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c3c100650 0x7f3c3c100a30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009880 tx=0x7f3c3002a490 comp rx=0 tx=0).stop 2024-09-20T19:03:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.830+0000 7f3c43289640 1 -- 172.21.15.17:0/2815571828 shutdown_connections 2024-09-20T19:03:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.830+0000 7f3c43289640 1 --2- 172.21.15.17:0/2815571828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3c101000 0x7f3c3c10dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.830+0000 7f3c43289640 1 --2- 172.21.15.17:0/2815571828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c3c100650 0x7f3c3c100a30 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.830+0000 7f3c43289640 1 -- 172.21.15.17:0/2815571828 >> 172.21.15.17:0/2815571828 conn(0x7f3c3c0fc520 msgr2=0x7f3c3c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:03:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.831+0000 7f3c43289640 1 -- 172.21.15.17:0/2815571828 shutdown_connections 2024-09-20T19:03:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.831+0000 7f3c43289640 1 -- 172.21.15.17:0/2815571828 wait complete. 2024-09-20T19:03:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.831+0000 7f3c43289640 1 Processor -- start 2024-09-20T19:03:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.831+0000 7f3c43289640 1 -- start start 2024-09-20T19:03:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.832+0000 7f3c43289640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c3c100650 0x7f3c3c19f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.832+0000 7f3c43289640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3c101000 0x7f3c3c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.832+0000 7f3c43289640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c110fb0 con 0x7f3c3c100650 2024-09-20T19:03:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.832+0000 7f3c43289640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c110e30 con 0x7f3c3c101000 2024-09-20T19:03:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.832+0000 7f3c41025640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c3c100650 0x7f3c3c19f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.832+0000 7f3c41025640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c3c100650 0x7f3c3c19f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48560/0 (socket says 172.21.15.17:48560) 2024-09-20T19:03:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.832+0000 7f3c41025640 1 -- 172.21.15.17:0/3604877014 learned_addr learned my addr 172.21.15.17:0/3604877014 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:03:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.832+0000 7f3c40824640 1 --2- 172.21.15.17:0/3604877014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3c101000 0x7f3c3c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.832+0000 7f3c41025640 1 -- 172.21.15.17:0/3604877014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3c101000 msgr2=0x7f3c3c19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:03:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.832+0000 7f3c41025640 1 --2- 172.21.15.17:0/3604877014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3c101000 0x7f3c3c19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:03:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.832+0000 7f3c41025640 1 -- 172.21.15.17:0/3604877014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3c1999a0 con 0x7f3c3c100650 2024-09-20T19:03:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.832+0000 7f3c41025640 1 --2- 172.21.15.17:0/3604877014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c3c100650 0x7f3c3c19f7e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3c30031460 tx=0x7f3c300045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.832+0000 7f3c2e7fc640 1 -- 172.21.15.17:0/3604877014 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c3003f070 con 0x7f3c3c100650 2024-09-20T19:03:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.832+0000 7f3c2e7fc640 1 -- 172.21.15.17:0/3604877014 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c300035f0 con 0x7f3c3c100650 2024-09-20T19:03:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.833+0000 7f3c43289640 1 -- 172.21.15.17:0/3604877014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c3c199c30 con 0x7f3c3c100650 2024-09-20T19:03:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.833+0000 7f3c2e7fc640 1 -- 172.21.15.17:0/3604877014 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c30035030 con 0x7f3c3c100650 2024-09-20T19:03:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.833+0000 7f3c43289640 1 -- 172.21.15.17:0/3604877014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c3c19a1c0 con 0x7f3c3c100650 2024-09-20T19:03:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.834+0000 7f3c43289640 1 -- 172.21.15.17:0/3604877014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c3c06aa90 con 0x7f3c3c100650 2024-09-20T19:03:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.834+0000 7f3c2e7fc640 1 -- 172.21.15.17:0/3604877014 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3c30042070 con 0x7f3c3c100650 2024-09-20T19:03:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.835+0000 7f3c2e7fc640 1 --2- 172.21.15.17:0/3604877014 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c2807af80 0x7f3c2807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:03:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.835+0000 7f3c2e7fc640 1 -- 172.21.15.17:0/3604877014 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f3c300be860 con 0x7f3c3c100650 2024-09-20T19:03:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.835+0000 7f3c40824640 1 --2- 172.21.15.17:0/3604877014 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c2807af80 0x7f3c2807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:03:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.836+0000 7f3c40824640 1 --2- 172.21.15.17:0/3604877014 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c2807af80 0x7f3c2807d440 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c102520 tx=0x7f3c3800b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:03:59.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:03:59.840+0000 7f3c2e7fc640 1 -- 172.21.15.17:0/3604877014 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c30089ee0 con 0x7f3c3c100650 2024-09-20T19:04:00.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.045+0000 7f3c43289640 1 -- 172.21.15.17:0/3604877014 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3c3c19aed0 con 0x7f3c2807af80 2024-09-20T19:04:00.051 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:03:59 smithi017 ceph-mon[108970]: pgmap v858: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:00.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.046+0000 7f3c2e7fc640 1 -- 172.21.15.17:0/3604877014 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3c3c19aed0 con 0x7f3c2807af80 2024-09-20T19:04:00.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.048+0000 7f3c43289640 1 -- 172.21.15.17:0/3604877014 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c2807af80 msgr2=0x7f3c2807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:00.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.048+0000 7f3c43289640 1 --2- 172.21.15.17:0/3604877014 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c2807af80 0x7f3c2807d440 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c102520 tx=0x7f3c3800b390 comp rx=0 tx=0).stop 2024-09-20T19:04:00.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.048+0000 7f3c43289640 1 -- 172.21.15.17:0/3604877014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c3c100650 msgr2=0x7f3c3c19f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:00.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.048+0000 7f3c43289640 1 --2- 172.21.15.17:0/3604877014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c3c100650 0x7f3c3c19f7e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3c30031460 tx=0x7f3c300045e0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.048+0000 7f3c43289640 1 -- 172.21.15.17:0/3604877014 shutdown_connections 2024-09-20T19:04:00.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.048+0000 7f3c43289640 1 --2- 172.21.15.17:0/3604877014 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c2807af80 0x7f3c2807d440 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.048+0000 7f3c43289640 1 --2- 172.21.15.17:0/3604877014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3c101000 0x7f3c3c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.048+0000 7f3c43289640 1 --2- 172.21.15.17:0/3604877014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c3c100650 0x7f3c3c19f7e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.048+0000 7f3c43289640 1 -- 172.21.15.17:0/3604877014 >> 172.21.15.17:0/3604877014 conn(0x7f3c3c0fc520 msgr2=0x7f3c3c0fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:00.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.048+0000 7f3c43289640 1 -- 172.21.15.17:0/3604877014 shutdown_connections 2024-09-20T19:04:00.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.048+0000 7f3c43289640 1 -- 172.21.15.17:0/3604877014 wait complete. 2024-09-20T19:04:00.063 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:04:00.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.133+0000 7ff556e9a640 1 -- 172.21.15.17:0/2052833003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff550102b20 msgr2=0x7ff550102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:00.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.133+0000 7ff556e9a640 1 --2- 172.21.15.17:0/2052833003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff550102b20 0x7ff550102f00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff5400098b0 tx=0x7ff54002a560 comp rx=0 tx=0).stop 2024-09-20T19:04:00.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.133+0000 7ff556e9a640 1 -- 172.21.15.17:0/2052833003 shutdown_connections 2024-09-20T19:04:00.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.133+0000 7ff556e9a640 1 --2- 172.21.15.17:0/2052833003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff550103440 0x7ff55010b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.133+0000 7ff556e9a640 1 --2- 172.21.15.17:0/2052833003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff550102b20 0x7ff550102f00 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.133+0000 7ff556e9a640 1 -- 172.21.15.17:0/2052833003 >> 172.21.15.17:0/2052833003 conn(0x7ff5500fc520 msgr2=0x7ff5500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:00.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.134+0000 7ff556e9a640 1 -- 172.21.15.17:0/2052833003 shutdown_connections 2024-09-20T19:04:00.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.134+0000 7ff556e9a640 1 -- 172.21.15.17:0/2052833003 wait complete. 2024-09-20T19:04:00.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.134+0000 7ff556e9a640 1 Processor -- start 2024-09-20T19:04:00.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.134+0000 7ff556e9a640 1 -- start start 2024-09-20T19:04:00.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.134+0000 7ff556e9a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff550102b20 0x7ff55019f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:00.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.134+0000 7ff556e9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff550103440 0x7ff55019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:00.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.134+0000 7ff556e9a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff55010edd0 con 0x7ff550103440 2024-09-20T19:04:00.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.134+0000 7ff556e9a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff55010ec50 con 0x7ff550102b20 2024-09-20T19:04:00.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.135+0000 7ff54ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff550103440 0x7ff55019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:00.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.135+0000 7ff54ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff550103440 0x7ff55019fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48572/0 (socket says 172.21.15.17:48572) 2024-09-20T19:04:00.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.135+0000 7ff54ffff640 1 -- 172.21.15.17:0/2813918225 learned_addr learned my addr 172.21.15.17:0/2813918225 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:04:00.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.135+0000 7ff554c36640 1 --2- 172.21.15.17:0/2813918225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff550102b20 0x7ff55019f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:00.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.135+0000 7ff54ffff640 1 -- 172.21.15.17:0/2813918225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff550102b20 msgr2=0x7ff55019f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:00.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.135+0000 7ff54ffff640 1 --2- 172.21.15.17:0/2813918225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff550102b20 0x7ff55019f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.135+0000 7ff54ffff640 1 -- 172.21.15.17:0/2813918225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5501a0440 con 0x7ff550103440 2024-09-20T19:04:00.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.135+0000 7ff554c36640 1 --2- 172.21.15.17:0/2813918225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff550102b20 0x7ff55019f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:04:00.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.135+0000 7ff54ffff640 1 --2- 172.21.15.17:0/2813918225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff550103440 0x7ff55019fd90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff54400c8a0 tx=0x7ff54400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:00.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.135+0000 7ff54dffb640 1 -- 172.21.15.17:0/2813918225 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff5440079b0 con 0x7ff550103440 2024-09-20T19:04:00.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.135+0000 7ff54dffb640 1 -- 172.21.15.17:0/2813918225 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff544007b50 con 0x7ff550103440 2024-09-20T19:04:00.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.135+0000 7ff556e9a640 1 -- 172.21.15.17:0/2813918225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff550199b30 con 0x7ff550103440 2024-09-20T19:04:00.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.135+0000 7ff54dffb640 1 -- 172.21.15.17:0/2813918225 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff544018700 con 0x7ff550103440 2024-09-20T19:04:00.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.136+0000 7ff556e9a640 1 -- 172.21.15.17:0/2813918225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff55019a090 con 0x7ff550103440 2024-09-20T19:04:00.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.137+0000 7ff556e9a640 1 -- 172.21.15.17:0/2813918225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff55006aa30 con 0x7ff550103440 2024-09-20T19:04:00.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.137+0000 7ff54dffb640 1 -- 172.21.15.17:0/2813918225 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff544007d00 con 0x7ff550103440 2024-09-20T19:04:00.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.138+0000 7ff54dffb640 1 --2- 172.21.15.17:0/2813918225 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff53807af30 0x7ff53807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:00.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.138+0000 7ff54dffb640 1 -- 172.21.15.17:0/2813918225 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7ff54409e310 con 0x7ff550103440 2024-09-20T19:04:00.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.138+0000 7ff554c36640 1 --2- 172.21.15.17:0/2813918225 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff53807af30 0x7ff53807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:00.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.138+0000 7ff554c36640 1 --2- 172.21.15.17:0/2813918225 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff53807af30 0x7ff53807d3f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff540009230 tx=0x7ff540009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:00.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.142+0000 7ff54dffb640 1 -- 172.21.15.17:0/2813918225 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff544014030 con 0x7ff550103440 2024-09-20T19:04:00.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:03:59 smithi172 ceph-mon[80431]: pgmap v858: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:00.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.348+0000 7ff556e9a640 1 -- 172.21.15.17:0/2813918225 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff55019afb0 con 0x7ff53807af30 2024-09-20T19:04:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.349+0000 7ff54dffb640 1 -- 172.21.15.17:0/2813918225 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff55019afb0 con 0x7ff53807af30 2024-09-20T19:04:00.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.351+0000 7ff556e9a640 1 -- 172.21.15.17:0/2813918225 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff53807af30 msgr2=0x7ff53807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:00.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.351+0000 7ff556e9a640 1 --2- 172.21.15.17:0/2813918225 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff53807af30 0x7ff53807d3f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff540009230 tx=0x7ff540009560 comp rx=0 tx=0).stop 2024-09-20T19:04:00.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.351+0000 7ff556e9a640 1 -- 172.21.15.17:0/2813918225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff550103440 msgr2=0x7ff55019fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:00.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.351+0000 7ff556e9a640 1 --2- 172.21.15.17:0/2813918225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff550103440 0x7ff55019fd90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff54400c8a0 tx=0x7ff54400cd60 comp rx=0 tx=0).stop 2024-09-20T19:04:00.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.351+0000 7ff556e9a640 1 -- 172.21.15.17:0/2813918225 shutdown_connections 2024-09-20T19:04:00.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.351+0000 7ff556e9a640 1 --2- 172.21.15.17:0/2813918225 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff53807af30 0x7ff53807d3f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.351+0000 7ff556e9a640 1 --2- 172.21.15.17:0/2813918225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff550103440 0x7ff55019fd90 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.351+0000 7ff556e9a640 1 --2- 172.21.15.17:0/2813918225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff550102b20 0x7ff55019f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.351+0000 7ff556e9a640 1 -- 172.21.15.17:0/2813918225 >> 172.21.15.17:0/2813918225 conn(0x7ff5500fc520 msgr2=0x7ff550100a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:00.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.352+0000 7ff556e9a640 1 -- 172.21.15.17:0/2813918225 shutdown_connections 2024-09-20T19:04:00.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.352+0000 7ff556e9a640 1 -- 172.21.15.17:0/2813918225 wait complete. 2024-09-20T19:04:00.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.435+0000 7fdc26dac640 1 -- 172.21.15.17:0/2815285695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc20102ac0 msgr2=0x7fdc20102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:00.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.435+0000 7fdc26dac640 1 --2- 172.21.15.17:0/2815285695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc20102ac0 0x7fdc20102ea0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009880 tx=0x7fdc1002a530 comp rx=0 tx=0).stop 2024-09-20T19:04:00.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.435+0000 7fdc26dac640 1 -- 172.21.15.17:0/2815285695 shutdown_connections 2024-09-20T19:04:00.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.435+0000 7fdc26dac640 1 --2- 172.21.15.17:0/2815285695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc201033e0 0x7fdc2010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.435+0000 7fdc26dac640 1 --2- 172.21.15.17:0/2815285695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc20102ac0 0x7fdc20102ea0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.435+0000 7fdc26dac640 1 -- 172.21.15.17:0/2815285695 >> 172.21.15.17:0/2815285695 conn(0x7fdc200fc520 msgr2=0x7fdc200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:00.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.435+0000 7fdc26dac640 1 -- 172.21.15.17:0/2815285695 shutdown_connections 2024-09-20T19:04:00.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.436+0000 7fdc26dac640 1 -- 172.21.15.17:0/2815285695 wait complete. 2024-09-20T19:04:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.436+0000 7fdc26dac640 1 Processor -- start 2024-09-20T19:04:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.436+0000 7fdc26dac640 1 -- start start 2024-09-20T19:04:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.436+0000 7fdc26dac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc20102ac0 0x7fdc2019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.436+0000 7fdc26dac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc201033e0 0x7fdc2019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.436+0000 7fdc26dac640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2010ee50 con 0x7fdc201033e0 2024-09-20T19:04:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.436+0000 7fdc26dac640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2010ecd0 con 0x7fdc20102ac0 2024-09-20T19:04:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.437+0000 7fdc1ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc201033e0 0x7fdc2019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.437+0000 7fdc1ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc201033e0 0x7fdc2019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48592/0 (socket says 172.21.15.17:48592) 2024-09-20T19:04:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.437+0000 7fdc1ffff640 1 -- 172.21.15.17:0/279886711 learned_addr learned my addr 172.21.15.17:0/279886711 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:04:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.437+0000 7fdc24b48640 1 --2- 172.21.15.17:0/279886711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc20102ac0 0x7fdc2019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.437+0000 7fdc1ffff640 1 -- 172.21.15.17:0/279886711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc20102ac0 msgr2=0x7fdc2019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.437+0000 7fdc1ffff640 1 --2- 172.21.15.17:0/279886711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc20102ac0 0x7fdc2019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.437+0000 7fdc1ffff640 1 -- 172.21.15.17:0/279886711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc20197860 con 0x7fdc201033e0 2024-09-20T19:04:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.437+0000 7fdc1ffff640 1 --2- 172.21.15.17:0/279886711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc201033e0 0x7fdc2019dbe0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400b370 tx=0x7fdc1400b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.437+0000 7fdc1dffb640 1 -- 172.21.15.17:0/279886711 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdc14015020 con 0x7fdc201033e0 2024-09-20T19:04:00.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.437+0000 7fdc1dffb640 1 -- 172.21.15.17:0/279886711 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdc14011af0 con 0x7fdc201033e0 2024-09-20T19:04:00.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.437+0000 7fdc1dffb640 1 -- 172.21.15.17:0/279886711 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdc14010d60 con 0x7fdc201033e0 2024-09-20T19:04:00.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.437+0000 7fdc26dac640 1 -- 172.21.15.17:0/279886711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc20197b50 con 0x7fdc201033e0 2024-09-20T19:04:00.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.438+0000 7fdc26dac640 1 -- 172.21.15.17:0/279886711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc201980e0 con 0x7fdc201033e0 2024-09-20T19:04:00.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.438+0000 7fdc26dac640 1 -- 172.21.15.17:0/279886711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc2006aa90 con 0x7fdc201033e0 2024-09-20T19:04:00.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.439+0000 7fdc1dffb640 1 -- 172.21.15.17:0/279886711 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdc14018020 con 0x7fdc201033e0 2024-09-20T19:04:00.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.439+0000 7fdc1dffb640 1 --2- 172.21.15.17:0/279886711 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdc0807af30 0x7fdc0807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:00.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.440+0000 7fdc1dffb640 1 -- 172.21.15.17:0/279886711 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fdc1409d940 con 0x7fdc201033e0 2024-09-20T19:04:00.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.440+0000 7fdc24b48640 1 --2- 172.21.15.17:0/279886711 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdc0807af30 0x7fdc0807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:00.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.440+0000 7fdc24b48640 1 --2- 172.21.15.17:0/279886711 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdc0807af30 0x7fdc0807d3f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fdc10031460 tx=0x7fdc10009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:00.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.444+0000 7fdc1dffb640 1 -- 172.21.15.17:0/279886711 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc1401f020 con 0x7fdc201033e0 2024-09-20T19:04:00.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.644+0000 7fdc26dac640 1 -- 172.21.15.17:0/279886711 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fdc201983f0 con 0x7fdc0807af30 2024-09-20T19:04:00.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.653+0000 7fdc1dffb640 1 -- 172.21.15.17:0/279886711 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fdc201983f0 con 0x7fdc0807af30 2024-09-20T19:04:00.659 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:04:00.660 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (25m) 4m ago 36m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:04:00.660 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (28m) 4m ago 36m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:04:00.660 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (27m) 4m ago 35m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:04:00.660 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (23m) 4m ago 36m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:04:00.660 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (23m) 4m ago 35m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:04:00.660 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (24m) 4m ago 36m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:04:00.660 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (19m) 4m ago 31m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:04:00.660 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (19m) 4m ago 31m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:04:00.660 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (4m) 4m ago 30m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:04:00.660 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (19m) 4m ago 31m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:04:00.660 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (27m) 4m ago 37m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:04:00.660 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (26m) 4m ago 35m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:04:00.660 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (24m) 4m ago 37m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:04:00.661 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (23m) 4m ago 35m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:04:00.661 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (26m) 4m ago 36m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:04:00.661 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (26m) 4m ago 35m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:04:00.661 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (23m) 4m ago 34m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:04:00.661 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (22m) 4m ago 33m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:04:00.661 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (21m) 4m ago 33m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:04:00.661 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (21m) 4m ago 32m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:04:00.661 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (20m) 4m ago 32m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:04:00.661 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (20m) 4m ago 32m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:04:00.661 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (25m) 4m ago 35m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:04:00.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.656+0000 7fdc26dac640 1 -- 172.21.15.17:0/279886711 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdc0807af30 msgr2=0x7fdc0807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:00.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.656+0000 7fdc26dac640 1 --2- 172.21.15.17:0/279886711 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdc0807af30 0x7fdc0807d3f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fdc10031460 tx=0x7fdc10009560 comp rx=0 tx=0).stop 2024-09-20T19:04:00.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.656+0000 7fdc26dac640 1 -- 172.21.15.17:0/279886711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc201033e0 msgr2=0x7fdc2019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:00.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.656+0000 7fdc26dac640 1 --2- 172.21.15.17:0/279886711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc201033e0 0x7fdc2019dbe0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400b370 tx=0x7fdc1400b830 comp rx=0 tx=0).stop 2024-09-20T19:04:00.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.656+0000 7fdc26dac640 1 -- 172.21.15.17:0/279886711 shutdown_connections 2024-09-20T19:04:00.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.656+0000 7fdc26dac640 1 --2- 172.21.15.17:0/279886711 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdc0807af30 0x7fdc0807d3f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.656+0000 7fdc26dac640 1 --2- 172.21.15.17:0/279886711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc201033e0 0x7fdc2019dbe0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.656+0000 7fdc26dac640 1 --2- 172.21.15.17:0/279886711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc20102ac0 0x7fdc2019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.656+0000 7fdc26dac640 1 -- 172.21.15.17:0/279886711 >> 172.21.15.17:0/279886711 conn(0x7fdc200fc520 msgr2=0x7fdc2010af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:00.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.656+0000 7fdc26dac640 1 -- 172.21.15.17:0/279886711 shutdown_connections 2024-09-20T19:04:00.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.656+0000 7fdc26dac640 1 -- 172.21.15.17:0/279886711 wait complete. 2024-09-20T19:04:00.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.739+0000 7f0293811640 1 -- 172.21.15.17:0/1264397219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f028c100800 msgr2=0x7f028c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:00.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.739+0000 7f0293811640 1 --2- 172.21.15.17:0/1264397219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f028c100800 0x7f028c100c60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f027c009880 tx=0x7f027c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.739+0000 7f0293811640 1 -- 172.21.15.17:0/1264397219 shutdown_connections 2024-09-20T19:04:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.739+0000 7f0293811640 1 --2- 172.21.15.17:0/1264397219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f028c100800 0x7f028c100c60 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.739+0000 7f0293811640 1 --2- 172.21.15.17:0/1264397219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f028c106800 0x7f028c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.739+0000 7f0293811640 1 -- 172.21.15.17:0/1264397219 >> 172.21.15.17:0/1264397219 conn(0x7f028c0fc520 msgr2=0x7f028c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.739+0000 7f0293811640 1 -- 172.21.15.17:0/1264397219 shutdown_connections 2024-09-20T19:04:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.739+0000 7f0293811640 1 -- 172.21.15.17:0/1264397219 wait complete. 2024-09-20T19:04:00.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.740+0000 7f0293811640 1 Processor -- start 2024-09-20T19:04:00.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.740+0000 7f0293811640 1 -- start start 2024-09-20T19:04:00.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.740+0000 7f0293811640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f028c100800 0x7f028c19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:00.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.740+0000 7f0293811640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f028c106800 0x7f028c19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:00.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.740+0000 7f0293811640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f028c10dcd0 con 0x7f028c100800 2024-09-20T19:04:00.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.740+0000 7f0293811640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f028c10db50 con 0x7f028c106800 2024-09-20T19:04:00.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.740+0000 7f02915ad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f028c100800 0x7f028c19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:00.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.740+0000 7f02915ad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f028c100800 0x7f028c19c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47888/0 (socket says 172.21.15.17:47888) 2024-09-20T19:04:00.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.740+0000 7f02915ad640 1 -- 172.21.15.17:0/3722320266 learned_addr learned my addr 172.21.15.17:0/3722320266 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:04:00.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.741+0000 7f02915ad640 1 -- 172.21.15.17:0/3722320266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f028c106800 msgr2=0x7f028c19cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:00.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.741+0000 7f0290dac640 1 --2- 172.21.15.17:0/3722320266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f028c106800 0x7f028c19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.741+0000 7f02915ad640 1 --2- 172.21.15.17:0/3722320266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f028c106800 0x7f028c19cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.741+0000 7f02915ad640 1 -- 172.21.15.17:0/3722320266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f028c1966e0 con 0x7f028c100800 2024-09-20T19:04:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.741+0000 7f02915ad640 1 --2- 172.21.15.17:0/3722320266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f028c100800 0x7f028c19c610 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f028800d6f0 tx=0x7f028800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.741+0000 7f02827fc640 1 -- 172.21.15.17:0/3722320266 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0288017070 con 0x7f028c100800 2024-09-20T19:04:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.741+0000 7f02827fc640 1 -- 172.21.15.17:0/3722320266 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f028800de00 con 0x7f028c100800 2024-09-20T19:04:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.741+0000 7f0293811640 1 -- 172.21.15.17:0/3722320266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f028c1969d0 con 0x7f028c100800 2024-09-20T19:04:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.741+0000 7f02827fc640 1 -- 172.21.15.17:0/3722320266 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0288004bb0 con 0x7f028c100800 2024-09-20T19:04:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.741+0000 7f0293811640 1 -- 172.21.15.17:0/3722320266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f028c196f30 con 0x7f028c100800 2024-09-20T19:04:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.742+0000 7f0293811640 1 -- 172.21.15.17:0/3722320266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f028c101f40 con 0x7f028c100800 2024-09-20T19:04:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.743+0000 7f02827fc640 1 -- 172.21.15.17:0/3722320266 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0288004e60 con 0x7f028c100800 2024-09-20T19:04:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.743+0000 7f02827fc640 1 --2- 172.21.15.17:0/3722320266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f027807af30 0x7f027807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.743+0000 7f02827fc640 1 -- 172.21.15.17:0/3722320266 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f028809dc50 con 0x7f028c100800 2024-09-20T19:04:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.743+0000 7f0290dac640 1 --2- 172.21.15.17:0/3722320266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f027807af30 0x7f027807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.744+0000 7f0290dac640 1 --2- 172.21.15.17:0/3722320266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f027807af30 0x7f027807d3f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f027c031460 tx=0x7f027c009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:00.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:00.748+0000 7f02827fc640 1 -- 172.21.15.17:0/3722320266 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0288069250 con 0x7f028c100800 2024-09-20T19:04:01.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.011+0000 7f0293811640 1 -- 172.21.15.17:0/3722320266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f028c108d70 con 0x7f028c100800 2024-09-20T19:04:01.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.011+0000 7f02827fc640 1 -- 172.21.15.17:0/3722320266 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f028806e100 con 0x7f028c100800 2024-09-20T19:04:01.017 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:04:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:04:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:04:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:04:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:04:01.017 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:04:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:04:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:04:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:04:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:04:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:04:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:04:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:04:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:04:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:04:01.018 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:04:01.018 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:04:01.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.014+0000 7f0293811640 1 -- 172.21.15.17:0/3722320266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f027807af30 msgr2=0x7f027807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:01.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.014+0000 7f0293811640 1 --2- 172.21.15.17:0/3722320266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f027807af30 0x7f027807d3f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f027c031460 tx=0x7f027c009560 comp rx=0 tx=0).stop 2024-09-20T19:04:01.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.014+0000 7f0293811640 1 -- 172.21.15.17:0/3722320266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f028c100800 msgr2=0x7f028c19c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:01.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.014+0000 7f0293811640 1 --2- 172.21.15.17:0/3722320266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f028c100800 0x7f028c19c610 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f028800d6f0 tx=0x7f028800dbb0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.014+0000 7f0293811640 1 -- 172.21.15.17:0/3722320266 shutdown_connections 2024-09-20T19:04:01.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.014+0000 7f0293811640 1 --2- 172.21.15.17:0/3722320266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f027807af30 0x7f027807d3f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.014+0000 7f0293811640 1 --2- 172.21.15.17:0/3722320266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f028c106800 0x7f028c19cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.014+0000 7f0293811640 1 --2- 172.21.15.17:0/3722320266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f028c100800 0x7f028c19c610 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.014+0000 7f0293811640 1 -- 172.21.15.17:0/3722320266 >> 172.21.15.17:0/3722320266 conn(0x7f028c0fc520 msgr2=0x7f028c0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:01.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.014+0000 7f0293811640 1 -- 172.21.15.17:0/3722320266 shutdown_connections 2024-09-20T19:04:01.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.014+0000 7f0293811640 1 -- 172.21.15.17:0/3722320266 wait complete. 2024-09-20T19:04:01.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.098+0000 7f2ecb97c640 1 -- 172.21.15.17:0/913219639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec41069a0 msgr2=0x7f2ec4106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:01.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.098+0000 7f2ecb97c640 1 --2- 172.21.15.17:0/913219639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec41069a0 0x7f2ec4106d80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009880 tx=0x7f2ebc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.098+0000 7f2ecb97c640 1 -- 172.21.15.17:0/913219639 shutdown_connections 2024-09-20T19:04:01.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.098+0000 7f2ecb97c640 1 --2- 172.21.15.17:0/913219639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec40ffdc0 0x7f2ec4100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.098+0000 7f2ecb97c640 1 --2- 172.21.15.17:0/913219639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec41069a0 0x7f2ec4106d80 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.098+0000 7f2ecb97c640 1 -- 172.21.15.17:0/913219639 >> 172.21.15.17:0/913219639 conn(0x7f2ec40fbc90 msgr2=0x7f2ec40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:01.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.098+0000 7f2ecb97c640 1 -- 172.21.15.17:0/913219639 shutdown_connections 2024-09-20T19:04:01.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.098+0000 7f2ecb97c640 1 -- 172.21.15.17:0/913219639 wait complete. 2024-09-20T19:04:01.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.099+0000 7f2ecb97c640 1 Processor -- start 2024-09-20T19:04:01.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.099+0000 7f2ecb97c640 1 -- start start 2024-09-20T19:04:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.099+0000 7f2ecb97c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec40ffdc0 0x7f2ec4100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.099+0000 7f2ecb97c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec41069a0 0x7f2ec41014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.099+0000 7f2ecb97c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec410efa0 con 0x7f2ec40ffdc0 2024-09-20T19:04:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.099+0000 7f2ecb97c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec410ee20 con 0x7f2ec41069a0 2024-09-20T19:04:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.099+0000 7f2ec9718640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec40ffdc0 0x7f2ec4100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.099+0000 7f2ec9718640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec40ffdc0 0x7f2ec4100fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47918/0 (socket says 172.21.15.17:47918) 2024-09-20T19:04:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.100+0000 7f2ec9718640 1 -- 172.21.15.17:0/2110874260 learned_addr learned my addr 172.21.15.17:0/2110874260 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:04:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.100+0000 7f2ec8f17640 1 --2- 172.21.15.17:0/2110874260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec41069a0 0x7f2ec41014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.100+0000 7f2ec9718640 1 -- 172.21.15.17:0/2110874260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec41069a0 msgr2=0x7f2ec41014e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:01.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.100+0000 7f2ec9718640 1 --2- 172.21.15.17:0/2110874260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec41069a0 0x7f2ec41014e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.100+0000 7f2ec9718640 1 -- 172.21.15.17:0/2110874260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec4101a20 con 0x7f2ec40ffdc0 2024-09-20T19:04:01.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.100+0000 7f2ec9718640 1 --2- 172.21.15.17:0/2110874260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec40ffdc0 0x7f2ec4100fa0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc031460 tx=0x7f2ebc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:01.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.100+0000 7f2ec27fc640 1 -- 172.21.15.17:0/2110874260 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ebc03f070 con 0x7f2ec40ffdc0 2024-09-20T19:04:01.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.100+0000 7f2ecb97c640 1 -- 172.21.15.17:0/2110874260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec4101cb0 con 0x7f2ec40ffdc0 2024-09-20T19:04:01.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.100+0000 7f2ec27fc640 1 -- 172.21.15.17:0/2110874260 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ebc004cf0 con 0x7f2ec40ffdc0 2024-09-20T19:04:01.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.100+0000 7f2ec27fc640 1 -- 172.21.15.17:0/2110874260 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ebc035030 con 0x7f2ec40ffdc0 2024-09-20T19:04:01.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.100+0000 7f2ecb97c640 1 -- 172.21.15.17:0/2110874260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec41a3ef0 con 0x7f2ec40ffdc0 2024-09-20T19:04:01.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.101+0000 7f2ecb97c640 1 -- 172.21.15.17:0/2110874260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec41030e0 con 0x7f2ec40ffdc0 2024-09-20T19:04:01.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.102+0000 7f2ec27fc640 1 -- 172.21.15.17:0/2110874260 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2ebc042070 con 0x7f2ec40ffdc0 2024-09-20T19:04:01.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.103+0000 7f2ec27fc640 1 --2- 172.21.15.17:0/2110874260 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2eac07af30 0x7f2eac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:01.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.103+0000 7f2ec8f17640 1 --2- 172.21.15.17:0/2110874260 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2eac07af30 0x7f2eac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:01.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.103+0000 7f2ec27fc640 1 -- 172.21.15.17:0/2110874260 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f2ebc0beba0 con 0x7f2ec40ffdc0 2024-09-20T19:04:01.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.103+0000 7f2ec8f17640 1 --2- 172.21.15.17:0/2110874260 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2eac07af30 0x7f2eac07d3f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4102a30 tx=0x7f2eb8008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:01.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.107+0000 7f2ec27fc640 1 -- 172.21.15.17:0/2110874260 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ebc08a100 con 0x7f2ec40ffdc0 2024-09-20T19:04:01.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.339+0000 7f2ecb97c640 1 -- 172.21.15.17:0/2110874260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f2ec41024d0 con 0x7f2ec40ffdc0 2024-09-20T19:04:01.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.340+0000 7f2ec27fc640 1 -- 172.21.15.17:0/2110874260 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7f2ebc08efb0 con 0x7f2ec40ffdc0 2024-09-20T19:04:01.346 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:04:01.346 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:04:01.346 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:04:01.346 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:04:01.346 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:04:01.346 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:04:01.346 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:04:01.347 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:04:01.347 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:04:01.347 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:04:01.347 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:04:01.347 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:04:01.347 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:04:01.347 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:04:01.347 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:04:01.347 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:04:01.347 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:04:01.347 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:04:01.347 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:04:01.347 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:04:01.347 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:04:01.348 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:04:01.348 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:04:01.348 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:04:01.348 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:04:01.348 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:04:01.348 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:04:01.348 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:04:01.348 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:04:01.348 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:04:01.348 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:04:01.348 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:04:01.348 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:04:01.348 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:04:01.349 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:04:01.349 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:04:01.349 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:04:01.349 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:04:01.349 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:04:01.349 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:04:01.349 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:04:01.349 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:04:01.349 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:04:01.350 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:04:01.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.342+0000 7f2ecb97c640 1 -- 172.21.15.17:0/2110874260 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2eac07af30 msgr2=0x7f2eac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:01.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.342+0000 7f2ecb97c640 1 --2- 172.21.15.17:0/2110874260 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2eac07af30 0x7f2eac07d3f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4102a30 tx=0x7f2eb8008040 comp rx=0 tx=0).stop 2024-09-20T19:04:01.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.342+0000 7f2ecb97c640 1 -- 172.21.15.17:0/2110874260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec40ffdc0 msgr2=0x7f2ec4100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:01.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.342+0000 7f2ecb97c640 1 --2- 172.21.15.17:0/2110874260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec40ffdc0 0x7f2ec4100fa0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc031460 tx=0x7f2ebc0048f0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.342+0000 7f2ecb97c640 1 -- 172.21.15.17:0/2110874260 shutdown_connections 2024-09-20T19:04:01.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.342+0000 7f2ecb97c640 1 --2- 172.21.15.17:0/2110874260 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2eac07af30 0x7f2eac07d3f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.342+0000 7f2ecb97c640 1 --2- 172.21.15.17:0/2110874260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec41069a0 0x7f2ec41014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.342+0000 7f2ecb97c640 1 --2- 172.21.15.17:0/2110874260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ec40ffdc0 0x7f2ec4100fa0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.342+0000 7f2ecb97c640 1 -- 172.21.15.17:0/2110874260 >> 172.21.15.17:0/2110874260 conn(0x7f2ec40fbc90 msgr2=0x7f2ec40fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:01.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.343+0000 7f2ecb97c640 1 -- 172.21.15.17:0/2110874260 shutdown_connections 2024-09-20T19:04:01.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.343+0000 7f2ecb97c640 1 -- 172.21.15.17:0/2110874260 wait complete. 2024-09-20T19:04:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.428+0000 7f3961c78640 1 -- 172.21.15.17:0/1742243987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f395c107900 msgr2=0x7f395c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.428+0000 7f3961c78640 1 --2- 172.21.15.17:0/1742243987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f395c107900 0x7f395c107ce0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f394c009880 tx=0x7f394c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.428+0000 7f3961c78640 1 -- 172.21.15.17:0/1742243987 shutdown_connections 2024-09-20T19:04:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.428+0000 7f3961c78640 1 --2- 172.21.15.17:0/1742243987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f395c101900 0x7f395c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.428+0000 7f3961c78640 1 --2- 172.21.15.17:0/1742243987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f395c107900 0x7f395c107ce0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.428+0000 7f3961c78640 1 -- 172.21.15.17:0/1742243987 >> 172.21.15.17:0/1742243987 conn(0x7f395c0fd600 msgr2=0x7f395c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.428+0000 7f3961c78640 1 -- 172.21.15.17:0/1742243987 shutdown_connections 2024-09-20T19:04:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.428+0000 7f3961c78640 1 -- 172.21.15.17:0/1742243987 wait complete. 2024-09-20T19:04:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.429+0000 7f3961c78640 1 Processor -- start 2024-09-20T19:04:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.429+0000 7f3961c78640 1 -- start start 2024-09-20T19:04:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.429+0000 7f3961c78640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f395c101900 0x7f395c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.429+0000 7f3961c78640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f395c107900 0x7f395c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.429+0000 7f3961c78640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f395c10edb0 con 0x7f395c107900 2024-09-20T19:04:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.429+0000 7f3961c78640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f395c10ec30 con 0x7f395c101900 2024-09-20T19:04:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.429+0000 7f3953fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f395c107900 0x7f395c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.429+0000 7f3953fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f395c107900 0x7f395c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47942/0 (socket says 172.21.15.17:47942) 2024-09-20T19:04:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.429+0000 7f3953fff640 1 -- 172.21.15.17:0/2923729564 learned_addr learned my addr 172.21.15.17:0/2923729564 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:04:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.429+0000 7f395b7fe640 1 --2- 172.21.15.17:0/2923729564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f395c101900 0x7f395c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.429+0000 7f3953fff640 1 -- 172.21.15.17:0/2923729564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f395c101900 msgr2=0x7f395c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.429+0000 7f3953fff640 1 --2- 172.21.15.17:0/2923729564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f395c101900 0x7f395c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.429+0000 7f3953fff640 1 -- 172.21.15.17:0/2923729564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395c074f70 con 0x7f395c107900 2024-09-20T19:04:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.430+0000 7f395b7fe640 1 --2- 172.21.15.17:0/2923729564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f395c101900 0x7f395c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:04:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.430+0000 7f3953fff640 1 --2- 172.21.15.17:0/2923729564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f395c107900 0x7f395c074a30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f394400c8a0 tx=0x7f394400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.430+0000 7f39597fa640 1 -- 172.21.15.17:0/2923729564 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39440079b0 con 0x7f395c107900 2024-09-20T19:04:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.430+0000 7f3961c78640 1 -- 172.21.15.17:0/2923729564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f395c075260 con 0x7f395c107900 2024-09-20T19:04:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.430+0000 7f39597fa640 1 -- 172.21.15.17:0/2923729564 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3944007b50 con 0x7f395c107900 2024-09-20T19:04:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.430+0000 7f39597fa640 1 -- 172.21.15.17:0/2923729564 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3944018700 con 0x7f395c107900 2024-09-20T19:04:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.430+0000 7f3961c78640 1 -- 172.21.15.17:0/2923729564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f395c1a3e00 con 0x7f395c107900 2024-09-20T19:04:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.431+0000 7f3961c78640 1 -- 172.21.15.17:0/2923729564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f395c103040 con 0x7f395c107900 2024-09-20T19:04:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.432+0000 7f39597fa640 1 -- 172.21.15.17:0/2923729564 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3944007d00 con 0x7f395c107900 2024-09-20T19:04:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.432+0000 7f39597fa640 1 --2- 172.21.15.17:0/2923729564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f394807af30 0x7f394807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.432+0000 7f39597fa640 1 -- 172.21.15.17:0/2923729564 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f394409e280 con 0x7f395c107900 2024-09-20T19:04:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.432+0000 7f395b7fe640 1 --2- 172.21.15.17:0/2923729564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f394807af30 0x7f394807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.433+0000 7f395b7fe640 1 --2- 172.21.15.17:0/2923729564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f394807af30 0x7f394807d3f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f394c006010 tx=0x7f394c0095f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:01.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.437+0000 7f39597fa640 1 -- 172.21.15.17:0/2923729564 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3944014030 con 0x7f395c107900 2024-09-20T19:04:01.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.646+0000 7f3961c78640 1 -- 172.21.15.17:0/2923729564 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f395c104b80 con 0x7f394807af30 2024-09-20T19:04:01.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.648+0000 7f39597fa640 1 -- 172.21.15.17:0/2923729564 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f394c004440 con 0x7f394807af30 2024-09-20T19:04:01.653 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:04:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:04:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:04:01.653 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:04:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:04:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:04:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:04:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:04:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:04:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:04:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:04:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:04:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:04:01.654 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:04:01.654 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:04:01.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.650+0000 7f3961c78640 1 -- 172.21.15.17:0/2923729564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f394807af30 msgr2=0x7f394807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:01.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.650+0000 7f3961c78640 1 --2- 172.21.15.17:0/2923729564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f394807af30 0x7f394807d3f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f394c006010 tx=0x7f394c0095f0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.650+0000 7f3961c78640 1 -- 172.21.15.17:0/2923729564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f395c107900 msgr2=0x7f395c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:01.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.650+0000 7f3961c78640 1 --2- 172.21.15.17:0/2923729564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f395c107900 0x7f395c074a30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f394400c8a0 tx=0x7f394400cd60 comp rx=0 tx=0).stop 2024-09-20T19:04:01.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.650+0000 7f3961c78640 1 -- 172.21.15.17:0/2923729564 shutdown_connections 2024-09-20T19:04:01.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.650+0000 7f3961c78640 1 --2- 172.21.15.17:0/2923729564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f394807af30 0x7f394807d3f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.650+0000 7f3961c78640 1 --2- 172.21.15.17:0/2923729564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f395c107900 0x7f395c074a30 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.650+0000 7f3961c78640 1 --2- 172.21.15.17:0/2923729564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f395c101900 0x7f395c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.650+0000 7f3961c78640 1 -- 172.21.15.17:0/2923729564 >> 172.21.15.17:0/2923729564 conn(0x7f395c0fd600 msgr2=0x7f395c0fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:01.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.650+0000 7f3961c78640 1 -- 172.21.15.17:0/2923729564 shutdown_connections 2024-09-20T19:04:01.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.650+0000 7f3961c78640 1 -- 172.21.15.17:0/2923729564 wait complete. 2024-09-20T19:04:01.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.735+0000 7f84be58d640 1 -- 172.21.15.17:0/2757128291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b81067f0 msgr2=0x7f84b8106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:01.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.735+0000 7f84be58d640 1 --2- 172.21.15.17:0/2757128291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b81067f0 0x7f84b8106bd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009880 tx=0x7f84a802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.735+0000 7f84be58d640 1 -- 172.21.15.17:0/2757128291 shutdown_connections 2024-09-20T19:04:01.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.735+0000 7f84be58d640 1 --2- 172.21.15.17:0/2757128291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b81007f0 0x7f84b8100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.735+0000 7f84be58d640 1 --2- 172.21.15.17:0/2757128291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b81067f0 0x7f84b8106bd0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.735+0000 7f84be58d640 1 -- 172.21.15.17:0/2757128291 >> 172.21.15.17:0/2757128291 conn(0x7f84b80fc550 msgr2=0x7f84b80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:01.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.735+0000 7f84be58d640 1 -- 172.21.15.17:0/2757128291 shutdown_connections 2024-09-20T19:04:01.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.735+0000 7f84be58d640 1 -- 172.21.15.17:0/2757128291 wait complete. 2024-09-20T19:04:01.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.735+0000 7f84be58d640 1 Processor -- start 2024-09-20T19:04:01.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.735+0000 7f84be58d640 1 -- start start 2024-09-20T19:04:01.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.736+0000 7f84be58d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b81007f0 0x7f84b8107720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:01.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.736+0000 7f84be58d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b81067f0 0x7f84b8107c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:01.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.736+0000 7f84be58d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f84b810dca0 con 0x7f84b81007f0 2024-09-20T19:04:01.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.736+0000 7f84be58d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f84b810db20 con 0x7f84b81067f0 2024-09-20T19:04:01.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.736+0000 7f84b7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b81007f0 0x7f84b8107720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:01.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.736+0000 7f84b7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b81007f0 0x7f84b8107720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47958/0 (socket says 172.21.15.17:47958) 2024-09-20T19:04:01.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.736+0000 7f84b7fff640 1 -- 172.21.15.17:0/2979161906 learned_addr learned my addr 172.21.15.17:0/2979161906 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:04:01.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.736+0000 7f84b77fe640 1 --2- 172.21.15.17:0/2979161906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b81067f0 0x7f84b8107c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:01.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.736+0000 7f84b7fff640 1 -- 172.21.15.17:0/2979161906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b81067f0 msgr2=0x7f84b8107c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:01.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.736+0000 7f84b7fff640 1 --2- 172.21.15.17:0/2979161906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b81067f0 0x7f84b8107c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:01.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.736+0000 7f84b7fff640 1 -- 172.21.15.17:0/2979161906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b81081a0 con 0x7f84b81007f0 2024-09-20T19:04:01.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.736+0000 7f84b7fff640 1 --2- 172.21.15.17:0/2979161906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b81007f0 0x7f84b8107720 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f84a8031460 tx=0x7f84a80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:01.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.736+0000 7f84b57fa640 1 -- 172.21.15.17:0/2979161906 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84a803f070 con 0x7f84b81007f0 2024-09-20T19:04:01.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.737+0000 7f84be58d640 1 -- 172.21.15.17:0/2979161906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b8108430 con 0x7f84b81007f0 2024-09-20T19:04:01.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.737+0000 7f84b57fa640 1 -- 172.21.15.17:0/2979161906 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f84a80035f0 con 0x7f84b81007f0 2024-09-20T19:04:01.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.737+0000 7f84b57fa640 1 -- 172.21.15.17:0/2979161906 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84a8035030 con 0x7f84b81007f0 2024-09-20T19:04:01.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.737+0000 7f84be58d640 1 -- 172.21.15.17:0/2979161906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b81a3d10 con 0x7f84b81007f0 2024-09-20T19:04:01.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.738+0000 7f84be58d640 1 -- 172.21.15.17:0/2979161906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b8101f30 con 0x7f84b81007f0 2024-09-20T19:04:01.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.738+0000 7f84b57fa640 1 -- 172.21.15.17:0/2979161906 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f84a8042070 con 0x7f84b81007f0 2024-09-20T19:04:01.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.739+0000 7f84b57fa640 1 --2- 172.21.15.17:0/2979161906 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f84a007af80 0x7f84a007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:01.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.739+0000 7f84b57fa640 1 -- 172.21.15.17:0/2979161906 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f84a80be860 con 0x7f84b81007f0 2024-09-20T19:04:01.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.739+0000 7f84b77fe640 1 --2- 172.21.15.17:0/2979161906 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f84a007af80 0x7f84a007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:01.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.740+0000 7f84b77fe640 1 --2- 172.21.15.17:0/2979161906 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f84a007af80 0x7f84a007d440 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f84b81091b0 tx=0x7f84ac00b410 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:01.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:01.743+0000 7f84b57fa640 1 -- 172.21.15.17:0/2979161906 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f84a8089ee0 con 0x7f84b81007f0 2024-09-20T19:04:01.956 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:01 smithi017 ceph-mon[108970]: from='client.35380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:01.956 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:01 smithi017 ceph-mon[108970]: from='client.35384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:01.956 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:01 smithi017 ceph-mon[108970]: from='client.35388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:01.956 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:01 smithi017 ceph-mon[108970]: pgmap v859: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:01.956 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:01 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3722320266' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:04:01.956 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:01 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2110874260' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:04:02.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:02.008+0000 7f84be58d640 1 -- 172.21.15.17:0/2979161906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f84b81a4060 con 0x7f84b81007f0 2024-09-20T19:04:02.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:02.008+0000 7f84b57fa640 1 -- 172.21.15.17:0/2979161906 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f84a808ed90 con 0x7f84b81007f0 2024-09-20T19:04:02.015 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:04:02.015 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:04:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:04:02.015 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:04:02.015 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:04:02.015 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:04:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:04:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:04:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:04:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:04:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:04:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:04:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:04:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:04:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:04:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:04:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:04:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:04:02.017 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:04:02.018 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:04:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:04:02.018 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:04:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:04:02.018 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:04:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:04:02.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:02.010+0000 7f84be58d640 1 -- 172.21.15.17:0/2979161906 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f84a007af80 msgr2=0x7f84a007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:02.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:02.010+0000 7f84be58d640 1 --2- 172.21.15.17:0/2979161906 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f84a007af80 0x7f84a007d440 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f84b81091b0 tx=0x7f84ac00b410 comp rx=0 tx=0).stop 2024-09-20T19:04:02.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:02.010+0000 7f84be58d640 1 -- 172.21.15.17:0/2979161906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b81007f0 msgr2=0x7f84b8107720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:02.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:02.010+0000 7f84be58d640 1 --2- 172.21.15.17:0/2979161906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b81007f0 0x7f84b8107720 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f84a8031460 tx=0x7f84a80045e0 comp rx=0 tx=0).stop 2024-09-20T19:04:02.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:02.010+0000 7f84be58d640 1 -- 172.21.15.17:0/2979161906 shutdown_connections 2024-09-20T19:04:02.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:02.010+0000 7f84be58d640 1 --2- 172.21.15.17:0/2979161906 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f84a007af80 0x7f84a007d440 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:02.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:02.010+0000 7f84be58d640 1 --2- 172.21.15.17:0/2979161906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b81067f0 0x7f84b8107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:02.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:02.010+0000 7f84be58d640 1 --2- 172.21.15.17:0/2979161906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b81007f0 0x7f84b8107720 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:02.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:02.010+0000 7f84be58d640 1 -- 172.21.15.17:0/2979161906 >> 172.21.15.17:0/2979161906 conn(0x7f84b80fc550 msgr2=0x7f84b8069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:02.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:02.010+0000 7f84be58d640 1 -- 172.21.15.17:0/2979161906 shutdown_connections 2024-09-20T19:04:02.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:02.010+0000 7f84be58d640 1 -- 172.21.15.17:0/2979161906 wait complete. 2024-09-20T19:04:02.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:01 smithi172 ceph-mon[80431]: from='client.35380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:02.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:01 smithi172 ceph-mon[80431]: from='client.35384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:02.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:01 smithi172 ceph-mon[80431]: from='client.35388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:02.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:01 smithi172 ceph-mon[80431]: pgmap v859: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:02.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:01 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3722320266' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:04:02.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:01 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2110874260' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:04:03.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:02 smithi017 ceph-mon[108970]: from='client.35400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:03.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:02 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2979161906' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:04:03.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:02 smithi172 ceph-mon[80431]: from='client.35400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:03.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:02 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2979161906' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:04:04.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:03 smithi017 ceph-mon[108970]: pgmap v860: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:04.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:03 smithi172 ceph-mon[80431]: pgmap v860: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:06.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:05 smithi017 ceph-mon[108970]: pgmap v861: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:06.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:05 smithi172 ceph-mon[80431]: pgmap v861: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:07.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:07 smithi017 ceph-mon[108970]: pgmap v862: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:07.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:04:08.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:07 smithi172 ceph-mon[80431]: pgmap v862: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:08.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:04:10.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:09 smithi017 ceph-mon[108970]: pgmap v863: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:10.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:09 smithi172 ceph-mon[80431]: pgmap v863: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:11.957 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:11 smithi017 ceph-mon[108970]: pgmap v864: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:12.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:11 smithi172 ceph-mon[80431]: pgmap v864: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:13.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:13 smithi017 ceph-mon[108970]: pgmap v865: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:14.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:13 smithi172 ceph-mon[80431]: pgmap v865: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:16.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:15 smithi017 ceph-mon[108970]: pgmap v866: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:16.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:15 smithi172 ceph-mon[80431]: pgmap v866: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:18.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:17 smithi017 ceph-mon[108970]: pgmap v867: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:18.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:17 smithi172 ceph-mon[80431]: pgmap v867: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:19.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:19 smithi017 ceph-mon[108970]: pgmap v868: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:20.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:19 smithi172 ceph-mon[80431]: pgmap v868: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:22.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:21 smithi017 ceph-mon[108970]: pgmap v869: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:22.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:21 smithi172 ceph-mon[80431]: pgmap v869: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:22.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:04:23.102 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:04:24.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:23 smithi017 ceph-mon[108970]: pgmap v870: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:24.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:23 smithi172 ceph-mon[80431]: pgmap v870: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:26.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:25 smithi017 ceph-mon[108970]: pgmap v871: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:26.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:25 smithi172 ceph-mon[80431]: pgmap v871: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:28.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:27 smithi017 ceph-mon[108970]: pgmap v872: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:28.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:27 smithi172 ceph-mon[80431]: pgmap v872: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:29.950 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:29 smithi172 ceph-mon[80431]: pgmap v873: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:30.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:29 smithi017 ceph-mon[108970]: pgmap v873: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:32.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.104+0000 7fe83fd07640 1 -- 172.21.15.17:0/1017912652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8381067f0 msgr2=0x7fe838106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:32.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.104+0000 7fe83fd07640 1 --2- 172.21.15.17:0/1017912652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8381067f0 0x7fe838106bd0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe828009c20 tx=0x7fe82802a970 comp rx=0 tx=0).stop 2024-09-20T19:04:32.111 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:31 smithi017 ceph-mon[108970]: pgmap v874: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.104+0000 7fe83fd07640 1 -- 172.21.15.17:0/1017912652 shutdown_connections 2024-09-20T19:04:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.104+0000 7fe83fd07640 1 --2- 172.21.15.17:0/1017912652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8381007f0 0x7fe838100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.104+0000 7fe83fd07640 1 --2- 172.21.15.17:0/1017912652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8381067f0 0x7fe838106bd0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.104+0000 7fe83fd07640 1 -- 172.21.15.17:0/1017912652 >> 172.21.15.17:0/1017912652 conn(0x7fe8380fc550 msgr2=0x7fe8380fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.104+0000 7fe83fd07640 1 -- 172.21.15.17:0/1017912652 shutdown_connections 2024-09-20T19:04:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.104+0000 7fe83fd07640 1 -- 172.21.15.17:0/1017912652 wait complete. 2024-09-20T19:04:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.105+0000 7fe83fd07640 1 Processor -- start 2024-09-20T19:04:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.105+0000 7fe83fd07640 1 -- start start 2024-09-20T19:04:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.105+0000 7fe83fd07640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8381007f0 0x7fe83819f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.105+0000 7fe83fd07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8381067f0 0x7fe83819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.105+0000 7fe83fd07640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe83810dca0 con 0x7fe8381007f0 2024-09-20T19:04:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.105+0000 7fe83fd07640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe83810db20 con 0x7fe8381067f0 2024-09-20T19:04:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.105+0000 7fe83daa3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8381007f0 0x7fe83819f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.105+0000 7fe83daa3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8381007f0 0x7fe83819f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36814/0 (socket says 172.21.15.17:36814) 2024-09-20T19:04:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.105+0000 7fe83daa3640 1 -- 172.21.15.17:0/2344243582 learned_addr learned my addr 172.21.15.17:0/2344243582 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:04:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.105+0000 7fe83d2a2640 1 --2- 172.21.15.17:0/2344243582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8381067f0 0x7fe83819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.106+0000 7fe83daa3640 1 -- 172.21.15.17:0/2344243582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8381067f0 msgr2=0x7fe83819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.106+0000 7fe83daa3640 1 --2- 172.21.15.17:0/2344243582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8381067f0 0x7fe83819fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.106+0000 7fe83daa3640 1 -- 172.21.15.17:0/2344243582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8381a0380 con 0x7fe8381007f0 2024-09-20T19:04:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.106+0000 7fe83daa3640 1 --2- 172.21.15.17:0/2344243582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8381007f0 0x7fe83819f790 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe828005cc0 tx=0x7fe82802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.106+0000 7fe836ffd640 1 -- 172.21.15.17:0/2344243582 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe828047070 con 0x7fe8381007f0 2024-09-20T19:04:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.106+0000 7fe836ffd640 1 -- 172.21.15.17:0/2344243582 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe82802f7e0 con 0x7fe8381007f0 2024-09-20T19:04:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.106+0000 7fe83fd07640 1 -- 172.21.15.17:0/2344243582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe838199a10 con 0x7fe8381007f0 2024-09-20T19:04:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.106+0000 7fe836ffd640 1 -- 172.21.15.17:0/2344243582 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe828034070 con 0x7fe8381007f0 2024-09-20T19:04:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.106+0000 7fe83fd07640 1 -- 172.21.15.17:0/2344243582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe838199f10 con 0x7fe8381007f0 2024-09-20T19:04:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.107+0000 7fe83fd07640 1 -- 172.21.15.17:0/2344243582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe838101f30 con 0x7fe8381007f0 2024-09-20T19:04:32.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.108+0000 7fe836ffd640 1 -- 172.21.15.17:0/2344243582 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe82804a070 con 0x7fe8381007f0 2024-09-20T19:04:32.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.109+0000 7fe836ffd640 1 --2- 172.21.15.17:0/2344243582 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe82007af30 0x7fe82007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:32.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.109+0000 7fe836ffd640 1 -- 172.21.15.17:0/2344243582 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fe8280bee40 con 0x7fe8381007f0 2024-09-20T19:04:32.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.109+0000 7fe83d2a2640 1 --2- 172.21.15.17:0/2344243582 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe82007af30 0x7fe82007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:32.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.109+0000 7fe83d2a2640 1 --2- 172.21.15.17:0/2344243582 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe82007af30 0x7fe82007d3f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe8380ffb60 tx=0x7fe82c00a2d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.113+0000 7fe836ffd640 1 -- 172.21.15.17:0/2344243582 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe82803f070 con 0x7fe8381007f0 2024-09-20T19:04:32.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:31 smithi172 ceph-mon[80431]: pgmap v874: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:32.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.323+0000 7fe83fd07640 1 -- 172.21.15.17:0/2344243582 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe83819a2f0 con 0x7fe82007af30 2024-09-20T19:04:32.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.324+0000 7fe836ffd640 1 -- 172.21.15.17:0/2344243582 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe83819a2f0 con 0x7fe82007af30 2024-09-20T19:04:32.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.327+0000 7fe83fd07640 1 -- 172.21.15.17:0/2344243582 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe82007af30 msgr2=0x7fe82007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:32.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.327+0000 7fe83fd07640 1 --2- 172.21.15.17:0/2344243582 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe82007af30 0x7fe82007d3f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe8380ffb60 tx=0x7fe82c00a2d0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.327+0000 7fe83fd07640 1 -- 172.21.15.17:0/2344243582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8381007f0 msgr2=0x7fe83819f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:32.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.327+0000 7fe83fd07640 1 --2- 172.21.15.17:0/2344243582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8381007f0 0x7fe83819f790 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe828005cc0 tx=0x7fe82802f5f0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.327+0000 7fe83fd07640 1 -- 172.21.15.17:0/2344243582 shutdown_connections 2024-09-20T19:04:32.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.327+0000 7fe83fd07640 1 --2- 172.21.15.17:0/2344243582 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe82007af30 0x7fe82007d3f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.327+0000 7fe83fd07640 1 --2- 172.21.15.17:0/2344243582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8381067f0 0x7fe83819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.327+0000 7fe83fd07640 1 --2- 172.21.15.17:0/2344243582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8381007f0 0x7fe83819f790 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.327+0000 7fe83fd07640 1 -- 172.21.15.17:0/2344243582 >> 172.21.15.17:0/2344243582 conn(0x7fe8380fc550 msgr2=0x7fe838069dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:32.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.327+0000 7fe83fd07640 1 -- 172.21.15.17:0/2344243582 shutdown_connections 2024-09-20T19:04:32.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.327+0000 7fe83fd07640 1 -- 172.21.15.17:0/2344243582 wait complete. 2024-09-20T19:04:32.342 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:04:32.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.415+0000 7f7641450640 1 -- 172.21.15.17:0/3728637117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763c1067f0 msgr2=0x7f763c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.415+0000 7f7641450640 1 --2- 172.21.15.17:0/3728637117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763c1067f0 0x7f763c106bd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f762c009880 tx=0x7f762c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.415+0000 7f7641450640 1 -- 172.21.15.17:0/3728637117 shutdown_connections 2024-09-20T19:04:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.415+0000 7f7641450640 1 --2- 172.21.15.17:0/3728637117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f763c1007f0 0x7f763c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.415+0000 7f7641450640 1 --2- 172.21.15.17:0/3728637117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763c1067f0 0x7f763c106bd0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.415+0000 7f7641450640 1 -- 172.21.15.17:0/3728637117 >> 172.21.15.17:0/3728637117 conn(0x7f763c0fc550 msgr2=0x7f763c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.415+0000 7f7641450640 1 -- 172.21.15.17:0/3728637117 shutdown_connections 2024-09-20T19:04:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.415+0000 7f7641450640 1 -- 172.21.15.17:0/3728637117 wait complete. 2024-09-20T19:04:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.415+0000 7f7641450640 1 Processor -- start 2024-09-20T19:04:32.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.416+0000 7f7641450640 1 -- start start 2024-09-20T19:04:32.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.416+0000 7f7641450640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763c1007f0 0x7f763c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:32.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.416+0000 7f7641450640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f763c1067f0 0x7f763c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:32.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.416+0000 7f7641450640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f763c10dca0 con 0x7f763c1007f0 2024-09-20T19:04:32.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.416+0000 7f7641450640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f763c10db20 con 0x7f763c1067f0 2024-09-20T19:04:32.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.416+0000 7f763affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763c1007f0 0x7f763c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:32.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.416+0000 7f763affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763c1007f0 0x7f763c19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36824/0 (socket says 172.21.15.17:36824) 2024-09-20T19:04:32.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.416+0000 7f763affd640 1 -- 172.21.15.17:0/1873311924 learned_addr learned my addr 172.21.15.17:0/1873311924 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:04:32.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.416+0000 7f763a7fc640 1 --2- 172.21.15.17:0/1873311924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f763c1067f0 0x7f763c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:32.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.416+0000 7f763affd640 1 -- 172.21.15.17:0/1873311924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f763c1067f0 msgr2=0x7f763c19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:32.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.416+0000 7f763affd640 1 --2- 172.21.15.17:0/1873311924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f763c1067f0 0x7f763c19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.416+0000 7f763affd640 1 -- 172.21.15.17:0/1873311924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f763c197750 con 0x7f763c1007f0 2024-09-20T19:04:32.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.416+0000 7f763affd640 1 --2- 172.21.15.17:0/1873311924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763c1007f0 0x7f763c19d680 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f762c031460 tx=0x7f762c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:32.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.417+0000 7f7623fff640 1 -- 172.21.15.17:0/1873311924 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f762c03f070 con 0x7f763c1007f0 2024-09-20T19:04:32.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.417+0000 7f7623fff640 1 -- 172.21.15.17:0/1873311924 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f762c0035f0 con 0x7f763c1007f0 2024-09-20T19:04:32.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.417+0000 7f7641450640 1 -- 172.21.15.17:0/1873311924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f763c1979e0 con 0x7f763c1007f0 2024-09-20T19:04:32.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.417+0000 7f7623fff640 1 -- 172.21.15.17:0/1873311924 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f762c035030 con 0x7f763c1007f0 2024-09-20T19:04:32.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.417+0000 7f7641450640 1 -- 172.21.15.17:0/1873311924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f763c197ee0 con 0x7f763c1007f0 2024-09-20T19:04:32.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.418+0000 7f7641450640 1 -- 172.21.15.17:0/1873311924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f763c101f30 con 0x7f763c1007f0 2024-09-20T19:04:32.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.418+0000 7f7623fff640 1 -- 172.21.15.17:0/1873311924 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f762c042070 con 0x7f763c1007f0 2024-09-20T19:04:32.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.419+0000 7f7623fff640 1 --2- 172.21.15.17:0/1873311924 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f762407af30 0x7f762407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:32.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.419+0000 7f7623fff640 1 -- 172.21.15.17:0/1873311924 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f762c0be970 con 0x7f763c1007f0 2024-09-20T19:04:32.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.419+0000 7f763a7fc640 1 --2- 172.21.15.17:0/1873311924 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f762407af30 0x7f762407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:32.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.419+0000 7f763a7fc640 1 --2- 172.21.15.17:0/1873311924 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f762407af30 0x7f762407d3f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f763c198fa0 tx=0x7f763000b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:32.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.423+0000 7f7623fff640 1 -- 172.21.15.17:0/1873311924 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f762c0c0e20 con 0x7f763c1007f0 2024-09-20T19:04:32.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.628+0000 7f7641450640 1 -- 172.21.15.17:0/1873311924 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f763c198250 con 0x7f762407af30 2024-09-20T19:04:32.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.629+0000 7f7623fff640 1 -- 172.21.15.17:0/1873311924 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f763c198250 con 0x7f762407af30 2024-09-20T19:04:32.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.631+0000 7f7641450640 1 -- 172.21.15.17:0/1873311924 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f762407af30 msgr2=0x7f762407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:32.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.631+0000 7f7641450640 1 --2- 172.21.15.17:0/1873311924 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f762407af30 0x7f762407d3f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f763c198fa0 tx=0x7f763000b390 comp rx=0 tx=0).stop 2024-09-20T19:04:32.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.631+0000 7f7641450640 1 -- 172.21.15.17:0/1873311924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763c1007f0 msgr2=0x7f763c19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:32.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.631+0000 7f7641450640 1 --2- 172.21.15.17:0/1873311924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763c1007f0 0x7f763c19d680 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f762c031460 tx=0x7f762c0045e0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.631+0000 7f7641450640 1 -- 172.21.15.17:0/1873311924 shutdown_connections 2024-09-20T19:04:32.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.631+0000 7f7641450640 1 --2- 172.21.15.17:0/1873311924 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f762407af30 0x7f762407d3f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.631+0000 7f7641450640 1 --2- 172.21.15.17:0/1873311924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f763c1067f0 0x7f763c19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.631+0000 7f7641450640 1 --2- 172.21.15.17:0/1873311924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763c1007f0 0x7f763c19d680 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.631+0000 7f7641450640 1 -- 172.21.15.17:0/1873311924 >> 172.21.15.17:0/1873311924 conn(0x7f763c0fc550 msgr2=0x7f763c069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:32.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.631+0000 7f7641450640 1 -- 172.21.15.17:0/1873311924 shutdown_connections 2024-09-20T19:04:32.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.631+0000 7f7641450640 1 -- 172.21.15.17:0/1873311924 wait complete. 2024-09-20T19:04:32.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.716+0000 7f06c60b1640 1 -- 172.21.15.17:0/2072404689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c0100800 msgr2=0x7f06c0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:32.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.716+0000 7f06c60b1640 1 --2- 172.21.15.17:0/2072404689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c0100800 0x7f06c0100c60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f06b4009880 tx=0x7f06b402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.716+0000 7f06c60b1640 1 -- 172.21.15.17:0/2072404689 shutdown_connections 2024-09-20T19:04:32.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.716+0000 7f06c60b1640 1 --2- 172.21.15.17:0/2072404689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c0100800 0x7f06c0100c60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.716+0000 7f06c60b1640 1 --2- 172.21.15.17:0/2072404689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06c0106800 0x7f06c0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.716+0000 7f06c60b1640 1 -- 172.21.15.17:0/2072404689 >> 172.21.15.17:0/2072404689 conn(0x7f06c00fc520 msgr2=0x7f06c00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:32.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.716+0000 7f06c60b1640 1 -- 172.21.15.17:0/2072404689 shutdown_connections 2024-09-20T19:04:32.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.716+0000 7f06c60b1640 1 -- 172.21.15.17:0/2072404689 wait complete. 2024-09-20T19:04:32.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.717+0000 7f06c60b1640 1 Processor -- start 2024-09-20T19:04:32.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.717+0000 7f06c60b1640 1 -- start start 2024-09-20T19:04:32.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.717+0000 7f06c60b1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c0100800 0x7f06c019f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:32.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.717+0000 7f06c60b1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06c0106800 0x7f06c019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:32.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.717+0000 7f06c60b1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f06c010dcd0 con 0x7f06c0100800 2024-09-20T19:04:32.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.717+0000 7f06c60b1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f06c010db50 con 0x7f06c0106800 2024-09-20T19:04:32.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.717+0000 7f06bf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c0100800 0x7f06c019f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:32.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.717+0000 7f06bf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c0100800 0x7f06c019f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36830/0 (socket says 172.21.15.17:36830) 2024-09-20T19:04:32.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.717+0000 7f06bf7fe640 1 -- 172.21.15.17:0/3185849266 learned_addr learned my addr 172.21.15.17:0/3185849266 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:04:32.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.717+0000 7f06beffd640 1 --2- 172.21.15.17:0/3185849266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06c0106800 0x7f06c019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:32.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.718+0000 7f06bf7fe640 1 -- 172.21.15.17:0/3185849266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06c0106800 msgr2=0x7f06c019fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:32.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.718+0000 7f06bf7fe640 1 --2- 172.21.15.17:0/3185849266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06c0106800 0x7f06c019fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.718+0000 7f06bf7fe640 1 -- 172.21.15.17:0/3185849266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c01999e0 con 0x7f06c0100800 2024-09-20T19:04:32.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.718+0000 7f06bf7fe640 1 --2- 172.21.15.17:0/3185849266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c0100800 0x7f06c019f820 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f06b000d6f0 tx=0x7f06b000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:32.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.718+0000 7f06bcff9640 1 -- 172.21.15.17:0/3185849266 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06b0017070 con 0x7f06c0100800 2024-09-20T19:04:32.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.718+0000 7f06bcff9640 1 -- 172.21.15.17:0/3185849266 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06b000de00 con 0x7f06c0100800 2024-09-20T19:04:32.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.718+0000 7f06c60b1640 1 -- 172.21.15.17:0/3185849266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c0199cd0 con 0x7f06c0100800 2024-09-20T19:04:32.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.718+0000 7f06bcff9640 1 -- 172.21.15.17:0/3185849266 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06b0004bb0 con 0x7f06c0100800 2024-09-20T19:04:32.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.718+0000 7f06c60b1640 1 -- 172.21.15.17:0/3185849266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c019a230 con 0x7f06c0100800 2024-09-20T19:04:32.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.719+0000 7f06c60b1640 1 -- 172.21.15.17:0/3185849266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06c0101f40 con 0x7f06c0100800 2024-09-20T19:04:32.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.720+0000 7f06bcff9640 1 -- 172.21.15.17:0/3185849266 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f06b0004e60 con 0x7f06c0100800 2024-09-20T19:04:32.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.721+0000 7f06bcff9640 1 --2- 172.21.15.17:0/3185849266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06a807af30 0x7f06a807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:32.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.721+0000 7f06bcff9640 1 -- 172.21.15.17:0/3185849266 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f06b009dba0 con 0x7f06c0100800 2024-09-20T19:04:32.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.721+0000 7f06beffd640 1 --2- 172.21.15.17:0/3185849266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06a807af30 0x7f06a807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:32.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.721+0000 7f06beffd640 1 --2- 172.21.15.17:0/3185849266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06a807af30 0x7f06a807d3f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f06c019b1d0 tx=0x7f06b4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:32.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.725+0000 7f06bcff9640 1 -- 172.21.15.17:0/3185849266 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f06b00691a0 con 0x7f06c0100800 2024-09-20T19:04:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.923+0000 7f06c60b1640 1 -- 172.21.15.17:0/3185849266 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f06c019a4e0 con 0x7f06a807af30 2024-09-20T19:04:32.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.933+0000 7f06bcff9640 1 -- 172.21.15.17:0/3185849266 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f06c019a4e0 con 0x7f06a807af30 2024-09-20T19:04:32.939 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:04:32.939 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (25m) 4m ago 36m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:04:32.939 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (29m) 4m ago 37m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:04:32.939 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (28m) 4m ago 36m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:04:32.940 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (24m) 4m ago 37m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:04:32.940 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (24m) 4m ago 36m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:04:32.940 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (25m) 4m ago 36m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:04:32.940 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (20m) 4m ago 31m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:04:32.940 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (20m) 4m ago 31m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:04:32.940 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (4m) 4m ago 31m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:04:32.940 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (19m) 4m ago 31m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:04:32.940 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (28m) 4m ago 38m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:04:32.940 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (27m) 4m ago 36m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:04:32.940 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (24m) 4m ago 38m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:04:32.940 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (24m) 4m ago 36m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:04:32.940 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (26m) 4m ago 37m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:04:32.940 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (26m) 4m ago 36m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:04:32.941 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (23m) 4m ago 34m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:04:32.941 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (23m) 4m ago 34m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:04:32.941 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (22m) 4m ago 33m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:04:32.941 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (21m) 4m ago 33m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:04:32.941 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (21m) 4m ago 33m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:04:32.941 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (20m) 4m ago 32m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:04:32.941 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (26m) 4m ago 36m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:04:32.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.935+0000 7f06c60b1640 1 -- 172.21.15.17:0/3185849266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06a807af30 msgr2=0x7f06a807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:32.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.935+0000 7f06c60b1640 1 --2- 172.21.15.17:0/3185849266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06a807af30 0x7f06a807d3f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f06c019b1d0 tx=0x7f06b4031400 comp rx=0 tx=0).stop 2024-09-20T19:04:32.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.935+0000 7f06c60b1640 1 -- 172.21.15.17:0/3185849266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c0100800 msgr2=0x7f06c019f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:32.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.935+0000 7f06c60b1640 1 --2- 172.21.15.17:0/3185849266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c0100800 0x7f06c019f820 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f06b000d6f0 tx=0x7f06b000dbb0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.935+0000 7f06c60b1640 1 -- 172.21.15.17:0/3185849266 shutdown_connections 2024-09-20T19:04:32.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.935+0000 7f06c60b1640 1 --2- 172.21.15.17:0/3185849266 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f06a807af30 0x7f06a807d3f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.935+0000 7f06c60b1640 1 --2- 172.21.15.17:0/3185849266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06c0106800 0x7f06c019fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.935+0000 7f06c60b1640 1 --2- 172.21.15.17:0/3185849266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06c0100800 0x7f06c019f820 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:32.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.935+0000 7f06c60b1640 1 -- 172.21.15.17:0/3185849266 >> 172.21.15.17:0/3185849266 conn(0x7f06c00fc520 msgr2=0x7f06c00fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:32.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.936+0000 7f06c60b1640 1 -- 172.21.15.17:0/3185849266 shutdown_connections 2024-09-20T19:04:32.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:32.936+0000 7f06c60b1640 1 -- 172.21.15.17:0/3185849266 wait complete. 2024-09-20T19:04:33.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.018+0000 7f3d451a0640 1 -- 172.21.15.17:0/966519479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d401007f0 msgr2=0x7f3d40100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:33.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.018+0000 7f3d451a0640 1 --2- 172.21.15.17:0/966519479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d401007f0 0x7f3d40100c50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3d28009c20 tx=0x7f3d2802a970 comp rx=0 tx=0).stop 2024-09-20T19:04:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.018+0000 7f3d451a0640 1 -- 172.21.15.17:0/966519479 shutdown_connections 2024-09-20T19:04:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.018+0000 7f3d451a0640 1 --2- 172.21.15.17:0/966519479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d401007f0 0x7f3d40100c50 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.018+0000 7f3d451a0640 1 --2- 172.21.15.17:0/966519479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d401067f0 0x7f3d40106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.018+0000 7f3d451a0640 1 -- 172.21.15.17:0/966519479 >> 172.21.15.17:0/966519479 conn(0x7f3d400fc550 msgr2=0x7f3d400fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.019+0000 7f3d451a0640 1 -- 172.21.15.17:0/966519479 shutdown_connections 2024-09-20T19:04:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.019+0000 7f3d451a0640 1 -- 172.21.15.17:0/966519479 wait complete. 2024-09-20T19:04:33.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.019+0000 7f3d451a0640 1 Processor -- start 2024-09-20T19:04:33.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.020+0000 7f3d451a0640 1 -- start start 2024-09-20T19:04:33.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.020+0000 7f3d451a0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d401007f0 0x7f3d400fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:33.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.020+0000 7f3d451a0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d401067f0 0x7f3d400fd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:33.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.020+0000 7f3d451a0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4010dcc0 con 0x7f3d401067f0 2024-09-20T19:04:33.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.020+0000 7f3d451a0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4010db40 con 0x7f3d401007f0 2024-09-20T19:04:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.020+0000 7f3d3e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d401067f0 0x7f3d400fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.020+0000 7f3d3e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d401067f0 0x7f3d400fd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36836/0 (socket says 172.21.15.17:36836) 2024-09-20T19:04:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.020+0000 7f3d3ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d401007f0 0x7f3d400fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.020+0000 7f3d3e59c640 1 -- 172.21.15.17:0/3873928904 learned_addr learned my addr 172.21.15.17:0/3873928904 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:04:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.021+0000 7f3d3e59c640 1 -- 172.21.15.17:0/3873928904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d401007f0 msgr2=0x7f3d400fccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.021+0000 7f3d3e59c640 1 --2- 172.21.15.17:0/3873928904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d401007f0 0x7f3d400fccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.021+0000 7f3d3e59c640 1 -- 172.21.15.17:0/3873928904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d400fd750 con 0x7f3d401067f0 2024-09-20T19:04:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.021+0000 7f3d3ed9d640 1 --2- 172.21.15.17:0/3873928904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d401007f0 0x7f3d400fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T19:04:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.021+0000 7f3d3e59c640 1 --2- 172.21.15.17:0/3873928904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d401067f0 0x7f3d400fd210 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3d2802ae90 tx=0x7f3d2802fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.021+0000 7f3d37fff640 1 -- 172.21.15.17:0/3873928904 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d28047070 con 0x7f3d401067f0 2024-09-20T19:04:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.021+0000 7f3d451a0640 1 -- 172.21.15.17:0/3873928904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d400fd9e0 con 0x7f3d401067f0 2024-09-20T19:04:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.021+0000 7f3d37fff640 1 -- 172.21.15.17:0/3873928904 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3d28003e30 con 0x7f3d401067f0 2024-09-20T19:04:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.021+0000 7f3d37fff640 1 -- 172.21.15.17:0/3873928904 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d28034070 con 0x7f3d401067f0 2024-09-20T19:04:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.021+0000 7f3d451a0640 1 -- 172.21.15.17:0/3873928904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d401a3da0 con 0x7f3d401067f0 2024-09-20T19:04:33.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.022+0000 7f3d451a0640 1 -- 172.21.15.17:0/3873928904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d40101f30 con 0x7f3d401067f0 2024-09-20T19:04:33.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.023+0000 7f3d37fff640 1 -- 172.21.15.17:0/3873928904 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3d2804a070 con 0x7f3d401067f0 2024-09-20T19:04:33.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.024+0000 7f3d37fff640 1 --2- 172.21.15.17:0/3873928904 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3d2c07af80 0x7f3d2c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:33.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.024+0000 7f3d37fff640 1 -- 172.21.15.17:0/3873928904 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f3d280beb60 con 0x7f3d401067f0 2024-09-20T19:04:33.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.024+0000 7f3d3ed9d640 1 --2- 172.21.15.17:0/3873928904 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3d2c07af80 0x7f3d2c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:33.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.024+0000 7f3d3ed9d640 1 --2- 172.21.15.17:0/3873928904 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3d2c07af80 0x7f3d2c07d440 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009fc0 tx=0x7f3d30005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:33.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.028+0000 7f3d37fff640 1 -- 172.21.15.17:0/3873928904 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3d2803f070 con 0x7f3d401067f0 2024-09-20T19:04:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.291+0000 7f3d451a0640 1 -- 172.21.15.17:0/3873928904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3d40109da0 con 0x7f3d401067f0 2024-09-20T19:04:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.292+0000 7f3d37fff640 1 -- 172.21.15.17:0/3873928904 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f3d2808a1e0 con 0x7f3d401067f0 2024-09-20T19:04:33.299 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:04:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:04:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:04:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:04:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:04:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:04:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:04:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:04:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:04:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:04:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:04:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:04:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:04:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:04:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:04:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:04:33.300 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:04:33.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.294+0000 7f3d451a0640 1 -- 172.21.15.17:0/3873928904 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3d2c07af80 msgr2=0x7f3d2c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:33.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.294+0000 7f3d451a0640 1 --2- 172.21.15.17:0/3873928904 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3d2c07af80 0x7f3d2c07d440 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009fc0 tx=0x7f3d30005f90 comp rx=0 tx=0).stop 2024-09-20T19:04:33.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.295+0000 7f3d451a0640 1 -- 172.21.15.17:0/3873928904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d401067f0 msgr2=0x7f3d400fd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:33.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.295+0000 7f3d451a0640 1 --2- 172.21.15.17:0/3873928904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d401067f0 0x7f3d400fd210 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3d2802ae90 tx=0x7f3d2802fd60 comp rx=0 tx=0).stop 2024-09-20T19:04:33.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.295+0000 7f3d451a0640 1 -- 172.21.15.17:0/3873928904 shutdown_connections 2024-09-20T19:04:33.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.295+0000 7f3d451a0640 1 --2- 172.21.15.17:0/3873928904 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3d2c07af80 0x7f3d2c07d440 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.295+0000 7f3d451a0640 1 --2- 172.21.15.17:0/3873928904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d401067f0 0x7f3d400fd210 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.295+0000 7f3d451a0640 1 --2- 172.21.15.17:0/3873928904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d401007f0 0x7f3d400fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.295+0000 7f3d451a0640 1 -- 172.21.15.17:0/3873928904 >> 172.21.15.17:0/3873928904 conn(0x7f3d400fc550 msgr2=0x7f3d40069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:33.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.295+0000 7f3d451a0640 1 -- 172.21.15.17:0/3873928904 shutdown_connections 2024-09-20T19:04:33.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.295+0000 7f3d451a0640 1 -- 172.21.15.17:0/3873928904 wait complete. 2024-09-20T19:04:33.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.378+0000 7ff280c19640 1 -- 172.21.15.17:0/2042502265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff27c102ac0 msgr2=0x7ff27c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:33.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.378+0000 7ff280c19640 1 --2- 172.21.15.17:0/2042502265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff27c102ac0 0x7ff27c102ea0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009880 tx=0x7ff26c02a540 comp rx=0 tx=0).stop 2024-09-20T19:04:33.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.378+0000 7ff280c19640 1 -- 172.21.15.17:0/2042502265 shutdown_connections 2024-09-20T19:04:33.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.378+0000 7ff280c19640 1 --2- 172.21.15.17:0/2042502265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff27c1033e0 0x7ff27c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.378+0000 7ff280c19640 1 --2- 172.21.15.17:0/2042502265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff27c102ac0 0x7ff27c102ea0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.378+0000 7ff280c19640 1 -- 172.21.15.17:0/2042502265 >> 172.21.15.17:0/2042502265 conn(0x7ff27c0fc520 msgr2=0x7ff27c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:33.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.378+0000 7ff280c19640 1 -- 172.21.15.17:0/2042502265 shutdown_connections 2024-09-20T19:04:33.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.378+0000 7ff280c19640 1 -- 172.21.15.17:0/2042502265 wait complete. 2024-09-20T19:04:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.379+0000 7ff280c19640 1 Processor -- start 2024-09-20T19:04:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.379+0000 7ff280c19640 1 -- start start 2024-09-20T19:04:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.379+0000 7ff280c19640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff27c102ac0 0x7ff27c19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.379+0000 7ff280c19640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff27c1033e0 0x7ff27c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.379+0000 7ff280c19640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c10edd0 con 0x7ff27c102ac0 2024-09-20T19:04:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.379+0000 7ff280c19640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c10ec50 con 0x7ff27c1033e0 2024-09-20T19:04:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.379+0000 7ff27a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff27c102ac0 0x7ff27c19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.379+0000 7ff27a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff27c102ac0 0x7ff27c19f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36848/0 (socket says 172.21.15.17:36848) 2024-09-20T19:04:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.379+0000 7ff27a59c640 1 -- 172.21.15.17:0/3640694115 learned_addr learned my addr 172.21.15.17:0/3640694115 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:04:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.379+0000 7ff279d9b640 1 --2- 172.21.15.17:0/3640694115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff27c1033e0 0x7ff27c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.380+0000 7ff27a59c640 1 -- 172.21.15.17:0/3640694115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff27c1033e0 msgr2=0x7ff27c19fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.380+0000 7ff27a59c640 1 --2- 172.21.15.17:0/3640694115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff27c1033e0 0x7ff27c19fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.380+0000 7ff27a59c640 1 -- 172.21.15.17:0/3640694115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27c1a03f0 con 0x7ff27c102ac0 2024-09-20T19:04:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.380+0000 7ff27a59c640 1 --2- 172.21.15.17:0/3640694115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff27c102ac0 0x7ff27c19f800 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff26c031460 tx=0x7ff26c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.380+0000 7ff26b7fe640 1 -- 172.21.15.17:0/3640694115 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff26c03f070 con 0x7ff27c102ac0 2024-09-20T19:04:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.380+0000 7ff26b7fe640 1 -- 172.21.15.17:0/3640694115 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff26c004cf0 con 0x7ff27c102ac0 2024-09-20T19:04:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.380+0000 7ff280c19640 1 -- 172.21.15.17:0/3640694115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27c199ad0 con 0x7ff27c102ac0 2024-09-20T19:04:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.380+0000 7ff26b7fe640 1 -- 172.21.15.17:0/3640694115 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff26c035030 con 0x7ff27c102ac0 2024-09-20T19:04:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.380+0000 7ff280c19640 1 -- 172.21.15.17:0/3640694115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff27c199fd0 con 0x7ff27c102ac0 2024-09-20T19:04:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.382+0000 7ff280c19640 1 -- 172.21.15.17:0/3640694115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff27c06aa90 con 0x7ff27c102ac0 2024-09-20T19:04:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.382+0000 7ff26b7fe640 1 -- 172.21.15.17:0/3640694115 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff26c042070 con 0x7ff27c102ac0 2024-09-20T19:04:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.382+0000 7ff26b7fe640 1 --2- 172.21.15.17:0/3640694115 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff26407af30 0x7ff26407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.383+0000 7ff26b7fe640 1 -- 172.21.15.17:0/3640694115 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7ff26c0bea10 con 0x7ff27c102ac0 2024-09-20T19:04:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.383+0000 7ff279d9b640 1 --2- 172.21.15.17:0/3640694115 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff26407af30 0x7ff26407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:33.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.383+0000 7ff279d9b640 1 --2- 172.21.15.17:0/3640694115 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff26407af30 0x7ff26407d3f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0fee80 tx=0x7ff27000a250 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:33.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.387+0000 7ff26b7fe640 1 -- 172.21.15.17:0/3640694115 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff26c08a010 con 0x7ff27c102ac0 2024-09-20T19:04:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.613+0000 7ff280c19640 1 -- 172.21.15.17:0/3640694115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff27c19aef0 con 0x7ff27c102ac0 2024-09-20T19:04:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.614+0000 7ff26b7fe640 1 -- 172.21.15.17:0/3640694115 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7ff26c08eec0 con 0x7ff27c102ac0 2024-09-20T19:04:33.621 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:04:33.621 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:04:33.621 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:04:33.621 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:04:33.621 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:04:33.621 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:04:33.621 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:04:33.621 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:04:33.621 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:04:33.621 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:04:33.621 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:04:33.622 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:04:33.622 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:04:33.622 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:04:33.622 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:04:33.622 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:04:33.622 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:04:33.622 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:04:33.622 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:04:33.622 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:04:33.622 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:04:33.622 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:04:33.622 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:04:33.623 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:04:33.623 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:04:33.623 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:04:33.623 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:04:33.623 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:04:33.623 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:04:33.623 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:04:33.623 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:04:33.623 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:04:33.623 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:04:33.623 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:04:33.623 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:04:33.623 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:04:33.624 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:04:33.624 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:04:33.624 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:04:33.624 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:04:33.624 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:04:33.624 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:04:33.624 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:04:33.625 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:04:33.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.616+0000 7ff280c19640 1 -- 172.21.15.17:0/3640694115 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff26407af30 msgr2=0x7ff26407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:33.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.616+0000 7ff280c19640 1 --2- 172.21.15.17:0/3640694115 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff26407af30 0x7ff26407d3f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0fee80 tx=0x7ff27000a250 comp rx=0 tx=0).stop 2024-09-20T19:04:33.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.616+0000 7ff280c19640 1 -- 172.21.15.17:0/3640694115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff27c102ac0 msgr2=0x7ff27c19f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:33.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.616+0000 7ff280c19640 1 --2- 172.21.15.17:0/3640694115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff27c102ac0 0x7ff27c19f800 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff26c031460 tx=0x7ff26c0048f0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.616+0000 7ff280c19640 1 -- 172.21.15.17:0/3640694115 shutdown_connections 2024-09-20T19:04:33.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.616+0000 7ff280c19640 1 --2- 172.21.15.17:0/3640694115 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff26407af30 0x7ff26407d3f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.616+0000 7ff280c19640 1 --2- 172.21.15.17:0/3640694115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff27c1033e0 0x7ff27c19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.616+0000 7ff280c19640 1 --2- 172.21.15.17:0/3640694115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff27c102ac0 0x7ff27c19f800 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.616+0000 7ff280c19640 1 -- 172.21.15.17:0/3640694115 >> 172.21.15.17:0/3640694115 conn(0x7ff27c0fc520 msgr2=0x7ff27c100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:33.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.616+0000 7ff280c19640 1 -- 172.21.15.17:0/3640694115 shutdown_connections 2024-09-20T19:04:33.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.616+0000 7ff280c19640 1 -- 172.21.15.17:0/3640694115 wait complete. 2024-09-20T19:04:33.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.703+0000 7ffa41fe8640 1 -- 172.21.15.17:0/1240875281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa3c106800 msgr2=0x7ffa3c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:33.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.703+0000 7ffa41fe8640 1 --2- 172.21.15.17:0/1240875281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa3c106800 0x7ffa3c106be0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c009880 tx=0x7ffa2c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.704+0000 7ffa41fe8640 1 -- 172.21.15.17:0/1240875281 shutdown_connections 2024-09-20T19:04:33.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.704+0000 7ffa41fe8640 1 --2- 172.21.15.17:0/1240875281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa3c100800 0x7ffa3c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.704+0000 7ffa41fe8640 1 --2- 172.21.15.17:0/1240875281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa3c106800 0x7ffa3c106be0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.704+0000 7ffa41fe8640 1 -- 172.21.15.17:0/1240875281 >> 172.21.15.17:0/1240875281 conn(0x7ffa3c0fc520 msgr2=0x7ffa3c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:33.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.704+0000 7ffa41fe8640 1 -- 172.21.15.17:0/1240875281 shutdown_connections 2024-09-20T19:04:33.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.704+0000 7ffa41fe8640 1 -- 172.21.15.17:0/1240875281 wait complete. 2024-09-20T19:04:33.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.704+0000 7ffa41fe8640 1 Processor -- start 2024-09-20T19:04:33.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.704+0000 7ffa41fe8640 1 -- start start 2024-09-20T19:04:33.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.705+0000 7ffa41fe8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa3c100800 0x7ffa3c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:33.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.705+0000 7ffa41fe8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa3c106800 0x7ffa3c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:33.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.705+0000 7ffa41fe8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c10dcb0 con 0x7ffa3c100800 2024-09-20T19:04:33.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.705+0000 7ffa41fe8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c10db30 con 0x7ffa3c106800 2024-09-20T19:04:33.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.705+0000 7ffa3b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa3c100800 0x7ffa3c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:33.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.705+0000 7ffa3b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa3c100800 0x7ffa3c19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36864/0 (socket says 172.21.15.17:36864) 2024-09-20T19:04:33.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.705+0000 7ffa3b7fe640 1 -- 172.21.15.17:0/2651746684 learned_addr learned my addr 172.21.15.17:0/2651746684 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:04:33.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.705+0000 7ffa3affd640 1 --2- 172.21.15.17:0/2651746684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa3c106800 0x7ffa3c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:33.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.705+0000 7ffa3b7fe640 1 -- 172.21.15.17:0/2651746684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa3c106800 msgr2=0x7ffa3c19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:33.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.705+0000 7ffa3b7fe640 1 --2- 172.21.15.17:0/2651746684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa3c106800 0x7ffa3c19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.705+0000 7ffa3b7fe640 1 -- 172.21.15.17:0/2651746684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3c197820 con 0x7ffa3c100800 2024-09-20T19:04:33.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.705+0000 7ffa3affd640 1 --2- 172.21.15.17:0/2651746684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa3c106800 0x7ffa3c19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:04:33.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.705+0000 7ffa3b7fe640 1 --2- 172.21.15.17:0/2651746684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa3c100800 0x7ffa3c19d6a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c031460 tx=0x7ffa2c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:33.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.706+0000 7ffa38ff9640 1 -- 172.21.15.17:0/2651746684 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa2c03f070 con 0x7ffa3c100800 2024-09-20T19:04:33.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.706+0000 7ffa38ff9640 1 -- 172.21.15.17:0/2651746684 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa2c0044d0 con 0x7ffa3c100800 2024-09-20T19:04:33.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.706+0000 7ffa38ff9640 1 -- 172.21.15.17:0/2651746684 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa2c035030 con 0x7ffa3c100800 2024-09-20T19:04:33.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.706+0000 7ffa41fe8640 1 -- 172.21.15.17:0/2651746684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa3c197ab0 con 0x7ffa3c100800 2024-09-20T19:04:33.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.706+0000 7ffa41fe8640 1 -- 172.21.15.17:0/2651746684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa3c197fe0 con 0x7ffa3c100800 2024-09-20T19:04:33.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.707+0000 7ffa41fe8640 1 -- 172.21.15.17:0/2651746684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa3c101f40 con 0x7ffa3c100800 2024-09-20T19:04:33.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.707+0000 7ffa38ff9640 1 -- 172.21.15.17:0/2651746684 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ffa2c042070 con 0x7ffa3c100800 2024-09-20T19:04:33.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.708+0000 7ffa38ff9640 1 --2- 172.21.15.17:0/2651746684 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa2407af40 0x7ffa2407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:33.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.708+0000 7ffa38ff9640 1 -- 172.21.15.17:0/2651746684 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7ffa2c0beb70 con 0x7ffa3c100800 2024-09-20T19:04:33.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.708+0000 7ffa3affd640 1 --2- 172.21.15.17:0/2651746684 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa2407af40 0x7ffa2407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:33.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.708+0000 7ffa3affd640 1 --2- 172.21.15.17:0/2651746684 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa2407af40 0x7ffa2407d400 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0ffb10 tx=0x7ffa30005ec0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:33.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.712+0000 7ffa38ff9640 1 -- 172.21.15.17:0/2651746684 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffa2c004cf0 con 0x7ffa3c100800 2024-09-20T19:04:33.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:33 smithi017 ceph-mon[108970]: from='client.35408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:33.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:33 smithi017 ceph-mon[108970]: from='client.35412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:33.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:33 smithi017 ceph-mon[108970]: pgmap v875: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:33.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:33 smithi017 ceph-mon[108970]: from='client.35416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:33.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:33 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3873928904' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:04:33.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:33 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3640694115' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:04:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.920+0000 7ffa41fe8640 1 -- 172.21.15.17:0/2651746684 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ffa3c198d50 con 0x7ffa2407af40 2024-09-20T19:04:33.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.922+0000 7ffa38ff9640 1 -- 172.21.15.17:0/2651746684 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ffa3c198d50 con 0x7ffa2407af40 2024-09-20T19:04:33.928 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:04:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:04:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:04:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:04:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:04:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:04:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:04:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:04:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:04:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:04:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:04:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:04:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:04:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:04:33.929 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:04:33.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.924+0000 7ffa41fe8640 1 -- 172.21.15.17:0/2651746684 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa2407af40 msgr2=0x7ffa2407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.924+0000 7ffa41fe8640 1 --2- 172.21.15.17:0/2651746684 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa2407af40 0x7ffa2407d400 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0ffb10 tx=0x7ffa30005ec0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.924+0000 7ffa41fe8640 1 -- 172.21.15.17:0/2651746684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa3c100800 msgr2=0x7ffa3c19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.924+0000 7ffa41fe8640 1 --2- 172.21.15.17:0/2651746684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa3c100800 0x7ffa3c19d6a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c031460 tx=0x7ffa2c0048f0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.924+0000 7ffa41fe8640 1 -- 172.21.15.17:0/2651746684 shutdown_connections 2024-09-20T19:04:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.924+0000 7ffa41fe8640 1 --2- 172.21.15.17:0/2651746684 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa2407af40 0x7ffa2407d400 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.924+0000 7ffa41fe8640 1 --2- 172.21.15.17:0/2651746684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa3c106800 0x7ffa3c19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.924+0000 7ffa41fe8640 1 --2- 172.21.15.17:0/2651746684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa3c100800 0x7ffa3c19d6a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.924+0000 7ffa41fe8640 1 -- 172.21.15.17:0/2651746684 >> 172.21.15.17:0/2651746684 conn(0x7ffa3c0fc520 msgr2=0x7ffa3c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.924+0000 7ffa41fe8640 1 -- 172.21.15.17:0/2651746684 shutdown_connections 2024-09-20T19:04:33.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:33.924+0000 7ffa41fe8640 1 -- 172.21.15.17:0/2651746684 wait complete. 2024-09-20T19:04:34.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.008+0000 7f9041a8c640 1 -- 172.21.15.17:0/4152932082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c107900 msgr2=0x7f903c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:34.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.008+0000 7f9041a8c640 1 --2- 172.21.15.17:0/4152932082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c107900 0x7f903c107ce0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f902c009c20 tx=0x7f902c02a970 comp rx=0 tx=0).stop 2024-09-20T19:04:34.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.008+0000 7f9041a8c640 1 -- 172.21.15.17:0/4152932082 shutdown_connections 2024-09-20T19:04:34.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.008+0000 7f9041a8c640 1 --2- 172.21.15.17:0/4152932082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903c101900 0x7f903c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:34.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.008+0000 7f9041a8c640 1 --2- 172.21.15.17:0/4152932082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c107900 0x7f903c107ce0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:34.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.008+0000 7f9041a8c640 1 -- 172.21.15.17:0/4152932082 >> 172.21.15.17:0/4152932082 conn(0x7f903c0fd600 msgr2=0x7f903c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:34.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.008+0000 7f9041a8c640 1 -- 172.21.15.17:0/4152932082 shutdown_connections 2024-09-20T19:04:34.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.008+0000 7f9041a8c640 1 -- 172.21.15.17:0/4152932082 wait complete. 2024-09-20T19:04:34.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.008+0000 7f9041a8c640 1 Processor -- start 2024-09-20T19:04:34.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.009+0000 7f9041a8c640 1 -- start start 2024-09-20T19:04:34.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.009+0000 7f9041a8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c101900 0x7f903c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:34.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.009+0000 7f9041a8c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903c107900 0x7f903c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:34.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.009+0000 7f9041a8c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f903c10ee30 con 0x7f903c101900 2024-09-20T19:04:34.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.009+0000 7f9041a8c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f903c10ecb0 con 0x7f903c107900 2024-09-20T19:04:34.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.009+0000 7f903b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c101900 0x7f903c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:34.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.009+0000 7f903b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c101900 0x7f903c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36882/0 (socket says 172.21.15.17:36882) 2024-09-20T19:04:34.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.009+0000 7f903b7fe640 1 -- 172.21.15.17:0/1158825821 learned_addr learned my addr 172.21.15.17:0/1158825821 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:04:34.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.009+0000 7f903affd640 1 --2- 172.21.15.17:0/1158825821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903c107900 0x7f903c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:34.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.009+0000 7f903b7fe640 1 -- 172.21.15.17:0/1158825821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903c107900 msgr2=0x7f903c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:34.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.009+0000 7f903b7fe640 1 --2- 172.21.15.17:0/1158825821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903c107900 0x7f903c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:34.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.009+0000 7f903b7fe640 1 -- 172.21.15.17:0/1158825821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903c074f70 con 0x7f903c101900 2024-09-20T19:04:34.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.009+0000 7f903affd640 1 --2- 172.21.15.17:0/1158825821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903c107900 0x7f903c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:04:34.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.010+0000 7f903b7fe640 1 --2- 172.21.15.17:0/1158825821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c101900 0x7f903c0744f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f902c006010 tx=0x7f902c02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:34.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.010+0000 7f9038ff9640 1 -- 172.21.15.17:0/1158825821 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f902c047070 con 0x7f903c101900 2024-09-20T19:04:34.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.010+0000 7f9038ff9640 1 -- 172.21.15.17:0/1158825821 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f902c02f7e0 con 0x7f903c101900 2024-09-20T19:04:34.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.010+0000 7f9041a8c640 1 -- 172.21.15.17:0/1158825821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f903c075200 con 0x7f903c101900 2024-09-20T19:04:34.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.010+0000 7f9038ff9640 1 -- 172.21.15.17:0/1158825821 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f902c034070 con 0x7f903c101900 2024-09-20T19:04:34.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.010+0000 7f9041a8c640 1 -- 172.21.15.17:0/1158825821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f903c1a3f00 con 0x7f903c101900 2024-09-20T19:04:34.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.011+0000 7f9041a8c640 1 -- 172.21.15.17:0/1158825821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f903c103040 con 0x7f903c101900 2024-09-20T19:04:34.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.012+0000 7f9038ff9640 1 -- 172.21.15.17:0/1158825821 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f902c04a070 con 0x7f903c101900 2024-09-20T19:04:34.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.012+0000 7f9038ff9640 1 --2- 172.21.15.17:0/1158825821 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f902407af40 0x7f902407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:04:34.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.012+0000 7f9038ff9640 1 -- 172.21.15.17:0/1158825821 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f902c0bee70 con 0x7f903c101900 2024-09-20T19:04:34.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.012+0000 7f903affd640 1 --2- 172.21.15.17:0/1158825821 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f902407af40 0x7f902407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:04:34.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.013+0000 7f903affd640 1 --2- 172.21.15.17:0/1158825821 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f902407af40 0x7f902407d400 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f903c075f80 tx=0x7f9030008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:04:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.017+0000 7f9038ff9640 1 -- 172.21.15.17:0/1158825821 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f902c03f070 con 0x7f903c101900 2024-09-20T19:04:34.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:33 smithi172 ceph-mon[80431]: from='client.35408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:34.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:33 smithi172 ceph-mon[80431]: from='client.35412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:34.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:33 smithi172 ceph-mon[80431]: pgmap v875: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:34.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:33 smithi172 ceph-mon[80431]: from='client.35416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:34.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:33 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3873928904' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:04:34.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:33 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3640694115' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:04:34.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.279+0000 7f9041a8c640 1 -- 172.21.15.17:0/1158825821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f903c109e70 con 0x7f903c101900 2024-09-20T19:04:34.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.280+0000 7f9038ff9640 1 -- 172.21.15.17:0/1158825821 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f902c08a470 con 0x7f903c101900 2024-09-20T19:04:34.287 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:04:34.287 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:04:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:04:34.287 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:04:34.287 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:04:34.287 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:04:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:04:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:04:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:04:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:04:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:04:34.287 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:04:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:04:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:04:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:04:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:04:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:04:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:04:34.288 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:04:34.288 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:04:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:04:34.288 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:04:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:04:34.288 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:04:34.288 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:04:34.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.282+0000 7f9041a8c640 1 -- 172.21.15.17:0/1158825821 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f902407af40 msgr2=0x7f902407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:34.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.282+0000 7f9041a8c640 1 --2- 172.21.15.17:0/1158825821 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f902407af40 0x7f902407d400 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f903c075f80 tx=0x7f9030008040 comp rx=0 tx=0).stop 2024-09-20T19:04:34.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.282+0000 7f9041a8c640 1 -- 172.21.15.17:0/1158825821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c101900 msgr2=0x7f903c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:04:34.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.282+0000 7f9041a8c640 1 --2- 172.21.15.17:0/1158825821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c101900 0x7f903c0744f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f902c006010 tx=0x7f902c02f5f0 comp rx=0 tx=0).stop 2024-09-20T19:04:34.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.282+0000 7f9041a8c640 1 -- 172.21.15.17:0/1158825821 shutdown_connections 2024-09-20T19:04:34.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.282+0000 7f9041a8c640 1 --2- 172.21.15.17:0/1158825821 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f902407af40 0x7f902407d400 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:34.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.282+0000 7f9041a8c640 1 --2- 172.21.15.17:0/1158825821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903c107900 0x7f903c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:34.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.282+0000 7f9041a8c640 1 --2- 172.21.15.17:0/1158825821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f903c101900 0x7f903c0744f0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:04:34.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.282+0000 7f9041a8c640 1 -- 172.21.15.17:0/1158825821 >> 172.21.15.17:0/1158825821 conn(0x7f903c0fd600 msgr2=0x7f903c0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:04:34.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.282+0000 7f9041a8c640 1 -- 172.21.15.17:0/1158825821 shutdown_connections 2024-09-20T19:04:34.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:04:34.282+0000 7f9041a8c640 1 -- 172.21.15.17:0/1158825821 wait complete. 2024-09-20T19:04:35.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:34 smithi017 ceph-mon[108970]: from='client.35428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:35.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:34 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1158825821' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:04:35.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:34 smithi172 ceph-mon[80431]: from='client.35428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:04:35.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:34 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1158825821' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:04:36.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:35 smithi017 ceph-mon[108970]: pgmap v876: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:36.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:35 smithi172 ceph-mon[80431]: pgmap v876: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:38.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:37 smithi017 ceph-mon[108970]: pgmap v877: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:38.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:04:38.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:37 smithi172 ceph-mon[80431]: pgmap v877: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:38.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:04:40.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:39 smithi017 ceph-mon[108970]: pgmap v878: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:40.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:39 smithi172 ceph-mon[80431]: pgmap v878: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:42.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:41 smithi017 ceph-mon[108970]: pgmap v879: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:42.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:41 smithi172 ceph-mon[80431]: pgmap v879: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:44.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:43 smithi017 ceph-mon[108970]: pgmap v880: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:44.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:43 smithi172 ceph-mon[80431]: pgmap v880: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:46.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:45 smithi017 ceph-mon[108970]: pgmap v881: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:46.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:45 smithi172 ceph-mon[80431]: pgmap v881: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:48.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:47 smithi017 ceph-mon[108970]: pgmap v882: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:48.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:47 smithi172 ceph-mon[80431]: pgmap v882: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:50.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:49 smithi017 ceph-mon[108970]: pgmap v883: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:50.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:49 smithi172 ceph-mon[80431]: pgmap v883: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:52.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:51 smithi017 ceph-mon[108970]: pgmap v884: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:52.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:51 smithi172 ceph-mon[80431]: pgmap v884: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:53.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:04:53.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:04:54.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:53 smithi017 ceph-mon[108970]: pgmap v885: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:54.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:53 smithi172 ceph-mon[80431]: pgmap v885: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:56.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:55 smithi017 ceph-mon[108970]: pgmap v886: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:56.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:55 smithi172 ceph-mon[80431]: pgmap v886: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:58.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:57 smithi017 ceph-mon[108970]: pgmap v887: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:04:58.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:57 smithi172 ceph-mon[80431]: pgmap v887: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:00.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:04:59 smithi017 ceph-mon[108970]: pgmap v888: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:00.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:04:59 smithi172 ceph-mon[80431]: pgmap v888: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:02.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:01 smithi017 ceph-mon[108970]: pgmap v889: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:02.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:01 smithi172 ceph-mon[80431]: pgmap v889: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:04.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:03 smithi017 ceph-mon[108970]: pgmap v890: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:04.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:03 smithi172 ceph-mon[80431]: pgmap v890: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:04.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.381+0000 7f3e168f4640 1 -- 172.21.15.17:0/3916168377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e10103480 msgr2=0x7f3e1010b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:04.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.381+0000 7f3e168f4640 1 --2- 172.21.15.17:0/3916168377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e10103480 0x7f3e1010b970 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009880 tx=0x7f3e0402a530 comp rx=0 tx=0).stop 2024-09-20T19:05:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.381+0000 7f3e168f4640 1 -- 172.21.15.17:0/3916168377 shutdown_connections 2024-09-20T19:05:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.381+0000 7f3e168f4640 1 --2- 172.21.15.17:0/3916168377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e10103480 0x7f3e1010b970 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.381+0000 7f3e168f4640 1 --2- 172.21.15.17:0/3916168377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e10102b60 0x7f3e10102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.381+0000 7f3e168f4640 1 -- 172.21.15.17:0/3916168377 >> 172.21.15.17:0/3916168377 conn(0x7f3e100fc520 msgr2=0x7f3e100fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.381+0000 7f3e168f4640 1 -- 172.21.15.17:0/3916168377 shutdown_connections 2024-09-20T19:05:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.381+0000 7f3e168f4640 1 -- 172.21.15.17:0/3916168377 wait complete. 2024-09-20T19:05:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.382+0000 7f3e168f4640 1 Processor -- start 2024-09-20T19:05:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.382+0000 7f3e168f4640 1 -- start start 2024-09-20T19:05:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.382+0000 7f3e168f4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e10102b60 0x7f3e101007c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.382+0000 7f3e168f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e10103480 0x7f3e10100d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.382+0000 7f3e168f4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1010edd0 con 0x7f3e10103480 2024-09-20T19:05:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.382+0000 7f3e168f4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1010ec50 con 0x7f3e10102b60 2024-09-20T19:05:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.383+0000 7f3e0f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e10103480 0x7f3e10100d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.383+0000 7f3e0f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e10103480 0x7f3e10100d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45176/0 (socket says 172.21.15.17:45176) 2024-09-20T19:05:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.383+0000 7f3e0f7fe640 1 -- 172.21.15.17:0/13463406 learned_addr learned my addr 172.21.15.17:0/13463406 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:05:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.383+0000 7f3e0ffff640 1 --2- 172.21.15.17:0/13463406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e10102b60 0x7f3e101007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.383+0000 7f3e0f7fe640 1 -- 172.21.15.17:0/13463406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e10102b60 msgr2=0x7f3e101007c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.383+0000 7f3e0f7fe640 1 --2- 172.21.15.17:0/13463406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e10102b60 0x7f3e101007c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.383+0000 7f3e0f7fe640 1 -- 172.21.15.17:0/13463406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e10101240 con 0x7f3e10103480 2024-09-20T19:05:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.383+0000 7f3e0ffff640 1 --2- 172.21.15.17:0/13463406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e10102b60 0x7f3e101007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:05:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.383+0000 7f3e0f7fe640 1 --2- 172.21.15.17:0/13463406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e10103480 0x7f3e10100d00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3e04004f90 tx=0x7f3e040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.383+0000 7f3e0d7fa640 1 -- 172.21.15.17:0/13463406 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e0403f070 con 0x7f3e10103480 2024-09-20T19:05:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.384+0000 7f3e0d7fa640 1 -- 172.21.15.17:0/13463406 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e04004c70 con 0x7f3e10103480 2024-09-20T19:05:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.384+0000 7f3e168f4640 1 -- 172.21.15.17:0/13463406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e101014d0 con 0x7f3e10103480 2024-09-20T19:05:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.384+0000 7f3e0d7fa640 1 -- 172.21.15.17:0/13463406 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e04035030 con 0x7f3e10103480 2024-09-20T19:05:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.384+0000 7f3e168f4640 1 -- 172.21.15.17:0/13463406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e101a3dc0 con 0x7f3e10103480 2024-09-20T19:05:04.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.385+0000 7f3e168f4640 1 -- 172.21.15.17:0/13463406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1006a9f0 con 0x7f3e10103480 2024-09-20T19:05:04.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.385+0000 7f3e0d7fa640 1 -- 172.21.15.17:0/13463406 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3e04042070 con 0x7f3e10103480 2024-09-20T19:05:04.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.386+0000 7f3e0d7fa640 1 --2- 172.21.15.17:0/13463406 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3df807af30 0x7f3df807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:04.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.386+0000 7f3e0d7fa640 1 -- 172.21.15.17:0/13463406 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f3e040bea30 con 0x7f3e10103480 2024-09-20T19:05:04.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.386+0000 7f3e0ffff640 1 --2- 172.21.15.17:0/13463406 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3df807af30 0x7f3df807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:04.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.387+0000 7f3e0ffff640 1 --2- 172.21.15.17:0/13463406 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3df807af30 0x7f3df807d3f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3e000058c0 tx=0x7f3e00005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:04.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.391+0000 7f3e0d7fa640 1 -- 172.21.15.17:0/13463406 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3e0408a030 con 0x7f3e10103480 2024-09-20T19:05:04.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.596+0000 7f3e168f4640 1 -- 172.21.15.17:0/13463406 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3e10062630 con 0x7f3df807af30 2024-09-20T19:05:04.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.597+0000 7f3e0d7fa640 1 -- 172.21.15.17:0/13463406 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3e10062630 con 0x7f3df807af30 2024-09-20T19:05:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.599+0000 7f3e168f4640 1 -- 172.21.15.17:0/13463406 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3df807af30 msgr2=0x7f3df807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.599+0000 7f3e168f4640 1 --2- 172.21.15.17:0/13463406 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3df807af30 0x7f3df807d3f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3e000058c0 tx=0x7f3e00005850 comp rx=0 tx=0).stop 2024-09-20T19:05:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.599+0000 7f3e168f4640 1 -- 172.21.15.17:0/13463406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e10103480 msgr2=0x7f3e10100d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.599+0000 7f3e168f4640 1 --2- 172.21.15.17:0/13463406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e10103480 0x7f3e10100d00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3e04004f90 tx=0x7f3e040048f0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.599+0000 7f3e168f4640 1 -- 172.21.15.17:0/13463406 shutdown_connections 2024-09-20T19:05:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.599+0000 7f3e168f4640 1 --2- 172.21.15.17:0/13463406 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3df807af30 0x7f3df807d3f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.599+0000 7f3e168f4640 1 --2- 172.21.15.17:0/13463406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e10103480 0x7f3e10100d00 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.599+0000 7f3e168f4640 1 --2- 172.21.15.17:0/13463406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e10102b60 0x7f3e101007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.599+0000 7f3e168f4640 1 -- 172.21.15.17:0/13463406 >> 172.21.15.17:0/13463406 conn(0x7f3e100fc520 msgr2=0x7f3e10103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.599+0000 7f3e168f4640 1 -- 172.21.15.17:0/13463406 shutdown_connections 2024-09-20T19:05:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.600+0000 7f3e168f4640 1 -- 172.21.15.17:0/13463406 wait complete. 2024-09-20T19:05:04.613 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:05:04.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.685+0000 7f4f0047f640 1 -- 172.21.15.17:0/2937882907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ef8107900 msgr2=0x7f4ef8107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:04.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.685+0000 7f4f0047f640 1 --2- 172.21.15.17:0/2937882907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ef8107900 0x7f4ef8107ce0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4009880 tx=0x7f4ef402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.685+0000 7f4f0047f640 1 -- 172.21.15.17:0/2937882907 shutdown_connections 2024-09-20T19:05:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.685+0000 7f4f0047f640 1 --2- 172.21.15.17:0/2937882907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef8101900 0x7f4ef8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.685+0000 7f4f0047f640 1 --2- 172.21.15.17:0/2937882907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ef8107900 0x7f4ef8107ce0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.685+0000 7f4f0047f640 1 -- 172.21.15.17:0/2937882907 >> 172.21.15.17:0/2937882907 conn(0x7f4ef80fd600 msgr2=0x7f4ef80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.685+0000 7f4f0047f640 1 -- 172.21.15.17:0/2937882907 shutdown_connections 2024-09-20T19:05:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.685+0000 7f4f0047f640 1 -- 172.21.15.17:0/2937882907 wait complete. 2024-09-20T19:05:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.686+0000 7f4f0047f640 1 Processor -- start 2024-09-20T19:05:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.686+0000 7f4f0047f640 1 -- start start 2024-09-20T19:05:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.686+0000 7f4f0047f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef8101900 0x7f4ef819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.686+0000 7f4f0047f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ef8107900 0x7f4ef819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.686+0000 7f4f0047f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef810edb0 con 0x7f4ef8107900 2024-09-20T19:05:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.686+0000 7f4f0047f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef810ec30 con 0x7f4ef8101900 2024-09-20T19:05:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.686+0000 7f4efda1a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ef8107900 0x7f4ef819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.686+0000 7f4efda1a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ef8107900 0x7f4ef819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45196/0 (socket says 172.21.15.17:45196) 2024-09-20T19:05:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.686+0000 7f4efda1a640 1 -- 172.21.15.17:0/2584190113 learned_addr learned my addr 172.21.15.17:0/2584190113 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:05:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.687+0000 7f4efe21b640 1 --2- 172.21.15.17:0/2584190113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef8101900 0x7f4ef819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.687+0000 7f4efda1a640 1 -- 172.21.15.17:0/2584190113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef8101900 msgr2=0x7f4ef819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.687+0000 7f4efda1a640 1 --2- 172.21.15.17:0/2584190113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef8101900 0x7f4ef819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.687+0000 7f4efda1a640 1 -- 172.21.15.17:0/2584190113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef81977e0 con 0x7f4ef8107900 2024-09-20T19:05:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.687+0000 7f4efe21b640 1 --2- 172.21.15.17:0/2584190113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef8101900 0x7f4ef819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:05:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.687+0000 7f4efda1a640 1 --2- 172.21.15.17:0/2584190113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ef8107900 0x7f4ef819dba0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800c8a0 tx=0x7f4ee800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.687+0000 7f4eef7fe640 1 -- 172.21.15.17:0/2584190113 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ee80079b0 con 0x7f4ef8107900 2024-09-20T19:05:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.687+0000 7f4eef7fe640 1 -- 172.21.15.17:0/2584190113 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4ee8007b50 con 0x7f4ef8107900 2024-09-20T19:05:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.687+0000 7f4f0047f640 1 -- 172.21.15.17:0/2584190113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef8197ad0 con 0x7f4ef8107900 2024-09-20T19:05:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.687+0000 7f4eef7fe640 1 -- 172.21.15.17:0/2584190113 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ee8018700 con 0x7f4ef8107900 2024-09-20T19:05:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.687+0000 7f4f0047f640 1 -- 172.21.15.17:0/2584190113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef8198060 con 0x7f4ef8107900 2024-09-20T19:05:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.688+0000 7f4f0047f640 1 -- 172.21.15.17:0/2584190113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef8103040 con 0x7f4ef8107900 2024-09-20T19:05:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.689+0000 7f4eef7fe640 1 -- 172.21.15.17:0/2584190113 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4ee8007d00 con 0x7f4ef8107900 2024-09-20T19:05:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.689+0000 7f4eef7fe640 1 --2- 172.21.15.17:0/2584190113 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ee407afd0 0x7f4ee407d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.689+0000 7f4eef7fe640 1 -- 172.21.15.17:0/2584190113 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f4ee809e2f0 con 0x7f4ef8107900 2024-09-20T19:05:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.689+0000 7f4efe21b640 1 --2- 172.21.15.17:0/2584190113 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ee407afd0 0x7f4ee407d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.690+0000 7f4efe21b640 1 --2- 172.21.15.17:0/2584190113 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ee407afd0 0x7f4ee407d490 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4006010 tx=0x7f4ef40095f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:04.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.694+0000 7f4eef7fe640 1 -- 172.21.15.17:0/2584190113 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ee8014030 con 0x7f4ef8107900 2024-09-20T19:05:04.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.898+0000 7f4f0047f640 1 -- 172.21.15.17:0/2584190113 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4ef8198370 con 0x7f4ee407afd0 2024-09-20T19:05:04.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.899+0000 7f4eef7fe640 1 -- 172.21.15.17:0/2584190113 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f4ef8198370 con 0x7f4ee407afd0 2024-09-20T19:05:04.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.902+0000 7f4f0047f640 1 -- 172.21.15.17:0/2584190113 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ee407afd0 msgr2=0x7f4ee407d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:04.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.902+0000 7f4f0047f640 1 --2- 172.21.15.17:0/2584190113 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ee407afd0 0x7f4ee407d490 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4006010 tx=0x7f4ef40095f0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.902+0000 7f4f0047f640 1 -- 172.21.15.17:0/2584190113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ef8107900 msgr2=0x7f4ef819dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:04.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.902+0000 7f4f0047f640 1 --2- 172.21.15.17:0/2584190113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ef8107900 0x7f4ef819dba0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800c8a0 tx=0x7f4ee800cd60 comp rx=0 tx=0).stop 2024-09-20T19:05:04.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.902+0000 7f4f0047f640 1 -- 172.21.15.17:0/2584190113 shutdown_connections 2024-09-20T19:05:04.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.902+0000 7f4f0047f640 1 --2- 172.21.15.17:0/2584190113 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ee407afd0 0x7f4ee407d490 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.902+0000 7f4f0047f640 1 --2- 172.21.15.17:0/2584190113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ef8107900 0x7f4ef819dba0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.902+0000 7f4f0047f640 1 --2- 172.21.15.17:0/2584190113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef8101900 0x7f4ef819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.902+0000 7f4f0047f640 1 -- 172.21.15.17:0/2584190113 >> 172.21.15.17:0/2584190113 conn(0x7f4ef80fd600 msgr2=0x7f4ef80fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:04.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.902+0000 7f4f0047f640 1 -- 172.21.15.17:0/2584190113 shutdown_connections 2024-09-20T19:05:04.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.902+0000 7f4f0047f640 1 -- 172.21.15.17:0/2584190113 wait complete. 2024-09-20T19:05:04.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.986+0000 7f3ab559b640 1 -- 172.21.15.17:0/220963172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0107900 msgr2=0x7f3ab0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:04.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.986+0000 7f3ab559b640 1 --2- 172.21.15.17:0/220963172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0107900 0x7f3ab0107ce0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0009880 tx=0x7f3aa002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.986+0000 7f3ab559b640 1 -- 172.21.15.17:0/220963172 shutdown_connections 2024-09-20T19:05:04.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.986+0000 7f3ab559b640 1 --2- 172.21.15.17:0/220963172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ab0101900 0x7f3ab0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.986+0000 7f3ab559b640 1 --2- 172.21.15.17:0/220963172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0107900 0x7f3ab0107ce0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.986+0000 7f3ab559b640 1 -- 172.21.15.17:0/220963172 >> 172.21.15.17:0/220963172 conn(0x7f3ab00fd600 msgr2=0x7f3ab00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:04.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.986+0000 7f3ab559b640 1 -- 172.21.15.17:0/220963172 shutdown_connections 2024-09-20T19:05:04.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.986+0000 7f3ab559b640 1 -- 172.21.15.17:0/220963172 wait complete. 2024-09-20T19:05:04.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.987+0000 7f3ab559b640 1 Processor -- start 2024-09-20T19:05:04.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.987+0000 7f3ab559b640 1 -- start start 2024-09-20T19:05:04.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.987+0000 7f3ab559b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0101900 0x7f3ab019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:04.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.987+0000 7f3ab559b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ab0107900 0x7f3ab019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:04.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.987+0000 7f3ab559b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab010edb0 con 0x7f3ab0101900 2024-09-20T19:05:04.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.987+0000 7f3ab559b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab010ec30 con 0x7f3ab0107900 2024-09-20T19:05:04.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.987+0000 7f3aaeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0101900 0x7f3ab019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:04.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.987+0000 7f3aaeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0101900 0x7f3ab019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45210/0 (socket says 172.21.15.17:45210) 2024-09-20T19:05:04.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.987+0000 7f3aaeffd640 1 -- 172.21.15.17:0/2611862652 learned_addr learned my addr 172.21.15.17:0/2611862652 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:05:04.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.988+0000 7f3aa67fc640 1 --2- 172.21.15.17:0/2611862652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ab0107900 0x7f3ab019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:04.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.988+0000 7f3aaeffd640 1 -- 172.21.15.17:0/2611862652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ab0107900 msgr2=0x7f3ab019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:04.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.988+0000 7f3aaeffd640 1 --2- 172.21.15.17:0/2611862652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ab0107900 0x7f3ab019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:04.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.988+0000 7f3aaeffd640 1 -- 172.21.15.17:0/2611862652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab01977c0 con 0x7f3ab0101900 2024-09-20T19:05:04.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.988+0000 7f3aa67fc640 1 --2- 172.21.15.17:0/2611862652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ab0107900 0x7f3ab019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:05:04.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.988+0000 7f3aaeffd640 1 --2- 172.21.15.17:0/2611862652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0101900 0x7f3ab019d640 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0031460 tx=0x7f3aa00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:04.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.988+0000 7f3aacff9640 1 -- 172.21.15.17:0/2611862652 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3aa003f070 con 0x7f3ab0101900 2024-09-20T19:05:04.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.988+0000 7f3ab559b640 1 -- 172.21.15.17:0/2611862652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab0197a50 con 0x7f3ab0101900 2024-09-20T19:05:04.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.988+0000 7f3aacff9640 1 -- 172.21.15.17:0/2611862652 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3aa00044d0 con 0x7f3ab0101900 2024-09-20T19:05:04.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.988+0000 7f3aacff9640 1 -- 172.21.15.17:0/2611862652 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3aa0035030 con 0x7f3ab0101900 2024-09-20T19:05:04.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.988+0000 7f3ab559b640 1 -- 172.21.15.17:0/2611862652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab0197f80 con 0x7f3ab0101900 2024-09-20T19:05:04.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.990+0000 7f3ab559b640 1 -- 172.21.15.17:0/2611862652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ab0103040 con 0x7f3ab0101900 2024-09-20T19:05:04.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.990+0000 7f3aacff9640 1 -- 172.21.15.17:0/2611862652 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3aa0042070 con 0x7f3ab0101900 2024-09-20T19:05:04.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.990+0000 7f3aacff9640 1 --2- 172.21.15.17:0/2611862652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a9c07af40 0x7f3a9c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:04.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.991+0000 7f3aacff9640 1 -- 172.21.15.17:0/2611862652 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f3aa00beb20 con 0x7f3ab0101900 2024-09-20T19:05:04.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.991+0000 7f3aa67fc640 1 --2- 172.21.15.17:0/2611862652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a9c07af40 0x7f3a9c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:04.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.991+0000 7f3aa67fc640 1 --2- 172.21.15.17:0/2611862652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a9c07af40 0x7f3a9c07d400 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0100e00 tx=0x7f3a98005d90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:05.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:04.995+0000 7f3aacff9640 1 -- 172.21.15.17:0/2611862652 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3aa0004cf0 con 0x7f3ab0101900 2024-09-20T19:05:05.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.189+0000 7f3ab559b640 1 -- 172.21.15.17:0/2611862652 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3ab0198cf0 con 0x7f3a9c07af40 2024-09-20T19:05:05.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.199+0000 7f3aacff9640 1 -- 172.21.15.17:0/2611862652 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f3ab0198cf0 con 0x7f3a9c07af40 2024-09-20T19:05:05.204 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:05:05.204 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (26m) 5m ago 37m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:05:05.204 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (29m) 5m ago 37m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:05:05.204 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (29m) 5m ago 36m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:05:05.204 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (24m) 5m ago 37m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:05:05.205 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (24m) 5m ago 36m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:05:05.205 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (26m) 5m ago 37m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:05:05.205 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (21m) 5m ago 32m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:05:05.205 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (20m) 5m ago 32m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:05:05.205 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (5m) 5m ago 32m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:05:05.205 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (20m) 5m ago 32m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:05:05.205 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (28m) 5m ago 38m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:05:05.205 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (27m) 5m ago 36m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:05:05.205 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (25m) 5m ago 38m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:05:05.206 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (24m) 5m ago 36m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:05:05.206 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (27m) 5m ago 37m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:05:05.206 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (27m) 5m ago 36m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:05:05.206 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (24m) 5m ago 35m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:05:05.206 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (23m) 5m ago 34m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:05:05.206 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (23m) 5m ago 34m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:05:05.206 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (22m) 5m ago 34m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:05:05.206 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (21m) 5m ago 33m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:05:05.206 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (21m) 5m ago 33m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:05:05.206 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (26m) 5m ago 37m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:05:05.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.201+0000 7f3ab559b640 1 -- 172.21.15.17:0/2611862652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a9c07af40 msgr2=0x7f3a9c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:05.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.201+0000 7f3ab559b640 1 --2- 172.21.15.17:0/2611862652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a9c07af40 0x7f3a9c07d400 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0100e00 tx=0x7f3a98005d90 comp rx=0 tx=0).stop 2024-09-20T19:05:05.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.201+0000 7f3ab559b640 1 -- 172.21.15.17:0/2611862652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0101900 msgr2=0x7f3ab019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:05.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.201+0000 7f3ab559b640 1 --2- 172.21.15.17:0/2611862652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0101900 0x7f3ab019d640 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0031460 tx=0x7f3aa00048f0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.201+0000 7f3ab559b640 1 -- 172.21.15.17:0/2611862652 shutdown_connections 2024-09-20T19:05:05.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.201+0000 7f3ab559b640 1 --2- 172.21.15.17:0/2611862652 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a9c07af40 0x7f3a9c07d400 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.201+0000 7f3ab559b640 1 --2- 172.21.15.17:0/2611862652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ab0107900 0x7f3ab019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.201+0000 7f3ab559b640 1 --2- 172.21.15.17:0/2611862652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ab0101900 0x7f3ab019d640 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.201+0000 7f3ab559b640 1 -- 172.21.15.17:0/2611862652 >> 172.21.15.17:0/2611862652 conn(0x7f3ab00fd600 msgr2=0x7f3ab00ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:05.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.201+0000 7f3ab559b640 1 -- 172.21.15.17:0/2611862652 shutdown_connections 2024-09-20T19:05:05.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.201+0000 7f3ab559b640 1 -- 172.21.15.17:0/2611862652 wait complete. 2024-09-20T19:05:05.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.284+0000 7f480087e640 1 -- 172.21.15.17:0/1512868019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47fc101900 msgr2=0x7f47fc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:05.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.284+0000 7f480087e640 1 --2- 172.21.15.17:0/1512868019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47fc101900 0x7f47fc101d60 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009880 tx=0x7f47f002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.284+0000 7f480087e640 1 -- 172.21.15.17:0/1512868019 shutdown_connections 2024-09-20T19:05:05.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.284+0000 7f480087e640 1 --2- 172.21.15.17:0/1512868019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47fc101900 0x7f47fc101d60 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.284+0000 7f480087e640 1 --2- 172.21.15.17:0/1512868019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47fc107900 0x7f47fc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.284+0000 7f480087e640 1 -- 172.21.15.17:0/1512868019 >> 172.21.15.17:0/1512868019 conn(0x7f47fc0fd600 msgr2=0x7f47fc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:05.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.284+0000 7f480087e640 1 -- 172.21.15.17:0/1512868019 shutdown_connections 2024-09-20T19:05:05.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.284+0000 7f480087e640 1 -- 172.21.15.17:0/1512868019 wait complete. 2024-09-20T19:05:05.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.285+0000 7f480087e640 1 Processor -- start 2024-09-20T19:05:05.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.285+0000 7f480087e640 1 -- start start 2024-09-20T19:05:05.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.286+0000 7f480087e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47fc101900 0x7f47fc19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:05.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.286+0000 7f480087e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47fc107900 0x7f47fc19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:05.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.286+0000 7f480087e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f47fc10edb0 con 0x7f47fc107900 2024-09-20T19:05:05.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.286+0000 7f480087e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f47fc10ec30 con 0x7f47fc101900 2024-09-20T19:05:05.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.286+0000 7f47f9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47fc107900 0x7f47fc19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:05.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.286+0000 7f47f9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47fc107900 0x7f47fc19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45222/0 (socket says 172.21.15.17:45222) 2024-09-20T19:05:05.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.286+0000 7f47f9d9b640 1 -- 172.21.15.17:0/3534370248 learned_addr learned my addr 172.21.15.17:0/3534370248 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:05:05.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.286+0000 7f47fa59c640 1 --2- 172.21.15.17:0/3534370248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47fc101900 0x7f47fc19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:05.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.286+0000 7f47f9d9b640 1 -- 172.21.15.17:0/3534370248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47fc101900 msgr2=0x7f47fc19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:05.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.286+0000 7f47f9d9b640 1 --2- 172.21.15.17:0/3534370248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47fc101900 0x7f47fc19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.286+0000 7f47f9d9b640 1 -- 172.21.15.17:0/3534370248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47fc197800 con 0x7f47fc107900 2024-09-20T19:05:05.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.286+0000 7f47f9d9b640 1 --2- 172.21.15.17:0/3534370248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47fc107900 0x7f47fc19dbc0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f47f0031460 tx=0x7f47f00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:05.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.286+0000 7f47eb7fe640 1 -- 172.21.15.17:0/3534370248 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47f003f070 con 0x7f47fc107900 2024-09-20T19:05:05.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.287+0000 7f480087e640 1 -- 172.21.15.17:0/3534370248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47fc197a90 con 0x7f47fc107900 2024-09-20T19:05:05.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.287+0000 7f47eb7fe640 1 -- 172.21.15.17:0/3534370248 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f47f00035f0 con 0x7f47fc107900 2024-09-20T19:05:05.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.287+0000 7f47eb7fe640 1 -- 172.21.15.17:0/3534370248 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47f0035030 con 0x7f47fc107900 2024-09-20T19:05:05.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.287+0000 7f480087e640 1 -- 172.21.15.17:0/3534370248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47fc197fc0 con 0x7f47fc107900 2024-09-20T19:05:05.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.288+0000 7f480087e640 1 -- 172.21.15.17:0/3534370248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47fc103040 con 0x7f47fc107900 2024-09-20T19:05:05.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.288+0000 7f47eb7fe640 1 -- 172.21.15.17:0/3534370248 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f47f0042070 con 0x7f47fc107900 2024-09-20T19:05:05.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.289+0000 7f47eb7fe640 1 --2- 172.21.15.17:0/3534370248 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f47e407af30 0x7f47e407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:05.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.289+0000 7f47eb7fe640 1 -- 172.21.15.17:0/3534370248 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f47f00be970 con 0x7f47fc107900 2024-09-20T19:05:05.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.289+0000 7f47fa59c640 1 --2- 172.21.15.17:0/3534370248 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f47e407af30 0x7f47e407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:05.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.289+0000 7f47fa59c640 1 --2- 172.21.15.17:0/3534370248 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f47e407af30 0x7f47e407d3f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f47ec005d00 tx=0x7f47ec00b410 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:05.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.293+0000 7f47eb7fe640 1 -- 172.21.15.17:0/3534370248 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f47f00c0e20 con 0x7f47fc107900 2024-09-20T19:05:05.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.555+0000 7f480087e640 1 -- 172.21.15.17:0/3534370248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f47fc198d30 con 0x7f47fc107900 2024-09-20T19:05:05.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.556+0000 7f47eb7fe640 1 -- 172.21.15.17:0/3534370248 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f47f0089f70 con 0x7f47fc107900 2024-09-20T19:05:05.561 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:05:05.561 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:05:05.561 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:05:05.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:05:05.561 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:05:05.561 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:05:05.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:05:05.562 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:05:05.562 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:05:05.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:05:05.562 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:05:05.562 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:05:05.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:05:05.562 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:05:05.562 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:05:05.562 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:05:05.562 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:05:05.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.558+0000 7f480087e640 1 -- 172.21.15.17:0/3534370248 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f47e407af30 msgr2=0x7f47e407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:05.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.558+0000 7f480087e640 1 --2- 172.21.15.17:0/3534370248 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f47e407af30 0x7f47e407d3f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f47ec005d00 tx=0x7f47ec00b410 comp rx=0 tx=0).stop 2024-09-20T19:05:05.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.558+0000 7f480087e640 1 -- 172.21.15.17:0/3534370248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47fc107900 msgr2=0x7f47fc19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:05.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.558+0000 7f480087e640 1 --2- 172.21.15.17:0/3534370248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47fc107900 0x7f47fc19dbc0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f47f0031460 tx=0x7f47f00045e0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.558+0000 7f480087e640 1 -- 172.21.15.17:0/3534370248 shutdown_connections 2024-09-20T19:05:05.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.558+0000 7f480087e640 1 --2- 172.21.15.17:0/3534370248 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f47e407af30 0x7f47e407d3f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.558+0000 7f480087e640 1 --2- 172.21.15.17:0/3534370248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47fc107900 0x7f47fc19dbc0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.558+0000 7f480087e640 1 --2- 172.21.15.17:0/3534370248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47fc101900 0x7f47fc19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.558+0000 7f480087e640 1 -- 172.21.15.17:0/3534370248 >> 172.21.15.17:0/3534370248 conn(0x7f47fc0fd600 msgr2=0x7f47fc0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:05.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.558+0000 7f480087e640 1 -- 172.21.15.17:0/3534370248 shutdown_connections 2024-09-20T19:05:05.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.558+0000 7f480087e640 1 -- 172.21.15.17:0/3534370248 wait complete. 2024-09-20T19:05:05.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.642+0000 7fbf78183640 1 -- 172.21.15.17:0/2453250174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf70068cb0 msgr2=0x7fbf700ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:05.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.642+0000 7fbf78183640 1 --2- 172.21.15.17:0/2453250174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf70068cb0 0x7fbf700ffb30 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00a9c0 tx=0x7fbf6c02b820 comp rx=0 tx=0).stop 2024-09-20T19:05:05.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.642+0000 7fbf78183640 1 -- 172.21.15.17:0/2453250174 shutdown_connections 2024-09-20T19:05:05.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.642+0000 7fbf78183640 1 --2- 172.21.15.17:0/2453250174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf70100070 0x7fbf701004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.642+0000 7fbf78183640 1 --2- 172.21.15.17:0/2453250174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf70068cb0 0x7fbf700ffb30 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.642+0000 7fbf78183640 1 -- 172.21.15.17:0/2453250174 >> 172.21.15.17:0/2453250174 conn(0x7fbf700fb870 msgr2=0x7fbf700fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:05.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.643+0000 7fbf78183640 1 -- 172.21.15.17:0/2453250174 shutdown_connections 2024-09-20T19:05:05.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.643+0000 7fbf78183640 1 -- 172.21.15.17:0/2453250174 wait complete. 2024-09-20T19:05:05.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.643+0000 7fbf78183640 1 Processor -- start 2024-09-20T19:05:05.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.643+0000 7fbf78183640 1 -- start start 2024-09-20T19:05:05.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.643+0000 7fbf78183640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf70068cb0 0x7fbf7019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:05.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.643+0000 7fbf78183640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf70100070 0x7fbf7019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:05.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.643+0000 7fbf78183640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7010cae0 con 0x7fbf70068cb0 2024-09-20T19:05:05.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.643+0000 7fbf78183640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7010c960 con 0x7fbf70100070 2024-09-20T19:05:05.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.644+0000 7fbf75f1f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf70068cb0 0x7fbf7019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:05.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.644+0000 7fbf75f1f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf70068cb0 0x7fbf7019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45228/0 (socket says 172.21.15.17:45228) 2024-09-20T19:05:05.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.644+0000 7fbf75f1f640 1 -- 172.21.15.17:0/3471749624 learned_addr learned my addr 172.21.15.17:0/3471749624 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:05:05.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.644+0000 7fbf75f1f640 1 -- 172.21.15.17:0/3471749624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf70100070 msgr2=0x7fbf7019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:05.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.644+0000 7fbf7571e640 1 --2- 172.21.15.17:0/3471749624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf70100070 0x7fbf7019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:05.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.644+0000 7fbf75f1f640 1 --2- 172.21.15.17:0/3471749624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf70100070 0x7fbf7019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.644+0000 7fbf75f1f640 1 -- 172.21.15.17:0/3471749624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf70197700 con 0x7fbf70068cb0 2024-09-20T19:05:05.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.644+0000 7fbf75f1f640 1 --2- 172.21.15.17:0/3471749624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf70068cb0 0x7fbf7019d630 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c030570 tx=0x7fbf6c0045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:05.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.644+0000 7fbf66ffd640 1 -- 172.21.15.17:0/3471749624 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf6c03f070 con 0x7fbf70068cb0 2024-09-20T19:05:05.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.644+0000 7fbf78183640 1 -- 172.21.15.17:0/3471749624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf701979f0 con 0x7fbf70068cb0 2024-09-20T19:05:05.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.644+0000 7fbf66ffd640 1 -- 172.21.15.17:0/3471749624 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbf6c0035f0 con 0x7fbf70068cb0 2024-09-20T19:05:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.644+0000 7fbf66ffd640 1 -- 172.21.15.17:0/3471749624 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf6c036040 con 0x7fbf70068cb0 2024-09-20T19:05:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.644+0000 7fbf78183640 1 -- 172.21.15.17:0/3471749624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf70197f50 con 0x7fbf70068cb0 2024-09-20T19:05:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.645+0000 7fbf78183640 1 -- 172.21.15.17:0/3471749624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf701011e0 con 0x7fbf70068cb0 2024-09-20T19:05:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.646+0000 7fbf66ffd640 1 -- 172.21.15.17:0/3471749624 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fbf6c042070 con 0x7fbf70068cb0 2024-09-20T19:05:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.647+0000 7fbf66ffd640 1 --2- 172.21.15.17:0/3471749624 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbf5c07af30 0x7fbf5c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:05.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.647+0000 7fbf66ffd640 1 -- 172.21.15.17:0/3471749624 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fbf6c0bea30 con 0x7fbf70068cb0 2024-09-20T19:05:05.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.647+0000 7fbf7571e640 1 --2- 172.21.15.17:0/3471749624 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbf5c07af30 0x7fbf5c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:05.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.647+0000 7fbf7571e640 1 --2- 172.21.15.17:0/3471749624 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbf5c07af30 0x7fbf5c07d3f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbf60005fd0 tx=0x7fbf60005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:05.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.651+0000 7fbf66ffd640 1 -- 172.21.15.17:0/3471749624 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbf6c0c0e20 con 0x7fbf70068cb0 2024-09-20T19:05:05.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.876+0000 7fbf78183640 1 -- 172.21.15.17:0/3471749624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbf7010a010 con 0x7fbf70068cb0 2024-09-20T19:05:05.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.877+0000 7fbf66ffd640 1 -- 172.21.15.17:0/3471749624 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7fbf6c089f90 con 0x7fbf70068cb0 2024-09-20T19:05:05.882 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:05:05.882 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:05:05.882 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:05:05.883 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:05:05.883 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:05:05.883 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:05:05.883 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:05:05.883 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:05:05.883 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:05:05.883 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:05:05.883 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:05:05.883 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:05:05.883 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:05:05.883 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:05:05.883 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:05:05.883 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:05:05.884 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:05:05.884 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:05:05.884 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:05:05.884 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:05:05.884 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:05:05.884 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:05:05.884 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:05:05.884 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:05:05.884 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:05:05.884 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:05:05.884 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:05:05.884 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:05:05.884 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:05:05.885 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:05:05.885 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:05:05.885 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:05:05.885 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:05:05.885 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:05:05.885 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:05:05.885 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:05:05.885 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:05:05.885 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:05:05.885 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:05:05.885 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:05:05.885 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:05:05.885 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:05:05.886 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:05:05.886 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:05:05.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.880+0000 7fbf78183640 1 -- 172.21.15.17:0/3471749624 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbf5c07af30 msgr2=0x7fbf5c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:05.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.880+0000 7fbf78183640 1 --2- 172.21.15.17:0/3471749624 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbf5c07af30 0x7fbf5c07d3f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbf60005fd0 tx=0x7fbf60005850 comp rx=0 tx=0).stop 2024-09-20T19:05:05.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.880+0000 7fbf78183640 1 -- 172.21.15.17:0/3471749624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf70068cb0 msgr2=0x7fbf7019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:05.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.880+0000 7fbf78183640 1 --2- 172.21.15.17:0/3471749624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf70068cb0 0x7fbf7019d630 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c030570 tx=0x7fbf6c0045c0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.880+0000 7fbf78183640 1 -- 172.21.15.17:0/3471749624 shutdown_connections 2024-09-20T19:05:05.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.880+0000 7fbf78183640 1 --2- 172.21.15.17:0/3471749624 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbf5c07af30 0x7fbf5c07d3f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.880+0000 7fbf78183640 1 --2- 172.21.15.17:0/3471749624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf70100070 0x7fbf7019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.880+0000 7fbf78183640 1 --2- 172.21.15.17:0/3471749624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf70068cb0 0x7fbf7019d630 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.880+0000 7fbf78183640 1 -- 172.21.15.17:0/3471749624 >> 172.21.15.17:0/3471749624 conn(0x7fbf700fb870 msgr2=0x7fbf70104760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:05.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.880+0000 7fbf78183640 1 -- 172.21.15.17:0/3471749624 shutdown_connections 2024-09-20T19:05:05.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.880+0000 7fbf78183640 1 -- 172.21.15.17:0/3471749624 wait complete. 2024-09-20T19:05:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.966+0000 7ff7faa71640 1 -- 172.21.15.17:0/216939783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7f4100c00 msgr2=0x7ff7f4104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.966+0000 7ff7faa71640 1 --2- 172.21.15.17:0/216939783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7f4100c00 0x7ff7f4104c50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009880 tx=0x7ff7dc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.966+0000 7ff7faa71640 1 -- 172.21.15.17:0/216939783 shutdown_connections 2024-09-20T19:05:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.966+0000 7ff7faa71640 1 --2- 172.21.15.17:0/216939783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7f4100c00 0x7ff7f4104c50 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.966+0000 7ff7faa71640 1 --2- 172.21.15.17:0/216939783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7f4100250 0x7ff7f4100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.966+0000 7ff7faa71640 1 -- 172.21.15.17:0/216939783 >> 172.21.15.17:0/216939783 conn(0x7ff7f40fbc90 msgr2=0x7ff7f40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.966+0000 7ff7faa71640 1 -- 172.21.15.17:0/216939783 shutdown_connections 2024-09-20T19:05:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.966+0000 7ff7faa71640 1 -- 172.21.15.17:0/216939783 wait complete. 2024-09-20T19:05:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.967+0000 7ff7faa71640 1 Processor -- start 2024-09-20T19:05:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.967+0000 7ff7faa71640 1 -- start start 2024-09-20T19:05:05.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.967+0000 7ff7faa71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7f4100250 0x7ff7f419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.967+0000 7ff7faa71640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7f4100c00 0x7ff7f419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.967+0000 7ff7faa71640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f410d4b0 con 0x7ff7f4100250 2024-09-20T19:05:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.967+0000 7ff7faa71640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f410d330 con 0x7ff7f4100c00 2024-09-20T19:05:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.967+0000 7ff7f880d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7f4100250 0x7ff7f419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.967+0000 7ff7f880d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7f4100250 0x7ff7f419c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45238/0 (socket says 172.21.15.17:45238) 2024-09-20T19:05:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.967+0000 7ff7f880d640 1 -- 172.21.15.17:0/3930298151 learned_addr learned my addr 172.21.15.17:0/3930298151 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:05:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.967+0000 7ff7f3fff640 1 --2- 172.21.15.17:0/3930298151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7f4100c00 0x7ff7f419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.967+0000 7ff7f880d640 1 -- 172.21.15.17:0/3930298151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7f4100c00 msgr2=0x7ff7f419cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.967+0000 7ff7f880d640 1 --2- 172.21.15.17:0/3930298151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7f4100c00 0x7ff7f419cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.967+0000 7ff7f880d640 1 -- 172.21.15.17:0/3930298151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f4196780 con 0x7ff7f4100250 2024-09-20T19:05:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.967+0000 7ff7f3fff640 1 --2- 172.21.15.17:0/3930298151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7f4100c00 0x7ff7f419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:05:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.968+0000 7ff7f880d640 1 --2- 172.21.15.17:0/3930298151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7f4100250 0x7ff7f419c600 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400d8d0 tx=0x7ff7e400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.968+0000 7ff7f1ffb640 1 -- 172.21.15.17:0/3930298151 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7e4017070 con 0x7ff7f4100250 2024-09-20T19:05:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.968+0000 7ff7f1ffb640 1 -- 172.21.15.17:0/3930298151 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7e4010460 con 0x7ff7f4100250 2024-09-20T19:05:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.968+0000 7ff7faa71640 1 -- 172.21.15.17:0/3930298151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f4196a70 con 0x7ff7f4100250 2024-09-20T19:05:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.968+0000 7ff7f1ffb640 1 -- 172.21.15.17:0/3930298151 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7e400f5f0 con 0x7ff7f4100250 2024-09-20T19:05:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.968+0000 7ff7faa71640 1 -- 172.21.15.17:0/3930298151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f4196fd0 con 0x7ff7f4100250 2024-09-20T19:05:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.969+0000 7ff7faa71640 1 -- 172.21.15.17:0/3930298151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f4101730 con 0x7ff7f4100250 2024-09-20T19:05:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.970+0000 7ff7f1ffb640 1 -- 172.21.15.17:0/3930298151 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff7e4009a30 con 0x7ff7f4100250 2024-09-20T19:05:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.970+0000 7ff7f1ffb640 1 --2- 172.21.15.17:0/3930298151 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff7e007af80 0x7ff7e007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.970+0000 7ff7f1ffb640 1 -- 172.21.15.17:0/3930298151 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7ff7e409de10 con 0x7ff7f4100250 2024-09-20T19:05:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.970+0000 7ff7f3fff640 1 --2- 172.21.15.17:0/3930298151 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff7e007af80 0x7ff7e007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.971+0000 7ff7f3fff640 1 --2- 172.21.15.17:0/3930298151 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff7e007af80 0x7ff7e007d440 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4197ad0 tx=0x7ff7dc031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:05.975+0000 7ff7f1ffb640 1 -- 172.21.15.17:0/3930298151 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7e4069490 con 0x7ff7f4100250 2024-09-20T19:05:06.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:05 smithi017 ceph-mon[108970]: from='client.35436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:06.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:05 smithi017 ceph-mon[108970]: pgmap v891: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:06.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:05 smithi017 ceph-mon[108970]: from='client.35440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:06.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:05 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3534370248' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:05:06.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:05 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3471749624' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:05:06.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.182+0000 7ff7faa71640 1 -- 172.21.15.17:0/3930298151 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff7f4197280 con 0x7ff7e007af80 2024-09-20T19:05:06.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.184+0000 7ff7f1ffb640 1 -- 172.21.15.17:0/3930298151 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff7f4197280 con 0x7ff7e007af80 2024-09-20T19:05:06.189 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:05:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:05:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:05:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:05:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:05:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:05:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:05:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:05:06.189 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:05:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:05:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:05:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:05:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:05:06.190 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:05:06.190 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:05:06.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.186+0000 7ff7faa71640 1 -- 172.21.15.17:0/3930298151 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff7e007af80 msgr2=0x7ff7e007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:06.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.186+0000 7ff7faa71640 1 --2- 172.21.15.17:0/3930298151 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff7e007af80 0x7ff7e007d440 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4197ad0 tx=0x7ff7dc031400 comp rx=0 tx=0).stop 2024-09-20T19:05:06.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.186+0000 7ff7faa71640 1 -- 172.21.15.17:0/3930298151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7f4100250 msgr2=0x7ff7f419c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:06.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.186+0000 7ff7faa71640 1 --2- 172.21.15.17:0/3930298151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7f4100250 0x7ff7f419c600 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400d8d0 tx=0x7ff7e400dd90 comp rx=0 tx=0).stop 2024-09-20T19:05:06.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.186+0000 7ff7faa71640 1 -- 172.21.15.17:0/3930298151 shutdown_connections 2024-09-20T19:05:06.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.186+0000 7ff7faa71640 1 --2- 172.21.15.17:0/3930298151 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff7e007af80 0x7ff7e007d440 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:06.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.186+0000 7ff7faa71640 1 --2- 172.21.15.17:0/3930298151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7f4100c00 0x7ff7f419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:06.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.186+0000 7ff7faa71640 1 --2- 172.21.15.17:0/3930298151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7f4100250 0x7ff7f419c600 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:06.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.186+0000 7ff7faa71640 1 -- 172.21.15.17:0/3930298151 >> 172.21.15.17:0/3930298151 conn(0x7ff7f40fbc90 msgr2=0x7ff7f40fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:06.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.186+0000 7ff7faa71640 1 -- 172.21.15.17:0/3930298151 shutdown_connections 2024-09-20T19:05:06.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.186+0000 7ff7faa71640 1 -- 172.21.15.17:0/3930298151 wait complete. 2024-09-20T19:05:06.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:05 smithi172 ceph-mon[80431]: from='client.35436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:06.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:05 smithi172 ceph-mon[80431]: pgmap v891: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:06.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:05 smithi172 ceph-mon[80431]: from='client.35440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:06.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:05 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3534370248' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:05:06.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:05 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3471749624' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:05:06.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.270+0000 7f7be76d7640 1 -- 172.21.15.17:0/1196406256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7be0107900 msgr2=0x7f7be0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:06.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.270+0000 7f7be76d7640 1 --2- 172.21.15.17:0/1196406256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7be0107900 0x7f7be0107ce0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009880 tx=0x7f7bdc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:05:06.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.270+0000 7f7be76d7640 1 -- 172.21.15.17:0/1196406256 shutdown_connections 2024-09-20T19:05:06.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.270+0000 7f7be76d7640 1 --2- 172.21.15.17:0/1196406256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7be0101900 0x7f7be0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:06.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.270+0000 7f7be76d7640 1 --2- 172.21.15.17:0/1196406256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7be0107900 0x7f7be0107ce0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:06.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.270+0000 7f7be76d7640 1 -- 172.21.15.17:0/1196406256 >> 172.21.15.17:0/1196406256 conn(0x7f7be00fd600 msgr2=0x7f7be00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:06.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.270+0000 7f7be76d7640 1 -- 172.21.15.17:0/1196406256 shutdown_connections 2024-09-20T19:05:06.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.270+0000 7f7be76d7640 1 -- 172.21.15.17:0/1196406256 wait complete. 2024-09-20T19:05:06.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.271+0000 7f7be76d7640 1 Processor -- start 2024-09-20T19:05:06.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.271+0000 7f7be76d7640 1 -- start start 2024-09-20T19:05:06.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.271+0000 7f7be76d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7be0101900 0x7f7be019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:06.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.271+0000 7f7be76d7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7be0107900 0x7f7be019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:06.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.271+0000 7f7be76d7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7be010edd0 con 0x7f7be0101900 2024-09-20T19:05:06.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.271+0000 7f7be76d7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7be010ec50 con 0x7f7be0107900 2024-09-20T19:05:06.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.271+0000 7f7be5473640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7be0101900 0x7f7be019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:06.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.271+0000 7f7be5473640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7be0101900 0x7f7be019d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45266/0 (socket says 172.21.15.17:45266) 2024-09-20T19:05:06.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.271+0000 7f7be5473640 1 -- 172.21.15.17:0/3834177627 learned_addr learned my addr 172.21.15.17:0/3834177627 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:05:06.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.272+0000 7f7be4c72640 1 --2- 172.21.15.17:0/3834177627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7be0107900 0x7f7be019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:06.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.272+0000 7f7be5473640 1 -- 172.21.15.17:0/3834177627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7be0107900 msgr2=0x7f7be019db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:06.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.272+0000 7f7be5473640 1 --2- 172.21.15.17:0/3834177627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7be0107900 0x7f7be019db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:06.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.272+0000 7f7be5473640 1 -- 172.21.15.17:0/3834177627 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be01977a0 con 0x7f7be0101900 2024-09-20T19:05:06.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.272+0000 7f7be5473640 1 --2- 172.21.15.17:0/3834177627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7be0101900 0x7f7be019d620 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc031460 tx=0x7f7bdc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:06.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.272+0000 7f7bd67fc640 1 -- 172.21.15.17:0/3834177627 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7bdc03f070 con 0x7f7be0101900 2024-09-20T19:05:06.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.272+0000 7f7bd67fc640 1 -- 172.21.15.17:0/3834177627 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7bdc0035f0 con 0x7f7be0101900 2024-09-20T19:05:06.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.272+0000 7f7be76d7640 1 -- 172.21.15.17:0/3834177627 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be0197a30 con 0x7f7be0101900 2024-09-20T19:05:06.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.272+0000 7f7bd67fc640 1 -- 172.21.15.17:0/3834177627 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7bdc035030 con 0x7f7be0101900 2024-09-20T19:05:06.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.272+0000 7f7be76d7640 1 -- 172.21.15.17:0/3834177627 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be0197f60 con 0x7f7be0101900 2024-09-20T19:05:06.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.273+0000 7f7be76d7640 1 -- 172.21.15.17:0/3834177627 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be0103040 con 0x7f7be0101900 2024-09-20T19:05:06.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.274+0000 7f7bd67fc640 1 -- 172.21.15.17:0/3834177627 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7bdc042070 con 0x7f7be0101900 2024-09-20T19:05:06.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.274+0000 7f7bd67fc640 1 --2- 172.21.15.17:0/3834177627 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7bcc07af30 0x7f7bcc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:06.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.274+0000 7f7bd67fc640 1 -- 172.21.15.17:0/3834177627 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f7bdc0bea20 con 0x7f7be0101900 2024-09-20T19:05:06.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.274+0000 7f7be4c72640 1 --2- 172.21.15.17:0/3834177627 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7bcc07af30 0x7f7bcc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:06.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.275+0000 7f7be4c72640 1 --2- 172.21.15.17:0/3834177627 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7bcc07af30 0x7f7bcc07d3f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0005fd0 tx=0x7f7bd0005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:06.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.279+0000 7f7bd67fc640 1 -- 172.21.15.17:0/3834177627 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7bdc08a020 con 0x7f7be0101900 2024-09-20T19:05:06.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.544+0000 7f7be76d7640 1 -- 172.21.15.17:0/3834177627 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f7be0109e70 con 0x7f7be0101900 2024-09-20T19:05:06.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.544+0000 7f7bd67fc640 1 -- 172.21.15.17:0/3834177627 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f7bdc08c020 con 0x7f7be0101900 2024-09-20T19:05:06.550 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:05:06.550 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:05:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:05:06.550 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:05:06.550 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:05:06.550 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:05:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:05:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:05:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:05:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:05:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:05:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:05:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:05:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:05:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:05:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:05:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:05:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:05:06.551 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:05:06.551 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:05:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:05:06.551 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:05:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:05:06.552 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:05:06.552 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:05:06.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.546+0000 7f7be76d7640 1 -- 172.21.15.17:0/3834177627 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7bcc07af30 msgr2=0x7f7bcc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.546+0000 7f7be76d7640 1 --2- 172.21.15.17:0/3834177627 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7bcc07af30 0x7f7bcc07d3f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0005fd0 tx=0x7f7bd0005850 comp rx=0 tx=0).stop 2024-09-20T19:05:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.546+0000 7f7be76d7640 1 -- 172.21.15.17:0/3834177627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7be0101900 msgr2=0x7f7be019d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.546+0000 7f7be76d7640 1 --2- 172.21.15.17:0/3834177627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7be0101900 0x7f7be019d620 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc031460 tx=0x7f7bdc0045e0 comp rx=0 tx=0).stop 2024-09-20T19:05:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.546+0000 7f7be76d7640 1 -- 172.21.15.17:0/3834177627 shutdown_connections 2024-09-20T19:05:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.546+0000 7f7be76d7640 1 --2- 172.21.15.17:0/3834177627 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7bcc07af30 0x7f7bcc07d3f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.546+0000 7f7be76d7640 1 --2- 172.21.15.17:0/3834177627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7be0107900 0x7f7be019db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.546+0000 7f7be76d7640 1 --2- 172.21.15.17:0/3834177627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7be0101900 0x7f7be019d620 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.546+0000 7f7be76d7640 1 -- 172.21.15.17:0/3834177627 >> 172.21.15.17:0/3834177627 conn(0x7f7be00fd600 msgr2=0x7f7be00fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.546+0000 7f7be76d7640 1 -- 172.21.15.17:0/3834177627 shutdown_connections 2024-09-20T19:05:06.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:06.547+0000 7f7be76d7640 1 -- 172.21.15.17:0/3834177627 wait complete. 2024-09-20T19:05:07.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:06 smithi172 ceph-mon[80431]: from='client.35444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:07.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:06 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3834177627' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:05:07.391 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:06 smithi017 ceph-mon[108970]: from='client.35444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:07.391 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:06 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3834177627' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:05:08.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:07 smithi172 ceph-mon[80431]: from='client.35456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:08.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:07 smithi172 ceph-mon[80431]: pgmap v892: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:08.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:05:08.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:07 smithi017 ceph-mon[108970]: from='client.35456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:08.391 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:07 smithi017 ceph-mon[108970]: pgmap v892: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:08.391 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:05:10.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:09 smithi172 ceph-mon[80431]: pgmap v893: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:10.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:09 smithi017 ceph-mon[108970]: pgmap v893: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:12.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:11 smithi172 ceph-mon[80431]: pgmap v894: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:12.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:11 smithi017 ceph-mon[108970]: pgmap v894: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:14.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:13 smithi172 ceph-mon[80431]: pgmap v895: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:14.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:13 smithi017 ceph-mon[108970]: pgmap v895: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:16.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:15 smithi172 ceph-mon[80431]: pgmap v896: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:16.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:15 smithi017 ceph-mon[108970]: pgmap v896: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:18.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:17 smithi017 ceph-mon[108970]: pgmap v897: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:18.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:17 smithi172 ceph-mon[80431]: pgmap v897: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:20.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:19 smithi172 ceph-mon[80431]: pgmap v898: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:20.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:19 smithi017 ceph-mon[108970]: pgmap v898: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:22.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:21 smithi172 ceph-mon[80431]: pgmap v899: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:22.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:21 smithi017 ceph-mon[108970]: pgmap v899: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:23.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:05:23.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:05:24.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:23 smithi172 ceph-mon[80431]: pgmap v900: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:24.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:23 smithi017 ceph-mon[108970]: pgmap v900: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:26.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:25 smithi172 ceph-mon[80431]: pgmap v901: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:26.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:25 smithi017 ceph-mon[108970]: pgmap v901: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:28.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:27 smithi017 ceph-mon[108970]: pgmap v902: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:28.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:27 smithi172 ceph-mon[80431]: pgmap v902: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:30.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:29 smithi172 ceph-mon[80431]: pgmap v903: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:30.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:29 smithi017 ceph-mon[108970]: pgmap v903: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:32.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:31 smithi172 ceph-mon[80431]: pgmap v904: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:32.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:31 smithi017 ceph-mon[108970]: pgmap v904: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:34.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:33 smithi172 ceph-mon[80431]: pgmap v905: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:34.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:33 smithi017 ceph-mon[108970]: pgmap v905: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:36.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:35 smithi172 ceph-mon[80431]: pgmap v906: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:36.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:35 smithi017 ceph-mon[108970]: pgmap v906: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:36.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.645+0000 7fc84818f640 1 -- 172.21.15.17:0/3055399739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8401067f0 msgr2=0x7fc840106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:36.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.645+0000 7fc84818f640 1 --2- 172.21.15.17:0/3055399739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8401067f0 0x7fc840106bd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009880 tx=0x7fc83c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:05:36.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.645+0000 7fc84818f640 1 -- 172.21.15.17:0/3055399739 shutdown_connections 2024-09-20T19:05:36.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.645+0000 7fc84818f640 1 --2- 172.21.15.17:0/3055399739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8401007f0 0x7fc840100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:36.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.645+0000 7fc84818f640 1 --2- 172.21.15.17:0/3055399739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8401067f0 0x7fc840106bd0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:36.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.645+0000 7fc84818f640 1 -- 172.21.15.17:0/3055399739 >> 172.21.15.17:0/3055399739 conn(0x7fc8400fc550 msgr2=0x7fc8400fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:36.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.645+0000 7fc84818f640 1 -- 172.21.15.17:0/3055399739 shutdown_connections 2024-09-20T19:05:36.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.645+0000 7fc84818f640 1 -- 172.21.15.17:0/3055399739 wait complete. 2024-09-20T19:05:36.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.646+0000 7fc84818f640 1 Processor -- start 2024-09-20T19:05:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.646+0000 7fc84818f640 1 -- start start 2024-09-20T19:05:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.646+0000 7fc84818f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8401007f0 0x7fc84019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.646+0000 7fc84818f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8401067f0 0x7fc84019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.646+0000 7fc84818f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc84010dca0 con 0x7fc8401007f0 2024-09-20T19:05:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.646+0000 7fc84818f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc84010db20 con 0x7fc8401067f0 2024-09-20T19:05:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.646+0000 7fc845f2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8401007f0 0x7fc84019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.646+0000 7fc845f2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8401007f0 0x7fc84019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56354/0 (socket says 172.21.15.17:56354) 2024-09-20T19:05:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.646+0000 7fc845f2b640 1 -- 172.21.15.17:0/1477648062 learned_addr learned my addr 172.21.15.17:0/1477648062 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:05:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.647+0000 7fc84572a640 1 --2- 172.21.15.17:0/1477648062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8401067f0 0x7fc84019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.647+0000 7fc845f2b640 1 -- 172.21.15.17:0/1477648062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8401067f0 msgr2=0x7fc84019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.647+0000 7fc845f2b640 1 --2- 172.21.15.17:0/1477648062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8401067f0 0x7fc84019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.647+0000 7fc845f2b640 1 -- 172.21.15.17:0/1477648062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc840197750 con 0x7fc8401007f0 2024-09-20T19:05:36.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.647+0000 7fc84572a640 1 --2- 172.21.15.17:0/1477648062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8401067f0 0x7fc84019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:05:36.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.647+0000 7fc845f2b640 1 --2- 172.21.15.17:0/1477648062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8401007f0 0x7fc84019d680 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc83c031460 tx=0x7fc83c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:36.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.647+0000 7fc836ffd640 1 -- 172.21.15.17:0/1477648062 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc83c03f070 con 0x7fc8401007f0 2024-09-20T19:05:36.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.647+0000 7fc836ffd640 1 -- 172.21.15.17:0/1477648062 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc83c0035f0 con 0x7fc8401007f0 2024-09-20T19:05:36.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.647+0000 7fc84818f640 1 -- 172.21.15.17:0/1477648062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8401979e0 con 0x7fc8401007f0 2024-09-20T19:05:36.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.647+0000 7fc836ffd640 1 -- 172.21.15.17:0/1477648062 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc83c035030 con 0x7fc8401007f0 2024-09-20T19:05:36.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.647+0000 7fc84818f640 1 -- 172.21.15.17:0/1477648062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc840197ee0 con 0x7fc8401007f0 2024-09-20T19:05:36.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.648+0000 7fc84818f640 1 -- 172.21.15.17:0/1477648062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc840101f30 con 0x7fc8401007f0 2024-09-20T19:05:36.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.649+0000 7fc836ffd640 1 -- 172.21.15.17:0/1477648062 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc83c042070 con 0x7fc8401007f0 2024-09-20T19:05:36.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.650+0000 7fc836ffd640 1 --2- 172.21.15.17:0/1477648062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc82c07af80 0x7fc82c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:36.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.650+0000 7fc836ffd640 1 -- 172.21.15.17:0/1477648062 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fc83c0be9b0 con 0x7fc8401007f0 2024-09-20T19:05:36.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.650+0000 7fc84572a640 1 --2- 172.21.15.17:0/1477648062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc82c07af80 0x7fc82c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:36.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.650+0000 7fc84572a640 1 --2- 172.21.15.17:0/1477648062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc82c07af80 0x7fc82c07d440 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc840198fa0 tx=0x7fc83000b5f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:36.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.654+0000 7fc836ffd640 1 -- 172.21.15.17:0/1477648062 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc83c089f90 con 0x7fc8401007f0 2024-09-20T19:05:36.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.864+0000 7fc84818f640 1 -- 172.21.15.17:0/1477648062 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc840198250 con 0x7fc82c07af80 2024-09-20T19:05:36.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.865+0000 7fc836ffd640 1 -- 172.21.15.17:0/1477648062 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc840198250 con 0x7fc82c07af80 2024-09-20T19:05:36.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.867+0000 7fc84818f640 1 -- 172.21.15.17:0/1477648062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc82c07af80 msgr2=0x7fc82c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:36.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.867+0000 7fc84818f640 1 --2- 172.21.15.17:0/1477648062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc82c07af80 0x7fc82c07d440 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc840198fa0 tx=0x7fc83000b5f0 comp rx=0 tx=0).stop 2024-09-20T19:05:36.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.867+0000 7fc84818f640 1 -- 172.21.15.17:0/1477648062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8401007f0 msgr2=0x7fc84019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:36.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.867+0000 7fc84818f640 1 --2- 172.21.15.17:0/1477648062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8401007f0 0x7fc84019d680 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc83c031460 tx=0x7fc83c0045e0 comp rx=0 tx=0).stop 2024-09-20T19:05:36.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.867+0000 7fc84818f640 1 -- 172.21.15.17:0/1477648062 shutdown_connections 2024-09-20T19:05:36.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.867+0000 7fc84818f640 1 --2- 172.21.15.17:0/1477648062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc82c07af80 0x7fc82c07d440 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:36.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.867+0000 7fc84818f640 1 --2- 172.21.15.17:0/1477648062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8401067f0 0x7fc84019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:36.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.867+0000 7fc84818f640 1 --2- 172.21.15.17:0/1477648062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8401007f0 0x7fc84019d680 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:36.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.867+0000 7fc84818f640 1 -- 172.21.15.17:0/1477648062 >> 172.21.15.17:0/1477648062 conn(0x7fc8400fc550 msgr2=0x7fc840069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:36.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.867+0000 7fc84818f640 1 -- 172.21.15.17:0/1477648062 shutdown_connections 2024-09-20T19:05:36.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.867+0000 7fc84818f640 1 -- 172.21.15.17:0/1477648062 wait complete. 2024-09-20T19:05:36.881 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:05:36.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.954+0000 7f7117e12640 1 -- 172.21.15.17:0/1318908499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7110100250 msgr2=0x7f7110100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:36.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.954+0000 7f7117e12640 1 --2- 172.21.15.17:0/1318908499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7110100250 0x7f7110100630 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f710c00a990 tx=0x7f710c02b7d0 comp rx=0 tx=0).stop 2024-09-20T19:05:36.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.954+0000 7f7117e12640 1 -- 172.21.15.17:0/1318908499 shutdown_connections 2024-09-20T19:05:36.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.954+0000 7f7117e12640 1 --2- 172.21.15.17:0/1318908499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7110100c00 0x7f7110104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:36.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.954+0000 7f7117e12640 1 --2- 172.21.15.17:0/1318908499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7110100250 0x7f7110100630 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:36.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.954+0000 7f7117e12640 1 -- 172.21.15.17:0/1318908499 >> 172.21.15.17:0/1318908499 conn(0x7f71100fbc90 msgr2=0x7f71100fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:36.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.954+0000 7f7117e12640 1 -- 172.21.15.17:0/1318908499 shutdown_connections 2024-09-20T19:05:36.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.954+0000 7f7117e12640 1 -- 172.21.15.17:0/1318908499 wait complete. 2024-09-20T19:05:36.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.955+0000 7f7117e12640 1 Processor -- start 2024-09-20T19:05:36.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.955+0000 7f7117e12640 1 -- start start 2024-09-20T19:05:36.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.955+0000 7f7117e12640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7110100250 0x7f711019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:36.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.955+0000 7f7117e12640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7110100c00 0x7f711019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:36.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.955+0000 7f7117e12640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f711010cbd0 con 0x7f7110100c00 2024-09-20T19:05:36.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.955+0000 7f7117e12640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f711010ca50 con 0x7f7110100250 2024-09-20T19:05:36.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.955+0000 7f71153ad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7110100c00 0x7f711019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:36.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.956+0000 7f71153ad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7110100c00 0x7f711019db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56374/0 (socket says 172.21.15.17:56374) 2024-09-20T19:05:36.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.956+0000 7f71153ad640 1 -- 172.21.15.17:0/93255354 learned_addr learned my addr 172.21.15.17:0/93255354 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:05:36.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.956+0000 7f7115bae640 1 --2- 172.21.15.17:0/93255354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7110100250 0x7f711019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:36.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.956+0000 7f71153ad640 1 -- 172.21.15.17:0/93255354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7110100250 msgr2=0x7f711019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:36.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.956+0000 7f71153ad640 1 --2- 172.21.15.17:0/93255354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7110100250 0x7f711019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:36.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.956+0000 7f71153ad640 1 -- 172.21.15.17:0/93255354 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71101977a0 con 0x7f7110100c00 2024-09-20T19:05:36.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.956+0000 7f7115bae640 1 --2- 172.21.15.17:0/93255354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7110100250 0x7f711019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:05:36.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.956+0000 7f71153ad640 1 --2- 172.21.15.17:0/93255354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7110100c00 0x7f711019db60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f710000d6f0 tx=0x7f710000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:36.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.956+0000 7f7106ffd640 1 -- 172.21.15.17:0/93255354 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7100017070 con 0x7f7110100c00 2024-09-20T19:05:36.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.956+0000 7f7106ffd640 1 -- 172.21.15.17:0/93255354 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f710000de00 con 0x7f7110100c00 2024-09-20T19:05:36.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.956+0000 7f7117e12640 1 -- 172.21.15.17:0/93255354 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7110197a90 con 0x7f7110100c00 2024-09-20T19:05:36.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.956+0000 7f7106ffd640 1 -- 172.21.15.17:0/93255354 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7100004bb0 con 0x7f7110100c00 2024-09-20T19:05:36.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.956+0000 7f7117e12640 1 -- 172.21.15.17:0/93255354 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7110198020 con 0x7f7110100c00 2024-09-20T19:05:36.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.957+0000 7f7117e12640 1 -- 172.21.15.17:0/93255354 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7110101730 con 0x7f7110100c00 2024-09-20T19:05:36.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.958+0000 7f7106ffd640 1 -- 172.21.15.17:0/93255354 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7100004e60 con 0x7f7110100c00 2024-09-20T19:05:36.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.959+0000 7f7106ffd640 1 --2- 172.21.15.17:0/93255354 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f70fc07af30 0x7f70fc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:36.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.959+0000 7f7106ffd640 1 -- 172.21.15.17:0/93255354 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f710009dcf0 con 0x7f7110100c00 2024-09-20T19:05:36.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.959+0000 7f7115bae640 1 --2- 172.21.15.17:0/93255354 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f70fc07af30 0x7f70fc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:36.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.959+0000 7f7115bae640 1 --2- 172.21.15.17:0/93255354 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f70fc07af30 0x7f70fc07d3f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f710c000c00 tx=0x7f710c005b90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:36.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:36.963+0000 7f7106ffd640 1 -- 172.21.15.17:0/93255354 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7100069250 con 0x7f7110100c00 2024-09-20T19:05:37.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.168+0000 7f7117e12640 1 -- 172.21.15.17:0/93255354 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f71101982d0 con 0x7f70fc07af30 2024-09-20T19:05:37.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.169+0000 7f7106ffd640 1 -- 172.21.15.17:0/93255354 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f71101982d0 con 0x7f70fc07af30 2024-09-20T19:05:37.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.171+0000 7f7117e12640 1 -- 172.21.15.17:0/93255354 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f70fc07af30 msgr2=0x7f70fc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:37.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.171+0000 7f7117e12640 1 --2- 172.21.15.17:0/93255354 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f70fc07af30 0x7f70fc07d3f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f710c000c00 tx=0x7f710c005b90 comp rx=0 tx=0).stop 2024-09-20T19:05:37.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.171+0000 7f7117e12640 1 -- 172.21.15.17:0/93255354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7110100c00 msgr2=0x7f711019db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:37.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.171+0000 7f7117e12640 1 --2- 172.21.15.17:0/93255354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7110100c00 0x7f711019db60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f710000d6f0 tx=0x7f710000dbb0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.171+0000 7f7117e12640 1 -- 172.21.15.17:0/93255354 shutdown_connections 2024-09-20T19:05:37.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.171+0000 7f7117e12640 1 --2- 172.21.15.17:0/93255354 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f70fc07af30 0x7f70fc07d3f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.171+0000 7f7117e12640 1 --2- 172.21.15.17:0/93255354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7110100c00 0x7f711019db60 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.171+0000 7f7117e12640 1 --2- 172.21.15.17:0/93255354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7110100250 0x7f711019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.171+0000 7f7117e12640 1 -- 172.21.15.17:0/93255354 >> 172.21.15.17:0/93255354 conn(0x7f71100fbc90 msgr2=0x7f71100fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:37.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.172+0000 7f7117e12640 1 -- 172.21.15.17:0/93255354 shutdown_connections 2024-09-20T19:05:37.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.172+0000 7f7117e12640 1 -- 172.21.15.17:0/93255354 wait complete. 2024-09-20T19:05:37.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.256+0000 7faf10f21640 1 -- 172.21.15.17:0/3615038569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf0c101900 msgr2=0x7faf0c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:37.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.256+0000 7faf10f21640 1 --2- 172.21.15.17:0/3615038569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf0c101900 0x7faf0c101d60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7faef4009880 tx=0x7faef402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.256+0000 7faf10f21640 1 -- 172.21.15.17:0/3615038569 shutdown_connections 2024-09-20T19:05:37.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.256+0000 7faf10f21640 1 --2- 172.21.15.17:0/3615038569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf0c101900 0x7faf0c101d60 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.256+0000 7faf10f21640 1 --2- 172.21.15.17:0/3615038569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf0c107900 0x7faf0c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.256+0000 7faf10f21640 1 -- 172.21.15.17:0/3615038569 >> 172.21.15.17:0/3615038569 conn(0x7faf0c0fd600 msgr2=0x7faf0c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:37.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.256+0000 7faf10f21640 1 -- 172.21.15.17:0/3615038569 shutdown_connections 2024-09-20T19:05:37.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.256+0000 7faf10f21640 1 -- 172.21.15.17:0/3615038569 wait complete. 2024-09-20T19:05:37.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.257+0000 7faf10f21640 1 Processor -- start 2024-09-20T19:05:37.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.257+0000 7faf10f21640 1 -- start start 2024-09-20T19:05:37.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.257+0000 7faf10f21640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf0c101900 0x7faf0c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:37.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.257+0000 7faf10f21640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf0c107900 0x7faf0c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:37.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.258+0000 7faf10f21640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c10edd0 con 0x7faf0c101900 2024-09-20T19:05:37.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.258+0000 7faf10f21640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c10ec50 con 0x7faf0c107900 2024-09-20T19:05:37.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.258+0000 7faf0a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf0c101900 0x7faf0c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:37.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.258+0000 7faf0a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf0c101900 0x7faf0c19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56404/0 (socket says 172.21.15.17:56404) 2024-09-20T19:05:37.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.258+0000 7faf0a59c640 1 -- 172.21.15.17:0/832106112 learned_addr learned my addr 172.21.15.17:0/832106112 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:05:37.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.258+0000 7faf09d9b640 1 --2- 172.21.15.17:0/832106112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf0c107900 0x7faf0c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:37.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.258+0000 7faf0a59c640 1 -- 172.21.15.17:0/832106112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf0c107900 msgr2=0x7faf0c19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:37.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.258+0000 7faf0a59c640 1 --2- 172.21.15.17:0/832106112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf0c107900 0x7faf0c19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.258+0000 7faf0a59c640 1 -- 172.21.15.17:0/832106112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c197800 con 0x7faf0c101900 2024-09-20T19:05:37.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.258+0000 7faf0a59c640 1 --2- 172.21.15.17:0/832106112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf0c101900 0x7faf0c19d680 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7faefc00d6f0 tx=0x7faefc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:37.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.258+0000 7faf037fe640 1 -- 172.21.15.17:0/832106112 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faefc017070 con 0x7faf0c101900 2024-09-20T19:05:37.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.258+0000 7faf10f21640 1 -- 172.21.15.17:0/832106112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0c197af0 con 0x7faf0c101900 2024-09-20T19:05:37.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.258+0000 7faf037fe640 1 -- 172.21.15.17:0/832106112 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faefc00de00 con 0x7faf0c101900 2024-09-20T19:05:37.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.259+0000 7faf037fe640 1 -- 172.21.15.17:0/832106112 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faefc004bb0 con 0x7faf0c101900 2024-09-20T19:05:37.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.259+0000 7faf10f21640 1 -- 172.21.15.17:0/832106112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0c198050 con 0x7faf0c101900 2024-09-20T19:05:37.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.260+0000 7faf10f21640 1 -- 172.21.15.17:0/832106112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0c103040 con 0x7faf0c101900 2024-09-20T19:05:37.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.260+0000 7faf037fe640 1 -- 172.21.15.17:0/832106112 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7faefc004e60 con 0x7faf0c101900 2024-09-20T19:05:37.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.261+0000 7faf037fe640 1 --2- 172.21.15.17:0/832106112 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faef807af30 0x7faef807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:37.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.262+0000 7faf09d9b640 1 --2- 172.21.15.17:0/832106112 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faef807af30 0x7faef807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:37.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.262+0000 7faf037fe640 1 -- 172.21.15.17:0/832106112 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7faefc09db90 con 0x7faf0c101900 2024-09-20T19:05:37.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.262+0000 7faf09d9b640 1 --2- 172.21.15.17:0/832106112 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faef807af30 0x7faef807d3f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faf0c198b50 tx=0x7faef4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:37.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.266+0000 7faf037fe640 1 -- 172.21.15.17:0/832106112 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faefc069190 con 0x7faf0c101900 2024-09-20T19:05:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.464+0000 7faf10f21640 1 -- 172.21.15.17:0/832106112 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7faf0c198300 con 0x7faef807af30 2024-09-20T19:05:37.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.474+0000 7faf037fe640 1 -- 172.21.15.17:0/832106112 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7faf0c198300 con 0x7faef807af30 2024-09-20T19:05:37.479 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:05:37.479 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (26m) 5m ago 37m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:05:37.479 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (30m) 5m ago 38m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:05:37.479 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (29m) 5m ago 37m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:05:37.479 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (25m) 5m ago 38m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:05:37.479 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (25m) 5m ago 37m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:05:37.479 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (26m) 5m ago 37m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:05:37.479 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (21m) 5m ago 32m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:05:37.479 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (21m) 5m ago 32m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:05:37.480 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (5m) 5m ago 32m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:05:37.480 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (21m) 5m ago 32m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:05:37.480 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (29m) 5m ago 39m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:05:37.480 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (28m) 5m ago 37m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:05:37.480 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (25m) 5m ago 39m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:05:37.480 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (25m) 5m ago 37m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:05:37.480 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (27m) 5m ago 38m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:05:37.480 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (27m) 5m ago 37m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:05:37.480 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (24m) 5m ago 35m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:05:37.480 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (24m) 5m ago 35m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:05:37.480 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (23m) 5m ago 35m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:05:37.480 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (22m) 5m ago 34m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:05:37.480 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (22m) 5m ago 34m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:05:37.481 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (21m) 5m ago 33m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:05:37.481 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (27m) 5m ago 37m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:05:37.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.476+0000 7faf10f21640 1 -- 172.21.15.17:0/832106112 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faef807af30 msgr2=0x7faef807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:37.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.476+0000 7faf10f21640 1 --2- 172.21.15.17:0/832106112 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faef807af30 0x7faef807d3f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faf0c198b50 tx=0x7faef4031400 comp rx=0 tx=0).stop 2024-09-20T19:05:37.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.476+0000 7faf10f21640 1 -- 172.21.15.17:0/832106112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf0c101900 msgr2=0x7faf0c19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:37.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.476+0000 7faf10f21640 1 --2- 172.21.15.17:0/832106112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf0c101900 0x7faf0c19d680 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7faefc00d6f0 tx=0x7faefc00dbb0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.476+0000 7faf10f21640 1 -- 172.21.15.17:0/832106112 shutdown_connections 2024-09-20T19:05:37.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.476+0000 7faf10f21640 1 --2- 172.21.15.17:0/832106112 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faef807af30 0x7faef807d3f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.476+0000 7faf10f21640 1 --2- 172.21.15.17:0/832106112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf0c107900 0x7faf0c19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.476+0000 7faf10f21640 1 --2- 172.21.15.17:0/832106112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf0c101900 0x7faf0c19d680 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.476+0000 7faf10f21640 1 -- 172.21.15.17:0/832106112 >> 172.21.15.17:0/832106112 conn(0x7faf0c0fd600 msgr2=0x7faf0c0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:37.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.476+0000 7faf10f21640 1 -- 172.21.15.17:0/832106112 shutdown_connections 2024-09-20T19:05:37.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.476+0000 7faf10f21640 1 -- 172.21.15.17:0/832106112 wait complete. 2024-09-20T19:05:37.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.560+0000 7fbc9197c640 1 -- 172.21.15.17:0/594006715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc8c1067f0 msgr2=0x7fbc8c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:37.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.560+0000 7fbc9197c640 1 --2- 172.21.15.17:0/594006715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc8c1067f0 0x7fbc8c106bd0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c009880 tx=0x7fbc7c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.560+0000 7fbc9197c640 1 -- 172.21.15.17:0/594006715 shutdown_connections 2024-09-20T19:05:37.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.560+0000 7fbc9197c640 1 --2- 172.21.15.17:0/594006715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc8c1007f0 0x7fbc8c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.560+0000 7fbc9197c640 1 --2- 172.21.15.17:0/594006715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc8c1067f0 0x7fbc8c106bd0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.560+0000 7fbc9197c640 1 -- 172.21.15.17:0/594006715 >> 172.21.15.17:0/594006715 conn(0x7fbc8c0fc550 msgr2=0x7fbc8c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:37.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.560+0000 7fbc9197c640 1 -- 172.21.15.17:0/594006715 shutdown_connections 2024-09-20T19:05:37.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.560+0000 7fbc9197c640 1 -- 172.21.15.17:0/594006715 wait complete. 2024-09-20T19:05:37.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.561+0000 7fbc9197c640 1 Processor -- start 2024-09-20T19:05:37.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.561+0000 7fbc9197c640 1 -- start start 2024-09-20T19:05:37.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.561+0000 7fbc9197c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc8c1007f0 0x7fbc8c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:37.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.561+0000 7fbc9197c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc8c1067f0 0x7fbc8c19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:37.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.561+0000 7fbc9197c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c10dcc0 con 0x7fbc8c1067f0 2024-09-20T19:05:37.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.561+0000 7fbc9197c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c10db40 con 0x7fbc8c1007f0 2024-09-20T19:05:37.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.562+0000 7fbc8a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc8c1067f0 0x7fbc8c19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:37.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.562+0000 7fbc8a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc8c1067f0 0x7fbc8c19dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56420/0 (socket says 172.21.15.17:56420) 2024-09-20T19:05:37.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.562+0000 7fbc8a7fc640 1 -- 172.21.15.17:0/4060873451 learned_addr learned my addr 172.21.15.17:0/4060873451 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:05:37.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.562+0000 7fbc8affd640 1 --2- 172.21.15.17:0/4060873451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc8c1007f0 0x7fbc8c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:37.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.562+0000 7fbc8a7fc640 1 -- 172.21.15.17:0/4060873451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc8c1007f0 msgr2=0x7fbc8c19d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:37.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.562+0000 7fbc8a7fc640 1 --2- 172.21.15.17:0/4060873451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc8c1007f0 0x7fbc8c19d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.562+0000 7fbc8a7fc640 1 -- 172.21.15.17:0/4060873451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8c1977f0 con 0x7fbc8c1067f0 2024-09-20T19:05:37.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.562+0000 7fbc8a7fc640 1 --2- 172.21.15.17:0/4060873451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc8c1067f0 0x7fbc8c19dbb0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000ea00 tx=0x7fbc8000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:37.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.562+0000 7fbc9097a640 1 -- 172.21.15.17:0/4060873451 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc8000cb80 con 0x7fbc8c1067f0 2024-09-20T19:05:37.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.562+0000 7fbc9097a640 1 -- 172.21.15.17:0/4060873451 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc8000cd20 con 0x7fbc8c1067f0 2024-09-20T19:05:37.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.562+0000 7fbc9197c640 1 -- 172.21.15.17:0/4060873451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc8c197ae0 con 0x7fbc8c1067f0 2024-09-20T19:05:37.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.563+0000 7fbc9097a640 1 -- 172.21.15.17:0/4060873451 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc80011470 con 0x7fbc8c1067f0 2024-09-20T19:05:37.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.563+0000 7fbc9197c640 1 -- 172.21.15.17:0/4060873451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc8c198070 con 0x7fbc8c1067f0 2024-09-20T19:05:37.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.564+0000 7fbc9197c640 1 -- 172.21.15.17:0/4060873451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc8c101f30 con 0x7fbc8c1067f0 2024-09-20T19:05:37.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.565+0000 7fbc9097a640 1 -- 172.21.15.17:0/4060873451 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fbc80005020 con 0x7fbc8c1067f0 2024-09-20T19:05:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.565+0000 7fbc9097a640 1 --2- 172.21.15.17:0/4060873451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbc7407af30 0x7fbc7407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.565+0000 7fbc9097a640 1 -- 172.21.15.17:0/4060873451 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fbc8009e410 con 0x7fbc8c1067f0 2024-09-20T19:05:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.565+0000 7fbc8affd640 1 --2- 172.21.15.17:0/4060873451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbc7407af30 0x7fbc7407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:37.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.566+0000 7fbc8affd640 1 --2- 172.21.15.17:0/4060873451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbc7407af30 0x7fbc7407d3f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c0096c0 tx=0x7fbc7c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:37.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.570+0000 7fbc9097a640 1 -- 172.21.15.17:0/4060873451 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbc80016030 con 0x7fbc8c1067f0 2024-09-20T19:05:37.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.831+0000 7fbc9197c640 1 -- 172.21.15.17:0/4060873451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fbc8c109d70 con 0x7fbc8c1067f0 2024-09-20T19:05:37.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.832+0000 7fbc9097a640 1 -- 172.21.15.17:0/4060873451 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fbc80069a10 con 0x7fbc8c1067f0 2024-09-20T19:05:37.837 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:05:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:05:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:05:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:05:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:05:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:05:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:05:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:05:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:05:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:05:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:05:37.837 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:05:37.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:05:37.838 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:05:37.838 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:05:37.838 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:05:37.838 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:05:37.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.834+0000 7fbc9197c640 1 -- 172.21.15.17:0/4060873451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbc7407af30 msgr2=0x7fbc7407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:37.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.834+0000 7fbc9197c640 1 --2- 172.21.15.17:0/4060873451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbc7407af30 0x7fbc7407d3f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c0096c0 tx=0x7fbc7c031400 comp rx=0 tx=0).stop 2024-09-20T19:05:37.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.834+0000 7fbc9197c640 1 -- 172.21.15.17:0/4060873451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc8c1067f0 msgr2=0x7fbc8c19dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:37.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.834+0000 7fbc9197c640 1 --2- 172.21.15.17:0/4060873451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc8c1067f0 0x7fbc8c19dbb0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000ea00 tx=0x7fbc8000eec0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.834+0000 7fbc9197c640 1 -- 172.21.15.17:0/4060873451 shutdown_connections 2024-09-20T19:05:37.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.834+0000 7fbc9197c640 1 --2- 172.21.15.17:0/4060873451 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fbc7407af30 0x7fbc7407d3f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.834+0000 7fbc9197c640 1 --2- 172.21.15.17:0/4060873451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc8c1067f0 0x7fbc8c19dbb0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.834+0000 7fbc9197c640 1 --2- 172.21.15.17:0/4060873451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc8c1007f0 0x7fbc8c19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.834+0000 7fbc9197c640 1 -- 172.21.15.17:0/4060873451 >> 172.21.15.17:0/4060873451 conn(0x7fbc8c0fc550 msgr2=0x7fbc8c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:37.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.834+0000 7fbc9197c640 1 -- 172.21.15.17:0/4060873451 shutdown_connections 2024-09-20T19:05:37.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.834+0000 7fbc9197c640 1 -- 172.21.15.17:0/4060873451 wait complete. 2024-09-20T19:05:37.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.919+0000 7fe12792c640 1 -- 172.21.15.17:0/3058398171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe120102ab0 msgr2=0x7fe120102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:37.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.919+0000 7fe12792c640 1 --2- 172.21.15.17:0/3058398171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe120102ab0 0x7fe120102e90 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe110009c20 tx=0x7fe11002aa00 comp rx=0 tx=0).stop 2024-09-20T19:05:37.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.919+0000 7fe12792c640 1 -- 172.21.15.17:0/3058398171 shutdown_connections 2024-09-20T19:05:37.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.919+0000 7fe12792c640 1 --2- 172.21.15.17:0/3058398171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1201033d0 0x7fe12010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.919+0000 7fe12792c640 1 --2- 172.21.15.17:0/3058398171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe120102ab0 0x7fe120102e90 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.919+0000 7fe12792c640 1 -- 172.21.15.17:0/3058398171 >> 172.21.15.17:0/3058398171 conn(0x7fe1200fc550 msgr2=0x7fe1200fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:37.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.919+0000 7fe12792c640 1 -- 172.21.15.17:0/3058398171 shutdown_connections 2024-09-20T19:05:37.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.919+0000 7fe12792c640 1 -- 172.21.15.17:0/3058398171 wait complete. 2024-09-20T19:05:37.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.919+0000 7fe12792c640 1 Processor -- start 2024-09-20T19:05:37.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.919+0000 7fe12792c640 1 -- start start 2024-09-20T19:05:37.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.920+0000 7fe12792c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe120102ab0 0x7fe12019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:37.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.920+0000 7fe12792c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1201033d0 0x7fe12019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:37.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.920+0000 7fe12792c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe12010edc0 con 0x7fe120102ab0 2024-09-20T19:05:37.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.920+0000 7fe12792c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe12010ec40 con 0x7fe1201033d0 2024-09-20T19:05:37.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.920+0000 7fe1256c8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe120102ab0 0x7fe12019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:37.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.920+0000 7fe1256c8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe120102ab0 0x7fe12019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56444/0 (socket says 172.21.15.17:56444) 2024-09-20T19:05:37.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.920+0000 7fe1256c8640 1 -- 172.21.15.17:0/3909882292 learned_addr learned my addr 172.21.15.17:0/3909882292 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:05:37.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.920+0000 7fe124ec7640 1 --2- 172.21.15.17:0/3909882292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1201033d0 0x7fe12019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:37.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.920+0000 7fe1256c8640 1 -- 172.21.15.17:0/3909882292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1201033d0 msgr2=0x7fe12019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:37.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.920+0000 7fe1256c8640 1 --2- 172.21.15.17:0/3909882292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1201033d0 0x7fe12019db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:37.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.920+0000 7fe1256c8640 1 -- 172.21.15.17:0/3909882292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1201977b0 con 0x7fe120102ab0 2024-09-20T19:05:37.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.920+0000 7fe1256c8640 1 --2- 172.21.15.17:0/3909882292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe120102ab0 0x7fe12019d630 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe110006010 tx=0x7fe11002ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:37.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.920+0000 7fe11e7fc640 1 -- 172.21.15.17:0/3909882292 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe110047070 con 0x7fe120102ab0 2024-09-20T19:05:37.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.920+0000 7fe11e7fc640 1 -- 172.21.15.17:0/3909882292 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe110003e30 con 0x7fe120102ab0 2024-09-20T19:05:37.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.920+0000 7fe12792c640 1 -- 172.21.15.17:0/3909882292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe120197a40 con 0x7fe120102ab0 2024-09-20T19:05:37.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.921+0000 7fe11e7fc640 1 -- 172.21.15.17:0/3909882292 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe110033050 con 0x7fe120102ab0 2024-09-20T19:05:37.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.921+0000 7fe12792c640 1 -- 172.21.15.17:0/3909882292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe120197f70 con 0x7fe120102ab0 2024-09-20T19:05:37.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.921+0000 7fe12792c640 1 -- 172.21.15.17:0/3909882292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe12006a580 con 0x7fe120102ab0 2024-09-20T19:05:37.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.922+0000 7fe11e7fc640 1 -- 172.21.15.17:0/3909882292 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe11004a070 con 0x7fe120102ab0 2024-09-20T19:05:37.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.923+0000 7fe11e7fc640 1 --2- 172.21.15.17:0/3909882292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe10807af40 0x7fe10807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:37.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.923+0000 7fe11e7fc640 1 -- 172.21.15.17:0/3909882292 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fe11003e030 con 0x7fe120102ab0 2024-09-20T19:05:37.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.923+0000 7fe124ec7640 1 --2- 172.21.15.17:0/3909882292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe10807af40 0x7fe10807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:37.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.923+0000 7fe124ec7640 1 --2- 172.21.15.17:0/3909882292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe10807af40 0x7fe10807d400 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe1200ff010 tx=0x7fe11400b2e0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:37.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:37.927+0000 7fe11e7fc640 1 -- 172.21.15.17:0/3909882292 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe11002ee90 con 0x7fe120102ab0 2024-09-20T19:05:38.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:37 smithi017 ceph-mon[108970]: pgmap v907: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:38.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:37 smithi017 ceph-mon[108970]: from='client.35464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:38.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:05:38.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:37 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4060873451' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:05:38.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.160+0000 7fe12792c640 1 -- 172.21.15.17:0/3909882292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe120105f80 con 0x7fe120102ab0 2024-09-20T19:05:38.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.161+0000 7fe11e7fc640 1 -- 172.21.15.17:0/3909882292 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7fe11008a6c0 con 0x7fe120102ab0 2024-09-20T19:05:38.166 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:05:38.166 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:05:38.166 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:05:38.166 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:05:38.166 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:05:38.166 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:05:38.166 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:05:38.166 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:05:38.166 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:05:38.166 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:05:38.166 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:05:38.167 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:05:38.167 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:05:38.167 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:05:38.167 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:05:38.167 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:05:38.167 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:05:38.167 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:05:38.167 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:05:38.167 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:05:38.167 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:05:38.167 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:05:38.167 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:05:38.167 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:05:38.167 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:05:38.168 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:05:38.168 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:05:38.168 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:05:38.168 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:05:38.168 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:05:38.168 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:05:38.168 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:05:38.168 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:05:38.168 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:05:38.168 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:05:38.168 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:05:38.168 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:05:38.168 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:05:38.168 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:05:38.168 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:05:38.169 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:05:38.169 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:05:38.169 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:05:38.169 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:05:38.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.163+0000 7fe12792c640 1 -- 172.21.15.17:0/3909882292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe10807af40 msgr2=0x7fe10807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:38.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.163+0000 7fe12792c640 1 --2- 172.21.15.17:0/3909882292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe10807af40 0x7fe10807d400 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe1200ff010 tx=0x7fe11400b2e0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.163+0000 7fe12792c640 1 -- 172.21.15.17:0/3909882292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe120102ab0 msgr2=0x7fe12019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.163+0000 7fe12792c640 1 --2- 172.21.15.17:0/3909882292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe120102ab0 0x7fe12019d630 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe110006010 tx=0x7fe11002ed20 comp rx=0 tx=0).stop 2024-09-20T19:05:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.163+0000 7fe12792c640 1 -- 172.21.15.17:0/3909882292 shutdown_connections 2024-09-20T19:05:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.163+0000 7fe12792c640 1 --2- 172.21.15.17:0/3909882292 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe10807af40 0x7fe10807d400 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.163+0000 7fe12792c640 1 --2- 172.21.15.17:0/3909882292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1201033d0 0x7fe12019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.163+0000 7fe12792c640 1 --2- 172.21.15.17:0/3909882292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe120102ab0 0x7fe12019d630 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.163+0000 7fe12792c640 1 -- 172.21.15.17:0/3909882292 >> 172.21.15.17:0/3909882292 conn(0x7fe1200fc550 msgr2=0x7fe120108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.163+0000 7fe12792c640 1 -- 172.21.15.17:0/3909882292 shutdown_connections 2024-09-20T19:05:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.163+0000 7fe12792c640 1 -- 172.21.15.17:0/3909882292 wait complete. 2024-09-20T19:05:38.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:37 smithi172 ceph-mon[80431]: pgmap v907: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:38.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:37 smithi172 ceph-mon[80431]: from='client.35464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:38.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:05:38.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:37 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4060873451' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:05:38.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.248+0000 7f885f1ae640 1 -- 172.21.15.17:0/3022254553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8858106800 msgr2=0x7f8858106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:38.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.248+0000 7f885f1ae640 1 --2- 172.21.15.17:0/3022254553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8858106800 0x7f8858106be0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8850009c20 tx=0x7f885002a970 comp rx=0 tx=0).stop 2024-09-20T19:05:38.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.248+0000 7f885f1ae640 1 -- 172.21.15.17:0/3022254553 shutdown_connections 2024-09-20T19:05:38.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.248+0000 7f885f1ae640 1 --2- 172.21.15.17:0/3022254553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8858100800 0x7f8858100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.248+0000 7f885f1ae640 1 --2- 172.21.15.17:0/3022254553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8858106800 0x7f8858106be0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.248+0000 7f885f1ae640 1 -- 172.21.15.17:0/3022254553 >> 172.21.15.17:0/3022254553 conn(0x7f88580fc520 msgr2=0x7f88580fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:38.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.248+0000 7f885f1ae640 1 -- 172.21.15.17:0/3022254553 shutdown_connections 2024-09-20T19:05:38.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.248+0000 7f885f1ae640 1 -- 172.21.15.17:0/3022254553 wait complete. 2024-09-20T19:05:38.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.249+0000 7f885f1ae640 1 Processor -- start 2024-09-20T19:05:38.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.249+0000 7f885f1ae640 1 -- start start 2024-09-20T19:05:38.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.249+0000 7f885f1ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8858100800 0x7f885819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:38.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.249+0000 7f885f1ae640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8858106800 0x7f885819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:38.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.249+0000 7f885f1ae640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f885810dcb0 con 0x7f8858100800 2024-09-20T19:05:38.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.249+0000 7f885f1ae640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f885810db30 con 0x7f8858106800 2024-09-20T19:05:38.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.249+0000 7f885cf4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8858100800 0x7f885819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:38.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.249+0000 7f885cf4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8858100800 0x7f885819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56466/0 (socket says 172.21.15.17:56466) 2024-09-20T19:05:38.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.249+0000 7f885cf4a640 1 -- 172.21.15.17:0/494197293 learned_addr learned my addr 172.21.15.17:0/494197293 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:05:38.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.249+0000 7f8857fff640 1 --2- 172.21.15.17:0/494197293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8858106800 0x7f885819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:38.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.250+0000 7f885cf4a640 1 -- 172.21.15.17:0/494197293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8858106800 msgr2=0x7f885819dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:38.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.250+0000 7f885cf4a640 1 --2- 172.21.15.17:0/494197293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8858106800 0x7f885819dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.250+0000 7f885cf4a640 1 -- 172.21.15.17:0/494197293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8858197820 con 0x7f8858100800 2024-09-20T19:05:38.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.250+0000 7f8857fff640 1 --2- 172.21.15.17:0/494197293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8858106800 0x7f885819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:05:38.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.250+0000 7f885cf4a640 1 --2- 172.21.15.17:0/494197293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8858100800 0x7f885819d6a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8850005cc0 tx=0x7f885002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:38.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.250+0000 7f8855ffb640 1 -- 172.21.15.17:0/494197293 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8850047070 con 0x7f8858100800 2024-09-20T19:05:38.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.250+0000 7f885f1ae640 1 -- 172.21.15.17:0/494197293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8858197ab0 con 0x7f8858100800 2024-09-20T19:05:38.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.250+0000 7f8855ffb640 1 -- 172.21.15.17:0/494197293 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f885002f7e0 con 0x7f8858100800 2024-09-20T19:05:38.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.250+0000 7f8855ffb640 1 -- 172.21.15.17:0/494197293 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8850034070 con 0x7f8858100800 2024-09-20T19:05:38.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.250+0000 7f885f1ae640 1 -- 172.21.15.17:0/494197293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8858197fe0 con 0x7f8858100800 2024-09-20T19:05:38.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.251+0000 7f885f1ae640 1 -- 172.21.15.17:0/494197293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8858101f40 con 0x7f8858100800 2024-09-20T19:05:38.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.252+0000 7f8855ffb640 1 -- 172.21.15.17:0/494197293 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f885004a070 con 0x7f8858100800 2024-09-20T19:05:38.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.252+0000 7f8855ffb640 1 --2- 172.21.15.17:0/494197293 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f884407af30 0x7f884407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:38.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.253+0000 7f8855ffb640 1 -- 172.21.15.17:0/494197293 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f88500beee0 con 0x7f8858100800 2024-09-20T19:05:38.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.253+0000 7f8857fff640 1 --2- 172.21.15.17:0/494197293 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f884407af30 0x7f884407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:38.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.253+0000 7f8857fff640 1 --2- 172.21.15.17:0/494197293 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f884407af30 0x7f884407d3f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f88580ffb10 tx=0x7f884800a5c0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:38.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.257+0000 7f8855ffb640 1 -- 172.21.15.17:0/494197293 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f885003f070 con 0x7f8858100800 2024-09-20T19:05:38.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.459+0000 7f885f1ae640 1 -- 172.21.15.17:0/494197293 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8858198350 con 0x7f884407af30 2024-09-20T19:05:38.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.460+0000 7f8855ffb640 1 -- 172.21.15.17:0/494197293 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8858198350 con 0x7f884407af30 2024-09-20T19:05:38.465 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:05:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:05:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:05:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:05:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:05:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:05:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:05:38.465 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:05:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:05:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:05:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:05:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:05:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:05:38.466 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:05:38.466 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:05:38.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.462+0000 7f885f1ae640 1 -- 172.21.15.17:0/494197293 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f884407af30 msgr2=0x7f884407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:38.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.462+0000 7f885f1ae640 1 --2- 172.21.15.17:0/494197293 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f884407af30 0x7f884407d3f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f88580ffb10 tx=0x7f884800a5c0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.462+0000 7f885f1ae640 1 -- 172.21.15.17:0/494197293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8858100800 msgr2=0x7f885819d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:38.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.462+0000 7f885f1ae640 1 --2- 172.21.15.17:0/494197293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8858100800 0x7f885819d6a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8850005cc0 tx=0x7f885002f5f0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.462+0000 7f885f1ae640 1 -- 172.21.15.17:0/494197293 shutdown_connections 2024-09-20T19:05:38.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.462+0000 7f885f1ae640 1 --2- 172.21.15.17:0/494197293 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f884407af30 0x7f884407d3f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.462+0000 7f885f1ae640 1 --2- 172.21.15.17:0/494197293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8858106800 0x7f885819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.462+0000 7f885f1ae640 1 --2- 172.21.15.17:0/494197293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8858100800 0x7f885819d6a0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.462+0000 7f885f1ae640 1 -- 172.21.15.17:0/494197293 >> 172.21.15.17:0/494197293 conn(0x7f88580fc520 msgr2=0x7f885806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:38.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.463+0000 7f885f1ae640 1 -- 172.21.15.17:0/494197293 shutdown_connections 2024-09-20T19:05:38.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.463+0000 7f885f1ae640 1 -- 172.21.15.17:0/494197293 wait complete. 2024-09-20T19:05:38.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.546+0000 7fb7dba88640 1 -- 172.21.15.17:0/1519138810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7d41033e0 msgr2=0x7fb7d410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:38.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.546+0000 7fb7dba88640 1 --2- 172.21.15.17:0/1519138810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7d41033e0 0x7fb7d410b8d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4009880 tx=0x7fb7c402a530 comp rx=0 tx=0).stop 2024-09-20T19:05:38.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.546+0000 7fb7dba88640 1 -- 172.21.15.17:0/1519138810 shutdown_connections 2024-09-20T19:05:38.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.546+0000 7fb7dba88640 1 --2- 172.21.15.17:0/1519138810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7d41033e0 0x7fb7d410b8d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.546+0000 7fb7dba88640 1 --2- 172.21.15.17:0/1519138810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7d4102ac0 0x7fb7d4102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.546+0000 7fb7dba88640 1 -- 172.21.15.17:0/1519138810 >> 172.21.15.17:0/1519138810 conn(0x7fb7d40fc520 msgr2=0x7fb7d40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:38.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.546+0000 7fb7dba88640 1 -- 172.21.15.17:0/1519138810 shutdown_connections 2024-09-20T19:05:38.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.546+0000 7fb7dba88640 1 -- 172.21.15.17:0/1519138810 wait complete. 2024-09-20T19:05:38.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.547+0000 7fb7dba88640 1 Processor -- start 2024-09-20T19:05:38.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.547+0000 7fb7dba88640 1 -- start start 2024-09-20T19:05:38.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.547+0000 7fb7dba88640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7d4102ac0 0x7fb7d419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:38.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.547+0000 7fb7dba88640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7d41033e0 0x7fb7d419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:38.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.547+0000 7fb7dba88640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d410edd0 con 0x7fb7d41033e0 2024-09-20T19:05:38.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.547+0000 7fb7dba88640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d410ec50 con 0x7fb7d4102ac0 2024-09-20T19:05:38.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.547+0000 7fb7d9023640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7d41033e0 0x7fb7d419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:38.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.548+0000 7fb7d9023640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7d41033e0 0x7fb7d419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56496/0 (socket says 172.21.15.17:56496) 2024-09-20T19:05:38.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.548+0000 7fb7d9023640 1 -- 172.21.15.17:0/3173591549 learned_addr learned my addr 172.21.15.17:0/3173591549 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:05:38.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.548+0000 7fb7d9824640 1 --2- 172.21.15.17:0/3173591549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7d4102ac0 0x7fb7d419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:38.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.548+0000 7fb7d9023640 1 -- 172.21.15.17:0/3173591549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7d4102ac0 msgr2=0x7fb7d419d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:38.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.548+0000 7fb7d9023640 1 --2- 172.21.15.17:0/3173591549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7d4102ac0 0x7fb7d419d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.548+0000 7fb7d9023640 1 -- 172.21.15.17:0/3173591549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d41977e0 con 0x7fb7d41033e0 2024-09-20T19:05:38.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.548+0000 7fb7d9824640 1 --2- 172.21.15.17:0/3173591549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7d4102ac0 0x7fb7d419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:05:38.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.548+0000 7fb7d9023640 1 --2- 172.21.15.17:0/3173591549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7d41033e0 0x7fb7d419dba0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4031460 tx=0x7fb7c4004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:38.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.548+0000 7fb7caffd640 1 -- 172.21.15.17:0/3173591549 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7c403f070 con 0x7fb7d41033e0 2024-09-20T19:05:38.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.548+0000 7fb7caffd640 1 -- 172.21.15.17:0/3173591549 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7c4004a90 con 0x7fb7d41033e0 2024-09-20T19:05:38.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.548+0000 7fb7dba88640 1 -- 172.21.15.17:0/3173591549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7d4197a70 con 0x7fb7d41033e0 2024-09-20T19:05:38.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.548+0000 7fb7caffd640 1 -- 172.21.15.17:0/3173591549 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7c4035030 con 0x7fb7d41033e0 2024-09-20T19:05:38.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.548+0000 7fb7dba88640 1 -- 172.21.15.17:0/3173591549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d4197fa0 con 0x7fb7d41033e0 2024-09-20T19:05:38.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.549+0000 7fb7dba88640 1 -- 172.21.15.17:0/3173591549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7d406aa90 con 0x7fb7d41033e0 2024-09-20T19:05:38.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.550+0000 7fb7caffd640 1 -- 172.21.15.17:0/3173591549 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb7c4042070 con 0x7fb7d41033e0 2024-09-20T19:05:38.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.551+0000 7fb7caffd640 1 --2- 172.21.15.17:0/3173591549 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7c007af90 0x7fb7c007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:05:38.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.551+0000 7fb7caffd640 1 -- 172.21.15.17:0/3173591549 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fb7c40beb20 con 0x7fb7d41033e0 2024-09-20T19:05:38.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.551+0000 7fb7d9824640 1 --2- 172.21.15.17:0/3173591549 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7c007af90 0x7fb7c007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:05:38.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.551+0000 7fb7d9824640 1 --2- 172.21.15.17:0/3173591549 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7c007af90 0x7fb7c007d450 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb7d00058c0 tx=0x7fb7d0005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:05:38.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.555+0000 7fb7caffd640 1 -- 172.21.15.17:0/3173591549 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7c408a100 con 0x7fb7d41033e0 2024-09-20T19:05:38.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.817+0000 7fb7dba88640 1 -- 172.21.15.17:0/3173591549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fb7d4105f60 con 0x7fb7d41033e0 2024-09-20T19:05:38.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.817+0000 7fb7caffd640 1 -- 172.21.15.17:0/3173591549 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fb7c408efb0 con 0x7fb7d41033e0 2024-09-20T19:05:38.822 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:05:38.823 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:05:38.823 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:05:38.823 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:05:38.823 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:05:38.823 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:05:38.823 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:05:38.823 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:05:38.823 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:05:38.823 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:05:38.823 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:05:38.824 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:05:38.824 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:05:38.824 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:05:38.824 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:05:38.824 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:05:38.824 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:05:38.824 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:05:38.824 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:05:38.824 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:05:38.824 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:05:38.824 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:05:38.824 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:05:38.825 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:05:38.825 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:05:38.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.819+0000 7fb7dba88640 1 -- 172.21.15.17:0/3173591549 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7c007af90 msgr2=0x7fb7c007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:38.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.819+0000 7fb7dba88640 1 --2- 172.21.15.17:0/3173591549 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7c007af90 0x7fb7c007d450 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb7d00058c0 tx=0x7fb7d0005850 comp rx=0 tx=0).stop 2024-09-20T19:05:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.819+0000 7fb7dba88640 1 -- 172.21.15.17:0/3173591549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7d41033e0 msgr2=0x7fb7d419dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:05:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.819+0000 7fb7dba88640 1 --2- 172.21.15.17:0/3173591549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7d41033e0 0x7fb7d419dba0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4031460 tx=0x7fb7c4004530 comp rx=0 tx=0).stop 2024-09-20T19:05:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.820+0000 7fb7dba88640 1 -- 172.21.15.17:0/3173591549 shutdown_connections 2024-09-20T19:05:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.820+0000 7fb7dba88640 1 --2- 172.21.15.17:0/3173591549 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7c007af90 0x7fb7c007d450 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.820+0000 7fb7dba88640 1 --2- 172.21.15.17:0/3173591549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7d41033e0 0x7fb7d419dba0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.820+0000 7fb7dba88640 1 --2- 172.21.15.17:0/3173591549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7d4102ac0 0x7fb7d419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:05:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.820+0000 7fb7dba88640 1 -- 172.21.15.17:0/3173591549 >> 172.21.15.17:0/3173591549 conn(0x7fb7d40fc520 msgr2=0x7fb7d4108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:05:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.820+0000 7fb7dba88640 1 -- 172.21.15.17:0/3173591549 shutdown_connections 2024-09-20T19:05:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:05:38.820+0000 7fb7dba88640 1 -- 172.21.15.17:0/3173591549 wait complete. 2024-09-20T19:05:39.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:38 smithi017 ceph-mon[108970]: from='client.35468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:39.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:38 smithi017 ceph-mon[108970]: from='client.35472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:39.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:38 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3909882292' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:05:39.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:38 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3173591549' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:05:39.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:38 smithi172 ceph-mon[80431]: from='client.35468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:39.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:38 smithi172 ceph-mon[80431]: from='client.35472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:39.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:38 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3909882292' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:05:39.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:38 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3173591549' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:05:40.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:39 smithi017 ceph-mon[108970]: from='client.35484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:40.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:39 smithi017 ceph-mon[108970]: pgmap v908: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:40.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:39 smithi172 ceph-mon[80431]: from='client.35484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:05:40.450 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:39 smithi172 ceph-mon[80431]: pgmap v908: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:42.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:41 smithi017 ceph-mon[108970]: pgmap v909: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:42.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:41 smithi172 ceph-mon[80431]: pgmap v909: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:44.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:43 smithi017 ceph-mon[108970]: pgmap v910: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:44.450 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:43 smithi172 ceph-mon[80431]: pgmap v910: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:46.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:45 smithi172 ceph-mon[80431]: pgmap v911: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:46.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:45 smithi017 ceph-mon[108970]: pgmap v911: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:48.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:47 smithi017 ceph-mon[108970]: pgmap v912: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:48.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:47 smithi172 ceph-mon[80431]: pgmap v912: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:50.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:49 smithi017 ceph-mon[108970]: pgmap v913: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:50.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:49 smithi172 ceph-mon[80431]: pgmap v913: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:52.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:51 smithi017 ceph-mon[108970]: pgmap v914: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:52.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:51 smithi172 ceph-mon[80431]: pgmap v914: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:53.351 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:05:53.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:05:54.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:53 smithi017 ceph-mon[108970]: pgmap v915: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:54.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:53 smithi172 ceph-mon[80431]: pgmap v915: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:56.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:55 smithi017 ceph-mon[108970]: pgmap v916: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:56.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:55 smithi172 ceph-mon[80431]: pgmap v916: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:58.290 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:57 smithi017 ceph-mon[108970]: pgmap v917: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:05:58.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:57 smithi172 ceph-mon[80431]: pgmap v917: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:00.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:05:59 smithi017 ceph-mon[108970]: pgmap v918: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:00.450 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:05:59 smithi172 ceph-mon[80431]: pgmap v918: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:02.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:01 smithi017 ceph-mon[108970]: pgmap v919: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:02.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:01 smithi172 ceph-mon[80431]: pgmap v919: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:04.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:03 smithi017 ceph-mon[108970]: pgmap v920: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:04.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:03 smithi172 ceph-mon[80431]: pgmap v920: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:06.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:05 smithi017 ceph-mon[108970]: pgmap v921: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:06.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:05 smithi172 ceph-mon[80431]: pgmap v921: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:08.391 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:07 smithi017 ceph-mon[108970]: pgmap v922: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:08.391 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:06:08.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:07 smithi172 ceph-mon[80431]: pgmap v922: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:08.450 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:06:08.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.913+0000 7f720d3cf640 1 -- 172.21.15.17:0/2778572516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72081033e0 msgr2=0x7f720810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:08.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.913+0000 7f720d3cf640 1 --2- 172.21.15.17:0/2778572516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72081033e0 0x7f720810b8d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009880 tx=0x7f71fc02a530 comp rx=0 tx=0).stop 2024-09-20T19:06:08.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.913+0000 7f720d3cf640 1 -- 172.21.15.17:0/2778572516 shutdown_connections 2024-09-20T19:06:08.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.913+0000 7f720d3cf640 1 --2- 172.21.15.17:0/2778572516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72081033e0 0x7f720810b8d0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:08.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.913+0000 7f720d3cf640 1 --2- 172.21.15.17:0/2778572516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7208102ac0 0x7f7208102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:08.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.913+0000 7f720d3cf640 1 -- 172.21.15.17:0/2778572516 >> 172.21.15.17:0/2778572516 conn(0x7f72080fc520 msgr2=0x7f72080fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:08.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.913+0000 7f720d3cf640 1 -- 172.21.15.17:0/2778572516 shutdown_connections 2024-09-20T19:06:08.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.913+0000 7f720d3cf640 1 -- 172.21.15.17:0/2778572516 wait complete. 2024-09-20T19:06:08.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.914+0000 7f720d3cf640 1 Processor -- start 2024-09-20T19:06:08.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.914+0000 7f720d3cf640 1 -- start start 2024-09-20T19:06:08.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.914+0000 7f720d3cf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7208102ac0 0x7f720819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:08.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.914+0000 7f720d3cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72081033e0 0x7f720819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:08.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.914+0000 7f720d3cf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f720810edf0 con 0x7f72081033e0 2024-09-20T19:06:08.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.914+0000 7f720d3cf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f720810ec70 con 0x7f7208102ac0 2024-09-20T19:06:08.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.914+0000 7f72067fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72081033e0 0x7f720819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:08.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.914+0000 7f72067fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72081033e0 0x7f720819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41148/0 (socket says 172.21.15.17:41148) 2024-09-20T19:06:08.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.914+0000 7f72067fc640 1 -- 172.21.15.17:0/4091400586 learned_addr learned my addr 172.21.15.17:0/4091400586 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:06:08.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.915+0000 7f7206ffd640 1 --2- 172.21.15.17:0/4091400586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7208102ac0 0x7f720819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:08.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.915+0000 7f72067fc640 1 -- 172.21.15.17:0/4091400586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7208102ac0 msgr2=0x7f720819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:08.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.915+0000 7f72067fc640 1 --2- 172.21.15.17:0/4091400586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7208102ac0 0x7f720819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:08.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.915+0000 7f72067fc640 1 -- 172.21.15.17:0/4091400586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7208197820 con 0x7f72081033e0 2024-09-20T19:06:08.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.915+0000 7f72067fc640 1 --2- 172.21.15.17:0/4091400586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72081033e0 0x7f720819dbe0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f71fc031460 tx=0x7f71fc004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:08.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.915+0000 7f71effff640 1 -- 172.21.15.17:0/4091400586 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f71fc03f070 con 0x7f72081033e0 2024-09-20T19:06:08.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.915+0000 7f71effff640 1 -- 172.21.15.17:0/4091400586 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f71fc0035f0 con 0x7f72081033e0 2024-09-20T19:06:08.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.915+0000 7f720d3cf640 1 -- 172.21.15.17:0/4091400586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7208197ab0 con 0x7f72081033e0 2024-09-20T19:06:08.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.915+0000 7f71effff640 1 -- 172.21.15.17:0/4091400586 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f71fc035030 con 0x7f72081033e0 2024-09-20T19:06:08.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.915+0000 7f720d3cf640 1 -- 172.21.15.17:0/4091400586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7208197fe0 con 0x7f72081033e0 2024-09-20T19:06:08.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.917+0000 7f720d3cf640 1 -- 172.21.15.17:0/4091400586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f720806aa90 con 0x7f72081033e0 2024-09-20T19:06:08.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.917+0000 7f71effff640 1 -- 172.21.15.17:0/4091400586 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f71fc042070 con 0x7f72081033e0 2024-09-20T19:06:08.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.918+0000 7f71effff640 1 --2- 172.21.15.17:0/4091400586 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f71f007af30 0x7f71f007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:08.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.918+0000 7f71effff640 1 -- 172.21.15.17:0/4091400586 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f71fc0be900 con 0x7f72081033e0 2024-09-20T19:06:08.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.918+0000 7f7206ffd640 1 --2- 172.21.15.17:0/4091400586 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f71f007af30 0x7f71f007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:08.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.919+0000 7f7206ffd640 1 --2- 172.21.15.17:0/4091400586 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f71f007af30 0x7f71f007d3f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f71f8005fd0 tx=0x7f71f800b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:08.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:08.923+0000 7f71effff640 1 -- 172.21.15.17:0/4091400586 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71fc089f00 con 0x7f72081033e0 2024-09-20T19:06:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.127+0000 7f720d3cf640 1 -- 172.21.15.17:0/4091400586 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7208198350 con 0x7f71f007af30 2024-09-20T19:06:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.129+0000 7f71effff640 1 -- 172.21.15.17:0/4091400586 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f7208198350 con 0x7f71f007af30 2024-09-20T19:06:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.132+0000 7f720d3cf640 1 -- 172.21.15.17:0/4091400586 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f71f007af30 msgr2=0x7f71f007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.132+0000 7f720d3cf640 1 --2- 172.21.15.17:0/4091400586 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f71f007af30 0x7f71f007d3f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f71f8005fd0 tx=0x7f71f800b390 comp rx=0 tx=0).stop 2024-09-20T19:06:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.132+0000 7f720d3cf640 1 -- 172.21.15.17:0/4091400586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72081033e0 msgr2=0x7f720819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.132+0000 7f720d3cf640 1 --2- 172.21.15.17:0/4091400586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72081033e0 0x7f720819dbe0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f71fc031460 tx=0x7f71fc004530 comp rx=0 tx=0).stop 2024-09-20T19:06:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.132+0000 7f720d3cf640 1 -- 172.21.15.17:0/4091400586 shutdown_connections 2024-09-20T19:06:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.132+0000 7f720d3cf640 1 --2- 172.21.15.17:0/4091400586 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f71f007af30 0x7f71f007d3f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.132+0000 7f720d3cf640 1 --2- 172.21.15.17:0/4091400586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72081033e0 0x7f720819dbe0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.132+0000 7f720d3cf640 1 --2- 172.21.15.17:0/4091400586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7208102ac0 0x7f720819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.132+0000 7f720d3cf640 1 -- 172.21.15.17:0/4091400586 >> 172.21.15.17:0/4091400586 conn(0x7f72080fc520 msgr2=0x7f7208108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.132+0000 7f720d3cf640 1 -- 172.21.15.17:0/4091400586 shutdown_connections 2024-09-20T19:06:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.132+0000 7f720d3cf640 1 -- 172.21.15.17:0/4091400586 wait complete. 2024-09-20T19:06:09.147 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:06:09.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.218+0000 7f8deedf0640 1 -- 172.21.15.17:0/2636012748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8de8101900 msgr2=0x7f8de8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:09.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.218+0000 7f8deedf0640 1 --2- 172.21.15.17:0/2636012748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8de8101900 0x7f8de8101d60 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009880 tx=0x7f8dd802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.218+0000 7f8deedf0640 1 -- 172.21.15.17:0/2636012748 shutdown_connections 2024-09-20T19:06:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.218+0000 7f8deedf0640 1 --2- 172.21.15.17:0/2636012748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8de8101900 0x7f8de8101d60 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.218+0000 7f8deedf0640 1 --2- 172.21.15.17:0/2636012748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8de8107900 0x7f8de8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.218+0000 7f8deedf0640 1 -- 172.21.15.17:0/2636012748 >> 172.21.15.17:0/2636012748 conn(0x7f8de80fd600 msgr2=0x7f8de80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.218+0000 7f8deedf0640 1 -- 172.21.15.17:0/2636012748 shutdown_connections 2024-09-20T19:06:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.218+0000 7f8deedf0640 1 -- 172.21.15.17:0/2636012748 wait complete. 2024-09-20T19:06:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.219+0000 7f8deedf0640 1 Processor -- start 2024-09-20T19:06:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.219+0000 7f8deedf0640 1 -- start start 2024-09-20T19:06:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.219+0000 7f8deedf0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8de8101900 0x7f8de819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.219+0000 7f8deedf0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8de8107900 0x7f8de819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.219+0000 7f8deedf0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8de810edd0 con 0x7f8de8107900 2024-09-20T19:06:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.219+0000 7f8deedf0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8de810ec50 con 0x7f8de8101900 2024-09-20T19:06:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.219+0000 7f8ddffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8de8107900 0x7f8de819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:09.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.219+0000 7f8ddffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8de8107900 0x7f8de819db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41174/0 (socket says 172.21.15.17:41174) 2024-09-20T19:06:09.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.219+0000 7f8ddffff640 1 -- 172.21.15.17:0/968722116 learned_addr learned my addr 172.21.15.17:0/968722116 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:06:09.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.219+0000 7f8decb8c640 1 --2- 172.21.15.17:0/968722116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8de8101900 0x7f8de819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:09.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.219+0000 7f8ddffff640 1 -- 172.21.15.17:0/968722116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8de8101900 msgr2=0x7f8de819d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:09.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.219+0000 7f8ddffff640 1 --2- 172.21.15.17:0/968722116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8de8101900 0x7f8de819d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.219+0000 7f8ddffff640 1 -- 172.21.15.17:0/968722116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de81977a0 con 0x7f8de8107900 2024-09-20T19:06:09.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.220+0000 7f8ddffff640 1 --2- 172.21.15.17:0/968722116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8de8107900 0x7f8de819db60 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8031460 tx=0x7f8dd80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:09.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.220+0000 7f8dddffb640 1 -- 172.21.15.17:0/968722116 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8dd803f070 con 0x7f8de8107900 2024-09-20T19:06:09.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.220+0000 7f8dddffb640 1 -- 172.21.15.17:0/968722116 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8dd80035f0 con 0x7f8de8107900 2024-09-20T19:06:09.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.220+0000 7f8deedf0640 1 -- 172.21.15.17:0/968722116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de8197a30 con 0x7f8de8107900 2024-09-20T19:06:09.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.220+0000 7f8dddffb640 1 -- 172.21.15.17:0/968722116 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8dd8035030 con 0x7f8de8107900 2024-09-20T19:06:09.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.220+0000 7f8deedf0640 1 -- 172.21.15.17:0/968722116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de8197f60 con 0x7f8de8107900 2024-09-20T19:06:09.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.221+0000 7f8deedf0640 1 -- 172.21.15.17:0/968722116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de8103040 con 0x7f8de8107900 2024-09-20T19:06:09.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.222+0000 7f8dddffb640 1 -- 172.21.15.17:0/968722116 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8dd8042070 con 0x7f8de8107900 2024-09-20T19:06:09.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.223+0000 7f8dddffb640 1 --2- 172.21.15.17:0/968722116 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8dd007af30 0x7f8dd007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:09.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.223+0000 7f8dddffb640 1 -- 172.21.15.17:0/968722116 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f8dd80be640 con 0x7f8de8107900 2024-09-20T19:06:09.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.223+0000 7f8decb8c640 1 --2- 172.21.15.17:0/968722116 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8dd007af30 0x7f8dd007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:09.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.224+0000 7f8decb8c640 1 --2- 172.21.15.17:0/968722116 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8dd007af30 0x7f8dd007d3f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8de4005fd0 tx=0x7f8de400b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:09.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.228+0000 7f8dddffb640 1 -- 172.21.15.17:0/968722116 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8dd8089ba0 con 0x7f8de8107900 2024-09-20T19:06:09.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.432+0000 7f8deedf0640 1 -- 172.21.15.17:0/968722116 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8de81982d0 con 0x7f8dd007af30 2024-09-20T19:06:09.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.433+0000 7f8dddffb640 1 -- 172.21.15.17:0/968722116 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8de81982d0 con 0x7f8dd007af30 2024-09-20T19:06:09.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.435+0000 7f8deedf0640 1 -- 172.21.15.17:0/968722116 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8dd007af30 msgr2=0x7f8dd007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:09.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.435+0000 7f8deedf0640 1 --2- 172.21.15.17:0/968722116 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8dd007af30 0x7f8dd007d3f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8de4005fd0 tx=0x7f8de400b390 comp rx=0 tx=0).stop 2024-09-20T19:06:09.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.435+0000 7f8deedf0640 1 -- 172.21.15.17:0/968722116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8de8107900 msgr2=0x7f8de819db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:09.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.435+0000 7f8deedf0640 1 --2- 172.21.15.17:0/968722116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8de8107900 0x7f8de819db60 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8031460 tx=0x7f8dd80045e0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.435+0000 7f8deedf0640 1 -- 172.21.15.17:0/968722116 shutdown_connections 2024-09-20T19:06:09.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.435+0000 7f8deedf0640 1 --2- 172.21.15.17:0/968722116 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8dd007af30 0x7f8dd007d3f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.435+0000 7f8deedf0640 1 --2- 172.21.15.17:0/968722116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8de8107900 0x7f8de819db60 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.435+0000 7f8deedf0640 1 --2- 172.21.15.17:0/968722116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8de8101900 0x7f8de819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.435+0000 7f8deedf0640 1 -- 172.21.15.17:0/968722116 >> 172.21.15.17:0/968722116 conn(0x7f8de80fd600 msgr2=0x7f8de80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:09.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.435+0000 7f8deedf0640 1 -- 172.21.15.17:0/968722116 shutdown_connections 2024-09-20T19:06:09.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.435+0000 7f8deedf0640 1 -- 172.21.15.17:0/968722116 wait complete. 2024-09-20T19:06:09.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.520+0000 7fec58ff5640 1 -- 172.21.15.17:0/2429852718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec54102ab0 msgr2=0x7fec54102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.520+0000 7fec58ff5640 1 --2- 172.21.15.17:0/2429852718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec54102ab0 0x7fec54102e90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fec44009880 tx=0x7fec4402a530 comp rx=0 tx=0).stop 2024-09-20T19:06:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.520+0000 7fec58ff5640 1 -- 172.21.15.17:0/2429852718 shutdown_connections 2024-09-20T19:06:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.520+0000 7fec58ff5640 1 --2- 172.21.15.17:0/2429852718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec541033d0 0x7fec5410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.520+0000 7fec58ff5640 1 --2- 172.21.15.17:0/2429852718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec54102ab0 0x7fec54102e90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.520+0000 7fec58ff5640 1 -- 172.21.15.17:0/2429852718 >> 172.21.15.17:0/2429852718 conn(0x7fec540fc550 msgr2=0x7fec540fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.520+0000 7fec58ff5640 1 -- 172.21.15.17:0/2429852718 shutdown_connections 2024-09-20T19:06:09.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.520+0000 7fec58ff5640 1 -- 172.21.15.17:0/2429852718 wait complete. 2024-09-20T19:06:09.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.521+0000 7fec58ff5640 1 Processor -- start 2024-09-20T19:06:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.521+0000 7fec58ff5640 1 -- start start 2024-09-20T19:06:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.521+0000 7fec58ff5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec54102ab0 0x7fec5419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.521+0000 7fec58ff5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec541033d0 0x7fec5419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.521+0000 7fec58ff5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fec5410edc0 con 0x7fec54102ab0 2024-09-20T19:06:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.521+0000 7fec58ff5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fec5410ec40 con 0x7fec541033d0 2024-09-20T19:06:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.521+0000 7fec5259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec54102ab0 0x7fec5419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.521+0000 7fec5259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec54102ab0 0x7fec5419d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41190/0 (socket says 172.21.15.17:41190) 2024-09-20T19:06:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.521+0000 7fec5259c640 1 -- 172.21.15.17:0/2919840259 learned_addr learned my addr 172.21.15.17:0/2919840259 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:06:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.521+0000 7fec51d9b640 1 --2- 172.21.15.17:0/2919840259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec541033d0 0x7fec5419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.521+0000 7fec5259c640 1 -- 172.21.15.17:0/2919840259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec541033d0 msgr2=0x7fec5419db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.521+0000 7fec5259c640 1 --2- 172.21.15.17:0/2919840259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec541033d0 0x7fec5419db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.521+0000 7fec5259c640 1 -- 172.21.15.17:0/2919840259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec541977b0 con 0x7fec54102ab0 2024-09-20T19:06:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.522+0000 7fec5259c640 1 --2- 172.21.15.17:0/2919840259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec54102ab0 0x7fec5419d630 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fec44031460 tx=0x7fec440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:09.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.522+0000 7fec437fe640 1 -- 172.21.15.17:0/2919840259 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec4403f070 con 0x7fec54102ab0 2024-09-20T19:06:09.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.522+0000 7fec437fe640 1 -- 172.21.15.17:0/2919840259 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fec44004cf0 con 0x7fec54102ab0 2024-09-20T19:06:09.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.522+0000 7fec58ff5640 1 -- 172.21.15.17:0/2919840259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec54197a40 con 0x7fec54102ab0 2024-09-20T19:06:09.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.522+0000 7fec58ff5640 1 -- 172.21.15.17:0/2919840259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec54197f70 con 0x7fec54102ab0 2024-09-20T19:06:09.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.523+0000 7fec437fe640 1 -- 172.21.15.17:0/2919840259 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec44035030 con 0x7fec54102ab0 2024-09-20T19:06:09.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.523+0000 7fec58ff5640 1 -- 172.21.15.17:0/2919840259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec5406a580 con 0x7fec54102ab0 2024-09-20T19:06:09.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.524+0000 7fec437fe640 1 -- 172.21.15.17:0/2919840259 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fec44042070 con 0x7fec54102ab0 2024-09-20T19:06:09.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.524+0000 7fec437fe640 1 --2- 172.21.15.17:0/2919840259 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec3c07af30 0x7fec3c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:09.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.524+0000 7fec437fe640 1 -- 172.21.15.17:0/2919840259 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fec440beac0 con 0x7fec54102ab0 2024-09-20T19:06:09.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.524+0000 7fec51d9b640 1 --2- 172.21.15.17:0/2919840259 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec3c07af30 0x7fec3c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:09.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.525+0000 7fec51d9b640 1 --2- 172.21.15.17:0/2919840259 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec3c07af30 0x7fec3c07d3f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fec48005fd0 tx=0x7fec48005f60 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:09.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.529+0000 7fec437fe640 1 -- 172.21.15.17:0/2919840259 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fec4408a0c0 con 0x7fec54102ab0 2024-09-20T19:06:09.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.726+0000 7fec58ff5640 1 -- 172.21.15.17:0/2919840259 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fec541982e0 con 0x7fec3c07af30 2024-09-20T19:06:09.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.736+0000 7fec437fe640 1 -- 172.21.15.17:0/2919840259 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fec541982e0 con 0x7fec3c07af30 2024-09-20T19:06:09.742 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:06:09.742 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (27m) 6m ago 38m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:06:09.742 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (30m) 6m ago 38m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:06:09.742 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (30m) 6m ago 37m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:06:09.742 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (25m) 6m ago 38m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:06:09.742 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (25m) 6m ago 37m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:06:09.742 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (27m) 6m ago 38m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:06:09.742 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (22m) 6m ago 33m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:06:09.742 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (21m) 6m ago 33m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:06:09.742 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (6m) 6m ago 33m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:06:09.742 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (21m) 6m ago 33m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:06:09.743 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (29m) 6m ago 39m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:06:09.743 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (28m) 6m ago 37m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:06:09.743 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (26m) 6m ago 39m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:06:09.743 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (26m) 6m ago 37m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:06:09.743 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (28m) 6m ago 38m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:06:09.743 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (28m) 6m ago 37m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:06:09.743 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (25m) 6m ago 36m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:06:09.743 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (24m) 6m ago 36m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:06:09.743 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (24m) 6m ago 35m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:06:09.743 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (23m) 6m ago 35m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:06:09.743 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (22m) 6m ago 34m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:06:09.743 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (22m) 6m ago 34m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:06:09.743 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (27m) 6m ago 38m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:06:09.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.739+0000 7fec58ff5640 1 -- 172.21.15.17:0/2919840259 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec3c07af30 msgr2=0x7fec3c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:09.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.739+0000 7fec58ff5640 1 --2- 172.21.15.17:0/2919840259 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec3c07af30 0x7fec3c07d3f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fec48005fd0 tx=0x7fec48005f60 comp rx=0 tx=0).stop 2024-09-20T19:06:09.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.739+0000 7fec58ff5640 1 -- 172.21.15.17:0/2919840259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec54102ab0 msgr2=0x7fec5419d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:09.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.739+0000 7fec58ff5640 1 --2- 172.21.15.17:0/2919840259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec54102ab0 0x7fec5419d630 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fec44031460 tx=0x7fec440048f0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.739+0000 7fec58ff5640 1 -- 172.21.15.17:0/2919840259 shutdown_connections 2024-09-20T19:06:09.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.739+0000 7fec58ff5640 1 --2- 172.21.15.17:0/2919840259 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fec3c07af30 0x7fec3c07d3f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.739+0000 7fec58ff5640 1 --2- 172.21.15.17:0/2919840259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec541033d0 0x7fec5419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.739+0000 7fec58ff5640 1 --2- 172.21.15.17:0/2919840259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec54102ab0 0x7fec5419d630 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.739+0000 7fec58ff5640 1 -- 172.21.15.17:0/2919840259 >> 172.21.15.17:0/2919840259 conn(0x7fec540fc550 msgr2=0x7fec54108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:09.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.739+0000 7fec58ff5640 1 -- 172.21.15.17:0/2919840259 shutdown_connections 2024-09-20T19:06:09.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.739+0000 7fec58ff5640 1 -- 172.21.15.17:0/2919840259 wait complete. 2024-09-20T19:06:09.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.822+0000 7f0a29318640 1 -- 172.21.15.17:0/2114080765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a24107900 msgr2=0x7f0a24107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:09.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.822+0000 7f0a29318640 1 --2- 172.21.15.17:0/2114080765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a24107900 0x7f0a24107ce0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009880 tx=0x7f0a1402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.822+0000 7f0a29318640 1 -- 172.21.15.17:0/2114080765 shutdown_connections 2024-09-20T19:06:09.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.822+0000 7f0a29318640 1 --2- 172.21.15.17:0/2114080765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a24101900 0x7f0a24101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.822+0000 7f0a29318640 1 --2- 172.21.15.17:0/2114080765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a24107900 0x7f0a24107ce0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.822+0000 7f0a29318640 1 -- 172.21.15.17:0/2114080765 >> 172.21.15.17:0/2114080765 conn(0x7f0a240fd600 msgr2=0x7f0a240ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:09.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.822+0000 7f0a29318640 1 -- 172.21.15.17:0/2114080765 shutdown_connections 2024-09-20T19:06:09.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.822+0000 7f0a29318640 1 -- 172.21.15.17:0/2114080765 wait complete. 2024-09-20T19:06:09.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.823+0000 7f0a29318640 1 Processor -- start 2024-09-20T19:06:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.823+0000 7f0a29318640 1 -- start start 2024-09-20T19:06:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.823+0000 7f0a29318640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a24101900 0x7f0a2419f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.823+0000 7f0a29318640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a24107900 0x7f0a2419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.823+0000 7f0a29318640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2410edb0 con 0x7f0a24101900 2024-09-20T19:06:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.823+0000 7f0a29318640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2410ec30 con 0x7f0a24107900 2024-09-20T19:06:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.823+0000 7f0a22ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a24101900 0x7f0a2419f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.823+0000 7f0a22ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a24101900 0x7f0a2419f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41206/0 (socket says 172.21.15.17:41206) 2024-09-20T19:06:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.823+0000 7f0a22ffd640 1 -- 172.21.15.17:0/227385590 learned_addr learned my addr 172.21.15.17:0/227385590 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:06:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.824+0000 7f0a227fc640 1 --2- 172.21.15.17:0/227385590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a24107900 0x7f0a2419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.824+0000 7f0a22ffd640 1 -- 172.21.15.17:0/227385590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a24107900 msgr2=0x7f0a2419fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:09.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.824+0000 7f0a22ffd640 1 --2- 172.21.15.17:0/227385590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a24107900 0x7f0a2419fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:09.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.824+0000 7f0a22ffd640 1 -- 172.21.15.17:0/227385590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a241a0480 con 0x7f0a24101900 2024-09-20T19:06:09.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.824+0000 7f0a22ffd640 1 --2- 172.21.15.17:0/227385590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a24101900 0x7f0a2419f890 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0a14031460 tx=0x7f0a140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:09.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.824+0000 7f0a0bfff640 1 -- 172.21.15.17:0/227385590 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a1403f070 con 0x7f0a24101900 2024-09-20T19:06:09.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.824+0000 7f0a29318640 1 -- 172.21.15.17:0/227385590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a24199b10 con 0x7f0a24101900 2024-09-20T19:06:09.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.824+0000 7f0a0bfff640 1 -- 172.21.15.17:0/227385590 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a14004cf0 con 0x7f0a24101900 2024-09-20T19:06:09.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.824+0000 7f0a0bfff640 1 -- 172.21.15.17:0/227385590 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a14035030 con 0x7f0a24101900 2024-09-20T19:06:09.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.824+0000 7f0a29318640 1 -- 172.21.15.17:0/227385590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a2419a010 con 0x7f0a24101900 2024-09-20T19:06:09.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.826+0000 7f0a29318640 1 -- 172.21.15.17:0/227385590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a24103040 con 0x7f0a24101900 2024-09-20T19:06:09.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.826+0000 7f0a0bfff640 1 -- 172.21.15.17:0/227385590 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0a14042070 con 0x7f0a24101900 2024-09-20T19:06:09.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.827+0000 7f0a0bfff640 1 --2- 172.21.15.17:0/227385590 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0a0c07af30 0x7f0a0c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:09.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.827+0000 7f0a227fc640 1 --2- 172.21.15.17:0/227385590 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0a0c07af30 0x7f0a0c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:09.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.827+0000 7f0a0bfff640 1 -- 172.21.15.17:0/227385590 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f0a140beb60 con 0x7f0a24101900 2024-09-20T19:06:09.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.828+0000 7f0a227fc640 1 --2- 172.21.15.17:0/227385590 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0a0c07af30 0x7f0a0c07d3f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0a18005e10 tx=0x7f0a18005da0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:09.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:09.831+0000 7f0a0bfff640 1 -- 172.21.15.17:0/227385590 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0a1408a0c0 con 0x7f0a24101900 2024-09-20T19:06:10.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.099+0000 7f0a29318640 1 -- 172.21.15.17:0/227385590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0a2419a380 con 0x7f0a24101900 2024-09-20T19:06:10.105 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:09 smithi017 ceph-mon[108970]: pgmap v923: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:10.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.099+0000 7f0a0bfff640 1 -- 172.21.15.17:0/227385590 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f0a1408ef70 con 0x7f0a24101900 2024-09-20T19:06:10.105 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:06:10.105 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:06:10.105 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:06:10.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:06:10.106 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:06:10.106 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:06:10.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:06:10.106 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:06:10.106 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:06:10.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:06:10.106 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:06:10.106 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:06:10.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:06:10.106 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:06:10.106 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:06:10.106 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:06:10.107 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:06:10.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.102+0000 7f0a29318640 1 -- 172.21.15.17:0/227385590 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0a0c07af30 msgr2=0x7f0a0c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:10.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.102+0000 7f0a29318640 1 --2- 172.21.15.17:0/227385590 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0a0c07af30 0x7f0a0c07d3f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0a18005e10 tx=0x7f0a18005da0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.102+0000 7f0a29318640 1 -- 172.21.15.17:0/227385590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a24101900 msgr2=0x7f0a2419f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:10.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.102+0000 7f0a29318640 1 --2- 172.21.15.17:0/227385590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a24101900 0x7f0a2419f890 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0a14031460 tx=0x7f0a140048f0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.102+0000 7f0a29318640 1 -- 172.21.15.17:0/227385590 shutdown_connections 2024-09-20T19:06:10.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.102+0000 7f0a29318640 1 --2- 172.21.15.17:0/227385590 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0a0c07af30 0x7f0a0c07d3f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.102+0000 7f0a29318640 1 --2- 172.21.15.17:0/227385590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a24107900 0x7f0a2419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.102+0000 7f0a29318640 1 --2- 172.21.15.17:0/227385590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a24101900 0x7f0a2419f890 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.102+0000 7f0a29318640 1 -- 172.21.15.17:0/227385590 >> 172.21.15.17:0/227385590 conn(0x7f0a240fd600 msgr2=0x7f0a24074940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:10.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.102+0000 7f0a29318640 1 -- 172.21.15.17:0/227385590 shutdown_connections 2024-09-20T19:06:10.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.102+0000 7f0a29318640 1 -- 172.21.15.17:0/227385590 wait complete. 2024-09-20T19:06:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.186+0000 7fc432618640 1 -- 172.21.15.17:0/3540497475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc42c102b30 msgr2=0x7fc42c102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.186+0000 7fc432618640 1 --2- 172.21.15.17:0/3540497475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc42c102b30 0x7fc42c102f10 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc41c009880 tx=0x7fc41c02a530 comp rx=0 tx=0).stop 2024-09-20T19:06:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.186+0000 7fc432618640 1 -- 172.21.15.17:0/3540497475 shutdown_connections 2024-09-20T19:06:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.186+0000 7fc432618640 1 --2- 172.21.15.17:0/3540497475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc42c103450 0x7fc42c10b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.186+0000 7fc432618640 1 --2- 172.21.15.17:0/3540497475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc42c102b30 0x7fc42c102f10 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.186+0000 7fc432618640 1 -- 172.21.15.17:0/3540497475 >> 172.21.15.17:0/3540497475 conn(0x7fc42c0fc550 msgr2=0x7fc42c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.186+0000 7fc432618640 1 -- 172.21.15.17:0/3540497475 shutdown_connections 2024-09-20T19:06:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.186+0000 7fc432618640 1 -- 172.21.15.17:0/3540497475 wait complete. 2024-09-20T19:06:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.186+0000 7fc432618640 1 Processor -- start 2024-09-20T19:06:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.187+0000 7fc432618640 1 -- start start 2024-09-20T19:06:10.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.187+0000 7fc432618640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc42c102b30 0x7fc42c19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:10.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.187+0000 7fc432618640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc42c103450 0x7fc42c19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:10.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.187+0000 7fc432618640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c10edc0 con 0x7fc42c102b30 2024-09-20T19:06:10.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.187+0000 7fc432618640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c10ec40 con 0x7fc42c103450 2024-09-20T19:06:10.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.187+0000 7fc42bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc42c102b30 0x7fc42c19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:10.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.187+0000 7fc42bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc42c102b30 0x7fc42c19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41212/0 (socket says 172.21.15.17:41212) 2024-09-20T19:06:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.187+0000 7fc42bfff640 1 -- 172.21.15.17:0/2182741157 learned_addr learned my addr 172.21.15.17:0/2182741157 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:06:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.187+0000 7fc423fff640 1 --2- 172.21.15.17:0/2182741157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc42c103450 0x7fc42c19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.187+0000 7fc42bfff640 1 -- 172.21.15.17:0/2182741157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc42c103450 msgr2=0x7fc42c19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.187+0000 7fc42bfff640 1 --2- 172.21.15.17:0/2182741157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc42c103450 0x7fc42c19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.187+0000 7fc42bfff640 1 -- 172.21.15.17:0/2182741157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42c1977b0 con 0x7fc42c102b30 2024-09-20T19:06:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.187+0000 7fc42bfff640 1 --2- 172.21.15.17:0/2182741157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc42c102b30 0x7fc42c19d630 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc41c004f90 tx=0x7fc41c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.188+0000 7fc429ffb640 1 -- 172.21.15.17:0/2182741157 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc41c03f070 con 0x7fc42c102b30 2024-09-20T19:06:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.188+0000 7fc429ffb640 1 -- 172.21.15.17:0/2182741157 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc41c004c70 con 0x7fc42c102b30 2024-09-20T19:06:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.188+0000 7fc432618640 1 -- 172.21.15.17:0/2182741157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc42c197a40 con 0x7fc42c102b30 2024-09-20T19:06:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.188+0000 7fc429ffb640 1 -- 172.21.15.17:0/2182741157 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc41c035030 con 0x7fc42c102b30 2024-09-20T19:06:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.188+0000 7fc432618640 1 -- 172.21.15.17:0/2182741157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc42c197f70 con 0x7fc42c102b30 2024-09-20T19:06:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.189+0000 7fc432618640 1 -- 172.21.15.17:0/2182741157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc42c06a500 con 0x7fc42c102b30 2024-09-20T19:06:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.189+0000 7fc429ffb640 1 -- 172.21.15.17:0/2182741157 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc41c042070 con 0x7fc42c102b30 2024-09-20T19:06:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.190+0000 7fc429ffb640 1 --2- 172.21.15.17:0/2182741157 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc41807af80 0x7fc41807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.190+0000 7fc429ffb640 1 -- 172.21.15.17:0/2182741157 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fc41c0be890 con 0x7fc42c102b30 2024-09-20T19:06:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.190+0000 7fc423fff640 1 --2- 172.21.15.17:0/2182741157 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc41807af80 0x7fc41807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.190+0000 7fc423fff640 1 --2- 172.21.15.17:0/2182741157 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc41807af80 0x7fc41807d440 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc42c108900 tx=0x7fc41400b410 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:10.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.194+0000 7fc429ffb640 1 -- 172.21.15.17:0/2182741157 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc41c089f10 con 0x7fc42c102b30 2024-09-20T19:06:10.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.420+0000 7fc432618640 1 -- 172.21.15.17:0/2182741157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc42c105f90 con 0x7fc42c102b30 2024-09-20T19:06:10.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.420+0000 7fc429ffb640 1 -- 172.21.15.17:0/2182741157 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7fc41c08edc0 con 0x7fc42c102b30 2024-09-20T19:06:10.426 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:06:10.426 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:06:10.426 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:06:10.426 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:06:10.426 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:06:10.426 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:06:10.426 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:06:10.426 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:06:10.427 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:06:10.427 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:06:10.427 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:06:10.427 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:06:10.427 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:06:10.427 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:06:10.427 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:06:10.427 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:06:10.427 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:06:10.427 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:06:10.427 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:06:10.427 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:06:10.427 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:06:10.427 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:06:10.428 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:06:10.428 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:06:10.428 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:06:10.428 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:06:10.428 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:06:10.428 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:06:10.428 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:06:10.428 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:06:10.428 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:06:10.428 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:06:10.428 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:06:10.428 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:06:10.428 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:06:10.428 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:06:10.428 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:06:10.429 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:06:10.429 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:06:10.429 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:06:10.429 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:06:10.429 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:06:10.429 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:06:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:06:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.422+0000 7fc432618640 1 -- 172.21.15.17:0/2182741157 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc41807af80 msgr2=0x7fc41807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.422+0000 7fc432618640 1 --2- 172.21.15.17:0/2182741157 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc41807af80 0x7fc41807d440 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc42c108900 tx=0x7fc41400b410 comp rx=0 tx=0).stop 2024-09-20T19:06:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.422+0000 7fc432618640 1 -- 172.21.15.17:0/2182741157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc42c102b30 msgr2=0x7fc42c19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.422+0000 7fc432618640 1 --2- 172.21.15.17:0/2182741157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc42c102b30 0x7fc42c19d630 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc41c004f90 tx=0x7fc41c0048f0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.422+0000 7fc432618640 1 -- 172.21.15.17:0/2182741157 shutdown_connections 2024-09-20T19:06:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.422+0000 7fc432618640 1 --2- 172.21.15.17:0/2182741157 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc41807af80 0x7fc41807d440 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.422+0000 7fc432618640 1 --2- 172.21.15.17:0/2182741157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc42c103450 0x7fc42c19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.422+0000 7fc432618640 1 --2- 172.21.15.17:0/2182741157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc42c102b30 0x7fc42c19d630 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.422+0000 7fc432618640 1 -- 172.21.15.17:0/2182741157 >> 172.21.15.17:0/2182741157 conn(0x7fc42c0fc550 msgr2=0x7fc42c108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.422+0000 7fc432618640 1 -- 172.21.15.17:0/2182741157 shutdown_connections 2024-09-20T19:06:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.422+0000 7fc432618640 1 -- 172.21.15.17:0/2182741157 wait complete. 2024-09-20T19:06:10.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:09 smithi172 ceph-mon[80431]: pgmap v923: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:10.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.507+0000 7fdac427b640 1 -- 172.21.15.17:0/3343181779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdabc100800 msgr2=0x7fdabc100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:10.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.507+0000 7fdac427b640 1 --2- 172.21.15.17:0/3343181779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdabc100800 0x7fdabc100c60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009880 tx=0x7fdaac02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.508+0000 7fdac427b640 1 -- 172.21.15.17:0/3343181779 shutdown_connections 2024-09-20T19:06:10.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.508+0000 7fdac427b640 1 --2- 172.21.15.17:0/3343181779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdabc100800 0x7fdabc100c60 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.508+0000 7fdac427b640 1 --2- 172.21.15.17:0/3343181779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdabc106800 0x7fdabc106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.508+0000 7fdac427b640 1 -- 172.21.15.17:0/3343181779 >> 172.21.15.17:0/3343181779 conn(0x7fdabc0fc520 msgr2=0x7fdabc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:10.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.508+0000 7fdac427b640 1 -- 172.21.15.17:0/3343181779 shutdown_connections 2024-09-20T19:06:10.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.508+0000 7fdac427b640 1 -- 172.21.15.17:0/3343181779 wait complete. 2024-09-20T19:06:10.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.508+0000 7fdac427b640 1 Processor -- start 2024-09-20T19:06:10.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.508+0000 7fdac427b640 1 -- start start 2024-09-20T19:06:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.508+0000 7fdac427b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdabc100800 0x7fdabc10b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.508+0000 7fdac427b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdabc106800 0x7fdabc10bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.509+0000 7fdac427b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc10edf0 con 0x7fdabc100800 2024-09-20T19:06:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.509+0000 7fdac427b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc10ec70 con 0x7fdabc106800 2024-09-20T19:06:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.509+0000 7fdac2017640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdabc100800 0x7fdabc10b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.509+0000 7fdac2017640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdabc100800 0x7fdabc10b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40186/0 (socket says 172.21.15.17:40186) 2024-09-20T19:06:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.509+0000 7fdac2017640 1 -- 172.21.15.17:0/2074900479 learned_addr learned my addr 172.21.15.17:0/2074900479 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:06:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.509+0000 7fdac1816640 1 --2- 172.21.15.17:0/2074900479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdabc106800 0x7fdabc10bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.509+0000 7fdac2017640 1 -- 172.21.15.17:0/2074900479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdabc106800 msgr2=0x7fdabc10bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.509+0000 7fdac2017640 1 --2- 172.21.15.17:0/2074900479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdabc106800 0x7fdabc10bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.509+0000 7fdac2017640 1 -- 172.21.15.17:0/2074900479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdabc10c210 con 0x7fdabc100800 2024-09-20T19:06:10.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.509+0000 7fdac1816640 1 --2- 172.21.15.17:0/2074900479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdabc106800 0x7fdabc10bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:06:10.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.509+0000 7fdac2017640 1 --2- 172.21.15.17:0/2074900479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdabc100800 0x7fdabc10b790 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fdab800ea00 tx=0x7fdab800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:10.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.509+0000 7fdab37fe640 1 -- 172.21.15.17:0/2074900479 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdab800cb80 con 0x7fdabc100800 2024-09-20T19:06:10.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.509+0000 7fdac427b640 1 -- 172.21.15.17:0/2074900479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdabc10c500 con 0x7fdabc100800 2024-09-20T19:06:10.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.509+0000 7fdab37fe640 1 -- 172.21.15.17:0/2074900479 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdab800cd20 con 0x7fdabc100800 2024-09-20T19:06:10.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.509+0000 7fdab37fe640 1 -- 172.21.15.17:0/2074900479 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdab8011470 con 0x7fdabc100800 2024-09-20T19:06:10.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.509+0000 7fdac427b640 1 -- 172.21.15.17:0/2074900479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdabc1a3e40 con 0x7fdabc100800 2024-09-20T19:06:10.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.510+0000 7fdac427b640 1 -- 172.21.15.17:0/2074900479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdabc101f40 con 0x7fdabc100800 2024-09-20T19:06:10.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.511+0000 7fdab37fe640 1 -- 172.21.15.17:0/2074900479 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdab8011750 con 0x7fdabc100800 2024-09-20T19:06:10.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.512+0000 7fdab37fe640 1 --2- 172.21.15.17:0/2074900479 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdaa807af30 0x7fdaa807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:10.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.512+0000 7fdab37fe640 1 -- 172.21.15.17:0/2074900479 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fdab809e4c0 con 0x7fdabc100800 2024-09-20T19:06:10.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.512+0000 7fdac1816640 1 --2- 172.21.15.17:0/2074900479 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdaa807af30 0x7fdaa807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:10.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.512+0000 7fdac1816640 1 --2- 172.21.15.17:0/2074900479 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdaa807af30 0x7fdaa807d3f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fdaac006010 tx=0x7fdaac0095f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:10.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.516+0000 7fdab37fe640 1 -- 172.21.15.17:0/2074900479 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdab8016030 con 0x7fdabc100800 2024-09-20T19:06:10.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.724+0000 7fdac427b640 1 -- 172.21.15.17:0/2074900479 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fdabc108dc0 con 0x7fdaa807af30 2024-09-20T19:06:10.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.726+0000 7fdab37fe640 1 -- 172.21.15.17:0/2074900479 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fdabc108dc0 con 0x7fdaa807af30 2024-09-20T19:06:10.731 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:06:10.731 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:06:10.731 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:06:10.731 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:06:10.732 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:06:10.732 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:06:10.732 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:06:10.732 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:06:10.732 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:06:10.732 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:06:10.732 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:06:10.732 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:06:10.732 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:06:10.732 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:06:10.732 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:06:10.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.728+0000 7fdac427b640 1 -- 172.21.15.17:0/2074900479 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdaa807af30 msgr2=0x7fdaa807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:10.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.728+0000 7fdac427b640 1 --2- 172.21.15.17:0/2074900479 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdaa807af30 0x7fdaa807d3f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fdaac006010 tx=0x7fdaac0095f0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.728+0000 7fdac427b640 1 -- 172.21.15.17:0/2074900479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdabc100800 msgr2=0x7fdabc10b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:10.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.728+0000 7fdac427b640 1 --2- 172.21.15.17:0/2074900479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdabc100800 0x7fdabc10b790 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fdab800ea00 tx=0x7fdab800eec0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.728+0000 7fdac427b640 1 -- 172.21.15.17:0/2074900479 shutdown_connections 2024-09-20T19:06:10.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.728+0000 7fdac427b640 1 --2- 172.21.15.17:0/2074900479 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdaa807af30 0x7fdaa807d3f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.728+0000 7fdac427b640 1 --2- 172.21.15.17:0/2074900479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdabc106800 0x7fdabc10bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.728+0000 7fdac427b640 1 --2- 172.21.15.17:0/2074900479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdabc100800 0x7fdabc10b790 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.729+0000 7fdac427b640 1 -- 172.21.15.17:0/2074900479 >> 172.21.15.17:0/2074900479 conn(0x7fdabc0fc520 msgr2=0x7fdabc0fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:10.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.729+0000 7fdac427b640 1 -- 172.21.15.17:0/2074900479 shutdown_connections 2024-09-20T19:06:10.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.729+0000 7fdac427b640 1 -- 172.21.15.17:0/2074900479 wait complete. 2024-09-20T19:06:10.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.812+0000 7fde98fba640 1 -- 172.21.15.17:0/2974608925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde94106800 msgr2=0x7fde94106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:10.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.812+0000 7fde98fba640 1 --2- 172.21.15.17:0/2974608925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde94106800 0x7fde94106be0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fde84009880 tx=0x7fde8402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.812+0000 7fde98fba640 1 -- 172.21.15.17:0/2974608925 shutdown_connections 2024-09-20T19:06:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.812+0000 7fde98fba640 1 --2- 172.21.15.17:0/2974608925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde94100800 0x7fde94100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.812+0000 7fde98fba640 1 --2- 172.21.15.17:0/2974608925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde94106800 0x7fde94106be0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.812+0000 7fde98fba640 1 -- 172.21.15.17:0/2974608925 >> 172.21.15.17:0/2974608925 conn(0x7fde940fc520 msgr2=0x7fde940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.813+0000 7fde98fba640 1 -- 172.21.15.17:0/2974608925 shutdown_connections 2024-09-20T19:06:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.813+0000 7fde98fba640 1 -- 172.21.15.17:0/2974608925 wait complete. 2024-09-20T19:06:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.813+0000 7fde98fba640 1 Processor -- start 2024-09-20T19:06:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.813+0000 7fde98fba640 1 -- start start 2024-09-20T19:06:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.814+0000 7fde98fba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde94100800 0x7fde94107730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.814+0000 7fde98fba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde94106800 0x7fde94107c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.814+0000 7fde98fba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fde9410dcb0 con 0x7fde94100800 2024-09-20T19:06:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.814+0000 7fde98fba640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fde9410db30 con 0x7fde94106800 2024-09-20T19:06:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.814+0000 7fde9259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde94100800 0x7fde94107730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.814+0000 7fde9259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde94100800 0x7fde94107730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40204/0 (socket says 172.21.15.17:40204) 2024-09-20T19:06:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.814+0000 7fde9259c640 1 -- 172.21.15.17:0/4106054157 learned_addr learned my addr 172.21.15.17:0/4106054157 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:06:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.814+0000 7fde91d9b640 1 --2- 172.21.15.17:0/4106054157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde94106800 0x7fde94107c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.814+0000 7fde9259c640 1 -- 172.21.15.17:0/4106054157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde94106800 msgr2=0x7fde94107c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.814+0000 7fde9259c640 1 --2- 172.21.15.17:0/4106054157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde94106800 0x7fde94107c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.814+0000 7fde9259c640 1 -- 172.21.15.17:0/4106054157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde941081b0 con 0x7fde94100800 2024-09-20T19:06:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.814+0000 7fde9259c640 1 --2- 172.21.15.17:0/4106054157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde94100800 0x7fde94107730 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fde84031460 tx=0x7fde840048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.814+0000 7fde837fe640 1 -- 172.21.15.17:0/4106054157 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde8403f070 con 0x7fde94100800 2024-09-20T19:06:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.814+0000 7fde98fba640 1 -- 172.21.15.17:0/4106054157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde94108440 con 0x7fde94100800 2024-09-20T19:06:10.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.814+0000 7fde837fe640 1 -- 172.21.15.17:0/4106054157 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fde84004cf0 con 0x7fde94100800 2024-09-20T19:06:10.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.814+0000 7fde837fe640 1 -- 172.21.15.17:0/4106054157 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde84035030 con 0x7fde94100800 2024-09-20T19:06:10.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.815+0000 7fde98fba640 1 -- 172.21.15.17:0/4106054157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde941a3e60 con 0x7fde94100800 2024-09-20T19:06:10.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.816+0000 7fde98fba640 1 -- 172.21.15.17:0/4106054157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde94101f40 con 0x7fde94100800 2024-09-20T19:06:10.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.816+0000 7fde837fe640 1 -- 172.21.15.17:0/4106054157 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fde84042070 con 0x7fde94100800 2024-09-20T19:06:10.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.817+0000 7fde837fe640 1 --2- 172.21.15.17:0/4106054157 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fde7c07af30 0x7fde7c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:10.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.817+0000 7fde837fe640 1 -- 172.21.15.17:0/4106054157 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fde840bea90 con 0x7fde94100800 2024-09-20T19:06:10.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.817+0000 7fde91d9b640 1 --2- 172.21.15.17:0/4106054157 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fde7c07af30 0x7fde7c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:10.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.817+0000 7fde91d9b640 1 --2- 172.21.15.17:0/4106054157 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fde7c07af30 0x7fde7c07d3f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fde88005e10 tx=0x7fde88005da0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:10.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:10.821+0000 7fde837fe640 1 -- 172.21.15.17:0/4106054157 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fde8408a090 con 0x7fde94100800 2024-09-20T19:06:11.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:11.085+0000 7fde98fba640 1 -- 172.21.15.17:0/4106054157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fde94100c60 con 0x7fde94100800 2024-09-20T19:06:11.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:11.085+0000 7fde837fe640 1 -- 172.21.15.17:0/4106054157 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fde8408ef40 con 0x7fde94100800 2024-09-20T19:06:11.091 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:06:11.092 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:06:11.092 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:06:11.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:06:11.092 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:06:11.092 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:06:11.092 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:06:11.092 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:06:11.092 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:06:11.092 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:06:11.092 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:06:11.092 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:06:11.092 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:06:11.093 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:06:11.093 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:06:11.093 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:06:11.093 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:06:11.093 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:06:11.093 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:06:11.093 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:06:11.093 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:06:11.093 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:06:11.093 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:06:11.093 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:06:11.093 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:06:11.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:11.088+0000 7fde98fba640 1 -- 172.21.15.17:0/4106054157 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fde7c07af30 msgr2=0x7fde7c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:11.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:11.088+0000 7fde98fba640 1 --2- 172.21.15.17:0/4106054157 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fde7c07af30 0x7fde7c07d3f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fde88005e10 tx=0x7fde88005da0 comp rx=0 tx=0).stop 2024-09-20T19:06:11.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:11.088+0000 7fde98fba640 1 -- 172.21.15.17:0/4106054157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde94100800 msgr2=0x7fde94107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:11.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:11.088+0000 7fde98fba640 1 --2- 172.21.15.17:0/4106054157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde94100800 0x7fde94107730 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fde84031460 tx=0x7fde840048f0 comp rx=0 tx=0).stop 2024-09-20T19:06:11.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:11.088+0000 7fde98fba640 1 -- 172.21.15.17:0/4106054157 shutdown_connections 2024-09-20T19:06:11.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:11.088+0000 7fde98fba640 1 --2- 172.21.15.17:0/4106054157 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fde7c07af30 0x7fde7c07d3f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:11.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:11.088+0000 7fde98fba640 1 --2- 172.21.15.17:0/4106054157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde94106800 0x7fde94107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:11.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:11.088+0000 7fde98fba640 1 --2- 172.21.15.17:0/4106054157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde94100800 0x7fde94107730 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:11.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:11.088+0000 7fde98fba640 1 -- 172.21.15.17:0/4106054157 >> 172.21.15.17:0/4106054157 conn(0x7fde940fc520 msgr2=0x7fde9406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:11.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:11.088+0000 7fde98fba640 1 -- 172.21.15.17:0/4106054157 shutdown_connections 2024-09-20T19:06:11.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:11.088+0000 7fde98fba640 1 -- 172.21.15.17:0/4106054157 wait complete. 2024-09-20T19:06:11.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:10 smithi017 ceph-mon[108970]: from='client.35492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:11.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:10 smithi017 ceph-mon[108970]: from='client.35496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:11.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:10 smithi017 ceph-mon[108970]: from='client.35500 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:11.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:10 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/227385590' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:06:11.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:10 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2182741157' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:06:11.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:10 smithi172 ceph-mon[80431]: from='client.35492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:11.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:10 smithi172 ceph-mon[80431]: from='client.35496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:11.450 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:10 smithi172 ceph-mon[80431]: from='client.35500 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:11.450 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:10 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/227385590' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:06:11.450 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:10 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2182741157' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:06:12.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:11 smithi017 ceph-mon[108970]: pgmap v924: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:12.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:11 smithi017 ceph-mon[108970]: from='client.35512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:12.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:11 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4106054157' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:06:12.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:11 smithi172 ceph-mon[80431]: pgmap v924: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:12.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:11 smithi172 ceph-mon[80431]: from='client.35512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:12.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:11 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4106054157' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:06:14.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:14 smithi017 ceph-mon[108970]: pgmap v925: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:14.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:14 smithi172 ceph-mon[80431]: pgmap v925: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:16.282 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:16 smithi172 ceph-mon[80431]: pgmap v926: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:16.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:16 smithi017 ceph-mon[108970]: pgmap v926: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:18.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:18 smithi017 ceph-mon[108970]: pgmap v927: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:18.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:18 smithi172 ceph-mon[80431]: pgmap v927: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:19.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:19 smithi017 ceph-mon[108970]: pgmap v928: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:19.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:19 smithi172 ceph-mon[80431]: pgmap v928: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:22.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:21 smithi017 ceph-mon[108970]: pgmap v929: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:22.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:21 smithi172 ceph-mon[80431]: pgmap v929: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:22.890 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:06:23.100 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:06:24.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:23 smithi017 ceph-mon[108970]: pgmap v930: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:24.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:23 smithi172 ceph-mon[80431]: pgmap v930: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:25.890 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:25 smithi017 ceph-mon[108970]: pgmap v931: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:26.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:25 smithi172 ceph-mon[80431]: pgmap v931: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:28.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:27 smithi017 ceph-mon[108970]: pgmap v932: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:28.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:27 smithi172 ceph-mon[80431]: pgmap v932: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:30.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:29 smithi017 ceph-mon[108970]: pgmap v933: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:30.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:29 smithi172 ceph-mon[80431]: pgmap v933: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:31.890 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:31 smithi017 ceph-mon[108970]: pgmap v934: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:32.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:31 smithi172 ceph-mon[80431]: pgmap v934: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:34.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:33 smithi017 ceph-mon[108970]: pgmap v935: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:34.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:33 smithi172 ceph-mon[80431]: pgmap v935: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:36.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:35 smithi017 ceph-mon[108970]: pgmap v936: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:36.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:35 smithi172 ceph-mon[80431]: pgmap v936: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:37.890 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:37 smithi017 ceph-mon[108970]: pgmap v937: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:37.890 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:06:38.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:37 smithi172 ceph-mon[80431]: pgmap v937: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:38.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:06:40.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:39 smithi017 ceph-mon[108970]: pgmap v938: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:40.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:39 smithi172 ceph-mon[80431]: pgmap v938: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:41.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.187+0000 7f10fa425640 1 -- 172.21.15.17:0/3197646169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f4107900 msgr2=0x7f10f4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:41.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.187+0000 7f10fa425640 1 --2- 172.21.15.17:0/3197646169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f4107900 0x7f10f4107ce0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009880 tx=0x7f10e402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.187+0000 7f10fa425640 1 -- 172.21.15.17:0/3197646169 shutdown_connections 2024-09-20T19:06:41.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.187+0000 7f10fa425640 1 --2- 172.21.15.17:0/3197646169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10f4101900 0x7f10f4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.187+0000 7f10fa425640 1 --2- 172.21.15.17:0/3197646169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f4107900 0x7f10f4107ce0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.187+0000 7f10fa425640 1 -- 172.21.15.17:0/3197646169 >> 172.21.15.17:0/3197646169 conn(0x7f10f40fd600 msgr2=0x7f10f40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:41.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.187+0000 7f10fa425640 1 -- 172.21.15.17:0/3197646169 shutdown_connections 2024-09-20T19:06:41.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.187+0000 7f10fa425640 1 -- 172.21.15.17:0/3197646169 wait complete. 2024-09-20T19:06:41.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.188+0000 7f10fa425640 1 Processor -- start 2024-09-20T19:06:41.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.188+0000 7f10fa425640 1 -- start start 2024-09-20T19:06:41.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.188+0000 7f10fa425640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10f4101900 0x7f10f40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:41.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.188+0000 7f10fa425640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f4107900 0x7f10f4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:41.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.188+0000 7f10fa425640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f10f410edd0 con 0x7f10f4107900 2024-09-20T19:06:41.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.188+0000 7f10fa425640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f10f410ec50 con 0x7f10f4101900 2024-09-20T19:06:41.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.188+0000 7f10f37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f4107900 0x7f10f4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:41.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.188+0000 7f10f37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f4107900 0x7f10f4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41224/0 (socket says 172.21.15.17:41224) 2024-09-20T19:06:41.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.188+0000 7f10f37fe640 1 -- 172.21.15.17:0/2656234234 learned_addr learned my addr 172.21.15.17:0/2656234234 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:06:41.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.189+0000 7f10f3fff640 1 --2- 172.21.15.17:0/2656234234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10f4101900 0x7f10f40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:41.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.189+0000 7f10f37fe640 1 -- 172.21.15.17:0/2656234234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10f4101900 msgr2=0x7f10f40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:41.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.189+0000 7f10f37fe640 1 --2- 172.21.15.17:0/2656234234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10f4101900 0x7f10f40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.189+0000 7f10f37fe640 1 -- 172.21.15.17:0/2656234234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f4074f70 con 0x7f10f4107900 2024-09-20T19:06:41.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.189+0000 7f10f37fe640 1 --2- 172.21.15.17:0/2656234234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f4107900 0x7f10f4074a30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f10e800d6f0 tx=0x7f10e800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:41.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.189+0000 7f10f17fa640 1 -- 172.21.15.17:0/2656234234 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10e8017070 con 0x7f10f4107900 2024-09-20T19:06:41.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.189+0000 7f10fa425640 1 -- 172.21.15.17:0/2656234234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f4075260 con 0x7f10f4107900 2024-09-20T19:06:41.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.189+0000 7f10f17fa640 1 -- 172.21.15.17:0/2656234234 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f10e800de00 con 0x7f10f4107900 2024-09-20T19:06:41.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.189+0000 7f10f17fa640 1 -- 172.21.15.17:0/2656234234 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10e8004bb0 con 0x7f10f4107900 2024-09-20T19:06:41.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.189+0000 7f10fa425640 1 -- 172.21.15.17:0/2656234234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f41a3e40 con 0x7f10f4107900 2024-09-20T19:06:41.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.190+0000 7f10fa425640 1 -- 172.21.15.17:0/2656234234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f4103040 con 0x7f10f4107900 2024-09-20T19:06:41.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.191+0000 7f10f17fa640 1 -- 172.21.15.17:0/2656234234 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f10e8009a30 con 0x7f10f4107900 2024-09-20T19:06:41.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.191+0000 7f10f17fa640 1 --2- 172.21.15.17:0/2656234234 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f10dc07af80 0x7f10dc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:41.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.192+0000 7f10f17fa640 1 -- 172.21.15.17:0/2656234234 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f10e809dc20 con 0x7f10f4107900 2024-09-20T19:06:41.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.192+0000 7f10f3fff640 1 --2- 172.21.15.17:0/2656234234 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f10dc07af80 0x7f10dc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:41.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.192+0000 7f10f3fff640 1 --2- 172.21.15.17:0/2656234234 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f10dc07af80 0x7f10dc07d440 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f10e40096c0 tx=0x7f10e4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:41.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.196+0000 7f10f17fa640 1 -- 172.21.15.17:0/2656234234 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f10e8069200 con 0x7f10f4107900 2024-09-20T19:06:41.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.403+0000 7f10fa425640 1 -- 172.21.15.17:0/2656234234 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f10f4062630 con 0x7f10dc07af80 2024-09-20T19:06:41.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.404+0000 7f10f17fa640 1 -- 172.21.15.17:0/2656234234 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f10f4062630 con 0x7f10dc07af80 2024-09-20T19:06:41.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.406+0000 7f10fa425640 1 -- 172.21.15.17:0/2656234234 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f10dc07af80 msgr2=0x7f10dc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:41.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.406+0000 7f10fa425640 1 --2- 172.21.15.17:0/2656234234 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f10dc07af80 0x7f10dc07d440 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f10e40096c0 tx=0x7f10e4031400 comp rx=0 tx=0).stop 2024-09-20T19:06:41.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.406+0000 7f10fa425640 1 -- 172.21.15.17:0/2656234234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f4107900 msgr2=0x7f10f4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:41.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.406+0000 7f10fa425640 1 --2- 172.21.15.17:0/2656234234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f4107900 0x7f10f4074a30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f10e800d6f0 tx=0x7f10e800dbb0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.407+0000 7f10fa425640 1 -- 172.21.15.17:0/2656234234 shutdown_connections 2024-09-20T19:06:41.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.407+0000 7f10fa425640 1 --2- 172.21.15.17:0/2656234234 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f10dc07af80 0x7f10dc07d440 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.407+0000 7f10fa425640 1 --2- 172.21.15.17:0/2656234234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10f4107900 0x7f10f4074a30 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.407+0000 7f10fa425640 1 --2- 172.21.15.17:0/2656234234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10f4101900 0x7f10f40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.407+0000 7f10fa425640 1 -- 172.21.15.17:0/2656234234 >> 172.21.15.17:0/2656234234 conn(0x7f10f40fd600 msgr2=0x7f10f40fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:41.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.407+0000 7f10fa425640 1 -- 172.21.15.17:0/2656234234 shutdown_connections 2024-09-20T19:06:41.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.407+0000 7f10fa425640 1 -- 172.21.15.17:0/2656234234 wait complete. 2024-09-20T19:06:41.420 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:06:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.492+0000 7f30c772d640 1 -- 172.21.15.17:0/1774513369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30c0107960 msgr2=0x7f30c0107d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.492+0000 7f30c772d640 1 --2- 172.21.15.17:0/1774513369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30c0107960 0x7f30c0107d40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f30bc009880 tx=0x7f30bc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.492+0000 7f30c772d640 1 -- 172.21.15.17:0/1774513369 shutdown_connections 2024-09-20T19:06:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.492+0000 7f30c772d640 1 --2- 172.21.15.17:0/1774513369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30c0101960 0x7f30c0101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.492+0000 7f30c772d640 1 --2- 172.21.15.17:0/1774513369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30c0107960 0x7f30c0107d40 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.492+0000 7f30c772d640 1 -- 172.21.15.17:0/1774513369 >> 172.21.15.17:0/1774513369 conn(0x7f30c00fd680 msgr2=0x7f30c00ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.492+0000 7f30c772d640 1 -- 172.21.15.17:0/1774513369 shutdown_connections 2024-09-20T19:06:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.492+0000 7f30c772d640 1 -- 172.21.15.17:0/1774513369 wait complete. 2024-09-20T19:06:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.493+0000 7f30c772d640 1 Processor -- start 2024-09-20T19:06:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.493+0000 7f30c772d640 1 -- start start 2024-09-20T19:06:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.493+0000 7f30c772d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30c0101960 0x7f30c019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.493+0000 7f30c772d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30c0107960 0x7f30c019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.493+0000 7f30c772d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f30c010ee30 con 0x7f30c0107960 2024-09-20T19:06:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.493+0000 7f30c772d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30c010ecb0 con 0x7f30c0101960 2024-09-20T19:06:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.493+0000 7f30c4cc8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30c0107960 0x7f30c019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.493+0000 7f30c4cc8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30c0107960 0x7f30c019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41250/0 (socket says 172.21.15.17:41250) 2024-09-20T19:06:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.493+0000 7f30c4cc8640 1 -- 172.21.15.17:0/617523468 learned_addr learned my addr 172.21.15.17:0/617523468 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:06:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.494+0000 7f30c54c9640 1 --2- 172.21.15.17:0/617523468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30c0101960 0x7f30c019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.494+0000 7f30c4cc8640 1 -- 172.21.15.17:0/617523468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30c0101960 msgr2=0x7f30c019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.494+0000 7f30c4cc8640 1 --2- 172.21.15.17:0/617523468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30c0101960 0x7f30c019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.494+0000 7f30c4cc8640 1 -- 172.21.15.17:0/617523468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c0197800 con 0x7f30c0107960 2024-09-20T19:06:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.494+0000 7f30c4cc8640 1 --2- 172.21.15.17:0/617523468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30c0107960 0x7f30c019dbc0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f30b400d6f0 tx=0x7f30b400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.494+0000 7f30b27fc640 1 -- 172.21.15.17:0/617523468 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f30b4017070 con 0x7f30c0107960 2024-09-20T19:06:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.494+0000 7f30b27fc640 1 -- 172.21.15.17:0/617523468 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f30b400de00 con 0x7f30c0107960 2024-09-20T19:06:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.494+0000 7f30c772d640 1 -- 172.21.15.17:0/617523468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30c0197af0 con 0x7f30c0107960 2024-09-20T19:06:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.494+0000 7f30b27fc640 1 -- 172.21.15.17:0/617523468 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f30b4004bb0 con 0x7f30c0107960 2024-09-20T19:06:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.494+0000 7f30c772d640 1 -- 172.21.15.17:0/617523468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30c0198080 con 0x7f30c0107960 2024-09-20T19:06:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.495+0000 7f30c772d640 1 -- 172.21.15.17:0/617523468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30c01030a0 con 0x7f30c0107960 2024-09-20T19:06:41.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.496+0000 7f30b27fc640 1 -- 172.21.15.17:0/617523468 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f30b4009a30 con 0x7f30c0107960 2024-09-20T19:06:41.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.497+0000 7f30b27fc640 1 --2- 172.21.15.17:0/617523468 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f30ac07af80 0x7f30ac07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:41.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.497+0000 7f30b27fc640 1 -- 172.21.15.17:0/617523468 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f30b409dac0 con 0x7f30c0107960 2024-09-20T19:06:41.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.497+0000 7f30c54c9640 1 --2- 172.21.15.17:0/617523468 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f30ac07af80 0x7f30ac07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:41.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.498+0000 7f30c54c9640 1 --2- 172.21.15.17:0/617523468 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f30ac07af80 0x7f30ac07d440 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0096c0 tx=0x7f30bc031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:41.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.501+0000 7f30b27fc640 1 -- 172.21.15.17:0/617523468 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f30b4069140 con 0x7f30c0107960 2024-09-20T19:06:41.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.708+0000 7f30c772d640 1 -- 172.21.15.17:0/617523468 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f30c0198330 con 0x7f30ac07af80 2024-09-20T19:06:41.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.709+0000 7f30b27fc640 1 -- 172.21.15.17:0/617523468 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f30c0198330 con 0x7f30ac07af80 2024-09-20T19:06:41.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.712+0000 7f30c772d640 1 -- 172.21.15.17:0/617523468 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f30ac07af80 msgr2=0x7f30ac07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:41.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.712+0000 7f30c772d640 1 --2- 172.21.15.17:0/617523468 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f30ac07af80 0x7f30ac07d440 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0096c0 tx=0x7f30bc031400 comp rx=0 tx=0).stop 2024-09-20T19:06:41.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.712+0000 7f30c772d640 1 -- 172.21.15.17:0/617523468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30c0107960 msgr2=0x7f30c019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:41.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.712+0000 7f30c772d640 1 --2- 172.21.15.17:0/617523468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30c0107960 0x7f30c019dbc0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f30b400d6f0 tx=0x7f30b400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.712+0000 7f30c772d640 1 -- 172.21.15.17:0/617523468 shutdown_connections 2024-09-20T19:06:41.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.712+0000 7f30c772d640 1 --2- 172.21.15.17:0/617523468 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f30ac07af80 0x7f30ac07d440 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.712+0000 7f30c772d640 1 --2- 172.21.15.17:0/617523468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30c0107960 0x7f30c019dbc0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.712+0000 7f30c772d640 1 --2- 172.21.15.17:0/617523468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30c0101960 0x7f30c019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.712+0000 7f30c772d640 1 -- 172.21.15.17:0/617523468 >> 172.21.15.17:0/617523468 conn(0x7f30c00fd680 msgr2=0x7f30c00fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:41.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.712+0000 7f30c772d640 1 -- 172.21.15.17:0/617523468 shutdown_connections 2024-09-20T19:06:41.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.712+0000 7f30c772d640 1 -- 172.21.15.17:0/617523468 wait complete. 2024-09-20T19:06:41.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.796+0000 7fb804b05640 1 -- 172.21.15.17:0/429763979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8001007f0 msgr2=0x7fb800100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:41.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.796+0000 7fb804b05640 1 --2- 172.21.15.17:0/429763979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8001007f0 0x7fb800100c50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009880 tx=0x7fb7f402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.797+0000 7fb804b05640 1 -- 172.21.15.17:0/429763979 shutdown_connections 2024-09-20T19:06:41.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.797+0000 7fb804b05640 1 --2- 172.21.15.17:0/429763979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8001007f0 0x7fb800100c50 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.797+0000 7fb804b05640 1 --2- 172.21.15.17:0/429763979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8001067f0 0x7fb800106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.797+0000 7fb804b05640 1 -- 172.21.15.17:0/429763979 >> 172.21.15.17:0/429763979 conn(0x7fb8000fc550 msgr2=0x7fb8000fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:41.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.797+0000 7fb804b05640 1 -- 172.21.15.17:0/429763979 shutdown_connections 2024-09-20T19:06:41.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.797+0000 7fb804b05640 1 -- 172.21.15.17:0/429763979 wait complete. 2024-09-20T19:06:41.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.797+0000 7fb804b05640 1 Processor -- start 2024-09-20T19:06:41.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.797+0000 7fb804b05640 1 -- start start 2024-09-20T19:06:41.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.798+0000 7fb804b05640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8001007f0 0x7fb80019d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:41.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.798+0000 7fb804b05640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8001067f0 0x7fb80019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:41.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.798+0000 7fb804b05640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb80010dca0 con 0x7fb8001007f0 2024-09-20T19:06:41.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.798+0000 7fb804b05640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb80010db20 con 0x7fb8001067f0 2024-09-20T19:06:41.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.798+0000 7fb7fe59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8001007f0 0x7fb80019d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:41.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.798+0000 7fb7fe59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8001007f0 0x7fb80019d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41262/0 (socket says 172.21.15.17:41262) 2024-09-20T19:06:41.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.798+0000 7fb7fe59c640 1 -- 172.21.15.17:0/2714550917 learned_addr learned my addr 172.21.15.17:0/2714550917 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:06:41.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.798+0000 7fb7fdd9b640 1 --2- 172.21.15.17:0/2714550917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8001067f0 0x7fb80019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:41.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.798+0000 7fb7fe59c640 1 -- 172.21.15.17:0/2714550917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8001067f0 msgr2=0x7fb80019db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:41.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.798+0000 7fb7fe59c640 1 --2- 172.21.15.17:0/2714550917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8001067f0 0x7fb80019db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:41.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.798+0000 7fb7fe59c640 1 -- 172.21.15.17:0/2714550917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb800197780 con 0x7fb8001007f0 2024-09-20T19:06:41.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.798+0000 7fb7fe59c640 1 --2- 172.21.15.17:0/2714550917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8001007f0 0x7fb80019d600 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000c8a0 tx=0x7fb7f000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:41.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.798+0000 7fb7ef7fe640 1 -- 172.21.15.17:0/2714550917 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7f00079b0 con 0x7fb8001007f0 2024-09-20T19:06:41.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.798+0000 7fb7ef7fe640 1 -- 172.21.15.17:0/2714550917 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7f0007b50 con 0x7fb8001007f0 2024-09-20T19:06:41.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.798+0000 7fb804b05640 1 -- 172.21.15.17:0/2714550917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb800197a70 con 0x7fb8001007f0 2024-09-20T19:06:41.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.799+0000 7fb7ef7fe640 1 -- 172.21.15.17:0/2714550917 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7f0018700 con 0x7fb8001007f0 2024-09-20T19:06:41.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.799+0000 7fb804b05640 1 -- 172.21.15.17:0/2714550917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb800197fd0 con 0x7fb8001007f0 2024-09-20T19:06:41.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.800+0000 7fb804b05640 1 -- 172.21.15.17:0/2714550917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb800101f30 con 0x7fb8001007f0 2024-09-20T19:06:41.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.800+0000 7fb7ef7fe640 1 -- 172.21.15.17:0/2714550917 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb7f0007d00 con 0x7fb8001007f0 2024-09-20T19:06:41.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.801+0000 7fb7ef7fe640 1 --2- 172.21.15.17:0/2714550917 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7e807af80 0x7fb7e807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:41.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.801+0000 7fb7fdd9b640 1 --2- 172.21.15.17:0/2714550917 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7e807af80 0x7fb7e807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:41.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.801+0000 7fb7ef7fe640 1 -- 172.21.15.17:0/2714550917 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fb7f009e160 con 0x7fb8001007f0 2024-09-20T19:06:41.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.802+0000 7fb7fdd9b640 1 --2- 172.21.15.17:0/2714550917 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7e807af80 0x7fb7e807d440 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb800198ad0 tx=0x7fb7f4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:41.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:41.806+0000 7fb7ef7fe640 1 -- 172.21.15.17:0/2714550917 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7f0014030 con 0x7fb8001007f0 2024-09-20T19:06:41.949 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:41 smithi172 ceph-mon[80431]: pgmap v939: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.001+0000 7fb804b05640 1 -- 172.21.15.17:0/2714550917 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb800198340 con 0x7fb7e807af80 2024-09-20T19:06:42.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.010+0000 7fb7ef7fe640 1 -- 172.21.15.17:0/2714550917 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb800198340 con 0x7fb7e807af80 2024-09-20T19:06:42.015 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:06:42.015 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (28m) 6m ago 39m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:06:42.015 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (31m) 6m ago 39m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:06:42.015 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (30m) 6m ago 38m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:06:42.015 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (26m) 6m ago 39m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:06:42.015 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (26m) 6m ago 38m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:06:42.015 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (27m) 6m ago 38m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:06:42.015 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (22m) 6m ago 33m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:06:42.015 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (22m) 6m ago 33m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:06:42.015 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (6m) 6m ago 33m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:06:42.015 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (22m) 6m ago 33m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:06:42.015 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (30m) 6m ago 40m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:06:42.016 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (29m) 6m ago 38m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:06:42.016 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (26m) 6m ago 40m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:06:42.016 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (26m) 6m ago 38m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:06:42.016 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (28m) 6m ago 39m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:06:42.016 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (28m) 6m ago 38m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:06:42.016 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (25m) 6m ago 37m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:06:42.016 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (25m) 6m ago 36m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:06:42.016 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (24m) 6m ago 36m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:06:42.016 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (24m) 6m ago 35m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:06:42.016 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (23m) 6m ago 35m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:06:42.016 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (22m) 6m ago 34m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:06:42.016 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (28m) 6m ago 38m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:06:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.012+0000 7fb804b05640 1 -- 172.21.15.17:0/2714550917 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7e807af80 msgr2=0x7fb7e807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.012+0000 7fb804b05640 1 --2- 172.21.15.17:0/2714550917 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7e807af80 0x7fb7e807d440 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb800198ad0 tx=0x7fb7f4031400 comp rx=0 tx=0).stop 2024-09-20T19:06:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.012+0000 7fb804b05640 1 -- 172.21.15.17:0/2714550917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8001007f0 msgr2=0x7fb80019d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.012+0000 7fb804b05640 1 --2- 172.21.15.17:0/2714550917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8001007f0 0x7fb80019d600 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000c8a0 tx=0x7fb7f000cd60 comp rx=0 tx=0).stop 2024-09-20T19:06:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.013+0000 7fb804b05640 1 -- 172.21.15.17:0/2714550917 shutdown_connections 2024-09-20T19:06:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.013+0000 7fb804b05640 1 --2- 172.21.15.17:0/2714550917 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7e807af80 0x7fb7e807d440 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.013+0000 7fb804b05640 1 --2- 172.21.15.17:0/2714550917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8001067f0 0x7fb80019db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.013+0000 7fb804b05640 1 --2- 172.21.15.17:0/2714550917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8001007f0 0x7fb80019d600 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.013+0000 7fb804b05640 1 -- 172.21.15.17:0/2714550917 >> 172.21.15.17:0/2714550917 conn(0x7fb8000fc550 msgr2=0x7fb800069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:42.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.013+0000 7fb804b05640 1 -- 172.21.15.17:0/2714550917 shutdown_connections 2024-09-20T19:06:42.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.013+0000 7fb804b05640 1 -- 172.21.15.17:0/2714550917 wait complete. 2024-09-20T19:06:42.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.095+0000 7fcb70aab640 1 -- 172.21.15.17:0/3493956431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb6c102ac0 msgr2=0x7fcb6c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.095+0000 7fcb70aab640 1 --2- 172.21.15.17:0/3493956431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb6c102ac0 0x7fcb6c102ea0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009880 tx=0x7fcb5c02a530 comp rx=0 tx=0).stop 2024-09-20T19:06:42.100 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:41 smithi017 ceph-mon[108970]: pgmap v939: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.095+0000 7fcb70aab640 1 -- 172.21.15.17:0/3493956431 shutdown_connections 2024-09-20T19:06:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.095+0000 7fcb70aab640 1 --2- 172.21.15.17:0/3493956431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb6c1033e0 0x7fcb6c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.095+0000 7fcb70aab640 1 --2- 172.21.15.17:0/3493956431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb6c102ac0 0x7fcb6c102ea0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.095+0000 7fcb70aab640 1 -- 172.21.15.17:0/3493956431 >> 172.21.15.17:0/3493956431 conn(0x7fcb6c0fc520 msgr2=0x7fcb6c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.095+0000 7fcb70aab640 1 -- 172.21.15.17:0/3493956431 shutdown_connections 2024-09-20T19:06:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.095+0000 7fcb70aab640 1 -- 172.21.15.17:0/3493956431 wait complete. 2024-09-20T19:06:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.096+0000 7fcb70aab640 1 Processor -- start 2024-09-20T19:06:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.096+0000 7fcb70aab640 1 -- start start 2024-09-20T19:06:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.097+0000 7fcb70aab640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb6c102ac0 0x7fcb6c100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.097+0000 7fcb70aab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb6c1033e0 0x7fcb6c100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.097+0000 7fcb70aab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c10edd0 con 0x7fcb6c1033e0 2024-09-20T19:06:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.097+0000 7fcb70aab640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c10ec50 con 0x7fcb6c102ac0 2024-09-20T19:06:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.097+0000 7fcb69d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb6c1033e0 0x7fcb6c100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.097+0000 7fcb69d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb6c1033e0 0x7fcb6c100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41280/0 (socket says 172.21.15.17:41280) 2024-09-20T19:06:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.097+0000 7fcb69d9b640 1 -- 172.21.15.17:0/1056403315 learned_addr learned my addr 172.21.15.17:0/1056403315 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:06:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.097+0000 7fcb6a59c640 1 --2- 172.21.15.17:0/1056403315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb6c102ac0 0x7fcb6c100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.097+0000 7fcb69d9b640 1 -- 172.21.15.17:0/1056403315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb6c102ac0 msgr2=0x7fcb6c100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.097+0000 7fcb69d9b640 1 --2- 172.21.15.17:0/1056403315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb6c102ac0 0x7fcb6c100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.097+0000 7fcb69d9b640 1 -- 172.21.15.17:0/1056403315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c1011a0 con 0x7fcb6c1033e0 2024-09-20T19:06:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.097+0000 7fcb6a59c640 1 --2- 172.21.15.17:0/1056403315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb6c102ac0 0x7fcb6c100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:06:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.097+0000 7fcb69d9b640 1 --2- 172.21.15.17:0/1056403315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb6c1033e0 0x7fcb6c100c60 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000d8d0 tx=0x7fcb6000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.097+0000 7fcb5b7fe640 1 -- 172.21.15.17:0/1056403315 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb60017030 con 0x7fcb6c1033e0 2024-09-20T19:06:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.097+0000 7fcb5b7fe640 1 -- 172.21.15.17:0/1056403315 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcb6000be10 con 0x7fcb6c1033e0 2024-09-20T19:06:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.097+0000 7fcb70aab640 1 -- 172.21.15.17:0/1056403315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6c101490 con 0x7fcb6c1033e0 2024-09-20T19:06:42.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.098+0000 7fcb5b7fe640 1 -- 172.21.15.17:0/1056403315 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb60005580 con 0x7fcb6c1033e0 2024-09-20T19:06:42.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.098+0000 7fcb70aab640 1 -- 172.21.15.17:0/1056403315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb6c1a3e40 con 0x7fcb6c1033e0 2024-09-20T19:06:42.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.099+0000 7fcb70aab640 1 -- 172.21.15.17:0/1056403315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb6c06aa90 con 0x7fcb6c1033e0 2024-09-20T19:06:42.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.099+0000 7fcb5b7fe640 1 -- 172.21.15.17:0/1056403315 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fcb60004020 con 0x7fcb6c1033e0 2024-09-20T19:06:42.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.100+0000 7fcb5b7fe640 1 --2- 172.21.15.17:0/1056403315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb5407af30 0x7fcb5407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:42.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.100+0000 7fcb5b7fe640 1 -- 172.21.15.17:0/1056403315 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fcb60018070 con 0x7fcb6c1033e0 2024-09-20T19:06:42.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.100+0000 7fcb6a59c640 1 --2- 172.21.15.17:0/1056403315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb5407af30 0x7fcb5407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:42.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.101+0000 7fcb6a59c640 1 --2- 172.21.15.17:0/1056403315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb5407af30 0x7fcb5407d3f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c000c00 tx=0x7fcb5c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:42.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.104+0000 7fcb5b7fe640 1 -- 172.21.15.17:0/1056403315 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb60069370 con 0x7fcb6c1033e0 2024-09-20T19:06:42.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.366+0000 7fcb70aab640 1 -- 172.21.15.17:0/1056403315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fcb6c105f90 con 0x7fcb6c1033e0 2024-09-20T19:06:42.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.366+0000 7fcb5b7fe640 1 -- 172.21.15.17:0/1056403315 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fcb6006e220 con 0x7fcb6c1033e0 2024-09-20T19:06:42.371 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:06:42.371 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:06:42.371 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:06:42.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:06:42.371 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:06:42.371 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:06:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:06:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:06:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:06:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:06:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:06:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:06:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:06:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:06:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:06:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:06:42.372 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:06:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.368+0000 7fcb70aab640 1 -- 172.21.15.17:0/1056403315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb5407af30 msgr2=0x7fcb5407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.368+0000 7fcb70aab640 1 --2- 172.21.15.17:0/1056403315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb5407af30 0x7fcb5407d3f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c000c00 tx=0x7fcb5c031400 comp rx=0 tx=0).stop 2024-09-20T19:06:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.368+0000 7fcb70aab640 1 -- 172.21.15.17:0/1056403315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb6c1033e0 msgr2=0x7fcb6c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.368+0000 7fcb70aab640 1 --2- 172.21.15.17:0/1056403315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb6c1033e0 0x7fcb6c100c60 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000d8d0 tx=0x7fcb6000dd90 comp rx=0 tx=0).stop 2024-09-20T19:06:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.369+0000 7fcb70aab640 1 -- 172.21.15.17:0/1056403315 shutdown_connections 2024-09-20T19:06:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.369+0000 7fcb70aab640 1 --2- 172.21.15.17:0/1056403315 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fcb5407af30 0x7fcb5407d3f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.369+0000 7fcb70aab640 1 --2- 172.21.15.17:0/1056403315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb6c1033e0 0x7fcb6c100c60 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.369+0000 7fcb70aab640 1 --2- 172.21.15.17:0/1056403315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb6c102ac0 0x7fcb6c100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.369+0000 7fcb70aab640 1 -- 172.21.15.17:0/1056403315 >> 172.21.15.17:0/1056403315 conn(0x7fcb6c0fc520 msgr2=0x7fcb6c108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.369+0000 7fcb70aab640 1 -- 172.21.15.17:0/1056403315 shutdown_connections 2024-09-20T19:06:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.369+0000 7fcb70aab640 1 -- 172.21.15.17:0/1056403315 wait complete. 2024-09-20T19:06:42.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.452+0000 7f72077b6640 1 -- 172.21.15.17:0/1654199163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7200100c00 msgr2=0x7f7200104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:42.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.453+0000 7f72077b6640 1 --2- 172.21.15.17:0/1654199163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7200100c00 0x7f7200104c50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009880 tx=0x7f71f002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.453+0000 7f72077b6640 1 -- 172.21.15.17:0/1654199163 shutdown_connections 2024-09-20T19:06:42.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.453+0000 7f72077b6640 1 --2- 172.21.15.17:0/1654199163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7200100c00 0x7f7200104c50 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.453+0000 7f72077b6640 1 --2- 172.21.15.17:0/1654199163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7200100250 0x7f7200100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.453+0000 7f72077b6640 1 -- 172.21.15.17:0/1654199163 >> 172.21.15.17:0/1654199163 conn(0x7f72000fbc90 msgr2=0x7f72000fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:42.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.453+0000 7f72077b6640 1 -- 172.21.15.17:0/1654199163 shutdown_connections 2024-09-20T19:06:42.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.453+0000 7f72077b6640 1 -- 172.21.15.17:0/1654199163 wait complete. 2024-09-20T19:06:42.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.453+0000 7f72077b6640 1 Processor -- start 2024-09-20T19:06:42.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.453+0000 7f72077b6640 1 -- start start 2024-09-20T19:06:42.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.454+0000 7f72077b6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7200100250 0x7f7200101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:42.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.454+0000 7f72077b6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7200100c00 0x7f7200102230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:42.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.454+0000 7f72077b6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f720010cc40 con 0x7f7200100c00 2024-09-20T19:06:42.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.454+0000 7f72077b6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f720010cac0 con 0x7f7200100250 2024-09-20T19:06:42.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.454+0000 7f7204d51640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7200100c00 0x7f7200102230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:42.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.454+0000 7f7204d51640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7200100c00 0x7f7200102230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41288/0 (socket says 172.21.15.17:41288) 2024-09-20T19:06:42.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.454+0000 7f7204d51640 1 -- 172.21.15.17:0/2719902555 learned_addr learned my addr 172.21.15.17:0/2719902555 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:06:42.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.454+0000 7f7205552640 1 --2- 172.21.15.17:0/2719902555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7200100250 0x7f7200101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:42.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.454+0000 7f7204d51640 1 -- 172.21.15.17:0/2719902555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7200100250 msgr2=0x7f7200101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:42.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.454+0000 7f7204d51640 1 --2- 172.21.15.17:0/2719902555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7200100250 0x7f7200101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.454+0000 7f7204d51640 1 -- 172.21.15.17:0/2719902555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7200102770 con 0x7f7200100c00 2024-09-20T19:06:42.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.454+0000 7f7204d51640 1 --2- 172.21.15.17:0/2719902555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7200100c00 0x7f7200102230 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f71f0031460 tx=0x7f71f00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:42.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.454+0000 7f71f67fc640 1 -- 172.21.15.17:0/2719902555 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f71f003f070 con 0x7f7200100c00 2024-09-20T19:06:42.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.454+0000 7f71f67fc640 1 -- 172.21.15.17:0/2719902555 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f71f00035f0 con 0x7f7200100c00 2024-09-20T19:06:42.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.454+0000 7f72077b6640 1 -- 172.21.15.17:0/2719902555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7200102a00 con 0x7f7200100c00 2024-09-20T19:06:42.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.454+0000 7f71f67fc640 1 -- 172.21.15.17:0/2719902555 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f71f0035030 con 0x7f7200100c00 2024-09-20T19:06:42.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.455+0000 7f72077b6640 1 -- 172.21.15.17:0/2719902555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72001a3e00 con 0x7f7200100c00 2024-09-20T19:06:42.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.456+0000 7f72077b6640 1 -- 172.21.15.17:0/2719902555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7200101730 con 0x7f7200100c00 2024-09-20T19:06:42.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.456+0000 7f71f67fc640 1 -- 172.21.15.17:0/2719902555 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f71f0042070 con 0x7f7200100c00 2024-09-20T19:06:42.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.457+0000 7f71f67fc640 1 --2- 172.21.15.17:0/2719902555 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f71ec07af30 0x7f71ec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:42.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.457+0000 7f71f67fc640 1 -- 172.21.15.17:0/2719902555 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f71f00be970 con 0x7f7200100c00 2024-09-20T19:06:42.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.457+0000 7f7205552640 1 --2- 172.21.15.17:0/2719902555 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f71ec07af30 0x7f71ec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:42.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.457+0000 7f7205552640 1 --2- 172.21.15.17:0/2719902555 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f71ec07af30 0x7f71ec07d3f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f71fc005fd0 tx=0x7f71fc00b490 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:42.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.461+0000 7f71f67fc640 1 -- 172.21.15.17:0/2719902555 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71f00c0e20 con 0x7f7200100c00 2024-09-20T19:06:42.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.689+0000 7f72077b6640 1 -- 172.21.15.17:0/2719902555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f720010a570 con 0x7f7200100c00 2024-09-20T19:06:42.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.689+0000 7f71f67fc640 1 -- 172.21.15.17:0/2719902555 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7f71f0089f70 con 0x7f7200100c00 2024-09-20T19:06:42.694 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:06:42.694 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:06:42.694 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:06:42.694 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:06:42.694 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:06:42.694 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:06:42.694 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:06:42.694 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:06:42.695 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:06:42.695 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:06:42.695 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:06:42.695 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:06:42.695 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:06:42.695 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:06:42.695 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:06:42.695 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:06:42.695 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:06:42.695 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:06:42.695 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:06:42.696 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:06:42.696 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:06:42.696 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:06:42.696 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:06:42.696 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:06:42.696 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:06:42.696 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:06:42.696 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:06:42.696 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:06:42.696 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:06:42.696 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:06:42.696 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:06:42.696 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:06:42.696 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:06:42.697 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:06:42.697 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:06:42.697 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:06:42.697 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:06:42.697 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:06:42.697 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:06:42.697 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:06:42.697 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:06:42.697 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:06:42.697 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:06:42.698 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:06:42.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.691+0000 7f72077b6640 1 -- 172.21.15.17:0/2719902555 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f71ec07af30 msgr2=0x7f71ec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:42.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.691+0000 7f72077b6640 1 --2- 172.21.15.17:0/2719902555 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f71ec07af30 0x7f71ec07d3f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f71fc005fd0 tx=0x7f71fc00b490 comp rx=0 tx=0).stop 2024-09-20T19:06:42.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.691+0000 7f72077b6640 1 -- 172.21.15.17:0/2719902555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7200100c00 msgr2=0x7f7200102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:42.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.691+0000 7f72077b6640 1 --2- 172.21.15.17:0/2719902555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7200100c00 0x7f7200102230 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f71f0031460 tx=0x7f71f00045e0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.691+0000 7f72077b6640 1 -- 172.21.15.17:0/2719902555 shutdown_connections 2024-09-20T19:06:42.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.691+0000 7f72077b6640 1 --2- 172.21.15.17:0/2719902555 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f71ec07af30 0x7f71ec07d3f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.691+0000 7f72077b6640 1 --2- 172.21.15.17:0/2719902555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7200100c00 0x7f7200102230 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.691+0000 7f72077b6640 1 --2- 172.21.15.17:0/2719902555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7200100250 0x7f7200101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.691+0000 7f72077b6640 1 -- 172.21.15.17:0/2719902555 >> 172.21.15.17:0/2719902555 conn(0x7f72000fbc90 msgr2=0x7f72000fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:42.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.692+0000 7f72077b6640 1 -- 172.21.15.17:0/2719902555 shutdown_connections 2024-09-20T19:06:42.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.692+0000 7f72077b6640 1 -- 172.21.15.17:0/2719902555 wait complete. 2024-09-20T19:06:42.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.777+0000 7f3aa2d38640 1 -- 172.21.15.17:0/2414926406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c102b10 msgr2=0x7f3a9c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:42.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.777+0000 7f3aa2d38640 1 --2- 172.21.15.17:0/2414926406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c102b10 0x7f3a9c102ef0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3a900098b0 tx=0x7f3a9002a560 comp rx=0 tx=0).stop 2024-09-20T19:06:42.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.777+0000 7f3aa2d38640 1 -- 172.21.15.17:0/2414926406 shutdown_connections 2024-09-20T19:06:42.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.777+0000 7f3aa2d38640 1 --2- 172.21.15.17:0/2414926406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a9c103430 0x7f3a9c10b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.777+0000 7f3aa2d38640 1 --2- 172.21.15.17:0/2414926406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c102b10 0x7f3a9c102ef0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.777+0000 7f3aa2d38640 1 -- 172.21.15.17:0/2414926406 >> 172.21.15.17:0/2414926406 conn(0x7f3a9c0fc550 msgr2=0x7f3a9c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:42.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.777+0000 7f3aa2d38640 1 -- 172.21.15.17:0/2414926406 shutdown_connections 2024-09-20T19:06:42.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.777+0000 7f3aa2d38640 1 -- 172.21.15.17:0/2414926406 wait complete. 2024-09-20T19:06:42.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.777+0000 7f3aa2d38640 1 Processor -- start 2024-09-20T19:06:42.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.778+0000 7f3aa2d38640 1 -- start start 2024-09-20T19:06:42.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.778+0000 7f3aa2d38640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c102b10 0x7f3a9c19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:42.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.778+0000 7f3aa2d38640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a9c103430 0x7f3a9c19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:42.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.778+0000 7f3aa2d38640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c10edc0 con 0x7f3a9c102b10 2024-09-20T19:06:42.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.778+0000 7f3aa2d38640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c10ec40 con 0x7f3a9c103430 2024-09-20T19:06:42.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.778+0000 7f3aa0ad4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c102b10 0x7f3a9c19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:42.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.778+0000 7f3aa0ad4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c102b10 0x7f3a9c19d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41310/0 (socket says 172.21.15.17:41310) 2024-09-20T19:06:42.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.778+0000 7f3aa0ad4640 1 -- 172.21.15.17:0/1752577859 learned_addr learned my addr 172.21.15.17:0/1752577859 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:06:42.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.778+0000 7f3a9bfff640 1 --2- 172.21.15.17:0/1752577859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a9c103430 0x7f3a9c19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:42.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.778+0000 7f3aa0ad4640 1 -- 172.21.15.17:0/1752577859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a9c103430 msgr2=0x7f3a9c19db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:42.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.778+0000 7f3aa0ad4640 1 --2- 172.21.15.17:0/1752577859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a9c103430 0x7f3a9c19db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:42.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.778+0000 7f3aa0ad4640 1 -- 172.21.15.17:0/1752577859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9c1977d0 con 0x7f3a9c102b10 2024-09-20T19:06:42.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.778+0000 7f3aa0ad4640 1 --2- 172.21.15.17:0/1752577859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c102b10 0x7f3a9c19d650 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3a900099d0 tx=0x7f3a900045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:42.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.780+0000 7f3a99ffb640 1 -- 172.21.15.17:0/1752577859 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a9003f070 con 0x7f3a9c102b10 2024-09-20T19:06:42.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.780+0000 7f3aa2d38640 1 -- 172.21.15.17:0/1752577859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9c197a60 con 0x7f3a9c102b10 2024-09-20T19:06:42.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.780+0000 7f3a99ffb640 1 -- 172.21.15.17:0/1752577859 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a900035f0 con 0x7f3a9c102b10 2024-09-20T19:06:42.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.780+0000 7f3a99ffb640 1 -- 172.21.15.17:0/1752577859 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a90035030 con 0x7f3a9c102b10 2024-09-20T19:06:42.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.780+0000 7f3aa2d38640 1 -- 172.21.15.17:0/1752577859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a9c197f90 con 0x7f3a9c102b10 2024-09-20T19:06:42.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.781+0000 7f3aa2d38640 1 -- 172.21.15.17:0/1752577859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a9c06a520 con 0x7f3a9c102b10 2024-09-20T19:06:42.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.782+0000 7f3a99ffb640 1 -- 172.21.15.17:0/1752577859 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3a90042070 con 0x7f3a9c102b10 2024-09-20T19:06:42.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.782+0000 7f3a99ffb640 1 --2- 172.21.15.17:0/1752577859 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a8c07af40 0x7f3a8c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:42.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.782+0000 7f3a99ffb640 1 -- 172.21.15.17:0/1752577859 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f3a900be9d0 con 0x7f3a9c102b10 2024-09-20T19:06:42.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.782+0000 7f3a9bfff640 1 --2- 172.21.15.17:0/1752577859 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a8c07af40 0x7f3a8c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:42.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.783+0000 7f3a9bfff640 1 --2- 172.21.15.17:0/1752577859 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a8c07af40 0x7f3a8c07d400 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c108970 tx=0x7f3a8800b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:42.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.787+0000 7f3a99ffb640 1 -- 172.21.15.17:0/1752577859 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3a90089fd0 con 0x7f3a9c102b10 2024-09-20T19:06:42.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.991+0000 7f3aa2d38640 1 -- 172.21.15.17:0/1752577859 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3a9c198300 con 0x7f3a8c07af40 2024-09-20T19:06:42.996 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:42 smithi017 ceph-mon[108970]: from='client.35520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:42.996 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:42 smithi017 ceph-mon[108970]: from='client.35524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:42.996 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:42 smithi017 ceph-mon[108970]: from='client.35528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:42.996 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:42 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1056403315' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:06:42.996 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:42 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2719902555' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:06:42.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.993+0000 7f3a99ffb640 1 -- 172.21.15.17:0/1752577859 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3a9c198300 con 0x7f3a8c07af40 2024-09-20T19:06:42.997 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:06:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:06:43.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.996+0000 7f3aa2d38640 1 -- 172.21.15.17:0/1752577859 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a8c07af40 msgr2=0x7f3a8c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:43.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.996+0000 7f3aa2d38640 1 --2- 172.21.15.17:0/1752577859 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a8c07af40 0x7f3a8c07d400 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c108970 tx=0x7f3a8800b390 comp rx=0 tx=0).stop 2024-09-20T19:06:43.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.996+0000 7f3aa2d38640 1 -- 172.21.15.17:0/1752577859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c102b10 msgr2=0x7f3a9c19d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:43.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.996+0000 7f3aa2d38640 1 --2- 172.21.15.17:0/1752577859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c102b10 0x7f3a9c19d650 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3a900099d0 tx=0x7f3a900045e0 comp rx=0 tx=0).stop 2024-09-20T19:06:43.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.996+0000 7f3aa2d38640 1 -- 172.21.15.17:0/1752577859 shutdown_connections 2024-09-20T19:06:43.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.996+0000 7f3aa2d38640 1 --2- 172.21.15.17:0/1752577859 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3a8c07af40 0x7f3a8c07d400 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:43.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.996+0000 7f3aa2d38640 1 --2- 172.21.15.17:0/1752577859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a9c103430 0x7f3a9c19db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:43.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.996+0000 7f3aa2d38640 1 --2- 172.21.15.17:0/1752577859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c102b10 0x7f3a9c19d650 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:43.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.996+0000 7f3aa2d38640 1 -- 172.21.15.17:0/1752577859 >> 172.21.15.17:0/1752577859 conn(0x7f3a9c0fc550 msgr2=0x7f3a9c107e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:43.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.996+0000 7f3aa2d38640 1 -- 172.21.15.17:0/1752577859 shutdown_connections 2024-09-20T19:06:43.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:42.996+0000 7f3aa2d38640 1 -- 172.21.15.17:0/1752577859 wait complete. 2024-09-20T19:06:43.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.080+0000 7f8e42ee7640 1 -- 172.21.15.17:0/3519310379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e3c106800 msgr2=0x7f8e3c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:43.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.080+0000 7f8e42ee7640 1 --2- 172.21.15.17:0/3519310379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e3c106800 0x7f8e3c106be0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009880 tx=0x7f8e2c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:06:43.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.080+0000 7f8e42ee7640 1 -- 172.21.15.17:0/3519310379 shutdown_connections 2024-09-20T19:06:43.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.080+0000 7f8e42ee7640 1 --2- 172.21.15.17:0/3519310379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e3c100800 0x7f8e3c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:43.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.080+0000 7f8e42ee7640 1 --2- 172.21.15.17:0/3519310379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e3c106800 0x7f8e3c106be0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:43.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.080+0000 7f8e42ee7640 1 -- 172.21.15.17:0/3519310379 >> 172.21.15.17:0/3519310379 conn(0x7f8e3c0fc520 msgr2=0x7f8e3c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:43.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.081+0000 7f8e42ee7640 1 -- 172.21.15.17:0/3519310379 shutdown_connections 2024-09-20T19:06:43.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.081+0000 7f8e42ee7640 1 -- 172.21.15.17:0/3519310379 wait complete. 2024-09-20T19:06:43.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.081+0000 7f8e42ee7640 1 Processor -- start 2024-09-20T19:06:43.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.081+0000 7f8e42ee7640 1 -- start start 2024-09-20T19:06:43.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.081+0000 7f8e42ee7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e3c100800 0x7f8e3c19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:43.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.081+0000 7f8e42ee7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e3c106800 0x7f8e3c19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:43.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.081+0000 7f8e42ee7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c10dcb0 con 0x7f8e3c106800 2024-09-20T19:06:43.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.081+0000 7f8e42ee7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3c10db30 con 0x7f8e3c100800 2024-09-20T19:06:43.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.082+0000 7f8e3bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e3c106800 0x7f8e3c19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:43.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.082+0000 7f8e3bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e3c106800 0x7f8e3c19db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41318/0 (socket says 172.21.15.17:41318) 2024-09-20T19:06:43.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.082+0000 7f8e3bfff640 1 -- 172.21.15.17:0/3305798196 learned_addr learned my addr 172.21.15.17:0/3305798196 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:06:43.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.082+0000 7f8e40c83640 1 --2- 172.21.15.17:0/3305798196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e3c100800 0x7f8e3c19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:43.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.082+0000 7f8e3bfff640 1 -- 172.21.15.17:0/3305798196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e3c100800 msgr2=0x7f8e3c19d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:43.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.082+0000 7f8e3bfff640 1 --2- 172.21.15.17:0/3305798196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e3c100800 0x7f8e3c19d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:43.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.082+0000 7f8e3bfff640 1 -- 172.21.15.17:0/3305798196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3c1977b0 con 0x7f8e3c106800 2024-09-20T19:06:43.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.082+0000 7f8e40c83640 1 --2- 172.21.15.17:0/3305798196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e3c100800 0x7f8e3c19d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:06:43.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.082+0000 7f8e3bfff640 1 --2- 172.21.15.17:0/3305798196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e3c106800 0x7f8e3c19db70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000c8a0 tx=0x7f8e3000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:43.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.082+0000 7f8e39ffb640 1 -- 172.21.15.17:0/3305798196 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e300079b0 con 0x7f8e3c106800 2024-09-20T19:06:43.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.082+0000 7f8e39ffb640 1 -- 172.21.15.17:0/3305798196 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e30007b50 con 0x7f8e3c106800 2024-09-20T19:06:43.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.082+0000 7f8e42ee7640 1 -- 172.21.15.17:0/3305798196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e3c197aa0 con 0x7f8e3c106800 2024-09-20T19:06:43.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.082+0000 7f8e39ffb640 1 -- 172.21.15.17:0/3305798196 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e30018700 con 0x7f8e3c106800 2024-09-20T19:06:43.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.083+0000 7f8e42ee7640 1 -- 172.21.15.17:0/3305798196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e3c198030 con 0x7f8e3c106800 2024-09-20T19:06:43.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.084+0000 7f8e42ee7640 1 -- 172.21.15.17:0/3305798196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e3c101f40 con 0x7f8e3c106800 2024-09-20T19:06:43.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.084+0000 7f8e39ffb640 1 -- 172.21.15.17:0/3305798196 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8e30007d00 con 0x7f8e3c106800 2024-09-20T19:06:43.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.085+0000 7f8e39ffb640 1 --2- 172.21.15.17:0/3305798196 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e2407af30 0x7f8e2407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:06:43.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.085+0000 7f8e39ffb640 1 -- 172.21.15.17:0/3305798196 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f8e3009e310 con 0x7f8e3c106800 2024-09-20T19:06:43.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.085+0000 7f8e40c83640 1 --2- 172.21.15.17:0/3305798196 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e2407af30 0x7f8e2407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:06:43.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.085+0000 7f8e40c83640 1 --2- 172.21.15.17:0/3305798196 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e2407af30 0x7f8e2407d3f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c006010 tx=0x7f8e2c0095f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:06:43.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.089+0000 7f8e39ffb640 1 -- 172.21.15.17:0/3305798196 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8e30014030 con 0x7f8e3c106800 2024-09-20T19:06:43.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:42 smithi172 ceph-mon[80431]: from='client.35520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:43.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:42 smithi172 ceph-mon[80431]: from='client.35524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:43.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:42 smithi172 ceph-mon[80431]: from='client.35528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:43.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:42 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1056403315' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:06:43.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:42 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2719902555' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:06:43.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.351+0000 7f8e42ee7640 1 -- 172.21.15.17:0/3305798196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f8e3c198d10 con 0x7f8e3c106800 2024-09-20T19:06:43.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.351+0000 7f8e39ffb640 1 -- 172.21.15.17:0/3305798196 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f8e3c198d10 con 0x7f8e3c106800 2024-09-20T19:06:43.356 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:06:43.356 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:06:43.356 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:06:43.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:06:43.357 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:06:43.357 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:06:43.357 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:06:43.357 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:06:43.357 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:06:43.357 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:06:43.357 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:06:43.357 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:06:43.357 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:06:43.357 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:06:43.357 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:06:43.357 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:06:43.358 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:06:43.358 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:06:43.358 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:06:43.358 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:06:43.358 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:06:43.358 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:06:43.358 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:06:43.358 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:06:43.358 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:06:43.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.353+0000 7f8e42ee7640 1 -- 172.21.15.17:0/3305798196 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e2407af30 msgr2=0x7f8e2407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:43.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.353+0000 7f8e42ee7640 1 --2- 172.21.15.17:0/3305798196 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e2407af30 0x7f8e2407d3f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c006010 tx=0x7f8e2c0095f0 comp rx=0 tx=0).stop 2024-09-20T19:06:43.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.353+0000 7f8e42ee7640 1 -- 172.21.15.17:0/3305798196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e3c106800 msgr2=0x7f8e3c19db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:06:43.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.353+0000 7f8e42ee7640 1 --2- 172.21.15.17:0/3305798196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e3c106800 0x7f8e3c19db70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000c8a0 tx=0x7f8e3000cd60 comp rx=0 tx=0).stop 2024-09-20T19:06:43.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.354+0000 7f8e42ee7640 1 -- 172.21.15.17:0/3305798196 shutdown_connections 2024-09-20T19:06:43.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.354+0000 7f8e42ee7640 1 --2- 172.21.15.17:0/3305798196 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8e2407af30 0x7f8e2407d3f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:43.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.354+0000 7f8e42ee7640 1 --2- 172.21.15.17:0/3305798196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e3c106800 0x7f8e3c19db70 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:43.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.354+0000 7f8e42ee7640 1 --2- 172.21.15.17:0/3305798196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e3c100800 0x7f8e3c19d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:06:43.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.354+0000 7f8e42ee7640 1 -- 172.21.15.17:0/3305798196 >> 172.21.15.17:0/3305798196 conn(0x7f8e3c0fc520 msgr2=0x7f8e3c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:06:43.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.354+0000 7f8e42ee7640 1 -- 172.21.15.17:0/3305798196 shutdown_connections 2024-09-20T19:06:43.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:06:43.354+0000 7f8e42ee7640 1 -- 172.21.15.17:0/3305798196 wait complete. 2024-09-20T19:06:44.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:43 smithi017 ceph-mon[108970]: pgmap v940: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:44.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:43 smithi017 ceph-mon[108970]: from='client.35540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:44.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:43 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3305798196' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:06:44.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:43 smithi172 ceph-mon[80431]: pgmap v940: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:44.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:43 smithi172 ceph-mon[80431]: from='client.35540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:06:44.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:43 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3305798196' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:06:46.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:45 smithi017 ceph-mon[108970]: pgmap v941: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:46.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:45 smithi172 ceph-mon[80431]: pgmap v941: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:48.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:47 smithi017 ceph-mon[108970]: pgmap v942: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:48.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:47 smithi172 ceph-mon[80431]: pgmap v942: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:49.890 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:49 smithi017 ceph-mon[108970]: pgmap v943: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:50.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:49 smithi172 ceph-mon[80431]: pgmap v943: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:52.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:51 smithi017 ceph-mon[108970]: pgmap v944: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:52.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:51 smithi172 ceph-mon[80431]: pgmap v944: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:52.890 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:06:53.100 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:06:54.127 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:53 smithi017 ceph-mon[108970]: pgmap v945: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:54.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:53 smithi172 ceph-mon[80431]: pgmap v945: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:55.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:55 smithi017 ceph-mon[108970]: pgmap v946: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:56.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:55 smithi172 ceph-mon[80431]: pgmap v946: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:58.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:57 smithi017 ceph-mon[108970]: pgmap v947: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:06:58.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:57 smithi172 ceph-mon[80431]: pgmap v947: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:00.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:06:59 smithi017 ceph-mon[108970]: pgmap v948: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:00.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:06:59 smithi172 ceph-mon[80431]: pgmap v948: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:01.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:01 smithi017 ceph-mon[108970]: pgmap v949: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:02.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:01 smithi172 ceph-mon[80431]: pgmap v949: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:04.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:03 smithi017 ceph-mon[108970]: pgmap v950: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:04.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:03 smithi172 ceph-mon[80431]: pgmap v950: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:06.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:05 smithi017 ceph-mon[108970]: pgmap v951: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:06.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:05 smithi172 ceph-mon[80431]: pgmap v951: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:08.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:07 smithi017 ceph-mon[108970]: pgmap v952: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:08.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:07:08.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:07 smithi172 ceph-mon[80431]: pgmap v952: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:08.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:07:10.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:09 smithi017 ceph-mon[108970]: pgmap v953: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:10.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:09 smithi172 ceph-mon[80431]: pgmap v953: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:12.113 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:11 smithi172 ceph-mon[80431]: pgmap v954: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:12.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:11 smithi017 ceph-mon[108970]: pgmap v954: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:13.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.452+0000 7efd7a637640 1 -- 172.21.15.17:0/765457870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd74102ac0 msgr2=0x7efd74102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:13.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.452+0000 7efd7a637640 1 --2- 172.21.15.17:0/765457870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd74102ac0 0x7efd74102ea0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7efd64009880 tx=0x7efd6402a540 comp rx=0 tx=0).stop 2024-09-20T19:07:13.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.452+0000 7efd7a637640 1 -- 172.21.15.17:0/765457870 shutdown_connections 2024-09-20T19:07:13.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.452+0000 7efd7a637640 1 --2- 172.21.15.17:0/765457870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd741033e0 0x7efd7410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:13.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.452+0000 7efd7a637640 1 --2- 172.21.15.17:0/765457870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd74102ac0 0x7efd74102ea0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:13.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.452+0000 7efd7a637640 1 -- 172.21.15.17:0/765457870 >> 172.21.15.17:0/765457870 conn(0x7efd740fc520 msgr2=0x7efd740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:13.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.453+0000 7efd7a637640 1 -- 172.21.15.17:0/765457870 shutdown_connections 2024-09-20T19:07:13.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.453+0000 7efd7a637640 1 -- 172.21.15.17:0/765457870 wait complete. 2024-09-20T19:07:13.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.453+0000 7efd7a637640 1 Processor -- start 2024-09-20T19:07:13.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.453+0000 7efd7a637640 1 -- start start 2024-09-20T19:07:13.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.454+0000 7efd7a637640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd74102ac0 0x7efd7419d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:13.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.454+0000 7efd7a637640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd741033e0 0x7efd7419dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:13.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.454+0000 7efd7a637640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efd7410edd0 con 0x7efd74102ac0 2024-09-20T19:07:13.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.454+0000 7efd7a637640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efd7410ec50 con 0x7efd741033e0 2024-09-20T19:07:13.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.454+0000 7efd73fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd74102ac0 0x7efd7419d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:13.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.454+0000 7efd73fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd74102ac0 0x7efd7419d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43294/0 (socket says 172.21.15.17:43294) 2024-09-20T19:07:13.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.454+0000 7efd73fff640 1 -- 172.21.15.17:0/2097797792 learned_addr learned my addr 172.21.15.17:0/2097797792 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:07:13.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.454+0000 7efd737fe640 1 --2- 172.21.15.17:0/2097797792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd741033e0 0x7efd7419dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:13.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.455+0000 7efd73fff640 1 -- 172.21.15.17:0/2097797792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd741033e0 msgr2=0x7efd7419dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:13.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.455+0000 7efd73fff640 1 --2- 172.21.15.17:0/2097797792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd741033e0 0x7efd7419dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:13.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.455+0000 7efd73fff640 1 -- 172.21.15.17:0/2097797792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7419e310 con 0x7efd74102ac0 2024-09-20T19:07:13.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.455+0000 7efd73fff640 1 --2- 172.21.15.17:0/2097797792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd74102ac0 0x7efd7419d720 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7efd64031460 tx=0x7efd640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:13.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.455+0000 7efd717fa640 1 -- 172.21.15.17:0/2097797792 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd6403f070 con 0x7efd74102ac0 2024-09-20T19:07:13.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.455+0000 7efd7a637640 1 -- 172.21.15.17:0/2097797792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd741979a0 con 0x7efd74102ac0 2024-09-20T19:07:13.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.455+0000 7efd717fa640 1 -- 172.21.15.17:0/2097797792 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efd64004cf0 con 0x7efd74102ac0 2024-09-20T19:07:13.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.455+0000 7efd717fa640 1 -- 172.21.15.17:0/2097797792 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd64035030 con 0x7efd74102ac0 2024-09-20T19:07:13.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.455+0000 7efd7a637640 1 -- 172.21.15.17:0/2097797792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd74197ea0 con 0x7efd74102ac0 2024-09-20T19:07:13.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.456+0000 7efd7a637640 1 -- 172.21.15.17:0/2097797792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd7406aa90 con 0x7efd74102ac0 2024-09-20T19:07:13.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.457+0000 7efd717fa640 1 -- 172.21.15.17:0/2097797792 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7efd64042070 con 0x7efd74102ac0 2024-09-20T19:07:13.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.458+0000 7efd717fa640 1 --2- 172.21.15.17:0/2097797792 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd5c07af30 0x7efd5c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:13.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.458+0000 7efd717fa640 1 -- 172.21.15.17:0/2097797792 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7efd640bea00 con 0x7efd74102ac0 2024-09-20T19:07:13.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.458+0000 7efd737fe640 1 --2- 172.21.15.17:0/2097797792 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd5c07af30 0x7efd5c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:13.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.458+0000 7efd737fe640 1 --2- 172.21.15.17:0/2097797792 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd5c07af30 0x7efd5c07d3f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7efd740feec0 tx=0x7efd6800a250 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:13.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.462+0000 7efd717fa640 1 -- 172.21.15.17:0/2097797792 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd6408a000 con 0x7efd74102ac0 2024-09-20T19:07:13.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.672+0000 7efd7a637640 1 -- 172.21.15.17:0/2097797792 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efd74198e10 con 0x7efd5c07af30 2024-09-20T19:07:13.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.673+0000 7efd717fa640 1 -- 172.21.15.17:0/2097797792 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7efd74198e10 con 0x7efd5c07af30 2024-09-20T19:07:13.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.676+0000 7efd7a637640 1 -- 172.21.15.17:0/2097797792 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd5c07af30 msgr2=0x7efd5c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:13.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.676+0000 7efd7a637640 1 --2- 172.21.15.17:0/2097797792 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd5c07af30 0x7efd5c07d3f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7efd740feec0 tx=0x7efd6800a250 comp rx=0 tx=0).stop 2024-09-20T19:07:13.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.676+0000 7efd7a637640 1 -- 172.21.15.17:0/2097797792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd74102ac0 msgr2=0x7efd7419d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:13.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.676+0000 7efd7a637640 1 --2- 172.21.15.17:0/2097797792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd74102ac0 0x7efd7419d720 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7efd64031460 tx=0x7efd640048f0 comp rx=0 tx=0).stop 2024-09-20T19:07:13.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.676+0000 7efd7a637640 1 -- 172.21.15.17:0/2097797792 shutdown_connections 2024-09-20T19:07:13.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.676+0000 7efd7a637640 1 --2- 172.21.15.17:0/2097797792 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd5c07af30 0x7efd5c07d3f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:13.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.676+0000 7efd7a637640 1 --2- 172.21.15.17:0/2097797792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd741033e0 0x7efd7419dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:13.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.676+0000 7efd7a637640 1 --2- 172.21.15.17:0/2097797792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd74102ac0 0x7efd7419d720 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:13.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.676+0000 7efd7a637640 1 -- 172.21.15.17:0/2097797792 >> 172.21.15.17:0/2097797792 conn(0x7efd740fc520 msgr2=0x7efd74108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:13.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.676+0000 7efd7a637640 1 -- 172.21.15.17:0/2097797792 shutdown_connections 2024-09-20T19:07:13.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.676+0000 7efd7a637640 1 -- 172.21.15.17:0/2097797792 wait complete. 2024-09-20T19:07:13.689 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:07:13.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.761+0000 7fb7cab02640 1 -- 172.21.15.17:0/110641578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7c4102ac0 msgr2=0x7fb7c4102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:13.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.761+0000 7fb7cab02640 1 --2- 172.21.15.17:0/110641578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7c4102ac0 0x7fb7c4102ea0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009880 tx=0x7fb7b402a530 comp rx=0 tx=0).stop 2024-09-20T19:07:13.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.761+0000 7fb7cab02640 1 -- 172.21.15.17:0/110641578 shutdown_connections 2024-09-20T19:07:13.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.761+0000 7fb7cab02640 1 --2- 172.21.15.17:0/110641578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7c41033e0 0x7fb7c410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:13.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.761+0000 7fb7cab02640 1 --2- 172.21.15.17:0/110641578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7c4102ac0 0x7fb7c4102ea0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:13.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.761+0000 7fb7cab02640 1 -- 172.21.15.17:0/110641578 >> 172.21.15.17:0/110641578 conn(0x7fb7c40fc520 msgr2=0x7fb7c40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:13.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.762+0000 7fb7cab02640 1 -- 172.21.15.17:0/110641578 shutdown_connections 2024-09-20T19:07:13.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.762+0000 7fb7cab02640 1 -- 172.21.15.17:0/110641578 wait complete. 2024-09-20T19:07:13.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.762+0000 7fb7cab02640 1 Processor -- start 2024-09-20T19:07:13.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.762+0000 7fb7cab02640 1 -- start start 2024-09-20T19:07:13.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.762+0000 7fb7cab02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7c4102ac0 0x7fb7c4100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:13.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.762+0000 7fb7cab02640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7c41033e0 0x7fb7c4100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:13.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.762+0000 7fb7cab02640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c410edd0 con 0x7fb7c4102ac0 2024-09-20T19:07:13.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.762+0000 7fb7cab02640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c410ec50 con 0x7fb7c41033e0 2024-09-20T19:07:13.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.763+0000 7fb7c889e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7c4102ac0 0x7fb7c4100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:13.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.763+0000 7fb7c889e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7c4102ac0 0x7fb7c4100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43302/0 (socket says 172.21.15.17:43302) 2024-09-20T19:07:13.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.763+0000 7fb7c889e640 1 -- 172.21.15.17:0/689805694 learned_addr learned my addr 172.21.15.17:0/689805694 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:07:13.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.763+0000 7fb7c3fff640 1 --2- 172.21.15.17:0/689805694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7c41033e0 0x7fb7c4100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:13.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.763+0000 7fb7c889e640 1 -- 172.21.15.17:0/689805694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7c41033e0 msgr2=0x7fb7c4100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:13.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.763+0000 7fb7c889e640 1 --2- 172.21.15.17:0/689805694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7c41033e0 0x7fb7c4100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:13.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.763+0000 7fb7c889e640 1 -- 172.21.15.17:0/689805694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c41011a0 con 0x7fb7c4102ac0 2024-09-20T19:07:13.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.763+0000 7fb7c889e640 1 --2- 172.21.15.17:0/689805694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7c4102ac0 0x7fb7c4100720 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4031460 tx=0x7fb7b40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:13.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.763+0000 7fb7c1ffb640 1 -- 172.21.15.17:0/689805694 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7b403f070 con 0x7fb7c4102ac0 2024-09-20T19:07:13.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.763+0000 7fb7c1ffb640 1 -- 172.21.15.17:0/689805694 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7b40035f0 con 0x7fb7c4102ac0 2024-09-20T19:07:13.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.763+0000 7fb7cab02640 1 -- 172.21.15.17:0/689805694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7c4101430 con 0x7fb7c4102ac0 2024-09-20T19:07:13.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.763+0000 7fb7c1ffb640 1 -- 172.21.15.17:0/689805694 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7b4035030 con 0x7fb7c4102ac0 2024-09-20T19:07:13.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.764+0000 7fb7cab02640 1 -- 172.21.15.17:0/689805694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7c41a3ea0 con 0x7fb7c4102ac0 2024-09-20T19:07:13.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.765+0000 7fb7cab02640 1 -- 172.21.15.17:0/689805694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7c406aa90 con 0x7fb7c4102ac0 2024-09-20T19:07:13.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.766+0000 7fb7c1ffb640 1 -- 172.21.15.17:0/689805694 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb7b4042070 con 0x7fb7c4102ac0 2024-09-20T19:07:13.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.766+0000 7fb7c1ffb640 1 --2- 172.21.15.17:0/689805694 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7ac07af30 0x7fb7ac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:13.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.766+0000 7fb7c1ffb640 1 -- 172.21.15.17:0/689805694 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fb7b40bea10 con 0x7fb7c4102ac0 2024-09-20T19:07:13.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.767+0000 7fb7c3fff640 1 --2- 172.21.15.17:0/689805694 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7ac07af30 0x7fb7ac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:13.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.767+0000 7fb7c3fff640 1 --2- 172.21.15.17:0/689805694 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7ac07af30 0x7fb7ac07d3f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb7c41021b0 tx=0x7fb7b800b2e0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:13.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.771+0000 7fb7c1ffb640 1 -- 172.21.15.17:0/689805694 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7b4089f70 con 0x7fb7c4102ac0 2024-09-20T19:07:13.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.979+0000 7fb7cab02640 1 -- 172.21.15.17:0/689805694 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb7c4062630 con 0x7fb7ac07af30 2024-09-20T19:07:13.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.980+0000 7fb7c1ffb640 1 -- 172.21.15.17:0/689805694 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fb7c4062630 con 0x7fb7ac07af30 2024-09-20T19:07:13.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.982+0000 7fb7cab02640 1 -- 172.21.15.17:0/689805694 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7ac07af30 msgr2=0x7fb7ac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:13.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.982+0000 7fb7cab02640 1 --2- 172.21.15.17:0/689805694 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7ac07af30 0x7fb7ac07d3f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb7c41021b0 tx=0x7fb7b800b2e0 comp rx=0 tx=0).stop 2024-09-20T19:07:13.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.982+0000 7fb7cab02640 1 -- 172.21.15.17:0/689805694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7c4102ac0 msgr2=0x7fb7c4100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:13.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.982+0000 7fb7cab02640 1 --2- 172.21.15.17:0/689805694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7c4102ac0 0x7fb7c4100720 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4031460 tx=0x7fb7b40045e0 comp rx=0 tx=0).stop 2024-09-20T19:07:13.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.982+0000 7fb7cab02640 1 -- 172.21.15.17:0/689805694 shutdown_connections 2024-09-20T19:07:13.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.982+0000 7fb7cab02640 1 --2- 172.21.15.17:0/689805694 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb7ac07af30 0x7fb7ac07d3f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:13.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.982+0000 7fb7cab02640 1 --2- 172.21.15.17:0/689805694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7c41033e0 0x7fb7c4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:13.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.982+0000 7fb7cab02640 1 --2- 172.21.15.17:0/689805694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7c4102ac0 0x7fb7c4100720 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:13.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.982+0000 7fb7cab02640 1 -- 172.21.15.17:0/689805694 >> 172.21.15.17:0/689805694 conn(0x7fb7c40fc520 msgr2=0x7fb7c4108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:13.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.983+0000 7fb7cab02640 1 -- 172.21.15.17:0/689805694 shutdown_connections 2024-09-20T19:07:13.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:13.983+0000 7fb7cab02640 1 -- 172.21.15.17:0/689805694 wait complete. 2024-09-20T19:07:14.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.066+0000 7f274f2d3640 1 -- 172.21.15.17:0/611590196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27481007f0 msgr2=0x7f2748100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:14.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.066+0000 7f274f2d3640 1 --2- 172.21.15.17:0/611590196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27481007f0 0x7f2748100c50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2744009880 tx=0x7f274402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.067+0000 7f274f2d3640 1 -- 172.21.15.17:0/611590196 shutdown_connections 2024-09-20T19:07:14.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.067+0000 7f274f2d3640 1 --2- 172.21.15.17:0/611590196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27481007f0 0x7f2748100c50 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.067+0000 7f274f2d3640 1 --2- 172.21.15.17:0/611590196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27481067f0 0x7f2748106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.067+0000 7f274f2d3640 1 -- 172.21.15.17:0/611590196 >> 172.21.15.17:0/611590196 conn(0x7f27480fc550 msgr2=0x7f27480fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:14.072 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:13 smithi017 ceph-mon[108970]: pgmap v955: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:14.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.067+0000 7f274f2d3640 1 -- 172.21.15.17:0/611590196 shutdown_connections 2024-09-20T19:07:14.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.067+0000 7f274f2d3640 1 -- 172.21.15.17:0/611590196 wait complete. 2024-09-20T19:07:14.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.067+0000 7f274f2d3640 1 Processor -- start 2024-09-20T19:07:14.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.068+0000 7f274f2d3640 1 -- start start 2024-09-20T19:07:14.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.068+0000 7f274f2d3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27481007f0 0x7f27481987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:14.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.068+0000 7f274f2d3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27481067f0 0x7f2748198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:14.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.068+0000 7f274f2d3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f274810dcc0 con 0x7f27481007f0 2024-09-20T19:07:14.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.068+0000 7f274f2d3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f274810db40 con 0x7f27481067f0 2024-09-20T19:07:14.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.068+0000 7f274d06f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27481007f0 0x7f27481987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:14.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.068+0000 7f274d06f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27481007f0 0x7f27481987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43312/0 (socket says 172.21.15.17:43312) 2024-09-20T19:07:14.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.068+0000 7f274d06f640 1 -- 172.21.15.17:0/3194276537 learned_addr learned my addr 172.21.15.17:0/3194276537 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:07:14.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.068+0000 7f274c86e640 1 --2- 172.21.15.17:0/3194276537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27481067f0 0x7f2748198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:14.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.068+0000 7f274d06f640 1 -- 172.21.15.17:0/3194276537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27481067f0 msgr2=0x7f2748198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:14.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.068+0000 7f274d06f640 1 --2- 172.21.15.17:0/3194276537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27481067f0 0x7f2748198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.068+0000 7f274d06f640 1 -- 172.21.15.17:0/3194276537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2748199330 con 0x7f27481007f0 2024-09-20T19:07:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.069+0000 7f274d06f640 1 --2- 172.21.15.17:0/3194276537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27481007f0 0x7f27481987f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f273c00d6f0 tx=0x7f273c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.069+0000 7f273a7fc640 1 -- 172.21.15.17:0/3194276537 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f273c017070 con 0x7f27481007f0 2024-09-20T19:07:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.069+0000 7f273a7fc640 1 -- 172.21.15.17:0/3194276537 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f273c00de00 con 0x7f27481007f0 2024-09-20T19:07:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.069+0000 7f274f2d3640 1 -- 172.21.15.17:0/3194276537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2748199620 con 0x7f27481007f0 2024-09-20T19:07:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.069+0000 7f273a7fc640 1 -- 172.21.15.17:0/3194276537 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f273c004bb0 con 0x7f27481007f0 2024-09-20T19:07:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.069+0000 7f274f2d3640 1 -- 172.21.15.17:0/3194276537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27481a1c20 con 0x7f27481007f0 2024-09-20T19:07:14.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.070+0000 7f274f2d3640 1 -- 172.21.15.17:0/3194276537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2748101f30 con 0x7f27481007f0 2024-09-20T19:07:14.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.071+0000 7f273a7fc640 1 -- 172.21.15.17:0/3194276537 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f273c004e60 con 0x7f27481007f0 2024-09-20T19:07:14.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.071+0000 7f273a7fc640 1 --2- 172.21.15.17:0/3194276537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f273407af30 0x7f273407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:14.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.071+0000 7f273a7fc640 1 -- 172.21.15.17:0/3194276537 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f273c09dc00 con 0x7f27481007f0 2024-09-20T19:07:14.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.071+0000 7f274c86e640 1 --2- 172.21.15.17:0/3194276537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f273407af30 0x7f273407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:14.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.072+0000 7f274c86e640 1 --2- 172.21.15.17:0/3194276537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f273407af30 0x7f273407d3f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f274806a7f0 tx=0x7f2744031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:14.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.076+0000 7f273a7fc640 1 -- 172.21.15.17:0/3194276537 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2748199620 con 0x7f27481007f0 2024-09-20T19:07:14.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:13 smithi172 ceph-mon[80431]: pgmap v955: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:14.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.274+0000 7f274f2d3640 1 -- 172.21.15.17:0/3194276537 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2748062630 con 0x7f273407af30 2024-09-20T19:07:14.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.283+0000 7f273a7fc640 1 -- 172.21.15.17:0/3194276537 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f2748062630 con 0x7f273407af30 2024-09-20T19:07:14.287 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:07:14.287 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (28m) 7m ago 39m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:07:14.287 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (31m) 7m ago 39m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:07:14.287 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (31m) 7m ago 38m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:07:14.288 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (26m) 7m ago 39m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:07:14.288 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (26m) 7m ago 38m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:07:14.288 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (28m) 7m ago 39m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:07:14.288 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (23m) 7m ago 34m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:07:14.288 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (22m) 7m ago 34m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:07:14.288 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (7m) 7m ago 34m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:07:14.288 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (22m) 7m ago 34m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:07:14.288 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (30m) 7m ago 40m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:07:14.288 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (29m) 7m ago 38m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:07:14.288 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (27m) 7m ago 40m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:07:14.288 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (27m) 7m ago 38m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:07:14.288 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (29m) 7m ago 39m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:07:14.288 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (29m) 7m ago 38m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:07:14.289 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (26m) 7m ago 37m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:07:14.289 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (25m) 7m ago 37m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:07:14.289 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (25m) 7m ago 36m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:07:14.289 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (24m) 7m ago 36m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:07:14.289 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (24m) 7m ago 35m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:07:14.289 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (23m) 7m ago 35m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:07:14.289 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (28m) 7m ago 39m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:07:14.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.286+0000 7f274f2d3640 1 -- 172.21.15.17:0/3194276537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f273407af30 msgr2=0x7f273407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:14.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.286+0000 7f274f2d3640 1 --2- 172.21.15.17:0/3194276537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f273407af30 0x7f273407d3f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f274806a7f0 tx=0x7f2744031400 comp rx=0 tx=0).stop 2024-09-20T19:07:14.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.286+0000 7f274f2d3640 1 -- 172.21.15.17:0/3194276537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27481007f0 msgr2=0x7f27481987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:14.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.286+0000 7f274f2d3640 1 --2- 172.21.15.17:0/3194276537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27481007f0 0x7f27481987f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f273c00d6f0 tx=0x7f273c00dbb0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.286+0000 7f274f2d3640 1 -- 172.21.15.17:0/3194276537 shutdown_connections 2024-09-20T19:07:14.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.286+0000 7f274f2d3640 1 --2- 172.21.15.17:0/3194276537 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f273407af30 0x7f273407d3f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.286+0000 7f274f2d3640 1 --2- 172.21.15.17:0/3194276537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27481067f0 0x7f2748198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.286+0000 7f274f2d3640 1 --2- 172.21.15.17:0/3194276537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27481007f0 0x7f27481987f0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.286+0000 7f274f2d3640 1 -- 172.21.15.17:0/3194276537 >> 172.21.15.17:0/3194276537 conn(0x7f27480fc550 msgr2=0x7f27480fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:14.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.286+0000 7f274f2d3640 1 -- 172.21.15.17:0/3194276537 shutdown_connections 2024-09-20T19:07:14.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.286+0000 7f274f2d3640 1 -- 172.21.15.17:0/3194276537 wait complete. 2024-09-20T19:07:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.368+0000 7f2cd76f3640 1 -- 172.21.15.17:0/922117649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd01033e0 msgr2=0x7f2cd010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.368+0000 7f2cd76f3640 1 --2- 172.21.15.17:0/922117649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd01033e0 0x7f2cd010b8d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009880 tx=0x7f2cc002a530 comp rx=0 tx=0).stop 2024-09-20T19:07:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.369+0000 7f2cd76f3640 1 -- 172.21.15.17:0/922117649 shutdown_connections 2024-09-20T19:07:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.369+0000 7f2cd76f3640 1 --2- 172.21.15.17:0/922117649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd01033e0 0x7f2cd010b8d0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.369+0000 7f2cd76f3640 1 --2- 172.21.15.17:0/922117649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cd0102ac0 0x7f2cd0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.369+0000 7f2cd76f3640 1 -- 172.21.15.17:0/922117649 >> 172.21.15.17:0/922117649 conn(0x7f2cd00fc520 msgr2=0x7f2cd00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.369+0000 7f2cd76f3640 1 -- 172.21.15.17:0/922117649 shutdown_connections 2024-09-20T19:07:14.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.369+0000 7f2cd76f3640 1 -- 172.21.15.17:0/922117649 wait complete. 2024-09-20T19:07:14.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.369+0000 7f2cd76f3640 1 Processor -- start 2024-09-20T19:07:14.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.369+0000 7f2cd76f3640 1 -- start start 2024-09-20T19:07:14.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.370+0000 7f2cd76f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd0102ac0 0x7f2cd019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:14.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.370+0000 7f2cd76f3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cd01033e0 0x7f2cd019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:14.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.370+0000 7f2cd76f3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd010edd0 con 0x7f2cd0102ac0 2024-09-20T19:07:14.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.370+0000 7f2cd76f3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd010ec50 con 0x7f2cd01033e0 2024-09-20T19:07:14.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.370+0000 7f2cd548f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd0102ac0 0x7f2cd019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:14.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.370+0000 7f2cd548f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd0102ac0 0x7f2cd019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43334/0 (socket says 172.21.15.17:43334) 2024-09-20T19:07:14.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.370+0000 7f2cd548f640 1 -- 172.21.15.17:0/4263043457 learned_addr learned my addr 172.21.15.17:0/4263043457 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:07:14.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.370+0000 7f2cd4c8e640 1 --2- 172.21.15.17:0/4263043457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cd01033e0 0x7f2cd019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:14.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.370+0000 7f2cd548f640 1 -- 172.21.15.17:0/4263043457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cd01033e0 msgr2=0x7f2cd019dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:14.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.370+0000 7f2cd548f640 1 --2- 172.21.15.17:0/4263043457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cd01033e0 0x7f2cd019dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.370+0000 7f2cd548f640 1 -- 172.21.15.17:0/4263043457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd01977e0 con 0x7f2cd0102ac0 2024-09-20T19:07:14.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.370+0000 7f2cd4c8e640 1 --2- 172.21.15.17:0/4263043457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cd01033e0 0x7f2cd019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:07:14.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.370+0000 7f2cd548f640 1 --2- 172.21.15.17:0/4263043457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd0102ac0 0x7f2cd019d660 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00d8d0 tx=0x7f2ccc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:14.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.371+0000 7f2cc67fc640 1 -- 172.21.15.17:0/4263043457 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ccc017070 con 0x7f2cd0102ac0 2024-09-20T19:07:14.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.371+0000 7f2cc67fc640 1 -- 172.21.15.17:0/4263043457 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ccc010460 con 0x7f2cd0102ac0 2024-09-20T19:07:14.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.371+0000 7f2cd76f3640 1 -- 172.21.15.17:0/4263043457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd0197ad0 con 0x7f2cd0102ac0 2024-09-20T19:07:14.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.371+0000 7f2cc67fc640 1 -- 172.21.15.17:0/4263043457 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ccc00f5f0 con 0x7f2cd0102ac0 2024-09-20T19:07:14.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.371+0000 7f2cd76f3640 1 -- 172.21.15.17:0/4263043457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd0198030 con 0x7f2cd0102ac0 2024-09-20T19:07:14.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.372+0000 7f2cd76f3640 1 -- 172.21.15.17:0/4263043457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cd006aa90 con 0x7f2cd0102ac0 2024-09-20T19:07:14.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.373+0000 7f2cc67fc640 1 -- 172.21.15.17:0/4263043457 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2ccc009a30 con 0x7f2cd0102ac0 2024-09-20T19:07:14.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.373+0000 7f2cc67fc640 1 --2- 172.21.15.17:0/4263043457 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2cbc07af40 0x7f2cbc07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:14.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.373+0000 7f2cc67fc640 1 -- 172.21.15.17:0/4263043457 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f2ccc09dea0 con 0x7f2cd0102ac0 2024-09-20T19:07:14.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.373+0000 7f2cd4c8e640 1 --2- 172.21.15.17:0/4263043457 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2cbc07af40 0x7f2cbc07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:14.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.374+0000 7f2cd4c8e640 1 --2- 172.21.15.17:0/4263043457 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2cbc07af40 0x7f2cbc07d400 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0198b30 tx=0x7f2cc0031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:14.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.378+0000 7f2cc67fc640 1 -- 172.21.15.17:0/4263043457 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ccc0694a0 con 0x7f2cd0102ac0 2024-09-20T19:07:14.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.646+0000 7f2cd76f3640 1 -- 172.21.15.17:0/4263043457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f2cd0105f60 con 0x7f2cd0102ac0 2024-09-20T19:07:14.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.646+0000 7f2cc67fc640 1 -- 172.21.15.17:0/4263043457 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f2ccc06e350 con 0x7f2cd0102ac0 2024-09-20T19:07:14.651 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:07:14.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:07:14.651 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:07:14.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:07:14.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:07:14.651 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:07:14.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:07:14.651 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:07:14.651 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:07:14.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:07:14.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:07:14.652 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:07:14.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:07:14.652 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:07:14.652 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:07:14.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:07:14.652 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:07:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.649+0000 7f2cd76f3640 1 -- 172.21.15.17:0/4263043457 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2cbc07af40 msgr2=0x7f2cbc07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.649+0000 7f2cd76f3640 1 --2- 172.21.15.17:0/4263043457 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2cbc07af40 0x7f2cbc07d400 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0198b30 tx=0x7f2cc0031400 comp rx=0 tx=0).stop 2024-09-20T19:07:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.649+0000 7f2cd76f3640 1 -- 172.21.15.17:0/4263043457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd0102ac0 msgr2=0x7f2cd019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.649+0000 7f2cd76f3640 1 --2- 172.21.15.17:0/4263043457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd0102ac0 0x7f2cd019d660 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00d8d0 tx=0x7f2ccc00dd90 comp rx=0 tx=0).stop 2024-09-20T19:07:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.649+0000 7f2cd76f3640 1 -- 172.21.15.17:0/4263043457 shutdown_connections 2024-09-20T19:07:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.649+0000 7f2cd76f3640 1 --2- 172.21.15.17:0/4263043457 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2cbc07af40 0x7f2cbc07d400 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.649+0000 7f2cd76f3640 1 --2- 172.21.15.17:0/4263043457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cd01033e0 0x7f2cd019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.649+0000 7f2cd76f3640 1 --2- 172.21.15.17:0/4263043457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd0102ac0 0x7f2cd019d660 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.649+0000 7f2cd76f3640 1 -- 172.21.15.17:0/4263043457 >> 172.21.15.17:0/4263043457 conn(0x7f2cd00fc520 msgr2=0x7f2cd0108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.649+0000 7f2cd76f3640 1 -- 172.21.15.17:0/4263043457 shutdown_connections 2024-09-20T19:07:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.649+0000 7f2cd76f3640 1 -- 172.21.15.17:0/4263043457 wait complete. 2024-09-20T19:07:14.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.733+0000 7f4873734640 1 -- 172.21.15.17:0/1607102355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f486c107900 msgr2=0x7f486c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:14.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.733+0000 7f4873734640 1 --2- 172.21.15.17:0/1607102355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f486c107900 0x7f486c107ce0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4868009880 tx=0x7f486802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.733+0000 7f4873734640 1 -- 172.21.15.17:0/1607102355 shutdown_connections 2024-09-20T19:07:14.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.733+0000 7f4873734640 1 --2- 172.21.15.17:0/1607102355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f486c101900 0x7f486c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.733+0000 7f4873734640 1 --2- 172.21.15.17:0/1607102355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f486c107900 0x7f486c107ce0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.733+0000 7f4873734640 1 -- 172.21.15.17:0/1607102355 >> 172.21.15.17:0/1607102355 conn(0x7f486c0fd600 msgr2=0x7f486c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:14.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.733+0000 7f4873734640 1 -- 172.21.15.17:0/1607102355 shutdown_connections 2024-09-20T19:07:14.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.733+0000 7f4873734640 1 -- 172.21.15.17:0/1607102355 wait complete. 2024-09-20T19:07:14.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.734+0000 7f4873734640 1 Processor -- start 2024-09-20T19:07:14.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.734+0000 7f4873734640 1 -- start start 2024-09-20T19:07:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.734+0000 7f4873734640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f486c101900 0x7f486c19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.734+0000 7f4873734640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f486c107900 0x7f486c19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.734+0000 7f4873734640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f486c10edd0 con 0x7f486c101900 2024-09-20T19:07:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.734+0000 7f4873734640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f486c10ec50 con 0x7f486c107900 2024-09-20T19:07:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.734+0000 7f48714d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f486c101900 0x7f486c19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.734+0000 7f48714d0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f486c101900 0x7f486c19d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43350/0 (socket says 172.21.15.17:43350) 2024-09-20T19:07:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.734+0000 7f48714d0640 1 -- 172.21.15.17:0/465015542 learned_addr learned my addr 172.21.15.17:0/465015542 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:07:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.734+0000 7f4870ccf640 1 --2- 172.21.15.17:0/465015542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f486c107900 0x7f486c19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.734+0000 7f48714d0640 1 -- 172.21.15.17:0/465015542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f486c107900 msgr2=0x7f486c19db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.734+0000 7f48714d0640 1 --2- 172.21.15.17:0/465015542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f486c107900 0x7f486c19db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.734+0000 7f48714d0640 1 -- 172.21.15.17:0/465015542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486c1977a0 con 0x7f486c101900 2024-09-20T19:07:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.734+0000 7f4870ccf640 1 --2- 172.21.15.17:0/465015542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f486c107900 0x7f486c19db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:07:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.735+0000 7f48714d0640 1 --2- 172.21.15.17:0/465015542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f486c101900 0x7f486c19d620 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4868031460 tx=0x7f48680045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:14.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.735+0000 7f48627fc640 1 -- 172.21.15.17:0/465015542 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f486803f070 con 0x7f486c101900 2024-09-20T19:07:14.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.735+0000 7f4873734640 1 -- 172.21.15.17:0/465015542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486c197a30 con 0x7f486c101900 2024-09-20T19:07:14.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.735+0000 7f48627fc640 1 -- 172.21.15.17:0/465015542 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f48680035f0 con 0x7f486c101900 2024-09-20T19:07:14.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.735+0000 7f48627fc640 1 -- 172.21.15.17:0/465015542 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4868035030 con 0x7f486c101900 2024-09-20T19:07:14.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.735+0000 7f4873734640 1 -- 172.21.15.17:0/465015542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f486c197f60 con 0x7f486c101900 2024-09-20T19:07:14.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.736+0000 7f4873734640 1 -- 172.21.15.17:0/465015542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f486c103040 con 0x7f486c101900 2024-09-20T19:07:14.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.737+0000 7f48627fc640 1 -- 172.21.15.17:0/465015542 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4868042070 con 0x7f486c101900 2024-09-20T19:07:14.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.737+0000 7f48627fc640 1 --2- 172.21.15.17:0/465015542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f485807af30 0x7f485807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:14.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.737+0000 7f48627fc640 1 -- 172.21.15.17:0/465015542 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f48680bea20 con 0x7f486c101900 2024-09-20T19:07:14.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.737+0000 7f4870ccf640 1 --2- 172.21.15.17:0/465015542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f485807af30 0x7f485807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:14.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.738+0000 7f4870ccf640 1 --2- 172.21.15.17:0/465015542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f485807af30 0x7f485807d3f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f486c0ffc20 tx=0x7f485c005e50 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:14.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.742+0000 7f48627fc640 1 -- 172.21.15.17:0/465015542 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f486808a020 con 0x7f486c101900 2024-09-20T19:07:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.967+0000 7f4873734640 1 -- 172.21.15.17:0/465015542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f486c109e70 con 0x7f486c101900 2024-09-20T19:07:14.971 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:14 smithi017 ceph-mon[108970]: from='client.35548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:14.972 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:14 smithi017 ceph-mon[108970]: from='client.35552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:14.972 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:14 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4263043457' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:07:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.968+0000 7f48627fc640 1 -- 172.21.15.17:0/465015542 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7f486808c020 con 0x7f486c101900 2024-09-20T19:07:14.972 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:07:14.972 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:07:14.972 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:07:14.972 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:07:14.972 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:07:14.972 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:07:14.973 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:07:14.973 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:07:14.973 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:07:14.973 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:07:14.973 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:07:14.973 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:07:14.973 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:07:14.973 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:07:14.973 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:07:14.973 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:07:14.973 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:07:14.973 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:07:14.974 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:07:14.974 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:07:14.974 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:07:14.974 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:07:14.974 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:07:14.974 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:07:14.974 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:07:14.974 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:07:14.974 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:07:14.974 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:07:14.974 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:07:14.974 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:07:14.974 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:07:14.974 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:07:14.975 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:07:14.975 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:07:14.975 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:07:14.975 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:07:14.975 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:07:14.975 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:07:14.975 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:07:14.975 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:07:14.975 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:07:14.975 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:07:14.975 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:07:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:07:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.970+0000 7f4873734640 1 -- 172.21.15.17:0/465015542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f485807af30 msgr2=0x7f485807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.970+0000 7f4873734640 1 --2- 172.21.15.17:0/465015542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f485807af30 0x7f485807d3f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f486c0ffc20 tx=0x7f485c005e50 comp rx=0 tx=0).stop 2024-09-20T19:07:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.970+0000 7f4873734640 1 -- 172.21.15.17:0/465015542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f486c101900 msgr2=0x7f486c19d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.970+0000 7f4873734640 1 --2- 172.21.15.17:0/465015542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f486c101900 0x7f486c19d620 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4868031460 tx=0x7f48680045e0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.970+0000 7f4873734640 1 -- 172.21.15.17:0/465015542 shutdown_connections 2024-09-20T19:07:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.970+0000 7f4873734640 1 --2- 172.21.15.17:0/465015542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f485807af30 0x7f485807d3f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.970+0000 7f4873734640 1 --2- 172.21.15.17:0/465015542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f486c107900 0x7f486c19db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.970+0000 7f4873734640 1 --2- 172.21.15.17:0/465015542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f486c101900 0x7f486c19d620 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:14.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.970+0000 7f4873734640 1 -- 172.21.15.17:0/465015542 >> 172.21.15.17:0/465015542 conn(0x7f486c0fd600 msgr2=0x7f486c0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:14.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.970+0000 7f4873734640 1 -- 172.21.15.17:0/465015542 shutdown_connections 2024-09-20T19:07:14.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:14.970+0000 7f4873734640 1 -- 172.21.15.17:0/465015542 wait complete. 2024-09-20T19:07:15.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.055+0000 7f7c5a018640 1 -- 172.21.15.17:0/3722939240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c54100820 msgr2=0x7f7c54100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:15.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.055+0000 7f7c5a018640 1 --2- 172.21.15.17:0/3722939240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c54100820 0x7f7c54100c80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009880 tx=0x7f7c4802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:07:15.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.055+0000 7f7c5a018640 1 -- 172.21.15.17:0/3722939240 shutdown_connections 2024-09-20T19:07:15.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.055+0000 7f7c5a018640 1 --2- 172.21.15.17:0/3722939240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c54100820 0x7f7c54100c80 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:15.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.055+0000 7f7c5a018640 1 --2- 172.21.15.17:0/3722939240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c54106820 0x7f7c54106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:15.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.055+0000 7f7c5a018640 1 -- 172.21.15.17:0/3722939240 >> 172.21.15.17:0/3722939240 conn(0x7f7c540fc540 msgr2=0x7f7c540fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:15.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.055+0000 7f7c5a018640 1 -- 172.21.15.17:0/3722939240 shutdown_connections 2024-09-20T19:07:15.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.055+0000 7f7c5a018640 1 -- 172.21.15.17:0/3722939240 wait complete. 2024-09-20T19:07:15.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.056+0000 7f7c5a018640 1 Processor -- start 2024-09-20T19:07:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.056+0000 7f7c5a018640 1 -- start start 2024-09-20T19:07:15.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.056+0000 7f7c5a018640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c54100820 0x7f7c540fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:15.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.056+0000 7f7c5a018640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c54106820 0x7f7c540fd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:15.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.056+0000 7f7c5a018640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5410dcf0 con 0x7f7c54100820 2024-09-20T19:07:15.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.056+0000 7f7c5a018640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5410db70 con 0x7f7c54106820 2024-09-20T19:07:15.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.057+0000 7f7c537fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c54100820 0x7f7c540fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:15.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.057+0000 7f7c537fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c54100820 0x7f7c540fcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43366/0 (socket says 172.21.15.17:43366) 2024-09-20T19:07:15.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.057+0000 7f7c537fe640 1 -- 172.21.15.17:0/3047494491 learned_addr learned my addr 172.21.15.17:0/3047494491 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:07:15.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.057+0000 7f7c52ffd640 1 --2- 172.21.15.17:0/3047494491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c54106820 0x7f7c540fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:15.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.057+0000 7f7c537fe640 1 -- 172.21.15.17:0/3047494491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c54106820 msgr2=0x7f7c540fd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:15.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.057+0000 7f7c537fe640 1 --2- 172.21.15.17:0/3047494491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c54106820 0x7f7c540fd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:15.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.057+0000 7f7c537fe640 1 -- 172.21.15.17:0/3047494491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c540fd710 con 0x7f7c54100820 2024-09-20T19:07:15.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.057+0000 7f7c537fe640 1 --2- 172.21.15.17:0/3047494491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c54100820 0x7f7c540fcc90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400d6f0 tx=0x7f7c4400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:15.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.057+0000 7f7c50ff9640 1 -- 172.21.15.17:0/3047494491 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c44017070 con 0x7f7c54100820 2024-09-20T19:07:15.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.057+0000 7f7c50ff9640 1 -- 172.21.15.17:0/3047494491 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c4400de00 con 0x7f7c54100820 2024-09-20T19:07:15.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.057+0000 7f7c5a018640 1 -- 172.21.15.17:0/3047494491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c540fda00 con 0x7f7c54100820 2024-09-20T19:07:15.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.057+0000 7f7c50ff9640 1 -- 172.21.15.17:0/3047494491 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c44004bb0 con 0x7f7c54100820 2024-09-20T19:07:15.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.057+0000 7f7c5a018640 1 -- 172.21.15.17:0/3047494491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c541a3e80 con 0x7f7c54100820 2024-09-20T19:07:15.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.058+0000 7f7c5a018640 1 -- 172.21.15.17:0/3047494491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c54101f60 con 0x7f7c54100820 2024-09-20T19:07:15.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.059+0000 7f7c50ff9640 1 -- 172.21.15.17:0/3047494491 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7c44009a30 con 0x7f7c54100820 2024-09-20T19:07:15.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.060+0000 7f7c50ff9640 1 --2- 172.21.15.17:0/3047494491 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7c3c07af90 0x7f7c3c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:15.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.060+0000 7f7c52ffd640 1 --2- 172.21.15.17:0/3047494491 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7c3c07af90 0x7f7c3c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:15.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.060+0000 7f7c50ff9640 1 -- 172.21.15.17:0/3047494491 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f7c4409db80 con 0x7f7c54100820 2024-09-20T19:07:15.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.060+0000 7f7c52ffd640 1 --2- 172.21.15.17:0/3047494491 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7c3c07af90 0x7f7c3c07d450 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7c540fe720 tx=0x7f7c480095c0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:15.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.064+0000 7f7c50ff9640 1 -- 172.21.15.17:0/3047494491 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7c44069200 con 0x7f7c54100820 2024-09-20T19:07:15.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:14 smithi172 ceph-mon[80431]: from='client.35548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:15.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:14 smithi172 ceph-mon[80431]: from='client.35552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:15.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:14 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4263043457' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:07:15.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.268+0000 7f7c5a018640 1 -- 172.21.15.17:0/3047494491 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7c54062630 con 0x7f7c3c07af90 2024-09-20T19:07:15.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.269+0000 7f7c50ff9640 1 -- 172.21.15.17:0/3047494491 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f7c54062630 con 0x7f7c3c07af90 2024-09-20T19:07:15.273 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:07:15.273 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:07:15.273 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:07:15.273 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:07:15.273 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:07:15.273 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:07:15.273 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:07:15.273 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:07:15.273 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:07:15.273 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:07:15.274 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:07:15.274 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:07:15.274 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:07:15.274 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:07:15.274 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:07:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.271+0000 7f7c5a018640 1 -- 172.21.15.17:0/3047494491 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7c3c07af90 msgr2=0x7f7c3c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.271+0000 7f7c5a018640 1 --2- 172.21.15.17:0/3047494491 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7c3c07af90 0x7f7c3c07d450 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7c540fe720 tx=0x7f7c480095c0 comp rx=0 tx=0).stop 2024-09-20T19:07:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.271+0000 7f7c5a018640 1 -- 172.21.15.17:0/3047494491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c54100820 msgr2=0x7f7c540fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.271+0000 7f7c5a018640 1 --2- 172.21.15.17:0/3047494491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c54100820 0x7f7c540fcc90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400d6f0 tx=0x7f7c4400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:07:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.271+0000 7f7c5a018640 1 -- 172.21.15.17:0/3047494491 shutdown_connections 2024-09-20T19:07:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.271+0000 7f7c5a018640 1 --2- 172.21.15.17:0/3047494491 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7c3c07af90 0x7f7c3c07d450 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.271+0000 7f7c5a018640 1 --2- 172.21.15.17:0/3047494491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c54106820 0x7f7c540fd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.271+0000 7f7c5a018640 1 --2- 172.21.15.17:0/3047494491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c54100820 0x7f7c540fcc90 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.271+0000 7f7c5a018640 1 -- 172.21.15.17:0/3047494491 >> 172.21.15.17:0/3047494491 conn(0x7f7c540fc540 msgr2=0x7f7c5406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.271+0000 7f7c5a018640 1 -- 172.21.15.17:0/3047494491 shutdown_connections 2024-09-20T19:07:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.271+0000 7f7c5a018640 1 -- 172.21.15.17:0/3047494491 wait complete. 2024-09-20T19:07:15.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.355+0000 7fa7043eb640 1 -- 172.21.15.17:0/4207517161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc101900 msgr2=0x7fa6fc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:15.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.355+0000 7fa7043eb640 1 --2- 172.21.15.17:0/4207517161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc101900 0x7fa6fc101d60 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec009880 tx=0x7fa6ec02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:07:15.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.355+0000 7fa7043eb640 1 -- 172.21.15.17:0/4207517161 shutdown_connections 2024-09-20T19:07:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.355+0000 7fa7043eb640 1 --2- 172.21.15.17:0/4207517161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc101900 0x7fa6fc101d60 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.355+0000 7fa7043eb640 1 --2- 172.21.15.17:0/4207517161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6fc107900 0x7fa6fc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.355+0000 7fa7043eb640 1 -- 172.21.15.17:0/4207517161 >> 172.21.15.17:0/4207517161 conn(0x7fa6fc0fd600 msgr2=0x7fa6fc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.355+0000 7fa7043eb640 1 -- 172.21.15.17:0/4207517161 shutdown_connections 2024-09-20T19:07:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.355+0000 7fa7043eb640 1 -- 172.21.15.17:0/4207517161 wait complete. 2024-09-20T19:07:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.356+0000 7fa7043eb640 1 Processor -- start 2024-09-20T19:07:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.356+0000 7fa7043eb640 1 -- start start 2024-09-20T19:07:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.356+0000 7fa7043eb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc101900 0x7fa6fc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.356+0000 7fa7043eb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6fc107900 0x7fa6fc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.356+0000 7fa7043eb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc10edd0 con 0x7fa6fc101900 2024-09-20T19:07:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.356+0000 7fa7043eb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc10ec50 con 0x7fa6fc107900 2024-09-20T19:07:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.356+0000 7fa702187640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc101900 0x7fa6fc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.356+0000 7fa702187640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc101900 0x7fa6fc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43384/0 (socket says 172.21.15.17:43384) 2024-09-20T19:07:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.356+0000 7fa702187640 1 -- 172.21.15.17:0/4271025731 learned_addr learned my addr 172.21.15.17:0/4271025731 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:07:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.357+0000 7fa702187640 1 -- 172.21.15.17:0/4271025731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6fc107900 msgr2=0x7fa6fc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:15.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.357+0000 7fa702187640 1 --2- 172.21.15.17:0/4271025731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6fc107900 0x7fa6fc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:15.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.357+0000 7fa702187640 1 -- 172.21.15.17:0/4271025731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6fc074f70 con 0x7fa6fc101900 2024-09-20T19:07:15.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.357+0000 7fa702187640 1 --2- 172.21.15.17:0/4271025731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc101900 0x7fa6fc0744f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800e970 tx=0x7fa6f800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:15.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.357+0000 7fa6f37fe640 1 -- 172.21.15.17:0/4271025731 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa6f800cac0 con 0x7fa6fc101900 2024-09-20T19:07:15.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.357+0000 7fa6f37fe640 1 -- 172.21.15.17:0/4271025731 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa6f80054e0 con 0x7fa6fc101900 2024-09-20T19:07:15.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.357+0000 7fa7043eb640 1 -- 172.21.15.17:0/4271025731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6fc075260 con 0x7fa6fc101900 2024-09-20T19:07:15.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.357+0000 7fa6f37fe640 1 -- 172.21.15.17:0/4271025731 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa6f8010430 con 0x7fa6fc101900 2024-09-20T19:07:15.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.357+0000 7fa7043eb640 1 -- 172.21.15.17:0/4271025731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6fc1a3e80 con 0x7fa6fc101900 2024-09-20T19:07:15.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.358+0000 7fa7043eb640 1 -- 172.21.15.17:0/4271025731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6fc103040 con 0x7fa6fc101900 2024-09-20T19:07:15.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.359+0000 7fa6f37fe640 1 -- 172.21.15.17:0/4271025731 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa6f8004e80 con 0x7fa6fc101900 2024-09-20T19:07:15.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.359+0000 7fa6f37fe640 1 --2- 172.21.15.17:0/4271025731 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6e807af30 0x7fa6e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:15.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.359+0000 7fa701986640 1 --2- 172.21.15.17:0/4271025731 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6e807af30 0x7fa6e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:15.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.359+0000 7fa6f37fe640 1 -- 172.21.15.17:0/4271025731 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fa6f809e6f0 con 0x7fa6fc101900 2024-09-20T19:07:15.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.360+0000 7fa701986640 1 --2- 172.21.15.17:0/4271025731 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6e807af30 0x7fa6e807d3f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec0096c0 tx=0x7fa6ec000bc0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:15.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.364+0000 7fa6f37fe640 1 -- 172.21.15.17:0/4271025731 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6f8069cf0 con 0x7fa6fc101900 2024-09-20T19:07:15.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.628+0000 7fa7043eb640 1 -- 172.21.15.17:0/4271025731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fa6fc101d60 con 0x7fa6fc101900 2024-09-20T19:07:15.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.628+0000 7fa6f37fe640 1 -- 172.21.15.17:0/4271025731 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fa6f806eba0 con 0x7fa6fc101900 2024-09-20T19:07:15.632 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:07:15.633 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:07:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:07:15.633 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:07:15.633 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:07:15.633 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:07:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:07:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:07:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:07:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:07:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:07:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:07:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:07:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:07:15.633 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:07:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:07:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:07:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:07:15.634 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:07:15.634 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:07:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:07:15.634 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:07:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:07:15.634 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:07:15.634 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:07:15.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.631+0000 7fa7043eb640 1 -- 172.21.15.17:0/4271025731 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6e807af30 msgr2=0x7fa6e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:15.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.631+0000 7fa7043eb640 1 --2- 172.21.15.17:0/4271025731 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6e807af30 0x7fa6e807d3f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec0096c0 tx=0x7fa6ec000bc0 comp rx=0 tx=0).stop 2024-09-20T19:07:15.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.631+0000 7fa7043eb640 1 -- 172.21.15.17:0/4271025731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc101900 msgr2=0x7fa6fc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:15.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.631+0000 7fa7043eb640 1 --2- 172.21.15.17:0/4271025731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc101900 0x7fa6fc0744f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800e970 tx=0x7fa6f800ed70 comp rx=0 tx=0).stop 2024-09-20T19:07:15.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.631+0000 7fa7043eb640 1 -- 172.21.15.17:0/4271025731 shutdown_connections 2024-09-20T19:07:15.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.631+0000 7fa7043eb640 1 --2- 172.21.15.17:0/4271025731 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa6e807af30 0x7fa6e807d3f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:15.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.631+0000 7fa7043eb640 1 --2- 172.21.15.17:0/4271025731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6fc107900 0x7fa6fc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:15.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.631+0000 7fa7043eb640 1 --2- 172.21.15.17:0/4271025731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6fc101900 0x7fa6fc0744f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:15.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.631+0000 7fa7043eb640 1 -- 172.21.15.17:0/4271025731 >> 172.21.15.17:0/4271025731 conn(0x7fa6fc0fd600 msgr2=0x7fa6fc0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:15.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.631+0000 7fa7043eb640 1 -- 172.21.15.17:0/4271025731 shutdown_connections 2024-09-20T19:07:15.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:15.631+0000 7fa7043eb640 1 -- 172.21.15.17:0/4271025731 wait complete. 2024-09-20T19:07:15.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:15 smithi017 ceph-mon[108970]: from='client.35556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:15.890 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:15 smithi017 ceph-mon[108970]: pgmap v956: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:15.890 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:15 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/465015542' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:07:15.890 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:15 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4271025731' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:07:16.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:15 smithi172 ceph-mon[80431]: from='client.35556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:16.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:15 smithi172 ceph-mon[80431]: pgmap v956: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:16.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:15 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/465015542' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:07:16.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:15 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4271025731' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:07:17.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:16 smithi017 ceph-mon[108970]: from='client.35568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:17.188 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:16 smithi172 ceph-mon[80431]: from='client.35568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:18.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:17 smithi017 ceph-mon[108970]: pgmap v957: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:18.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:17 smithi172 ceph-mon[80431]: pgmap v957: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:20.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:19 smithi017 ceph-mon[108970]: pgmap v958: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:20.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:19 smithi172 ceph-mon[80431]: pgmap v958: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:22.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:21 smithi017 ceph-mon[108970]: pgmap v959: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:22.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:21 smithi172 ceph-mon[80431]: pgmap v959: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:23.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:07:23.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:07:24.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:23 smithi017 ceph-mon[108970]: pgmap v960: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:24.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:23 smithi172 ceph-mon[80431]: pgmap v960: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:26.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:25 smithi017 ceph-mon[108970]: pgmap v961: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:26.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:25 smithi172 ceph-mon[80431]: pgmap v961: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:28.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:27 smithi017 ceph-mon[108970]: pgmap v962: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:28.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:27 smithi172 ceph-mon[80431]: pgmap v962: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:30.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:29 smithi017 ceph-mon[108970]: pgmap v963: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:30.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:29 smithi172 ceph-mon[80431]: pgmap v963: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:32.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:31 smithi017 ceph-mon[108970]: pgmap v964: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:32.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:31 smithi172 ceph-mon[80431]: pgmap v964: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:34.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:33 smithi017 ceph-mon[108970]: pgmap v965: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:34.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:33 smithi172 ceph-mon[80431]: pgmap v965: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:36.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:35 smithi017 ceph-mon[108970]: pgmap v966: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:36.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:35 smithi172 ceph-mon[80431]: pgmap v966: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:38.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:37 smithi017 ceph-mon[108970]: pgmap v967: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:38.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:07:38.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:37 smithi172 ceph-mon[80431]: pgmap v967: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:38.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:07:40.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:39 smithi017 ceph-mon[108970]: pgmap v968: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:40.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:39 smithi172 ceph-mon[80431]: pgmap v968: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:42.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:41 smithi017 ceph-mon[108970]: pgmap v969: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:42.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:41 smithi172 ceph-mon[80431]: pgmap v969: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:44.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:43 smithi172 ceph-mon[80431]: pgmap v970: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:44.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:43 smithi017 ceph-mon[108970]: pgmap v970: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.729+0000 7f500c556640 1 -- 172.21.15.17:0/3309730427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5004102b40 msgr2=0x7f5004102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.729+0000 7f500c556640 1 --2- 172.21.15.17:0/3309730427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5004102b40 0x7f5004102f20 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5000009880 tx=0x7f500002a530 comp rx=0 tx=0).stop 2024-09-20T19:07:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.730+0000 7f500c556640 1 -- 172.21.15.17:0/3309730427 shutdown_connections 2024-09-20T19:07:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.730+0000 7f500c556640 1 --2- 172.21.15.17:0/3309730427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5004103460 0x7f500410b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.730+0000 7f500c556640 1 --2- 172.21.15.17:0/3309730427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5004102b40 0x7f5004102f20 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.730+0000 7f500c556640 1 -- 172.21.15.17:0/3309730427 >> 172.21.15.17:0/3309730427 conn(0x7f50040fc520 msgr2=0x7f50040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.730+0000 7f500c556640 1 -- 172.21.15.17:0/3309730427 shutdown_connections 2024-09-20T19:07:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.730+0000 7f500c556640 1 -- 172.21.15.17:0/3309730427 wait complete. 2024-09-20T19:07:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.730+0000 7f500c556640 1 Processor -- start 2024-09-20T19:07:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.730+0000 7f500c556640 1 -- start start 2024-09-20T19:07:45.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.731+0000 7f500c556640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5004102b40 0x7f500419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:45.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.731+0000 7f500c556640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5004103460 0x7f500419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:45.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.731+0000 7f500c556640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f500410edf0 con 0x7f5004103460 2024-09-20T19:07:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.731+0000 7f500c556640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f500410ec70 con 0x7f5004102b40 2024-09-20T19:07:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.731+0000 7f5009af1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5004103460 0x7f500419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.731+0000 7f5009af1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5004103460 0x7f500419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35884/0 (socket says 172.21.15.17:35884) 2024-09-20T19:07:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.731+0000 7f5009af1640 1 -- 172.21.15.17:0/822062434 learned_addr learned my addr 172.21.15.17:0/822062434 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:07:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.731+0000 7f500a2f2640 1 --2- 172.21.15.17:0/822062434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5004102b40 0x7f500419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.731+0000 7f5009af1640 1 -- 172.21.15.17:0/822062434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5004102b40 msgr2=0x7f500419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.731+0000 7f5009af1640 1 --2- 172.21.15.17:0/822062434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5004102b40 0x7f500419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.731+0000 7f5009af1640 1 -- 172.21.15.17:0/822062434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50041977c0 con 0x7f5004103460 2024-09-20T19:07:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.731+0000 7f5009af1640 1 --2- 172.21.15.17:0/822062434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5004103460 0x7f500419db80 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400d6f0 tx=0x7f4ff400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.731+0000 7f4ffb7fe640 1 -- 172.21.15.17:0/822062434 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ff4017070 con 0x7f5004103460 2024-09-20T19:07:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.732+0000 7f500c556640 1 -- 172.21.15.17:0/822062434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5004197ab0 con 0x7f5004103460 2024-09-20T19:07:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.732+0000 7f4ffb7fe640 1 -- 172.21.15.17:0/822062434 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4ff400de00 con 0x7f5004103460 2024-09-20T19:07:45.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.732+0000 7f4ffb7fe640 1 -- 172.21.15.17:0/822062434 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ff4004bb0 con 0x7f5004103460 2024-09-20T19:07:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.732+0000 7f500c556640 1 -- 172.21.15.17:0/822062434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5004198040 con 0x7f5004103460 2024-09-20T19:07:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.733+0000 7f500c556640 1 -- 172.21.15.17:0/822062434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f500406aa10 con 0x7f5004103460 2024-09-20T19:07:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.733+0000 7f4ffb7fe640 1 -- 172.21.15.17:0/822062434 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4ff4004e60 con 0x7f5004103460 2024-09-20T19:07:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.734+0000 7f4ffb7fe640 1 --2- 172.21.15.17:0/822062434 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ff007af40 0x7f4ff007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.734+0000 7f4ffb7fe640 1 -- 172.21.15.17:0/822062434 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f4ff409dba0 con 0x7f5004103460 2024-09-20T19:07:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.734+0000 7f500a2f2640 1 --2- 172.21.15.17:0/822062434 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ff007af40 0x7f4ff007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.735+0000 7f500a2f2640 1 --2- 172.21.15.17:0/822062434 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ff007af40 0x7f4ff007d400 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f50000096c0 tx=0x7f5000004f30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.739+0000 7f4ffb7fe640 1 -- 172.21.15.17:0/822062434 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ff40691a0 con 0x7f5004103460 2024-09-20T19:07:45.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.947+0000 7f500c556640 1 -- 172.21.15.17:0/822062434 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f50041982f0 con 0x7f4ff007af40 2024-09-20T19:07:45.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.949+0000 7f4ffb7fe640 1 -- 172.21.15.17:0/822062434 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f50041982f0 con 0x7f4ff007af40 2024-09-20T19:07:45.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.951+0000 7f500c556640 1 -- 172.21.15.17:0/822062434 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ff007af40 msgr2=0x7f4ff007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:45.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.951+0000 7f500c556640 1 --2- 172.21.15.17:0/822062434 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ff007af40 0x7f4ff007d400 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f50000096c0 tx=0x7f5000004f30 comp rx=0 tx=0).stop 2024-09-20T19:07:45.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.951+0000 7f500c556640 1 -- 172.21.15.17:0/822062434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5004103460 msgr2=0x7f500419db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:45.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.951+0000 7f500c556640 1 --2- 172.21.15.17:0/822062434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5004103460 0x7f500419db80 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400d6f0 tx=0x7f4ff400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:07:45.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.951+0000 7f500c556640 1 -- 172.21.15.17:0/822062434 shutdown_connections 2024-09-20T19:07:45.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.951+0000 7f500c556640 1 --2- 172.21.15.17:0/822062434 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ff007af40 0x7f4ff007d400 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:45.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.951+0000 7f500c556640 1 --2- 172.21.15.17:0/822062434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5004103460 0x7f500419db80 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:45.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.951+0000 7f500c556640 1 --2- 172.21.15.17:0/822062434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5004102b40 0x7f500419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:45.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.951+0000 7f500c556640 1 -- 172.21.15.17:0/822062434 >> 172.21.15.17:0/822062434 conn(0x7f50040fc520 msgr2=0x7f5004108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:45.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.951+0000 7f500c556640 1 -- 172.21.15.17:0/822062434 shutdown_connections 2024-09-20T19:07:45.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:45.951+0000 7f500c556640 1 -- 172.21.15.17:0/822062434 wait complete. 2024-09-20T19:07:45.965 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:07:46.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.036+0000 7f686b51b640 1 -- 172.21.15.17:0/3633745804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864102b60 msgr2=0x7f6864102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:46.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.036+0000 7f686b51b640 1 --2- 172.21.15.17:0/3633745804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864102b60 0x7f6864102f40 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6860009880 tx=0x7f686002a530 comp rx=0 tx=0).stop 2024-09-20T19:07:46.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.036+0000 7f686b51b640 1 -- 172.21.15.17:0/3633745804 shutdown_connections 2024-09-20T19:07:46.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.036+0000 7f686b51b640 1 --2- 172.21.15.17:0/3633745804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6864103480 0x7f686410b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.036+0000 7f686b51b640 1 --2- 172.21.15.17:0/3633745804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864102b60 0x7f6864102f40 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.036+0000 7f686b51b640 1 -- 172.21.15.17:0/3633745804 >> 172.21.15.17:0/3633745804 conn(0x7f68640fc520 msgr2=0x7f68640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:46.042 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:45 smithi017 ceph-mon[108970]: pgmap v971: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:46.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.037+0000 7f686b51b640 1 -- 172.21.15.17:0/3633745804 shutdown_connections 2024-09-20T19:07:46.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.037+0000 7f686b51b640 1 -- 172.21.15.17:0/3633745804 wait complete. 2024-09-20T19:07:46.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.037+0000 7f686b51b640 1 Processor -- start 2024-09-20T19:07:46.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.037+0000 7f686b51b640 1 -- start start 2024-09-20T19:07:46.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.038+0000 7f686b51b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864102b60 0x7f686419d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:46.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.038+0000 7f686b51b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6864103480 0x7f686419dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:46.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.038+0000 7f686b51b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f686410ee50 con 0x7f6864102b60 2024-09-20T19:07:46.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.038+0000 7f686b51b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f686410ecd0 con 0x7f6864103480 2024-09-20T19:07:46.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.038+0000 7f68692b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864102b60 0x7f686419d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:46.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.038+0000 7f68692b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864102b60 0x7f686419d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35894/0 (socket says 172.21.15.17:35894) 2024-09-20T19:07:46.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.038+0000 7f68692b7640 1 -- 172.21.15.17:0/3735449222 learned_addr learned my addr 172.21.15.17:0/3735449222 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:07:46.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.038+0000 7f6868ab6640 1 --2- 172.21.15.17:0/3735449222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6864103480 0x7f686419dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:46.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.038+0000 7f68692b7640 1 -- 172.21.15.17:0/3735449222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6864103480 msgr2=0x7f686419dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:46.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.038+0000 7f68692b7640 1 --2- 172.21.15.17:0/3735449222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6864103480 0x7f686419dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.038+0000 7f68692b7640 1 -- 172.21.15.17:0/3735449222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68641978a0 con 0x7f6864102b60 2024-09-20T19:07:46.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.038+0000 7f68692b7640 1 --2- 172.21.15.17:0/3735449222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864102b60 0x7f686419d6e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6860004f90 tx=0x7f68600048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:46.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.039+0000 7f685a7fc640 1 -- 172.21.15.17:0/3735449222 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f686003f070 con 0x7f6864102b60 2024-09-20T19:07:46.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.039+0000 7f685a7fc640 1 -- 172.21.15.17:0/3735449222 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6860004cf0 con 0x7f6864102b60 2024-09-20T19:07:46.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.039+0000 7f686b51b640 1 -- 172.21.15.17:0/3735449222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6864197b30 con 0x7f6864102b60 2024-09-20T19:07:46.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.039+0000 7f686b51b640 1 -- 172.21.15.17:0/3735449222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6864198060 con 0x7f6864102b60 2024-09-20T19:07:46.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.039+0000 7f685a7fc640 1 -- 172.21.15.17:0/3735449222 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6860035030 con 0x7f6864102b60 2024-09-20T19:07:46.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.040+0000 7f686b51b640 1 -- 172.21.15.17:0/3735449222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f686406a9f0 con 0x7f6864102b60 2024-09-20T19:07:46.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.041+0000 7f685a7fc640 1 -- 172.21.15.17:0/3735449222 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6860042070 con 0x7f6864102b60 2024-09-20T19:07:46.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.041+0000 7f685a7fc640 1 --2- 172.21.15.17:0/3735449222 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f685007af30 0x7f685007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:46.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.041+0000 7f685a7fc640 1 -- 172.21.15.17:0/3735449222 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f68600be600 con 0x7f6864102b60 2024-09-20T19:07:46.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.042+0000 7f6868ab6640 1 --2- 172.21.15.17:0/3735449222 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f685007af30 0x7f685007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:46.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.042+0000 7f6868ab6640 1 --2- 172.21.15.17:0/3735449222 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f685007af30 0x7f685007d3f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6864108950 tx=0x7f6854009110 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:46.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.046+0000 7f685a7fc640 1 -- 172.21.15.17:0/3735449222 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6860089c00 con 0x7f6864102b60 2024-09-20T19:07:46.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:45 smithi172 ceph-mon[80431]: pgmap v971: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:46.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.251+0000 7f686b51b640 1 -- 172.21.15.17:0/3735449222 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6864198dd0 con 0x7f685007af30 2024-09-20T19:07:46.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.252+0000 7f685a7fc640 1 -- 172.21.15.17:0/3735449222 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6864198dd0 con 0x7f685007af30 2024-09-20T19:07:46.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.254+0000 7f686b51b640 1 -- 172.21.15.17:0/3735449222 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f685007af30 msgr2=0x7f685007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:46.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.254+0000 7f686b51b640 1 --2- 172.21.15.17:0/3735449222 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f685007af30 0x7f685007d3f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6864108950 tx=0x7f6854009110 comp rx=0 tx=0).stop 2024-09-20T19:07:46.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.254+0000 7f686b51b640 1 -- 172.21.15.17:0/3735449222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864102b60 msgr2=0x7f686419d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:46.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.254+0000 7f686b51b640 1 --2- 172.21.15.17:0/3735449222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864102b60 0x7f686419d6e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6860004f90 tx=0x7f68600048f0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.255+0000 7f686b51b640 1 -- 172.21.15.17:0/3735449222 shutdown_connections 2024-09-20T19:07:46.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.255+0000 7f686b51b640 1 --2- 172.21.15.17:0/3735449222 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f685007af30 0x7f685007d3f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.255+0000 7f686b51b640 1 --2- 172.21.15.17:0/3735449222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6864103480 0x7f686419dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.255+0000 7f686b51b640 1 --2- 172.21.15.17:0/3735449222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6864102b60 0x7f686419d6e0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.255+0000 7f686b51b640 1 -- 172.21.15.17:0/3735449222 >> 172.21.15.17:0/3735449222 conn(0x7f68640fc520 msgr2=0x7f6864107e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:46.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.255+0000 7f686b51b640 1 -- 172.21.15.17:0/3735449222 shutdown_connections 2024-09-20T19:07:46.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.255+0000 7f686b51b640 1 -- 172.21.15.17:0/3735449222 wait complete. 2024-09-20T19:07:46.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.339+0000 7f5211de3640 1 -- 172.21.15.17:0/2317648976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f520c107900 msgr2=0x7f520c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:46.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.339+0000 7f5211de3640 1 --2- 172.21.15.17:0/2317648976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f520c107900 0x7f520c107ce0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009880 tx=0x7f51f402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.339+0000 7f5211de3640 1 -- 172.21.15.17:0/2317648976 shutdown_connections 2024-09-20T19:07:46.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.339+0000 7f5211de3640 1 --2- 172.21.15.17:0/2317648976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f520c101900 0x7f520c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.339+0000 7f5211de3640 1 --2- 172.21.15.17:0/2317648976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f520c107900 0x7f520c107ce0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.339+0000 7f5211de3640 1 -- 172.21.15.17:0/2317648976 >> 172.21.15.17:0/2317648976 conn(0x7f520c0fd600 msgr2=0x7f520c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:46.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.340+0000 7f5211de3640 1 -- 172.21.15.17:0/2317648976 shutdown_connections 2024-09-20T19:07:46.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.340+0000 7f5211de3640 1 -- 172.21.15.17:0/2317648976 wait complete. 2024-09-20T19:07:46.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.340+0000 7f5211de3640 1 Processor -- start 2024-09-20T19:07:46.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.340+0000 7f5211de3640 1 -- start start 2024-09-20T19:07:46.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.341+0000 7f5211de3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f520c101900 0x7f520c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:46.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.341+0000 7f5211de3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f520c107900 0x7f520c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:46.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.341+0000 7f5211de3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f520c10edb0 con 0x7f520c107900 2024-09-20T19:07:46.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.341+0000 7f5211de3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f520c10ec30 con 0x7f520c101900 2024-09-20T19:07:46.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.341+0000 7f520affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f520c107900 0x7f520c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:46.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.341+0000 7f520affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f520c107900 0x7f520c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35912/0 (socket says 172.21.15.17:35912) 2024-09-20T19:07:46.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.341+0000 7f520affd640 1 -- 172.21.15.17:0/1576807452 learned_addr learned my addr 172.21.15.17:0/1576807452 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:07:46.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.341+0000 7f520b7fe640 1 --2- 172.21.15.17:0/1576807452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f520c101900 0x7f520c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:46.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.341+0000 7f520affd640 1 -- 172.21.15.17:0/1576807452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f520c101900 msgr2=0x7f520c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:46.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.341+0000 7f520affd640 1 --2- 172.21.15.17:0/1576807452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f520c101900 0x7f520c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.341+0000 7f520affd640 1 -- 172.21.15.17:0/1576807452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520c074f70 con 0x7f520c107900 2024-09-20T19:07:46.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.341+0000 7f520affd640 1 --2- 172.21.15.17:0/1576807452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f520c107900 0x7f520c074a30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c8a0 tx=0x7f51fc00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:46.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.342+0000 7f5208ff9640 1 -- 172.21.15.17:0/1576807452 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f51fc0079b0 con 0x7f520c107900 2024-09-20T19:07:46.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.342+0000 7f5211de3640 1 -- 172.21.15.17:0/1576807452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f520c075260 con 0x7f520c107900 2024-09-20T19:07:46.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.342+0000 7f5208ff9640 1 -- 172.21.15.17:0/1576807452 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51fc007b50 con 0x7f520c107900 2024-09-20T19:07:46.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.342+0000 7f5211de3640 1 -- 172.21.15.17:0/1576807452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f520c1a3de0 con 0x7f520c107900 2024-09-20T19:07:46.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.342+0000 7f5208ff9640 1 -- 172.21.15.17:0/1576807452 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f51fc018700 con 0x7f520c107900 2024-09-20T19:07:46.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.343+0000 7f5211de3640 1 -- 172.21.15.17:0/1576807452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51ec005290 con 0x7f520c107900 2024-09-20T19:07:46.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.344+0000 7f5208ff9640 1 -- 172.21.15.17:0/1576807452 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f51fc007d00 con 0x7f520c107900 2024-09-20T19:07:46.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.344+0000 7f5208ff9640 1 --2- 172.21.15.17:0/1576807452 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f51f807af30 0x7f51f807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:46.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.344+0000 7f520b7fe640 1 --2- 172.21.15.17:0/1576807452 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f51f807af30 0x7f51f807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:46.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.344+0000 7f5208ff9640 1 -- 172.21.15.17:0/1576807452 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f51fc09e0e0 con 0x7f520c107900 2024-09-20T19:07:46.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.345+0000 7f520b7fe640 1 --2- 172.21.15.17:0/1576807452 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f51f807af30 0x7f51f807d3f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f51f4000c00 tx=0x7f51f4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:46.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.349+0000 7f5208ff9640 1 -- 172.21.15.17:0/1576807452 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f51fc014030 con 0x7f520c107900 2024-09-20T19:07:46.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.545+0000 7f5211de3640 1 -- 172.21.15.17:0/1576807452 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f51ec000bc0 con 0x7f51f807af30 2024-09-20T19:07:46.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.555+0000 7f5208ff9640 1 -- 172.21.15.17:0/1576807452 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f51ec000bc0 con 0x7f51f807af30 2024-09-20T19:07:46.560 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:07:46.560 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (29m) 7m ago 40m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:07:46.560 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (32m) 7m ago 40m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:07:46.560 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (31m) 7m ago 39m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:07:46.560 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (27m) 7m ago 40m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:07:46.560 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (27m) 7m ago 39m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:07:46.560 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (28m) 7m ago 39m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:07:46.560 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (23m) 7m ago 34m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:07:46.560 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (23m) 7m ago 34m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:07:46.560 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (8m) 7m ago 34m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:07:46.561 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (23m) 7m ago 34m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:07:46.561 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (31m) 7m ago 41m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:07:46.561 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (30m) 7m ago 39m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:07:46.561 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (27m) 7m ago 41m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:07:46.561 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (27m) 7m ago 39m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:07:46.561 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (29m) 7m ago 40m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:07:46.561 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (29m) 7m ago 39m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:07:46.561 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (27m) 7m ago 38m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:07:46.561 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (26m) 7m ago 37m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:07:46.561 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (25m) 7m ago 37m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:07:46.561 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (25m) 7m ago 36m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:07:46.561 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (24m) 7m ago 36m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:07:46.561 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (23m) 7m ago 35m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:07:46.561 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (29m) 7m ago 39m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:07:46.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.558+0000 7f5211de3640 1 -- 172.21.15.17:0/1576807452 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f51f807af30 msgr2=0x7f51f807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:46.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.558+0000 7f5211de3640 1 --2- 172.21.15.17:0/1576807452 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f51f807af30 0x7f51f807d3f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f51f4000c00 tx=0x7f51f4031400 comp rx=0 tx=0).stop 2024-09-20T19:07:46.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.558+0000 7f5211de3640 1 -- 172.21.15.17:0/1576807452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f520c107900 msgr2=0x7f520c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:46.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.558+0000 7f5211de3640 1 --2- 172.21.15.17:0/1576807452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f520c107900 0x7f520c074a30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c8a0 tx=0x7f51fc00cd60 comp rx=0 tx=0).stop 2024-09-20T19:07:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.558+0000 7f5211de3640 1 -- 172.21.15.17:0/1576807452 shutdown_connections 2024-09-20T19:07:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.558+0000 7f5211de3640 1 --2- 172.21.15.17:0/1576807452 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f51f807af30 0x7f51f807d3f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.558+0000 7f5211de3640 1 --2- 172.21.15.17:0/1576807452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f520c107900 0x7f520c074a30 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.558+0000 7f5211de3640 1 --2- 172.21.15.17:0/1576807452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f520c101900 0x7f520c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.559+0000 7f5211de3640 1 -- 172.21.15.17:0/1576807452 >> 172.21.15.17:0/1576807452 conn(0x7f520c0fd600 msgr2=0x7f520c0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.559+0000 7f5211de3640 1 -- 172.21.15.17:0/1576807452 shutdown_connections 2024-09-20T19:07:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.559+0000 7f5211de3640 1 -- 172.21.15.17:0/1576807452 wait complete. 2024-09-20T19:07:46.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.642+0000 7f69e822a640 1 -- 172.21.15.17:0/1536322658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69e0102ac0 msgr2=0x7f69e0102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:46.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.642+0000 7f69e822a640 1 --2- 172.21.15.17:0/1536322658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69e0102ac0 0x7f69e0102ea0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009880 tx=0x7f69dc02a530 comp rx=0 tx=0).stop 2024-09-20T19:07:46.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.642+0000 7f69e822a640 1 -- 172.21.15.17:0/1536322658 shutdown_connections 2024-09-20T19:07:46.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.642+0000 7f69e822a640 1 --2- 172.21.15.17:0/1536322658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e01033e0 0x7f69e010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.642+0000 7f69e822a640 1 --2- 172.21.15.17:0/1536322658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69e0102ac0 0x7f69e0102ea0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.642+0000 7f69e822a640 1 -- 172.21.15.17:0/1536322658 >> 172.21.15.17:0/1536322658 conn(0x7f69e00fc520 msgr2=0x7f69e00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:46.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.642+0000 7f69e822a640 1 -- 172.21.15.17:0/1536322658 shutdown_connections 2024-09-20T19:07:46.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.642+0000 7f69e822a640 1 -- 172.21.15.17:0/1536322658 wait complete. 2024-09-20T19:07:46.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.643+0000 7f69e822a640 1 Processor -- start 2024-09-20T19:07:46.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.643+0000 7f69e822a640 1 -- start start 2024-09-20T19:07:46.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.643+0000 7f69e822a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69e0102ac0 0x7f69e019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:46.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.643+0000 7f69e822a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e01033e0 0x7f69e019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:46.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.643+0000 7f69e822a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f69e010edd0 con 0x7f69e0102ac0 2024-09-20T19:07:46.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.643+0000 7f69e822a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f69e010ec50 con 0x7f69e01033e0 2024-09-20T19:07:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.643+0000 7f69e5fc6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69e0102ac0 0x7f69e019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.643+0000 7f69e5fc6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69e0102ac0 0x7f69e019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35942/0 (socket says 172.21.15.17:35942) 2024-09-20T19:07:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.643+0000 7f69e5fc6640 1 -- 172.21.15.17:0/511132303 learned_addr learned my addr 172.21.15.17:0/511132303 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:07:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.643+0000 7f69e57c5640 1 --2- 172.21.15.17:0/511132303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e01033e0 0x7f69e019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.643+0000 7f69e5fc6640 1 -- 172.21.15.17:0/511132303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e01033e0 msgr2=0x7f69e019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.643+0000 7f69e5fc6640 1 --2- 172.21.15.17:0/511132303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e01033e0 0x7f69e019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.643+0000 7f69e5fc6640 1 -- 172.21.15.17:0/511132303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e01977c0 con 0x7f69e0102ac0 2024-09-20T19:07:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.643+0000 7f69e57c5640 1 --2- 172.21.15.17:0/511132303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e01033e0 0x7f69e019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:07:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.644+0000 7f69e5fc6640 1 --2- 172.21.15.17:0/511132303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69e0102ac0 0x7f69e019d640 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f69dc031460 tx=0x7f69dc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.644+0000 7f69d6ffd640 1 -- 172.21.15.17:0/511132303 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69dc03f070 con 0x7f69e0102ac0 2024-09-20T19:07:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.644+0000 7f69d6ffd640 1 -- 172.21.15.17:0/511132303 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f69dc004cf0 con 0x7f69e0102ac0 2024-09-20T19:07:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.644+0000 7f69e822a640 1 -- 172.21.15.17:0/511132303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e0197a50 con 0x7f69e0102ac0 2024-09-20T19:07:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.644+0000 7f69d6ffd640 1 -- 172.21.15.17:0/511132303 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69dc035030 con 0x7f69e0102ac0 2024-09-20T19:07:46.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.644+0000 7f69e822a640 1 -- 172.21.15.17:0/511132303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e0197f80 con 0x7f69e0102ac0 2024-09-20T19:07:46.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.645+0000 7f69e822a640 1 -- 172.21.15.17:0/511132303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e006aa90 con 0x7f69e0102ac0 2024-09-20T19:07:46.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.646+0000 7f69d6ffd640 1 -- 172.21.15.17:0/511132303 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f69dc042070 con 0x7f69e0102ac0 2024-09-20T19:07:46.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.646+0000 7f69d6ffd640 1 --2- 172.21.15.17:0/511132303 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f69cc07af80 0x7f69cc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:46.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.646+0000 7f69e57c5640 1 --2- 172.21.15.17:0/511132303 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f69cc07af80 0x7f69cc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:46.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.646+0000 7f69d6ffd640 1 -- 172.21.15.17:0/511132303 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f69dc0be9e0 con 0x7f69e0102ac0 2024-09-20T19:07:46.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.647+0000 7f69e57c5640 1 --2- 172.21.15.17:0/511132303 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f69cc07af80 0x7f69cc07d440 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f69e0108900 tx=0x7f69d0005dd0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:46.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.651+0000 7f69d6ffd640 1 -- 172.21.15.17:0/511132303 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69dc08a060 con 0x7f69e0102ac0 2024-09-20T19:07:46.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.915+0000 7f69e822a640 1 -- 172.21.15.17:0/511132303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f69e0105f90 con 0x7f69e0102ac0 2024-09-20T19:07:46.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.916+0000 7f69d6ffd640 1 -- 172.21.15.17:0/511132303 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f69dc08ef10 con 0x7f69e0102ac0 2024-09-20T19:07:46.921 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:07:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:07:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:07:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:07:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:07:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:07:46.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:07:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:07:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:07:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:07:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:07:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:07:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:07:46.922 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:07:46.923 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:07:46.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:07:46.923 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:07:46.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.918+0000 7f69e822a640 1 -- 172.21.15.17:0/511132303 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f69cc07af80 msgr2=0x7f69cc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:46.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.918+0000 7f69e822a640 1 --2- 172.21.15.17:0/511132303 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f69cc07af80 0x7f69cc07d440 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f69e0108900 tx=0x7f69d0005dd0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.918+0000 7f69e822a640 1 -- 172.21.15.17:0/511132303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69e0102ac0 msgr2=0x7f69e019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:46.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.918+0000 7f69e822a640 1 --2- 172.21.15.17:0/511132303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69e0102ac0 0x7f69e019d640 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f69dc031460 tx=0x7f69dc0048f0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.918+0000 7f69e822a640 1 -- 172.21.15.17:0/511132303 shutdown_connections 2024-09-20T19:07:46.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.918+0000 7f69e822a640 1 --2- 172.21.15.17:0/511132303 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f69cc07af80 0x7f69cc07d440 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.918+0000 7f69e822a640 1 --2- 172.21.15.17:0/511132303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e01033e0 0x7f69e019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.918+0000 7f69e822a640 1 --2- 172.21.15.17:0/511132303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69e0102ac0 0x7f69e019d640 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:46.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.918+0000 7f69e822a640 1 -- 172.21.15.17:0/511132303 >> 172.21.15.17:0/511132303 conn(0x7f69e00fc520 msgr2=0x7f69e0108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:46.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.918+0000 7f69e822a640 1 -- 172.21.15.17:0/511132303 shutdown_connections 2024-09-20T19:07:46.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:46.918+0000 7f69e822a640 1 -- 172.21.15.17:0/511132303 wait complete. 2024-09-20T19:07:47.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.002+0000 7f129834f640 1 -- 172.21.15.17:0/827799911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12901067f0 msgr2=0x7f1290106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:47.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.002+0000 7f129834f640 1 --2- 172.21.15.17:0/827799911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12901067f0 0x7f1290106bd0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f128c009880 tx=0x7f128c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.002+0000 7f129834f640 1 -- 172.21.15.17:0/827799911 shutdown_connections 2024-09-20T19:07:47.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.002+0000 7f129834f640 1 --2- 172.21.15.17:0/827799911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12901007f0 0x7f1290100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.002+0000 7f129834f640 1 --2- 172.21.15.17:0/827799911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12901067f0 0x7f1290106bd0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.002+0000 7f129834f640 1 -- 172.21.15.17:0/827799911 >> 172.21.15.17:0/827799911 conn(0x7f12900fc550 msgr2=0x7f12900fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:47.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.002+0000 7f129834f640 1 -- 172.21.15.17:0/827799911 shutdown_connections 2024-09-20T19:07:47.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.002+0000 7f129834f640 1 -- 172.21.15.17:0/827799911 wait complete. 2024-09-20T19:07:47.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.003+0000 7f129834f640 1 Processor -- start 2024-09-20T19:07:47.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.003+0000 7f129834f640 1 -- start start 2024-09-20T19:07:47.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.003+0000 7f129834f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12901007f0 0x7f129019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:47.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.003+0000 7f129834f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12901067f0 0x7f129019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:47.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.003+0000 7f129834f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f129010dca0 con 0x7f12901067f0 2024-09-20T19:07:47.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.003+0000 7f129834f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f129010db20 con 0x7f12901007f0 2024-09-20T19:07:47.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.003+0000 7f12958ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12901067f0 0x7f129019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:47.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.003+0000 7f12958ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12901067f0 0x7f129019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35958/0 (socket says 172.21.15.17:35958) 2024-09-20T19:07:47.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.003+0000 7f12958ea640 1 -- 172.21.15.17:0/4049510603 learned_addr learned my addr 172.21.15.17:0/4049510603 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:07:47.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.003+0000 7f12960eb640 1 --2- 172.21.15.17:0/4049510603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12901007f0 0x7f129019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:47.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.003+0000 7f12958ea640 1 -- 172.21.15.17:0/4049510603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12901007f0 msgr2=0x7f129019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:47.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.003+0000 7f12958ea640 1 --2- 172.21.15.17:0/4049510603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12901007f0 0x7f129019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.003+0000 7f12958ea640 1 -- 172.21.15.17:0/4049510603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1290197750 con 0x7f12901067f0 2024-09-20T19:07:47.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.004+0000 7f12958ea640 1 --2- 172.21.15.17:0/4049510603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12901067f0 0x7f129019dbc0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f128000d8d0 tx=0x7f128000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:47.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.004+0000 7f12877fe640 1 -- 172.21.15.17:0/4049510603 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1280017030 con 0x7f12901067f0 2024-09-20T19:07:47.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.004+0000 7f12877fe640 1 -- 172.21.15.17:0/4049510603 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1280004020 con 0x7f12901067f0 2024-09-20T19:07:47.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.004+0000 7f129834f640 1 -- 172.21.15.17:0/4049510603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1290197a40 con 0x7f12901067f0 2024-09-20T19:07:47.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.004+0000 7f12877fe640 1 -- 172.21.15.17:0/4049510603 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f12800047a0 con 0x7f12901067f0 2024-09-20T19:07:47.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.004+0000 7f129834f640 1 -- 172.21.15.17:0/4049510603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1290197fa0 con 0x7f12901067f0 2024-09-20T19:07:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.005+0000 7f129834f640 1 -- 172.21.15.17:0/4049510603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1290101f30 con 0x7f12901067f0 2024-09-20T19:07:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.006+0000 7f12877fe640 1 -- 172.21.15.17:0/4049510603 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f12800041d0 con 0x7f12901067f0 2024-09-20T19:07:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.006+0000 7f12877fe640 1 --2- 172.21.15.17:0/4049510603 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f127c07af80 0x7f127c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.006+0000 7f12877fe640 1 -- 172.21.15.17:0/4049510603 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f1280018070 con 0x7f12901067f0 2024-09-20T19:07:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.006+0000 7f12960eb640 1 --2- 172.21.15.17:0/4049510603 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f127c07af80 0x7f127c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.007+0000 7f12960eb640 1 --2- 172.21.15.17:0/4049510603 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f127c07af80 0x7f127c07d440 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f128c0096c0 tx=0x7f128c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:47.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.011+0000 7f12877fe640 1 -- 172.21.15.17:0/4049510603 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f12800692f0 con 0x7f12901067f0 2024-09-20T19:07:47.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:46 smithi172 ceph-mon[80431]: from='client.35576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:47.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.237+0000 7f129834f640 1 -- 172.21.15.17:0/4049510603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1290198310 con 0x7f12901067f0 2024-09-20T19:07:47.242 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:46 smithi017 ceph-mon[108970]: from='client.35576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:47.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.238+0000 7f12877fe640 1 -- 172.21.15.17:0/4049510603 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7f128006e1a0 con 0x7f12901067f0 2024-09-20T19:07:47.243 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:07:47.243 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:07:47.243 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:07:47.243 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:07:47.243 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:07:47.244 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:07:47.244 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:07:47.244 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:07:47.244 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:07:47.244 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:07:47.244 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:07:47.244 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:07:47.244 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:07:47.244 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:07:47.244 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:07:47.244 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:07:47.244 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:07:47.245 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:07:47.245 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:07:47.245 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:07:47.245 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:07:47.245 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:07:47.245 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:07:47.245 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:07:47.245 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:07:47.245 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:07:47.245 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:07:47.245 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:07:47.245 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:07:47.245 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:07:47.245 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:07:47.246 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:07:47.246 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:07:47.246 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:07:47.246 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:07:47.246 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:07:47.246 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:07:47.246 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:07:47.246 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:07:47.246 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:07:47.246 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:07:47.246 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:07:47.246 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:07:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:07:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.240+0000 7f129834f640 1 -- 172.21.15.17:0/4049510603 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f127c07af80 msgr2=0x7f127c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.240+0000 7f129834f640 1 --2- 172.21.15.17:0/4049510603 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f127c07af80 0x7f127c07d440 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f128c0096c0 tx=0x7f128c031400 comp rx=0 tx=0).stop 2024-09-20T19:07:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.240+0000 7f129834f640 1 -- 172.21.15.17:0/4049510603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12901067f0 msgr2=0x7f129019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.240+0000 7f129834f640 1 --2- 172.21.15.17:0/4049510603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12901067f0 0x7f129019dbc0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f128000d8d0 tx=0x7f128000dd90 comp rx=0 tx=0).stop 2024-09-20T19:07:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.240+0000 7f129834f640 1 -- 172.21.15.17:0/4049510603 shutdown_connections 2024-09-20T19:07:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.240+0000 7f129834f640 1 --2- 172.21.15.17:0/4049510603 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f127c07af80 0x7f127c07d440 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.240+0000 7f129834f640 1 --2- 172.21.15.17:0/4049510603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12901067f0 0x7f129019dbc0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.240+0000 7f129834f640 1 --2- 172.21.15.17:0/4049510603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12901007f0 0x7f129019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.240+0000 7f129834f640 1 -- 172.21.15.17:0/4049510603 >> 172.21.15.17:0/4049510603 conn(0x7f12900fc550 msgr2=0x7f1290069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.240+0000 7f129834f640 1 -- 172.21.15.17:0/4049510603 shutdown_connections 2024-09-20T19:07:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.240+0000 7f129834f640 1 -- 172.21.15.17:0/4049510603 wait complete. 2024-09-20T19:07:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.326+0000 7f6fa48aa640 1 -- 172.21.15.17:0/3641586825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa0102b50 msgr2=0x7f6fa0102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.326+0000 7f6fa48aa640 1 --2- 172.21.15.17:0/3641586825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa0102b50 0x7f6fa0102f30 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009c20 tx=0x7f6f9802aa00 comp rx=0 tx=0).stop 2024-09-20T19:07:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.326+0000 7f6fa48aa640 1 -- 172.21.15.17:0/3641586825 shutdown_connections 2024-09-20T19:07:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.326+0000 7f6fa48aa640 1 --2- 172.21.15.17:0/3641586825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa0103470 0x7f6fa010b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.326+0000 7f6fa48aa640 1 --2- 172.21.15.17:0/3641586825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa0102b50 0x7f6fa0102f30 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.326+0000 7f6fa48aa640 1 -- 172.21.15.17:0/3641586825 >> 172.21.15.17:0/3641586825 conn(0x7f6fa00fc550 msgr2=0x7f6fa00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.326+0000 7f6fa48aa640 1 -- 172.21.15.17:0/3641586825 shutdown_connections 2024-09-20T19:07:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.326+0000 7f6fa48aa640 1 -- 172.21.15.17:0/3641586825 wait complete. 2024-09-20T19:07:47.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.326+0000 7f6fa48aa640 1 Processor -- start 2024-09-20T19:07:47.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.327+0000 7f6fa48aa640 1 -- start start 2024-09-20T19:07:47.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.327+0000 7f6fa48aa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa0102b50 0x7f6fa019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:47.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.327+0000 7f6fa48aa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa0103470 0x7f6fa019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:47.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.327+0000 7f6fa48aa640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa010edc0 con 0x7f6fa0102b50 2024-09-20T19:07:47.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.327+0000 7f6fa48aa640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa010ec40 con 0x7f6fa0103470 2024-09-20T19:07:47.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.327+0000 7f6f9e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa0102b50 0x7f6fa019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:47.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.327+0000 7f6f9e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa0102b50 0x7f6fa019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35970/0 (socket says 172.21.15.17:35970) 2024-09-20T19:07:47.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.327+0000 7f6f9e59c640 1 -- 172.21.15.17:0/1919108514 learned_addr learned my addr 172.21.15.17:0/1919108514 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:07:47.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.327+0000 7f6f9dd9b640 1 --2- 172.21.15.17:0/1919108514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa0103470 0x7f6fa019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:47.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.327+0000 7f6f9e59c640 1 -- 172.21.15.17:0/1919108514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa0103470 msgr2=0x7f6fa019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:47.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.327+0000 7f6f9e59c640 1 --2- 172.21.15.17:0/1919108514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa0103470 0x7f6fa019db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.327+0000 7f6f9e59c640 1 -- 172.21.15.17:0/1919108514 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa01977b0 con 0x7f6fa0102b50 2024-09-20T19:07:47.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.327+0000 7f6f9e59c640 1 --2- 172.21.15.17:0/1919108514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa0102b50 0x7f6fa019d630 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6f9802af20 tx=0x7f6f9802ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:47.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.328+0000 7f6f977fe640 1 -- 172.21.15.17:0/1919108514 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f98047070 con 0x7f6fa0102b50 2024-09-20T19:07:47.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.328+0000 7f6f977fe640 1 -- 172.21.15.17:0/1919108514 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f98003e30 con 0x7f6fa0102b50 2024-09-20T19:07:47.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.328+0000 7f6fa48aa640 1 -- 172.21.15.17:0/1919108514 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa0197a40 con 0x7f6fa0102b50 2024-09-20T19:07:47.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.328+0000 7f6f977fe640 1 -- 172.21.15.17:0/1919108514 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f98033050 con 0x7f6fa0102b50 2024-09-20T19:07:47.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.328+0000 7f6fa48aa640 1 -- 172.21.15.17:0/1919108514 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa0197f70 con 0x7f6fa0102b50 2024-09-20T19:07:47.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.329+0000 7f6fa48aa640 1 -- 172.21.15.17:0/1919108514 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa006a4e0 con 0x7f6fa0102b50 2024-09-20T19:07:47.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.330+0000 7f6f977fe640 1 -- 172.21.15.17:0/1919108514 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6f9804a070 con 0x7f6fa0102b50 2024-09-20T19:07:47.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.330+0000 7f6f977fe640 1 --2- 172.21.15.17:0/1919108514 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6f8c07af80 0x7f6f8c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:47.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.331+0000 7f6f9dd9b640 1 --2- 172.21.15.17:0/1919108514 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6f8c07af80 0x7f6f8c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:47.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.331+0000 7f6f977fe640 1 -- 172.21.15.17:0/1919108514 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f6f9803e030 con 0x7f6fa0102b50 2024-09-20T19:07:47.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.331+0000 7f6f9dd9b640 1 --2- 172.21.15.17:0/1919108514 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6f8c07af80 0x7f6f8c07d440 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6f88005fd0 tx=0x7f6f88005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:47.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.335+0000 7f6f977fe640 1 -- 172.21.15.17:0/1919108514 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f9808a770 con 0x7f6fa0102b50 2024-09-20T19:07:47.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.543+0000 7f6fa48aa640 1 -- 172.21.15.17:0/1919108514 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6fa0198220 con 0x7f6f8c07af80 2024-09-20T19:07:47.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.544+0000 7f6f977fe640 1 -- 172.21.15.17:0/1919108514 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6fa0198220 con 0x7f6f8c07af80 2024-09-20T19:07:47.549 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:07:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:07:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:07:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:07:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:07:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:07:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:07:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:07:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:07:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:07:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:07:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:07:47.549 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:07:47.550 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:07:47.550 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:07:47.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.546+0000 7f6fa48aa640 1 -- 172.21.15.17:0/1919108514 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6f8c07af80 msgr2=0x7f6f8c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:47.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.546+0000 7f6fa48aa640 1 --2- 172.21.15.17:0/1919108514 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6f8c07af80 0x7f6f8c07d440 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6f88005fd0 tx=0x7f6f88005850 comp rx=0 tx=0).stop 2024-09-20T19:07:47.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.546+0000 7f6fa48aa640 1 -- 172.21.15.17:0/1919108514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa0102b50 msgr2=0x7f6fa019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:47.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.546+0000 7f6fa48aa640 1 --2- 172.21.15.17:0/1919108514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa0102b50 0x7f6fa019d630 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6f9802af20 tx=0x7f6f9802ee50 comp rx=0 tx=0).stop 2024-09-20T19:07:47.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.546+0000 7f6fa48aa640 1 -- 172.21.15.17:0/1919108514 shutdown_connections 2024-09-20T19:07:47.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.546+0000 7f6fa48aa640 1 --2- 172.21.15.17:0/1919108514 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6f8c07af80 0x7f6f8c07d440 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.546+0000 7f6fa48aa640 1 --2- 172.21.15.17:0/1919108514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa0103470 0x7f6fa019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.546+0000 7f6fa48aa640 1 --2- 172.21.15.17:0/1919108514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa0102b50 0x7f6fa019d630 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.546+0000 7f6fa48aa640 1 -- 172.21.15.17:0/1919108514 >> 172.21.15.17:0/1919108514 conn(0x7f6fa00fc550 msgr2=0x7f6fa0108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:47.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.546+0000 7f6fa48aa640 1 -- 172.21.15.17:0/1919108514 shutdown_connections 2024-09-20T19:07:47.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.546+0000 7f6fa48aa640 1 -- 172.21.15.17:0/1919108514 wait complete. 2024-09-20T19:07:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.630+0000 7f617c81a640 1 -- 172.21.15.17:0/605848088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6178100800 msgr2=0x7f6178100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.630+0000 7f617c81a640 1 --2- 172.21.15.17:0/605848088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6178100800 0x7f6178100c60 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6160009880 tx=0x7f616002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.630+0000 7f617c81a640 1 -- 172.21.15.17:0/605848088 shutdown_connections 2024-09-20T19:07:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.630+0000 7f617c81a640 1 --2- 172.21.15.17:0/605848088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6178100800 0x7f6178100c60 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.630+0000 7f617c81a640 1 --2- 172.21.15.17:0/605848088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6178106800 0x7f6178106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.630+0000 7f617c81a640 1 -- 172.21.15.17:0/605848088 >> 172.21.15.17:0/605848088 conn(0x7f61780fc520 msgr2=0x7f61780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.630+0000 7f617c81a640 1 -- 172.21.15.17:0/605848088 shutdown_connections 2024-09-20T19:07:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.630+0000 7f617c81a640 1 -- 172.21.15.17:0/605848088 wait complete. 2024-09-20T19:07:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.631+0000 7f617c81a640 1 Processor -- start 2024-09-20T19:07:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.631+0000 7f617c81a640 1 -- start start 2024-09-20T19:07:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.631+0000 7f617c81a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6178100800 0x7f61780fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.631+0000 7f617c81a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6178106800 0x7f61780fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.631+0000 7f617c81a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f617810dcb0 con 0x7f6178100800 2024-09-20T19:07:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.631+0000 7f617c81a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f617810db30 con 0x7f6178106800 2024-09-20T19:07:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.631+0000 7f617659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6178100800 0x7f61780fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.631+0000 7f617659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6178100800 0x7f61780fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35986/0 (socket says 172.21.15.17:35986) 2024-09-20T19:07:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.631+0000 7f617659c640 1 -- 172.21.15.17:0/383178992 learned_addr learned my addr 172.21.15.17:0/383178992 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:07:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.632+0000 7f616ffff640 1 --2- 172.21.15.17:0/383178992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6178106800 0x7f61780fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:47.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.632+0000 7f617659c640 1 -- 172.21.15.17:0/383178992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6178106800 msgr2=0x7f61780fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:47.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.632+0000 7f617659c640 1 --2- 172.21.15.17:0/383178992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6178106800 0x7f61780fd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.632+0000 7f617659c640 1 -- 172.21.15.17:0/383178992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61780fd650 con 0x7f6178100800 2024-09-20T19:07:47.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.632+0000 7f617659c640 1 --2- 172.21.15.17:0/383178992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6178100800 0x7f61780fcbd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f616800d8d0 tx=0x7f616800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:47.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.632+0000 7f616f7fe640 1 -- 172.21.15.17:0/383178992 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6168017070 con 0x7f6178100800 2024-09-20T19:07:47.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.632+0000 7f617c81a640 1 -- 172.21.15.17:0/383178992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61780fd940 con 0x7f6178100800 2024-09-20T19:07:47.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.632+0000 7f616f7fe640 1 -- 172.21.15.17:0/383178992 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6168010460 con 0x7f6178100800 2024-09-20T19:07:47.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.632+0000 7f616f7fe640 1 -- 172.21.15.17:0/383178992 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f616800f5f0 con 0x7f6178100800 2024-09-20T19:07:47.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.632+0000 7f617c81a640 1 -- 172.21.15.17:0/383178992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61781a3e70 con 0x7f6178100800 2024-09-20T19:07:47.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.633+0000 7f617c81a640 1 -- 172.21.15.17:0/383178992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6178101f40 con 0x7f6178100800 2024-09-20T19:07:47.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.634+0000 7f616f7fe640 1 -- 172.21.15.17:0/383178992 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6168009a30 con 0x7f6178100800 2024-09-20T19:07:47.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.635+0000 7f616f7fe640 1 --2- 172.21.15.17:0/383178992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f616407af80 0x7f616407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:07:47.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.635+0000 7f616f7fe640 1 -- 172.21.15.17:0/383178992 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f616809de00 con 0x7f6178100800 2024-09-20T19:07:47.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.635+0000 7f616ffff640 1 --2- 172.21.15.17:0/383178992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f616407af80 0x7f616407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:07:47.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.635+0000 7f616ffff640 1 --2- 172.21.15.17:0/383178992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f616407af80 0x7f616407d440 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6160031460 tx=0x7f6160009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:07:47.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.639+0000 7f616f7fe640 1 -- 172.21.15.17:0/383178992 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6168069480 con 0x7f6178100800 2024-09-20T19:07:47.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.901+0000 7f617c81a640 1 -- 172.21.15.17:0/383178992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6178100c60 con 0x7f6178100800 2024-09-20T19:07:47.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.901+0000 7f616f7fe640 1 -- 172.21.15.17:0/383178992 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f616806e330 con 0x7f6178100800 2024-09-20T19:07:47.907 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:07:47.907 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:07:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:07:47.907 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:07:47.907 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:07:47.907 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:07:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:07:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:07:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:07:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:07:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:07:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:07:47.907 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:07:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:07:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:07:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:07:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:07:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:07:47.908 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:07:47.908 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:07:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:07:47.908 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:07:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:07:47.908 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:07:47.908 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:07:47.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.903+0000 7f617c81a640 1 -- 172.21.15.17:0/383178992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f616407af80 msgr2=0x7f616407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:47.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.904+0000 7f617c81a640 1 --2- 172.21.15.17:0/383178992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f616407af80 0x7f616407d440 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6160031460 tx=0x7f6160009560 comp rx=0 tx=0).stop 2024-09-20T19:07:47.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.904+0000 7f617c81a640 1 -- 172.21.15.17:0/383178992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6178100800 msgr2=0x7f61780fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:07:47.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.904+0000 7f617c81a640 1 --2- 172.21.15.17:0/383178992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6178100800 0x7f61780fcbd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f616800d8d0 tx=0x7f616800dd90 comp rx=0 tx=0).stop 2024-09-20T19:07:47.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.904+0000 7f617c81a640 1 -- 172.21.15.17:0/383178992 shutdown_connections 2024-09-20T19:07:47.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.904+0000 7f617c81a640 1 --2- 172.21.15.17:0/383178992 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f616407af80 0x7f616407d440 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.904+0000 7f617c81a640 1 --2- 172.21.15.17:0/383178992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6178106800 0x7f61780fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.904+0000 7f617c81a640 1 --2- 172.21.15.17:0/383178992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6178100800 0x7f61780fcbd0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:07:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.904+0000 7f617c81a640 1 -- 172.21.15.17:0/383178992 >> 172.21.15.17:0/383178992 conn(0x7f61780fc520 msgr2=0x7f617806a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:07:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.904+0000 7f617c81a640 1 -- 172.21.15.17:0/383178992 shutdown_connections 2024-09-20T19:07:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:07:47.904+0000 7f617c81a640 1 -- 172.21.15.17:0/383178992 wait complete. 2024-09-20T19:07:48.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:47 smithi172 ceph-mon[80431]: from='client.35580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:48.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:47 smithi172 ceph-mon[80431]: from='client.35584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:48.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:47 smithi172 ceph-mon[80431]: pgmap v972: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:48.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:47 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/511132303' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:07:48.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:47 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4049510603' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:07:48.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:47 smithi017 ceph-mon[108970]: from='client.35580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:48.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:47 smithi017 ceph-mon[108970]: from='client.35584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:48.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:47 smithi017 ceph-mon[108970]: pgmap v972: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:48.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:47 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/511132303' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:07:48.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:47 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4049510603' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:07:49.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:48 smithi172 ceph-mon[80431]: from='client.35596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:49.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:48 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/383178992' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:07:49.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:48 smithi017 ceph-mon[108970]: from='client.35596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:07:49.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:48 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/383178992' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:07:50.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:49 smithi172 ceph-mon[80431]: pgmap v973: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:50.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:49 smithi017 ceph-mon[108970]: pgmap v973: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:52.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:51 smithi172 ceph-mon[80431]: pgmap v974: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:52.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:51 smithi017 ceph-mon[108970]: pgmap v974: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:53.100 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:07:53.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:07:54.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:53 smithi172 ceph-mon[80431]: pgmap v975: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:54.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:53 smithi017 ceph-mon[108970]: pgmap v975: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:56.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:55 smithi172 ceph-mon[80431]: pgmap v976: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:56.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:55 smithi017 ceph-mon[108970]: pgmap v976: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:58.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:57 smithi172 ceph-mon[80431]: pgmap v977: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:07:58.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:57 smithi017 ceph-mon[108970]: pgmap v977: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:00.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:07:59 smithi172 ceph-mon[80431]: pgmap v978: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:00.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:07:59 smithi017 ceph-mon[108970]: pgmap v978: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:02.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:01 smithi172 ceph-mon[80431]: pgmap v979: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:02.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:01 smithi017 ceph-mon[108970]: pgmap v979: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:04.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:03 smithi172 ceph-mon[80431]: pgmap v980: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:04.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:03 smithi017 ceph-mon[108970]: pgmap v980: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:06.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:05 smithi172 ceph-mon[80431]: pgmap v981: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:06.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:05 smithi017 ceph-mon[108970]: pgmap v981: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:08.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:07 smithi172 ceph-mon[80431]: pgmap v982: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:08.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:08:08.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:07 smithi017 ceph-mon[108970]: pgmap v982: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:08.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:08:10.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:09 smithi172 ceph-mon[80431]: pgmap v983: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:10.273 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:09 smithi017 ceph-mon[108970]: pgmap v983: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:12.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:11 smithi172 ceph-mon[80431]: pgmap v984: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:12.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:11 smithi017 ceph-mon[108970]: pgmap v984: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:14.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:13 smithi172 ceph-mon[80431]: pgmap v985: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:14.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:13 smithi017 ceph-mon[108970]: pgmap v985: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:16.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:15 smithi017 ceph-mon[108970]: pgmap v986: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:16.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:15 smithi172 ceph-mon[80431]: pgmap v986: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:18.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.003+0000 7fed30eed640 1 -- 172.21.15.17:0/721403503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed2c102b20 msgr2=0x7fed2c102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:18.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.003+0000 7fed30eed640 1 --2- 172.21.15.17:0/721403503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed2c102b20 0x7fed2c102f00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0098b0 tx=0x7fed1c02a560 comp rx=0 tx=0).stop 2024-09-20T19:08:18.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.003+0000 7fed30eed640 1 -- 172.21.15.17:0/721403503 shutdown_connections 2024-09-20T19:08:18.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.003+0000 7fed30eed640 1 --2- 172.21.15.17:0/721403503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed2c103440 0x7fed2c10b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:18.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.003+0000 7fed30eed640 1 --2- 172.21.15.17:0/721403503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed2c102b20 0x7fed2c102f00 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:18.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.003+0000 7fed30eed640 1 -- 172.21.15.17:0/721403503 >> 172.21.15.17:0/721403503 conn(0x7fed2c0fc520 msgr2=0x7fed2c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:18.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.003+0000 7fed30eed640 1 -- 172.21.15.17:0/721403503 shutdown_connections 2024-09-20T19:08:18.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.003+0000 7fed30eed640 1 -- 172.21.15.17:0/721403503 wait complete. 2024-09-20T19:08:18.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.004+0000 7fed30eed640 1 Processor -- start 2024-09-20T19:08:18.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.004+0000 7fed30eed640 1 -- start start 2024-09-20T19:08:18.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.004+0000 7fed30eed640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed2c102b20 0x7fed2c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:18.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.004+0000 7fed30eed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed2c103440 0x7fed2c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:18.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.004+0000 7fed30eed640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c10edd0 con 0x7fed2c103440 2024-09-20T19:08:18.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.004+0000 7fed30eed640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c10ec50 con 0x7fed2c102b20 2024-09-20T19:08:18.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.004+0000 7fed2a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed2c102b20 0x7fed2c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:18.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.004+0000 7fed2a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed2c102b20 0x7fed2c19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.17:42990/0 (socket says 172.21.15.17:42990) 2024-09-20T19:08:18.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.004+0000 7fed23fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed2c103440 0x7fed2c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:18.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.004+0000 7fed2a59c640 1 -- 172.21.15.17:0/2206976170 learned_addr learned my addr 172.21.15.17:0/2206976170 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:08:18.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.004+0000 7fed23fff640 1 -- 172.21.15.17:0/2206976170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed2c102b20 msgr2=0x7fed2c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:18.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.004+0000 7fed23fff640 1 --2- 172.21.15.17:0/2206976170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed2c102b20 0x7fed2c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:18.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.004+0000 7fed23fff640 1 -- 172.21.15.17:0/2206976170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2c197800 con 0x7fed2c103440 2024-09-20T19:08:18.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.004+0000 7fed2a59c640 1 --2- 172.21.15.17:0/2206976170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed2c102b20 0x7fed2c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T19:08:18.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.005+0000 7fed23fff640 1 --2- 172.21.15.17:0/2206976170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed2c103440 0x7fed2c19dbc0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fed14005fd0 tx=0x7fed1400dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:18.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.005+0000 7fed237fe640 1 -- 172.21.15.17:0/2206976170 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed1400be30 con 0x7fed2c103440 2024-09-20T19:08:18.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.005+0000 7fed237fe640 1 -- 172.21.15.17:0/2206976170 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed14004030 con 0x7fed2c103440 2024-09-20T19:08:18.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.005+0000 7fed30eed640 1 -- 172.21.15.17:0/2206976170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2c197af0 con 0x7fed2c103440 2024-09-20T19:08:18.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.005+0000 7fed237fe640 1 -- 172.21.15.17:0/2206976170 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed14003cd0 con 0x7fed2c103440 2024-09-20T19:08:18.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.005+0000 7fed30eed640 1 -- 172.21.15.17:0/2206976170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed2c198080 con 0x7fed2c103440 2024-09-20T19:08:18.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.006+0000 7fed30eed640 1 -- 172.21.15.17:0/2206976170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed2c06aa30 con 0x7fed2c103440 2024-09-20T19:08:18.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.007+0000 7fed237fe640 1 -- 172.21.15.17:0/2206976170 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fed140041e0 con 0x7fed2c103440 2024-09-20T19:08:18.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.007+0000 7fed237fe640 1 --2- 172.21.15.17:0/2206976170 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed1807af40 0x7fed1807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:18.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.008+0000 7fed237fe640 1 -- 172.21.15.17:0/2206976170 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fed1409d910 con 0x7fed2c103440 2024-09-20T19:08:18.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.008+0000 7fed2a59c640 1 --2- 172.21.15.17:0/2206976170 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed1807af40 0x7fed1807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:18.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.008+0000 7fed2a59c640 1 --2- 172.21.15.17:0/2206976170 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed1807af40 0x7fed1807d400 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0096c0 tx=0x7fed1c031420 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:18.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.012+0000 7fed237fe640 1 -- 172.21.15.17:0/2206976170 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fed14017020 con 0x7fed2c103440 2024-09-20T19:08:18.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.217+0000 7fed30eed640 1 -- 172.21.15.17:0/2206976170 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fed2c198330 con 0x7fed1807af40 2024-09-20T19:08:18.221 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:17 smithi017 ceph-mon[108970]: pgmap v987: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:18.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.219+0000 7fed237fe640 1 -- 172.21.15.17:0/2206976170 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fed2c198330 con 0x7fed1807af40 2024-09-20T19:08:18.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.221+0000 7fed30eed640 1 -- 172.21.15.17:0/2206976170 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed1807af40 msgr2=0x7fed1807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:18.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.221+0000 7fed30eed640 1 --2- 172.21.15.17:0/2206976170 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed1807af40 0x7fed1807d400 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0096c0 tx=0x7fed1c031420 comp rx=0 tx=0).stop 2024-09-20T19:08:18.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.221+0000 7fed30eed640 1 -- 172.21.15.17:0/2206976170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed2c103440 msgr2=0x7fed2c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:18.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.221+0000 7fed30eed640 1 --2- 172.21.15.17:0/2206976170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed2c103440 0x7fed2c19dbc0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fed14005fd0 tx=0x7fed1400dd60 comp rx=0 tx=0).stop 2024-09-20T19:08:18.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.221+0000 7fed30eed640 1 -- 172.21.15.17:0/2206976170 shutdown_connections 2024-09-20T19:08:18.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.221+0000 7fed30eed640 1 --2- 172.21.15.17:0/2206976170 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed1807af40 0x7fed1807d400 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:18.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.221+0000 7fed30eed640 1 --2- 172.21.15.17:0/2206976170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed2c103440 0x7fed2c19dbc0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:18.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.221+0000 7fed30eed640 1 --2- 172.21.15.17:0/2206976170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed2c102b20 0x7fed2c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:18.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.221+0000 7fed30eed640 1 -- 172.21.15.17:0/2206976170 >> 172.21.15.17:0/2206976170 conn(0x7fed2c0fc520 msgr2=0x7fed2c103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:18.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.221+0000 7fed30eed640 1 -- 172.21.15.17:0/2206976170 shutdown_connections 2024-09-20T19:08:18.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.221+0000 7fed30eed640 1 -- 172.21.15.17:0/2206976170 wait complete. 2024-09-20T19:08:18.233 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:08:18.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.306+0000 7f93eb670640 1 -- 172.21.15.17:0/3939782659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4101900 msgr2=0x7f93e4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:18.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.306+0000 7f93eb670640 1 --2- 172.21.15.17:0/3939782659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4101900 0x7f93e4101d60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009880 tx=0x7f93d402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:08:18.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.306+0000 7f93eb670640 1 -- 172.21.15.17:0/3939782659 shutdown_connections 2024-09-20T19:08:18.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.306+0000 7f93eb670640 1 --2- 172.21.15.17:0/3939782659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4101900 0x7f93e4101d60 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:18.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.306+0000 7f93eb670640 1 --2- 172.21.15.17:0/3939782659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93e4107900 0x7f93e4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:18.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.306+0000 7f93eb670640 1 -- 172.21.15.17:0/3939782659 >> 172.21.15.17:0/3939782659 conn(0x7f93e40fd600 msgr2=0x7f93e40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:18.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.307+0000 7f93eb670640 1 -- 172.21.15.17:0/3939782659 shutdown_connections 2024-09-20T19:08:18.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.307+0000 7f93eb670640 1 -- 172.21.15.17:0/3939782659 wait complete. 2024-09-20T19:08:18.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.307+0000 7f93eb670640 1 Processor -- start 2024-09-20T19:08:18.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.307+0000 7f93eb670640 1 -- start start 2024-09-20T19:08:18.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.307+0000 7f93eb670640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93e4101900 0x7f93e40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:18.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.307+0000 7f93eb670640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4107900 0x7f93e4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:18.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.307+0000 7f93eb670640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f93e410edb0 con 0x7f93e4107900 2024-09-20T19:08:18.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.307+0000 7f93eb670640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93e410ec30 con 0x7f93e4101900 2024-09-20T19:08:18.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.308+0000 7f93e8c0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4107900 0x7f93e4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:18.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.308+0000 7f93e8c0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4107900 0x7f93e4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35152/0 (socket says 172.21.15.17:35152) 2024-09-20T19:08:18.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.308+0000 7f93e8c0b640 1 -- 172.21.15.17:0/354944176 learned_addr learned my addr 172.21.15.17:0/354944176 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:08:18.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.308+0000 7f93e940c640 1 --2- 172.21.15.17:0/354944176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93e4101900 0x7f93e40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:18.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.308+0000 7f93e8c0b640 1 -- 172.21.15.17:0/354944176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93e4101900 msgr2=0x7f93e40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:18.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.308+0000 7f93e8c0b640 1 --2- 172.21.15.17:0/354944176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93e4101900 0x7f93e40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:18.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.308+0000 7f93e8c0b640 1 -- 172.21.15.17:0/354944176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e4074f70 con 0x7f93e4107900 2024-09-20T19:08:18.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.308+0000 7f93e8c0b640 1 --2- 172.21.15.17:0/354944176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4107900 0x7f93e4074a30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f93d4031460 tx=0x7f93d40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:18.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.308+0000 7f93da7fc640 1 -- 172.21.15.17:0/354944176 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93d403f070 con 0x7f93e4107900 2024-09-20T19:08:18.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.308+0000 7f93da7fc640 1 -- 172.21.15.17:0/354944176 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f93d4004cf0 con 0x7f93e4107900 2024-09-20T19:08:18.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.308+0000 7f93eb670640 1 -- 172.21.15.17:0/354944176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e4075200 con 0x7f93e4107900 2024-09-20T19:08:18.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.308+0000 7f93da7fc640 1 -- 172.21.15.17:0/354944176 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93d4035030 con 0x7f93e4107900 2024-09-20T19:08:18.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.308+0000 7f93eb670640 1 -- 172.21.15.17:0/354944176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e41a3d20 con 0x7f93e4107900 2024-09-20T19:08:18.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.309+0000 7f93eb670640 1 -- 172.21.15.17:0/354944176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93e4103040 con 0x7f93e4107900 2024-09-20T19:08:18.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.310+0000 7f93da7fc640 1 -- 172.21.15.17:0/354944176 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f93d4042070 con 0x7f93e4107900 2024-09-20T19:08:18.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.311+0000 7f93da7fc640 1 --2- 172.21.15.17:0/354944176 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93d007af30 0x7f93d007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:18.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.311+0000 7f93e940c640 1 --2- 172.21.15.17:0/354944176 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93d007af30 0x7f93d007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:18.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.311+0000 7f93da7fc640 1 -- 172.21.15.17:0/354944176 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f93d40be9e0 con 0x7f93e4107900 2024-09-20T19:08:18.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.311+0000 7f93e940c640 1 --2- 172.21.15.17:0/354944176 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93d007af30 0x7f93d007d3f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f93e000abe0 tx=0x7f93e000a2d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:18.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.315+0000 7f93da7fc640 1 -- 172.21.15.17:0/354944176 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f93d4089fe0 con 0x7f93e4107900 2024-09-20T19:08:18.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:17 smithi172 ceph-mon[80431]: pgmap v987: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:18.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.521+0000 7f93eb670640 1 -- 172.21.15.17:0/354944176 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f93e4062630 con 0x7f93d007af30 2024-09-20T19:08:18.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.522+0000 7f93da7fc640 1 -- 172.21.15.17:0/354944176 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f93e4062630 con 0x7f93d007af30 2024-09-20T19:08:18.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.524+0000 7f93eb670640 1 -- 172.21.15.17:0/354944176 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93d007af30 msgr2=0x7f93d007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:18.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.524+0000 7f93eb670640 1 --2- 172.21.15.17:0/354944176 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93d007af30 0x7f93d007d3f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f93e000abe0 tx=0x7f93e000a2d0 comp rx=0 tx=0).stop 2024-09-20T19:08:18.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.524+0000 7f93eb670640 1 -- 172.21.15.17:0/354944176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4107900 msgr2=0x7f93e4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:18.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.524+0000 7f93eb670640 1 --2- 172.21.15.17:0/354944176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4107900 0x7f93e4074a30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f93d4031460 tx=0x7f93d40048f0 comp rx=0 tx=0).stop 2024-09-20T19:08:18.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.524+0000 7f93eb670640 1 -- 172.21.15.17:0/354944176 shutdown_connections 2024-09-20T19:08:18.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.524+0000 7f93eb670640 1 --2- 172.21.15.17:0/354944176 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f93d007af30 0x7f93d007d3f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:18.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.524+0000 7f93eb670640 1 --2- 172.21.15.17:0/354944176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e4107900 0x7f93e4074a30 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:18.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.524+0000 7f93eb670640 1 --2- 172.21.15.17:0/354944176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93e4101900 0x7f93e40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:18.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.524+0000 7f93eb670640 1 -- 172.21.15.17:0/354944176 >> 172.21.15.17:0/354944176 conn(0x7f93e40fd600 msgr2=0x7f93e40fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:18.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.524+0000 7f93eb670640 1 -- 172.21.15.17:0/354944176 shutdown_connections 2024-09-20T19:08:18.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.524+0000 7f93eb670640 1 -- 172.21.15.17:0/354944176 wait complete. 2024-09-20T19:08:18.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.608+0000 7fe6d85ad640 1 -- 172.21.15.17:0/732984129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d0100800 msgr2=0x7fe6d0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.608+0000 7fe6d85ad640 1 --2- 172.21.15.17:0/732984129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d0100800 0x7fe6d0100c60 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009880 tx=0x7fe6c002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.608+0000 7fe6d85ad640 1 -- 172.21.15.17:0/732984129 shutdown_connections 2024-09-20T19:08:19.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.608+0000 7fe6d85ad640 1 --2- 172.21.15.17:0/732984129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d0100800 0x7fe6d0100c60 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.608+0000 7fe6d85ad640 1 --2- 172.21.15.17:0/732984129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6d0106800 0x7fe6d0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.608+0000 7fe6d85ad640 1 -- 172.21.15.17:0/732984129 >> 172.21.15.17:0/732984129 conn(0x7fe6d00fc520 msgr2=0x7fe6d00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:19.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.608+0000 7fe6d85ad640 1 -- 172.21.15.17:0/732984129 shutdown_connections 2024-09-20T19:08:19.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.608+0000 7fe6d85ad640 1 -- 172.21.15.17:0/732984129 wait complete. 2024-09-20T19:08:19.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.609+0000 7fe6d85ad640 1 Processor -- start 2024-09-20T19:08:19.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.609+0000 7fe6d85ad640 1 -- start start 2024-09-20T19:08:19.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.609+0000 7fe6d85ad640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6d0100800 0x7fe6d019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:19.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.609+0000 7fe6d85ad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d0106800 0x7fe6d019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:19.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.609+0000 7fe6d85ad640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d010dcb0 con 0x7fe6d0106800 2024-09-20T19:08:19.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.609+0000 7fe6d85ad640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d010db30 con 0x7fe6d0100800 2024-09-20T19:08:19.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.609+0000 7fe6d5b48640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d0106800 0x7fe6d019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:19.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.609+0000 7fe6d5b48640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d0106800 0x7fe6d019dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35178/0 (socket says 172.21.15.17:35178) 2024-09-20T19:08:19.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.609+0000 7fe6d5b48640 1 -- 172.21.15.17:0/3056425141 learned_addr learned my addr 172.21.15.17:0/3056425141 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:08:19.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.609+0000 7fe6d6349640 1 --2- 172.21.15.17:0/3056425141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6d0100800 0x7fe6d019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:19.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.609+0000 7fe6d5b48640 1 -- 172.21.15.17:0/3056425141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6d0100800 msgr2=0x7fe6d019d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.609+0000 7fe6d5b48640 1 --2- 172.21.15.17:0/3056425141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6d0100800 0x7fe6d019d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.609+0000 7fe6d5b48640 1 -- 172.21.15.17:0/3056425141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d01977f0 con 0x7fe6d0106800 2024-09-20T19:08:19.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.609+0000 7fe6d6349640 1 --2- 172.21.15.17:0/3056425141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6d0100800 0x7fe6d019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:08:19.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.610+0000 7fe6d5b48640 1 --2- 172.21.15.17:0/3056425141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d0106800 0x7fe6d019dbb0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0031460 tx=0x7fe6c00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:19.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.610+0000 7fe6c77fe640 1 -- 172.21.15.17:0/3056425141 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe6c003f070 con 0x7fe6d0106800 2024-09-20T19:08:19.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.610+0000 7fe6c77fe640 1 -- 172.21.15.17:0/3056425141 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe6c00035f0 con 0x7fe6d0106800 2024-09-20T19:08:19.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.610+0000 7fe6d85ad640 1 -- 172.21.15.17:0/3056425141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d0197a80 con 0x7fe6d0106800 2024-09-20T19:08:19.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.610+0000 7fe6c77fe640 1 -- 172.21.15.17:0/3056425141 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe6c0035030 con 0x7fe6d0106800 2024-09-20T19:08:19.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.610+0000 7fe6d85ad640 1 -- 172.21.15.17:0/3056425141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d0197fb0 con 0x7fe6d0106800 2024-09-20T19:08:19.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.611+0000 7fe6d85ad640 1 -- 172.21.15.17:0/3056425141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d0101f40 con 0x7fe6d0106800 2024-09-20T19:08:19.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.612+0000 7fe6c77fe640 1 -- 172.21.15.17:0/3056425141 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe6c0042070 con 0x7fe6d0106800 2024-09-20T19:08:19.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.612+0000 7fe6c77fe640 1 --2- 172.21.15.17:0/3056425141 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe6bc07af80 0x7fe6bc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:19.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.612+0000 7fe6c77fe640 1 -- 172.21.15.17:0/3056425141 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fe6c00be910 con 0x7fe6d0106800 2024-09-20T19:08:19.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.612+0000 7fe6d6349640 1 --2- 172.21.15.17:0/3056425141 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe6bc07af80 0x7fe6bc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:19.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.613+0000 7fe6d6349640 1 --2- 172.21.15.17:0/3056425141 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe6bc07af80 0x7fe6bc07d440 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc005fd0 tx=0x7fe6cc00b5f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:19.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.616+0000 7fe6c77fe640 1 -- 172.21.15.17:0/3056425141 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe6c0089f90 con 0x7fe6d0106800 2024-09-20T19:08:19.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.813+0000 7fe6d85ad640 1 -- 172.21.15.17:0/3056425141 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe6d0198260 con 0x7fe6bc07af80 2024-09-20T19:08:19.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.823+0000 7fe6c77fe640 1 -- 172.21.15.17:0/3056425141 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fe6d0198260 con 0x7fe6bc07af80 2024-09-20T19:08:19.091 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:08:19.091 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (29m) 8m ago 40m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:08:19.091 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (32m) 8m ago 40m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:08:19.091 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (32m) 8m ago 40m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:08:19.091 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (28m) 8m ago 40m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:08:19.091 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (27m) 8m ago 39m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:08:19.092 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (29m) 8m ago 40m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:08:19.092 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (24m) 8m ago 35m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:08:19.092 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (23m) 8m ago 35m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:08:19.092 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (8m) 8m ago 35m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:08:19.092 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (23m) 8m ago 35m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:08:19.092 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (31m) 8m ago 41m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:08:19.092 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (30m) 8m ago 39m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:08:19.092 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (28m) 8m ago 42m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:08:19.092 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (28m) 8m ago 39m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:08:19.092 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (30m) 8m ago 40m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:08:19.092 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (30m) 8m ago 39m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:08:19.092 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (27m) 8m ago 38m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:08:19.092 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (26m) 8m ago 38m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:08:19.093 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (26m) 8m ago 37m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:08:19.093 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (25m) 8m ago 37m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:08:19.093 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (25m) 8m ago 36m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:08:19.093 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (24m) 8m ago 36m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:08:19.093 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (29m) 8m ago 40m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:08:19.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.826+0000 7fe6d85ad640 1 -- 172.21.15.17:0/3056425141 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe6bc07af80 msgr2=0x7fe6bc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.826+0000 7fe6d85ad640 1 --2- 172.21.15.17:0/3056425141 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe6bc07af80 0x7fe6bc07d440 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc005fd0 tx=0x7fe6cc00b5f0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.826+0000 7fe6d85ad640 1 -- 172.21.15.17:0/3056425141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d0106800 msgr2=0x7fe6d019dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.826+0000 7fe6d85ad640 1 --2- 172.21.15.17:0/3056425141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d0106800 0x7fe6d019dbb0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0031460 tx=0x7fe6c00045e0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.826+0000 7fe6d85ad640 1 -- 172.21.15.17:0/3056425141 shutdown_connections 2024-09-20T19:08:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.826+0000 7fe6d85ad640 1 --2- 172.21.15.17:0/3056425141 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe6bc07af80 0x7fe6bc07d440 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.826+0000 7fe6d85ad640 1 --2- 172.21.15.17:0/3056425141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d0106800 0x7fe6d019dbb0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.826+0000 7fe6d85ad640 1 --2- 172.21.15.17:0/3056425141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6d0100800 0x7fe6d019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.826+0000 7fe6d85ad640 1 -- 172.21.15.17:0/3056425141 >> 172.21.15.17:0/3056425141 conn(0x7fe6d00fc520 msgr2=0x7fe6d006a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.826+0000 7fe6d85ad640 1 -- 172.21.15.17:0/3056425141 shutdown_connections 2024-09-20T19:08:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.826+0000 7fe6d85ad640 1 -- 172.21.15.17:0/3056425141 wait complete. 2024-09-20T19:08:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.909+0000 7fd4e49bb640 1 -- 172.21.15.17:0/2263818338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e01033e0 msgr2=0x7fd4e010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.909+0000 7fd4e49bb640 1 --2- 172.21.15.17:0/2263818338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e01033e0 0x7fd4e010b8d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009880 tx=0x7fd4d402a530 comp rx=0 tx=0).stop 2024-09-20T19:08:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.909+0000 7fd4e49bb640 1 -- 172.21.15.17:0/2263818338 shutdown_connections 2024-09-20T19:08:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.909+0000 7fd4e49bb640 1 --2- 172.21.15.17:0/2263818338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e01033e0 0x7fd4e010b8d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.909+0000 7fd4e49bb640 1 --2- 172.21.15.17:0/2263818338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4e0102ac0 0x7fd4e0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.909+0000 7fd4e49bb640 1 -- 172.21.15.17:0/2263818338 >> 172.21.15.17:0/2263818338 conn(0x7fd4e00fc520 msgr2=0x7fd4e00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.909+0000 7fd4e49bb640 1 -- 172.21.15.17:0/2263818338 shutdown_connections 2024-09-20T19:08:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.909+0000 7fd4e49bb640 1 -- 172.21.15.17:0/2263818338 wait complete. 2024-09-20T19:08:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.910+0000 7fd4e49bb640 1 Processor -- start 2024-09-20T19:08:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.910+0000 7fd4e49bb640 1 -- start start 2024-09-20T19:08:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.910+0000 7fd4e49bb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e0102ac0 0x7fd4e019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.910+0000 7fd4e49bb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4e01033e0 0x7fd4e019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.910+0000 7fd4e49bb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e010ee50 con 0x7fd4e0102ac0 2024-09-20T19:08:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.910+0000 7fd4e49bb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e010ecd0 con 0x7fd4e01033e0 2024-09-20T19:08:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.910+0000 7fd4de59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e0102ac0 0x7fd4e019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.910+0000 7fd4de59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e0102ac0 0x7fd4e019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35200/0 (socket says 172.21.15.17:35200) 2024-09-20T19:08:19.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.910+0000 7fd4de59c640 1 -- 172.21.15.17:0/3742344428 learned_addr learned my addr 172.21.15.17:0/3742344428 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:08:19.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.910+0000 7fd4ddd9b640 1 --2- 172.21.15.17:0/3742344428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4e01033e0 0x7fd4e019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:19.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.910+0000 7fd4de59c640 1 -- 172.21.15.17:0/3742344428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4e01033e0 msgr2=0x7fd4e019dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.910+0000 7fd4de59c640 1 --2- 172.21.15.17:0/3742344428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4e01033e0 0x7fd4e019dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.911+0000 7fd4de59c640 1 -- 172.21.15.17:0/3742344428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e0197860 con 0x7fd4e0102ac0 2024-09-20T19:08:19.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.911+0000 7fd4de59c640 1 --2- 172.21.15.17:0/3742344428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e0102ac0 0x7fd4e019d6a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000b420 tx=0x7fd4d000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:19.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.911+0000 7fd4cf7fe640 1 -- 172.21.15.17:0/3742344428 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd4d0011630 con 0x7fd4e0102ac0 2024-09-20T19:08:19.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.911+0000 7fd4cf7fe640 1 -- 172.21.15.17:0/3742344428 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd4d0016070 con 0x7fd4e0102ac0 2024-09-20T19:08:19.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.911+0000 7fd4cf7fe640 1 -- 172.21.15.17:0/3742344428 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd4d0010d40 con 0x7fd4e0102ac0 2024-09-20T19:08:19.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.911+0000 7fd4e49bb640 1 -- 172.21.15.17:0/3742344428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e0197b50 con 0x7fd4e0102ac0 2024-09-20T19:08:19.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.911+0000 7fd4e49bb640 1 -- 172.21.15.17:0/3742344428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e01980b0 con 0x7fd4e0102ac0 2024-09-20T19:08:19.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.912+0000 7fd4e49bb640 1 -- 172.21.15.17:0/3742344428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e006aa90 con 0x7fd4e0102ac0 2024-09-20T19:08:19.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.913+0000 7fd4cf7fe640 1 -- 172.21.15.17:0/3742344428 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd4d001b460 con 0x7fd4e0102ac0 2024-09-20T19:08:19.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.913+0000 7fd4cf7fe640 1 --2- 172.21.15.17:0/3742344428 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd4c807af30 0x7fd4c807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:19.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.913+0000 7fd4cf7fe640 1 -- 172.21.15.17:0/3742344428 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fd4d009d7e0 con 0x7fd4e0102ac0 2024-09-20T19:08:19.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.913+0000 7fd4ddd9b640 1 --2- 172.21.15.17:0/3742344428 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd4c807af30 0x7fd4c807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:19.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.914+0000 7fd4ddd9b640 1 --2- 172.21.15.17:0/3742344428 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd4c807af30 0x7fd4c807d3f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0199050 tx=0x7fd4d4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:19.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:18.918+0000 7fd4cf7fe640 1 -- 172.21.15.17:0/3742344428 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4d0021250 con 0x7fd4e0102ac0 2024-09-20T19:08:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.181+0000 7fd4e49bb640 1 -- 172.21.15.17:0/3742344428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd4e0198d90 con 0x7fd4e0102ac0 2024-09-20T19:08:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.182+0000 7fd4cf7fe640 1 -- 172.21.15.17:0/3742344428 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fd4d0068d40 con 0x7fd4e0102ac0 2024-09-20T19:08:19.185 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:08:19.185 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:08:19.186 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:08:19.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:08:19.186 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:08:19.186 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:08:19.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:08:19.186 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:08:19.186 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:08:19.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:08:19.186 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:08:19.186 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:08:19.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:08:19.186 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:08:19.186 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:08:19.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:08:19.187 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:08:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.184+0000 7fd4e49bb640 1 -- 172.21.15.17:0/3742344428 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd4c807af30 msgr2=0x7fd4c807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.184+0000 7fd4e49bb640 1 --2- 172.21.15.17:0/3742344428 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd4c807af30 0x7fd4c807d3f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0199050 tx=0x7fd4d4031400 comp rx=0 tx=0).stop 2024-09-20T19:08:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.184+0000 7fd4e49bb640 1 -- 172.21.15.17:0/3742344428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e0102ac0 msgr2=0x7fd4e019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.184+0000 7fd4e49bb640 1 --2- 172.21.15.17:0/3742344428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e0102ac0 0x7fd4e019d6a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000b420 tx=0x7fd4d000b8e0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.184+0000 7fd4e49bb640 1 -- 172.21.15.17:0/3742344428 shutdown_connections 2024-09-20T19:08:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.184+0000 7fd4e49bb640 1 --2- 172.21.15.17:0/3742344428 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd4c807af30 0x7fd4c807d3f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.184+0000 7fd4e49bb640 1 --2- 172.21.15.17:0/3742344428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4e01033e0 0x7fd4e019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.184+0000 7fd4e49bb640 1 --2- 172.21.15.17:0/3742344428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e0102ac0 0x7fd4e019d6a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.184+0000 7fd4e49bb640 1 -- 172.21.15.17:0/3742344428 >> 172.21.15.17:0/3742344428 conn(0x7fd4e00fc520 msgr2=0x7fd4e0108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.184+0000 7fd4e49bb640 1 -- 172.21.15.17:0/3742344428 shutdown_connections 2024-09-20T19:08:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.184+0000 7fd4e49bb640 1 -- 172.21.15.17:0/3742344428 wait complete. 2024-09-20T19:08:19.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.268+0000 7fe191594640 1 -- 172.21.15.17:0/2661549798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c1033e0 msgr2=0x7fe18c10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.268+0000 7fe191594640 1 --2- 172.21.15.17:0/2661549798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c1033e0 0x7fe18c10b8d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe180009880 tx=0x7fe18002a530 comp rx=0 tx=0).stop 2024-09-20T19:08:19.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.268+0000 7fe191594640 1 -- 172.21.15.17:0/2661549798 shutdown_connections 2024-09-20T19:08:19.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.268+0000 7fe191594640 1 --2- 172.21.15.17:0/2661549798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c1033e0 0x7fe18c10b8d0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.268+0000 7fe191594640 1 --2- 172.21.15.17:0/2661549798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe18c102ac0 0x7fe18c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.268+0000 7fe191594640 1 -- 172.21.15.17:0/2661549798 >> 172.21.15.17:0/2661549798 conn(0x7fe18c0fc520 msgr2=0x7fe18c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:19.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.268+0000 7fe191594640 1 -- 172.21.15.17:0/2661549798 shutdown_connections 2024-09-20T19:08:19.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.268+0000 7fe191594640 1 -- 172.21.15.17:0/2661549798 wait complete. 2024-09-20T19:08:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.269+0000 7fe191594640 1 Processor -- start 2024-09-20T19:08:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.269+0000 7fe191594640 1 -- start start 2024-09-20T19:08:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.269+0000 7fe191594640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c102ac0 0x7fe18c100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.269+0000 7fe191594640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe18c1033e0 0x7fe18c100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.269+0000 7fe191594640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c10ee50 con 0x7fe18c102ac0 2024-09-20T19:08:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.269+0000 7fe191594640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c10ecd0 con 0x7fe18c1033e0 2024-09-20T19:08:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.270+0000 7fe18affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c102ac0 0x7fe18c100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.270+0000 7fe18affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c102ac0 0x7fe18c100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35218/0 (socket says 172.21.15.17:35218) 2024-09-20T19:08:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.270+0000 7fe18affd640 1 -- 172.21.15.17:0/214452831 learned_addr learned my addr 172.21.15.17:0/214452831 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:08:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.270+0000 7fe18affd640 1 -- 172.21.15.17:0/214452831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe18c1033e0 msgr2=0x7fe18c100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.270+0000 7fe18a7fc640 1 --2- 172.21.15.17:0/214452831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe18c1033e0 0x7fe18c100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.270+0000 7fe18affd640 1 --2- 172.21.15.17:0/214452831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe18c1033e0 0x7fe18c100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.270+0000 7fe18affd640 1 -- 172.21.15.17:0/214452831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18c1011a0 con 0x7fe18c102ac0 2024-09-20T19:08:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.270+0000 7fe18affd640 1 --2- 172.21.15.17:0/214452831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c102ac0 0x7fe18c100720 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe17c00b420 tx=0x7fe17c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.270+0000 7fe173fff640 1 -- 172.21.15.17:0/214452831 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe17c011630 con 0x7fe18c102ac0 2024-09-20T19:08:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.270+0000 7fe173fff640 1 -- 172.21.15.17:0/214452831 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe17c016070 con 0x7fe18c102ac0 2024-09-20T19:08:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.270+0000 7fe191594640 1 -- 172.21.15.17:0/214452831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18c101490 con 0x7fe18c102ac0 2024-09-20T19:08:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.270+0000 7fe173fff640 1 -- 172.21.15.17:0/214452831 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe17c010d40 con 0x7fe18c102ac0 2024-09-20T19:08:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.270+0000 7fe191594640 1 -- 172.21.15.17:0/214452831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe18c1a3ee0 con 0x7fe18c102ac0 2024-09-20T19:08:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.272+0000 7fe191594640 1 -- 172.21.15.17:0/214452831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe18c06aa90 con 0x7fe18c102ac0 2024-09-20T19:08:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.272+0000 7fe173fff640 1 -- 172.21.15.17:0/214452831 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe17c01b460 con 0x7fe18c102ac0 2024-09-20T19:08:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.273+0000 7fe173fff640 1 --2- 172.21.15.17:0/214452831 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe17407af30 0x7fe17407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.273+0000 7fe173fff640 1 -- 172.21.15.17:0/214452831 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fe17c09d7b0 con 0x7fe18c102ac0 2024-09-20T19:08:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.273+0000 7fe18a7fc640 1 --2- 172.21.15.17:0/214452831 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe17407af30 0x7fe17407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.273+0000 7fe18a7fc640 1 --2- 172.21.15.17:0/214452831 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe17407af30 0x7fe17407d3f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe180031460 tx=0x7fe180009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:19.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.277+0000 7fe173fff640 1 -- 172.21.15.17:0/214452831 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe17c021250 con 0x7fe18c102ac0 2024-09-20T19:08:19.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.508+0000 7fe191594640 1 -- 172.21.15.17:0/214452831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe18c105f60 con 0x7fe18c102ac0 2024-09-20T19:08:19.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.508+0000 7fe173fff640 1 -- 172.21.15.17:0/214452831 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7fe17c068db0 con 0x7fe18c102ac0 2024-09-20T19:08:19.512 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:08:19.512 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:08:19.512 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:08:19.512 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:08:19.512 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:08:19.513 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:08:19.513 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:08:19.513 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:08:19.513 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:08:19.513 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:08:19.513 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:08:19.513 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:08:19.513 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:08:19.513 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:08:19.513 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:08:19.513 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:08:19.513 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:08:19.514 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:08:19.514 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:08:19.514 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:08:19.514 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:08:19.514 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:08:19.514 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:08:19.514 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:08:19.514 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:08:19.514 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:08:19.514 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:08:19.514 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:08:19.514 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:08:19.514 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:08:19.515 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:08:19.515 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:08:19.515 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:08:19.515 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:08:19.515 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:08:19.515 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:08:19.515 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:08:19.515 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:08:19.515 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:08:19.515 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:08:19.515 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:08:19.515 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:08:19.515 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:08:19.516 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:08:19.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.511+0000 7fe191594640 1 -- 172.21.15.17:0/214452831 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe17407af30 msgr2=0x7fe17407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.511+0000 7fe191594640 1 --2- 172.21.15.17:0/214452831 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe17407af30 0x7fe17407d3f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe180031460 tx=0x7fe180009560 comp rx=0 tx=0).stop 2024-09-20T19:08:19.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.511+0000 7fe191594640 1 -- 172.21.15.17:0/214452831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c102ac0 msgr2=0x7fe18c100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.511+0000 7fe191594640 1 --2- 172.21.15.17:0/214452831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c102ac0 0x7fe18c100720 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe17c00b420 tx=0x7fe17c00b8e0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.511+0000 7fe191594640 1 -- 172.21.15.17:0/214452831 shutdown_connections 2024-09-20T19:08:19.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.511+0000 7fe191594640 1 --2- 172.21.15.17:0/214452831 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe17407af30 0x7fe17407d3f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.511+0000 7fe191594640 1 --2- 172.21.15.17:0/214452831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe18c1033e0 0x7fe18c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.511+0000 7fe191594640 1 --2- 172.21.15.17:0/214452831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe18c102ac0 0x7fe18c100720 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.511+0000 7fe191594640 1 -- 172.21.15.17:0/214452831 >> 172.21.15.17:0/214452831 conn(0x7fe18c0fc520 msgr2=0x7fe18c108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:19.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.511+0000 7fe191594640 1 -- 172.21.15.17:0/214452831 shutdown_connections 2024-09-20T19:08:19.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.511+0000 7fe191594640 1 -- 172.21.15.17:0/214452831 wait complete. 2024-09-20T19:08:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.606+0000 7f656fedb640 1 -- 172.21.15.17:0/2242329662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6568107900 msgr2=0x7f6568107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.606+0000 7f656fedb640 1 --2- 172.21.15.17:0/2242329662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6568107900 0x7f6568107ce0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f6564009880 tx=0x7f656402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.606+0000 7f656fedb640 1 -- 172.21.15.17:0/2242329662 shutdown_connections 2024-09-20T19:08:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.606+0000 7f656fedb640 1 --2- 172.21.15.17:0/2242329662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6568101900 0x7f6568101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.606+0000 7f656fedb640 1 --2- 172.21.15.17:0/2242329662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6568107900 0x7f6568107ce0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.606+0000 7f656fedb640 1 -- 172.21.15.17:0/2242329662 >> 172.21.15.17:0/2242329662 conn(0x7f65680fd600 msgr2=0x7f65680ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.606+0000 7f656fedb640 1 -- 172.21.15.17:0/2242329662 shutdown_connections 2024-09-20T19:08:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.606+0000 7f656fedb640 1 -- 172.21.15.17:0/2242329662 wait complete. 2024-09-20T19:08:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.607+0000 7f656fedb640 1 Processor -- start 2024-09-20T19:08:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.607+0000 7f656fedb640 1 -- start start 2024-09-20T19:08:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.607+0000 7f656fedb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6568101900 0x7f656819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.607+0000 7f656fedb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6568107900 0x7f656819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.607+0000 7f656fedb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f656810edb0 con 0x7f6568101900 2024-09-20T19:08:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.607+0000 7f656fedb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f656810ec30 con 0x7f6568107900 2024-09-20T19:08:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.607+0000 7f656dc77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6568101900 0x7f656819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:19.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.607+0000 7f656dc77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6568101900 0x7f656819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35242/0 (socket says 172.21.15.17:35242) 2024-09-20T19:08:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.607+0000 7f656dc77640 1 -- 172.21.15.17:0/358493908 learned_addr learned my addr 172.21.15.17:0/358493908 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:08:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.607+0000 7f656d476640 1 --2- 172.21.15.17:0/358493908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6568107900 0x7f656819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.607+0000 7f656dc77640 1 -- 172.21.15.17:0/358493908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6568107900 msgr2=0x7f656819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.607+0000 7f656dc77640 1 --2- 172.21.15.17:0/358493908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6568107900 0x7f656819dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.607+0000 7f656dc77640 1 -- 172.21.15.17:0/358493908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65681977e0 con 0x7f6568101900 2024-09-20T19:08:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.607+0000 7f656d476640 1 --2- 172.21.15.17:0/358493908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6568107900 0x7f656819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:08:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.608+0000 7f656dc77640 1 --2- 172.21.15.17:0/358493908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6568101900 0x7f656819d660 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f6564031460 tx=0x7f65640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.608+0000 7f655effd640 1 -- 172.21.15.17:0/358493908 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f656403f070 con 0x7f6568101900 2024-09-20T19:08:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.608+0000 7f655effd640 1 -- 172.21.15.17:0/358493908 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6564004cf0 con 0x7f6568101900 2024-09-20T19:08:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.608+0000 7f656fedb640 1 -- 172.21.15.17:0/358493908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6568197a70 con 0x7f6568101900 2024-09-20T19:08:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.608+0000 7f655effd640 1 -- 172.21.15.17:0/358493908 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6564035030 con 0x7f6568101900 2024-09-20T19:08:19.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.608+0000 7f656fedb640 1 -- 172.21.15.17:0/358493908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6568197fa0 con 0x7f6568101900 2024-09-20T19:08:19.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.609+0000 7f656fedb640 1 -- 172.21.15.17:0/358493908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6568103040 con 0x7f6568101900 2024-09-20T19:08:19.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.610+0000 7f655effd640 1 -- 172.21.15.17:0/358493908 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6564042070 con 0x7f6568101900 2024-09-20T19:08:19.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.610+0000 7f655effd640 1 --2- 172.21.15.17:0/358493908 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f655407af30 0x7f655407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:19.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.610+0000 7f655effd640 1 -- 172.21.15.17:0/358493908 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f65640beac0 con 0x7f6568101900 2024-09-20T19:08:19.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.610+0000 7f656d476640 1 --2- 172.21.15.17:0/358493908 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f655407af30 0x7f655407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:19.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.611+0000 7f656d476640 1 --2- 172.21.15.17:0/358493908 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f655407af30 0x7f655407d3f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6568100d10 tx=0x7f6558005ec0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:19.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.615+0000 7f655effd640 1 -- 172.21.15.17:0/358493908 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f656408a0c0 con 0x7f6568101900 2024-09-20T19:08:19.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.820+0000 7f656fedb640 1 -- 172.21.15.17:0/358493908 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6568198250 con 0x7f655407af30 2024-09-20T19:08:19.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.821+0000 7f655effd640 1 -- 172.21.15.17:0/358493908 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6568198250 con 0x7f655407af30 2024-09-20T19:08:19.825 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:08:19.825 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:08:19.825 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:08:19.825 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:08:19.825 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:08:19.825 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:08:19.826 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:08:19.826 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:08:19.826 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:08:19.826 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:08:19.826 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:08:19.826 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:08:19.826 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:08:19.826 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:08:19.826 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:08:19.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.824+0000 7f656fedb640 1 -- 172.21.15.17:0/358493908 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f655407af30 msgr2=0x7f655407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.824+0000 7f656fedb640 1 --2- 172.21.15.17:0/358493908 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f655407af30 0x7f655407d3f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6568100d10 tx=0x7f6558005ec0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.824+0000 7f656fedb640 1 -- 172.21.15.17:0/358493908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6568101900 msgr2=0x7f656819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.824+0000 7f656fedb640 1 --2- 172.21.15.17:0/358493908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6568101900 0x7f656819d660 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f6564031460 tx=0x7f65640048f0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.824+0000 7f656fedb640 1 -- 172.21.15.17:0/358493908 shutdown_connections 2024-09-20T19:08:19.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.824+0000 7f656fedb640 1 --2- 172.21.15.17:0/358493908 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f655407af30 0x7f655407d3f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.824+0000 7f656fedb640 1 --2- 172.21.15.17:0/358493908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6568107900 0x7f656819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.824+0000 7f656fedb640 1 --2- 172.21.15.17:0/358493908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6568101900 0x7f656819d660 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.824+0000 7f656fedb640 1 -- 172.21.15.17:0/358493908 >> 172.21.15.17:0/358493908 conn(0x7f65680fd600 msgr2=0x7f65680fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:19.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.824+0000 7f656fedb640 1 -- 172.21.15.17:0/358493908 shutdown_connections 2024-09-20T19:08:19.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.824+0000 7f656fedb640 1 -- 172.21.15.17:0/358493908 wait complete. 2024-09-20T19:08:19.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.920+0000 7fddc1b9d640 1 -- 172.21.15.17:0/1520552424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddbc100030 msgr2=0x7fddbc100410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.920+0000 7fddc1b9d640 1 --2- 172.21.15.17:0/1520552424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddbc100030 0x7fddbc100410 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fddb000a990 tx=0x7fddb002b7d0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.920+0000 7fddc1b9d640 1 -- 172.21.15.17:0/1520552424 shutdown_connections 2024-09-20T19:08:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.920+0000 7fddc1b9d640 1 --2- 172.21.15.17:0/1520552424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddbc1009e0 0x7fddbc104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.920+0000 7fddc1b9d640 1 --2- 172.21.15.17:0/1520552424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddbc100030 0x7fddbc100410 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.920+0000 7fddc1b9d640 1 -- 172.21.15.17:0/1520552424 >> 172.21.15.17:0/1520552424 conn(0x7fddbc0fbad0 msgr2=0x7fddbc0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.920+0000 7fddc1b9d640 1 -- 172.21.15.17:0/1520552424 shutdown_connections 2024-09-20T19:08:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.920+0000 7fddc1b9d640 1 -- 172.21.15.17:0/1520552424 wait complete. 2024-09-20T19:08:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.921+0000 7fddc1b9d640 1 Processor -- start 2024-09-20T19:08:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.921+0000 7fddc1b9d640 1 -- start start 2024-09-20T19:08:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.921+0000 7fddc1b9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddbc100030 0x7fddbc19d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.921+0000 7fddc1b9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddbc1009e0 0x7fddbc19dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.921+0000 7fddc1b9d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc10c9b0 con 0x7fddbc1009e0 2024-09-20T19:08:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.921+0000 7fddc1b9d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc10c830 con 0x7fddbc100030 2024-09-20T19:08:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.921+0000 7fddbbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddbc1009e0 0x7fddbc19dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.921+0000 7fddbbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddbc1009e0 0x7fddbc19dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35252/0 (socket says 172.21.15.17:35252) 2024-09-20T19:08:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.921+0000 7fddbbfff640 1 -- 172.21.15.17:0/889955425 learned_addr learned my addr 172.21.15.17:0/889955425 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:08:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.921+0000 7fddc0b9b640 1 --2- 172.21.15.17:0/889955425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddbc100030 0x7fddbc19d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.921+0000 7fddbbfff640 1 -- 172.21.15.17:0/889955425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddbc100030 msgr2=0x7fddbc19d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.921+0000 7fddbbfff640 1 --2- 172.21.15.17:0/889955425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddbc100030 0x7fddbc19d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.921+0000 7fddbbfff640 1 -- 172.21.15.17:0/889955425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddbc197640 con 0x7fddbc1009e0 2024-09-20T19:08:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.922+0000 7fddbbfff640 1 --2- 172.21.15.17:0/889955425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddbc1009e0 0x7fddbc19dab0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fdda800d6f0 tx=0x7fdda800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.922+0000 7fddb9ffb640 1 -- 172.21.15.17:0/889955425 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdda8017070 con 0x7fddbc1009e0 2024-09-20T19:08:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.922+0000 7fddb9ffb640 1 -- 172.21.15.17:0/889955425 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdda800de00 con 0x7fddbc1009e0 2024-09-20T19:08:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.922+0000 7fddc1b9d640 1 -- 172.21.15.17:0/889955425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddbc197930 con 0x7fddbc1009e0 2024-09-20T19:08:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.922+0000 7fddb9ffb640 1 -- 172.21.15.17:0/889955425 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdda8004bb0 con 0x7fddbc1009e0 2024-09-20T19:08:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.922+0000 7fddc1b9d640 1 -- 172.21.15.17:0/889955425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddbc197e90 con 0x7fddbc1009e0 2024-09-20T19:08:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.923+0000 7fddc1b9d640 1 -- 172.21.15.17:0/889955425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddbc101510 con 0x7fddbc1009e0 2024-09-20T19:08:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.924+0000 7fddb9ffb640 1 -- 172.21.15.17:0/889955425 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdda8009a30 con 0x7fddbc1009e0 2024-09-20T19:08:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.924+0000 7fddb9ffb640 1 --2- 172.21.15.17:0/889955425 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fddac07af90 0x7fddac07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.924+0000 7fddb9ffb640 1 -- 172.21.15.17:0/889955425 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fdda809db70 con 0x7fddbc1009e0 2024-09-20T19:08:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.924+0000 7fddc0b9b640 1 --2- 172.21.15.17:0/889955425 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fddac07af90 0x7fddac07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.925+0000 7fddc0b9b640 1 --2- 172.21.15.17:0/889955425 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fddac07af90 0x7fddac07d450 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fddb000a7d0 tx=0x7fddb0005fd0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:19.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:19.929+0000 7fddb9ffb640 1 -- 172.21.15.17:0/889955425 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdda80691f0 con 0x7fddbc1009e0 2024-09-20T19:08:20.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:19 smithi017 ceph-mon[108970]: from='client.35604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:20.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:19 smithi017 ceph-mon[108970]: from='client.35608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:20.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:19 smithi017 ceph-mon[108970]: pgmap v988: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:20.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:19 smithi017 ceph-mon[108970]: from='client.35612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:20.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:19 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3742344428' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:08:20.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:19 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/214452831' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:08:20.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:20.193+0000 7fddc1b9d640 1 -- 172.21.15.17:0/889955425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fddbc198b70 con 0x7fddbc1009e0 2024-09-20T19:08:20.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:20.194+0000 7fddb9ffb640 1 -- 172.21.15.17:0/889955425 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fdda806e0a0 con 0x7fddbc1009e0 2024-09-20T19:08:20.197 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:08:20.198 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:08:20.198 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:08:20.198 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:08:20.198 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:08:20.198 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:08:20.198 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:08:20.198 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:08:20.198 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:08:20.198 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:08:20.198 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:08:20.198 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:08:20.199 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:08:20.199 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:08:20.199 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:08:20.199 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:08:20.199 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:08:20.199 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:08:20.199 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:08:20.199 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:08:20.199 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:08:20.199 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:08:20.199 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:08:20.199 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:08:20.199 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:08:20.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:20.196+0000 7fddc1b9d640 1 -- 172.21.15.17:0/889955425 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fddac07af90 msgr2=0x7fddac07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:20.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:20.196+0000 7fddc1b9d640 1 --2- 172.21.15.17:0/889955425 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fddac07af90 0x7fddac07d450 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fddb000a7d0 tx=0x7fddb0005fd0 comp rx=0 tx=0).stop 2024-09-20T19:08:20.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:20.196+0000 7fddc1b9d640 1 -- 172.21.15.17:0/889955425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddbc1009e0 msgr2=0x7fddbc19dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:20.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:20.196+0000 7fddc1b9d640 1 --2- 172.21.15.17:0/889955425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddbc1009e0 0x7fddbc19dab0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fdda800d6f0 tx=0x7fdda800dbb0 comp rx=0 tx=0).stop 2024-09-20T19:08:20.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:20.196+0000 7fddc1b9d640 1 -- 172.21.15.17:0/889955425 shutdown_connections 2024-09-20T19:08:20.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:20.196+0000 7fddc1b9d640 1 --2- 172.21.15.17:0/889955425 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fddac07af90 0x7fddac07d450 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:20.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:20.196+0000 7fddc1b9d640 1 --2- 172.21.15.17:0/889955425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddbc1009e0 0x7fddbc19dab0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:20.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:20.196+0000 7fddc1b9d640 1 --2- 172.21.15.17:0/889955425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddbc100030 0x7fddbc19d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:20.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:20.196+0000 7fddc1b9d640 1 -- 172.21.15.17:0/889955425 >> 172.21.15.17:0/889955425 conn(0x7fddbc0fbad0 msgr2=0x7fddbc0fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:20.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:20.196+0000 7fddc1b9d640 1 -- 172.21.15.17:0/889955425 shutdown_connections 2024-09-20T19:08:20.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:20.196+0000 7fddc1b9d640 1 -- 172.21.15.17:0/889955425 wait complete. 2024-09-20T19:08:20.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:19 smithi172 ceph-mon[80431]: from='client.35604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:20.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:19 smithi172 ceph-mon[80431]: from='client.35608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:20.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:19 smithi172 ceph-mon[80431]: pgmap v988: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:20.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:19 smithi172 ceph-mon[80431]: from='client.35612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:20.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:19 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3742344428' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:08:20.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:19 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/214452831' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:08:21.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:20 smithi017 ceph-mon[108970]: from='client.35624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:21.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:20 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/889955425' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:08:21.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:20 smithi172 ceph-mon[80431]: from='client.35624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:21.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:20 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/889955425' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:08:22.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:21 smithi017 ceph-mon[108970]: pgmap v989: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:22.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:21 smithi172 ceph-mon[80431]: pgmap v989: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:23.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:08:23.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:08:24.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:23 smithi017 ceph-mon[108970]: pgmap v990: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:24.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:23 smithi172 ceph-mon[80431]: pgmap v990: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:26.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:25 smithi017 ceph-mon[108970]: pgmap v991: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:26.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:25 smithi172 ceph-mon[80431]: pgmap v991: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:28.242 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:27 smithi172 ceph-mon[80431]: pgmap v992: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:28.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:27 smithi017 ceph-mon[108970]: pgmap v992: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:30.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:29 smithi017 ceph-mon[108970]: pgmap v993: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:30.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:29 smithi172 ceph-mon[80431]: pgmap v993: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:32.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:31 smithi017 ceph-mon[108970]: pgmap v994: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:32.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:31 smithi172 ceph-mon[80431]: pgmap v994: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:34.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:33 smithi017 ceph-mon[108970]: pgmap v995: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:34.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:33 smithi172 ceph-mon[80431]: pgmap v995: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:36.391 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:35 smithi017 ceph-mon[108970]: pgmap v996: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:36.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:35 smithi172 ceph-mon[80431]: pgmap v996: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:38.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:37 smithi017 ceph-mon[108970]: pgmap v997: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:38.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:08:38.392 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:37 smithi172 ceph-mon[80431]: pgmap v997: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:38.392 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:08:40.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:39 smithi017 ceph-mon[108970]: pgmap v998: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:40.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:39 smithi172 ceph-mon[80431]: pgmap v998: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:42.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:41 smithi017 ceph-mon[108970]: pgmap v999: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:42.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:41 smithi172 ceph-mon[80431]: pgmap v999: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:44.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:43 smithi017 ceph-mon[108970]: pgmap v1000: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:44.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:43 smithi172 ceph-mon[80431]: pgmap v1000: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:46.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:45 smithi017 ceph-mon[108970]: pgmap v1001: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:46.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:45 smithi172 ceph-mon[80431]: pgmap v1001: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:48.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:48 smithi017 ceph-mon[108970]: pgmap v1002: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:48.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:48 smithi172 ceph-mon[80431]: pgmap v1002: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:50.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.294+0000 7fd7d14ff640 1 -- 172.21.15.17:0/3958475361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7cc1067f0 msgr2=0x7fd7cc106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:50.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.294+0000 7fd7d14ff640 1 --2- 172.21.15.17:0/3958475361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7cc1067f0 0x7fd7cc106bd0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009880 tx=0x7fd7bc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:08:50.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.294+0000 7fd7d14ff640 1 -- 172.21.15.17:0/3958475361 shutdown_connections 2024-09-20T19:08:50.299 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:50 smithi017 ceph-mon[108970]: pgmap v1003: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:50.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.294+0000 7fd7d14ff640 1 --2- 172.21.15.17:0/3958475361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7cc1007f0 0x7fd7cc100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:50.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.294+0000 7fd7d14ff640 1 --2- 172.21.15.17:0/3958475361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7cc1067f0 0x7fd7cc106bd0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:50.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.294+0000 7fd7d14ff640 1 -- 172.21.15.17:0/3958475361 >> 172.21.15.17:0/3958475361 conn(0x7fd7cc0fc550 msgr2=0x7fd7cc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:50.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.294+0000 7fd7d14ff640 1 -- 172.21.15.17:0/3958475361 shutdown_connections 2024-09-20T19:08:50.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.294+0000 7fd7d14ff640 1 -- 172.21.15.17:0/3958475361 wait complete. 2024-09-20T19:08:50.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.295+0000 7fd7d14ff640 1 Processor -- start 2024-09-20T19:08:50.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.295+0000 7fd7d14ff640 1 -- start start 2024-09-20T19:08:50.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.295+0000 7fd7d14ff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7cc1007f0 0x7fd7cc19c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:50.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.295+0000 7fd7d14ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7cc1067f0 0x7fd7cc19cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:50.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.295+0000 7fd7d14ff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc10dcc0 con 0x7fd7cc1067f0 2024-09-20T19:08:50.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.295+0000 7fd7d14ff640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc10db40 con 0x7fd7cc1007f0 2024-09-20T19:08:50.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.296+0000 7fd7ca7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7cc1067f0 0x7fd7cc19cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:50.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.296+0000 7fd7ca7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7cc1067f0 0x7fd7cc19cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57574/0 (socket says 172.21.15.17:57574) 2024-09-20T19:08:50.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.296+0000 7fd7ca7fc640 1 -- 172.21.15.17:0/3183089601 learned_addr learned my addr 172.21.15.17:0/3183089601 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:08:50.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.296+0000 7fd7caffd640 1 --2- 172.21.15.17:0/3183089601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7cc1007f0 0x7fd7cc19c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:50.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.296+0000 7fd7ca7fc640 1 -- 172.21.15.17:0/3183089601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7cc1007f0 msgr2=0x7fd7cc19c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:50.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.296+0000 7fd7ca7fc640 1 --2- 172.21.15.17:0/3183089601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7cc1007f0 0x7fd7cc19c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:50.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.296+0000 7fd7ca7fc640 1 -- 172.21.15.17:0/3183089601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc1966d0 con 0x7fd7cc1067f0 2024-09-20T19:08:50.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.296+0000 7fd7caffd640 1 --2- 172.21.15.17:0/3183089601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7cc1007f0 0x7fd7cc19c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:08:50.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.296+0000 7fd7ca7fc640 1 --2- 172.21.15.17:0/3183089601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7cc1067f0 0x7fd7cc19cb40 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009860 tx=0x7fd7c0009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:50.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.296+0000 7fd7b3fff640 1 -- 172.21.15.17:0/3183089601 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7c0005020 con 0x7fd7cc1067f0 2024-09-20T19:08:50.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.297+0000 7fd7d14ff640 1 -- 172.21.15.17:0/3183089601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7cc196960 con 0x7fd7cc1067f0 2024-09-20T19:08:50.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.297+0000 7fd7b3fff640 1 -- 172.21.15.17:0/3183089601 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd7c00047a0 con 0x7fd7cc1067f0 2024-09-20T19:08:50.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.297+0000 7fd7b3fff640 1 -- 172.21.15.17:0/3183089601 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7c0007b00 con 0x7fd7cc1067f0 2024-09-20T19:08:50.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.297+0000 7fd7d14ff640 1 -- 172.21.15.17:0/3183089601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7cc196ec0 con 0x7fd7cc1067f0 2024-09-20T19:08:50.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.298+0000 7fd7d14ff640 1 -- 172.21.15.17:0/3183089601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7cc101f30 con 0x7fd7cc1067f0 2024-09-20T19:08:50.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.298+0000 7fd7b3fff640 1 -- 172.21.15.17:0/3183089601 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd7c0018420 con 0x7fd7cc1067f0 2024-09-20T19:08:50.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.299+0000 7fd7b3fff640 1 --2- 172.21.15.17:0/3183089601 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd7b407af30 0x7fd7b407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:50.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.299+0000 7fd7b3fff640 1 -- 172.21.15.17:0/3183089601 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fd7c0013030 con 0x7fd7cc1067f0 2024-09-20T19:08:50.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.299+0000 7fd7caffd640 1 --2- 172.21.15.17:0/3183089601 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd7b407af30 0x7fd7b407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:50.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.300+0000 7fd7caffd640 1 --2- 172.21.15.17:0/3183089601 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd7b407af30 0x7fd7b407d3f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc000c00 tx=0x7fd7bc031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:50.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.303+0000 7fd7b3fff640 1 -- 172.21.15.17:0/3183089601 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd7c006aea0 con 0x7fd7cc1067f0 2024-09-20T19:08:50.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:50 smithi172 ceph-mon[80431]: pgmap v1003: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:50.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.508+0000 7fd7d14ff640 1 -- 172.21.15.17:0/3183089601 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd7cc197170 con 0x7fd7b407af30 2024-09-20T19:08:50.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.510+0000 7fd7b3fff640 1 -- 172.21.15.17:0/3183089601 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fd7cc197170 con 0x7fd7b407af30 2024-09-20T19:08:50.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.512+0000 7fd7d14ff640 1 -- 172.21.15.17:0/3183089601 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd7b407af30 msgr2=0x7fd7b407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:50.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.512+0000 7fd7d14ff640 1 --2- 172.21.15.17:0/3183089601 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd7b407af30 0x7fd7b407d3f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc000c00 tx=0x7fd7bc031400 comp rx=0 tx=0).stop 2024-09-20T19:08:50.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.512+0000 7fd7d14ff640 1 -- 172.21.15.17:0/3183089601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7cc1067f0 msgr2=0x7fd7cc19cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:50.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.512+0000 7fd7d14ff640 1 --2- 172.21.15.17:0/3183089601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7cc1067f0 0x7fd7cc19cb40 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009860 tx=0x7fd7c0009d20 comp rx=0 tx=0).stop 2024-09-20T19:08:50.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.512+0000 7fd7d14ff640 1 -- 172.21.15.17:0/3183089601 shutdown_connections 2024-09-20T19:08:50.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.512+0000 7fd7d14ff640 1 --2- 172.21.15.17:0/3183089601 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd7b407af30 0x7fd7b407d3f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:50.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.512+0000 7fd7d14ff640 1 --2- 172.21.15.17:0/3183089601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7cc1067f0 0x7fd7cc19cb40 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:50.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.512+0000 7fd7d14ff640 1 --2- 172.21.15.17:0/3183089601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7cc1007f0 0x7fd7cc19c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:50.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.512+0000 7fd7d14ff640 1 -- 172.21.15.17:0/3183089601 >> 172.21.15.17:0/3183089601 conn(0x7fd7cc0fc550 msgr2=0x7fd7cc0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:50.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.512+0000 7fd7d14ff640 1 -- 172.21.15.17:0/3183089601 shutdown_connections 2024-09-20T19:08:50.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.512+0000 7fd7d14ff640 1 -- 172.21.15.17:0/3183089601 wait complete. 2024-09-20T19:08:50.524 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:08:50.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.597+0000 7f62f6cb9640 1 -- 172.21.15.17:0/1582143178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f0102ac0 msgr2=0x7f62f0102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:50.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.597+0000 7f62f6cb9640 1 --2- 172.21.15.17:0/1582143178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f0102ac0 0x7f62f0102ea0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009880 tx=0x7f62e402a530 comp rx=0 tx=0).stop 2024-09-20T19:08:50.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.597+0000 7f62f6cb9640 1 -- 172.21.15.17:0/1582143178 shutdown_connections 2024-09-20T19:08:50.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.597+0000 7f62f6cb9640 1 --2- 172.21.15.17:0/1582143178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f01033e0 0x7f62f010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:50.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.597+0000 7f62f6cb9640 1 --2- 172.21.15.17:0/1582143178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f0102ac0 0x7f62f0102ea0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:50.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.597+0000 7f62f6cb9640 1 -- 172.21.15.17:0/1582143178 >> 172.21.15.17:0/1582143178 conn(0x7f62f00fc520 msgr2=0x7f62f00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:50.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.597+0000 7f62f6cb9640 1 -- 172.21.15.17:0/1582143178 shutdown_connections 2024-09-20T19:08:50.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.597+0000 7f62f6cb9640 1 -- 172.21.15.17:0/1582143178 wait complete. 2024-09-20T19:08:50.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.598+0000 7f62f6cb9640 1 Processor -- start 2024-09-20T19:08:50.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.598+0000 7f62f6cb9640 1 -- start start 2024-09-20T19:08:50.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.598+0000 7f62f6cb9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f0102ac0 0x7f62f0100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:50.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.598+0000 7f62f6cb9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f01033e0 0x7f62f0100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:50.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.598+0000 7f62f6cb9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f62f010edf0 con 0x7f62f01033e0 2024-09-20T19:08:50.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.598+0000 7f62f6cb9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f62f010ec70 con 0x7f62f0102ac0 2024-09-20T19:08:50.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.599+0000 7f62effff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f01033e0 0x7f62f0100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:50.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.599+0000 7f62effff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f01033e0 0x7f62f0100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34798/0 (socket says 172.21.15.17:34798) 2024-09-20T19:08:50.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.599+0000 7f62effff640 1 -- 172.21.15.17:0/987209542 learned_addr learned my addr 172.21.15.17:0/987209542 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:08:50.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.599+0000 7f62f4a55640 1 --2- 172.21.15.17:0/987209542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f0102ac0 0x7f62f0100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:50.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.599+0000 7f62effff640 1 -- 172.21.15.17:0/987209542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f0102ac0 msgr2=0x7f62f0100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:50.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.599+0000 7f62effff640 1 --2- 172.21.15.17:0/987209542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f0102ac0 0x7f62f0100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:50.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.599+0000 7f62effff640 1 -- 172.21.15.17:0/987209542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f01011a0 con 0x7f62f01033e0 2024-09-20T19:08:50.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.599+0000 7f62effff640 1 --2- 172.21.15.17:0/987209542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f01033e0 0x7f62f0100c60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00d6d0 tx=0x7f62dc00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:50.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.599+0000 7f62edffb640 1 -- 172.21.15.17:0/987209542 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f62dc017070 con 0x7f62f01033e0 2024-09-20T19:08:50.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.599+0000 7f62f6cb9640 1 -- 172.21.15.17:0/987209542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f0101490 con 0x7f62f01033e0 2024-09-20T19:08:50.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.599+0000 7f62edffb640 1 -- 172.21.15.17:0/987209542 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f62dc0054e0 con 0x7f62f01033e0 2024-09-20T19:08:50.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.599+0000 7f62edffb640 1 -- 172.21.15.17:0/987209542 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f62dc004ae0 con 0x7f62f01033e0 2024-09-20T19:08:50.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.600+0000 7f62f6cb9640 1 -- 172.21.15.17:0/987209542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f01a3e40 con 0x7f62f01033e0 2024-09-20T19:08:50.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.601+0000 7f62f6cb9640 1 -- 172.21.15.17:0/987209542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f006aa90 con 0x7f62f01033e0 2024-09-20T19:08:50.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.601+0000 7f62edffb640 1 -- 172.21.15.17:0/987209542 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f62dc004de0 con 0x7f62f01033e0 2024-09-20T19:08:50.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.602+0000 7f62edffb640 1 --2- 172.21.15.17:0/987209542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f62e007af30 0x7f62e007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:50.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.602+0000 7f62edffb640 1 -- 172.21.15.17:0/987209542 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f62dc09dba0 con 0x7f62f01033e0 2024-09-20T19:08:50.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.602+0000 7f62f4a55640 1 --2- 172.21.15.17:0/987209542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f62e007af30 0x7f62e007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:50.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.603+0000 7f62f4a55640 1 --2- 172.21.15.17:0/987209542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f62e007af30 0x7f62e007d3f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f62e40096c0 tx=0x7f62e4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:50.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.607+0000 7f62edffb640 1 -- 172.21.15.17:0/987209542 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f62dc0691a0 con 0x7f62f01033e0 2024-09-20T19:08:50.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.814+0000 7f62f6cb9640 1 -- 172.21.15.17:0/987209542 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f62f010b640 con 0x7f62e007af30 2024-09-20T19:08:50.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.815+0000 7f62edffb640 1 -- 172.21.15.17:0/987209542 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f62f010b640 con 0x7f62e007af30 2024-09-20T19:08:50.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.817+0000 7f62f6cb9640 1 -- 172.21.15.17:0/987209542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f62e007af30 msgr2=0x7f62e007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:50.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.817+0000 7f62f6cb9640 1 --2- 172.21.15.17:0/987209542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f62e007af30 0x7f62e007d3f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f62e40096c0 tx=0x7f62e4031400 comp rx=0 tx=0).stop 2024-09-20T19:08:50.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.817+0000 7f62f6cb9640 1 -- 172.21.15.17:0/987209542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f01033e0 msgr2=0x7f62f0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:50.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.817+0000 7f62f6cb9640 1 --2- 172.21.15.17:0/987209542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f01033e0 0x7f62f0100c60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00d6d0 tx=0x7f62dc00db90 comp rx=0 tx=0).stop 2024-09-20T19:08:50.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.818+0000 7f62f6cb9640 1 -- 172.21.15.17:0/987209542 shutdown_connections 2024-09-20T19:08:50.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.818+0000 7f62f6cb9640 1 --2- 172.21.15.17:0/987209542 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f62e007af30 0x7f62e007d3f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:50.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.818+0000 7f62f6cb9640 1 --2- 172.21.15.17:0/987209542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f01033e0 0x7f62f0100c60 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:50.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.818+0000 7f62f6cb9640 1 --2- 172.21.15.17:0/987209542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f0102ac0 0x7f62f0100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:50.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.818+0000 7f62f6cb9640 1 -- 172.21.15.17:0/987209542 >> 172.21.15.17:0/987209542 conn(0x7f62f00fc520 msgr2=0x7f62f010af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:50.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.818+0000 7f62f6cb9640 1 -- 172.21.15.17:0/987209542 shutdown_connections 2024-09-20T19:08:50.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.818+0000 7f62f6cb9640 1 -- 172.21.15.17:0/987209542 wait complete. 2024-09-20T19:08:50.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.903+0000 7f6c5b5ec640 1 -- 172.21.15.17:0/103206492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c541007f0 msgr2=0x7f6c54100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:50.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.903+0000 7f6c5b5ec640 1 --2- 172.21.15.17:0/103206492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c541007f0 0x7f6c54100c50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009880 tx=0x7f6c4802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:08:50.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.904+0000 7f6c5b5ec640 1 -- 172.21.15.17:0/103206492 shutdown_connections 2024-09-20T19:08:50.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.904+0000 7f6c5b5ec640 1 --2- 172.21.15.17:0/103206492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c541007f0 0x7f6c54100c50 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:50.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.904+0000 7f6c5b5ec640 1 --2- 172.21.15.17:0/103206492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c541067f0 0x7f6c54106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:50.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.904+0000 7f6c5b5ec640 1 -- 172.21.15.17:0/103206492 >> 172.21.15.17:0/103206492 conn(0x7f6c540fc550 msgr2=0x7f6c540fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:50.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.904+0000 7f6c5b5ec640 1 -- 172.21.15.17:0/103206492 shutdown_connections 2024-09-20T19:08:50.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.904+0000 7f6c5b5ec640 1 -- 172.21.15.17:0/103206492 wait complete. 2024-09-20T19:08:50.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.904+0000 7f6c5b5ec640 1 Processor -- start 2024-09-20T19:08:50.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.904+0000 7f6c5b5ec640 1 -- start start 2024-09-20T19:08:50.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.905+0000 7f6c5b5ec640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c541007f0 0x7f6c5419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:50.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.905+0000 7f6c5b5ec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c541067f0 0x7f6c5419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:50.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.905+0000 7f6c5b5ec640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5410ede0 con 0x7f6c541067f0 2024-09-20T19:08:50.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.905+0000 7f6c5b5ec640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5410ec60 con 0x7f6c541007f0 2024-09-20T19:08:50.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.905+0000 7f6c58b87640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c541067f0 0x7f6c5419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:50.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.905+0000 7f6c58b87640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c541067f0 0x7f6c5419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34812/0 (socket says 172.21.15.17:34812) 2024-09-20T19:08:50.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.905+0000 7f6c58b87640 1 -- 172.21.15.17:0/1803523820 learned_addr learned my addr 172.21.15.17:0/1803523820 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:08:50.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.905+0000 7f6c59388640 1 --2- 172.21.15.17:0/1803523820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c541007f0 0x7f6c5419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:50.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.905+0000 7f6c58b87640 1 -- 172.21.15.17:0/1803523820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c541007f0 msgr2=0x7f6c5419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:50.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.905+0000 7f6c58b87640 1 --2- 172.21.15.17:0/1803523820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c541007f0 0x7f6c5419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:50.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.905+0000 7f6c58b87640 1 -- 172.21.15.17:0/1803523820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c541977d0 con 0x7f6c541067f0 2024-09-20T19:08:50.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.905+0000 7f6c59388640 1 --2- 172.21.15.17:0/1803523820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c541007f0 0x7f6c5419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:08:50.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.905+0000 7f6c58b87640 1 --2- 172.21.15.17:0/1803523820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c541067f0 0x7f6c5419db90 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6c48031460 tx=0x7f6c480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:50.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.905+0000 7f6c467fc640 1 -- 172.21.15.17:0/1803523820 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c4803f070 con 0x7f6c541067f0 2024-09-20T19:08:50.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.906+0000 7f6c467fc640 1 -- 172.21.15.17:0/1803523820 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6c480035f0 con 0x7f6c541067f0 2024-09-20T19:08:50.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.906+0000 7f6c467fc640 1 -- 172.21.15.17:0/1803523820 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c48035030 con 0x7f6c541067f0 2024-09-20T19:08:50.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.906+0000 7f6c5b5ec640 1 -- 172.21.15.17:0/1803523820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c54197a60 con 0x7f6c541067f0 2024-09-20T19:08:50.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.906+0000 7f6c5b5ec640 1 -- 172.21.15.17:0/1803523820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c54197f90 con 0x7f6c541067f0 2024-09-20T19:08:50.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.907+0000 7f6c5b5ec640 1 -- 172.21.15.17:0/1803523820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c54101f30 con 0x7f6c541067f0 2024-09-20T19:08:50.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.907+0000 7f6c467fc640 1 -- 172.21.15.17:0/1803523820 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6c48042070 con 0x7f6c541067f0 2024-09-20T19:08:50.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.908+0000 7f6c467fc640 1 --2- 172.21.15.17:0/1803523820 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c4007af80 0x7f6c4007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:50.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.908+0000 7f6c59388640 1 --2- 172.21.15.17:0/1803523820 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c4007af80 0x7f6c4007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:50.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.908+0000 7f6c467fc640 1 -- 172.21.15.17:0/1803523820 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f6c480be910 con 0x7f6c541067f0 2024-09-20T19:08:50.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.909+0000 7f6c59388640 1 --2- 172.21.15.17:0/1803523820 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c4007af80 0x7f6c4007d440 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6c500058c0 tx=0x7f6c50005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:50.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:50.912+0000 7f6c467fc640 1 -- 172.21.15.17:0/1803523820 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6c48089f90 con 0x7f6c541067f0 2024-09-20T19:08:51.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.111+0000 7f6c5b5ec640 1 -- 172.21.15.17:0/1803523820 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6c54198240 con 0x7f6c4007af80 2024-09-20T19:08:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.121+0000 7f6c467fc640 1 -- 172.21.15.17:0/1803523820 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f6c54198240 con 0x7f6c4007af80 2024-09-20T19:08:51.124 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:08:51.125 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (30m) 9m ago 41m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:08:51.125 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (33m) 9m ago 41m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:08:51.125 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (32m) 9m ago 40m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:08:51.125 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (28m) 9m ago 41m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:08:51.125 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (28m) 9m ago 40m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:08:51.125 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (29m) 9m ago 41m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:08:51.125 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (24m) 9m ago 35m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:08:51.125 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (24m) 9m ago 35m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:08:51.125 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (9m) 9m ago 35m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:08:51.125 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (24m) 9m ago 35m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:08:51.125 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (32m) 9m ago 42m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:08:51.125 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (31m) 9m ago 40m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:08:51.126 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (28m) 9m ago 42m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:08:51.126 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (28m) 9m ago 40m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:08:51.126 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (31m) 9m ago 41m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:08:51.126 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (30m) 9m ago 40m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:08:51.126 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (28m) 9m ago 39m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:08:51.126 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (27m) 9m ago 38m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:08:51.126 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (26m) 9m ago 38m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:08:51.126 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (26m) 9m ago 37m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:08:51.126 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (25m) 9m ago 37m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:08:51.126 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (25m) 9m ago 36m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:08:51.126 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (30m) 9m ago 40m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:08:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.124+0000 7f6c5b5ec640 1 -- 172.21.15.17:0/1803523820 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c4007af80 msgr2=0x7f6c4007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.124+0000 7f6c5b5ec640 1 --2- 172.21.15.17:0/1803523820 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c4007af80 0x7f6c4007d440 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6c500058c0 tx=0x7f6c50005850 comp rx=0 tx=0).stop 2024-09-20T19:08:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.124+0000 7f6c5b5ec640 1 -- 172.21.15.17:0/1803523820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c541067f0 msgr2=0x7f6c5419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.124+0000 7f6c5b5ec640 1 --2- 172.21.15.17:0/1803523820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c541067f0 0x7f6c5419db90 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6c48031460 tx=0x7f6c480045e0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.124+0000 7f6c5b5ec640 1 -- 172.21.15.17:0/1803523820 shutdown_connections 2024-09-20T19:08:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.124+0000 7f6c5b5ec640 1 --2- 172.21.15.17:0/1803523820 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c4007af80 0x7f6c4007d440 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.124+0000 7f6c5b5ec640 1 --2- 172.21.15.17:0/1803523820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c541067f0 0x7f6c5419db90 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.124+0000 7f6c5b5ec640 1 --2- 172.21.15.17:0/1803523820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c541007f0 0x7f6c5419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.124+0000 7f6c5b5ec640 1 -- 172.21.15.17:0/1803523820 >> 172.21.15.17:0/1803523820 conn(0x7f6c540fc550 msgr2=0x7f6c540fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.124+0000 7f6c5b5ec640 1 -- 172.21.15.17:0/1803523820 shutdown_connections 2024-09-20T19:08:51.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.124+0000 7f6c5b5ec640 1 -- 172.21.15.17:0/1803523820 wait complete. 2024-09-20T19:08:51.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.210+0000 7feb57e8f640 1 -- 172.21.15.17:0/2781423643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb50106810 msgr2=0x7feb50106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:51.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.210+0000 7feb57e8f640 1 --2- 172.21.15.17:0/2781423643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb50106810 0x7feb50106bf0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009880 tx=0x7feb4c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.210+0000 7feb57e8f640 1 -- 172.21.15.17:0/2781423643 shutdown_connections 2024-09-20T19:08:51.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.210+0000 7feb57e8f640 1 --2- 172.21.15.17:0/2781423643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb50100810 0x7feb50100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.210+0000 7feb57e8f640 1 --2- 172.21.15.17:0/2781423643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb50106810 0x7feb50106bf0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.210+0000 7feb57e8f640 1 -- 172.21.15.17:0/2781423643 >> 172.21.15.17:0/2781423643 conn(0x7feb500fc510 msgr2=0x7feb500fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:51.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.210+0000 7feb57e8f640 1 -- 172.21.15.17:0/2781423643 shutdown_connections 2024-09-20T19:08:51.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.210+0000 7feb57e8f640 1 -- 172.21.15.17:0/2781423643 wait complete. 2024-09-20T19:08:51.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.210+0000 7feb57e8f640 1 Processor -- start 2024-09-20T19:08:51.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.211+0000 7feb57e8f640 1 -- start start 2024-09-20T19:08:51.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.211+0000 7feb57e8f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb50100810 0x7feb50198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.211+0000 7feb57e8f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb50106810 0x7feb50198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.211+0000 7feb57e8f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7feb5010dce0 con 0x7feb50100810 2024-09-20T19:08:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.211+0000 7feb57e8f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feb5010db60 con 0x7feb50106810 2024-09-20T19:08:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.211+0000 7feb55c2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb50100810 0x7feb50198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.211+0000 7feb55c2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb50100810 0x7feb50198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34826/0 (socket says 172.21.15.17:34826) 2024-09-20T19:08:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.211+0000 7feb55c2b640 1 -- 172.21.15.17:0/1622853174 learned_addr learned my addr 172.21.15.17:0/1622853174 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:08:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.211+0000 7feb5542a640 1 --2- 172.21.15.17:0/1622853174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb50106810 0x7feb50198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.211+0000 7feb55c2b640 1 -- 172.21.15.17:0/1622853174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb50106810 msgr2=0x7feb50198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.211+0000 7feb55c2b640 1 --2- 172.21.15.17:0/1622853174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb50106810 0x7feb50198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.211+0000 7feb55c2b640 1 -- 172.21.15.17:0/1622853174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb50199390 con 0x7feb50100810 2024-09-20T19:08:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.211+0000 7feb55c2b640 1 --2- 172.21.15.17:0/1622853174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb50100810 0x7feb50198850 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7feb4c031460 tx=0x7feb4c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.212+0000 7feb46ffd640 1 -- 172.21.15.17:0/1622853174 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb4c03f070 con 0x7feb50100810 2024-09-20T19:08:51.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.212+0000 7feb46ffd640 1 -- 172.21.15.17:0/1622853174 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feb4c0035f0 con 0x7feb50100810 2024-09-20T19:08:51.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.212+0000 7feb46ffd640 1 -- 172.21.15.17:0/1622853174 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb4c035030 con 0x7feb50100810 2024-09-20T19:08:51.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.212+0000 7feb57e8f640 1 -- 172.21.15.17:0/1622853174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb50199620 con 0x7feb50100810 2024-09-20T19:08:51.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.212+0000 7feb57e8f640 1 -- 172.21.15.17:0/1622853174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb501a1bd0 con 0x7feb50100810 2024-09-20T19:08:51.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.213+0000 7feb57e8f640 1 -- 172.21.15.17:0/1622853174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb50101f50 con 0x7feb50100810 2024-09-20T19:08:51.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.213+0000 7feb46ffd640 1 -- 172.21.15.17:0/1622853174 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7feb4c042070 con 0x7feb50100810 2024-09-20T19:08:51.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.214+0000 7feb46ffd640 1 --2- 172.21.15.17:0/1622853174 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb3c07af30 0x7feb3c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:51.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.214+0000 7feb46ffd640 1 -- 172.21.15.17:0/1622853174 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7feb4c0beac0 con 0x7feb50100810 2024-09-20T19:08:51.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.214+0000 7feb5542a640 1 --2- 172.21.15.17:0/1622853174 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb3c07af30 0x7feb3c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:51.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.214+0000 7feb5542a640 1 --2- 172.21.15.17:0/1622853174 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb3c07af30 0x7feb3c07d3f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7feb40005fd0 tx=0x7feb40005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:51.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.218+0000 7feb46ffd640 1 -- 172.21.15.17:0/1622853174 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feb4c08a020 con 0x7feb50100810 2024-09-20T19:08:51.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.485+0000 7feb57e8f640 1 -- 172.21.15.17:0/1622853174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7feb50108d80 con 0x7feb50100810 2024-09-20T19:08:51.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.486+0000 7feb46ffd640 1 -- 172.21.15.17:0/1622853174 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7feb4c08c070 con 0x7feb50100810 2024-09-20T19:08:51.489 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:08:51.490 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:08:51.490 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:08:51.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:08:51.490 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:08:51.490 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:08:51.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:08:51.490 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:08:51.491 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:08:51.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:08:51.491 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:08:51.491 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:08:51.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:08:51.491 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:08:51.491 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:08:51.491 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:08:51.492 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:08:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.488+0000 7feb57e8f640 1 -- 172.21.15.17:0/1622853174 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb3c07af30 msgr2=0x7feb3c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.488+0000 7feb57e8f640 1 --2- 172.21.15.17:0/1622853174 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb3c07af30 0x7feb3c07d3f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7feb40005fd0 tx=0x7feb40005850 comp rx=0 tx=0).stop 2024-09-20T19:08:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.488+0000 7feb57e8f640 1 -- 172.21.15.17:0/1622853174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb50100810 msgr2=0x7feb50198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.488+0000 7feb57e8f640 1 --2- 172.21.15.17:0/1622853174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb50100810 0x7feb50198850 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7feb4c031460 tx=0x7feb4c0045e0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.488+0000 7feb57e8f640 1 -- 172.21.15.17:0/1622853174 shutdown_connections 2024-09-20T19:08:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.488+0000 7feb57e8f640 1 --2- 172.21.15.17:0/1622853174 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb3c07af30 0x7feb3c07d3f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.488+0000 7feb57e8f640 1 --2- 172.21.15.17:0/1622853174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb50106810 0x7feb50198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.488+0000 7feb57e8f640 1 --2- 172.21.15.17:0/1622853174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb50100810 0x7feb50198850 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.488+0000 7feb57e8f640 1 -- 172.21.15.17:0/1622853174 >> 172.21.15.17:0/1622853174 conn(0x7feb500fc510 msgr2=0x7feb500fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.488+0000 7feb57e8f640 1 -- 172.21.15.17:0/1622853174 shutdown_connections 2024-09-20T19:08:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.488+0000 7feb57e8f640 1 -- 172.21.15.17:0/1622853174 wait complete. 2024-09-20T19:08:51.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.573+0000 7f2225850640 1 -- 172.21.15.17:0/1412197235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2220103430 msgr2=0x7f222010b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:51.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.573+0000 7f2225850640 1 --2- 172.21.15.17:0/1412197235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2220103430 0x7f222010b920 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f22140098b0 tx=0x7f221402a560 comp rx=0 tx=0).stop 2024-09-20T19:08:51.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.573+0000 7f2225850640 1 -- 172.21.15.17:0/1412197235 shutdown_connections 2024-09-20T19:08:51.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.573+0000 7f2225850640 1 --2- 172.21.15.17:0/1412197235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2220103430 0x7f222010b920 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.573+0000 7f2225850640 1 --2- 172.21.15.17:0/1412197235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2220102b10 0x7f2220102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.573+0000 7f2225850640 1 -- 172.21.15.17:0/1412197235 >> 172.21.15.17:0/1412197235 conn(0x7f22200fc550 msgr2=0x7f22200fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:51.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.573+0000 7f2225850640 1 -- 172.21.15.17:0/1412197235 shutdown_connections 2024-09-20T19:08:51.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.573+0000 7f2225850640 1 -- 172.21.15.17:0/1412197235 wait complete. 2024-09-20T19:08:51.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.573+0000 7f2225850640 1 Processor -- start 2024-09-20T19:08:51.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.574+0000 7f2225850640 1 -- start start 2024-09-20T19:08:51.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.574+0000 7f2225850640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2220102b10 0x7f2220100770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:51.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.574+0000 7f2225850640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2220103430 0x7f2220100cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:51.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.574+0000 7f2225850640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f222010ee40 con 0x7f2220103430 2024-09-20T19:08:51.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.574+0000 7f2225850640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f222010ecc0 con 0x7f2220102b10 2024-09-20T19:08:51.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.574+0000 7f221e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2220103430 0x7f2220100cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:51.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.574+0000 7f221e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2220103430 0x7f2220100cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34846/0 (socket says 172.21.15.17:34846) 2024-09-20T19:08:51.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.574+0000 7f221e7fc640 1 -- 172.21.15.17:0/4197605028 learned_addr learned my addr 172.21.15.17:0/4197605028 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:08:51.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.574+0000 7f221effd640 1 --2- 172.21.15.17:0/4197605028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2220102b10 0x7f2220100770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:51.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.574+0000 7f221e7fc640 1 -- 172.21.15.17:0/4197605028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2220102b10 msgr2=0x7f2220100770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:51.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.574+0000 7f221e7fc640 1 --2- 172.21.15.17:0/4197605028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2220102b10 0x7f2220100770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.574+0000 7f221e7fc640 1 -- 172.21.15.17:0/4197605028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22201011f0 con 0x7f2220103430 2024-09-20T19:08:51.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.575+0000 7f221e7fc640 1 --2- 172.21.15.17:0/4197605028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2220103430 0x7f2220100cb0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2214009230 tx=0x7f22140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:51.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.575+0000 7f222484e640 1 -- 172.21.15.17:0/4197605028 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f221403f070 con 0x7f2220103430 2024-09-20T19:08:51.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.575+0000 7f222484e640 1 -- 172.21.15.17:0/4197605028 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2214004ac0 con 0x7f2220103430 2024-09-20T19:08:51.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.575+0000 7f2225850640 1 -- 172.21.15.17:0/4197605028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2220101480 con 0x7f2220103430 2024-09-20T19:08:51.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.575+0000 7f222484e640 1 -- 172.21.15.17:0/4197605028 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2214035030 con 0x7f2220103430 2024-09-20T19:08:51.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.575+0000 7f2225850640 1 -- 172.21.15.17:0/4197605028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22201a3e30 con 0x7f2220103430 2024-09-20T19:08:51.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.576+0000 7f2225850640 1 -- 172.21.15.17:0/4197605028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f222006a520 con 0x7f2220103430 2024-09-20T19:08:51.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.577+0000 7f222484e640 1 -- 172.21.15.17:0/4197605028 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2214042070 con 0x7f2220103430 2024-09-20T19:08:51.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.577+0000 7f222484e640 1 --2- 172.21.15.17:0/4197605028 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f220807af90 0x7f220807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:51.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.577+0000 7f222484e640 1 -- 172.21.15.17:0/4197605028 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f22140beb30 con 0x7f2220103430 2024-09-20T19:08:51.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.577+0000 7f221effd640 1 --2- 172.21.15.17:0/4197605028 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f220807af90 0x7f220807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:51.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.578+0000 7f221effd640 1 --2- 172.21.15.17:0/4197605028 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f220807af90 0x7f220807d450 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2210009f20 tx=0x7f22100094f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:51.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.582+0000 7f222484e640 1 -- 172.21.15.17:0/4197605028 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f221408a1b0 con 0x7f2220103430 2024-09-20T19:08:51.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.808+0000 7f2225850640 1 -- 172.21.15.17:0/4197605028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f222002d7c0 con 0x7f2220103430 2024-09-20T19:08:51.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.809+0000 7f222484e640 1 -- 172.21.15.17:0/4197605028 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7f221408f060 con 0x7f2220103430 2024-09-20T19:08:51.812 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:08:51.812 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:08:51.812 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:08:51.813 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:08:51.813 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:08:51.813 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:08:51.813 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:08:51.813 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:08:51.813 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:08:51.813 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:08:51.813 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:08:51.813 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:08:51.813 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:08:51.813 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:08:51.813 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:08:51.813 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:08:51.814 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:08:51.814 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:08:51.814 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:08:51.814 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:08:51.814 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:08:51.814 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:08:51.814 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:08:51.814 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:08:51.814 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:08:51.814 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:08:51.814 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:08:51.814 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:08:51.814 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:08:51.814 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:08:51.815 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:08:51.815 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:08:51.815 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:08:51.815 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:08:51.815 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:08:51.815 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:08:51.815 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:08:51.815 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:08:51.815 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:08:51.815 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:08:51.815 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:08:51.815 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:08:51.815 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:08:51.816 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:08:51.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.812+0000 7f2225850640 1 -- 172.21.15.17:0/4197605028 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f220807af90 msgr2=0x7f220807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:51.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.812+0000 7f2225850640 1 --2- 172.21.15.17:0/4197605028 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f220807af90 0x7f220807d450 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2210009f20 tx=0x7f22100094f0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.812+0000 7f2225850640 1 -- 172.21.15.17:0/4197605028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2220103430 msgr2=0x7f2220100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:51.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.812+0000 7f2225850640 1 --2- 172.21.15.17:0/4197605028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2220103430 0x7f2220100cb0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2214009230 tx=0x7f22140046c0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.812+0000 7f2225850640 1 -- 172.21.15.17:0/4197605028 shutdown_connections 2024-09-20T19:08:51.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.812+0000 7f2225850640 1 --2- 172.21.15.17:0/4197605028 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f220807af90 0x7f220807d450 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.812+0000 7f2225850640 1 --2- 172.21.15.17:0/4197605028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2220103430 0x7f2220100cb0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.812+0000 7f2225850640 1 --2- 172.21.15.17:0/4197605028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2220102b10 0x7f2220100770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.812+0000 7f2225850640 1 -- 172.21.15.17:0/4197605028 >> 172.21.15.17:0/4197605028 conn(0x7f22200fc550 msgr2=0x7f2220103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:51.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.812+0000 7f2225850640 1 -- 172.21.15.17:0/4197605028 shutdown_connections 2024-09-20T19:08:51.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.812+0000 7f2225850640 1 -- 172.21.15.17:0/4197605028 wait complete. 2024-09-20T19:08:51.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.898+0000 7fba4206e640 1 -- 172.21.15.17:0/642779253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba3c105860 msgr2=0x7fba3c105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:51.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.898+0000 7fba4206e640 1 --2- 172.21.15.17:0/642779253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba3c105860 0x7fba3c105c40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009880 tx=0x7fba2c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.898+0000 7fba4206e640 1 -- 172.21.15.17:0/642779253 shutdown_connections 2024-09-20T19:08:51.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.898+0000 7fba4206e640 1 --2- 172.21.15.17:0/642779253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba3c101010 0x7fba3c101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.898+0000 7fba4206e640 1 --2- 172.21.15.17:0/642779253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba3c105860 0x7fba3c105c40 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.898+0000 7fba4206e640 1 -- 172.21.15.17:0/642779253 >> 172.21.15.17:0/642779253 conn(0x7fba3c0fbc90 msgr2=0x7fba3c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:51.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.898+0000 7fba4206e640 1 -- 172.21.15.17:0/642779253 shutdown_connections 2024-09-20T19:08:51.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.899+0000 7fba4206e640 1 -- 172.21.15.17:0/642779253 wait complete. 2024-09-20T19:08:51.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.899+0000 7fba4206e640 1 Processor -- start 2024-09-20T19:08:51.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.899+0000 7fba4206e640 1 -- start start 2024-09-20T19:08:51.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba4206e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba3c101010 0x7fba3c19d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:51.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba4206e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba3c105860 0x7fba3c19dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:51.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba4206e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c10de40 con 0x7fba3c105860 2024-09-20T19:08:51.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba4206e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c10dcc0 con 0x7fba3c101010 2024-09-20T19:08:51.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba3affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba3c105860 0x7fba3c19dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:51.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba3affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba3c105860 0x7fba3c19dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34866/0 (socket says 172.21.15.17:34866) 2024-09-20T19:08:51.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba3affd640 1 -- 172.21.15.17:0/15664945 learned_addr learned my addr 172.21.15.17:0/15664945 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:08:51.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba3b7fe640 1 --2- 172.21.15.17:0/15664945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba3c101010 0x7fba3c19d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:51.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba3affd640 1 -- 172.21.15.17:0/15664945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba3c101010 msgr2=0x7fba3c19d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:51.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba3affd640 1 --2- 172.21.15.17:0/15664945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba3c101010 0x7fba3c19d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:51.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba3affd640 1 -- 172.21.15.17:0/15664945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c197910 con 0x7fba3c105860 2024-09-20T19:08:51.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba3b7fe640 1 --2- 172.21.15.17:0/15664945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba3c101010 0x7fba3c19d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:08:51.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba3affd640 1 --2- 172.21.15.17:0/15664945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba3c105860 0x7fba3c19dc90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fba3000c8f0 tx=0x7fba3000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:51.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba38ff9640 1 -- 172.21.15.17:0/15664945 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba300079b0 con 0x7fba3c105860 2024-09-20T19:08:51.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba38ff9640 1 -- 172.21.15.17:0/15664945 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba300054e0 con 0x7fba3c105860 2024-09-20T19:08:51.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba4206e640 1 -- 172.21.15.17:0/15664945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3c197c00 con 0x7fba3c105860 2024-09-20T19:08:51.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba38ff9640 1 -- 172.21.15.17:0/15664945 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba30004dd0 con 0x7fba3c105860 2024-09-20T19:08:51.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.900+0000 7fba4206e640 1 -- 172.21.15.17:0/15664945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba3c198190 con 0x7fba3c105860 2024-09-20T19:08:51.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.901+0000 7fba4206e640 1 -- 172.21.15.17:0/15664945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba3c102020 con 0x7fba3c105860 2024-09-20T19:08:51.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.902+0000 7fba38ff9640 1 -- 172.21.15.17:0/15664945 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fba30005020 con 0x7fba3c105860 2024-09-20T19:08:51.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.903+0000 7fba38ff9640 1 --2- 172.21.15.17:0/15664945 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fba2407af30 0x7fba2407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:51.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.903+0000 7fba38ff9640 1 -- 172.21.15.17:0/15664945 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fba3009dea0 con 0x7fba3c105860 2024-09-20T19:08:51.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.903+0000 7fba3b7fe640 1 --2- 172.21.15.17:0/15664945 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fba2407af30 0x7fba2407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:51.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.903+0000 7fba3b7fe640 1 --2- 172.21.15.17:0/15664945 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fba2407af30 0x7fba2407d3f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fba2c006010 tx=0x7fba2c004220 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:51.907+0000 7fba38ff9640 1 -- 172.21.15.17:0/15664945 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fba30014030 con 0x7fba3c105860 2024-09-20T19:08:52.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.114+0000 7fba4206e640 1 -- 172.21.15.17:0/15664945 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fba3c109e00 con 0x7fba2407af30 2024-09-20T19:08:52.118 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:52 smithi017 ceph-mon[108970]: from='client.35632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:52.118 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:52 smithi017 ceph-mon[108970]: pgmap v1004: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:52.118 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:52 smithi017 ceph-mon[108970]: from='client.35636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:52.118 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:52 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1622853174' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:08:52.118 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:52 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4197605028' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:08:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.115+0000 7fba38ff9640 1 -- 172.21.15.17:0/15664945 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fba2c004430 con 0x7fba2407af30 2024-09-20T19:08:52.119 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:08:52.119 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:08:52.119 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:08:52.119 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:08:52.119 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:08:52.119 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:08:52.119 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:08:52.119 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:08:52.119 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:08:52.119 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:08:52.120 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:08:52.120 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:08:52.120 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:08:52.120 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:08:52.120 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:08:52.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.117+0000 7fba4206e640 1 -- 172.21.15.17:0/15664945 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fba2407af30 msgr2=0x7fba2407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:52.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.117+0000 7fba4206e640 1 --2- 172.21.15.17:0/15664945 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fba2407af30 0x7fba2407d3f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fba2c006010 tx=0x7fba2c004220 comp rx=0 tx=0).stop 2024-09-20T19:08:52.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.117+0000 7fba4206e640 1 -- 172.21.15.17:0/15664945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba3c105860 msgr2=0x7fba3c19dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:52.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.117+0000 7fba4206e640 1 --2- 172.21.15.17:0/15664945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba3c105860 0x7fba3c19dc90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fba3000c8f0 tx=0x7fba3000cdb0 comp rx=0 tx=0).stop 2024-09-20T19:08:52.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.118+0000 7fba4206e640 1 -- 172.21.15.17:0/15664945 shutdown_connections 2024-09-20T19:08:52.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.118+0000 7fba4206e640 1 --2- 172.21.15.17:0/15664945 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fba2407af30 0x7fba2407d3f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:52.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.118+0000 7fba4206e640 1 --2- 172.21.15.17:0/15664945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba3c105860 0x7fba3c19dc90 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:52.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.118+0000 7fba4206e640 1 --2- 172.21.15.17:0/15664945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba3c101010 0x7fba3c19d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:52.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.118+0000 7fba4206e640 1 -- 172.21.15.17:0/15664945 >> 172.21.15.17:0/15664945 conn(0x7fba3c0fbc90 msgr2=0x7fba3c100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:52.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.118+0000 7fba4206e640 1 -- 172.21.15.17:0/15664945 shutdown_connections 2024-09-20T19:08:52.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.118+0000 7fba4206e640 1 -- 172.21.15.17:0/15664945 wait complete. 2024-09-20T19:08:52.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.202+0000 7f2fca074640 1 -- 172.21.15.17:0/1754666278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fc4107900 msgr2=0x7f2fc4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:52.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.202+0000 7f2fca074640 1 --2- 172.21.15.17:0/1754666278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fc4107900 0x7f2fc4107ce0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009880 tx=0x7f2fb402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:08:52.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.202+0000 7f2fca074640 1 -- 172.21.15.17:0/1754666278 shutdown_connections 2024-09-20T19:08:52.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.202+0000 7f2fca074640 1 --2- 172.21.15.17:0/1754666278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fc4101900 0x7f2fc4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:52.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.202+0000 7f2fca074640 1 --2- 172.21.15.17:0/1754666278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fc4107900 0x7f2fc4107ce0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:52.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.202+0000 7f2fca074640 1 -- 172.21.15.17:0/1754666278 >> 172.21.15.17:0/1754666278 conn(0x7f2fc40fd600 msgr2=0x7f2fc40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:52.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.202+0000 7f2fca074640 1 -- 172.21.15.17:0/1754666278 shutdown_connections 2024-09-20T19:08:52.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.203+0000 7f2fca074640 1 -- 172.21.15.17:0/1754666278 wait complete. 2024-09-20T19:08:52.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.203+0000 7f2fca074640 1 Processor -- start 2024-09-20T19:08:52.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.203+0000 7f2fca074640 1 -- start start 2024-09-20T19:08:52.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.204+0000 7f2fca074640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fc4101900 0x7f2fc419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:52.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.204+0000 7f2fca074640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fc4107900 0x7f2fc419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:52.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.204+0000 7f2fca074640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc410ee30 con 0x7f2fc4107900 2024-09-20T19:08:52.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.204+0000 7f2fca074640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc410ecb0 con 0x7f2fc4101900 2024-09-20T19:08:52.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.204+0000 7f2fc2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fc4107900 0x7f2fc419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:52.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.204+0000 7f2fc2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fc4107900 0x7f2fc419dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34894/0 (socket says 172.21.15.17:34894) 2024-09-20T19:08:52.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.204+0000 7f2fc2ffd640 1 -- 172.21.15.17:0/1191688365 learned_addr learned my addr 172.21.15.17:0/1191688365 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:08:52.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.204+0000 7f2fc37fe640 1 --2- 172.21.15.17:0/1191688365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fc4101900 0x7f2fc419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:52.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.204+0000 7f2fc2ffd640 1 -- 172.21.15.17:0/1191688365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fc4101900 msgr2=0x7f2fc419d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:52.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.204+0000 7f2fc2ffd640 1 --2- 172.21.15.17:0/1191688365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fc4101900 0x7f2fc419d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:52.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.204+0000 7f2fc2ffd640 1 -- 172.21.15.17:0/1191688365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc4197860 con 0x7f2fc4107900 2024-09-20T19:08:52.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.204+0000 7f2fc2ffd640 1 --2- 172.21.15.17:0/1191688365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fc4107900 0x7f2fc419dbe0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800b420 tx=0x7f2fb800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:52.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.204+0000 7f2fc0ff9640 1 -- 172.21.15.17:0/1191688365 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fb8011630 con 0x7f2fc4107900 2024-09-20T19:08:52.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.204+0000 7f2fc0ff9640 1 -- 172.21.15.17:0/1191688365 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2fb8016070 con 0x7f2fc4107900 2024-09-20T19:08:52.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.204+0000 7f2fc0ff9640 1 -- 172.21.15.17:0/1191688365 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fb8010d40 con 0x7f2fc4107900 2024-09-20T19:08:52.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.204+0000 7f2fca074640 1 -- 172.21.15.17:0/1191688365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc4197b50 con 0x7f2fc4107900 2024-09-20T19:08:52.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.205+0000 7f2fca074640 1 -- 172.21.15.17:0/1191688365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc41980e0 con 0x7f2fc4107900 2024-09-20T19:08:52.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.205+0000 7f2fca074640 1 -- 172.21.15.17:0/1191688365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc4103040 con 0x7f2fc4107900 2024-09-20T19:08:52.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.206+0000 7f2fc0ff9640 1 -- 172.21.15.17:0/1191688365 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2fb801b460 con 0x7f2fc4107900 2024-09-20T19:08:52.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.207+0000 7f2fc0ff9640 1 --2- 172.21.15.17:0/1191688365 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2fac07af40 0x7f2fac07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:08:52.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.207+0000 7f2fc0ff9640 1 -- 172.21.15.17:0/1191688365 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f2fb809d740 con 0x7f2fc4107900 2024-09-20T19:08:52.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.207+0000 7f2fc37fe640 1 --2- 172.21.15.17:0/1191688365 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2fac07af40 0x7f2fac07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:08:52.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.207+0000 7f2fc37fe640 1 --2- 172.21.15.17:0/1191688365 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2fac07af40 0x7f2fac07d400 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4000c00 tx=0x7f2fb4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:08:52.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.211+0000 7f2fc0ff9640 1 -- 172.21.15.17:0/1191688365 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2fb8021250 con 0x7f2fc4107900 2024-09-20T19:08:52.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:52 smithi172 ceph-mon[80431]: from='client.35632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:52.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:52 smithi172 ceph-mon[80431]: pgmap v1004: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:52.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:52 smithi172 ceph-mon[80431]: from='client.35636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:52.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:52 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1622853174' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:08:52.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:52 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4197605028' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:08:52.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.473+0000 7f2fca074640 1 -- 172.21.15.17:0/1191688365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f2fc4198d90 con 0x7f2fc4107900 2024-09-20T19:08:52.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.474+0000 7f2fc0ff9640 1 -- 172.21.15.17:0/1191688365 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f2fb8068d40 con 0x7f2fc4107900 2024-09-20T19:08:52.477 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:08:52.477 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:08:52.477 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:08:52.477 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:08:52.477 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:08:52.477 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:08:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:08:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:08:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:08:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:08:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:08:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:08:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:08:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:08:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:08:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:08:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:08:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:08:52.478 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:08:52.478 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:08:52.479 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:08:52.479 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:08:52.479 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:08:52.479 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:08:52.479 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:08:52.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.477+0000 7f2fca074640 1 -- 172.21.15.17:0/1191688365 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2fac07af40 msgr2=0x7f2fac07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:52.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.477+0000 7f2fca074640 1 --2- 172.21.15.17:0/1191688365 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2fac07af40 0x7f2fac07d400 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4000c00 tx=0x7f2fb4031400 comp rx=0 tx=0).stop 2024-09-20T19:08:52.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.477+0000 7f2fca074640 1 -- 172.21.15.17:0/1191688365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fc4107900 msgr2=0x7f2fc419dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:08:52.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.477+0000 7f2fca074640 1 --2- 172.21.15.17:0/1191688365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fc4107900 0x7f2fc419dbe0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800b420 tx=0x7f2fb800b8e0 comp rx=0 tx=0).stop 2024-09-20T19:08:52.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.477+0000 7f2fca074640 1 -- 172.21.15.17:0/1191688365 shutdown_connections 2024-09-20T19:08:52.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.477+0000 7f2fca074640 1 --2- 172.21.15.17:0/1191688365 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2fac07af40 0x7f2fac07d400 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:52.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.477+0000 7f2fca074640 1 --2- 172.21.15.17:0/1191688365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fc4107900 0x7f2fc419dbe0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:52.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.477+0000 7f2fca074640 1 --2- 172.21.15.17:0/1191688365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fc4101900 0x7f2fc419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:08:52.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.477+0000 7f2fca074640 1 -- 172.21.15.17:0/1191688365 >> 172.21.15.17:0/1191688365 conn(0x7f2fc40fd600 msgr2=0x7f2fc40fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:08:52.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.477+0000 7f2fca074640 1 -- 172.21.15.17:0/1191688365 shutdown_connections 2024-09-20T19:08:52.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:08:52.477+0000 7f2fca074640 1 -- 172.21.15.17:0/1191688365 wait complete. 2024-09-20T19:08:53.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:53 smithi172 ceph-mon[80431]: from='client.35640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:53.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:53 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:08:53.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:53 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1191688365' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:08:53.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:53 smithi017 ceph-mon[108970]: from='client.35640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:53.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:53 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:08:53.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:53 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1191688365' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:08:54.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:54 smithi017 ceph-mon[108970]: from='client.35652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:54.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:54 smithi017 ceph-mon[108970]: pgmap v1005: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:54.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:54 smithi172 ceph-mon[80431]: from='client.35652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:08:54.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:54 smithi172 ceph-mon[80431]: pgmap v1005: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:56.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:56 smithi017 ceph-mon[108970]: pgmap v1006: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:56.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:56 smithi172 ceph-mon[80431]: pgmap v1006: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:58.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:08:58 smithi017 ceph-mon[108970]: pgmap v1007: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:08:58.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:08:58 smithi172 ceph-mon[80431]: pgmap v1007: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:00.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:00 smithi017 ceph-mon[108970]: pgmap v1008: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:00.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:00 smithi172 ceph-mon[80431]: pgmap v1008: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:02.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:02 smithi017 ceph-mon[108970]: pgmap v1009: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:02.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:02 smithi172 ceph-mon[80431]: pgmap v1009: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:04.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:04 smithi017 ceph-mon[108970]: pgmap v1010: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:04.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:04 smithi172 ceph-mon[80431]: pgmap v1010: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:06.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:06 smithi017 ceph-mon[108970]: pgmap v1011: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:06.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:06 smithi172 ceph-mon[80431]: pgmap v1011: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:08.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:08 smithi017 ceph-mon[108970]: pgmap v1012: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:08.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:09:08.449 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:08 smithi172 ceph-mon[80431]: pgmap v1012: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:08.450 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:09:10.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:10 smithi017 ceph-mon[108970]: pgmap v1013: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:10.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:10 smithi172 ceph-mon[80431]: pgmap v1013: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:11.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:11 smithi017 ceph-mon[108970]: pgmap v1014: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:11.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:11 smithi172 ceph-mon[80431]: pgmap v1014: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:13.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:13 smithi017 ceph-mon[108970]: pgmap v1015: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:14.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:13 smithi172 ceph-mon[80431]: pgmap v1015: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:16.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:15 smithi017 ceph-mon[108970]: pgmap v1016: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:16.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:15 smithi172 ceph-mon[80431]: pgmap v1016: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:18.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:17 smithi017 ceph-mon[108970]: pgmap v1017: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:18.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:17 smithi172 ceph-mon[80431]: pgmap v1017: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:19.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:19 smithi017 ceph-mon[108970]: pgmap v1018: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:20.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:19 smithi172 ceph-mon[80431]: pgmap v1018: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:22.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:21 smithi017 ceph-mon[108970]: pgmap v1019: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:22.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:21 smithi172 ceph-mon[80431]: pgmap v1019: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:22.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.574+0000 7f0c5d10a640 1 -- 172.21.15.17:0/585316777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c58101900 msgr2=0x7f0c58101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:22.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.574+0000 7f0c5d10a640 1 --2- 172.21.15.17:0/585316777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c58101900 0x7f0c58101d60 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009880 tx=0x7f0c4c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:22.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.574+0000 7f0c5d10a640 1 -- 172.21.15.17:0/585316777 shutdown_connections 2024-09-20T19:09:22.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.574+0000 7f0c5d10a640 1 --2- 172.21.15.17:0/585316777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c58101900 0x7f0c58101d60 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:22.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.574+0000 7f0c5d10a640 1 --2- 172.21.15.17:0/585316777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c58107900 0x7f0c58107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:22.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.574+0000 7f0c5d10a640 1 -- 172.21.15.17:0/585316777 >> 172.21.15.17:0/585316777 conn(0x7f0c580fd600 msgr2=0x7f0c580ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:22.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.575+0000 7f0c5d10a640 1 -- 172.21.15.17:0/585316777 shutdown_connections 2024-09-20T19:09:22.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.575+0000 7f0c5d10a640 1 -- 172.21.15.17:0/585316777 wait complete. 2024-09-20T19:09:22.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.575+0000 7f0c5d10a640 1 Processor -- start 2024-09-20T19:09:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.576+0000 7f0c5d10a640 1 -- start start 2024-09-20T19:09:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.576+0000 7f0c5d10a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c58101900 0x7f0c5819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.576+0000 7f0c5d10a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c58107900 0x7f0c5819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.576+0000 7f0c5d10a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5810edd0 con 0x7f0c58107900 2024-09-20T19:09:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.576+0000 7f0c5d10a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5810ec50 con 0x7f0c58101900 2024-09-20T19:09:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.576+0000 7f0c5659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c58107900 0x7f0c5819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:22.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.576+0000 7f0c5659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c58107900 0x7f0c5819db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43034/0 (socket says 172.21.15.17:43034) 2024-09-20T19:09:22.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.576+0000 7f0c5659c640 1 -- 172.21.15.17:0/773164486 learned_addr learned my addr 172.21.15.17:0/773164486 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:09:22.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.576+0000 7f0c56d9d640 1 --2- 172.21.15.17:0/773164486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c58101900 0x7f0c5819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:22.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.576+0000 7f0c5659c640 1 -- 172.21.15.17:0/773164486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c58101900 msgr2=0x7f0c5819d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:22.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.576+0000 7f0c5659c640 1 --2- 172.21.15.17:0/773164486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c58101900 0x7f0c5819d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:22.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.576+0000 7f0c5659c640 1 -- 172.21.15.17:0/773164486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c581977a0 con 0x7f0c58107900 2024-09-20T19:09:22.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.577+0000 7f0c5659c640 1 --2- 172.21.15.17:0/773164486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c58107900 0x7f0c5819db60 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c031460 tx=0x7f0c4c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:22.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.577+0000 7f0c3ffff640 1 -- 172.21.15.17:0/773164486 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c4c03f070 con 0x7f0c58107900 2024-09-20T19:09:22.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.577+0000 7f0c3ffff640 1 -- 172.21.15.17:0/773164486 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0c4c0035f0 con 0x7f0c58107900 2024-09-20T19:09:22.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.577+0000 7f0c5d10a640 1 -- 172.21.15.17:0/773164486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c58197a30 con 0x7f0c58107900 2024-09-20T19:09:22.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.577+0000 7f0c3ffff640 1 -- 172.21.15.17:0/773164486 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c4c035030 con 0x7f0c58107900 2024-09-20T19:09:22.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.577+0000 7f0c5d10a640 1 -- 172.21.15.17:0/773164486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c58197f60 con 0x7f0c58107900 2024-09-20T19:09:22.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.578+0000 7f0c5d10a640 1 -- 172.21.15.17:0/773164486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c58103040 con 0x7f0c58107900 2024-09-20T19:09:22.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.579+0000 7f0c3ffff640 1 -- 172.21.15.17:0/773164486 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0c4c042070 con 0x7f0c58107900 2024-09-20T19:09:22.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.579+0000 7f0c3ffff640 1 --2- 172.21.15.17:0/773164486 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0c4007af30 0x7f0c4007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:22.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.579+0000 7f0c3ffff640 1 -- 172.21.15.17:0/773164486 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f0c4c0be970 con 0x7f0c58107900 2024-09-20T19:09:22.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.579+0000 7f0c56d9d640 1 --2- 172.21.15.17:0/773164486 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0c4007af30 0x7f0c4007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:22.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.580+0000 7f0c56d9d640 1 --2- 172.21.15.17:0/773164486 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0c4007af30 0x7f0c4007d3f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0c48005fd0 tx=0x7f0c4800b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:22.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.584+0000 7f0c3ffff640 1 -- 172.21.15.17:0/773164486 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0c4c0c0e20 con 0x7f0c58107900 2024-09-20T19:09:22.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.790+0000 7f0c5d10a640 1 -- 172.21.15.17:0/773164486 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0c58198210 con 0x7f0c4007af30 2024-09-20T19:09:22.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.792+0000 7f0c3ffff640 1 -- 172.21.15.17:0/773164486 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f0c58198210 con 0x7f0c4007af30 2024-09-20T19:09:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.794+0000 7f0c5d10a640 1 -- 172.21.15.17:0/773164486 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0c4007af30 msgr2=0x7f0c4007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.794+0000 7f0c5d10a640 1 --2- 172.21.15.17:0/773164486 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0c4007af30 0x7f0c4007d3f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0c48005fd0 tx=0x7f0c4800b390 comp rx=0 tx=0).stop 2024-09-20T19:09:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.794+0000 7f0c5d10a640 1 -- 172.21.15.17:0/773164486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c58107900 msgr2=0x7f0c5819db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:22.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.794+0000 7f0c5d10a640 1 --2- 172.21.15.17:0/773164486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c58107900 0x7f0c5819db60 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c031460 tx=0x7f0c4c0045e0 comp rx=0 tx=0).stop 2024-09-20T19:09:22.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.794+0000 7f0c5d10a640 1 -- 172.21.15.17:0/773164486 shutdown_connections 2024-09-20T19:09:22.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.794+0000 7f0c5d10a640 1 --2- 172.21.15.17:0/773164486 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0c4007af30 0x7f0c4007d3f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:22.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.794+0000 7f0c5d10a640 1 --2- 172.21.15.17:0/773164486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c58107900 0x7f0c5819db60 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:22.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.794+0000 7f0c5d10a640 1 --2- 172.21.15.17:0/773164486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c58101900 0x7f0c5819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:22.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.794+0000 7f0c5d10a640 1 -- 172.21.15.17:0/773164486 >> 172.21.15.17:0/773164486 conn(0x7f0c580fd600 msgr2=0x7f0c580fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:22.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.794+0000 7f0c5d10a640 1 -- 172.21.15.17:0/773164486 shutdown_connections 2024-09-20T19:09:22.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.794+0000 7f0c5d10a640 1 -- 172.21.15.17:0/773164486 wait complete. 2024-09-20T19:09:22.807 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:09:22.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.882+0000 7f47cd0bf640 1 -- 172.21.15.17:0/3724188686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47c8101070 msgr2=0x7f47c810dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:22.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.882+0000 7f47cd0bf640 1 --2- 172.21.15.17:0/3724188686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47c8101070 0x7f47c810dd30 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009880 tx=0x7f47b002a490 comp rx=0 tx=0).stop 2024-09-20T19:09:22.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.882+0000 7f47cd0bf640 1 -- 172.21.15.17:0/3724188686 shutdown_connections 2024-09-20T19:09:22.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.882+0000 7f47cd0bf640 1 --2- 172.21.15.17:0/3724188686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47c8101070 0x7f47c810dd30 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:22.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.882+0000 7f47cd0bf640 1 --2- 172.21.15.17:0/3724188686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c81006c0 0x7f47c8100aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:22.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:09:22.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.883+0000 7f47cd0bf640 1 -- 172.21.15.17:0/3724188686 >> 172.21.15.17:0/3724188686 conn(0x7f47c80fc550 msgr2=0x7f47c80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:22.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.883+0000 7f47cd0bf640 1 -- 172.21.15.17:0/3724188686 shutdown_connections 2024-09-20T19:09:22.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.883+0000 7f47cd0bf640 1 -- 172.21.15.17:0/3724188686 wait complete. 2024-09-20T19:09:22.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.883+0000 7f47cd0bf640 1 Processor -- start 2024-09-20T19:09:22.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.884+0000 7f47cd0bf640 1 -- start start 2024-09-20T19:09:22.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.884+0000 7f47cd0bf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c81006c0 0x7f47c819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:22.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.884+0000 7f47cd0bf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47c8101070 0x7f47c819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:22.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.884+0000 7f47cd0bf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f47c8110f80 con 0x7f47c8101070 2024-09-20T19:09:22.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.884+0000 7f47cd0bf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f47c8110e00 con 0x7f47c81006c0 2024-09-20T19:09:22.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.884+0000 7f47c659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47c8101070 0x7f47c819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:22.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.884+0000 7f47c659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47c8101070 0x7f47c819fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43052/0 (socket says 172.21.15.17:43052) 2024-09-20T19:09:22.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.884+0000 7f47c659c640 1 -- 172.21.15.17:0/682042378 learned_addr learned my addr 172.21.15.17:0/682042378 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:09:22.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.884+0000 7f47c6d9d640 1 --2- 172.21.15.17:0/682042378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c81006c0 0x7f47c819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:22.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.884+0000 7f47c659c640 1 -- 172.21.15.17:0/682042378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c81006c0 msgr2=0x7f47c819f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:22.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.884+0000 7f47c659c640 1 --2- 172.21.15.17:0/682042378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c81006c0 0x7f47c819f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:22.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.884+0000 7f47c659c640 1 -- 172.21.15.17:0/682042378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c81999d0 con 0x7f47c8101070 2024-09-20T19:09:22.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.885+0000 7f47c659c640 1 --2- 172.21.15.17:0/682042378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47c8101070 0x7f47c819fd50 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f47b0031460 tx=0x7f47b0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:22.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.885+0000 7f47bffff640 1 -- 172.21.15.17:0/682042378 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47b003f070 con 0x7f47c8101070 2024-09-20T19:09:22.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.885+0000 7f47cd0bf640 1 -- 172.21.15.17:0/682042378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c8199c60 con 0x7f47c8101070 2024-09-20T19:09:22.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.885+0000 7f47bffff640 1 -- 172.21.15.17:0/682042378 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f47b00035f0 con 0x7f47c8101070 2024-09-20T19:09:22.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.885+0000 7f47bffff640 1 -- 172.21.15.17:0/682042378 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47b0035030 con 0x7f47c8101070 2024-09-20T19:09:22.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.885+0000 7f47cd0bf640 1 -- 172.21.15.17:0/682042378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c819a1f0 con 0x7f47c8101070 2024-09-20T19:09:22.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.886+0000 7f47cd0bf640 1 -- 172.21.15.17:0/682042378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c806a500 con 0x7f47c8101070 2024-09-20T19:09:22.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.887+0000 7f47bffff640 1 -- 172.21.15.17:0/682042378 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f47b0042070 con 0x7f47c8101070 2024-09-20T19:09:22.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.887+0000 7f47bffff640 1 --2- 172.21.15.17:0/682042378 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f47b407af80 0x7f47b407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:22.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.888+0000 7f47bffff640 1 -- 172.21.15.17:0/682042378 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f47b00be830 con 0x7f47c8101070 2024-09-20T19:09:22.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.888+0000 7f47c6d9d640 1 --2- 172.21.15.17:0/682042378 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f47b407af80 0x7f47b407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:22.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.888+0000 7f47c6d9d640 1 --2- 172.21.15.17:0/682042378 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f47b407af80 0x7f47b407d440 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f47c819ab10 tx=0x7f47c0005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:22.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:22.892+0000 7f47bffff640 1 -- 172.21.15.17:0/682042378 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f47b0089eb0 con 0x7f47c8101070 2024-09-20T19:09:23.099 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:09:23.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.100+0000 7f47cd0bf640 1 -- 172.21.15.17:0/682042378 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f47c810b480 con 0x7f47b407af80 2024-09-20T19:09:23.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.102+0000 7f47bffff640 1 -- 172.21.15.17:0/682042378 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f47c001b3f0 con 0x7f47b407af80 2024-09-20T19:09:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.104+0000 7f47cd0bf640 1 -- 172.21.15.17:0/682042378 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f47b407af80 msgr2=0x7f47b407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.104+0000 7f47cd0bf640 1 --2- 172.21.15.17:0/682042378 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f47b407af80 0x7f47b407d440 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f47c819ab10 tx=0x7f47c0005f90 comp rx=0 tx=0).stop 2024-09-20T19:09:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.104+0000 7f47cd0bf640 1 -- 172.21.15.17:0/682042378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47c8101070 msgr2=0x7f47c819fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.104+0000 7f47cd0bf640 1 --2- 172.21.15.17:0/682042378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47c8101070 0x7f47c819fd50 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f47b0031460 tx=0x7f47b0004530 comp rx=0 tx=0).stop 2024-09-20T19:09:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.104+0000 7f47cd0bf640 1 -- 172.21.15.17:0/682042378 shutdown_connections 2024-09-20T19:09:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.104+0000 7f47cd0bf640 1 --2- 172.21.15.17:0/682042378 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f47b407af80 0x7f47b407d440 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.104+0000 7f47cd0bf640 1 --2- 172.21.15.17:0/682042378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47c8101070 0x7f47c819fd50 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.104+0000 7f47cd0bf640 1 --2- 172.21.15.17:0/682042378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c81006c0 0x7f47c819f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.104+0000 7f47cd0bf640 1 -- 172.21.15.17:0/682042378 >> 172.21.15.17:0/682042378 conn(0x7f47c80fc550 msgr2=0x7f47c80fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.104+0000 7f47cd0bf640 1 -- 172.21.15.17:0/682042378 shutdown_connections 2024-09-20T19:09:23.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.104+0000 7f47cd0bf640 1 -- 172.21.15.17:0/682042378 wait complete. 2024-09-20T19:09:23.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.188+0000 7f43d8389640 1 -- 172.21.15.17:0/2183717327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d0100800 msgr2=0x7f43d0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:23.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.188+0000 7f43d8389640 1 --2- 172.21.15.17:0/2183717327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d0100800 0x7f43d0100c60 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009880 tx=0x7f43cc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.188+0000 7f43d8389640 1 -- 172.21.15.17:0/2183717327 shutdown_connections 2024-09-20T19:09:23.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.188+0000 7f43d8389640 1 --2- 172.21.15.17:0/2183717327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d0100800 0x7f43d0100c60 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.188+0000 7f43d8389640 1 --2- 172.21.15.17:0/2183717327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d0106800 0x7f43d0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.188+0000 7f43d8389640 1 -- 172.21.15.17:0/2183717327 >> 172.21.15.17:0/2183717327 conn(0x7f43d00fc520 msgr2=0x7f43d00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:23.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.188+0000 7f43d8389640 1 -- 172.21.15.17:0/2183717327 shutdown_connections 2024-09-20T19:09:23.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.188+0000 7f43d8389640 1 -- 172.21.15.17:0/2183717327 wait complete. 2024-09-20T19:09:23.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.189+0000 7f43d8389640 1 Processor -- start 2024-09-20T19:09:23.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.189+0000 7f43d8389640 1 -- start start 2024-09-20T19:09:23.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.189+0000 7f43d8389640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d0100800 0x7f43d019f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:23.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.189+0000 7f43d8389640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d0106800 0x7f43d019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:23.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.189+0000 7f43d8389640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f43d010dcb0 con 0x7f43d0100800 2024-09-20T19:09:23.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.189+0000 7f43d8389640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f43d010db30 con 0x7f43d0106800 2024-09-20T19:09:23.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.189+0000 7f43d6125640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d0100800 0x7f43d019f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:23.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.189+0000 7f43d6125640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d0100800 0x7f43d019f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43074/0 (socket says 172.21.15.17:43074) 2024-09-20T19:09:23.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.189+0000 7f43d6125640 1 -- 172.21.15.17:0/2446098096 learned_addr learned my addr 172.21.15.17:0/2446098096 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:09:23.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.190+0000 7f43d5924640 1 --2- 172.21.15.17:0/2446098096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d0106800 0x7f43d019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:23.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.190+0000 7f43d6125640 1 -- 172.21.15.17:0/2446098096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d0106800 msgr2=0x7f43d019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:23.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.190+0000 7f43d6125640 1 --2- 172.21.15.17:0/2446098096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d0106800 0x7f43d019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.190+0000 7f43d6125640 1 -- 172.21.15.17:0/2446098096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d01a03f0 con 0x7f43d0100800 2024-09-20T19:09:23.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.190+0000 7f43d5924640 1 --2- 172.21.15.17:0/2446098096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d0106800 0x7f43d019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:09:23.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.190+0000 7f43d6125640 1 --2- 172.21.15.17:0/2446098096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d0100800 0x7f43d019f800 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f43c400c8a0 tx=0x7f43c400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:23.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.190+0000 7f43c37fe640 1 -- 172.21.15.17:0/2446098096 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f43c40079b0 con 0x7f43d0100800 2024-09-20T19:09:23.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.190+0000 7f43c37fe640 1 -- 172.21.15.17:0/2446098096 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f43c4007b50 con 0x7f43d0100800 2024-09-20T19:09:23.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.190+0000 7f43d8389640 1 -- 172.21.15.17:0/2446098096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d0199ae0 con 0x7f43d0100800 2024-09-20T19:09:23.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.190+0000 7f43c37fe640 1 -- 172.21.15.17:0/2446098096 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f43c4018700 con 0x7f43d0100800 2024-09-20T19:09:23.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.190+0000 7f43d8389640 1 -- 172.21.15.17:0/2446098096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d019a040 con 0x7f43d0100800 2024-09-20T19:09:23.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.191+0000 7f43d8389640 1 -- 172.21.15.17:0/2446098096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43d0101f40 con 0x7f43d0100800 2024-09-20T19:09:23.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.192+0000 7f43c37fe640 1 -- 172.21.15.17:0/2446098096 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f43c4007d00 con 0x7f43d0100800 2024-09-20T19:09:23.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.192+0000 7f43c37fe640 1 --2- 172.21.15.17:0/2446098096 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43bc07af30 0x7f43bc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:23.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.192+0000 7f43c37fe640 1 -- 172.21.15.17:0/2446098096 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f43c409e280 con 0x7f43d0100800 2024-09-20T19:09:23.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.192+0000 7f43d5924640 1 --2- 172.21.15.17:0/2446098096 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43bc07af30 0x7f43bc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:23.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.193+0000 7f43d5924640 1 --2- 172.21.15.17:0/2446098096 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43bc07af30 0x7f43bc07d3f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f43d019b1b0 tx=0x7f43cc009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.197+0000 7f43c37fe640 1 -- 172.21.15.17:0/2446098096 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43c4014030 con 0x7f43d0100800 2024-09-20T19:09:23.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.391+0000 7f43d8389640 1 -- 172.21.15.17:0/2446098096 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f43d019a380 con 0x7f43bc07af30 2024-09-20T19:09:23.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.400+0000 7f43c37fe640 1 -- 172.21.15.17:0/2446098096 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f43d019a380 con 0x7f43bc07af30 2024-09-20T19:09:23.405 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:09:23.405 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (30m) 9m ago 41m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:09:23.405 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (33m) 9m ago 41m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:09:23.405 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (33m) 9m ago 41m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:09:23.405 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (29m) 9m ago 41m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:09:23.405 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (29m) 9m ago 41m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:09:23.405 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (30m) 9m ago 41m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:09:23.405 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (25m) 9m ago 36m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:09:23.406 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (25m) 9m ago 36m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:09:23.406 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (9m) 9m ago 36m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:09:23.406 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (24m) 9m ago 36m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:09:23.406 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (32m) 9m ago 42m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:09:23.406 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (31m) 9m ago 40m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:09:23.406 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (29m) 9m ago 43m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:09:23.406 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (29m) 9m ago 40m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:09:23.406 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (31m) 9m ago 41m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:09:23.406 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (31m) 9m ago 40m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:09:23.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (28m) 9m ago 39m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:09:23.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (28m) 9m ago 39m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:09:23.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (27m) 9m ago 38m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:09:23.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (26m) 9m ago 38m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:09:23.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (26m) 9m ago 37m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:09:23.407 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (25m) 9m ago 37m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:09:23.407 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (31m) 9m ago 41m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:09:23.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.402+0000 7f43d8389640 1 -- 172.21.15.17:0/2446098096 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43bc07af30 msgr2=0x7f43bc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:23.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.402+0000 7f43d8389640 1 --2- 172.21.15.17:0/2446098096 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43bc07af30 0x7f43bc07d3f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f43d019b1b0 tx=0x7f43cc009560 comp rx=0 tx=0).stop 2024-09-20T19:09:23.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.402+0000 7f43d8389640 1 -- 172.21.15.17:0/2446098096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d0100800 msgr2=0x7f43d019f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:23.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.402+0000 7f43d8389640 1 --2- 172.21.15.17:0/2446098096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d0100800 0x7f43d019f800 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f43c400c8a0 tx=0x7f43c400cd60 comp rx=0 tx=0).stop 2024-09-20T19:09:23.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.403+0000 7f43d8389640 1 -- 172.21.15.17:0/2446098096 shutdown_connections 2024-09-20T19:09:23.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.403+0000 7f43d8389640 1 --2- 172.21.15.17:0/2446098096 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f43bc07af30 0x7f43bc07d3f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.403+0000 7f43d8389640 1 --2- 172.21.15.17:0/2446098096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d0106800 0x7f43d019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.403+0000 7f43d8389640 1 --2- 172.21.15.17:0/2446098096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d0100800 0x7f43d019f800 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.403+0000 7f43d8389640 1 -- 172.21.15.17:0/2446098096 >> 172.21.15.17:0/2446098096 conn(0x7f43d00fc520 msgr2=0x7f43d00fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:23.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.403+0000 7f43d8389640 1 -- 172.21.15.17:0/2446098096 shutdown_connections 2024-09-20T19:09:23.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.403+0000 7f43d8389640 1 -- 172.21.15.17:0/2446098096 wait complete. 2024-09-20T19:09:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.485+0000 7fa14f20c640 1 -- 172.21.15.17:0/956359255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1481033e0 msgr2=0x7fa14810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.485+0000 7fa14f20c640 1 --2- 172.21.15.17:0/956359255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1481033e0 0x7fa14810b8d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa138009880 tx=0x7fa13802a530 comp rx=0 tx=0).stop 2024-09-20T19:09:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.485+0000 7fa14f20c640 1 -- 172.21.15.17:0/956359255 shutdown_connections 2024-09-20T19:09:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.485+0000 7fa14f20c640 1 --2- 172.21.15.17:0/956359255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1481033e0 0x7fa14810b8d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.486+0000 7fa14f20c640 1 --2- 172.21.15.17:0/956359255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa148102ac0 0x7fa148102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.486+0000 7fa14f20c640 1 -- 172.21.15.17:0/956359255 >> 172.21.15.17:0/956359255 conn(0x7fa1480fc520 msgr2=0x7fa1480fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:23.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.486+0000 7fa14f20c640 1 -- 172.21.15.17:0/956359255 shutdown_connections 2024-09-20T19:09:23.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.486+0000 7fa14f20c640 1 -- 172.21.15.17:0/956359255 wait complete. 2024-09-20T19:09:23.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.486+0000 7fa14f20c640 1 Processor -- start 2024-09-20T19:09:23.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.486+0000 7fa14f20c640 1 -- start start 2024-09-20T19:09:23.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.487+0000 7fa14f20c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa148102ac0 0x7fa148100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:23.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.487+0000 7fa14f20c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1481033e0 0x7fa148100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:23.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.487+0000 7fa14f20c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa14810edf0 con 0x7fa148102ac0 2024-09-20T19:09:23.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.487+0000 7fa14f20c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa14810ec70 con 0x7fa1481033e0 2024-09-20T19:09:23.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.487+0000 7fa14cfa8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa148102ac0 0x7fa148100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.487+0000 7fa14cfa8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa148102ac0 0x7fa148100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43092/0 (socket says 172.21.15.17:43092) 2024-09-20T19:09:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.487+0000 7fa14cfa8640 1 -- 172.21.15.17:0/3429866604 learned_addr learned my addr 172.21.15.17:0/3429866604 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:09:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.487+0000 7fa147fff640 1 --2- 172.21.15.17:0/3429866604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1481033e0 0x7fa148100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.487+0000 7fa14cfa8640 1 -- 172.21.15.17:0/3429866604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1481033e0 msgr2=0x7fa148100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.487+0000 7fa14cfa8640 1 --2- 172.21.15.17:0/3429866604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1481033e0 0x7fa148100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.487+0000 7fa14cfa8640 1 -- 172.21.15.17:0/3429866604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1481011a0 con 0x7fa148102ac0 2024-09-20T19:09:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.487+0000 7fa14cfa8640 1 --2- 172.21.15.17:0/3429866604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa148102ac0 0x7fa148100720 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fa13000c8f0 tx=0x7fa13000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.488+0000 7fa145ffb640 1 -- 172.21.15.17:0/3429866604 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa1300079b0 con 0x7fa148102ac0 2024-09-20T19:09:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.488+0000 7fa145ffb640 1 -- 172.21.15.17:0/3429866604 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa1300054e0 con 0x7fa148102ac0 2024-09-20T19:09:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.488+0000 7fa14f20c640 1 -- 172.21.15.17:0/3429866604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa148101490 con 0x7fa148102ac0 2024-09-20T19:09:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.488+0000 7fa145ffb640 1 -- 172.21.15.17:0/3429866604 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa130004dd0 con 0x7fa148102ac0 2024-09-20T19:09:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.488+0000 7fa14f20c640 1 -- 172.21.15.17:0/3429866604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1481a3e80 con 0x7fa148102ac0 2024-09-20T19:09:23.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.489+0000 7fa14f20c640 1 -- 172.21.15.17:0/3429866604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa14806aa90 con 0x7fa148102ac0 2024-09-20T19:09:23.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.490+0000 7fa145ffb640 1 -- 172.21.15.17:0/3429866604 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa130005020 con 0x7fa148102ac0 2024-09-20T19:09:23.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.491+0000 7fa145ffb640 1 --2- 172.21.15.17:0/3429866604 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa13407af40 0x7fa13407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:23.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.491+0000 7fa145ffb640 1 -- 172.21.15.17:0/3429866604 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fa13009df90 con 0x7fa148102ac0 2024-09-20T19:09:23.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.491+0000 7fa147fff640 1 --2- 172.21.15.17:0/3429866604 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa13407af40 0x7fa13407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:23.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.491+0000 7fa147fff640 1 --2- 172.21.15.17:0/3429866604 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa13407af40 0x7fa13407d400 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa1481021b0 tx=0x7fa138009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:23.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.497+0000 7fa145ffb640 1 -- 172.21.15.17:0/3429866604 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa130014030 con 0x7fa148102ac0 2024-09-20T19:09:23.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.762+0000 7fa14f20c640 1 -- 172.21.15.17:0/3429866604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa148105f60 con 0x7fa148102ac0 2024-09-20T19:09:23.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.762+0000 7fa145ffb640 1 -- 172.21.15.17:0/3429866604 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fa130069570 con 0x7fa148102ac0 2024-09-20T19:09:23.767 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:09:23.767 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:09:23.768 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:09:23.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:09:23.768 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:09:23.768 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:09:23.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:09:23.768 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:09:23.768 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:09:23.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:09:23.769 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:09:23.769 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:09:23.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:09:23.769 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:09:23.769 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:09:23.770 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:09:23.770 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:09:23.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.765+0000 7fa14f20c640 1 -- 172.21.15.17:0/3429866604 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa13407af40 msgr2=0x7fa13407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:23.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.765+0000 7fa14f20c640 1 --2- 172.21.15.17:0/3429866604 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa13407af40 0x7fa13407d400 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa1481021b0 tx=0x7fa138009560 comp rx=0 tx=0).stop 2024-09-20T19:09:23.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.765+0000 7fa14f20c640 1 -- 172.21.15.17:0/3429866604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa148102ac0 msgr2=0x7fa148100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:23.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.765+0000 7fa14f20c640 1 --2- 172.21.15.17:0/3429866604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa148102ac0 0x7fa148100720 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fa13000c8f0 tx=0x7fa13000cdb0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.765+0000 7fa14f20c640 1 -- 172.21.15.17:0/3429866604 shutdown_connections 2024-09-20T19:09:23.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.765+0000 7fa14f20c640 1 --2- 172.21.15.17:0/3429866604 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa13407af40 0x7fa13407d400 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.765+0000 7fa14f20c640 1 --2- 172.21.15.17:0/3429866604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1481033e0 0x7fa148100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.765+0000 7fa14f20c640 1 --2- 172.21.15.17:0/3429866604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa148102ac0 0x7fa148100720 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.765+0000 7fa14f20c640 1 -- 172.21.15.17:0/3429866604 >> 172.21.15.17:0/3429866604 conn(0x7fa1480fc520 msgr2=0x7fa148108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:23.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.765+0000 7fa14f20c640 1 -- 172.21.15.17:0/3429866604 shutdown_connections 2024-09-20T19:09:23.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.765+0000 7fa14f20c640 1 -- 172.21.15.17:0/3429866604 wait complete. 2024-09-20T19:09:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.849+0000 7fdaa2c87640 1 -- 172.21.15.17:0/3452984526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda9c101900 msgr2=0x7fda9c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.849+0000 7fdaa2c87640 1 --2- 172.21.15.17:0/3452984526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda9c101900 0x7fda9c101d60 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fda90009880 tx=0x7fda9002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.849+0000 7fdaa2c87640 1 -- 172.21.15.17:0/3452984526 shutdown_connections 2024-09-20T19:09:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.849+0000 7fdaa2c87640 1 --2- 172.21.15.17:0/3452984526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda9c101900 0x7fda9c101d60 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.849+0000 7fdaa2c87640 1 --2- 172.21.15.17:0/3452984526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda9c107900 0x7fda9c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.849+0000 7fdaa2c87640 1 -- 172.21.15.17:0/3452984526 >> 172.21.15.17:0/3452984526 conn(0x7fda9c0fd600 msgr2=0x7fda9c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:23.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.849+0000 7fdaa2c87640 1 -- 172.21.15.17:0/3452984526 shutdown_connections 2024-09-20T19:09:23.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.849+0000 7fdaa2c87640 1 -- 172.21.15.17:0/3452984526 wait complete. 2024-09-20T19:09:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.850+0000 7fdaa2c87640 1 Processor -- start 2024-09-20T19:09:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.850+0000 7fdaa2c87640 1 -- start start 2024-09-20T19:09:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.850+0000 7fdaa2c87640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda9c101900 0x7fda9c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.850+0000 7fdaa2c87640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda9c107900 0x7fda9c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.850+0000 7fdaa2c87640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c10edd0 con 0x7fda9c107900 2024-09-20T19:09:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.850+0000 7fdaa2c87640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c10ec50 con 0x7fda9c101900 2024-09-20T19:09:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.850+0000 7fda9bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda9c107900 0x7fda9c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.850+0000 7fda9bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda9c107900 0x7fda9c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43114/0 (socket says 172.21.15.17:43114) 2024-09-20T19:09:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.850+0000 7fda9bfff640 1 -- 172.21.15.17:0/4275716274 learned_addr learned my addr 172.21.15.17:0/4275716274 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:09:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.850+0000 7fdaa0a23640 1 --2- 172.21.15.17:0/4275716274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda9c101900 0x7fda9c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:23.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.850+0000 7fda9bfff640 1 -- 172.21.15.17:0/4275716274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda9c101900 msgr2=0x7fda9c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:23.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.850+0000 7fda9bfff640 1 --2- 172.21.15.17:0/4275716274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda9c101900 0x7fda9c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:23.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.850+0000 7fda9bfff640 1 -- 172.21.15.17:0/4275716274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9c197800 con 0x7fda9c107900 2024-09-20T19:09:23.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.851+0000 7fda9bfff640 1 --2- 172.21.15.17:0/4275716274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda9c107900 0x7fda9c19dbc0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fda90031460 tx=0x7fda900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:23.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.851+0000 7fda99ffb640 1 -- 172.21.15.17:0/4275716274 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda9003f070 con 0x7fda9c107900 2024-09-20T19:09:23.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.851+0000 7fda99ffb640 1 -- 172.21.15.17:0/4275716274 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda900044d0 con 0x7fda9c107900 2024-09-20T19:09:23.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.851+0000 7fdaa2c87640 1 -- 172.21.15.17:0/4275716274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda9c197a90 con 0x7fda9c107900 2024-09-20T19:09:23.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.851+0000 7fda99ffb640 1 -- 172.21.15.17:0/4275716274 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda90035030 con 0x7fda9c107900 2024-09-20T19:09:23.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.851+0000 7fdaa2c87640 1 -- 172.21.15.17:0/4275716274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda9c197fc0 con 0x7fda9c107900 2024-09-20T19:09:23.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.852+0000 7fdaa2c87640 1 -- 172.21.15.17:0/4275716274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda9c103040 con 0x7fda9c107900 2024-09-20T19:09:23.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.853+0000 7fda99ffb640 1 -- 172.21.15.17:0/4275716274 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fda90042070 con 0x7fda9c107900 2024-09-20T19:09:23.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.853+0000 7fda99ffb640 1 --2- 172.21.15.17:0/4275716274 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda8407af40 0x7fda8407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:23.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.853+0000 7fda99ffb640 1 -- 172.21.15.17:0/4275716274 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fda900bea70 con 0x7fda9c107900 2024-09-20T19:09:23.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.854+0000 7fdaa0a23640 1 --2- 172.21.15.17:0/4275716274 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda8407af40 0x7fda8407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:23.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.854+0000 7fdaa0a23640 1 --2- 172.21.15.17:0/4275716274 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda8407af40 0x7fda8407d400 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0058c0 tx=0x7fda8c00a250 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:23.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:23.858+0000 7fda99ffb640 1 -- 172.21.15.17:0/4275716274 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fda90004cf0 con 0x7fda9c107900 2024-09-20T19:09:24.068 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:23 smithi172 ceph-mon[80431]: pgmap v1020: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:24.068 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:23 smithi172 ceph-mon[80431]: from='client.35660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:24.068 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:23 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3429866604' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:09:24.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.083+0000 7fdaa2c87640 1 -- 172.21.15.17:0/4275716274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fda9c109e70 con 0x7fda9c107900 2024-09-20T19:09:24.087 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:23 smithi017 ceph-mon[108970]: pgmap v1020: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:24.087 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:23 smithi017 ceph-mon[108970]: from='client.35660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:24.087 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:23 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3429866604' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:09:24.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.083+0000 7fda99ffb640 1 -- 172.21.15.17:0/4275716274 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7fda9008a070 con 0x7fda9c107900 2024-09-20T19:09:24.088 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:09:24.088 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:09:24.088 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:09:24.088 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:09:24.088 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:09:24.088 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:09:24.088 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:09:24.088 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:09:24.088 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:09:24.088 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:09:24.089 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:09:24.089 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:09:24.089 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:09:24.089 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:09:24.089 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:09:24.089 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:09:24.089 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:09:24.089 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:09:24.089 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:09:24.089 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:09:24.089 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:09:24.089 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:09:24.089 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:09:24.089 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:09:24.090 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:09:24.090 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:09:24.090 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:09:24.090 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:09:24.090 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:09:24.090 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:09:24.090 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:09:24.090 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:09:24.090 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:09:24.090 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:09:24.090 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:09:24.090 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:09:24.090 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:09:24.090 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:09:24.091 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:09:24.091 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:09:24.091 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:09:24.091 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:09:24.091 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:09:24.091 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:09:24.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.086+0000 7fdaa2c87640 1 -- 172.21.15.17:0/4275716274 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda8407af40 msgr2=0x7fda8407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:24.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.086+0000 7fdaa2c87640 1 --2- 172.21.15.17:0/4275716274 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda8407af40 0x7fda8407d400 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0058c0 tx=0x7fda8c00a250 comp rx=0 tx=0).stop 2024-09-20T19:09:24.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.086+0000 7fdaa2c87640 1 -- 172.21.15.17:0/4275716274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda9c107900 msgr2=0x7fda9c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:24.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.086+0000 7fdaa2c87640 1 --2- 172.21.15.17:0/4275716274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda9c107900 0x7fda9c19dbc0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fda90031460 tx=0x7fda900048f0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.086+0000 7fdaa2c87640 1 -- 172.21.15.17:0/4275716274 shutdown_connections 2024-09-20T19:09:24.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.087+0000 7fdaa2c87640 1 --2- 172.21.15.17:0/4275716274 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fda8407af40 0x7fda8407d400 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.087+0000 7fdaa2c87640 1 --2- 172.21.15.17:0/4275716274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda9c107900 0x7fda9c19dbc0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.087+0000 7fdaa2c87640 1 --2- 172.21.15.17:0/4275716274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda9c101900 0x7fda9c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.087+0000 7fdaa2c87640 1 -- 172.21.15.17:0/4275716274 >> 172.21.15.17:0/4275716274 conn(0x7fda9c0fd600 msgr2=0x7fda9c0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:24.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.087+0000 7fdaa2c87640 1 -- 172.21.15.17:0/4275716274 shutdown_connections 2024-09-20T19:09:24.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.087+0000 7fdaa2c87640 1 -- 172.21.15.17:0/4275716274 wait complete. 2024-09-20T19:09:24.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.174+0000 7f05f8950640 1 -- 172.21.15.17:0/3083674264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f41007f0 msgr2=0x7f05f4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:24.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.174+0000 7f05f8950640 1 --2- 172.21.15.17:0/3083674264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f41007f0 0x7f05f4100c50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009880 tx=0x7f05dc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.174+0000 7f05f8950640 1 -- 172.21.15.17:0/3083674264 shutdown_connections 2024-09-20T19:09:24.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.174+0000 7f05f8950640 1 --2- 172.21.15.17:0/3083674264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f41007f0 0x7f05f4100c50 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.174+0000 7f05f8950640 1 --2- 172.21.15.17:0/3083674264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05f41067f0 0x7f05f4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.174+0000 7f05f8950640 1 -- 172.21.15.17:0/3083674264 >> 172.21.15.17:0/3083674264 conn(0x7f05f40fc550 msgr2=0x7f05f40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:24.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.174+0000 7f05f8950640 1 -- 172.21.15.17:0/3083674264 shutdown_connections 2024-09-20T19:09:24.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.174+0000 7f05f8950640 1 -- 172.21.15.17:0/3083674264 wait complete. 2024-09-20T19:09:24.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.175+0000 7f05f8950640 1 Processor -- start 2024-09-20T19:09:24.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.175+0000 7f05f8950640 1 -- start start 2024-09-20T19:09:24.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.175+0000 7f05f8950640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05f41007f0 0x7f05f419f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:24.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.175+0000 7f05f8950640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f41067f0 0x7f05f419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:24.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.175+0000 7f05f8950640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f05f410dcc0 con 0x7f05f41067f0 2024-09-20T19:09:24.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.175+0000 7f05f8950640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f05f410db40 con 0x7f05f41007f0 2024-09-20T19:09:24.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.175+0000 7f05ebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f41067f0 0x7f05f419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:24.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.175+0000 7f05ebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f41067f0 0x7f05f419fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43140/0 (socket says 172.21.15.17:43140) 2024-09-20T19:09:24.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.175+0000 7f05ebfff640 1 -- 172.21.15.17:0/3381639781 learned_addr learned my addr 172.21.15.17:0/3381639781 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:09:24.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.175+0000 7f05f259c640 1 --2- 172.21.15.17:0/3381639781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05f41007f0 0x7f05f419f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:24.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.175+0000 7f05ebfff640 1 -- 172.21.15.17:0/3381639781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05f41007f0 msgr2=0x7f05f419f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:24.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.175+0000 7f05ebfff640 1 --2- 172.21.15.17:0/3381639781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05f41007f0 0x7f05f419f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.176+0000 7f05ebfff640 1 -- 172.21.15.17:0/3381639781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f41999b0 con 0x7f05f41067f0 2024-09-20T19:09:24.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.176+0000 7f05ebfff640 1 --2- 172.21.15.17:0/3381639781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f41067f0 0x7f05f419fd30 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f05dc031460 tx=0x7f05dc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:24.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.176+0000 7f05eb7fe640 1 -- 172.21.15.17:0/3381639781 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05dc03f070 con 0x7f05f41067f0 2024-09-20T19:09:24.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.176+0000 7f05eb7fe640 1 -- 172.21.15.17:0/3381639781 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05dc0035f0 con 0x7f05f41067f0 2024-09-20T19:09:24.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.176+0000 7f05f8950640 1 -- 172.21.15.17:0/3381639781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f4199c40 con 0x7f05f41067f0 2024-09-20T19:09:24.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.176+0000 7f05eb7fe640 1 -- 172.21.15.17:0/3381639781 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05dc035030 con 0x7f05f41067f0 2024-09-20T19:09:24.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.176+0000 7f05f8950640 1 -- 172.21.15.17:0/3381639781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f419a170 con 0x7f05f41067f0 2024-09-20T19:09:24.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.177+0000 7f05f8950640 1 -- 172.21.15.17:0/3381639781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f4101f30 con 0x7f05f41067f0 2024-09-20T19:09:24.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.178+0000 7f05eb7fe640 1 -- 172.21.15.17:0/3381639781 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f05dc042070 con 0x7f05f41067f0 2024-09-20T19:09:24.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.178+0000 7f05eb7fe640 1 --2- 172.21.15.17:0/3381639781 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05e007af80 0x7f05e007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:24.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.179+0000 7f05f259c640 1 --2- 172.21.15.17:0/3381639781 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05e007af80 0x7f05e007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:24.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.179+0000 7f05eb7fe640 1 -- 172.21.15.17:0/3381639781 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f05dc0be860 con 0x7f05f41067f0 2024-09-20T19:09:24.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.179+0000 7f05f259c640 1 --2- 172.21.15.17:0/3381639781 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05e007af80 0x7f05e007d440 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f05f419aaf0 tx=0x7f05e400b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:24.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.183+0000 7f05eb7fe640 1 -- 172.21.15.17:0/3381639781 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f05dc089ee0 con 0x7f05f41067f0 2024-09-20T19:09:24.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.387+0000 7f05f8950640 1 -- 172.21.15.17:0/3381639781 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f05f419a420 con 0x7f05e007af80 2024-09-20T19:09:24.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.388+0000 7f05eb7fe640 1 -- 172.21.15.17:0/3381639781 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f05f419a420 con 0x7f05e007af80 2024-09-20T19:09:24.392 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:09:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:09:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:09:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:09:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:09:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:09:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:09:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:09:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:09:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:09:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:09:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:09:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:09:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:09:24.393 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:09:24.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.390+0000 7f05f8950640 1 -- 172.21.15.17:0/3381639781 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05e007af80 msgr2=0x7f05e007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:24.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.390+0000 7f05f8950640 1 --2- 172.21.15.17:0/3381639781 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05e007af80 0x7f05e007d440 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f05f419aaf0 tx=0x7f05e400b390 comp rx=0 tx=0).stop 2024-09-20T19:09:24.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.390+0000 7f05f8950640 1 -- 172.21.15.17:0/3381639781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f41067f0 msgr2=0x7f05f419fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:24.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.390+0000 7f05f8950640 1 --2- 172.21.15.17:0/3381639781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f41067f0 0x7f05f419fd30 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f05dc031460 tx=0x7f05dc0045e0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.390+0000 7f05f8950640 1 -- 172.21.15.17:0/3381639781 shutdown_connections 2024-09-20T19:09:24.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.391+0000 7f05f8950640 1 --2- 172.21.15.17:0/3381639781 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05e007af80 0x7f05e007d440 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.391+0000 7f05f8950640 1 --2- 172.21.15.17:0/3381639781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f41067f0 0x7f05f419fd30 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.391+0000 7f05f8950640 1 --2- 172.21.15.17:0/3381639781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05f41007f0 0x7f05f419f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.391+0000 7f05f8950640 1 -- 172.21.15.17:0/3381639781 >> 172.21.15.17:0/3381639781 conn(0x7f05f40fc550 msgr2=0x7f05f4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:24.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.391+0000 7f05f8950640 1 -- 172.21.15.17:0/3381639781 shutdown_connections 2024-09-20T19:09:24.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.391+0000 7f05f8950640 1 -- 172.21.15.17:0/3381639781 wait complete. 2024-09-20T19:09:24.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.474+0000 7f0105dea640 1 -- 172.21.15.17:0/76484637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0100101900 msgr2=0x7f0100101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:24.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.474+0000 7f0105dea640 1 --2- 172.21.15.17:0/76484637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0100101900 0x7f0100101d60 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009880 tx=0x7f00f402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.474+0000 7f0105dea640 1 -- 172.21.15.17:0/76484637 shutdown_connections 2024-09-20T19:09:24.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.474+0000 7f0105dea640 1 --2- 172.21.15.17:0/76484637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0100101900 0x7f0100101d60 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.474+0000 7f0105dea640 1 --2- 172.21.15.17:0/76484637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0100107900 0x7f0100107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.474+0000 7f0105dea640 1 -- 172.21.15.17:0/76484637 >> 172.21.15.17:0/76484637 conn(0x7f01000fd600 msgr2=0x7f01000ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:24.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.474+0000 7f0105dea640 1 -- 172.21.15.17:0/76484637 shutdown_connections 2024-09-20T19:09:24.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.474+0000 7f0105dea640 1 -- 172.21.15.17:0/76484637 wait complete. 2024-09-20T19:09:24.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.475+0000 7f0105dea640 1 Processor -- start 2024-09-20T19:09:24.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.475+0000 7f0105dea640 1 -- start start 2024-09-20T19:09:24.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.475+0000 7f0105dea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0100101900 0x7f010019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:24.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.475+0000 7f0105dea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0100107900 0x7f010019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.475+0000 7f0105dea640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f010010edd0 con 0x7f0100107900 2024-09-20T19:09:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.475+0000 7f0105dea640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f010010ec50 con 0x7f0100101900 2024-09-20T19:09:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.475+0000 7f00feffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0100107900 0x7f010019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.475+0000 7f00feffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0100107900 0x7f010019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43154/0 (socket says 172.21.15.17:43154) 2024-09-20T19:09:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.476+0000 7f00feffd640 1 -- 172.21.15.17:0/11442985 learned_addr learned my addr 172.21.15.17:0/11442985 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:09:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.476+0000 7f00ff7fe640 1 --2- 172.21.15.17:0/11442985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0100101900 0x7f010019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.476+0000 7f00feffd640 1 -- 172.21.15.17:0/11442985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0100101900 msgr2=0x7f010019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.476+0000 7f00feffd640 1 --2- 172.21.15.17:0/11442985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0100101900 0x7f010019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.476+0000 7f00feffd640 1 -- 172.21.15.17:0/11442985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0100197800 con 0x7f0100107900 2024-09-20T19:09:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.476+0000 7f00feffd640 1 --2- 172.21.15.17:0/11442985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0100107900 0x7f010019dbc0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f00f4031460 tx=0x7f00f40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.476+0000 7f00fcff9640 1 -- 172.21.15.17:0/11442985 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f00f403f070 con 0x7f0100107900 2024-09-20T19:09:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.476+0000 7f0105dea640 1 -- 172.21.15.17:0/11442985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0100197a90 con 0x7f0100107900 2024-09-20T19:09:24.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.476+0000 7f00fcff9640 1 -- 172.21.15.17:0/11442985 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f00f4004cf0 con 0x7f0100107900 2024-09-20T19:09:24.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.476+0000 7f00fcff9640 1 -- 172.21.15.17:0/11442985 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f00f4035030 con 0x7f0100107900 2024-09-20T19:09:24.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.476+0000 7f0105dea640 1 -- 172.21.15.17:0/11442985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0100197fc0 con 0x7f0100107900 2024-09-20T19:09:24.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.477+0000 7f0105dea640 1 -- 172.21.15.17:0/11442985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0100103040 con 0x7f0100107900 2024-09-20T19:09:24.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.478+0000 7f00fcff9640 1 -- 172.21.15.17:0/11442985 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f00f4042070 con 0x7f0100107900 2024-09-20T19:09:24.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.478+0000 7f00fcff9640 1 --2- 172.21.15.17:0/11442985 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f00e807af30 0x7f00e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:24.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.479+0000 7f00fcff9640 1 -- 172.21.15.17:0/11442985 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f00f40beb20 con 0x7f0100107900 2024-09-20T19:09:24.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.479+0000 7f00ff7fe640 1 --2- 172.21.15.17:0/11442985 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f00e807af30 0x7f00e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:24.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.479+0000 7f00ff7fe640 1 --2- 172.21.15.17:0/11442985 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f00e807af30 0x7f00e807d3f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f00f0005fd0 tx=0x7f00f0005e20 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:24.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.483+0000 7f00fcff9640 1 -- 172.21.15.17:0/11442985 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f00f408a0c0 con 0x7f0100107900 2024-09-20T19:09:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.743+0000 7f0105dea640 1 -- 172.21.15.17:0/11442985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f0100109e70 con 0x7f0100107900 2024-09-20T19:09:24.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.743+0000 7f00fcff9640 1 -- 172.21.15.17:0/11442985 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f00f408ef70 con 0x7f0100107900 2024-09-20T19:09:24.747 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:09:24.748 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:09:24.748 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:09:24.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:09:24.748 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:09:24.748 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:09:24.748 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:09:24.748 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:09:24.748 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:09:24.748 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:09:24.748 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:09:24.748 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:09:24.748 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:09:24.749 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:09:24.749 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:09:24.749 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:09:24.749 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:09:24.749 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:09:24.749 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:09:24.749 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:09:24.749 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:09:24.749 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:09:24.749 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:09:24.749 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:09:24.749 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:09:24.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.745+0000 7f0105dea640 1 -- 172.21.15.17:0/11442985 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f00e807af30 msgr2=0x7f00e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:24.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.745+0000 7f0105dea640 1 --2- 172.21.15.17:0/11442985 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f00e807af30 0x7f00e807d3f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f00f0005fd0 tx=0x7f00f0005e20 comp rx=0 tx=0).stop 2024-09-20T19:09:24.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.745+0000 7f0105dea640 1 -- 172.21.15.17:0/11442985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0100107900 msgr2=0x7f010019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:24.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.745+0000 7f0105dea640 1 --2- 172.21.15.17:0/11442985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0100107900 0x7f010019dbc0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f00f4031460 tx=0x7f00f40048f0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.745+0000 7f0105dea640 1 -- 172.21.15.17:0/11442985 shutdown_connections 2024-09-20T19:09:24.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.745+0000 7f0105dea640 1 --2- 172.21.15.17:0/11442985 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f00e807af30 0x7f00e807d3f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.745+0000 7f0105dea640 1 --2- 172.21.15.17:0/11442985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0100107900 0x7f010019dbc0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.745+0000 7f0105dea640 1 --2- 172.21.15.17:0/11442985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0100101900 0x7f010019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:24.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.745+0000 7f0105dea640 1 -- 172.21.15.17:0/11442985 >> 172.21.15.17:0/11442985 conn(0x7f01000fd600 msgr2=0x7f01000fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:24.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.746+0000 7f0105dea640 1 -- 172.21.15.17:0/11442985 shutdown_connections 2024-09-20T19:09:24.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:24.746+0000 7f0105dea640 1 -- 172.21.15.17:0/11442985 wait complete. 2024-09-20T19:09:25.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:24 smithi017 ceph-mon[108970]: from='client.35664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:25.337 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:24 smithi017 ceph-mon[108970]: from='client.35668 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:25.337 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:24 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4275716274' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:09:25.338 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:24 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/11442985' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:09:25.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:24 smithi172 ceph-mon[80431]: from='client.35664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:25.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:24 smithi172 ceph-mon[80431]: from='client.35668 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:25.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:24 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4275716274' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:09:25.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:24 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/11442985' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:09:26.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:25 smithi017 ceph-mon[108970]: from='client.35680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:26.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:25 smithi017 ceph-mon[108970]: pgmap v1021: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:26.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:25 smithi172 ceph-mon[80431]: from='client.35680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:26.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:25 smithi172 ceph-mon[80431]: pgmap v1021: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:28.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:27 smithi017 ceph-mon[108970]: pgmap v1022: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:28.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:27 smithi172 ceph-mon[80431]: pgmap v1022: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:30.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:29 smithi017 ceph-mon[108970]: pgmap v1023: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:30.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:29 smithi172 ceph-mon[80431]: pgmap v1023: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:32.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:31 smithi017 ceph-mon[108970]: pgmap v1024: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:32.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:31 smithi172 ceph-mon[80431]: pgmap v1024: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:34.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:33 smithi017 ceph-mon[108970]: pgmap v1025: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:34.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:33 smithi172 ceph-mon[80431]: pgmap v1025: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:36.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:35 smithi017 ceph-mon[108970]: pgmap v1026: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:36.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:35 smithi172 ceph-mon[80431]: pgmap v1026: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:38.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:37 smithi017 ceph-mon[108970]: pgmap v1027: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:38.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:09:38.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:37 smithi172 ceph-mon[80431]: pgmap v1027: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:38.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:09:40.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:39 smithi017 ceph-mon[108970]: pgmap v1028: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:40.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:39 smithi172 ceph-mon[80431]: pgmap v1028: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:41.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:41 smithi017 ceph-mon[108970]: pgmap v1029: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:42.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:41 smithi172 ceph-mon[80431]: pgmap v1029: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:44.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:43 smithi017 ceph-mon[108970]: pgmap v1030: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:44.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:43 smithi172 ceph-mon[80431]: pgmap v1030: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:46.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:45 smithi017 ceph-mon[108970]: pgmap v1031: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:46.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:45 smithi172 ceph-mon[80431]: pgmap v1031: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:48.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:47 smithi017 ceph-mon[108970]: pgmap v1032: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:48.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:47 smithi172 ceph-mon[80431]: pgmap v1032: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:50.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:49 smithi017 ceph-mon[108970]: pgmap v1033: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:50.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:49 smithi172 ceph-mon[80431]: pgmap v1033: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:52.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:51 smithi017 ceph-mon[108970]: pgmap v1034: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:52.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:51 smithi172 ceph-mon[80431]: pgmap v1034: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:53.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:09:53.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:09:54.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:53 smithi017 ceph-mon[108970]: pgmap v1035: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:54.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:53 smithi172 ceph-mon[80431]: pgmap v1035: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:54.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.844+0000 7f5052ce2640 1 -- 172.21.15.17:0/780948219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f504c107900 msgr2=0x7f504c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:54.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.844+0000 7f5052ce2640 1 --2- 172.21.15.17:0/780948219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f504c107900 0x7f504c107ce0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f503c009880 tx=0x7f503c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:54.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.844+0000 7f5052ce2640 1 -- 172.21.15.17:0/780948219 shutdown_connections 2024-09-20T19:09:54.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.844+0000 7f5052ce2640 1 --2- 172.21.15.17:0/780948219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f504c101900 0x7f504c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:54.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.844+0000 7f5052ce2640 1 --2- 172.21.15.17:0/780948219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f504c107900 0x7f504c107ce0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:54.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.844+0000 7f5052ce2640 1 -- 172.21.15.17:0/780948219 >> 172.21.15.17:0/780948219 conn(0x7f504c0fd600 msgr2=0x7f504c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:54.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.844+0000 7f5052ce2640 1 -- 172.21.15.17:0/780948219 shutdown_connections 2024-09-20T19:09:54.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.844+0000 7f5052ce2640 1 -- 172.21.15.17:0/780948219 wait complete. 2024-09-20T19:09:54.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.845+0000 7f5052ce2640 1 Processor -- start 2024-09-20T19:09:54.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.845+0000 7f5052ce2640 1 -- start start 2024-09-20T19:09:54.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.845+0000 7f5052ce2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f504c101900 0x7f504c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:54.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.845+0000 7f5052ce2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f504c107900 0x7f504c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:54.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.845+0000 7f5052ce2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f504c10edd0 con 0x7f504c101900 2024-09-20T19:09:54.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.845+0000 7f5052ce2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f504c10ec50 con 0x7f504c107900 2024-09-20T19:09:54.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.846+0000 7f5050a7e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f504c101900 0x7f504c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:54.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.846+0000 7f5050a7e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f504c101900 0x7f504c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40254/0 (socket says 172.21.15.17:40254) 2024-09-20T19:09:54.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.846+0000 7f5050a7e640 1 -- 172.21.15.17:0/2365454184 learned_addr learned my addr 172.21.15.17:0/2365454184 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:09:54.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.846+0000 7f504bfff640 1 --2- 172.21.15.17:0/2365454184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f504c107900 0x7f504c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:54.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.846+0000 7f5050a7e640 1 -- 172.21.15.17:0/2365454184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f504c107900 msgr2=0x7f504c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:54.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.846+0000 7f5050a7e640 1 --2- 172.21.15.17:0/2365454184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f504c107900 0x7f504c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:54.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.846+0000 7f5050a7e640 1 -- 172.21.15.17:0/2365454184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f504c074f70 con 0x7f504c101900 2024-09-20T19:09:54.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.846+0000 7f5050a7e640 1 --2- 172.21.15.17:0/2365454184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f504c101900 0x7f504c0744f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f503c031460 tx=0x7f503c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:54.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.846+0000 7f5049ffb640 1 -- 172.21.15.17:0/2365454184 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f503c03f070 con 0x7f504c101900 2024-09-20T19:09:54.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.846+0000 7f5049ffb640 1 -- 172.21.15.17:0/2365454184 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f503c004b10 con 0x7f504c101900 2024-09-20T19:09:54.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.846+0000 7f5052ce2640 1 -- 172.21.15.17:0/2365454184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f504c075200 con 0x7f504c101900 2024-09-20T19:09:54.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.846+0000 7f5049ffb640 1 -- 172.21.15.17:0/2365454184 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f503c035030 con 0x7f504c101900 2024-09-20T19:09:54.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.847+0000 7f5052ce2640 1 -- 172.21.15.17:0/2365454184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f504c1a3d80 con 0x7f504c101900 2024-09-20T19:09:54.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.848+0000 7f5052ce2640 1 -- 172.21.15.17:0/2365454184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f504c103040 con 0x7f504c101900 2024-09-20T19:09:54.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.848+0000 7f5049ffb640 1 -- 172.21.15.17:0/2365454184 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f503c042070 con 0x7f504c101900 2024-09-20T19:09:54.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.849+0000 7f5049ffb640 1 --2- 172.21.15.17:0/2365454184 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f503807af90 0x7f503807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:54.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.849+0000 7f5049ffb640 1 -- 172.21.15.17:0/2365454184 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f503c0bea60 con 0x7f504c101900 2024-09-20T19:09:54.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.849+0000 7f504bfff640 1 --2- 172.21.15.17:0/2365454184 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f503807af90 0x7f503807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:54.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.850+0000 7f504bfff640 1 --2- 172.21.15.17:0/2365454184 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f503807af90 0x7f503807d450 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f504c075f80 tx=0x7f503400b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:54.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:54.853+0000 7f5049ffb640 1 -- 172.21.15.17:0/2365454184 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f503c08a040 con 0x7f504c101900 2024-09-20T19:09:55.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.063+0000 7f5052ce2640 1 -- 172.21.15.17:0/2365454184 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f504c062630 con 0x7f503807af90 2024-09-20T19:09:55.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.064+0000 7f5049ffb640 1 -- 172.21.15.17:0/2365454184 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f504c062630 con 0x7f503807af90 2024-09-20T19:09:55.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.066+0000 7f5052ce2640 1 -- 172.21.15.17:0/2365454184 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f503807af90 msgr2=0x7f503807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:55.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.066+0000 7f5052ce2640 1 --2- 172.21.15.17:0/2365454184 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f503807af90 0x7f503807d450 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f504c075f80 tx=0x7f503400b390 comp rx=0 tx=0).stop 2024-09-20T19:09:55.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.066+0000 7f5052ce2640 1 -- 172.21.15.17:0/2365454184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f504c101900 msgr2=0x7f504c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:55.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.066+0000 7f5052ce2640 1 --2- 172.21.15.17:0/2365454184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f504c101900 0x7f504c0744f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f503c031460 tx=0x7f503c0045e0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.066+0000 7f5052ce2640 1 -- 172.21.15.17:0/2365454184 shutdown_connections 2024-09-20T19:09:55.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.066+0000 7f5052ce2640 1 --2- 172.21.15.17:0/2365454184 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f503807af90 0x7f503807d450 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.066+0000 7f5052ce2640 1 --2- 172.21.15.17:0/2365454184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f504c107900 0x7f504c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.066+0000 7f5052ce2640 1 --2- 172.21.15.17:0/2365454184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f504c101900 0x7f504c0744f0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.066+0000 7f5052ce2640 1 -- 172.21.15.17:0/2365454184 >> 172.21.15.17:0/2365454184 conn(0x7f504c0fd600 msgr2=0x7f504c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:55.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.066+0000 7f5052ce2640 1 -- 172.21.15.17:0/2365454184 shutdown_connections 2024-09-20T19:09:55.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.066+0000 7f5052ce2640 1 -- 172.21.15.17:0/2365454184 wait complete. 2024-09-20T19:09:55.083 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:09:55.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.152+0000 7ff5da245640 1 -- 172.21.15.17:0/3302028504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5d4102ab0 msgr2=0x7ff5d4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:55.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.152+0000 7ff5da245640 1 --2- 172.21.15.17:0/3302028504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5d4102ab0 0x7ff5d4102e90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009c20 tx=0x7ff5c402aa00 comp rx=0 tx=0).stop 2024-09-20T19:09:55.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.152+0000 7ff5da245640 1 -- 172.21.15.17:0/3302028504 shutdown_connections 2024-09-20T19:09:55.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.152+0000 7ff5da245640 1 --2- 172.21.15.17:0/3302028504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5d41033d0 0x7ff5d410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.152+0000 7ff5da245640 1 --2- 172.21.15.17:0/3302028504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5d4102ab0 0x7ff5d4102e90 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.152+0000 7ff5da245640 1 -- 172.21.15.17:0/3302028504 >> 172.21.15.17:0/3302028504 conn(0x7ff5d40fc550 msgr2=0x7ff5d40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:55.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.152+0000 7ff5da245640 1 -- 172.21.15.17:0/3302028504 shutdown_connections 2024-09-20T19:09:55.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.152+0000 7ff5da245640 1 -- 172.21.15.17:0/3302028504 wait complete. 2024-09-20T19:09:55.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.152+0000 7ff5da245640 1 Processor -- start 2024-09-20T19:09:55.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.153+0000 7ff5da245640 1 -- start start 2024-09-20T19:09:55.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.153+0000 7ff5da245640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5d4102ab0 0x7ff5d419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.153+0000 7ff5da245640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5d41033d0 0x7ff5d419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.153+0000 7ff5da245640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d410edc0 con 0x7ff5d41033d0 2024-09-20T19:09:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.153+0000 7ff5da245640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d410ec40 con 0x7ff5d4102ab0 2024-09-20T19:09:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.153+0000 7ff5d2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5d41033d0 0x7ff5d419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.153+0000 7ff5d2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5d41033d0 0x7ff5d419db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40278/0 (socket says 172.21.15.17:40278) 2024-09-20T19:09:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.153+0000 7ff5d2ffd640 1 -- 172.21.15.17:0/3376742824 learned_addr learned my addr 172.21.15.17:0/3376742824 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:09:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.153+0000 7ff5d37fe640 1 --2- 172.21.15.17:0/3376742824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5d4102ab0 0x7ff5d419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.153+0000 7ff5d2ffd640 1 -- 172.21.15.17:0/3376742824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5d4102ab0 msgr2=0x7ff5d419d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.153+0000 7ff5d2ffd640 1 --2- 172.21.15.17:0/3376742824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5d4102ab0 0x7ff5d419d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.153+0000 7ff5d2ffd640 1 -- 172.21.15.17:0/3376742824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d41977b0 con 0x7ff5d41033d0 2024-09-20T19:09:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.154+0000 7ff5d2ffd640 1 --2- 172.21.15.17:0/3376742824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5d41033d0 0x7ff5d419db70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800d6c0 tx=0x7ff5c800db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:55.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.154+0000 7ff5d0ff9640 1 -- 172.21.15.17:0/3376742824 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff5c8017070 con 0x7ff5d41033d0 2024-09-20T19:09:55.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.154+0000 7ff5d0ff9640 1 -- 172.21.15.17:0/3376742824 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff5c8009ce0 con 0x7ff5d41033d0 2024-09-20T19:09:55.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.154+0000 7ff5da245640 1 -- 172.21.15.17:0/3376742824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d4197aa0 con 0x7ff5d41033d0 2024-09-20T19:09:55.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.154+0000 7ff5d0ff9640 1 -- 172.21.15.17:0/3376742824 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff5c800f3c0 con 0x7ff5d41033d0 2024-09-20T19:09:55.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.154+0000 7ff5da245640 1 -- 172.21.15.17:0/3376742824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d4198030 con 0x7ff5d41033d0 2024-09-20T19:09:55.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.155+0000 7ff5da245640 1 -- 172.21.15.17:0/3376742824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d406a580 con 0x7ff5d41033d0 2024-09-20T19:09:55.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.156+0000 7ff5d0ff9640 1 -- 172.21.15.17:0/3376742824 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff5c8010460 con 0x7ff5d41033d0 2024-09-20T19:09:55.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.156+0000 7ff5d0ff9640 1 --2- 172.21.15.17:0/3376742824 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff5bc07af40 0x7ff5bc07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:55.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.156+0000 7ff5d0ff9640 1 -- 172.21.15.17:0/3376742824 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7ff5c809dde0 con 0x7ff5d41033d0 2024-09-20T19:09:55.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.156+0000 7ff5d37fe640 1 --2- 172.21.15.17:0/3376742824 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff5bc07af40 0x7ff5bc07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:55.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.157+0000 7ff5d37fe640 1 --2- 172.21.15.17:0/3376742824 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff5bc07af40 0x7ff5bc07d400 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4000f80 tx=0x7ff5c403a040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:55.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.161+0000 7ff5d0ff9640 1 -- 172.21.15.17:0/3376742824 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff5c80693e0 con 0x7ff5d41033d0 2024-09-20T19:09:55.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.364+0000 7ff5da245640 1 -- 172.21.15.17:0/3376742824 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff5d41983a0 con 0x7ff5bc07af40 2024-09-20T19:09:55.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.365+0000 7ff5d0ff9640 1 -- 172.21.15.17:0/3376742824 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff5c40481c0 con 0x7ff5bc07af40 2024-09-20T19:09:55.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.367+0000 7ff5da245640 1 -- 172.21.15.17:0/3376742824 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff5bc07af40 msgr2=0x7ff5bc07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:55.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.367+0000 7ff5da245640 1 --2- 172.21.15.17:0/3376742824 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff5bc07af40 0x7ff5bc07d400 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4000f80 tx=0x7ff5c403a040 comp rx=0 tx=0).stop 2024-09-20T19:09:55.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.367+0000 7ff5da245640 1 -- 172.21.15.17:0/3376742824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5d41033d0 msgr2=0x7ff5d419db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:55.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.367+0000 7ff5da245640 1 --2- 172.21.15.17:0/3376742824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5d41033d0 0x7ff5d419db70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800d6c0 tx=0x7ff5c800db80 comp rx=0 tx=0).stop 2024-09-20T19:09:55.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.367+0000 7ff5da245640 1 -- 172.21.15.17:0/3376742824 shutdown_connections 2024-09-20T19:09:55.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.367+0000 7ff5da245640 1 --2- 172.21.15.17:0/3376742824 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff5bc07af40 0x7ff5bc07d400 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.367+0000 7ff5da245640 1 --2- 172.21.15.17:0/3376742824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5d41033d0 0x7ff5d419db70 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.367+0000 7ff5da245640 1 --2- 172.21.15.17:0/3376742824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5d4102ab0 0x7ff5d419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.367+0000 7ff5da245640 1 -- 172.21.15.17:0/3376742824 >> 172.21.15.17:0/3376742824 conn(0x7ff5d40fc550 msgr2=0x7ff5d4108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:55.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.368+0000 7ff5da245640 1 -- 172.21.15.17:0/3376742824 shutdown_connections 2024-09-20T19:09:55.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.368+0000 7ff5da245640 1 -- 172.21.15.17:0/3376742824 wait complete. 2024-09-20T19:09:55.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.452+0000 7fb686bb5640 1 -- 172.21.15.17:0/1420264687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6801007f0 msgr2=0x7fb680100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:55.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.452+0000 7fb686bb5640 1 --2- 172.21.15.17:0/1420264687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6801007f0 0x7fb680100c50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009880 tx=0x7fb66c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.452+0000 7fb686bb5640 1 -- 172.21.15.17:0/1420264687 shutdown_connections 2024-09-20T19:09:55.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.452+0000 7fb686bb5640 1 --2- 172.21.15.17:0/1420264687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6801007f0 0x7fb680100c50 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.452+0000 7fb686bb5640 1 --2- 172.21.15.17:0/1420264687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6801067f0 0x7fb680106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.452+0000 7fb686bb5640 1 -- 172.21.15.17:0/1420264687 >> 172.21.15.17:0/1420264687 conn(0x7fb6800fc550 msgr2=0x7fb6800fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:55.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.452+0000 7fb686bb5640 1 -- 172.21.15.17:0/1420264687 shutdown_connections 2024-09-20T19:09:55.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.452+0000 7fb686bb5640 1 -- 172.21.15.17:0/1420264687 wait complete. 2024-09-20T19:09:55.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.452+0000 7fb686bb5640 1 Processor -- start 2024-09-20T19:09:55.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.452+0000 7fb686bb5640 1 -- start start 2024-09-20T19:09:55.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.453+0000 7fb686bb5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6801007f0 0x7fb6800fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:55.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.453+0000 7fb686bb5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6801067f0 0x7fb6800fd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:55.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.453+0000 7fb686bb5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb68010dcc0 con 0x7fb6801007f0 2024-09-20T19:09:55.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.453+0000 7fb686bb5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb68010db40 con 0x7fb6801067f0 2024-09-20T19:09:55.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.453+0000 7fb684951640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6801007f0 0x7fb6800fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:55.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.453+0000 7fb684951640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6801007f0 0x7fb6800fccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40292/0 (socket says 172.21.15.17:40292) 2024-09-20T19:09:55.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.453+0000 7fb684951640 1 -- 172.21.15.17:0/3043484743 learned_addr learned my addr 172.21.15.17:0/3043484743 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:09:55.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.453+0000 7fb67ffff640 1 --2- 172.21.15.17:0/3043484743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6801067f0 0x7fb6800fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:55.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.453+0000 7fb684951640 1 -- 172.21.15.17:0/3043484743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6801067f0 msgr2=0x7fb6800fd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:55.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.453+0000 7fb684951640 1 --2- 172.21.15.17:0/3043484743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6801067f0 0x7fb6800fd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.453+0000 7fb684951640 1 -- 172.21.15.17:0/3043484743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6800fd750 con 0x7fb6801007f0 2024-09-20T19:09:55.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.453+0000 7fb684951640 1 --2- 172.21.15.17:0/3043484743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6801007f0 0x7fb6800fccd0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb67400c8f0 tx=0x7fb67400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:55.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.454+0000 7fb67dffb640 1 -- 172.21.15.17:0/3043484743 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb6740079b0 con 0x7fb6801007f0 2024-09-20T19:09:55.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.454+0000 7fb686bb5640 1 -- 172.21.15.17:0/3043484743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6800fda40 con 0x7fb6801007f0 2024-09-20T19:09:55.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.454+0000 7fb67dffb640 1 -- 172.21.15.17:0/3043484743 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb6740054e0 con 0x7fb6801007f0 2024-09-20T19:09:55.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.454+0000 7fb67dffb640 1 -- 172.21.15.17:0/3043484743 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb674004dd0 con 0x7fb6801007f0 2024-09-20T19:09:55.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.454+0000 7fb686bb5640 1 -- 172.21.15.17:0/3043484743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6801a3e60 con 0x7fb6801007f0 2024-09-20T19:09:55.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.455+0000 7fb686bb5640 1 -- 172.21.15.17:0/3043484743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb680101f30 con 0x7fb6801007f0 2024-09-20T19:09:55.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.456+0000 7fb67dffb640 1 -- 172.21.15.17:0/3043484743 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb674005020 con 0x7fb6801007f0 2024-09-20T19:09:55.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.456+0000 7fb67dffb640 1 --2- 172.21.15.17:0/3043484743 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb67007af30 0x7fb67007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:55.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.457+0000 7fb67ffff640 1 --2- 172.21.15.17:0/3043484743 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb67007af30 0x7fb67007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:55.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.457+0000 7fb67dffb640 1 -- 172.21.15.17:0/3043484743 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fb67409dec0 con 0x7fb6801007f0 2024-09-20T19:09:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.457+0000 7fb67ffff640 1 --2- 172.21.15.17:0/3043484743 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb67007af30 0x7fb67007d3f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb6800fe760 tx=0x7fb66c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.461+0000 7fb67dffb640 1 -- 172.21.15.17:0/3043484743 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb674014030 con 0x7fb6801007f0 2024-09-20T19:09:55.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.660+0000 7fb686bb5640 1 -- 172.21.15.17:0/3043484743 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb680062630 con 0x7fb67007af30 2024-09-20T19:09:55.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.670+0000 7fb67dffb640 1 -- 172.21.15.17:0/3043484743 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb680062630 con 0x7fb67007af30 2024-09-20T19:09:55.673 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:09:55.673 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (31m) 10m ago 42m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:09:55.673 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (34m) 10m ago 42m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:09:55.673 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (33m) 10m ago 41m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:09:55.673 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (29m) 10m ago 42m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:09:55.673 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (29m) 10m ago 41m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:09:55.673 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (30m) 10m ago 42m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:09:55.674 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (25m) 10m ago 37m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:09:55.674 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (25m) 10m ago 36m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:09:55.674 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (10m) 10m ago 36m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:09:55.674 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (25m) 10m ago 37m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:09:55.674 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (33m) 10m ago 43m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:09:55.674 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (32m) 10m ago 41m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:09:55.674 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (30m) 10m ago 43m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:09:55.674 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (29m) 10m ago 41m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:09:55.674 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (32m) 10m ago 42m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:09:55.674 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (31m) 10m ago 41m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:09:55.674 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (29m) 10m ago 40m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:09:55.674 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (28m) 10m ago 39m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:09:55.674 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (27m) 10m ago 39m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:09:55.674 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (27m) 10m ago 38m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:09:55.674 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (26m) 10m ago 38m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:09:55.675 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (26m) 10m ago 38m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:09:55.675 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (31m) 10m ago 41m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:09:55.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.673+0000 7fb686bb5640 1 -- 172.21.15.17:0/3043484743 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb67007af30 msgr2=0x7fb67007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:55.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.673+0000 7fb686bb5640 1 --2- 172.21.15.17:0/3043484743 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb67007af30 0x7fb67007d3f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb6800fe760 tx=0x7fb66c031400 comp rx=0 tx=0).stop 2024-09-20T19:09:55.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.673+0000 7fb686bb5640 1 -- 172.21.15.17:0/3043484743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6801007f0 msgr2=0x7fb6800fccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:55.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.673+0000 7fb686bb5640 1 --2- 172.21.15.17:0/3043484743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6801007f0 0x7fb6800fccd0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb67400c8f0 tx=0x7fb67400cdb0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.673+0000 7fb686bb5640 1 -- 172.21.15.17:0/3043484743 shutdown_connections 2024-09-20T19:09:55.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.673+0000 7fb686bb5640 1 --2- 172.21.15.17:0/3043484743 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb67007af30 0x7fb67007d3f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.673+0000 7fb686bb5640 1 --2- 172.21.15.17:0/3043484743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6801067f0 0x7fb6800fd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.673+0000 7fb686bb5640 1 --2- 172.21.15.17:0/3043484743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6801007f0 0x7fb6800fccd0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.673+0000 7fb686bb5640 1 -- 172.21.15.17:0/3043484743 >> 172.21.15.17:0/3043484743 conn(0x7fb6800fc550 msgr2=0x7fb680069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:55.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.673+0000 7fb686bb5640 1 -- 172.21.15.17:0/3043484743 shutdown_connections 2024-09-20T19:09:55.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.673+0000 7fb686bb5640 1 -- 172.21.15.17:0/3043484743 wait complete. 2024-09-20T19:09:55.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.757+0000 7fb657960640 1 -- 172.21.15.17:0/2913745101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650101900 msgr2=0x7fb650101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.757+0000 7fb657960640 1 --2- 172.21.15.17:0/2913745101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650101900 0x7fb650101d60 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb640009880 tx=0x7fb64002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.758+0000 7fb657960640 1 -- 172.21.15.17:0/2913745101 shutdown_connections 2024-09-20T19:09:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.758+0000 7fb657960640 1 --2- 172.21.15.17:0/2913745101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650101900 0x7fb650101d60 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.758+0000 7fb657960640 1 --2- 172.21.15.17:0/2913745101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb650107900 0x7fb650107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.758+0000 7fb657960640 1 -- 172.21.15.17:0/2913745101 >> 172.21.15.17:0/2913745101 conn(0x7fb6500fd600 msgr2=0x7fb6500ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.758+0000 7fb657960640 1 -- 172.21.15.17:0/2913745101 shutdown_connections 2024-09-20T19:09:55.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.758+0000 7fb657960640 1 -- 172.21.15.17:0/2913745101 wait complete. 2024-09-20T19:09:55.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.758+0000 7fb657960640 1 Processor -- start 2024-09-20T19:09:55.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.758+0000 7fb657960640 1 -- start start 2024-09-20T19:09:55.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.759+0000 7fb657960640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650101900 0x7fb6500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:55.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.759+0000 7fb657960640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb650107900 0x7fb650074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:55.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.759+0000 7fb657960640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb65010edd0 con 0x7fb650101900 2024-09-20T19:09:55.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.759+0000 7fb657960640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb65010ec50 con 0x7fb650107900 2024-09-20T19:09:55.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.759+0000 7fb6556fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650101900 0x7fb6500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:55.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.759+0000 7fb6556fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650101900 0x7fb6500744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40298/0 (socket says 172.21.15.17:40298) 2024-09-20T19:09:55.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.759+0000 7fb6556fc640 1 -- 172.21.15.17:0/2843470200 learned_addr learned my addr 172.21.15.17:0/2843470200 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:09:55.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.759+0000 7fb654efb640 1 --2- 172.21.15.17:0/2843470200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb650107900 0x7fb650074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:55.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.759+0000 7fb6556fc640 1 -- 172.21.15.17:0/2843470200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb650107900 msgr2=0x7fb650074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:55.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.759+0000 7fb6556fc640 1 --2- 172.21.15.17:0/2843470200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb650107900 0x7fb650074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:55.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.759+0000 7fb6556fc640 1 -- 172.21.15.17:0/2843470200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb650074f70 con 0x7fb650101900 2024-09-20T19:09:55.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.759+0000 7fb6556fc640 1 --2- 172.21.15.17:0/2843470200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650101900 0x7fb6500744f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb64c00c8f0 tx=0x7fb64c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:55.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.759+0000 7fb6467fc640 1 -- 172.21.15.17:0/2843470200 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb64c0079b0 con 0x7fb650101900 2024-09-20T19:09:55.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.760+0000 7fb6467fc640 1 -- 172.21.15.17:0/2843470200 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb64c0054e0 con 0x7fb650101900 2024-09-20T19:09:55.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.760+0000 7fb657960640 1 -- 172.21.15.17:0/2843470200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb650075260 con 0x7fb650101900 2024-09-20T19:09:55.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.760+0000 7fb6467fc640 1 -- 172.21.15.17:0/2843470200 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb64c004dd0 con 0x7fb650101900 2024-09-20T19:09:55.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.760+0000 7fb657960640 1 -- 172.21.15.17:0/2843470200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6501a3e80 con 0x7fb650101900 2024-09-20T19:09:55.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.761+0000 7fb657960640 1 -- 172.21.15.17:0/2843470200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb650103040 con 0x7fb650101900 2024-09-20T19:09:55.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.762+0000 7fb6467fc640 1 -- 172.21.15.17:0/2843470200 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb64c005020 con 0x7fb650101900 2024-09-20T19:09:55.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.762+0000 7fb6467fc640 1 --2- 172.21.15.17:0/2843470200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb63c07aed0 0x7fb63c07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:55.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.762+0000 7fb6467fc640 1 -- 172.21.15.17:0/2843470200 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fb64c09dfd0 con 0x7fb650101900 2024-09-20T19:09:55.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.762+0000 7fb654efb640 1 --2- 172.21.15.17:0/2843470200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb63c07aed0 0x7fb63c07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:55.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.763+0000 7fb654efb640 1 --2- 172.21.15.17:0/2843470200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb63c07aed0 0x7fb63c07d390 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb650075f80 tx=0x7fb640031420 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:55.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:55.767+0000 7fb6467fc640 1 -- 172.21.15.17:0/2843470200 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb64c014030 con 0x7fb650101900 2024-09-20T19:09:56.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.029+0000 7fb657960640 1 -- 172.21.15.17:0/2843470200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb650109e70 con 0x7fb650101900 2024-09-20T19:09:56.033 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:55 smithi017 ceph-mon[108970]: pgmap v1036: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:56.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.030+0000 7fb6467fc640 1 -- 172.21.15.17:0/2843470200 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fb64c0695d0 con 0x7fb650101900 2024-09-20T19:09:56.033 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:09:56.033 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:09:56.033 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:09:56.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:09:56.033 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:09:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:09:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:09:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:09:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:09:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:09:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:09:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:09:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:09:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:09:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:09:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:09:56.034 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:09:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.032+0000 7fb657960640 1 -- 172.21.15.17:0/2843470200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb63c07aed0 msgr2=0x7fb63c07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.032+0000 7fb657960640 1 --2- 172.21.15.17:0/2843470200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb63c07aed0 0x7fb63c07d390 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb650075f80 tx=0x7fb640031420 comp rx=0 tx=0).stop 2024-09-20T19:09:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.032+0000 7fb657960640 1 -- 172.21.15.17:0/2843470200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650101900 msgr2=0x7fb6500744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.032+0000 7fb657960640 1 --2- 172.21.15.17:0/2843470200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650101900 0x7fb6500744f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb64c00c8f0 tx=0x7fb64c00cdb0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.032+0000 7fb657960640 1 -- 172.21.15.17:0/2843470200 shutdown_connections 2024-09-20T19:09:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.032+0000 7fb657960640 1 --2- 172.21.15.17:0/2843470200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb63c07aed0 0x7fb63c07d390 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.032+0000 7fb657960640 1 --2- 172.21.15.17:0/2843470200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb650107900 0x7fb650074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.032+0000 7fb657960640 1 --2- 172.21.15.17:0/2843470200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb650101900 0x7fb6500744f0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.032+0000 7fb657960640 1 -- 172.21.15.17:0/2843470200 >> 172.21.15.17:0/2843470200 conn(0x7fb6500fd600 msgr2=0x7fb6500fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:56.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.032+0000 7fb657960640 1 -- 172.21.15.17:0/2843470200 shutdown_connections 2024-09-20T19:09:56.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.032+0000 7fb657960640 1 -- 172.21.15.17:0/2843470200 wait complete. 2024-09-20T19:09:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.117+0000 7efdaeac5640 1 -- 172.21.15.17:0/830982761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda81069a0 msgr2=0x7efda8106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.117+0000 7efdaeac5640 1 --2- 172.21.15.17:0/830982761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda81069a0 0x7efda8106d80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009880 tx=0x7efd9c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.117+0000 7efdaeac5640 1 -- 172.21.15.17:0/830982761 shutdown_connections 2024-09-20T19:09:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.117+0000 7efdaeac5640 1 --2- 172.21.15.17:0/830982761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda80ffdc0 0x7efda8100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.117+0000 7efdaeac5640 1 --2- 172.21.15.17:0/830982761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda81069a0 0x7efda8106d80 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.117+0000 7efdaeac5640 1 -- 172.21.15.17:0/830982761 >> 172.21.15.17:0/830982761 conn(0x7efda80fbc90 msgr2=0x7efda80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.117+0000 7efdaeac5640 1 -- 172.21.15.17:0/830982761 shutdown_connections 2024-09-20T19:09:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.117+0000 7efdaeac5640 1 -- 172.21.15.17:0/830982761 wait complete. 2024-09-20T19:09:56.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.118+0000 7efdaeac5640 1 Processor -- start 2024-09-20T19:09:56.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.118+0000 7efdaeac5640 1 -- start start 2024-09-20T19:09:56.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.118+0000 7efdaeac5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda80ffdc0 0x7efda819d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.118+0000 7efdaeac5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda81069a0 0x7efda819dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.118+0000 7efdaeac5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efda810ef40 con 0x7efda81069a0 2024-09-20T19:09:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.118+0000 7efdaeac5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efda810edc0 con 0x7efda80ffdc0 2024-09-20T19:09:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.119+0000 7efda7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda81069a0 0x7efda819dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.119+0000 7efda7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda81069a0 0x7efda819dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40318/0 (socket says 172.21.15.17:40318) 2024-09-20T19:09:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.119+0000 7efda7fff640 1 -- 172.21.15.17:0/2760480239 learned_addr learned my addr 172.21.15.17:0/2760480239 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:09:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.119+0000 7efdac861640 1 --2- 172.21.15.17:0/2760480239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda80ffdc0 0x7efda819d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.119+0000 7efda7fff640 1 -- 172.21.15.17:0/2760480239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda80ffdc0 msgr2=0x7efda819d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.119+0000 7efda7fff640 1 --2- 172.21.15.17:0/2760480239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda80ffdc0 0x7efda819d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.119+0000 7efda7fff640 1 -- 172.21.15.17:0/2760480239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda81978d0 con 0x7efda81069a0 2024-09-20T19:09:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.119+0000 7efda7fff640 1 --2- 172.21.15.17:0/2760480239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda81069a0 0x7efda819dc50 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7efd9400d6f0 tx=0x7efd9400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.119+0000 7efda5ffb640 1 -- 172.21.15.17:0/2760480239 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd94017070 con 0x7efda81069a0 2024-09-20T19:09:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.119+0000 7efda5ffb640 1 -- 172.21.15.17:0/2760480239 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efd9400de00 con 0x7efda81069a0 2024-09-20T19:09:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.119+0000 7efdaeac5640 1 -- 172.21.15.17:0/2760480239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda8197bc0 con 0x7efda81069a0 2024-09-20T19:09:56.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.119+0000 7efda5ffb640 1 -- 172.21.15.17:0/2760480239 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd94004bb0 con 0x7efda81069a0 2024-09-20T19:09:56.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.120+0000 7efdaeac5640 1 -- 172.21.15.17:0/2760480239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda8198150 con 0x7efda81069a0 2024-09-20T19:09:56.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.120+0000 7efdaeac5640 1 -- 172.21.15.17:0/2760480239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda81030e0 con 0x7efda81069a0 2024-09-20T19:09:56.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.121+0000 7efda5ffb640 1 -- 172.21.15.17:0/2760480239 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7efd94009a30 con 0x7efda81069a0 2024-09-20T19:09:56.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.121+0000 7efda5ffb640 1 --2- 172.21.15.17:0/2760480239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd9807af90 0x7efd9807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:56.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.122+0000 7efda5ffb640 1 -- 172.21.15.17:0/2760480239 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7efd9409dac0 con 0x7efda81069a0 2024-09-20T19:09:56.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.122+0000 7efdac861640 1 --2- 172.21.15.17:0/2760480239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd9807af90 0x7efd9807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:56.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.122+0000 7efdac861640 1 --2- 172.21.15.17:0/2760480239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd9807af90 0x7efd9807d450 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7efd9c000c00 tx=0x7efd9c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:56.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.126+0000 7efda5ffb640 1 -- 172.21.15.17:0/2760480239 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd94069140 con 0x7efda81069a0 2024-09-20T19:09:56.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:55 smithi172 ceph-mon[80431]: pgmap v1036: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:56.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.355+0000 7efdaeac5640 1 -- 172.21.15.17:0/2760480239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7efda8198e00 con 0x7efda81069a0 2024-09-20T19:09:56.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.355+0000 7efda5ffb640 1 -- 172.21.15.17:0/2760480239 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7efd9406dff0 con 0x7efda81069a0 2024-09-20T19:09:56.358 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:09:56.358 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:09:56.358 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:09:56.358 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:09:56.359 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:09:56.359 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:09:56.359 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:09:56.359 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:09:56.359 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:09:56.359 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:09:56.359 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:09:56.359 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:09:56.359 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:09:56.359 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:09:56.359 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:09:56.359 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:09:56.359 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:09:56.359 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:09:56.360 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:09:56.360 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:09:56.360 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:09:56.360 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:09:56.360 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:09:56.360 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:09:56.360 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:09:56.360 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:09:56.360 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:09:56.360 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:09:56.360 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:09:56.360 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:09:56.360 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:09:56.360 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:09:56.361 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:09:56.361 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:09:56.361 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:09:56.361 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:09:56.361 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:09:56.361 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:09:56.361 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:09:56.361 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:09:56.361 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:09:56.361 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:09:56.361 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:09:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:09:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.358+0000 7efdaeac5640 1 -- 172.21.15.17:0/2760480239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd9807af90 msgr2=0x7efd9807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.358+0000 7efdaeac5640 1 --2- 172.21.15.17:0/2760480239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd9807af90 0x7efd9807d450 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7efd9c000c00 tx=0x7efd9c031400 comp rx=0 tx=0).stop 2024-09-20T19:09:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.358+0000 7efdaeac5640 1 -- 172.21.15.17:0/2760480239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda81069a0 msgr2=0x7efda819dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.358+0000 7efdaeac5640 1 --2- 172.21.15.17:0/2760480239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda81069a0 0x7efda819dc50 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7efd9400d6f0 tx=0x7efd9400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.358+0000 7efdaeac5640 1 -- 172.21.15.17:0/2760480239 shutdown_connections 2024-09-20T19:09:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.358+0000 7efdaeac5640 1 --2- 172.21.15.17:0/2760480239 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efd9807af90 0x7efd9807d450 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.358+0000 7efdaeac5640 1 --2- 172.21.15.17:0/2760480239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efda81069a0 0x7efda819dc50 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.358+0000 7efdaeac5640 1 --2- 172.21.15.17:0/2760480239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda80ffdc0 0x7efda819d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.358+0000 7efdaeac5640 1 -- 172.21.15.17:0/2760480239 >> 172.21.15.17:0/2760480239 conn(0x7efda80fbc90 msgr2=0x7efda80fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:56.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.358+0000 7efdaeac5640 1 -- 172.21.15.17:0/2760480239 shutdown_connections 2024-09-20T19:09:56.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.358+0000 7efdaeac5640 1 -- 172.21.15.17:0/2760480239 wait complete. 2024-09-20T19:09:56.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.443+0000 7febacc37640 1 -- 172.21.15.17:0/3613181088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba8107900 msgr2=0x7feba8107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:56.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.443+0000 7febacc37640 1 --2- 172.21.15.17:0/3613181088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba8107900 0x7feba8107ce0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7feb98009880 tx=0x7feb9802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.444+0000 7febacc37640 1 -- 172.21.15.17:0/3613181088 shutdown_connections 2024-09-20T19:09:56.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.444+0000 7febacc37640 1 --2- 172.21.15.17:0/3613181088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba8101900 0x7feba8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.444+0000 7febacc37640 1 --2- 172.21.15.17:0/3613181088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba8107900 0x7feba8107ce0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.444+0000 7febacc37640 1 -- 172.21.15.17:0/3613181088 >> 172.21.15.17:0/3613181088 conn(0x7feba80fd600 msgr2=0x7feba80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:56.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.444+0000 7febacc37640 1 -- 172.21.15.17:0/3613181088 shutdown_connections 2024-09-20T19:09:56.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.444+0000 7febacc37640 1 -- 172.21.15.17:0/3613181088 wait complete. 2024-09-20T19:09:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.444+0000 7febacc37640 1 Processor -- start 2024-09-20T19:09:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.444+0000 7febacc37640 1 -- start start 2024-09-20T19:09:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.445+0000 7febacc37640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba8101900 0x7feba80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.445+0000 7febacc37640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba8107900 0x7feba8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.445+0000 7febacc37640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7feba810edb0 con 0x7feba8107900 2024-09-20T19:09:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.445+0000 7febacc37640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feba810ec30 con 0x7feba8101900 2024-09-20T19:09:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.445+0000 7feba5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba8107900 0x7feba8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.445+0000 7feba5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba8107900 0x7feba8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40330/0 (socket says 172.21.15.17:40330) 2024-09-20T19:09:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.445+0000 7feba5d9b640 1 -- 172.21.15.17:0/3853198199 learned_addr learned my addr 172.21.15.17:0/3853198199 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:09:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.445+0000 7feba659c640 1 --2- 172.21.15.17:0/3853198199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba8101900 0x7feba80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.445+0000 7feba5d9b640 1 -- 172.21.15.17:0/3853198199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba8101900 msgr2=0x7feba80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:56.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.445+0000 7feba5d9b640 1 --2- 172.21.15.17:0/3853198199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba8101900 0x7feba80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.445+0000 7feba5d9b640 1 -- 172.21.15.17:0/3853198199 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba8074f70 con 0x7feba8107900 2024-09-20T19:09:56.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.445+0000 7feba5d9b640 1 --2- 172.21.15.17:0/3853198199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba8107900 0x7feba8074a30 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00d8d0 tx=0x7feb9c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:56.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.445+0000 7feb977fe640 1 -- 172.21.15.17:0/3853198199 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb9c017030 con 0x7feba8107900 2024-09-20T19:09:56.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.445+0000 7feb977fe640 1 -- 172.21.15.17:0/3853198199 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feb9c004020 con 0x7feba8107900 2024-09-20T19:09:56.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.445+0000 7febacc37640 1 -- 172.21.15.17:0/3853198199 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba8075260 con 0x7feba8107900 2024-09-20T19:09:56.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.445+0000 7feb977fe640 1 -- 172.21.15.17:0/3853198199 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb9c0047a0 con 0x7feba8107900 2024-09-20T19:09:56.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.446+0000 7febacc37640 1 -- 172.21.15.17:0/3853198199 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba81a3e60 con 0x7feba8107900 2024-09-20T19:09:56.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.447+0000 7febacc37640 1 -- 172.21.15.17:0/3853198199 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba8103040 con 0x7feba8107900 2024-09-20T19:09:56.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.447+0000 7feb977fe640 1 -- 172.21.15.17:0/3853198199 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7feb9c0041d0 con 0x7feba8107900 2024-09-20T19:09:56.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.448+0000 7feb977fe640 1 --2- 172.21.15.17:0/3853198199 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb9007af80 0x7feb9007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:56.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.448+0000 7feb977fe640 1 -- 172.21.15.17:0/3853198199 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7feb9c018070 con 0x7feba8107900 2024-09-20T19:09:56.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.448+0000 7feba659c640 1 --2- 172.21.15.17:0/3853198199 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb9007af80 0x7feb9007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:56.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.448+0000 7feba659c640 1 --2- 172.21.15.17:0/3853198199 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb9007af80 0x7feb9007d440 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7feb980096c0 tx=0x7feb98031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:56.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.452+0000 7feb977fe640 1 -- 172.21.15.17:0/3853198199 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feb9c069340 con 0x7feba8107900 2024-09-20T19:09:56.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.658+0000 7febacc37640 1 -- 172.21.15.17:0/3853198199 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7feba8062630 con 0x7feb9007af80 2024-09-20T19:09:56.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.659+0000 7feb977fe640 1 -- 172.21.15.17:0/3853198199 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7feba8062630 con 0x7feb9007af80 2024-09-20T19:09:56.662 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:09:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:09:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:09:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:09:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:09:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:09:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:09:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:09:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:09:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:09:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:09:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:09:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:09:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:09:56.663 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:09:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.661+0000 7febacc37640 1 -- 172.21.15.17:0/3853198199 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb9007af80 msgr2=0x7feb9007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.661+0000 7febacc37640 1 --2- 172.21.15.17:0/3853198199 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb9007af80 0x7feb9007d440 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7feb980096c0 tx=0x7feb98031400 comp rx=0 tx=0).stop 2024-09-20T19:09:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.661+0000 7febacc37640 1 -- 172.21.15.17:0/3853198199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba8107900 msgr2=0x7feba8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.661+0000 7febacc37640 1 --2- 172.21.15.17:0/3853198199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba8107900 0x7feba8074a30 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00d8d0 tx=0x7feb9c00dd90 comp rx=0 tx=0).stop 2024-09-20T19:09:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.661+0000 7febacc37640 1 -- 172.21.15.17:0/3853198199 shutdown_connections 2024-09-20T19:09:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.661+0000 7febacc37640 1 --2- 172.21.15.17:0/3853198199 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7feb9007af80 0x7feb9007d440 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.661+0000 7febacc37640 1 --2- 172.21.15.17:0/3853198199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba8107900 0x7feba8074a30 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.661+0000 7febacc37640 1 --2- 172.21.15.17:0/3853198199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba8101900 0x7feba80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.661+0000 7febacc37640 1 -- 172.21.15.17:0/3853198199 >> 172.21.15.17:0/3853198199 conn(0x7feba80fd600 msgr2=0x7feba80fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:56.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.661+0000 7febacc37640 1 -- 172.21.15.17:0/3853198199 shutdown_connections 2024-09-20T19:09:56.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.661+0000 7febacc37640 1 -- 172.21.15.17:0/3853198199 wait complete. 2024-09-20T19:09:56.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.745+0000 7f42d3ae2640 1 -- 172.21.15.17:0/1785829885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc100800 msgr2=0x7f42cc100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:56.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.745+0000 7f42d3ae2640 1 --2- 172.21.15.17:0/1785829885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc100800 0x7f42cc100c60 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009880 tx=0x7f42bc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.745+0000 7f42d3ae2640 1 -- 172.21.15.17:0/1785829885 shutdown_connections 2024-09-20T19:09:56.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.745+0000 7f42d3ae2640 1 --2- 172.21.15.17:0/1785829885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc100800 0x7f42cc100c60 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.745+0000 7f42d3ae2640 1 --2- 172.21.15.17:0/1785829885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42cc106800 0x7f42cc106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.745+0000 7f42d3ae2640 1 -- 172.21.15.17:0/1785829885 >> 172.21.15.17:0/1785829885 conn(0x7f42cc0fc520 msgr2=0x7f42cc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:56.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.745+0000 7f42d3ae2640 1 -- 172.21.15.17:0/1785829885 shutdown_connections 2024-09-20T19:09:56.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.745+0000 7f42d3ae2640 1 -- 172.21.15.17:0/1785829885 wait complete. 2024-09-20T19:09:56.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.746+0000 7f42d3ae2640 1 Processor -- start 2024-09-20T19:09:56.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.746+0000 7f42d3ae2640 1 -- start start 2024-09-20T19:09:56.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.746+0000 7f42d3ae2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42cc100800 0x7f42cc19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.746+0000 7f42d3ae2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc106800 0x7f42cc19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.746+0000 7f42d3ae2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc10dcb0 con 0x7f42cc106800 2024-09-20T19:09:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.746+0000 7f42d3ae2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc10db30 con 0x7f42cc100800 2024-09-20T19:09:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.746+0000 7f42d107d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc106800 0x7f42cc19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.746+0000 7f42d107d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc106800 0x7f42cc19dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40358/0 (socket says 172.21.15.17:40358) 2024-09-20T19:09:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.746+0000 7f42d107d640 1 -- 172.21.15.17:0/278600564 learned_addr learned my addr 172.21.15.17:0/278600564 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:09:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.746+0000 7f42d187e640 1 --2- 172.21.15.17:0/278600564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42cc100800 0x7f42cc19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.747+0000 7f42d107d640 1 -- 172.21.15.17:0/278600564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42cc100800 msgr2=0x7f42cc19d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.747+0000 7f42d107d640 1 --2- 172.21.15.17:0/278600564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42cc100800 0x7f42cc19d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.747+0000 7f42d107d640 1 -- 172.21.15.17:0/278600564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42cc1977f0 con 0x7f42cc106800 2024-09-20T19:09:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.747+0000 7f42d107d640 1 --2- 172.21.15.17:0/278600564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc106800 0x7f42cc19dbb0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f42bc031460 tx=0x7f42bc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.747+0000 7f42c2ffd640 1 -- 172.21.15.17:0/278600564 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42bc03f070 con 0x7f42cc106800 2024-09-20T19:09:56.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.747+0000 7f42c2ffd640 1 -- 172.21.15.17:0/278600564 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42bc004cf0 con 0x7f42cc106800 2024-09-20T19:09:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.747+0000 7f42d3ae2640 1 -- 172.21.15.17:0/278600564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42cc197a80 con 0x7f42cc106800 2024-09-20T19:09:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.747+0000 7f42c2ffd640 1 -- 172.21.15.17:0/278600564 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42bc035030 con 0x7f42cc106800 2024-09-20T19:09:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.747+0000 7f42d3ae2640 1 -- 172.21.15.17:0/278600564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42cc197fb0 con 0x7f42cc106800 2024-09-20T19:09:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.748+0000 7f42d3ae2640 1 -- 172.21.15.17:0/278600564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42cc101f40 con 0x7f42cc106800 2024-09-20T19:09:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.749+0000 7f42c2ffd640 1 -- 172.21.15.17:0/278600564 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f42bc042070 con 0x7f42cc106800 2024-09-20T19:09:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.750+0000 7f42c2ffd640 1 --2- 172.21.15.17:0/278600564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f42b807af80 0x7f42b807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:09:56.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.750+0000 7f42d187e640 1 --2- 172.21.15.17:0/278600564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f42b807af80 0x7f42b807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:09:56.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.750+0000 7f42c2ffd640 1 -- 172.21.15.17:0/278600564 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f42bc0be930 con 0x7f42cc106800 2024-09-20T19:09:56.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.750+0000 7f42d187e640 1 --2- 172.21.15.17:0/278600564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f42b807af80 0x7f42b807d440 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f42c800abe0 tx=0x7f42c800a2d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:09:56.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:56.754+0000 7f42c2ffd640 1 -- 172.21.15.17:0/278600564 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f42bc089fb0 con 0x7f42cc106800 2024-09-20T19:09:57.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:57.023+0000 7f42d3ae2640 1 -- 172.21.15.17:0/278600564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f42cc198d20 con 0x7f42cc106800 2024-09-20T19:09:57.027 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:56 smithi017 ceph-mon[108970]: from='client.35688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:57.027 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:56 smithi017 ceph-mon[108970]: from='client.35692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:57.027 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:56 smithi017 ceph-mon[108970]: from='client.35696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:57.027 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:56 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2843470200' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:09:57.027 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:56 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2760480239' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:09:57.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:57.023+0000 7f42c2ffd640 1 -- 172.21.15.17:0/278600564 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f42bc08ee60 con 0x7f42cc106800 2024-09-20T19:09:57.028 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:09:57.028 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:09:57.028 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:09:57.029 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:09:57.029 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:09:57.029 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:09:57.029 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:09:57.029 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:09:57.029 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:09:57.030 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:09:57.030 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:09:57.030 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:09:57.030 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:09:57.030 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:09:57.031 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:09:57.031 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:09:57.031 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:09:57.031 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:09:57.031 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:09:57.031 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:09:57.032 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:09:57.032 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:09:57.032 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:09:57.032 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:09:57.032 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:09:57.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:57.026+0000 7f42d3ae2640 1 -- 172.21.15.17:0/278600564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f42b807af80 msgr2=0x7f42b807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:57.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:57.026+0000 7f42d3ae2640 1 --2- 172.21.15.17:0/278600564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f42b807af80 0x7f42b807d440 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f42c800abe0 tx=0x7f42c800a2d0 comp rx=0 tx=0).stop 2024-09-20T19:09:57.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:57.026+0000 7f42d3ae2640 1 -- 172.21.15.17:0/278600564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc106800 msgr2=0x7f42cc19dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:09:57.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:57.026+0000 7f42d3ae2640 1 --2- 172.21.15.17:0/278600564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc106800 0x7f42cc19dbb0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f42bc031460 tx=0x7f42bc0048f0 comp rx=0 tx=0).stop 2024-09-20T19:09:57.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:57.026+0000 7f42d3ae2640 1 -- 172.21.15.17:0/278600564 shutdown_connections 2024-09-20T19:09:57.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:57.026+0000 7f42d3ae2640 1 --2- 172.21.15.17:0/278600564 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f42b807af80 0x7f42b807d440 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:57.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:57.026+0000 7f42d3ae2640 1 --2- 172.21.15.17:0/278600564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42cc106800 0x7f42cc19dbb0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:57.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:57.026+0000 7f42d3ae2640 1 --2- 172.21.15.17:0/278600564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42cc100800 0x7f42cc19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:09:57.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:57.026+0000 7f42d3ae2640 1 -- 172.21.15.17:0/278600564 >> 172.21.15.17:0/278600564 conn(0x7f42cc0fc520 msgr2=0x7f42cc06a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:09:57.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:57.026+0000 7f42d3ae2640 1 -- 172.21.15.17:0/278600564 shutdown_connections 2024-09-20T19:09:57.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:09:57.026+0000 7f42d3ae2640 1 -- 172.21.15.17:0/278600564 wait complete. 2024-09-20T19:09:57.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:56 smithi172 ceph-mon[80431]: from='client.35688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:57.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:56 smithi172 ceph-mon[80431]: from='client.35692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:57.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:56 smithi172 ceph-mon[80431]: from='client.35696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:57.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:56 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2843470200' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:09:57.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:56 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2760480239' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:09:58.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:57 smithi017 ceph-mon[108970]: from='client.35708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:58.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:57 smithi017 ceph-mon[108970]: pgmap v1037: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:58.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:57 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/278600564' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:09:58.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:57 smithi172 ceph-mon[80431]: from='client.35708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:09:58.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:57 smithi172 ceph-mon[80431]: pgmap v1037: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:09:58.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:57 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/278600564' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:10:00.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:09:59 smithi017 ceph-mon[108970]: pgmap v1038: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:00.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:00 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T19:09:59.999+0000 7fd07e20f640 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:10:00.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:09:59 smithi172 ceph-mon[80431]: pgmap v1038: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:01.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:00 smithi017 ceph-mon[108970]: overall HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:10:01.234 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:00 smithi172 ceph-mon[80431]: overall HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:10:02.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:01 smithi017 ceph-mon[108970]: pgmap v1039: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:02.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:01 smithi172 ceph-mon[80431]: pgmap v1039: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:04.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:03 smithi172 ceph-mon[80431]: pgmap v1040: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:04.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:03 smithi017 ceph-mon[108970]: pgmap v1040: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:06.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:05 smithi172 ceph-mon[80431]: pgmap v1041: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:06.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:05 smithi017 ceph-mon[108970]: pgmap v1041: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:08.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:07 smithi172 ceph-mon[80431]: pgmap v1042: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:08.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:10:08.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:07 smithi017 ceph-mon[108970]: pgmap v1042: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:08.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:10:10.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:09 smithi172 ceph-mon[80431]: pgmap v1043: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:10.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:09 smithi017 ceph-mon[108970]: pgmap v1043: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:12.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:11 smithi172 ceph-mon[80431]: pgmap v1044: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:12.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:11 smithi017 ceph-mon[108970]: pgmap v1044: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:14.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:13 smithi172 ceph-mon[80431]: pgmap v1045: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:14.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:13 smithi017 ceph-mon[108970]: pgmap v1045: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:16.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:15 smithi172 ceph-mon[80431]: pgmap v1046: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:16.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:15 smithi017 ceph-mon[108970]: pgmap v1046: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:18.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:17 smithi172 ceph-mon[80431]: pgmap v1047: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:18.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:17 smithi017 ceph-mon[108970]: pgmap v1047: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:20.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:19 smithi172 ceph-mon[80431]: pgmap v1048: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:20.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:19 smithi017 ceph-mon[108970]: pgmap v1048: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:22.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:21 smithi172 ceph-mon[80431]: pgmap v1049: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:22.240 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:21 smithi017 ceph-mon[108970]: pgmap v1049: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:23.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:10:23.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:10:24.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:23 smithi172 ceph-mon[80431]: pgmap v1050: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:24.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:23 smithi017 ceph-mon[108970]: pgmap v1050: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:26.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:25 smithi172 ceph-mon[80431]: pgmap v1051: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:26.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:25 smithi017 ceph-mon[108970]: pgmap v1051: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:27.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.124+0000 7fd07aed2640 1 -- 172.21.15.17:0/50542537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd074103440 msgr2=0x7fd07410b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:27.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.124+0000 7fd07aed2640 1 --2- 172.21.15.17:0/50542537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd074103440 0x7fd07410b930 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd0600098b0 tx=0x7fd06002a560 comp rx=0 tx=0).stop 2024-09-20T19:10:27.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.124+0000 7fd07aed2640 1 -- 172.21.15.17:0/50542537 shutdown_connections 2024-09-20T19:10:27.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.124+0000 7fd07aed2640 1 --2- 172.21.15.17:0/50542537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd074103440 0x7fd07410b930 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.124+0000 7fd07aed2640 1 --2- 172.21.15.17:0/50542537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd074102b20 0x7fd074102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.124+0000 7fd07aed2640 1 -- 172.21.15.17:0/50542537 >> 172.21.15.17:0/50542537 conn(0x7fd0740fc520 msgr2=0x7fd0740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:27.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.124+0000 7fd07aed2640 1 -- 172.21.15.17:0/50542537 shutdown_connections 2024-09-20T19:10:27.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.124+0000 7fd07aed2640 1 -- 172.21.15.17:0/50542537 wait complete. 2024-09-20T19:10:27.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.125+0000 7fd07aed2640 1 Processor -- start 2024-09-20T19:10:27.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.125+0000 7fd07aed2640 1 -- start start 2024-09-20T19:10:27.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.125+0000 7fd07aed2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd074102b20 0x7fd074100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:27.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.125+0000 7fd07aed2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd074103440 0x7fd074100cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:27.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.125+0000 7fd07aed2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd07410edf0 con 0x7fd074102b20 2024-09-20T19:10:27.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.125+0000 7fd07aed2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd07410ec70 con 0x7fd074103440 2024-09-20T19:10:27.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.125+0000 7fd078c6e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd074102b20 0x7fd074100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:27.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.125+0000 7fd078c6e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd074102b20 0x7fd074100780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48270/0 (socket says 172.21.15.17:48270) 2024-09-20T19:10:27.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.125+0000 7fd078c6e640 1 -- 172.21.15.17:0/2574476555 learned_addr learned my addr 172.21.15.17:0/2574476555 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:10:27.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.125+0000 7fd073fff640 1 --2- 172.21.15.17:0/2574476555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd074103440 0x7fd074100cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:27.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.126+0000 7fd078c6e640 1 -- 172.21.15.17:0/2574476555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd074103440 msgr2=0x7fd074100cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:27.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.126+0000 7fd078c6e640 1 --2- 172.21.15.17:0/2574476555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd074103440 0x7fd074100cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.126+0000 7fd078c6e640 1 -- 172.21.15.17:0/2574476555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd074101200 con 0x7fd074102b20 2024-09-20T19:10:27.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.126+0000 7fd078c6e640 1 --2- 172.21.15.17:0/2574476555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd074102b20 0x7fd074100780 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd06800d6f0 tx=0x7fd06800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:27.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.126+0000 7fd071ffb640 1 -- 172.21.15.17:0/2574476555 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd068017070 con 0x7fd074102b20 2024-09-20T19:10:27.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.126+0000 7fd071ffb640 1 -- 172.21.15.17:0/2574476555 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd06800de00 con 0x7fd074102b20 2024-09-20T19:10:27.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.126+0000 7fd07aed2640 1 -- 172.21.15.17:0/2574476555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0741014f0 con 0x7fd074102b20 2024-09-20T19:10:27.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.126+0000 7fd071ffb640 1 -- 172.21.15.17:0/2574476555 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd068004bb0 con 0x7fd074102b20 2024-09-20T19:10:27.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.126+0000 7fd07aed2640 1 -- 172.21.15.17:0/2574476555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0741a3f00 con 0x7fd074102b20 2024-09-20T19:10:27.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.128+0000 7fd07aed2640 1 -- 172.21.15.17:0/2574476555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd07406aa30 con 0x7fd074102b20 2024-09-20T19:10:27.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.128+0000 7fd071ffb640 1 -- 172.21.15.17:0/2574476555 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd068009a30 con 0x7fd074102b20 2024-09-20T19:10:27.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.129+0000 7fd071ffb640 1 --2- 172.21.15.17:0/2574476555 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd06407af80 0x7fd06407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:27.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.129+0000 7fd073fff640 1 --2- 172.21.15.17:0/2574476555 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd06407af80 0x7fd06407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:27.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.129+0000 7fd071ffb640 1 -- 172.21.15.17:0/2574476555 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fd06809dad0 con 0x7fd074102b20 2024-09-20T19:10:27.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.129+0000 7fd073fff640 1 --2- 172.21.15.17:0/2574476555 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd06407af80 0x7fd06407d440 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd060000c00 tx=0x7fd060031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:27.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.133+0000 7fd071ffb640 1 -- 172.21.15.17:0/2574476555 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd068069150 con 0x7fd074102b20 2024-09-20T19:10:27.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.341+0000 7fd07aed2640 1 -- 172.21.15.17:0/2574476555 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd074062630 con 0x7fd06407af80 2024-09-20T19:10:27.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.342+0000 7fd071ffb640 1 -- 172.21.15.17:0/2574476555 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fd074062630 con 0x7fd06407af80 2024-09-20T19:10:27.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.344+0000 7fd07aed2640 1 -- 172.21.15.17:0/2574476555 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd06407af80 msgr2=0x7fd06407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:27.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.344+0000 7fd07aed2640 1 --2- 172.21.15.17:0/2574476555 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd06407af80 0x7fd06407d440 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd060000c00 tx=0x7fd060031400 comp rx=0 tx=0).stop 2024-09-20T19:10:27.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.344+0000 7fd07aed2640 1 -- 172.21.15.17:0/2574476555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd074102b20 msgr2=0x7fd074100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:27.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.344+0000 7fd07aed2640 1 --2- 172.21.15.17:0/2574476555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd074102b20 0x7fd074100780 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd06800d6f0 tx=0x7fd06800dbb0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.344+0000 7fd07aed2640 1 -- 172.21.15.17:0/2574476555 shutdown_connections 2024-09-20T19:10:27.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.344+0000 7fd07aed2640 1 --2- 172.21.15.17:0/2574476555 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd06407af80 0x7fd06407d440 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.344+0000 7fd07aed2640 1 --2- 172.21.15.17:0/2574476555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd074103440 0x7fd074100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.344+0000 7fd07aed2640 1 --2- 172.21.15.17:0/2574476555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd074102b20 0x7fd074100780 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.344+0000 7fd07aed2640 1 -- 172.21.15.17:0/2574476555 >> 172.21.15.17:0/2574476555 conn(0x7fd0740fc520 msgr2=0x7fd074103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:27.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.344+0000 7fd07aed2640 1 -- 172.21.15.17:0/2574476555 shutdown_connections 2024-09-20T19:10:27.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.344+0000 7fd07aed2640 1 -- 172.21.15.17:0/2574476555 wait complete. 2024-09-20T19:10:27.357 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:10:27.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.432+0000 7f859b29c640 1 -- 172.21.15.17:0/4145217216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85941033e0 msgr2=0x7f859410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:27.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.432+0000 7f859b29c640 1 --2- 172.21.15.17:0/4145217216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85941033e0 0x7f859410b8d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8584009880 tx=0x7f858402a530 comp rx=0 tx=0).stop 2024-09-20T19:10:27.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.432+0000 7f859b29c640 1 -- 172.21.15.17:0/4145217216 shutdown_connections 2024-09-20T19:10:27.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.432+0000 7f859b29c640 1 --2- 172.21.15.17:0/4145217216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85941033e0 0x7f859410b8d0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.432+0000 7f859b29c640 1 --2- 172.21.15.17:0/4145217216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8594102ac0 0x7f8594102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.432+0000 7f859b29c640 1 -- 172.21.15.17:0/4145217216 >> 172.21.15.17:0/4145217216 conn(0x7f85940fc520 msgr2=0x7f85940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:27.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.432+0000 7f859b29c640 1 -- 172.21.15.17:0/4145217216 shutdown_connections 2024-09-20T19:10:27.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.432+0000 7f859b29c640 1 -- 172.21.15.17:0/4145217216 wait complete. 2024-09-20T19:10:27.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.433+0000 7f859b29c640 1 Processor -- start 2024-09-20T19:10:27.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.433+0000 7f859b29c640 1 -- start start 2024-09-20T19:10:27.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.433+0000 7f859b29c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8594102ac0 0x7f8594100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:27.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.433+0000 7f859b29c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85941033e0 0x7f8594100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:27.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.433+0000 7f859b29c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f859410edd0 con 0x7f8594102ac0 2024-09-20T19:10:27.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.433+0000 7f859b29c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f859410ec50 con 0x7f85941033e0 2024-09-20T19:10:27.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.433+0000 7f8599038640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8594102ac0 0x7f8594100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:27.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.433+0000 7f8599038640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8594102ac0 0x7f8594100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48282/0 (socket says 172.21.15.17:48282) 2024-09-20T19:10:27.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.433+0000 7f8599038640 1 -- 172.21.15.17:0/2140643447 learned_addr learned my addr 172.21.15.17:0/2140643447 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:10:27.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.433+0000 7f8598837640 1 --2- 172.21.15.17:0/2140643447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85941033e0 0x7f8594100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:27.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.433+0000 7f8599038640 1 -- 172.21.15.17:0/2140643447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85941033e0 msgr2=0x7f8594100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:27.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.433+0000 7f8599038640 1 --2- 172.21.15.17:0/2140643447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85941033e0 0x7f8594100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.433+0000 7f8599038640 1 -- 172.21.15.17:0/2140643447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85941011a0 con 0x7f8594102ac0 2024-09-20T19:10:27.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.434+0000 7f8599038640 1 --2- 172.21.15.17:0/2140643447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8594102ac0 0x7f8594100720 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f859000c810 tx=0x7f859000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:27.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.434+0000 7f858a7fc640 1 -- 172.21.15.17:0/2140643447 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8590004020 con 0x7f8594102ac0 2024-09-20T19:10:27.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.434+0000 7f859b29c640 1 -- 172.21.15.17:0/2140643447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8594101490 con 0x7f8594102ac0 2024-09-20T19:10:27.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.434+0000 7f858a7fc640 1 -- 172.21.15.17:0/2140643447 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f85900041c0 con 0x7f8594102ac0 2024-09-20T19:10:27.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.434+0000 7f858a7fc640 1 -- 172.21.15.17:0/2140643447 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85900047a0 con 0x7f8594102ac0 2024-09-20T19:10:27.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.434+0000 7f859b29c640 1 -- 172.21.15.17:0/2140643447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85941a3ea0 con 0x7f8594102ac0 2024-09-20T19:10:27.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.435+0000 7f859b29c640 1 -- 172.21.15.17:0/2140643447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f859406aa90 con 0x7f8594102ac0 2024-09-20T19:10:27.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.436+0000 7f858a7fc640 1 -- 172.21.15.17:0/2140643447 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f85900079b0 con 0x7f8594102ac0 2024-09-20T19:10:27.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.436+0000 7f858a7fc640 1 --2- 172.21.15.17:0/2140643447 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f858007af30 0x7f858007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:27.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.436+0000 7f858a7fc640 1 -- 172.21.15.17:0/2140643447 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f859009df90 con 0x7f8594102ac0 2024-09-20T19:10:27.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.436+0000 7f8598837640 1 --2- 172.21.15.17:0/2140643447 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f858007af30 0x7f858007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:27.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.437+0000 7f8598837640 1 --2- 172.21.15.17:0/2140643447 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f858007af30 0x7f858007d3f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8584031460 tx=0x7f8584009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:27.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.441+0000 7f858a7fc640 1 -- 172.21.15.17:0/2140643447 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8590014030 con 0x7f8594102ac0 2024-09-20T19:10:27.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.647+0000 7f859b29c640 1 -- 172.21.15.17:0/2140643447 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8594062630 con 0x7f858007af30 2024-09-20T19:10:27.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.648+0000 7f858a7fc640 1 -- 172.21.15.17:0/2140643447 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8594062630 con 0x7f858007af30 2024-09-20T19:10:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.650+0000 7f859b29c640 1 -- 172.21.15.17:0/2140643447 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f858007af30 msgr2=0x7f858007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.650+0000 7f859b29c640 1 --2- 172.21.15.17:0/2140643447 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f858007af30 0x7f858007d3f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8584031460 tx=0x7f8584009560 comp rx=0 tx=0).stop 2024-09-20T19:10:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.650+0000 7f859b29c640 1 -- 172.21.15.17:0/2140643447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8594102ac0 msgr2=0x7f8594100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.650+0000 7f859b29c640 1 --2- 172.21.15.17:0/2140643447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8594102ac0 0x7f8594100720 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f859000c810 tx=0x7f859000ccd0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.650+0000 7f859b29c640 1 -- 172.21.15.17:0/2140643447 shutdown_connections 2024-09-20T19:10:27.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.650+0000 7f859b29c640 1 --2- 172.21.15.17:0/2140643447 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f858007af30 0x7f858007d3f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.650+0000 7f859b29c640 1 --2- 172.21.15.17:0/2140643447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85941033e0 0x7f8594100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.650+0000 7f859b29c640 1 --2- 172.21.15.17:0/2140643447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8594102ac0 0x7f8594100720 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.650+0000 7f859b29c640 1 -- 172.21.15.17:0/2140643447 >> 172.21.15.17:0/2140643447 conn(0x7f85940fc520 msgr2=0x7f8594108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:27.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.651+0000 7f859b29c640 1 -- 172.21.15.17:0/2140643447 shutdown_connections 2024-09-20T19:10:27.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.651+0000 7f859b29c640 1 -- 172.21.15.17:0/2140643447 wait complete. 2024-09-20T19:10:27.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.736+0000 7f416ad08640 1 -- 172.21.15.17:0/2640678897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41641067f0 msgr2=0x7f4164106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:27.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.736+0000 7f416ad08640 1 --2- 172.21.15.17:0/2640678897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41641067f0 0x7f4164106bd0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4158009880 tx=0x7f415802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.736+0000 7f416ad08640 1 -- 172.21.15.17:0/2640678897 shutdown_connections 2024-09-20T19:10:27.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.736+0000 7f416ad08640 1 --2- 172.21.15.17:0/2640678897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41641007f0 0x7f4164100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.736+0000 7f416ad08640 1 --2- 172.21.15.17:0/2640678897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41641067f0 0x7f4164106bd0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.736+0000 7f416ad08640 1 -- 172.21.15.17:0/2640678897 >> 172.21.15.17:0/2640678897 conn(0x7f41640fc550 msgr2=0x7f41640fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:27.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.736+0000 7f416ad08640 1 -- 172.21.15.17:0/2640678897 shutdown_connections 2024-09-20T19:10:27.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.736+0000 7f416ad08640 1 -- 172.21.15.17:0/2640678897 wait complete. 2024-09-20T19:10:27.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.737+0000 7f416ad08640 1 Processor -- start 2024-09-20T19:10:27.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.737+0000 7f416ad08640 1 -- start start 2024-09-20T19:10:27.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.737+0000 7f416ad08640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41641007f0 0x7f416419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:27.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.737+0000 7f416ad08640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41641067f0 0x7f416419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:27.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.737+0000 7f416ad08640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f416410dcc0 con 0x7f41641007f0 2024-09-20T19:10:27.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.737+0000 7f416ad08640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f416410db40 con 0x7f41641067f0 2024-09-20T19:10:27.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.737+0000 7f4168aa4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41641007f0 0x7f416419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:27.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.737+0000 7f4168aa4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41641007f0 0x7f416419d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48288/0 (socket says 172.21.15.17:48288) 2024-09-20T19:10:27.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.738+0000 7f4168aa4640 1 -- 172.21.15.17:0/1008568744 learned_addr learned my addr 172.21.15.17:0/1008568744 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:10:27.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.738+0000 7f4163fff640 1 --2- 172.21.15.17:0/1008568744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41641067f0 0x7f416419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:27.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.738+0000 7f4168aa4640 1 -- 172.21.15.17:0/1008568744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41641067f0 msgr2=0x7f416419dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:27.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.738+0000 7f4168aa4640 1 --2- 172.21.15.17:0/1008568744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41641067f0 0x7f416419dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.738+0000 7f4168aa4640 1 -- 172.21.15.17:0/1008568744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41641977f0 con 0x7f41641007f0 2024-09-20T19:10:27.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.738+0000 7f4168aa4640 1 --2- 172.21.15.17:0/1008568744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41641007f0 0x7f416419d670 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4158031460 tx=0x7f41580045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:27.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.738+0000 7f4161ffb640 1 -- 172.21.15.17:0/1008568744 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f415803f070 con 0x7f41641007f0 2024-09-20T19:10:27.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.738+0000 7f416ad08640 1 -- 172.21.15.17:0/1008568744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4164197a80 con 0x7f41641007f0 2024-09-20T19:10:27.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.738+0000 7f4161ffb640 1 -- 172.21.15.17:0/1008568744 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f41580035f0 con 0x7f41641007f0 2024-09-20T19:10:27.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.738+0000 7f4161ffb640 1 -- 172.21.15.17:0/1008568744 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4158035030 con 0x7f41641007f0 2024-09-20T19:10:27.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.739+0000 7f416ad08640 1 -- 172.21.15.17:0/1008568744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4164197fb0 con 0x7f41641007f0 2024-09-20T19:10:27.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.740+0000 7f416ad08640 1 -- 172.21.15.17:0/1008568744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4164101f30 con 0x7f41641007f0 2024-09-20T19:10:27.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.740+0000 7f4161ffb640 1 -- 172.21.15.17:0/1008568744 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4158042070 con 0x7f41641007f0 2024-09-20T19:10:27.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.741+0000 7f4161ffb640 1 --2- 172.21.15.17:0/1008568744 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f415407af80 0x7f415407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:27.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.741+0000 7f4161ffb640 1 -- 172.21.15.17:0/1008568744 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f41580be910 con 0x7f41641007f0 2024-09-20T19:10:27.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.741+0000 7f4163fff640 1 --2- 172.21.15.17:0/1008568744 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f415407af80 0x7f415407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:27.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.742+0000 7f4163fff640 1 --2- 172.21.15.17:0/1008568744 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f415407af80 0x7f415407d440 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4150005fd0 tx=0x7f4150005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:27.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.745+0000 7f4161ffb640 1 -- 172.21.15.17:0/1008568744 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4158089f90 con 0x7f41641007f0 2024-09-20T19:10:27.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.941+0000 7f416ad08640 1 -- 172.21.15.17:0/1008568744 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4164198320 con 0x7f415407af80 2024-09-20T19:10:27.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.951+0000 7f4161ffb640 1 -- 172.21.15.17:0/1008568744 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f4164198320 con 0x7f415407af80 2024-09-20T19:10:27.954 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:10:27.954 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (31m) 10m ago 42m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:10:27.954 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (34m) 10m ago 43m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:10:27.954 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (34m) 10m ago 42m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:10:27.954 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (30m) 10m ago 43m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:10:27.954 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (30m) 10m ago 42m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:10:27.954 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (31m) 10m ago 42m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:10:27.954 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (26m) 10m ago 37m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:10:27.954 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (26m) 10m ago 37m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:10:27.954 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (10m) 10m ago 37m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:10:27.954 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (25m) 10m ago 37m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:10:27.954 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (34m) 10m ago 44m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:10:27.954 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (33m) 10m ago 41m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:10:27.955 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (30m) 10m ago 44m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:10:27.955 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (30m) 10m ago 41m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:10:27.955 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (32m) 10m ago 42m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:10:27.955 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (32m) 10m ago 42m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:10:27.955 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (29m) 10m ago 40m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:10:27.955 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (29m) 10m ago 40m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:10:27.955 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (28m) 10m ago 39m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:10:27.955 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (27m) 10m ago 39m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:10:27.955 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (27m) 10m ago 38m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:10:27.955 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (26m) 10m ago 38m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:10:27.955 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (32m) 10m ago 42m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:10:27.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.953+0000 7f416ad08640 1 -- 172.21.15.17:0/1008568744 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f415407af80 msgr2=0x7f415407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:27.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.953+0000 7f416ad08640 1 --2- 172.21.15.17:0/1008568744 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f415407af80 0x7f415407d440 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4150005fd0 tx=0x7f4150005850 comp rx=0 tx=0).stop 2024-09-20T19:10:27.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.953+0000 7f416ad08640 1 -- 172.21.15.17:0/1008568744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41641007f0 msgr2=0x7f416419d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:27.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.953+0000 7f416ad08640 1 --2- 172.21.15.17:0/1008568744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41641007f0 0x7f416419d670 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4158031460 tx=0x7f41580045e0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.953+0000 7f416ad08640 1 -- 172.21.15.17:0/1008568744 shutdown_connections 2024-09-20T19:10:27.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.953+0000 7f416ad08640 1 --2- 172.21.15.17:0/1008568744 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f415407af80 0x7f415407d440 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.953+0000 7f416ad08640 1 --2- 172.21.15.17:0/1008568744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41641067f0 0x7f416419dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.953+0000 7f416ad08640 1 --2- 172.21.15.17:0/1008568744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41641007f0 0x7f416419d670 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:27.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.954+0000 7f416ad08640 1 -- 172.21.15.17:0/1008568744 >> 172.21.15.17:0/1008568744 conn(0x7f41640fc550 msgr2=0x7f4164069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:27.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.954+0000 7f416ad08640 1 -- 172.21.15.17:0/1008568744 shutdown_connections 2024-09-20T19:10:27.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:27.954+0000 7f416ad08640 1 -- 172.21.15.17:0/1008568744 wait complete. 2024-09-20T19:10:28.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.037+0000 7f2c3cf9b640 1 -- 172.21.15.17:0/3540555718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c381007f0 msgr2=0x7f2c38100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:28.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.037+0000 7f2c3cf9b640 1 --2- 172.21.15.17:0/3540555718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c381007f0 0x7f2c38100c50 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009880 tx=0x7f2c2c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.040 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:27 smithi017 ceph-mon[108970]: pgmap v1052: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.037+0000 7f2c3cf9b640 1 -- 172.21.15.17:0/3540555718 shutdown_connections 2024-09-20T19:10:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.037+0000 7f2c3cf9b640 1 --2- 172.21.15.17:0/3540555718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c381007f0 0x7f2c38100c50 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.037+0000 7f2c3cf9b640 1 --2- 172.21.15.17:0/3540555718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c381067f0 0x7f2c38106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.037+0000 7f2c3cf9b640 1 -- 172.21.15.17:0/3540555718 >> 172.21.15.17:0/3540555718 conn(0x7f2c380fc550 msgr2=0x7f2c380fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.037+0000 7f2c3cf9b640 1 -- 172.21.15.17:0/3540555718 shutdown_connections 2024-09-20T19:10:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.037+0000 7f2c3cf9b640 1 -- 172.21.15.17:0/3540555718 wait complete. 2024-09-20T19:10:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.038+0000 7f2c3cf9b640 1 Processor -- start 2024-09-20T19:10:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.038+0000 7f2c3cf9b640 1 -- start start 2024-09-20T19:10:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.038+0000 7f2c3cf9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c381007f0 0x7f2c3819d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.038+0000 7f2c3cf9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c381067f0 0x7f2c3819db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.038+0000 7f2c3cf9b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3810dca0 con 0x7f2c381007f0 2024-09-20T19:10:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.038+0000 7f2c3cf9b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3810db20 con 0x7f2c381067f0 2024-09-20T19:10:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.038+0000 7f2c3659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c381007f0 0x7f2c3819d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.038+0000 7f2c3659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c381007f0 0x7f2c3819d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48300/0 (socket says 172.21.15.17:48300) 2024-09-20T19:10:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.038+0000 7f2c3659c640 1 -- 172.21.15.17:0/4255439294 learned_addr learned my addr 172.21.15.17:0/4255439294 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:10:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.038+0000 7f2c35d9b640 1 --2- 172.21.15.17:0/4255439294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c381067f0 0x7f2c3819db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.039+0000 7f2c3659c640 1 -- 172.21.15.17:0/4255439294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c381067f0 msgr2=0x7f2c3819db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.039+0000 7f2c3659c640 1 --2- 172.21.15.17:0/4255439294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c381067f0 0x7f2c3819db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.039+0000 7f2c3659c640 1 -- 172.21.15.17:0/4255439294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c38197780 con 0x7f2c381007f0 2024-09-20T19:10:28.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.039+0000 7f2c3659c640 1 --2- 172.21.15.17:0/4255439294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c381007f0 0x7f2c3819d600 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800c8a0 tx=0x7f2c2800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:28.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.039+0000 7f2c277fe640 1 -- 172.21.15.17:0/4255439294 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c280079b0 con 0x7f2c381007f0 2024-09-20T19:10:28.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.039+0000 7f2c3cf9b640 1 -- 172.21.15.17:0/4255439294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c38197a70 con 0x7f2c381007f0 2024-09-20T19:10:28.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.039+0000 7f2c277fe640 1 -- 172.21.15.17:0/4255439294 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2c28007b50 con 0x7f2c381007f0 2024-09-20T19:10:28.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.039+0000 7f2c277fe640 1 -- 172.21.15.17:0/4255439294 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c28018700 con 0x7f2c381007f0 2024-09-20T19:10:28.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.039+0000 7f2c3cf9b640 1 -- 172.21.15.17:0/4255439294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c38197fd0 con 0x7f2c381007f0 2024-09-20T19:10:28.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.040+0000 7f2c3cf9b640 1 -- 172.21.15.17:0/4255439294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c18005290 con 0x7f2c381007f0 2024-09-20T19:10:28.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.041+0000 7f2c277fe640 1 -- 172.21.15.17:0/4255439294 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2c28007d00 con 0x7f2c381007f0 2024-09-20T19:10:28.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.042+0000 7f2c277fe640 1 --2- 172.21.15.17:0/4255439294 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2c2007af30 0x7f2c2007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:28.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.042+0000 7f2c35d9b640 1 --2- 172.21.15.17:0/4255439294 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2c2007af30 0x7f2c2007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:28.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.042+0000 7f2c277fe640 1 -- 172.21.15.17:0/4255439294 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f2c2809e130 con 0x7f2c381007f0 2024-09-20T19:10:28.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.042+0000 7f2c35d9b640 1 --2- 172.21.15.17:0/4255439294 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2c2007af30 0x7f2c2007d3f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2c38198ad0 tx=0x7f2c2c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:28.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.046+0000 7f2c277fe640 1 -- 172.21.15.17:0/4255439294 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2c28014030 con 0x7f2c381007f0 2024-09-20T19:10:28.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:27 smithi172 ceph-mon[80431]: pgmap v1052: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:28.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.314+0000 7f2c3cf9b640 1 -- 172.21.15.17:0/4255439294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f2c18005d90 con 0x7f2c381007f0 2024-09-20T19:10:28.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.314+0000 7f2c277fe640 1 -- 172.21.15.17:0/4255439294 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f2c28069730 con 0x7f2c381007f0 2024-09-20T19:10:28.317 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:10:28.317 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:10:28.317 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:10:28.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:10:28.317 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:10:28.317 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:10:28.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:10:28.317 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:10:28.317 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:10:28.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:10:28.318 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:10:28.318 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:10:28.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:10:28.318 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:10:28.318 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:10:28.318 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:10:28.318 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:10:28.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.316+0000 7f2c3cf9b640 1 -- 172.21.15.17:0/4255439294 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2c2007af30 msgr2=0x7f2c2007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:28.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.316+0000 7f2c3cf9b640 1 --2- 172.21.15.17:0/4255439294 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2c2007af30 0x7f2c2007d3f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2c38198ad0 tx=0x7f2c2c031400 comp rx=0 tx=0).stop 2024-09-20T19:10:28.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.316+0000 7f2c3cf9b640 1 -- 172.21.15.17:0/4255439294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c381007f0 msgr2=0x7f2c3819d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:28.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.316+0000 7f2c3cf9b640 1 --2- 172.21.15.17:0/4255439294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c381007f0 0x7f2c3819d600 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800c8a0 tx=0x7f2c2800cd60 comp rx=0 tx=0).stop 2024-09-20T19:10:28.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.316+0000 7f2c3cf9b640 1 -- 172.21.15.17:0/4255439294 shutdown_connections 2024-09-20T19:10:28.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.316+0000 7f2c3cf9b640 1 --2- 172.21.15.17:0/4255439294 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2c2007af30 0x7f2c2007d3f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.316+0000 7f2c3cf9b640 1 --2- 172.21.15.17:0/4255439294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c381067f0 0x7f2c3819db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.316+0000 7f2c3cf9b640 1 --2- 172.21.15.17:0/4255439294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c381007f0 0x7f2c3819d600 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.316+0000 7f2c3cf9b640 1 -- 172.21.15.17:0/4255439294 >> 172.21.15.17:0/4255439294 conn(0x7f2c380fc550 msgr2=0x7f2c38069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:28.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.316+0000 7f2c3cf9b640 1 -- 172.21.15.17:0/4255439294 shutdown_connections 2024-09-20T19:10:28.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.316+0000 7f2c3cf9b640 1 -- 172.21.15.17:0/4255439294 wait complete. 2024-09-20T19:10:28.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.401+0000 7f590017d640 1 -- 172.21.15.17:0/2170466134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f81000d0 msgr2=0x7f58f8100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:28.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.401+0000 7f590017d640 1 --2- 172.21.15.17:0/2170466134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f81000d0 0x7f58f8100530 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009880 tx=0x7f58e802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.401+0000 7f590017d640 1 -- 172.21.15.17:0/2170466134 shutdown_connections 2024-09-20T19:10:28.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.401+0000 7f590017d640 1 --2- 172.21.15.17:0/2170466134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f81000d0 0x7f58f8100530 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.401+0000 7f590017d640 1 --2- 172.21.15.17:0/2170466134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58f8102650 0x7f58f8102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.401+0000 7f590017d640 1 -- 172.21.15.17:0/2170466134 >> 172.21.15.17:0/2170466134 conn(0x7f58f8077270 msgr2=0x7f58f8077680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:28.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.401+0000 7f590017d640 1 -- 172.21.15.17:0/2170466134 shutdown_connections 2024-09-20T19:10:28.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.401+0000 7f590017d640 1 -- 172.21.15.17:0/2170466134 wait complete. 2024-09-20T19:10:28.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.402+0000 7f590017d640 1 Processor -- start 2024-09-20T19:10:28.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.402+0000 7f590017d640 1 -- start start 2024-09-20T19:10:28.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.402+0000 7f590017d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58f81000d0 0x7f58f819f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:28.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.402+0000 7f590017d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f8102650 0x7f58f819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.402+0000 7f590017d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f58f8110fe0 con 0x7f58f8102650 2024-09-20T19:10:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.402+0000 7f590017d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f58f8110e60 con 0x7f58f81000d0 2024-09-20T19:10:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.402+0000 7f58fd718640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f8102650 0x7f58f819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.402+0000 7f58fd718640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f8102650 0x7f58f819fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48318/0 (socket says 172.21.15.17:48318) 2024-09-20T19:10:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.402+0000 7f58fd718640 1 -- 172.21.15.17:0/2540085800 learned_addr learned my addr 172.21.15.17:0/2540085800 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:10:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.403+0000 7f58fdf19640 1 --2- 172.21.15.17:0/2540085800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58f81000d0 0x7f58f819f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.403+0000 7f58fd718640 1 -- 172.21.15.17:0/2540085800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58f81000d0 msgr2=0x7f58f819f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.403+0000 7f58fd718640 1 --2- 172.21.15.17:0/2540085800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58f81000d0 0x7f58f819f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.403+0000 7f58fd718640 1 -- 172.21.15.17:0/2540085800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f8199950 con 0x7f58f8102650 2024-09-20T19:10:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.403+0000 7f58fdf19640 1 --2- 172.21.15.17:0/2540085800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58f81000d0 0x7f58f819f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:10:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.403+0000 7f58fd718640 1 --2- 172.21.15.17:0/2540085800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f8102650 0x7f58f819fcd0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f58e8031460 tx=0x7f58e80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.403+0000 7f58eeffd640 1 -- 172.21.15.17:0/2540085800 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58e803f070 con 0x7f58f8102650 2024-09-20T19:10:28.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.403+0000 7f58eeffd640 1 -- 172.21.15.17:0/2540085800 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f58e8004cf0 con 0x7f58f8102650 2024-09-20T19:10:28.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.403+0000 7f590017d640 1 -- 172.21.15.17:0/2540085800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f8199be0 con 0x7f58f8102650 2024-09-20T19:10:28.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.403+0000 7f58eeffd640 1 -- 172.21.15.17:0/2540085800 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58e8035030 con 0x7f58f8102650 2024-09-20T19:10:28.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.403+0000 7f590017d640 1 -- 172.21.15.17:0/2540085800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f819a110 con 0x7f58f8102650 2024-09-20T19:10:28.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.404+0000 7f590017d640 1 -- 172.21.15.17:0/2540085800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58f8069f00 con 0x7f58f8102650 2024-09-20T19:10:28.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.405+0000 7f58eeffd640 1 -- 172.21.15.17:0/2540085800 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f58e8042070 con 0x7f58f8102650 2024-09-20T19:10:28.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.405+0000 7f58eeffd640 1 --2- 172.21.15.17:0/2540085800 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f58e407af30 0x7f58e407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:28.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.405+0000 7f58eeffd640 1 -- 172.21.15.17:0/2540085800 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f58e80beb00 con 0x7f58f8102650 2024-09-20T19:10:28.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.406+0000 7f58fdf19640 1 --2- 172.21.15.17:0/2540085800 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f58e407af30 0x7f58e407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:28.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.406+0000 7f58fdf19640 1 --2- 172.21.15.17:0/2540085800 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f58e407af30 0x7f58e407d3f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f58f40058c0 tx=0x7f58f4005d50 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:28.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.410+0000 7f58eeffd640 1 -- 172.21.15.17:0/2540085800 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f58e808a100 con 0x7f58f8102650 2024-09-20T19:10:28.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.650+0000 7f590017d640 1 -- 172.21.15.17:0/2540085800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f58f819af10 con 0x7f58f8102650 2024-09-20T19:10:28.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.650+0000 7f58eeffd640 1 -- 172.21.15.17:0/2540085800 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7f58e808efb0 con 0x7f58f8102650 2024-09-20T19:10:28.654 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:10:28.654 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:10:28.654 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:10:28.654 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:10:28.654 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:10:28.654 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:10:28.654 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:10:28.654 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:10:28.654 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:10:28.654 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:10:28.655 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:10:28.655 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:10:28.655 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:10:28.655 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:10:28.655 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:10:28.655 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:10:28.655 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:10:28.655 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:10:28.655 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:10:28.655 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:10:28.655 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:10:28.656 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:10:28.656 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:10:28.656 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:10:28.656 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:10:28.656 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:10:28.656 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:10:28.656 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:10:28.656 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:10:28.656 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:10:28.656 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:10:28.656 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:10:28.656 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:10:28.657 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:10:28.657 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:10:28.657 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:10:28.657 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:10:28.657 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:10:28.657 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:10:28.657 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:10:28.657 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:10:28.657 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:10:28.657 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:10:28.658 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:10:28.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.653+0000 7f590017d640 1 -- 172.21.15.17:0/2540085800 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f58e407af30 msgr2=0x7f58e407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:28.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.653+0000 7f590017d640 1 --2- 172.21.15.17:0/2540085800 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f58e407af30 0x7f58e407d3f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f58f40058c0 tx=0x7f58f4005d50 comp rx=0 tx=0).stop 2024-09-20T19:10:28.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.653+0000 7f590017d640 1 -- 172.21.15.17:0/2540085800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f8102650 msgr2=0x7f58f819fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:28.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.653+0000 7f590017d640 1 --2- 172.21.15.17:0/2540085800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f8102650 0x7f58f819fcd0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f58e8031460 tx=0x7f58e80048f0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.653+0000 7f590017d640 1 -- 172.21.15.17:0/2540085800 shutdown_connections 2024-09-20T19:10:28.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.653+0000 7f590017d640 1 --2- 172.21.15.17:0/2540085800 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f58e407af30 0x7f58e407d3f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.653+0000 7f590017d640 1 --2- 172.21.15.17:0/2540085800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f8102650 0x7f58f819fcd0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.653+0000 7f590017d640 1 --2- 172.21.15.17:0/2540085800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58f81000d0 0x7f58f819f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.653+0000 7f590017d640 1 -- 172.21.15.17:0/2540085800 >> 172.21.15.17:0/2540085800 conn(0x7f58f8077270 msgr2=0x7f58f80fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:28.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.653+0000 7f590017d640 1 -- 172.21.15.17:0/2540085800 shutdown_connections 2024-09-20T19:10:28.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.653+0000 7f590017d640 1 -- 172.21.15.17:0/2540085800 wait complete. 2024-09-20T19:10:28.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.738+0000 7f1a0da65640 1 -- 172.21.15.17:0/2413638697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a08102ac0 msgr2=0x7f1a08102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:28.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.738+0000 7f1a0da65640 1 --2- 172.21.15.17:0/2413638697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a08102ac0 0x7f1a08102ea0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009880 tx=0x7f19f802a530 comp rx=0 tx=0).stop 2024-09-20T19:10:28.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.738+0000 7f1a0da65640 1 -- 172.21.15.17:0/2413638697 shutdown_connections 2024-09-20T19:10:28.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.738+0000 7f1a0da65640 1 --2- 172.21.15.17:0/2413638697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a081033e0 0x7f1a0810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.738+0000 7f1a0da65640 1 --2- 172.21.15.17:0/2413638697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a08102ac0 0x7f1a08102ea0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.738+0000 7f1a0da65640 1 -- 172.21.15.17:0/2413638697 >> 172.21.15.17:0/2413638697 conn(0x7f1a080fc520 msgr2=0x7f1a080fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:28.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.738+0000 7f1a0da65640 1 -- 172.21.15.17:0/2413638697 shutdown_connections 2024-09-20T19:10:28.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.738+0000 7f1a0da65640 1 -- 172.21.15.17:0/2413638697 wait complete. 2024-09-20T19:10:28.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.739+0000 7f1a0da65640 1 Processor -- start 2024-09-20T19:10:28.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.739+0000 7f1a0da65640 1 -- start start 2024-09-20T19:10:28.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.739+0000 7f1a0da65640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a08102ac0 0x7f1a08100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:28.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.739+0000 7f1a0da65640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a081033e0 0x7f1a08100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:28.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.739+0000 7f1a0da65640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0810ee50 con 0x7f1a081033e0 2024-09-20T19:10:28.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.739+0000 7f1a0da65640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0810ecd0 con 0x7f1a08102ac0 2024-09-20T19:10:28.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.739+0000 7f1a06ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a081033e0 0x7f1a08100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:28.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.740+0000 7f1a06ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a081033e0 0x7f1a08100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48344/0 (socket says 172.21.15.17:48344) 2024-09-20T19:10:28.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.740+0000 7f1a06ffd640 1 -- 172.21.15.17:0/2238256091 learned_addr learned my addr 172.21.15.17:0/2238256091 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:10:28.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.740+0000 7f1a077fe640 1 --2- 172.21.15.17:0/2238256091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a08102ac0 0x7f1a08100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:28.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.740+0000 7f1a06ffd640 1 -- 172.21.15.17:0/2238256091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a08102ac0 msgr2=0x7f1a08100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:28.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.740+0000 7f1a06ffd640 1 --2- 172.21.15.17:0/2238256091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a08102ac0 0x7f1a08100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.740+0000 7f1a06ffd640 1 -- 172.21.15.17:0/2238256091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a081011a0 con 0x7f1a081033e0 2024-09-20T19:10:28.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.740+0000 7f1a077fe640 1 --2- 172.21.15.17:0/2238256091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a08102ac0 0x7f1a08100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:10:28.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.740+0000 7f1a06ffd640 1 --2- 172.21.15.17:0/2238256091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a081033e0 0x7f1a08100c60 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00b370 tx=0x7f19fc00b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:28.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.740+0000 7f1a04ff9640 1 -- 172.21.15.17:0/2238256091 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19fc015020 con 0x7f1a081033e0 2024-09-20T19:10:28.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.740+0000 7f1a0da65640 1 -- 172.21.15.17:0/2238256091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a08101490 con 0x7f1a081033e0 2024-09-20T19:10:28.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.740+0000 7f1a04ff9640 1 -- 172.21.15.17:0/2238256091 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f19fc011af0 con 0x7f1a081033e0 2024-09-20T19:10:28.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.740+0000 7f1a04ff9640 1 -- 172.21.15.17:0/2238256091 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19fc010d60 con 0x7f1a081033e0 2024-09-20T19:10:28.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.740+0000 7f1a0da65640 1 -- 172.21.15.17:0/2238256091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a081a3f80 con 0x7f1a081033e0 2024-09-20T19:10:28.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.741+0000 7f1a0da65640 1 -- 172.21.15.17:0/2238256091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a0806aa90 con 0x7f1a081033e0 2024-09-20T19:10:28.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.742+0000 7f1a04ff9640 1 -- 172.21.15.17:0/2238256091 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f19fc018020 con 0x7f1a081033e0 2024-09-20T19:10:28.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.743+0000 7f1a04ff9640 1 --2- 172.21.15.17:0/2238256091 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f19f007af30 0x7f19f007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:28.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.743+0000 7f1a077fe640 1 --2- 172.21.15.17:0/2238256091 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f19f007af30 0x7f19f007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:28.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.743+0000 7f1a04ff9640 1 -- 172.21.15.17:0/2238256091 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f19fc09d960 con 0x7f1a081033e0 2024-09-20T19:10:28.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.743+0000 7f1a077fe640 1 --2- 172.21.15.17:0/2238256091 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f19f007af30 0x7f19f007d3f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f19f8006010 tx=0x7f19f80095f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:28.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.747+0000 7f1a04ff9640 1 -- 172.21.15.17:0/2238256091 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f19fc01f020 con 0x7f1a081033e0 2024-09-20T19:10:28.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.952+0000 7f1a0da65640 1 -- 172.21.15.17:0/2238256091 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1a08062630 con 0x7f19f007af30 2024-09-20T19:10:28.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.954+0000 7f1a04ff9640 1 -- 172.21.15.17:0/2238256091 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f1a08062630 con 0x7f19f007af30 2024-09-20T19:10:28.956 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:10:28.956 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:10:28.957 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:10:28.957 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:10:28.957 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:10:28.957 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:10:28.957 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:10:28.957 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:10:28.957 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:10:28.957 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:10:28.957 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:10:28.957 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:10:28.957 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:10:28.957 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:10:28.957 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:10:28.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.956+0000 7f1a0da65640 1 -- 172.21.15.17:0/2238256091 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f19f007af30 msgr2=0x7f19f007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:28.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.956+0000 7f1a0da65640 1 --2- 172.21.15.17:0/2238256091 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f19f007af30 0x7f19f007d3f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f19f8006010 tx=0x7f19f80095f0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.956+0000 7f1a0da65640 1 -- 172.21.15.17:0/2238256091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a081033e0 msgr2=0x7f1a08100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:28.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.956+0000 7f1a0da65640 1 --2- 172.21.15.17:0/2238256091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a081033e0 0x7f1a08100c60 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00b370 tx=0x7f19fc00b830 comp rx=0 tx=0).stop 2024-09-20T19:10:28.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.956+0000 7f1a0da65640 1 -- 172.21.15.17:0/2238256091 shutdown_connections 2024-09-20T19:10:28.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.956+0000 7f1a0da65640 1 --2- 172.21.15.17:0/2238256091 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f19f007af30 0x7f19f007d3f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.956+0000 7f1a0da65640 1 --2- 172.21.15.17:0/2238256091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a081033e0 0x7f1a08100c60 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.956+0000 7f1a0da65640 1 --2- 172.21.15.17:0/2238256091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a08102ac0 0x7f1a08100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:28.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.956+0000 7f1a0da65640 1 -- 172.21.15.17:0/2238256091 >> 172.21.15.17:0/2238256091 conn(0x7f1a080fc520 msgr2=0x7f1a08108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:28.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.956+0000 7f1a0da65640 1 -- 172.21.15.17:0/2238256091 shutdown_connections 2024-09-20T19:10:28.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:28.956+0000 7f1a0da65640 1 -- 172.21.15.17:0/2238256091 wait complete. 2024-09-20T19:10:29.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.040+0000 7f5b72029640 1 -- 172.21.15.17:0/449930181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b6c101900 msgr2=0x7f5b6c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:29.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.040+0000 7f5b72029640 1 --2- 172.21.15.17:0/449930181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b6c101900 0x7f5b6c101d60 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009880 tx=0x7f5b6002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:10:29.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.040+0000 7f5b72029640 1 -- 172.21.15.17:0/449930181 shutdown_connections 2024-09-20T19:10:29.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.040+0000 7f5b72029640 1 --2- 172.21.15.17:0/449930181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b6c101900 0x7f5b6c101d60 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:29.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.040+0000 7f5b72029640 1 --2- 172.21.15.17:0/449930181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b6c107900 0x7f5b6c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:29.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.040+0000 7f5b72029640 1 -- 172.21.15.17:0/449930181 >> 172.21.15.17:0/449930181 conn(0x7f5b6c0fd600 msgr2=0x7f5b6c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:29.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.040+0000 7f5b72029640 1 -- 172.21.15.17:0/449930181 shutdown_connections 2024-09-20T19:10:29.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.040+0000 7f5b72029640 1 -- 172.21.15.17:0/449930181 wait complete. 2024-09-20T19:10:29.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.041+0000 7f5b72029640 1 Processor -- start 2024-09-20T19:10:29.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.041+0000 7f5b72029640 1 -- start start 2024-09-20T19:10:29.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.041+0000 7f5b72029640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b6c101900 0x7f5b6c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:29.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.041+0000 7f5b72029640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b6c107900 0x7f5b6c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:29.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.041+0000 7f5b72029640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c10edd0 con 0x7f5b6c101900 2024-09-20T19:10:29.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.041+0000 7f5b72029640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c10ec50 con 0x7f5b6c107900 2024-09-20T19:10:29.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.041+0000 7f5b6b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b6c101900 0x7f5b6c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:29.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.041+0000 7f5b6b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b6c101900 0x7f5b6c19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48376/0 (socket says 172.21.15.17:48376) 2024-09-20T19:10:29.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.041+0000 7f5b6b7fe640 1 -- 172.21.15.17:0/1865226934 learned_addr learned my addr 172.21.15.17:0/1865226934 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:10:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.042+0000 7f5b6affd640 1 --2- 172.21.15.17:0/1865226934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b6c107900 0x7f5b6c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.042+0000 7f5b6b7fe640 1 -- 172.21.15.17:0/1865226934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b6c107900 msgr2=0x7f5b6c19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.042+0000 7f5b6b7fe640 1 --2- 172.21.15.17:0/1865226934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b6c107900 0x7f5b6c19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.042+0000 7f5b6b7fe640 1 -- 172.21.15.17:0/1865226934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6c197800 con 0x7f5b6c101900 2024-09-20T19:10:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.042+0000 7f5b6b7fe640 1 --2- 172.21.15.17:0/1865226934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b6c101900 0x7f5b6c19d680 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00e970 tx=0x7f5b5c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.042+0000 7f5b68ff9640 1 -- 172.21.15.17:0/1865226934 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b5c00cac0 con 0x7f5b6c101900 2024-09-20T19:10:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.042+0000 7f5b68ff9640 1 -- 172.21.15.17:0/1865226934 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b5c0054e0 con 0x7f5b6c101900 2024-09-20T19:10:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.042+0000 7f5b72029640 1 -- 172.21.15.17:0/1865226934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b6c197af0 con 0x7f5b6c101900 2024-09-20T19:10:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.042+0000 7f5b68ff9640 1 -- 172.21.15.17:0/1865226934 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b5c010430 con 0x7f5b6c101900 2024-09-20T19:10:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.042+0000 7f5b72029640 1 -- 172.21.15.17:0/1865226934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b6c198050 con 0x7f5b6c101900 2024-09-20T19:10:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.043+0000 7f5b72029640 1 -- 172.21.15.17:0/1865226934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b6c103040 con 0x7f5b6c101900 2024-09-20T19:10:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.044+0000 7f5b68ff9640 1 -- 172.21.15.17:0/1865226934 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5b5c004e80 con 0x7f5b6c101900 2024-09-20T19:10:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.044+0000 7f5b68ff9640 1 --2- 172.21.15.17:0/1865226934 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b5407af30 0x7f5b5407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.045+0000 7f5b6affd640 1 --2- 172.21.15.17:0/1865226934 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b5407af30 0x7f5b5407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.045+0000 7f5b68ff9640 1 -- 172.21.15.17:0/1865226934 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f5b5c09e630 con 0x7f5b6c101900 2024-09-20T19:10:29.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.045+0000 7f5b6affd640 1 --2- 172.21.15.17:0/1865226934 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b5407af30 0x7f5b5407d3f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c198b50 tx=0x7f5b60031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:29.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.049+0000 7f5b68ff9640 1 -- 172.21.15.17:0/1865226934 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5b5c069c30 con 0x7f5b6c101900 2024-09-20T19:10:29.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:28 smithi172 ceph-mon[80431]: from='client.35716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:29.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:28 smithi172 ceph-mon[80431]: from='client.35720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:29.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:28 smithi172 ceph-mon[80431]: from='client.35724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:29.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:28 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4255439294' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:10:29.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:28 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2540085800' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:10:29.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.314+0000 7f5b72029640 1 -- 172.21.15.17:0/1865226934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f5b6c109e70 con 0x7f5b6c101900 2024-09-20T19:10:29.317 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:28 smithi017 ceph-mon[108970]: from='client.35716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:29.317 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:28 smithi017 ceph-mon[108970]: from='client.35720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:29.317 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:28 smithi017 ceph-mon[108970]: from='client.35724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:29.317 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:28 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4255439294' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:10:29.317 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:28 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2540085800' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:10:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.314+0000 7f5b68ff9640 1 -- 172.21.15.17:0/1865226934 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f5b5c06eae0 con 0x7f5b6c101900 2024-09-20T19:10:29.318 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:10:29.318 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:10:29.318 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:10:29.318 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:10:29.318 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:10:29.318 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:10:29.318 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:10:29.318 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:10:29.318 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:10:29.318 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:10:29.318 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:10:29.318 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:10:29.318 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:10:29.319 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:10:29.319 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:10:29.319 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:10:29.319 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:10:29.319 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:10:29.319 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:10:29.319 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:10:29.319 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:10:29.319 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:10:29.319 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:10:29.319 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:10:29.320 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:10:29.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.317+0000 7f5b72029640 1 -- 172.21.15.17:0/1865226934 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b5407af30 msgr2=0x7f5b5407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.317+0000 7f5b72029640 1 --2- 172.21.15.17:0/1865226934 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b5407af30 0x7f5b5407d3f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c198b50 tx=0x7f5b60031400 comp rx=0 tx=0).stop 2024-09-20T19:10:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.317+0000 7f5b72029640 1 -- 172.21.15.17:0/1865226934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b6c101900 msgr2=0x7f5b6c19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.317+0000 7f5b72029640 1 --2- 172.21.15.17:0/1865226934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b6c101900 0x7f5b6c19d680 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00e970 tx=0x7f5b5c00ed70 comp rx=0 tx=0).stop 2024-09-20T19:10:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.317+0000 7f5b72029640 1 -- 172.21.15.17:0/1865226934 shutdown_connections 2024-09-20T19:10:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.317+0000 7f5b72029640 1 --2- 172.21.15.17:0/1865226934 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f5b5407af30 0x7f5b5407d3f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.317+0000 7f5b72029640 1 --2- 172.21.15.17:0/1865226934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b6c107900 0x7f5b6c19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.317+0000 7f5b72029640 1 --2- 172.21.15.17:0/1865226934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5b6c101900 0x7f5b6c19d680 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.317+0000 7f5b72029640 1 -- 172.21.15.17:0/1865226934 >> 172.21.15.17:0/1865226934 conn(0x7f5b6c0fd600 msgr2=0x7f5b6c0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:29.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.317+0000 7f5b72029640 1 -- 172.21.15.17:0/1865226934 shutdown_connections 2024-09-20T19:10:29.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:29.317+0000 7f5b72029640 1 -- 172.21.15.17:0/1865226934 wait complete. 2024-09-20T19:10:30.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:29 smithi172 ceph-mon[80431]: pgmap v1053: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:30.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:29 smithi172 ceph-mon[80431]: from='client.35736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:30.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:29 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1865226934' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:10:30.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:29 smithi017 ceph-mon[108970]: pgmap v1053: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:30.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:29 smithi017 ceph-mon[108970]: from='client.35736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:10:30.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:29 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1865226934' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:10:32.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:31 smithi172 ceph-mon[80431]: pgmap v1054: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:32.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:31 smithi017 ceph-mon[108970]: pgmap v1054: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:34.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:33 smithi172 ceph-mon[80431]: pgmap v1055: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:34.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:33 smithi017 ceph-mon[108970]: pgmap v1055: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:36.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:35 smithi172 ceph-mon[80431]: pgmap v1056: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:36.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:35 smithi017 ceph-mon[108970]: pgmap v1056: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:38.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:37 smithi172 ceph-mon[80431]: pgmap v1057: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:38.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:10:38.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:37 smithi017 ceph-mon[108970]: pgmap v1057: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:38.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:10:40.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:39 smithi017 ceph-mon[108970]: pgmap v1058: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:40.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:39 smithi172 ceph-mon[80431]: pgmap v1058: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:42.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:41 smithi017 ceph-mon[108970]: pgmap v1059: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:42.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:41 smithi172 ceph-mon[80431]: pgmap v1059: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:44.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:43 smithi017 ceph-mon[108970]: pgmap v1060: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:44.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:43 smithi172 ceph-mon[80431]: pgmap v1060: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:46.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:45 smithi017 ceph-mon[108970]: pgmap v1061: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:46.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:45 smithi172 ceph-mon[80431]: pgmap v1061: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:48.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:47 smithi017 ceph-mon[108970]: pgmap v1062: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:48.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:47 smithi172 ceph-mon[80431]: pgmap v1062: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:50.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:49 smithi172 ceph-mon[80431]: pgmap v1063: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:50.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:49 smithi017 ceph-mon[108970]: pgmap v1063: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:52.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:51 smithi017 ceph-mon[108970]: pgmap v1064: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:52.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:51 smithi172 ceph-mon[80431]: pgmap v1064: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:53.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:10:53.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:10:54.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:53 smithi017 ceph-mon[108970]: pgmap v1065: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:54.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:53 smithi172 ceph-mon[80431]: pgmap v1065: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:56.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:55 smithi017 ceph-mon[108970]: pgmap v1066: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:56.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:55 smithi172 ceph-mon[80431]: pgmap v1066: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:58.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:57 smithi017 ceph-mon[108970]: pgmap v1067: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:58.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:57 smithi172 ceph-mon[80431]: pgmap v1067: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:10:59.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.414+0000 7f62dd9f6640 1 -- 172.21.15.17:0/2464205244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d81033d0 msgr2=0x7f62d810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:59.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.414+0000 7f62dd9f6640 1 --2- 172.21.15.17:0/2464205244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d81033d0 0x7f62d810b8c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009880 tx=0x7f62c002a530 comp rx=0 tx=0).stop 2024-09-20T19:10:59.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.414+0000 7f62dd9f6640 1 -- 172.21.15.17:0/2464205244 shutdown_connections 2024-09-20T19:10:59.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.414+0000 7f62dd9f6640 1 --2- 172.21.15.17:0/2464205244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d81033d0 0x7f62d810b8c0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:59.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.414+0000 7f62dd9f6640 1 --2- 172.21.15.17:0/2464205244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62d8102ab0 0x7f62d8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:59.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.414+0000 7f62dd9f6640 1 -- 172.21.15.17:0/2464205244 >> 172.21.15.17:0/2464205244 conn(0x7f62d80fc550 msgr2=0x7f62d80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:59.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.414+0000 7f62dd9f6640 1 -- 172.21.15.17:0/2464205244 shutdown_connections 2024-09-20T19:10:59.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.414+0000 7f62dd9f6640 1 -- 172.21.15.17:0/2464205244 wait complete. 2024-09-20T19:10:59.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.414+0000 7f62dd9f6640 1 Processor -- start 2024-09-20T19:10:59.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.415+0000 7f62dd9f6640 1 -- start start 2024-09-20T19:10:59.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.415+0000 7f62dd9f6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62d8102ab0 0x7f62d819d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:59.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.415+0000 7f62dd9f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d81033d0 0x7f62d819db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:59.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.415+0000 7f62dd9f6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f62d810edc0 con 0x7f62d81033d0 2024-09-20T19:10:59.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.415+0000 7f62dd9f6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f62d810ec40 con 0x7f62d8102ab0 2024-09-20T19:10:59.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.415+0000 7f62d67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d81033d0 0x7f62d819db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:59.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.415+0000 7f62d67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d81033d0 0x7f62d819db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53754/0 (socket says 172.21.15.17:53754) 2024-09-20T19:10:59.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.415+0000 7f62d67fc640 1 -- 172.21.15.17:0/124711291 learned_addr learned my addr 172.21.15.17:0/124711291 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:10:59.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.415+0000 7f62d6ffd640 1 --2- 172.21.15.17:0/124711291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62d8102ab0 0x7f62d819d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:59.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.416+0000 7f62d67fc640 1 -- 172.21.15.17:0/124711291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62d8102ab0 msgr2=0x7f62d819d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:59.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.416+0000 7f62d67fc640 1 --2- 172.21.15.17:0/124711291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62d8102ab0 0x7f62d819d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:59.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.416+0000 7f62d67fc640 1 -- 172.21.15.17:0/124711291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d8197790 con 0x7f62d81033d0 2024-09-20T19:10:59.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.416+0000 7f62d67fc640 1 --2- 172.21.15.17:0/124711291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d81033d0 0x7f62d819db50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f62c0031460 tx=0x7f62c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:59.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.416+0000 7f62dc9f4640 1 -- 172.21.15.17:0/124711291 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f62c003f070 con 0x7f62d81033d0 2024-09-20T19:10:59.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.416+0000 7f62dc9f4640 1 -- 172.21.15.17:0/124711291 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f62c0004ac0 con 0x7f62d81033d0 2024-09-20T19:10:59.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.416+0000 7f62dd9f6640 1 -- 172.21.15.17:0/124711291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d8197a20 con 0x7f62d81033d0 2024-09-20T19:10:59.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.416+0000 7f62dc9f4640 1 -- 172.21.15.17:0/124711291 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f62c0035030 con 0x7f62d81033d0 2024-09-20T19:10:59.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.416+0000 7f62dd9f6640 1 -- 172.21.15.17:0/124711291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d8197f50 con 0x7f62d81033d0 2024-09-20T19:10:59.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.417+0000 7f62dd9f6640 1 -- 172.21.15.17:0/124711291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62d806a580 con 0x7f62d81033d0 2024-09-20T19:10:59.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.418+0000 7f62dc9f4640 1 -- 172.21.15.17:0/124711291 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f62c0042070 con 0x7f62d81033d0 2024-09-20T19:10:59.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.419+0000 7f62dc9f4640 1 --2- 172.21.15.17:0/124711291 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f62c407af30 0x7f62c407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:59.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.419+0000 7f62dc9f4640 1 -- 172.21.15.17:0/124711291 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f62c00be9b0 con 0x7f62d81033d0 2024-09-20T19:10:59.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.419+0000 7f62d6ffd640 1 --2- 172.21.15.17:0/124711291 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f62c407af30 0x7f62c407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:59.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.420+0000 7f62d6ffd640 1 --2- 172.21.15.17:0/124711291 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f62c407af30 0x7f62c407d3f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f62c8005c40 tx=0x7f62c800a590 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:59.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.423+0000 7f62dc9f4640 1 -- 172.21.15.17:0/124711291 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f62c0089fb0 con 0x7f62d81033d0 2024-09-20T19:10:59.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.632+0000 7f62dd9f6640 1 -- 172.21.15.17:0/124711291 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f62d81982c0 con 0x7f62c407af30 2024-09-20T19:10:59.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.633+0000 7f62dc9f4640 1 -- 172.21.15.17:0/124711291 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f62d81982c0 con 0x7f62c407af30 2024-09-20T19:10:59.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.636+0000 7f62dd9f6640 1 -- 172.21.15.17:0/124711291 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f62c407af30 msgr2=0x7f62c407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:59.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.636+0000 7f62dd9f6640 1 --2- 172.21.15.17:0/124711291 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f62c407af30 0x7f62c407d3f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f62c8005c40 tx=0x7f62c800a590 comp rx=0 tx=0).stop 2024-09-20T19:10:59.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.636+0000 7f62dd9f6640 1 -- 172.21.15.17:0/124711291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d81033d0 msgr2=0x7f62d819db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:59.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.636+0000 7f62dd9f6640 1 --2- 172.21.15.17:0/124711291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d81033d0 0x7f62d819db50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f62c0031460 tx=0x7f62c00046c0 comp rx=0 tx=0).stop 2024-09-20T19:10:59.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.636+0000 7f62dd9f6640 1 -- 172.21.15.17:0/124711291 shutdown_connections 2024-09-20T19:10:59.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.636+0000 7f62dd9f6640 1 --2- 172.21.15.17:0/124711291 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f62c407af30 0x7f62c407d3f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:59.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.636+0000 7f62dd9f6640 1 --2- 172.21.15.17:0/124711291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d81033d0 0x7f62d819db50 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:59.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.636+0000 7f62dd9f6640 1 --2- 172.21.15.17:0/124711291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62d8102ab0 0x7f62d819d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:59.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.636+0000 7f62dd9f6640 1 -- 172.21.15.17:0/124711291 >> 172.21.15.17:0/124711291 conn(0x7f62d80fc550 msgr2=0x7f62d810aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:59.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.636+0000 7f62dd9f6640 1 -- 172.21.15.17:0/124711291 shutdown_connections 2024-09-20T19:10:59.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.636+0000 7f62dd9f6640 1 -- 172.21.15.17:0/124711291 wait complete. 2024-09-20T19:10:59.648 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:10:59.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.722+0000 7f76f42d1640 1 -- 172.21.15.17:0/892914213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76ec1033e0 msgr2=0x7f76ec10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:59.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.722+0000 7f76f42d1640 1 --2- 172.21.15.17:0/892914213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76ec1033e0 0x7f76ec10b8d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009880 tx=0x7f76dc02a530 comp rx=0 tx=0).stop 2024-09-20T19:10:59.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.722+0000 7f76f42d1640 1 -- 172.21.15.17:0/892914213 shutdown_connections 2024-09-20T19:10:59.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.722+0000 7f76f42d1640 1 --2- 172.21.15.17:0/892914213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76ec1033e0 0x7f76ec10b8d0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:59.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.722+0000 7f76f42d1640 1 --2- 172.21.15.17:0/892914213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76ec102ac0 0x7f76ec102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:59.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.722+0000 7f76f42d1640 1 -- 172.21.15.17:0/892914213 >> 172.21.15.17:0/892914213 conn(0x7f76ec0fc520 msgr2=0x7f76ec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:59.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.722+0000 7f76f42d1640 1 -- 172.21.15.17:0/892914213 shutdown_connections 2024-09-20T19:10:59.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.722+0000 7f76f42d1640 1 -- 172.21.15.17:0/892914213 wait complete. 2024-09-20T19:10:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.723+0000 7f76f42d1640 1 Processor -- start 2024-09-20T19:10:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.723+0000 7f76f42d1640 1 -- start start 2024-09-20T19:10:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.723+0000 7f76f42d1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76ec102ac0 0x7f76ec19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.723+0000 7f76f42d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76ec1033e0 0x7f76ec19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.723+0000 7f76f42d1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec10edd0 con 0x7f76ec1033e0 2024-09-20T19:10:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.723+0000 7f76f42d1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec10ec50 con 0x7f76ec102ac0 2024-09-20T19:10:59.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.723+0000 7f76f186c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76ec1033e0 0x7f76ec19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.723+0000 7f76f186c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76ec1033e0 0x7f76ec19dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53764/0 (socket says 172.21.15.17:53764) 2024-09-20T19:10:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.723+0000 7f76f186c640 1 -- 172.21.15.17:0/204395107 learned_addr learned my addr 172.21.15.17:0/204395107 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:10:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.723+0000 7f76f206d640 1 --2- 172.21.15.17:0/204395107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76ec102ac0 0x7f76ec19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.724+0000 7f76f186c640 1 -- 172.21.15.17:0/204395107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76ec102ac0 msgr2=0x7f76ec19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.724+0000 7f76f186c640 1 --2- 172.21.15.17:0/204395107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76ec102ac0 0x7f76ec19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.724+0000 7f76f186c640 1 -- 172.21.15.17:0/204395107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec1977e0 con 0x7f76ec1033e0 2024-09-20T19:10:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.724+0000 7f76f206d640 1 --2- 172.21.15.17:0/204395107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76ec102ac0 0x7f76ec19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:10:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.724+0000 7f76f186c640 1 --2- 172.21.15.17:0/204395107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76ec1033e0 0x7f76ec19dba0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f76dc031460 tx=0x7f76dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.724+0000 7f76e37fe640 1 -- 172.21.15.17:0/204395107 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76dc03f070 con 0x7f76ec1033e0 2024-09-20T19:10:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.724+0000 7f76e37fe640 1 -- 172.21.15.17:0/204395107 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76dc004ac0 con 0x7f76ec1033e0 2024-09-20T19:10:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.724+0000 7f76f42d1640 1 -- 172.21.15.17:0/204395107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76ec197a70 con 0x7f76ec1033e0 2024-09-20T19:10:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.724+0000 7f76e37fe640 1 -- 172.21.15.17:0/204395107 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76dc035030 con 0x7f76ec1033e0 2024-09-20T19:10:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.724+0000 7f76f42d1640 1 -- 172.21.15.17:0/204395107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76ec197fa0 con 0x7f76ec1033e0 2024-09-20T19:10:59.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.726+0000 7f76f42d1640 1 -- 172.21.15.17:0/204395107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76ec06aa90 con 0x7f76ec1033e0 2024-09-20T19:10:59.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.726+0000 7f76e37fe640 1 -- 172.21.15.17:0/204395107 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f76dc042070 con 0x7f76ec1033e0 2024-09-20T19:10:59.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.727+0000 7f76e37fe640 1 --2- 172.21.15.17:0/204395107 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f76d807af80 0x7f76d807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:10:59.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.727+0000 7f76e37fe640 1 -- 172.21.15.17:0/204395107 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f76dc0be960 con 0x7f76ec1033e0 2024-09-20T19:10:59.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.727+0000 7f76f206d640 1 --2- 172.21.15.17:0/204395107 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f76d807af80 0x7f76d807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:10:59.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.727+0000 7f76f206d640 1 --2- 172.21.15.17:0/204395107 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f76d807af80 0x7f76d807d440 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f76e800abe0 tx=0x7f76e800a5c0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:10:59.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.732+0000 7f76e37fe640 1 -- 172.21.15.17:0/204395107 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f76dc089fe0 con 0x7f76ec1033e0 2024-09-20T19:10:59.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.936+0000 7f76f42d1640 1 -- 172.21.15.17:0/204395107 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f76ec198250 con 0x7f76d807af80 2024-09-20T19:10:59.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.937+0000 7f76e37fe640 1 -- 172.21.15.17:0/204395107 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f76ec198250 con 0x7f76d807af80 2024-09-20T19:10:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.939+0000 7f76f42d1640 1 -- 172.21.15.17:0/204395107 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f76d807af80 msgr2=0x7f76d807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.939+0000 7f76f42d1640 1 --2- 172.21.15.17:0/204395107 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f76d807af80 0x7f76d807d440 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f76e800abe0 tx=0x7f76e800a5c0 comp rx=0 tx=0).stop 2024-09-20T19:10:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.939+0000 7f76f42d1640 1 -- 172.21.15.17:0/204395107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76ec1033e0 msgr2=0x7f76ec19dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:10:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.939+0000 7f76f42d1640 1 --2- 172.21.15.17:0/204395107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76ec1033e0 0x7f76ec19dba0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f76dc031460 tx=0x7f76dc0046c0 comp rx=0 tx=0).stop 2024-09-20T19:10:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.939+0000 7f76f42d1640 1 -- 172.21.15.17:0/204395107 shutdown_connections 2024-09-20T19:10:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.939+0000 7f76f42d1640 1 --2- 172.21.15.17:0/204395107 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f76d807af80 0x7f76d807d440 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.939+0000 7f76f42d1640 1 --2- 172.21.15.17:0/204395107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76ec1033e0 0x7f76ec19dba0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.939+0000 7f76f42d1640 1 --2- 172.21.15.17:0/204395107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76ec102ac0 0x7f76ec19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:10:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.939+0000 7f76f42d1640 1 -- 172.21.15.17:0/204395107 >> 172.21.15.17:0/204395107 conn(0x7f76ec0fc520 msgr2=0x7f76ec108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:10:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.939+0000 7f76f42d1640 1 -- 172.21.15.17:0/204395107 shutdown_connections 2024-09-20T19:10:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:10:59.939+0000 7f76f42d1640 1 -- 172.21.15.17:0/204395107 wait complete. 2024-09-20T19:11:00.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.024+0000 7f41fdfa7640 1 -- 172.21.15.17:0/1042037127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41f81007f0 msgr2=0x7f41f8100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:00.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.024+0000 7f41fdfa7640 1 --2- 172.21.15.17:0/1042037127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41f81007f0 0x7f41f8100c50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f41ec009880 tx=0x7f41ec02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.024+0000 7f41fdfa7640 1 -- 172.21.15.17:0/1042037127 shutdown_connections 2024-09-20T19:11:00.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.024+0000 7f41fdfa7640 1 --2- 172.21.15.17:0/1042037127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41f81007f0 0x7f41f8100c50 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.024+0000 7f41fdfa7640 1 --2- 172.21.15.17:0/1042037127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f81067f0 0x7f41f8106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.024+0000 7f41fdfa7640 1 -- 172.21.15.17:0/1042037127 >> 172.21.15.17:0/1042037127 conn(0x7f41f80fc550 msgr2=0x7f41f80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:00.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.024+0000 7f41fdfa7640 1 -- 172.21.15.17:0/1042037127 shutdown_connections 2024-09-20T19:11:00.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.024+0000 7f41fdfa7640 1 -- 172.21.15.17:0/1042037127 wait complete. 2024-09-20T19:11:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.024+0000 7f41fdfa7640 1 Processor -- start 2024-09-20T19:11:00.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.025+0000 7f41fdfa7640 1 -- start start 2024-09-20T19:11:00.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.025+0000 7f41fdfa7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41f81007f0 0x7f41f81987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:00.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.025+0000 7f41fdfa7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f81067f0 0x7f41f8198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:00.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.025+0000 7f41fdfa7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f41f810dcc0 con 0x7f41f81007f0 2024-09-20T19:11:00.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.025+0000 7f41fdfa7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f41f810db40 con 0x7f41f81067f0 2024-09-20T19:11:00.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.025+0000 7f41f77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41f81007f0 0x7f41f81987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:00.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.025+0000 7f41f77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41f81007f0 0x7f41f81987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53778/0 (socket says 172.21.15.17:53778) 2024-09-20T19:11:00.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.025+0000 7f41f77fe640 1 -- 172.21.15.17:0/1759231045 learned_addr learned my addr 172.21.15.17:0/1759231045 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:11:00.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.025+0000 7f41f6ffd640 1 --2- 172.21.15.17:0/1759231045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f81067f0 0x7f41f8198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:00.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.025+0000 7f41f77fe640 1 -- 172.21.15.17:0/1759231045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f81067f0 msgr2=0x7f41f8198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:00.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.025+0000 7f41f77fe640 1 --2- 172.21.15.17:0/1759231045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f81067f0 0x7f41f8198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.025+0000 7f41f77fe640 1 -- 172.21.15.17:0/1759231045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f8199340 con 0x7f41f81007f0 2024-09-20T19:11:00.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.025+0000 7f41f6ffd640 1 --2- 172.21.15.17:0/1759231045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f81067f0 0x7f41f8198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:11:00.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.026+0000 7f41f77fe640 1 --2- 172.21.15.17:0/1759231045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41f81007f0 0x7f41f81987b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f41e800d6f0 tx=0x7f41e800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:00.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.026+0000 7f41f4ff9640 1 -- 172.21.15.17:0/1759231045 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f41e8017070 con 0x7f41f81007f0 2024-09-20T19:11:00.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.026+0000 7f41f4ff9640 1 -- 172.21.15.17:0/1759231045 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f41e800de00 con 0x7f41f81007f0 2024-09-20T19:11:00.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.026+0000 7f41fdfa7640 1 -- 172.21.15.17:0/1759231045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f81a1820 con 0x7f41f81007f0 2024-09-20T19:11:00.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.026+0000 7f41f4ff9640 1 -- 172.21.15.17:0/1759231045 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f41e8004bb0 con 0x7f41f81007f0 2024-09-20T19:11:00.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.026+0000 7f41fdfa7640 1 -- 172.21.15.17:0/1759231045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f81a1c20 con 0x7f41f81007f0 2024-09-20T19:11:00.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.027+0000 7f41fdfa7640 1 -- 172.21.15.17:0/1759231045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f8101f30 con 0x7f41f81007f0 2024-09-20T19:11:00.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.028+0000 7f41f4ff9640 1 -- 172.21.15.17:0/1759231045 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f41e8009a30 con 0x7f41f81007f0 2024-09-20T19:11:00.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.028+0000 7f41f4ff9640 1 --2- 172.21.15.17:0/1759231045 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f41e007ad30 0x7f41e007d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:00.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.028+0000 7f41f4ff9640 1 -- 172.21.15.17:0/1759231045 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f41e809d890 con 0x7f41f81007f0 2024-09-20T19:11:00.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.028+0000 7f41f6ffd640 1 --2- 172.21.15.17:0/1759231045 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f41e007ad30 0x7f41e007d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:00.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.029+0000 7f41f6ffd640 1 --2- 172.21.15.17:0/1759231045 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f41e007ad30 0x7f41e007d1f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f41f806a830 tx=0x7f41ec031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:00.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.032+0000 7f41f4ff9640 1 -- 172.21.15.17:0/1759231045 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f41e8068fb0 con 0x7f41f81007f0 2024-09-20T19:11:00.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.229+0000 7f41fdfa7640 1 -- 172.21.15.17:0/1759231045 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f41f8062630 con 0x7f41e007ad30 2024-09-20T19:11:00.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.238+0000 7f41f4ff9640 1 -- 172.21.15.17:0/1759231045 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f41f8062630 con 0x7f41e007ad30 2024-09-20T19:11:00.242 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:10:59 smithi017 ceph-mon[108970]: pgmap v1068: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:00.242 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:11:00.242 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (32m) 11m ago 43m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:11:00.242 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (35m) 11m ago 43m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:11:00.243 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (34m) 11m ago 42m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:11:00.243 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (30m) 11m ago 43m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:11:00.243 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (30m) 11m ago 42m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:11:00.243 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (31m) 11m ago 43m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:11:00.243 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (26m) 11m ago 38m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:11:00.243 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (26m) 11m ago 38m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:11:00.243 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (11m) 11m ago 37m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:11:00.243 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (26m) 11m ago 38m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:11:00.243 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (34m) 11m ago 44m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:11:00.243 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (33m) 11m ago 42m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:11:00.243 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (31m) 11m ago 44m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:11:00.244 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (30m) 11m ago 42m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:11:00.244 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (33m) 11m ago 43m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:11:00.244 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (33m) 11m ago 42m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:11:00.244 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (30m) 11m ago 41m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:11:00.244 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (29m) 11m ago 40m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:11:00.244 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (28m) 11m ago 40m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:11:00.244 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (28m) 11m ago 39m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:11:00.244 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (27m) 11m ago 39m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:11:00.244 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (27m) 11m ago 39m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:11:00.244 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (32m) 11m ago 42m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:11:00.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.241+0000 7f41fdfa7640 1 -- 172.21.15.17:0/1759231045 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f41e007ad30 msgr2=0x7f41e007d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:00.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.241+0000 7f41fdfa7640 1 --2- 172.21.15.17:0/1759231045 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f41e007ad30 0x7f41e007d1f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f41f806a830 tx=0x7f41ec031400 comp rx=0 tx=0).stop 2024-09-20T19:11:00.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.241+0000 7f41fdfa7640 1 -- 172.21.15.17:0/1759231045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41f81007f0 msgr2=0x7f41f81987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:00.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.241+0000 7f41fdfa7640 1 --2- 172.21.15.17:0/1759231045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41f81007f0 0x7f41f81987b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f41e800d6f0 tx=0x7f41e800dbb0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.241+0000 7f41fdfa7640 1 -- 172.21.15.17:0/1759231045 shutdown_connections 2024-09-20T19:11:00.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.241+0000 7f41fdfa7640 1 --2- 172.21.15.17:0/1759231045 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f41e007ad30 0x7f41e007d1f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.241+0000 7f41fdfa7640 1 --2- 172.21.15.17:0/1759231045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41f81067f0 0x7f41f8198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.241+0000 7f41fdfa7640 1 --2- 172.21.15.17:0/1759231045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41f81007f0 0x7f41f81987b0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.241+0000 7f41fdfa7640 1 -- 172.21.15.17:0/1759231045 >> 172.21.15.17:0/1759231045 conn(0x7f41f80fc550 msgr2=0x7f41f80fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:00.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.241+0000 7f41fdfa7640 1 -- 172.21.15.17:0/1759231045 shutdown_connections 2024-09-20T19:11:00.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.241+0000 7f41fdfa7640 1 -- 172.21.15.17:0/1759231045 wait complete. 2024-09-20T19:11:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.324+0000 7f17d248d640 1 -- 172.21.15.17:0/3217886630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17cc1069a0 msgr2=0x7f17cc106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.324+0000 7f17d248d640 1 --2- 172.21.15.17:0/3217886630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17cc1069a0 0x7f17cc106d80 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009880 tx=0x7f17bc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.324+0000 7f17d248d640 1 -- 172.21.15.17:0/3217886630 shutdown_connections 2024-09-20T19:11:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.324+0000 7f17d248d640 1 --2- 172.21.15.17:0/3217886630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc0ffdc0 0x7f17cc100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.324+0000 7f17d248d640 1 --2- 172.21.15.17:0/3217886630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17cc1069a0 0x7f17cc106d80 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.324+0000 7f17d248d640 1 -- 172.21.15.17:0/3217886630 >> 172.21.15.17:0/3217886630 conn(0x7f17cc0fbc90 msgr2=0x7f17cc0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:00.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.325+0000 7f17d248d640 1 -- 172.21.15.17:0/3217886630 shutdown_connections 2024-09-20T19:11:00.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.325+0000 7f17d248d640 1 -- 172.21.15.17:0/3217886630 wait complete. 2024-09-20T19:11:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.325+0000 7f17d248d640 1 Processor -- start 2024-09-20T19:11:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.325+0000 7f17d248d640 1 -- start start 2024-09-20T19:11:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.325+0000 7f17d248d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc0ffdc0 0x7f17cc19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.326+0000 7f17d248d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17cc1069a0 0x7f17cc19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.326+0000 7f17d248d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc10ef20 con 0x7f17cc1069a0 2024-09-20T19:11:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.326+0000 7f17d248d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc10eda0 con 0x7f17cc0ffdc0 2024-09-20T19:11:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.326+0000 7f17cb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17cc1069a0 0x7f17cc19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.326+0000 7f17cb7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17cc1069a0 0x7f17cc19dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53800/0 (socket says 172.21.15.17:53800) 2024-09-20T19:11:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.326+0000 7f17cb7fe640 1 -- 172.21.15.17:0/2774949290 learned_addr learned my addr 172.21.15.17:0/2774949290 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:11:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.326+0000 7f17cbfff640 1 --2- 172.21.15.17:0/2774949290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc0ffdc0 0x7f17cc19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.326+0000 7f17cb7fe640 1 -- 172.21.15.17:0/2774949290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc0ffdc0 msgr2=0x7f17cc19d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.326+0000 7f17cb7fe640 1 --2- 172.21.15.17:0/2774949290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc0ffdc0 0x7f17cc19d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.326+0000 7f17cb7fe640 1 -- 172.21.15.17:0/2774949290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17cc197890 con 0x7f17cc1069a0 2024-09-20T19:11:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.326+0000 7f17cbfff640 1 --2- 172.21.15.17:0/2774949290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc0ffdc0 0x7f17cc19d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:11:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.326+0000 7f17cb7fe640 1 --2- 172.21.15.17:0/2774949290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17cc1069a0 0x7f17cc19dc10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f17c000c810 tx=0x7f17c000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.326+0000 7f17c97fa640 1 -- 172.21.15.17:0/2774949290 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f17c0004020 con 0x7f17cc1069a0 2024-09-20T19:11:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.326+0000 7f17c97fa640 1 -- 172.21.15.17:0/2774949290 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f17c00041c0 con 0x7f17cc1069a0 2024-09-20T19:11:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.326+0000 7f17c97fa640 1 -- 172.21.15.17:0/2774949290 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f17c00047a0 con 0x7f17cc1069a0 2024-09-20T19:11:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.326+0000 7f17d248d640 1 -- 172.21.15.17:0/2774949290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17cc197b80 con 0x7f17cc1069a0 2024-09-20T19:11:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.327+0000 7f17d248d640 1 -- 172.21.15.17:0/2774949290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17cc198110 con 0x7f17cc1069a0 2024-09-20T19:11:00.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.327+0000 7f17d248d640 1 -- 172.21.15.17:0/2774949290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17cc1030e0 con 0x7f17cc1069a0 2024-09-20T19:11:00.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.328+0000 7f17c97fa640 1 -- 172.21.15.17:0/2774949290 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f17c00079b0 con 0x7f17cc1069a0 2024-09-20T19:11:00.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.329+0000 7f17c97fa640 1 --2- 172.21.15.17:0/2774949290 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f17b407af40 0x7f17b407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:00.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.329+0000 7f17c97fa640 1 -- 172.21.15.17:0/2774949290 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f17c009df00 con 0x7f17cc1069a0 2024-09-20T19:11:00.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.329+0000 7f17cbfff640 1 --2- 172.21.15.17:0/2774949290 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f17b407af40 0x7f17b407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:00.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.329+0000 7f17cbfff640 1 --2- 172.21.15.17:0/2774949290 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f17b407af40 0x7f17b407d400 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f17bc000c00 tx=0x7f17bc031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:00.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.333+0000 7f17c97fa640 1 -- 172.21.15.17:0/2774949290 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f17c0014030 con 0x7f17cc1069a0 2024-09-20T19:11:00.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:10:59 smithi172 ceph-mon[80431]: pgmap v1068: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:00.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.595+0000 7f17d248d640 1 -- 172.21.15.17:0/2774949290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f17cc198dc0 con 0x7f17cc1069a0 2024-09-20T19:11:00.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.596+0000 7f17c97fa640 1 -- 172.21.15.17:0/2774949290 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f17c0069500 con 0x7f17cc1069a0 2024-09-20T19:11:00.600 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:11:00.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:11:00.600 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:11:00.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:11:00.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:11:00.600 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:11:00.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:11:00.600 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:11:00.600 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:11:00.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:11:00.600 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:11:00.601 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:11:00.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:11:00.601 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:11:00.601 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:11:00.601 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:11:00.601 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:11:00.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.598+0000 7f17d248d640 1 -- 172.21.15.17:0/2774949290 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f17b407af40 msgr2=0x7f17b407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:00.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.598+0000 7f17d248d640 1 --2- 172.21.15.17:0/2774949290 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f17b407af40 0x7f17b407d400 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f17bc000c00 tx=0x7f17bc031400 comp rx=0 tx=0).stop 2024-09-20T19:11:00.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.598+0000 7f17d248d640 1 -- 172.21.15.17:0/2774949290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17cc1069a0 msgr2=0x7f17cc19dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:00.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.598+0000 7f17d248d640 1 --2- 172.21.15.17:0/2774949290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17cc1069a0 0x7f17cc19dc10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f17c000c810 tx=0x7f17c000ccd0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.598+0000 7f17d248d640 1 -- 172.21.15.17:0/2774949290 shutdown_connections 2024-09-20T19:11:00.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.598+0000 7f17d248d640 1 --2- 172.21.15.17:0/2774949290 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f17b407af40 0x7f17b407d400 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.599+0000 7f17d248d640 1 --2- 172.21.15.17:0/2774949290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17cc1069a0 0x7f17cc19dc10 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.599+0000 7f17d248d640 1 --2- 172.21.15.17:0/2774949290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc0ffdc0 0x7f17cc19d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.599+0000 7f17d248d640 1 -- 172.21.15.17:0/2774949290 >> 172.21.15.17:0/2774949290 conn(0x7f17cc0fbc90 msgr2=0x7f17cc0fc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:00.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.599+0000 7f17d248d640 1 -- 172.21.15.17:0/2774949290 shutdown_connections 2024-09-20T19:11:00.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.599+0000 7f17d248d640 1 -- 172.21.15.17:0/2774949290 wait complete. 2024-09-20T19:11:00.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.682+0000 7f37ff16e640 1 -- 172.21.15.17:0/3254903878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37f81067f0 msgr2=0x7f37f8106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:00.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.682+0000 7f37ff16e640 1 --2- 172.21.15.17:0/3254903878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37f81067f0 0x7f37f8106bd0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009880 tx=0x7f37e802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.682+0000 7f37ff16e640 1 -- 172.21.15.17:0/3254903878 shutdown_connections 2024-09-20T19:11:00.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.682+0000 7f37ff16e640 1 --2- 172.21.15.17:0/3254903878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37f81007f0 0x7f37f8100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.683+0000 7f37ff16e640 1 --2- 172.21.15.17:0/3254903878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37f81067f0 0x7f37f8106bd0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.683+0000 7f37ff16e640 1 -- 172.21.15.17:0/3254903878 >> 172.21.15.17:0/3254903878 conn(0x7f37f80fc550 msgr2=0x7f37f80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:00.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.683+0000 7f37ff16e640 1 -- 172.21.15.17:0/3254903878 shutdown_connections 2024-09-20T19:11:00.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.683+0000 7f37ff16e640 1 -- 172.21.15.17:0/3254903878 wait complete. 2024-09-20T19:11:00.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.683+0000 7f37ff16e640 1 Processor -- start 2024-09-20T19:11:00.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.683+0000 7f37ff16e640 1 -- start start 2024-09-20T19:11:00.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.683+0000 7f37ff16e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37f81007f0 0x7f37f819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:00.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.683+0000 7f37ff16e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37f81067f0 0x7f37f819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:00.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.683+0000 7f37ff16e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f37f810dcc0 con 0x7f37f81067f0 2024-09-20T19:11:00.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.683+0000 7f37ff16e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f37f810db40 con 0x7f37f81007f0 2024-09-20T19:11:00.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.684+0000 7f37f7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37f81067f0 0x7f37f819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:00.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.684+0000 7f37f7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37f81067f0 0x7f37f819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33632/0 (socket says 172.21.15.17:33632) 2024-09-20T19:11:00.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.684+0000 7f37f7fff640 1 -- 172.21.15.17:0/4163632526 learned_addr learned my addr 172.21.15.17:0/4163632526 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:11:00.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.684+0000 7f37fcf0a640 1 --2- 172.21.15.17:0/4163632526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37f81007f0 0x7f37f819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:00.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.684+0000 7f37f7fff640 1 -- 172.21.15.17:0/4163632526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37f81007f0 msgr2=0x7f37f819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:00.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.684+0000 7f37f7fff640 1 --2- 172.21.15.17:0/4163632526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37f81007f0 0x7f37f819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.684+0000 7f37f7fff640 1 -- 172.21.15.17:0/4163632526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f81977b0 con 0x7f37f81067f0 2024-09-20T19:11:00.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.684+0000 7f37f7fff640 1 --2- 172.21.15.17:0/4163632526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37f81067f0 0x7f37f819db70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00d6f0 tx=0x7f37ec00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:00.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.684+0000 7f37f5ffb640 1 -- 172.21.15.17:0/4163632526 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f37ec017070 con 0x7f37f81067f0 2024-09-20T19:11:00.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.684+0000 7f37f5ffb640 1 -- 172.21.15.17:0/4163632526 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f37ec00de00 con 0x7f37f81067f0 2024-09-20T19:11:00.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.684+0000 7f37ff16e640 1 -- 172.21.15.17:0/4163632526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37f8197aa0 con 0x7f37f81067f0 2024-09-20T19:11:00.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.684+0000 7f37f5ffb640 1 -- 172.21.15.17:0/4163632526 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f37ec004bb0 con 0x7f37f81067f0 2024-09-20T19:11:00.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.685+0000 7f37ff16e640 1 -- 172.21.15.17:0/4163632526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37f8198030 con 0x7f37f81067f0 2024-09-20T19:11:00.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.686+0000 7f37ff16e640 1 -- 172.21.15.17:0/4163632526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37f8101f30 con 0x7f37f81067f0 2024-09-20T19:11:00.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.686+0000 7f37f5ffb640 1 -- 172.21.15.17:0/4163632526 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f37ec009a30 con 0x7f37f81067f0 2024-09-20T19:11:00.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.687+0000 7f37f5ffb640 1 --2- 172.21.15.17:0/4163632526 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f37e007af80 0x7f37e007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:00.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.687+0000 7f37f5ffb640 1 -- 172.21.15.17:0/4163632526 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f37ec09dac0 con 0x7f37f81067f0 2024-09-20T19:11:00.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.687+0000 7f37fcf0a640 1 --2- 172.21.15.17:0/4163632526 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f37e007af80 0x7f37e007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:00.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.687+0000 7f37fcf0a640 1 --2- 172.21.15.17:0/4163632526 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f37e007af80 0x7f37e007d440 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f37e80096c0 tx=0x7f37e8031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:00.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.691+0000 7f37f5ffb640 1 -- 172.21.15.17:0/4163632526 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f37ec069140 con 0x7f37f81067f0 2024-09-20T19:11:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.919+0000 7f37ff16e640 1 -- 172.21.15.17:0/4163632526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f37f8109d70 con 0x7f37f81067f0 2024-09-20T19:11:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.919+0000 7f37f5ffb640 1 -- 172.21.15.17:0/4163632526 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7f37ec06dff0 con 0x7f37f81067f0 2024-09-20T19:11:00.923 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:11:00.923 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:11:00.924 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:11:00.924 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:11:00.924 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:11:00.924 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:11:00.924 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:11:00.924 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:11:00.924 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:11:00.924 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:11:00.924 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:11:00.924 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:11:00.924 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:11:00.924 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:11:00.924 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:11:00.925 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:11:00.925 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:11:00.925 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:11:00.925 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:11:00.925 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:11:00.925 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:11:00.925 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:11:00.925 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:11:00.925 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:11:00.925 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:11:00.925 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:11:00.925 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:11:00.925 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:11:00.926 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:11:00.926 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:11:00.926 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:11:00.926 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:11:00.926 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:11:00.926 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:11:00.926 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:11:00.926 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:11:00.926 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:11:00.926 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:11:00.926 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:11:00.926 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:11:00.926 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:11:00.927 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:11:00.927 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:11:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:11:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.922+0000 7f37ff16e640 1 -- 172.21.15.17:0/4163632526 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f37e007af80 msgr2=0x7f37e007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.922+0000 7f37ff16e640 1 --2- 172.21.15.17:0/4163632526 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f37e007af80 0x7f37e007d440 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f37e80096c0 tx=0x7f37e8031400 comp rx=0 tx=0).stop 2024-09-20T19:11:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.922+0000 7f37ff16e640 1 -- 172.21.15.17:0/4163632526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37f81067f0 msgr2=0x7f37f819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.922+0000 7f37ff16e640 1 --2- 172.21.15.17:0/4163632526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37f81067f0 0x7f37f819db70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00d6f0 tx=0x7f37ec00dbb0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.922+0000 7f37ff16e640 1 -- 172.21.15.17:0/4163632526 shutdown_connections 2024-09-20T19:11:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.922+0000 7f37ff16e640 1 --2- 172.21.15.17:0/4163632526 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f37e007af80 0x7f37e007d440 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.922+0000 7f37ff16e640 1 --2- 172.21.15.17:0/4163632526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37f81067f0 0x7f37f819db70 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.922+0000 7f37ff16e640 1 --2- 172.21.15.17:0/4163632526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37f81007f0 0x7f37f819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.922+0000 7f37ff16e640 1 -- 172.21.15.17:0/4163632526 >> 172.21.15.17:0/4163632526 conn(0x7f37f80fc550 msgr2=0x7f37f8069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.922+0000 7f37ff16e640 1 -- 172.21.15.17:0/4163632526 shutdown_connections 2024-09-20T19:11:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:00.922+0000 7f37ff16e640 1 -- 172.21.15.17:0/4163632526 wait complete. 2024-09-20T19:11:01.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.008+0000 7ff3bf794640 1 -- 172.21.15.17:0/2836634634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3b8102ac0 msgr2=0x7ff3b8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:01.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.008+0000 7ff3bf794640 1 --2- 172.21.15.17:0/2836634634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3b8102ac0 0x7ff3b8102ea0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009880 tx=0x7ff3b402a530 comp rx=0 tx=0).stop 2024-09-20T19:11:01.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.008+0000 7ff3bf794640 1 -- 172.21.15.17:0/2836634634 shutdown_connections 2024-09-20T19:11:01.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.008+0000 7ff3bf794640 1 --2- 172.21.15.17:0/2836634634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3b81033e0 0x7ff3b810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:01.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.008+0000 7ff3bf794640 1 --2- 172.21.15.17:0/2836634634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3b8102ac0 0x7ff3b8102ea0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:01.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.008+0000 7ff3bf794640 1 -- 172.21.15.17:0/2836634634 >> 172.21.15.17:0/2836634634 conn(0x7ff3b80fc520 msgr2=0x7ff3b80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:01.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.008+0000 7ff3bf794640 1 -- 172.21.15.17:0/2836634634 shutdown_connections 2024-09-20T19:11:01.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.008+0000 7ff3bf794640 1 -- 172.21.15.17:0/2836634634 wait complete. 2024-09-20T19:11:01.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.008+0000 7ff3bf794640 1 Processor -- start 2024-09-20T19:11:01.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.009+0000 7ff3bf794640 1 -- start start 2024-09-20T19:11:01.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.009+0000 7ff3bf794640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3b8102ac0 0x7ff3b8100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:01.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.009+0000 7ff3bf794640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3b81033e0 0x7ff3b8100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:01.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.009+0000 7ff3bf794640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b810edd0 con 0x7ff3b8102ac0 2024-09-20T19:11:01.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.009+0000 7ff3bf794640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b810ec50 con 0x7ff3b81033e0 2024-09-20T19:11:01.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.009+0000 7ff3bd530640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3b8102ac0 0x7ff3b8100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:01.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.009+0000 7ff3bd530640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3b8102ac0 0x7ff3b8100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33644/0 (socket says 172.21.15.17:33644) 2024-09-20T19:11:01.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.009+0000 7ff3bd530640 1 -- 172.21.15.17:0/2232369868 learned_addr learned my addr 172.21.15.17:0/2232369868 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:11:01.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.009+0000 7ff3bcd2f640 1 --2- 172.21.15.17:0/2232369868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3b81033e0 0x7ff3b8100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:01.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.009+0000 7ff3bd530640 1 -- 172.21.15.17:0/2232369868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3b81033e0 msgr2=0x7ff3b8100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:01.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.009+0000 7ff3bd530640 1 --2- 172.21.15.17:0/2232369868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3b81033e0 0x7ff3b8100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:01.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.009+0000 7ff3bd530640 1 -- 172.21.15.17:0/2232369868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b81011a0 con 0x7ff3b8102ac0 2024-09-20T19:11:01.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.010+0000 7ff3bd530640 1 --2- 172.21.15.17:0/2232369868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3b8102ac0 0x7ff3b8100720 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4031460 tx=0x7ff3b40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:01.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.010+0000 7ff3ae7fc640 1 -- 172.21.15.17:0/2232369868 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff3b403f070 con 0x7ff3b8102ac0 2024-09-20T19:11:01.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.010+0000 7ff3ae7fc640 1 -- 172.21.15.17:0/2232369868 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff3b40035f0 con 0x7ff3b8102ac0 2024-09-20T19:11:01.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.010+0000 7ff3ae7fc640 1 -- 172.21.15.17:0/2232369868 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff3b4035030 con 0x7ff3b8102ac0 2024-09-20T19:11:01.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.010+0000 7ff3bf794640 1 -- 172.21.15.17:0/2232369868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b8101430 con 0x7ff3b8102ac0 2024-09-20T19:11:01.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.010+0000 7ff3bf794640 1 -- 172.21.15.17:0/2232369868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b81a3ea0 con 0x7ff3b8102ac0 2024-09-20T19:11:01.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.011+0000 7ff3bf794640 1 -- 172.21.15.17:0/2232369868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3b806aa90 con 0x7ff3b8102ac0 2024-09-20T19:11:01.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.012+0000 7ff3ae7fc640 1 -- 172.21.15.17:0/2232369868 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff3b4042070 con 0x7ff3b8102ac0 2024-09-20T19:11:01.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.012+0000 7ff3ae7fc640 1 --2- 172.21.15.17:0/2232369868 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff3a407af80 0x7ff3a407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:01.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.012+0000 7ff3bcd2f640 1 --2- 172.21.15.17:0/2232369868 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff3a407af80 0x7ff3a407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:01.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.012+0000 7ff3ae7fc640 1 -- 172.21.15.17:0/2232369868 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7ff3b40be860 con 0x7ff3b8102ac0 2024-09-20T19:11:01.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.013+0000 7ff3bcd2f640 1 --2- 172.21.15.17:0/2232369868 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff3a407af80 0x7ff3a407d440 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff3b81021b0 tx=0x7ff3a800b2e0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:01.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.017+0000 7ff3ae7fc640 1 -- 172.21.15.17:0/2232369868 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff3b4089ee0 con 0x7ff3b8102ac0 2024-09-20T19:11:01.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.223+0000 7ff3bf794640 1 -- 172.21.15.17:0/2232369868 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff3b8062630 con 0x7ff3a407af80 2024-09-20T19:11:01.227 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:00 smithi017 ceph-mon[108970]: from='client.35744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:01.227 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:00 smithi017 ceph-mon[108970]: from='client.35748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:01.227 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:00 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2774949290' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:01.227 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:00 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4163632526' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:11:01.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.224+0000 7ff3ae7fc640 1 -- 172.21.15.17:0/2232369868 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff3b8062630 con 0x7ff3a407af80 2024-09-20T19:11:01.228 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:11:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:11:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:11:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:11:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:11:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:11:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:11:01.228 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:11:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:11:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:11:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:11:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:11:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:11:01.229 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:11:01.229 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:11:01.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.226+0000 7ff3bf794640 1 -- 172.21.15.17:0/2232369868 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff3a407af80 msgr2=0x7ff3a407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:01.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.226+0000 7ff3bf794640 1 --2- 172.21.15.17:0/2232369868 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff3a407af80 0x7ff3a407d440 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff3b81021b0 tx=0x7ff3a800b2e0 comp rx=0 tx=0).stop 2024-09-20T19:11:01.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.226+0000 7ff3bf794640 1 -- 172.21.15.17:0/2232369868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3b8102ac0 msgr2=0x7ff3b8100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:01.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.226+0000 7ff3bf794640 1 --2- 172.21.15.17:0/2232369868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3b8102ac0 0x7ff3b8100720 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4031460 tx=0x7ff3b40045e0 comp rx=0 tx=0).stop 2024-09-20T19:11:01.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.226+0000 7ff3bf794640 1 -- 172.21.15.17:0/2232369868 shutdown_connections 2024-09-20T19:11:01.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.226+0000 7ff3bf794640 1 --2- 172.21.15.17:0/2232369868 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff3a407af80 0x7ff3a407d440 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:01.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.226+0000 7ff3bf794640 1 --2- 172.21.15.17:0/2232369868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3b81033e0 0x7ff3b8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:01.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.226+0000 7ff3bf794640 1 --2- 172.21.15.17:0/2232369868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3b8102ac0 0x7ff3b8100720 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:01.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.226+0000 7ff3bf794640 1 -- 172.21.15.17:0/2232369868 >> 172.21.15.17:0/2232369868 conn(0x7ff3b80fc520 msgr2=0x7ff3b8108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:01.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.226+0000 7ff3bf794640 1 -- 172.21.15.17:0/2232369868 shutdown_connections 2024-09-20T19:11:01.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.227+0000 7ff3bf794640 1 -- 172.21.15.17:0/2232369868 wait complete. 2024-09-20T19:11:01.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.311+0000 7fa7469d2640 1 -- 172.21.15.17:0/2458153245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7401067f0 msgr2=0x7fa740106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:01.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.311+0000 7fa7469d2640 1 --2- 172.21.15.17:0/2458153245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7401067f0 0x7fa740106bd0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa730009880 tx=0x7fa73002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:11:01.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.311+0000 7fa7469d2640 1 -- 172.21.15.17:0/2458153245 shutdown_connections 2024-09-20T19:11:01.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.311+0000 7fa7469d2640 1 --2- 172.21.15.17:0/2458153245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7401007f0 0x7fa740100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:01.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.311+0000 7fa7469d2640 1 --2- 172.21.15.17:0/2458153245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7401067f0 0x7fa740106bd0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:01.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.311+0000 7fa7469d2640 1 -- 172.21.15.17:0/2458153245 >> 172.21.15.17:0/2458153245 conn(0x7fa7400fc550 msgr2=0x7fa7400fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:01.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.311+0000 7fa7469d2640 1 -- 172.21.15.17:0/2458153245 shutdown_connections 2024-09-20T19:11:01.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.311+0000 7fa7469d2640 1 -- 172.21.15.17:0/2458153245 wait complete. 2024-09-20T19:11:01.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.311+0000 7fa7469d2640 1 Processor -- start 2024-09-20T19:11:01.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.311+0000 7fa7469d2640 1 -- start start 2024-09-20T19:11:01.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.312+0000 7fa7469d2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7401007f0 0x7fa74019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:01.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.312+0000 7fa7469d2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7401067f0 0x7fa74019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:01.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.312+0000 7fa7469d2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa74010dcc0 con 0x7fa7401067f0 2024-09-20T19:11:01.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.312+0000 7fa7469d2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa74010db40 con 0x7fa7401007f0 2024-09-20T19:11:01.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.312+0000 7fa73f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7401067f0 0x7fa74019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.312+0000 7fa73f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7401067f0 0x7fa74019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33658/0 (socket says 172.21.15.17:33658) 2024-09-20T19:11:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.312+0000 7fa73f7fe640 1 -- 172.21.15.17:0/245923261 learned_addr learned my addr 172.21.15.17:0/245923261 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:11:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.312+0000 7fa73ffff640 1 --2- 172.21.15.17:0/245923261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7401007f0 0x7fa74019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.312+0000 7fa73f7fe640 1 -- 172.21.15.17:0/245923261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7401007f0 msgr2=0x7fa74019d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.312+0000 7fa73f7fe640 1 --2- 172.21.15.17:0/245923261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7401007f0 0x7fa74019d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.312+0000 7fa73f7fe640 1 -- 172.21.15.17:0/245923261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7401977b0 con 0x7fa7401067f0 2024-09-20T19:11:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.313+0000 7fa73f7fe640 1 --2- 172.21.15.17:0/245923261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7401067f0 0x7fa74019db70 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa73400c8f0 tx=0x7fa73400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.313+0000 7fa73d7fa640 1 -- 172.21.15.17:0/245923261 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7340079b0 con 0x7fa7401067f0 2024-09-20T19:11:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.313+0000 7fa73d7fa640 1 -- 172.21.15.17:0/245923261 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa7340054e0 con 0x7fa7401067f0 2024-09-20T19:11:01.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.313+0000 7fa7469d2640 1 -- 172.21.15.17:0/245923261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa740197aa0 con 0x7fa7401067f0 2024-09-20T19:11:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.313+0000 7fa73d7fa640 1 -- 172.21.15.17:0/245923261 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa734004dd0 con 0x7fa7401067f0 2024-09-20T19:11:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.313+0000 7fa7469d2640 1 -- 172.21.15.17:0/245923261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa740198030 con 0x7fa7401067f0 2024-09-20T19:11:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.314+0000 7fa7469d2640 1 -- 172.21.15.17:0/245923261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa740101f30 con 0x7fa7401067f0 2024-09-20T19:11:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.315+0000 7fa73d7fa640 1 -- 172.21.15.17:0/245923261 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa734005020 con 0x7fa7401067f0 2024-09-20T19:11:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.315+0000 7fa73d7fa640 1 --2- 172.21.15.17:0/245923261 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa72807af30 0x7fa72807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:01.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.315+0000 7fa73d7fa640 1 -- 172.21.15.17:0/245923261 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fa73409de30 con 0x7fa7401067f0 2024-09-20T19:11:01.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.315+0000 7fa73ffff640 1 --2- 172.21.15.17:0/245923261 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa72807af30 0x7fa72807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:01.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.316+0000 7fa73ffff640 1 --2- 172.21.15.17:0/245923261 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa72807af30 0x7fa72807d3f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa730000c00 tx=0x7fa730031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:01.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.319+0000 7fa73d7fa640 1 -- 172.21.15.17:0/245923261 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa734014030 con 0x7fa7401067f0 2024-09-20T19:11:01.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:00 smithi172 ceph-mon[80431]: from='client.35744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:01.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:00 smithi172 ceph-mon[80431]: from='client.35748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:01.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:00 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2774949290' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:01.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:00 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4163632526' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:11:01.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.582+0000 7fa7469d2640 1 -- 172.21.15.17:0/245923261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fa740109d70 con 0x7fa7401067f0 2024-09-20T19:11:01.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.583+0000 7fa73d7fa640 1 -- 172.21.15.17:0/245923261 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fa7340694b0 con 0x7fa7401067f0 2024-09-20T19:11:01.587 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:11:01.587 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:11:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:11:01.587 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:11:01.587 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:11:01.587 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:11:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:11:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:11:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:11:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:11:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:11:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:11:01.587 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:11:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:11:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:11:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:11:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:11:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:11:01.588 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:11:01.588 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:11:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:11:01.588 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:11:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:11:01.588 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:11:01.588 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:11:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.585+0000 7fa7469d2640 1 -- 172.21.15.17:0/245923261 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa72807af30 msgr2=0x7fa72807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.585+0000 7fa7469d2640 1 --2- 172.21.15.17:0/245923261 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa72807af30 0x7fa72807d3f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa730000c00 tx=0x7fa730031400 comp rx=0 tx=0).stop 2024-09-20T19:11:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.585+0000 7fa7469d2640 1 -- 172.21.15.17:0/245923261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7401067f0 msgr2=0x7fa74019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.585+0000 7fa7469d2640 1 --2- 172.21.15.17:0/245923261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7401067f0 0x7fa74019db70 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa73400c8f0 tx=0x7fa73400cdb0 comp rx=0 tx=0).stop 2024-09-20T19:11:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.585+0000 7fa7469d2640 1 -- 172.21.15.17:0/245923261 shutdown_connections 2024-09-20T19:11:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.585+0000 7fa7469d2640 1 --2- 172.21.15.17:0/245923261 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa72807af30 0x7fa72807d3f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.585+0000 7fa7469d2640 1 --2- 172.21.15.17:0/245923261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7401067f0 0x7fa74019db70 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.585+0000 7fa7469d2640 1 --2- 172.21.15.17:0/245923261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7401007f0 0x7fa74019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.585+0000 7fa7469d2640 1 -- 172.21.15.17:0/245923261 >> 172.21.15.17:0/245923261 conn(0x7fa7400fc550 msgr2=0x7fa740069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.585+0000 7fa7469d2640 1 -- 172.21.15.17:0/245923261 shutdown_connections 2024-09-20T19:11:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:01.585+0000 7fa7469d2640 1 -- 172.21.15.17:0/245923261 wait complete. 2024-09-20T19:11:02.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:01 smithi017 ceph-mon[108970]: from='client.35752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:02.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:01 smithi017 ceph-mon[108970]: pgmap v1069: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:02.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:01 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/245923261' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:11:02.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:01 smithi172 ceph-mon[80431]: from='client.35752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:02.702 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:01 smithi172 ceph-mon[80431]: pgmap v1069: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:02.702 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:01 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/245923261' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:11:03.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:02 smithi017 ceph-mon[108970]: from='client.35764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:03.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:02 smithi172 ceph-mon[80431]: from='client.35764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:04.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:03 smithi017 ceph-mon[108970]: pgmap v1070: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:04.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:03 smithi172 ceph-mon[80431]: pgmap v1070: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:06.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:05 smithi017 ceph-mon[108970]: pgmap v1071: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:06.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:05 smithi172 ceph-mon[80431]: pgmap v1071: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:08.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:08 smithi017 ceph-mon[108970]: pgmap v1072: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:08.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:11:08.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:08 smithi172 ceph-mon[80431]: pgmap v1072: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:08.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:11:10.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:10 smithi017 ceph-mon[108970]: pgmap v1073: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:10.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:10 smithi172 ceph-mon[80431]: pgmap v1073: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:12.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:12 smithi017 ceph-mon[108970]: pgmap v1074: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:12.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:12 smithi172 ceph-mon[80431]: pgmap v1074: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:14.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:14 smithi017 ceph-mon[108970]: pgmap v1075: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:14.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:14 smithi172 ceph-mon[80431]: pgmap v1075: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:16.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:16 smithi017 ceph-mon[108970]: pgmap v1076: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:16.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:16 smithi172 ceph-mon[80431]: pgmap v1076: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:18.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:18 smithi017 ceph-mon[108970]: pgmap v1077: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:18.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:18 smithi172 ceph-mon[80431]: pgmap v1077: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:20.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:20 smithi017 ceph-mon[108970]: pgmap v1078: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:20.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:20 smithi172 ceph-mon[80431]: pgmap v1078: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:22.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:22 smithi017 ceph-mon[108970]: pgmap v1079: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:22.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:22 smithi172 ceph-mon[80431]: pgmap v1079: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:23.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:23 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:11:23.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:23 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:11:24.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:24 smithi017 ceph-mon[108970]: pgmap v1080: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:24.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:24 smithi172 ceph-mon[80431]: pgmap v1080: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:26.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:26 smithi172 ceph-mon[80431]: pgmap v1081: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:26.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:26 smithi017 ceph-mon[108970]: pgmap v1081: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:28.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:28 smithi017 ceph-mon[108970]: pgmap v1082: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:28.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:28 smithi172 ceph-mon[80431]: pgmap v1082: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:30.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:30 smithi017 ceph-mon[108970]: pgmap v1083: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:30.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:30 smithi172 ceph-mon[80431]: pgmap v1083: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:31.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.683+0000 7f517c959640 1 -- 172.21.15.17:0/82650645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51781033d0 msgr2=0x7f517810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:31.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.683+0000 7f517c959640 1 --2- 172.21.15.17:0/82650645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51781033d0 0x7f517810b8c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f516c009880 tx=0x7f516c02a530 comp rx=0 tx=0).stop 2024-09-20T19:11:31.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.683+0000 7f517c959640 1 -- 172.21.15.17:0/82650645 shutdown_connections 2024-09-20T19:11:31.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.683+0000 7f517c959640 1 --2- 172.21.15.17:0/82650645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51781033d0 0x7f517810b8c0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:31.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.683+0000 7f517c959640 1 --2- 172.21.15.17:0/82650645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5178102ab0 0x7f5178102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:31.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.683+0000 7f517c959640 1 -- 172.21.15.17:0/82650645 >> 172.21.15.17:0/82650645 conn(0x7f51780fc550 msgr2=0x7f51780fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:31.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.683+0000 7f517c959640 1 -- 172.21.15.17:0/82650645 shutdown_connections 2024-09-20T19:11:31.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.684+0000 7f517c959640 1 -- 172.21.15.17:0/82650645 wait complete. 2024-09-20T19:11:31.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.684+0000 7f517c959640 1 Processor -- start 2024-09-20T19:11:31.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.684+0000 7f517c959640 1 -- start start 2024-09-20T19:11:31.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.685+0000 7f517c959640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5178102ab0 0x7f517819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:31.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.685+0000 7f517c959640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51781033d0 0x7f517819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:31.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.685+0000 7f517c959640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f517810ede0 con 0x7f5178102ab0 2024-09-20T19:11:31.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.685+0000 7f517c959640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f517810ec60 con 0x7f51781033d0 2024-09-20T19:11:31.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.685+0000 7f517659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5178102ab0 0x7f517819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.685+0000 7f517659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5178102ab0 0x7f517819d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55788/0 (socket says 172.21.15.17:55788) 2024-09-20T19:11:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.685+0000 7f517659c640 1 -- 172.21.15.17:0/3674817796 learned_addr learned my addr 172.21.15.17:0/3674817796 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:11:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.685+0000 7f5175d9b640 1 --2- 172.21.15.17:0/3674817796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51781033d0 0x7f517819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.685+0000 7f517659c640 1 -- 172.21.15.17:0/3674817796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51781033d0 msgr2=0x7f517819dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.685+0000 7f517659c640 1 --2- 172.21.15.17:0/3674817796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51781033d0 0x7f517819dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.685+0000 7f517659c640 1 -- 172.21.15.17:0/3674817796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5178197810 con 0x7f5178102ab0 2024-09-20T19:11:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.686+0000 7f517659c640 1 --2- 172.21.15.17:0/3674817796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5178102ab0 0x7f517819d690 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f516800e970 tx=0x7f516800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.686+0000 7f51677fe640 1 -- 172.21.15.17:0/3674817796 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f516800cac0 con 0x7f5178102ab0 2024-09-20T19:11:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.686+0000 7f517c959640 1 -- 172.21.15.17:0/3674817796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5178197b00 con 0x7f5178102ab0 2024-09-20T19:11:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.686+0000 7f51677fe640 1 -- 172.21.15.17:0/3674817796 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51680054e0 con 0x7f5178102ab0 2024-09-20T19:11:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.686+0000 7f51677fe640 1 -- 172.21.15.17:0/3674817796 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5168010430 con 0x7f5178102ab0 2024-09-20T19:11:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.686+0000 7f517c959640 1 -- 172.21.15.17:0/3674817796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5178198060 con 0x7f5178102ab0 2024-09-20T19:11:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.687+0000 7f517c959640 1 -- 172.21.15.17:0/3674817796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f517806a580 con 0x7f5178102ab0 2024-09-20T19:11:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.687+0000 7f51677fe640 1 -- 172.21.15.17:0/3674817796 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5168004f00 con 0x7f5178102ab0 2024-09-20T19:11:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.688+0000 7f51677fe640 1 --2- 172.21.15.17:0/3674817796 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f516007af80 0x7f516007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.688+0000 7f51677fe640 1 -- 172.21.15.17:0/3674817796 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f516809e650 con 0x7f5178102ab0 2024-09-20T19:11:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.688+0000 7f5175d9b640 1 --2- 172.21.15.17:0/3674817796 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f516007af80 0x7f516007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:31.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.689+0000 7f5175d9b640 1 --2- 172.21.15.17:0/3674817796 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f516007af80 0x7f516007d440 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5178198b60 tx=0x7f516c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:31.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.693+0000 7f51677fe640 1 -- 172.21.15.17:0/3674817796 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5168069cd0 con 0x7f5178102ab0 2024-09-20T19:11:31.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.897+0000 7f517c959640 1 -- 172.21.15.17:0/3674817796 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5178198370 con 0x7f516007af80 2024-09-20T19:11:31.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.899+0000 7f51677fe640 1 -- 172.21.15.17:0/3674817796 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5178198370 con 0x7f516007af80 2024-09-20T19:11:31.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.901+0000 7f517c959640 1 -- 172.21.15.17:0/3674817796 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f516007af80 msgr2=0x7f516007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:31.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.901+0000 7f517c959640 1 --2- 172.21.15.17:0/3674817796 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f516007af80 0x7f516007d440 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5178198b60 tx=0x7f516c031400 comp rx=0 tx=0).stop 2024-09-20T19:11:31.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.901+0000 7f517c959640 1 -- 172.21.15.17:0/3674817796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5178102ab0 msgr2=0x7f517819d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:31.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.901+0000 7f517c959640 1 --2- 172.21.15.17:0/3674817796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5178102ab0 0x7f517819d690 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f516800e970 tx=0x7f516800ed70 comp rx=0 tx=0).stop 2024-09-20T19:11:31.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.901+0000 7f517c959640 1 -- 172.21.15.17:0/3674817796 shutdown_connections 2024-09-20T19:11:31.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.901+0000 7f517c959640 1 --2- 172.21.15.17:0/3674817796 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f516007af80 0x7f516007d440 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:31.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.901+0000 7f517c959640 1 --2- 172.21.15.17:0/3674817796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51781033d0 0x7f517819dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:31.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.901+0000 7f517c959640 1 --2- 172.21.15.17:0/3674817796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5178102ab0 0x7f517819d690 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:31.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.901+0000 7f517c959640 1 -- 172.21.15.17:0/3674817796 >> 172.21.15.17:0/3674817796 conn(0x7f51780fc550 msgr2=0x7f5178108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:31.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.901+0000 7f517c959640 1 -- 172.21.15.17:0/3674817796 shutdown_connections 2024-09-20T19:11:31.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.901+0000 7f517c959640 1 -- 172.21.15.17:0/3674817796 wait complete. 2024-09-20T19:11:31.912 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:11:31.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.986+0000 7f7aedf92640 1 -- 172.21.15.17:0/362051936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae81033e0 msgr2=0x7f7ae810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:31.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.986+0000 7f7aedf92640 1 --2- 172.21.15.17:0/362051936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae81033e0 0x7f7ae810b8d0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009880 tx=0x7f7adc02a530 comp rx=0 tx=0).stop 2024-09-20T19:11:31.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.986+0000 7f7aedf92640 1 -- 172.21.15.17:0/362051936 shutdown_connections 2024-09-20T19:11:31.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.986+0000 7f7aedf92640 1 --2- 172.21.15.17:0/362051936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae81033e0 0x7f7ae810b8d0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:31.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.986+0000 7f7aedf92640 1 --2- 172.21.15.17:0/362051936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ae8102ac0 0x7f7ae8102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:31.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.986+0000 7f7aedf92640 1 -- 172.21.15.17:0/362051936 >> 172.21.15.17:0/362051936 conn(0x7f7ae80fc520 msgr2=0x7f7ae80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:31.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.987+0000 7f7aedf92640 1 -- 172.21.15.17:0/362051936 shutdown_connections 2024-09-20T19:11:31.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.987+0000 7f7aedf92640 1 -- 172.21.15.17:0/362051936 wait complete. 2024-09-20T19:11:31.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.987+0000 7f7aedf92640 1 Processor -- start 2024-09-20T19:11:31.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.987+0000 7f7aedf92640 1 -- start start 2024-09-20T19:11:31.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.988+0000 7f7aedf92640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ae8102ac0 0x7f7ae819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:31.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.988+0000 7f7aedf92640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae81033e0 0x7f7ae819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:31.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.988+0000 7f7aedf92640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae810edf0 con 0x7f7ae81033e0 2024-09-20T19:11:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.988+0000 7f7aedf92640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae810ec70 con 0x7f7ae8102ac0 2024-09-20T19:11:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.988+0000 7f7ae6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae81033e0 0x7f7ae819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.988+0000 7f7ae6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae81033e0 0x7f7ae819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55814/0 (socket says 172.21.15.17:55814) 2024-09-20T19:11:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.988+0000 7f7ae6ffd640 1 -- 172.21.15.17:0/470263748 learned_addr learned my addr 172.21.15.17:0/470263748 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:11:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.988+0000 7f7ae77fe640 1 --2- 172.21.15.17:0/470263748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ae8102ac0 0x7f7ae819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.988+0000 7f7ae6ffd640 1 -- 172.21.15.17:0/470263748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ae8102ac0 msgr2=0x7f7ae819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.988+0000 7f7ae6ffd640 1 --2- 172.21.15.17:0/470263748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ae8102ac0 0x7f7ae819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.988+0000 7f7ae6ffd640 1 -- 172.21.15.17:0/470263748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae8197820 con 0x7f7ae81033e0 2024-09-20T19:11:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.988+0000 7f7ae77fe640 1 --2- 172.21.15.17:0/470263748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ae8102ac0 0x7f7ae819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:11:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.988+0000 7f7ae6ffd640 1 --2- 172.21.15.17:0/470263748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae81033e0 0x7f7ae819dbe0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f7adc031460 tx=0x7f7adc004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.988+0000 7f7ae4ff9640 1 -- 172.21.15.17:0/470263748 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7adc03f070 con 0x7f7ae81033e0 2024-09-20T19:11:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.988+0000 7f7aedf92640 1 -- 172.21.15.17:0/470263748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae8197ab0 con 0x7f7ae81033e0 2024-09-20T19:11:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.988+0000 7f7ae4ff9640 1 -- 172.21.15.17:0/470263748 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7adc0035f0 con 0x7f7ae81033e0 2024-09-20T19:11:31.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.988+0000 7f7ae4ff9640 1 -- 172.21.15.17:0/470263748 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7adc035030 con 0x7f7ae81033e0 2024-09-20T19:11:31.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.989+0000 7f7aedf92640 1 -- 172.21.15.17:0/470263748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae8197fe0 con 0x7f7ae81033e0 2024-09-20T19:11:31.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.990+0000 7f7aedf92640 1 -- 172.21.15.17:0/470263748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ae806aa90 con 0x7f7ae81033e0 2024-09-20T19:11:31.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.990+0000 7f7ae4ff9640 1 -- 172.21.15.17:0/470263748 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7adc042070 con 0x7f7ae81033e0 2024-09-20T19:11:31.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.991+0000 7f7ae4ff9640 1 --2- 172.21.15.17:0/470263748 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7ad007af30 0x7f7ad007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:31.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.991+0000 7f7ae4ff9640 1 -- 172.21.15.17:0/470263748 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f7adc0be9b0 con 0x7f7ae81033e0 2024-09-20T19:11:31.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.991+0000 7f7ae77fe640 1 --2- 172.21.15.17:0/470263748 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7ad007af30 0x7f7ad007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:31.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.991+0000 7f7ae77fe640 1 --2- 172.21.15.17:0/470263748 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7ad007af30 0x7f7ad007d3f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80058c0 tx=0x7f7ad8005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:31.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:31.995+0000 7f7ae4ff9640 1 -- 172.21.15.17:0/470263748 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7adc089fb0 con 0x7f7ae81033e0 2024-09-20T19:11:32.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.202+0000 7f7aedf92640 1 -- 172.21.15.17:0/470263748 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7ae8198290 con 0x7f7ad007af30 2024-09-20T19:11:32.205 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:32 smithi017 ceph-mon[108970]: pgmap v1084: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:32.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.204+0000 7f7ae4ff9640 1 -- 172.21.15.17:0/470263748 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f7ae8198290 con 0x7f7ad007af30 2024-09-20T19:11:32.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.206+0000 7f7aedf92640 1 -- 172.21.15.17:0/470263748 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7ad007af30 msgr2=0x7f7ad007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:32.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.206+0000 7f7aedf92640 1 --2- 172.21.15.17:0/470263748 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7ad007af30 0x7f7ad007d3f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80058c0 tx=0x7f7ad8005850 comp rx=0 tx=0).stop 2024-09-20T19:11:32.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.206+0000 7f7aedf92640 1 -- 172.21.15.17:0/470263748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae81033e0 msgr2=0x7f7ae819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:32.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.206+0000 7f7aedf92640 1 --2- 172.21.15.17:0/470263748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae81033e0 0x7f7ae819dbe0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f7adc031460 tx=0x7f7adc004530 comp rx=0 tx=0).stop 2024-09-20T19:11:32.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.206+0000 7f7aedf92640 1 -- 172.21.15.17:0/470263748 shutdown_connections 2024-09-20T19:11:32.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.206+0000 7f7aedf92640 1 --2- 172.21.15.17:0/470263748 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7ad007af30 0x7f7ad007d3f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.206+0000 7f7aedf92640 1 --2- 172.21.15.17:0/470263748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ae81033e0 0x7f7ae819dbe0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.206+0000 7f7aedf92640 1 --2- 172.21.15.17:0/470263748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ae8102ac0 0x7f7ae819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.206+0000 7f7aedf92640 1 -- 172.21.15.17:0/470263748 >> 172.21.15.17:0/470263748 conn(0x7f7ae80fc520 msgr2=0x7f7ae8108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:32.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.206+0000 7f7aedf92640 1 -- 172.21.15.17:0/470263748 shutdown_connections 2024-09-20T19:11:32.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.206+0000 7f7aedf92640 1 -- 172.21.15.17:0/470263748 wait complete. 2024-09-20T19:11:32.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.291+0000 7fc9a5b1d640 1 -- 172.21.15.17:0/3158004160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a0102ac0 msgr2=0x7fc9a0102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:32.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.291+0000 7fc9a5b1d640 1 --2- 172.21.15.17:0/3158004160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a0102ac0 0x7fc9a0102ea0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc990009880 tx=0x7fc99002a530 comp rx=0 tx=0).stop 2024-09-20T19:11:32.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.291+0000 7fc9a5b1d640 1 -- 172.21.15.17:0/3158004160 shutdown_connections 2024-09-20T19:11:32.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.291+0000 7fc9a5b1d640 1 --2- 172.21.15.17:0/3158004160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9a01033e0 0x7fc9a010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.291+0000 7fc9a5b1d640 1 --2- 172.21.15.17:0/3158004160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a0102ac0 0x7fc9a0102ea0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.291+0000 7fc9a5b1d640 1 -- 172.21.15.17:0/3158004160 >> 172.21.15.17:0/3158004160 conn(0x7fc9a00fc520 msgr2=0x7fc9a00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:32.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.291+0000 7fc9a5b1d640 1 -- 172.21.15.17:0/3158004160 shutdown_connections 2024-09-20T19:11:32.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.291+0000 7fc9a5b1d640 1 -- 172.21.15.17:0/3158004160 wait complete. 2024-09-20T19:11:32.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.292+0000 7fc9a5b1d640 1 Processor -- start 2024-09-20T19:11:32.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.292+0000 7fc9a5b1d640 1 -- start start 2024-09-20T19:11:32.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.292+0000 7fc9a5b1d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a0102ac0 0x7fc9a019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:32.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.292+0000 7fc9a5b1d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9a01033e0 0x7fc9a019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:32.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.292+0000 7fc9a5b1d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a010edf0 con 0x7fc9a0102ac0 2024-09-20T19:11:32.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.292+0000 7fc9a5b1d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a010ec70 con 0x7fc9a01033e0 2024-09-20T19:11:32.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.292+0000 7fc99f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a0102ac0 0x7fc9a019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:32.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.292+0000 7fc99f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a0102ac0 0x7fc9a019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55834/0 (socket says 172.21.15.17:55834) 2024-09-20T19:11:32.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.292+0000 7fc99f7fe640 1 -- 172.21.15.17:0/2692948890 learned_addr learned my addr 172.21.15.17:0/2692948890 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:11:32.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.292+0000 7fc99effd640 1 --2- 172.21.15.17:0/2692948890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9a01033e0 0x7fc9a019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:32.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.293+0000 7fc99f7fe640 1 -- 172.21.15.17:0/2692948890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9a01033e0 msgr2=0x7fc9a019dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:32.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.293+0000 7fc99f7fe640 1 --2- 172.21.15.17:0/2692948890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9a01033e0 0x7fc9a019dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.293+0000 7fc99f7fe640 1 -- 172.21.15.17:0/2692948890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a01977e0 con 0x7fc9a0102ac0 2024-09-20T19:11:32.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.293+0000 7fc99f7fe640 1 --2- 172.21.15.17:0/2692948890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a0102ac0 0x7fc9a019d660 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc990031460 tx=0x7fc9900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:32.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.293+0000 7fc99cff9640 1 -- 172.21.15.17:0/2692948890 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc99003f070 con 0x7fc9a0102ac0 2024-09-20T19:11:32.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.293+0000 7fc9a5b1d640 1 -- 172.21.15.17:0/2692948890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a0197a70 con 0x7fc9a0102ac0 2024-09-20T19:11:32.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.293+0000 7fc99cff9640 1 -- 172.21.15.17:0/2692948890 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc990004cf0 con 0x7fc9a0102ac0 2024-09-20T19:11:32.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.293+0000 7fc99cff9640 1 -- 172.21.15.17:0/2692948890 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc990035030 con 0x7fc9a0102ac0 2024-09-20T19:11:32.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.293+0000 7fc9a5b1d640 1 -- 172.21.15.17:0/2692948890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a0197fa0 con 0x7fc9a0102ac0 2024-09-20T19:11:32.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.294+0000 7fc9a5b1d640 1 -- 172.21.15.17:0/2692948890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a006aa90 con 0x7fc9a0102ac0 2024-09-20T19:11:32.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.295+0000 7fc99cff9640 1 -- 172.21.15.17:0/2692948890 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc990042070 con 0x7fc9a0102ac0 2024-09-20T19:11:32.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.295+0000 7fc99cff9640 1 --2- 172.21.15.17:0/2692948890 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc98807af30 0x7fc98807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:32.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.296+0000 7fc99effd640 1 --2- 172.21.15.17:0/2692948890 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc98807af30 0x7fc98807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:32.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.296+0000 7fc99cff9640 1 -- 172.21.15.17:0/2692948890 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fc9900bea10 con 0x7fc9a0102ac0 2024-09-20T19:11:32.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.296+0000 7fc99effd640 1 --2- 172.21.15.17:0/2692948890 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc98807af30 0x7fc98807d3f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0108900 tx=0x7fc994005f50 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:32.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.300+0000 7fc99cff9640 1 -- 172.21.15.17:0/2692948890 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc99008a010 con 0x7fc9a0102ac0 2024-09-20T19:11:32.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:32 smithi172 ceph-mon[80431]: pgmap v1084: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:32.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.497+0000 7fc9a5b1d640 1 -- 172.21.15.17:0/2692948890 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc9a0198250 con 0x7fc98807af30 2024-09-20T19:11:32.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.507+0000 7fc99cff9640 1 -- 172.21.15.17:0/2692948890 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fc9a0198250 con 0x7fc98807af30 2024-09-20T19:11:32.509 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:11:32.509 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (32m) 11m ago 43m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:11:32.509 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (36m) 11m ago 44m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:11:32.509 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (35m) 11m ago 43m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:11:32.509 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (31m) 11m ago 44m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:11:32.510 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (31m) 11m ago 43m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:11:32.510 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (32m) 11m ago 43m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:11:32.510 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (27m) 11m ago 38m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:11:32.510 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (27m) 11m ago 38m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:11:32.510 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (11m) 11m ago 38m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:11:32.510 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (26m) 11m ago 38m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:11:32.510 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (35m) 11m ago 45m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:11:32.510 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (34m) 11m ago 43m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:11:32.510 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (31m) 11m ago 45m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:11:32.510 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (31m) 11m ago 43m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:11:32.511 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (33m) 11m ago 43m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:11:32.511 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (33m) 11m ago 43m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:11:32.511 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (30m) 11m ago 41m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:11:32.511 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (30m) 11m ago 41m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:11:32.511 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (29m) 11m ago 40m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:11:32.511 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (28m) 11m ago 40m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:11:32.511 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (28m) 11m ago 40m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:11:32.511 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (27m) 11m ago 39m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:11:32.511 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (33m) 11m ago 43m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:11:32.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.509+0000 7fc9a5b1d640 1 -- 172.21.15.17:0/2692948890 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc98807af30 msgr2=0x7fc98807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:32.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.509+0000 7fc9a5b1d640 1 --2- 172.21.15.17:0/2692948890 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc98807af30 0x7fc98807d3f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0108900 tx=0x7fc994005f50 comp rx=0 tx=0).stop 2024-09-20T19:11:32.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.509+0000 7fc9a5b1d640 1 -- 172.21.15.17:0/2692948890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a0102ac0 msgr2=0x7fc9a019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:32.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.509+0000 7fc9a5b1d640 1 --2- 172.21.15.17:0/2692948890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a0102ac0 0x7fc9a019d660 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc990031460 tx=0x7fc9900048f0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.509+0000 7fc9a5b1d640 1 -- 172.21.15.17:0/2692948890 shutdown_connections 2024-09-20T19:11:32.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.509+0000 7fc9a5b1d640 1 --2- 172.21.15.17:0/2692948890 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fc98807af30 0x7fc98807d3f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.509+0000 7fc9a5b1d640 1 --2- 172.21.15.17:0/2692948890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9a01033e0 0x7fc9a019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.509+0000 7fc9a5b1d640 1 --2- 172.21.15.17:0/2692948890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9a0102ac0 0x7fc9a019d660 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.509+0000 7fc9a5b1d640 1 -- 172.21.15.17:0/2692948890 >> 172.21.15.17:0/2692948890 conn(0x7fc9a00fc520 msgr2=0x7fc9a0108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:32.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.509+0000 7fc9a5b1d640 1 -- 172.21.15.17:0/2692948890 shutdown_connections 2024-09-20T19:11:32.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.509+0000 7fc9a5b1d640 1 -- 172.21.15.17:0/2692948890 wait complete. 2024-09-20T19:11:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.592+0000 7effb8bc5640 1 -- 172.21.15.17:0/1303854599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb4101900 msgr2=0x7effb4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.592+0000 7effb8bc5640 1 --2- 172.21.15.17:0/1303854599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb4101900 0x7effb4101d60 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7effa8009880 tx=0x7effa802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.592+0000 7effb8bc5640 1 -- 172.21.15.17:0/1303854599 shutdown_connections 2024-09-20T19:11:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.592+0000 7effb8bc5640 1 --2- 172.21.15.17:0/1303854599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb4101900 0x7effb4101d60 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.592+0000 7effb8bc5640 1 --2- 172.21.15.17:0/1303854599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb4107900 0x7effb4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.592+0000 7effb8bc5640 1 -- 172.21.15.17:0/1303854599 >> 172.21.15.17:0/1303854599 conn(0x7effb40fd600 msgr2=0x7effb40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.592+0000 7effb8bc5640 1 -- 172.21.15.17:0/1303854599 shutdown_connections 2024-09-20T19:11:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.592+0000 7effb8bc5640 1 -- 172.21.15.17:0/1303854599 wait complete. 2024-09-20T19:11:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.593+0000 7effb8bc5640 1 Processor -- start 2024-09-20T19:11:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.593+0000 7effb8bc5640 1 -- start start 2024-09-20T19:11:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.593+0000 7effb8bc5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb4101900 0x7effb419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.593+0000 7effb8bc5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb4107900 0x7effb419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.593+0000 7effb8bc5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7effb410edd0 con 0x7effb4107900 2024-09-20T19:11:32.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.593+0000 7effb8bc5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7effb410ec50 con 0x7effb4101900 2024-09-20T19:11:32.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.593+0000 7effb1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb4107900 0x7effb419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:32.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.593+0000 7effb1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb4107900 0x7effb419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55854/0 (socket says 172.21.15.17:55854) 2024-09-20T19:11:32.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.593+0000 7effb1d9b640 1 -- 172.21.15.17:0/1325567629 learned_addr learned my addr 172.21.15.17:0/1325567629 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:11:32.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.593+0000 7effb259c640 1 --2- 172.21.15.17:0/1325567629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb4101900 0x7effb419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:32.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.594+0000 7effb1d9b640 1 -- 172.21.15.17:0/1325567629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb4101900 msgr2=0x7effb419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:32.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.594+0000 7effb1d9b640 1 --2- 172.21.15.17:0/1325567629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb4101900 0x7effb419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.594+0000 7effb1d9b640 1 -- 172.21.15.17:0/1325567629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb4197800 con 0x7effb4107900 2024-09-20T19:11:32.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.594+0000 7effb1d9b640 1 --2- 172.21.15.17:0/1325567629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb4107900 0x7effb419dbc0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7effa8031460 tx=0x7effa80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:32.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.594+0000 7effa37fe640 1 -- 172.21.15.17:0/1325567629 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7effa803f070 con 0x7effb4107900 2024-09-20T19:11:32.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.594+0000 7effa37fe640 1 -- 172.21.15.17:0/1325567629 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7effa80044d0 con 0x7effb4107900 2024-09-20T19:11:32.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.594+0000 7effb8bc5640 1 -- 172.21.15.17:0/1325567629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb4197a90 con 0x7effb4107900 2024-09-20T19:11:32.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.594+0000 7effa37fe640 1 -- 172.21.15.17:0/1325567629 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7effa8035030 con 0x7effb4107900 2024-09-20T19:11:32.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.594+0000 7effb8bc5640 1 -- 172.21.15.17:0/1325567629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb4197fc0 con 0x7effb4107900 2024-09-20T19:11:32.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.595+0000 7effb8bc5640 1 -- 172.21.15.17:0/1325567629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb4103040 con 0x7effb4107900 2024-09-20T19:11:32.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.596+0000 7effa37fe640 1 -- 172.21.15.17:0/1325567629 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7effa8042070 con 0x7effb4107900 2024-09-20T19:11:32.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.596+0000 7effa37fe640 1 --2- 172.21.15.17:0/1325567629 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7eff9c07af90 0x7eff9c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:32.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.596+0000 7effb259c640 1 --2- 172.21.15.17:0/1325567629 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7eff9c07af90 0x7eff9c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:32.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.596+0000 7effa37fe640 1 -- 172.21.15.17:0/1325567629 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7effa80beae0 con 0x7effb4107900 2024-09-20T19:11:32.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.597+0000 7effb259c640 1 --2- 172.21.15.17:0/1325567629 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7eff9c07af90 0x7eff9c07d450 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7effa40058c0 tx=0x7effa4005c60 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:32.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.601+0000 7effa37fe640 1 -- 172.21.15.17:0/1325567629 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7effa8004cf0 con 0x7effb4107900 2024-09-20T19:11:32.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.864+0000 7effb8bc5640 1 -- 172.21.15.17:0/1325567629 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7effb4198d30 con 0x7effb4107900 2024-09-20T19:11:32.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.864+0000 7effa37fe640 1 -- 172.21.15.17:0/1325567629 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7effa808a160 con 0x7effb4107900 2024-09-20T19:11:32.867 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:11:32.867 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:11:32.867 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:11:32.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:11:32.867 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:11:32.867 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:11:32.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:11:32.867 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:11:32.867 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:11:32.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:11:32.868 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:11:32.868 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:11:32.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:11:32.868 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:11:32.868 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:11:32.868 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:11:32.868 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:11:32.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.867+0000 7effb8bc5640 1 -- 172.21.15.17:0/1325567629 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7eff9c07af90 msgr2=0x7eff9c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:32.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.867+0000 7effb8bc5640 1 --2- 172.21.15.17:0/1325567629 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7eff9c07af90 0x7eff9c07d450 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7effa40058c0 tx=0x7effa4005c60 comp rx=0 tx=0).stop 2024-09-20T19:11:32.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.867+0000 7effb8bc5640 1 -- 172.21.15.17:0/1325567629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb4107900 msgr2=0x7effb419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:32.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.867+0000 7effb8bc5640 1 --2- 172.21.15.17:0/1325567629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb4107900 0x7effb419dbc0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7effa8031460 tx=0x7effa80048f0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.867+0000 7effb8bc5640 1 -- 172.21.15.17:0/1325567629 shutdown_connections 2024-09-20T19:11:32.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.867+0000 7effb8bc5640 1 --2- 172.21.15.17:0/1325567629 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7eff9c07af90 0x7eff9c07d450 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.867+0000 7effb8bc5640 1 --2- 172.21.15.17:0/1325567629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7effb4107900 0x7effb419dbc0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.867+0000 7effb8bc5640 1 --2- 172.21.15.17:0/1325567629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb4101900 0x7effb419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.867+0000 7effb8bc5640 1 -- 172.21.15.17:0/1325567629 >> 172.21.15.17:0/1325567629 conn(0x7effb40fd600 msgr2=0x7effb40fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:32.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.867+0000 7effb8bc5640 1 -- 172.21.15.17:0/1325567629 shutdown_connections 2024-09-20T19:11:32.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.867+0000 7effb8bc5640 1 -- 172.21.15.17:0/1325567629 wait complete. 2024-09-20T19:11:32.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.951+0000 7fd323cd7640 1 -- 172.21.15.17:0/1388647692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c100650 msgr2=0x7fd31c100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:32.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.951+0000 7fd323cd7640 1 --2- 172.21.15.17:0/1388647692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c100650 0x7fd31c100a30 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd318009880 tx=0x7fd31802a490 comp rx=0 tx=0).stop 2024-09-20T19:11:32.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.952+0000 7fd323cd7640 1 -- 172.21.15.17:0/1388647692 shutdown_connections 2024-09-20T19:11:32.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.952+0000 7fd323cd7640 1 --2- 172.21.15.17:0/1388647692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd31c101000 0x7fd31c10dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.952+0000 7fd323cd7640 1 --2- 172.21.15.17:0/1388647692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c100650 0x7fd31c100a30 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.952+0000 7fd323cd7640 1 -- 172.21.15.17:0/1388647692 >> 172.21.15.17:0/1388647692 conn(0x7fd31c0fc520 msgr2=0x7fd31c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:32.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.952+0000 7fd323cd7640 1 -- 172.21.15.17:0/1388647692 shutdown_connections 2024-09-20T19:11:32.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.952+0000 7fd323cd7640 1 -- 172.21.15.17:0/1388647692 wait complete. 2024-09-20T19:11:32.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.952+0000 7fd323cd7640 1 Processor -- start 2024-09-20T19:11:32.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.952+0000 7fd323cd7640 1 -- start start 2024-09-20T19:11:32.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.953+0000 7fd323cd7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd31c100650 0x7fd31c19f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:32.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.953+0000 7fd323cd7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c101000 0x7fd31c19fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:32.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.953+0000 7fd323cd7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c110fb0 con 0x7fd31c101000 2024-09-20T19:11:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.953+0000 7fd323cd7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c110e30 con 0x7fd31c100650 2024-09-20T19:11:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.953+0000 7fd321272640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c101000 0x7fd31c19fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.953+0000 7fd321272640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c101000 0x7fd31c19fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55860/0 (socket says 172.21.15.17:55860) 2024-09-20T19:11:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.953+0000 7fd321272640 1 -- 172.21.15.17:0/2995674057 learned_addr learned my addr 172.21.15.17:0/2995674057 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:11:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.953+0000 7fd321a73640 1 --2- 172.21.15.17:0/2995674057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd31c100650 0x7fd31c19f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.953+0000 7fd321272640 1 -- 172.21.15.17:0/2995674057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd31c100650 msgr2=0x7fd31c19f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.953+0000 7fd321272640 1 --2- 172.21.15.17:0/2995674057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd31c100650 0x7fd31c19f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.953+0000 7fd321272640 1 -- 172.21.15.17:0/2995674057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c199a40 con 0x7fd31c101000 2024-09-20T19:11:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.953+0000 7fd321272640 1 --2- 172.21.15.17:0/2995674057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c101000 0x7fd31c19fdc0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00d6f0 tx=0x7fd30c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.953+0000 7fd312ffd640 1 -- 172.21.15.17:0/2995674057 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd30c017070 con 0x7fd31c101000 2024-09-20T19:11:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.953+0000 7fd312ffd640 1 -- 172.21.15.17:0/2995674057 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd30c00de00 con 0x7fd31c101000 2024-09-20T19:11:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.953+0000 7fd323cd7640 1 -- 172.21.15.17:0/2995674057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31c199d30 con 0x7fd31c101000 2024-09-20T19:11:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.953+0000 7fd312ffd640 1 -- 172.21.15.17:0/2995674057 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd30c004bb0 con 0x7fd31c101000 2024-09-20T19:11:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.953+0000 7fd323cd7640 1 -- 172.21.15.17:0/2995674057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31c19a2c0 con 0x7fd31c101000 2024-09-20T19:11:32.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.955+0000 7fd323cd7640 1 -- 172.21.15.17:0/2995674057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd31c06aa90 con 0x7fd31c101000 2024-09-20T19:11:32.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.955+0000 7fd312ffd640 1 -- 172.21.15.17:0/2995674057 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd30c009a30 con 0x7fd31c101000 2024-09-20T19:11:32.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.956+0000 7fd312ffd640 1 --2- 172.21.15.17:0/2995674057 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd30807af90 0x7fd30807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:32.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.956+0000 7fd312ffd640 1 -- 172.21.15.17:0/2995674057 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fd30c09db60 con 0x7fd31c101000 2024-09-20T19:11:32.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.956+0000 7fd321a73640 1 --2- 172.21.15.17:0/2995674057 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd30807af90 0x7fd30807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:32.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.956+0000 7fd321a73640 1 --2- 172.21.15.17:0/2995674057 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd30807af90 0x7fd30807d450 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd318000c00 tx=0x7fd318031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:32.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:32.960+0000 7fd312ffd640 1 -- 172.21.15.17:0/2995674057 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd30c069140 con 0x7fd31c101000 2024-09-20T19:11:33.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:33 smithi017 ceph-mon[108970]: from='client.35772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:33.379 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:33 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1325567629' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:33.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.185+0000 7fd323cd7640 1 -- 172.21.15.17:0/2995674057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd31c10b3a0 con 0x7fd31c101000 2024-09-20T19:11:33.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.185+0000 7fd312ffd640 1 -- 172.21.15.17:0/2995674057 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7fd30c06dff0 con 0x7fd31c101000 2024-09-20T19:11:33.381 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:11:33.381 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:11:33.381 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:11:33.381 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:11:33.381 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:11:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:11:33.381 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:11:33.381 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:11:33.381 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:11:33.381 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:11:33.381 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:11:33.381 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:11:33.381 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:11:33.382 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:11:33.382 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:11:33.382 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:11:33.382 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:11:33.382 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:11:33.382 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:11:33.382 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:11:33.382 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:11:33.382 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:11:33.382 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:11:33.382 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:11:33.382 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:11:33.382 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:11:33.383 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:11:33.383 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:11:33.383 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:11:33.383 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:11:33.383 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:11:33.383 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:11:33.383 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:11:33.383 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:11:33.383 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:11:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:11:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:11:33.383 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:11:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:11:33.383 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:11:33.384 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:11:33.384 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:11:33.384 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:11:33.386 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:11:33.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.187+0000 7fd323cd7640 1 -- 172.21.15.17:0/2995674057 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd30807af90 msgr2=0x7fd30807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.187+0000 7fd323cd7640 1 --2- 172.21.15.17:0/2995674057 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd30807af90 0x7fd30807d450 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd318000c00 tx=0x7fd318031400 comp rx=0 tx=0).stop 2024-09-20T19:11:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.187+0000 7fd323cd7640 1 -- 172.21.15.17:0/2995674057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c101000 msgr2=0x7fd31c19fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.187+0000 7fd323cd7640 1 --2- 172.21.15.17:0/2995674057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c101000 0x7fd31c19fdc0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00d6f0 tx=0x7fd30c00dbb0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.187+0000 7fd323cd7640 1 -- 172.21.15.17:0/2995674057 shutdown_connections 2024-09-20T19:11:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.188+0000 7fd323cd7640 1 --2- 172.21.15.17:0/2995674057 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fd30807af90 0x7fd30807d450 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.188+0000 7fd323cd7640 1 --2- 172.21.15.17:0/2995674057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c101000 0x7fd31c19fdc0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.188+0000 7fd323cd7640 1 --2- 172.21.15.17:0/2995674057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd31c100650 0x7fd31c19f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.188+0000 7fd323cd7640 1 -- 172.21.15.17:0/2995674057 >> 172.21.15.17:0/2995674057 conn(0x7fd31c0fc520 msgr2=0x7fd31c0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.188+0000 7fd323cd7640 1 -- 172.21.15.17:0/2995674057 shutdown_connections 2024-09-20T19:11:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.188+0000 7fd323cd7640 1 -- 172.21.15.17:0/2995674057 wait complete. 2024-09-20T19:11:33.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.272+0000 7fb437957640 1 -- 172.21.15.17:0/429335741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb430101000 msgr2=0x7fb43010dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.272+0000 7fb437957640 1 --2- 172.21.15.17:0/429335741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb430101000 0x7fb43010dcc0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fb420009880 tx=0x7fb42002a490 comp rx=0 tx=0).stop 2024-09-20T19:11:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.272+0000 7fb437957640 1 -- 172.21.15.17:0/429335741 shutdown_connections 2024-09-20T19:11:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.272+0000 7fb437957640 1 --2- 172.21.15.17:0/429335741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb430101000 0x7fb43010dcc0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.272+0000 7fb437957640 1 --2- 172.21.15.17:0/429335741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb430100650 0x7fb430100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.272+0000 7fb437957640 1 -- 172.21.15.17:0/429335741 >> 172.21.15.17:0/429335741 conn(0x7fb4300fc520 msgr2=0x7fb4300fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.273+0000 7fb437957640 1 -- 172.21.15.17:0/429335741 shutdown_connections 2024-09-20T19:11:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.273+0000 7fb437957640 1 -- 172.21.15.17:0/429335741 wait complete. 2024-09-20T19:11:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.273+0000 7fb437957640 1 Processor -- start 2024-09-20T19:11:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.273+0000 7fb437957640 1 -- start start 2024-09-20T19:11:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.273+0000 7fb437957640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb430100650 0x7fb43019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.273+0000 7fb437957640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb430101000 0x7fb43019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.273+0000 7fb437957640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb430110f90 con 0x7fb430100650 2024-09-20T19:11:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.273+0000 7fb437957640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb430110e10 con 0x7fb430101000 2024-09-20T19:11:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.274+0000 7fb4356f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb430100650 0x7fb43019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.274+0000 7fb4356f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb430100650 0x7fb43019f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55880/0 (socket says 172.21.15.17:55880) 2024-09-20T19:11:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.274+0000 7fb4356f3640 1 -- 172.21.15.17:0/3428435731 learned_addr learned my addr 172.21.15.17:0/3428435731 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:11:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.274+0000 7fb434ef2640 1 --2- 172.21.15.17:0/3428435731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb430101000 0x7fb43019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.274+0000 7fb4356f3640 1 -- 172.21.15.17:0/3428435731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb430101000 msgr2=0x7fb43019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.274+0000 7fb4356f3640 1 --2- 172.21.15.17:0/3428435731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb430101000 0x7fb43019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.274+0000 7fb4356f3640 1 -- 172.21.15.17:0/3428435731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb430199a20 con 0x7fb430100650 2024-09-20T19:11:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.274+0000 7fb434ef2640 1 --2- 172.21.15.17:0/3428435731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb430101000 0x7fb43019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:11:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.274+0000 7fb4356f3640 1 --2- 172.21.15.17:0/3428435731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb430100650 0x7fb43019f860 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00c8f0 tx=0x7fb42c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.274+0000 7fb4267fc640 1 -- 172.21.15.17:0/3428435731 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb42c0079b0 con 0x7fb430100650 2024-09-20T19:11:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.274+0000 7fb4267fc640 1 -- 172.21.15.17:0/3428435731 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb42c0054e0 con 0x7fb430100650 2024-09-20T19:11:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.274+0000 7fb437957640 1 -- 172.21.15.17:0/3428435731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb430199d10 con 0x7fb430100650 2024-09-20T19:11:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.274+0000 7fb4267fc640 1 -- 172.21.15.17:0/3428435731 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb42c004dd0 con 0x7fb430100650 2024-09-20T19:11:33.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.274+0000 7fb437957640 1 -- 172.21.15.17:0/3428435731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43019a2a0 con 0x7fb430100650 2024-09-20T19:11:33.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.275+0000 7fb437957640 1 -- 172.21.15.17:0/3428435731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb43006aa90 con 0x7fb430100650 2024-09-20T19:11:33.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.276+0000 7fb4267fc640 1 -- 172.21.15.17:0/3428435731 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb42c005020 con 0x7fb430100650 2024-09-20T19:11:33.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.277+0000 7fb4267fc640 1 --2- 172.21.15.17:0/3428435731 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb41c07aed0 0x7fb41c07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:33.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.277+0000 7fb4267fc640 1 -- 172.21.15.17:0/3428435731 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fb42c09dfe0 con 0x7fb430100650 2024-09-20T19:11:33.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.277+0000 7fb434ef2640 1 --2- 172.21.15.17:0/3428435731 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb41c07aed0 0x7fb41c07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:33.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.277+0000 7fb434ef2640 1 --2- 172.21.15.17:0/3428435731 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb41c07aed0 0x7fb41c07d390 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb420031460 tx=0x7fb420004280 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:33.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.281+0000 7fb4267fc640 1 -- 172.21.15.17:0/3428435731 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb42c014030 con 0x7fb430100650 2024-09-20T19:11:33.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:33 smithi172 ceph-mon[80431]: from='client.35772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:33.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:33 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1325567629' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:11:33.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.491+0000 7fb437957640 1 -- 172.21.15.17:0/3428435731 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb43019af50 con 0x7fb41c07aed0 2024-09-20T19:11:33.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.492+0000 7fb4267fc640 1 -- 172.21.15.17:0/3428435731 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fb43019af50 con 0x7fb41c07aed0 2024-09-20T19:11:33.495 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:11:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:11:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:11:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:11:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:11:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:11:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:11:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:11:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:11:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:11:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:11:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:11:33.495 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:11:33.496 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:11:33.496 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:11:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.494+0000 7fb437957640 1 -- 172.21.15.17:0/3428435731 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb41c07aed0 msgr2=0x7fb41c07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.494+0000 7fb437957640 1 --2- 172.21.15.17:0/3428435731 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb41c07aed0 0x7fb41c07d390 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb420031460 tx=0x7fb420004280 comp rx=0 tx=0).stop 2024-09-20T19:11:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.494+0000 7fb437957640 1 -- 172.21.15.17:0/3428435731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb430100650 msgr2=0x7fb43019f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.494+0000 7fb437957640 1 --2- 172.21.15.17:0/3428435731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb430100650 0x7fb43019f860 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00c8f0 tx=0x7fb42c00cdb0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.494+0000 7fb437957640 1 -- 172.21.15.17:0/3428435731 shutdown_connections 2024-09-20T19:11:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.494+0000 7fb437957640 1 --2- 172.21.15.17:0/3428435731 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb41c07aed0 0x7fb41c07d390 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.494+0000 7fb437957640 1 --2- 172.21.15.17:0/3428435731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb430101000 0x7fb43019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.494+0000 7fb437957640 1 --2- 172.21.15.17:0/3428435731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb430100650 0x7fb43019f860 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.494+0000 7fb437957640 1 -- 172.21.15.17:0/3428435731 >> 172.21.15.17:0/3428435731 conn(0x7fb4300fc520 msgr2=0x7fb4300fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.495+0000 7fb437957640 1 -- 172.21.15.17:0/3428435731 shutdown_connections 2024-09-20T19:11:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.495+0000 7fb437957640 1 -- 172.21.15.17:0/3428435731 wait complete. 2024-09-20T19:11:33.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.579+0000 7f74e4105640 1 -- 172.21.15.17:0/959229568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74dc101900 msgr2=0x7f74dc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:33.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.579+0000 7f74e4105640 1 --2- 172.21.15.17:0/959229568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74dc101900 0x7f74dc101d60 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009880 tx=0x7f74cc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.579+0000 7f74e4105640 1 -- 172.21.15.17:0/959229568 shutdown_connections 2024-09-20T19:11:33.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.579+0000 7f74e4105640 1 --2- 172.21.15.17:0/959229568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74dc101900 0x7f74dc101d60 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.579+0000 7f74e4105640 1 --2- 172.21.15.17:0/959229568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74dc107900 0x7f74dc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.579+0000 7f74e4105640 1 -- 172.21.15.17:0/959229568 >> 172.21.15.17:0/959229568 conn(0x7f74dc0fd600 msgr2=0x7f74dc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:33.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.579+0000 7f74e4105640 1 -- 172.21.15.17:0/959229568 shutdown_connections 2024-09-20T19:11:33.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.579+0000 7f74e4105640 1 -- 172.21.15.17:0/959229568 wait complete. 2024-09-20T19:11:33.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.580+0000 7f74e4105640 1 Processor -- start 2024-09-20T19:11:33.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.580+0000 7f74e4105640 1 -- start start 2024-09-20T19:11:33.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.580+0000 7f74e4105640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74dc101900 0x7f74dc19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:33.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.580+0000 7f74e4105640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74dc107900 0x7f74dc19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:33.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.580+0000 7f74e4105640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc10edd0 con 0x7f74dc101900 2024-09-20T19:11:33.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.580+0000 7f74e4105640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc10ec50 con 0x7f74dc107900 2024-09-20T19:11:33.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.580+0000 7f74e1ea1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74dc101900 0x7f74dc19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:33.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.580+0000 7f74e1ea1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74dc101900 0x7f74dc19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55896/0 (socket says 172.21.15.17:55896) 2024-09-20T19:11:33.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.580+0000 7f74e1ea1640 1 -- 172.21.15.17:0/998033957 learned_addr learned my addr 172.21.15.17:0/998033957 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:11:33.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.580+0000 7f74e16a0640 1 --2- 172.21.15.17:0/998033957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74dc107900 0x7f74dc19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.580+0000 7f74e1ea1640 1 -- 172.21.15.17:0/998033957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74dc107900 msgr2=0x7f74dc19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.580+0000 7f74e1ea1640 1 --2- 172.21.15.17:0/998033957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74dc107900 0x7f74dc19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.580+0000 7f74e1ea1640 1 -- 172.21.15.17:0/998033957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74dc197800 con 0x7f74dc101900 2024-09-20T19:11:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.580+0000 7f74e16a0640 1 --2- 172.21.15.17:0/998033957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74dc107900 0x7f74dc19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:11:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.581+0000 7f74e1ea1640 1 --2- 172.21.15.17:0/998033957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74dc101900 0x7f74dc19d680 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f74d800c8f0 tx=0x7f74d800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.581+0000 7f74d2ffd640 1 -- 172.21.15.17:0/998033957 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f74d80079b0 con 0x7f74dc101900 2024-09-20T19:11:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.581+0000 7f74d2ffd640 1 -- 172.21.15.17:0/998033957 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f74d80054e0 con 0x7f74dc101900 2024-09-20T19:11:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.581+0000 7f74e4105640 1 -- 172.21.15.17:0/998033957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74dc197af0 con 0x7f74dc101900 2024-09-20T19:11:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.581+0000 7f74d2ffd640 1 -- 172.21.15.17:0/998033957 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f74d8004dd0 con 0x7f74dc101900 2024-09-20T19:11:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.581+0000 7f74e4105640 1 -- 172.21.15.17:0/998033957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74dc198080 con 0x7f74dc101900 2024-09-20T19:11:33.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.582+0000 7f74e4105640 1 -- 172.21.15.17:0/998033957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74dc103040 con 0x7f74dc101900 2024-09-20T19:11:33.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.583+0000 7f74d2ffd640 1 -- 172.21.15.17:0/998033957 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f74d8005020 con 0x7f74dc101900 2024-09-20T19:11:33.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.583+0000 7f74d2ffd640 1 --2- 172.21.15.17:0/998033957 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f74c807af40 0x7f74c807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:11:33.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.583+0000 7f74d2ffd640 1 -- 172.21.15.17:0/998033957 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f74d809dea0 con 0x7f74dc101900 2024-09-20T19:11:33.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.583+0000 7f74e16a0640 1 --2- 172.21.15.17:0/998033957 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f74c807af40 0x7f74c807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:11:33.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.584+0000 7f74e16a0640 1 --2- 172.21.15.17:0/998033957 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f74c807af40 0x7f74c807d400 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f74cc031460 tx=0x7f74cc004280 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:11:33.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.588+0000 7f74d2ffd640 1 -- 172.21.15.17:0/998033957 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f74d8014030 con 0x7f74dc101900 2024-09-20T19:11:33.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.849+0000 7f74e4105640 1 -- 172.21.15.17:0/998033957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f74dc109e70 con 0x7f74dc101900 2024-09-20T19:11:33.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.849+0000 7f74d2ffd640 1 -- 172.21.15.17:0/998033957 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f74d8069520 con 0x7f74dc101900 2024-09-20T19:11:33.852 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:11:33.852 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:11:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:11:33.852 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:11:33.852 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:11:33.852 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:11:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:11:33.852 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:11:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:11:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:11:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:11:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:11:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:11:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:11:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:11:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:11:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:11:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:11:33.853 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:11:33.853 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:11:33.853 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:11:33.854 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:11:33.854 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:11:33.854 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:11:33.854 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:11:33.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.852+0000 7f74e4105640 1 -- 172.21.15.17:0/998033957 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f74c807af40 msgr2=0x7f74c807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:33.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.852+0000 7f74e4105640 1 --2- 172.21.15.17:0/998033957 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f74c807af40 0x7f74c807d400 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f74cc031460 tx=0x7f74cc004280 comp rx=0 tx=0).stop 2024-09-20T19:11:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.852+0000 7f74e4105640 1 -- 172.21.15.17:0/998033957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74dc101900 msgr2=0x7f74dc19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:11:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.852+0000 7f74e4105640 1 --2- 172.21.15.17:0/998033957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74dc101900 0x7f74dc19d680 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f74d800c8f0 tx=0x7f74d800cdb0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.852+0000 7f74e4105640 1 -- 172.21.15.17:0/998033957 shutdown_connections 2024-09-20T19:11:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.852+0000 7f74e4105640 1 --2- 172.21.15.17:0/998033957 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f74c807af40 0x7f74c807d400 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.852+0000 7f74e4105640 1 --2- 172.21.15.17:0/998033957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74dc107900 0x7f74dc19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.852+0000 7f74e4105640 1 --2- 172.21.15.17:0/998033957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74dc101900 0x7f74dc19d680 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:11:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.852+0000 7f74e4105640 1 -- 172.21.15.17:0/998033957 >> 172.21.15.17:0/998033957 conn(0x7f74dc0fd600 msgr2=0x7f74dc0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:11:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.852+0000 7f74e4105640 1 -- 172.21.15.17:0/998033957 shutdown_connections 2024-09-20T19:11:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:11:33.852+0000 7f74e4105640 1 -- 172.21.15.17:0/998033957 wait complete. 2024-09-20T19:11:34.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:34 smithi017 ceph-mon[108970]: from='client.35776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:34.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:34 smithi017 ceph-mon[108970]: from='client.35780 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:34.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:34 smithi017 ceph-mon[108970]: pgmap v1085: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:34.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:34 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2995674057' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:11:34.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:34 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/998033957' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:11:34.451 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:34 smithi172 ceph-mon[80431]: from='client.35776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:34.451 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:34 smithi172 ceph-mon[80431]: from='client.35780 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:34.451 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:34 smithi172 ceph-mon[80431]: pgmap v1085: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:34.451 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:34 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2995674057' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:11:34.451 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:34 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/998033957' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:11:35.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:35 smithi017 ceph-mon[108970]: from='client.35792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:35.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:35 smithi172 ceph-mon[80431]: from='client.35792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:11:36.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:36 smithi017 ceph-mon[108970]: pgmap v1086: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:36.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:36 smithi172 ceph-mon[80431]: pgmap v1086: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:38.371 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:38 smithi017 ceph-mon[108970]: pgmap v1087: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:38.372 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:38 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:11:38.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:38 smithi172 ceph-mon[80431]: pgmap v1087: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:38.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:38 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:11:39.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:39 smithi017 ceph-mon[108970]: pgmap v1088: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:39.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:39 smithi172 ceph-mon[80431]: pgmap v1088: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:42.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:41 smithi017 ceph-mon[108970]: pgmap v1089: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:42.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:41 smithi172 ceph-mon[80431]: pgmap v1089: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:44.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:43 smithi017 ceph-mon[108970]: pgmap v1090: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:44.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:43 smithi172 ceph-mon[80431]: pgmap v1090: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:46.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:45 smithi017 ceph-mon[108970]: pgmap v1091: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:46.174 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:45 smithi172 ceph-mon[80431]: pgmap v1091: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:48.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:47 smithi017 ceph-mon[108970]: pgmap v1092: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:48.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:47 smithi172 ceph-mon[80431]: pgmap v1092: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:50.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:49 smithi017 ceph-mon[108970]: pgmap v1093: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:50.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:49 smithi172 ceph-mon[80431]: pgmap v1093: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:52.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:51 smithi017 ceph-mon[108970]: pgmap v1094: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:52.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:51 smithi172 ceph-mon[80431]: pgmap v1094: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:53.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:11:53.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:11:54.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:53 smithi017 ceph-mon[108970]: pgmap v1095: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:54.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:53 smithi172 ceph-mon[80431]: pgmap v1095: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:56.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:55 smithi017 ceph-mon[108970]: pgmap v1096: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:56.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:55 smithi172 ceph-mon[80431]: pgmap v1096: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:58.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:57 smithi017 ceph-mon[108970]: pgmap v1097: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:11:58.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:57 smithi172 ceph-mon[80431]: pgmap v1097: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:00.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:11:59 smithi017 ceph-mon[108970]: pgmap v1098: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:00.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:11:59 smithi172 ceph-mon[80431]: pgmap v1098: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:02.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:01 smithi017 ceph-mon[108970]: pgmap v1099: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:02.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:01 smithi172 ceph-mon[80431]: pgmap v1099: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.944+0000 7f11cf3b9640 1 -- 172.21.15.17:0/2169218236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c8101000 msgr2=0x7f11c810dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.944+0000 7f11cf3b9640 1 --2- 172.21.15.17:0/2169218236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c8101000 0x7f11c810dcc0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009880 tx=0x7f11b802a490 comp rx=0 tx=0).stop 2024-09-20T19:12:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.944+0000 7f11cf3b9640 1 -- 172.21.15.17:0/2169218236 shutdown_connections 2024-09-20T19:12:03.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.944+0000 7f11cf3b9640 1 --2- 172.21.15.17:0/2169218236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c8101000 0x7f11c810dcc0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.944+0000 7f11cf3b9640 1 --2- 172.21.15.17:0/2169218236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c8100650 0x7f11c8100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.944+0000 7f11cf3b9640 1 -- 172.21.15.17:0/2169218236 >> 172.21.15.17:0/2169218236 conn(0x7f11c80fc520 msgr2=0x7f11c80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.945+0000 7f11cf3b9640 1 -- 172.21.15.17:0/2169218236 shutdown_connections 2024-09-20T19:12:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.945+0000 7f11cf3b9640 1 -- 172.21.15.17:0/2169218236 wait complete. 2024-09-20T19:12:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.945+0000 7f11cf3b9640 1 Processor -- start 2024-09-20T19:12:03.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.945+0000 7f11cf3b9640 1 -- start start 2024-09-20T19:12:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.945+0000 7f11cf3b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c8100650 0x7f11c819f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.945+0000 7f11cf3b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c8101000 0x7f11c819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:03.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.945+0000 7f11cf3b9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f11c8110f90 con 0x7f11c8101000 2024-09-20T19:12:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.946+0000 7f11cf3b9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f11c8110e10 con 0x7f11c8100650 2024-09-20T19:12:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.946+0000 7f11cc954640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c8101000 0x7f11c819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.946+0000 7f11cc954640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c8101000 0x7f11c819fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45832/0 (socket says 172.21.15.17:45832) 2024-09-20T19:12:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.946+0000 7f11cc954640 1 -- 172.21.15.17:0/1219917616 learned_addr learned my addr 172.21.15.17:0/1219917616 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:12:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.946+0000 7f11cd155640 1 --2- 172.21.15.17:0/1219917616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c8100650 0x7f11c819f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.946+0000 7f11cc954640 1 -- 172.21.15.17:0/1219917616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c8100650 msgr2=0x7f11c819f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.946+0000 7f11cc954640 1 --2- 172.21.15.17:0/1219917616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c8100650 0x7f11c819f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.946+0000 7f11cc954640 1 -- 172.21.15.17:0/1219917616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c8199a20 con 0x7f11c8101000 2024-09-20T19:12:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.946+0000 7f11cc954640 1 --2- 172.21.15.17:0/1219917616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c8101000 0x7f11c819fda0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f11b8031460 tx=0x7f11b80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.946+0000 7f11be7fc640 1 -- 172.21.15.17:0/1219917616 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f11b803f070 con 0x7f11c8101000 2024-09-20T19:12:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.946+0000 7f11be7fc640 1 -- 172.21.15.17:0/1219917616 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f11b8004b10 con 0x7f11c8101000 2024-09-20T19:12:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.946+0000 7f11cf3b9640 1 -- 172.21.15.17:0/1219917616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c8199cb0 con 0x7f11c8101000 2024-09-20T19:12:03.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.946+0000 7f11be7fc640 1 -- 172.21.15.17:0/1219917616 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f11b8035030 con 0x7f11c8101000 2024-09-20T19:12:03.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.946+0000 7f11cf3b9640 1 -- 172.21.15.17:0/1219917616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c819a240 con 0x7f11c8101000 2024-09-20T19:12:03.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.947+0000 7f11cf3b9640 1 -- 172.21.15.17:0/1219917616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c806aa90 con 0x7f11c8101000 2024-09-20T19:12:03.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.948+0000 7f11be7fc640 1 -- 172.21.15.17:0/1219917616 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f11b8042070 con 0x7f11c8101000 2024-09-20T19:12:03.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.949+0000 7f11be7fc640 1 --2- 172.21.15.17:0/1219917616 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f11b407af90 0x7f11b407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:03.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.949+0000 7f11be7fc640 1 -- 172.21.15.17:0/1219917616 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f11b80be9c0 con 0x7f11c8101000 2024-09-20T19:12:03.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.949+0000 7f11cd155640 1 --2- 172.21.15.17:0/1219917616 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f11b407af90 0x7f11b407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:03.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.949+0000 7f11cd155640 1 --2- 172.21.15.17:0/1219917616 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f11b407af90 0x7f11b407d450 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f11c819ab60 tx=0x7f11c400b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:03.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:03.953+0000 7f11be7fc640 1 -- 172.21.15.17:0/1219917616 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f11b808a040 con 0x7f11c8101000 2024-09-20T19:12:04.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:03 smithi017 ceph-mon[108970]: pgmap v1100: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.163+0000 7f11cf3b9640 1 -- 172.21.15.17:0/1219917616 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f11c810b410 con 0x7f11b407af90 2024-09-20T19:12:04.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.164+0000 7f11be7fc640 1 -- 172.21.15.17:0/1219917616 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f11c4003890 con 0x7f11b407af90 2024-09-20T19:12:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.166+0000 7f11cf3b9640 1 -- 172.21.15.17:0/1219917616 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f11b407af90 msgr2=0x7f11b407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.166+0000 7f11cf3b9640 1 --2- 172.21.15.17:0/1219917616 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f11b407af90 0x7f11b407d450 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f11c819ab60 tx=0x7f11c400b390 comp rx=0 tx=0).stop 2024-09-20T19:12:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.166+0000 7f11cf3b9640 1 -- 172.21.15.17:0/1219917616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c8101000 msgr2=0x7f11c819fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.166+0000 7f11cf3b9640 1 --2- 172.21.15.17:0/1219917616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c8101000 0x7f11c819fda0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f11b8031460 tx=0x7f11b80045e0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.166+0000 7f11cf3b9640 1 -- 172.21.15.17:0/1219917616 shutdown_connections 2024-09-20T19:12:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.166+0000 7f11cf3b9640 1 --2- 172.21.15.17:0/1219917616 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f11b407af90 0x7f11b407d450 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.166+0000 7f11cf3b9640 1 --2- 172.21.15.17:0/1219917616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11c8101000 0x7f11c819fda0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.166+0000 7f11cf3b9640 1 --2- 172.21.15.17:0/1219917616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c8100650 0x7f11c819f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.166+0000 7f11cf3b9640 1 -- 172.21.15.17:0/1219917616 >> 172.21.15.17:0/1219917616 conn(0x7f11c80fc520 msgr2=0x7f11c80fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.167+0000 7f11cf3b9640 1 -- 172.21.15.17:0/1219917616 shutdown_connections 2024-09-20T19:12:04.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.167+0000 7f11cf3b9640 1 -- 172.21.15.17:0/1219917616 wait complete. 2024-09-20T19:12:04.178 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:12:04.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:03 smithi172 ceph-mon[80431]: pgmap v1100: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:04.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.252+0000 7f3b2e0c2640 1 -- 172.21.15.17:0/2549407154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b28103470 msgr2=0x7f3b2810b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:04.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.252+0000 7f3b2e0c2640 1 --2- 172.21.15.17:0/2549407154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b28103470 0x7f3b2810b960 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009880 tx=0x7f3b1c02a530 comp rx=0 tx=0).stop 2024-09-20T19:12:04.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.252+0000 7f3b2e0c2640 1 -- 172.21.15.17:0/2549407154 shutdown_connections 2024-09-20T19:12:04.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.252+0000 7f3b2e0c2640 1 --2- 172.21.15.17:0/2549407154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b28103470 0x7f3b2810b960 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.252+0000 7f3b2e0c2640 1 --2- 172.21.15.17:0/2549407154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b28102b50 0x7f3b28102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.252+0000 7f3b2e0c2640 1 -- 172.21.15.17:0/2549407154 >> 172.21.15.17:0/2549407154 conn(0x7f3b280fc550 msgr2=0x7f3b280fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:04.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.252+0000 7f3b2e0c2640 1 -- 172.21.15.17:0/2549407154 shutdown_connections 2024-09-20T19:12:04.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.252+0000 7f3b2e0c2640 1 -- 172.21.15.17:0/2549407154 wait complete. 2024-09-20T19:12:04.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.252+0000 7f3b2e0c2640 1 Processor -- start 2024-09-20T19:12:04.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.253+0000 7f3b2e0c2640 1 -- start start 2024-09-20T19:12:04.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.253+0000 7f3b2e0c2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b28102b50 0x7f3b2819d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:04.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.253+0000 7f3b2e0c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b28103470 0x7f3b2819db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:04.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.253+0000 7f3b2e0c2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2810edc0 con 0x7f3b28103470 2024-09-20T19:12:04.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.253+0000 7f3b2e0c2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2810ec40 con 0x7f3b28102b50 2024-09-20T19:12:04.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.253+0000 7f3b26ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b28103470 0x7f3b2819db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:04.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.253+0000 7f3b26ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b28103470 0x7f3b2819db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45840/0 (socket says 172.21.15.17:45840) 2024-09-20T19:12:04.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.253+0000 7f3b26ffd640 1 -- 172.21.15.17:0/1535999357 learned_addr learned my addr 172.21.15.17:0/1535999357 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:12:04.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.253+0000 7f3b277fe640 1 --2- 172.21.15.17:0/1535999357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b28102b50 0x7f3b2819d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:04.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.253+0000 7f3b26ffd640 1 -- 172.21.15.17:0/1535999357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b28102b50 msgr2=0x7f3b2819d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:04.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.253+0000 7f3b26ffd640 1 --2- 172.21.15.17:0/1535999357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b28102b50 0x7f3b2819d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.253+0000 7f3b26ffd640 1 -- 172.21.15.17:0/1535999357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b28197790 con 0x7f3b28103470 2024-09-20T19:12:04.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.253+0000 7f3b26ffd640 1 --2- 172.21.15.17:0/1535999357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b28103470 0x7f3b2819db50 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c004f90 tx=0x7f3b1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:04.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.254+0000 7f3b24ff9640 1 -- 172.21.15.17:0/1535999357 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b1c03f070 con 0x7f3b28103470 2024-09-20T19:12:04.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.254+0000 7f3b24ff9640 1 -- 172.21.15.17:0/1535999357 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3b1c004ac0 con 0x7f3b28103470 2024-09-20T19:12:04.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.254+0000 7f3b24ff9640 1 -- 172.21.15.17:0/1535999357 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b1c035030 con 0x7f3b28103470 2024-09-20T19:12:04.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.254+0000 7f3b2e0c2640 1 -- 172.21.15.17:0/1535999357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b28197a20 con 0x7f3b28103470 2024-09-20T19:12:04.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.254+0000 7f3b2e0c2640 1 -- 172.21.15.17:0/1535999357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b28197f50 con 0x7f3b28103470 2024-09-20T19:12:04.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.255+0000 7f3b2e0c2640 1 -- 172.21.15.17:0/1535999357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b2806a4e0 con 0x7f3b28103470 2024-09-20T19:12:04.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.255+0000 7f3b24ff9640 1 -- 172.21.15.17:0/1535999357 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3b1c042070 con 0x7f3b28103470 2024-09-20T19:12:04.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.256+0000 7f3b24ff9640 1 --2- 172.21.15.17:0/1535999357 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3b1007af80 0x7f3b1007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:04.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.256+0000 7f3b24ff9640 1 -- 172.21.15.17:0/1535999357 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f3b1c0be7b0 con 0x7f3b28103470 2024-09-20T19:12:04.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.256+0000 7f3b277fe640 1 --2- 172.21.15.17:0/1535999357 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3b1007af80 0x7f3b1007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:04.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.256+0000 7f3b277fe640 1 --2- 172.21.15.17:0/1535999357 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3b1007af80 0x7f3b1007d440 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3b18009bd0 tx=0x7f3b18005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:04.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.260+0000 7f3b24ff9640 1 -- 172.21.15.17:0/1535999357 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b1c089e30 con 0x7f3b28103470 2024-09-20T19:12:04.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.464+0000 7f3b2e0c2640 1 -- 172.21.15.17:0/1535999357 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3b28198200 con 0x7f3b1007af80 2024-09-20T19:12:04.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.465+0000 7f3b24ff9640 1 -- 172.21.15.17:0/1535999357 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3b28198200 con 0x7f3b1007af80 2024-09-20T19:12:04.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.467+0000 7f3b2e0c2640 1 -- 172.21.15.17:0/1535999357 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3b1007af80 msgr2=0x7f3b1007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:04.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.467+0000 7f3b2e0c2640 1 --2- 172.21.15.17:0/1535999357 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3b1007af80 0x7f3b1007d440 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3b18009bd0 tx=0x7f3b18005f90 comp rx=0 tx=0).stop 2024-09-20T19:12:04.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.467+0000 7f3b2e0c2640 1 -- 172.21.15.17:0/1535999357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b28103470 msgr2=0x7f3b2819db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:04.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.467+0000 7f3b2e0c2640 1 --2- 172.21.15.17:0/1535999357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b28103470 0x7f3b2819db50 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c004f90 tx=0x7f3b1c0046c0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.467+0000 7f3b2e0c2640 1 -- 172.21.15.17:0/1535999357 shutdown_connections 2024-09-20T19:12:04.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.467+0000 7f3b2e0c2640 1 --2- 172.21.15.17:0/1535999357 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3b1007af80 0x7f3b1007d440 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.467+0000 7f3b2e0c2640 1 --2- 172.21.15.17:0/1535999357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b28103470 0x7f3b2819db50 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.467+0000 7f3b2e0c2640 1 --2- 172.21.15.17:0/1535999357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b28102b50 0x7f3b2819d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.467+0000 7f3b2e0c2640 1 -- 172.21.15.17:0/1535999357 >> 172.21.15.17:0/1535999357 conn(0x7f3b280fc550 msgr2=0x7f3b28108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:04.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.468+0000 7f3b2e0c2640 1 -- 172.21.15.17:0/1535999357 shutdown_connections 2024-09-20T19:12:04.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.468+0000 7f3b2e0c2640 1 -- 172.21.15.17:0/1535999357 wait complete. 2024-09-20T19:12:04.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.552+0000 7f7eab57c640 1 -- 172.21.15.17:0/1062050501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ea4102b10 msgr2=0x7f7ea4102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:04.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.552+0000 7f7eab57c640 1 --2- 172.21.15.17:0/1062050501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ea4102b10 0x7f7ea4102ef0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f7ea00098b0 tx=0x7f7ea002a560 comp rx=0 tx=0).stop 2024-09-20T19:12:04.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.552+0000 7f7eab57c640 1 -- 172.21.15.17:0/1062050501 shutdown_connections 2024-09-20T19:12:04.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.552+0000 7f7eab57c640 1 --2- 172.21.15.17:0/1062050501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ea4103430 0x7f7ea410b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.552+0000 7f7eab57c640 1 --2- 172.21.15.17:0/1062050501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ea4102b10 0x7f7ea4102ef0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.552+0000 7f7eab57c640 1 -- 172.21.15.17:0/1062050501 >> 172.21.15.17:0/1062050501 conn(0x7f7ea40fc510 msgr2=0x7f7ea40fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.552+0000 7f7eab57c640 1 -- 172.21.15.17:0/1062050501 shutdown_connections 2024-09-20T19:12:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.552+0000 7f7eab57c640 1 -- 172.21.15.17:0/1062050501 wait complete. 2024-09-20T19:12:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.552+0000 7f7eab57c640 1 Processor -- start 2024-09-20T19:12:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.552+0000 7f7eab57c640 1 -- start start 2024-09-20T19:12:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.553+0000 7f7eab57c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ea4102b10 0x7f7ea419d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.553+0000 7f7eab57c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ea4103430 0x7f7ea419dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.553+0000 7f7eab57c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea410ee00 con 0x7f7ea4102b10 2024-09-20T19:12:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.553+0000 7f7eab57c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea410ec80 con 0x7f7ea4103430 2024-09-20T19:12:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.553+0000 7f7ea9318640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ea4102b10 0x7f7ea419d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.553+0000 7f7ea9318640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ea4102b10 0x7f7ea419d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45866/0 (socket says 172.21.15.17:45866) 2024-09-20T19:12:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.553+0000 7f7ea9318640 1 -- 172.21.15.17:0/3139340912 learned_addr learned my addr 172.21.15.17:0/3139340912 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:12:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.553+0000 7f7ea8b17640 1 --2- 172.21.15.17:0/3139340912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ea4103430 0x7f7ea419dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.553+0000 7f7ea9318640 1 -- 172.21.15.17:0/3139340912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ea4103430 msgr2=0x7f7ea419dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:04.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.553+0000 7f7ea9318640 1 --2- 172.21.15.17:0/3139340912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ea4103430 0x7f7ea419dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.553+0000 7f7ea9318640 1 -- 172.21.15.17:0/3139340912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea4197850 con 0x7f7ea4102b10 2024-09-20T19:12:04.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.553+0000 7f7ea9318640 1 --2- 172.21.15.17:0/3139340912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ea4102b10 0x7f7ea419d6d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0031460 tx=0x7f7ea00045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:04.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.554+0000 7f7e9a7fc640 1 -- 172.21.15.17:0/3139340912 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ea003f070 con 0x7f7ea4102b10 2024-09-20T19:12:04.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.554+0000 7f7e9a7fc640 1 -- 172.21.15.17:0/3139340912 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7ea00035f0 con 0x7f7ea4102b10 2024-09-20T19:12:04.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.554+0000 7f7eab57c640 1 -- 172.21.15.17:0/3139340912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea4197ae0 con 0x7f7ea4102b10 2024-09-20T19:12:04.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.554+0000 7f7e9a7fc640 1 -- 172.21.15.17:0/3139340912 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ea0035030 con 0x7f7ea4102b10 2024-09-20T19:12:04.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.554+0000 7f7eab57c640 1 -- 172.21.15.17:0/3139340912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea4198010 con 0x7f7ea4102b10 2024-09-20T19:12:04.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.555+0000 7f7eab57c640 1 -- 172.21.15.17:0/3139340912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ea406ad60 con 0x7f7ea4102b10 2024-09-20T19:12:04.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.555+0000 7f7e9a7fc640 1 -- 172.21.15.17:0/3139340912 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7ea0042070 con 0x7f7ea4102b10 2024-09-20T19:12:04.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.556+0000 7f7e9a7fc640 1 --2- 172.21.15.17:0/3139340912 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e9007af80 0x7f7e9007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:04.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.556+0000 7f7e9a7fc640 1 -- 172.21.15.17:0/3139340912 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f7ea00be810 con 0x7f7ea4102b10 2024-09-20T19:12:04.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.556+0000 7f7ea8b17640 1 --2- 172.21.15.17:0/3139340912 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e9007af80 0x7f7e9007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:04.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.557+0000 7f7ea8b17640 1 --2- 172.21.15.17:0/3139340912 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e9007af80 0x7f7e9007d440 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7ea41088e0 tx=0x7f7e9400b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:04.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.561+0000 7f7e9a7fc640 1 -- 172.21.15.17:0/3139340912 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7ea0089e90 con 0x7f7ea4102b10 2024-09-20T19:12:04.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.764+0000 7f7eab57c640 1 -- 172.21.15.17:0/3139340912 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7ea4198380 con 0x7f7e9007af80 2024-09-20T19:12:04.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.773+0000 7f7e9a7fc640 1 -- 172.21.15.17:0/3139340912 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f7ea4198380 con 0x7f7e9007af80 2024-09-20T19:12:04.778 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:12:04.778 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (33m) 12m ago 44m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:12:04.778 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (36m) 12m ago 44m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:12:04.778 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (36m) 12m ago 43m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:12:04.778 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (31m) 12m ago 44m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:12:04.778 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (31m) 12m ago 43m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:12:04.778 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (33m) 12m ago 44m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:12:04.778 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (28m) 12m ago 39m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:12:04.778 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (27m) 12m ago 39m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:12:04.779 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (12m) 12m ago 39m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:12:04.779 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (27m) 12m ago 39m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:12:04.779 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (35m) 12m ago 45m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:12:04.779 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (34m) 12m ago 43m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:12:04.779 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (32m) 12m ago 45m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:12:04.779 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (31m) 12m ago 43m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:12:04.779 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (34m) 12m ago 44m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:12:04.779 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (34m) 12m ago 43m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:12:04.779 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (31m) 12m ago 42m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:12:04.779 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (30m) 12m ago 41m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:12:04.779 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (30m) 12m ago 41m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:12:04.779 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (29m) 12m ago 41m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:12:04.779 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (28m) 12m ago 40m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:12:04.779 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (28m) 12m ago 40m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:12:04.780 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (33m) 12m ago 44m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:12:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.775+0000 7f7eab57c640 1 -- 172.21.15.17:0/3139340912 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e9007af80 msgr2=0x7f7e9007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.775+0000 7f7eab57c640 1 --2- 172.21.15.17:0/3139340912 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e9007af80 0x7f7e9007d440 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7ea41088e0 tx=0x7f7e9400b390 comp rx=0 tx=0).stop 2024-09-20T19:12:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.775+0000 7f7eab57c640 1 -- 172.21.15.17:0/3139340912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ea4102b10 msgr2=0x7f7ea419d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.775+0000 7f7eab57c640 1 --2- 172.21.15.17:0/3139340912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ea4102b10 0x7f7ea419d6d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0031460 tx=0x7f7ea00045c0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.775+0000 7f7eab57c640 1 -- 172.21.15.17:0/3139340912 shutdown_connections 2024-09-20T19:12:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.775+0000 7f7eab57c640 1 --2- 172.21.15.17:0/3139340912 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e9007af80 0x7f7e9007d440 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.775+0000 7f7eab57c640 1 --2- 172.21.15.17:0/3139340912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ea4103430 0x7f7ea419dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.775+0000 7f7eab57c640 1 --2- 172.21.15.17:0/3139340912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ea4102b10 0x7f7ea419d6d0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.775+0000 7f7eab57c640 1 -- 172.21.15.17:0/3139340912 >> 172.21.15.17:0/3139340912 conn(0x7f7ea40fc510 msgr2=0x7f7ea4108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.776+0000 7f7eab57c640 1 -- 172.21.15.17:0/3139340912 shutdown_connections 2024-09-20T19:12:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.776+0000 7f7eab57c640 1 -- 172.21.15.17:0/3139340912 wait complete. 2024-09-20T19:12:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.859+0000 7f8dd1840640 1 -- 172.21.15.17:0/1150736452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc1067f0 msgr2=0x7f8dcc106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.859+0000 7f8dd1840640 1 --2- 172.21.15.17:0/1150736452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc1067f0 0x7f8dcc106bd0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009880 tx=0x7f8dbc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.859+0000 7f8dd1840640 1 -- 172.21.15.17:0/1150736452 shutdown_connections 2024-09-20T19:12:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.859+0000 7f8dd1840640 1 --2- 172.21.15.17:0/1150736452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dcc1007f0 0x7f8dcc100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.859+0000 7f8dd1840640 1 --2- 172.21.15.17:0/1150736452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc1067f0 0x7f8dcc106bd0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.859+0000 7f8dd1840640 1 -- 172.21.15.17:0/1150736452 >> 172.21.15.17:0/1150736452 conn(0x7f8dcc0fc550 msgr2=0x7f8dcc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:04.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.859+0000 7f8dd1840640 1 -- 172.21.15.17:0/1150736452 shutdown_connections 2024-09-20T19:12:04.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.859+0000 7f8dd1840640 1 -- 172.21.15.17:0/1150736452 wait complete. 2024-09-20T19:12:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.859+0000 7f8dd1840640 1 Processor -- start 2024-09-20T19:12:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.860+0000 7f8dd1840640 1 -- start start 2024-09-20T19:12:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.860+0000 7f8dd1840640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dcc1007f0 0x7f8dcc198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.860+0000 7f8dd1840640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc1067f0 0x7f8dcc198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.860+0000 7f8dd1840640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8dcc10dcc0 con 0x7f8dcc1067f0 2024-09-20T19:12:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.860+0000 7f8dd1840640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8dcc10db40 con 0x7f8dcc1007f0 2024-09-20T19:12:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.860+0000 7f8dca7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc1067f0 0x7f8dcc198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.860+0000 7f8dca7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc1067f0 0x7f8dcc198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45878/0 (socket says 172.21.15.17:45878) 2024-09-20T19:12:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.860+0000 7f8dca7fc640 1 -- 172.21.15.17:0/1759699796 learned_addr learned my addr 172.21.15.17:0/1759699796 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:12:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.860+0000 7f8dca7fc640 1 -- 172.21.15.17:0/1759699796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dcc1007f0 msgr2=0x7f8dcc198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.860+0000 7f8dca7fc640 1 --2- 172.21.15.17:0/1759699796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dcc1007f0 0x7f8dcc198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.860+0000 7f8dca7fc640 1 -- 172.21.15.17:0/1759699796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dcc199350 con 0x7f8dcc1067f0 2024-09-20T19:12:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.861+0000 7f8dca7fc640 1 --2- 172.21.15.17:0/1759699796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc1067f0 0x7f8dcc198d50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000e970 tx=0x7f8dc000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.861+0000 7f8dd083e640 1 -- 172.21.15.17:0/1759699796 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8dc000cac0 con 0x7f8dcc1067f0 2024-09-20T19:12:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.861+0000 7f8dd083e640 1 -- 172.21.15.17:0/1759699796 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8dc00054e0 con 0x7f8dcc1067f0 2024-09-20T19:12:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.861+0000 7f8dd1840640 1 -- 172.21.15.17:0/1759699796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dcc199640 con 0x7f8dcc1067f0 2024-09-20T19:12:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.861+0000 7f8dd083e640 1 -- 172.21.15.17:0/1759699796 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8dc0010430 con 0x7f8dcc1067f0 2024-09-20T19:12:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.861+0000 7f8dd1840640 1 -- 172.21.15.17:0/1759699796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dcc1a1c40 con 0x7f8dcc1067f0 2024-09-20T19:12:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.862+0000 7f8dd1840640 1 -- 172.21.15.17:0/1759699796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dcc101f30 con 0x7f8dcc1067f0 2024-09-20T19:12:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.863+0000 7f8dd083e640 1 -- 172.21.15.17:0/1759699796 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8dc0004ea0 con 0x7f8dcc1067f0 2024-09-20T19:12:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.863+0000 7f8dd083e640 1 --2- 172.21.15.17:0/1759699796 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8db407af40 0x7f8db407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.863+0000 7f8dd083e640 1 -- 172.21.15.17:0/1759699796 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f8dc009e780 con 0x7f8dcc1067f0 2024-09-20T19:12:04.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.863+0000 7f8dcaffd640 1 --2- 172.21.15.17:0/1759699796 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8db407af40 0x7f8db407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:04.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.864+0000 7f8dcaffd640 1 --2- 172.21.15.17:0/1759699796 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8db407af40 0x7f8db407d400 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0096c0 tx=0x7f8dbc000bc0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:04.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:04.868+0000 7f8dd083e640 1 -- 172.21.15.17:0/1759699796 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8dcc199640 con 0x7f8dcc1067f0 2024-09-20T19:12:05.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.130+0000 7f8dd1840640 1 -- 172.21.15.17:0/1759699796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8dcc108d60 con 0x7f8dcc1067f0 2024-09-20T19:12:05.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.131+0000 7f8dd083e640 1 -- 172.21.15.17:0/1759699796 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f8dc0069d80 con 0x7f8dcc1067f0 2024-09-20T19:12:05.133 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:12:05.133 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:12:05.134 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:12:05.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:12:05.134 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:12:05.134 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:12:05.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:12:05.134 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:12:05.134 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:12:05.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:12:05.134 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:12:05.134 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:12:05.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:12:05.134 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:12:05.134 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:12:05.135 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:12:05.135 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:12:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.133+0000 7f8dd1840640 1 -- 172.21.15.17:0/1759699796 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8db407af40 msgr2=0x7f8db407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.133+0000 7f8dd1840640 1 --2- 172.21.15.17:0/1759699796 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8db407af40 0x7f8db407d400 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0096c0 tx=0x7f8dbc000bc0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.133+0000 7f8dd1840640 1 -- 172.21.15.17:0/1759699796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc1067f0 msgr2=0x7f8dcc198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.133+0000 7f8dd1840640 1 --2- 172.21.15.17:0/1759699796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc1067f0 0x7f8dcc198d50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000e970 tx=0x7f8dc000ed70 comp rx=0 tx=0).stop 2024-09-20T19:12:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.133+0000 7f8dd1840640 1 -- 172.21.15.17:0/1759699796 shutdown_connections 2024-09-20T19:12:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.133+0000 7f8dd1840640 1 --2- 172.21.15.17:0/1759699796 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8db407af40 0x7f8db407d400 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.133+0000 7f8dd1840640 1 --2- 172.21.15.17:0/1759699796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dcc1067f0 0x7f8dcc198d50 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.133+0000 7f8dd1840640 1 --2- 172.21.15.17:0/1759699796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dcc1007f0 0x7f8dcc198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.133+0000 7f8dd1840640 1 -- 172.21.15.17:0/1759699796 >> 172.21.15.17:0/1759699796 conn(0x7f8dcc0fc550 msgr2=0x7f8dcc0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.134+0000 7f8dd1840640 1 -- 172.21.15.17:0/1759699796 shutdown_connections 2024-09-20T19:12:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.134+0000 7f8dd1840640 1 -- 172.21.15.17:0/1759699796 wait complete. 2024-09-20T19:12:05.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.218+0000 7f74b97e8640 1 -- 172.21.15.17:0/811969065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4101900 msgr2=0x7f74b4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:05.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.218+0000 7f74b97e8640 1 --2- 172.21.15.17:0/811969065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4101900 0x7f74b4101d60 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009880 tx=0x7f74a802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.218+0000 7f74b97e8640 1 -- 172.21.15.17:0/811969065 shutdown_connections 2024-09-20T19:12:05.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.218+0000 7f74b97e8640 1 --2- 172.21.15.17:0/811969065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4101900 0x7f74b4101d60 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.218+0000 7f74b97e8640 1 --2- 172.21.15.17:0/811969065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74b4107900 0x7f74b4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.218+0000 7f74b97e8640 1 -- 172.21.15.17:0/811969065 >> 172.21.15.17:0/811969065 conn(0x7f74b40fd600 msgr2=0x7f74b40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:05.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.218+0000 7f74b97e8640 1 -- 172.21.15.17:0/811969065 shutdown_connections 2024-09-20T19:12:05.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.218+0000 7f74b97e8640 1 -- 172.21.15.17:0/811969065 wait complete. 2024-09-20T19:12:05.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.219+0000 7f74b97e8640 1 Processor -- start 2024-09-20T19:12:05.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.219+0000 7f74b97e8640 1 -- start start 2024-09-20T19:12:05.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.219+0000 7f74b97e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4101900 0x7f74b419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:05.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.219+0000 7f74b97e8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74b4107900 0x7f74b419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:05.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.219+0000 7f74b97e8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f74b410edd0 con 0x7f74b4101900 2024-09-20T19:12:05.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.219+0000 7f74b97e8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f74b410ec50 con 0x7f74b4107900 2024-09-20T19:12:05.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.219+0000 7f74b2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4101900 0x7f74b419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:05.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.219+0000 7f74b2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4101900 0x7f74b419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45906/0 (socket says 172.21.15.17:45906) 2024-09-20T19:12:05.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.219+0000 7f74b2ffd640 1 -- 172.21.15.17:0/3661264013 learned_addr learned my addr 172.21.15.17:0/3661264013 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:12:05.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.220+0000 7f74b27fc640 1 --2- 172.21.15.17:0/3661264013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74b4107900 0x7f74b419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:05.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.220+0000 7f74b2ffd640 1 -- 172.21.15.17:0/3661264013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74b4107900 msgr2=0x7f74b419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:05.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.220+0000 7f74b2ffd640 1 --2- 172.21.15.17:0/3661264013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74b4107900 0x7f74b419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.220+0000 7f74b2ffd640 1 -- 172.21.15.17:0/3661264013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b4197800 con 0x7f74b4101900 2024-09-20T19:12:05.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.220+0000 7f74b2ffd640 1 --2- 172.21.15.17:0/3661264013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4101900 0x7f74b419d680 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f74a400d6f0 tx=0x7f74a400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:05.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.220+0000 7f749bfff640 1 -- 172.21.15.17:0/3661264013 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f74a4017070 con 0x7f74b4101900 2024-09-20T19:12:05.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.220+0000 7f749bfff640 1 -- 172.21.15.17:0/3661264013 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f74a400de00 con 0x7f74b4101900 2024-09-20T19:12:05.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.220+0000 7f74b97e8640 1 -- 172.21.15.17:0/3661264013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b4197af0 con 0x7f74b4101900 2024-09-20T19:12:05.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.220+0000 7f749bfff640 1 -- 172.21.15.17:0/3661264013 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f74a4004bb0 con 0x7f74b4101900 2024-09-20T19:12:05.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.220+0000 7f74b97e8640 1 -- 172.21.15.17:0/3661264013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b4198050 con 0x7f74b4101900 2024-09-20T19:12:05.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.221+0000 7f74b97e8640 1 -- 172.21.15.17:0/3661264013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b4103040 con 0x7f74b4101900 2024-09-20T19:12:05.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.222+0000 7f749bfff640 1 -- 172.21.15.17:0/3661264013 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f74a4009a30 con 0x7f74b4101900 2024-09-20T19:12:05.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.223+0000 7f749bfff640 1 --2- 172.21.15.17:0/3661264013 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f749c07af80 0x7f749c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:05.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.223+0000 7f749bfff640 1 -- 172.21.15.17:0/3661264013 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f74a409db60 con 0x7f74b4101900 2024-09-20T19:12:05.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.223+0000 7f74b27fc640 1 --2- 172.21.15.17:0/3661264013 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f749c07af80 0x7f749c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:05.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.223+0000 7f74b27fc640 1 --2- 172.21.15.17:0/3661264013 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f749c07af80 0x7f749c07d440 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f74b4198b50 tx=0x7f74a8031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:05.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.227+0000 7f749bfff640 1 -- 172.21.15.17:0/3661264013 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f74a4069140 con 0x7f74b4101900 2024-09-20T19:12:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.454+0000 7f74b97e8640 1 -- 172.21.15.17:0/3661264013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f74b4109e70 con 0x7f74b4101900 2024-09-20T19:12:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.454+0000 7f749bfff640 1 -- 172.21.15.17:0/3661264013 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7f74a406dff0 con 0x7f74b4101900 2024-09-20T19:12:05.457 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:12:05.457 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:12:05.457 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:12:05.457 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:12:05.457 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:12:05.457 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:12:05.457 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:12:05.457 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:12:05.457 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:12:05.457 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:12:05.458 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:12:05.458 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:12:05.458 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:12:05.458 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:12:05.458 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:12:05.458 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:12:05.458 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:12:05.458 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:12:05.458 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:12:05.458 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:12:05.458 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:12:05.458 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:12:05.458 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:12:05.458 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:12:05.459 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:12:05.459 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:12:05.459 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:12:05.459 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:12:05.459 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:12:05.459 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:12:05.459 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:12:05.459 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:12:05.459 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:12:05.459 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:12:05.459 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:12:05.459 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:12:05.459 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:12:05.459 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:12:05.459 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:12:05.460 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:12:05.460 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:12:05.460 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:12:05.460 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:12:05.460 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:12:05.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.457+0000 7f74b97e8640 1 -- 172.21.15.17:0/3661264013 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f749c07af80 msgr2=0x7f749c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:05.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.457+0000 7f74b97e8640 1 --2- 172.21.15.17:0/3661264013 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f749c07af80 0x7f749c07d440 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f74b4198b50 tx=0x7f74a8031400 comp rx=0 tx=0).stop 2024-09-20T19:12:05.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.457+0000 7f74b97e8640 1 -- 172.21.15.17:0/3661264013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4101900 msgr2=0x7f74b419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:05.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.457+0000 7f74b97e8640 1 --2- 172.21.15.17:0/3661264013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4101900 0x7f74b419d680 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f74a400d6f0 tx=0x7f74a400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.457+0000 7f74b97e8640 1 -- 172.21.15.17:0/3661264013 shutdown_connections 2024-09-20T19:12:05.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.457+0000 7f74b97e8640 1 --2- 172.21.15.17:0/3661264013 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f749c07af80 0x7f749c07d440 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.457+0000 7f74b97e8640 1 --2- 172.21.15.17:0/3661264013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74b4107900 0x7f74b419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.457+0000 7f74b97e8640 1 --2- 172.21.15.17:0/3661264013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4101900 0x7f74b419d680 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.457+0000 7f74b97e8640 1 -- 172.21.15.17:0/3661264013 >> 172.21.15.17:0/3661264013 conn(0x7f74b40fd600 msgr2=0x7f74b40fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:05.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.457+0000 7f74b97e8640 1 -- 172.21.15.17:0/3661264013 shutdown_connections 2024-09-20T19:12:05.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.457+0000 7f74b97e8640 1 -- 172.21.15.17:0/3661264013 wait complete. 2024-09-20T19:12:05.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.542+0000 7fac79f24640 1 -- 172.21.15.17:0/367073777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac741007f0 msgr2=0x7fac74100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:05.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.542+0000 7fac79f24640 1 --2- 172.21.15.17:0/367073777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac741007f0 0x7fac74100c50 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fac68009880 tx=0x7fac6802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.542+0000 7fac79f24640 1 -- 172.21.15.17:0/367073777 shutdown_connections 2024-09-20T19:12:05.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.542+0000 7fac79f24640 1 --2- 172.21.15.17:0/367073777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac741007f0 0x7fac74100c50 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.542+0000 7fac79f24640 1 --2- 172.21.15.17:0/367073777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac741067f0 0x7fac74106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.542+0000 7fac79f24640 1 -- 172.21.15.17:0/367073777 >> 172.21.15.17:0/367073777 conn(0x7fac740fc550 msgr2=0x7fac740fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:05.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.542+0000 7fac79f24640 1 -- 172.21.15.17:0/367073777 shutdown_connections 2024-09-20T19:12:05.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.542+0000 7fac79f24640 1 -- 172.21.15.17:0/367073777 wait complete. 2024-09-20T19:12:05.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.542+0000 7fac79f24640 1 Processor -- start 2024-09-20T19:12:05.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.543+0000 7fac79f24640 1 -- start start 2024-09-20T19:12:05.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.543+0000 7fac79f24640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac741007f0 0x7fac7419c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:05.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.543+0000 7fac79f24640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac741067f0 0x7fac7419cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:05.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.543+0000 7fac79f24640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fac7410dcc0 con 0x7fac741067f0 2024-09-20T19:12:05.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.543+0000 7fac79f24640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fac7410db40 con 0x7fac741007f0 2024-09-20T19:12:05.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.543+0000 7fac72ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac741067f0 0x7fac7419cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:05.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.543+0000 7fac72ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac741067f0 0x7fac7419cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45914/0 (socket says 172.21.15.17:45914) 2024-09-20T19:12:05.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.543+0000 7fac72ffd640 1 -- 172.21.15.17:0/71309757 learned_addr learned my addr 172.21.15.17:0/71309757 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:12:05.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.543+0000 7fac737fe640 1 --2- 172.21.15.17:0/71309757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac741007f0 0x7fac7419c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:05.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.543+0000 7fac72ffd640 1 -- 172.21.15.17:0/71309757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac741007f0 msgr2=0x7fac7419c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:05.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.543+0000 7fac72ffd640 1 --2- 172.21.15.17:0/71309757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac741007f0 0x7fac7419c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.543+0000 7fac72ffd640 1 -- 172.21.15.17:0/71309757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac741966b0 con 0x7fac741067f0 2024-09-20T19:12:05.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.543+0000 7fac737fe640 1 --2- 172.21.15.17:0/71309757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac741007f0 0x7fac7419c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:12:05.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.544+0000 7fac72ffd640 1 --2- 172.21.15.17:0/71309757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac741067f0 0x7fac7419cb20 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fac68031460 tx=0x7fac680048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:05.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.544+0000 7fac70ff9640 1 -- 172.21.15.17:0/71309757 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac6803f070 con 0x7fac741067f0 2024-09-20T19:12:05.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.544+0000 7fac79f24640 1 -- 172.21.15.17:0/71309757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac74196940 con 0x7fac741067f0 2024-09-20T19:12:05.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.544+0000 7fac70ff9640 1 -- 172.21.15.17:0/71309757 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fac68004cf0 con 0x7fac741067f0 2024-09-20T19:12:05.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.544+0000 7fac70ff9640 1 -- 172.21.15.17:0/71309757 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac68035030 con 0x7fac741067f0 2024-09-20T19:12:05.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.544+0000 7fac79f24640 1 -- 172.21.15.17:0/71309757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac74196e40 con 0x7fac741067f0 2024-09-20T19:12:05.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.545+0000 7fac79f24640 1 -- 172.21.15.17:0/71309757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac74101f30 con 0x7fac741067f0 2024-09-20T19:12:05.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.546+0000 7fac70ff9640 1 -- 172.21.15.17:0/71309757 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fac68042070 con 0x7fac741067f0 2024-09-20T19:12:05.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.546+0000 7fac70ff9640 1 --2- 172.21.15.17:0/71309757 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac5c07af30 0x7fac5c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:05.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.546+0000 7fac70ff9640 1 -- 172.21.15.17:0/71309757 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fac680beac0 con 0x7fac741067f0 2024-09-20T19:12:05.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.546+0000 7fac737fe640 1 --2- 172.21.15.17:0/71309757 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac5c07af30 0x7fac5c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:05.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.547+0000 7fac737fe640 1 --2- 172.21.15.17:0/71309757 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac5c07af30 0x7fac5c07d3f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fac640058c0 tx=0x7fac64005d30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:05.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.551+0000 7fac70ff9640 1 -- 172.21.15.17:0/71309757 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fac6808a0c0 con 0x7fac741067f0 2024-09-20T19:12:05.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.755+0000 7fac79f24640 1 -- 172.21.15.17:0/71309757 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fac741971b0 con 0x7fac5c07af30 2024-09-20T19:12:05.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.756+0000 7fac70ff9640 1 -- 172.21.15.17:0/71309757 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fac741971b0 con 0x7fac5c07af30 2024-09-20T19:12:05.759 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:12:05.759 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:12:05.759 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:12:05.759 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:12:05.759 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:12:05.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:12:05.759 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:12:05.759 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:12:05.759 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:12:05.759 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:12:05.760 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:12:05.760 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:12:05.760 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:12:05.760 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:12:05.760 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:12:05.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.758+0000 7fac79f24640 1 -- 172.21.15.17:0/71309757 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac5c07af30 msgr2=0x7fac5c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:05.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.758+0000 7fac79f24640 1 --2- 172.21.15.17:0/71309757 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac5c07af30 0x7fac5c07d3f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fac640058c0 tx=0x7fac64005d30 comp rx=0 tx=0).stop 2024-09-20T19:12:05.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.758+0000 7fac79f24640 1 -- 172.21.15.17:0/71309757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac741067f0 msgr2=0x7fac7419cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:05.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.758+0000 7fac79f24640 1 --2- 172.21.15.17:0/71309757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac741067f0 0x7fac7419cb20 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fac68031460 tx=0x7fac680048f0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.758+0000 7fac79f24640 1 -- 172.21.15.17:0/71309757 shutdown_connections 2024-09-20T19:12:05.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.758+0000 7fac79f24640 1 --2- 172.21.15.17:0/71309757 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fac5c07af30 0x7fac5c07d3f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.758+0000 7fac79f24640 1 --2- 172.21.15.17:0/71309757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac741067f0 0x7fac7419cb20 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.758+0000 7fac79f24640 1 --2- 172.21.15.17:0/71309757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac741007f0 0x7fac7419c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.758+0000 7fac79f24640 1 -- 172.21.15.17:0/71309757 >> 172.21.15.17:0/71309757 conn(0x7fac740fc550 msgr2=0x7fac740fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:05.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.759+0000 7fac79f24640 1 -- 172.21.15.17:0/71309757 shutdown_connections 2024-09-20T19:12:05.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.759+0000 7fac79f24640 1 -- 172.21.15.17:0/71309757 wait complete. 2024-09-20T19:12:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.843+0000 7f01125a0640 1 -- 172.21.15.17:0/500778187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c101750 msgr2=0x7f010c101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.843+0000 7f01125a0640 1 --2- 172.21.15.17:0/500778187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c101750 0x7f010c101bb0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f00fc009880 tx=0x7f00fc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.843+0000 7f01125a0640 1 -- 172.21.15.17:0/500778187 shutdown_connections 2024-09-20T19:12:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.843+0000 7f01125a0640 1 --2- 172.21.15.17:0/500778187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c101750 0x7f010c101bb0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.843+0000 7f01125a0640 1 --2- 172.21.15.17:0/500778187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f010c107750 0x7f010c107b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.843+0000 7f01125a0640 1 -- 172.21.15.17:0/500778187 >> 172.21.15.17:0/500778187 conn(0x7f010c0fd470 msgr2=0x7f010c0ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.843+0000 7f01125a0640 1 -- 172.21.15.17:0/500778187 shutdown_connections 2024-09-20T19:12:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.843+0000 7f01125a0640 1 -- 172.21.15.17:0/500778187 wait complete. 2024-09-20T19:12:05.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.844+0000 7f01125a0640 1 Processor -- start 2024-09-20T19:12:05.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.844+0000 7f01125a0640 1 -- start start 2024-09-20T19:12:05.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.844+0000 7f01125a0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f010c101750 0x7f010c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:05.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.844+0000 7f01125a0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c107750 0x7f010c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:05.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.844+0000 7f01125a0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f010c10ec00 con 0x7f010c107750 2024-09-20T19:12:05.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.844+0000 7f01125a0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f010c10ea80 con 0x7f010c101750 2024-09-20T19:12:05.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.844+0000 7f0110d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c107750 0x7f010c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:05.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.844+0000 7f0110d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c107750 0x7f010c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45934/0 (socket says 172.21.15.17:45934) 2024-09-20T19:12:05.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.844+0000 7f0110d9d640 1 -- 172.21.15.17:0/3775072443 learned_addr learned my addr 172.21.15.17:0/3775072443 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:12:05.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.844+0000 7f011159e640 1 --2- 172.21.15.17:0/3775072443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f010c101750 0x7f010c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:05.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.845+0000 7f0110d9d640 1 -- 172.21.15.17:0/3775072443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f010c101750 msgr2=0x7f010c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:05.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.845+0000 7f0110d9d640 1 --2- 172.21.15.17:0/3775072443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f010c101750 0x7f010c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:05.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.845+0000 7f0110d9d640 1 -- 172.21.15.17:0/3775072443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010c074f70 con 0x7f010c107750 2024-09-20T19:12:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.845+0000 7f0110d9d640 1 --2- 172.21.15.17:0/3775072443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c107750 0x7f010c074a30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f00fc031460 tx=0x7f00fc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.845+0000 7f01027fc640 1 -- 172.21.15.17:0/3775072443 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f00fc03f070 con 0x7f010c107750 2024-09-20T19:12:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.845+0000 7f01027fc640 1 -- 172.21.15.17:0/3775072443 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f00fc004cf0 con 0x7f010c107750 2024-09-20T19:12:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.845+0000 7f01125a0640 1 -- 172.21.15.17:0/3775072443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f010c075200 con 0x7f010c107750 2024-09-20T19:12:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.845+0000 7f01027fc640 1 -- 172.21.15.17:0/3775072443 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f00fc035030 con 0x7f010c107750 2024-09-20T19:12:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.845+0000 7f01125a0640 1 -- 172.21.15.17:0/3775072443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f010c1a3b90 con 0x7f010c107750 2024-09-20T19:12:05.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.846+0000 7f01125a0640 1 -- 172.21.15.17:0/3775072443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f010c102e90 con 0x7f010c107750 2024-09-20T19:12:05.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.847+0000 7f01027fc640 1 -- 172.21.15.17:0/3775072443 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f00fc042070 con 0x7f010c107750 2024-09-20T19:12:05.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.847+0000 7f01027fc640 1 --2- 172.21.15.17:0/3775072443 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f00f807af30 0x7f00f807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:05.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.847+0000 7f01027fc640 1 -- 172.21.15.17:0/3775072443 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f00fc0beac0 con 0x7f010c107750 2024-09-20T19:12:05.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.847+0000 7f011159e640 1 --2- 172.21.15.17:0/3775072443 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f00f807af30 0x7f00f807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:05.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.848+0000 7f011159e640 1 --2- 172.21.15.17:0/3775072443 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f00f807af30 0x7f00f807d3f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f01080058c0 tx=0x7f010800a4c0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:05.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:05.852+0000 7f01027fc640 1 -- 172.21.15.17:0/3775072443 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f00fc08a0c0 con 0x7f010c107750 2024-09-20T19:12:06.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:06.114+0000 7f01125a0640 1 -- 172.21.15.17:0/3775072443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f010c02d7c0 con 0x7f010c107750 2024-09-20T19:12:06.117 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:05 smithi017 ceph-mon[108970]: from='client.35800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:06.117 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:05 smithi017 ceph-mon[108970]: from='client.35804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:06.117 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:05 smithi017 ceph-mon[108970]: from='client.35808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:06.117 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:05 smithi017 ceph-mon[108970]: pgmap v1101: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:06.117 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:05 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1759699796' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:12:06.117 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:05 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3661264013' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:12:06.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:06.115+0000 7f01027fc640 1 -- 172.21.15.17:0/3775072443 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f00fc08ef70 con 0x7f010c107750 2024-09-20T19:12:06.118 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:12:06.118 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:12:06.118 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:12:06.118 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:12:06.118 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:12:06.118 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:12:06.118 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:12:06.118 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:12:06.118 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:12:06.118 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:12:06.118 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:12:06.118 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:12:06.119 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:12:06.119 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:12:06.119 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:12:06.119 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:12:06.119 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:12:06.119 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:12:06.119 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:12:06.119 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:12:06.119 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:12:06.119 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:12:06.119 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:12:06.119 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:12:06.120 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:12:06.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:06.118+0000 7f01125a0640 1 -- 172.21.15.17:0/3775072443 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f00f807af30 msgr2=0x7f00f807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:06.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:06.118+0000 7f01125a0640 1 --2- 172.21.15.17:0/3775072443 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f00f807af30 0x7f00f807d3f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f01080058c0 tx=0x7f010800a4c0 comp rx=0 tx=0).stop 2024-09-20T19:12:06.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:06.118+0000 7f01125a0640 1 -- 172.21.15.17:0/3775072443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c107750 msgr2=0x7f010c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:06.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:06.118+0000 7f01125a0640 1 --2- 172.21.15.17:0/3775072443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c107750 0x7f010c074a30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f00fc031460 tx=0x7f00fc0048f0 comp rx=0 tx=0).stop 2024-09-20T19:12:06.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:06.118+0000 7f01125a0640 1 -- 172.21.15.17:0/3775072443 shutdown_connections 2024-09-20T19:12:06.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:06.118+0000 7f01125a0640 1 --2- 172.21.15.17:0/3775072443 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f00f807af30 0x7f00f807d3f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:06.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:06.118+0000 7f01125a0640 1 --2- 172.21.15.17:0/3775072443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f010c107750 0x7f010c074a30 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:06.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:06.118+0000 7f01125a0640 1 --2- 172.21.15.17:0/3775072443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f010c101750 0x7f010c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:06.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:06.118+0000 7f01125a0640 1 -- 172.21.15.17:0/3775072443 >> 172.21.15.17:0/3775072443 conn(0x7f010c0fd470 msgr2=0x7f010c0fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:06.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:06.118+0000 7f01125a0640 1 -- 172.21.15.17:0/3775072443 shutdown_connections 2024-09-20T19:12:06.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:06.118+0000 7f01125a0640 1 -- 172.21.15.17:0/3775072443 wait complete. 2024-09-20T19:12:06.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:05 smithi172 ceph-mon[80431]: from='client.35800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:06.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:05 smithi172 ceph-mon[80431]: from='client.35804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:06.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:05 smithi172 ceph-mon[80431]: from='client.35808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:06.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:05 smithi172 ceph-mon[80431]: pgmap v1101: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:06.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:05 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1759699796' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:12:06.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:05 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3661264013' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:12:07.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:06 smithi017 ceph-mon[108970]: from='client.35820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:07.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:06 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3775072443' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:12:07.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:06 smithi172 ceph-mon[80431]: from='client.35820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:07.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:06 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3775072443' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:12:08.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:07 smithi017 ceph-mon[108970]: pgmap v1102: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:08.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:12:08.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:07 smithi172 ceph-mon[80431]: pgmap v1102: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:08.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:12:10.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:09 smithi017 ceph-mon[108970]: pgmap v1103: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:10.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:09 smithi172 ceph-mon[80431]: pgmap v1103: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:12.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:11 smithi172 ceph-mon[80431]: pgmap v1104: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:12.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:11 smithi017 ceph-mon[108970]: pgmap v1104: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:14.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:13 smithi172 ceph-mon[80431]: pgmap v1105: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:14.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:13 smithi017 ceph-mon[108970]: pgmap v1105: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:16.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:15 smithi172 ceph-mon[80431]: pgmap v1106: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:16.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:15 smithi017 ceph-mon[108970]: pgmap v1106: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:18.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:17 smithi172 ceph-mon[80431]: pgmap v1107: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:18.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:17 smithi017 ceph-mon[108970]: pgmap v1107: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:20.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:19 smithi172 ceph-mon[80431]: pgmap v1108: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:20.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:19 smithi017 ceph-mon[108970]: pgmap v1108: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:21.947 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:21 smithi172 ceph-mon[80431]: pgmap v1109: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:22.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:21 smithi017 ceph-mon[108970]: pgmap v1109: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:23.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:12:23.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:12:24.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:23 smithi172 ceph-mon[80431]: pgmap v1110: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:24.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:23 smithi017 ceph-mon[108970]: pgmap v1110: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:26.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:25 smithi172 ceph-mon[80431]: pgmap v1111: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:26.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:25 smithi017 ceph-mon[108970]: pgmap v1111: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:28.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:27 smithi172 ceph-mon[80431]: pgmap v1112: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:28.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:27 smithi017 ceph-mon[108970]: pgmap v1112: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:30.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:29 smithi172 ceph-mon[80431]: pgmap v1113: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:30.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:29 smithi017 ceph-mon[108970]: pgmap v1113: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:32.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:31 smithi172 ceph-mon[80431]: pgmap v1114: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:32.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:31 smithi017 ceph-mon[108970]: pgmap v1114: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:34.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:33 smithi172 ceph-mon[80431]: pgmap v1115: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:34.198 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:33 smithi017 ceph-mon[108970]: pgmap v1115: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:36.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:35 smithi172 ceph-mon[80431]: pgmap v1116: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.215+0000 7f21b5520640 1 -- 172.21.15.17:0/1171489667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21b0100800 msgr2=0x7f21b0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.215+0000 7f21b5520640 1 --2- 172.21.15.17:0/1171489667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21b0100800 0x7f21b0100c60 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f21a4009880 tx=0x7f21a402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.215+0000 7f21b5520640 1 -- 172.21.15.17:0/1171489667 shutdown_connections 2024-09-20T19:12:36.219 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:35 smithi017 ceph-mon[108970]: pgmap v1116: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:36.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.215+0000 7f21b5520640 1 --2- 172.21.15.17:0/1171489667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21b0100800 0x7f21b0100c60 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.215+0000 7f21b5520640 1 --2- 172.21.15.17:0/1171489667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21b0106800 0x7f21b0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.215+0000 7f21b5520640 1 -- 172.21.15.17:0/1171489667 >> 172.21.15.17:0/1171489667 conn(0x7f21b00fc520 msgr2=0x7f21b00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.215+0000 7f21b5520640 1 -- 172.21.15.17:0/1171489667 shutdown_connections 2024-09-20T19:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.215+0000 7f21b5520640 1 -- 172.21.15.17:0/1171489667 wait complete. 2024-09-20T19:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.216+0000 7f21b5520640 1 Processor -- start 2024-09-20T19:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.216+0000 7f21b5520640 1 -- start start 2024-09-20T19:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.216+0000 7f21b5520640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21b0100800 0x7f21b019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.216+0000 7f21b5520640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21b0106800 0x7f21b019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.216+0000 7f21b5520640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f21b010dcd0 con 0x7f21b0100800 2024-09-20T19:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.216+0000 7f21b5520640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f21b010db50 con 0x7f21b0106800 2024-09-20T19:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.217+0000 7f21aeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21b0100800 0x7f21b019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.217+0000 7f21aeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21b0100800 0x7f21b019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56900/0 (socket says 172.21.15.17:56900) 2024-09-20T19:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.217+0000 7f21aeffd640 1 -- 172.21.15.17:0/465616747 learned_addr learned my addr 172.21.15.17:0/465616747 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.217+0000 7f21ae7fc640 1 --2- 172.21.15.17:0/465616747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21b0106800 0x7f21b019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.217+0000 7f21aeffd640 1 -- 172.21.15.17:0/465616747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21b0106800 msgr2=0x7f21b019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.217+0000 7f21aeffd640 1 --2- 172.21.15.17:0/465616747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21b0106800 0x7f21b019dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.217+0000 7f21aeffd640 1 -- 172.21.15.17:0/465616747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b01977f0 con 0x7f21b0100800 2024-09-20T19:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.217+0000 7f21aeffd640 1 --2- 172.21.15.17:0/465616747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21b0100800 0x7f21b019d670 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f21a000d6f0 tx=0x7f21a000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.217+0000 7f2197fff640 1 -- 172.21.15.17:0/465616747 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21a0017070 con 0x7f21b0100800 2024-09-20T19:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.217+0000 7f2197fff640 1 -- 172.21.15.17:0/465616747 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f21a000de00 con 0x7f21b0100800 2024-09-20T19:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.217+0000 7f21b5520640 1 -- 172.21.15.17:0/465616747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b0197ae0 con 0x7f21b0100800 2024-09-20T19:12:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.217+0000 7f2197fff640 1 -- 172.21.15.17:0/465616747 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21a0004bb0 con 0x7f21b0100800 2024-09-20T19:12:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.218+0000 7f21b5520640 1 -- 172.21.15.17:0/465616747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b0198040 con 0x7f21b0100800 2024-09-20T19:12:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.219+0000 7f21b5520640 1 -- 172.21.15.17:0/465616747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21b0101f40 con 0x7f21b0100800 2024-09-20T19:12:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.219+0000 7f2197fff640 1 -- 172.21.15.17:0/465616747 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f21a0004e60 con 0x7f21b0100800 2024-09-20T19:12:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.220+0000 7f2197fff640 1 --2- 172.21.15.17:0/465616747 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f219807af40 0x7f219807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.220+0000 7f2197fff640 1 -- 172.21.15.17:0/465616747 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f21a009dc50 con 0x7f21b0100800 2024-09-20T19:12:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.220+0000 7f21ae7fc640 1 --2- 172.21.15.17:0/465616747 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f219807af40 0x7f219807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:36.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.221+0000 7f21ae7fc640 1 --2- 172.21.15.17:0/465616747 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f219807af40 0x7f219807d400 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f21b0198b40 tx=0x7f21a40095c0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:36.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.225+0000 7f2197fff640 1 -- 172.21.15.17:0/465616747 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f21a0069250 con 0x7f21b0100800 2024-09-20T19:12:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.435+0000 7f21b5520640 1 -- 172.21.15.17:0/465616747 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f21b01982f0 con 0x7f219807af40 2024-09-20T19:12:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.436+0000 7f2197fff640 1 -- 172.21.15.17:0/465616747 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f21b01982f0 con 0x7f219807af40 2024-09-20T19:12:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.439+0000 7f21b5520640 1 -- 172.21.15.17:0/465616747 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f219807af40 msgr2=0x7f219807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.439+0000 7f21b5520640 1 --2- 172.21.15.17:0/465616747 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f219807af40 0x7f219807d400 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f21b0198b40 tx=0x7f21a40095c0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.439+0000 7f21b5520640 1 -- 172.21.15.17:0/465616747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21b0100800 msgr2=0x7f21b019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.439+0000 7f21b5520640 1 --2- 172.21.15.17:0/465616747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21b0100800 0x7f21b019d670 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f21a000d6f0 tx=0x7f21a000dbb0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.439+0000 7f21b5520640 1 -- 172.21.15.17:0/465616747 shutdown_connections 2024-09-20T19:12:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.439+0000 7f21b5520640 1 --2- 172.21.15.17:0/465616747 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f219807af40 0x7f219807d400 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.439+0000 7f21b5520640 1 --2- 172.21.15.17:0/465616747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21b0106800 0x7f21b019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.439+0000 7f21b5520640 1 --2- 172.21.15.17:0/465616747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21b0100800 0x7f21b019d670 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.439+0000 7f21b5520640 1 -- 172.21.15.17:0/465616747 >> 172.21.15.17:0/465616747 conn(0x7f21b00fc520 msgr2=0x7f21b006a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.439+0000 7f21b5520640 1 -- 172.21.15.17:0/465616747 shutdown_connections 2024-09-20T19:12:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.439+0000 7f21b5520640 1 -- 172.21.15.17:0/465616747 wait complete. 2024-09-20T19:12:36.451 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:12:36.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.525+0000 7f4307ef9640 1 -- 172.21.15.17:0/3190686502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4300102ab0 msgr2=0x7f4300102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:36.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.525+0000 7f4307ef9640 1 --2- 172.21.15.17:0/3190686502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4300102ab0 0x7f4300102e90 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009880 tx=0x7f42fc02a530 comp rx=0 tx=0).stop 2024-09-20T19:12:36.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.525+0000 7f4307ef9640 1 -- 172.21.15.17:0/3190686502 shutdown_connections 2024-09-20T19:12:36.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.525+0000 7f4307ef9640 1 --2- 172.21.15.17:0/3190686502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43001033d0 0x7f430010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.525+0000 7f4307ef9640 1 --2- 172.21.15.17:0/3190686502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4300102ab0 0x7f4300102e90 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.525+0000 7f4307ef9640 1 -- 172.21.15.17:0/3190686502 >> 172.21.15.17:0/3190686502 conn(0x7f43000fc550 msgr2=0x7f43000fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:36.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.525+0000 7f4307ef9640 1 -- 172.21.15.17:0/3190686502 shutdown_connections 2024-09-20T19:12:36.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.525+0000 7f4307ef9640 1 -- 172.21.15.17:0/3190686502 wait complete. 2024-09-20T19:12:36.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.525+0000 7f4307ef9640 1 Processor -- start 2024-09-20T19:12:36.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.525+0000 7f4307ef9640 1 -- start start 2024-09-20T19:12:36.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.526+0000 7f4307ef9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4300102ab0 0x7f430019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.526+0000 7f4307ef9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43001033d0 0x7f430019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.526+0000 7f4307ef9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f430010ede0 con 0x7f43001033d0 2024-09-20T19:12:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.526+0000 7f4307ef9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f430010ec60 con 0x7f4300102ab0 2024-09-20T19:12:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.526+0000 7f4305494640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43001033d0 0x7f430019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.526+0000 7f4305494640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43001033d0 0x7f430019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56918/0 (socket says 172.21.15.17:56918) 2024-09-20T19:12:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.526+0000 7f4305494640 1 -- 172.21.15.17:0/2121217337 learned_addr learned my addr 172.21.15.17:0/2121217337 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:12:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.526+0000 7f4305c95640 1 --2- 172.21.15.17:0/2121217337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4300102ab0 0x7f430019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.526+0000 7f4305494640 1 -- 172.21.15.17:0/2121217337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4300102ab0 msgr2=0x7f430019d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.526+0000 7f4305494640 1 --2- 172.21.15.17:0/2121217337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4300102ab0 0x7f430019d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.526+0000 7f4305494640 1 -- 172.21.15.17:0/2121217337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43001977b0 con 0x7f43001033d0 2024-09-20T19:12:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.526+0000 7f4305494640 1 --2- 172.21.15.17:0/2121217337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43001033d0 0x7f430019db70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f42f000d6d0 tx=0x7f42f000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.527+0000 7f42f6ffd640 1 -- 172.21.15.17:0/2121217337 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42f0017070 con 0x7f43001033d0 2024-09-20T19:12:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.527+0000 7f42f6ffd640 1 -- 172.21.15.17:0/2121217337 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42f00054e0 con 0x7f43001033d0 2024-09-20T19:12:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.527+0000 7f4307ef9640 1 -- 172.21.15.17:0/2121217337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4300197aa0 con 0x7f43001033d0 2024-09-20T19:12:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.527+0000 7f42f6ffd640 1 -- 172.21.15.17:0/2121217337 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42f0004ae0 con 0x7f43001033d0 2024-09-20T19:12:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.527+0000 7f4307ef9640 1 -- 172.21.15.17:0/2121217337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4300198030 con 0x7f43001033d0 2024-09-20T19:12:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.528+0000 7f4307ef9640 1 -- 172.21.15.17:0/2121217337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f430006a580 con 0x7f43001033d0 2024-09-20T19:12:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.529+0000 7f42f6ffd640 1 -- 172.21.15.17:0/2121217337 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f42f0004d90 con 0x7f43001033d0 2024-09-20T19:12:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.529+0000 7f42f6ffd640 1 --2- 172.21.15.17:0/2121217337 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f42ec07af80 0x7f42ec07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:36.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.529+0000 7f4305c95640 1 --2- 172.21.15.17:0/2121217337 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f42ec07af80 0x7f42ec07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:36.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.529+0000 7f42f6ffd640 1 -- 172.21.15.17:0/2121217337 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f42f009db50 con 0x7f43001033d0 2024-09-20T19:12:36.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.530+0000 7f4305c95640 1 --2- 172.21.15.17:0/2121217337 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f42ec07af80 0x7f42ec07d440 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f42fc0096c0 tx=0x7f42fc031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:36.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.534+0000 7f42f6ffd640 1 -- 172.21.15.17:0/2121217337 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f42f00691d0 con 0x7f43001033d0 2024-09-20T19:12:36.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.739+0000 7f4307ef9640 1 -- 172.21.15.17:0/2121217337 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f43001982e0 con 0x7f42ec07af80 2024-09-20T19:12:36.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.741+0000 7f42f6ffd640 1 -- 172.21.15.17:0/2121217337 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f43001982e0 con 0x7f42ec07af80 2024-09-20T19:12:36.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.743+0000 7f4307ef9640 1 -- 172.21.15.17:0/2121217337 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f42ec07af80 msgr2=0x7f42ec07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:36.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.743+0000 7f4307ef9640 1 --2- 172.21.15.17:0/2121217337 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f42ec07af80 0x7f42ec07d440 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f42fc0096c0 tx=0x7f42fc031400 comp rx=0 tx=0).stop 2024-09-20T19:12:36.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.743+0000 7f4307ef9640 1 -- 172.21.15.17:0/2121217337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43001033d0 msgr2=0x7f430019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:36.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.743+0000 7f4307ef9640 1 --2- 172.21.15.17:0/2121217337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43001033d0 0x7f430019db70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f42f000d6d0 tx=0x7f42f000db90 comp rx=0 tx=0).stop 2024-09-20T19:12:36.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.743+0000 7f4307ef9640 1 -- 172.21.15.17:0/2121217337 shutdown_connections 2024-09-20T19:12:36.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.743+0000 7f4307ef9640 1 --2- 172.21.15.17:0/2121217337 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f42ec07af80 0x7f42ec07d440 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.743+0000 7f4307ef9640 1 --2- 172.21.15.17:0/2121217337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43001033d0 0x7f430019db70 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.743+0000 7f4307ef9640 1 --2- 172.21.15.17:0/2121217337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4300102ab0 0x7f430019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.743+0000 7f4307ef9640 1 -- 172.21.15.17:0/2121217337 >> 172.21.15.17:0/2121217337 conn(0x7f43000fc550 msgr2=0x7f430010aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:36.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.743+0000 7f4307ef9640 1 -- 172.21.15.17:0/2121217337 shutdown_connections 2024-09-20T19:12:36.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.743+0000 7f4307ef9640 1 -- 172.21.15.17:0/2121217337 wait complete. 2024-09-20T19:12:36.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.827+0000 7f70ce7c5640 1 -- 172.21.15.17:0/2804166982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70c81033e0 msgr2=0x7f70c810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.827+0000 7f70ce7c5640 1 --2- 172.21.15.17:0/2804166982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70c81033e0 0x7f70c810b8d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f70bc009880 tx=0x7f70bc02a530 comp rx=0 tx=0).stop 2024-09-20T19:12:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.827+0000 7f70ce7c5640 1 -- 172.21.15.17:0/2804166982 shutdown_connections 2024-09-20T19:12:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.827+0000 7f70ce7c5640 1 --2- 172.21.15.17:0/2804166982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70c81033e0 0x7f70c810b8d0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.827+0000 7f70ce7c5640 1 --2- 172.21.15.17:0/2804166982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70c8102ac0 0x7f70c8102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.827+0000 7f70ce7c5640 1 -- 172.21.15.17:0/2804166982 >> 172.21.15.17:0/2804166982 conn(0x7f70c80fc520 msgr2=0x7f70c80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.827+0000 7f70ce7c5640 1 -- 172.21.15.17:0/2804166982 shutdown_connections 2024-09-20T19:12:36.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.827+0000 7f70ce7c5640 1 -- 172.21.15.17:0/2804166982 wait complete. 2024-09-20T19:12:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.828+0000 7f70ce7c5640 1 Processor -- start 2024-09-20T19:12:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.828+0000 7f70ce7c5640 1 -- start start 2024-09-20T19:12:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.828+0000 7f70ce7c5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70c8102ac0 0x7f70c819f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.828+0000 7f70ce7c5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70c81033e0 0x7f70c819fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.829+0000 7f70ce7c5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f70c810edf0 con 0x7f70c81033e0 2024-09-20T19:12:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.829+0000 7f70ce7c5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f70c810ec70 con 0x7f70c8102ac0 2024-09-20T19:12:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.829+0000 7f70c77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70c81033e0 0x7f70c819fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.829+0000 7f70c77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70c81033e0 0x7f70c819fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56934/0 (socket says 172.21.15.17:56934) 2024-09-20T19:12:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.829+0000 7f70c77fe640 1 -- 172.21.15.17:0/1312381803 learned_addr learned my addr 172.21.15.17:0/1312381803 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:12:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.829+0000 7f70c7fff640 1 --2- 172.21.15.17:0/1312381803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70c8102ac0 0x7f70c819f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.829+0000 7f70c77fe640 1 -- 172.21.15.17:0/1312381803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70c8102ac0 msgr2=0x7f70c819f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.829+0000 7f70c77fe640 1 --2- 172.21.15.17:0/1312381803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70c8102ac0 0x7f70c819f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.829+0000 7f70c77fe640 1 -- 172.21.15.17:0/1312381803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c8199ab0 con 0x7f70c81033e0 2024-09-20T19:12:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.829+0000 7f70c77fe640 1 --2- 172.21.15.17:0/1312381803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70c81033e0 0x7f70c819fe30 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f70bc031460 tx=0x7f70bc004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.829+0000 7f70c57fa640 1 -- 172.21.15.17:0/1312381803 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f70bc03f070 con 0x7f70c81033e0 2024-09-20T19:12:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.829+0000 7f70c57fa640 1 -- 172.21.15.17:0/1312381803 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f70bc0035f0 con 0x7f70c81033e0 2024-09-20T19:12:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.829+0000 7f70ce7c5640 1 -- 172.21.15.17:0/1312381803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c8199d40 con 0x7f70c81033e0 2024-09-20T19:12:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.830+0000 7f70c57fa640 1 -- 172.21.15.17:0/1312381803 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f70bc035030 con 0x7f70c81033e0 2024-09-20T19:12:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.830+0000 7f70ce7c5640 1 -- 172.21.15.17:0/1312381803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c819a270 con 0x7f70c81033e0 2024-09-20T19:12:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.831+0000 7f70ce7c5640 1 -- 172.21.15.17:0/1312381803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70c806aa90 con 0x7f70c81033e0 2024-09-20T19:12:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.831+0000 7f70c57fa640 1 -- 172.21.15.17:0/1312381803 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f70bc042070 con 0x7f70c81033e0 2024-09-20T19:12:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.832+0000 7f70c57fa640 1 --2- 172.21.15.17:0/1312381803 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f70b007af80 0x7f70b007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.832+0000 7f70c57fa640 1 -- 172.21.15.17:0/1312381803 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f70bc0be8e0 con 0x7f70c81033e0 2024-09-20T19:12:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.832+0000 7f70c7fff640 1 --2- 172.21.15.17:0/1312381803 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f70b007af80 0x7f70b007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.833+0000 7f70c7fff640 1 --2- 172.21.15.17:0/1312381803 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f70b007af80 0x7f70b007d440 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f70b8005fd0 tx=0x7f70b8005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:36.836+0000 7f70c57fa640 1 -- 172.21.15.17:0/1312381803 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f70bc089f60 con 0x7f70c81033e0 2024-09-20T19:12:37.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.031+0000 7f70ce7c5640 1 -- 172.21.15.17:0/1312381803 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f70c810b3e0 con 0x7f70b007af80 2024-09-20T19:12:37.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.041+0000 7f70c57fa640 1 -- 172.21.15.17:0/1312381803 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f70b800fb90 con 0x7f70b007af80 2024-09-20T19:12:37.044 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:12:37.044 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (33m) 12m ago 44m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:12:37.044 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (37m) 12m ago 45m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:12:37.044 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (36m) 12m ago 44m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:12:37.044 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (32m) 12m ago 45m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:12:37.044 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (32m) 12m ago 44m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:12:37.044 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (33m) 12m ago 44m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:12:37.045 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (28m) 12m ago 39m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:12:37.045 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (28m) 12m ago 39m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:12:37.045 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (12m) 12m ago 39m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:12:37.045 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (28m) 12m ago 39m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:12:37.045 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (36m) 12m ago 46m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:12:37.045 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (35m) 12m ago 44m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:12:37.045 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (32m) 12m ago 46m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:12:37.045 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (32m) 12m ago 44m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:12:37.045 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (34m) 12m ago 45m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:12:37.045 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (34m) 12m ago 44m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:12:37.045 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (31m) 12m ago 42m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:12:37.045 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (31m) 12m ago 42m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:12:37.045 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (30m) 12m ago 42m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:12:37.046 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (29m) 12m ago 41m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:12:37.046 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (29m) 12m ago 41m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:12:37.046 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (28m) 12m ago 40m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:12:37.046 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (34m) 12m ago 44m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:12:37.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.043+0000 7f70ce7c5640 1 -- 172.21.15.17:0/1312381803 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f70b007af80 msgr2=0x7f70b007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:37.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.043+0000 7f70ce7c5640 1 --2- 172.21.15.17:0/1312381803 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f70b007af80 0x7f70b007d440 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f70b8005fd0 tx=0x7f70b8005850 comp rx=0 tx=0).stop 2024-09-20T19:12:37.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.043+0000 7f70ce7c5640 1 -- 172.21.15.17:0/1312381803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70c81033e0 msgr2=0x7f70c819fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:37.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.043+0000 7f70ce7c5640 1 --2- 172.21.15.17:0/1312381803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70c81033e0 0x7f70c819fe30 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f70bc031460 tx=0x7f70bc004530 comp rx=0 tx=0).stop 2024-09-20T19:12:37.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.043+0000 7f70ce7c5640 1 -- 172.21.15.17:0/1312381803 shutdown_connections 2024-09-20T19:12:37.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.043+0000 7f70ce7c5640 1 --2- 172.21.15.17:0/1312381803 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f70b007af80 0x7f70b007d440 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.043+0000 7f70ce7c5640 1 --2- 172.21.15.17:0/1312381803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70c81033e0 0x7f70c819fe30 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.043+0000 7f70ce7c5640 1 --2- 172.21.15.17:0/1312381803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70c8102ac0 0x7f70c819f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.043+0000 7f70ce7c5640 1 -- 172.21.15.17:0/1312381803 >> 172.21.15.17:0/1312381803 conn(0x7f70c80fc520 msgr2=0x7f70c8100a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:37.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.043+0000 7f70ce7c5640 1 -- 172.21.15.17:0/1312381803 shutdown_connections 2024-09-20T19:12:37.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.043+0000 7f70ce7c5640 1 -- 172.21.15.17:0/1312381803 wait complete. 2024-09-20T19:12:37.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.135+0000 7f1d0da6f640 1 -- 172.21.15.17:0/2362260756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d08101900 msgr2=0x7f1d08101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:37.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.135+0000 7f1d0da6f640 1 --2- 172.21.15.17:0/2362260756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d08101900 0x7f1d08101d60 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009880 tx=0x7f1cfc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.135+0000 7f1d0da6f640 1 -- 172.21.15.17:0/2362260756 shutdown_connections 2024-09-20T19:12:37.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.135+0000 7f1d0da6f640 1 --2- 172.21.15.17:0/2362260756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d08101900 0x7f1d08101d60 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.135+0000 7f1d0da6f640 1 --2- 172.21.15.17:0/2362260756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d08107900 0x7f1d08107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.135+0000 7f1d0da6f640 1 -- 172.21.15.17:0/2362260756 >> 172.21.15.17:0/2362260756 conn(0x7f1d080fd600 msgr2=0x7f1d080ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:37.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.135+0000 7f1d0da6f640 1 -- 172.21.15.17:0/2362260756 shutdown_connections 2024-09-20T19:12:37.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.135+0000 7f1d0da6f640 1 -- 172.21.15.17:0/2362260756 wait complete. 2024-09-20T19:12:37.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.136+0000 7f1d0da6f640 1 Processor -- start 2024-09-20T19:12:37.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.136+0000 7f1d0da6f640 1 -- start start 2024-09-20T19:12:37.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.136+0000 7f1d0da6f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d08101900 0x7f1d0819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:37.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.136+0000 7f1d0da6f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d08107900 0x7f1d0819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:37.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.136+0000 7f1d0da6f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0810edd0 con 0x7f1d08101900 2024-09-20T19:12:37.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.136+0000 7f1d0da6f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0810ec50 con 0x7f1d08107900 2024-09-20T19:12:37.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.137+0000 7f1d077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d08101900 0x7f1d0819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:37.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.137+0000 7f1d077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d08101900 0x7f1d0819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56946/0 (socket says 172.21.15.17:56946) 2024-09-20T19:12:37.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.137+0000 7f1d077fe640 1 -- 172.21.15.17:0/718127610 learned_addr learned my addr 172.21.15.17:0/718127610 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:12:37.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.137+0000 7f1d06ffd640 1 --2- 172.21.15.17:0/718127610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d08107900 0x7f1d0819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:37.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.137+0000 7f1d077fe640 1 -- 172.21.15.17:0/718127610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d08107900 msgr2=0x7f1d0819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:37.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.137+0000 7f1d077fe640 1 --2- 172.21.15.17:0/718127610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d08107900 0x7f1d0819dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.137+0000 7f1d077fe640 1 -- 172.21.15.17:0/718127610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d08197800 con 0x7f1d08101900 2024-09-20T19:12:37.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.137+0000 7f1d077fe640 1 --2- 172.21.15.17:0/718127610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d08101900 0x7f1d0819d680 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800c8f0 tx=0x7f1cf800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:37.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.137+0000 7f1d04ff9640 1 -- 172.21.15.17:0/718127610 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cf80079b0 con 0x7f1d08101900 2024-09-20T19:12:37.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.137+0000 7f1d0da6f640 1 -- 172.21.15.17:0/718127610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d08197af0 con 0x7f1d08101900 2024-09-20T19:12:37.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.137+0000 7f1d04ff9640 1 -- 172.21.15.17:0/718127610 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1cf80054e0 con 0x7f1d08101900 2024-09-20T19:12:37.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.137+0000 7f1d04ff9640 1 -- 172.21.15.17:0/718127610 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cf8004dd0 con 0x7f1d08101900 2024-09-20T19:12:37.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.137+0000 7f1d0da6f640 1 -- 172.21.15.17:0/718127610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d08198050 con 0x7f1d08101900 2024-09-20T19:12:37.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.139+0000 7f1d0da6f640 1 -- 172.21.15.17:0/718127610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d08103040 con 0x7f1d08101900 2024-09-20T19:12:37.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.139+0000 7f1d04ff9640 1 -- 172.21.15.17:0/718127610 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1cf8005020 con 0x7f1d08101900 2024-09-20T19:12:37.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.140+0000 7f1d04ff9640 1 --2- 172.21.15.17:0/718127610 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1cf007aed0 0x7f1cf007d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:37.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.140+0000 7f1d04ff9640 1 -- 172.21.15.17:0/718127610 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f1cf809df30 con 0x7f1d08101900 2024-09-20T19:12:37.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.140+0000 7f1d06ffd640 1 --2- 172.21.15.17:0/718127610 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1cf007aed0 0x7f1cf007d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:37.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.141+0000 7f1d06ffd640 1 --2- 172.21.15.17:0/718127610 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1cf007aed0 0x7f1cf007d390 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1d08198b50 tx=0x7f1cfc031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:37.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.145+0000 7f1d04ff9640 1 -- 172.21.15.17:0/718127610 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1cf8014030 con 0x7f1d08101900 2024-09-20T19:12:37.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.406+0000 7f1d0da6f640 1 -- 172.21.15.17:0/718127610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1d08109e70 con 0x7f1d08101900 2024-09-20T19:12:37.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.406+0000 7f1d04ff9640 1 -- 172.21.15.17:0/718127610 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f1cf8069530 con 0x7f1d08101900 2024-09-20T19:12:37.409 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:12:37.409 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:12:37.410 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:12:37.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:12:37.410 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:12:37.410 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:12:37.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:12:37.410 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:12:37.410 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:12:37.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:12:37.410 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:12:37.410 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:12:37.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:12:37.410 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:12:37.410 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:12:37.411 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:12:37.411 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:12:37.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.408+0000 7f1d0da6f640 1 -- 172.21.15.17:0/718127610 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1cf007aed0 msgr2=0x7f1cf007d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:37.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.408+0000 7f1d0da6f640 1 --2- 172.21.15.17:0/718127610 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1cf007aed0 0x7f1cf007d390 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1d08198b50 tx=0x7f1cfc031400 comp rx=0 tx=0).stop 2024-09-20T19:12:37.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.408+0000 7f1d0da6f640 1 -- 172.21.15.17:0/718127610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d08101900 msgr2=0x7f1d0819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:37.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.408+0000 7f1d0da6f640 1 --2- 172.21.15.17:0/718127610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d08101900 0x7f1d0819d680 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800c8f0 tx=0x7f1cf800cdb0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.408+0000 7f1d0da6f640 1 -- 172.21.15.17:0/718127610 shutdown_connections 2024-09-20T19:12:37.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.408+0000 7f1d0da6f640 1 --2- 172.21.15.17:0/718127610 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1cf007aed0 0x7f1cf007d390 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.408+0000 7f1d0da6f640 1 --2- 172.21.15.17:0/718127610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d08107900 0x7f1d0819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.408+0000 7f1d0da6f640 1 --2- 172.21.15.17:0/718127610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d08101900 0x7f1d0819d680 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.408+0000 7f1d0da6f640 1 -- 172.21.15.17:0/718127610 >> 172.21.15.17:0/718127610 conn(0x7f1d080fd600 msgr2=0x7f1d080fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:37.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.408+0000 7f1d0da6f640 1 -- 172.21.15.17:0/718127610 shutdown_connections 2024-09-20T19:12:37.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.409+0000 7f1d0da6f640 1 -- 172.21.15.17:0/718127610 wait complete. 2024-09-20T19:12:37.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.492+0000 7f267beea640 1 -- 172.21.15.17:0/3268953472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26741033d0 msgr2=0x7f267410b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:37.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.492+0000 7f267beea640 1 --2- 172.21.15.17:0/3268953472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26741033d0 0x7f267410b8c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f2668009880 tx=0x7f266802a530 comp rx=0 tx=0).stop 2024-09-20T19:12:37.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.492+0000 7f267beea640 1 -- 172.21.15.17:0/3268953472 shutdown_connections 2024-09-20T19:12:37.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.493+0000 7f267beea640 1 --2- 172.21.15.17:0/3268953472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26741033d0 0x7f267410b8c0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.493+0000 7f267beea640 1 --2- 172.21.15.17:0/3268953472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2674102ab0 0x7f2674102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.493+0000 7f267beea640 1 -- 172.21.15.17:0/3268953472 >> 172.21.15.17:0/3268953472 conn(0x7f26740fc550 msgr2=0x7f26740fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:37.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.493+0000 7f267beea640 1 -- 172.21.15.17:0/3268953472 shutdown_connections 2024-09-20T19:12:37.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.493+0000 7f267beea640 1 -- 172.21.15.17:0/3268953472 wait complete. 2024-09-20T19:12:37.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.493+0000 7f267beea640 1 Processor -- start 2024-09-20T19:12:37.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.493+0000 7f267beea640 1 -- start start 2024-09-20T19:12:37.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.493+0000 7f267beea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2674102ab0 0x7f267419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:37.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.493+0000 7f267beea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26741033d0 0x7f267419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:37.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.493+0000 7f267beea640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f267410edc0 con 0x7f26741033d0 2024-09-20T19:12:37.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.493+0000 7f267beea640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f267410ec40 con 0x7f2674102ab0 2024-09-20T19:12:37.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.494+0000 7f2679485640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26741033d0 0x7f267419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:37.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.494+0000 7f2679485640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26741033d0 0x7f267419db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56964/0 (socket says 172.21.15.17:56964) 2024-09-20T19:12:37.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.494+0000 7f2679485640 1 -- 172.21.15.17:0/2812678409 learned_addr learned my addr 172.21.15.17:0/2812678409 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:12:37.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.494+0000 7f2679c86640 1 --2- 172.21.15.17:0/2812678409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2674102ab0 0x7f267419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:37.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.494+0000 7f2679485640 1 -- 172.21.15.17:0/2812678409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2674102ab0 msgr2=0x7f267419d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:37.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.494+0000 7f2679485640 1 --2- 172.21.15.17:0/2812678409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2674102ab0 0x7f267419d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.494+0000 7f2679485640 1 -- 172.21.15.17:0/2812678409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2674197790 con 0x7f26741033d0 2024-09-20T19:12:37.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.494+0000 7f2679485640 1 --2- 172.21.15.17:0/2812678409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26741033d0 0x7f267419db50 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f2668031460 tx=0x7f2668004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:37.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.494+0000 7f2672ffd640 1 -- 172.21.15.17:0/2812678409 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f266803f070 con 0x7f26741033d0 2024-09-20T19:12:37.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.494+0000 7f2672ffd640 1 -- 172.21.15.17:0/2812678409 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f26680035f0 con 0x7f26741033d0 2024-09-20T19:12:37.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.494+0000 7f267beea640 1 -- 172.21.15.17:0/2812678409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2674197a20 con 0x7f26741033d0 2024-09-20T19:12:37.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.494+0000 7f2672ffd640 1 -- 172.21.15.17:0/2812678409 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2668035030 con 0x7f26741033d0 2024-09-20T19:12:37.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.494+0000 7f267beea640 1 -- 172.21.15.17:0/2812678409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2674197f50 con 0x7f26741033d0 2024-09-20T19:12:37.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.495+0000 7f2670ff9640 1 -- 172.21.15.17:0/2812678409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f267406a580 con 0x7f26741033d0 2024-09-20T19:12:37.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.496+0000 7f2672ffd640 1 -- 172.21.15.17:0/2812678409 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2668042070 con 0x7f26741033d0 2024-09-20T19:12:37.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.497+0000 7f2672ffd640 1 --2- 172.21.15.17:0/2812678409 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f265c07af30 0x7f265c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:37.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.497+0000 7f2672ffd640 1 -- 172.21.15.17:0/2812678409 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f26680be900 con 0x7f26741033d0 2024-09-20T19:12:37.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.497+0000 7f2679c86640 1 --2- 172.21.15.17:0/2812678409 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f265c07af30 0x7f265c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:37.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.497+0000 7f2679c86640 1 --2- 172.21.15.17:0/2812678409 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f265c07af30 0x7f265c07d3f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2664005fd0 tx=0x7f2664009680 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:37.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.501+0000 7f2672ffd640 1 -- 172.21.15.17:0/2812678409 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2668089f00 con 0x7f26741033d0 2024-09-20T19:12:37.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.729+0000 7f2670ff9640 1 -- 172.21.15.17:0/2812678409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f2674102e90 con 0x7f26741033d0 2024-09-20T19:12:37.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.730+0000 7f2672ffd640 1 -- 172.21.15.17:0/2812678409 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7f266808edb0 con 0x7f26741033d0 2024-09-20T19:12:37.733 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:12:37.734 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:12:37.734 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:12:37.734 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:12:37.734 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:12:37.734 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:12:37.734 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:12:37.734 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:12:37.735 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:12:37.735 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:12:37.735 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:12:37.735 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:12:37.735 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:12:37.735 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:12:37.735 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:12:37.736 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:12:37.736 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:12:37.736 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:12:37.736 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:12:37.736 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:12:37.736 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:12:37.737 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:12:37.737 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:12:37.737 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:12:37.737 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:12:37.737 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:12:37.737 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:12:37.737 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:12:37.737 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:12:37.738 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:12:37.738 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:12:37.738 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:12:37.738 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:12:37.738 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:12:37.738 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:12:37.738 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:12:37.739 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:12:37.739 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:12:37.739 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:12:37.739 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:12:37.739 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:12:37.739 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:12:37.739 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:12:37.740 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:12:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.732+0000 7f2670ff9640 1 -- 172.21.15.17:0/2812678409 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f265c07af30 msgr2=0x7f265c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.732+0000 7f2670ff9640 1 --2- 172.21.15.17:0/2812678409 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f265c07af30 0x7f265c07d3f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2664005fd0 tx=0x7f2664009680 comp rx=0 tx=0).stop 2024-09-20T19:12:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.732+0000 7f2670ff9640 1 -- 172.21.15.17:0/2812678409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26741033d0 msgr2=0x7f267419db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.732+0000 7f2670ff9640 1 --2- 172.21.15.17:0/2812678409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26741033d0 0x7f267419db50 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f2668031460 tx=0x7f2668004530 comp rx=0 tx=0).stop 2024-09-20T19:12:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.732+0000 7f2670ff9640 1 -- 172.21.15.17:0/2812678409 shutdown_connections 2024-09-20T19:12:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.732+0000 7f2670ff9640 1 --2- 172.21.15.17:0/2812678409 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f265c07af30 0x7f265c07d3f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.732+0000 7f2670ff9640 1 --2- 172.21.15.17:0/2812678409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26741033d0 0x7f267419db50 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.732+0000 7f2670ff9640 1 --2- 172.21.15.17:0/2812678409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2674102ab0 0x7f267419d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.732+0000 7f2670ff9640 1 -- 172.21.15.17:0/2812678409 >> 172.21.15.17:0/2812678409 conn(0x7f26740fc550 msgr2=0x7f267410aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:37.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.732+0000 7f2670ff9640 1 -- 172.21.15.17:0/2812678409 shutdown_connections 2024-09-20T19:12:37.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.732+0000 7f2670ff9640 1 -- 172.21.15.17:0/2812678409 wait complete. 2024-09-20T19:12:37.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.817+0000 7fa448d31640 1 -- 172.21.15.17:0/4267866937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa444109b90 msgr2=0x7fa444109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:37.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.817+0000 7fa448d31640 1 --2- 172.21.15.17:0/4267866937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa444109b90 0x7fa444109f70 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fa434009880 tx=0x7fa43402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.817+0000 7fa448d31640 1 -- 172.21.15.17:0/4267866937 shutdown_connections 2024-09-20T19:12:37.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.817+0000 7fa448d31640 1 --2- 172.21.15.17:0/4267866937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa444103b00 0x7fa444103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.817+0000 7fa448d31640 1 --2- 172.21.15.17:0/4267866937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa444109b90 0x7fa444109f70 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.817+0000 7fa448d31640 1 -- 172.21.15.17:0/4267866937 >> 172.21.15.17:0/4267866937 conn(0x7fa4440ff800 msgr2=0x7fa444101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:37.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.817+0000 7fa448d31640 1 -- 172.21.15.17:0/4267866937 shutdown_connections 2024-09-20T19:12:37.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.817+0000 7fa448d31640 1 -- 172.21.15.17:0/4267866937 wait complete. 2024-09-20T19:12:37.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.818+0000 7fa448d31640 1 Processor -- start 2024-09-20T19:12:37.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.818+0000 7fa448d31640 1 -- start start 2024-09-20T19:12:37.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.818+0000 7fa448d31640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa444103b00 0x7fa44419f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:37.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.818+0000 7fa448d31640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa444109b90 0x7fa44419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:37.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.818+0000 7fa448d31640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa444111030 con 0x7fa444109b90 2024-09-20T19:12:37.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.818+0000 7fa448d31640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa444110eb0 con 0x7fa444103b00 2024-09-20T19:12:37.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.819+0000 7fa441d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa444109b90 0x7fa44419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:37.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.819+0000 7fa441d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa444109b90 0x7fa44419fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56982/0 (socket says 172.21.15.17:56982) 2024-09-20T19:12:37.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.819+0000 7fa441d9b640 1 -- 172.21.15.17:0/3711232550 learned_addr learned my addr 172.21.15.17:0/3711232550 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:12:37.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.819+0000 7fa44259c640 1 --2- 172.21.15.17:0/3711232550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa444103b00 0x7fa44419f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:37.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.819+0000 7fa441d9b640 1 -- 172.21.15.17:0/3711232550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa444103b00 msgr2=0x7fa44419f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:37.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.819+0000 7fa441d9b640 1 --2- 172.21.15.17:0/3711232550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa444103b00 0x7fa44419f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:37.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.819+0000 7fa441d9b640 1 -- 172.21.15.17:0/3711232550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa444199a60 con 0x7fa444109b90 2024-09-20T19:12:37.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.819+0000 7fa44259c640 1 --2- 172.21.15.17:0/3711232550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa444103b00 0x7fa44419f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:12:37.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.819+0000 7fa441d9b640 1 --2- 172.21.15.17:0/3711232550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa444109b90 0x7fa44419fde0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa43800b420 tx=0x7fa43800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:37.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.819+0000 7fa4337fe640 1 -- 172.21.15.17:0/3711232550 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa438011630 con 0x7fa444109b90 2024-09-20T19:12:37.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.819+0000 7fa4337fe640 1 -- 172.21.15.17:0/3711232550 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa438016070 con 0x7fa444109b90 2024-09-20T19:12:37.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.819+0000 7fa448d31640 1 -- 172.21.15.17:0/3711232550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa444199d50 con 0x7fa444109b90 2024-09-20T19:12:37.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.819+0000 7fa4337fe640 1 -- 172.21.15.17:0/3711232550 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa438010d40 con 0x7fa444109b90 2024-09-20T19:12:37.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.819+0000 7fa448d31640 1 -- 172.21.15.17:0/3711232550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa44419a2e0 con 0x7fa444109b90 2024-09-20T19:12:37.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.820+0000 7fa448d31640 1 -- 172.21.15.17:0/3711232550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa444105200 con 0x7fa444109b90 2024-09-20T19:12:37.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.821+0000 7fa4337fe640 1 -- 172.21.15.17:0/3711232550 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa43801b460 con 0x7fa444109b90 2024-09-20T19:12:37.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.822+0000 7fa4337fe640 1 --2- 172.21.15.17:0/3711232550 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa42c07af80 0x7fa42c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:37.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.822+0000 7fa44259c640 1 --2- 172.21.15.17:0/3711232550 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa42c07af80 0x7fa42c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:37.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.822+0000 7fa4337fe640 1 -- 172.21.15.17:0/3711232550 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fa43809d6f0 con 0x7fa444109b90 2024-09-20T19:12:37.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.822+0000 7fa44259c640 1 --2- 172.21.15.17:0/3711232550 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa42c07af80 0x7fa42c07d440 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa434000c00 tx=0x7fa434031420 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:37.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:37.826+0000 7fa4337fe640 1 -- 172.21.15.17:0/3711232550 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa438021250 con 0x7fa444109b90 2024-09-20T19:12:38.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.032+0000 7fa448d31640 1 -- 172.21.15.17:0/3711232550 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa44419af90 con 0x7fa42c07af80 2024-09-20T19:12:38.036 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:37 smithi017 ceph-mon[108970]: from='client.35828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:38.036 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:37 smithi017 ceph-mon[108970]: from='client.35832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:38.036 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:37 smithi017 ceph-mon[108970]: pgmap v1117: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:38.036 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:37 smithi017 ceph-mon[108970]: from='client.35836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:38.036 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:12:38.036 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:37 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/718127610' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:12:38.037 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:37 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2812678409' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:12:38.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.033+0000 7fa4337fe640 1 -- 172.21.15.17:0/3711232550 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa44419af90 con 0x7fa42c07af80 2024-09-20T19:12:38.038 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:12:38.038 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:12:38.038 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:12:38.038 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:12:38.038 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:12:38.038 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:12:38.039 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:12:38.039 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:12:38.039 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:12:38.039 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:12:38.039 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:12:38.039 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:12:38.039 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:12:38.040 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:12:38.040 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:12:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.035+0000 7fa448d31640 1 -- 172.21.15.17:0/3711232550 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa42c07af80 msgr2=0x7fa42c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.035+0000 7fa448d31640 1 --2- 172.21.15.17:0/3711232550 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa42c07af80 0x7fa42c07d440 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa434000c00 tx=0x7fa434031420 comp rx=0 tx=0).stop 2024-09-20T19:12:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.035+0000 7fa448d31640 1 -- 172.21.15.17:0/3711232550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa444109b90 msgr2=0x7fa44419fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.035+0000 7fa448d31640 1 --2- 172.21.15.17:0/3711232550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa444109b90 0x7fa44419fde0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa43800b420 tx=0x7fa43800b8e0 comp rx=0 tx=0).stop 2024-09-20T19:12:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.036+0000 7fa448d31640 1 -- 172.21.15.17:0/3711232550 shutdown_connections 2024-09-20T19:12:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.036+0000 7fa448d31640 1 --2- 172.21.15.17:0/3711232550 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa42c07af80 0x7fa42c07d440 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.036+0000 7fa448d31640 1 --2- 172.21.15.17:0/3711232550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa444109b90 0x7fa44419fde0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.036+0000 7fa448d31640 1 --2- 172.21.15.17:0/3711232550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa444103b00 0x7fa44419f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.036+0000 7fa448d31640 1 -- 172.21.15.17:0/3711232550 >> 172.21.15.17:0/3711232550 conn(0x7fa4440ff800 msgr2=0x7fa444100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.036+0000 7fa448d31640 1 -- 172.21.15.17:0/3711232550 shutdown_connections 2024-09-20T19:12:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.036+0000 7fa448d31640 1 -- 172.21.15.17:0/3711232550 wait complete. 2024-09-20T19:12:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.120+0000 7f66b3697640 1 -- 172.21.15.17:0/910643815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66ac101900 msgr2=0x7f66ac101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:38.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.120+0000 7f66b3697640 1 --2- 172.21.15.17:0/910643815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66ac101900 0x7f66ac101d60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f669c009880 tx=0x7f669c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:12:38.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.120+0000 7f66b3697640 1 -- 172.21.15.17:0/910643815 shutdown_connections 2024-09-20T19:12:38.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.120+0000 7f66b3697640 1 --2- 172.21.15.17:0/910643815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66ac101900 0x7f66ac101d60 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:38.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.120+0000 7f66b3697640 1 --2- 172.21.15.17:0/910643815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ac107900 0x7f66ac107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:38.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.120+0000 7f66b3697640 1 -- 172.21.15.17:0/910643815 >> 172.21.15.17:0/910643815 conn(0x7f66ac0fd600 msgr2=0x7f66ac0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:38.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.120+0000 7f66b3697640 1 -- 172.21.15.17:0/910643815 shutdown_connections 2024-09-20T19:12:38.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.120+0000 7f66b3697640 1 -- 172.21.15.17:0/910643815 wait complete. 2024-09-20T19:12:38.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.121+0000 7f66b3697640 1 Processor -- start 2024-09-20T19:12:38.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.121+0000 7f66b3697640 1 -- start start 2024-09-20T19:12:38.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.121+0000 7f66b3697640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66ac101900 0x7f66ac19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:38.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.121+0000 7f66b3697640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ac107900 0x7f66ac19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:38.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.121+0000 7f66b3697640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac10edb0 con 0x7f66ac101900 2024-09-20T19:12:38.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.121+0000 7f66b3697640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac10ec30 con 0x7f66ac107900 2024-09-20T19:12:38.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.121+0000 7f66b1433640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66ac101900 0x7f66ac19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:38.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.121+0000 7f66b1433640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66ac101900 0x7f66ac19f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57002/0 (socket says 172.21.15.17:57002) 2024-09-20T19:12:38.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.121+0000 7f66b1433640 1 -- 172.21.15.17:0/3611930084 learned_addr learned my addr 172.21.15.17:0/3611930084 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:12:38.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.121+0000 7f66b0c32640 1 --2- 172.21.15.17:0/3611930084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ac107900 0x7f66ac19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:38.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.121+0000 7f66b1433640 1 -- 172.21.15.17:0/3611930084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ac107900 msgr2=0x7f66ac19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:38.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.121+0000 7f66b1433640 1 --2- 172.21.15.17:0/3611930084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ac107900 0x7f66ac19fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:38.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.121+0000 7f66b1433640 1 -- 172.21.15.17:0/3611930084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac1a0440 con 0x7f66ac101900 2024-09-20T19:12:38.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.122+0000 7f66b0c32640 1 --2- 172.21.15.17:0/3611930084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ac107900 0x7f66ac19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:12:38.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.122+0000 7f66b1433640 1 --2- 172.21.15.17:0/3611930084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66ac101900 0x7f66ac19f850 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f66a800c8a0 tx=0x7f66a800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:38.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.122+0000 7f66a27fc640 1 -- 172.21.15.17:0/3611930084 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66a80079b0 con 0x7f66ac101900 2024-09-20T19:12:38.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.122+0000 7f66a27fc640 1 -- 172.21.15.17:0/3611930084 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f66a8007b50 con 0x7f66ac101900 2024-09-20T19:12:38.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.122+0000 7f66b3697640 1 -- 172.21.15.17:0/3611930084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ac199b30 con 0x7f66ac101900 2024-09-20T19:12:38.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.122+0000 7f66a27fc640 1 -- 172.21.15.17:0/3611930084 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66a8018700 con 0x7f66ac101900 2024-09-20T19:12:38.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.122+0000 7f66b3697640 1 -- 172.21.15.17:0/3611930084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ac19a090 con 0x7f66ac101900 2024-09-20T19:12:38.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.123+0000 7f66b3697640 1 -- 172.21.15.17:0/3611930084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66ac103040 con 0x7f66ac101900 2024-09-20T19:12:38.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.124+0000 7f66a27fc640 1 -- 172.21.15.17:0/3611930084 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f66a8007d00 con 0x7f66ac101900 2024-09-20T19:12:38.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.124+0000 7f66a27fc640 1 --2- 172.21.15.17:0/3611930084 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f669807af30 0x7f669807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:12:38.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.124+0000 7f66a27fc640 1 -- 172.21.15.17:0/3611930084 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f66a809e310 con 0x7f66ac101900 2024-09-20T19:12:38.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.124+0000 7f66b0c32640 1 --2- 172.21.15.17:0/3611930084 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f669807af30 0x7f669807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:12:38.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.125+0000 7f66b0c32640 1 --2- 172.21.15.17:0/3611930084 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f669807af30 0x7f669807d3f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f669c031460 tx=0x7f669c0095f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:12:38.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.129+0000 7f66a27fc640 1 -- 172.21.15.17:0/3611930084 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f66a8014030 con 0x7f66ac101900 2024-09-20T19:12:38.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:37 smithi172 ceph-mon[80431]: from='client.35828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:38.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:37 smithi172 ceph-mon[80431]: from='client.35832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:38.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:37 smithi172 ceph-mon[80431]: pgmap v1117: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:38.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:37 smithi172 ceph-mon[80431]: from='client.35836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:38.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:12:38.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:37 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/718127610' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:12:38.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:37 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2812678409' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:12:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.389+0000 7f66b3697640 1 -- 172.21.15.17:0/3611930084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f66ac101d60 con 0x7f66ac101900 2024-09-20T19:12:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.389+0000 7f66a27fc640 1 -- 172.21.15.17:0/3611930084 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f66a8069910 con 0x7f66ac101900 2024-09-20T19:12:38.392 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:12:38.392 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:12:38.392 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:12:38.392 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:12:38.392 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:12:38.393 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:12:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:12:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:12:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:12:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:12:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:12:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:12:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:12:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:12:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:12:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:12:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:12:38.393 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:12:38.393 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:12:38.394 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:12:38.394 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:12:38.394 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:12:38.394 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:12:38.394 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:12:38.394 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:12:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.391+0000 7f66b3697640 1 -- 172.21.15.17:0/3611930084 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f669807af30 msgr2=0x7f669807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.391+0000 7f66b3697640 1 --2- 172.21.15.17:0/3611930084 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f669807af30 0x7f669807d3f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f669c031460 tx=0x7f669c0095f0 comp rx=0 tx=0).stop 2024-09-20T19:12:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.391+0000 7f66b3697640 1 -- 172.21.15.17:0/3611930084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66ac101900 msgr2=0x7f66ac19f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:12:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.391+0000 7f66b3697640 1 --2- 172.21.15.17:0/3611930084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66ac101900 0x7f66ac19f850 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f66a800c8a0 tx=0x7f66a800cd60 comp rx=0 tx=0).stop 2024-09-20T19:12:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.391+0000 7f66b3697640 1 -- 172.21.15.17:0/3611930084 shutdown_connections 2024-09-20T19:12:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.391+0000 7f66b3697640 1 --2- 172.21.15.17:0/3611930084 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f669807af30 0x7f669807d3f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.391+0000 7f66b3697640 1 --2- 172.21.15.17:0/3611930084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ac107900 0x7f66ac19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.391+0000 7f66b3697640 1 --2- 172.21.15.17:0/3611930084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66ac101900 0x7f66ac19f850 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:12:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.391+0000 7f66b3697640 1 -- 172.21.15.17:0/3611930084 >> 172.21.15.17:0/3611930084 conn(0x7f66ac0fd600 msgr2=0x7f66ac074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:12:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.391+0000 7f66b3697640 1 -- 172.21.15.17:0/3611930084 shutdown_connections 2024-09-20T19:12:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:12:38.391+0000 7f66b3697640 1 -- 172.21.15.17:0/3611930084 wait complete. 2024-09-20T19:12:39.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:38 smithi172 ceph-mon[80431]: from='client.35848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:39.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:38 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3611930084' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:12:39.274 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:38 smithi017 ceph-mon[108970]: from='client.35848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:12:39.274 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:38 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3611930084' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:12:40.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:39 smithi172 ceph-mon[80431]: pgmap v1118: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:40.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:39 smithi017 ceph-mon[108970]: pgmap v1118: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:42.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:41 smithi172 ceph-mon[80431]: pgmap v1119: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:42.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:41 smithi017 ceph-mon[108970]: pgmap v1119: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:44.351 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:43 smithi017 ceph-mon[108970]: pgmap v1120: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:44.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:43 smithi172 ceph-mon[80431]: pgmap v1120: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:46.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:45 smithi017 ceph-mon[108970]: pgmap v1121: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:46.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:45 smithi172 ceph-mon[80431]: pgmap v1121: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:48.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:47 smithi017 ceph-mon[108970]: pgmap v1122: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:48.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:47 smithi172 ceph-mon[80431]: pgmap v1122: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:50.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:49 smithi017 ceph-mon[108970]: pgmap v1123: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:50.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:49 smithi172 ceph-mon[80431]: pgmap v1123: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:52.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:51 smithi017 ceph-mon[108970]: pgmap v1124: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:52.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:51 smithi172 ceph-mon[80431]: pgmap v1124: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:53.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:12:53.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:12:54.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:53 smithi017 ceph-mon[108970]: pgmap v1125: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:54.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:53 smithi172 ceph-mon[80431]: pgmap v1125: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:56.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:55 smithi017 ceph-mon[108970]: pgmap v1126: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:56.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:55 smithi172 ceph-mon[80431]: pgmap v1126: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:58.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:57 smithi017 ceph-mon[108970]: pgmap v1127: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:12:58.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:57 smithi172 ceph-mon[80431]: pgmap v1127: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:00.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:12:59 smithi017 ceph-mon[108970]: pgmap v1128: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:00.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:12:59 smithi172 ceph-mon[80431]: pgmap v1128: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:02.290 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:01 smithi172 ceph-mon[80431]: pgmap v1129: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:02.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:01 smithi017 ceph-mon[108970]: pgmap v1129: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:04.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:03 smithi017 ceph-mon[108970]: pgmap v1130: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:04.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:03 smithi172 ceph-mon[80431]: pgmap v1130: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:06.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:05 smithi017 ceph-mon[108970]: pgmap v1131: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:06.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:05 smithi172 ceph-mon[80431]: pgmap v1131: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:08.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:07 smithi017 ceph-mon[108970]: pgmap v1132: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:08.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:13:08.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:07 smithi172 ceph-mon[80431]: pgmap v1132: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:08.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:13:08.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.490+0000 7fa7eb00b640 1 -- 172.21.15.17:0/1560816705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e4107900 msgr2=0x7fa7e4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:08.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.490+0000 7fa7eb00b640 1 --2- 172.21.15.17:0/1560816705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e4107900 0x7fa7e4107ce0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009880 tx=0x7fa7cc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:08.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.490+0000 7fa7eb00b640 1 -- 172.21.15.17:0/1560816705 shutdown_connections 2024-09-20T19:13:08.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.490+0000 7fa7eb00b640 1 --2- 172.21.15.17:0/1560816705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7e4101900 0x7fa7e4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:08.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.490+0000 7fa7eb00b640 1 --2- 172.21.15.17:0/1560816705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e4107900 0x7fa7e4107ce0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:08.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.490+0000 7fa7eb00b640 1 -- 172.21.15.17:0/1560816705 >> 172.21.15.17:0/1560816705 conn(0x7fa7e40fd600 msgr2=0x7fa7e40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:08.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.490+0000 7fa7eb00b640 1 -- 172.21.15.17:0/1560816705 shutdown_connections 2024-09-20T19:13:08.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.490+0000 7fa7eb00b640 1 -- 172.21.15.17:0/1560816705 wait complete. 2024-09-20T19:13:08.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.491+0000 7fa7eb00b640 1 Processor -- start 2024-09-20T19:13:08.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.491+0000 7fa7eb00b640 1 -- start start 2024-09-20T19:13:08.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.491+0000 7fa7eb00b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e4101900 0x7fa7e40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:08.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.491+0000 7fa7eb00b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7e4107900 0x7fa7e4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:08.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.491+0000 7fa7eb00b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e410edd0 con 0x7fa7e4101900 2024-09-20T19:13:08.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.491+0000 7fa7eb00b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e410ec50 con 0x7fa7e4107900 2024-09-20T19:13:08.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.491+0000 7fa7e8da7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e4101900 0x7fa7e40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:08.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.491+0000 7fa7e8da7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e4101900 0x7fa7e40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33436/0 (socket says 172.21.15.17:33436) 2024-09-20T19:13:08.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.491+0000 7fa7e8da7640 1 -- 172.21.15.17:0/2007543518 learned_addr learned my addr 172.21.15.17:0/2007543518 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:13:08.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.491+0000 7fa7e3fff640 1 --2- 172.21.15.17:0/2007543518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7e4107900 0x7fa7e4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:08.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.492+0000 7fa7e8da7640 1 -- 172.21.15.17:0/2007543518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7e4107900 msgr2=0x7fa7e4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:08.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.492+0000 7fa7e8da7640 1 --2- 172.21.15.17:0/2007543518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7e4107900 0x7fa7e4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:08.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.492+0000 7fa7e8da7640 1 -- 172.21.15.17:0/2007543518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e4074f70 con 0x7fa7e4101900 2024-09-20T19:13:08.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.492+0000 7fa7e8da7640 1 --2- 172.21.15.17:0/2007543518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e4101900 0x7fa7e40744f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc031460 tx=0x7fa7cc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:08.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.492+0000 7fa7e1ffb640 1 -- 172.21.15.17:0/2007543518 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7cc03f070 con 0x7fa7e4101900 2024-09-20T19:13:08.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.492+0000 7fa7e1ffb640 1 -- 172.21.15.17:0/2007543518 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa7cc0035f0 con 0x7fa7e4101900 2024-09-20T19:13:08.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.492+0000 7fa7eb00b640 1 -- 172.21.15.17:0/2007543518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7e4075200 con 0x7fa7e4101900 2024-09-20T19:13:08.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.492+0000 7fa7e1ffb640 1 -- 172.21.15.17:0/2007543518 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7cc035030 con 0x7fa7e4101900 2024-09-20T19:13:08.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.493+0000 7fa7eb00b640 1 -- 172.21.15.17:0/2007543518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7e41a3d80 con 0x7fa7e4101900 2024-09-20T19:13:08.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.494+0000 7fa7eb00b640 1 -- 172.21.15.17:0/2007543518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7e4103040 con 0x7fa7e4101900 2024-09-20T19:13:08.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.495+0000 7fa7e1ffb640 1 -- 172.21.15.17:0/2007543518 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa7cc042070 con 0x7fa7e4101900 2024-09-20T19:13:08.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.495+0000 7fa7e1ffb640 1 --2- 172.21.15.17:0/2007543518 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa7d007af30 0x7fa7d007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:08.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.495+0000 7fa7e1ffb640 1 -- 172.21.15.17:0/2007543518 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fa7cc0be970 con 0x7fa7e4101900 2024-09-20T19:13:08.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.495+0000 7fa7e3fff640 1 --2- 172.21.15.17:0/2007543518 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa7d007af30 0x7fa7d007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:08.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.496+0000 7fa7e3fff640 1 --2- 172.21.15.17:0/2007543518 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa7d007af30 0x7fa7d007d3f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4075f80 tx=0x7fa7d400b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:08.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.500+0000 7fa7e1ffb640 1 -- 172.21.15.17:0/2007543518 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa7cc0c0e20 con 0x7fa7e4101900 2024-09-20T19:13:08.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.706+0000 7fa7eb00b640 1 -- 172.21.15.17:0/2007543518 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa7e4062630 con 0x7fa7d007af30 2024-09-20T19:13:08.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.707+0000 7fa7e1ffb640 1 -- 172.21.15.17:0/2007543518 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa7e4062630 con 0x7fa7d007af30 2024-09-20T19:13:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.710+0000 7fa7eb00b640 1 -- 172.21.15.17:0/2007543518 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa7d007af30 msgr2=0x7fa7d007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.710+0000 7fa7eb00b640 1 --2- 172.21.15.17:0/2007543518 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa7d007af30 0x7fa7d007d3f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4075f80 tx=0x7fa7d400b390 comp rx=0 tx=0).stop 2024-09-20T19:13:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.710+0000 7fa7eb00b640 1 -- 172.21.15.17:0/2007543518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e4101900 msgr2=0x7fa7e40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.710+0000 7fa7eb00b640 1 --2- 172.21.15.17:0/2007543518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e4101900 0x7fa7e40744f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc031460 tx=0x7fa7cc0045e0 comp rx=0 tx=0).stop 2024-09-20T19:13:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.710+0000 7fa7eb00b640 1 -- 172.21.15.17:0/2007543518 shutdown_connections 2024-09-20T19:13:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.710+0000 7fa7eb00b640 1 --2- 172.21.15.17:0/2007543518 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa7d007af30 0x7fa7d007d3f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:08.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.710+0000 7fa7eb00b640 1 --2- 172.21.15.17:0/2007543518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7e4107900 0x7fa7e4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:08.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.710+0000 7fa7eb00b640 1 --2- 172.21.15.17:0/2007543518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7e4101900 0x7fa7e40744f0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:08.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.710+0000 7fa7eb00b640 1 -- 172.21.15.17:0/2007543518 >> 172.21.15.17:0/2007543518 conn(0x7fa7e40fd600 msgr2=0x7fa7e40fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:08.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.710+0000 7fa7eb00b640 1 -- 172.21.15.17:0/2007543518 shutdown_connections 2024-09-20T19:13:08.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.710+0000 7fa7eb00b640 1 -- 172.21.15.17:0/2007543518 wait complete. 2024-09-20T19:13:08.721 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:13:08.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.795+0000 7fdf4ca84640 1 -- 172.21.15.17:0/1354178174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf48107900 msgr2=0x7fdf48107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:08.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.795+0000 7fdf4ca84640 1 --2- 172.21.15.17:0/1354178174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf48107900 0x7fdf48107ce0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009880 tx=0x7fdf4002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:08.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.796+0000 7fdf4ca84640 1 -- 172.21.15.17:0/1354178174 shutdown_connections 2024-09-20T19:13:08.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.796+0000 7fdf4ca84640 1 --2- 172.21.15.17:0/1354178174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf48101900 0x7fdf48101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:08.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.796+0000 7fdf4ca84640 1 --2- 172.21.15.17:0/1354178174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf48107900 0x7fdf48107ce0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:08.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.796+0000 7fdf4ca84640 1 -- 172.21.15.17:0/1354178174 >> 172.21.15.17:0/1354178174 conn(0x7fdf480fd5e0 msgr2=0x7fdf480ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:08.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.796+0000 7fdf4ca84640 1 -- 172.21.15.17:0/1354178174 shutdown_connections 2024-09-20T19:13:08.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.796+0000 7fdf4ca84640 1 -- 172.21.15.17:0/1354178174 wait complete. 2024-09-20T19:13:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.797+0000 7fdf4ca84640 1 Processor -- start 2024-09-20T19:13:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.797+0000 7fdf4ca84640 1 -- start start 2024-09-20T19:13:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.797+0000 7fdf4ca84640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf48101900 0x7fdf480744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.797+0000 7fdf4ca84640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf48107900 0x7fdf48074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.797+0000 7fdf4ca84640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4810ee30 con 0x7fdf48101900 2024-09-20T19:13:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.797+0000 7fdf4ca84640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4810ecb0 con 0x7fdf48107900 2024-09-20T19:13:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.797+0000 7fdf4659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf48101900 0x7fdf480744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.797+0000 7fdf4659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf48101900 0x7fdf480744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33458/0 (socket says 172.21.15.17:33458) 2024-09-20T19:13:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.797+0000 7fdf4659c640 1 -- 172.21.15.17:0/2021039465 learned_addr learned my addr 172.21.15.17:0/2021039465 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:13:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.797+0000 7fdf45d9b640 1 --2- 172.21.15.17:0/2021039465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf48107900 0x7fdf48074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.797+0000 7fdf4659c640 1 -- 172.21.15.17:0/2021039465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf48107900 msgr2=0x7fdf48074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.797+0000 7fdf4659c640 1 --2- 172.21.15.17:0/2021039465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf48107900 0x7fdf48074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.797+0000 7fdf4659c640 1 -- 172.21.15.17:0/2021039465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf48074f70 con 0x7fdf48101900 2024-09-20T19:13:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.798+0000 7fdf4659c640 1 --2- 172.21.15.17:0/2021039465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf48101900 0x7fdf480744f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fdf40031460 tx=0x7fdf400048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.798+0000 7fdf3f7fe640 1 -- 172.21.15.17:0/2021039465 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf4003f070 con 0x7fdf48101900 2024-09-20T19:13:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.798+0000 7fdf4ca84640 1 -- 172.21.15.17:0/2021039465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf48075200 con 0x7fdf48101900 2024-09-20T19:13:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.798+0000 7fdf3f7fe640 1 -- 172.21.15.17:0/2021039465 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdf400044d0 con 0x7fdf48101900 2024-09-20T19:13:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.798+0000 7fdf3f7fe640 1 -- 172.21.15.17:0/2021039465 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf40035030 con 0x7fdf48101900 2024-09-20T19:13:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.798+0000 7fdf4ca84640 1 -- 172.21.15.17:0/2021039465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf481a3da0 con 0x7fdf48101900 2024-09-20T19:13:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.799+0000 7fdf4ca84640 1 -- 172.21.15.17:0/2021039465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf48103040 con 0x7fdf48101900 2024-09-20T19:13:08.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.801+0000 7fdf3f7fe640 1 -- 172.21.15.17:0/2021039465 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdf40042070 con 0x7fdf48101900 2024-09-20T19:13:08.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.801+0000 7fdf3f7fe640 1 --2- 172.21.15.17:0/2021039465 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf3407af40 0x7fdf3407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:08.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.801+0000 7fdf3f7fe640 1 -- 172.21.15.17:0/2021039465 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fdf400bec00 con 0x7fdf48101900 2024-09-20T19:13:08.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.801+0000 7fdf45d9b640 1 --2- 172.21.15.17:0/2021039465 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf3407af40 0x7fdf3407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:08.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.802+0000 7fdf45d9b640 1 --2- 172.21.15.17:0/2021039465 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf3407af40 0x7fdf3407d400 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdf48075f80 tx=0x7fdf30008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:08.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:08.806+0000 7fdf3f7fe640 1 -- 172.21.15.17:0/2021039465 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdf400c4020 con 0x7fdf48101900 2024-09-20T19:13:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.011+0000 7fdf4ca84640 1 -- 172.21.15.17:0/2021039465 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fdf48062630 con 0x7fdf3407af40 2024-09-20T19:13:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.012+0000 7fdf3f7fe640 1 -- 172.21.15.17:0/2021039465 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fdf48062630 con 0x7fdf3407af40 2024-09-20T19:13:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.014+0000 7fdf4ca84640 1 -- 172.21.15.17:0/2021039465 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf3407af40 msgr2=0x7fdf3407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.014+0000 7fdf4ca84640 1 --2- 172.21.15.17:0/2021039465 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf3407af40 0x7fdf3407d400 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdf48075f80 tx=0x7fdf30008040 comp rx=0 tx=0).stop 2024-09-20T19:13:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.014+0000 7fdf4ca84640 1 -- 172.21.15.17:0/2021039465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf48101900 msgr2=0x7fdf480744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.014+0000 7fdf4ca84640 1 --2- 172.21.15.17:0/2021039465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf48101900 0x7fdf480744f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fdf40031460 tx=0x7fdf400048f0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.014+0000 7fdf4ca84640 1 -- 172.21.15.17:0/2021039465 shutdown_connections 2024-09-20T19:13:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.014+0000 7fdf4ca84640 1 --2- 172.21.15.17:0/2021039465 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdf3407af40 0x7fdf3407d400 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.014+0000 7fdf4ca84640 1 --2- 172.21.15.17:0/2021039465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf48107900 0x7fdf48074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.014+0000 7fdf4ca84640 1 --2- 172.21.15.17:0/2021039465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf48101900 0x7fdf480744f0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.014+0000 7fdf4ca84640 1 -- 172.21.15.17:0/2021039465 >> 172.21.15.17:0/2021039465 conn(0x7fdf480fd5e0 msgr2=0x7fdf480fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.014+0000 7fdf4ca84640 1 -- 172.21.15.17:0/2021039465 shutdown_connections 2024-09-20T19:13:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.014+0000 7fdf4ca84640 1 -- 172.21.15.17:0/2021039465 wait complete. 2024-09-20T19:13:09.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.098+0000 7fb8f302e640 1 -- 172.21.15.17:0/549013389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec102b20 msgr2=0x7fb8ec102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.098+0000 7fb8f302e640 1 --2- 172.21.15.17:0/549013389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec102b20 0x7fb8ec102f00 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00098b0 tx=0x7fb8e002a560 comp rx=0 tx=0).stop 2024-09-20T19:13:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.098+0000 7fb8f302e640 1 -- 172.21.15.17:0/549013389 shutdown_connections 2024-09-20T19:13:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.098+0000 7fb8f302e640 1 --2- 172.21.15.17:0/549013389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ec103440 0x7fb8ec10b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.098+0000 7fb8f302e640 1 --2- 172.21.15.17:0/549013389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec102b20 0x7fb8ec102f00 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.098+0000 7fb8f302e640 1 -- 172.21.15.17:0/549013389 >> 172.21.15.17:0/549013389 conn(0x7fb8ec0fc520 msgr2=0x7fb8ec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.098+0000 7fb8f302e640 1 -- 172.21.15.17:0/549013389 shutdown_connections 2024-09-20T19:13:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.098+0000 7fb8f302e640 1 -- 172.21.15.17:0/549013389 wait complete. 2024-09-20T19:13:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.099+0000 7fb8f302e640 1 Processor -- start 2024-09-20T19:13:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.099+0000 7fb8f302e640 1 -- start start 2024-09-20T19:13:09.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.099+0000 7fb8f302e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ec102b20 0x7fb8ec19d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:09.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.099+0000 7fb8f302e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec103440 0x7fb8ec19dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:09.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.099+0000 7fb8f302e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec10ee50 con 0x7fb8ec103440 2024-09-20T19:13:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.099+0000 7fb8f302e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec10ecd0 con 0x7fb8ec102b20 2024-09-20T19:13:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.099+0000 7fb8ebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec103440 0x7fb8ec19dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.099+0000 7fb8ebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec103440 0x7fb8ec19dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33470/0 (socket says 172.21.15.17:33470) 2024-09-20T19:13:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.099+0000 7fb8ebfff640 1 -- 172.21.15.17:0/1501913562 learned_addr learned my addr 172.21.15.17:0/1501913562 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:13:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.099+0000 7fb8f0dca640 1 --2- 172.21.15.17:0/1501913562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ec102b20 0x7fb8ec19d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.100+0000 7fb8ebfff640 1 -- 172.21.15.17:0/1501913562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ec102b20 msgr2=0x7fb8ec19d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.100+0000 7fb8ebfff640 1 --2- 172.21.15.17:0/1501913562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ec102b20 0x7fb8ec19d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.100+0000 7fb8ebfff640 1 -- 172.21.15.17:0/1501913562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ec1978a0 con 0x7fb8ec103440 2024-09-20T19:13:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.100+0000 7fb8ebfff640 1 --2- 172.21.15.17:0/1501913562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec103440 0x7fb8ec19dc20 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800b420 tx=0x7fb8d800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.100+0000 7fb8e9ffb640 1 -- 172.21.15.17:0/1501913562 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb8d8011630 con 0x7fb8ec103440 2024-09-20T19:13:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.100+0000 7fb8e9ffb640 1 -- 172.21.15.17:0/1501913562 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb8d8016070 con 0x7fb8ec103440 2024-09-20T19:13:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.100+0000 7fb8e9ffb640 1 -- 172.21.15.17:0/1501913562 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb8d8010d40 con 0x7fb8ec103440 2024-09-20T19:13:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.100+0000 7fb8f302e640 1 -- 172.21.15.17:0/1501913562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8ec197b90 con 0x7fb8ec103440 2024-09-20T19:13:09.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.100+0000 7fb8f302e640 1 -- 172.21.15.17:0/1501913562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8ec198120 con 0x7fb8ec103440 2024-09-20T19:13:09.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.102+0000 7fb8f302e640 1 -- 172.21.15.17:0/1501913562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8ec06aa30 con 0x7fb8ec103440 2024-09-20T19:13:09.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.102+0000 7fb8e9ffb640 1 -- 172.21.15.17:0/1501913562 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb8d801b460 con 0x7fb8ec103440 2024-09-20T19:13:09.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.103+0000 7fb8e9ffb640 1 --2- 172.21.15.17:0/1501913562 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb8dc07af30 0x7fb8dc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:09.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.103+0000 7fb8e9ffb640 1 -- 172.21.15.17:0/1501913562 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fb8d809d740 con 0x7fb8ec103440 2024-09-20T19:13:09.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.103+0000 7fb8f0dca640 1 --2- 172.21.15.17:0/1501913562 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb8dc07af30 0x7fb8dc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:09.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.103+0000 7fb8f0dca640 1 --2- 172.21.15.17:0/1501913562 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb8dc07af30 0x7fb8dc07d3f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009230 tx=0x7fb8e0031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:09.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.107+0000 7fb8e9ffb640 1 -- 172.21.15.17:0/1501913562 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb8d8021250 con 0x7fb8ec103440 2024-09-20T19:13:09.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.304+0000 7fb8f302e640 1 -- 172.21.15.17:0/1501913562 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb8ec198dd0 con 0x7fb8dc07af30 2024-09-20T19:13:09.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.313+0000 7fb8e9ffb640 1 -- 172.21.15.17:0/1501913562 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb8ec198dd0 con 0x7fb8dc07af30 2024-09-20T19:13:09.315 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:13:09.315 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (34m) 13m ago 45m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:13:09.315 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (37m) 13m ago 45m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:13:09.315 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (37m) 13m ago 44m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:13:09.316 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (32m) 13m ago 45m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:13:09.316 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (32m) 13m ago 44m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:13:09.316 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (34m) 13m ago 45m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:13:09.316 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (29m) 13m ago 40m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:13:09.316 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (28m) 13m ago 40m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:13:09.316 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (13m) 13m ago 40m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:13:09.316 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (28m) 13m ago 40m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:13:09.316 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (36m) 13m ago 46m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:13:09.316 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (35m) 13m ago 44m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:13:09.316 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (33m) 13m ago 46m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:13:09.316 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (33m) 13m ago 44m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:13:09.316 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (35m) 13m ago 45m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:13:09.316 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (35m) 13m ago 44m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:13:09.316 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (32m) 13m ago 43m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:13:09.317 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (31m) 13m ago 43m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:13:09.323 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (31m) 13m ago 42m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:13:09.323 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (30m) 13m ago 42m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:13:09.323 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (29m) 13m ago 41m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:13:09.323 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (29m) 13m ago 41m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:13:09.323 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (34m) 13m ago 45m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:13:09.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.316+0000 7fb8f302e640 1 -- 172.21.15.17:0/1501913562 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb8dc07af30 msgr2=0x7fb8dc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:09.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.316+0000 7fb8f302e640 1 --2- 172.21.15.17:0/1501913562 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb8dc07af30 0x7fb8dc07d3f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009230 tx=0x7fb8e0031400 comp rx=0 tx=0).stop 2024-09-20T19:13:09.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.316+0000 7fb8f302e640 1 -- 172.21.15.17:0/1501913562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec103440 msgr2=0x7fb8ec19dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:09.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.316+0000 7fb8f302e640 1 --2- 172.21.15.17:0/1501913562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec103440 0x7fb8ec19dc20 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800b420 tx=0x7fb8d800b8e0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.316+0000 7fb8f302e640 1 -- 172.21.15.17:0/1501913562 shutdown_connections 2024-09-20T19:13:09.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.316+0000 7fb8f302e640 1 --2- 172.21.15.17:0/1501913562 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb8dc07af30 0x7fb8dc07d3f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.316+0000 7fb8f302e640 1 --2- 172.21.15.17:0/1501913562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ec103440 0x7fb8ec19dc20 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.316+0000 7fb8f302e640 1 --2- 172.21.15.17:0/1501913562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ec102b20 0x7fb8ec19d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.316+0000 7fb8f302e640 1 -- 172.21.15.17:0/1501913562 >> 172.21.15.17:0/1501913562 conn(0x7fb8ec0fc520 msgr2=0x7fb8ec108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:09.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.316+0000 7fb8f302e640 1 -- 172.21.15.17:0/1501913562 shutdown_connections 2024-09-20T19:13:09.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.316+0000 7fb8f302e640 1 -- 172.21.15.17:0/1501913562 wait complete. 2024-09-20T19:13:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.399+0000 7f7e97855640 1 -- 172.21.15.17:0/780543064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e901007f0 msgr2=0x7f7e90100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.399+0000 7f7e97855640 1 --2- 172.21.15.17:0/780543064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e901007f0 0x7f7e90100c50 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009880 tx=0x7f7e8402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.399+0000 7f7e97855640 1 -- 172.21.15.17:0/780543064 shutdown_connections 2024-09-20T19:13:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.399+0000 7f7e97855640 1 --2- 172.21.15.17:0/780543064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e901007f0 0x7f7e90100c50 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.399+0000 7f7e97855640 1 --2- 172.21.15.17:0/780543064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e901067f0 0x7f7e90106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.399+0000 7f7e97855640 1 -- 172.21.15.17:0/780543064 >> 172.21.15.17:0/780543064 conn(0x7f7e900fc550 msgr2=0x7f7e900fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.399+0000 7f7e97855640 1 -- 172.21.15.17:0/780543064 shutdown_connections 2024-09-20T19:13:09.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.399+0000 7f7e97855640 1 -- 172.21.15.17:0/780543064 wait complete. 2024-09-20T19:13:09.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.399+0000 7f7e97855640 1 Processor -- start 2024-09-20T19:13:09.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.400+0000 7f7e97855640 1 -- start start 2024-09-20T19:13:09.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.400+0000 7f7e97855640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e901007f0 0x7f7e9019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:09.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.400+0000 7f7e97855640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e901067f0 0x7f7e9019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:09.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.400+0000 7f7e97855640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9010dcc0 con 0x7f7e901067f0 2024-09-20T19:13:09.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.400+0000 7f7e97855640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9010db40 con 0x7f7e901007f0 2024-09-20T19:13:09.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.400+0000 7f7e94df0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e901067f0 0x7f7e9019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:09.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.400+0000 7f7e94df0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e901067f0 0x7f7e9019dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33474/0 (socket says 172.21.15.17:33474) 2024-09-20T19:13:09.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.400+0000 7f7e94df0640 1 -- 172.21.15.17:0/922921206 learned_addr learned my addr 172.21.15.17:0/922921206 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:13:09.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.400+0000 7f7e955f1640 1 --2- 172.21.15.17:0/922921206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e901007f0 0x7f7e9019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:09.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.400+0000 7f7e94df0640 1 -- 172.21.15.17:0/922921206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e901007f0 msgr2=0x7f7e9019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:09.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.400+0000 7f7e94df0640 1 --2- 172.21.15.17:0/922921206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e901007f0 0x7f7e9019d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.400+0000 7f7e94df0640 1 -- 172.21.15.17:0/922921206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e901977e0 con 0x7f7e901067f0 2024-09-20T19:13:09.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.400+0000 7f7e94df0640 1 --2- 172.21.15.17:0/922921206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e901067f0 0x7f7e9019dba0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f7e84031460 tx=0x7f7e840045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:09.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.401+0000 7f7e8e7fc640 1 -- 172.21.15.17:0/922921206 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7e8403f070 con 0x7f7e901067f0 2024-09-20T19:13:09.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.401+0000 7f7e8e7fc640 1 -- 172.21.15.17:0/922921206 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7e840035f0 con 0x7f7e901067f0 2024-09-20T19:13:09.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.401+0000 7f7e97855640 1 -- 172.21.15.17:0/922921206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e90197a70 con 0x7f7e901067f0 2024-09-20T19:13:09.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.401+0000 7f7e8e7fc640 1 -- 172.21.15.17:0/922921206 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7e84035030 con 0x7f7e901067f0 2024-09-20T19:13:09.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.401+0000 7f7e97855640 1 -- 172.21.15.17:0/922921206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e90197fa0 con 0x7f7e901067f0 2024-09-20T19:13:09.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.402+0000 7f7e97855640 1 -- 172.21.15.17:0/922921206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e90101f30 con 0x7f7e901067f0 2024-09-20T19:13:09.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.402+0000 7f7e8e7fc640 1 -- 172.21.15.17:0/922921206 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7e84042070 con 0x7f7e901067f0 2024-09-20T19:13:09.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.403+0000 7f7e8e7fc640 1 --2- 172.21.15.17:0/922921206 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e7807af30 0x7f7e7807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:09.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.403+0000 7f7e8e7fc640 1 -- 172.21.15.17:0/922921206 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f7e840be970 con 0x7f7e901067f0 2024-09-20T19:13:09.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.403+0000 7f7e955f1640 1 --2- 172.21.15.17:0/922921206 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e7807af30 0x7f7e7807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:09.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.403+0000 7f7e955f1640 1 --2- 172.21.15.17:0/922921206 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e7807af30 0x7f7e7807d3f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f7e80005fd0 tx=0x7f7e8000b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:09.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.407+0000 7f7e8e7fc640 1 -- 172.21.15.17:0/922921206 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7e840c0e20 con 0x7f7e901067f0 2024-09-20T19:13:09.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.674+0000 7f7e97855640 1 -- 172.21.15.17:0/922921206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7e90198d10 con 0x7f7e901067f0 2024-09-20T19:13:09.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.674+0000 7f7e8e7fc640 1 -- 172.21.15.17:0/922921206 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f7e84089f70 con 0x7f7e901067f0 2024-09-20T19:13:09.676 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:13:09.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:13:09.676 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:13:09.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:13:09.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:13:09.676 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:13:09.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:13:09.677 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:13:09.677 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:13:09.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:13:09.677 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:13:09.677 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:13:09.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:13:09.677 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:13:09.677 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:13:09.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:13:09.677 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:13:09.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.676+0000 7f7e97855640 1 -- 172.21.15.17:0/922921206 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e7807af30 msgr2=0x7f7e7807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:09.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.676+0000 7f7e97855640 1 --2- 172.21.15.17:0/922921206 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e7807af30 0x7f7e7807d3f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f7e80005fd0 tx=0x7f7e8000b390 comp rx=0 tx=0).stop 2024-09-20T19:13:09.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.676+0000 7f7e97855640 1 -- 172.21.15.17:0/922921206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e901067f0 msgr2=0x7f7e9019dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:09.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.676+0000 7f7e97855640 1 --2- 172.21.15.17:0/922921206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e901067f0 0x7f7e9019dba0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f7e84031460 tx=0x7f7e840045e0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.677+0000 7f7e97855640 1 -- 172.21.15.17:0/922921206 shutdown_connections 2024-09-20T19:13:09.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.677+0000 7f7e97855640 1 --2- 172.21.15.17:0/922921206 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7e7807af30 0x7f7e7807d3f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.677+0000 7f7e97855640 1 --2- 172.21.15.17:0/922921206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e901067f0 0x7f7e9019dba0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.677+0000 7f7e97855640 1 --2- 172.21.15.17:0/922921206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e901007f0 0x7f7e9019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.677+0000 7f7e97855640 1 -- 172.21.15.17:0/922921206 >> 172.21.15.17:0/922921206 conn(0x7f7e900fc550 msgr2=0x7f7e90069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:09.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.677+0000 7f7e97855640 1 -- 172.21.15.17:0/922921206 shutdown_connections 2024-09-20T19:13:09.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.677+0000 7f7e97855640 1 -- 172.21.15.17:0/922921206 wait complete. 2024-09-20T19:13:09.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.763+0000 7f0d1e838640 1 -- 172.21.15.17:0/1980691231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d18106800 msgr2=0x7f0d18106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:09.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.763+0000 7f0d1e838640 1 --2- 172.21.15.17:0/1980691231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d18106800 0x7f0d18106be0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009880 tx=0x7f0d0802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.763+0000 7f0d1e838640 1 -- 172.21.15.17:0/1980691231 shutdown_connections 2024-09-20T19:13:09.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.763+0000 7f0d1e838640 1 --2- 172.21.15.17:0/1980691231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d18100800 0x7f0d18100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.763+0000 7f0d1e838640 1 --2- 172.21.15.17:0/1980691231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d18106800 0x7f0d18106be0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.763+0000 7f0d1e838640 1 -- 172.21.15.17:0/1980691231 >> 172.21.15.17:0/1980691231 conn(0x7f0d180fc520 msgr2=0x7f0d180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:09.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.763+0000 7f0d1e838640 1 -- 172.21.15.17:0/1980691231 shutdown_connections 2024-09-20T19:13:09.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.763+0000 7f0d1e838640 1 -- 172.21.15.17:0/1980691231 wait complete. 2024-09-20T19:13:09.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.764+0000 7f0d1e838640 1 Processor -- start 2024-09-20T19:13:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.764+0000 7f0d1e838640 1 -- start start 2024-09-20T19:13:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.765+0000 7f0d1e838640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d18100800 0x7f0d1819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.765+0000 7f0d1e838640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d18106800 0x7f0d1819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.765+0000 7f0d1e838640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1810dd30 con 0x7f0d18100800 2024-09-20T19:13:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.765+0000 7f0d1e838640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1810dbb0 con 0x7f0d18106800 2024-09-20T19:13:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.765+0000 7f0d17fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d18100800 0x7f0d1819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.765+0000 7f0d17fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d18100800 0x7f0d1819c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33492/0 (socket says 172.21.15.17:33492) 2024-09-20T19:13:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.765+0000 7f0d17fff640 1 -- 172.21.15.17:0/552808124 learned_addr learned my addr 172.21.15.17:0/552808124 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:13:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.765+0000 7f0d177fe640 1 --2- 172.21.15.17:0/552808124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d18106800 0x7f0d1819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.765+0000 7f0d17fff640 1 -- 172.21.15.17:0/552808124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d18106800 msgr2=0x7f0d1819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.765+0000 7f0d17fff640 1 --2- 172.21.15.17:0/552808124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d18106800 0x7f0d1819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.765+0000 7f0d17fff640 1 -- 172.21.15.17:0/552808124 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d18196740 con 0x7f0d18100800 2024-09-20T19:13:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.766+0000 7f0d17fff640 1 --2- 172.21.15.17:0/552808124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d18100800 0x7f0d1819c670 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0d08031460 tx=0x7f0d080048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.766+0000 7f0d157fa640 1 -- 172.21.15.17:0/552808124 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d08035070 con 0x7f0d18100800 2024-09-20T19:13:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.766+0000 7f0d157fa640 1 -- 172.21.15.17:0/552808124 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d08004c70 con 0x7f0d18100800 2024-09-20T19:13:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.766+0000 7f0d1e838640 1 -- 172.21.15.17:0/552808124 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d181969d0 con 0x7f0d18100800 2024-09-20T19:13:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.766+0000 7f0d1e838640 1 -- 172.21.15.17:0/552808124 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d18196ed0 con 0x7f0d18100800 2024-09-20T19:13:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.766+0000 7f0d157fa640 1 -- 172.21.15.17:0/552808124 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d08031860 con 0x7f0d18100800 2024-09-20T19:13:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.767+0000 7f0d1e838640 1 -- 172.21.15.17:0/552808124 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d18101f40 con 0x7f0d18100800 2024-09-20T19:13:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.767+0000 7f0d157fa640 1 -- 172.21.15.17:0/552808124 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0d08031b60 con 0x7f0d18100800 2024-09-20T19:13:09.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.768+0000 7f0d157fa640 1 --2- 172.21.15.17:0/552808124 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0d0007af30 0x7f0d0007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:09.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.768+0000 7f0d157fa640 1 -- 172.21.15.17:0/552808124 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f0d0803e070 con 0x7f0d18100800 2024-09-20T19:13:09.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.768+0000 7f0d177fe640 1 --2- 172.21.15.17:0/552808124 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0d0007af30 0x7f0d0007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:09.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.769+0000 7f0d177fe640 1 --2- 172.21.15.17:0/552808124 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0d0007af30 0x7f0d0007d3f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0d18197f90 tx=0x7f0d0c009110 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:09.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.772+0000 7f0d157fa640 1 -- 172.21.15.17:0/552808124 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0d0808bc20 con 0x7f0d18100800 2024-09-20T19:13:10.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.999+0000 7f0d1e838640 1 -- 172.21.15.17:0/552808124 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f0d18197180 con 0x7f0d18100800 2024-09-20T19:13:10.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:09.999+0000 7f0d157fa640 1 -- 172.21.15.17:0/552808124 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7f0d08090ad0 con 0x7f0d18100800 2024-09-20T19:13:10.001 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:13:10.001 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:13:10.001 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:13:10.002 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:13:10.002 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:13:10.002 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:13:10.002 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:13:10.002 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:13:10.002 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:13:10.002 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:13:10.002 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:13:10.002 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:13:10.002 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:13:10.002 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:13:10.002 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:13:10.002 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:13:10.003 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:13:10.003 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:13:10.003 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:13:10.003 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:13:10.003 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:13:10.003 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:13:10.003 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:13:10.003 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:13:10.003 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:13:10.003 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:13:10.003 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:13:10.003 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:13:10.003 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:13:10.003 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:13:10.003 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:13:10.004 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:13:10.004 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:13:10.004 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:13:10.004 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:13:10.004 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:13:10.004 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:13:10.004 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:13:10.004 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:13:10.004 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:13:10.004 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:13:10.004 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:13:10.004 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:13:10.005 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:13:10.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.001+0000 7f0d1e838640 1 -- 172.21.15.17:0/552808124 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0d0007af30 msgr2=0x7f0d0007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:10.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.001+0000 7f0d1e838640 1 --2- 172.21.15.17:0/552808124 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0d0007af30 0x7f0d0007d3f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0d18197f90 tx=0x7f0d0c009110 comp rx=0 tx=0).stop 2024-09-20T19:13:10.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.001+0000 7f0d1e838640 1 -- 172.21.15.17:0/552808124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d18100800 msgr2=0x7f0d1819c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:10.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.001+0000 7f0d1e838640 1 --2- 172.21.15.17:0/552808124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d18100800 0x7f0d1819c670 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0d08031460 tx=0x7f0d080048f0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.001+0000 7f0d1e838640 1 -- 172.21.15.17:0/552808124 shutdown_connections 2024-09-20T19:13:10.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.001+0000 7f0d1e838640 1 --2- 172.21.15.17:0/552808124 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f0d0007af30 0x7f0d0007d3f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.001+0000 7f0d1e838640 1 --2- 172.21.15.17:0/552808124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d18106800 0x7f0d1819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.001+0000 7f0d1e838640 1 --2- 172.21.15.17:0/552808124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d18100800 0x7f0d1819c670 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.001+0000 7f0d1e838640 1 -- 172.21.15.17:0/552808124 >> 172.21.15.17:0/552808124 conn(0x7f0d180fc520 msgr2=0x7f0d180fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:10.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.001+0000 7f0d1e838640 1 -- 172.21.15.17:0/552808124 shutdown_connections 2024-09-20T19:13:10.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.002+0000 7f0d1e838640 1 -- 172.21.15.17:0/552808124 wait complete. 2024-09-20T19:13:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.086+0000 7f8efa7c0640 1 -- 172.21.15.17:0/2705768187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ef4102b50 msgr2=0x7f8ef4102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.086+0000 7f8efa7c0640 1 --2- 172.21.15.17:0/2705768187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ef4102b50 0x7f8ef4102f30 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4009880 tx=0x7f8ee402a530 comp rx=0 tx=0).stop 2024-09-20T19:13:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.086+0000 7f8efa7c0640 1 -- 172.21.15.17:0/2705768187 shutdown_connections 2024-09-20T19:13:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.086+0000 7f8efa7c0640 1 --2- 172.21.15.17:0/2705768187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ef4103470 0x7f8ef410b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.086+0000 7f8efa7c0640 1 --2- 172.21.15.17:0/2705768187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ef4102b50 0x7f8ef4102f30 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.086+0000 7f8efa7c0640 1 -- 172.21.15.17:0/2705768187 >> 172.21.15.17:0/2705768187 conn(0x7f8ef40fc550 msgr2=0x7f8ef40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.086+0000 7f8efa7c0640 1 -- 172.21.15.17:0/2705768187 shutdown_connections 2024-09-20T19:13:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.087+0000 7f8efa7c0640 1 -- 172.21.15.17:0/2705768187 wait complete. 2024-09-20T19:13:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.087+0000 7f8efa7c0640 1 Processor -- start 2024-09-20T19:13:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.087+0000 7f8efa7c0640 1 -- start start 2024-09-20T19:13:10.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.087+0000 7f8efa7c0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ef4102b50 0x7f8ef419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:10.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.087+0000 7f8efa7c0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ef4103470 0x7f8ef419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:10.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.087+0000 7f8efa7c0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef410ee40 con 0x7f8ef4103470 2024-09-20T19:13:10.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.087+0000 7f8efa7c0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef410ecc0 con 0x7f8ef4102b50 2024-09-20T19:13:10.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.088+0000 7f8ef37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ef4103470 0x7f8ef419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:10.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.088+0000 7f8ef37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ef4103470 0x7f8ef419dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33518/0 (socket says 172.21.15.17:33518) 2024-09-20T19:13:10.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.088+0000 7f8ef37fe640 1 -- 172.21.15.17:0/3031274904 learned_addr learned my addr 172.21.15.17:0/3031274904 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:13:10.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.088+0000 7f8ef3fff640 1 --2- 172.21.15.17:0/3031274904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ef4102b50 0x7f8ef419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:10.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.088+0000 7f8ef37fe640 1 -- 172.21.15.17:0/3031274904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ef4102b50 msgr2=0x7f8ef419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:10.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.088+0000 7f8ef37fe640 1 --2- 172.21.15.17:0/3031274904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ef4102b50 0x7f8ef419d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.088+0000 7f8ef37fe640 1 -- 172.21.15.17:0/3031274904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef4197830 con 0x7f8ef4103470 2024-09-20T19:13:10.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.088+0000 7f8ef3fff640 1 --2- 172.21.15.17:0/3031274904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ef4102b50 0x7f8ef419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:13:10.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.088+0000 7f8ef37fe640 1 --2- 172.21.15.17:0/3031274904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ef4103470 0x7f8ef419dbf0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800b420 tx=0x7f8ee800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:10.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.088+0000 7f8ef17fa640 1 -- 172.21.15.17:0/3031274904 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ee8011630 con 0x7f8ef4103470 2024-09-20T19:13:10.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.088+0000 7f8efa7c0640 1 -- 172.21.15.17:0/3031274904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef4197b20 con 0x7f8ef4103470 2024-09-20T19:13:10.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.088+0000 7f8ef17fa640 1 -- 172.21.15.17:0/3031274904 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ee8016070 con 0x7f8ef4103470 2024-09-20T19:13:10.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.088+0000 7f8ef17fa640 1 -- 172.21.15.17:0/3031274904 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ee8010d40 con 0x7f8ef4103470 2024-09-20T19:13:10.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.088+0000 7f8efa7c0640 1 -- 172.21.15.17:0/3031274904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef41980b0 con 0x7f8ef4103470 2024-09-20T19:13:10.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.089+0000 7f8efa7c0640 1 -- 172.21.15.17:0/3031274904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ef406a4e0 con 0x7f8ef4103470 2024-09-20T19:13:10.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.090+0000 7f8ef17fa640 1 -- 172.21.15.17:0/3031274904 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8ee801b460 con 0x7f8ef4103470 2024-09-20T19:13:10.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.091+0000 7f8ef17fa640 1 --2- 172.21.15.17:0/3031274904 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8edc07af30 0x7f8edc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:10.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.091+0000 7f8ef17fa640 1 -- 172.21.15.17:0/3031274904 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f8ee809d7e0 con 0x7f8ef4103470 2024-09-20T19:13:10.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.091+0000 7f8ef3fff640 1 --2- 172.21.15.17:0/3031274904 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8edc07af30 0x7f8edc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:10.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.091+0000 7f8ef3fff640 1 --2- 172.21.15.17:0/3031274904 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8edc07af30 0x7f8edc07d3f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4000c00 tx=0x7f8ee4004f30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:10.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.095+0000 7f8ef17fa640 1 -- 172.21.15.17:0/3031274904 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8ee8021250 con 0x7f8ef4103470 2024-09-20T19:13:10.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.300+0000 7f8efa7c0640 1 -- 172.21.15.17:0/3031274904 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8ef41983c0 con 0x7f8edc07af30 2024-09-20T19:13:10.302 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:09 smithi017 ceph-mon[108970]: from='client.35856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:10.302 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:09 smithi017 ceph-mon[108970]: pgmap v1133: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:10.302 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:09 smithi017 ceph-mon[108970]: from='client.35860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:10.302 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:09 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/922921206' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:10.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.301+0000 7f8ef17fa640 1 -- 172.21.15.17:0/3031274904 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8ef41983c0 con 0x7f8edc07af30 2024-09-20T19:13:10.303 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:13:10.303 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:13:10.303 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:13:10.303 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:13:10.303 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:13:10.303 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:13:10.304 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:13:10.304 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:13:10.304 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:13:10.304 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:13:10.304 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:13:10.304 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:13:10.304 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:13:10.304 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:13:10.304 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:13:10.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.304+0000 7f8efa7c0640 1 -- 172.21.15.17:0/3031274904 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8edc07af30 msgr2=0x7f8edc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:10.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.304+0000 7f8efa7c0640 1 --2- 172.21.15.17:0/3031274904 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8edc07af30 0x7f8edc07d3f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4000c00 tx=0x7f8ee4004f30 comp rx=0 tx=0).stop 2024-09-20T19:13:10.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.304+0000 7f8efa7c0640 1 -- 172.21.15.17:0/3031274904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ef4103470 msgr2=0x7f8ef419dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:10.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.304+0000 7f8efa7c0640 1 --2- 172.21.15.17:0/3031274904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ef4103470 0x7f8ef419dbf0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800b420 tx=0x7f8ee800b8e0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.304+0000 7f8efa7c0640 1 -- 172.21.15.17:0/3031274904 shutdown_connections 2024-09-20T19:13:10.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.304+0000 7f8efa7c0640 1 --2- 172.21.15.17:0/3031274904 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8edc07af30 0x7f8edc07d3f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.304+0000 7f8efa7c0640 1 --2- 172.21.15.17:0/3031274904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ef4103470 0x7f8ef419dbf0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.304+0000 7f8efa7c0640 1 --2- 172.21.15.17:0/3031274904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ef4102b50 0x7f8ef419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.304+0000 7f8efa7c0640 1 -- 172.21.15.17:0/3031274904 >> 172.21.15.17:0/3031274904 conn(0x7f8ef40fc550 msgr2=0x7f8ef4108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:10.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.304+0000 7f8efa7c0640 1 -- 172.21.15.17:0/3031274904 shutdown_connections 2024-09-20T19:13:10.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.304+0000 7f8efa7c0640 1 -- 172.21.15.17:0/3031274904 wait complete. 2024-09-20T19:13:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.389+0000 7ff2509ca640 1 -- 172.21.15.17:0/985608384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff24c1007f0 msgr2=0x7ff24c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.389+0000 7ff2509ca640 1 --2- 172.21.15.17:0/985608384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff24c1007f0 0x7ff24c100c50 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ff234009880 tx=0x7ff23402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.389+0000 7ff2509ca640 1 -- 172.21.15.17:0/985608384 shutdown_connections 2024-09-20T19:13:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.389+0000 7ff2509ca640 1 --2- 172.21.15.17:0/985608384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff24c1007f0 0x7ff24c100c50 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.389+0000 7ff2509ca640 1 --2- 172.21.15.17:0/985608384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c1067f0 0x7ff24c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.389+0000 7ff2509ca640 1 -- 172.21.15.17:0/985608384 >> 172.21.15.17:0/985608384 conn(0x7ff24c0fc550 msgr2=0x7ff24c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:10.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.389+0000 7ff2509ca640 1 -- 172.21.15.17:0/985608384 shutdown_connections 2024-09-20T19:13:10.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.389+0000 7ff2509ca640 1 -- 172.21.15.17:0/985608384 wait complete. 2024-09-20T19:13:10.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.390+0000 7ff2509ca640 1 Processor -- start 2024-09-20T19:13:10.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.390+0000 7ff2509ca640 1 -- start start 2024-09-20T19:13:10.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.390+0000 7ff2509ca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff24c1007f0 0x7ff24c19f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:10.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.390+0000 7ff2509ca640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c1067f0 0x7ff24c19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:10.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.390+0000 7ff2509ca640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff24c10dcc0 con 0x7ff24c1007f0 2024-09-20T19:13:10.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.390+0000 7ff2509ca640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff24c10db40 con 0x7ff24c1067f0 2024-09-20T19:13:10.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.390+0000 7ff24a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff24c1007f0 0x7ff24c19f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:10.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.390+0000 7ff24a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff24c1007f0 0x7ff24c19f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33532/0 (socket says 172.21.15.17:33532) 2024-09-20T19:13:10.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.390+0000 7ff24a59c640 1 -- 172.21.15.17:0/2087292961 learned_addr learned my addr 172.21.15.17:0/2087292961 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:13:10.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.390+0000 7ff243fff640 1 --2- 172.21.15.17:0/2087292961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c1067f0 0x7ff24c19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:10.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.390+0000 7ff24a59c640 1 -- 172.21.15.17:0/2087292961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c1067f0 msgr2=0x7ff24c19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:10.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.390+0000 7ff24a59c640 1 --2- 172.21.15.17:0/2087292961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c1067f0 0x7ff24c19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.390+0000 7ff24a59c640 1 -- 172.21.15.17:0/2087292961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24c1999b0 con 0x7ff24c1007f0 2024-09-20T19:13:10.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.390+0000 7ff243fff640 1 --2- 172.21.15.17:0/2087292961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c1067f0 0x7ff24c19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:13:10.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.390+0000 7ff24a59c640 1 --2- 172.21.15.17:0/2087292961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff24c1007f0 0x7ff24c19f7f0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00d6f0 tx=0x7ff23c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:10.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.391+0000 7ff2437fe640 1 -- 172.21.15.17:0/2087292961 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff23c017070 con 0x7ff24c1007f0 2024-09-20T19:13:10.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.391+0000 7ff2509ca640 1 -- 172.21.15.17:0/2087292961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff24c199ca0 con 0x7ff24c1007f0 2024-09-20T19:13:10.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.391+0000 7ff2437fe640 1 -- 172.21.15.17:0/2087292961 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff23c00de00 con 0x7ff24c1007f0 2024-09-20T19:13:10.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.391+0000 7ff2437fe640 1 -- 172.21.15.17:0/2087292961 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff23c004bb0 con 0x7ff24c1007f0 2024-09-20T19:13:10.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.391+0000 7ff2509ca640 1 -- 172.21.15.17:0/2087292961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff24c19a230 con 0x7ff24c1007f0 2024-09-20T19:13:10.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.392+0000 7ff2509ca640 1 -- 172.21.15.17:0/2087292961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff24c101f30 con 0x7ff24c1007f0 2024-09-20T19:13:10.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.392+0000 7ff2437fe640 1 -- 172.21.15.17:0/2087292961 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff23c004e60 con 0x7ff24c1007f0 2024-09-20T19:13:10.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.393+0000 7ff2437fe640 1 --2- 172.21.15.17:0/2087292961 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff23807af30 0x7ff23807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:10.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.393+0000 7ff2437fe640 1 -- 172.21.15.17:0/2087292961 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7ff23c09dcf0 con 0x7ff24c1007f0 2024-09-20T19:13:10.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.393+0000 7ff243fff640 1 --2- 172.21.15.17:0/2087292961 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff23807af30 0x7ff23807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:10.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.394+0000 7ff243fff640 1 --2- 172.21.15.17:0/2087292961 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff23807af30 0x7ff23807d3f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff234031460 tx=0x7ff2340095f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:10.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.397+0000 7ff2437fe640 1 -- 172.21.15.17:0/2087292961 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff23c069250 con 0x7ff24c1007f0 2024-09-20T19:13:10.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:09 smithi172 ceph-mon[80431]: from='client.35856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:10.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:09 smithi172 ceph-mon[80431]: pgmap v1133: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:10.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:09 smithi172 ceph-mon[80431]: from='client.35860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:10.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:09 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/922921206' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:10.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.661+0000 7ff2509ca640 1 -- 172.21.15.17:0/2087292961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff24c19a4e0 con 0x7ff24c1007f0 2024-09-20T19:13:10.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.662+0000 7ff2437fe640 1 -- 172.21.15.17:0/2087292961 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7ff23c06e100 con 0x7ff24c1007f0 2024-09-20T19:13:10.664 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:13:10.664 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:13:10.664 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:13:10.664 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:13:10.664 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:13:10.664 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:13:10.664 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:13:10.664 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:13:10.665 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:13:10.665 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:13:10.665 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:13:10.665 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:13:10.665 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:13:10.665 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:13:10.665 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:13:10.665 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:13:10.665 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:13:10.665 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:13:10.665 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:13:10.666 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:13:10.666 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:13:10.666 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:13:10.666 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:13:10.666 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:13:10.666 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:13:10.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.664+0000 7ff2509ca640 1 -- 172.21.15.17:0/2087292961 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff23807af30 msgr2=0x7ff23807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:10.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.664+0000 7ff2509ca640 1 --2- 172.21.15.17:0/2087292961 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff23807af30 0x7ff23807d3f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff234031460 tx=0x7ff2340095f0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.664+0000 7ff2509ca640 1 -- 172.21.15.17:0/2087292961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff24c1007f0 msgr2=0x7ff24c19f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:10.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.664+0000 7ff2509ca640 1 --2- 172.21.15.17:0/2087292961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff24c1007f0 0x7ff24c19f7f0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00d6f0 tx=0x7ff23c00dbb0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.664+0000 7ff2509ca640 1 -- 172.21.15.17:0/2087292961 shutdown_connections 2024-09-20T19:13:10.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.664+0000 7ff2509ca640 1 --2- 172.21.15.17:0/2087292961 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ff23807af30 0x7ff23807d3f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.664+0000 7ff2509ca640 1 --2- 172.21.15.17:0/2087292961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c1067f0 0x7ff24c19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.664+0000 7ff2509ca640 1 --2- 172.21.15.17:0/2087292961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff24c1007f0 0x7ff24c19f7f0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:10.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.664+0000 7ff2509ca640 1 -- 172.21.15.17:0/2087292961 >> 172.21.15.17:0/2087292961 conn(0x7ff24c0fc550 msgr2=0x7ff24c0fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:10.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.664+0000 7ff2509ca640 1 -- 172.21.15.17:0/2087292961 shutdown_connections 2024-09-20T19:13:10.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:10.664+0000 7ff2509ca640 1 -- 172.21.15.17:0/2087292961 wait complete. 2024-09-20T19:13:11.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:10 smithi017 ceph-mon[108970]: from='client.35864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:11.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:10 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/552808124' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:13:11.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:10 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2087292961' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:13:11.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:10 smithi172 ceph-mon[80431]: from='client.35864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:11.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:10 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/552808124' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:13:11.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:10 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2087292961' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:13:12.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:11 smithi017 ceph-mon[108970]: from='client.35876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:12.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:11 smithi017 ceph-mon[108970]: pgmap v1134: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:12.441 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:11 smithi172 ceph-mon[80431]: from='client.35876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:12.441 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:11 smithi172 ceph-mon[80431]: pgmap v1134: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:14.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:13 smithi017 ceph-mon[108970]: pgmap v1135: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:14.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:13 smithi172 ceph-mon[80431]: pgmap v1135: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:16.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:16 smithi017 ceph-mon[108970]: pgmap v1136: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:16.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:16 smithi172 ceph-mon[80431]: pgmap v1136: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:18.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:18 smithi017 ceph-mon[108970]: pgmap v1137: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:18.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:18 smithi172 ceph-mon[80431]: pgmap v1137: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:20.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:20 smithi017 ceph-mon[108970]: pgmap v1138: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:20.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:20 smithi172 ceph-mon[80431]: pgmap v1138: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:22.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:22 smithi017 ceph-mon[108970]: pgmap v1139: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:22.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:22 smithi172 ceph-mon[80431]: pgmap v1139: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:23.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:23 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:13:23.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:23 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:13:24.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:24 smithi017 ceph-mon[108970]: pgmap v1140: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:24.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:24 smithi172 ceph-mon[80431]: pgmap v1140: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:26.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:26 smithi017 ceph-mon[108970]: pgmap v1141: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:26.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:26 smithi172 ceph-mon[80431]: pgmap v1141: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:28.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:28 smithi017 ceph-mon[108970]: pgmap v1142: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:28.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:28 smithi172 ceph-mon[80431]: pgmap v1142: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:30.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:30 smithi017 ceph-mon[108970]: pgmap v1143: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:30.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:30 smithi172 ceph-mon[80431]: pgmap v1143: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:32.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:32 smithi017 ceph-mon[108970]: pgmap v1144: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:32.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:32 smithi172 ceph-mon[80431]: pgmap v1144: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:33.637 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:33 smithi017 ceph-mon[108970]: pgmap v1145: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:33.696 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:33 smithi172 ceph-mon[80431]: pgmap v1145: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:36.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:35 smithi017 ceph-mon[108970]: pgmap v1146: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:36.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:35 smithi172 ceph-mon[80431]: pgmap v1146: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:38.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:37 smithi017 ceph-mon[108970]: pgmap v1147: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:38.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:13:38.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:37 smithi172 ceph-mon[80431]: pgmap v1147: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:38.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:13:40.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:39 smithi017 ceph-mon[108970]: pgmap v1148: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:40.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:39 smithi172 ceph-mon[80431]: pgmap v1148: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:40.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.760+0000 7f6cb8e41640 1 -- 172.21.15.17:0/493249721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cb4100800 msgr2=0x7f6cb4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:40.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.760+0000 7f6cb8e41640 1 --2- 172.21.15.17:0/493249721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cb4100800 0x7f6cb4100c60 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009880 tx=0x7f6ca802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:40.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.760+0000 7f6cb8e41640 1 -- 172.21.15.17:0/493249721 shutdown_connections 2024-09-20T19:13:40.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.760+0000 7f6cb8e41640 1 --2- 172.21.15.17:0/493249721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cb4100800 0x7f6cb4100c60 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:40.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.760+0000 7f6cb8e41640 1 --2- 172.21.15.17:0/493249721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cb4106800 0x7f6cb4106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:40.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.760+0000 7f6cb8e41640 1 -- 172.21.15.17:0/493249721 >> 172.21.15.17:0/493249721 conn(0x7f6cb40fc520 msgr2=0x7f6cb40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:40.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.760+0000 7f6cb8e41640 1 -- 172.21.15.17:0/493249721 shutdown_connections 2024-09-20T19:13:40.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.760+0000 7f6cb8e41640 1 -- 172.21.15.17:0/493249721 wait complete. 2024-09-20T19:13:40.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.761+0000 7f6cb8e41640 1 Processor -- start 2024-09-20T19:13:40.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.761+0000 7f6cb8e41640 1 -- start start 2024-09-20T19:13:40.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.762+0000 7f6cb8e41640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cb4100800 0x7f6cb419f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:40.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.762+0000 7f6cb8e41640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cb4106800 0x7f6cb419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:40.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.762+0000 7f6cb8e41640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb410dcd0 con 0x7f6cb4106800 2024-09-20T19:13:40.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.762+0000 7f6cb8e41640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb410db50 con 0x7f6cb4100800 2024-09-20T19:13:40.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.762+0000 7f6cb1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cb4106800 0x7f6cb419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:40.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.762+0000 7f6cb1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cb4106800 0x7f6cb419fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44940/0 (socket says 172.21.15.17:44940) 2024-09-20T19:13:40.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.762+0000 7f6cb1d9b640 1 -- 172.21.15.17:0/3442867099 learned_addr learned my addr 172.21.15.17:0/3442867099 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:13:40.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.762+0000 7f6cb259c640 1 --2- 172.21.15.17:0/3442867099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cb4100800 0x7f6cb419f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:40.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.762+0000 7f6cb1d9b640 1 -- 172.21.15.17:0/3442867099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cb4100800 msgr2=0x7f6cb419f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:40.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.762+0000 7f6cb1d9b640 1 --2- 172.21.15.17:0/3442867099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cb4100800 0x7f6cb419f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:40.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.762+0000 7f6cb1d9b640 1 -- 172.21.15.17:0/3442867099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb4199a20 con 0x7f6cb4106800 2024-09-20T19:13:40.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.762+0000 7f6cb1d9b640 1 --2- 172.21.15.17:0/3442867099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cb4106800 0x7f6cb419fda0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8031460 tx=0x7f6ca8004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:40.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.763+0000 7f6ca37fe640 1 -- 172.21.15.17:0/3442867099 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ca803f070 con 0x7f6cb4106800 2024-09-20T19:13:40.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.763+0000 7f6ca37fe640 1 -- 172.21.15.17:0/3442867099 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ca80035f0 con 0x7f6cb4106800 2024-09-20T19:13:40.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.763+0000 7f6cb8e41640 1 -- 172.21.15.17:0/3442867099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb4199cb0 con 0x7f6cb4106800 2024-09-20T19:13:40.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.763+0000 7f6ca37fe640 1 -- 172.21.15.17:0/3442867099 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ca8035030 con 0x7f6cb4106800 2024-09-20T19:13:40.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.763+0000 7f6cb8e41640 1 -- 172.21.15.17:0/3442867099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb419a1e0 con 0x7f6cb4106800 2024-09-20T19:13:40.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.764+0000 7f6cb8e41640 1 -- 172.21.15.17:0/3442867099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb4101f40 con 0x7f6cb4106800 2024-09-20T19:13:40.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.765+0000 7f6ca37fe640 1 -- 172.21.15.17:0/3442867099 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6ca8042070 con 0x7f6cb4106800 2024-09-20T19:13:40.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.765+0000 7f6ca37fe640 1 --2- 172.21.15.17:0/3442867099 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c9c07af80 0x7f6c9c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:40.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.765+0000 7f6ca37fe640 1 -- 172.21.15.17:0/3442867099 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f6ca80be830 con 0x7f6cb4106800 2024-09-20T19:13:40.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.765+0000 7f6cb259c640 1 --2- 172.21.15.17:0/3442867099 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c9c07af80 0x7f6c9c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:40.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.766+0000 7f6cb259c640 1 --2- 172.21.15.17:0/3442867099 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c9c07af80 0x7f6c9c07d440 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6cb419ab60 tx=0x7f6ca4005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:40.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.770+0000 7f6ca37fe640 1 -- 172.21.15.17:0/3442867099 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ca8089eb0 con 0x7f6cb4106800 2024-09-20T19:13:40.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.977+0000 7f6cb8e41640 1 -- 172.21.15.17:0/3442867099 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6cb419a490 con 0x7f6c9c07af80 2024-09-20T19:13:40.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.979+0000 7f6ca37fe640 1 -- 172.21.15.17:0/3442867099 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6cb419a490 con 0x7f6c9c07af80 2024-09-20T19:13:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.981+0000 7f6cb8e41640 1 -- 172.21.15.17:0/3442867099 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c9c07af80 msgr2=0x7f6c9c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.981+0000 7f6cb8e41640 1 --2- 172.21.15.17:0/3442867099 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c9c07af80 0x7f6c9c07d440 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6cb419ab60 tx=0x7f6ca4005f90 comp rx=0 tx=0).stop 2024-09-20T19:13:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.981+0000 7f6cb8e41640 1 -- 172.21.15.17:0/3442867099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cb4106800 msgr2=0x7f6cb419fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.981+0000 7f6cb8e41640 1 --2- 172.21.15.17:0/3442867099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cb4106800 0x7f6cb419fda0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8031460 tx=0x7f6ca8004530 comp rx=0 tx=0).stop 2024-09-20T19:13:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.981+0000 7f6cb8e41640 1 -- 172.21.15.17:0/3442867099 shutdown_connections 2024-09-20T19:13:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.981+0000 7f6cb8e41640 1 --2- 172.21.15.17:0/3442867099 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6c9c07af80 0x7f6c9c07d440 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.981+0000 7f6cb8e41640 1 --2- 172.21.15.17:0/3442867099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cb4106800 0x7f6cb419fda0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.981+0000 7f6cb8e41640 1 --2- 172.21.15.17:0/3442867099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cb4100800 0x7f6cb419f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.981+0000 7f6cb8e41640 1 -- 172.21.15.17:0/3442867099 >> 172.21.15.17:0/3442867099 conn(0x7f6cb40fc520 msgr2=0x7f6cb406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.981+0000 7f6cb8e41640 1 -- 172.21.15.17:0/3442867099 shutdown_connections 2024-09-20T19:13:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:40.981+0000 7f6cb8e41640 1 -- 172.21.15.17:0/3442867099 wait complete. 2024-09-20T19:13:40.991 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:13:41.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.066+0000 7f8c99a55640 1 -- 172.21.15.17:0/1397900057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c94100800 msgr2=0x7f8c94100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:41.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.066+0000 7f8c99a55640 1 --2- 172.21.15.17:0/1397900057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c94100800 0x7f8c94100c60 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f8c88009880 tx=0x7f8c8802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.066+0000 7f8c99a55640 1 -- 172.21.15.17:0/1397900057 shutdown_connections 2024-09-20T19:13:41.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.066+0000 7f8c99a55640 1 --2- 172.21.15.17:0/1397900057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c94100800 0x7f8c94100c60 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.066+0000 7f8c99a55640 1 --2- 172.21.15.17:0/1397900057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c94106800 0x7f8c94106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.066+0000 7f8c99a55640 1 -- 172.21.15.17:0/1397900057 >> 172.21.15.17:0/1397900057 conn(0x7f8c940fc520 msgr2=0x7f8c940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:41.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.066+0000 7f8c99a55640 1 -- 172.21.15.17:0/1397900057 shutdown_connections 2024-09-20T19:13:41.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.066+0000 7f8c99a55640 1 -- 172.21.15.17:0/1397900057 wait complete. 2024-09-20T19:13:41.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.067+0000 7f8c99a55640 1 Processor -- start 2024-09-20T19:13:41.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.067+0000 7f8c99a55640 1 -- start start 2024-09-20T19:13:41.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.067+0000 7f8c99a55640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c94100800 0x7f8c941987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:41.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.067+0000 7f8c99a55640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c94106800 0x7f8c94198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:41.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.067+0000 7f8c99a55640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9410dcd0 con 0x7f8c94106800 2024-09-20T19:13:41.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.067+0000 7f8c99a55640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9410db50 con 0x7f8c94100800 2024-09-20T19:13:41.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.068+0000 7f8c927fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c94106800 0x7f8c94198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:41.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.068+0000 7f8c927fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c94106800 0x7f8c94198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44952/0 (socket says 172.21.15.17:44952) 2024-09-20T19:13:41.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.068+0000 7f8c927fc640 1 -- 172.21.15.17:0/3552543062 learned_addr learned my addr 172.21.15.17:0/3552543062 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:13:41.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.068+0000 7f8c92ffd640 1 --2- 172.21.15.17:0/3552543062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c94100800 0x7f8c941987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:41.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.068+0000 7f8c927fc640 1 -- 172.21.15.17:0/3552543062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c94100800 msgr2=0x7f8c941987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:41.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.068+0000 7f8c927fc640 1 --2- 172.21.15.17:0/3552543062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c94100800 0x7f8c941987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.068+0000 7f8c927fc640 1 -- 172.21.15.17:0/3552543062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c94199320 con 0x7f8c94106800 2024-09-20T19:13:41.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.068+0000 7f8c927fc640 1 --2- 172.21.15.17:0/3552543062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c94106800 0x7f8c94198d20 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f8c88031460 tx=0x7f8c88004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:41.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.068+0000 7f8c98a53640 1 -- 172.21.15.17:0/3552543062 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c8803f070 con 0x7f8c94106800 2024-09-20T19:13:41.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.068+0000 7f8c99a55640 1 -- 172.21.15.17:0/3552543062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c941995b0 con 0x7f8c94106800 2024-09-20T19:13:41.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.068+0000 7f8c98a53640 1 -- 172.21.15.17:0/3552543062 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c88004a90 con 0x7f8c94106800 2024-09-20T19:13:41.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.068+0000 7f8c98a53640 1 -- 172.21.15.17:0/3552543062 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c88035030 con 0x7f8c94106800 2024-09-20T19:13:41.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.068+0000 7f8c99a55640 1 -- 172.21.15.17:0/3552543062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c941a1b60 con 0x7f8c94106800 2024-09-20T19:13:41.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.070+0000 7f8c99a55640 1 -- 172.21.15.17:0/3552543062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c94101f40 con 0x7f8c94106800 2024-09-20T19:13:41.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.070+0000 7f8c98a53640 1 -- 172.21.15.17:0/3552543062 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8c88042070 con 0x7f8c94106800 2024-09-20T19:13:41.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.071+0000 7f8c98a53640 1 --2- 172.21.15.17:0/3552543062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8c7c07af40 0x7f8c7c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:41.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.071+0000 7f8c98a53640 1 -- 172.21.15.17:0/3552543062 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f8c880bea50 con 0x7f8c94106800 2024-09-20T19:13:41.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.071+0000 7f8c92ffd640 1 --2- 172.21.15.17:0/3552543062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8c7c07af40 0x7f8c7c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:41.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.071+0000 7f8c92ffd640 1 --2- 172.21.15.17:0/3552543062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8c7c07af40 0x7f8c7c07d400 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009bd0 tx=0x7f8c84005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:41.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.075+0000 7f8c98a53640 1 -- 172.21.15.17:0/3552543062 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8c8808a050 con 0x7f8c94106800 2024-09-20T19:13:41.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.279+0000 7f8c99a55640 1 -- 172.21.15.17:0/3552543062 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8c94062630 con 0x7f8c7c07af40 2024-09-20T19:13:41.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.280+0000 7f8c98a53640 1 -- 172.21.15.17:0/3552543062 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8c94062630 con 0x7f8c7c07af40 2024-09-20T19:13:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.283+0000 7f8c99a55640 1 -- 172.21.15.17:0/3552543062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8c7c07af40 msgr2=0x7f8c7c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.283+0000 7f8c99a55640 1 --2- 172.21.15.17:0/3552543062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8c7c07af40 0x7f8c7c07d400 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009bd0 tx=0x7f8c84005f90 comp rx=0 tx=0).stop 2024-09-20T19:13:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.283+0000 7f8c99a55640 1 -- 172.21.15.17:0/3552543062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c94106800 msgr2=0x7f8c94198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.283+0000 7f8c99a55640 1 --2- 172.21.15.17:0/3552543062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c94106800 0x7f8c94198d20 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f8c88031460 tx=0x7f8c88004530 comp rx=0 tx=0).stop 2024-09-20T19:13:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.283+0000 7f8c99a55640 1 -- 172.21.15.17:0/3552543062 shutdown_connections 2024-09-20T19:13:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.283+0000 7f8c99a55640 1 --2- 172.21.15.17:0/3552543062 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f8c7c07af40 0x7f8c7c07d400 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.283+0000 7f8c99a55640 1 --2- 172.21.15.17:0/3552543062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c94106800 0x7f8c94198d20 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.283+0000 7f8c99a55640 1 --2- 172.21.15.17:0/3552543062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c94100800 0x7f8c941987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.283+0000 7f8c99a55640 1 -- 172.21.15.17:0/3552543062 >> 172.21.15.17:0/3552543062 conn(0x7f8c940fc520 msgr2=0x7f8c940fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:41.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.283+0000 7f8c99a55640 1 -- 172.21.15.17:0/3552543062 shutdown_connections 2024-09-20T19:13:41.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.283+0000 7f8c99a55640 1 -- 172.21.15.17:0/3552543062 wait complete. 2024-09-20T19:13:41.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.368+0000 7f8212da6640 1 -- 172.21.15.17:0/2173292529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f820c101900 msgr2=0x7f820c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:41.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.368+0000 7f8212da6640 1 --2- 172.21.15.17:0/2173292529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f820c101900 0x7f820c101d60 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009880 tx=0x7f81fc02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.368+0000 7f8212da6640 1 -- 172.21.15.17:0/2173292529 shutdown_connections 2024-09-20T19:13:41.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.368+0000 7f8212da6640 1 --2- 172.21.15.17:0/2173292529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f820c101900 0x7f820c101d60 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.368+0000 7f8212da6640 1 --2- 172.21.15.17:0/2173292529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f820c107900 0x7f820c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.368+0000 7f8212da6640 1 -- 172.21.15.17:0/2173292529 >> 172.21.15.17:0/2173292529 conn(0x7f820c0fd600 msgr2=0x7f820c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:41.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.368+0000 7f8212da6640 1 -- 172.21.15.17:0/2173292529 shutdown_connections 2024-09-20T19:13:41.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.368+0000 7f8212da6640 1 -- 172.21.15.17:0/2173292529 wait complete. 2024-09-20T19:13:41.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.369+0000 7f8212da6640 1 Processor -- start 2024-09-20T19:13:41.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.369+0000 7f8212da6640 1 -- start start 2024-09-20T19:13:41.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.369+0000 7f8212da6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f820c101900 0x7f820c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:41.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.369+0000 7f8212da6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f820c107900 0x7f820c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:41.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.369+0000 7f8212da6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f820c10edd0 con 0x7f820c107900 2024-09-20T19:13:41.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.369+0000 7f8212da6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f820c10ec50 con 0x7f820c101900 2024-09-20T19:13:41.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.369+0000 7f8203fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f820c107900 0x7f820c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:41.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.369+0000 7f8203fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f820c107900 0x7f820c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44962/0 (socket says 172.21.15.17:44962) 2024-09-20T19:13:41.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.369+0000 7f8203fff640 1 -- 172.21.15.17:0/140599322 learned_addr learned my addr 172.21.15.17:0/140599322 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:13:41.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.369+0000 7f8210b42640 1 --2- 172.21.15.17:0/140599322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f820c101900 0x7f820c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:41.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.369+0000 7f8203fff640 1 -- 172.21.15.17:0/140599322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f820c101900 msgr2=0x7f820c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:41.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.369+0000 7f8203fff640 1 --2- 172.21.15.17:0/140599322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f820c101900 0x7f820c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.369+0000 7f8203fff640 1 -- 172.21.15.17:0/140599322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820c197800 con 0x7f820c107900 2024-09-20T19:13:41.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.370+0000 7f8203fff640 1 --2- 172.21.15.17:0/140599322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f820c107900 0x7f820c19dbc0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f81fc031460 tx=0x7f81fc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:41.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.370+0000 7f8201ffb640 1 -- 172.21.15.17:0/140599322 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f81fc03f070 con 0x7f820c107900 2024-09-20T19:13:41.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.370+0000 7f8201ffb640 1 -- 172.21.15.17:0/140599322 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f81fc0035f0 con 0x7f820c107900 2024-09-20T19:13:41.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.370+0000 7f8212da6640 1 -- 172.21.15.17:0/140599322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820c197a90 con 0x7f820c107900 2024-09-20T19:13:41.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.370+0000 7f8201ffb640 1 -- 172.21.15.17:0/140599322 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f81fc035030 con 0x7f820c107900 2024-09-20T19:13:41.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.370+0000 7f8212da6640 1 -- 172.21.15.17:0/140599322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f820c197fc0 con 0x7f820c107900 2024-09-20T19:13:41.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.371+0000 7f8212da6640 1 -- 172.21.15.17:0/140599322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f820c103040 con 0x7f820c107900 2024-09-20T19:13:41.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.372+0000 7f8201ffb640 1 -- 172.21.15.17:0/140599322 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f81fc042070 con 0x7f820c107900 2024-09-20T19:13:41.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.372+0000 7f8201ffb640 1 --2- 172.21.15.17:0/140599322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f81f407af80 0x7f81f407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:41.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.373+0000 7f8210b42640 1 --2- 172.21.15.17:0/140599322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f81f407af80 0x7f81f407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:41.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.373+0000 7f8201ffb640 1 -- 172.21.15.17:0/140599322 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f81fc0be860 con 0x7f820c107900 2024-09-20T19:13:41.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.373+0000 7f8210b42640 1 --2- 172.21.15.17:0/140599322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f81f407af80 0x7f81f407d440 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8208005fd0 tx=0x7f820800b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:41.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.377+0000 7f8201ffb640 1 -- 172.21.15.17:0/140599322 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81fc089ee0 con 0x7f820c107900 2024-09-20T19:13:41.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.577+0000 7f8212da6640 1 -- 172.21.15.17:0/140599322 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f820c198330 con 0x7f81f407af80 2024-09-20T19:13:41.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.587+0000 7f8201ffb640 1 -- 172.21.15.17:0/140599322 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f820c198330 con 0x7f81f407af80 2024-09-20T19:13:41.589 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:13:41.589 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (35m) 13m ago 46m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:13:41.589 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (38m) 13m ago 46m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:13:41.589 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (37m) 13m ago 45m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:13:41.589 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (33m) 13m ago 46m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:13:41.589 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (33m) 13m ago 45m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:13:41.589 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (34m) 13m ago 45m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:13:41.589 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (29m) 13m ago 40m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:13:41.589 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (29m) 13m ago 40m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:13:41.589 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (13m) 13m ago 40m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:13:41.590 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (29m) 13m ago 40m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:13:41.590 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (37m) 13m ago 47m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:13:41.590 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (36m) 13m ago 45m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:13:41.590 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (33m) 13m ago 47m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:13:41.590 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (33m) 13m ago 45m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:13:41.590 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (35m) 13m ago 46m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:13:41.590 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (35m) 13m ago 45m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:13:41.590 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (32m) 13m ago 44m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:13:41.590 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (32m) 13m ago 43m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:13:41.590 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (31m) 13m ago 43m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:13:41.590 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (31m) 13m ago 42m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:13:41.591 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (30m) 13m ago 42m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:13:41.591 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (29m) 13m ago 41m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:13:41.591 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (35m) 13m ago 45m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:13:41.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.589+0000 7f8212da6640 1 -- 172.21.15.17:0/140599322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f81f407af80 msgr2=0x7f81f407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:41.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.589+0000 7f8212da6640 1 --2- 172.21.15.17:0/140599322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f81f407af80 0x7f81f407d440 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8208005fd0 tx=0x7f820800b390 comp rx=0 tx=0).stop 2024-09-20T19:13:41.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.589+0000 7f8212da6640 1 -- 172.21.15.17:0/140599322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f820c107900 msgr2=0x7f820c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:41.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.589+0000 7f8212da6640 1 --2- 172.21.15.17:0/140599322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f820c107900 0x7f820c19dbc0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f81fc031460 tx=0x7f81fc0045e0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.589+0000 7f8212da6640 1 -- 172.21.15.17:0/140599322 shutdown_connections 2024-09-20T19:13:41.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.589+0000 7f8212da6640 1 --2- 172.21.15.17:0/140599322 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f81f407af80 0x7f81f407d440 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.589+0000 7f8212da6640 1 --2- 172.21.15.17:0/140599322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f820c107900 0x7f820c19dbc0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.589+0000 7f8212da6640 1 --2- 172.21.15.17:0/140599322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f820c101900 0x7f820c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.589+0000 7f8212da6640 1 -- 172.21.15.17:0/140599322 >> 172.21.15.17:0/140599322 conn(0x7f820c0fd600 msgr2=0x7f820c0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:41.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.589+0000 7f8212da6640 1 -- 172.21.15.17:0/140599322 shutdown_connections 2024-09-20T19:13:41.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.589+0000 7f8212da6640 1 -- 172.21.15.17:0/140599322 wait complete. 2024-09-20T19:13:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.672+0000 7f0697221640 1 -- 172.21.15.17:0/145033729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06901033e0 msgr2=0x7f069010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.672+0000 7f0697221640 1 --2- 172.21.15.17:0/145033729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06901033e0 0x7f069010b8d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f0680009c20 tx=0x7f068002aa00 comp rx=0 tx=0).stop 2024-09-20T19:13:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.672+0000 7f0697221640 1 -- 172.21.15.17:0/145033729 shutdown_connections 2024-09-20T19:13:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.672+0000 7f0697221640 1 --2- 172.21.15.17:0/145033729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06901033e0 0x7f069010b8d0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.672+0000 7f0697221640 1 --2- 172.21.15.17:0/145033729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0690102ac0 0x7f0690102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.672+0000 7f0697221640 1 -- 172.21.15.17:0/145033729 >> 172.21.15.17:0/145033729 conn(0x7f06900fc520 msgr2=0x7f06900fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.672+0000 7f0697221640 1 -- 172.21.15.17:0/145033729 shutdown_connections 2024-09-20T19:13:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.672+0000 7f0697221640 1 -- 172.21.15.17:0/145033729 wait complete. 2024-09-20T19:13:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.673+0000 7f0697221640 1 Processor -- start 2024-09-20T19:13:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.673+0000 7f0697221640 1 -- start start 2024-09-20T19:13:41.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.673+0000 7f0697221640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0690102ac0 0x7f0690100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:41.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.673+0000 7f0697221640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06901033e0 0x7f0690100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:41.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.673+0000 7f0697221640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f069010edd0 con 0x7f0690102ac0 2024-09-20T19:13:41.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.673+0000 7f0697221640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f069010ec50 con 0x7f06901033e0 2024-09-20T19:13:41.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.673+0000 7f0694fbd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0690102ac0 0x7f0690100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:41.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.673+0000 7f0694fbd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0690102ac0 0x7f0690100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44988/0 (socket says 172.21.15.17:44988) 2024-09-20T19:13:41.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.673+0000 7f0694fbd640 1 -- 172.21.15.17:0/3666448114 learned_addr learned my addr 172.21.15.17:0/3666448114 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:13:41.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.674+0000 7f068ffff640 1 --2- 172.21.15.17:0/3666448114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06901033e0 0x7f0690100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:41.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.674+0000 7f0694fbd640 1 -- 172.21.15.17:0/3666448114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06901033e0 msgr2=0x7f0690100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:41.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.674+0000 7f0694fbd640 1 --2- 172.21.15.17:0/3666448114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06901033e0 0x7f0690100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.674+0000 7f0694fbd640 1 -- 172.21.15.17:0/3666448114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06901011a0 con 0x7f0690102ac0 2024-09-20T19:13:41.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.674+0000 7f0694fbd640 1 --2- 172.21.15.17:0/3666448114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0690102ac0 0x7f0690100720 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f067800d8d0 tx=0x7f067800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:41.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.674+0000 7f068dffb640 1 -- 172.21.15.17:0/3666448114 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0678017030 con 0x7f0690102ac0 2024-09-20T19:13:41.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.674+0000 7f068dffb640 1 -- 172.21.15.17:0/3666448114 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0678004020 con 0x7f0690102ac0 2024-09-20T19:13:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.674+0000 7f0697221640 1 -- 172.21.15.17:0/3666448114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0690101490 con 0x7f0690102ac0 2024-09-20T19:13:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.674+0000 7f068dffb640 1 -- 172.21.15.17:0/3666448114 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06780047a0 con 0x7f0690102ac0 2024-09-20T19:13:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.674+0000 7f0697221640 1 -- 172.21.15.17:0/3666448114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06901a3e60 con 0x7f0690102ac0 2024-09-20T19:13:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.675+0000 7f0697221640 1 -- 172.21.15.17:0/3666448114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f069006aa90 con 0x7f0690102ac0 2024-09-20T19:13:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.676+0000 7f068dffb640 1 -- 172.21.15.17:0/3666448114 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f06780041d0 con 0x7f0690102ac0 2024-09-20T19:13:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.677+0000 7f068dffb640 1 --2- 172.21.15.17:0/3666448114 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f067c07af90 0x7f067c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.677+0000 7f068ffff640 1 --2- 172.21.15.17:0/3666448114 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f067c07af90 0x7f067c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:41.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.677+0000 7f068dffb640 1 -- 172.21.15.17:0/3666448114 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f0678018070 con 0x7f0690102ac0 2024-09-20T19:13:41.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.677+0000 7f068ffff640 1 --2- 172.21.15.17:0/3666448114 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f067c07af90 0x7f067c07d450 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0680006010 tx=0x7f0680009380 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:41.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.681+0000 7f068dffb640 1 -- 172.21.15.17:0/3666448114 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0678069430 con 0x7f0690102ac0 2024-09-20T19:13:41.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.942+0000 7f0697221640 1 -- 172.21.15.17:0/3666448114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0690105f60 con 0x7f0690102ac0 2024-09-20T19:13:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.942+0000 7f068dffb640 1 -- 172.21.15.17:0/3666448114 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f067806e2e0 con 0x7f0690102ac0 2024-09-20T19:13:41.944 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:13:41.944 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:13:41.944 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:13:41.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:13:41.944 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:13:41.944 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:13:41.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:13:41.944 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:13:41.944 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:13:41.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:13:41.945 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:13:41.945 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:13:41.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:13:41.945 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:13:41.945 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:13:41.945 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:13:41.945 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:13:41.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.944+0000 7f0697221640 1 -- 172.21.15.17:0/3666448114 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f067c07af90 msgr2=0x7f067c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:41.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.944+0000 7f0697221640 1 --2- 172.21.15.17:0/3666448114 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f067c07af90 0x7f067c07d450 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0680006010 tx=0x7f0680009380 comp rx=0 tx=0).stop 2024-09-20T19:13:41.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.944+0000 7f0697221640 1 -- 172.21.15.17:0/3666448114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0690102ac0 msgr2=0x7f0690100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:41.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.944+0000 7f0697221640 1 --2- 172.21.15.17:0/3666448114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0690102ac0 0x7f0690100720 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f067800d8d0 tx=0x7f067800dd90 comp rx=0 tx=0).stop 2024-09-20T19:13:41.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.944+0000 7f0697221640 1 -- 172.21.15.17:0/3666448114 shutdown_connections 2024-09-20T19:13:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.944+0000 7f0697221640 1 --2- 172.21.15.17:0/3666448114 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f067c07af90 0x7f067c07d450 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.944+0000 7f0697221640 1 --2- 172.21.15.17:0/3666448114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06901033e0 0x7f0690100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.944+0000 7f0697221640 1 --2- 172.21.15.17:0/3666448114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0690102ac0 0x7f0690100720 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.944+0000 7f0697221640 1 -- 172.21.15.17:0/3666448114 >> 172.21.15.17:0/3666448114 conn(0x7f06900fc520 msgr2=0x7f0690108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.944+0000 7f0697221640 1 -- 172.21.15.17:0/3666448114 shutdown_connections 2024-09-20T19:13:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:41.945+0000 7f0697221640 1 -- 172.21.15.17:0/3666448114 wait complete. 2024-09-20T19:13:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.029+0000 7f89475ef640 1 -- 172.21.15.17:0/3871676488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8940106800 msgr2=0x7f8940106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.029+0000 7f89475ef640 1 --2- 172.21.15.17:0/3871676488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8940106800 0x7f8940106be0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f893c009880 tx=0x7f893c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.029+0000 7f89475ef640 1 -- 172.21.15.17:0/3871676488 shutdown_connections 2024-09-20T19:13:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.029+0000 7f89475ef640 1 --2- 172.21.15.17:0/3871676488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8940100800 0x7f8940100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.029+0000 7f89475ef640 1 --2- 172.21.15.17:0/3871676488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8940106800 0x7f8940106be0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.029+0000 7f89475ef640 1 -- 172.21.15.17:0/3871676488 >> 172.21.15.17:0/3871676488 conn(0x7f89400fc520 msgr2=0x7f89400fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.029+0000 7f89475ef640 1 -- 172.21.15.17:0/3871676488 shutdown_connections 2024-09-20T19:13:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.029+0000 7f89475ef640 1 -- 172.21.15.17:0/3871676488 wait complete. 2024-09-20T19:13:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.030+0000 7f89475ef640 1 Processor -- start 2024-09-20T19:13:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.030+0000 7f89475ef640 1 -- start start 2024-09-20T19:13:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.030+0000 7f89475ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8940100800 0x7f89400fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.030+0000 7f89475ef640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8940106800 0x7f89400fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.030+0000 7f89475ef640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f894010dcd0 con 0x7f8940100800 2024-09-20T19:13:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.030+0000 7f89475ef640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f894010db50 con 0x7f8940106800 2024-09-20T19:13:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.030+0000 7f894538b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8940100800 0x7f89400fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.030+0000 7f894538b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8940100800 0x7f89400fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44998/0 (socket says 172.21.15.17:44998) 2024-09-20T19:13:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.030+0000 7f894538b640 1 -- 172.21.15.17:0/4044482081 learned_addr learned my addr 172.21.15.17:0/4044482081 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:13:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.030+0000 7f8944b8a640 1 --2- 172.21.15.17:0/4044482081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8940106800 0x7f89400fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.031+0000 7f894538b640 1 -- 172.21.15.17:0/4044482081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8940106800 msgr2=0x7f89400fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.031+0000 7f894538b640 1 --2- 172.21.15.17:0/4044482081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8940106800 0x7f89400fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.031+0000 7f894538b640 1 -- 172.21.15.17:0/4044482081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89400fd650 con 0x7f8940100800 2024-09-20T19:13:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.031+0000 7f894538b640 1 --2- 172.21.15.17:0/4044482081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8940100800 0x7f89400fcbd0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f893c031460 tx=0x7f893c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.031+0000 7f89367fc640 1 -- 172.21.15.17:0/4044482081 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f893c03f070 con 0x7f8940100800 2024-09-20T19:13:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.031+0000 7f89367fc640 1 -- 172.21.15.17:0/4044482081 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f893c0035f0 con 0x7f8940100800 2024-09-20T19:13:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.031+0000 7f89475ef640 1 -- 172.21.15.17:0/4044482081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89400fd8e0 con 0x7f8940100800 2024-09-20T19:13:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.031+0000 7f89367fc640 1 -- 172.21.15.17:0/4044482081 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f893c035030 con 0x7f8940100800 2024-09-20T19:13:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.031+0000 7f89475ef640 1 -- 172.21.15.17:0/4044482081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89401a3d80 con 0x7f8940100800 2024-09-20T19:13:42.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.032+0000 7f89475ef640 1 -- 172.21.15.17:0/4044482081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8940101f40 con 0x7f8940100800 2024-09-20T19:13:42.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.033+0000 7f89367fc640 1 -- 172.21.15.17:0/4044482081 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f893c042070 con 0x7f8940100800 2024-09-20T19:13:42.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.033+0000 7f89367fc640 1 --2- 172.21.15.17:0/4044482081 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f892c07af80 0x7f892c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:42.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.034+0000 7f89367fc640 1 -- 172.21.15.17:0/4044482081 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f893c0be860 con 0x7f8940100800 2024-09-20T19:13:42.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.034+0000 7f8944b8a640 1 --2- 172.21.15.17:0/4044482081 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f892c07af80 0x7f892c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:42.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.034+0000 7f8944b8a640 1 --2- 172.21.15.17:0/4044482081 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f892c07af80 0x7f892c07d440 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f89400fe660 tx=0x7f893000b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.038+0000 7f89367fc640 1 -- 172.21.15.17:0/4044482081 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f893c089ee0 con 0x7f8940100800 2024-09-20T19:13:42.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:41 smithi017 ceph-mon[108970]: pgmap v1149: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:42.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:41 smithi017 ceph-mon[108970]: from='client.35884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:42.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:41 smithi172 ceph-mon[80431]: pgmap v1149: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:42.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:41 smithi172 ceph-mon[80431]: from='client.35884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:42.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.263+0000 7f89475ef640 1 -- 172.21.15.17:0/4044482081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8940109d80 con 0x7f8940100800 2024-09-20T19:13:42.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.264+0000 7f89367fc640 1 -- 172.21.15.17:0/4044482081 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7f893c08ed90 con 0x7f8940100800 2024-09-20T19:13:42.266 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:13:42.266 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:13:42.266 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:13:42.266 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:13:42.266 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:13:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:13:42.267 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:13:42.267 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:13:42.267 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:13:42.267 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:13:42.267 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:13:42.267 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:13:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:13:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:13:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:13:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:13:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:13:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:13:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:13:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:13:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:13:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:13:42.268 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:13:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:13:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:13:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:13:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:13:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:13:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:13:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:13:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:13:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:13:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:13:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:13:42.269 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:13:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:13:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:13:42.270 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:13:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:13:42.270 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:13:42.270 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:13:42.270 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:13:42.270 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:13:42.271 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:13:42.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.266+0000 7f89475ef640 1 -- 172.21.15.17:0/4044482081 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f892c07af80 msgr2=0x7f892c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:42.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.266+0000 7f89475ef640 1 --2- 172.21.15.17:0/4044482081 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f892c07af80 0x7f892c07d440 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f89400fe660 tx=0x7f893000b390 comp rx=0 tx=0).stop 2024-09-20T19:13:42.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.266+0000 7f89475ef640 1 -- 172.21.15.17:0/4044482081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8940100800 msgr2=0x7f89400fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:42.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.266+0000 7f89475ef640 1 --2- 172.21.15.17:0/4044482081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8940100800 0x7f89400fcbd0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f893c031460 tx=0x7f893c0045e0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.266+0000 7f89475ef640 1 -- 172.21.15.17:0/4044482081 shutdown_connections 2024-09-20T19:13:42.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.266+0000 7f89475ef640 1 --2- 172.21.15.17:0/4044482081 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f892c07af80 0x7f892c07d440 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.266+0000 7f89475ef640 1 --2- 172.21.15.17:0/4044482081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8940106800 0x7f89400fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.266+0000 7f89475ef640 1 --2- 172.21.15.17:0/4044482081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8940100800 0x7f89400fcbd0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.266+0000 7f89475ef640 1 -- 172.21.15.17:0/4044482081 >> 172.21.15.17:0/4044482081 conn(0x7f89400fc520 msgr2=0x7f894006a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:42.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.266+0000 7f89475ef640 1 -- 172.21.15.17:0/4044482081 shutdown_connections 2024-09-20T19:13:42.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.266+0000 7f89475ef640 1 -- 172.21.15.17:0/4044482081 wait complete. 2024-09-20T19:13:42.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.351+0000 7f65696f5640 1 -- 172.21.15.17:0/144043468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6564106800 msgr2=0x7f6564106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:42.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.351+0000 7f65696f5640 1 --2- 172.21.15.17:0/144043468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6564106800 0x7f6564106be0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f6554009880 tx=0x7f655402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.351+0000 7f65696f5640 1 -- 172.21.15.17:0/144043468 shutdown_connections 2024-09-20T19:13:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.351+0000 7f65696f5640 1 --2- 172.21.15.17:0/144043468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6564100800 0x7f6564100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.351+0000 7f65696f5640 1 --2- 172.21.15.17:0/144043468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6564106800 0x7f6564106be0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.351+0000 7f65696f5640 1 -- 172.21.15.17:0/144043468 >> 172.21.15.17:0/144043468 conn(0x7f65640fc520 msgr2=0x7f65640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.351+0000 7f65696f5640 1 -- 172.21.15.17:0/144043468 shutdown_connections 2024-09-20T19:13:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.351+0000 7f65696f5640 1 -- 172.21.15.17:0/144043468 wait complete. 2024-09-20T19:13:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.352+0000 7f65696f5640 1 Processor -- start 2024-09-20T19:13:42.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.352+0000 7f65696f5640 1 -- start start 2024-09-20T19:13:42.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.352+0000 7f65696f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6564100800 0x7f656419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:42.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.352+0000 7f65696f5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6564106800 0x7f656419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:42.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.352+0000 7f65696f5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f656410dcb0 con 0x7f6564106800 2024-09-20T19:13:42.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.352+0000 7f65696f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f656410db30 con 0x7f6564100800 2024-09-20T19:13:42.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.352+0000 7f65627fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6564106800 0x7f656419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.352+0000 7f65627fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6564106800 0x7f656419db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45024/0 (socket says 172.21.15.17:45024) 2024-09-20T19:13:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.352+0000 7f65627fc640 1 -- 172.21.15.17:0/3300723849 learned_addr learned my addr 172.21.15.17:0/3300723849 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:13:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.353+0000 7f6562ffd640 1 --2- 172.21.15.17:0/3300723849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6564100800 0x7f656419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.353+0000 7f65627fc640 1 -- 172.21.15.17:0/3300723849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6564100800 msgr2=0x7f656419d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.353+0000 7f65627fc640 1 --2- 172.21.15.17:0/3300723849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6564100800 0x7f656419d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.353+0000 7f65627fc640 1 -- 172.21.15.17:0/3300723849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6564197790 con 0x7f6564106800 2024-09-20T19:13:42.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.353+0000 7f65627fc640 1 --2- 172.21.15.17:0/3300723849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6564106800 0x7f656419db50 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f655800c810 tx=0x7f655800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:42.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.353+0000 7f654bfff640 1 -- 172.21.15.17:0/3300723849 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6558004020 con 0x7f6564106800 2024-09-20T19:13:42.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.353+0000 7f654bfff640 1 -- 172.21.15.17:0/3300723849 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f65580041c0 con 0x7f6564106800 2024-09-20T19:13:42.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.353+0000 7f65696f5640 1 -- 172.21.15.17:0/3300723849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6564197a80 con 0x7f6564106800 2024-09-20T19:13:42.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.353+0000 7f654bfff640 1 -- 172.21.15.17:0/3300723849 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f65580047a0 con 0x7f6564106800 2024-09-20T19:13:42.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.353+0000 7f65696f5640 1 -- 172.21.15.17:0/3300723849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6564198010 con 0x7f6564106800 2024-09-20T19:13:42.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.354+0000 7f65696f5640 1 -- 172.21.15.17:0/3300723849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6564101f40 con 0x7f6564106800 2024-09-20T19:13:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.355+0000 7f654bfff640 1 -- 172.21.15.17:0/3300723849 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f65580079b0 con 0x7f6564106800 2024-09-20T19:13:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.355+0000 7f654bfff640 1 --2- 172.21.15.17:0/3300723849 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f654c07af90 0x7f654c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.356+0000 7f654bfff640 1 -- 172.21.15.17:0/3300723849 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f655809df20 con 0x7f6564106800 2024-09-20T19:13:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.356+0000 7f6562ffd640 1 --2- 172.21.15.17:0/3300723849 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f654c07af90 0x7f654c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:42.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.356+0000 7f6562ffd640 1 --2- 172.21.15.17:0/3300723849 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f654c07af90 0x7f654c07d450 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6554031460 tx=0x7f6554009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:42.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.360+0000 7f654bfff640 1 -- 172.21.15.17:0/3300723849 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6558014030 con 0x7f6564106800 2024-09-20T19:13:42.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.563+0000 7f65696f5640 1 -- 172.21.15.17:0/3300723849 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6564198320 con 0x7f654c07af90 2024-09-20T19:13:42.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.564+0000 7f654bfff640 1 -- 172.21.15.17:0/3300723849 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6564198320 con 0x7f654c07af90 2024-09-20T19:13:42.567 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:13:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:13:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:13:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:13:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:13:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:13:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:13:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:13:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:13:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:13:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:13:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:13:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:13:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:13:42.568 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:13:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.566+0000 7f65696f5640 1 -- 172.21.15.17:0/3300723849 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f654c07af90 msgr2=0x7f654c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.566+0000 7f65696f5640 1 --2- 172.21.15.17:0/3300723849 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f654c07af90 0x7f654c07d450 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6554031460 tx=0x7f6554009560 comp rx=0 tx=0).stop 2024-09-20T19:13:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.566+0000 7f65696f5640 1 -- 172.21.15.17:0/3300723849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6564106800 msgr2=0x7f656419db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.566+0000 7f65696f5640 1 --2- 172.21.15.17:0/3300723849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6564106800 0x7f656419db50 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f655800c810 tx=0x7f655800ccd0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.566+0000 7f65696f5640 1 -- 172.21.15.17:0/3300723849 shutdown_connections 2024-09-20T19:13:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.566+0000 7f65696f5640 1 --2- 172.21.15.17:0/3300723849 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f654c07af90 0x7f654c07d450 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.566+0000 7f65696f5640 1 --2- 172.21.15.17:0/3300723849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6564106800 0x7f656419db50 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.566+0000 7f65696f5640 1 --2- 172.21.15.17:0/3300723849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6564100800 0x7f656419d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.566+0000 7f65696f5640 1 -- 172.21.15.17:0/3300723849 >> 172.21.15.17:0/3300723849 conn(0x7f65640fc520 msgr2=0x7f656406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:42.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.567+0000 7f65696f5640 1 -- 172.21.15.17:0/3300723849 shutdown_connections 2024-09-20T19:13:42.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.567+0000 7f65696f5640 1 -- 172.21.15.17:0/3300723849 wait complete. 2024-09-20T19:13:42.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.651+0000 7fb13066e640 1 -- 172.21.15.17:0/365352897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb128106800 msgr2=0x7fb128106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:42.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.651+0000 7fb13066e640 1 --2- 172.21.15.17:0/365352897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb128106800 0x7fb128106be0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb120009880 tx=0x7fb12002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.651+0000 7fb13066e640 1 -- 172.21.15.17:0/365352897 shutdown_connections 2024-09-20T19:13:42.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.651+0000 7fb13066e640 1 --2- 172.21.15.17:0/365352897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb128100800 0x7fb128100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.651+0000 7fb13066e640 1 --2- 172.21.15.17:0/365352897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb128106800 0x7fb128106be0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.651+0000 7fb13066e640 1 -- 172.21.15.17:0/365352897 >> 172.21.15.17:0/365352897 conn(0x7fb1280fc520 msgr2=0x7fb1280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:42.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.651+0000 7fb13066e640 1 -- 172.21.15.17:0/365352897 shutdown_connections 2024-09-20T19:13:42.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.651+0000 7fb13066e640 1 -- 172.21.15.17:0/365352897 wait complete. 2024-09-20T19:13:42.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.652+0000 7fb13066e640 1 Processor -- start 2024-09-20T19:13:42.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.652+0000 7fb13066e640 1 -- start start 2024-09-20T19:13:42.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.652+0000 7fb13066e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb128100800 0x7fb128107c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:42.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.652+0000 7fb13066e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb128106800 0x7fb128108160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:42.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.652+0000 7fb13066e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb12810dcb0 con 0x7fb128106800 2024-09-20T19:13:42.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.652+0000 7fb13066e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb12810db30 con 0x7fb128100800 2024-09-20T19:13:42.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.652+0000 7fb12dc09640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb128106800 0x7fb128108160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:42.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.652+0000 7fb12dc09640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb128106800 0x7fb128108160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45034/0 (socket says 172.21.15.17:45034) 2024-09-20T19:13:42.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.652+0000 7fb12dc09640 1 -- 172.21.15.17:0/4120896265 learned_addr learned my addr 172.21.15.17:0/4120896265 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:13:42.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.653+0000 7fb12e40a640 1 --2- 172.21.15.17:0/4120896265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb128100800 0x7fb128107c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:42.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.653+0000 7fb12dc09640 1 -- 172.21.15.17:0/4120896265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb128100800 msgr2=0x7fb128107c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:42.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.653+0000 7fb12dc09640 1 --2- 172.21.15.17:0/4120896265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb128100800 0x7fb128107c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.653+0000 7fb12dc09640 1 -- 172.21.15.17:0/4120896265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1281086a0 con 0x7fb128106800 2024-09-20T19:13:42.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.653+0000 7fb12e40a640 1 --2- 172.21.15.17:0/4120896265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb128100800 0x7fb128107c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:13:42.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.653+0000 7fb12dc09640 1 --2- 172.21.15.17:0/4120896265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb128106800 0x7fb128108160 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00d8d0 tx=0x7fb11c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:42.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.653+0000 7fb1277fe640 1 -- 172.21.15.17:0/4120896265 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb11c017070 con 0x7fb128106800 2024-09-20T19:13:42.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.653+0000 7fb1277fe640 1 -- 172.21.15.17:0/4120896265 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb11c010460 con 0x7fb128106800 2024-09-20T19:13:42.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.653+0000 7fb1277fe640 1 -- 172.21.15.17:0/4120896265 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb11c00f5f0 con 0x7fb128106800 2024-09-20T19:13:42.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.653+0000 7fb13066e640 1 -- 172.21.15.17:0/4120896265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb128108990 con 0x7fb128106800 2024-09-20T19:13:42.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.653+0000 7fb13066e640 1 -- 172.21.15.17:0/4120896265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1281a3e30 con 0x7fb128106800 2024-09-20T19:13:42.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.654+0000 7fb13066e640 1 -- 172.21.15.17:0/4120896265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb128101f40 con 0x7fb128106800 2024-09-20T19:13:42.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.655+0000 7fb1277fe640 1 -- 172.21.15.17:0/4120896265 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb11c009a30 con 0x7fb128106800 2024-09-20T19:13:42.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.655+0000 7fb1277fe640 1 --2- 172.21.15.17:0/4120896265 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb11007af90 0x7fb11007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:13:42.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.655+0000 7fb1277fe640 1 -- 172.21.15.17:0/4120896265 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fb11c09ddf0 con 0x7fb128106800 2024-09-20T19:13:42.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.655+0000 7fb12e40a640 1 --2- 172.21.15.17:0/4120896265 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb11007af90 0x7fb11007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:13:42.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.656+0000 7fb12e40a640 1 --2- 172.21.15.17:0/4120896265 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb11007af90 0x7fb11007d450 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb120031460 tx=0x7fb1200041a0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:13:42.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.660+0000 7fb1277fe640 1 -- 172.21.15.17:0/4120896265 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb11c069470 con 0x7fb128106800 2024-09-20T19:13:42.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.922+0000 7fb13066e640 1 -- 172.21.15.17:0/4120896265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fb1281a40e0 con 0x7fb128106800 2024-09-20T19:13:42.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.922+0000 7fb1277fe640 1 -- 172.21.15.17:0/4120896265 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7fb11c06e320 con 0x7fb128106800 2024-09-20T19:13:42.925 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:13:42.926 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:13:42.926 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:13:42.926 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:13:42.926 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:13:42.926 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:13:42.927 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:13:42.927 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:13:42.927 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:13:42.927 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:13:42.927 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:13:42.927 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:13:42.927 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:13:42.928 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:13:42.928 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:13:42.928 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:13:42.928 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:13:42.928 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:13:42.928 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:13:42.929 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:13:42.929 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:13:42.929 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:13:42.929 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:13:42.929 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:13:42.929 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:13:42.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.924+0000 7fb13066e640 1 -- 172.21.15.17:0/4120896265 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb11007af90 msgr2=0x7fb11007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:42.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.924+0000 7fb13066e640 1 --2- 172.21.15.17:0/4120896265 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb11007af90 0x7fb11007d450 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb120031460 tx=0x7fb1200041a0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.924+0000 7fb13066e640 1 -- 172.21.15.17:0/4120896265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb128106800 msgr2=0x7fb128108160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:13:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.924+0000 7fb13066e640 1 --2- 172.21.15.17:0/4120896265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb128106800 0x7fb128108160 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00d8d0 tx=0x7fb11c00dd90 comp rx=0 tx=0).stop 2024-09-20T19:13:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.924+0000 7fb13066e640 1 -- 172.21.15.17:0/4120896265 shutdown_connections 2024-09-20T19:13:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.924+0000 7fb13066e640 1 --2- 172.21.15.17:0/4120896265 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb11007af90 0x7fb11007d450 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.924+0000 7fb13066e640 1 --2- 172.21.15.17:0/4120896265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb128106800 0x7fb128108160 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.924+0000 7fb13066e640 1 --2- 172.21.15.17:0/4120896265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb128100800 0x7fb128107c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:13:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.924+0000 7fb13066e640 1 -- 172.21.15.17:0/4120896265 >> 172.21.15.17:0/4120896265 conn(0x7fb1280fc520 msgr2=0x7fb128109ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:13:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.925+0000 7fb13066e640 1 -- 172.21.15.17:0/4120896265 shutdown_connections 2024-09-20T19:13:42.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:13:42.925+0000 7fb13066e640 1 -- 172.21.15.17:0/4120896265 wait complete. 2024-09-20T19:13:43.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:42 smithi017 ceph-mon[108970]: from='client.35888 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:43.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:42 smithi017 ceph-mon[108970]: from='client.35892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:43.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:42 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3666448114' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:43.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:42 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4044482081' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:13:43.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:42 smithi172 ceph-mon[80431]: from='client.35888 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:43.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:42 smithi172 ceph-mon[80431]: from='client.35892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:43.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:42 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3666448114' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:13:43.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:42 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4044482081' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:13:44.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:43 smithi017 ceph-mon[108970]: from='client.35904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:44.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:43 smithi017 ceph-mon[108970]: pgmap v1150: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:44.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:43 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4120896265' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:13:44.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:43 smithi172 ceph-mon[80431]: from='client.35904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:13:44.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:43 smithi172 ceph-mon[80431]: pgmap v1150: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:44.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:43 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4120896265' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:13:46.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:45 smithi172 ceph-mon[80431]: pgmap v1151: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:46.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:45 smithi017 ceph-mon[108970]: pgmap v1151: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:48.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:47 smithi172 ceph-mon[80431]: pgmap v1152: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:48.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:47 smithi017 ceph-mon[108970]: pgmap v1152: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:50.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:49 smithi172 ceph-mon[80431]: pgmap v1153: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:50.331 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:49 smithi017 ceph-mon[108970]: pgmap v1153: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:52.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:51 smithi172 ceph-mon[80431]: pgmap v1154: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:52.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:51 smithi017 ceph-mon[108970]: pgmap v1154: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:53.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:13:53.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:13:54.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:53 smithi172 ceph-mon[80431]: pgmap v1155: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:54.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:53 smithi017 ceph-mon[108970]: pgmap v1155: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:56.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:55 smithi172 ceph-mon[80431]: pgmap v1156: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:56.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:55 smithi017 ceph-mon[108970]: pgmap v1156: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:58.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:57 smithi172 ceph-mon[80431]: pgmap v1157: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:13:58.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:57 smithi017 ceph-mon[108970]: pgmap v1157: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:00.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:13:59 smithi172 ceph-mon[80431]: pgmap v1158: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:00.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:13:59 smithi017 ceph-mon[108970]: pgmap v1158: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:02.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:01 smithi172 ceph-mon[80431]: pgmap v1159: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:02.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:01 smithi017 ceph-mon[108970]: pgmap v1159: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:04.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:03 smithi172 ceph-mon[80431]: pgmap v1160: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:04.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:03 smithi017 ceph-mon[108970]: pgmap v1160: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:06.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:05 smithi172 ceph-mon[80431]: pgmap v1161: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:06.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:05 smithi017 ceph-mon[108970]: pgmap v1161: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:08.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:07 smithi172 ceph-mon[80431]: pgmap v1162: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:08.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:14:08.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:07 smithi017 ceph-mon[108970]: pgmap v1162: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:08.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:14:10.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:09 smithi172 ceph-mon[80431]: pgmap v1163: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:10.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:09 smithi017 ceph-mon[108970]: pgmap v1163: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:12.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:11 smithi172 ceph-mon[80431]: pgmap v1164: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:12.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:11 smithi017 ceph-mon[108970]: pgmap v1164: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:13.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.021+0000 7f557a6c0640 1 -- 172.21.15.17:0/1580305905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5574106800 msgr2=0x7f5574106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:13.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.021+0000 7f557a6c0640 1 --2- 172.21.15.17:0/1580305905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5574106800 0x7f5574106be0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f5564009880 tx=0x7f556402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.022+0000 7f557a6c0640 1 -- 172.21.15.17:0/1580305905 shutdown_connections 2024-09-20T19:14:13.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.022+0000 7f557a6c0640 1 --2- 172.21.15.17:0/1580305905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5574100800 0x7f5574100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.022+0000 7f557a6c0640 1 --2- 172.21.15.17:0/1580305905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5574106800 0x7f5574106be0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.022+0000 7f557a6c0640 1 -- 172.21.15.17:0/1580305905 >> 172.21.15.17:0/1580305905 conn(0x7f55740fc520 msgr2=0x7f55740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:13.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.022+0000 7f557a6c0640 1 -- 172.21.15.17:0/1580305905 shutdown_connections 2024-09-20T19:14:13.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.022+0000 7f557a6c0640 1 -- 172.21.15.17:0/1580305905 wait complete. 2024-09-20T19:14:13.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.022+0000 7f557a6c0640 1 Processor -- start 2024-09-20T19:14:13.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.022+0000 7f557a6c0640 1 -- start start 2024-09-20T19:14:13.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.023+0000 7f557a6c0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5574100800 0x7f557419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:13.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.023+0000 7f557a6c0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5574106800 0x7f557419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:13.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.023+0000 7f557a6c0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f557410dcb0 con 0x7f5574100800 2024-09-20T19:14:13.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.023+0000 7f557a6c0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f557410db30 con 0x7f5574106800 2024-09-20T19:14:13.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.023+0000 7f5573fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5574100800 0x7f557419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:13.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.023+0000 7f5573fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5574100800 0x7f557419d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54894/0 (socket says 172.21.15.17:54894) 2024-09-20T19:14:13.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.023+0000 7f5573fff640 1 -- 172.21.15.17:0/483186647 learned_addr learned my addr 172.21.15.17:0/483186647 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:14:13.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.023+0000 7f55737fe640 1 --2- 172.21.15.17:0/483186647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5574106800 0x7f557419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:13.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.023+0000 7f5573fff640 1 -- 172.21.15.17:0/483186647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5574106800 msgr2=0x7f557419db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.023+0000 7f5573fff640 1 --2- 172.21.15.17:0/483186647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5574106800 0x7f557419db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.023+0000 7f5573fff640 1 -- 172.21.15.17:0/483186647 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5574197790 con 0x7f5574100800 2024-09-20T19:14:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.024+0000 7f5573fff640 1 --2- 172.21.15.17:0/483186647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5574100800 0x7f557419d610 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f5564031460 tx=0x7f55640045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.024+0000 7f55717fa640 1 -- 172.21.15.17:0/483186647 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f556403f070 con 0x7f5574100800 2024-09-20T19:14:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.024+0000 7f55717fa640 1 -- 172.21.15.17:0/483186647 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f55640035f0 con 0x7f5574100800 2024-09-20T19:14:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.024+0000 7f557a6c0640 1 -- 172.21.15.17:0/483186647 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5574197a20 con 0x7f5574100800 2024-09-20T19:14:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.024+0000 7f55717fa640 1 -- 172.21.15.17:0/483186647 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5564035030 con 0x7f5574100800 2024-09-20T19:14:13.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.024+0000 7f557a6c0640 1 -- 172.21.15.17:0/483186647 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5574197f50 con 0x7f5574100800 2024-09-20T19:14:13.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.025+0000 7f557a6c0640 1 -- 172.21.15.17:0/483186647 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5574101f40 con 0x7f5574100800 2024-09-20T19:14:13.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.026+0000 7f55717fa640 1 -- 172.21.15.17:0/483186647 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5564042070 con 0x7f5574100800 2024-09-20T19:14:13.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.026+0000 7f55717fa640 1 --2- 172.21.15.17:0/483186647 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f555c07af80 0x7f555c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:13.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.027+0000 7f55717fa640 1 -- 172.21.15.17:0/483186647 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f55640be860 con 0x7f5574100800 2024-09-20T19:14:13.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.027+0000 7f55737fe640 1 --2- 172.21.15.17:0/483186647 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f555c07af80 0x7f555c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:13.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.027+0000 7f55737fe640 1 --2- 172.21.15.17:0/483186647 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f555c07af80 0x7f555c07d440 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f55740ffaf0 tx=0x7f556800b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:13.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.031+0000 7f55717fa640 1 -- 172.21.15.17:0/483186647 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5564089ee0 con 0x7f5574100800 2024-09-20T19:14:13.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.237+0000 7f557a6c0640 1 -- 172.21.15.17:0/483186647 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5574198200 con 0x7f555c07af80 2024-09-20T19:14:13.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.238+0000 7f55717fa640 1 -- 172.21.15.17:0/483186647 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5574198200 con 0x7f555c07af80 2024-09-20T19:14:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.240+0000 7f557a6c0640 1 -- 172.21.15.17:0/483186647 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f555c07af80 msgr2=0x7f555c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.240+0000 7f557a6c0640 1 --2- 172.21.15.17:0/483186647 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f555c07af80 0x7f555c07d440 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f55740ffaf0 tx=0x7f556800b390 comp rx=0 tx=0).stop 2024-09-20T19:14:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.240+0000 7f557a6c0640 1 -- 172.21.15.17:0/483186647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5574100800 msgr2=0x7f557419d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.240+0000 7f557a6c0640 1 --2- 172.21.15.17:0/483186647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5574100800 0x7f557419d610 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f5564031460 tx=0x7f55640045e0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.240+0000 7f557a6c0640 1 -- 172.21.15.17:0/483186647 shutdown_connections 2024-09-20T19:14:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.240+0000 7f557a6c0640 1 --2- 172.21.15.17:0/483186647 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f555c07af80 0x7f555c07d440 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.240+0000 7f557a6c0640 1 --2- 172.21.15.17:0/483186647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5574106800 0x7f557419db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.240+0000 7f557a6c0640 1 --2- 172.21.15.17:0/483186647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5574100800 0x7f557419d610 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.240+0000 7f557a6c0640 1 -- 172.21.15.17:0/483186647 >> 172.21.15.17:0/483186647 conn(0x7f55740fc520 msgr2=0x7f557406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.240+0000 7f557a6c0640 1 -- 172.21.15.17:0/483186647 shutdown_connections 2024-09-20T19:14:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.240+0000 7f557a6c0640 1 -- 172.21.15.17:0/483186647 wait complete. 2024-09-20T19:14:13.252 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:14:13.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.326+0000 7efcb2845640 1 -- 172.21.15.17:0/2377820410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac101900 msgr2=0x7efcac101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:13.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.326+0000 7efcb2845640 1 --2- 172.21.15.17:0/2377820410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac101900 0x7efcac101d60 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7efca0009880 tx=0x7efca002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.326+0000 7efcb2845640 1 -- 172.21.15.17:0/2377820410 shutdown_connections 2024-09-20T19:14:13.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.326+0000 7efcb2845640 1 --2- 172.21.15.17:0/2377820410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac101900 0x7efcac101d60 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.326+0000 7efcb2845640 1 --2- 172.21.15.17:0/2377820410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcac107900 0x7efcac107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.326+0000 7efcb2845640 1 -- 172.21.15.17:0/2377820410 >> 172.21.15.17:0/2377820410 conn(0x7efcac0fd600 msgr2=0x7efcac0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:13.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.326+0000 7efcb2845640 1 -- 172.21.15.17:0/2377820410 shutdown_connections 2024-09-20T19:14:13.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.326+0000 7efcb2845640 1 -- 172.21.15.17:0/2377820410 wait complete. 2024-09-20T19:14:13.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.327+0000 7efcb2845640 1 Processor -- start 2024-09-20T19:14:13.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.327+0000 7efcb2845640 1 -- start start 2024-09-20T19:14:13.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.327+0000 7efcb2845640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac101900 0x7efcac19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:13.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.327+0000 7efcb2845640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcac107900 0x7efcac19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:13.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.327+0000 7efcb2845640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efcac10edd0 con 0x7efcac101900 2024-09-20T19:14:13.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.327+0000 7efcb2845640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efcac10ec50 con 0x7efcac107900 2024-09-20T19:14:13.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.327+0000 7efcabfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac101900 0x7efcac19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:13.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.327+0000 7efcabfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac101900 0x7efcac19d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54914/0 (socket says 172.21.15.17:54914) 2024-09-20T19:14:13.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.327+0000 7efcabfff640 1 -- 172.21.15.17:0/3716733185 learned_addr learned my addr 172.21.15.17:0/3716733185 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:14:13.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.327+0000 7efcab7fe640 1 --2- 172.21.15.17:0/3716733185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcac107900 0x7efcac19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:13.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.327+0000 7efcabfff640 1 -- 172.21.15.17:0/3716733185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcac107900 msgr2=0x7efcac19db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:13.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.327+0000 7efcabfff640 1 --2- 172.21.15.17:0/3716733185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcac107900 0x7efcac19db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.328+0000 7efcabfff640 1 -- 172.21.15.17:0/3716733185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcac1977a0 con 0x7efcac101900 2024-09-20T19:14:13.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.328+0000 7efcab7fe640 1 --2- 172.21.15.17:0/3716733185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcac107900 0x7efcac19db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:14:13.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.328+0000 7efcabfff640 1 --2- 172.21.15.17:0/3716733185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac101900 0x7efcac19d620 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00d6f0 tx=0x7efc9c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:13.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.328+0000 7efca97fa640 1 -- 172.21.15.17:0/3716733185 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc9c017070 con 0x7efcac101900 2024-09-20T19:14:13.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.328+0000 7efca97fa640 1 -- 172.21.15.17:0/3716733185 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efc9c00de00 con 0x7efcac101900 2024-09-20T19:14:13.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.328+0000 7efcb2845640 1 -- 172.21.15.17:0/3716733185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcac197a90 con 0x7efcac101900 2024-09-20T19:14:13.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.328+0000 7efca97fa640 1 -- 172.21.15.17:0/3716733185 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc9c004bb0 con 0x7efcac101900 2024-09-20T19:14:13.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.328+0000 7efcb2845640 1 -- 172.21.15.17:0/3716733185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcac197ff0 con 0x7efcac101900 2024-09-20T19:14:13.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.329+0000 7efcb2845640 1 -- 172.21.15.17:0/3716733185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcac103040 con 0x7efcac101900 2024-09-20T19:14:13.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.330+0000 7efca97fa640 1 -- 172.21.15.17:0/3716733185 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7efc9c004e60 con 0x7efcac101900 2024-09-20T19:14:13.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.330+0000 7efca97fa640 1 --2- 172.21.15.17:0/3716733185 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efc9407af30 0x7efc9407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:13.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.330+0000 7efca97fa640 1 -- 172.21.15.17:0/3716733185 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7efc9c09dc50 con 0x7efcac101900 2024-09-20T19:14:13.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.330+0000 7efcab7fe640 1 --2- 172.21.15.17:0/3716733185 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efc9407af30 0x7efc9407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:13.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.331+0000 7efcab7fe640 1 --2- 172.21.15.17:0/3716733185 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efc9407af30 0x7efc9407d3f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efcac198af0 tx=0x7efca0031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:13.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.335+0000 7efca97fa640 1 -- 172.21.15.17:0/3716733185 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efc9c069250 con 0x7efcac101900 2024-09-20T19:14:13.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.542+0000 7efcb2845640 1 -- 172.21.15.17:0/3716733185 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efcac1982a0 con 0x7efc9407af30 2024-09-20T19:14:13.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.543+0000 7efca97fa640 1 -- 172.21.15.17:0/3716733185 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7efcac1982a0 con 0x7efc9407af30 2024-09-20T19:14:13.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.545+0000 7efcb2845640 1 -- 172.21.15.17:0/3716733185 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efc9407af30 msgr2=0x7efc9407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:13.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.545+0000 7efcb2845640 1 --2- 172.21.15.17:0/3716733185 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efc9407af30 0x7efc9407d3f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efcac198af0 tx=0x7efca0031400 comp rx=0 tx=0).stop 2024-09-20T19:14:13.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.545+0000 7efcb2845640 1 -- 172.21.15.17:0/3716733185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac101900 msgr2=0x7efcac19d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:13.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.545+0000 7efcb2845640 1 --2- 172.21.15.17:0/3716733185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac101900 0x7efcac19d620 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00d6f0 tx=0x7efc9c00dbb0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.545+0000 7efcb2845640 1 -- 172.21.15.17:0/3716733185 shutdown_connections 2024-09-20T19:14:13.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.545+0000 7efcb2845640 1 --2- 172.21.15.17:0/3716733185 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7efc9407af30 0x7efc9407d3f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.545+0000 7efcb2845640 1 --2- 172.21.15.17:0/3716733185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcac107900 0x7efcac19db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.545+0000 7efcb2845640 1 --2- 172.21.15.17:0/3716733185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcac101900 0x7efcac19d620 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.545+0000 7efcb2845640 1 -- 172.21.15.17:0/3716733185 >> 172.21.15.17:0/3716733185 conn(0x7efcac0fd600 msgr2=0x7efcac0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:13.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.545+0000 7efcb2845640 1 -- 172.21.15.17:0/3716733185 shutdown_connections 2024-09-20T19:14:13.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.545+0000 7efcb2845640 1 -- 172.21.15.17:0/3716733185 wait complete. 2024-09-20T19:14:13.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.630+0000 7fed80c38640 1 -- 172.21.15.17:0/38419454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed7c100c00 msgr2=0x7fed7c104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:13.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.630+0000 7fed80c38640 1 --2- 172.21.15.17:0/38419454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed7c100c00 0x7fed7c104c50 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fed7000a990 tx=0x7fed7002b7d0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.630+0000 7fed80c38640 1 -- 172.21.15.17:0/38419454 shutdown_connections 2024-09-20T19:14:13.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.630+0000 7fed80c38640 1 --2- 172.21.15.17:0/38419454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed7c100c00 0x7fed7c104c50 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.630+0000 7fed80c38640 1 --2- 172.21.15.17:0/38419454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed7c100250 0x7fed7c100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.630+0000 7fed80c38640 1 -- 172.21.15.17:0/38419454 >> 172.21.15.17:0/38419454 conn(0x7fed7c0fbc90 msgr2=0x7fed7c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:13.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.630+0000 7fed80c38640 1 -- 172.21.15.17:0/38419454 shutdown_connections 2024-09-20T19:14:13.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.630+0000 7fed80c38640 1 -- 172.21.15.17:0/38419454 wait complete. 2024-09-20T19:14:13.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.631+0000 7fed80c38640 1 Processor -- start 2024-09-20T19:14:13.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.631+0000 7fed80c38640 1 -- start start 2024-09-20T19:14:13.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.631+0000 7fed80c38640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed7c100250 0x7fed7c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:13.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.632+0000 7fed80c38640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed7c100c00 0x7fed7c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:13.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.632+0000 7fed80c38640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c10cbd0 con 0x7fed7c100250 2024-09-20T19:14:13.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.632+0000 7fed80c38640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c10ca50 con 0x7fed7c100c00 2024-09-20T19:14:13.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.632+0000 7fed7a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed7c100250 0x7fed7c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:13.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.632+0000 7fed7a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed7c100250 0x7fed7c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54944/0 (socket says 172.21.15.17:54944) 2024-09-20T19:14:13.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.632+0000 7fed7a59c640 1 -- 172.21.15.17:0/204779909 learned_addr learned my addr 172.21.15.17:0/204779909 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:14:13.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.632+0000 7fed79d9b640 1 --2- 172.21.15.17:0/204779909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed7c100c00 0x7fed7c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:13.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.632+0000 7fed7a59c640 1 -- 172.21.15.17:0/204779909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed7c100c00 msgr2=0x7fed7c19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:13.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.632+0000 7fed7a59c640 1 --2- 172.21.15.17:0/204779909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed7c100c00 0x7fed7c19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.632+0000 7fed7a59c640 1 -- 172.21.15.17:0/204779909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7c197810 con 0x7fed7c100250 2024-09-20T19:14:13.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.632+0000 7fed7a59c640 1 --2- 172.21.15.17:0/204779909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed7c100250 0x7fed7c19d640 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fed6c00d6f0 tx=0x7fed6c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:13.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.632+0000 7fed6b7fe640 1 -- 172.21.15.17:0/204779909 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed6c017070 con 0x7fed7c100250 2024-09-20T19:14:13.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.632+0000 7fed6b7fe640 1 -- 172.21.15.17:0/204779909 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed6c00de00 con 0x7fed7c100250 2024-09-20T19:14:13.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.632+0000 7fed80c38640 1 -- 172.21.15.17:0/204779909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed7c197b00 con 0x7fed7c100250 2024-09-20T19:14:13.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.633+0000 7fed6b7fe640 1 -- 172.21.15.17:0/204779909 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed6c004bb0 con 0x7fed7c100250 2024-09-20T19:14:13.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.633+0000 7fed80c38640 1 -- 172.21.15.17:0/204779909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed7c198060 con 0x7fed7c100250 2024-09-20T19:14:13.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.634+0000 7fed80c38640 1 -- 172.21.15.17:0/204779909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed7c101730 con 0x7fed7c100250 2024-09-20T19:14:13.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.634+0000 7fed6b7fe640 1 -- 172.21.15.17:0/204779909 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fed6c009a30 con 0x7fed7c100250 2024-09-20T19:14:13.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.635+0000 7fed6b7fe640 1 --2- 172.21.15.17:0/204779909 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed6407af30 0x7fed6407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:13.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.635+0000 7fed6b7fe640 1 -- 172.21.15.17:0/204779909 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fed6c09dbb0 con 0x7fed7c100250 2024-09-20T19:14:13.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.635+0000 7fed79d9b640 1 --2- 172.21.15.17:0/204779909 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed6407af30 0x7fed6407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:13.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.635+0000 7fed79d9b640 1 --2- 172.21.15.17:0/204779909 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed6407af30 0x7fed6407d3f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fed7000a340 tx=0x7fed70005fd0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:13.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.639+0000 7fed6b7fe640 1 -- 172.21.15.17:0/204779909 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fed6c0a4080 con 0x7fed7c100250 2024-09-20T19:14:13.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.835+0000 7fed80c38640 1 -- 172.21.15.17:0/204779909 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fed7c1982e0 con 0x7fed6407af30 2024-09-20T19:14:13.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.845+0000 7fed6b7fe640 1 -- 172.21.15.17:0/204779909 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fed7c1982e0 con 0x7fed6407af30 2024-09-20T19:14:13.848 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:14:13.848 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (35m) 14m ago 46m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:14:13.848 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (38m) 14m ago 46m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:14:13.848 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (38m) 14m ago 45m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:14:13.848 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (33m) 14m ago 46m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:14:13.848 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (33m) 14m ago 45m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:14:13.848 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (35m) 14m ago 46m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:14:13.849 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (30m) 14m ago 41m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:14:13.849 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (29m) 14m ago 41m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:14:13.849 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (14m) 14m ago 41m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:14:13.849 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (29m) 14m ago 41m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:14:13.849 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (37m) 14m ago 47m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:14:13.849 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (36m) 14m ago 45m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:14:13.849 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (34m) 14m ago 47m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:14:13.849 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (34m) 14m ago 45m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:14:13.849 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (36m) 14m ago 46m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:14:13.849 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (36m) 14m ago 45m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:14:13.849 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (33m) 14m ago 44m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:14:13.849 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (32m) 14m ago 44m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:14:13.849 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (32m) 14m ago 43m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:14:13.849 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (31m) 14m ago 43m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:14:13.850 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (31m) 14m ago 42m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:14:13.850 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (30m) 14m ago 42m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:14:13.850 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (35m) 14m ago 46m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:14:13.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.847+0000 7fed80c38640 1 -- 172.21.15.17:0/204779909 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed6407af30 msgr2=0x7fed6407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:13.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.847+0000 7fed80c38640 1 --2- 172.21.15.17:0/204779909 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed6407af30 0x7fed6407d3f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fed7000a340 tx=0x7fed70005fd0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.847+0000 7fed80c38640 1 -- 172.21.15.17:0/204779909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed7c100250 msgr2=0x7fed7c19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:13.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.847+0000 7fed80c38640 1 --2- 172.21.15.17:0/204779909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed7c100250 0x7fed7c19d640 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fed6c00d6f0 tx=0x7fed6c00dbb0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.847+0000 7fed80c38640 1 -- 172.21.15.17:0/204779909 shutdown_connections 2024-09-20T19:14:13.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.847+0000 7fed80c38640 1 --2- 172.21.15.17:0/204779909 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fed6407af30 0x7fed6407d3f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.847+0000 7fed80c38640 1 --2- 172.21.15.17:0/204779909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed7c100c00 0x7fed7c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.847+0000 7fed80c38640 1 --2- 172.21.15.17:0/204779909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed7c100250 0x7fed7c19d640 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.847+0000 7fed80c38640 1 -- 172.21.15.17:0/204779909 >> 172.21.15.17:0/204779909 conn(0x7fed7c0fbc90 msgr2=0x7fed7c0fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:13.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.848+0000 7fed80c38640 1 -- 172.21.15.17:0/204779909 shutdown_connections 2024-09-20T19:14:13.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.848+0000 7fed80c38640 1 -- 172.21.15.17:0/204779909 wait complete. 2024-09-20T19:14:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.935+0000 7f4513f04640 1 -- 172.21.15.17:0/4222025496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c074f40 msgr2=0x7f450c10dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.935+0000 7f4513f04640 1 --2- 172.21.15.17:0/4222025496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c074f40 0x7f450c10dc00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f4500009880 tx=0x7f450002a530 comp rx=0 tx=0).stop 2024-09-20T19:14:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.935+0000 7f4513f04640 1 -- 172.21.15.17:0/4222025496 shutdown_connections 2024-09-20T19:14:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.935+0000 7f4513f04640 1 --2- 172.21.15.17:0/4222025496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c074f40 0x7f450c10dc00 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.935+0000 7f4513f04640 1 --2- 172.21.15.17:0/4222025496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f450c074620 0x7f450c074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.935+0000 7f4513f04640 1 -- 172.21.15.17:0/4222025496 >> 172.21.15.17:0/4222025496 conn(0x7f450c0fd600 msgr2=0x7f450c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:13.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.935+0000 7f4513f04640 1 -- 172.21.15.17:0/4222025496 shutdown_connections 2024-09-20T19:14:13.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.935+0000 7f4513f04640 1 -- 172.21.15.17:0/4222025496 wait complete. 2024-09-20T19:14:13.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.936+0000 7f4513f04640 1 Processor -- start 2024-09-20T19:14:13.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.936+0000 7f4513f04640 1 -- start start 2024-09-20T19:14:13.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.936+0000 7f4513f04640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c074620 0x7f450c19f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:13.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.936+0000 7f4513f04640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f450c074f40 0x7f450c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:13.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.936+0000 7f4513f04640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f450c110ff0 con 0x7f450c074620 2024-09-20T19:14:13.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.936+0000 7f4513f04640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f450c110e70 con 0x7f450c074f40 2024-09-20T19:14:13.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.936+0000 7f4511ca0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c074620 0x7f450c19f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:13.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.936+0000 7f4511ca0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c074620 0x7f450c19f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54970/0 (socket says 172.21.15.17:54970) 2024-09-20T19:14:13.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.937+0000 7f4511ca0640 1 -- 172.21.15.17:0/2000354648 learned_addr learned my addr 172.21.15.17:0/2000354648 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:14:13.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.937+0000 7f451149f640 1 --2- 172.21.15.17:0/2000354648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f450c074f40 0x7f450c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:13.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.937+0000 7f4511ca0640 1 -- 172.21.15.17:0/2000354648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f450c074f40 msgr2=0x7f450c19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:13.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.937+0000 7f4511ca0640 1 --2- 172.21.15.17:0/2000354648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f450c074f40 0x7f450c19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:13.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.937+0000 7f4511ca0640 1 -- 172.21.15.17:0/2000354648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450c199a20 con 0x7f450c074620 2024-09-20T19:14:13.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.937+0000 7f451149f640 1 --2- 172.21.15.17:0/2000354648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f450c074f40 0x7f450c19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:14:13.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.937+0000 7f4511ca0640 1 --2- 172.21.15.17:0/2000354648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c074620 0x7f450c19f860 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f450800d6f0 tx=0x7f450800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:13.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.937+0000 7f44feffd640 1 -- 172.21.15.17:0/2000354648 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4508017070 con 0x7f450c074620 2024-09-20T19:14:13.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.937+0000 7f44feffd640 1 -- 172.21.15.17:0/2000354648 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f450800de00 con 0x7f450c074620 2024-09-20T19:14:13.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.937+0000 7f4513f04640 1 -- 172.21.15.17:0/2000354648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f450c199d10 con 0x7f450c074620 2024-09-20T19:14:13.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.937+0000 7f44feffd640 1 -- 172.21.15.17:0/2000354648 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4508004bb0 con 0x7f450c074620 2024-09-20T19:14:13.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.937+0000 7f4513f04640 1 -- 172.21.15.17:0/2000354648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f450c19a270 con 0x7f450c074620 2024-09-20T19:14:13.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.938+0000 7f4513f04640 1 -- 172.21.15.17:0/2000354648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f450c075cd0 con 0x7f450c074620 2024-09-20T19:14:13.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.939+0000 7f44feffd640 1 -- 172.21.15.17:0/2000354648 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4508009a30 con 0x7f450c074620 2024-09-20T19:14:13.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.939+0000 7f44feffd640 1 --2- 172.21.15.17:0/2000354648 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f44f807af90 0x7f44f807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:13.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.940+0000 7f44feffd640 1 -- 172.21.15.17:0/2000354648 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f450809dc10 con 0x7f450c074620 2024-09-20T19:14:13.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.940+0000 7f451149f640 1 --2- 172.21.15.17:0/2000354648 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f44f807af90 0x7f44f807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:13.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.940+0000 7f451149f640 1 --2- 172.21.15.17:0/2000354648 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f44f807af90 0x7f44f807d450 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f450c19b210 tx=0x7f4500031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:13.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:13.944+0000 7f44feffd640 1 -- 172.21.15.17:0/2000354648 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f45080691f0 con 0x7f450c074620 2024-09-20T19:14:14.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:13 smithi172 ceph-mon[80431]: pgmap v1165: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:14.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.210+0000 7f4513f04640 1 -- 172.21.15.17:0/2000354648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f450c19af50 con 0x7f450c074620 2024-09-20T19:14:14.213 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:13 smithi017 ceph-mon[108970]: pgmap v1165: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:14.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.210+0000 7f44feffd640 1 -- 172.21.15.17:0/2000354648 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f450806e0a0 con 0x7f450c074620 2024-09-20T19:14:14.213 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:14:14.213 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:14:14.213 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:14:14.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:14:14.213 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:14:14.214 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:14:14.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:14:14.214 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:14:14.214 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:14:14.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:14:14.214 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:14:14.214 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:14:14.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:14:14.214 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:14:14.214 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:14:14.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:14:14.214 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:14:14.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.213+0000 7f4513f04640 1 -- 172.21.15.17:0/2000354648 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f44f807af90 msgr2=0x7f44f807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:14.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.213+0000 7f4513f04640 1 --2- 172.21.15.17:0/2000354648 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f44f807af90 0x7f44f807d450 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f450c19b210 tx=0x7f4500031400 comp rx=0 tx=0).stop 2024-09-20T19:14:14.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.213+0000 7f4513f04640 1 -- 172.21.15.17:0/2000354648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c074620 msgr2=0x7f450c19f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:14.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.213+0000 7f4513f04640 1 --2- 172.21.15.17:0/2000354648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c074620 0x7f450c19f860 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f450800d6f0 tx=0x7f450800dbb0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.213+0000 7f4513f04640 1 -- 172.21.15.17:0/2000354648 shutdown_connections 2024-09-20T19:14:14.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.213+0000 7f4513f04640 1 --2- 172.21.15.17:0/2000354648 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f44f807af90 0x7f44f807d450 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.213+0000 7f4513f04640 1 --2- 172.21.15.17:0/2000354648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f450c074f40 0x7f450c19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.213+0000 7f4513f04640 1 --2- 172.21.15.17:0/2000354648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c074620 0x7f450c19f860 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.213+0000 7f4513f04640 1 -- 172.21.15.17:0/2000354648 >> 172.21.15.17:0/2000354648 conn(0x7f450c0fd600 msgr2=0x7f450c10b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:14.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.213+0000 7f4513f04640 1 -- 172.21.15.17:0/2000354648 shutdown_connections 2024-09-20T19:14:14.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.213+0000 7f4513f04640 1 -- 172.21.15.17:0/2000354648 wait complete. 2024-09-20T19:14:14.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.297+0000 7f6a0a328640 1 -- 172.21.15.17:0/4160358872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a041007f0 msgr2=0x7f6a04100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:14.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.297+0000 7f6a0a328640 1 --2- 172.21.15.17:0/4160358872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a041007f0 0x7f6a04100c50 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009880 tx=0x7f69f802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.298+0000 7f6a0a328640 1 -- 172.21.15.17:0/4160358872 shutdown_connections 2024-09-20T19:14:14.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.298+0000 7f6a0a328640 1 --2- 172.21.15.17:0/4160358872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a041007f0 0x7f6a04100c50 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.298+0000 7f6a0a328640 1 --2- 172.21.15.17:0/4160358872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a041067f0 0x7f6a04106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.298+0000 7f6a0a328640 1 -- 172.21.15.17:0/4160358872 >> 172.21.15.17:0/4160358872 conn(0x7f6a040fc550 msgr2=0x7f6a040fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:14.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.298+0000 7f6a0a328640 1 -- 172.21.15.17:0/4160358872 shutdown_connections 2024-09-20T19:14:14.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.298+0000 7f6a0a328640 1 -- 172.21.15.17:0/4160358872 wait complete. 2024-09-20T19:14:14.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.298+0000 7f6a0a328640 1 Processor -- start 2024-09-20T19:14:14.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.298+0000 7f6a0a328640 1 -- start start 2024-09-20T19:14:14.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.299+0000 7f6a0a328640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a041007f0 0x7f6a0419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:14.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.299+0000 7f6a0a328640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a041067f0 0x7f6a0419db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:14.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.299+0000 7f6a0a328640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0410dca0 con 0x7f6a041067f0 2024-09-20T19:14:14.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.299+0000 7f6a0a328640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0410db20 con 0x7f6a041007f0 2024-09-20T19:14:14.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.299+0000 7f6a037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a041067f0 0x7f6a0419db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:14.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.299+0000 7f6a037fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a041067f0 0x7f6a0419db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54988/0 (socket says 172.21.15.17:54988) 2024-09-20T19:14:14.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.299+0000 7f6a037fe640 1 -- 172.21.15.17:0/39103380 learned_addr learned my addr 172.21.15.17:0/39103380 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:14:14.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.299+0000 7f6a03fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a041007f0 0x7f6a0419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:14.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.299+0000 7f6a037fe640 1 -- 172.21.15.17:0/39103380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a041007f0 msgr2=0x7f6a0419d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:14.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.299+0000 7f6a037fe640 1 --2- 172.21.15.17:0/39103380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a041007f0 0x7f6a0419d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.299+0000 7f6a037fe640 1 -- 172.21.15.17:0/39103380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a04197780 con 0x7f6a041067f0 2024-09-20T19:14:14.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.299+0000 7f6a037fe640 1 --2- 172.21.15.17:0/39103380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a041067f0 0x7f6a0419db40 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f69f8031460 tx=0x7f69f80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:14.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.300+0000 7f6a017fa640 1 -- 172.21.15.17:0/39103380 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69f803f070 con 0x7f6a041067f0 2024-09-20T19:14:14.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.300+0000 7f6a0a328640 1 -- 172.21.15.17:0/39103380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a04197a10 con 0x7f6a041067f0 2024-09-20T19:14:14.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.300+0000 7f6a017fa640 1 -- 172.21.15.17:0/39103380 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f69f8004cf0 con 0x7f6a041067f0 2024-09-20T19:14:14.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.300+0000 7f6a017fa640 1 -- 172.21.15.17:0/39103380 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69f8035030 con 0x7f6a041067f0 2024-09-20T19:14:14.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.300+0000 7f6a0a328640 1 -- 172.21.15.17:0/39103380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a04197f40 con 0x7f6a041067f0 2024-09-20T19:14:14.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.301+0000 7f6a0a328640 1 -- 172.21.15.17:0/39103380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a04101f30 con 0x7f6a041067f0 2024-09-20T19:14:14.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.301+0000 7f6a017fa640 1 -- 172.21.15.17:0/39103380 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f69f8042070 con 0x7f6a041067f0 2024-09-20T19:14:14.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.302+0000 7f6a017fa640 1 --2- 172.21.15.17:0/39103380 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f69ec07af30 0x7f69ec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:14.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.302+0000 7f6a017fa640 1 -- 172.21.15.17:0/39103380 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f69f80be9d0 con 0x7f6a041067f0 2024-09-20T19:14:14.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.302+0000 7f6a03fff640 1 --2- 172.21.15.17:0/39103380 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f69ec07af30 0x7f69ec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:14.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.302+0000 7f6a03fff640 1 --2- 172.21.15.17:0/39103380 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f69ec07af30 0x7f69ec07d3f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f69f400abe0 tx=0x7f69f400a2d0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:14.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.307+0000 7f6a017fa640 1 -- 172.21.15.17:0/39103380 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69f8089fd0 con 0x7f6a041067f0 2024-09-20T19:14:14.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.531+0000 7f6a0a328640 1 -- 172.21.15.17:0/39103380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6a04198cb0 con 0x7f6a041067f0 2024-09-20T19:14:14.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.532+0000 7f6a017fa640 1 -- 172.21.15.17:0/39103380 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+1996 (secure 0 0 0) 0x7f69f808ee80 con 0x7f6a041067f0 2024-09-20T19:14:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:e26 2024-09-20T19:14:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T18:59:45:147712+0000 2024-09-20T19:14:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:14:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:14:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:14:14.535 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:14:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:14:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:14:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 17 2024-09-20T19:14:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-20T19:14:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:14:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T18:43:54.971296+0000 2024-09-20T19:14:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:14:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:14:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:14:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:14:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:14:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:14:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:14:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:14:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:14:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:14:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:14:14.537 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:14:14.537 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-09-20T19:14:14.537 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-09-20T19:14:14.537 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:14:14.537 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:14:14.537 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:14:14.537 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:14:14.537 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:14:14.537 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:14:14.537 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:14:14.537 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:14:14.537 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:14:14.537 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:14:14.538 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:14:14.538 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:14:14.538 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:14:14.538 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{-1:34332} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:14:14.538 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{-1:34364} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:14:14.538 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:14:14.538 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:14:14.539 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:14:14.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.534+0000 7f6a0a328640 1 -- 172.21.15.17:0/39103380 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f69ec07af30 msgr2=0x7f69ec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:14.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.534+0000 7f6a0a328640 1 --2- 172.21.15.17:0/39103380 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f69ec07af30 0x7f69ec07d3f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f69f400abe0 tx=0x7f69f400a2d0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.534+0000 7f6a0a328640 1 -- 172.21.15.17:0/39103380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a041067f0 msgr2=0x7f6a0419db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:14.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.534+0000 7f6a0a328640 1 --2- 172.21.15.17:0/39103380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a041067f0 0x7f6a0419db40 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f69f8031460 tx=0x7f69f80048f0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.534+0000 7f6a0a328640 1 -- 172.21.15.17:0/39103380 shutdown_connections 2024-09-20T19:14:14.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.534+0000 7f6a0a328640 1 --2- 172.21.15.17:0/39103380 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f69ec07af30 0x7f69ec07d3f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.534+0000 7f6a0a328640 1 --2- 172.21.15.17:0/39103380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a041067f0 0x7f6a0419db40 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.534+0000 7f6a0a328640 1 --2- 172.21.15.17:0/39103380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a041007f0 0x7f6a0419d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.534+0000 7f6a0a328640 1 -- 172.21.15.17:0/39103380 >> 172.21.15.17:0/39103380 conn(0x7f6a040fc550 msgr2=0x7f6a04069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:14.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.534+0000 7f6a0a328640 1 -- 172.21.15.17:0/39103380 shutdown_connections 2024-09-20T19:14:14.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.534+0000 7f6a0a328640 1 -- 172.21.15.17:0/39103380 wait complete. 2024-09-20T19:14:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.619+0000 7fb00da1e640 1 -- 172.21.15.17:0/2413429675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb008101900 msgr2=0x7fb008101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.619+0000 7fb00da1e640 1 --2- 172.21.15.17:0/2413429675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb008101900 0x7fb008101d60 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7faff0009880 tx=0x7faff002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.619+0000 7fb00da1e640 1 -- 172.21.15.17:0/2413429675 shutdown_connections 2024-09-20T19:14:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.619+0000 7fb00da1e640 1 --2- 172.21.15.17:0/2413429675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb008101900 0x7fb008101d60 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.619+0000 7fb00da1e640 1 --2- 172.21.15.17:0/2413429675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb008107900 0x7fb008107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.619+0000 7fb00da1e640 1 -- 172.21.15.17:0/2413429675 >> 172.21.15.17:0/2413429675 conn(0x7fb0080fd600 msgr2=0x7fb0080ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.619+0000 7fb00da1e640 1 -- 172.21.15.17:0/2413429675 shutdown_connections 2024-09-20T19:14:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.619+0000 7fb00da1e640 1 -- 172.21.15.17:0/2413429675 wait complete. 2024-09-20T19:14:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.620+0000 7fb00da1e640 1 Processor -- start 2024-09-20T19:14:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.620+0000 7fb00da1e640 1 -- start start 2024-09-20T19:14:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.620+0000 7fb00da1e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb008101900 0x7fb00819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.620+0000 7fb00da1e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb008107900 0x7fb00819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.620+0000 7fb00da1e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb00810edd0 con 0x7fb008107900 2024-09-20T19:14:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.620+0000 7fb00da1e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb00810ec50 con 0x7fb008101900 2024-09-20T19:14:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.620+0000 7faffffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb008107900 0x7fb00819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.620+0000 7faffffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb008107900 0x7fb00819db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55002/0 (socket says 172.21.15.17:55002) 2024-09-20T19:14:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.620+0000 7faffffff640 1 -- 172.21.15.17:0/4094421022 learned_addr learned my addr 172.21.15.17:0/4094421022 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:14:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.621+0000 7fb006ffd640 1 --2- 172.21.15.17:0/4094421022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb008101900 0x7fb00819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.621+0000 7faffffff640 1 -- 172.21.15.17:0/4094421022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb008101900 msgr2=0x7fb00819d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.621+0000 7faffffff640 1 --2- 172.21.15.17:0/4094421022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb008101900 0x7fb00819d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.621+0000 7faffffff640 1 -- 172.21.15.17:0/4094421022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0081977a0 con 0x7fb008107900 2024-09-20T19:14:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.621+0000 7fb006ffd640 1 --2- 172.21.15.17:0/4094421022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb008101900 0x7fb00819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:14:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.621+0000 7faffffff640 1 --2- 172.21.15.17:0/4094421022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb008107900 0x7fb00819db60 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7faff0031460 tx=0x7faff0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.621+0000 7fb00ca1c640 1 -- 172.21.15.17:0/4094421022 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faff003f070 con 0x7fb008107900 2024-09-20T19:14:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.621+0000 7fb00ca1c640 1 -- 172.21.15.17:0/4094421022 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faff00035f0 con 0x7fb008107900 2024-09-20T19:14:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.621+0000 7fb00da1e640 1 -- 172.21.15.17:0/4094421022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb008197a30 con 0x7fb008107900 2024-09-20T19:14:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.621+0000 7fb00ca1c640 1 -- 172.21.15.17:0/4094421022 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faff0035030 con 0x7fb008107900 2024-09-20T19:14:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.621+0000 7fb00da1e640 1 -- 172.21.15.17:0/4094421022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb008197f60 con 0x7fb008107900 2024-09-20T19:14:14.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.622+0000 7fb00da1e640 1 -- 172.21.15.17:0/4094421022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb008103040 con 0x7fb008107900 2024-09-20T19:14:14.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.623+0000 7fb00ca1c640 1 -- 172.21.15.17:0/4094421022 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7faff0042070 con 0x7fb008107900 2024-09-20T19:14:14.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.623+0000 7fb00ca1c640 1 --2- 172.21.15.17:0/4094421022 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faff407af80 0x7faff407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:14.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.624+0000 7fb00ca1c640 1 -- 172.21.15.17:0/4094421022 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7faff00be8e0 con 0x7fb008107900 2024-09-20T19:14:14.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.624+0000 7fb006ffd640 1 --2- 172.21.15.17:0/4094421022 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faff407af80 0x7faff407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:14.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.624+0000 7fb006ffd640 1 --2- 172.21.15.17:0/4094421022 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faff407af80 0x7faff407d440 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7faff8009b50 tx=0x7faff8005f90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:14.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.628+0000 7fb00ca1c640 1 -- 172.21.15.17:0/4094421022 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faff0089f60 con 0x7fb008107900 2024-09-20T19:14:14.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.831+0000 7fb00da1e640 1 -- 172.21.15.17:0/4094421022 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb008198210 con 0x7faff407af80 2024-09-20T19:14:14.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.833+0000 7fb00ca1c640 1 -- 172.21.15.17:0/4094421022 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fb008198210 con 0x7faff407af80 2024-09-20T19:14:14.835 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:14:14.835 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:14:14.835 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:14:14.835 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:14:14.835 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:14:14.835 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:14:14.835 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:14:14.836 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:14:14.836 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:14:14.836 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:14:14.836 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:14:14.836 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:14:14.836 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-09-20T19:14:14.836 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:14:14.836 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:14:14.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.835+0000 7fb00da1e640 1 -- 172.21.15.17:0/4094421022 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faff407af80 msgr2=0x7faff407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:14.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.835+0000 7fb00da1e640 1 --2- 172.21.15.17:0/4094421022 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faff407af80 0x7faff407d440 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7faff8009b50 tx=0x7faff8005f90 comp rx=0 tx=0).stop 2024-09-20T19:14:14.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.835+0000 7fb00da1e640 1 -- 172.21.15.17:0/4094421022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb008107900 msgr2=0x7fb00819db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:14.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.835+0000 7fb00da1e640 1 --2- 172.21.15.17:0/4094421022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb008107900 0x7fb00819db60 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7faff0031460 tx=0x7faff0004530 comp rx=0 tx=0).stop 2024-09-20T19:14:14.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.835+0000 7fb00da1e640 1 -- 172.21.15.17:0/4094421022 shutdown_connections 2024-09-20T19:14:14.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.835+0000 7fb00da1e640 1 --2- 172.21.15.17:0/4094421022 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7faff407af80 0x7faff407d440 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.835+0000 7fb00da1e640 1 --2- 172.21.15.17:0/4094421022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb008107900 0x7fb00819db60 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.835+0000 7fb00da1e640 1 --2- 172.21.15.17:0/4094421022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb008101900 0x7fb00819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.835+0000 7fb00da1e640 1 -- 172.21.15.17:0/4094421022 >> 172.21.15.17:0/4094421022 conn(0x7fb0080fd600 msgr2=0x7fb0080fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:14.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.835+0000 7fb00da1e640 1 -- 172.21.15.17:0/4094421022 shutdown_connections 2024-09-20T19:14:14.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.835+0000 7fb00da1e640 1 -- 172.21.15.17:0/4094421022 wait complete. 2024-09-20T19:14:14.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.919+0000 7f30b066c640 1 -- 172.21.15.17:0/122331452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a81033e0 msgr2=0x7f30a810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:14.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.919+0000 7f30b066c640 1 --2- 172.21.15.17:0/122331452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a81033e0 0x7f30a810b8d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f3098009880 tx=0x7f309802a530 comp rx=0 tx=0).stop 2024-09-20T19:14:14.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.919+0000 7f30b066c640 1 -- 172.21.15.17:0/122331452 shutdown_connections 2024-09-20T19:14:14.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.919+0000 7f30b066c640 1 --2- 172.21.15.17:0/122331452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a81033e0 0x7f30a810b8d0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.919+0000 7f30b066c640 1 --2- 172.21.15.17:0/122331452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a8102ac0 0x7f30a8102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.919+0000 7f30b066c640 1 -- 172.21.15.17:0/122331452 >> 172.21.15.17:0/122331452 conn(0x7f30a80fc520 msgr2=0x7f30a80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:14.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.919+0000 7f30b066c640 1 -- 172.21.15.17:0/122331452 shutdown_connections 2024-09-20T19:14:14.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.919+0000 7f30b066c640 1 -- 172.21.15.17:0/122331452 wait complete. 2024-09-20T19:14:14.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.919+0000 7f30b066c640 1 Processor -- start 2024-09-20T19:14:14.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.919+0000 7f30b066c640 1 -- start start 2024-09-20T19:14:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.919+0000 7f30b066c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a8102ac0 0x7f30a819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.919+0000 7f30b066c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a81033e0 0x7f30a819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.919+0000 7f30b066c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f30a810edf0 con 0x7f30a8102ac0 2024-09-20T19:14:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.919+0000 7f30b066c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30a810ec70 con 0x7f30a81033e0 2024-09-20T19:14:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.920+0000 7f30ae408640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a8102ac0 0x7f30a819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.920+0000 7f30ae408640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a8102ac0 0x7f30a819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55014/0 (socket says 172.21.15.17:55014) 2024-09-20T19:14:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.920+0000 7f30ae408640 1 -- 172.21.15.17:0/864573361 learned_addr learned my addr 172.21.15.17:0/864573361 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:14:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.920+0000 7f30adc07640 1 --2- 172.21.15.17:0/864573361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a81033e0 0x7f30a819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.920+0000 7f30ae408640 1 -- 172.21.15.17:0/864573361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a81033e0 msgr2=0x7f30a819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.920+0000 7f30ae408640 1 --2- 172.21.15.17:0/864573361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a81033e0 0x7f30a819dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.920+0000 7f30ae408640 1 -- 172.21.15.17:0/864573361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a8197800 con 0x7f30a8102ac0 2024-09-20T19:14:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.920+0000 7f30ae408640 1 --2- 172.21.15.17:0/864573361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a8102ac0 0x7f30a819d680 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f30a400d6f0 tx=0x7f30a400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.920+0000 7f309f7fe640 1 -- 172.21.15.17:0/864573361 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f30a4017070 con 0x7f30a8102ac0 2024-09-20T19:14:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.920+0000 7f309f7fe640 1 -- 172.21.15.17:0/864573361 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f30a400de00 con 0x7f30a8102ac0 2024-09-20T19:14:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.920+0000 7f30b066c640 1 -- 172.21.15.17:0/864573361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a8197af0 con 0x7f30a8102ac0 2024-09-20T19:14:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.920+0000 7f309f7fe640 1 -- 172.21.15.17:0/864573361 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f30a4004bb0 con 0x7f30a8102ac0 2024-09-20T19:14:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.920+0000 7f30b066c640 1 -- 172.21.15.17:0/864573361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a8198050 con 0x7f30a8102ac0 2024-09-20T19:14:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.921+0000 7f30b066c640 1 -- 172.21.15.17:0/864573361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a806aa90 con 0x7f30a8102ac0 2024-09-20T19:14:14.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.922+0000 7f309f7fe640 1 -- 172.21.15.17:0/864573361 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f30a4004e60 con 0x7f30a8102ac0 2024-09-20T19:14:14.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.923+0000 7f309f7fe640 1 --2- 172.21.15.17:0/864573361 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f309407af30 0x7f309407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:14.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.923+0000 7f309f7fe640 1 -- 172.21.15.17:0/864573361 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f30a409dcf0 con 0x7f30a8102ac0 2024-09-20T19:14:14.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.923+0000 7f30adc07640 1 --2- 172.21.15.17:0/864573361 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f309407af30 0x7f309407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:14.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.923+0000 7f30adc07640 1 --2- 172.21.15.17:0/864573361 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f309407af30 0x7f309407d3f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f30a8198b50 tx=0x7f3098031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:14.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:14.928+0000 7f309f7fe640 1 -- 172.21.15.17:0/864573361 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f30a4069250 con 0x7f30a8102ac0 2024-09-20T19:14:15.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:14 smithi017 ceph-mon[108970]: from='client.35912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:15.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:14 smithi017 ceph-mon[108970]: from='client.35916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:15.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:14 smithi017 ceph-mon[108970]: from='client.35920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:15.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:14 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2000354648' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:15.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:14 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/39103380' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:14:15.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:15.190+0000 7f30b066c640 1 -- 172.21.15.17:0/864573361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f30a8105f60 con 0x7f30a8102ac0 2024-09-20T19:14:15.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:15.191+0000 7f309f7fe640 1 -- 172.21.15.17:0/864573361 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3795 (secure 0 0 0) 0x7f30a406e100 con 0x7f30a8102ac0 2024-09-20T19:14:15.193 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-20T19:14:15.194 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:14:15.194 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:14:15.194 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:14:15.194 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:14:15.194 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:14:15.194 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:14:15.194 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:14:15.194 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:14:15.194 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:14:15.194 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:14:15.194 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:14:15.194 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:14:15.195 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:14:15.195 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:14:15.195 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:14:15.195 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:14:15.195 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:14:15.195 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp400_ctlq:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:14:15.195 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:14:15.195 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:14:15.195 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:14:15.195 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:14:15.195 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-20T19:14:15.195 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-20T19:14:15.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:15.193+0000 7f30b066c640 1 -- 172.21.15.17:0/864573361 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f309407af30 msgr2=0x7f309407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:15.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:15.193+0000 7f30b066c640 1 --2- 172.21.15.17:0/864573361 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f309407af30 0x7f309407d3f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f30a8198b50 tx=0x7f3098031400 comp rx=0 tx=0).stop 2024-09-20T19:14:15.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:15.193+0000 7f30b066c640 1 -- 172.21.15.17:0/864573361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a8102ac0 msgr2=0x7f30a819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:15.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:15.193+0000 7f30b066c640 1 --2- 172.21.15.17:0/864573361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a8102ac0 0x7f30a819d680 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f30a400d6f0 tx=0x7f30a400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:14:15.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:15.193+0000 7f30b066c640 1 -- 172.21.15.17:0/864573361 shutdown_connections 2024-09-20T19:14:15.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:15.193+0000 7f30b066c640 1 --2- 172.21.15.17:0/864573361 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f309407af30 0x7f309407d3f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:15.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:15.193+0000 7f30b066c640 1 --2- 172.21.15.17:0/864573361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a81033e0 0x7f30a819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:15.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:15.193+0000 7f30b066c640 1 --2- 172.21.15.17:0/864573361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30a8102ac0 0x7f30a819d680 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:15.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:15.193+0000 7f30b066c640 1 -- 172.21.15.17:0/864573361 >> 172.21.15.17:0/864573361 conn(0x7f30a80fc520 msgr2=0x7f30a8108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:15.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:15.193+0000 7f30b066c640 1 -- 172.21.15.17:0/864573361 shutdown_connections 2024-09-20T19:14:15.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:15.193+0000 7f30b066c640 1 -- 172.21.15.17:0/864573361 wait complete. 2024-09-20T19:14:15.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:14 smithi172 ceph-mon[80431]: from='client.35912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:15.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:14 smithi172 ceph-mon[80431]: from='client.35916 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:15.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:14 smithi172 ceph-mon[80431]: from='client.35920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:15.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:14 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2000354648' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:15.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:14 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/39103380' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:14:16.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:15 smithi017 ceph-mon[108970]: pgmap v1166: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:16.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:15 smithi017 ceph-mon[108970]: from='client.35932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:16.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:15 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/864573361' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:14:16.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:15 smithi172 ceph-mon[80431]: pgmap v1166: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:16.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:15 smithi172 ceph-mon[80431]: from='client.35932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:16.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:15 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/864573361' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:14:18.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:17 smithi172 ceph-mon[80431]: pgmap v1167: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:18.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:17 smithi017 ceph-mon[108970]: pgmap v1167: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:20.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:19 smithi017 ceph-mon[108970]: pgmap v1168: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:20.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:19 smithi172 ceph-mon[80431]: pgmap v1168: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:22.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:21 smithi017 ceph-mon[108970]: pgmap v1169: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:22.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:21 smithi172 ceph-mon[80431]: pgmap v1169: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:23.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:14:23.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:14:24.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:23 smithi017 ceph-mon[108970]: pgmap v1170: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:24.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:23 smithi172 ceph-mon[80431]: pgmap v1170: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:26.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:25 smithi017 ceph-mon[108970]: pgmap v1171: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:26.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:25 smithi172 ceph-mon[80431]: pgmap v1171: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:28.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:27 smithi017 ceph-mon[108970]: pgmap v1172: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:28.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:27 smithi172 ceph-mon[80431]: pgmap v1172: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:30.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:29 smithi017 ceph-mon[108970]: pgmap v1173: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:30.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:29 smithi172 ceph-mon[80431]: pgmap v1173: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:32.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:31 smithi017 ceph-mon[108970]: pgmap v1174: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:32.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:31 smithi172 ceph-mon[80431]: pgmap v1174: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:34.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:33 smithi017 ceph-mon[108970]: pgmap v1175: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:34.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:33 smithi172 ceph-mon[80431]: pgmap v1175: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:36.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:35 smithi017 ceph-mon[108970]: pgmap v1176: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:36.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:35 smithi172 ceph-mon[80431]: pgmap v1176: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:38.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:37 smithi017 ceph-mon[108970]: pgmap v1177: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:38.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:14:38.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:37 smithi172 ceph-mon[80431]: pgmap v1177: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:38.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:14:40.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:39 smithi017 ceph-mon[108970]: pgmap v1178: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:40.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:39 smithi172 ceph-mon[80431]: pgmap v1178: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:42.390 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:41 smithi017 ceph-mon[108970]: pgmap v1179: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:42.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:41 smithi172 ceph-mon[80431]: pgmap v1179: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:44.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:43 smithi172 ceph-mon[80431]: pgmap v1180: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:44.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:43 smithi017 ceph-mon[108970]: pgmap v1180: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.286+0000 7f67c6da0640 1 -- 172.21.15.17:0/3324769115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67c01028d0 msgr2=0x7f67c0102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.286+0000 7f67c6da0640 1 --2- 172.21.15.17:0/3324769115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67c01028d0 0x7f67c0102cb0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f67bc009880 tx=0x7f67bc02a530 comp rx=0 tx=0).stop 2024-09-20T19:14:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.286+0000 7f67c6da0640 1 -- 172.21.15.17:0/3324769115 shutdown_connections 2024-09-20T19:14:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.286+0000 7f67c6da0640 1 --2- 172.21.15.17:0/3324769115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c01031f0 0x7f67c010b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.286+0000 7f67c6da0640 1 --2- 172.21.15.17:0/3324769115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67c01028d0 0x7f67c0102cb0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.286+0000 7f67c6da0640 1 -- 172.21.15.17:0/3324769115 >> 172.21.15.17:0/3324769115 conn(0x7f67c00fc310 msgr2=0x7f67c00fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:45.289 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:44 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:45.289 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:44 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:14:45.289 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:44 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:45.289 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:44 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:45.289 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:44 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:45.289 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:44 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:45.289 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:44 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:45.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.286+0000 7f67c6da0640 1 -- 172.21.15.17:0/3324769115 shutdown_connections 2024-09-20T19:14:45.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.286+0000 7f67c6da0640 1 -- 172.21.15.17:0/3324769115 wait complete. 2024-09-20T19:14:45.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.287+0000 7f67c6da0640 1 Processor -- start 2024-09-20T19:14:45.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.287+0000 7f67c6da0640 1 -- start start 2024-09-20T19:14:45.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.287+0000 7f67c6da0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c01028d0 0x7f67c019d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:45.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.287+0000 7f67c6da0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67c01031f0 0x7f67c019db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:45.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.287+0000 7f67c6da0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f67c010ec60 con 0x7f67c01031f0 2024-09-20T19:14:45.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.287+0000 7f67c6da0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f67c010eae0 con 0x7f67c01028d0 2024-09-20T19:14:45.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.287+0000 7f67c559d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67c01031f0 0x7f67c019db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:45.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.287+0000 7f67c559d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67c01031f0 0x7f67c019db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45760/0 (socket says 172.21.15.17:45760) 2024-09-20T19:14:45.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.287+0000 7f67c559d640 1 -- 172.21.15.17:0/3833679155 learned_addr learned my addr 172.21.15.17:0/3833679155 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:14:45.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.288+0000 7f67c5d9e640 1 --2- 172.21.15.17:0/3833679155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c01028d0 0x7f67c019d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:45.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.288+0000 7f67c559d640 1 -- 172.21.15.17:0/3833679155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c01028d0 msgr2=0x7f67c019d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:45.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.288+0000 7f67c559d640 1 --2- 172.21.15.17:0/3833679155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c01028d0 0x7f67c019d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.288+0000 7f67c559d640 1 -- 172.21.15.17:0/3833679155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c0197690 con 0x7f67c01031f0 2024-09-20T19:14:45.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.288+0000 7f67c5d9e640 1 --2- 172.21.15.17:0/3833679155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c01028d0 0x7f67c019d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:14:45.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.288+0000 7f67c559d640 1 --2- 172.21.15.17:0/3833679155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67c01031f0 0x7f67c019db00 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f67b000b370 tx=0x7f67b000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:45.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.288+0000 7f67b6ffd640 1 -- 172.21.15.17:0/3833679155 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67b0015020 con 0x7f67c01031f0 2024-09-20T19:14:45.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.288+0000 7f67b6ffd640 1 -- 172.21.15.17:0/3833679155 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f67b0011af0 con 0x7f67c01031f0 2024-09-20T19:14:45.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.288+0000 7f67c6da0640 1 -- 172.21.15.17:0/3833679155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c0197980 con 0x7f67c01031f0 2024-09-20T19:14:45.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.288+0000 7f67b6ffd640 1 -- 172.21.15.17:0/3833679155 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67b0010d60 con 0x7f67c01031f0 2024-09-20T19:14:45.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.288+0000 7f67c6da0640 1 -- 172.21.15.17:0/3833679155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c0197ee0 con 0x7f67c01031f0 2024-09-20T19:14:45.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.289+0000 7f67c6da0640 1 -- 172.21.15.17:0/3833679155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c006a580 con 0x7f67c01031f0 2024-09-20T19:14:45.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.290+0000 7f67b6ffd640 1 -- 172.21.15.17:0/3833679155 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f67b0018020 con 0x7f67c01031f0 2024-09-20T19:14:45.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.290+0000 7f67b6ffd640 1 --2- 172.21.15.17:0/3833679155 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f67ac07af80 0x7f67ac07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:45.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.291+0000 7f67b6ffd640 1 -- 172.21.15.17:0/3833679155 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f67b009d8c0 con 0x7f67c01031f0 2024-09-20T19:14:45.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.291+0000 7f67c5d9e640 1 --2- 172.21.15.17:0/3833679155 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f67ac07af80 0x7f67ac07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:45.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.291+0000 7f67c5d9e640 1 --2- 172.21.15.17:0/3833679155 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f67ac07af80 0x7f67ac07d440 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f67bc000c00 tx=0x7f67bc031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:45.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.295+0000 7f67b6ffd640 1 -- 172.21.15.17:0/3833679155 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67b001f020 con 0x7f67c01031f0 2024-09-20T19:14:45.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:44 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:45.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:44 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:14:45.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:44 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:45.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:44 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:45.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:44 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:45.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:44 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:45.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:44 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:45.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.500+0000 7f67c6da0640 1 -- 172.21.15.17:0/3833679155 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f67c01981f0 con 0x7f67ac07af80 2024-09-20T19:14:45.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.501+0000 7f67b6ffd640 1 -- 172.21.15.17:0/3833679155 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f67c01981f0 con 0x7f67ac07af80 2024-09-20T19:14:45.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.503+0000 7f67c6da0640 1 -- 172.21.15.17:0/3833679155 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f67ac07af80 msgr2=0x7f67ac07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:45.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.503+0000 7f67c6da0640 1 --2- 172.21.15.17:0/3833679155 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f67ac07af80 0x7f67ac07d440 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f67bc000c00 tx=0x7f67bc031400 comp rx=0 tx=0).stop 2024-09-20T19:14:45.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.503+0000 7f67c6da0640 1 -- 172.21.15.17:0/3833679155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67c01031f0 msgr2=0x7f67c019db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:45.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.503+0000 7f67c6da0640 1 --2- 172.21.15.17:0/3833679155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67c01031f0 0x7f67c019db00 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f67b000b370 tx=0x7f67b000b830 comp rx=0 tx=0).stop 2024-09-20T19:14:45.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.503+0000 7f67c6da0640 1 -- 172.21.15.17:0/3833679155 shutdown_connections 2024-09-20T19:14:45.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.503+0000 7f67c6da0640 1 --2- 172.21.15.17:0/3833679155 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f67ac07af80 0x7f67ac07d440 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.503+0000 7f67c6da0640 1 --2- 172.21.15.17:0/3833679155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67c01031f0 0x7f67c019db00 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.503+0000 7f67c6da0640 1 --2- 172.21.15.17:0/3833679155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c01028d0 0x7f67c019d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.503+0000 7f67c6da0640 1 -- 172.21.15.17:0/3833679155 >> 172.21.15.17:0/3833679155 conn(0x7f67c00fc310 msgr2=0x7f67c0108d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:45.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.503+0000 7f67c6da0640 1 -- 172.21.15.17:0/3833679155 shutdown_connections 2024-09-20T19:14:45.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.503+0000 7f67c6da0640 1 -- 172.21.15.17:0/3833679155 wait complete. 2024-09-20T19:14:45.514 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:14:45.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.589+0000 7f7010875640 1 -- 172.21.15.17:0/1710848221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f700c101900 msgr2=0x7f700c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:45.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.589+0000 7f7010875640 1 --2- 172.21.15.17:0/1710848221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f700c101900 0x7f700c101d60 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f7000009880 tx=0x7f700002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.589+0000 7f7010875640 1 -- 172.21.15.17:0/1710848221 shutdown_connections 2024-09-20T19:14:45.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.589+0000 7f7010875640 1 --2- 172.21.15.17:0/1710848221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f700c101900 0x7f700c101d60 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.589+0000 7f7010875640 1 --2- 172.21.15.17:0/1710848221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f700c107900 0x7f700c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.589+0000 7f7010875640 1 -- 172.21.15.17:0/1710848221 >> 172.21.15.17:0/1710848221 conn(0x7f700c0fd600 msgr2=0x7f700c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:45.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.589+0000 7f7010875640 1 -- 172.21.15.17:0/1710848221 shutdown_connections 2024-09-20T19:14:45.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.589+0000 7f7010875640 1 -- 172.21.15.17:0/1710848221 wait complete. 2024-09-20T19:14:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.590+0000 7f7010875640 1 Processor -- start 2024-09-20T19:14:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.590+0000 7f7010875640 1 -- start start 2024-09-20T19:14:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.590+0000 7f7010875640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f700c101900 0x7f700c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.590+0000 7f7010875640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f700c107900 0x7f700c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.590+0000 7f7010875640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f700c10edd0 con 0x7f700c107900 2024-09-20T19:14:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.590+0000 7f7010875640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f700c10ec50 con 0x7f700c101900 2024-09-20T19:14:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.590+0000 7f7009d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f700c107900 0x7f700c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.590+0000 7f7009d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f700c107900 0x7f700c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45768/0 (socket says 172.21.15.17:45768) 2024-09-20T19:14:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.590+0000 7f7009d9b640 1 -- 172.21.15.17:0/4270675923 learned_addr learned my addr 172.21.15.17:0/4270675923 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:14:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.590+0000 7f700a59c640 1 --2- 172.21.15.17:0/4270675923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f700c101900 0x7f700c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.590+0000 7f7009d9b640 1 -- 172.21.15.17:0/4270675923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f700c101900 msgr2=0x7f700c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.590+0000 7f7009d9b640 1 --2- 172.21.15.17:0/4270675923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f700c101900 0x7f700c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.590+0000 7f7009d9b640 1 -- 172.21.15.17:0/4270675923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700c074f70 con 0x7f700c107900 2024-09-20T19:14:45.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.591+0000 7f7009d9b640 1 --2- 172.21.15.17:0/4270675923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f700c107900 0x7f700c074a30 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f7000031460 tx=0x7f70000045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:45.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.591+0000 7f6ffb7fe640 1 -- 172.21.15.17:0/4270675923 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f700003f070 con 0x7f700c107900 2024-09-20T19:14:45.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.591+0000 7f6ffb7fe640 1 -- 172.21.15.17:0/4270675923 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f70000035f0 con 0x7f700c107900 2024-09-20T19:14:45.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.591+0000 7f7010875640 1 -- 172.21.15.17:0/4270675923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f700c075200 con 0x7f700c107900 2024-09-20T19:14:45.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.591+0000 7f6ffb7fe640 1 -- 172.21.15.17:0/4270675923 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7000035030 con 0x7f700c107900 2024-09-20T19:14:45.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.591+0000 7f7010875640 1 -- 172.21.15.17:0/4270675923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f700c1a3d60 con 0x7f700c107900 2024-09-20T19:14:45.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.592+0000 7f7010875640 1 -- 172.21.15.17:0/4270675923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f700c103040 con 0x7f700c107900 2024-09-20T19:14:45.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.593+0000 7f6ffb7fe640 1 -- 172.21.15.17:0/4270675923 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7000042070 con 0x7f700c107900 2024-09-20T19:14:45.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.593+0000 7f6ffb7fe640 1 --2- 172.21.15.17:0/4270675923 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ff407af30 0x7f6ff407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:45.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.593+0000 7f6ffb7fe640 1 -- 172.21.15.17:0/4270675923 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f70000bea20 con 0x7f700c107900 2024-09-20T19:14:45.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.593+0000 7f700a59c640 1 --2- 172.21.15.17:0/4270675923 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ff407af30 0x7f6ff407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:45.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.594+0000 7f700a59c640 1 --2- 172.21.15.17:0/4270675923 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ff407af30 0x7f6ff407d3f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc005fd0 tx=0x7f6ffc005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:45.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.598+0000 7f6ffb7fe640 1 -- 172.21.15.17:0/4270675923 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f700008a020 con 0x7f700c107900 2024-09-20T19:14:45.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.804+0000 7f7010875640 1 -- 172.21.15.17:0/4270675923 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f700c062630 con 0x7f6ff407af30 2024-09-20T19:14:45.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.805+0000 7f6ffb7fe640 1 -- 172.21.15.17:0/4270675923 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f700c062630 con 0x7f6ff407af30 2024-09-20T19:14:45.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.808+0000 7f7010875640 1 -- 172.21.15.17:0/4270675923 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ff407af30 msgr2=0x7f6ff407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:45.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.808+0000 7f7010875640 1 --2- 172.21.15.17:0/4270675923 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ff407af30 0x7f6ff407d3f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc005fd0 tx=0x7f6ffc005850 comp rx=0 tx=0).stop 2024-09-20T19:14:45.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.808+0000 7f7010875640 1 -- 172.21.15.17:0/4270675923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f700c107900 msgr2=0x7f700c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:45.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.808+0000 7f7010875640 1 --2- 172.21.15.17:0/4270675923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f700c107900 0x7f700c074a30 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f7000031460 tx=0x7f70000045e0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.808+0000 7f7010875640 1 -- 172.21.15.17:0/4270675923 shutdown_connections 2024-09-20T19:14:45.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.808+0000 7f7010875640 1 --2- 172.21.15.17:0/4270675923 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ff407af30 0x7f6ff407d3f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.808+0000 7f7010875640 1 --2- 172.21.15.17:0/4270675923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f700c107900 0x7f700c074a30 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.808+0000 7f7010875640 1 --2- 172.21.15.17:0/4270675923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f700c101900 0x7f700c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.808+0000 7f7010875640 1 -- 172.21.15.17:0/4270675923 >> 172.21.15.17:0/4270675923 conn(0x7f700c0fd600 msgr2=0x7f700c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:45.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.808+0000 7f7010875640 1 -- 172.21.15.17:0/4270675923 shutdown_connections 2024-09-20T19:14:45.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.808+0000 7f7010875640 1 -- 172.21.15.17:0/4270675923 wait complete. 2024-09-20T19:14:45.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.892+0000 7ffab8a19640 1 -- 172.21.15.17:0/3387610285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffab4107900 msgr2=0x7ffab4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:45.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.892+0000 7ffab8a19640 1 --2- 172.21.15.17:0/3387610285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffab4107900 0x7ffab4107ce0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009880 tx=0x7ffaa402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.892+0000 7ffab8a19640 1 -- 172.21.15.17:0/3387610285 shutdown_connections 2024-09-20T19:14:45.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.892+0000 7ffab8a19640 1 --2- 172.21.15.17:0/3387610285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffab4101900 0x7ffab4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.892+0000 7ffab8a19640 1 --2- 172.21.15.17:0/3387610285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffab4107900 0x7ffab4107ce0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.892+0000 7ffab8a19640 1 -- 172.21.15.17:0/3387610285 >> 172.21.15.17:0/3387610285 conn(0x7ffab40fd600 msgr2=0x7ffab40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:45.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.892+0000 7ffab8a19640 1 -- 172.21.15.17:0/3387610285 shutdown_connections 2024-09-20T19:14:45.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.892+0000 7ffab8a19640 1 -- 172.21.15.17:0/3387610285 wait complete. 2024-09-20T19:14:45.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.893+0000 7ffab8a19640 1 Processor -- start 2024-09-20T19:14:45.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.893+0000 7ffab8a19640 1 -- start start 2024-09-20T19:14:45.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.894+0000 7ffab8a19640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffab4101900 0x7ffab40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:45.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.894+0000 7ffab8a19640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffab4107900 0x7ffab4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:45.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.894+0000 7ffab8a19640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffab410edd0 con 0x7ffab4107900 2024-09-20T19:14:45.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.894+0000 7ffab8a19640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffab410ec50 con 0x7ffab4101900 2024-09-20T19:14:45.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.894+0000 7ffab1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffab4107900 0x7ffab4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:45.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.894+0000 7ffab1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffab4107900 0x7ffab4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45774/0 (socket says 172.21.15.17:45774) 2024-09-20T19:14:45.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.894+0000 7ffab1d9b640 1 -- 172.21.15.17:0/1094701085 learned_addr learned my addr 172.21.15.17:0/1094701085 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:14:45.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.894+0000 7ffab259c640 1 --2- 172.21.15.17:0/1094701085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffab4101900 0x7ffab40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:45.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.894+0000 7ffab1d9b640 1 -- 172.21.15.17:0/1094701085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffab4101900 msgr2=0x7ffab40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:45.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.894+0000 7ffab1d9b640 1 --2- 172.21.15.17:0/1094701085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffab4101900 0x7ffab40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:45.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.894+0000 7ffab1d9b640 1 -- 172.21.15.17:0/1094701085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab4074f70 con 0x7ffab4107900 2024-09-20T19:14:45.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.894+0000 7ffab1d9b640 1 --2- 172.21.15.17:0/1094701085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffab4107900 0x7ffab4074a30 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800d6f0 tx=0x7ffaa800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:45.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.894+0000 7ffaa37fe640 1 -- 172.21.15.17:0/1094701085 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffaa8017070 con 0x7ffab4107900 2024-09-20T19:14:45.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.894+0000 7ffab8a19640 1 -- 172.21.15.17:0/1094701085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab4075260 con 0x7ffab4107900 2024-09-20T19:14:45.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.894+0000 7ffaa37fe640 1 -- 172.21.15.17:0/1094701085 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffaa800de00 con 0x7ffab4107900 2024-09-20T19:14:45.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.894+0000 7ffaa37fe640 1 -- 172.21.15.17:0/1094701085 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffaa8004bb0 con 0x7ffab4107900 2024-09-20T19:14:45.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.894+0000 7ffab8a19640 1 -- 172.21.15.17:0/1094701085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab41a3e00 con 0x7ffab4107900 2024-09-20T19:14:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.895+0000 7ffab8a19640 1 -- 172.21.15.17:0/1094701085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab4103040 con 0x7ffab4107900 2024-09-20T19:14:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.896+0000 7ffaa37fe640 1 -- 172.21.15.17:0/1094701085 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ffaa8004e60 con 0x7ffab4107900 2024-09-20T19:14:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.897+0000 7ffaa37fe640 1 --2- 172.21.15.17:0/1094701085 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa9c07af30 0x7ffa9c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.897+0000 7ffaa37fe640 1 -- 172.21.15.17:0/1094701085 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7ffaa809dba0 con 0x7ffab4107900 2024-09-20T19:14:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.897+0000 7ffab259c640 1 --2- 172.21.15.17:0/1094701085 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa9c07af30 0x7ffa9c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.897+0000 7ffab259c640 1 --2- 172.21.15.17:0/1094701085 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa9c07af30 0x7ffa9c07d3f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40096c0 tx=0x7ffaa4031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:45.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:45.901+0000 7ffaa37fe640 1 -- 172.21.15.17:0/1094701085 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffaa80691a0 con 0x7ffab4107900 2024-09-20T19:14:46.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.120+0000 7ffab8a19640 1 -- 172.21.15.17:0/1094701085 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ffab4062630 con 0x7ffa9c07af30 2024-09-20T19:14:46.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.130+0000 7ffaa37fe640 1 -- 172.21.15.17:0/1094701085 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ffab4062630 con 0x7ffa9c07af30 2024-09-20T19:14:46.132 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:14:46.132 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (36m) 14m ago 47m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:14:46.132 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (39m) 14m ago 47m 10.2M - 19.1.1-369-ged8ee0f2 6acb0a031eab 49836659fa6a 2024-09-20T19:14:46.132 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (38m) 14m ago 46m 10.0M - 19.1.1-369-ged8ee0f2 6acb0a031eab b118bf302716 2024-09-20T19:14:46.132 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (34m) 14m ago 47m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:14:46.132 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (34m) 14m ago 46m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:14:46.132 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (35m) 14m ago 46m 83.4M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:14:46.132 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (30m) 14m ago 41m 20.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:14:46.132 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (30m) 14m ago 41m 20.8M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:14:46.132 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (15m) 14m ago 41m 14.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:14:46.133 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (30m) 14m ago 41m 22.0M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:14:46.133 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (38m) 14m ago 48m 531M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:14:46.133 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (37m) 14m ago 46m 465M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:14:46.133 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (34m) 14m ago 48m 66.8M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:14:46.133 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (34m) 14m ago 46m 49.5M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:14:46.133 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (36m) 14m ago 47m 12.2M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:14:46.133 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (36m) 14m ago 46m 11.5M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:14:46.133 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (34m) 14m ago 45m 90.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:14:46.133 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (33m) 14m ago 44m 94.3M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:14:46.133 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (32m) 14m ago 44m 87.4M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:14:46.133 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (32m) 14m ago 43m 103M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:14:46.133 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (31m) 14m ago 43m 90.3M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:14:46.133 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (30m) 14m ago 42m 81.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:14:46.133 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (36m) 14m ago 46m 71.4M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:14:46.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.132+0000 7ffab8a19640 1 -- 172.21.15.17:0/1094701085 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa9c07af30 msgr2=0x7ffa9c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:46.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.132+0000 7ffab8a19640 1 --2- 172.21.15.17:0/1094701085 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa9c07af30 0x7ffa9c07d3f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40096c0 tx=0x7ffaa4031400 comp rx=0 tx=0).stop 2024-09-20T19:14:46.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.132+0000 7ffab8a19640 1 -- 172.21.15.17:0/1094701085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffab4107900 msgr2=0x7ffab4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:46.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.132+0000 7ffab8a19640 1 --2- 172.21.15.17:0/1094701085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffab4107900 0x7ffab4074a30 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800d6f0 tx=0x7ffaa800dbb0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.132+0000 7ffab8a19640 1 -- 172.21.15.17:0/1094701085 shutdown_connections 2024-09-20T19:14:46.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.132+0000 7ffab8a19640 1 --2- 172.21.15.17:0/1094701085 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7ffa9c07af30 0x7ffa9c07d3f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.132+0000 7ffab8a19640 1 --2- 172.21.15.17:0/1094701085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffab4107900 0x7ffab4074a30 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.132+0000 7ffab8a19640 1 --2- 172.21.15.17:0/1094701085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffab4101900 0x7ffab40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.132+0000 7ffab8a19640 1 -- 172.21.15.17:0/1094701085 >> 172.21.15.17:0/1094701085 conn(0x7ffab40fd600 msgr2=0x7ffab40fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:46.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.132+0000 7ffab8a19640 1 -- 172.21.15.17:0/1094701085 shutdown_connections 2024-09-20T19:14:46.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.133+0000 7ffab8a19640 1 -- 172.21.15.17:0/1094701085 wait complete. 2024-09-20T19:14:46.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:45 smithi017 ceph-mon[108970]: pgmap v1181: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:46.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:45 smithi017 ceph-mon[108970]: pgmap v1182: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:46.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:45 smithi017 ceph-mon[108970]: pgmap v1183: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:46.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:46.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:46.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:45 smithi017 ceph-mon[108970]: Upgrade: Setting container_image for all mds 2024-09-20T19:14:46.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:46.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi017.puqizo"} : dispatch 2024-09-20T19:14:46.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi017.puqizo"}]': finished 2024-09-20T19:14:46.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi017.xhlvpy"} : dispatch 2024-09-20T19:14:46.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi017.xhlvpy"}]': finished 2024-09-20T19:14:46.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi172.liatxm"} : dispatch 2024-09-20T19:14:46.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi172.liatxm"}]': finished 2024-09-20T19:14:46.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi172.mugtlk"} : dispatch 2024-09-20T19:14:46.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi172.mugtlk"}]': finished 2024-09-20T19:14:46.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:45 smithi017 ceph-mon[108970]: Upgrade: Setting filesystem cephfs Joinable 2024-09-20T19:14:46.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:45 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-20T19:14:46.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.219+0000 7fa8fa85d640 1 -- 172.21.15.17:0/344539623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4107900 msgr2=0x7fa8f4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:46.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.219+0000 7fa8fa85d640 1 --2- 172.21.15.17:0/344539623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4107900 0x7fa8f4107ce0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009880 tx=0x7fa8e402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.219+0000 7fa8fa85d640 1 -- 172.21.15.17:0/344539623 shutdown_connections 2024-09-20T19:14:46.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.219+0000 7fa8fa85d640 1 --2- 172.21.15.17:0/344539623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8f4101900 0x7fa8f4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.219+0000 7fa8fa85d640 1 --2- 172.21.15.17:0/344539623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4107900 0x7fa8f4107ce0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.219+0000 7fa8fa85d640 1 -- 172.21.15.17:0/344539623 >> 172.21.15.17:0/344539623 conn(0x7fa8f40fd5e0 msgr2=0x7fa8f40ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:46.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.219+0000 7fa8fa85d640 1 -- 172.21.15.17:0/344539623 shutdown_connections 2024-09-20T19:14:46.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.219+0000 7fa8fa85d640 1 -- 172.21.15.17:0/344539623 wait complete. 2024-09-20T19:14:46.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.220+0000 7fa8fa85d640 1 Processor -- start 2024-09-20T19:14:46.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.220+0000 7fa8fa85d640 1 -- start start 2024-09-20T19:14:46.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.220+0000 7fa8fa85d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4101900 0x7fa8f40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:46.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.220+0000 7fa8fa85d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8f4107900 0x7fa8f4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:46.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.220+0000 7fa8fa85d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f410edd0 con 0x7fa8f4101900 2024-09-20T19:14:46.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.220+0000 7fa8fa85d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f410ec50 con 0x7fa8f4107900 2024-09-20T19:14:46.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.220+0000 7fa8f3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4101900 0x7fa8f40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:46.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.220+0000 7fa8f3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4101900 0x7fa8f40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45788/0 (socket says 172.21.15.17:45788) 2024-09-20T19:14:46.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.220+0000 7fa8f3fff640 1 -- 172.21.15.17:0/49394475 learned_addr learned my addr 172.21.15.17:0/49394475 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:14:46.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.221+0000 7fa8f37fe640 1 --2- 172.21.15.17:0/49394475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8f4107900 0x7fa8f4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:46.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.221+0000 7fa8f3fff640 1 -- 172.21.15.17:0/49394475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8f4107900 msgr2=0x7fa8f4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:46.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.221+0000 7fa8f3fff640 1 --2- 172.21.15.17:0/49394475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8f4107900 0x7fa8f4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.221+0000 7fa8f3fff640 1 -- 172.21.15.17:0/49394475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f4074f70 con 0x7fa8f4101900 2024-09-20T19:14:46.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.221+0000 7fa8f37fe640 1 --2- 172.21.15.17:0/49394475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8f4107900 0x7fa8f4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:14:46.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.221+0000 7fa8f3fff640 1 --2- 172.21.15.17:0/49394475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4101900 0x7fa8f40744f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4031460 tx=0x7fa8e40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:46.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.221+0000 7fa8f17fa640 1 -- 172.21.15.17:0/49394475 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa8e403f070 con 0x7fa8f4101900 2024-09-20T19:14:46.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.221+0000 7fa8f17fa640 1 -- 172.21.15.17:0/49394475 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa8e4004b10 con 0x7fa8f4101900 2024-09-20T19:14:46.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.222+0000 7fa8f17fa640 1 -- 172.21.15.17:0/49394475 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa8e4035030 con 0x7fa8f4101900 2024-09-20T19:14:46.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.222+0000 7fa8fa85d640 1 -- 172.21.15.17:0/49394475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f4075200 con 0x7fa8f4101900 2024-09-20T19:14:46.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.222+0000 7fa8fa85d640 1 -- 172.21.15.17:0/49394475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f41a3d80 con 0x7fa8f4101900 2024-09-20T19:14:46.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.223+0000 7fa8fa85d640 1 -- 172.21.15.17:0/49394475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f4103040 con 0x7fa8f4101900 2024-09-20T19:14:46.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.224+0000 7fa8f17fa640 1 -- 172.21.15.17:0/49394475 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa8e4042070 con 0x7fa8f4101900 2024-09-20T19:14:46.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.225+0000 7fa8f17fa640 1 --2- 172.21.15.17:0/49394475 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa8dc07af90 0x7fa8dc07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:46.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.225+0000 7fa8f17fa640 1 -- 172.21.15.17:0/49394475 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fa8e40bf430 con 0x7fa8f4101900 2024-09-20T19:14:46.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.225+0000 7fa8f37fe640 1 --2- 172.21.15.17:0/49394475 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa8dc07af90 0x7fa8dc07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:46.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.226+0000 7fa8f37fe640 1 --2- 172.21.15.17:0/49394475 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa8dc07af90 0x7fa8dc07d450 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80058c0 tx=0x7fa8e8005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:46.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.232+0000 7fa8f17fa640 1 -- 172.21.15.17:0/49394475 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa8e408ab50 con 0x7fa8f4101900 2024-09-20T19:14:46.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:45 smithi172 ceph-mon[80431]: pgmap v1181: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:46.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:45 smithi172 ceph-mon[80431]: pgmap v1182: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:46.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:45 smithi172 ceph-mon[80431]: pgmap v1183: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail 2024-09-20T19:14:46.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:46.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:46.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:45 smithi172 ceph-mon[80431]: Upgrade: Setting container_image for all mds 2024-09-20T19:14:46.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:46.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi017.puqizo"} : dispatch 2024-09-20T19:14:46.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi017.puqizo"}]': finished 2024-09-20T19:14:46.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi017.xhlvpy"} : dispatch 2024-09-20T19:14:46.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi017.xhlvpy"}]': finished 2024-09-20T19:14:46.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi172.liatxm"} : dispatch 2024-09-20T19:14:46.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi172.liatxm"}]': finished 2024-09-20T19:14:46.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi172.mugtlk"} : dispatch 2024-09-20T19:14:46.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi172.mugtlk"}]': finished 2024-09-20T19:14:46.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:45 smithi172 ceph-mon[80431]: Upgrade: Setting filesystem cephfs Joinable 2024-09-20T19:14:46.448 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:45 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-20T19:14:46.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.503+0000 7fa8fa85d640 1 -- 172.21.15.17:0/49394475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa8f4109e70 con 0x7fa8f4101900 2024-09-20T19:14:46.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.503+0000 7fa8f17fa640 1 -- 172.21.15.17:0/49394475 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fa8e408fa00 con 0x7fa8f4101900 2024-09-20T19:14:46.505 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:14:46.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:14:46.505 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:14:46.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:14:46.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:14:46.505 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:14:46.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:14:46.505 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:14:46.505 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:14:46.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:14:46.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:14:46.506 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:14:46.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:14:46.506 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:14:46.506 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:14:46.506 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:14:46.506 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:14:46.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.507+0000 7fa8fa85d640 1 -- 172.21.15.17:0/49394475 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa8dc07af90 msgr2=0x7fa8dc07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:46.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.507+0000 7fa8fa85d640 1 --2- 172.21.15.17:0/49394475 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa8dc07af90 0x7fa8dc07d450 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80058c0 tx=0x7fa8e8005850 comp rx=0 tx=0).stop 2024-09-20T19:14:46.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.507+0000 7fa8fa85d640 1 -- 172.21.15.17:0/49394475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4101900 msgr2=0x7fa8f40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:46.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.507+0000 7fa8fa85d640 1 --2- 172.21.15.17:0/49394475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4101900 0x7fa8f40744f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4031460 tx=0x7fa8e40045e0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.507+0000 7fa8fa85d640 1 -- 172.21.15.17:0/49394475 shutdown_connections 2024-09-20T19:14:46.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.507+0000 7fa8fa85d640 1 --2- 172.21.15.17:0/49394475 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa8dc07af90 0x7fa8dc07d450 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.507+0000 7fa8fa85d640 1 --2- 172.21.15.17:0/49394475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8f4107900 0x7fa8f4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.507+0000 7fa8fa85d640 1 --2- 172.21.15.17:0/49394475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f4101900 0x7fa8f40744f0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.507+0000 7fa8fa85d640 1 -- 172.21.15.17:0/49394475 >> 172.21.15.17:0/49394475 conn(0x7fa8f40fd5e0 msgr2=0x7fa8f40fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:46.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.507+0000 7fa8fa85d640 1 -- 172.21.15.17:0/49394475 shutdown_connections 2024-09-20T19:14:46.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.507+0000 7fa8fa85d640 1 -- 172.21.15.17:0/49394475 wait complete. 2024-09-20T19:14:46.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.600+0000 7fb8ad033640 1 -- 172.21.15.17:0/3109818233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a81033d0 msgr2=0x7fb8a810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:46.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.600+0000 7fb8ad033640 1 --2- 172.21.15.17:0/3109818233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a81033d0 0x7fb8a810b8c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009880 tx=0x7fb89c02a540 comp rx=0 tx=0).stop 2024-09-20T19:14:46.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.600+0000 7fb8ad033640 1 -- 172.21.15.17:0/3109818233 shutdown_connections 2024-09-20T19:14:46.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.600+0000 7fb8ad033640 1 --2- 172.21.15.17:0/3109818233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a81033d0 0x7fb8a810b8c0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.600+0000 7fb8ad033640 1 --2- 172.21.15.17:0/3109818233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a8102ab0 0x7fb8a8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.600+0000 7fb8ad033640 1 -- 172.21.15.17:0/3109818233 >> 172.21.15.17:0/3109818233 conn(0x7fb8a80fc550 msgr2=0x7fb8a80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:46.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.600+0000 7fb8ad033640 1 -- 172.21.15.17:0/3109818233 shutdown_connections 2024-09-20T19:14:46.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.600+0000 7fb8ad033640 1 -- 172.21.15.17:0/3109818233 wait complete. 2024-09-20T19:14:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.601+0000 7fb8ad033640 1 Processor -- start 2024-09-20T19:14:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.601+0000 7fb8ad033640 1 -- start start 2024-09-20T19:14:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.602+0000 7fb8ad033640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a8102ab0 0x7fb8a819d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.602+0000 7fb8ad033640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a81033d0 0x7fb8a819db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.602+0000 7fb8ad033640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a810edc0 con 0x7fb8a8102ab0 2024-09-20T19:14:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.602+0000 7fb8ad033640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a810ec40 con 0x7fb8a81033d0 2024-09-20T19:14:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.602+0000 7fb8a6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a8102ab0 0x7fb8a819d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.602+0000 7fb8a6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a8102ab0 0x7fb8a819d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45802/0 (socket says 172.21.15.17:45802) 2024-09-20T19:14:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.602+0000 7fb8a6d9d640 1 -- 172.21.15.17:0/257768735 learned_addr learned my addr 172.21.15.17:0/257768735 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:14:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.602+0000 7fb8a659c640 1 --2- 172.21.15.17:0/257768735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a81033d0 0x7fb8a819db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:46.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.602+0000 7fb8a6d9d640 1 -- 172.21.15.17:0/257768735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a81033d0 msgr2=0x7fb8a819db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:46.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.602+0000 7fb8a6d9d640 1 --2- 172.21.15.17:0/257768735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a81033d0 0x7fb8a819db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.602+0000 7fb8a6d9d640 1 -- 172.21.15.17:0/257768735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a8197790 con 0x7fb8a8102ab0 2024-09-20T19:14:46.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.602+0000 7fb8a6d9d640 1 --2- 172.21.15.17:0/257768735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a8102ab0 0x7fb8a819d610 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb89800c8a0 tx=0x7fb89800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:46.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.603+0000 7fb88ffff640 1 -- 172.21.15.17:0/257768735 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb8980079b0 con 0x7fb8a8102ab0 2024-09-20T19:14:46.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.603+0000 7fb8ad033640 1 -- 172.21.15.17:0/257768735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a8197a80 con 0x7fb8a8102ab0 2024-09-20T19:14:46.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.603+0000 7fb88ffff640 1 -- 172.21.15.17:0/257768735 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb898007b50 con 0x7fb8a8102ab0 2024-09-20T19:14:46.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.603+0000 7fb88ffff640 1 -- 172.21.15.17:0/257768735 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb898018700 con 0x7fb8a8102ab0 2024-09-20T19:14:46.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.603+0000 7fb8ad033640 1 -- 172.21.15.17:0/257768735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a8197e80 con 0x7fb8a8102ab0 2024-09-20T19:14:46.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.604+0000 7fb8ad033640 1 -- 172.21.15.17:0/257768735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a806a580 con 0x7fb8a8102ab0 2024-09-20T19:14:46.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.605+0000 7fb88ffff640 1 -- 172.21.15.17:0/257768735 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb898007d00 con 0x7fb8a8102ab0 2024-09-20T19:14:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.606+0000 7fb88ffff640 1 --2- 172.21.15.17:0/257768735 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb890083740 0x7fb890085c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.606+0000 7fb88ffff640 1 -- 172.21.15.17:0/257768735 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fb89809e370 con 0x7fb8a8102ab0 2024-09-20T19:14:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.606+0000 7fb8a659c640 1 --2- 172.21.15.17:0/257768735 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb890083740 0x7fb890085c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:46.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.607+0000 7fb8a659c640 1 --2- 172.21.15.17:0/257768735 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb890083740 0x7fb890085c00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8198ae0 tx=0x7fb89c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:46.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.610+0000 7fb88ffff640 1 -- 172.21.15.17:0/257768735 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb898014030 con 0x7fb8a8102ab0 2024-09-20T19:14:46.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.837+0000 7fb8ad033640 1 -- 172.21.15.17:0/257768735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb8a8102e90 con 0x7fb8a8102ab0 2024-09-20T19:14:46.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.838+0000 7fb88ffff640 1 -- 172.21.15.17:0/257768735 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2013 (secure 0 0 0) 0x7fb898069a90 con 0x7fb8a8102ab0 2024-09-20T19:14:46.840 INFO:teuthology.orchestra.run.smithi017.stdout:e28 2024-09-20T19:14:46.840 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T19:14:46:014546+0000 2024-09-20T19:14:46.840 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:14:46.840 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:14:46.840 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:14:46.840 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:14:46.840 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:14:46.840 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:14:46.840 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 28 2024-09-20T19:14:46.840 INFO:teuthology.orchestra.run.smithi017.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-20T19:14:46.840 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:14:46.841 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T19:14:46.014517+0000 2024-09-20T19:14:46.841 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:14:46.841 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:14:46.841 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:14:46.841 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:14:46.841 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:14:46.841 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:14:46.841 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:14:46.841 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:14:46.841 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:14:46.841 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:14:46.841 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:14:46.841 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:14:46.841 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=34332,1=34364} 2024-09-20T19:14:46.842 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-09-20T19:14:46.842 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:14:46.842 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:14:46.842 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:14:46.842 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:14:46.842 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:14:46.842 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:14:46.842 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:14:46.842 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:14:46.842 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-09-20T19:14:46.842 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{0:34332} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:14:46.842 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{1:34364} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:14:46.842 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:14:46.842 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:14:46.843 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-09-20T19:14:46.843 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:14:46.843 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:14:46.843 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{-1:44921} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:14:46.843 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 28 2024-09-20T19:14:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.841+0000 7fb8ad033640 1 -- 172.21.15.17:0/257768735 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb890083740 msgr2=0x7fb890085c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.841+0000 7fb8ad033640 1 --2- 172.21.15.17:0/257768735 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb890083740 0x7fb890085c00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8198ae0 tx=0x7fb89c031400 comp rx=0 tx=0).stop 2024-09-20T19:14:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.841+0000 7fb8ad033640 1 -- 172.21.15.17:0/257768735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a8102ab0 msgr2=0x7fb8a819d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.841+0000 7fb8ad033640 1 --2- 172.21.15.17:0/257768735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a8102ab0 0x7fb8a819d610 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb89800c8a0 tx=0x7fb89800cd60 comp rx=0 tx=0).stop 2024-09-20T19:14:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.842+0000 7fb8ad033640 1 -- 172.21.15.17:0/257768735 shutdown_connections 2024-09-20T19:14:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.842+0000 7fb8ad033640 1 --2- 172.21.15.17:0/257768735 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb890083740 0x7fb890085c00 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.842+0000 7fb8ad033640 1 --2- 172.21.15.17:0/257768735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a81033d0 0x7fb8a819db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.842+0000 7fb8ad033640 1 --2- 172.21.15.17:0/257768735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a8102ab0 0x7fb8a819d610 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.842+0000 7fb8ad033640 1 -- 172.21.15.17:0/257768735 >> 172.21.15.17:0/257768735 conn(0x7fb8a80fc550 msgr2=0x7fb8a810aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.842+0000 7fb8ad033640 1 -- 172.21.15.17:0/257768735 shutdown_connections 2024-09-20T19:14:46.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.842+0000 7fb8ad033640 1 -- 172.21.15.17:0/257768735 wait complete. 2024-09-20T19:14:46.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.930+0000 7f4acea17640 1 -- 172.21.15.17:0/480274442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ac81067f0 msgr2=0x7f4ac8106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.930+0000 7f4acea17640 1 --2- 172.21.15.17:0/480274442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ac81067f0 0x7f4ac8106bd0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8009880 tx=0x7f4ab802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.931+0000 7f4acea17640 1 -- 172.21.15.17:0/480274442 shutdown_connections 2024-09-20T19:14:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.931+0000 7f4acea17640 1 --2- 172.21.15.17:0/480274442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ac81007f0 0x7f4ac8100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.931+0000 7f4acea17640 1 --2- 172.21.15.17:0/480274442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ac81067f0 0x7f4ac8106bd0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.931+0000 7f4acea17640 1 -- 172.21.15.17:0/480274442 >> 172.21.15.17:0/480274442 conn(0x7f4ac80fc550 msgr2=0x7f4ac80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.931+0000 7f4acea17640 1 -- 172.21.15.17:0/480274442 shutdown_connections 2024-09-20T19:14:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.931+0000 7f4acea17640 1 -- 172.21.15.17:0/480274442 wait complete. 2024-09-20T19:14:46.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.932+0000 7f4acea17640 1 Processor -- start 2024-09-20T19:14:46.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.932+0000 7f4acea17640 1 -- start start 2024-09-20T19:14:46.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.932+0000 7f4acea17640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ac81007f0 0x7f4ac819c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:46.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.932+0000 7f4acea17640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ac81067f0 0x7f4ac819cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:46.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.932+0000 7f4acea17640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac810dca0 con 0x7f4ac81067f0 2024-09-20T19:14:46.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.932+0000 7f4acea17640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac810db20 con 0x7f4ac81007f0 2024-09-20T19:14:46.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.932+0000 7f4ac77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ac81067f0 0x7f4ac819cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:46.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.932+0000 7f4ac77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ac81067f0 0x7f4ac819cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45822/0 (socket says 172.21.15.17:45822) 2024-09-20T19:14:46.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.933+0000 7f4ac77fe640 1 -- 172.21.15.17:0/1285218765 learned_addr learned my addr 172.21.15.17:0/1285218765 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:14:46.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.933+0000 7f4ac7fff640 1 --2- 172.21.15.17:0/1285218765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ac81007f0 0x7f4ac819c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:46.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.933+0000 7f4ac77fe640 1 -- 172.21.15.17:0/1285218765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ac81007f0 msgr2=0x7f4ac819c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:46.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.933+0000 7f4ac77fe640 1 --2- 172.21.15.17:0/1285218765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ac81007f0 0x7f4ac819c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:46.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.933+0000 7f4ac77fe640 1 -- 172.21.15.17:0/1285218765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac8196790 con 0x7f4ac81067f0 2024-09-20T19:14:46.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.933+0000 7f4ac77fe640 1 --2- 172.21.15.17:0/1285218765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ac81067f0 0x7f4ac819cb50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00d8d0 tx=0x7f4abc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:46.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.933+0000 7f4ac57fa640 1 -- 172.21.15.17:0/1285218765 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4abc017030 con 0x7f4ac81067f0 2024-09-20T19:14:46.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.933+0000 7f4ac57fa640 1 -- 172.21.15.17:0/1285218765 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4abc004020 con 0x7f4ac81067f0 2024-09-20T19:14:46.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.933+0000 7f4acea17640 1 -- 172.21.15.17:0/1285218765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac8196a80 con 0x7f4ac81067f0 2024-09-20T19:14:46.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.933+0000 7f4ac57fa640 1 -- 172.21.15.17:0/1285218765 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4abc0047a0 con 0x7f4ac81067f0 2024-09-20T19:14:46.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.933+0000 7f4acea17640 1 -- 172.21.15.17:0/1285218765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac8197010 con 0x7f4ac81067f0 2024-09-20T19:14:46.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.935+0000 7f4acea17640 1 -- 172.21.15.17:0/1285218765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac8101f30 con 0x7f4ac81067f0 2024-09-20T19:14:46.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.936+0000 7f4ac57fa640 1 -- 172.21.15.17:0/1285218765 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4abc0041d0 con 0x7f4ac81067f0 2024-09-20T19:14:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.937+0000 7f4ac57fa640 1 --2- 172.21.15.17:0/1285218765 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ab007af30 0x7f4ab007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.937+0000 7f4ac57fa640 1 -- 172.21.15.17:0/1285218765 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f4abc018070 con 0x7f4ac81067f0 2024-09-20T19:14:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.937+0000 7f4ac7fff640 1 --2- 172.21.15.17:0/1285218765 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ab007af30 0x7f4ab007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:46.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.937+0000 7f4ac7fff640 1 --2- 172.21.15.17:0/1285218765 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ab007af30 0x7f4ab007d3f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80096c0 tx=0x7f4ab8031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:46.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:46.945+0000 7f4ac57fa640 1 -- 172.21.15.17:0/1285218765 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4abc069420 con 0x7f4ac81067f0 2024-09-20T19:14:47.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:47 smithi017 ceph-mon[108970]: from='client.35940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:47.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:47 smithi017 ceph-mon[108970]: from='client.35944 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:47.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:47 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-20T19:14:47.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:47 smithi017 ceph-mon[108970]: Standby daemon mds.cephfs.smithi017.puqizo assigned to filesystem cephfs as rank 0 2024-09-20T19:14:47.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:47 smithi017 ceph-mon[108970]: Standby daemon mds.cephfs.smithi017.xhlvpy assigned to filesystem cephfs as rank 1 2024-09-20T19:14:47.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:47 smithi017 ceph-mon[108970]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-20T19:14:47.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:47 smithi017 ceph-mon[108970]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-20T19:14:47.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:47 smithi017 ceph-mon[108970]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-20T19:14:47.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:47 smithi017 ceph-mon[108970]: fsmap cephfs:2/2 {0=cephfs.smithi017.puqizo=up:replay,1=cephfs.smithi017.xhlvpy=up:replay} 2 up:standby 2024-09-20T19:14:47.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:47 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"} : dispatch 2024-09-20T19:14:47.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:47 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/49394475' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:47.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:47 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/257768735' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:14:47.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.181+0000 7f4acea17640 1 -- 172.21.15.17:0/1285218765 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4ac8197320 con 0x7f4ab007af30 2024-09-20T19:14:47.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.183+0000 7f4ac57fa640 1 -- 172.21.15.17:0/1285218765 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7f4ac8197320 con 0x7f4ab007af30 2024-09-20T19:14:47.185 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:14:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2", 2024-09-20T19:14:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-09-20T19:14:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-20T19:14:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-09-20T19:14:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-09-20T19:14:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-09-20T19:14:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-09-20T19:14:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-09-20T19:14:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "mon" 2024-09-20T19:14:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-20T19:14:47.185 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-09-20T19:14:47.186 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-20T19:14:47.186 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:14:47.186 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:14:47.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.185+0000 7f4acea17640 1 -- 172.21.15.17:0/1285218765 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ab007af30 msgr2=0x7f4ab007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:47.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.185+0000 7f4acea17640 1 --2- 172.21.15.17:0/1285218765 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ab007af30 0x7f4ab007d3f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80096c0 tx=0x7f4ab8031400 comp rx=0 tx=0).stop 2024-09-20T19:14:47.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.185+0000 7f4acea17640 1 -- 172.21.15.17:0/1285218765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ac81067f0 msgr2=0x7f4ac819cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:47.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.185+0000 7f4acea17640 1 --2- 172.21.15.17:0/1285218765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ac81067f0 0x7f4ac819cb50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00d8d0 tx=0x7f4abc00dd90 comp rx=0 tx=0).stop 2024-09-20T19:14:47.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.186+0000 7f4acea17640 1 -- 172.21.15.17:0/1285218765 shutdown_connections 2024-09-20T19:14:47.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.186+0000 7f4acea17640 1 --2- 172.21.15.17:0/1285218765 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f4ab007af30 0x7f4ab007d3f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:47.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.186+0000 7f4acea17640 1 --2- 172.21.15.17:0/1285218765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ac81067f0 0x7f4ac819cb50 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:47.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.186+0000 7f4acea17640 1 --2- 172.21.15.17:0/1285218765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ac81007f0 0x7f4ac819c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:47.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.186+0000 7f4acea17640 1 -- 172.21.15.17:0/1285218765 >> 172.21.15.17:0/1285218765 conn(0x7f4ac80fc550 msgr2=0x7f4ac80fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:47.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.186+0000 7f4acea17640 1 -- 172.21.15.17:0/1285218765 shutdown_connections 2024-09-20T19:14:47.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.186+0000 7f4acea17640 1 -- 172.21.15.17:0/1285218765 wait complete. 2024-09-20T19:14:47.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.283+0000 7fe96df94640 1 -- 172.21.15.17:0/2317029172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe968101ef0 msgr2=0x7fe9681054a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.283+0000 7fe96df94640 1 --2- 172.21.15.17:0/2317029172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe968101ef0 0x7fe9681054a0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fe950009880 tx=0x7fe95002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:14:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.283+0000 7fe96df94640 1 -- 172.21.15.17:0/2317029172 shutdown_connections 2024-09-20T19:14:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.283+0000 7fe96df94640 1 --2- 172.21.15.17:0/2317029172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe968101ef0 0x7fe9681054a0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.283+0000 7fe96df94640 1 --2- 172.21.15.17:0/2317029172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe968101540 0x7fe968101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.283+0000 7fe96df94640 1 -- 172.21.15.17:0/2317029172 >> 172.21.15.17:0/2317029172 conn(0x7fe9680771e0 msgr2=0x7fe9680775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.284+0000 7fe96df94640 1 -- 172.21.15.17:0/2317029172 shutdown_connections 2024-09-20T19:14:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.284+0000 7fe96df94640 1 -- 172.21.15.17:0/2317029172 wait complete. 2024-09-20T19:14:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.284+0000 7fe96df94640 1 Processor -- start 2024-09-20T19:14:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.285+0000 7fe96df94640 1 -- start start 2024-09-20T19:14:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.285+0000 7fe96df94640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe968101540 0x7fe968102540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.285+0000 7fe96df94640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe968101ef0 0x7fe968102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.285+0000 7fe95ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe968101ef0 0x7fe968102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.285+0000 7fe95ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe968101ef0 0x7fe968102a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45848/0 (socket says 172.21.15.17:45848) 2024-09-20T19:14:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.285+0000 7fe95ffff640 1 -- 172.21.15.17:0/1573445200 learned_addr learned my addr 172.21.15.17:0/1573445200 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:14:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.285+0000 7fe96df94640 1 -- 172.21.15.17:0/1573445200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe96810dcb0 con 0x7fe968101ef0 2024-09-20T19:14:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.285+0000 7fe96df94640 1 -- 172.21.15.17:0/1573445200 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe96810db30 con 0x7fe968101540 2024-09-20T19:14:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.285+0000 7fe9677fe640 1 --2- 172.21.15.17:0/1573445200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe968101540 0x7fe968102540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.286+0000 7fe9677fe640 1 -- 172.21.15.17:0/1573445200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe968101ef0 msgr2=0x7fe968102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.286+0000 7fe9677fe640 1 --2- 172.21.15.17:0/1573445200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe968101ef0 0x7fe968102a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.286+0000 7fe9677fe640 1 -- 172.21.15.17:0/1573445200 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe968102fc0 con 0x7fe968101540 2024-09-20T19:14:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.286+0000 7fe95ffff640 1 --2- 172.21.15.17:0/1573445200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe968101ef0 0x7fe968102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-20T19:14:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.286+0000 7fe9677fe640 1 --2- 172.21.15.17:0/1573445200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe968101540 0x7fe968102540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe95800e970 tx=0x7fe95800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.286+0000 7fe9657fa640 1 -- 172.21.15.17:0/1573445200 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe95800cac0 con 0x7fe968101540 2024-09-20T19:14:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.286+0000 7fe9657fa640 1 -- 172.21.15.17:0/1573445200 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe95800cc60 con 0x7fe968101540 2024-09-20T19:14:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.286+0000 7fe96df94640 1 -- 172.21.15.17:0/1573445200 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9681032b0 con 0x7fe968101540 2024-09-20T19:14:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.286+0000 7fe9657fa640 1 -- 172.21.15.17:0/1573445200 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe9580047a0 con 0x7fe968101540 2024-09-20T19:14:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.286+0000 7fe96df94640 1 -- 172.21.15.17:0/1573445200 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9681a3be0 con 0x7fe968101540 2024-09-20T19:14:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.288+0000 7fe96df94640 1 -- 172.21.15.17:0/1573445200 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9680698d0 con 0x7fe968101540 2024-09-20T19:14:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.288+0000 7fe9657fa640 1 -- 172.21.15.17:0/1573445200 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe958004ab0 con 0x7fe968101540 2024-09-20T19:14:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.289+0000 7fe9657fa640 1 --2- 172.21.15.17:0/1573445200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe95407af40 0x7fe95407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:14:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.289+0000 7fe95ffff640 1 --2- 172.21.15.17:0/1573445200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe95407af40 0x7fe95407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:14:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.290+0000 7fe9657fa640 1 -- 172.21.15.17:0/1573445200 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fe95809e510 con 0x7fe968101540 2024-09-20T19:14:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.290+0000 7fe95ffff640 1 --2- 172.21.15.17:0/1573445200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe95407af40 0x7fe95407d400 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe9500096c0 tx=0x7fe950000bc0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:14:47.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.294+0000 7fe9657fa640 1 -- 172.21.15.17:0/1573445200 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe958069a70 con 0x7fe968101540 2024-09-20T19:14:47.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:47 smithi172 ceph-mon[80431]: from='client.35940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:47.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:47 smithi172 ceph-mon[80431]: from='client.35944 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:47.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:47 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-20T19:14:47.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:47 smithi172 ceph-mon[80431]: Standby daemon mds.cephfs.smithi017.puqizo assigned to filesystem cephfs as rank 0 2024-09-20T19:14:47.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:47 smithi172 ceph-mon[80431]: Standby daemon mds.cephfs.smithi017.xhlvpy assigned to filesystem cephfs as rank 1 2024-09-20T19:14:47.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:47 smithi172 ceph-mon[80431]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-20T19:14:47.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:47 smithi172 ceph-mon[80431]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-20T19:14:47.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:47 smithi172 ceph-mon[80431]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-20T19:14:47.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:47 smithi172 ceph-mon[80431]: fsmap cephfs:2/2 {0=cephfs.smithi017.puqizo=up:replay,1=cephfs.smithi017.xhlvpy=up:replay} 2 up:standby 2024-09-20T19:14:47.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:47 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"} : dispatch 2024-09-20T19:14:47.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:47 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/49394475' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:47.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:47 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/257768735' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:14:47.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.607+0000 7fe96df94640 1 -- 172.21.15.17:0/1573445200 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe9681a4080 con 0x7fe968101540 2024-09-20T19:14:47.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.608+0000 7fe9657fa640 1 -- 172.21.15.17:0/1573445200 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3669 (secure 0 0 0) 0x7fe95806e920 con 0x7fe968101540 2024-09-20T19:14:47.610 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-20T19:14:47.610 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-20T19:14:47.610 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi172 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi172/config 2024-09-20T19:14:47.610 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-20T19:14:47.610 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpmqzu1z9q:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:14:47.611 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-09-20T19:14:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-20T19:14:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-09-20T19:14:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-20T19:14:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-09-20T19:14:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5628, in 2024-09-20T19:14:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 5616, in main 2024-09-20T19:14:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-20T19:14:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-20T19:14:47.611 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-20T19:14:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-20T19:14:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-20T19:14:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmp1ys5mv1z.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-20T19:14:47.612 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 -e NODE_NAME=smithi172 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/run/ceph:z -v /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpmqzu1z9q:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 inventory --format=json-pretty --filter-for-batch 2024-09-20T19:14:47.612 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-20T19:14:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-09-20T19:14:47.612 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:14:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:14:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.611+0000 7fe96df94640 1 -- 172.21.15.17:0/1573445200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe95407af40 msgr2=0x7fe95407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.611+0000 7fe96df94640 1 --2- 172.21.15.17:0/1573445200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe95407af40 0x7fe95407d400 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe9500096c0 tx=0x7fe950000bc0 comp rx=0 tx=0).stop 2024-09-20T19:14:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.611+0000 7fe96df94640 1 -- 172.21.15.17:0/1573445200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe968101540 msgr2=0x7fe968102540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:14:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.611+0000 7fe96df94640 1 --2- 172.21.15.17:0/1573445200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe968101540 0x7fe968102540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe95800e970 tx=0x7fe95800ee30 comp rx=0 tx=0).stop 2024-09-20T19:14:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.611+0000 7fe96df94640 1 -- 172.21.15.17:0/1573445200 shutdown_connections 2024-09-20T19:14:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.611+0000 7fe96df94640 1 --2- 172.21.15.17:0/1573445200 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe95407af40 0x7fe95407d400 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.611+0000 7fe96df94640 1 --2- 172.21.15.17:0/1573445200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe968101ef0 0x7fe968102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.611+0000 7fe96df94640 1 --2- 172.21.15.17:0/1573445200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe968101540 0x7fe968102540 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:14:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.611+0000 7fe96df94640 1 -- 172.21.15.17:0/1573445200 >> 172.21.15.17:0/1573445200 conn(0x7fe9680771e0 msgr2=0x7fe968104720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:14:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.611+0000 7fe96df94640 1 -- 172.21.15.17:0/1573445200 shutdown_connections 2024-09-20T19:14:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:14:47.611+0000 7fe96df94640 1 -- 172.21.15.17:0/1573445200 wait complete. 2024-09-20T19:14:48.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:48 smithi017 ceph-mon[108970]: from='client.35948 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:48.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:48 smithi017 ceph-mon[108970]: pgmap v1184: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1017 KiB/s rd, 0 op/s 2024-09-20T19:14:48.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:48 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-20T19:14:48.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:48 smithi017 ceph-mon[108970]: mds.? [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] up:resolve 2024-09-20T19:14:48.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:48 smithi017 ceph-mon[108970]: fsmap cephfs:2/2 {0=cephfs.smithi017.puqizo=up:replay,1=cephfs.smithi017.xhlvpy=up:resolve} 2 up:standby 2024-09-20T19:14:48.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:48 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:48.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:48 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:48.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:48 smithi017 ceph-mon[108970]: Upgrade: Setting container_image for all rgw 2024-09-20T19:14:48.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:48 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:48.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:48 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:48.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:48 smithi017 ceph-mon[108970]: Upgrade: Setting container_image for all rbd-mirror 2024-09-20T19:14:48.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:48 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:48.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:48 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:48.388 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:48 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1573445200' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:14:48.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:48 smithi172 ceph-mon[80431]: from='client.35948 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:48.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:48 smithi172 ceph-mon[80431]: pgmap v1184: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1017 KiB/s rd, 0 op/s 2024-09-20T19:14:48.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:48 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-20T19:14:48.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:48 smithi172 ceph-mon[80431]: mds.? [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] up:resolve 2024-09-20T19:14:48.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:48 smithi172 ceph-mon[80431]: fsmap cephfs:2/2 {0=cephfs.smithi017.puqizo=up:replay,1=cephfs.smithi017.xhlvpy=up:resolve} 2 up:standby 2024-09-20T19:14:48.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:48 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:48.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:48 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:48.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:48 smithi172 ceph-mon[80431]: Upgrade: Setting container_image for all rgw 2024-09-20T19:14:48.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:48 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:48.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:48 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:48.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:48 smithi172 ceph-mon[80431]: Upgrade: Setting container_image for all rbd-mirror 2024-09-20T19:14:48.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:48 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:48.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:48 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:14:48.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:48 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1573445200' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:14:49.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:49 smithi172 ceph-mon[80431]: from='client.35960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:49.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:49 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:49.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:49 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-20T19:14:49.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:49 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:49.345 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:49 smithi017 ceph-mon[108970]: from='client.35960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:14:49.345 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:49 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:49.345 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:49 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-20T19:14:49.345 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:49 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:50.258 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:50 smithi017 ceph-mon[108970]: Upgrade: Updating ceph-exporter.smithi017 (1/2) 2024-09-20T19:14:50.258 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:50 smithi017 ceph-mon[108970]: Deploying daemon ceph-exporter.smithi017 on smithi017 2024-09-20T19:14:50.258 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:50 smithi017 ceph-mon[108970]: pgmap v1185: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 8.9 MiB/s rd, 3 op/s 2024-09-20T19:14:50.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:50 smithi172 ceph-mon[80431]: Upgrade: Updating ceph-exporter.smithi017 (1/2) 2024-09-20T19:14:50.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:50 smithi172 ceph-mon[80431]: Deploying daemon ceph-exporter.smithi017 on smithi017 2024-09-20T19:14:50.447 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:50 smithi172 ceph-mon[80431]: pgmap v1185: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 8.9 MiB/s rd, 3 op/s 2024-09-20T19:14:52.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:52 smithi017 ceph-mon[108970]: pgmap v1186: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 7 op/s 2024-09-20T19:14:52.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:52 smithi172 ceph-mon[80431]: pgmap v1186: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 7 op/s 2024-09-20T19:14:53.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:53 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:53.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:53 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:14:53.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:53 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:53.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:53 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:53.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:53 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:53.408 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:53 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:14:53.409 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:53 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:53.409 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:53 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:54.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:54 smithi017 ceph-mon[108970]: pgmap v1187: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 9 op/s 2024-09-20T19:14:54.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:54 smithi172 ceph-mon[80431]: pgmap v1187: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 9 op/s 2024-09-20T19:14:55.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:55 smithi017 ceph-mon[108970]: Upgrade: Updating ceph-exporter.smithi172 (2/2) 2024-09-20T19:14:55.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:55.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-20T19:14:55.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:55 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:55.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:55 smithi017 ceph-mon[108970]: Deploying daemon ceph-exporter.smithi172 on smithi172 2024-09-20T19:14:55.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:55 smithi017 ceph-mon[108970]: mds.? [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] up:resolve 2024-09-20T19:14:55.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:55 smithi017 ceph-mon[108970]: fsmap cephfs:2/2 {0=cephfs.smithi017.puqizo=up:resolve,1=cephfs.smithi017.xhlvpy=up:resolve} 2 up:standby 2024-09-20T19:14:55.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:55 smithi017 ceph-mon[108970]: pgmap v1188: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 8 op/s 2024-09-20T19:14:55.504 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:55 smithi172 ceph-mon[80431]: Upgrade: Updating ceph-exporter.smithi172 (2/2) 2024-09-20T19:14:55.504 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:55.504 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-20T19:14:55.504 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:55 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:14:55.504 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:55 smithi172 ceph-mon[80431]: Deploying daemon ceph-exporter.smithi172 on smithi172 2024-09-20T19:14:55.504 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:55 smithi172 ceph-mon[80431]: mds.? [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] up:resolve 2024-09-20T19:14:55.504 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:55 smithi172 ceph-mon[80431]: fsmap cephfs:2/2 {0=cephfs.smithi017.puqizo=up:resolve,1=cephfs.smithi017.xhlvpy=up:resolve} 2 up:standby 2024-09-20T19:14:55.504 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:55 smithi172 ceph-mon[80431]: pgmap v1188: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 8 op/s 2024-09-20T19:14:57.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:56 smithi017 ceph-mon[108970]: reconnect by client.14600 192.168.0.1:0/4159009387 after 0.000999989 2024-09-20T19:14:57.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:56 smithi017 ceph-mon[108970]: reconnect by client.14600 192.168.0.1:0/4159009387 after 0.000999989 2024-09-20T19:14:57.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:56 smithi017 ceph-mon[108970]: reconnect by client.24355 192.168.0.1:0/2617768171 after 0.000999989 2024-09-20T19:14:57.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:56 smithi017 ceph-mon[108970]: reconnect by client.24355 192.168.0.1:0/2617768171 after 0.000999989 2024-09-20T19:14:57.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:56 smithi017 ceph-mon[108970]: mds.? [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] up:reconnect 2024-09-20T19:14:57.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:56 smithi017 ceph-mon[108970]: mds.? [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] up:reconnect 2024-09-20T19:14:57.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:56 smithi017 ceph-mon[108970]: fsmap cephfs:2/2 {0=cephfs.smithi017.puqizo=up:reconnect,1=cephfs.smithi017.xhlvpy=up:reconnect} 2 up:standby 2024-09-20T19:14:57.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:56 smithi172 ceph-mon[80431]: reconnect by client.14600 192.168.0.1:0/4159009387 after 0.000999989 2024-09-20T19:14:57.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:56 smithi172 ceph-mon[80431]: reconnect by client.14600 192.168.0.1:0/4159009387 after 0.000999989 2024-09-20T19:14:57.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:56 smithi172 ceph-mon[80431]: reconnect by client.24355 192.168.0.1:0/2617768171 after 0.000999989 2024-09-20T19:14:57.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:56 smithi172 ceph-mon[80431]: reconnect by client.24355 192.168.0.1:0/2617768171 after 0.000999989 2024-09-20T19:14:57.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:56 smithi172 ceph-mon[80431]: mds.? [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] up:reconnect 2024-09-20T19:14:57.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:56 smithi172 ceph-mon[80431]: mds.? [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] up:reconnect 2024-09-20T19:14:57.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:56 smithi172 ceph-mon[80431]: fsmap cephfs:2/2 {0=cephfs.smithi017.puqizo=up:reconnect,1=cephfs.smithi017.xhlvpy=up:reconnect} 2 up:standby 2024-09-20T19:14:58.135 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:57 smithi172 ceph-mon[80431]: mds.? [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] up:rejoin 2024-09-20T19:14:58.135 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:57 smithi172 ceph-mon[80431]: mds.? [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] up:rejoin 2024-09-20T19:14:58.135 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:57 smithi172 ceph-mon[80431]: fsmap cephfs:2/2 {0=cephfs.smithi017.puqizo=up:rejoin,1=cephfs.smithi017.xhlvpy=up:rejoin} 2 up:standby 2024-09-20T19:14:58.135 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:57 smithi172 ceph-mon[80431]: daemon mds.cephfs.smithi017.xhlvpy is now active in filesystem cephfs as rank 1 2024-09-20T19:14:58.135 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:57 smithi172 ceph-mon[80431]: daemon mds.cephfs.smithi017.puqizo is now active in filesystem cephfs as rank 0 2024-09-20T19:14:58.136 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:57 smithi172 ceph-mon[80431]: pgmap v1189: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 7 op/s 2024-09-20T19:14:58.136 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:57 smithi172 ceph-mon[80431]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-20T19:14:58.136 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:57 smithi172 ceph-mon[80431]: mds.? [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] up:active 2024-09-20T19:14:58.136 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:57 smithi172 ceph-mon[80431]: mds.? [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] up:active 2024-09-20T19:14:58.136 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:57 smithi172 ceph-mon[80431]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi017.xhlvpy=up:active} 2 up:standby-replay 2024-09-20T19:14:58.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:57 smithi017 ceph-mon[108970]: mds.? [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] up:rejoin 2024-09-20T19:14:58.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:57 smithi017 ceph-mon[108970]: mds.? [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] up:rejoin 2024-09-20T19:14:58.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:57 smithi017 ceph-mon[108970]: fsmap cephfs:2/2 {0=cephfs.smithi017.puqizo=up:rejoin,1=cephfs.smithi017.xhlvpy=up:rejoin} 2 up:standby 2024-09-20T19:14:58.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:57 smithi017 ceph-mon[108970]: daemon mds.cephfs.smithi017.xhlvpy is now active in filesystem cephfs as rank 1 2024-09-20T19:14:58.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:57 smithi017 ceph-mon[108970]: daemon mds.cephfs.smithi017.puqizo is now active in filesystem cephfs as rank 0 2024-09-20T19:14:58.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:57 smithi017 ceph-mon[108970]: pgmap v1189: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 7 op/s 2024-09-20T19:14:58.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:57 smithi017 ceph-mon[108970]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-20T19:14:58.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:57 smithi017 ceph-mon[108970]: mds.? [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] up:active 2024-09-20T19:14:58.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:57 smithi017 ceph-mon[108970]: mds.? [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] up:active 2024-09-20T19:14:58.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:57 smithi017 ceph-mon[108970]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi017.xhlvpy=up:active} 2 up:standby-replay 2024-09-20T19:14:59.584 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:59 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:59.584 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:59 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:59.584 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:59 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:59.584 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:59 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:59.584 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:59 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:59.585 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:59 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:59.585 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:59 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:59.585 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:14:59 smithi172 ceph-mon[80431]: pgmap v1190: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 341 B/s wr, 14 op/s 2024-09-20T19:14:59.637 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:59 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:59.637 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:59 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:59.637 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:59 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:14:59.637 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:59 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:59.637 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:59 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:59.637 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:59 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:59.637 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:59 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:14:59.637 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:14:59 smithi017 ceph-mon[108970]: pgmap v1190: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 341 B/s wr, 14 op/s 2024-09-20T19:15:02.326 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:02 smithi172 ceph-mon[80431]: pgmap v1191: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 767 B/s wr, 17 op/s 2024-09-20T19:15:02.327 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:02 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:02.327 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:02 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:02.327 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:02 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:02.327 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:02 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:02.327 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:02 smithi017 ceph-mon[108970]: pgmap v1191: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 767 B/s wr, 17 op/s 2024-09-20T19:15:02.327 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:02 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:02.327 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:02 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:02.328 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:02 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:02.328 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:02 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:04.280 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:04 smithi172 ceph-mon[80431]: pgmap v1192: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 5.2 KiB/s wr, 18 op/s 2024-09-20T19:15:04.280 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:04 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:04.280 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:04 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:04.280 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:04 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:04.280 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:04 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:04.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:04 smithi017 ceph-mon[108970]: pgmap v1192: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 5.2 KiB/s wr, 18 op/s 2024-09-20T19:15:04.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:04 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:04.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:04 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:04.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:04 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:04.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:04 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:06.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:06 smithi017 ceph-mon[108970]: pgmap v1193: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 5.2 KiB/s wr, 18 op/s 2024-09-20T19:15:06.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:06 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:06.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:06 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:06.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:06 smithi172 ceph-mon[80431]: pgmap v1193: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 5.2 KiB/s wr, 18 op/s 2024-09-20T19:15:06.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:06 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:06.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:06 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:07.816 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:07.816 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:07.816 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:07.816 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:15:08.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:07 smithi017 ceph-mon[108970]: pgmap v1194: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-09-20T19:15:08.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:08.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:08.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:08.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:08.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:08.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:08.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:08.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:07 smithi017 ceph-mon[108970]: Upgrade: Setting filesystem cephfs Joinable 2024-09-20T19:15:08.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-20T19:15:08.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:08.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:15:08.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:08.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:08.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:08.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:15:08.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:07 smithi172 ceph-mon[80431]: pgmap v1194: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-09-20T19:15:08.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:08.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:08.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:08.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:08.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:08.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:08.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:08.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:07 smithi172 ceph-mon[80431]: Upgrade: Setting filesystem cephfs Joinable 2024-09-20T19:15:08.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-20T19:15:08.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:08.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:15:09.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-20T19:15:09.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-20T19:15:09.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi017.xhlvpy=up:active} 2 up:standby-replay 2024-09-20T19:15:09.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: Upgrade: Setting container_image for all ceph-exporter 2024-09-20T19:15:09.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:09.138 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi017"} : dispatch 2024-09-20T19:15:09.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi017"}]': finished 2024-09-20T19:15:09.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi172"} : dispatch 2024-09-20T19:15:09.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi172"}]': finished 2024-09-20T19:15:09.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: Upgrade: Setting container_image for all iscsi 2024-09-20T19:15:09.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:09.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: Upgrade: Setting container_image for all nfs 2024-09-20T19:15:09.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:09.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: Upgrade: Setting container_image for all nvmeof 2024-09-20T19:15:09.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:09.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: Upgrade: Finalizing container_image settings 2024-09-20T19:15:09.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-20T19:15:09.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-20T19:15:09.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:09.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-20T19:15:09.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-20T19:15:09.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-20T19:15:09.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-20T19:15:09.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-20T19:15:09.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-20T19:15:09.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-20T19:15:09.140 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-20T19:15:09.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-20T19:15:09.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-20T19:15:09.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-20T19:15:09.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:09.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-20T19:15:09.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-20T19:15:09.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-20T19:15:09.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-20T19:15:09.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-20T19:15:09.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-20T19:15:09.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-20T19:15:09.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-20T19:15:09.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:09.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:09.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:09.141 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:09.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:09.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:09.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: Upgrade: Complete! 2024-09-20T19:15:09.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-20T19:15:09.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-20T19:15:09.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:09.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:09.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:15:09.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:09.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:09.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:09.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:15:09.142 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:09.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-20T19:15:09.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-20T19:15:09.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: fsmap cephfs:2 {0=cephfs.smithi017.puqizo=up:active,1=cephfs.smithi017.xhlvpy=up:active} 2 up:standby-replay 2024-09-20T19:15:09.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: Upgrade: Setting container_image for all ceph-exporter 2024-09-20T19:15:09.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:09.197 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi017"} : dispatch 2024-09-20T19:15:09.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi017"}]': finished 2024-09-20T19:15:09.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi172"} : dispatch 2024-09-20T19:15:09.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi172"}]': finished 2024-09-20T19:15:09.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: Upgrade: Setting container_image for all iscsi 2024-09-20T19:15:09.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:09.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: Upgrade: Setting container_image for all nfs 2024-09-20T19:15:09.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:09.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: Upgrade: Setting container_image for all nvmeof 2024-09-20T19:15:09.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:09.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:09.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: Upgrade: Finalizing container_image settings 2024-09-20T19:15:09.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-20T19:15:09.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-20T19:15:09.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:09.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-20T19:15:09.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-20T19:15:09.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-20T19:15:09.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-20T19:15:09.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-20T19:15:09.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-20T19:15:09.199 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-20T19:15:09.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-20T19:15:09.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-20T19:15:09.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-20T19:15:09.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-20T19:15:09.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:09.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-20T19:15:09.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-20T19:15:09.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-20T19:15:09.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-20T19:15:09.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-20T19:15:09.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-20T19:15:09.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-20T19:15:09.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-20T19:15:09.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:09.200 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:09.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:09.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:09.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:09.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-20T19:15:09.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: Upgrade: Complete! 2024-09-20T19:15:09.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-20T19:15:09.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-20T19:15:09.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:09.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:09.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:15:09.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:09.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:15:09.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:15:09.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:15:09.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:10.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:09 smithi017 ceph-mon[108970]: pgmap v1195: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-09-20T19:15:10.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:09 smithi172 ceph-mon[80431]: pgmap v1195: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 5.2 KiB/s wr, 19 op/s 2024-09-20T19:15:12.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:11 smithi017 ceph-mon[108970]: pgmap v1196: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 4.9 KiB/s wr, 12 op/s 2024-09-20T19:15:12.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:11 smithi172 ceph-mon[80431]: pgmap v1196: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 4.9 KiB/s wr, 12 op/s 2024-09-20T19:15:13.573 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:13 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:13.574 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:13 smithi017 ceph-mon[108970]: pgmap v1197: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-20T19:15:13.696 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:13 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:13.696 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:13 smithi172 ceph-mon[80431]: pgmap v1197: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-20T19:15:16.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:15 smithi017 ceph-mon[108970]: pgmap v1198: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 7.8 MiB/s rd, 4 op/s 2024-09-20T19:15:16.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:15 smithi172 ceph-mon[80431]: pgmap v1198: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 7.8 MiB/s rd, 4 op/s 2024-09-20T19:15:17.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.710+0000 7fb3691d6640 1 -- 172.21.15.17:0/2939079158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3641067f0 msgr2=0x7fb364106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:17.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.710+0000 7fb3691d6640 1 --2- 172.21.15.17:0/2939079158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3641067f0 0x7fb364106bd0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fb354009880 tx=0x7fb35402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:15:17.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.710+0000 7fb3691d6640 1 -- 172.21.15.17:0/2939079158 shutdown_connections 2024-09-20T19:15:17.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.710+0000 7fb3691d6640 1 --2- 172.21.15.17:0/2939079158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3641007f0 0x7fb364100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:17.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.710+0000 7fb3691d6640 1 --2- 172.21.15.17:0/2939079158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3641067f0 0x7fb364106bd0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.710+0000 7fb3691d6640 1 -- 172.21.15.17:0/2939079158 >> 172.21.15.17:0/2939079158 conn(0x7fb3640fc550 msgr2=0x7fb3640fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.710+0000 7fb3691d6640 1 -- 172.21.15.17:0/2939079158 shutdown_connections 2024-09-20T19:15:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.710+0000 7fb3691d6640 1 -- 172.21.15.17:0/2939079158 wait complete. 2024-09-20T19:15:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.711+0000 7fb3691d6640 1 Processor -- start 2024-09-20T19:15:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.711+0000 7fb3691d6640 1 -- start start 2024-09-20T19:15:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.712+0000 7fb3691d6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3641007f0 0x7fb36419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.712+0000 7fb3691d6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3641067f0 0x7fb36419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.712+0000 7fb3691d6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb36410dcc0 con 0x7fb3641007f0 2024-09-20T19:15:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.712+0000 7fb3691d6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb36410db40 con 0x7fb3641067f0 2024-09-20T19:15:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.712+0000 7fb362d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3641007f0 0x7fb36419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.712+0000 7fb362d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3641007f0 0x7fb36419d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54662/0 (socket says 172.21.15.17:54662) 2024-09-20T19:15:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.712+0000 7fb362d9d640 1 -- 172.21.15.17:0/3491993807 learned_addr learned my addr 172.21.15.17:0/3491993807 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:15:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.712+0000 7fb36259c640 1 --2- 172.21.15.17:0/3491993807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3641067f0 0x7fb36419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.712+0000 7fb362d9d640 1 -- 172.21.15.17:0/3491993807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3641067f0 msgr2=0x7fb36419db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.712+0000 7fb362d9d640 1 --2- 172.21.15.17:0/3491993807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3641067f0 0x7fb36419db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.712+0000 7fb362d9d640 1 -- 172.21.15.17:0/3491993807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3641977b0 con 0x7fb3641007f0 2024-09-20T19:15:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.713+0000 7fb362d9d640 1 --2- 172.21.15.17:0/3491993807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3641007f0 0x7fb36419d630 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fb354031460 tx=0x7fb3540045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.713+0000 7fb34bfff640 1 -- 172.21.15.17:0/3491993807 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb35403f070 con 0x7fb3641007f0 2024-09-20T19:15:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.713+0000 7fb3691d6640 1 -- 172.21.15.17:0/3491993807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb364197a40 con 0x7fb3641007f0 2024-09-20T19:15:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.713+0000 7fb34bfff640 1 -- 172.21.15.17:0/3491993807 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb3540035f0 con 0x7fb3641007f0 2024-09-20T19:15:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.713+0000 7fb34bfff640 1 -- 172.21.15.17:0/3491993807 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb354035030 con 0x7fb3641007f0 2024-09-20T19:15:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.713+0000 7fb3691d6640 1 -- 172.21.15.17:0/3491993807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb364197f70 con 0x7fb3641007f0 2024-09-20T19:15:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.714+0000 7fb3691d6640 1 -- 172.21.15.17:0/3491993807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb364101f30 con 0x7fb3641007f0 2024-09-20T19:15:17.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.715+0000 7fb34bfff640 1 -- 172.21.15.17:0/3491993807 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb354042070 con 0x7fb3641007f0 2024-09-20T19:15:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.715+0000 7fb34bfff640 1 --2- 172.21.15.17:0/3491993807 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb34c07af30 0x7fb34c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.715+0000 7fb34bfff640 1 -- 172.21.15.17:0/3491993807 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fb3540be970 con 0x7fb3641007f0 2024-09-20T19:15:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.715+0000 7fb36259c640 1 --2- 172.21.15.17:0/3491993807 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb34c07af30 0x7fb34c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:17.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.716+0000 7fb36259c640 1 --2- 172.21.15.17:0/3491993807 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb34c07af30 0x7fb34c07d3f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb364104fd0 tx=0x7fb35800b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:17.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.720+0000 7fb34bfff640 1 -- 172.21.15.17:0/3491993807 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3540c0e20 con 0x7fb3641007f0 2024-09-20T19:15:17.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.925+0000 7fb3691d6640 1 -- 172.21.15.17:0/3491993807 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb3641982e0 con 0x7fb34c07af30 2024-09-20T19:15:17.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.926+0000 7fb34bfff640 1 -- 172.21.15.17:0/3491993807 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7fb3641982e0 con 0x7fb34c07af30 2024-09-20T19:15:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.928+0000 7fb3691d6640 1 -- 172.21.15.17:0/3491993807 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb34c07af30 msgr2=0x7fb34c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.928+0000 7fb3691d6640 1 --2- 172.21.15.17:0/3491993807 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb34c07af30 0x7fb34c07d3f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb364104fd0 tx=0x7fb35800b390 comp rx=0 tx=0).stop 2024-09-20T19:15:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.928+0000 7fb3691d6640 1 -- 172.21.15.17:0/3491993807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3641007f0 msgr2=0x7fb36419d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.928+0000 7fb3691d6640 1 --2- 172.21.15.17:0/3491993807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3641007f0 0x7fb36419d630 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fb354031460 tx=0x7fb3540045e0 comp rx=0 tx=0).stop 2024-09-20T19:15:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.928+0000 7fb3691d6640 1 -- 172.21.15.17:0/3491993807 shutdown_connections 2024-09-20T19:15:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.928+0000 7fb3691d6640 1 --2- 172.21.15.17:0/3491993807 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb34c07af30 0x7fb34c07d3f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:17.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.928+0000 7fb3691d6640 1 --2- 172.21.15.17:0/3491993807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3641067f0 0x7fb36419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:17.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.928+0000 7fb3691d6640 1 --2- 172.21.15.17:0/3491993807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3641007f0 0x7fb36419d630 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:17.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.928+0000 7fb3691d6640 1 -- 172.21.15.17:0/3491993807 >> 172.21.15.17:0/3491993807 conn(0x7fb3640fc550 msgr2=0x7fb364069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:17.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.928+0000 7fb3691d6640 1 -- 172.21.15.17:0/3491993807 shutdown_connections 2024-09-20T19:15:17.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:17.928+0000 7fb3691d6640 1 -- 172.21.15.17:0/3491993807 wait complete. 2024-09-20T19:15:17.970 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:17 smithi017 ceph-mon[108970]: pgmap v1199: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s rd, 4 op/s 2024-09-20T19:15:18.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:17 smithi172 ceph-mon[80431]: pgmap v1199: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s rd, 4 op/s 2024-09-20T19:15:18.575 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph orch ps' 2024-09-20T19:15:18.879 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:15:19.119 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:18 smithi017 ceph-mon[108970]: from='client.35970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:19.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:18 smithi172 ceph-mon[80431]: from='client.35970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:19.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.332+0000 7fdb3384c640 1 -- 172.21.15.17:0/3446289921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c1007f0 msgr2=0x7fdb2c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.332+0000 7fdb3384c640 1 --2- 172.21.15.17:0/3446289921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c1007f0 0x7fdb2c100c50 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009880 tx=0x7fdb1c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:15:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.332+0000 7fdb3384c640 1 -- 172.21.15.17:0/3446289921 shutdown_connections 2024-09-20T19:15:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.332+0000 7fdb3384c640 1 --2- 172.21.15.17:0/3446289921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c1007f0 0x7fdb2c100c50 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.332+0000 7fdb3384c640 1 --2- 172.21.15.17:0/3446289921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb2c1067f0 0x7fdb2c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.332+0000 7fdb3384c640 1 -- 172.21.15.17:0/3446289921 >> 172.21.15.17:0/3446289921 conn(0x7fdb2c0fc550 msgr2=0x7fdb2c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.332+0000 7fdb3384c640 1 -- 172.21.15.17:0/3446289921 shutdown_connections 2024-09-20T19:15:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.332+0000 7fdb3384c640 1 -- 172.21.15.17:0/3446289921 wait complete. 2024-09-20T19:15:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.333+0000 7fdb3384c640 1 Processor -- start 2024-09-20T19:15:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.333+0000 7fdb3384c640 1 -- start start 2024-09-20T19:15:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.333+0000 7fdb3384c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c1007f0 0x7fdb2c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.333+0000 7fdb3384c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb2c1067f0 0x7fdb2c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.333+0000 7fdb3384c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c10dca0 con 0x7fdb2c1007f0 2024-09-20T19:15:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.333+0000 7fdb3384c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c10db20 con 0x7fdb2c1067f0 2024-09-20T19:15:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.334+0000 7fdb315e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c1007f0 0x7fdb2c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.334+0000 7fdb315e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c1007f0 0x7fdb2c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54674/0 (socket says 172.21.15.17:54674) 2024-09-20T19:15:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.334+0000 7fdb315e8640 1 -- 172.21.15.17:0/3486418154 learned_addr learned my addr 172.21.15.17:0/3486418154 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:15:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.334+0000 7fdb30de7640 1 --2- 172.21.15.17:0/3486418154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb2c1067f0 0x7fdb2c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.334+0000 7fdb315e8640 1 -- 172.21.15.17:0/3486418154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb2c1067f0 msgr2=0x7fdb2c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.334+0000 7fdb315e8640 1 --2- 172.21.15.17:0/3486418154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb2c1067f0 0x7fdb2c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.334+0000 7fdb315e8640 1 -- 172.21.15.17:0/3486418154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2c0fd700 con 0x7fdb2c1007f0 2024-09-20T19:15:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.334+0000 7fdb315e8640 1 --2- 172.21.15.17:0/3486418154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c1007f0 0x7fdb2c0fcc80 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fdb2800d8d0 tx=0x7fdb2800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.334+0000 7fdb227fc640 1 -- 172.21.15.17:0/3486418154 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb28017070 con 0x7fdb2c1007f0 2024-09-20T19:15:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.334+0000 7fdb3384c640 1 -- 172.21.15.17:0/3486418154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2c0fd9f0 con 0x7fdb2c1007f0 2024-09-20T19:15:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.334+0000 7fdb227fc640 1 -- 172.21.15.17:0/3486418154 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb28010460 con 0x7fdb2c1007f0 2024-09-20T19:15:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.334+0000 7fdb227fc640 1 -- 172.21.15.17:0/3486418154 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb2800f5f0 con 0x7fdb2c1007f0 2024-09-20T19:15:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.335+0000 7fdb3384c640 1 -- 172.21.15.17:0/3486418154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb2c1a3e00 con 0x7fdb2c1007f0 2024-09-20T19:15:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.336+0000 7fdb3384c640 1 -- 172.21.15.17:0/3486418154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb2c101f30 con 0x7fdb2c1007f0 2024-09-20T19:15:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.336+0000 7fdb227fc640 1 -- 172.21.15.17:0/3486418154 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdb28009a30 con 0x7fdb2c1007f0 2024-09-20T19:15:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.337+0000 7fdb227fc640 1 --2- 172.21.15.17:0/3486418154 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdb1807af30 0x7fdb1807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:19.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.337+0000 7fdb227fc640 1 -- 172.21.15.17:0/3486418154 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fdb2809ddf0 con 0x7fdb2c1007f0 2024-09-20T19:15:19.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.337+0000 7fdb30de7640 1 --2- 172.21.15.17:0/3486418154 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdb1807af30 0x7fdb1807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:19.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.338+0000 7fdb30de7640 1 --2- 172.21.15.17:0/3486418154 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdb1807af30 0x7fdb1807d3f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0fe710 tx=0x7fdb1c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:19.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.341+0000 7fdb227fc640 1 -- 172.21.15.17:0/3486418154 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb280693f0 con 0x7fdb2c1007f0 2024-09-20T19:15:19.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.538+0000 7fdb3384c640 1 -- 172.21.15.17:0/3486418154 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fdb2c062630 con 0x7fdb1807af30 2024-09-20T19:15:19.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.548+0000 7fdb227fc640 1 -- 172.21.15.17:0/3486418154 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fdb2c062630 con 0x7fdb1807af30 2024-09-20T19:15:19.550 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:15:19.551 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (36m) 16s ago 47m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:15:19.551 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (27s) 16s ago 47m 8246k - 19.3.0-5099-g88deadb8 441f9a3fe515 13ee1947d1e2 2024-09-20T19:15:19.551 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (22s) 18s ago 47m 7516k - 19.3.0-5099-g88deadb8 441f9a3fe515 23495c1d91e3 2024-09-20T19:15:19.551 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (35m) 16s ago 47m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:15:19.551 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (34m) 18s ago 46m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:15:19.551 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (36m) 16s ago 47m 83.9M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:15:19.551 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (31m) 16s ago 42m 89.1M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:15:19.551 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (30m) 16s ago 42m 26.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:15:19.551 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (15m) 18s ago 42m 23.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:15:19.551 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (30m) 18s ago 42m 183M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:15:19.551 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (38m) 16s ago 48m 535M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:15:19.551 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (37m) 18s ago 46m 466M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:15:19.551 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (35m) 16s ago 49m 84.4M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:15:19.552 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (35m) 18s ago 46m 57.7M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:15:19.552 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (37m) 16s ago 47m 12.4M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:15:19.552 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (37m) 18s ago 46m 10.8M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:15:19.552 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (34m) 16s ago 45m 95.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:15:19.552 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (33m) 16s ago 45m 104M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:15:19.552 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (33m) 16s ago 44m 96.1M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:15:19.552 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (32m) 18s ago 44m 114M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:15:19.552 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (32m) 18s ago 43m 94.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:15:19.552 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (31m) 18s ago 43m 90.2M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:15:19.552 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (37m) 16s ago 47m 71.7M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:15:19.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.550+0000 7fdb3384c640 1 -- 172.21.15.17:0/3486418154 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdb1807af30 msgr2=0x7fdb1807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:19.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.550+0000 7fdb3384c640 1 --2- 172.21.15.17:0/3486418154 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdb1807af30 0x7fdb1807d3f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0fe710 tx=0x7fdb1c031400 comp rx=0 tx=0).stop 2024-09-20T19:15:19.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.550+0000 7fdb3384c640 1 -- 172.21.15.17:0/3486418154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c1007f0 msgr2=0x7fdb2c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:19.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.550+0000 7fdb3384c640 1 --2- 172.21.15.17:0/3486418154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c1007f0 0x7fdb2c0fcc80 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fdb2800d8d0 tx=0x7fdb2800dd90 comp rx=0 tx=0).stop 2024-09-20T19:15:19.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.550+0000 7fdb3384c640 1 -- 172.21.15.17:0/3486418154 shutdown_connections 2024-09-20T19:15:19.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.550+0000 7fdb3384c640 1 --2- 172.21.15.17:0/3486418154 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdb1807af30 0x7fdb1807d3f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:19.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.550+0000 7fdb3384c640 1 --2- 172.21.15.17:0/3486418154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb2c1067f0 0x7fdb2c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:19.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.550+0000 7fdb3384c640 1 --2- 172.21.15.17:0/3486418154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb2c1007f0 0x7fdb2c0fcc80 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:19.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.551+0000 7fdb3384c640 1 -- 172.21.15.17:0/3486418154 >> 172.21.15.17:0/3486418154 conn(0x7fdb2c0fc550 msgr2=0x7fdb2c069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:19.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.551+0000 7fdb3384c640 1 -- 172.21.15.17:0/3486418154 shutdown_connections 2024-09-20T19:15:19.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:19.551+0000 7fdb3384c640 1 -- 172.21.15.17:0/3486418154 wait complete. 2024-09-20T19:15:20.120 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:19 smithi017 ceph-mon[108970]: pgmap v1200: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 482 KiB/s rd, 3 op/s 2024-09-20T19:15:20.151 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph orch upgrade status' 2024-09-20T19:15:20.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:19 smithi172 ceph-mon[80431]: pgmap v1200: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 482 KiB/s rd, 3 op/s 2024-09-20T19:15:20.412 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:15:20.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.839+0000 7f1c6ef34640 1 -- 172.21.15.17:0/2642868625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c68102b20 msgr2=0x7f1c68102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:20.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.839+0000 7f1c6ef34640 1 --2- 172.21.15.17:0/2642868625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c68102b20 0x7f1c68102f00 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f1c580098b0 tx=0x7f1c5802a560 comp rx=0 tx=0).stop 2024-09-20T19:15:20.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.840+0000 7f1c6ef34640 1 -- 172.21.15.17:0/2642868625 shutdown_connections 2024-09-20T19:15:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.840+0000 7f1c6ef34640 1 --2- 172.21.15.17:0/2642868625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c68103440 0x7f1c6810b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.840+0000 7f1c6ef34640 1 --2- 172.21.15.17:0/2642868625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c68102b20 0x7f1c68102f00 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.840+0000 7f1c6ef34640 1 -- 172.21.15.17:0/2642868625 >> 172.21.15.17:0/2642868625 conn(0x7f1c680fc520 msgr2=0x7f1c680fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.840+0000 7f1c6ef34640 1 -- 172.21.15.17:0/2642868625 shutdown_connections 2024-09-20T19:15:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.840+0000 7f1c6ef34640 1 -- 172.21.15.17:0/2642868625 wait complete. 2024-09-20T19:15:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.840+0000 7f1c6ef34640 1 Processor -- start 2024-09-20T19:15:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.840+0000 7f1c6ef34640 1 -- start start 2024-09-20T19:15:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.841+0000 7f1c6ef34640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c68102b20 0x7f1c6819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.841+0000 7f1c6ef34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c68103440 0x7f1c6819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.841+0000 7f1c6ef34640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6810edf0 con 0x7f1c68103440 2024-09-20T19:15:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.841+0000 7f1c6ef34640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6810ec70 con 0x7f1c68102b20 2024-09-20T19:15:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.841+0000 7f1c67fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c68103440 0x7f1c6819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.841+0000 7f1c67fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c68103440 0x7f1c6819dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42758/0 (socket says 172.21.15.17:42758) 2024-09-20T19:15:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.841+0000 7f1c67fff640 1 -- 172.21.15.17:0/1558658455 learned_addr learned my addr 172.21.15.17:0/1558658455 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:15:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.841+0000 7f1c6ccd0640 1 --2- 172.21.15.17:0/1558658455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c68102b20 0x7f1c6819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.841+0000 7f1c67fff640 1 -- 172.21.15.17:0/1558658455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c68102b20 msgr2=0x7f1c6819d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.841+0000 7f1c67fff640 1 --2- 172.21.15.17:0/1558658455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c68102b20 0x7f1c6819d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.841+0000 7f1c67fff640 1 -- 172.21.15.17:0/1558658455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c68197880 con 0x7f1c68103440 2024-09-20T19:15:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.841+0000 7f1c6ccd0640 1 --2- 172.21.15.17:0/1558658455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c68102b20 0x7f1c6819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:15:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.842+0000 7f1c67fff640 1 --2- 172.21.15.17:0/1558658455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c68103440 0x7f1c6819dc00 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00c8f0 tx=0x7f1c5c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.842+0000 7f1c65ffb640 1 -- 172.21.15.17:0/1558658455 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c5c0079b0 con 0x7f1c68103440 2024-09-20T19:15:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.842+0000 7f1c65ffb640 1 -- 172.21.15.17:0/1558658455 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1c5c0054e0 con 0x7f1c68103440 2024-09-20T19:15:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.842+0000 7f1c6ef34640 1 -- 172.21.15.17:0/1558658455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c68197b70 con 0x7f1c68103440 2024-09-20T19:15:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.842+0000 7f1c65ffb640 1 -- 172.21.15.17:0/1558658455 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c5c004dd0 con 0x7f1c68103440 2024-09-20T19:15:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.842+0000 7f1c6ef34640 1 -- 172.21.15.17:0/1558658455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c68198100 con 0x7f1c68103440 2024-09-20T19:15:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.843+0000 7f1c6ef34640 1 -- 172.21.15.17:0/1558658455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c6806aa30 con 0x7f1c68103440 2024-09-20T19:15:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.844+0000 7f1c65ffb640 1 -- 172.21.15.17:0/1558658455 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1c5c005020 con 0x7f1c68103440 2024-09-20T19:15:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.844+0000 7f1c65ffb640 1 --2- 172.21.15.17:0/1558658455 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1c5007af30 0x7f1c5007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.844+0000 7f1c65ffb640 1 -- 172.21.15.17:0/1558658455 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f1c5c09dea0 con 0x7f1c68103440 2024-09-20T19:15:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.844+0000 7f1c6ccd0640 1 --2- 172.21.15.17:0/1558658455 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1c5007af30 0x7f1c5007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.845+0000 7f1c6ccd0640 1 --2- 172.21.15.17:0/1558658455 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1c5007af30 0x7f1c5007d3f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009230 tx=0x7f1c58009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:20.849+0000 7f1c65ffb640 1 -- 172.21.15.17:0/1558658455 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c5c014030 con 0x7f1c68103440 2024-09-20T19:15:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:21.054+0000 7f1c6ef34640 1 -- 172.21.15.17:0/1558658455 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1c68198db0 con 0x7f1c5007af30 2024-09-20T19:15:21.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:21.056+0000 7f1c65ffb640 1 -- 172.21.15.17:0/1558658455 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f1c68198db0 con 0x7f1c5007af30 2024-09-20T19:15:21.058 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:15:21.058 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": null, 2024-09-20T19:15:21.058 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": false, 2024-09-20T19:15:21.058 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "", 2024-09-20T19:15:21.058 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [], 2024-09-20T19:15:21.058 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": null, 2024-09-20T19:15:21.058 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-20T19:15:21.058 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-09-20T19:15:21.059 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:15:21.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:21.058+0000 7f1c6ef34640 1 -- 172.21.15.17:0/1558658455 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1c5007af30 msgr2=0x7f1c5007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:21.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:21.058+0000 7f1c6ef34640 1 --2- 172.21.15.17:0/1558658455 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1c5007af30 0x7f1c5007d3f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009230 tx=0x7f1c58009560 comp rx=0 tx=0).stop 2024-09-20T19:15:21.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:21.058+0000 7f1c6ef34640 1 -- 172.21.15.17:0/1558658455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c68103440 msgr2=0x7f1c6819dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:21.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:21.058+0000 7f1c6ef34640 1 --2- 172.21.15.17:0/1558658455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c68103440 0x7f1c6819dc00 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00c8f0 tx=0x7f1c5c00cdb0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:21.058+0000 7f1c6ef34640 1 -- 172.21.15.17:0/1558658455 shutdown_connections 2024-09-20T19:15:21.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:21.058+0000 7f1c6ef34640 1 --2- 172.21.15.17:0/1558658455 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f1c5007af30 0x7f1c5007d3f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:21.058+0000 7f1c6ef34640 1 --2- 172.21.15.17:0/1558658455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c68103440 0x7f1c6819dc00 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:21.058+0000 7f1c6ef34640 1 --2- 172.21.15.17:0/1558658455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c68102b20 0x7f1c6819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:21.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:21.058+0000 7f1c6ef34640 1 -- 172.21.15.17:0/1558658455 >> 172.21.15.17:0/1558658455 conn(0x7f1c680fc520 msgr2=0x7f1c68107e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:21.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:21.058+0000 7f1c6ef34640 1 -- 172.21.15.17:0/1558658455 shutdown_connections 2024-09-20T19:15:21.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:21.058+0000 7f1c6ef34640 1 -- 172.21.15.17:0/1558658455 wait complete. 2024-09-20T19:15:21.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:20 smithi017 ceph-mon[108970]: from='client.35974 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:21.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:20 smithi172 ceph-mon[80431]: from='client.35974 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:21.742 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph health detail' 2024-09-20T19:15:22.006 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:15:22.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:21 smithi017 ceph-mon[108970]: pgmap v1201: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:22.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:21 smithi017 ceph-mon[108970]: from='client.35978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:22.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:21 smithi172 ceph-mon[80431]: pgmap v1201: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:22.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:21 smithi172 ceph-mon[80431]: from='client.35978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:15:22.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.428+0000 7f271030a640 1 -- 172.21.15.17:0/447960408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2708103450 msgr2=0x7f270810b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:22.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.428+0000 7f271030a640 1 --2- 172.21.15.17:0/447960408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2708103450 0x7f270810b940 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009880 tx=0x7f26f802a530 comp rx=0 tx=0).stop 2024-09-20T19:15:22.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.429+0000 7f271030a640 1 -- 172.21.15.17:0/447960408 shutdown_connections 2024-09-20T19:15:22.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.429+0000 7f271030a640 1 --2- 172.21.15.17:0/447960408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2708103450 0x7f270810b940 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.429+0000 7f271030a640 1 --2- 172.21.15.17:0/447960408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2708102b30 0x7f2708102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.429+0000 7f271030a640 1 -- 172.21.15.17:0/447960408 >> 172.21.15.17:0/447960408 conn(0x7f27080fc550 msgr2=0x7f27080fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:22.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.429+0000 7f271030a640 1 -- 172.21.15.17:0/447960408 shutdown_connections 2024-09-20T19:15:22.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.429+0000 7f271030a640 1 -- 172.21.15.17:0/447960408 wait complete. 2024-09-20T19:15:22.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.429+0000 7f271030a640 1 Processor -- start 2024-09-20T19:15:22.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.429+0000 7f271030a640 1 -- start start 2024-09-20T19:15:22.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.429+0000 7f271030a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2708102b30 0x7f2708100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:22.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.430+0000 7f271030a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2708103450 0x7f2708100cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:22.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.430+0000 7f271030a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f270810edc0 con 0x7f2708102b30 2024-09-20T19:15:22.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.430+0000 7f271030a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f270810ec40 con 0x7f2708103450 2024-09-20T19:15:22.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.430+0000 7f270e0a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2708102b30 0x7f2708100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:22.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.430+0000 7f270e0a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2708102b30 0x7f2708100790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42782/0 (socket says 172.21.15.17:42782) 2024-09-20T19:15:22.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.430+0000 7f270e0a6640 1 -- 172.21.15.17:0/4240536574 learned_addr learned my addr 172.21.15.17:0/4240536574 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:15:22.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.430+0000 7f270d8a5640 1 --2- 172.21.15.17:0/4240536574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2708103450 0x7f2708100cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:22.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.430+0000 7f270e0a6640 1 -- 172.21.15.17:0/4240536574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2708103450 msgr2=0x7f2708100cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:22.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.430+0000 7f270e0a6640 1 --2- 172.21.15.17:0/4240536574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2708103450 0x7f2708100cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.430+0000 7f270e0a6640 1 -- 172.21.15.17:0/4240536574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2708101210 con 0x7f2708102b30 2024-09-20T19:15:22.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.430+0000 7f270e0a6640 1 --2- 172.21.15.17:0/4240536574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2708102b30 0x7f2708100790 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f270400ea30 tx=0x7f270400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:22.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.430+0000 7f26ff7fe640 1 -- 172.21.15.17:0/4240536574 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f270400cbe0 con 0x7f2708102b30 2024-09-20T19:15:22.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.430+0000 7f26ff7fe640 1 -- 172.21.15.17:0/4240536574 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f270400cd80 con 0x7f2708102b30 2024-09-20T19:15:22.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.430+0000 7f271030a640 1 -- 172.21.15.17:0/4240536574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2708101500 con 0x7f2708102b30 2024-09-20T19:15:22.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.430+0000 7f26ff7fe640 1 -- 172.21.15.17:0/4240536574 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f270401a920 con 0x7f2708102b30 2024-09-20T19:15:22.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.430+0000 7f271030a640 1 -- 172.21.15.17:0/4240536574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27081a3f10 con 0x7f2708102b30 2024-09-20T19:15:22.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.431+0000 7f271030a640 1 -- 172.21.15.17:0/4240536574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f270806a500 con 0x7f2708102b30 2024-09-20T19:15:22.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.432+0000 7f26ff7fe640 1 -- 172.21.15.17:0/4240536574 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f270401abd0 con 0x7f2708102b30 2024-09-20T19:15:22.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.433+0000 7f26ff7fe640 1 --2- 172.21.15.17:0/4240536574 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f26f407af40 0x7f26f407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:22.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.433+0000 7f270d8a5640 1 --2- 172.21.15.17:0/4240536574 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f26f407af40 0x7f26f407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:22.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.433+0000 7f26ff7fe640 1 -- 172.21.15.17:0/4240536574 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f270409e6b0 con 0x7f2708102b30 2024-09-20T19:15:22.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.433+0000 7f270d8a5640 1 --2- 172.21.15.17:0/4240536574 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f26f407af40 0x7f26f407d400 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2708102220 tx=0x7f26f8004f30 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:22.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.437+0000 7f26ff7fe640 1 -- 172.21.15.17:0/4240536574 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2704016030 con 0x7f2708102b30 2024-09-20T19:15:22.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.704+0000 7f271030a640 1 -- 172.21.15.17:0/4240536574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f2708102f10 con 0x7f2708102b30 2024-09-20T19:15:22.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.704+0000 7f26ff7fe640 1 -- 172.21.15.17:0/4240536574 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f2704069c10 con 0x7f2708102b30 2024-09-20T19:15:22.707 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:15:22.707 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:15:22.707 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:15:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.707+0000 7f271030a640 1 -- 172.21.15.17:0/4240536574 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f26f407af40 msgr2=0x7f26f407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.707+0000 7f271030a640 1 --2- 172.21.15.17:0/4240536574 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f26f407af40 0x7f26f407d400 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2708102220 tx=0x7f26f8004f30 comp rx=0 tx=0).stop 2024-09-20T19:15:22.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.707+0000 7f271030a640 1 -- 172.21.15.17:0/4240536574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2708102b30 msgr2=0x7f2708100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:22.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.707+0000 7f271030a640 1 --2- 172.21.15.17:0/4240536574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2708102b30 0x7f2708100790 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f270400ea30 tx=0x7f270400eef0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.707+0000 7f271030a640 1 -- 172.21.15.17:0/4240536574 shutdown_connections 2024-09-20T19:15:22.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.707+0000 7f271030a640 1 --2- 172.21.15.17:0/4240536574 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f26f407af40 0x7f26f407d400 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.707+0000 7f271030a640 1 --2- 172.21.15.17:0/4240536574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2708103450 0x7f2708100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.707+0000 7f271030a640 1 --2- 172.21.15.17:0/4240536574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2708102b30 0x7f2708100790 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:22.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.707+0000 7f271030a640 1 -- 172.21.15.17:0/4240536574 >> 172.21.15.17:0/4240536574 conn(0x7f27080fc550 msgr2=0x7f2708107e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:22.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.707+0000 7f271030a640 1 -- 172.21.15.17:0/4240536574 shutdown_connections 2024-09-20T19:15:22.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:22.707+0000 7f271030a640 1 -- 172.21.15.17:0/4240536574 wait complete. 2024-09-20T19:15:23.344 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:23 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:23.344 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:23 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:15:23.344 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:23 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4240536574' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:15:23.372 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph versions' 2024-09-20T19:15:23.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:23 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:15:23.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:23 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:15:23.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:23 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4240536574' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-20T19:15:23.642 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:15:24.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.088+0000 7f78a76b8640 1 -- 172.21.15.17:0/3444577063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a0103430 msgr2=0x7f78a010b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:24.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.088+0000 7f78a76b8640 1 --2- 172.21.15.17:0/3444577063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a0103430 0x7f78a010b920 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f78900098b0 tx=0x7f789002a560 comp rx=0 tx=0).stop 2024-09-20T19:15:24.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.088+0000 7f78a76b8640 1 -- 172.21.15.17:0/3444577063 shutdown_connections 2024-09-20T19:15:24.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.088+0000 7f78a76b8640 1 --2- 172.21.15.17:0/3444577063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a0103430 0x7f78a010b920 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:24.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.088+0000 7f78a76b8640 1 --2- 172.21.15.17:0/3444577063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78a0102b10 0x7f78a0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:24.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.088+0000 7f78a76b8640 1 -- 172.21.15.17:0/3444577063 >> 172.21.15.17:0/3444577063 conn(0x7f78a00fc550 msgr2=0x7f78a00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:24.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.088+0000 7f78a76b8640 1 -- 172.21.15.17:0/3444577063 shutdown_connections 2024-09-20T19:15:24.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.088+0000 7f78a76b8640 1 -- 172.21.15.17:0/3444577063 wait complete. 2024-09-20T19:15:24.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.089+0000 7f78a76b8640 1 Processor -- start 2024-09-20T19:15:24.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.089+0000 7f78a76b8640 1 -- start start 2024-09-20T19:15:24.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.089+0000 7f78a76b8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78a0102b10 0x7f78a019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:24.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.089+0000 7f78a76b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a0103430 0x7f78a019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:24.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.089+0000 7f78a76b8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f78a010edc0 con 0x7f78a0103430 2024-09-20T19:15:24.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.089+0000 7f78a76b8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f78a010ec40 con 0x7f78a0102b10 2024-09-20T19:15:24.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.089+0000 7f78a4c53640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a0103430 0x7f78a019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:24.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.089+0000 7f78a4c53640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a0103430 0x7f78a019dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42788/0 (socket says 172.21.15.17:42788) 2024-09-20T19:15:24.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.089+0000 7f78a4c53640 1 -- 172.21.15.17:0/1006941543 learned_addr learned my addr 172.21.15.17:0/1006941543 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:15:24.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.089+0000 7f78a5454640 1 --2- 172.21.15.17:0/1006941543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78a0102b10 0x7f78a019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:24.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.090+0000 7f78a4c53640 1 -- 172.21.15.17:0/1006941543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78a0102b10 msgr2=0x7f78a019d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:24.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.090+0000 7f78a4c53640 1 --2- 172.21.15.17:0/1006941543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78a0102b10 0x7f78a019d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:24.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.090+0000 7f78a4c53640 1 -- 172.21.15.17:0/1006941543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a01977f0 con 0x7f78a0103430 2024-09-20T19:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.090+0000 7f78a4c53640 1 --2- 172.21.15.17:0/1006941543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a0103430 0x7f78a019dbb0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f7890031460 tx=0x7f78900045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.090+0000 7f78967fc640 1 -- 172.21.15.17:0/1006941543 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f789003f070 con 0x7f78a0103430 2024-09-20T19:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.090+0000 7f78967fc640 1 -- 172.21.15.17:0/1006941543 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f78900035f0 con 0x7f78a0103430 2024-09-20T19:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.090+0000 7f78a76b8640 1 -- 172.21.15.17:0/1006941543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a0197a80 con 0x7f78a0103430 2024-09-20T19:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.090+0000 7f78967fc640 1 -- 172.21.15.17:0/1006941543 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7890035030 con 0x7f78a0103430 2024-09-20T19:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.090+0000 7f78a76b8640 1 -- 172.21.15.17:0/1006941543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a0197fb0 con 0x7f78a0103430 2024-09-20T19:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.091+0000 7f78a76b8640 1 -- 172.21.15.17:0/1006941543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a006a520 con 0x7f78a0103430 2024-09-20T19:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.092+0000 7f78967fc640 1 -- 172.21.15.17:0/1006941543 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7890042070 con 0x7f78a0103430 2024-09-20T19:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.093+0000 7f78967fc640 1 --2- 172.21.15.17:0/1006941543 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f788c07af80 0x7f788c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.093+0000 7f78967fc640 1 -- 172.21.15.17:0/1006941543 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f78900be7e0 con 0x7f78a0103430 2024-09-20T19:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.093+0000 7f78a5454640 1 --2- 172.21.15.17:0/1006941543 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f788c07af80 0x7f788c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:15:24.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.093+0000 7f78a5454640 1 --2- 172.21.15.17:0/1006941543 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f788c07af80 0x7f788c07d440 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f789c005d00 tx=0x7f789c00b410 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:15:24.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.101+0000 7f78967fc640 1 -- 172.21.15.17:0/1006941543 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7890089e60 con 0x7f78a0103430 2024-09-20T19:15:24.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.364+0000 7f78a76b8640 1 -- 172.21.15.17:0/1006941543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f78a0105fa0 con 0x7f78a0103430 2024-09-20T19:15:24.367 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:24 smithi017 ceph-mon[108970]: pgmap v1202: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:24.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.365+0000 7f78967fc640 1 -- 172.21.15.17:0/1006941543 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f789008ed10 con 0x7f78a0103430 2024-09-20T19:15:24.367 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:15:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:15:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:15:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:15:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:15:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:15:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:15:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:15:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:15:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:15:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:15:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:15:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:15:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:15:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:15:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:15:24.368 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:15:24.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.367+0000 7f78a76b8640 1 -- 172.21.15.17:0/1006941543 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f788c07af80 msgr2=0x7f788c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:24.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.367+0000 7f78a76b8640 1 --2- 172.21.15.17:0/1006941543 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f788c07af80 0x7f788c07d440 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f789c005d00 tx=0x7f789c00b410 comp rx=0 tx=0).stop 2024-09-20T19:15:24.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.367+0000 7f78a76b8640 1 -- 172.21.15.17:0/1006941543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a0103430 msgr2=0x7f78a019dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:15:24.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.367+0000 7f78a76b8640 1 --2- 172.21.15.17:0/1006941543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a0103430 0x7f78a019dbb0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f7890031460 tx=0x7f78900045c0 comp rx=0 tx=0).stop 2024-09-20T19:15:24.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.367+0000 7f78a76b8640 1 -- 172.21.15.17:0/1006941543 shutdown_connections 2024-09-20T19:15:24.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.367+0000 7f78a76b8640 1 --2- 172.21.15.17:0/1006941543 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f788c07af80 0x7f788c07d440 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:24.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.367+0000 7f78a76b8640 1 --2- 172.21.15.17:0/1006941543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a0103430 0x7f78a019dbb0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:24.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.367+0000 7f78a76b8640 1 --2- 172.21.15.17:0/1006941543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78a0102b10 0x7f78a019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:15:24.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.367+0000 7f78a76b8640 1 -- 172.21.15.17:0/1006941543 >> 172.21.15.17:0/1006941543 conn(0x7f78a00fc550 msgr2=0x7f78a0103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:15:24.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.367+0000 7f78a76b8640 1 -- 172.21.15.17:0/1006941543 shutdown_connections 2024-09-20T19:15:24.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:15:24.367+0000 7f78a76b8640 1 -- 172.21.15.17:0/1006941543 wait complete. 2024-09-20T19:15:24.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:24 smithi172 ceph-mon[80431]: pgmap v1202: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:25.160 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-20T19:15:25.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:25 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1006941543' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:25.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:25 smithi017 ceph-mon[108970]: pgmap v1203: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:15:25.423 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:15:25.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:25 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1006941543' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:15:25.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:25 smithi172 ceph-mon[80431]: pgmap v1203: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:15:26.007 INFO:teuthology.orchestra.run.smithi017.stdout:wait for servicemap items w/ changing names to refresh 2024-09-20T19:15:26.731 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'sleep 60' 2024-09-20T19:15:26.997 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:15:28.136 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:27 smithi017 ceph-mon[108970]: pgmap v1204: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:28.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:27 smithi172 ceph-mon[80431]: pgmap v1204: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:30.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:29 smithi017 ceph-mon[108970]: pgmap v1205: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:30.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:29 smithi172 ceph-mon[80431]: pgmap v1205: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:32.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:31 smithi172 ceph-mon[80431]: pgmap v1206: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:32.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:31 smithi017 ceph-mon[108970]: pgmap v1206: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:34.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:33 smithi017 ceph-mon[108970]: pgmap v1207: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:34.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:33 smithi172 ceph-mon[80431]: pgmap v1207: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:36.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:35 smithi172 ceph-mon[80431]: pgmap v1208: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:15:36.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:35 smithi017 ceph-mon[108970]: pgmap v1208: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:15:38.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:37 smithi017 ceph-mon[108970]: pgmap v1209: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:38.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:15:38.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:37 smithi172 ceph-mon[80431]: pgmap v1209: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:38.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:15:40.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:39 smithi172 ceph-mon[80431]: pgmap v1210: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:40.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:39 smithi017 ceph-mon[108970]: pgmap v1210: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:42.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:41 smithi172 ceph-mon[80431]: pgmap v1211: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:42.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:41 smithi017 ceph-mon[108970]: pgmap v1211: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:44.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:43 smithi172 ceph-mon[80431]: pgmap v1212: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:44.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:43 smithi017 ceph-mon[108970]: pgmap v1212: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:46.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:45 smithi172 ceph-mon[80431]: pgmap v1213: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:15:46.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:45 smithi017 ceph-mon[108970]: pgmap v1213: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:15:48.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:47 smithi172 ceph-mon[80431]: pgmap v1214: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:48.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:47 smithi017 ceph-mon[108970]: pgmap v1214: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:50.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:49 smithi172 ceph-mon[80431]: pgmap v1215: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:50.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:49 smithi017 ceph-mon[108970]: pgmap v1215: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:52.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:51 smithi172 ceph-mon[80431]: pgmap v1216: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:52.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:51 smithi017 ceph-mon[108970]: pgmap v1216: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:53.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:15:53.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:15:54.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:53 smithi017 ceph-mon[108970]: pgmap v1217: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:54.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:53 smithi172 ceph-mon[80431]: pgmap v1217: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:56.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:55 smithi172 ceph-mon[80431]: pgmap v1218: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:15:56.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:55 smithi017 ceph-mon[108970]: pgmap v1218: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:15:58.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:57 smithi172 ceph-mon[80431]: pgmap v1219: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:15:58.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:57 smithi017 ceph-mon[108970]: pgmap v1219: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:00.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:15:59 smithi172 ceph-mon[80431]: pgmap v1220: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:00.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:15:59 smithi017 ceph-mon[108970]: pgmap v1220: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:02.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:01 smithi172 ceph-mon[80431]: pgmap v1221: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:02.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:01 smithi017 ceph-mon[108970]: pgmap v1221: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:04.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:03 smithi172 ceph-mon[80431]: pgmap v1222: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:04.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:03 smithi017 ceph-mon[108970]: pgmap v1222: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:06.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:05 smithi172 ceph-mon[80431]: pgmap v1223: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:16:06.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:05 smithi017 ceph-mon[108970]: pgmap v1223: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:16:08.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:07 smithi017 ceph-mon[108970]: pgmap v1224: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:08.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:16:08.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:07 smithi172 ceph-mon[80431]: pgmap v1224: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:08.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:16:09.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:16:09.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:16:09.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:16:09.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:16:09.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:16:09.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:16:09.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:16:09.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:16:10.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:09 smithi017 ceph-mon[108970]: pgmap v1225: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:10.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:09 smithi172 ceph-mon[80431]: pgmap v1225: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:12.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:11 smithi017 ceph-mon[108970]: pgmap v1226: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:12.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:11 smithi172 ceph-mon[80431]: pgmap v1226: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:14.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:13 smithi017 ceph-mon[108970]: pgmap v1227: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:14.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:13 smithi172 ceph-mon[80431]: pgmap v1227: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:16.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:15 smithi017 ceph-mon[108970]: pgmap v1228: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:16:16.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:15 smithi172 ceph-mon[80431]: pgmap v1228: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:16:18.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:17 smithi017 ceph-mon[108970]: pgmap v1229: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:18.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:17 smithi172 ceph-mon[80431]: pgmap v1229: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:20.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:19 smithi017 ceph-mon[108970]: pgmap v1230: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:20.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:19 smithi172 ceph-mon[80431]: pgmap v1230: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:22.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:21 smithi017 ceph-mon[108970]: pgmap v1231: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:22.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:21 smithi172 ceph-mon[80431]: pgmap v1231: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:23.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:16:23.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:16:24.338 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:23 smithi017 ceph-mon[108970]: pgmap v1232: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:24.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:23 smithi172 ceph-mon[80431]: pgmap v1232: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:26.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:25 smithi017 ceph-mon[108970]: pgmap v1233: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:16:26.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:25 smithi172 ceph-mon[80431]: pgmap v1233: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:16:28.113 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:27 smithi017 ceph-mon[108970]: pgmap v1234: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:28.147 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph orch ps' 2024-09-20T19:16:28.413 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:28.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:27 smithi172 ceph-mon[80431]: pgmap v1234: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:28.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.974+0000 7f6e551c8640 1 -- 172.21.15.17:0/2964688163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e50106800 msgr2=0x7f6e50106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:28.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.974+0000 7f6e551c8640 1 --2- 172.21.15.17:0/2964688163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e50106800 0x7f6e50106be0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009880 tx=0x7f6e4002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:16:28.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.974+0000 7f6e551c8640 1 -- 172.21.15.17:0/2964688163 shutdown_connections 2024-09-20T19:16:28.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.974+0000 7f6e551c8640 1 --2- 172.21.15.17:0/2964688163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e50100800 0x7f6e50100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:28.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.974+0000 7f6e551c8640 1 --2- 172.21.15.17:0/2964688163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e50106800 0x7f6e50106be0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:28.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.974+0000 7f6e551c8640 1 -- 172.21.15.17:0/2964688163 >> 172.21.15.17:0/2964688163 conn(0x7f6e500fc520 msgr2=0x7f6e500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:28.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.974+0000 7f6e551c8640 1 -- 172.21.15.17:0/2964688163 shutdown_connections 2024-09-20T19:16:28.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.974+0000 7f6e551c8640 1 -- 172.21.15.17:0/2964688163 wait complete. 2024-09-20T19:16:28.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.975+0000 7f6e551c8640 1 Processor -- start 2024-09-20T19:16:28.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.975+0000 7f6e551c8640 1 -- start start 2024-09-20T19:16:28.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.975+0000 7f6e551c8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e50100800 0x7f6e50198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:28.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.975+0000 7f6e551c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e50106800 0x7f6e50198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:28.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.975+0000 7f6e551c8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5010dd30 con 0x7f6e50100800 2024-09-20T19:16:28.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.975+0000 7f6e551c8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5010dbb0 con 0x7f6e50106800 2024-09-20T19:16:28.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.975+0000 7f6e4ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e50100800 0x7f6e50198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:28.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.975+0000 7f6e4ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e50100800 0x7f6e50198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47792/0 (socket says 172.21.15.17:47792) 2024-09-20T19:16:29.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.975+0000 7f6e4ed9d640 1 -- 172.21.15.17:0/3412340559 learned_addr learned my addr 172.21.15.17:0/3412340559 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:29.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.976+0000 7f6e4ed9d640 1 -- 172.21.15.17:0/3412340559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e50106800 msgr2=0x7f6e50198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:29.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.976+0000 7f6e4ed9d640 1 --2- 172.21.15.17:0/3412340559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e50106800 0x7f6e50198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:29.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.976+0000 7f6e4ed9d640 1 -- 172.21.15.17:0/3412340559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e501993c0 con 0x7f6e50100800 2024-09-20T19:16:29.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.976+0000 7f6e4ed9d640 1 --2- 172.21.15.17:0/3412340559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e50100800 0x7f6e50198880 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f6e40031460 tx=0x7f6e400048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:29.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.976+0000 7f6e4cd99640 1 -- 172.21.15.17:0/3412340559 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6e4003f070 con 0x7f6e50100800 2024-09-20T19:16:29.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.976+0000 7f6e4cd99640 1 -- 172.21.15.17:0/3412340559 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e40004cf0 con 0x7f6e50100800 2024-09-20T19:16:29.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.976+0000 7f6e551c8640 1 -- 172.21.15.17:0/3412340559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e50199650 con 0x7f6e50100800 2024-09-20T19:16:29.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.976+0000 7f6e4cd99640 1 -- 172.21.15.17:0/3412340559 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6e40035030 con 0x7f6e50100800 2024-09-20T19:16:29.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.976+0000 7f6e551c8640 1 -- 172.21.15.17:0/3412340559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e501a1c00 con 0x7f6e50100800 2024-09-20T19:16:29.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.977+0000 7f6e551c8640 1 -- 172.21.15.17:0/3412340559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e50101f40 con 0x7f6e50100800 2024-09-20T19:16:29.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.978+0000 7f6e4cd99640 1 -- 172.21.15.17:0/3412340559 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6e40042070 con 0x7f6e50100800 2024-09-20T19:16:29.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.978+0000 7f6e4cd99640 1 --2- 172.21.15.17:0/3412340559 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6e3c07af30 0x7f6e3c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:29.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.978+0000 7f6e4cd99640 1 -- 172.21.15.17:0/3412340559 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f6e400beb00 con 0x7f6e50100800 2024-09-20T19:16:29.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.978+0000 7f6e47fff640 1 --2- 172.21.15.17:0/3412340559 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6e3c07af30 0x7f6e3c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:29.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.979+0000 7f6e47fff640 1 --2- 172.21.15.17:0/3412340559 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6e3c07af30 0x7f6e3c07d3f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6e5006ad00 tx=0x7f6e38006c90 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:29.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:28.983+0000 7f6e4cd99640 1 -- 172.21.15.17:0/3412340559 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6e4008a100 con 0x7f6e50100800 2024-09-20T19:16:29.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:29.179+0000 7f6e551c8640 1 -- 172.21.15.17:0/3412340559 --> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6e50062630 con 0x7f6e3c07af30 2024-09-20T19:16:29.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:29.189+0000 7f6e4cd99640 1 -- 172.21.15.17:0/3412340559 <== mgr.14754 v2:172.21.15.17:6800/1838370206 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f6e50062630 con 0x7f6e3c07af30 2024-09-20T19:16:29.191 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-20T19:16:29.191 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (37m) 86s ago 48m 20.7M - 0.27.0 11f11916f8cd 97be8897a37c 2024-09-20T19:16:29.191 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (96s) 86s ago 49m 8246k - 19.3.0-5099-g88deadb8 441f9a3fe515 13ee1947d1e2 2024-09-20T19:16:29.191 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi172 smithi172 running (92s) 88s ago 48m 7516k - 19.3.0-5099-g88deadb8 441f9a3fe515 23495c1d91e3 2024-09-20T19:16:29.191 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (36m) 86s ago 49m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 578d49cdd426 2024-09-20T19:16:29.191 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi172 smithi172 running (36m) 88s ago 48m 6895k - 19.3.0-5099-g88deadb8 441f9a3fe515 a43237e35895 2024-09-20T19:16:29.191 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (37m) 86s ago 48m 83.9M - 10.4.8 5aad1d7cf004 a2abf8e475b5 2024-09-20T19:16:29.191 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.puqizo smithi017 running (32m) 85s ago 43m 89.1M - 19.3.0-5099-g88deadb8 441f9a3fe515 b7aa335a42a1 2024-09-20T19:16:29.191 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.xhlvpy smithi017 running (32m) 85s ago 43m 26.2M - 19.3.0-5099-g88deadb8 441f9a3fe515 f52ecae649ec 2024-09-20T19:16:29.191 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.liatxm smithi172 running (16m) 88s ago 43m 23.7M - 19.3.0-5099-g88deadb8 441f9a3fe515 0eb3dfd24399 2024-09-20T19:16:29.192 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi172.mugtlk smithi172 running (31m) 88s ago 43m 183M - 19.3.0-5099-g88deadb8 441f9a3fe515 8eefa414a2bc 2024-09-20T19:16:29.192 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.xusjwd smithi017 *:8443,9283,8765 running (40m) 86s ago 50m 535M - 19.3.0-5099-g88deadb8 441f9a3fe515 9cdf6de0ee04 2024-09-20T19:16:29.192 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi172.jczphg smithi172 *:8443,9283,8765 running (39m) 88s ago 48m 466M - 19.3.0-5099-g88deadb8 441f9a3fe515 16ddf74c1bfe 2024-09-20T19:16:29.192 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (36m) 86s ago 50m 84.4M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 27c3175c6357 2024-09-20T19:16:29.192 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi172 smithi172 running (36m) 88s ago 47m 57.7M 2048M 19.3.0-5099-g88deadb8 441f9a3fe515 4be383715faa 2024-09-20T19:16:29.192 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (38m) 86s ago 48m 12.4M - 1.7.0 72c9c2088986 0be43575d3df 2024-09-20T19:16:29.192 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi172 smithi172 *:9100 running (38m) 88s ago 48m 10.8M - 1.7.0 72c9c2088986 5462405671eb 2024-09-20T19:16:29.192 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (35m) 86s ago 46m 95.6M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 86f4bf02274a 2024-09-20T19:16:29.192 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (35m) 86s ago 46m 104M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 9e34b5153d0a 2024-09-20T19:16:29.192 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (34m) 85s ago 45m 96.1M 1217M 19.3.0-5099-g88deadb8 441f9a3fe515 608ec433a002 2024-09-20T19:16:29.192 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi172 running (33m) 88s ago 45m 114M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 f7f0c8354238 2024-09-20T19:16:29.192 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi172 running (33m) 88s ago 45m 94.5M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 621ed127d387 2024-09-20T19:16:29.192 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi172 running (32m) 88s ago 44m 90.2M 2240M 19.3.0-5099-g88deadb8 441f9a3fe515 6047a709a06a 2024-09-20T19:16:29.192 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (38m) 86s ago 48m 71.7M - 2.51.0 1d3b7f56885b 6ba6a3e06c20 2024-09-20T19:16:29.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:29.192+0000 7f6e551c8640 1 -- 172.21.15.17:0/3412340559 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6e3c07af30 msgr2=0x7f6e3c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:29.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:29.192+0000 7f6e551c8640 1 --2- 172.21.15.17:0/3412340559 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6e3c07af30 0x7f6e3c07d3f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6e5006ad00 tx=0x7f6e38006c90 comp rx=0 tx=0).stop 2024-09-20T19:16:29.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:29.192+0000 7f6e551c8640 1 -- 172.21.15.17:0/3412340559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e50100800 msgr2=0x7f6e50198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:29.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:29.192+0000 7f6e551c8640 1 --2- 172.21.15.17:0/3412340559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e50100800 0x7f6e50198880 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f6e40031460 tx=0x7f6e400048f0 comp rx=0 tx=0).stop 2024-09-20T19:16:29.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:29.192+0000 7f6e551c8640 1 -- 172.21.15.17:0/3412340559 shutdown_connections 2024-09-20T19:16:29.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:29.192+0000 7f6e551c8640 1 --2- 172.21.15.17:0/3412340559 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6e3c07af30 0x7f6e3c07d3f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:29.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:29.192+0000 7f6e551c8640 1 --2- 172.21.15.17:0/3412340559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e50106800 0x7f6e50198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:29.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:29.192+0000 7f6e551c8640 1 --2- 172.21.15.17:0/3412340559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e50100800 0x7f6e50198880 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:29.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:29.192+0000 7f6e551c8640 1 -- 172.21.15.17:0/3412340559 >> 172.21.15.17:0/3412340559 conn(0x7f6e500fc520 msgr2=0x7f6e500fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:29.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:29.192+0000 7f6e551c8640 1 -- 172.21.15.17:0/3412340559 shutdown_connections 2024-09-20T19:16:29.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:29.192+0000 7f6e551c8640 1 -- 172.21.15.17:0/3412340559 wait complete. 2024-09-20T19:16:29.831 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph versions' 2024-09-20T19:16:30.092 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:30.136 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:29 smithi017 ceph-mon[108970]: pgmap v1235: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:30.195 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:29 smithi172 ceph-mon[80431]: pgmap v1235: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.530+0000 7f40fdd12640 1 -- 172.21.15.17:0/1275215365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f8100120 msgr2=0x7f40f8100500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.530+0000 7f40fdd12640 1 --2- 172.21.15.17:0/1275215365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f8100120 0x7f40f8100500 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009880 tx=0x7f40e802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:16:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.530+0000 7f40fdd12640 1 -- 172.21.15.17:0/1275215365 shutdown_connections 2024-09-20T19:16:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.530+0000 7f40fdd12640 1 --2- 172.21.15.17:0/1275215365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f8100ad0 0x7f40f8106610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.530+0000 7f40fdd12640 1 --2- 172.21.15.17:0/1275215365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f8100120 0x7f40f8100500 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.530+0000 7f40fdd12640 1 -- 172.21.15.17:0/1275215365 >> 172.21.15.17:0/1275215365 conn(0x7f40f80fbc90 msgr2=0x7f40f80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.530+0000 7f40fdd12640 1 -- 172.21.15.17:0/1275215365 shutdown_connections 2024-09-20T19:16:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.530+0000 7f40fdd12640 1 -- 172.21.15.17:0/1275215365 wait complete. 2024-09-20T19:16:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.531+0000 7f40fdd12640 1 Processor -- start 2024-09-20T19:16:30.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.531+0000 7f40fdd12640 1 -- start start 2024-09-20T19:16:30.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.531+0000 7f40fdd12640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f8100120 0x7f40f819d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:30.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.531+0000 7f40fdd12640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f8100ad0 0x7f40f819dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:30.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.531+0000 7f40fdd12640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f40f810eee0 con 0x7f40f8100ad0 2024-09-20T19:16:30.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.531+0000 7f40fdd12640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f40f810ed60 con 0x7f40f8100120 2024-09-20T19:16:30.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.532+0000 7f40eeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f8100ad0 0x7f40f819dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:30.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.532+0000 7f40eeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f8100ad0 0x7f40f819dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60468/0 (socket says 172.21.15.17:60468) 2024-09-20T19:16:30.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.532+0000 7f40eeffd640 1 -- 172.21.15.17:0/4114605968 learned_addr learned my addr 172.21.15.17:0/4114605968 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:30.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.532+0000 7f40f77fe640 1 --2- 172.21.15.17:0/4114605968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f8100120 0x7f40f819d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.532+0000 7f40eeffd640 1 -- 172.21.15.17:0/4114605968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f8100120 msgr2=0x7f40f819d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.532+0000 7f40eeffd640 1 --2- 172.21.15.17:0/4114605968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f8100120 0x7f40f819d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.532+0000 7f40eeffd640 1 -- 172.21.15.17:0/4114605968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f81978f0 con 0x7f40f8100ad0 2024-09-20T19:16:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.532+0000 7f40f77fe640 1 --2- 172.21.15.17:0/4114605968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f8100120 0x7f40f819d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:16:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.532+0000 7f40eeffd640 1 --2- 172.21.15.17:0/4114605968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f8100ad0 0x7f40f819dc70 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f40e000b3d0 tx=0x7f40e000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.532+0000 7f40f57fa640 1 -- 172.21.15.17:0/4114605968 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40e0015020 con 0x7f40f8100ad0 2024-09-20T19:16:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.532+0000 7f40f57fa640 1 -- 172.21.15.17:0/4114605968 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f40e0011af0 con 0x7f40f8100ad0 2024-09-20T19:16:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.532+0000 7f40fdd12640 1 -- 172.21.15.17:0/4114605968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f8197be0 con 0x7f40f8100ad0 2024-09-20T19:16:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.532+0000 7f40f57fa640 1 -- 172.21.15.17:0/4114605968 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40e0010d30 con 0x7f40f8100ad0 2024-09-20T19:16:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.532+0000 7f40fdd12640 1 -- 172.21.15.17:0/4114605968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f8198170 con 0x7f40f8100ad0 2024-09-20T19:16:30.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.533+0000 7f40fdd12640 1 -- 172.21.15.17:0/4114605968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f81031e0 con 0x7f40f8100ad0 2024-09-20T19:16:30.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.534+0000 7f40f57fa640 1 -- 172.21.15.17:0/4114605968 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f40e0018020 con 0x7f40f8100ad0 2024-09-20T19:16:30.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.535+0000 7f40f57fa640 1 --2- 172.21.15.17:0/4114605968 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f40e407af90 0x7f40e407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:30.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.535+0000 7f40f57fa640 1 -- 172.21.15.17:0/4114605968 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f40e009d9f0 con 0x7f40f8100ad0 2024-09-20T19:16:30.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.535+0000 7f40f77fe640 1 --2- 172.21.15.17:0/4114605968 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f40e407af90 0x7f40e407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:30.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.535+0000 7f40f77fe640 1 --2- 172.21.15.17:0/4114605968 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f40e407af90 0x7f40e407d450 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f40e8006010 tx=0x7f40e8005d50 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:30.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.539+0000 7f40f57fa640 1 -- 172.21.15.17:0/4114605968 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f40e001f020 con 0x7f40f8100ad0 2024-09-20T19:16:30.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.803+0000 7f40fdd12640 1 -- 172.21.15.17:0/4114605968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f40f8109ef0 con 0x7f40f8100ad0 2024-09-20T19:16:30.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.804+0000 7f40f57fa640 1 -- 172.21.15.17:0/4114605968 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f40e0068fd0 con 0x7f40f8100ad0 2024-09-20T19:16:30.805 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-20T19:16:30.805 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-09-20T19:16:30.805 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:16:30.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:16:30.805 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-09-20T19:16:30.805 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 2 2024-09-20T19:16:30.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:16:30.805 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-09-20T19:16:30.805 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 6 2024-09-20T19:16:30.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:16:30.806 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-20T19:16:30.806 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 4 2024-09-20T19:16:30.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-20T19:16:30.806 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-09-20T19:16:30.806 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)": 14 2024-09-20T19:16:30.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-20T19:16:30.806 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-20T19:16:30.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.806+0000 7f40fdd12640 1 -- 172.21.15.17:0/4114605968 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f40e407af90 msgr2=0x7f40e407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:30.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.806+0000 7f40fdd12640 1 --2- 172.21.15.17:0/4114605968 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f40e407af90 0x7f40e407d450 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f40e8006010 tx=0x7f40e8005d50 comp rx=0 tx=0).stop 2024-09-20T19:16:30.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.806+0000 7f40fdd12640 1 -- 172.21.15.17:0/4114605968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f8100ad0 msgr2=0x7f40f819dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:30.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.806+0000 7f40fdd12640 1 --2- 172.21.15.17:0/4114605968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f8100ad0 0x7f40f819dc70 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f40e000b3d0 tx=0x7f40e000b890 comp rx=0 tx=0).stop 2024-09-20T19:16:30.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.806+0000 7f40fdd12640 1 -- 172.21.15.17:0/4114605968 shutdown_connections 2024-09-20T19:16:30.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.806+0000 7f40fdd12640 1 --2- 172.21.15.17:0/4114605968 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f40e407af90 0x7f40e407d450 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:30.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.806+0000 7f40fdd12640 1 --2- 172.21.15.17:0/4114605968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f8100ad0 0x7f40f819dc70 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:30.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.806+0000 7f40fdd12640 1 --2- 172.21.15.17:0/4114605968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f8100120 0x7f40f819d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:30.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.806+0000 7f40fdd12640 1 -- 172.21.15.17:0/4114605968 >> 172.21.15.17:0/4114605968 conn(0x7f40f80fbc90 msgr2=0x7f40f80fd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:30.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.806+0000 7f40fdd12640 1 -- 172.21.15.17:0/4114605968 shutdown_connections 2024-09-20T19:16:30.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:30.807+0000 7f40fdd12640 1 -- 172.21.15.17:0/4114605968 wait complete. 2024-09-20T19:16:31.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:30 smithi017 ceph-mon[108970]: from='client.35990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:16:31.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:30 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/4114605968' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:16:31.441 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-20T19:16:31.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:30 smithi172 ceph-mon[80431]: from='client.35990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-20T19:16:31.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:30 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/4114605968' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:16:31.702 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:32.081 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:31 smithi017 ceph-mon[108970]: pgmap v1236: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:32.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.163+0000 7f05db896640 1 -- 172.21.15.17:0/2517629479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05d41033e0 msgr2=0x7f05d410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:32.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.163+0000 7f05db896640 1 --2- 172.21.15.17:0/2517629479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05d41033e0 0x7f05d410b8d0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f05c4009880 tx=0x7f05c402a530 comp rx=0 tx=0).stop 2024-09-20T19:16:32.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.163+0000 7f05db896640 1 -- 172.21.15.17:0/2517629479 shutdown_connections 2024-09-20T19:16:32.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.163+0000 7f05db896640 1 --2- 172.21.15.17:0/2517629479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05d41033e0 0x7f05d410b8d0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:32.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.163+0000 7f05db896640 1 --2- 172.21.15.17:0/2517629479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05d4102ac0 0x7f05d4102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:32.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.163+0000 7f05db896640 1 -- 172.21.15.17:0/2517629479 >> 172.21.15.17:0/2517629479 conn(0x7f05d40fc520 msgr2=0x7f05d40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:32.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.163+0000 7f05db896640 1 -- 172.21.15.17:0/2517629479 shutdown_connections 2024-09-20T19:16:32.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.163+0000 7f05db896640 1 -- 172.21.15.17:0/2517629479 wait complete. 2024-09-20T19:16:32.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.163+0000 7f05db896640 1 Processor -- start 2024-09-20T19:16:32.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.163+0000 7f05db896640 1 -- start start 2024-09-20T19:16:32.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.164+0000 7f05db896640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05d4102ac0 0x7f05d419f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:32.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.164+0000 7f05db896640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05d41033e0 0x7f05d419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:32.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.164+0000 7f05db896640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f05d410edf0 con 0x7f05d4102ac0 2024-09-20T19:16:32.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.164+0000 7f05db896640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f05d410ec70 con 0x7f05d41033e0 2024-09-20T19:16:32.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.164+0000 7f05d9632640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05d4102ac0 0x7f05d419f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.164+0000 7f05d9632640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05d4102ac0 0x7f05d419f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60486/0 (socket says 172.21.15.17:60486) 2024-09-20T19:16:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.164+0000 7f05d9632640 1 -- 172.21.15.17:0/1060490341 learned_addr learned my addr 172.21.15.17:0/1060490341 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.164+0000 7f05d8e31640 1 --2- 172.21.15.17:0/1060490341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05d41033e0 0x7f05d419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.164+0000 7f05d9632640 1 -- 172.21.15.17:0/1060490341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05d41033e0 msgr2=0x7f05d419fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.164+0000 7f05d9632640 1 --2- 172.21.15.17:0/1060490341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05d41033e0 0x7f05d419fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.164+0000 7f05d9632640 1 -- 172.21.15.17:0/1060490341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d4199a10 con 0x7f05d4102ac0 2024-09-20T19:16:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.164+0000 7f05d8e31640 1 --2- 172.21.15.17:0/1060490341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05d41033e0 0x7f05d419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:16:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.164+0000 7f05d9632640 1 --2- 172.21.15.17:0/1060490341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05d4102ac0 0x7f05d419f850 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f05d000c8f0 tx=0x7f05d000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.164+0000 7f05ca7fc640 1 -- 172.21.15.17:0/1060490341 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05d00079b0 con 0x7f05d4102ac0 2024-09-20T19:16:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.164+0000 7f05ca7fc640 1 -- 172.21.15.17:0/1060490341 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05d00054e0 con 0x7f05d4102ac0 2024-09-20T19:16:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.164+0000 7f05db896640 1 -- 172.21.15.17:0/1060490341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d4199d00 con 0x7f05d4102ac0 2024-09-20T19:16:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.165+0000 7f05ca7fc640 1 -- 172.21.15.17:0/1060490341 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05d0004dd0 con 0x7f05d4102ac0 2024-09-20T19:16:32.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.165+0000 7f05db896640 1 -- 172.21.15.17:0/1060490341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d419a260 con 0x7f05d4102ac0 2024-09-20T19:16:32.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.165+0000 7f05db896640 1 -- 172.21.15.17:0/1060490341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05d406aa90 con 0x7f05d4102ac0 2024-09-20T19:16:32.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.166+0000 7f05ca7fc640 1 -- 172.21.15.17:0/1060490341 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f05d0005020 con 0x7f05d4102ac0 2024-09-20T19:16:32.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.167+0000 7f05ca7fc640 1 --2- 172.21.15.17:0/1060490341 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05c007aed0 0x7f05c007d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:32.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.167+0000 7f05ca7fc640 1 -- 172.21.15.17:0/1060490341 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f05d009dfe0 con 0x7f05d4102ac0 2024-09-20T19:16:32.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.167+0000 7f05d8e31640 1 --2- 172.21.15.17:0/1060490341 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05c007aed0 0x7f05c007d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:32.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.168+0000 7f05d8e31640 1 --2- 172.21.15.17:0/1060490341 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05c007aed0 0x7f05c007d390 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f05d419b200 tx=0x7f05c4009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:32.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.172+0000 7f05ca7fc640 1 -- 172.21.15.17:0/1060490341 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f05d0014030 con 0x7f05d4102ac0 2024-09-20T19:16:32.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.436+0000 7f05db896640 1 -- 172.21.15.17:0/1060490341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f05d419af40 con 0x7f05d4102ac0 2024-09-20T19:16:32.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.437+0000 7f05ca7fc640 1 -- 172.21.15.17:0/1060490341 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f05d00695e0 con 0x7f05d4102ac0 2024-09-20T19:16:32.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.439+0000 7f05db896640 1 -- 172.21.15.17:0/1060490341 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05c007aed0 msgr2=0x7f05c007d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:32.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.439+0000 7f05db896640 1 --2- 172.21.15.17:0/1060490341 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05c007aed0 0x7f05c007d390 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f05d419b200 tx=0x7f05c4009560 comp rx=0 tx=0).stop 2024-09-20T19:16:32.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.439+0000 7f05db896640 1 -- 172.21.15.17:0/1060490341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05d4102ac0 msgr2=0x7f05d419f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:32.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.439+0000 7f05db896640 1 --2- 172.21.15.17:0/1060490341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05d4102ac0 0x7f05d419f850 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f05d000c8f0 tx=0x7f05d000cdb0 comp rx=0 tx=0).stop 2024-09-20T19:16:32.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.439+0000 7f05db896640 1 -- 172.21.15.17:0/1060490341 shutdown_connections 2024-09-20T19:16:32.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.439+0000 7f05db896640 1 --2- 172.21.15.17:0/1060490341 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f05c007aed0 0x7f05c007d390 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:32.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.439+0000 7f05db896640 1 --2- 172.21.15.17:0/1060490341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05d41033e0 0x7f05d419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:32.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.439+0000 7f05db896640 1 --2- 172.21.15.17:0/1060490341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05d4102ac0 0x7f05d419f850 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:32.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.439+0000 7f05db896640 1 -- 172.21.15.17:0/1060490341 >> 172.21.15.17:0/1060490341 conn(0x7f05d40fc520 msgr2=0x7f05d4100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:32.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.439+0000 7f05db896640 1 -- 172.21.15.17:0/1060490341 shutdown_connections 2024-09-20T19:16:32.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:32.439+0000 7f05db896640 1 -- 172.21.15.17:0/1060490341 wait complete. 2024-09-20T19:16:32.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:31 smithi172 ceph-mon[80431]: pgmap v1236: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:32.449 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-09-20T19:16:33.087 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -e sha1=88deadb8082f4a33832e228ccefc59cedba158a5 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-20T19:16:33.351 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:33.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:32 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1060490341' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:16:33.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:32 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1060490341' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:16:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.786+0000 7f408bf97640 1 -- 172.21.15.17:0/3454314932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4084074510 msgr2=0x7f40840748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.786+0000 7f408bf97640 1 --2- 172.21.15.17:0/3454314932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4084074510 0x7f40840748f0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f4074009c20 tx=0x7f407402aa00 comp rx=0 tx=0).stop 2024-09-20T19:16:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.787+0000 7f408bf97640 1 -- 172.21.15.17:0/3454314932 shutdown_connections 2024-09-20T19:16:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.787+0000 7f408bf97640 1 --2- 172.21.15.17:0/3454314932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4084074e30 0x7f408410dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.787+0000 7f408bf97640 1 --2- 172.21.15.17:0/3454314932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4084074510 0x7f40840748f0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.787+0000 7f408bf97640 1 -- 172.21.15.17:0/3454314932 >> 172.21.15.17:0/3454314932 conn(0x7f40840fd610 msgr2=0x7f40840ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.787+0000 7f408bf97640 1 -- 172.21.15.17:0/3454314932 shutdown_connections 2024-09-20T19:16:33.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.787+0000 7f408bf97640 1 -- 172.21.15.17:0/3454314932 wait complete. 2024-09-20T19:16:33.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.787+0000 7f408bf97640 1 Processor -- start 2024-09-20T19:16:33.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.788+0000 7f408bf97640 1 -- start start 2024-09-20T19:16:33.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.788+0000 7f408bf97640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4084074510 0x7f408419f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:33.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.788+0000 7f408bf97640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4084074e30 0x7f408419fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:33.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.788+0000 7f408bf97640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4084110fd0 con 0x7f4084074510 2024-09-20T19:16:33.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.788+0000 7f408bf97640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4084110e50 con 0x7f4084074e30 2024-09-20T19:16:33.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.788+0000 7f4089d33640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4084074510 0x7f408419f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:33.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.788+0000 7f4089d33640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4084074510 0x7f408419f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60496/0 (socket says 172.21.15.17:60496) 2024-09-20T19:16:33.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.788+0000 7f4089d33640 1 -- 172.21.15.17:0/1594330446 learned_addr learned my addr 172.21.15.17:0/1594330446 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:33.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.788+0000 7f4089532640 1 --2- 172.21.15.17:0/1594330446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4084074e30 0x7f408419fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:33.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.788+0000 7f4089d33640 1 -- 172.21.15.17:0/1594330446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4084074e30 msgr2=0x7f408419fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:33.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.788+0000 7f4089d33640 1 --2- 172.21.15.17:0/1594330446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4084074e30 0x7f408419fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:33.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.788+0000 7f4089d33640 1 -- 172.21.15.17:0/1594330446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4084199b00 con 0x7f4084074510 2024-09-20T19:16:33.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.788+0000 7f4089532640 1 --2- 172.21.15.17:0/1594330446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4084074e30 0x7f408419fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:16:33.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.788+0000 7f4089d33640 1 --2- 172.21.15.17:0/1594330446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4084074510 0x7f408419f940 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f407402af20 tx=0x7f407402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:33.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.789+0000 7f4082ffd640 1 -- 172.21.15.17:0/1594330446 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4074047070 con 0x7f4084074510 2024-09-20T19:16:33.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.789+0000 7f408bf97640 1 -- 172.21.15.17:0/1594330446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4084199d90 con 0x7f4084074510 2024-09-20T19:16:33.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.789+0000 7f4082ffd640 1 -- 172.21.15.17:0/1594330446 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4074003e30 con 0x7f4084074510 2024-09-20T19:16:33.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.789+0000 7f4082ffd640 1 -- 172.21.15.17:0/1594330446 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4074033050 con 0x7f4084074510 2024-09-20T19:16:33.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.789+0000 7f408bf97640 1 -- 172.21.15.17:0/1594330446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f408419a2c0 con 0x7f4084074510 2024-09-20T19:16:33.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.790+0000 7f408bf97640 1 -- 172.21.15.17:0/1594330446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4084075c50 con 0x7f4084074510 2024-09-20T19:16:33.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.790+0000 7f4082ffd640 1 -- 172.21.15.17:0/1594330446 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f407404a070 con 0x7f4084074510 2024-09-20T19:16:33.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.791+0000 7f4082ffd640 1 --2- 172.21.15.17:0/1594330446 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f406c07af40 0x7f406c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:33.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.791+0000 7f4082ffd640 1 -- 172.21.15.17:0/1594330446 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f407403e030 con 0x7f4084074510 2024-09-20T19:16:33.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.791+0000 7f4089532640 1 --2- 172.21.15.17:0/1594330446 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f406c07af40 0x7f406c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:33.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.792+0000 7f4089532640 1 --2- 172.21.15.17:0/1594330446 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f406c07af40 0x7f406c07d400 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f40840fffb0 tx=0x7f4078005e50 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:33.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:33.796+0000 7f4082ffd640 1 -- 172.21.15.17:0/1594330446 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f407408a7a0 con 0x7f4084074510 2024-09-20T19:16:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:34.057+0000 7f408bf97640 1 -- 172.21.15.17:0/1594330446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4084108350 con 0x7f4084074510 2024-09-20T19:16:34.059 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:33 smithi017 ceph-mon[108970]: pgmap v1237: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:34.058+0000 7f4082ffd640 1 -- 172.21.15.17:0/1594330446 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f407408f650 con 0x7f4084074510 2024-09-20T19:16:34.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:34.060+0000 7f408bf97640 1 -- 172.21.15.17:0/1594330446 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f406c07af40 msgr2=0x7f406c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:34.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:34.060+0000 7f408bf97640 1 --2- 172.21.15.17:0/1594330446 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f406c07af40 0x7f406c07d400 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f40840fffb0 tx=0x7f4078005e50 comp rx=0 tx=0).stop 2024-09-20T19:16:34.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:34.060+0000 7f408bf97640 1 -- 172.21.15.17:0/1594330446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4084074510 msgr2=0x7f408419f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:34.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:34.060+0000 7f408bf97640 1 --2- 172.21.15.17:0/1594330446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4084074510 0x7f408419f940 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f407402af20 tx=0x7f407402ee60 comp rx=0 tx=0).stop 2024-09-20T19:16:34.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:34.060+0000 7f408bf97640 1 -- 172.21.15.17:0/1594330446 shutdown_connections 2024-09-20T19:16:34.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:34.060+0000 7f408bf97640 1 --2- 172.21.15.17:0/1594330446 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f406c07af40 0x7f406c07d400 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:34.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:34.060+0000 7f408bf97640 1 --2- 172.21.15.17:0/1594330446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4084074e30 0x7f408419fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:34.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:34.060+0000 7f408bf97640 1 --2- 172.21.15.17:0/1594330446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4084074510 0x7f408419f940 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:34.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:34.060+0000 7f408bf97640 1 -- 172.21.15.17:0/1594330446 >> 172.21.15.17:0/1594330446 conn(0x7f40840fd610 msgr2=0x7f408410b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:34.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:34.060+0000 7f408bf97640 1 -- 172.21.15.17:0/1594330446 shutdown_connections 2024-09-20T19:16:34.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:34.060+0000 7f408bf97640 1 -- 172.21.15.17:0/1594330446 wait complete. 2024-09-20T19:16:34.070 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.3.0-5099-g88deadb8 (88deadb8082f4a33832e228ccefc59cedba158a5) squid (dev)" 2024-09-20T19:16:34.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:33 smithi172 ceph-mon[80431]: pgmap v1237: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:34.696 DEBUG:teuthology.parallel:result is None 2024-09-20T19:16:34.696 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-20T19:16:34.708 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-09-20T19:16:34.708 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-20T19:16:34.966 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:35.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:35 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1594330446' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:16:35.355 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:35 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1594330446' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-20T19:16:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.438+0000 7fb26397a640 1 -- 172.21.15.17:0/2112837351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb25c100650 msgr2=0x7fb25c100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.438+0000 7fb26397a640 1 --2- 172.21.15.17:0/2112837351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb25c100650 0x7fb25c100a30 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fb258009880 tx=0x7fb25802a490 comp rx=0 tx=0).stop 2024-09-20T19:16:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.438+0000 7fb26397a640 1 -- 172.21.15.17:0/2112837351 shutdown_connections 2024-09-20T19:16:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.438+0000 7fb26397a640 1 --2- 172.21.15.17:0/2112837351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25c101000 0x7fb25c10dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.438+0000 7fb26397a640 1 --2- 172.21.15.17:0/2112837351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb25c100650 0x7fb25c100a30 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.438+0000 7fb26397a640 1 -- 172.21.15.17:0/2112837351 >> 172.21.15.17:0/2112837351 conn(0x7fb25c0fc520 msgr2=0x7fb25c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.438+0000 7fb26397a640 1 -- 172.21.15.17:0/2112837351 shutdown_connections 2024-09-20T19:16:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.438+0000 7fb26397a640 1 -- 172.21.15.17:0/2112837351 wait complete. 2024-09-20T19:16:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.438+0000 7fb26397a640 1 Processor -- start 2024-09-20T19:16:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.438+0000 7fb26397a640 1 -- start start 2024-09-20T19:16:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.439+0000 7fb26397a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb25c100650 0x7fb25c19f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.439+0000 7fb26397a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25c101000 0x7fb25c19fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.439+0000 7fb26397a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c110fb0 con 0x7fb25c100650 2024-09-20T19:16:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.439+0000 7fb26397a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c110e30 con 0x7fb25c101000 2024-09-20T19:16:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.439+0000 7fb261716640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb25c100650 0x7fb25c19f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.439+0000 7fb261716640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb25c100650 0x7fb25c19f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60514/0 (socket says 172.21.15.17:60514) 2024-09-20T19:16:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.439+0000 7fb261716640 1 -- 172.21.15.17:0/3944594316 learned_addr learned my addr 172.21.15.17:0/3944594316 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.439+0000 7fb260f15640 1 --2- 172.21.15.17:0/3944594316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25c101000 0x7fb25c19fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.439+0000 7fb261716640 1 -- 172.21.15.17:0/3944594316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25c101000 msgr2=0x7fb25c19fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.439+0000 7fb261716640 1 --2- 172.21.15.17:0/3944594316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25c101000 0x7fb25c19fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.439+0000 7fb261716640 1 -- 172.21.15.17:0/3944594316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25c199a40 con 0x7fb25c100650 2024-09-20T19:16:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.439+0000 7fb261716640 1 --2- 172.21.15.17:0/3944594316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb25c100650 0x7fb25c19f880 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fb258031460 tx=0x7fb2580045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.439+0000 7fb2527fc640 1 -- 172.21.15.17:0/3944594316 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb25803f070 con 0x7fb25c100650 2024-09-20T19:16:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.439+0000 7fb2527fc640 1 -- 172.21.15.17:0/3944594316 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb2580035f0 con 0x7fb25c100650 2024-09-20T19:16:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.440+0000 7fb26397a640 1 -- 172.21.15.17:0/3944594316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25c199cd0 con 0x7fb25c100650 2024-09-20T19:16:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.440+0000 7fb2527fc640 1 -- 172.21.15.17:0/3944594316 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb258035030 con 0x7fb25c100650 2024-09-20T19:16:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.440+0000 7fb26397a640 1 -- 172.21.15.17:0/3944594316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb25c19a260 con 0x7fb25c100650 2024-09-20T19:16:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.440+0000 7fb26397a640 1 -- 172.21.15.17:0/3944594316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb25c06aa90 con 0x7fb25c100650 2024-09-20T19:16:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.441+0000 7fb2527fc640 1 -- 172.21.15.17:0/3944594316 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb258042070 con 0x7fb25c100650 2024-09-20T19:16:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.442+0000 7fb2527fc640 1 --2- 172.21.15.17:0/3944594316 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb24807af80 0x7fb24807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.442+0000 7fb2527fc640 1 -- 172.21.15.17:0/3944594316 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fb2580be860 con 0x7fb25c100650 2024-09-20T19:16:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.442+0000 7fb260f15640 1 --2- 172.21.15.17:0/3944594316 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb24807af80 0x7fb24807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.442+0000 7fb260f15640 1 --2- 172.21.15.17:0/3944594316 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb24807af80 0x7fb24807d440 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb25c102520 tx=0x7fb24c00b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.446+0000 7fb2527fc640 1 -- 172.21.15.17:0/3944594316 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb258089ee0 con 0x7fb25c100650 2024-09-20T19:16:35.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.672+0000 7fb26397a640 1 -- 172.21.15.17:0/3944594316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb25c10b3a0 con 0x7fb25c100650 2024-09-20T19:16:35.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.672+0000 7fb2527fc640 1 -- 172.21.15.17:0/3944594316 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 34 v34) ==== 76+0+2046 (secure 0 0 0) 0x7fb25808ed90 con 0x7fb25c100650 2024-09-20T19:16:35.674 INFO:teuthology.orchestra.run.smithi017.stdout:e34 2024-09-20T19:16:35.674 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-09-20T19:15:07:824776+0000 2024-09-20T19:16:35.674 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-20T19:16:35.674 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:16:35.674 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-09-20T19:16:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:35.674 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-09-20T19:16:35.674 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-09-20T19:16:35.674 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 34 2024-09-20T19:16:35.674 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-20T19:16:35.674 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-20T18:32:49.312742+0000 2024-09-20T19:16:35.674 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-20T19:15:06.923689+0000 2024-09-20T19:16:35.674 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-09-20T19:16:35.675 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-09-20T19:16:35.675 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-09-20T19:16:35.675 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-09-20T19:16:35.675 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-09-20T19:16:35.675 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-09-20T19:16:35.675 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-09-20T19:16:35.675 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-09-20T19:16:35.675 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 75 2024-09-20T19:16:35.675 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-20T19:16:35.675 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-09-20T19:16:35.675 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-09-20T19:16:35.675 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=34332,1=34364} 2024-09-20T19:16:35.675 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-09-20T19:16:35.675 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-09-20T19:16:35.676 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-09-20T19:16:35.676 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-09-20T19:16:35.676 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-09-20T19:16:35.676 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-09-20T19:16:35.676 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-09-20T19:16:35.676 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-09-20T19:16:35.676 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-09-20T19:16:35.676 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 34332 members: 34364,34332 2024-09-20T19:16:35.676 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.puqizo{0:34332} state up:active seq 467 join_fscid=1 addr [v2:172.21.15.17:6826/2584064280,v1:172.21.15.17:6827/2584064280] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:16:35.676 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.mugtlk{0:44325} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.172:6824/356477761,v1:172.21.15.172:6825/356477761] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:16:35.676 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.xhlvpy{1:34364} state up:active seq 463 join_fscid=1 addr [v2:172.21.15.17:6828/569261295,v1:172.21.15.17:6829/569261295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:16:35.676 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi172.liatxm{1:44921} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.172:6826/170330025,v1:172.21.15.172:6827/170330025] compat {c=[1],r=[1],i=[1fff]}] 2024-09-20T19:16:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:35.677 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 34 2024-09-20T19:16:35.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.674+0000 7fb26397a640 1 -- 172.21.15.17:0/3944594316 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb24807af80 msgr2=0x7fb24807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:35.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.674+0000 7fb26397a640 1 --2- 172.21.15.17:0/3944594316 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb24807af80 0x7fb24807d440 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb25c102520 tx=0x7fb24c00b390 comp rx=0 tx=0).stop 2024-09-20T19:16:35.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.674+0000 7fb26397a640 1 -- 172.21.15.17:0/3944594316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb25c100650 msgr2=0x7fb25c19f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:35.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.674+0000 7fb26397a640 1 --2- 172.21.15.17:0/3944594316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb25c100650 0x7fb25c19f880 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fb258031460 tx=0x7fb2580045e0 comp rx=0 tx=0).stop 2024-09-20T19:16:35.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.675+0000 7fb26397a640 1 -- 172.21.15.17:0/3944594316 shutdown_connections 2024-09-20T19:16:35.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.675+0000 7fb26397a640 1 --2- 172.21.15.17:0/3944594316 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fb24807af80 0x7fb24807d440 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:35.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.675+0000 7fb26397a640 1 --2- 172.21.15.17:0/3944594316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25c101000 0x7fb25c19fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:35.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.675+0000 7fb26397a640 1 --2- 172.21.15.17:0/3944594316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb25c100650 0x7fb25c19f880 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:35.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.675+0000 7fb26397a640 1 -- 172.21.15.17:0/3944594316 >> 172.21.15.17:0/3944594316 conn(0x7fb25c0fc520 msgr2=0x7fb25c0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:35.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.675+0000 7fb26397a640 1 -- 172.21.15.17:0/3944594316 shutdown_connections 2024-09-20T19:16:35.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:35.675+0000 7fb26397a640 1 -- 172.21.15.17:0/3944594316 wait complete. 2024-09-20T19:16:36.300 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:36 smithi017 ceph-mon[108970]: pgmap v1238: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:16:36.300 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:36 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3944594316' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:16:36.327 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-20T19:16:36.337 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-20T19:16:36.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:36 smithi172 ceph-mon[80431]: pgmap v1238: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:16:36.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:36 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3944594316' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-20T19:16:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:37.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.027+0000 7fab32cb1640 1 -- 172.21.15.17:0/742028827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c100250 msgr2=0x7fab2c100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:37.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.027+0000 7fab32cb1640 1 --2- 172.21.15.17:0/742028827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c100250 0x7fab2c100630 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009880 tx=0x7fab1c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:16:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.028+0000 7fab32cb1640 1 -- 172.21.15.17:0/742028827 shutdown_connections 2024-09-20T19:16:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.028+0000 7fab32cb1640 1 --2- 172.21.15.17:0/742028827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab2c100c00 0x7fab2c104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.028+0000 7fab32cb1640 1 --2- 172.21.15.17:0/742028827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c100250 0x7fab2c100630 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.028+0000 7fab32cb1640 1 -- 172.21.15.17:0/742028827 >> 172.21.15.17:0/742028827 conn(0x7fab2c0fbc90 msgr2=0x7fab2c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.028+0000 7fab32cb1640 1 -- 172.21.15.17:0/742028827 shutdown_connections 2024-09-20T19:16:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.028+0000 7fab32cb1640 1 -- 172.21.15.17:0/742028827 wait complete. 2024-09-20T19:16:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.028+0000 7fab32cb1640 1 Processor -- start 2024-09-20T19:16:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.028+0000 7fab32cb1640 1 -- start start 2024-09-20T19:16:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.029+0000 7fab32cb1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab2c100250 0x7fab2c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.029+0000 7fab32cb1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c100c00 0x7fab2c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.029+0000 7fab32cb1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c10d4b0 con 0x7fab2c100c00 2024-09-20T19:16:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.029+0000 7fab32cb1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c10d330 con 0x7fab2c100250 2024-09-20T19:16:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.029+0000 7fab2bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c100c00 0x7fab2c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.029+0000 7fab2bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c100c00 0x7fab2c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60520/0 (socket says 172.21.15.17:60520) 2024-09-20T19:16:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.029+0000 7fab2bfff640 1 -- 172.21.15.17:0/2893271122 learned_addr learned my addr 172.21.15.17:0/2893271122 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.029+0000 7fab30a4d640 1 --2- 172.21.15.17:0/2893271122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab2c100250 0x7fab2c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.029+0000 7fab2bfff640 1 -- 172.21.15.17:0/2893271122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab2c100250 msgr2=0x7fab2c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.029+0000 7fab2bfff640 1 --2- 172.21.15.17:0/2893271122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab2c100250 0x7fab2c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.029+0000 7fab2bfff640 1 -- 172.21.15.17:0/2893271122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab2c197800 con 0x7fab2c100c00 2024-09-20T19:16:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.029+0000 7fab30a4d640 1 --2- 172.21.15.17:0/2893271122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab2c100250 0x7fab2c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:16:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.029+0000 7fab2bfff640 1 --2- 172.21.15.17:0/2893271122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c100c00 0x7fab2c19dbc0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fab2000c8a0 tx=0x7fab2000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.029+0000 7fab29ffb640 1 -- 172.21.15.17:0/2893271122 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab200079b0 con 0x7fab2c100c00 2024-09-20T19:16:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.030+0000 7fab29ffb640 1 -- 172.21.15.17:0/2893271122 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fab20007b50 con 0x7fab2c100c00 2024-09-20T19:16:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.030+0000 7fab32cb1640 1 -- 172.21.15.17:0/2893271122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab2c197af0 con 0x7fab2c100c00 2024-09-20T19:16:37.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.030+0000 7fab29ffb640 1 -- 172.21.15.17:0/2893271122 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab20018700 con 0x7fab2c100c00 2024-09-20T19:16:37.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.030+0000 7fab32cb1640 1 -- 172.21.15.17:0/2893271122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab2c198080 con 0x7fab2c100c00 2024-09-20T19:16:37.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.031+0000 7fab32cb1640 1 -- 172.21.15.17:0/2893271122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab2c101730 con 0x7fab2c100c00 2024-09-20T19:16:37.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.031+0000 7fab29ffb640 1 -- 172.21.15.17:0/2893271122 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fab20007d00 con 0x7fab2c100c00 2024-09-20T19:16:37.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.032+0000 7fab29ffb640 1 --2- 172.21.15.17:0/2893271122 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fab1407af90 0x7fab1407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:37.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.032+0000 7fab29ffb640 1 -- 172.21.15.17:0/2893271122 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fab2009e250 con 0x7fab2c100c00 2024-09-20T19:16:37.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.032+0000 7fab30a4d640 1 --2- 172.21.15.17:0/2893271122 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fab1407af90 0x7fab1407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:37.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.032+0000 7fab30a4d640 1 --2- 172.21.15.17:0/2893271122 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fab1407af90 0x7fab1407d450 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fab1c031460 tx=0x7fab1c004280 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:37.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.036+0000 7fab29ffb640 1 -- 172.21.15.17:0/2893271122 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fab20014030 con 0x7fab2c100c00 2024-09-20T19:16:37.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.284+0000 7fab32cb1640 1 -- 172.21.15.17:0/2893271122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab2c198d30 con 0x7fab2c100c00 2024-09-20T19:16:37.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.284+0000 7fab29ffb640 1 -- 172.21.15.17:0/2893271122 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5355 (secure 0 0 0) 0x7fab200698d0 con 0x7fab2c100c00 2024-09-20T19:16:37.285 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:37.285 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":34,"btime":"2024-09-20T19:15:07:824776+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T19:15:06.923689+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34332,"mds_1":34364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34332":{"gid":34332,"name":"cephfs.smithi017.puqizo","rank":0,"incarnation":28,"state":"up:active","state_seq":467,"addr":"172.21.15.17:6827/2584064280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2584064280},{"type":"v1","addr":"172.21.15.17:6827","nonce":2584064280}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"cephfs.smithi017.xhlvpy","rank":1,"incarnation":28,"state":"up:active","state_seq":463,"addr":"172.21.15.17:6829/569261295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":569261295},{"type":"v1","addr":"172.21.15.17:6829","nonce":569261295}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44325":{"gid":44325,"name":"cephfs.smithi172.mugtlk","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6825/356477761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":356477761},{"type":"v1","addr":"172.21.15.172:6825","nonce":356477761}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44921":{"gid":44921,"name":"cephfs.smithi172.liatxm","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6827/170330025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":170330025},{"type":"v1","addr":"172.21.15.172:6827","nonce":170330025}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34332,"qdb_cluster":[34364,34332]},"id":1}]} 2024-09-20T19:16:37.286 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 34 2024-09-20T19:16:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.287+0000 7fab32cb1640 1 -- 172.21.15.17:0/2893271122 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fab1407af90 msgr2=0x7fab1407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.287+0000 7fab32cb1640 1 --2- 172.21.15.17:0/2893271122 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fab1407af90 0x7fab1407d450 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fab1c031460 tx=0x7fab1c004280 comp rx=0 tx=0).stop 2024-09-20T19:16:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.287+0000 7fab32cb1640 1 -- 172.21.15.17:0/2893271122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c100c00 msgr2=0x7fab2c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.287+0000 7fab32cb1640 1 --2- 172.21.15.17:0/2893271122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c100c00 0x7fab2c19dbc0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fab2000c8a0 tx=0x7fab2000cd60 comp rx=0 tx=0).stop 2024-09-20T19:16:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.287+0000 7fab32cb1640 1 -- 172.21.15.17:0/2893271122 shutdown_connections 2024-09-20T19:16:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.287+0000 7fab32cb1640 1 --2- 172.21.15.17:0/2893271122 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fab1407af90 0x7fab1407d450 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.287+0000 7fab32cb1640 1 --2- 172.21.15.17:0/2893271122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c100c00 0x7fab2c19dbc0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.287+0000 7fab32cb1640 1 --2- 172.21.15.17:0/2893271122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab2c100250 0x7fab2c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.287+0000 7fab32cb1640 1 -- 172.21.15.17:0/2893271122 >> 172.21.15.17:0/2893271122 conn(0x7fab2c0fbc90 msgr2=0x7fab2c0fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:37.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.287+0000 7fab32cb1640 1 -- 172.21.15.17:0/2893271122 shutdown_connections 2024-09-20T19:16:37.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:37.287+0000 7fab32cb1640 1 -- 172.21.15.17:0/2893271122 wait complete. 2024-09-20T19:16:37.914 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 2, 'flags': 50} 2024-09-20T19:16:37.915 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 16 2024-09-20T19:16:38.136 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:38 smithi017 ceph-mon[108970]: pgmap v1239: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:38.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:38 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:16:38.137 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:38 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2893271122' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-20T19:16:38.180 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:38.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:38 smithi172 ceph-mon[80431]: pgmap v1239: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:38.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:38 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:16:38.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:38 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2893271122' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-20T19:16:38.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.605+0000 7fe33f936640 1 -- 172.21.15.17:0/142744946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe338102b70 msgr2=0x7fe338102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:38.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.605+0000 7fe33f936640 1 --2- 172.21.15.17:0/142744946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe338102b70 0x7fe338102f50 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fe334009880 tx=0x7fe33402a530 comp rx=0 tx=0).stop 2024-09-20T19:16:38.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.605+0000 7fe33f936640 1 -- 172.21.15.17:0/142744946 shutdown_connections 2024-09-20T19:16:38.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.605+0000 7fe33f936640 1 --2- 172.21.15.17:0/142744946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe338103490 0x7fe33810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:38.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.605+0000 7fe33f936640 1 --2- 172.21.15.17:0/142744946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe338102b70 0x7fe338102f50 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:38.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.605+0000 7fe33f936640 1 -- 172.21.15.17:0/142744946 >> 172.21.15.17:0/142744946 conn(0x7fe3380fc550 msgr2=0x7fe3380fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:38.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.605+0000 7fe33f936640 1 -- 172.21.15.17:0/142744946 shutdown_connections 2024-09-20T19:16:38.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.605+0000 7fe33f936640 1 -- 172.21.15.17:0/142744946 wait complete. 2024-09-20T19:16:38.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.605+0000 7fe33f936640 1 Processor -- start 2024-09-20T19:16:38.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.605+0000 7fe33f936640 1 -- start start 2024-09-20T19:16:38.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.606+0000 7fe33f936640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe338102b70 0x7fe33819c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:38.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.606+0000 7fe33f936640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe338103490 0x7fe338194380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:38.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.606+0000 7fe33f936640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe33810edc0 con 0x7fe338102b70 2024-09-20T19:16:38.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.606+0000 7fe33f936640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe33810ec40 con 0x7fe338103490 2024-09-20T19:16:38.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.606+0000 7fe33d6d2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe338102b70 0x7fe33819c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:38.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.606+0000 7fe33d6d2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe338102b70 0x7fe33819c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60536/0 (socket says 172.21.15.17:60536) 2024-09-20T19:16:38.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.606+0000 7fe33d6d2640 1 -- 172.21.15.17:0/3012558741 learned_addr learned my addr 172.21.15.17:0/3012558741 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:38.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.606+0000 7fe33ced1640 1 --2- 172.21.15.17:0/3012558741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe338103490 0x7fe338194380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:38.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.606+0000 7fe33d6d2640 1 -- 172.21.15.17:0/3012558741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe338103490 msgr2=0x7fe338194380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:38.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.606+0000 7fe33d6d2640 1 --2- 172.21.15.17:0/3012558741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe338103490 0x7fe338194380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:38.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.606+0000 7fe33d6d2640 1 -- 172.21.15.17:0/3012558741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3381948c0 con 0x7fe338102b70 2024-09-20T19:16:38.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.606+0000 7fe33d6d2640 1 --2- 172.21.15.17:0/3012558741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe338102b70 0x7fe33819c3b0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fe334004f90 tx=0x7fe3340048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:38.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.607+0000 7fe32e7fc640 1 -- 172.21.15.17:0/3012558741 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe33403f070 con 0x7fe338102b70 2024-09-20T19:16:38.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.607+0000 7fe33f936640 1 -- 172.21.15.17:0/3012558741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe338194b50 con 0x7fe338102b70 2024-09-20T19:16:38.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.607+0000 7fe32e7fc640 1 -- 172.21.15.17:0/3012558741 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe334004c70 con 0x7fe338102b70 2024-09-20T19:16:38.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.607+0000 7fe32e7fc640 1 -- 172.21.15.17:0/3012558741 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe334035030 con 0x7fe338102b70 2024-09-20T19:16:38.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.607+0000 7fe33f936640 1 -- 172.21.15.17:0/3012558741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe338195080 con 0x7fe338102b70 2024-09-20T19:16:38.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.608+0000 7fe33f936640 1 -- 172.21.15.17:0/3012558741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe33806a4c0 con 0x7fe338102b70 2024-09-20T19:16:38.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.608+0000 7fe32e7fc640 1 -- 172.21.15.17:0/3012558741 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe334042070 con 0x7fe338102b70 2024-09-20T19:16:38.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.609+0000 7fe32e7fc640 1 --2- 172.21.15.17:0/3012558741 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe32407af80 0x7fe32407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:38.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.609+0000 7fe32e7fc640 1 -- 172.21.15.17:0/3012558741 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fe3340be850 con 0x7fe338102b70 2024-09-20T19:16:38.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.609+0000 7fe33ced1640 1 --2- 172.21.15.17:0/3012558741 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe32407af80 0x7fe32407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:38.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.610+0000 7fe33ced1640 1 --2- 172.21.15.17:0/3012558741 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe32407af80 0x7fe32407d440 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe338195b40 tx=0x7fe32800b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:38.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.614+0000 7fe32e7fc640 1 -- 172.21.15.17:0/3012558741 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe334089ed0 con 0x7fe338102b70 2024-09-20T19:16:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.840+0000 7fe33f936640 1 -- 172.21.15.17:0/3012558741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) -- 0x7fe338106fd0 con 0x7fe338102b70 2024-09-20T19:16:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.840+0000 7fe32e7fc640 1 -- 172.21.15.17:0/3012558741 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v34) ==== 107+0+3647 (secure 0 0 0) 0x7fe33408ed80 con 0x7fe338102b70 2024-09-20T19:16:38.841 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:38.842 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":16,"btime":"2024-09-20T18:43:54:860380+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T18:43:53.862333+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14552,"mds_1":24325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14552":{"gid":14552,"name":"cephfs.smithi017.puqizo","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6827/3360305779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":3360305779},{"type":"v1","addr":"172.21.15.17:6827","nonce":3360305779}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24325":{"gid":24325,"name":"cephfs.smithi172.mugtlk","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6825/1043027893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1043027893},{"type":"v1","addr":"172.21.15.172:6825","nonce":1043027893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14552,"qdb_cluster":[14552,24325]},"id":1}]} 2024-09-20T19:16:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 16 2024-09-20T19:16:38.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.843+0000 7fe33f936640 1 -- 172.21.15.17:0/3012558741 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe32407af80 msgr2=0x7fe32407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:38.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.843+0000 7fe33f936640 1 --2- 172.21.15.17:0/3012558741 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe32407af80 0x7fe32407d440 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe338195b40 tx=0x7fe32800b390 comp rx=0 tx=0).stop 2024-09-20T19:16:38.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.843+0000 7fe33f936640 1 -- 172.21.15.17:0/3012558741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe338102b70 msgr2=0x7fe33819c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:38.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.843+0000 7fe33f936640 1 --2- 172.21.15.17:0/3012558741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe338102b70 0x7fe33819c3b0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fe334004f90 tx=0x7fe3340048f0 comp rx=0 tx=0).stop 2024-09-20T19:16:38.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.843+0000 7fe33f936640 1 -- 172.21.15.17:0/3012558741 shutdown_connections 2024-09-20T19:16:38.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.843+0000 7fe33f936640 1 --2- 172.21.15.17:0/3012558741 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe32407af80 0x7fe32407d440 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:38.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.843+0000 7fe33f936640 1 --2- 172.21.15.17:0/3012558741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe338103490 0x7fe338194380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:38.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.843+0000 7fe33f936640 1 --2- 172.21.15.17:0/3012558741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe338102b70 0x7fe33819c3b0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:38.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.843+0000 7fe33f936640 1 -- 172.21.15.17:0/3012558741 >> 172.21.15.17:0/3012558741 conn(0x7fe3380fc550 msgr2=0x7fe338100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:38.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.843+0000 7fe33f936640 1 -- 172.21.15.17:0/3012558741 shutdown_connections 2024-09-20T19:16:38.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:38.843+0000 7fe33f936640 1 -- 172.21.15.17:0/3012558741 wait complete. 2024-09-20T19:16:39.320 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:39 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3012558741' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-20T19:16:39.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:39 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3012558741' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-20T19:16:39.454 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 16 2024-09-20T19:16:39.454 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 17 2024-09-20T19:16:39.724 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:40.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.203+0000 7f3c31249640 1 -- 172.21.15.17:0/1896834642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c2c107910 msgr2=0x7f3c2c107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:40.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.203+0000 7f3c31249640 1 --2- 172.21.15.17:0/1896834642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c2c107910 0x7f3c2c107cf0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c009880 tx=0x7f3c1c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:16:40.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.203+0000 7f3c31249640 1 -- 172.21.15.17:0/1896834642 shutdown_connections 2024-09-20T19:16:40.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.203+0000 7f3c31249640 1 --2- 172.21.15.17:0/1896834642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c2c101910 0x7f3c2c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:40.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.203+0000 7f3c31249640 1 --2- 172.21.15.17:0/1896834642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c2c107910 0x7f3c2c107cf0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:40.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.203+0000 7f3c31249640 1 -- 172.21.15.17:0/1896834642 >> 172.21.15.17:0/1896834642 conn(0x7f3c2c0fd610 msgr2=0x7f3c2c0ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:40.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.203+0000 7f3c31249640 1 -- 172.21.15.17:0/1896834642 shutdown_connections 2024-09-20T19:16:40.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.203+0000 7f3c31249640 1 -- 172.21.15.17:0/1896834642 wait complete. 2024-09-20T19:16:40.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.203+0000 7f3c31249640 1 Processor -- start 2024-09-20T19:16:40.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.204+0000 7f3c31249640 1 -- start start 2024-09-20T19:16:40.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.204+0000 7f3c31249640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c2c101910 0x7f3c2c19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:40.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.204+0000 7f3c31249640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c2c107910 0x7f3c2c19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:40.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.204+0000 7f3c31249640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2c10edc0 con 0x7f3c2c101910 2024-09-20T19:16:40.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.204+0000 7f3c31249640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2c10ec40 con 0x7f3c2c107910 2024-09-20T19:16:40.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.204+0000 7f3c2ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c2c101910 0x7f3c2c19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:40.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.204+0000 7f3c2ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c2c101910 0x7f3c2c19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60552/0 (socket says 172.21.15.17:60552) 2024-09-20T19:16:40.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.204+0000 7f3c2ad9d640 1 -- 172.21.15.17:0/2235710645 learned_addr learned my addr 172.21.15.17:0/2235710645 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:40.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.204+0000 7f3c23fff640 1 --2- 172.21.15.17:0/2235710645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c2c107910 0x7f3c2c19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:40.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.204+0000 7f3c2ad9d640 1 -- 172.21.15.17:0/2235710645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c2c107910 msgr2=0x7f3c2c19dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:40.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.204+0000 7f3c2ad9d640 1 --2- 172.21.15.17:0/2235710645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c2c107910 0x7f3c2c19dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:40.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.204+0000 7f3c2ad9d640 1 -- 172.21.15.17:0/2235710645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2c197850 con 0x7f3c2c101910 2024-09-20T19:16:40.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.204+0000 7f3c2ad9d640 1 --2- 172.21.15.17:0/2235710645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c2c101910 0x7f3c2c19d6d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c031460 tx=0x7f3c1c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:40.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.205+0000 7f3c28d99640 1 -- 172.21.15.17:0/2235710645 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c1c03f070 con 0x7f3c2c101910 2024-09-20T19:16:40.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.205+0000 7f3c31249640 1 -- 172.21.15.17:0/2235710645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c2c197ae0 con 0x7f3c2c101910 2024-09-20T19:16:40.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.205+0000 7f3c28d99640 1 -- 172.21.15.17:0/2235710645 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c1c0035f0 con 0x7f3c2c101910 2024-09-20T19:16:40.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.205+0000 7f3c28d99640 1 -- 172.21.15.17:0/2235710645 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c1c035030 con 0x7f3c2c101910 2024-09-20T19:16:40.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.205+0000 7f3c31249640 1 -- 172.21.15.17:0/2235710645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c2c198010 con 0x7f3c2c101910 2024-09-20T19:16:40.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.206+0000 7f3c31249640 1 -- 172.21.15.17:0/2235710645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c2c103050 con 0x7f3c2c101910 2024-09-20T19:16:40.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.206+0000 7f3c28d99640 1 -- 172.21.15.17:0/2235710645 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3c1c042070 con 0x7f3c2c101910 2024-09-20T19:16:40.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.207+0000 7f3c28d99640 1 --2- 172.21.15.17:0/2235710645 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c1807af30 0x7f3c1807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:40.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.207+0000 7f3c28d99640 1 -- 172.21.15.17:0/2235710645 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f3c1c0be9d0 con 0x7f3c2c101910 2024-09-20T19:16:40.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.207+0000 7f3c23fff640 1 --2- 172.21.15.17:0/2235710645 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c1807af30 0x7f3c1807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:40.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.207+0000 7f3c23fff640 1 --2- 172.21.15.17:0/2235710645 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c1807af30 0x7f3c1807d3f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c100d70 tx=0x7f3c1400b390 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:40.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.211+0000 7f3c28d99640 1 -- 172.21.15.17:0/2235710645 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c1c089f70 con 0x7f3c2c101910 2024-09-20T19:16:40.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:40 smithi017 ceph-mon[108970]: pgmap v1240: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.437+0000 7f3c31249640 1 -- 172.21.15.17:0/2235710645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) -- 0x7f3c2c198db0 con 0x7f3c2c101910 2024-09-20T19:16:40.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.438+0000 7f3c28d99640 1 -- 172.21.15.17:0/2235710645 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v34) ==== 107+0+3612 (secure 0 0 0) 0x7f3c2c198db0 con 0x7f3c2c101910 2024-09-20T19:16:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:40.439 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"btime":"2024-09-20T18:43:54:971300+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34320,"name":"cephfs.smithi017.xhlvpy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/1871368212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1871368212},{"type":"v1","addr":"172.21.15.17:6829","nonce":1871368212}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":44285,"name":"cephfs.smithi172.liatxm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/3829314266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3829314266},{"type":"v1","addr":"172.21.15.172:6827","nonce":3829314266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T18:43:54.971296+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:16:40.439 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2024-09-20T19:16:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.440+0000 7f3c31249640 1 -- 172.21.15.17:0/2235710645 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c1807af30 msgr2=0x7f3c1807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.440+0000 7f3c31249640 1 --2- 172.21.15.17:0/2235710645 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c1807af30 0x7f3c1807d3f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c100d70 tx=0x7f3c1400b390 comp rx=0 tx=0).stop 2024-09-20T19:16:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.440+0000 7f3c31249640 1 -- 172.21.15.17:0/2235710645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c2c101910 msgr2=0x7f3c2c19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.440+0000 7f3c31249640 1 --2- 172.21.15.17:0/2235710645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c2c101910 0x7f3c2c19d6d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c031460 tx=0x7f3c1c0045e0 comp rx=0 tx=0).stop 2024-09-20T19:16:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.440+0000 7f3c31249640 1 -- 172.21.15.17:0/2235710645 shutdown_connections 2024-09-20T19:16:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.440+0000 7f3c31249640 1 --2- 172.21.15.17:0/2235710645 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f3c1807af30 0x7f3c1807d3f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.440+0000 7f3c31249640 1 --2- 172.21.15.17:0/2235710645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c2c107910 0x7f3c2c19dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.440+0000 7f3c31249640 1 --2- 172.21.15.17:0/2235710645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c2c101910 0x7f3c2c19d6d0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.440+0000 7f3c31249640 1 -- 172.21.15.17:0/2235710645 >> 172.21.15.17:0/2235710645 conn(0x7f3c2c0fd610 msgr2=0x7f3c2c0fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.440+0000 7f3c31249640 1 -- 172.21.15.17:0/2235710645 shutdown_connections 2024-09-20T19:16:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:40.440+0000 7f3c31249640 1 -- 172.21.15.17:0/2235710645 wait complete. 2024-09-20T19:16:40.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:40 smithi172 ceph-mon[80431]: pgmap v1240: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:41.039 DEBUG:tasks.fs:max_mds not reduced in epoch 17 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-20T19:16:41.039 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 17 2024-09-20T19:16:41.039 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 18 2024-09-20T19:16:41.297 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:41.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:41 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2235710645' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-20T19:16:41.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:41 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2235710645' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-20T19:16:41.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.709+0000 7f57300aa640 1 -- 172.21.15.17:0/232884133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5728100800 msgr2=0x7f5728100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:41.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.709+0000 7f57300aa640 1 --2- 172.21.15.17:0/232884133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5728100800 0x7f5728100c60 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f5718009880 tx=0x7f571802a4a0 comp rx=0 tx=0).stop 2024-09-20T19:16:41.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.709+0000 7f57300aa640 1 -- 172.21.15.17:0/232884133 shutdown_connections 2024-09-20T19:16:41.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.709+0000 7f57300aa640 1 --2- 172.21.15.17:0/232884133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5728100800 0x7f5728100c60 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:41.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.709+0000 7f57300aa640 1 --2- 172.21.15.17:0/232884133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5728106800 0x7f5728106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:41.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.709+0000 7f57300aa640 1 -- 172.21.15.17:0/232884133 >> 172.21.15.17:0/232884133 conn(0x7f57280fc520 msgr2=0x7f57280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:41.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.709+0000 7f57300aa640 1 -- 172.21.15.17:0/232884133 shutdown_connections 2024-09-20T19:16:41.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.709+0000 7f57300aa640 1 -- 172.21.15.17:0/232884133 wait complete. 2024-09-20T19:16:41.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.710+0000 7f57300aa640 1 Processor -- start 2024-09-20T19:16:41.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.710+0000 7f57300aa640 1 -- start start 2024-09-20T19:16:41.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.710+0000 7f57300aa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5728100800 0x7f572819f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:41.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.710+0000 7f57300aa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5728106800 0x7f572819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:41.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.710+0000 7f57300aa640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f572810dd30 con 0x7f5728100800 2024-09-20T19:16:41.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.710+0000 7f57300aa640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f572810dbb0 con 0x7f5728106800 2024-09-20T19:16:41.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.710+0000 7f572de46640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5728100800 0x7f572819f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:41.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.710+0000 7f572de46640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5728100800 0x7f572819f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36278/0 (socket says 172.21.15.17:36278) 2024-09-20T19:16:41.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.710+0000 7f572de46640 1 -- 172.21.15.17:0/3278577862 learned_addr learned my addr 172.21.15.17:0/3278577862 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:41.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.710+0000 7f572d645640 1 --2- 172.21.15.17:0/3278577862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5728106800 0x7f572819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:41.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.710+0000 7f572de46640 1 -- 172.21.15.17:0/3278577862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5728106800 msgr2=0x7f572819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:41.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.710+0000 7f572de46640 1 --2- 172.21.15.17:0/3278577862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5728106800 0x7f572819fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:41.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.710+0000 7f572de46640 1 -- 172.21.15.17:0/3278577862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5728199a20 con 0x7f5728100800 2024-09-20T19:16:41.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.711+0000 7f572de46640 1 --2- 172.21.15.17:0/3278577862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5728100800 0x7f572819f860 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f572400b420 tx=0x7f572400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:41.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.711+0000 7f571effd640 1 -- 172.21.15.17:0/3278577862 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5724011630 con 0x7f5728100800 2024-09-20T19:16:41.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.711+0000 7f571effd640 1 -- 172.21.15.17:0/3278577862 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5724016070 con 0x7f5728100800 2024-09-20T19:16:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.711+0000 7f57300aa640 1 -- 172.21.15.17:0/3278577862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5728199d10 con 0x7f5728100800 2024-09-20T19:16:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.711+0000 7f571effd640 1 -- 172.21.15.17:0/3278577862 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5724010d40 con 0x7f5728100800 2024-09-20T19:16:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.711+0000 7f57300aa640 1 -- 172.21.15.17:0/3278577862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f572819a2a0 con 0x7f5728100800 2024-09-20T19:16:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.712+0000 7f57300aa640 1 -- 172.21.15.17:0/3278577862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5728101f40 con 0x7f5728100800 2024-09-20T19:16:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.713+0000 7f571effd640 1 -- 172.21.15.17:0/3278577862 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f572401b460 con 0x7f5728100800 2024-09-20T19:16:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.713+0000 7f571effd640 1 --2- 172.21.15.17:0/3278577862 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f571407af80 0x7f571407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.713+0000 7f571effd640 1 -- 172.21.15.17:0/3278577862 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f572409d6f0 con 0x7f5728100800 2024-09-20T19:16:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.713+0000 7f572d645640 1 --2- 172.21.15.17:0/3278577862 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f571407af80 0x7f571407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.714+0000 7f572d645640 1 --2- 172.21.15.17:0/3278577862 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f571407af80 0x7f571407d440 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5718031460 tx=0x7f5718009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.717+0000 7f571effd640 1 -- 172.21.15.17:0/3278577862 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5724021250 con 0x7f5728100800 2024-09-20T19:16:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.946+0000 7f57300aa640 1 -- 172.21.15.17:0/3278577862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) -- 0x7f572819a5b0 con 0x7f5728100800 2024-09-20T19:16:41.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.947+0000 7f571effd640 1 -- 172.21.15.17:0/3278577862 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v34) ==== 107+0+5309 (secure 0 0 0) 0x7f5724068d70 con 0x7f5728100800 2024-09-20T19:16:41.948 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:41.949 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":18,"btime":"2024-09-20T18:43:55:973230+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34320,"name":"cephfs.smithi017.xhlvpy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/1871368212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1871368212},{"type":"v1","addr":"172.21.15.17:6829","nonce":1871368212}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34328,"name":"cephfs.smithi017.puqizo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/3271129451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":3271129451},{"type":"v1","addr":"172.21.15.17:6827","nonce":3271129451}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":44285,"name":"cephfs.smithi172.liatxm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/3829314266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3829314266},{"type":"v1","addr":"172.21.15.172:6827","nonce":3829314266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":44293,"name":"cephfs.smithi172.mugtlk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/2779951413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2779951413},{"type":"v1","addr":"172.21.15.172:6825","nonce":2779951413}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T18:43:54.971296+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:16:41.949 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 18 2024-09-20T19:16:41.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.949+0000 7f57300aa640 1 -- 172.21.15.17:0/3278577862 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f571407af80 msgr2=0x7f571407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:41.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.949+0000 7f57300aa640 1 --2- 172.21.15.17:0/3278577862 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f571407af80 0x7f571407d440 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5718031460 tx=0x7f5718009560 comp rx=0 tx=0).stop 2024-09-20T19:16:41.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.949+0000 7f57300aa640 1 -- 172.21.15.17:0/3278577862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5728100800 msgr2=0x7f572819f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:41.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.949+0000 7f57300aa640 1 --2- 172.21.15.17:0/3278577862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5728100800 0x7f572819f860 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f572400b420 tx=0x7f572400b8e0 comp rx=0 tx=0).stop 2024-09-20T19:16:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.949+0000 7f57300aa640 1 -- 172.21.15.17:0/3278577862 shutdown_connections 2024-09-20T19:16:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.949+0000 7f57300aa640 1 --2- 172.21.15.17:0/3278577862 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f571407af80 0x7f571407d440 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.949+0000 7f57300aa640 1 --2- 172.21.15.17:0/3278577862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5728106800 0x7f572819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.949+0000 7f57300aa640 1 --2- 172.21.15.17:0/3278577862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5728100800 0x7f572819f860 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.949+0000 7f57300aa640 1 -- 172.21.15.17:0/3278577862 >> 172.21.15.17:0/3278577862 conn(0x7f57280fc520 msgr2=0x7f57280fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.950+0000 7f57300aa640 1 -- 172.21.15.17:0/3278577862 shutdown_connections 2024-09-20T19:16:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:41.950+0000 7f57300aa640 1 -- 172.21.15.17:0/3278577862 wait complete. 2024-09-20T19:16:42.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:42 smithi017 ceph-mon[108970]: pgmap v1241: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:42.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:42 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3278577862' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-20T19:16:42.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:42 smithi172 ceph-mon[80431]: pgmap v1241: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:42.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:42 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3278577862' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-20T19:16:42.536 DEBUG:tasks.fs:max_mds not reduced in epoch 18 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-20T19:16:42.536 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2024-09-20T19:16:42.536 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 19 2024-09-20T19:16:42.798 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:43.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.260+0000 7f41819e8640 1 -- 172.21.15.17:0/469644831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f417c107900 msgr2=0x7f417c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:43.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.260+0000 7f41819e8640 1 --2- 172.21.15.17:0/469644831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f417c107900 0x7f417c107ce0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f416c009880 tx=0x7f416c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:16:43.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.260+0000 7f41819e8640 1 -- 172.21.15.17:0/469644831 shutdown_connections 2024-09-20T19:16:43.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.260+0000 7f41819e8640 1 --2- 172.21.15.17:0/469644831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f417c101900 0x7f417c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:43.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.260+0000 7f41819e8640 1 --2- 172.21.15.17:0/469644831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f417c107900 0x7f417c107ce0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:43.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.260+0000 7f41819e8640 1 -- 172.21.15.17:0/469644831 >> 172.21.15.17:0/469644831 conn(0x7f417c0fd600 msgr2=0x7f417c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:43.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.260+0000 7f41819e8640 1 -- 172.21.15.17:0/469644831 shutdown_connections 2024-09-20T19:16:43.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.260+0000 7f41819e8640 1 -- 172.21.15.17:0/469644831 wait complete. 2024-09-20T19:16:43.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.261+0000 7f41819e8640 1 Processor -- start 2024-09-20T19:16:43.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.261+0000 7f41819e8640 1 -- start start 2024-09-20T19:16:43.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.261+0000 7f41819e8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f417c101900 0x7f417c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:43.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.261+0000 7f41819e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f417c107900 0x7f417c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:43.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.261+0000 7f41819e8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f417c10edd0 con 0x7f417c107900 2024-09-20T19:16:43.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.261+0000 7f41819e8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f417c10ec50 con 0x7f417c101900 2024-09-20T19:16:43.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.262+0000 7f41727fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f417c107900 0x7f417c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:43.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.262+0000 7f41727fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f417c107900 0x7f417c19db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36306/0 (socket says 172.21.15.17:36306) 2024-09-20T19:16:43.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.262+0000 7f41727fc640 1 -- 172.21.15.17:0/2194981144 learned_addr learned my addr 172.21.15.17:0/2194981144 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:43.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.262+0000 7f417affd640 1 --2- 172.21.15.17:0/2194981144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f417c101900 0x7f417c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:43.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.262+0000 7f41727fc640 1 -- 172.21.15.17:0/2194981144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f417c101900 msgr2=0x7f417c19d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:43.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.262+0000 7f41727fc640 1 --2- 172.21.15.17:0/2194981144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f417c101900 0x7f417c19d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:43.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.262+0000 7f41727fc640 1 -- 172.21.15.17:0/2194981144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417c1977c0 con 0x7f417c107900 2024-09-20T19:16:43.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.262+0000 7f41727fc640 1 --2- 172.21.15.17:0/2194981144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f417c107900 0x7f417c19db80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f416400d6f0 tx=0x7f416400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:43.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.262+0000 7f41809e6640 1 -- 172.21.15.17:0/2194981144 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4164017070 con 0x7f417c107900 2024-09-20T19:16:43.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.262+0000 7f41809e6640 1 -- 172.21.15.17:0/2194981144 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f416400de00 con 0x7f417c107900 2024-09-20T19:16:43.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.262+0000 7f41819e8640 1 -- 172.21.15.17:0/2194981144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417c197ab0 con 0x7f417c107900 2024-09-20T19:16:43.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.262+0000 7f41809e6640 1 -- 172.21.15.17:0/2194981144 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4164004bb0 con 0x7f417c107900 2024-09-20T19:16:43.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.262+0000 7f41819e8640 1 -- 172.21.15.17:0/2194981144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417c198040 con 0x7f417c107900 2024-09-20T19:16:43.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.263+0000 7f41819e8640 1 -- 172.21.15.17:0/2194981144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f417c103040 con 0x7f417c107900 2024-09-20T19:16:43.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.264+0000 7f41809e6640 1 -- 172.21.15.17:0/2194981144 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4164004e60 con 0x7f417c107900 2024-09-20T19:16:43.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.265+0000 7f41809e6640 1 --2- 172.21.15.17:0/2194981144 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f416807af30 0x7f416807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:43.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.265+0000 7f417affd640 1 --2- 172.21.15.17:0/2194981144 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f416807af30 0x7f416807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:43.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.265+0000 7f41809e6640 1 -- 172.21.15.17:0/2194981144 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f416409dba0 con 0x7f417c107900 2024-09-20T19:16:43.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.266+0000 7f417affd640 1 --2- 172.21.15.17:0/2194981144 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f416807af30 0x7f416807d3f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f416c0096c0 tx=0x7f416c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:43.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.270+0000 7f41809e6640 1 -- 172.21.15.17:0/2194981144 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f41640691a0 con 0x7f417c107900 2024-09-20T19:16:43.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.497+0000 7f41819e8640 1 -- 172.21.15.17:0/2194981144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) -- 0x7f417c109e70 con 0x7f417c107900 2024-09-20T19:16:43.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.497+0000 7f41809e6640 1 -- 172.21.15.17:0/2194981144 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v34) ==== 107+0+4462 (secure 0 0 0) 0x7f416406e050 con 0x7f417c107900 2024-09-20T19:16:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:43.499 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"btime":"2024-09-20T18:43:58:738600+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34320,"name":"cephfs.smithi017.xhlvpy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/1871368212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1871368212},{"type":"v1","addr":"172.21.15.17:6829","nonce":1871368212}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":44285,"name":"cephfs.smithi172.liatxm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/3829314266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3829314266},{"type":"v1","addr":"172.21.15.172:6827","nonce":3829314266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":44293,"name":"cephfs.smithi172.mugtlk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/2779951413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2779951413},{"type":"v1","addr":"172.21.15.172:6825","nonce":2779951413}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T18:43:54.971296+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:16:43.499 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 19 2024-09-20T19:16:43.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.500+0000 7f41819e8640 1 -- 172.21.15.17:0/2194981144 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f416807af30 msgr2=0x7f416807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:43.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.500+0000 7f41819e8640 1 --2- 172.21.15.17:0/2194981144 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f416807af30 0x7f416807d3f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f416c0096c0 tx=0x7f416c031400 comp rx=0 tx=0).stop 2024-09-20T19:16:43.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.500+0000 7f41819e8640 1 -- 172.21.15.17:0/2194981144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f417c107900 msgr2=0x7f417c19db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:43.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.500+0000 7f41819e8640 1 --2- 172.21.15.17:0/2194981144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f417c107900 0x7f417c19db80 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f416400d6f0 tx=0x7f416400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:16:43.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.500+0000 7f41819e8640 1 -- 172.21.15.17:0/2194981144 shutdown_connections 2024-09-20T19:16:43.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.500+0000 7f41819e8640 1 --2- 172.21.15.17:0/2194981144 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f416807af30 0x7f416807d3f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:43.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.500+0000 7f41819e8640 1 --2- 172.21.15.17:0/2194981144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f417c107900 0x7f417c19db80 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:43.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.500+0000 7f41819e8640 1 --2- 172.21.15.17:0/2194981144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f417c101900 0x7f417c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:43.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.500+0000 7f41819e8640 1 -- 172.21.15.17:0/2194981144 >> 172.21.15.17:0/2194981144 conn(0x7f417c0fd600 msgr2=0x7f417c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:43.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.500+0000 7f41819e8640 1 -- 172.21.15.17:0/2194981144 shutdown_connections 2024-09-20T19:16:43.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:43.500+0000 7f41819e8640 1 -- 172.21.15.17:0/2194981144 wait complete. 2024-09-20T19:16:44.187 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:44 smithi017 ceph-mon[108970]: pgmap v1242: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:44.187 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:44 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2194981144' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-20T19:16:44.188 DEBUG:tasks.fs:max_mds not reduced in epoch 19 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-20T19:16:44.188 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-09-20T19:16:44.189 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 20 2024-09-20T19:16:44.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:44 smithi172 ceph-mon[80431]: pgmap v1242: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:44.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:44 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2194981144' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-20T19:16:44.449 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:44.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.893+0000 7f7ccfa14640 1 -- 172.21.15.17:0/3077033416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8074f40 msgr2=0x7f7cc810dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:44.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.893+0000 7f7ccfa14640 1 --2- 172.21.15.17:0/3077033416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8074f40 0x7f7cc810dc00 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8009880 tx=0x7f7cb802a530 comp rx=0 tx=0).stop 2024-09-20T19:16:44.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.893+0000 7f7ccfa14640 1 -- 172.21.15.17:0/3077033416 shutdown_connections 2024-09-20T19:16:44.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.893+0000 7f7ccfa14640 1 --2- 172.21.15.17:0/3077033416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8074f40 0x7f7cc810dc00 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:44.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.893+0000 7f7ccfa14640 1 --2- 172.21.15.17:0/3077033416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cc8074620 0x7f7cc8074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:44.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.893+0000 7f7ccfa14640 1 -- 172.21.15.17:0/3077033416 >> 172.21.15.17:0/3077033416 conn(0x7f7cc80fd600 msgr2=0x7f7cc80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.894+0000 7f7ccfa14640 1 -- 172.21.15.17:0/3077033416 shutdown_connections 2024-09-20T19:16:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.894+0000 7f7ccfa14640 1 -- 172.21.15.17:0/3077033416 wait complete. 2024-09-20T19:16:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.894+0000 7f7ccfa14640 1 Processor -- start 2024-09-20T19:16:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.894+0000 7f7ccfa14640 1 -- start start 2024-09-20T19:16:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.894+0000 7f7ccfa14640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cc8074620 0x7f7cc819f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.894+0000 7f7ccfa14640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8074f40 0x7f7cc819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.894+0000 7f7ccfa14640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc8110ff0 con 0x7f7cc8074f40 2024-09-20T19:16:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.894+0000 7f7ccfa14640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc8110e70 con 0x7f7cc8074620 2024-09-20T19:16:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.895+0000 7f7cccfaf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8074f40 0x7f7cc819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.895+0000 7f7cccfaf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8074f40 0x7f7cc819fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36320/0 (socket says 172.21.15.17:36320) 2024-09-20T19:16:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.895+0000 7f7cccfaf640 1 -- 172.21.15.17:0/2984798620 learned_addr learned my addr 172.21.15.17:0/2984798620 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.895+0000 7f7ccd7b0640 1 --2- 172.21.15.17:0/2984798620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cc8074620 0x7f7cc819f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.895+0000 7f7cccfaf640 1 -- 172.21.15.17:0/2984798620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cc8074620 msgr2=0x7f7cc819f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.895+0000 7f7cccfaf640 1 --2- 172.21.15.17:0/2984798620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cc8074620 0x7f7cc819f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.895+0000 7f7cccfaf640 1 -- 172.21.15.17:0/2984798620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc8199a00 con 0x7f7cc8074f40 2024-09-20T19:16:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.895+0000 7f7ccd7b0640 1 --2- 172.21.15.17:0/2984798620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cc8074620 0x7f7cc819f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:16:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.895+0000 7f7cccfaf640 1 --2- 172.21.15.17:0/2984798620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8074f40 0x7f7cc819fd80 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8031460 tx=0x7f7cb80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.895+0000 7f7cbe7fc640 1 -- 172.21.15.17:0/2984798620 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cb803f070 con 0x7f7cc8074f40 2024-09-20T19:16:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.895+0000 7f7cbe7fc640 1 -- 172.21.15.17:0/2984798620 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7cb8004cf0 con 0x7f7cc8074f40 2024-09-20T19:16:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.895+0000 7f7cbe7fc640 1 -- 172.21.15.17:0/2984798620 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cb8035030 con 0x7f7cc8074f40 2024-09-20T19:16:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.895+0000 7f7ccfa14640 1 -- 172.21.15.17:0/2984798620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc8199c90 con 0x7f7cc8074f40 2024-09-20T19:16:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.895+0000 7f7ccfa14640 1 -- 172.21.15.17:0/2984798620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc819a1c0 con 0x7f7cc8074f40 2024-09-20T19:16:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.896+0000 7f7ccfa14640 1 -- 172.21.15.17:0/2984798620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cc8075cd0 con 0x7f7cc8074f40 2024-09-20T19:16:44.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.897+0000 7f7cbe7fc640 1 -- 172.21.15.17:0/2984798620 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7cb8042070 con 0x7f7cc8074f40 2024-09-20T19:16:44.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.898+0000 7f7cbe7fc640 1 --2- 172.21.15.17:0/2984798620 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7cb407af80 0x7f7cb407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:44.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.898+0000 7f7cbe7fc640 1 -- 172.21.15.17:0/2984798620 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f7cb80be9e0 con 0x7f7cc8074f40 2024-09-20T19:16:44.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.898+0000 7f7ccd7b0640 1 --2- 172.21.15.17:0/2984798620 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7cb407af80 0x7f7cb407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:44.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.898+0000 7f7ccd7b0640 1 --2- 172.21.15.17:0/2984798620 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7cb407af80 0x7f7cb407d440 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4005fd0 tx=0x7f7cc4005ea0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:44.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:44.902+0000 7f7cbe7fc640 1 -- 172.21.15.17:0/2984798620 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7cb808a060 con 0x7f7cc8074f40 2024-09-20T19:16:45.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:45.129+0000 7f7ccfa14640 1 -- 172.21.15.17:0/2984798620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) -- 0x7f7cc81082f0 con 0x7f7cc8074f40 2024-09-20T19:16:45.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:45.129+0000 7f7cbe7fc640 1 -- 172.21.15.17:0/2984798620 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v34) ==== 107+0+5309 (secure 0 0 0) 0x7f7cb808ef10 con 0x7f7cc8074f40 2024-09-20T19:16:45.131 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:45.131 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"btime":"2024-09-20T18:44:04:241218+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34320,"name":"cephfs.smithi017.xhlvpy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/1871368212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1871368212},{"type":"v1","addr":"172.21.15.17:6829","nonce":1871368212}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34332,"name":"cephfs.smithi017.puqizo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/2584064280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2584064280},{"type":"v1","addr":"172.21.15.17:6827","nonce":2584064280}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":44285,"name":"cephfs.smithi172.liatxm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/3829314266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3829314266},{"type":"v1","addr":"172.21.15.172:6827","nonce":3829314266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":44293,"name":"cephfs.smithi172.mugtlk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/2779951413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2779951413},{"type":"v1","addr":"172.21.15.172:6825","nonce":2779951413}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T18:43:54.971296+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:16:45.131 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 20 2024-09-20T19:16:45.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:45.132+0000 7f7ccfa14640 1 -- 172.21.15.17:0/2984798620 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7cb407af80 msgr2=0x7f7cb407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:45.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:45.132+0000 7f7ccfa14640 1 --2- 172.21.15.17:0/2984798620 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7cb407af80 0x7f7cb407d440 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4005fd0 tx=0x7f7cc4005ea0 comp rx=0 tx=0).stop 2024-09-20T19:16:45.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:45.132+0000 7f7ccfa14640 1 -- 172.21.15.17:0/2984798620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8074f40 msgr2=0x7f7cc819fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:45.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:45.132+0000 7f7ccfa14640 1 --2- 172.21.15.17:0/2984798620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8074f40 0x7f7cc819fd80 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8031460 tx=0x7f7cb80048f0 comp rx=0 tx=0).stop 2024-09-20T19:16:45.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:45.132+0000 7f7ccfa14640 1 -- 172.21.15.17:0/2984798620 shutdown_connections 2024-09-20T19:16:45.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:45.132+0000 7f7ccfa14640 1 --2- 172.21.15.17:0/2984798620 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f7cb407af80 0x7f7cb407d440 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:45.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:45.132+0000 7f7ccfa14640 1 --2- 172.21.15.17:0/2984798620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8074f40 0x7f7cc819fd80 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:45.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:45.132+0000 7f7ccfa14640 1 --2- 172.21.15.17:0/2984798620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cc8074620 0x7f7cc819f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:45.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:45.132+0000 7f7ccfa14640 1 -- 172.21.15.17:0/2984798620 >> 172.21.15.17:0/2984798620 conn(0x7f7cc80fd600 msgr2=0x7f7cc810b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:45.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:45.132+0000 7f7ccfa14640 1 -- 172.21.15.17:0/2984798620 shutdown_connections 2024-09-20T19:16:45.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:45.132+0000 7f7ccfa14640 1 -- 172.21.15.17:0/2984798620 wait complete. 2024-09-20T19:16:45.746 DEBUG:tasks.fs:max_mds not reduced in epoch 20 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-20T19:16:45.746 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-09-20T19:16:45.746 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 21 2024-09-20T19:16:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:46.284 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:46 smithi017 ceph-mon[108970]: pgmap v1243: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:16:46.285 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:46 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2984798620' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-20T19:16:46.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:46 smithi172 ceph-mon[80431]: pgmap v1243: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:16:46.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:46 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2984798620' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-20T19:16:46.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.491+0000 7f29939a4640 1 -- 172.21.15.17:0/1345383300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c101900 msgr2=0x7f298c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:46.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.491+0000 7f29939a4640 1 --2- 172.21.15.17:0/1345383300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c101900 0x7f298c101d60 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f297c009880 tx=0x7f297c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:16:46.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.491+0000 7f29939a4640 1 -- 172.21.15.17:0/1345383300 shutdown_connections 2024-09-20T19:16:46.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.491+0000 7f29939a4640 1 --2- 172.21.15.17:0/1345383300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c101900 0x7f298c101d60 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:46.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.491+0000 7f29939a4640 1 --2- 172.21.15.17:0/1345383300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f298c107900 0x7f298c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:46.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.491+0000 7f29939a4640 1 -- 172.21.15.17:0/1345383300 >> 172.21.15.17:0/1345383300 conn(0x7f298c0fd600 msgr2=0x7f298c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:46.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.491+0000 7f29939a4640 1 -- 172.21.15.17:0/1345383300 shutdown_connections 2024-09-20T19:16:46.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.491+0000 7f29939a4640 1 -- 172.21.15.17:0/1345383300 wait complete. 2024-09-20T19:16:46.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.492+0000 7f29939a4640 1 Processor -- start 2024-09-20T19:16:46.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.492+0000 7f29939a4640 1 -- start start 2024-09-20T19:16:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.492+0000 7f29939a4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f298c101900 0x7f298c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.492+0000 7f29939a4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c107900 0x7f298c19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.492+0000 7f29939a4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f298c10ee30 con 0x7f298c107900 2024-09-20T19:16:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.492+0000 7f29939a4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f298c10ecb0 con 0x7f298c101900 2024-09-20T19:16:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.492+0000 7f2990f3f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c107900 0x7f298c19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.492+0000 7f2990f3f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c107900 0x7f298c19dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36348/0 (socket says 172.21.15.17:36348) 2024-09-20T19:16:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.492+0000 7f2990f3f640 1 -- 172.21.15.17:0/1728432843 learned_addr learned my addr 172.21.15.17:0/1728432843 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.492+0000 7f2991740640 1 --2- 172.21.15.17:0/1728432843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f298c101900 0x7f298c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.492+0000 7f2990f3f640 1 -- 172.21.15.17:0/1728432843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f298c101900 msgr2=0x7f298c19d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.492+0000 7f2990f3f640 1 --2- 172.21.15.17:0/1728432843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f298c101900 0x7f298c19d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.492+0000 7f2990f3f640 1 -- 172.21.15.17:0/1728432843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c197840 con 0x7f298c107900 2024-09-20T19:16:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.493+0000 7f2991740640 1 --2- 172.21.15.17:0/1728432843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f298c101900 0x7f298c19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:16:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.493+0000 7f2990f3f640 1 --2- 172.21.15.17:0/1728432843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c107900 0x7f298c19dc00 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f297c031460 tx=0x7f297c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.493+0000 7f29827fc640 1 -- 172.21.15.17:0/1728432843 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f297c03f070 con 0x7f298c107900 2024-09-20T19:16:46.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.493+0000 7f29827fc640 1 -- 172.21.15.17:0/1728432843 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f297c004cf0 con 0x7f298c107900 2024-09-20T19:16:46.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.493+0000 7f29939a4640 1 -- 172.21.15.17:0/1728432843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f298c197ad0 con 0x7f298c107900 2024-09-20T19:16:46.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.493+0000 7f29827fc640 1 -- 172.21.15.17:0/1728432843 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f297c035030 con 0x7f298c107900 2024-09-20T19:16:46.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.493+0000 7f29939a4640 1 -- 172.21.15.17:0/1728432843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f298c198000 con 0x7f298c107900 2024-09-20T19:16:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.494+0000 7f29939a4640 1 -- 172.21.15.17:0/1728432843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f298c103040 con 0x7f298c107900 2024-09-20T19:16:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.495+0000 7f29827fc640 1 -- 172.21.15.17:0/1728432843 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f297c042070 con 0x7f298c107900 2024-09-20T19:16:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.495+0000 7f29827fc640 1 --2- 172.21.15.17:0/1728432843 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f297807af30 0x7f297807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.495+0000 7f29827fc640 1 -- 172.21.15.17:0/1728432843 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f297c0beb00 con 0x7f298c107900 2024-09-20T19:16:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.495+0000 7f2991740640 1 --2- 172.21.15.17:0/1728432843 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f297807af30 0x7f297807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.496+0000 7f2991740640 1 --2- 172.21.15.17:0/1728432843 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f297807af30 0x7f297807d3f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2988006fd0 tx=0x7f2988008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.500+0000 7f29827fc640 1 -- 172.21.15.17:0/1728432843 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f297c08a100 con 0x7f298c107900 2024-09-20T19:16:46.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.726+0000 7f29939a4640 1 -- 172.21.15.17:0/1728432843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) -- 0x7f298c198d70 con 0x7f298c107900 2024-09-20T19:16:46.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.726+0000 7f29827fc640 1 -- 172.21.15.17:0/1728432843 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v34) ==== 107+0+4462 (secure 0 0 0) 0x7f297c08efb0 con 0x7f298c107900 2024-09-20T19:16:46.728 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:46.728 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"btime":"2024-09-20T18:44:17:523360+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34332,"name":"cephfs.smithi017.puqizo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/2584064280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2584064280},{"type":"v1","addr":"172.21.15.17:6827","nonce":2584064280}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":44285,"name":"cephfs.smithi172.liatxm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/3829314266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3829314266},{"type":"v1","addr":"172.21.15.172:6827","nonce":3829314266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":44293,"name":"cephfs.smithi172.mugtlk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/2779951413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2779951413},{"type":"v1","addr":"172.21.15.172:6825","nonce":2779951413}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T18:43:54.971296+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:16:46.729 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 21 2024-09-20T19:16:46.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.728+0000 7f29939a4640 1 -- 172.21.15.17:0/1728432843 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f297807af30 msgr2=0x7f297807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:46.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.728+0000 7f29939a4640 1 --2- 172.21.15.17:0/1728432843 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f297807af30 0x7f297807d3f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2988006fd0 tx=0x7f2988008040 comp rx=0 tx=0).stop 2024-09-20T19:16:46.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.728+0000 7f29939a4640 1 -- 172.21.15.17:0/1728432843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c107900 msgr2=0x7f298c19dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:46.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.728+0000 7f29939a4640 1 --2- 172.21.15.17:0/1728432843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c107900 0x7f298c19dc00 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f297c031460 tx=0x7f297c0048f0 comp rx=0 tx=0).stop 2024-09-20T19:16:46.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.728+0000 7f29939a4640 1 -- 172.21.15.17:0/1728432843 shutdown_connections 2024-09-20T19:16:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.728+0000 7f29939a4640 1 --2- 172.21.15.17:0/1728432843 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f297807af30 0x7f297807d3f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.728+0000 7f29939a4640 1 --2- 172.21.15.17:0/1728432843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c107900 0x7f298c19dc00 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.728+0000 7f29939a4640 1 --2- 172.21.15.17:0/1728432843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f298c101900 0x7f298c19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.729+0000 7f29939a4640 1 -- 172.21.15.17:0/1728432843 >> 172.21.15.17:0/1728432843 conn(0x7f298c0fd600 msgr2=0x7f298c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.729+0000 7f29939a4640 1 -- 172.21.15.17:0/1728432843 shutdown_connections 2024-09-20T19:16:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:46.729+0000 7f29939a4640 1 -- 172.21.15.17:0/1728432843 wait complete. 2024-09-20T19:16:47.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:47 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1728432843' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-20T19:16:47.421 DEBUG:tasks.fs:max_mds not reduced in epoch 21 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-20T19:16:47.421 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-09-20T19:16:47.421 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 22 2024-09-20T19:16:47.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:47 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1728432843' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-20T19:16:47.682 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:48.072 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:48 smithi017 ceph-mon[108970]: pgmap v1244: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.127+0000 7f664c7bd640 1 -- 172.21.15.17:0/640082099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66441033d0 msgr2=0x7f664410b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.127+0000 7f664c7bd640 1 --2- 172.21.15.17:0/640082099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66441033d0 0x7f664410b8c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6638009880 tx=0x7f663802a530 comp rx=0 tx=0).stop 2024-09-20T19:16:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.127+0000 7f664c7bd640 1 -- 172.21.15.17:0/640082099 shutdown_connections 2024-09-20T19:16:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.127+0000 7f664c7bd640 1 --2- 172.21.15.17:0/640082099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66441033d0 0x7f664410b8c0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.127+0000 7f664c7bd640 1 --2- 172.21.15.17:0/640082099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6644102ab0 0x7f6644102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.127+0000 7f664c7bd640 1 -- 172.21.15.17:0/640082099 >> 172.21.15.17:0/640082099 conn(0x7f66440fc550 msgr2=0x7f66440fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.127+0000 7f664c7bd640 1 -- 172.21.15.17:0/640082099 shutdown_connections 2024-09-20T19:16:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.127+0000 7f664c7bd640 1 -- 172.21.15.17:0/640082099 wait complete. 2024-09-20T19:16:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.128+0000 7f664c7bd640 1 Processor -- start 2024-09-20T19:16:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.128+0000 7f664c7bd640 1 -- start start 2024-09-20T19:16:48.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.128+0000 7f664c7bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6644102ab0 0x7f664419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:48.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.128+0000 7f664c7bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66441033d0 0x7f664419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:48.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.128+0000 7f664c7bd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f664410ee40 con 0x7f66441033d0 2024-09-20T19:16:48.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.128+0000 7f664c7bd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f664410ecc0 con 0x7f6644102ab0 2024-09-20T19:16:48.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.128+0000 7f6649d58640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66441033d0 0x7f664419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:48.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.128+0000 7f6649d58640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66441033d0 0x7f664419dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36372/0 (socket says 172.21.15.17:36372) 2024-09-20T19:16:48.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.128+0000 7f6649d58640 1 -- 172.21.15.17:0/2913986932 learned_addr learned my addr 172.21.15.17:0/2913986932 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:48.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.129+0000 7f664a559640 1 --2- 172.21.15.17:0/2913986932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6644102ab0 0x7f664419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.129+0000 7f6649d58640 1 -- 172.21.15.17:0/2913986932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6644102ab0 msgr2=0x7f664419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.129+0000 7f6649d58640 1 --2- 172.21.15.17:0/2913986932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6644102ab0 0x7f664419d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.129+0000 7f6649d58640 1 -- 172.21.15.17:0/2913986932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6644197830 con 0x7f66441033d0 2024-09-20T19:16:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.129+0000 7f6649d58640 1 --2- 172.21.15.17:0/2913986932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66441033d0 0x7f664419dbf0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f6638031460 tx=0x7f66380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.129+0000 7f66437fe640 1 -- 172.21.15.17:0/2913986932 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f663803f070 con 0x7f66441033d0 2024-09-20T19:16:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.129+0000 7f664c7bd640 1 -- 172.21.15.17:0/2913986932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6644197ac0 con 0x7f66441033d0 2024-09-20T19:16:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.129+0000 7f66437fe640 1 -- 172.21.15.17:0/2913986932 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6638004ac0 con 0x7f66441033d0 2024-09-20T19:16:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.129+0000 7f66437fe640 1 -- 172.21.15.17:0/2913986932 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6638035030 con 0x7f66441033d0 2024-09-20T19:16:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.129+0000 7f664c7bd640 1 -- 172.21.15.17:0/2913986932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6644197ff0 con 0x7f66441033d0 2024-09-20T19:16:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.130+0000 7f664c7bd640 1 -- 172.21.15.17:0/2913986932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f664406a580 con 0x7f66441033d0 2024-09-20T19:16:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.131+0000 7f66437fe640 1 -- 172.21.15.17:0/2913986932 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6638042070 con 0x7f66441033d0 2024-09-20T19:16:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.131+0000 7f66437fe640 1 --2- 172.21.15.17:0/2913986932 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f662c07af30 0x7f662c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.131+0000 7f66437fe640 1 -- 172.21.15.17:0/2913986932 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f66380beab0 con 0x7f66441033d0 2024-09-20T19:16:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.131+0000 7f664a559640 1 --2- 172.21.15.17:0/2913986932 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f662c07af30 0x7f662c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.132+0000 7f664a559640 1 --2- 172.21.15.17:0/2913986932 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f662c07af30 0x7f662c07d3f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6634007dc0 tx=0x7f66340072f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.136+0000 7f66437fe640 1 -- 172.21.15.17:0/2913986932 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f663808a0b0 con 0x7f66441033d0 2024-09-20T19:16:48.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.362+0000 7f664c7bd640 1 -- 172.21.15.17:0/2913986932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) -- 0x7f6644105f50 con 0x7f66441033d0 2024-09-20T19:16:48.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.362+0000 7f66437fe640 1 -- 172.21.15.17:0/2913986932 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v34) ==== 107+0+5306 (secure 0 0 0) 0x7f663808ef60 con 0x7f66441033d0 2024-09-20T19:16:48.363 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:48.364 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"btime":"2024-09-20T18:44:20:531905+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34332,"name":"cephfs.smithi017.puqizo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/2584064280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2584064280},{"type":"v1","addr":"172.21.15.17:6827","nonce":2584064280}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34364,"name":"cephfs.smithi017.xhlvpy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/569261295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":569261295},{"type":"v1","addr":"172.21.15.17:6829","nonce":569261295}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44285,"name":"cephfs.smithi172.liatxm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/3829314266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3829314266},{"type":"v1","addr":"172.21.15.172:6827","nonce":3829314266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":44293,"name":"cephfs.smithi172.mugtlk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/2779951413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2779951413},{"type":"v1","addr":"172.21.15.172:6825","nonce":2779951413}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T18:43:54.971296+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:16:48.364 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2024-09-20T19:16:48.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.365+0000 7f664c7bd640 1 -- 172.21.15.17:0/2913986932 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f662c07af30 msgr2=0x7f662c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:48.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.365+0000 7f664c7bd640 1 --2- 172.21.15.17:0/2913986932 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f662c07af30 0x7f662c07d3f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6634007dc0 tx=0x7f66340072f0 comp rx=0 tx=0).stop 2024-09-20T19:16:48.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.365+0000 7f664c7bd640 1 -- 172.21.15.17:0/2913986932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66441033d0 msgr2=0x7f664419dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:48.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.365+0000 7f664c7bd640 1 --2- 172.21.15.17:0/2913986932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66441033d0 0x7f664419dbf0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f6638031460 tx=0x7f66380046c0 comp rx=0 tx=0).stop 2024-09-20T19:16:48.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.365+0000 7f664c7bd640 1 -- 172.21.15.17:0/2913986932 shutdown_connections 2024-09-20T19:16:48.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.365+0000 7f664c7bd640 1 --2- 172.21.15.17:0/2913986932 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f662c07af30 0x7f662c07d3f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:48.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.365+0000 7f664c7bd640 1 --2- 172.21.15.17:0/2913986932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66441033d0 0x7f664419dbf0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:48.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.365+0000 7f664c7bd640 1 --2- 172.21.15.17:0/2913986932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6644102ab0 0x7f664419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:48.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.365+0000 7f664c7bd640 1 -- 172.21.15.17:0/2913986932 >> 172.21.15.17:0/2913986932 conn(0x7f66440fc550 msgr2=0x7f6644108e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:48.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.365+0000 7f664c7bd640 1 -- 172.21.15.17:0/2913986932 shutdown_connections 2024-09-20T19:16:48.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:48.365+0000 7f664c7bd640 1 -- 172.21.15.17:0/2913986932 wait complete. 2024-09-20T19:16:48.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:48 smithi172 ceph-mon[80431]: pgmap v1244: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:49.170 DEBUG:tasks.fs:max_mds not reduced in epoch 22 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-20T19:16:49.170 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-20T19:16:49.171 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 23 2024-09-20T19:16:49.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:49 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2913986932' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-20T19:16:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:49.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:49 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2913986932' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-20T19:16:49.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.815+0000 7f6216508640 1 -- 172.21.15.17:0/2517268371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210106800 msgr2=0x7f6210106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:49.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.815+0000 7f6216508640 1 --2- 172.21.15.17:0/2517268371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210106800 0x7f6210106be0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f6200009880 tx=0x7f620002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:16:49.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.815+0000 7f6216508640 1 -- 172.21.15.17:0/2517268371 shutdown_connections 2024-09-20T19:16:49.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.816+0000 7f6216508640 1 --2- 172.21.15.17:0/2517268371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6210100800 0x7f6210100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:49.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.816+0000 7f6216508640 1 --2- 172.21.15.17:0/2517268371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210106800 0x7f6210106be0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:49.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.816+0000 7f6216508640 1 -- 172.21.15.17:0/2517268371 >> 172.21.15.17:0/2517268371 conn(0x7f62100fc520 msgr2=0x7f62100fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:49.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.816+0000 7f6216508640 1 -- 172.21.15.17:0/2517268371 shutdown_connections 2024-09-20T19:16:49.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.816+0000 7f6216508640 1 -- 172.21.15.17:0/2517268371 wait complete. 2024-09-20T19:16:49.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.816+0000 7f6216508640 1 Processor -- start 2024-09-20T19:16:49.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.816+0000 7f6216508640 1 -- start start 2024-09-20T19:16:49.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.817+0000 7f6216508640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6210100800 0x7f62100fcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:49.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.817+0000 7f6216508640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210106800 0x7f62100fd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:49.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.817+0000 7f6216508640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f621010dcd0 con 0x7f6210106800 2024-09-20T19:16:49.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.817+0000 7f6216508640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f621010db50 con 0x7f6210100800 2024-09-20T19:16:49.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.817+0000 7f620f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210106800 0x7f62100fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:49.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.817+0000 7f620f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210106800 0x7f62100fd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36392/0 (socket says 172.21.15.17:36392) 2024-09-20T19:16:49.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.817+0000 7f620f7fe640 1 -- 172.21.15.17:0/1022156821 learned_addr learned my addr 172.21.15.17:0/1022156821 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:49.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.817+0000 7f620ffff640 1 --2- 172.21.15.17:0/1022156821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6210100800 0x7f62100fcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:49.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.817+0000 7f620f7fe640 1 -- 172.21.15.17:0/1022156821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6210100800 msgr2=0x7f62100fcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:49.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.817+0000 7f620f7fe640 1 --2- 172.21.15.17:0/1022156821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6210100800 0x7f62100fcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:49.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.817+0000 7f620f7fe640 1 -- 172.21.15.17:0/1022156821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62100fd680 con 0x7f6210106800 2024-09-20T19:16:49.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.817+0000 7f620f7fe640 1 --2- 172.21.15.17:0/1022156821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210106800 0x7f62100fd140 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f620400d6f0 tx=0x7f620400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:49.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.817+0000 7f620d7fa640 1 -- 172.21.15.17:0/1022156821 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6204017070 con 0x7f6210106800 2024-09-20T19:16:49.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.817+0000 7f6216508640 1 -- 172.21.15.17:0/1022156821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62100fd970 con 0x7f6210106800 2024-09-20T19:16:49.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.817+0000 7f620d7fa640 1 -- 172.21.15.17:0/1022156821 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f620400de00 con 0x7f6210106800 2024-09-20T19:16:49.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.817+0000 7f620d7fa640 1 -- 172.21.15.17:0/1022156821 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6204004bb0 con 0x7f6210106800 2024-09-20T19:16:49.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.818+0000 7f6216508640 1 -- 172.21.15.17:0/1022156821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62101a3e60 con 0x7f6210106800 2024-09-20T19:16:49.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.819+0000 7f6216508640 1 -- 172.21.15.17:0/1022156821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6210101f40 con 0x7f6210106800 2024-09-20T19:16:49.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.819+0000 7f620d7fa640 1 -- 172.21.15.17:0/1022156821 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6204004e60 con 0x7f6210106800 2024-09-20T19:16:49.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.820+0000 7f620d7fa640 1 --2- 172.21.15.17:0/1022156821 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f61f807af30 0x7f61f807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:49.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.820+0000 7f620ffff640 1 --2- 172.21.15.17:0/1022156821 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f61f807af30 0x7f61f807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:49.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.820+0000 7f620d7fa640 1 -- 172.21.15.17:0/1022156821 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f620409dc30 con 0x7f6210106800 2024-09-20T19:16:49.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.820+0000 7f620ffff640 1 --2- 172.21.15.17:0/1022156821 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f61f807af30 0x7f61f807d3f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f62000096c0 tx=0x7f6200031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:49.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:49.824+0000 7f620d7fa640 1 -- 172.21.15.17:0/1022156821 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6204069230 con 0x7f6210106800 2024-09-20T19:16:50.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:50.053+0000 7f6216508640 1 -- 172.21.15.17:0/1022156821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) -- 0x7f6210100c60 con 0x7f6210106800 2024-09-20T19:16:50.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:50.053+0000 7f620d7fa640 1 -- 172.21.15.17:0/1022156821 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v34) ==== 107+0+4456 (secure 0 0 0) 0x7f620406e0e0 con 0x7f6210106800 2024-09-20T19:16:50.055 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:50.055 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":23,"btime":"2024-09-20T18:44:32:459884+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34332,"name":"cephfs.smithi017.puqizo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/2584064280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2584064280},{"type":"v1","addr":"172.21.15.17:6827","nonce":2584064280}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34364,"name":"cephfs.smithi017.xhlvpy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/569261295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":569261295},{"type":"v1","addr":"172.21.15.17:6829","nonce":569261295}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44285,"name":"cephfs.smithi172.liatxm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/3829314266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3829314266},{"type":"v1","addr":"172.21.15.172:6827","nonce":3829314266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T18:43:54.971296+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:16:50.055 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 23 2024-09-20T19:16:50.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:50.055+0000 7f6216508640 1 -- 172.21.15.17:0/1022156821 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f61f807af30 msgr2=0x7f61f807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:50.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:50.055+0000 7f6216508640 1 --2- 172.21.15.17:0/1022156821 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f61f807af30 0x7f61f807d3f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f62000096c0 tx=0x7f6200031400 comp rx=0 tx=0).stop 2024-09-20T19:16:50.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:50.055+0000 7f6216508640 1 -- 172.21.15.17:0/1022156821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210106800 msgr2=0x7f62100fd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:50.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:50.055+0000 7f6216508640 1 --2- 172.21.15.17:0/1022156821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210106800 0x7f62100fd140 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f620400d6f0 tx=0x7f620400dbb0 comp rx=0 tx=0).stop 2024-09-20T19:16:50.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:50.055+0000 7f6216508640 1 -- 172.21.15.17:0/1022156821 shutdown_connections 2024-09-20T19:16:50.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:50.055+0000 7f6216508640 1 --2- 172.21.15.17:0/1022156821 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f61f807af30 0x7f61f807d3f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:50.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:50.055+0000 7f6216508640 1 --2- 172.21.15.17:0/1022156821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210106800 0x7f62100fd140 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:50.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:50.055+0000 7f6216508640 1 --2- 172.21.15.17:0/1022156821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6210100800 0x7f62100fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:50.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:50.055+0000 7f6216508640 1 -- 172.21.15.17:0/1022156821 >> 172.21.15.17:0/1022156821 conn(0x7f62100fc520 msgr2=0x7f621006a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:50.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:50.055+0000 7f6216508640 1 -- 172.21.15.17:0/1022156821 shutdown_connections 2024-09-20T19:16:50.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:50.056+0000 7f6216508640 1 -- 172.21.15.17:0/1022156821 wait complete. 2024-09-20T19:16:50.066 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:50 smithi017 ceph-mon[108970]: pgmap v1245: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:50.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:50 smithi172 ceph-mon[80431]: pgmap v1245: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:50.744 DEBUG:tasks.fs:max_mds not reduced in epoch 23 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-20T19:16:50.744 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-20T19:16:50.745 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 24 2024-09-20T19:16:51.006 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:51.383 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:51 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1022156821' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-20T19:16:51.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:51 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1022156821' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-20T19:16:51.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.465+0000 7f404fdb3640 1 -- 172.21.15.17:0/866333778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40481067f0 msgr2=0x7f4048106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:51.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.465+0000 7f404fdb3640 1 --2- 172.21.15.17:0/866333778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40481067f0 0x7f4048106bd0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f4044009880 tx=0x7f404402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:16:51.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.465+0000 7f404fdb3640 1 -- 172.21.15.17:0/866333778 shutdown_connections 2024-09-20T19:16:51.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.465+0000 7f404fdb3640 1 --2- 172.21.15.17:0/866333778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40481007f0 0x7f4048100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:51.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.465+0000 7f404fdb3640 1 --2- 172.21.15.17:0/866333778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40481067f0 0x7f4048106bd0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:51.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.465+0000 7f404fdb3640 1 -- 172.21.15.17:0/866333778 >> 172.21.15.17:0/866333778 conn(0x7f40480fc550 msgr2=0x7f40480fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:51.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.465+0000 7f404fdb3640 1 -- 172.21.15.17:0/866333778 shutdown_connections 2024-09-20T19:16:51.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.465+0000 7f404fdb3640 1 -- 172.21.15.17:0/866333778 wait complete. 2024-09-20T19:16:51.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.466+0000 7f404fdb3640 1 Processor -- start 2024-09-20T19:16:51.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.466+0000 7f404fdb3640 1 -- start start 2024-09-20T19:16:51.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.466+0000 7f404fdb3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40481007f0 0x7f404819d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:51.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.466+0000 7f404fdb3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40481067f0 0x7f404819dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:51.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.466+0000 7f404fdb3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f404810edc0 con 0x7f40481007f0 2024-09-20T19:16:51.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.466+0000 7f404fdb3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f404810ec40 con 0x7f40481067f0 2024-09-20T19:16:51.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.466+0000 7f404db4f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40481007f0 0x7f404819d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:51.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.466+0000 7f404db4f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40481007f0 0x7f404819d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38808/0 (socket says 172.21.15.17:38808) 2024-09-20T19:16:51.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.466+0000 7f404db4f640 1 -- 172.21.15.17:0/2405290254 learned_addr learned my addr 172.21.15.17:0/2405290254 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:51.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.466+0000 7f404d34e640 1 --2- 172.21.15.17:0/2405290254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40481067f0 0x7f404819dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:51.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.466+0000 7f404db4f640 1 -- 172.21.15.17:0/2405290254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40481067f0 msgr2=0x7f404819dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:51.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.466+0000 7f404db4f640 1 --2- 172.21.15.17:0/2405290254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40481067f0 0x7f404819dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:51.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.466+0000 7f404db4f640 1 -- 172.21.15.17:0/2405290254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40481978b0 con 0x7f40481007f0 2024-09-20T19:16:51.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.467+0000 7f404db4f640 1 --2- 172.21.15.17:0/2405290254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40481007f0 0x7f404819d6f0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f4044031460 tx=0x7f40440045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:51.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.467+0000 7f403effd640 1 -- 172.21.15.17:0/2405290254 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f404403f070 con 0x7f40481007f0 2024-09-20T19:16:51.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.467+0000 7f404fdb3640 1 -- 172.21.15.17:0/2405290254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4048197b40 con 0x7f40481007f0 2024-09-20T19:16:51.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.467+0000 7f403effd640 1 -- 172.21.15.17:0/2405290254 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f40440035f0 con 0x7f40481007f0 2024-09-20T19:16:51.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.467+0000 7f403effd640 1 -- 172.21.15.17:0/2405290254 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4044035030 con 0x7f40481007f0 2024-09-20T19:16:51.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.467+0000 7f404fdb3640 1 -- 172.21.15.17:0/2405290254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4048198070 con 0x7f40481007f0 2024-09-20T19:16:51.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.468+0000 7f404fdb3640 1 -- 172.21.15.17:0/2405290254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4048101f30 con 0x7f40481007f0 2024-09-20T19:16:51.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.469+0000 7f403effd640 1 -- 172.21.15.17:0/2405290254 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4044042070 con 0x7f40481007f0 2024-09-20T19:16:51.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.469+0000 7f403effd640 1 --2- 172.21.15.17:0/2405290254 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f403407af30 0x7f403407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:51.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.469+0000 7f403effd640 1 -- 172.21.15.17:0/2405290254 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f40440bea20 con 0x7f40481007f0 2024-09-20T19:16:51.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.469+0000 7f404d34e640 1 --2- 172.21.15.17:0/2405290254 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f403407af30 0x7f403407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:51.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.470+0000 7f404d34e640 1 --2- 172.21.15.17:0/2405290254 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f403407af30 0x7f403407d3f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4038005fd0 tx=0x7f4038005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:51.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.473+0000 7f403effd640 1 -- 172.21.15.17:0/2405290254 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f404408a020 con 0x7f40481007f0 2024-09-20T19:16:51.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.699+0000 7f404fdb3640 1 -- 172.21.15.17:0/2405290254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) -- 0x7f4048198de0 con 0x7f40481007f0 2024-09-20T19:16:51.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.700+0000 7f403effd640 1 -- 172.21.15.17:0/2405290254 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v34) ==== 107+0+5303 (secure 0 0 0) 0x7f404408c020 con 0x7f40481007f0 2024-09-20T19:16:51.702 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:51.702 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"btime":"2024-09-20T18:44:37:466428+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34332,"name":"cephfs.smithi017.puqizo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/2584064280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2584064280},{"type":"v1","addr":"172.21.15.17:6827","nonce":2584064280}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34364,"name":"cephfs.smithi017.xhlvpy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/569261295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":569261295},{"type":"v1","addr":"172.21.15.17:6829","nonce":569261295}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44285,"name":"cephfs.smithi172.liatxm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/3829314266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3829314266},{"type":"v1","addr":"172.21.15.172:6827","nonce":3829314266}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":44325,"name":"cephfs.smithi172.mugtlk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/356477761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":356477761},{"type":"v1","addr":"172.21.15.172:6825","nonce":356477761}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T18:43:54.971296+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:16:51.702 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-09-20T19:16:51.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.702+0000 7f404fdb3640 1 -- 172.21.15.17:0/2405290254 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f403407af30 msgr2=0x7f403407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:51.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.702+0000 7f404fdb3640 1 --2- 172.21.15.17:0/2405290254 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f403407af30 0x7f403407d3f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4038005fd0 tx=0x7f4038005850 comp rx=0 tx=0).stop 2024-09-20T19:16:51.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.702+0000 7f404fdb3640 1 -- 172.21.15.17:0/2405290254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40481007f0 msgr2=0x7f404819d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:51.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.702+0000 7f404fdb3640 1 --2- 172.21.15.17:0/2405290254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40481007f0 0x7f404819d6f0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f4044031460 tx=0x7f40440045e0 comp rx=0 tx=0).stop 2024-09-20T19:16:51.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.702+0000 7f404fdb3640 1 -- 172.21.15.17:0/2405290254 shutdown_connections 2024-09-20T19:16:51.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.702+0000 7f404fdb3640 1 --2- 172.21.15.17:0/2405290254 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f403407af30 0x7f403407d3f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:51.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.702+0000 7f404fdb3640 1 --2- 172.21.15.17:0/2405290254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40481067f0 0x7f404819dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:51.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.702+0000 7f404fdb3640 1 --2- 172.21.15.17:0/2405290254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40481007f0 0x7f404819d6f0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:51.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.702+0000 7f404fdb3640 1 -- 172.21.15.17:0/2405290254 >> 172.21.15.17:0/2405290254 conn(0x7f40480fc550 msgr2=0x7f40480fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:51.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.702+0000 7f404fdb3640 1 -- 172.21.15.17:0/2405290254 shutdown_connections 2024-09-20T19:16:51.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:51.702+0000 7f404fdb3640 1 -- 172.21.15.17:0/2405290254 wait complete. 2024-09-20T19:16:52.304 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:52 smithi017 ceph-mon[108970]: pgmap v1246: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:52.304 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:52 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2405290254' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-20T19:16:52.336 DEBUG:tasks.fs:max_mds not reduced in epoch 24 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-20T19:16:52.336 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-20T19:16:52.336 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 25 2024-09-20T19:16:52.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:52 smithi172 ceph-mon[80431]: pgmap v1246: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:52.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:52 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2405290254' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-20T19:16:52.599 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:53.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.086+0000 7f2b93ae3640 1 -- 172.21.15.17:0/142926206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c100c00 msgr2=0x7f2b8c104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:53.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.086+0000 7f2b93ae3640 1 --2- 172.21.15.17:0/142926206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c100c00 0x7f2b8c104c50 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00a990 tx=0x7f2b7c02b7d0 comp rx=0 tx=0).stop 2024-09-20T19:16:53.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.086+0000 7f2b93ae3640 1 -- 172.21.15.17:0/142926206 shutdown_connections 2024-09-20T19:16:53.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.086+0000 7f2b93ae3640 1 --2- 172.21.15.17:0/142926206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c100c00 0x7f2b8c104c50 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:53.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.086+0000 7f2b93ae3640 1 --2- 172.21.15.17:0/142926206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b8c100250 0x7f2b8c100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:53.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.086+0000 7f2b93ae3640 1 -- 172.21.15.17:0/142926206 >> 172.21.15.17:0/142926206 conn(0x7f2b8c0fbc90 msgr2=0x7f2b8c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:53.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.086+0000 7f2b93ae3640 1 -- 172.21.15.17:0/142926206 shutdown_connections 2024-09-20T19:16:53.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.086+0000 7f2b93ae3640 1 -- 172.21.15.17:0/142926206 wait complete. 2024-09-20T19:16:53.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.087+0000 7f2b93ae3640 1 Processor -- start 2024-09-20T19:16:53.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.087+0000 7f2b93ae3640 1 -- start start 2024-09-20T19:16:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.087+0000 7f2b93ae3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b8c100250 0x7f2b8c19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.087+0000 7f2b93ae3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c100c00 0x7f2b8c19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.087+0000 7f2b93ae3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8c10cc30 con 0x7f2b8c100c00 2024-09-20T19:16:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.087+0000 7f2b93ae3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8c10cab0 con 0x7f2b8c100250 2024-09-20T19:16:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.087+0000 7f2b9107e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c100c00 0x7f2b8c19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.087+0000 7f2b9107e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c100c00 0x7f2b8c19dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38836/0 (socket says 172.21.15.17:38836) 2024-09-20T19:16:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.087+0000 7f2b9107e640 1 -- 172.21.15.17:0/2435881677 learned_addr learned my addr 172.21.15.17:0/2435881677 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.088+0000 7f2b9187f640 1 --2- 172.21.15.17:0/2435881677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b8c100250 0x7f2b8c19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.088+0000 7f2b9107e640 1 -- 172.21.15.17:0/2435881677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b8c100250 msgr2=0x7f2b8c19d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.088+0000 7f2b9107e640 1 --2- 172.21.15.17:0/2435881677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b8c100250 0x7f2b8c19d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.088+0000 7f2b9107e640 1 -- 172.21.15.17:0/2435881677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8c197850 con 0x7f2b8c100c00 2024-09-20T19:16:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.088+0000 7f2b9107e640 1 --2- 172.21.15.17:0/2435881677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c100c00 0x7f2b8c19dc10 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c036040 tx=0x7f2b7c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.088+0000 7f2b82ffd640 1 -- 172.21.15.17:0/2435881677 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2b7c044020 con 0x7f2b8c100c00 2024-09-20T19:16:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.088+0000 7f2b82ffd640 1 -- 172.21.15.17:0/2435881677 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2b7c004b80 con 0x7f2b8c100c00 2024-09-20T19:16:53.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.088+0000 7f2b82ffd640 1 -- 172.21.15.17:0/2435881677 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2b7c003820 con 0x7f2b8c100c00 2024-09-20T19:16:53.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.088+0000 7f2b93ae3640 1 -- 172.21.15.17:0/2435881677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8c197ae0 con 0x7f2b8c100c00 2024-09-20T19:16:53.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.088+0000 7f2b93ae3640 1 -- 172.21.15.17:0/2435881677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b8c198070 con 0x7f2b8c100c00 2024-09-20T19:16:53.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.089+0000 7f2b93ae3640 1 -- 172.21.15.17:0/2435881677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b8c101730 con 0x7f2b8c100c00 2024-09-20T19:16:53.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.090+0000 7f2b82ffd640 1 -- 172.21.15.17:0/2435881677 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2b7c047020 con 0x7f2b8c100c00 2024-09-20T19:16:53.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.090+0000 7f2b82ffd640 1 --2- 172.21.15.17:0/2435881677 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2b7807af40 0x7f2b7807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:53.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.091+0000 7f2b9187f640 1 --2- 172.21.15.17:0/2435881677 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2b7807af40 0x7f2b7807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:53.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.091+0000 7f2b82ffd640 1 -- 172.21.15.17:0/2435881677 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f2b7c0bf600 con 0x7f2b8c100c00 2024-09-20T19:16:53.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.091+0000 7f2b9187f640 1 --2- 172.21.15.17:0/2435881677 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2b7807af40 0x7f2b7807d400 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009890 tx=0x7f2b88008040 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:53.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.095+0000 7f2b82ffd640 1 -- 172.21.15.17:0/2435881677 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2b7c04e020 con 0x7f2b8c100c00 2024-09-20T19:16:53.136 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:53 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:16:53.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.323+0000 7f2b93ae3640 1 -- 172.21.15.17:0/2435881677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) -- 0x7f2b8c10a570 con 0x7f2b8c100c00 2024-09-20T19:16:53.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.324+0000 7f2b82ffd640 1 -- 172.21.15.17:0/2435881677 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v34) ==== 107+0+4453 (secure 0 0 0) 0x7f2b7c08ac00 con 0x7f2b8c100c00 2024-09-20T19:16:53.326 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:53.326 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":25,"btime":"2024-09-20T18:59:40:133284+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34332,"name":"cephfs.smithi017.puqizo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/2584064280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2584064280},{"type":"v1","addr":"172.21.15.17:6827","nonce":2584064280}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34364,"name":"cephfs.smithi017.xhlvpy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/569261295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":569261295},{"type":"v1","addr":"172.21.15.17:6829","nonce":569261295}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44325,"name":"cephfs.smithi172.mugtlk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/356477761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":356477761},{"type":"v1","addr":"172.21.15.172:6825","nonce":356477761}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T18:43:54.971296+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:16:53.326 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 25 2024-09-20T19:16:53.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.326+0000 7f2b93ae3640 1 -- 172.21.15.17:0/2435881677 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2b7807af40 msgr2=0x7f2b7807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:53.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.326+0000 7f2b93ae3640 1 --2- 172.21.15.17:0/2435881677 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2b7807af40 0x7f2b7807d400 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009890 tx=0x7f2b88008040 comp rx=0 tx=0).stop 2024-09-20T19:16:53.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.326+0000 7f2b93ae3640 1 -- 172.21.15.17:0/2435881677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c100c00 msgr2=0x7f2b8c19dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:53.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.326+0000 7f2b93ae3640 1 --2- 172.21.15.17:0/2435881677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c100c00 0x7f2b8c19dc10 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c036040 tx=0x7f2b7c004270 comp rx=0 tx=0).stop 2024-09-20T19:16:53.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.326+0000 7f2b93ae3640 1 -- 172.21.15.17:0/2435881677 shutdown_connections 2024-09-20T19:16:53.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.326+0000 7f2b93ae3640 1 --2- 172.21.15.17:0/2435881677 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f2b7807af40 0x7f2b7807d400 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:53.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.326+0000 7f2b93ae3640 1 --2- 172.21.15.17:0/2435881677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c100c00 0x7f2b8c19dc10 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:53.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.326+0000 7f2b93ae3640 1 --2- 172.21.15.17:0/2435881677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b8c100250 0x7f2b8c19d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:53.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.326+0000 7f2b93ae3640 1 -- 172.21.15.17:0/2435881677 >> 172.21.15.17:0/2435881677 conn(0x7f2b8c0fbc90 msgr2=0x7f2b8c0fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:53.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.326+0000 7f2b93ae3640 1 -- 172.21.15.17:0/2435881677 shutdown_connections 2024-09-20T19:16:53.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:53.326+0000 7f2b93ae3640 1 -- 172.21.15.17:0/2435881677 wait complete. 2024-09-20T19:16:53.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:53 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:16:53.957 DEBUG:tasks.fs:max_mds not reduced in epoch 25 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-20T19:16:53.957 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-20T19:16:53.957 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 26 2024-09-20T19:16:54.219 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:54.340 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:54 smithi017 ceph-mon[108970]: pgmap v1247: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:54.340 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:54 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2435881677' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-20T19:16:54.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:54 smithi172 ceph-mon[80431]: pgmap v1247: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:54.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:54 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2435881677' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-20T19:16:54.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.679+0000 7fa69c21a640 1 -- 172.21.15.17:0/3456633395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa694074590 msgr2=0x7fa694074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:54.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.679+0000 7fa69c21a640 1 --2- 172.21.15.17:0/3456633395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa694074590 0x7fa694074970 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fa684009880 tx=0x7fa68402a530 comp rx=0 tx=0).stop 2024-09-20T19:16:54.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.679+0000 7fa69c21a640 1 -- 172.21.15.17:0/3456633395 shutdown_connections 2024-09-20T19:16:54.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.679+0000 7fa69c21a640 1 --2- 172.21.15.17:0/3456633395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa694074eb0 0x7fa6941123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:54.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.679+0000 7fa69c21a640 1 --2- 172.21.15.17:0/3456633395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa694074590 0x7fa694074970 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:54.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.679+0000 7fa69c21a640 1 -- 172.21.15.17:0/3456633395 >> 172.21.15.17:0/3456633395 conn(0x7fa6940fd600 msgr2=0x7fa6940ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:54.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.679+0000 7fa69c21a640 1 -- 172.21.15.17:0/3456633395 shutdown_connections 2024-09-20T19:16:54.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.679+0000 7fa69c21a640 1 -- 172.21.15.17:0/3456633395 wait complete. 2024-09-20T19:16:54.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.680+0000 7fa69c21a640 1 Processor -- start 2024-09-20T19:16:54.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.680+0000 7fa69c21a640 1 -- start start 2024-09-20T19:16:54.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.680+0000 7fa69c21a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa694074590 0x7fa69419e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:54.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.680+0000 7fa69c21a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa694074eb0 0x7fa69419e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:54.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.680+0000 7fa69c21a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa6941153f0 con 0x7fa694074590 2024-09-20T19:16:54.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.680+0000 7fa69c21a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa694115270 con 0x7fa694074eb0 2024-09-20T19:16:54.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.680+0000 7fa699fb6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa694074590 0x7fa69419e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:54.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.680+0000 7fa699fb6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa694074590 0x7fa69419e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38850/0 (socket says 172.21.15.17:38850) 2024-09-20T19:16:54.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.680+0000 7fa699fb6640 1 -- 172.21.15.17:0/3399538205 learned_addr learned my addr 172.21.15.17:0/3399538205 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.681+0000 7fa6997b5640 1 --2- 172.21.15.17:0/3399538205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa694074eb0 0x7fa69419e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.681+0000 7fa699fb6640 1 -- 172.21.15.17:0/3399538205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa694074eb0 msgr2=0x7fa69419e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.681+0000 7fa699fb6640 1 --2- 172.21.15.17:0/3399538205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa694074eb0 0x7fa69419e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.681+0000 7fa699fb6640 1 -- 172.21.15.17:0/3399538205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6941a2900 con 0x7fa694074590 2024-09-20T19:16:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.681+0000 7fa6997b5640 1 --2- 172.21.15.17:0/3399538205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa694074eb0 0x7fa69419e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-20T19:16:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.681+0000 7fa699fb6640 1 --2- 172.21.15.17:0/3399538205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa694074590 0x7fa69419e030 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fa684031460 tx=0x7fa6840045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.681+0000 7fa692ffd640 1 -- 172.21.15.17:0/3399538205 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa68403f070 con 0x7fa694074590 2024-09-20T19:16:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.681+0000 7fa692ffd640 1 -- 172.21.15.17:0/3399538205 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa6840035f0 con 0x7fa694074590 2024-09-20T19:16:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.681+0000 7fa69c21a640 1 -- 172.21.15.17:0/3399538205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6941a2b90 con 0x7fa694074590 2024-09-20T19:16:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.681+0000 7fa692ffd640 1 -- 172.21.15.17:0/3399538205 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa684035030 con 0x7fa694074590 2024-09-20T19:16:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.681+0000 7fa69c21a640 1 -- 172.21.15.17:0/3399538205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6941a30c0 con 0x7fa694074590 2024-09-20T19:16:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.682+0000 7fa69c21a640 1 -- 172.21.15.17:0/3399538205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa694075cd0 con 0x7fa694074590 2024-09-20T19:16:54.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.683+0000 7fa692ffd640 1 -- 172.21.15.17:0/3399538205 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa684042070 con 0x7fa694074590 2024-09-20T19:16:54.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.683+0000 7fa692ffd640 1 --2- 172.21.15.17:0/3399538205 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa67c07af30 0x7fa67c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:54.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.683+0000 7fa692ffd640 1 -- 172.21.15.17:0/3399538205 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fa6840bea20 con 0x7fa694074590 2024-09-20T19:16:54.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.683+0000 7fa6997b5640 1 --2- 172.21.15.17:0/3399538205 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa67c07af30 0x7fa67c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:54.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.684+0000 7fa6997b5640 1 --2- 172.21.15.17:0/3399538205 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa67c07af30 0x7fa67c07d3f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa694104860 tx=0x7fa688005e50 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:54.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.688+0000 7fa692ffd640 1 -- 172.21.15.17:0/3399538205 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa68408a020 con 0x7fa694074590 2024-09-20T19:16:54.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.918+0000 7fa69c21a640 1 -- 172.21.15.17:0/3399538205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) -- 0x7fa69410fac0 con 0x7fa694074590 2024-09-20T19:16:54.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.919+0000 7fa692ffd640 1 -- 172.21.15.17:0/3399538205 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v34) ==== 107+0+5300 (secure 0 0 0) 0x7fa68408c020 con 0x7fa694074590 2024-09-20T19:16:54.921 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:54.921 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"btime":"2024-09-20T18:59:45:147712+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34332,"name":"cephfs.smithi017.puqizo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/2584064280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2584064280},{"type":"v1","addr":"172.21.15.17:6827","nonce":2584064280}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34364,"name":"cephfs.smithi017.xhlvpy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/569261295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":569261295},{"type":"v1","addr":"172.21.15.17:6829","nonce":569261295}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44325,"name":"cephfs.smithi172.mugtlk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/356477761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":356477761},{"type":"v1","addr":"172.21.15.172:6825","nonce":356477761}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44921,"name":"cephfs.smithi172.liatxm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/170330025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":170330025},{"type":"v1","addr":"172.21.15.172:6827","nonce":170330025}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T18:43:54.971296+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:16:54.921 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-09-20T19:16:54.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.921+0000 7fa69c21a640 1 -- 172.21.15.17:0/3399538205 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa67c07af30 msgr2=0x7fa67c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:54.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.921+0000 7fa69c21a640 1 --2- 172.21.15.17:0/3399538205 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa67c07af30 0x7fa67c07d3f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa694104860 tx=0x7fa688005e50 comp rx=0 tx=0).stop 2024-09-20T19:16:54.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.921+0000 7fa69c21a640 1 -- 172.21.15.17:0/3399538205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa694074590 msgr2=0x7fa69419e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:54.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.921+0000 7fa69c21a640 1 --2- 172.21.15.17:0/3399538205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa694074590 0x7fa69419e030 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fa684031460 tx=0x7fa6840045e0 comp rx=0 tx=0).stop 2024-09-20T19:16:54.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.921+0000 7fa69c21a640 1 -- 172.21.15.17:0/3399538205 shutdown_connections 2024-09-20T19:16:54.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.921+0000 7fa69c21a640 1 --2- 172.21.15.17:0/3399538205 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fa67c07af30 0x7fa67c07d3f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:54.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.921+0000 7fa69c21a640 1 --2- 172.21.15.17:0/3399538205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa694074eb0 0x7fa69419e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:54.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.921+0000 7fa69c21a640 1 --2- 172.21.15.17:0/3399538205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa694074590 0x7fa69419e030 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:54.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.921+0000 7fa69c21a640 1 -- 172.21.15.17:0/3399538205 >> 172.21.15.17:0/3399538205 conn(0x7fa6940fd600 msgr2=0x7fa694104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:54.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.921+0000 7fa69c21a640 1 -- 172.21.15.17:0/3399538205 shutdown_connections 2024-09-20T19:16:54.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:54.921+0000 7fa69c21a640 1 -- 172.21.15.17:0/3399538205 wait complete. 2024-09-20T19:16:55.286 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:55 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3399538205' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-20T19:16:55.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:55 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3399538205' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-20T19:16:55.624 DEBUG:tasks.fs:max_mds not reduced in epoch 26 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-20T19:16:55.624 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-20T19:16:55.624 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 27 2024-09-20T19:16:55.882 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:56.274 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:56 smithi017 ceph-mon[108970]: pgmap v1248: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:16:56.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.355+0000 7f7486b9b640 1 -- 172.21.15.17:0/868380476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7480107900 msgr2=0x7f7480107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:56.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.355+0000 7f7486b9b640 1 --2- 172.21.15.17:0/868380476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7480107900 0x7f7480107ce0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f747c009880 tx=0x7f747c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:16:56.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.355+0000 7f7486b9b640 1 -- 172.21.15.17:0/868380476 shutdown_connections 2024-09-20T19:16:56.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.355+0000 7f7486b9b640 1 --2- 172.21.15.17:0/868380476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7480101900 0x7f7480101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:56.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.355+0000 7f7486b9b640 1 --2- 172.21.15.17:0/868380476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7480107900 0x7f7480107ce0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:56.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.355+0000 7f7486b9b640 1 -- 172.21.15.17:0/868380476 >> 172.21.15.17:0/868380476 conn(0x7f74800fd600 msgr2=0x7f74800ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:56.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.355+0000 7f7486b9b640 1 -- 172.21.15.17:0/868380476 shutdown_connections 2024-09-20T19:16:56.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.355+0000 7f7486b9b640 1 -- 172.21.15.17:0/868380476 wait complete. 2024-09-20T19:16:56.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.356+0000 7f7486b9b640 1 Processor -- start 2024-09-20T19:16:56.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.356+0000 7f7486b9b640 1 -- start start 2024-09-20T19:16:56.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.356+0000 7f7486b9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7480101900 0x7f748019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:56.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.356+0000 7f7486b9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7480107900 0x7f748019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:56.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.356+0000 7f7486b9b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f748010ee30 con 0x7f7480107900 2024-09-20T19:16:56.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.356+0000 7f7486b9b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f748010ecb0 con 0x7f7480101900 2024-09-20T19:16:56.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.356+0000 7f7477fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7480107900 0x7f748019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:56.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.356+0000 7f7477fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7480107900 0x7f748019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38868/0 (socket says 172.21.15.17:38868) 2024-09-20T19:16:56.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.356+0000 7f7477fff640 1 -- 172.21.15.17:0/1144581148 learned_addr learned my addr 172.21.15.17:0/1144581148 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:56.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.356+0000 7f7484937640 1 --2- 172.21.15.17:0/1144581148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7480101900 0x7f748019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:56.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.356+0000 7f7477fff640 1 -- 172.21.15.17:0/1144581148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7480101900 msgr2=0x7f748019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:56.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.356+0000 7f7477fff640 1 --2- 172.21.15.17:0/1144581148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7480101900 0x7f748019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:56.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.356+0000 7f7477fff640 1 -- 172.21.15.17:0/1144581148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7480197810 con 0x7f7480107900 2024-09-20T19:16:56.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.356+0000 7f7484937640 1 --2- 172.21.15.17:0/1144581148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7480101900 0x7f748019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-20T19:16:56.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.357+0000 7f7477fff640 1 --2- 172.21.15.17:0/1144581148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7480107900 0x7f748019dbd0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f747000b420 tx=0x7f747000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:56.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.357+0000 7f7475ffb640 1 -- 172.21.15.17:0/1144581148 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7470011630 con 0x7f7480107900 2024-09-20T19:16:56.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.357+0000 7f7475ffb640 1 -- 172.21.15.17:0/1144581148 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7470016070 con 0x7f7480107900 2024-09-20T19:16:56.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.357+0000 7f7486b9b640 1 -- 172.21.15.17:0/1144581148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7480197b00 con 0x7f7480107900 2024-09-20T19:16:56.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.357+0000 7f7475ffb640 1 -- 172.21.15.17:0/1144581148 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7470010d40 con 0x7f7480107900 2024-09-20T19:16:56.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.357+0000 7f7486b9b640 1 -- 172.21.15.17:0/1144581148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7480198090 con 0x7f7480107900 2024-09-20T19:16:56.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.358+0000 7f7486b9b640 1 -- 172.21.15.17:0/1144581148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7480103040 con 0x7f7480107900 2024-09-20T19:16:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.359+0000 7f7475ffb640 1 -- 172.21.15.17:0/1144581148 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f747001b460 con 0x7f7480107900 2024-09-20T19:16:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.359+0000 7f7475ffb640 1 --2- 172.21.15.17:0/1144581148 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f746807af80 0x7f746807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.359+0000 7f7475ffb640 1 -- 172.21.15.17:0/1144581148 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f747009d6f0 con 0x7f7480107900 2024-09-20T19:16:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.359+0000 7f7484937640 1 --2- 172.21.15.17:0/1144581148 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f746807af80 0x7f746807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.360+0000 7f7484937640 1 --2- 172.21.15.17:0/1144581148 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f746807af80 0x7f746807d440 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f747c000c00 tx=0x7f747c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.364+0000 7f7475ffb640 1 -- 172.21.15.17:0/1144581148 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7470021250 con 0x7f7480107900 2024-09-20T19:16:56.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:56 smithi172 ceph-mon[80431]: pgmap v1248: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:16:56.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.590+0000 7f7486b9b640 1 -- 172.21.15.17:0/1144581148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) -- 0x7f7480109e70 con 0x7f7480107900 2024-09-20T19:16:56.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.591+0000 7f7475ffb640 1 -- 172.21.15.17:0/1144581148 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v34) ==== 107+0+5299 (secure 0 0 0) 0x7f7470068d70 con 0x7f7480107900 2024-09-20T19:16:56.593 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:56.593 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"btime":"2024-09-20T19:14:46:010366+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34332,"name":"cephfs.smithi017.puqizo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/2584064280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2584064280},{"type":"v1","addr":"172.21.15.17:6827","nonce":2584064280}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34364,"name":"cephfs.smithi017.xhlvpy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/569261295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":569261295},{"type":"v1","addr":"172.21.15.17:6829","nonce":569261295}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44325,"name":"cephfs.smithi172.mugtlk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/356477761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":356477761},{"type":"v1","addr":"172.21.15.172:6825","nonce":356477761}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44921,"name":"cephfs.smithi172.liatxm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/170330025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":170330025},{"type":"v1","addr":"172.21.15.172:6827","nonce":170330025}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T19:14:45.013494+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:16:56.593 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-09-20T19:16:56.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.593+0000 7f7486b9b640 1 -- 172.21.15.17:0/1144581148 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f746807af80 msgr2=0x7f746807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:56.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.593+0000 7f7486b9b640 1 --2- 172.21.15.17:0/1144581148 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f746807af80 0x7f746807d440 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f747c000c00 tx=0x7f747c031400 comp rx=0 tx=0).stop 2024-09-20T19:16:56.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.593+0000 7f7486b9b640 1 -- 172.21.15.17:0/1144581148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7480107900 msgr2=0x7f748019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:56.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.593+0000 7f7486b9b640 1 --2- 172.21.15.17:0/1144581148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7480107900 0x7f748019dbd0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f747000b420 tx=0x7f747000b8e0 comp rx=0 tx=0).stop 2024-09-20T19:16:56.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.593+0000 7f7486b9b640 1 -- 172.21.15.17:0/1144581148 shutdown_connections 2024-09-20T19:16:56.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.593+0000 7f7486b9b640 1 --2- 172.21.15.17:0/1144581148 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f746807af80 0x7f746807d440 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:56.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.593+0000 7f7486b9b640 1 --2- 172.21.15.17:0/1144581148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7480107900 0x7f748019dbd0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:56.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.593+0000 7f7486b9b640 1 --2- 172.21.15.17:0/1144581148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7480101900 0x7f748019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:56.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.593+0000 7f7486b9b640 1 -- 172.21.15.17:0/1144581148 >> 172.21.15.17:0/1144581148 conn(0x7f74800fd600 msgr2=0x7f74800fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:56.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.593+0000 7f7486b9b640 1 -- 172.21.15.17:0/1144581148 shutdown_connections 2024-09-20T19:16:56.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:56.593+0000 7f7486b9b640 1 -- 172.21.15.17:0/1144581148 wait complete. 2024-09-20T19:16:57.136 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:57 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1144581148' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-20T19:16:57.198 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-20T19:16:57.198 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 28 2024-09-20T19:16:57.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:57 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1144581148' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-20T19:16:57.457 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:57.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.922+0000 7fdc1781e640 1 -- 172.21.15.17:0/1002316082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc10101900 msgr2=0x7fdc10101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:57.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.922+0000 7fdc1781e640 1 --2- 172.21.15.17:0/1002316082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc10101900 0x7fdc10101d60 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009880 tx=0x7fdc0002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:16:57.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.922+0000 7fdc1781e640 1 -- 172.21.15.17:0/1002316082 shutdown_connections 2024-09-20T19:16:57.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.922+0000 7fdc1781e640 1 --2- 172.21.15.17:0/1002316082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc10101900 0x7fdc10101d60 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:57.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.922+0000 7fdc1781e640 1 --2- 172.21.15.17:0/1002316082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc10107900 0x7fdc10107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:57.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.922+0000 7fdc1781e640 1 -- 172.21.15.17:0/1002316082 >> 172.21.15.17:0/1002316082 conn(0x7fdc100fd600 msgr2=0x7fdc100ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:57.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.922+0000 7fdc1781e640 1 -- 172.21.15.17:0/1002316082 shutdown_connections 2024-09-20T19:16:57.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.922+0000 7fdc1781e640 1 -- 172.21.15.17:0/1002316082 wait complete. 2024-09-20T19:16:57.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.923+0000 7fdc1781e640 1 Processor -- start 2024-09-20T19:16:57.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.923+0000 7fdc1781e640 1 -- start start 2024-09-20T19:16:57.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.923+0000 7fdc1781e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc10101900 0x7fdc100744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:57.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.923+0000 7fdc1781e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc10107900 0x7fdc10074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:57.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.923+0000 7fdc1781e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1010edd0 con 0x7fdc10101900 2024-09-20T19:16:57.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.923+0000 7fdc1781e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1010ec50 con 0x7fdc10107900 2024-09-20T19:16:57.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.923+0000 7fdc155ba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc10101900 0x7fdc100744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:57.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.923+0000 7fdc155ba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc10101900 0x7fdc100744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38880/0 (socket says 172.21.15.17:38880) 2024-09-20T19:16:57.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.923+0000 7fdc155ba640 1 -- 172.21.15.17:0/3370824994 learned_addr learned my addr 172.21.15.17:0/3370824994 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:57.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.923+0000 7fdc14db9640 1 --2- 172.21.15.17:0/3370824994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc10107900 0x7fdc10074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:57.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.923+0000 7fdc155ba640 1 -- 172.21.15.17:0/3370824994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc10107900 msgr2=0x7fdc10074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:57.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.923+0000 7fdc155ba640 1 --2- 172.21.15.17:0/3370824994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc10107900 0x7fdc10074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:57.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.923+0000 7fdc155ba640 1 -- 172.21.15.17:0/3370824994 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc10074f70 con 0x7fdc10101900 2024-09-20T19:16:57.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.924+0000 7fdc155ba640 1 --2- 172.21.15.17:0/3370824994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc10101900 0x7fdc100744f0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00d6f0 tx=0x7fdc0c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:57.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.924+0000 7fdc067fc640 1 -- 172.21.15.17:0/3370824994 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdc0c017070 con 0x7fdc10101900 2024-09-20T19:16:57.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.924+0000 7fdc067fc640 1 -- 172.21.15.17:0/3370824994 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdc0c00de00 con 0x7fdc10101900 2024-09-20T19:16:57.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.924+0000 7fdc1781e640 1 -- 172.21.15.17:0/3370824994 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc10075260 con 0x7fdc10101900 2024-09-20T19:16:57.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.924+0000 7fdc067fc640 1 -- 172.21.15.17:0/3370824994 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdc0c004bb0 con 0x7fdc10101900 2024-09-20T19:16:57.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.924+0000 7fdc1781e640 1 -- 172.21.15.17:0/3370824994 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc101a3e20 con 0x7fdc10101900 2024-09-20T19:16:57.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.925+0000 7fdc1781e640 1 -- 172.21.15.17:0/3370824994 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc10103040 con 0x7fdc10101900 2024-09-20T19:16:57.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.926+0000 7fdc067fc640 1 -- 172.21.15.17:0/3370824994 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdc0c009a30 con 0x7fdc10101900 2024-09-20T19:16:57.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.926+0000 7fdc067fc640 1 --2- 172.21.15.17:0/3370824994 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdbfc07af80 0x7fdbfc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:57.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.926+0000 7fdc067fc640 1 -- 172.21.15.17:0/3370824994 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fdc0c09db80 con 0x7fdc10101900 2024-09-20T19:16:57.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.926+0000 7fdc14db9640 1 --2- 172.21.15.17:0/3370824994 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdbfc07af80 0x7fdbfc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:57.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.927+0000 7fdc14db9640 1 --2- 172.21.15.17:0/3370824994 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdbfc07af80 0x7fdbfc07d440 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fdc00031460 tx=0x7fdc00009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:57.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:57.931+0000 7fdc067fc640 1 -- 172.21.15.17:0/3370824994 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc0c069200 con 0x7fdc10101900 2024-09-20T19:16:58.136 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:58 smithi017 ceph-mon[108970]: pgmap v1249: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:58.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:58.156+0000 7fdc1781e640 1 -- 172.21.15.17:0/3370824994 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) -- 0x7fdc10109e70 con 0x7fdc10101900 2024-09-20T19:16:58.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:58.156+0000 7fdc067fc640 1 -- 172.21.15.17:0/3370824994 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v34) ==== 107+0+5322 (secure 0 0 0) 0x7fdc0c05ee20 con 0x7fdc10101900 2024-09-20T19:16:58.158 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:58.158 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":28,"btime":"2024-09-20T19:14:46:014546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44325,"name":"cephfs.smithi172.mugtlk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/356477761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":356477761},{"type":"v1","addr":"172.21.15.172:6825","nonce":356477761}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44921,"name":"cephfs.smithi172.liatxm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/170330025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":170330025},{"type":"v1","addr":"172.21.15.172:6827","nonce":170330025}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T19:14:46.014517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34332,"mds_1":34364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34332":{"gid":34332,"name":"cephfs.smithi017.puqizo","rank":0,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.17:6827/2584064280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2584064280},{"type":"v1","addr":"172.21.15.17:6827","nonce":2584064280}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"cephfs.smithi017.xhlvpy","rank":1,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.17:6829/569261295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":569261295},{"type":"v1","addr":"172.21.15.17:6829","nonce":569261295}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:16:58.159 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 28 2024-09-20T19:16:58.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:58.158+0000 7fdc1781e640 1 -- 172.21.15.17:0/3370824994 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdbfc07af80 msgr2=0x7fdbfc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:58.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:58.158+0000 7fdc1781e640 1 --2- 172.21.15.17:0/3370824994 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdbfc07af80 0x7fdbfc07d440 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fdc00031460 tx=0x7fdc00009560 comp rx=0 tx=0).stop 2024-09-20T19:16:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:58.158+0000 7fdc1781e640 1 -- 172.21.15.17:0/3370824994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc10101900 msgr2=0x7fdc100744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:58.158+0000 7fdc1781e640 1 --2- 172.21.15.17:0/3370824994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc10101900 0x7fdc100744f0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00d6f0 tx=0x7fdc0c00dbb0 comp rx=0 tx=0).stop 2024-09-20T19:16:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:58.158+0000 7fdc1781e640 1 -- 172.21.15.17:0/3370824994 shutdown_connections 2024-09-20T19:16:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:58.158+0000 7fdc1781e640 1 --2- 172.21.15.17:0/3370824994 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fdbfc07af80 0x7fdbfc07d440 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:58.158+0000 7fdc1781e640 1 --2- 172.21.15.17:0/3370824994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc10107900 0x7fdc10074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:58.158+0000 7fdc1781e640 1 --2- 172.21.15.17:0/3370824994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc10101900 0x7fdc100744f0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:58.158+0000 7fdc1781e640 1 -- 172.21.15.17:0/3370824994 >> 172.21.15.17:0/3370824994 conn(0x7fdc100fd600 msgr2=0x7fdc100fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:58.158+0000 7fdc1781e640 1 -- 172.21.15.17:0/3370824994 shutdown_connections 2024-09-20T19:16:58.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:58.158+0000 7fdc1781e640 1 -- 172.21.15.17:0/3370824994 wait complete. 2024-09-20T19:16:58.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:58 smithi172 ceph-mon[80431]: pgmap v1249: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:16:58.748 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-20T19:16:58.748 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 29 2024-09-20T19:16:59.008 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:16:59.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:16:59 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3370824994' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-20T19:16:59.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:16:59 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3370824994' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-20T19:16:59.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.498+0000 7f24d239f640 1 -- 172.21.15.17:0/3765189784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24cc1031f0 msgr2=0x7f24cc10b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:59.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.498+0000 7f24d239f640 1 --2- 172.21.15.17:0/3765189784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24cc1031f0 0x7f24cc10b6e0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009880 tx=0x7f24bc02a530 comp rx=0 tx=0).stop 2024-09-20T19:16:59.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.498+0000 7f24d239f640 1 -- 172.21.15.17:0/3765189784 shutdown_connections 2024-09-20T19:16:59.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.498+0000 7f24d239f640 1 --2- 172.21.15.17:0/3765189784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24cc1031f0 0x7f24cc10b6e0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:59.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.498+0000 7f24d239f640 1 --2- 172.21.15.17:0/3765189784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24cc1028d0 0x7f24cc102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:59.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.498+0000 7f24d239f640 1 -- 172.21.15.17:0/3765189784 >> 172.21.15.17:0/3765189784 conn(0x7f24cc0fc310 msgr2=0x7f24cc0fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:59.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.498+0000 7f24d239f640 1 -- 172.21.15.17:0/3765189784 shutdown_connections 2024-09-20T19:16:59.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.498+0000 7f24d239f640 1 -- 172.21.15.17:0/3765189784 wait complete. 2024-09-20T19:16:59.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.499+0000 7f24d239f640 1 Processor -- start 2024-09-20T19:16:59.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.499+0000 7f24d239f640 1 -- start start 2024-09-20T19:16:59.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.499+0000 7f24d239f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24cc1028d0 0x7f24cc19d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:59.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.499+0000 7f24d239f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24cc1031f0 0x7f24cc19d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:59.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.499+0000 7f24d239f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f24cc10ebe0 con 0x7f24cc1028d0 2024-09-20T19:16:59.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.499+0000 7f24d239f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f24cc10ea60 con 0x7f24cc1031f0 2024-09-20T19:16:59.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.499+0000 7f24d139d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24cc1028d0 0x7f24cc19d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:59.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.499+0000 7f24d139d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24cc1028d0 0x7f24cc19d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38900/0 (socket says 172.21.15.17:38900) 2024-09-20T19:16:59.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.499+0000 7f24d139d640 1 -- 172.21.15.17:0/3335276235 learned_addr learned my addr 172.21.15.17:0/3335276235 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:16:59.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.500+0000 7f24d0b9c640 1 --2- 172.21.15.17:0/3335276235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24cc1031f0 0x7f24cc19d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:59.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.500+0000 7f24d139d640 1 -- 172.21.15.17:0/3335276235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24cc1031f0 msgr2=0x7f24cc19d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:59.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.500+0000 7f24d139d640 1 --2- 172.21.15.17:0/3335276235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24cc1031f0 0x7f24cc19d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:59.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.500+0000 7f24d139d640 1 -- 172.21.15.17:0/3335276235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24cc1975f0 con 0x7f24cc1028d0 2024-09-20T19:16:59.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.500+0000 7f24d139d640 1 --2- 172.21.15.17:0/3335276235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24cc1028d0 0x7f24cc19d430 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f24c800d8d0 tx=0x7f24c800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:59.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.500+0000 7f24c27fc640 1 -- 172.21.15.17:0/3335276235 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24c8017070 con 0x7f24cc1028d0 2024-09-20T19:16:59.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.500+0000 7f24d239f640 1 -- 172.21.15.17:0/3335276235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24cc1978e0 con 0x7f24cc1028d0 2024-09-20T19:16:59.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.500+0000 7f24c27fc640 1 -- 172.21.15.17:0/3335276235 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f24c8010460 con 0x7f24cc1028d0 2024-09-20T19:16:59.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.500+0000 7f24c27fc640 1 -- 172.21.15.17:0/3335276235 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24c800f5f0 con 0x7f24cc1028d0 2024-09-20T19:16:59.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.500+0000 7f24d239f640 1 -- 172.21.15.17:0/3335276235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24cc197e70 con 0x7f24cc1028d0 2024-09-20T19:16:59.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.501+0000 7f24d239f640 1 -- 172.21.15.17:0/3335276235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24cc06a580 con 0x7f24cc1028d0 2024-09-20T19:16:59.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.502+0000 7f24c27fc640 1 -- 172.21.15.17:0/3335276235 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f24c8009a30 con 0x7f24cc1028d0 2024-09-20T19:16:59.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.502+0000 7f24c27fc640 1 --2- 172.21.15.17:0/3335276235 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24b807af30 0x7f24b807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:16:59.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.502+0000 7f24c27fc640 1 -- 172.21.15.17:0/3335276235 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f24c809df40 con 0x7f24cc1028d0 2024-09-20T19:16:59.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.502+0000 7f24d0b9c640 1 --2- 172.21.15.17:0/3335276235 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24b807af30 0x7f24b807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:16:59.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.503+0000 7f24d0b9c640 1 --2- 172.21.15.17:0/3335276235 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24b807af30 0x7f24b807d3f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f24bc031460 tx=0x7f24bc009560 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:16:59.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.507+0000 7f24c27fc640 1 -- 172.21.15.17:0/3335276235 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24c80694a0 con 0x7f24cc1028d0 2024-09-20T19:16:59.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.734+0000 7f24d239f640 1 -- 172.21.15.17:0/3335276235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) -- 0x7f24cc105de0 con 0x7f24cc1028d0 2024-09-20T19:16:59.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.735+0000 7f24c27fc640 1 -- 172.21.15.17:0/3335276235 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v34) ==== 107+0+5324 (secure 0 0 0) 0x7f24c806e350 con 0x7f24cc1028d0 2024-09-20T19:16:59.737 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:16:59.737 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":29,"btime":"2024-09-20T19:14:47:016102+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44325,"name":"cephfs.smithi172.mugtlk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/356477761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":356477761},{"type":"v1","addr":"172.21.15.172:6825","nonce":356477761}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44921,"name":"cephfs.smithi172.liatxm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/170330025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":170330025},{"type":"v1","addr":"172.21.15.172:6827","nonce":170330025}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T19:14:46.025517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34332,"mds_1":34364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34332":{"gid":34332,"name":"cephfs.smithi017.puqizo","rank":0,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.17:6827/2584064280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2584064280},{"type":"v1","addr":"172.21.15.17:6827","nonce":2584064280}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"cephfs.smithi017.xhlvpy","rank":1,"incarnation":28,"state":"up:resolve","state_seq":458,"addr":"172.21.15.17:6829/569261295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":569261295},{"type":"v1","addr":"172.21.15.17:6829","nonce":569261295}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:16:59.737 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 29 2024-09-20T19:16:59.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.737+0000 7f24d239f640 1 -- 172.21.15.17:0/3335276235 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24b807af30 msgr2=0x7f24b807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:59.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.737+0000 7f24d239f640 1 --2- 172.21.15.17:0/3335276235 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24b807af30 0x7f24b807d3f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f24bc031460 tx=0x7f24bc009560 comp rx=0 tx=0).stop 2024-09-20T19:16:59.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.737+0000 7f24d239f640 1 -- 172.21.15.17:0/3335276235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24cc1028d0 msgr2=0x7f24cc19d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:16:59.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.737+0000 7f24d239f640 1 --2- 172.21.15.17:0/3335276235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24cc1028d0 0x7f24cc19d430 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f24c800d8d0 tx=0x7f24c800dd90 comp rx=0 tx=0).stop 2024-09-20T19:16:59.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.737+0000 7f24d239f640 1 -- 172.21.15.17:0/3335276235 shutdown_connections 2024-09-20T19:16:59.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.737+0000 7f24d239f640 1 --2- 172.21.15.17:0/3335276235 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f24b807af30 0x7f24b807d3f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:59.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.737+0000 7f24d239f640 1 --2- 172.21.15.17:0/3335276235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24cc1031f0 0x7f24cc19d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:59.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.737+0000 7f24d239f640 1 --2- 172.21.15.17:0/3335276235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24cc1028d0 0x7f24cc19d430 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:16:59.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.737+0000 7f24d239f640 1 -- 172.21.15.17:0/3335276235 >> 172.21.15.17:0/3335276235 conn(0x7f24cc0fc310 msgr2=0x7f24cc103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:16:59.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.737+0000 7f24d239f640 1 -- 172.21.15.17:0/3335276235 shutdown_connections 2024-09-20T19:16:59.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:16:59.738+0000 7f24d239f640 1 -- 172.21.15.17:0/3335276235 wait complete. 2024-09-20T19:17:00.360 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:00 smithi172 ceph-mon[80431]: pgmap v1250: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:00.360 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:00 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3335276235' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-20T19:17:00.376 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:00 smithi017 ceph-mon[108970]: pgmap v1250: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:00.376 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:00 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3335276235' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-20T19:17:00.405 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 30 2024-09-20T19:17:00.671 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:17:01.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.149+0000 7f8455abc640 1 -- 172.21.15.17:0/1904423742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8450100800 msgr2=0x7f8450100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:01.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.149+0000 7f8455abc640 1 --2- 172.21.15.17:0/1904423742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8450100800 0x7f8450100c60 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f8444009880 tx=0x7f844402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:01.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.149+0000 7f8455abc640 1 -- 172.21.15.17:0/1904423742 shutdown_connections 2024-09-20T19:17:01.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.149+0000 7f8455abc640 1 --2- 172.21.15.17:0/1904423742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8450100800 0x7f8450100c60 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:01.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.149+0000 7f8455abc640 1 --2- 172.21.15.17:0/1904423742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8450106800 0x7f8450106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:01.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.149+0000 7f8455abc640 1 -- 172.21.15.17:0/1904423742 >> 172.21.15.17:0/1904423742 conn(0x7f84500fc520 msgr2=0x7f84500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:01.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.149+0000 7f8455abc640 1 -- 172.21.15.17:0/1904423742 shutdown_connections 2024-09-20T19:17:01.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.149+0000 7f8455abc640 1 -- 172.21.15.17:0/1904423742 wait complete. 2024-09-20T19:17:01.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.149+0000 7f8455abc640 1 Processor -- start 2024-09-20T19:17:01.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.150+0000 7f8455abc640 1 -- start start 2024-09-20T19:17:01.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.150+0000 7f8455abc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8450100800 0x7f845019f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:01.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.150+0000 7f8455abc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8450106800 0x7f845019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:01.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.150+0000 7f8455abc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f845010dcd0 con 0x7f8450100800 2024-09-20T19:17:01.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.150+0000 7f8455abc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f845010db50 con 0x7f8450106800 2024-09-20T19:17:01.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.150+0000 7f844f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8450100800 0x7f845019f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:01.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.150+0000 7f844f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8450100800 0x7f845019f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37390/0 (socket says 172.21.15.17:37390) 2024-09-20T19:17:01.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.150+0000 7f844f7fe640 1 -- 172.21.15.17:0/1890952946 learned_addr learned my addr 172.21.15.17:0/1890952946 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:17:01.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.150+0000 7f844effd640 1 --2- 172.21.15.17:0/1890952946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8450106800 0x7f845019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:01.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.151+0000 7f844f7fe640 1 -- 172.21.15.17:0/1890952946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8450106800 msgr2=0x7f845019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:01.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.151+0000 7f844f7fe640 1 --2- 172.21.15.17:0/1890952946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8450106800 0x7f845019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:01.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.151+0000 7f844f7fe640 1 -- 172.21.15.17:0/1890952946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84501999a0 con 0x7f8450100800 2024-09-20T19:17:01.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.151+0000 7f844f7fe640 1 --2- 172.21.15.17:0/1890952946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8450100800 0x7f845019f7e0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f844000cc60 tx=0x7f844000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:01.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.151+0000 7f844cff9640 1 -- 172.21.15.17:0/1890952946 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f844000ad30 con 0x7f8450100800 2024-09-20T19:17:01.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.151+0000 7f844cff9640 1 -- 172.21.15.17:0/1890952946 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8440005020 con 0x7f8450100800 2024-09-20T19:17:01.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.151+0000 7f8455abc640 1 -- 172.21.15.17:0/1890952946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8450199c90 con 0x7f8450100800 2024-09-20T19:17:01.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.151+0000 7f844cff9640 1 -- 172.21.15.17:0/1890952946 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f844000f640 con 0x7f8450100800 2024-09-20T19:17:01.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.151+0000 7f8455abc640 1 -- 172.21.15.17:0/1890952946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f845019a1f0 con 0x7f8450100800 2024-09-20T19:17:01.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.152+0000 7f8455abc640 1 -- 172.21.15.17:0/1890952946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8450101f40 con 0x7f8450100800 2024-09-20T19:17:01.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.153+0000 7f844cff9640 1 -- 172.21.15.17:0/1890952946 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8440004b20 con 0x7f8450100800 2024-09-20T19:17:01.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.153+0000 7f844cff9640 1 --2- 172.21.15.17:0/1890952946 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f843807af90 0x7f843807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:01.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.153+0000 7f844cff9640 1 -- 172.21.15.17:0/1890952946 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f844009e1e0 con 0x7f8450100800 2024-09-20T19:17:01.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.153+0000 7f844effd640 1 --2- 172.21.15.17:0/1890952946 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f843807af90 0x7f843807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:01.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.154+0000 7f844effd640 1 --2- 172.21.15.17:0/1890952946 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f843807af90 0x7f843807d450 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f845019b190 tx=0x7f8444031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:01.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.158+0000 7f844cff9640 1 -- 172.21.15.17:0/1890952946 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8440014030 con 0x7f8450100800 2024-09-20T19:17:01.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.382+0000 7f8455abc640 1 -- 172.21.15.17:0/1890952946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) -- 0x7f845019a4a0 con 0x7f8450100800 2024-09-20T19:17:01.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.383+0000 7f844cff9640 1 -- 172.21.15.17:0/1890952946 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v34) ==== 107+0+5327 (secure 0 0 0) 0x7f84400697c0 con 0x7f8450100800 2024-09-20T19:17:01.385 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:17:01.385 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":30,"btime":"2024-09-20T19:14:54:760468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44325,"name":"cephfs.smithi172.mugtlk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/356477761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":356477761},{"type":"v1","addr":"172.21.15.172:6825","nonce":356477761}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44921,"name":"cephfs.smithi172.liatxm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/170330025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":170330025},{"type":"v1","addr":"172.21.15.172:6827","nonce":170330025}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T19:14:53.989563+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34332,"mds_1":34364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34332":{"gid":34332,"name":"cephfs.smithi017.puqizo","rank":0,"incarnation":28,"state":"up:resolve","state_seq":464,"addr":"172.21.15.17:6827/2584064280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2584064280},{"type":"v1","addr":"172.21.15.17:6827","nonce":2584064280}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"cephfs.smithi017.xhlvpy","rank":1,"incarnation":28,"state":"up:resolve","state_seq":458,"addr":"172.21.15.17:6829/569261295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":569261295},{"type":"v1","addr":"172.21.15.17:6829","nonce":569261295}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:17:01.386 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-09-20T19:17:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.386+0000 7f8455abc640 1 -- 172.21.15.17:0/1890952946 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f843807af90 msgr2=0x7f843807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.386+0000 7f8455abc640 1 --2- 172.21.15.17:0/1890952946 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f843807af90 0x7f843807d450 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f845019b190 tx=0x7f8444031400 comp rx=0 tx=0).stop 2024-09-20T19:17:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.386+0000 7f8455abc640 1 -- 172.21.15.17:0/1890952946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8450100800 msgr2=0x7f845019f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.386+0000 7f8455abc640 1 --2- 172.21.15.17:0/1890952946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8450100800 0x7f845019f7e0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f844000cc60 tx=0x7f844000a620 comp rx=0 tx=0).stop 2024-09-20T19:17:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.386+0000 7f8455abc640 1 -- 172.21.15.17:0/1890952946 shutdown_connections 2024-09-20T19:17:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.386+0000 7f8455abc640 1 --2- 172.21.15.17:0/1890952946 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f843807af90 0x7f843807d450 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.386+0000 7f8455abc640 1 --2- 172.21.15.17:0/1890952946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8450106800 0x7f845019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.386+0000 7f8455abc640 1 --2- 172.21.15.17:0/1890952946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8450100800 0x7f845019f7e0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.386+0000 7f8455abc640 1 -- 172.21.15.17:0/1890952946 >> 172.21.15.17:0/1890952946 conn(0x7f84500fc520 msgr2=0x7f845006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.386+0000 7f8455abc640 1 -- 172.21.15.17:0/1890952946 shutdown_connections 2024-09-20T19:17:01.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:01.386+0000 7f8455abc640 1 -- 172.21.15.17:0/1890952946 wait complete. 2024-09-20T19:17:02.005 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 31 2024-09-20T19:17:02.266 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:17:02.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:02 smithi017 ceph-mon[108970]: pgmap v1251: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:02.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:02 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/1890952946' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-20T19:17:02.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:02 smithi172 ceph-mon[80431]: pgmap v1251: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:02.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:02 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/1890952946' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-20T19:17:02.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.737+0000 7f339fc23640 1 -- 172.21.15.17:0/1801988542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33981067f0 msgr2=0x7f3398106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:02.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.737+0000 7f339fc23640 1 --2- 172.21.15.17:0/1801988542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33981067f0 0x7f3398106bd0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f3394009880 tx=0x7f339402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:02.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.737+0000 7f339fc23640 1 -- 172.21.15.17:0/1801988542 shutdown_connections 2024-09-20T19:17:02.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.737+0000 7f339fc23640 1 --2- 172.21.15.17:0/1801988542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33981007f0 0x7f3398100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:02.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.737+0000 7f339fc23640 1 --2- 172.21.15.17:0/1801988542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33981067f0 0x7f3398106bd0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:02.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.737+0000 7f339fc23640 1 -- 172.21.15.17:0/1801988542 >> 172.21.15.17:0/1801988542 conn(0x7f33980fc550 msgr2=0x7f33980fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:02.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.737+0000 7f339fc23640 1 -- 172.21.15.17:0/1801988542 shutdown_connections 2024-09-20T19:17:02.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.737+0000 7f339fc23640 1 -- 172.21.15.17:0/1801988542 wait complete. 2024-09-20T19:17:02.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.738+0000 7f339fc23640 1 Processor -- start 2024-09-20T19:17:02.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.738+0000 7f339fc23640 1 -- start start 2024-09-20T19:17:02.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.738+0000 7f339fc23640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33981007f0 0x7f339819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:02.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.738+0000 7f339fc23640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33981067f0 0x7f339819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:02.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.738+0000 7f339fc23640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f339810dcc0 con 0x7f33981067f0 2024-09-20T19:17:02.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.738+0000 7f339fc23640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f339810db40 con 0x7f33981007f0 2024-09-20T19:17:02.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.738+0000 7f339d1be640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33981067f0 0x7f339819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:02.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.738+0000 7f339d1be640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33981067f0 0x7f339819cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37412/0 (socket says 172.21.15.17:37412) 2024-09-20T19:17:02.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.738+0000 7f339d1be640 1 -- 172.21.15.17:0/625333624 learned_addr learned my addr 172.21.15.17:0/625333624 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:17:02.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.739+0000 7f339d9bf640 1 --2- 172.21.15.17:0/625333624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33981007f0 0x7f339819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:02.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.739+0000 7f339d1be640 1 -- 172.21.15.17:0/625333624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33981007f0 msgr2=0x7f339819c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:02.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.739+0000 7f339d1be640 1 --2- 172.21.15.17:0/625333624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33981007f0 0x7f339819c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:02.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.739+0000 7f339d1be640 1 -- 172.21.15.17:0/625333624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33981966d0 con 0x7f33981067f0 2024-09-20T19:17:02.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.739+0000 7f339d1be640 1 --2- 172.21.15.17:0/625333624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33981067f0 0x7f339819cb40 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f338800c8f0 tx=0x7f338800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:02.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.739+0000 7f338effd640 1 -- 172.21.15.17:0/625333624 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f33880079b0 con 0x7f33981067f0 2024-09-20T19:17:02.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.739+0000 7f338effd640 1 -- 172.21.15.17:0/625333624 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f33880054e0 con 0x7f33981067f0 2024-09-20T19:17:02.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.739+0000 7f339fc23640 1 -- 172.21.15.17:0/625333624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33981969c0 con 0x7f33981067f0 2024-09-20T19:17:02.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.739+0000 7f338effd640 1 -- 172.21.15.17:0/625333624 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3388004dd0 con 0x7f33981067f0 2024-09-20T19:17:02.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.739+0000 7f339fc23640 1 -- 172.21.15.17:0/625333624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3398196f20 con 0x7f33981067f0 2024-09-20T19:17:02.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.740+0000 7f339fc23640 1 -- 172.21.15.17:0/625333624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3398101f30 con 0x7f33981067f0 2024-09-20T19:17:02.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.741+0000 7f338effd640 1 -- 172.21.15.17:0/625333624 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3388005020 con 0x7f33981067f0 2024-09-20T19:17:02.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.741+0000 7f338effd640 1 --2- 172.21.15.17:0/625333624 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f338407aed0 0x7f338407d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:02.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.741+0000 7f338effd640 1 -- 172.21.15.17:0/625333624 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f338809dfd0 con 0x7f33981067f0 2024-09-20T19:17:02.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.741+0000 7f339d9bf640 1 --2- 172.21.15.17:0/625333624 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f338407aed0 0x7f338407d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:02.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.742+0000 7f339d9bf640 1 --2- 172.21.15.17:0/625333624 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f338407aed0 0x7f338407d390 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3394031460 tx=0x7f3394005bd0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:02.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.746+0000 7f338effd640 1 -- 172.21.15.17:0/625333624 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3388014030 con 0x7f33981067f0 2024-09-20T19:17:02.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.971+0000 7f339fc23640 1 -- 172.21.15.17:0/625333624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) -- 0x7f3398108d60 con 0x7f33981067f0 2024-09-20T19:17:02.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.971+0000 7f338effd640 1 -- 172.21.15.17:0/625333624 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v34) ==== 107+0+5331 (secure 0 0 0) 0x7f33880880e0 con 0x7f33981067f0 2024-09-20T19:17:02.973 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:17:02.974 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"btime":"2024-09-20T19:14:55:761953+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44325,"name":"cephfs.smithi172.mugtlk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/356477761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":356477761},{"type":"v1","addr":"172.21.15.172:6825","nonce":356477761}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44921,"name":"cephfs.smithi172.liatxm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/170330025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":170330025},{"type":"v1","addr":"172.21.15.172:6827","nonce":170330025}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T19:14:54.840301+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34332,"mds_1":34364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34332":{"gid":34332,"name":"cephfs.smithi017.puqizo","rank":0,"incarnation":28,"state":"up:reconnect","state_seq":465,"addr":"172.21.15.17:6827/2584064280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2584064280},{"type":"v1","addr":"172.21.15.17:6827","nonce":2584064280}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"cephfs.smithi017.xhlvpy","rank":1,"incarnation":28,"state":"up:reconnect","state_seq":461,"addr":"172.21.15.17:6829/569261295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":569261295},{"type":"v1","addr":"172.21.15.17:6829","nonce":569261295}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:17:02.974 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 31 2024-09-20T19:17:02.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.974+0000 7f339fc23640 1 -- 172.21.15.17:0/625333624 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f338407aed0 msgr2=0x7f338407d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:02.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.974+0000 7f339fc23640 1 --2- 172.21.15.17:0/625333624 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f338407aed0 0x7f338407d390 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3394031460 tx=0x7f3394005bd0 comp rx=0 tx=0).stop 2024-09-20T19:17:02.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.974+0000 7f339fc23640 1 -- 172.21.15.17:0/625333624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33981067f0 msgr2=0x7f339819cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:02.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.974+0000 7f339fc23640 1 --2- 172.21.15.17:0/625333624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33981067f0 0x7f339819cb40 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f338800c8f0 tx=0x7f338800cdb0 comp rx=0 tx=0).stop 2024-09-20T19:17:02.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.974+0000 7f339fc23640 1 -- 172.21.15.17:0/625333624 shutdown_connections 2024-09-20T19:17:02.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.974+0000 7f339fc23640 1 --2- 172.21.15.17:0/625333624 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f338407aed0 0x7f338407d390 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:02.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.974+0000 7f339fc23640 1 --2- 172.21.15.17:0/625333624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33981067f0 0x7f339819cb40 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:02.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.974+0000 7f339fc23640 1 --2- 172.21.15.17:0/625333624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33981007f0 0x7f339819c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:02.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.974+0000 7f339fc23640 1 -- 172.21.15.17:0/625333624 >> 172.21.15.17:0/625333624 conn(0x7f33980fc550 msgr2=0x7f33980fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:02.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.974+0000 7f339fc23640 1 -- 172.21.15.17:0/625333624 shutdown_connections 2024-09-20T19:17:02.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:02.974+0000 7f339fc23640 1 -- 172.21.15.17:0/625333624 wait complete. 2024-09-20T19:17:03.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:03 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/625333624' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-20T19:17:03.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:03 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/625333624' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-20T19:17:03.657 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 32 2024-09-20T19:17:03.918 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:17:04.313 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:04 smithi017 ceph-mon[108970]: pgmap v1252: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:04.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.310+0000 7f978227a640 1 -- 172.21.15.17:0/4000985846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f977c100800 msgr2=0x7f977c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:04.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.310+0000 7f978227a640 1 --2- 172.21.15.17:0/4000985846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f977c100800 0x7f977c100c60 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f9770009880 tx=0x7f977002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.310+0000 7f978227a640 1 -- 172.21.15.17:0/4000985846 shutdown_connections 2024-09-20T19:17:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.310+0000 7f978227a640 1 --2- 172.21.15.17:0/4000985846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f977c100800 0x7f977c100c60 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.310+0000 7f978227a640 1 --2- 172.21.15.17:0/4000985846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f977c106800 0x7f977c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.310+0000 7f978227a640 1 -- 172.21.15.17:0/4000985846 >> 172.21.15.17:0/4000985846 conn(0x7f977c0fc520 msgr2=0x7f977c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.310+0000 7f978227a640 1 -- 172.21.15.17:0/4000985846 shutdown_connections 2024-09-20T19:17:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.310+0000 7f978227a640 1 -- 172.21.15.17:0/4000985846 wait complete. 2024-09-20T19:17:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.311+0000 7f978227a640 1 Processor -- start 2024-09-20T19:17:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.311+0000 7f978227a640 1 -- start start 2024-09-20T19:17:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.311+0000 7f978227a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f977c100800 0x7f977c0fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.311+0000 7f978227a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f977c106800 0x7f977c0fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.311+0000 7f978227a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f977c10dcd0 con 0x7f977c106800 2024-09-20T19:17:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.311+0000 7f978227a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f977c10db50 con 0x7f977c100800 2024-09-20T19:17:04.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.312+0000 7f977b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f977c106800 0x7f977c0fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:04.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.312+0000 7f977b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f977c106800 0x7f977c0fd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37424/0 (socket says 172.21.15.17:37424) 2024-09-20T19:17:04.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.312+0000 7f977b7fe640 1 -- 172.21.15.17:0/2571254610 learned_addr learned my addr 172.21.15.17:0/2571254610 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:17:04.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.312+0000 7f977bfff640 1 --2- 172.21.15.17:0/2571254610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f977c100800 0x7f977c0fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:04.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.312+0000 7f977b7fe640 1 -- 172.21.15.17:0/2571254610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f977c100800 msgr2=0x7f977c0fcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:04.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.312+0000 7f977b7fe640 1 --2- 172.21.15.17:0/2571254610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f977c100800 0x7f977c0fcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:04.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.312+0000 7f977b7fe640 1 -- 172.21.15.17:0/2571254610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f977c0fd690 con 0x7f977c106800 2024-09-20T19:17:04.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.312+0000 7f977b7fe640 1 --2- 172.21.15.17:0/2571254610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f977c106800 0x7f977c0fd150 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9770031460 tx=0x7f97700045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:04.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.312+0000 7f97797fa640 1 -- 172.21.15.17:0/2571254610 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f977003f070 con 0x7f977c106800 2024-09-20T19:17:04.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.312+0000 7f97797fa640 1 -- 172.21.15.17:0/2571254610 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f97700035f0 con 0x7f977c106800 2024-09-20T19:17:04.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.312+0000 7f978227a640 1 -- 172.21.15.17:0/2571254610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f977c0fd920 con 0x7f977c106800 2024-09-20T19:17:04.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.312+0000 7f97797fa640 1 -- 172.21.15.17:0/2571254610 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9770035030 con 0x7f977c106800 2024-09-20T19:17:04.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.313+0000 7f978227a640 1 -- 172.21.15.17:0/2571254610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f977c1a3db0 con 0x7f977c106800 2024-09-20T19:17:04.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.313+0000 7f978227a640 1 -- 172.21.15.17:0/2571254610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f977c101f40 con 0x7f977c106800 2024-09-20T19:17:04.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.314+0000 7f97797fa640 1 -- 172.21.15.17:0/2571254610 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9770042070 con 0x7f977c106800 2024-09-20T19:17:04.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.315+0000 7f97797fa640 1 --2- 172.21.15.17:0/2571254610 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f976407af30 0x7f976407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:04.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.315+0000 7f97797fa640 1 -- 172.21.15.17:0/2571254610 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f97700bea20 con 0x7f977c106800 2024-09-20T19:17:04.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.315+0000 7f977bfff640 1 --2- 172.21.15.17:0/2571254610 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f976407af30 0x7f976407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:04.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.315+0000 7f977bfff640 1 --2- 172.21.15.17:0/2571254610 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f976407af30 0x7f976407d3f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f976c005fd0 tx=0x7f976c005850 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:04.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.319+0000 7f97797fa640 1 -- 172.21.15.17:0/2571254610 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f977008a020 con 0x7f977c106800 2024-09-20T19:17:04.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:04 smithi172 ceph-mon[80431]: pgmap v1252: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:04.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.545+0000 7f978227a640 1 -- 172.21.15.17:0/2571254610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) -- 0x7f977c109d80 con 0x7f977c106800 2024-09-20T19:17:04.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.545+0000 7f97797fa640 1 -- 172.21.15.17:0/2571254610 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v34) ==== 107+0+5325 (secure 0 0 0) 0x7f977008c020 con 0x7f977c106800 2024-09-20T19:17:04.547 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:17:04.547 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"btime":"2024-09-20T19:14:56:765550+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44325,"name":"cephfs.smithi172.mugtlk","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6825/356477761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":356477761},{"type":"v1","addr":"172.21.15.172:6825","nonce":356477761}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44921,"name":"cephfs.smithi172.liatxm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6827/170330025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":170330025},{"type":"v1","addr":"172.21.15.172:6827","nonce":170330025}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T19:14:55.768122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34332,"mds_1":34364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34332":{"gid":34332,"name":"cephfs.smithi017.puqizo","rank":0,"incarnation":28,"state":"up:rejoin","state_seq":466,"addr":"172.21.15.17:6827/2584064280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2584064280},{"type":"v1","addr":"172.21.15.17:6827","nonce":2584064280}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"cephfs.smithi017.xhlvpy","rank":1,"incarnation":28,"state":"up:rejoin","state_seq":462,"addr":"172.21.15.17:6829/569261295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":569261295},{"type":"v1","addr":"172.21.15.17:6829","nonce":569261295}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-20T19:17:04.548 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-09-20T19:17:04.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.548+0000 7f978227a640 1 -- 172.21.15.17:0/2571254610 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f976407af30 msgr2=0x7f976407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:04.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.548+0000 7f978227a640 1 --2- 172.21.15.17:0/2571254610 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f976407af30 0x7f976407d3f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f976c005fd0 tx=0x7f976c005850 comp rx=0 tx=0).stop 2024-09-20T19:17:04.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.548+0000 7f978227a640 1 -- 172.21.15.17:0/2571254610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f977c106800 msgr2=0x7f977c0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:04.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.548+0000 7f978227a640 1 --2- 172.21.15.17:0/2571254610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f977c106800 0x7f977c0fd150 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9770031460 tx=0x7f97700045e0 comp rx=0 tx=0).stop 2024-09-20T19:17:04.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.548+0000 7f978227a640 1 -- 172.21.15.17:0/2571254610 shutdown_connections 2024-09-20T19:17:04.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.548+0000 7f978227a640 1 --2- 172.21.15.17:0/2571254610 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f976407af30 0x7f976407d3f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:04.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.548+0000 7f978227a640 1 --2- 172.21.15.17:0/2571254610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f977c106800 0x7f977c0fd150 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:04.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.548+0000 7f978227a640 1 --2- 172.21.15.17:0/2571254610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f977c100800 0x7f977c0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:04.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.548+0000 7f978227a640 1 -- 172.21.15.17:0/2571254610 >> 172.21.15.17:0/2571254610 conn(0x7f977c0fc520 msgr2=0x7f977c06a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:04.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.548+0000 7f978227a640 1 -- 172.21.15.17:0/2571254610 shutdown_connections 2024-09-20T19:17:04.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:04.548+0000 7f978227a640 1 -- 172.21.15.17:0/2571254610 wait complete. 2024-09-20T19:17:05.136 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:05 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2571254610' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-20T19:17:05.189 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 33 2024-09-20T19:17:05.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:05 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2571254610' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-20T19:17:05.447 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:17:05.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.876+0000 7fe337d53640 1 -- 172.21.15.17:0/3225289917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe330101900 msgr2=0x7fe330101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:05.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.876+0000 7fe337d53640 1 --2- 172.21.15.17:0/3225289917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe330101900 0x7fe330101d60 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fe324009880 tx=0x7fe32402a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:05.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.876+0000 7fe337d53640 1 -- 172.21.15.17:0/3225289917 shutdown_connections 2024-09-20T19:17:05.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.876+0000 7fe337d53640 1 --2- 172.21.15.17:0/3225289917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe330101900 0x7fe330101d60 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:05.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.876+0000 7fe337d53640 1 --2- 172.21.15.17:0/3225289917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe330107900 0x7fe330107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:05.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.876+0000 7fe337d53640 1 -- 172.21.15.17:0/3225289917 >> 172.21.15.17:0/3225289917 conn(0x7fe3300fd600 msgr2=0x7fe3300ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:05.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.876+0000 7fe337d53640 1 -- 172.21.15.17:0/3225289917 shutdown_connections 2024-09-20T19:17:05.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.876+0000 7fe337d53640 1 -- 172.21.15.17:0/3225289917 wait complete. 2024-09-20T19:17:05.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.877+0000 7fe337d53640 1 Processor -- start 2024-09-20T19:17:05.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.877+0000 7fe337d53640 1 -- start start 2024-09-20T19:17:05.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.877+0000 7fe337d53640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe330101900 0x7fe33019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:05.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.877+0000 7fe337d53640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe330107900 0x7fe33019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:05.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.877+0000 7fe337d53640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe33010ee30 con 0x7fe330107900 2024-09-20T19:17:05.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.877+0000 7fe337d53640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe33010ecb0 con 0x7fe330101900 2024-09-20T19:17:05.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.877+0000 7fe3352ee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe330107900 0x7fe33019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:05.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.877+0000 7fe3352ee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe330107900 0x7fe33019dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37442/0 (socket says 172.21.15.17:37442) 2024-09-20T19:17:05.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.877+0000 7fe3352ee640 1 -- 172.21.15.17:0/3870507733 learned_addr learned my addr 172.21.15.17:0/3870507733 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:17:05.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.878+0000 7fe335aef640 1 --2- 172.21.15.17:0/3870507733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe330101900 0x7fe33019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:05.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.878+0000 7fe3352ee640 1 -- 172.21.15.17:0/3870507733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe330101900 msgr2=0x7fe33019d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:05.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.878+0000 7fe3352ee640 1 --2- 172.21.15.17:0/3870507733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe330101900 0x7fe33019d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:05.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.878+0000 7fe3352ee640 1 -- 172.21.15.17:0/3870507733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe330197840 con 0x7fe330107900 2024-09-20T19:17:05.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.878+0000 7fe3352ee640 1 --2- 172.21.15.17:0/3870507733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe330107900 0x7fe33019dc00 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe324031460 tx=0x7fe3240048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:05.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.878+0000 7fe32effd640 1 -- 172.21.15.17:0/3870507733 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe32403f070 con 0x7fe330107900 2024-09-20T19:17:05.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.878+0000 7fe32effd640 1 -- 172.21.15.17:0/3870507733 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe324004cf0 con 0x7fe330107900 2024-09-20T19:17:05.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.878+0000 7fe337d53640 1 -- 172.21.15.17:0/3870507733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe330197ad0 con 0x7fe330107900 2024-09-20T19:17:05.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.878+0000 7fe32effd640 1 -- 172.21.15.17:0/3870507733 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe324035030 con 0x7fe330107900 2024-09-20T19:17:05.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.878+0000 7fe337d53640 1 -- 172.21.15.17:0/3870507733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe330198000 con 0x7fe330107900 2024-09-20T19:17:05.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.879+0000 7fe337d53640 1 -- 172.21.15.17:0/3870507733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe330103040 con 0x7fe330107900 2024-09-20T19:17:05.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.880+0000 7fe32effd640 1 -- 172.21.15.17:0/3870507733 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe324042070 con 0x7fe330107900 2024-09-20T19:17:05.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.880+0000 7fe32effd640 1 --2- 172.21.15.17:0/3870507733 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe31807af80 0x7fe31807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:05.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.880+0000 7fe32effd640 1 -- 172.21.15.17:0/3870507733 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7fe3240bea80 con 0x7fe330107900 2024-09-20T19:17:05.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.880+0000 7fe335aef640 1 --2- 172.21.15.17:0/3870507733 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe31807af80 0x7fe31807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:05.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.881+0000 7fe335aef640 1 --2- 172.21.15.17:0/3870507733 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe31807af80 0x7fe31807d440 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe320009f20 tx=0x7fe3200094f0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:05.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:05.885+0000 7fe32effd640 1 -- 172.21.15.17:0/3870507733 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe32408a060 con 0x7fe330107900 2024-09-20T19:17:06.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:06.110+0000 7fe337d53640 1 -- 172.21.15.17:0/3870507733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) -- 0x7fe330109e90 con 0x7fe330107900 2024-09-20T19:17:06.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:06.110+0000 7fe32effd640 1 -- 172.21.15.17:0/3870507733 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v34) ==== 107+0+5355 (secure 0 0 0) 0x7fe32408ef10 con 0x7fe330107900 2024-09-20T19:17:06.113 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-20T19:17:06.113 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":33,"btime":"2024-09-20T19:14:57:207440+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-20T18:32:49.312742+0000","modified":"2024-09-20T19:14:57.207435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34332,"mds_1":34364},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34332":{"gid":34332,"name":"cephfs.smithi017.puqizo","rank":0,"incarnation":28,"state":"up:active","state_seq":467,"addr":"172.21.15.17:6827/2584064280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2584064280},{"type":"v1","addr":"172.21.15.17:6827","nonce":2584064280}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"cephfs.smithi017.xhlvpy","rank":1,"incarnation":28,"state":"up:active","state_seq":463,"addr":"172.21.15.17:6829/569261295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":569261295},{"type":"v1","addr":"172.21.15.17:6829","nonce":569261295}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44325":{"gid":44325,"name":"cephfs.smithi172.mugtlk","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6825/356477761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":356477761},{"type":"v1","addr":"172.21.15.172:6825","nonce":356477761}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44921":{"gid":44921,"name":"cephfs.smithi172.liatxm","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6827/170330025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":170330025},{"type":"v1","addr":"172.21.15.172:6827","nonce":170330025}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34332,"qdb_cluster":[34332,34364]},"id":1}]} 2024-09-20T19:17:06.113 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 33 2024-09-20T19:17:06.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:06.112+0000 7fe337d53640 1 -- 172.21.15.17:0/3870507733 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe31807af80 msgr2=0x7fe31807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:06.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:06.112+0000 7fe337d53640 1 --2- 172.21.15.17:0/3870507733 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe31807af80 0x7fe31807d440 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe320009f20 tx=0x7fe3200094f0 comp rx=0 tx=0).stop 2024-09-20T19:17:06.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:06.112+0000 7fe337d53640 1 -- 172.21.15.17:0/3870507733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe330107900 msgr2=0x7fe33019dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:06.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:06.112+0000 7fe337d53640 1 --2- 172.21.15.17:0/3870507733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe330107900 0x7fe33019dc00 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe324031460 tx=0x7fe3240048f0 comp rx=0 tx=0).stop 2024-09-20T19:17:06.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:06.113+0000 7fe337d53640 1 -- 172.21.15.17:0/3870507733 shutdown_connections 2024-09-20T19:17:06.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:06.113+0000 7fe337d53640 1 --2- 172.21.15.17:0/3870507733 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7fe31807af80 0x7fe31807d440 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:06.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:06.113+0000 7fe337d53640 1 --2- 172.21.15.17:0/3870507733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe330107900 0x7fe33019dc00 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:06.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:06.113+0000 7fe337d53640 1 --2- 172.21.15.17:0/3870507733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe330101900 0x7fe33019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:06.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:06.113+0000 7fe337d53640 1 -- 172.21.15.17:0/3870507733 >> 172.21.15.17:0/3870507733 conn(0x7fe3300fd600 msgr2=0x7fe3300fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:06.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:06.113+0000 7fe337d53640 1 -- 172.21.15.17:0/3870507733 shutdown_connections 2024-09-20T19:17:06.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:06.113+0000 7fe337d53640 1 -- 172.21.15.17:0/3870507733 wait complete. 2024-09-20T19:17:06.136 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:06 smithi017 ceph-mon[108970]: pgmap v1253: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:17:06.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:06 smithi172 ceph-mon[80431]: pgmap v1253: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:17:06.742 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-20T19:17:06.752 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-20T19:17:06.752 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T19:17:06.752 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-20T19:17:06.772 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T19:17:06.772 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-20T19:17:06.831 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-20T19:17:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:17:07.378 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:07 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3870507733' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-20T19:17:07.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:07 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3870507733' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-20T19:17:07.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.586+0000 7f489d742640 1 -- 172.21.15.17:0/901299379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4898101910 msgr2=0x7f4898101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:07.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.586+0000 7f489d742640 1 --2- 172.21.15.17:0/901299379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4898101910 0x7f4898101d70 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f488c009880 tx=0x7f488c02a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:07.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.586+0000 7f489d742640 1 -- 172.21.15.17:0/901299379 shutdown_connections 2024-09-20T19:17:07.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.586+0000 7f489d742640 1 --2- 172.21.15.17:0/901299379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4898101910 0x7f4898101d70 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:07.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.586+0000 7f489d742640 1 --2- 172.21.15.17:0/901299379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4898107910 0x7f4898107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:07.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.586+0000 7f489d742640 1 -- 172.21.15.17:0/901299379 >> 172.21.15.17:0/901299379 conn(0x7f48980fd610 msgr2=0x7f48980ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:07.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.586+0000 7f489d742640 1 -- 172.21.15.17:0/901299379 shutdown_connections 2024-09-20T19:17:07.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.586+0000 7f489d742640 1 -- 172.21.15.17:0/901299379 wait complete. 2024-09-20T19:17:07.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.587+0000 7f489d742640 1 Processor -- start 2024-09-20T19:17:07.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.587+0000 7f489d742640 1 -- start start 2024-09-20T19:17:07.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.587+0000 7f489d742640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4898101910 0x7f489819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:07.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.587+0000 7f489d742640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4898107910 0x7f489819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:07.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.587+0000 7f489d742640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f489810edc0 con 0x7f4898101910 2024-09-20T19:17:07.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.587+0000 7f489d742640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f489810ec40 con 0x7f4898107910 2024-09-20T19:17:07.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.587+0000 7f4896ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4898101910 0x7f489819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:07.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.587+0000 7f4896ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4898101910 0x7f489819d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37460/0 (socket says 172.21.15.17:37460) 2024-09-20T19:17:07.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.587+0000 7f4896ffd640 1 -- 172.21.15.17:0/2426326742 learned_addr learned my addr 172.21.15.17:0/2426326742 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:17:07.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.587+0000 7f48967fc640 1 --2- 172.21.15.17:0/2426326742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4898107910 0x7f489819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:07.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.588+0000 7f4896ffd640 1 -- 172.21.15.17:0/2426326742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4898107910 msgr2=0x7f489819db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:07.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.588+0000 7f4896ffd640 1 --2- 172.21.15.17:0/2426326742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4898107910 0x7f489819db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:07.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.588+0000 7f4896ffd640 1 -- 172.21.15.17:0/2426326742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48981977d0 con 0x7f4898101910 2024-09-20T19:17:07.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.588+0000 7f4896ffd640 1 --2- 172.21.15.17:0/2426326742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4898101910 0x7f489819d650 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f488800c8a0 tx=0x7f488800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:07.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.588+0000 7f487ffff640 1 -- 172.21.15.17:0/2426326742 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f48880079b0 con 0x7f4898101910 2024-09-20T19:17:07.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.588+0000 7f487ffff640 1 -- 172.21.15.17:0/2426326742 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4888007b50 con 0x7f4898101910 2024-09-20T19:17:07.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.588+0000 7f489d742640 1 -- 172.21.15.17:0/2426326742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4898197ac0 con 0x7f4898101910 2024-09-20T19:17:07.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.588+0000 7f487ffff640 1 -- 172.21.15.17:0/2426326742 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4888018700 con 0x7f4898101910 2024-09-20T19:17:07.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.588+0000 7f489d742640 1 -- 172.21.15.17:0/2426326742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4898198020 con 0x7f4898101910 2024-09-20T19:17:07.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.589+0000 7f489d742640 1 -- 172.21.15.17:0/2426326742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4898103050 con 0x7f4898101910 2024-09-20T19:17:07.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.590+0000 7f487ffff640 1 -- 172.21.15.17:0/2426326742 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4888007d00 con 0x7f4898101910 2024-09-20T19:17:07.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.590+0000 7f487ffff640 1 --2- 172.21.15.17:0/2426326742 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f488007af40 0x7f488007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:07.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.591+0000 7f48967fc640 1 --2- 172.21.15.17:0/2426326742 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f488007af40 0x7f488007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:07.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.591+0000 7f487ffff640 1 -- 172.21.15.17:0/2426326742 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f488809e210 con 0x7f4898101910 2024-09-20T19:17:07.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.591+0000 7f48967fc640 1 --2- 172.21.15.17:0/2426326742 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f488007af40 0x7f488007d400 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4898198b20 tx=0x7f488c031400 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:07.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.595+0000 7f487ffff640 1 -- 172.21.15.17:0/2426326742 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4888014030 con 0x7f4898101910 2024-09-20T19:17:07.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.798+0000 7f489d742640 1 -- 172.21.15.17:0/2426326742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4898198d00 con 0x7f4898101910 2024-09-20T19:17:07.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.798+0000 7f487ffff640 1 -- 172.21.15.17:0/2426326742 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 31 entries v80) ==== 81+0+1839 (secure 0 0 0) 0x7f4888069810 con 0x7f4898101910 2024-09-20T19:17:07.801 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.172:6824/1043027893 2024-09-21T18:43:54.970945+0000 2024-09-20T19:17:07.801 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3393805637 2024-09-21T18:26:38.662388+0000 2024-09-20T19:17:07.801 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/513066305 2024-09-21T18:26:38.662388+0000 2024-09-20T19:17:07.801 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/513066305 2024-09-21T18:26:38.662388+0000 2024-09-20T19:17:07.801 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2241274877 2024-09-21T18:34:56.617264+0000 2024-09-20T19:17:07.801 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/3940118846 2024-09-21T18:27:10.529430+0000 2024-09-20T19:17:07.801 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3160589064 2024-09-21T18:26:38.662388+0000 2024-09-20T19:17:07.801 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/3940118846 2024-09-21T18:27:10.529430+0000 2024-09-20T19:17:07.801 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2934627597 2024-09-21T18:27:10.529430+0000 2024-09-20T19:17:07.801 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/4095439401 2024-09-21T18:28:07.480593+0000 2024-09-20T19:17:07.801 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/29863517 2024-09-21T18:28:07.480593+0000 2024-09-20T19:17:07.801 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2816923133 2024-09-21T18:27:10.529430+0000 2024-09-20T19:17:07.801 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/29863517 2024-09-21T18:28:07.480593+0000 2024-09-20T19:17:07.802 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.172:6825/1043027893 2024-09-21T18:43:54.970945+0000 2024-09-20T19:17:07.802 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.172:6829/3016443347 2024-09-21T18:36:36.235339+0000 2024-09-20T19:17:07.802 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.172:0/3897907720 2024-09-21T18:36:36.235339+0000 2024-09-20T19:17:07.802 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/652312164 2024-09-21T18:26:38.662388+0000 2024-09-20T19:17:07.802 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/352736886 2024-09-21T18:28:07.480593+0000 2024-09-20T19:17:07.802 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.172:0/1714707464 2024-09-21T18:36:36.235339+0000 2024-09-20T19:17:07.802 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2443650242 2024-09-21T18:28:07.480593+0000 2024-09-20T19:17:07.802 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3027447183 2024-09-21T18:34:56.617264+0000 2024-09-20T19:17:07.802 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.172:0/3383207955 2024-09-21T18:36:36.235339+0000 2024-09-20T19:17:07.802 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1352836007 2024-09-21T18:34:56.617264+0000 2024-09-20T19:17:07.802 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.172:0/1015347889 2024-09-21T18:36:36.235339+0000 2024-09-20T19:17:07.802 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/2021461456 2024-09-21T18:34:56.617264+0000 2024-09-20T19:17:07.802 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/384622812 2024-09-21T18:34:56.617264+0000 2024-09-20T19:17:07.803 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/2021461456 2024-09-21T18:34:56.617264+0000 2024-09-20T19:17:07.803 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.172:6828/3016443347 2024-09-21T18:36:36.235339+0000 2024-09-20T19:17:07.803 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3207433207 2024-09-21T18:27:10.529430+0000 2024-09-20T19:17:07.803 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6826/3360305779 2024-09-21T18:43:54.970933+0000 2024-09-20T19:17:07.803 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6827/3360305779 2024-09-21T18:43:54.970933+0000 2024-09-20T19:17:07.803 INFO:teuthology.orchestra.run.smithi017.stderr:listed 31 entries 2024-09-20T19:17:07.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.801+0000 7f489d742640 1 -- 172.21.15.17:0/2426326742 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f488007af40 msgr2=0x7f488007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:07.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.801+0000 7f489d742640 1 --2- 172.21.15.17:0/2426326742 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f488007af40 0x7f488007d400 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4898198b20 tx=0x7f488c031400 comp rx=0 tx=0).stop 2024-09-20T19:17:07.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.801+0000 7f489d742640 1 -- 172.21.15.17:0/2426326742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4898101910 msgr2=0x7f489819d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:07.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.801+0000 7f489d742640 1 --2- 172.21.15.17:0/2426326742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4898101910 0x7f489819d650 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f488800c8a0 tx=0x7f488800cd60 comp rx=0 tx=0).stop 2024-09-20T19:17:07.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.801+0000 7f489d742640 1 -- 172.21.15.17:0/2426326742 shutdown_connections 2024-09-20T19:17:07.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.801+0000 7f489d742640 1 --2- 172.21.15.17:0/2426326742 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f488007af40 0x7f488007d400 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:07.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.801+0000 7f489d742640 1 --2- 172.21.15.17:0/2426326742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4898107910 0x7f489819db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:07.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.801+0000 7f489d742640 1 --2- 172.21.15.17:0/2426326742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4898101910 0x7f489819d650 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:07.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.801+0000 7f489d742640 1 -- 172.21.15.17:0/2426326742 >> 172.21.15.17:0/2426326742 conn(0x7f48980fd610 msgr2=0x7f48980fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:07.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.801+0000 7f489d742640 1 -- 172.21.15.17:0/2426326742 shutdown_connections 2024-09-20T19:17:07.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:07.801+0000 7f489d742640 1 -- 172.21.15.17:0/2426326742 wait complete. 2024-09-20T19:17:08.351 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:08 smithi017 ceph-mon[108970]: pgmap v1254: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:08.352 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:17:08.352 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:08 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/2426326742' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-20T19:17:08.353 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-20T19:17:08.353 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-20T19:17:08.371 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 7a27d282-777d-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-20T19:17:08.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:08 smithi172 ceph-mon[80431]: pgmap v1254: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:08.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:17:08.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:08 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/2426326742' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-20T19:17:08.673 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/mon.smithi017/config 2024-09-20T19:17:09.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.161+0000 7f6bc6c4c640 1 -- 172.21.15.17:0/2664031819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc0100800 msgr2=0x7f6bc0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:09.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.161+0000 7f6bc6c4c640 1 --2- 172.21.15.17:0/2664031819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc0100800 0x7f6bc0100c60 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009880 tx=0x7f6bb002a4a0 comp rx=0 tx=0).stop 2024-09-20T19:17:09.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.161+0000 7f6bc6c4c640 1 -- 172.21.15.17:0/2664031819 shutdown_connections 2024-09-20T19:17:09.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.161+0000 7f6bc6c4c640 1 --2- 172.21.15.17:0/2664031819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc0100800 0x7f6bc0100c60 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:09.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.161+0000 7f6bc6c4c640 1 --2- 172.21.15.17:0/2664031819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc0106800 0x7f6bc0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:09.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.161+0000 7f6bc6c4c640 1 -- 172.21.15.17:0/2664031819 >> 172.21.15.17:0/2664031819 conn(0x7f6bc00fc520 msgr2=0x7f6bc00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:09.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.161+0000 7f6bc6c4c640 1 -- 172.21.15.17:0/2664031819 shutdown_connections 2024-09-20T19:17:09.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.161+0000 7f6bc6c4c640 1 -- 172.21.15.17:0/2664031819 wait complete. 2024-09-20T19:17:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.162+0000 7f6bc6c4c640 1 Processor -- start 2024-09-20T19:17:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.162+0000 7f6bc6c4c640 1 -- start start 2024-09-20T19:17:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.162+0000 7f6bc6c4c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc0100800 0x7f6bc019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.162+0000 7f6bc6c4c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc0106800 0x7f6bc019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.162+0000 7f6bc6c4c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc010dcb0 con 0x7f6bc0100800 2024-09-20T19:17:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.162+0000 7f6bc6c4c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc010db30 con 0x7f6bc0106800 2024-09-20T19:17:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.162+0000 7f6bc49e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc0100800 0x7f6bc019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.162+0000 7f6bc49e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc0100800 0x7f6bc019d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37468/0 (socket says 172.21.15.17:37468) 2024-09-20T19:17:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.162+0000 7f6bc49e8640 1 -- 172.21.15.17:0/3434332319 learned_addr learned my addr 172.21.15.17:0/3434332319 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-20T19:17:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.162+0000 7f6bb7fff640 1 --2- 172.21.15.17:0/3434332319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc0106800 0x7f6bc019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.162+0000 7f6bc49e8640 1 -- 172.21.15.17:0/3434332319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc0106800 msgr2=0x7f6bc019db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.162+0000 7f6bc49e8640 1 --2- 172.21.15.17:0/3434332319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc0106800 0x7f6bc019db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.163+0000 7f6bc49e8640 1 -- 172.21.15.17:0/3434332319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc01977a0 con 0x7f6bc0100800 2024-09-20T19:17:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.163+0000 7f6bc49e8640 1 --2- 172.21.15.17:0/3434332319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc0100800 0x7f6bc019d620 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00d8d0 tx=0x7f6bbc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:09.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.163+0000 7f6bb5ffb640 1 -- 172.21.15.17:0/3434332319 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6bbc017030 con 0x7f6bc0100800 2024-09-20T19:17:09.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.163+0000 7f6bb5ffb640 1 -- 172.21.15.17:0/3434332319 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6bbc004020 con 0x7f6bc0100800 2024-09-20T19:17:09.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.163+0000 7f6bc6c4c640 1 -- 172.21.15.17:0/3434332319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc0197a90 con 0x7f6bc0100800 2024-09-20T19:17:09.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.163+0000 7f6bb5ffb640 1 -- 172.21.15.17:0/3434332319 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6bbc0047a0 con 0x7f6bc0100800 2024-09-20T19:17:09.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.163+0000 7f6bc6c4c640 1 -- 172.21.15.17:0/3434332319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc0197ff0 con 0x7f6bc0100800 2024-09-20T19:17:09.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.164+0000 7f6bc6c4c640 1 -- 172.21.15.17:0/3434332319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc0101f40 con 0x7f6bc0100800 2024-09-20T19:17:09.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.165+0000 7f6bb5ffb640 1 -- 172.21.15.17:0/3434332319 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6bbc0041d0 con 0x7f6bc0100800 2024-09-20T19:17:09.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.165+0000 7f6bb5ffb640 1 --2- 172.21.15.17:0/3434332319 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ba807af40 0x7f6ba807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-20T19:17:09.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.165+0000 7f6bb5ffb640 1 -- 172.21.15.17:0/3434332319 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6156+0+0 (secure 0 0 0) 0x7f6bbc018070 con 0x7f6bc0100800 2024-09-20T19:17:09.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.165+0000 7f6bb7fff640 1 --2- 172.21.15.17:0/3434332319 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ba807af40 0x7f6ba807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-20T19:17:09.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.166+0000 7f6bb7fff640 1 --2- 172.21.15.17:0/3434332319 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ba807af40 0x7f6ba807d400 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0198af0 tx=0x7f6bb00095c0 comp rx=0 tx=0).ready entity=mgr.14754 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-20T19:17:09.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.170+0000 7f6bb5ffb640 1 -- 172.21.15.17:0/3434332319 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6bbc069420 con 0x7f6bc0100800 2024-09-20T19:17:09.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.371+0000 7f6bc6c4c640 1 -- 172.21.15.17:0/3434332319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6bc0109da0 con 0x7f6bc0100800 2024-09-20T19:17:09.373 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:09 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:17:09.374 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:09 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:17:09.374 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:09 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:17:09.374 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:09 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:17:09.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.372+0000 7f6bb5ffb640 1 -- 172.21.15.17:0/3434332319 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 31 entries v80) ==== 81+0+1839 (secure 0 0 0) 0x7f6bbc06e2d0 con 0x7f6bc0100800 2024-09-20T19:17:09.374 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.172:6824/1043027893 2024-09-21T18:43:54.970945+0000 2024-09-20T19:17:09.374 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3393805637 2024-09-21T18:26:38.662388+0000 2024-09-20T19:17:09.374 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/513066305 2024-09-21T18:26:38.662388+0000 2024-09-20T19:17:09.375 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/513066305 2024-09-21T18:26:38.662388+0000 2024-09-20T19:17:09.375 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2241274877 2024-09-21T18:34:56.617264+0000 2024-09-20T19:17:09.375 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/3940118846 2024-09-21T18:27:10.529430+0000 2024-09-20T19:17:09.375 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3160589064 2024-09-21T18:26:38.662388+0000 2024-09-20T19:17:09.375 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/3940118846 2024-09-21T18:27:10.529430+0000 2024-09-20T19:17:09.375 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2934627597 2024-09-21T18:27:10.529430+0000 2024-09-20T19:17:09.375 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/4095439401 2024-09-21T18:28:07.480593+0000 2024-09-20T19:17:09.375 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/29863517 2024-09-21T18:28:07.480593+0000 2024-09-20T19:17:09.375 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2816923133 2024-09-21T18:27:10.529430+0000 2024-09-20T19:17:09.375 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/29863517 2024-09-21T18:28:07.480593+0000 2024-09-20T19:17:09.375 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.172:6825/1043027893 2024-09-21T18:43:54.970945+0000 2024-09-20T19:17:09.375 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.172:6829/3016443347 2024-09-21T18:36:36.235339+0000 2024-09-20T19:17:09.375 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.172:0/3897907720 2024-09-21T18:36:36.235339+0000 2024-09-20T19:17:09.375 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/652312164 2024-09-21T18:26:38.662388+0000 2024-09-20T19:17:09.375 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/352736886 2024-09-21T18:28:07.480593+0000 2024-09-20T19:17:09.376 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.172:0/1714707464 2024-09-21T18:36:36.235339+0000 2024-09-20T19:17:09.376 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2443650242 2024-09-21T18:28:07.480593+0000 2024-09-20T19:17:09.376 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3027447183 2024-09-21T18:34:56.617264+0000 2024-09-20T19:17:09.376 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.172:0/3383207955 2024-09-21T18:36:36.235339+0000 2024-09-20T19:17:09.376 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1352836007 2024-09-21T18:34:56.617264+0000 2024-09-20T19:17:09.376 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.172:0/1015347889 2024-09-21T18:36:36.235339+0000 2024-09-20T19:17:09.376 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/2021461456 2024-09-21T18:34:56.617264+0000 2024-09-20T19:17:09.376 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/384622812 2024-09-21T18:34:56.617264+0000 2024-09-20T19:17:09.376 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/2021461456 2024-09-21T18:34:56.617264+0000 2024-09-20T19:17:09.376 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.172:6828/3016443347 2024-09-21T18:36:36.235339+0000 2024-09-20T19:17:09.376 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3207433207 2024-09-21T18:27:10.529430+0000 2024-09-20T19:17:09.376 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6826/3360305779 2024-09-21T18:43:54.970933+0000 2024-09-20T19:17:09.376 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6827/3360305779 2024-09-21T18:43:54.970933+0000 2024-09-20T19:17:09.377 INFO:teuthology.orchestra.run.smithi017.stderr:listed 31 entries 2024-09-20T19:17:09.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.374+0000 7f6bc6c4c640 1 -- 172.21.15.17:0/3434332319 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ba807af40 msgr2=0x7f6ba807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:09.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.374+0000 7f6bc6c4c640 1 --2- 172.21.15.17:0/3434332319 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ba807af40 0x7f6ba807d400 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0198af0 tx=0x7f6bb00095c0 comp rx=0 tx=0).stop 2024-09-20T19:17:09.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.374+0000 7f6bc6c4c640 1 -- 172.21.15.17:0/3434332319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc0100800 msgr2=0x7f6bc019d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-20T19:17:09.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.374+0000 7f6bc6c4c640 1 --2- 172.21.15.17:0/3434332319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc0100800 0x7f6bc019d620 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00d8d0 tx=0x7f6bbc00dd90 comp rx=0 tx=0).stop 2024-09-20T19:17:09.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.374+0000 7f6bc6c4c640 1 -- 172.21.15.17:0/3434332319 shutdown_connections 2024-09-20T19:17:09.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.374+0000 7f6bc6c4c640 1 --2- 172.21.15.17:0/3434332319 >> [v2:172.21.15.17:6800/1838370206,v1:172.21.15.17:6801/1838370206] conn(0x7f6ba807af40 0x7f6ba807d400 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:09.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.374+0000 7f6bc6c4c640 1 --2- 172.21.15.17:0/3434332319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc0106800 0x7f6bc019db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:09.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.375+0000 7f6bc6c4c640 1 --2- 172.21.15.17:0/3434332319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc0100800 0x7f6bc019d620 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-20T19:17:09.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.375+0000 7f6bc6c4c640 1 -- 172.21.15.17:0/3434332319 >> 172.21.15.17:0/3434332319 conn(0x7f6bc00fc520 msgr2=0x7f6bc006a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-20T19:17:09.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.375+0000 7f6bc6c4c640 1 -- 172.21.15.17:0/3434332319 shutdown_connections 2024-09-20T19:17:09.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-20T19:17:09.375+0000 7f6bc6c4c640 1 -- 172.21.15.17:0/3434332319 wait complete. 2024-09-20T19:17:09.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:09 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:17:09.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:09 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:17:09.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:09 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:17:09.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:09 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:17:09.929 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-20T19:17:09.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-20T19:17:09.929 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-20T19:17:09.958 INFO:teuthology.orchestra.run:waiting for 300 2024-09-20T19:17:10.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:10 smithi017 ceph-mon[108970]: pgmap v1255: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:10.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:10 smithi017 ceph-mon[108970]: from='client.? 172.21.15.17:0/3434332319' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-20T19:17:10.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:10 smithi172 ceph-mon[80431]: pgmap v1255: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:10.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:10 smithi172 ceph-mon[80431]: from='client.? 172.21.15.17:0/3434332319' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-20T19:17:12.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:12 smithi017 ceph-mon[108970]: pgmap v1256: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:12.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:12 smithi172 ceph-mon[80431]: pgmap v1256: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:14.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:14 smithi017 ceph-mon[108970]: pgmap v1257: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:14.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:14 smithi172 ceph-mon[80431]: pgmap v1257: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:16.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:16 smithi017 ceph-mon[108970]: pgmap v1258: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:17:16.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:16 smithi172 ceph-mon[80431]: pgmap v1258: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:17:18.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:18 smithi017 ceph-mon[108970]: pgmap v1259: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:18.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:18 smithi172 ceph-mon[80431]: pgmap v1259: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:20.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:20 smithi017 ceph-mon[108970]: pgmap v1260: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:20.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:20 smithi172 ceph-mon[80431]: pgmap v1260: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:22.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:22 smithi017 ceph-mon[108970]: pgmap v1261: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:22.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:17:22.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:22 smithi172 ceph-mon[80431]: pgmap v1261: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:22.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:17:24.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:24 smithi017 ceph-mon[108970]: pgmap v1262: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:24.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:24 smithi172 ceph-mon[80431]: pgmap v1262: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:26.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:26 smithi017 ceph-mon[108970]: pgmap v1263: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:17:26.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:26 smithi172 ceph-mon[80431]: pgmap v1263: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:17:28.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:28 smithi017 ceph-mon[108970]: pgmap v1264: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:28.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:28 smithi172 ceph-mon[80431]: pgmap v1264: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:29.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:29 smithi017 ceph-mon[108970]: pgmap v1265: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:29.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:29 smithi172 ceph-mon[80431]: pgmap v1265: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:32.195 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:31 smithi172 ceph-mon[80431]: pgmap v1266: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:32.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:31 smithi017 ceph-mon[108970]: pgmap v1266: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:34.195 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:33 smithi172 ceph-mon[80431]: pgmap v1267: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:34.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:33 smithi017 ceph-mon[108970]: pgmap v1267: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:36.136 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:35 smithi017 ceph-mon[108970]: pgmap v1268: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:17:36.195 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:35 smithi172 ceph-mon[80431]: pgmap v1268: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:17:38.181 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:37 smithi017 ceph-mon[108970]: pgmap v1269: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:38.181 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:17:38.195 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:37 smithi172 ceph-mon[80431]: pgmap v1269: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:38.195 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:17:40.195 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:39 smithi172 ceph-mon[80431]: pgmap v1270: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:40.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:39 smithi017 ceph-mon[108970]: pgmap v1270: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:42.195 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:41 smithi172 ceph-mon[80431]: pgmap v1271: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:42.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:41 smithi017 ceph-mon[108970]: pgmap v1271: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:44.195 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:43 smithi172 ceph-mon[80431]: pgmap v1272: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:44.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:43 smithi017 ceph-mon[108970]: pgmap v1272: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:46.136 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:45 smithi017 ceph-mon[108970]: pgmap v1273: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:17:46.195 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:45 smithi172 ceph-mon[80431]: pgmap v1273: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:17:48.195 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:47 smithi172 ceph-mon[80431]: pgmap v1274: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:48.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:47 smithi017 ceph-mon[108970]: pgmap v1274: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:50.195 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:49 smithi172 ceph-mon[80431]: pgmap v1275: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:50.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:49 smithi017 ceph-mon[108970]: pgmap v1275: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:52.195 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:51 smithi172 ceph-mon[80431]: pgmap v1276: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:52.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:51 smithi017 ceph-mon[108970]: pgmap v1276: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:53.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:17:53.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:17:54.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:53 smithi172 ceph-mon[80431]: pgmap v1277: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:54.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:53 smithi017 ceph-mon[108970]: pgmap v1277: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:56.361 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:55 smithi172 ceph-mon[80431]: pgmap v1278: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:17:56.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:55 smithi017 ceph-mon[108970]: pgmap v1278: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:17:58.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:57 smithi017 ceph-mon[108970]: pgmap v1279: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:17:58.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:57 smithi172 ceph-mon[80431]: pgmap v1279: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:00.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:17:59 smithi017 ceph-mon[108970]: pgmap v1280: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:00.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:17:59 smithi172 ceph-mon[80431]: pgmap v1280: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:02.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:01 smithi017 ceph-mon[108970]: pgmap v1281: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:02.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:01 smithi172 ceph-mon[80431]: pgmap v1281: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:04.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:03 smithi017 ceph-mon[108970]: pgmap v1282: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:04.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:03 smithi172 ceph-mon[80431]: pgmap v1282: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:06.249 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:05 smithi017 ceph-mon[108970]: pgmap v1283: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:18:06.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:05 smithi172 ceph-mon[80431]: pgmap v1283: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:18:08.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:07 smithi017 ceph-mon[108970]: pgmap v1284: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:08.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:18:08.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:07 smithi172 ceph-mon[80431]: pgmap v1284: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:08.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:18:10.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:09 smithi017 ceph-mon[108970]: pgmap v1285: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:10.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:09 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:18:10.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:09 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:18:10.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:09 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:18:10.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:09 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:18:10.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:09 smithi172 ceph-mon[80431]: pgmap v1285: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:10.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:09 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:18:10.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:09 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:18:10.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:09 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:18:10.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:09 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:18:12.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:11 smithi017 ceph-mon[108970]: pgmap v1286: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:12.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:11 smithi172 ceph-mon[80431]: pgmap v1286: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:14.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:13 smithi017 ceph-mon[108970]: pgmap v1287: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:14.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:13 smithi172 ceph-mon[80431]: pgmap v1287: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:16.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:15 smithi017 ceph-mon[108970]: pgmap v1288: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:18:16.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:15 smithi172 ceph-mon[80431]: pgmap v1288: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:18:18.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:17 smithi017 ceph-mon[108970]: pgmap v1289: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:18.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:17 smithi172 ceph-mon[80431]: pgmap v1289: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:20.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:19 smithi017 ceph-mon[108970]: pgmap v1290: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:20.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:19 smithi172 ceph-mon[80431]: pgmap v1290: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:22.195 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:21 smithi172 ceph-mon[80431]: pgmap v1291: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:22.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:21 smithi017 ceph-mon[108970]: pgmap v1291: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:23.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:23 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:18:23.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:23 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:18:24.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:24 smithi172 ceph-mon[80431]: pgmap v1292: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:24.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:24 smithi017 ceph-mon[108970]: pgmap v1292: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:26.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:26 smithi017 ceph-mon[108970]: pgmap v1293: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:18:26.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:26 smithi172 ceph-mon[80431]: pgmap v1293: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:18:28.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:28 smithi017 ceph-mon[108970]: pgmap v1294: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:28.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:28 smithi172 ceph-mon[80431]: pgmap v1294: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:30.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:30 smithi017 ceph-mon[108970]: pgmap v1295: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:30.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:30 smithi172 ceph-mon[80431]: pgmap v1295: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:32.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:32 smithi017 ceph-mon[108970]: pgmap v1296: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:32.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:32 smithi172 ceph-mon[80431]: pgmap v1296: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:34.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:34 smithi017 ceph-mon[108970]: pgmap v1297: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:34.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:34 smithi172 ceph-mon[80431]: pgmap v1297: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:36.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:36 smithi017 ceph-mon[108970]: pgmap v1298: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:18:36.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:36 smithi172 ceph-mon[80431]: pgmap v1298: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:18:38.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:38 smithi017 ceph-mon[108970]: pgmap v1299: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:38.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:38 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:18:38.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:38 smithi172 ceph-mon[80431]: pgmap v1299: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:38.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:38 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:18:40.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:40 smithi017 ceph-mon[108970]: pgmap v1300: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:40.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:40 smithi172 ceph-mon[80431]: pgmap v1300: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:42.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:42 smithi017 ceph-mon[108970]: pgmap v1301: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:42.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:42 smithi172 ceph-mon[80431]: pgmap v1301: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:44.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:44 smithi017 ceph-mon[108970]: pgmap v1302: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:44.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:44 smithi172 ceph-mon[80431]: pgmap v1302: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:46.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:46 smithi017 ceph-mon[108970]: pgmap v1303: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:18:46.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:46 smithi172 ceph-mon[80431]: pgmap v1303: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:18:48.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:48 smithi017 ceph-mon[108970]: pgmap v1304: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:48.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:48 smithi172 ceph-mon[80431]: pgmap v1304: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:50.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:50 smithi017 ceph-mon[108970]: pgmap v1305: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:50.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:50 smithi172 ceph-mon[80431]: pgmap v1305: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:52.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:52 smithi172 ceph-mon[80431]: pgmap v1306: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:52.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:52 smithi017 ceph-mon[108970]: pgmap v1306: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:53.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:53 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:18:53.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:53 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:18:54.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:54 smithi172 ceph-mon[80431]: pgmap v1307: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:54.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:54 smithi017 ceph-mon[108970]: pgmap v1307: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:56.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:56 smithi017 ceph-mon[108970]: pgmap v1308: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:18:56.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:56 smithi172 ceph-mon[80431]: pgmap v1308: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:18:58.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:18:58 smithi017 ceph-mon[108970]: pgmap v1309: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:18:58.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:18:58 smithi172 ceph-mon[80431]: pgmap v1309: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:00.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:00 smithi017 ceph-mon[108970]: pgmap v1310: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:00.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:00 smithi172 ceph-mon[80431]: pgmap v1310: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:02.297 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:02 smithi017 ceph-mon[108970]: pgmap v1311: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:02.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:02 smithi172 ceph-mon[80431]: pgmap v1311: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:04.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:04 smithi017 ceph-mon[108970]: pgmap v1312: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:04.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:04 smithi172 ceph-mon[80431]: pgmap v1312: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:06.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:06 smithi017 ceph-mon[108970]: pgmap v1313: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:19:06.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:06 smithi172 ceph-mon[80431]: pgmap v1313: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:19:08.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:08 smithi017 ceph-mon[108970]: pgmap v1314: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:08.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:19:08.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:08 smithi172 ceph-mon[80431]: pgmap v1314: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:08.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:19:10.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:10 smithi017 ceph-mon[108970]: pgmap v1315: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:10.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:10 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:19:10.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:10 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:19:10.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:10 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:19:10.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:10 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:19:10.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:10 smithi172 ceph-mon[80431]: pgmap v1315: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:10.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:10 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:19:10.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:10 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:19:10.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:10 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:19:10.446 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:10 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:19:12.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:12 smithi017 ceph-mon[108970]: pgmap v1316: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:12.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:12 smithi172 ceph-mon[80431]: pgmap v1316: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:14.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:14 smithi017 ceph-mon[108970]: pgmap v1317: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:14.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:14 smithi172 ceph-mon[80431]: pgmap v1317: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:16.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:16 smithi017 ceph-mon[108970]: pgmap v1318: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:19:16.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:16 smithi172 ceph-mon[80431]: pgmap v1318: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:19:18.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:18 smithi017 ceph-mon[108970]: pgmap v1319: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:18.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:18 smithi172 ceph-mon[80431]: pgmap v1319: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:20.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:20 smithi017 ceph-mon[108970]: pgmap v1320: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:20.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:20 smithi172 ceph-mon[80431]: pgmap v1320: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:22.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:22 smithi017 ceph-mon[108970]: pgmap v1321: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:22.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:22 smithi172 ceph-mon[80431]: pgmap v1321: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:23.195 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:23 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:19:23.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:23 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:19:24.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:24 smithi017 ceph-mon[108970]: pgmap v1322: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:24.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:24 smithi172 ceph-mon[80431]: pgmap v1322: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:26.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:26 smithi017 ceph-mon[108970]: pgmap v1323: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:19:26.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:26 smithi172 ceph-mon[80431]: pgmap v1323: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:19:28.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:28 smithi017 ceph-mon[108970]: pgmap v1324: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:28.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:28 smithi172 ceph-mon[80431]: pgmap v1324: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:30.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:30 smithi017 ceph-mon[108970]: pgmap v1325: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:30.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:30 smithi172 ceph-mon[80431]: pgmap v1325: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:32.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:32 smithi017 ceph-mon[108970]: pgmap v1326: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:32.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:32 smithi172 ceph-mon[80431]: pgmap v1326: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:34.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:34 smithi017 ceph-mon[108970]: pgmap v1327: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:34.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:34 smithi172 ceph-mon[80431]: pgmap v1327: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:36.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:36 smithi017 ceph-mon[108970]: pgmap v1328: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:19:36.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:36 smithi172 ceph-mon[80431]: pgmap v1328: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:19:37.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:19:37.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:19:38.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:38 smithi017 ceph-mon[108970]: pgmap v1329: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:38.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:38 smithi172 ceph-mon[80431]: pgmap v1329: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:40.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:40 smithi017 ceph-mon[108970]: pgmap v1330: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:40.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:40 smithi172 ceph-mon[80431]: pgmap v1330: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:42.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:42 smithi017 ceph-mon[108970]: pgmap v1331: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:42.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:42 smithi172 ceph-mon[80431]: pgmap v1331: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:44.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:44 smithi017 ceph-mon[108970]: pgmap v1332: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:44.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:44 smithi172 ceph-mon[80431]: pgmap v1332: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:46.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:46 smithi172 ceph-mon[80431]: pgmap v1333: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:19:46.572 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:46 smithi017 ceph-mon[108970]: pgmap v1333: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:19:48.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:48 smithi172 ceph-mon[80431]: pgmap v1334: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:19:48.636 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:48 smithi017 ceph-mon[108970]: pgmap v1334: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:19:50.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:50 smithi172 ceph-mon[80431]: pgmap v1335: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:50.636 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:50 smithi017 ceph-mon[108970]: pgmap v1335: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:52.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:52 smithi017 ceph-mon[108970]: pgmap v1336: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:52.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:19:52.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:52 smithi172 ceph-mon[80431]: pgmap v1336: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:52.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:19:53.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:53 smithi172 ceph-mon[80431]: pgmap v1337: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:53.636 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:53 smithi017 ceph-mon[108970]: pgmap v1337: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:19:56.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:55 smithi017 ceph-mon[108970]: pgmap v1338: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:19:56.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:55 smithi172 ceph-mon[80431]: pgmap v1338: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:19:58.342 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:57 smithi017 ceph-mon[108970]: pgmap v1339: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:19:58.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:57 smithi172 ceph-mon[80431]: pgmap v1339: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:20:00.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:19:59 smithi017 ceph-mon[108970]: pgmap v1340: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:00.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:19:59 smithi172 ceph-mon[80431]: pgmap v1340: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:01.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:00 smithi017 ceph-mon[108970]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:20:01.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:00 smithi017 ceph-mon[108970]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:20:01.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:00 smithi017 ceph-mon[108970]: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:20:01.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:00 smithi172 ceph-mon[80431]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-20T19:20:01.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:00 smithi172 ceph-mon[80431]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-20T19:20:01.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:00 smithi172 ceph-mon[80431]: fs cephfs has deprecated feature inline_data enabled. 2024-09-20T19:20:02.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:01 smithi017 ceph-mon[108970]: pgmap v1341: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:02.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:01 smithi172 ceph-mon[80431]: pgmap v1341: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:04.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:03 smithi017 ceph-mon[108970]: pgmap v1342: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:04.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:03 smithi172 ceph-mon[80431]: pgmap v1342: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:06.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:05 smithi017 ceph-mon[108970]: pgmap v1343: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:20:06.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:05 smithi172 ceph-mon[80431]: pgmap v1343: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:20:08.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:07 smithi017 ceph-mon[108970]: pgmap v1344: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:20:08.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:20:08.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:07 smithi172 ceph-mon[80431]: pgmap v1344: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:20:08.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:20:10.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:09 smithi017 ceph-mon[108970]: pgmap v1345: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:10.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:09 smithi172 ceph-mon[80431]: pgmap v1345: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:11.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:10 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:20:11.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:10 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:20:11.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:10 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:20:11.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:10 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:20:11.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:10 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:20:11.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:10 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:20:11.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:10 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:20:11.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:10 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:20:12.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:11 smithi017 ceph-mon[108970]: pgmap v1346: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:12.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:11 smithi172 ceph-mon[80431]: pgmap v1346: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:14.198 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:13 smithi172 ceph-mon[80431]: pgmap v1347: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:14.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:13 smithi017 ceph-mon[108970]: pgmap v1347: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:16.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:15 smithi017 ceph-mon[108970]: pgmap v1348: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:20:16.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:15 smithi172 ceph-mon[80431]: pgmap v1348: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:20:18.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:17 smithi017 ceph-mon[108970]: pgmap v1349: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:20:18.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:17 smithi172 ceph-mon[80431]: pgmap v1349: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:20:20.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:19 smithi017 ceph-mon[108970]: pgmap v1350: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T19:20:20.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:19 smithi172 ceph-mon[80431]: pgmap v1350: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T19:20:22.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:21 smithi017 ceph-mon[108970]: pgmap v1351: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T19:20:22.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:21 smithi172 ceph-mon[80431]: pgmap v1351: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T19:20:23.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:22 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:20:23.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:22 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:20:24.136 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:23 smithi017 ceph-mon[108970]: pgmap v1352: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T19:20:24.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:23 smithi172 ceph-mon[80431]: pgmap v1352: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T19:20:26.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:25 smithi017 ceph-mon[108970]: pgmap v1353: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T19:20:26.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:26 smithi172 ceph-mon[80431]: pgmap v1353: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T19:20:28.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:28 smithi017 ceph-mon[108970]: pgmap v1354: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-20T19:20:28.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:28 smithi172 ceph-mon[80431]: pgmap v1354: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-20T19:20:30.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:30 smithi017 ceph-mon[108970]: pgmap v1355: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T19:20:30.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:30 smithi172 ceph-mon[80431]: pgmap v1355: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-20T19:20:32.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:32 smithi017 ceph-mon[108970]: pgmap v1356: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:32.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:32 smithi172 ceph-mon[80431]: pgmap v1356: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:33.636 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:33 smithi017 ceph-mon[108970]: pgmap v1357: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:33.695 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:33 smithi172 ceph-mon[80431]: pgmap v1357: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:36.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:35 smithi017 ceph-mon[108970]: pgmap v1358: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:20:36.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:35 smithi172 ceph-mon[80431]: pgmap v1358: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:20:38.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:37 smithi017 ceph-mon[108970]: pgmap v1359: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:20:38.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:37 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:20:38.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:37 smithi172 ceph-mon[80431]: pgmap v1359: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:20:38.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:37 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:20:40.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:39 smithi017 ceph-mon[108970]: pgmap v1360: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:40.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:39 smithi172 ceph-mon[80431]: pgmap v1360: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:42.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:41 smithi017 ceph-mon[108970]: pgmap v1361: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:42.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:41 smithi172 ceph-mon[80431]: pgmap v1361: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:44.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:43 smithi017 ceph-mon[108970]: pgmap v1362: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:44.407 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:43 smithi172 ceph-mon[80431]: pgmap v1362: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:46.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:45 smithi017 ceph-mon[108970]: pgmap v1363: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:20:46.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:45 smithi172 ceph-mon[80431]: pgmap v1363: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:20:48.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:47 smithi017 ceph-mon[108970]: pgmap v1364: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:20:48.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:47 smithi172 ceph-mon[80431]: pgmap v1364: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:20:50.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:49 smithi017 ceph-mon[108970]: pgmap v1365: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:50.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:49 smithi172 ceph-mon[80431]: pgmap v1365: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:52.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:51 smithi017 ceph-mon[108970]: pgmap v1366: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:52.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:51 smithi172 ceph-mon[80431]: pgmap v1366: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:53.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:52 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:20:53.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:52 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:20:54.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:53 smithi017 ceph-mon[108970]: pgmap v1367: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:54.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:53 smithi172 ceph-mon[80431]: pgmap v1367: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:20:56.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:55 smithi017 ceph-mon[108970]: pgmap v1368: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:20:56.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:55 smithi172 ceph-mon[80431]: pgmap v1368: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:20:58.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:57 smithi017 ceph-mon[108970]: pgmap v1369: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:20:58.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:57 smithi172 ceph-mon[80431]: pgmap v1369: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:21:00.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:20:59 smithi017 ceph-mon[108970]: pgmap v1370: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:00.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:20:59 smithi172 ceph-mon[80431]: pgmap v1370: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:02.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:02 smithi017 ceph-mon[108970]: pgmap v1371: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:02.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:02 smithi172 ceph-mon[80431]: pgmap v1371: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:04.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:04 smithi017 ceph-mon[108970]: pgmap v1372: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:04.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:04 smithi172 ceph-mon[80431]: pgmap v1372: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:06.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:06 smithi017 ceph-mon[108970]: pgmap v1373: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:21:06.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:06 smithi172 ceph-mon[80431]: pgmap v1373: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:21:08.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:08 smithi017 ceph-mon[108970]: pgmap v1374: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:21:08.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:08 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:21:08.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:08 smithi172 ceph-mon[80431]: pgmap v1374: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:21:08.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:08 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:21:10.195 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:10 smithi172 ceph-mon[80431]: pgmap v1375: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:10.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:10 smithi017 ceph-mon[108970]: pgmap v1375: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:11.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:21:11.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:21:11.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:21:11.387 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:11 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:21:11.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-20T19:21:11.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-20T19:21:11.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-20T19:21:11.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:11 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' 2024-09-20T19:21:12.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:12 smithi017 ceph-mon[108970]: pgmap v1376: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:12.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:12 smithi172 ceph-mon[80431]: pgmap v1376: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:14.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:14 smithi017 ceph-mon[108970]: pgmap v1377: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:14.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:14 smithi172 ceph-mon[80431]: pgmap v1377: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:16.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:16 smithi017 ceph-mon[108970]: pgmap v1378: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:21:16.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:16 smithi172 ceph-mon[80431]: pgmap v1378: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:21:18.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:18 smithi017 ceph-mon[108970]: pgmap v1379: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:21:18.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:18 smithi172 ceph-mon[80431]: pgmap v1379: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:21:20.135 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:20 smithi017 ceph-mon[108970]: pgmap v1380: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:20.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:20 smithi172 ceph-mon[80431]: pgmap v1380: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:22.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:22 smithi017 ceph-mon[108970]: pgmap v1381: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:22.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:22 smithi172 ceph-mon[80431]: pgmap v1381: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:23.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:23 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:21:23.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:23 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:21:24.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:24 smithi017 ceph-mon[108970]: pgmap v1382: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:24.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:24 smithi172 ceph-mon[80431]: pgmap v1382: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:26.346 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:26 smithi172 ceph-mon[80431]: pgmap v1383: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:21:26.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:26 smithi017 ceph-mon[108970]: pgmap v1383: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:21:28.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:28 smithi017 ceph-mon[108970]: pgmap v1384: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:21:28.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:28 smithi172 ceph-mon[80431]: pgmap v1384: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:21:30.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:30 smithi017 ceph-mon[108970]: pgmap v1385: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:30.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:30 smithi172 ceph-mon[80431]: pgmap v1385: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:32.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:32 smithi017 ceph-mon[108970]: pgmap v1386: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:32.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:32 smithi172 ceph-mon[80431]: pgmap v1386: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:34.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:34 smithi017 ceph-mon[108970]: pgmap v1387: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:34.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:34 smithi172 ceph-mon[80431]: pgmap v1387: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:36.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:36 smithi017 ceph-mon[108970]: pgmap v1388: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:21:36.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:36 smithi172 ceph-mon[80431]: pgmap v1388: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:21:38.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:38 smithi017 ceph-mon[108970]: pgmap v1389: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:21:38.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:38 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:21:38.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:38 smithi172 ceph-mon[80431]: pgmap v1389: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:21:38.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:38 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:21:40.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:40 smithi017 ceph-mon[108970]: pgmap v1390: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:40.427 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:40 smithi172 ceph-mon[80431]: pgmap v1390: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:42.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:42 smithi017 ceph-mon[108970]: pgmap v1391: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:42.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:42 smithi172 ceph-mon[80431]: pgmap v1391: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:44.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:44 smithi017 ceph-mon[108970]: pgmap v1392: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:44.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:44 smithi172 ceph-mon[80431]: pgmap v1392: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:46.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:46 smithi017 ceph-mon[108970]: pgmap v1393: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:21:46.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:46 smithi172 ceph-mon[80431]: pgmap v1393: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:21:48.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:48 smithi017 ceph-mon[108970]: pgmap v1394: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:21:48.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:48 smithi172 ceph-mon[80431]: pgmap v1394: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:21:50.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:50 smithi017 ceph-mon[108970]: pgmap v1395: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:50.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:50 smithi172 ceph-mon[80431]: pgmap v1395: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:52.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:52 smithi017 ceph-mon[108970]: pgmap v1396: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:52.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:52 smithi172 ceph-mon[80431]: pgmap v1396: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:53.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:53 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:21:53.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:53 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:21:54.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:54 smithi017 ceph-mon[108970]: pgmap v1397: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:54.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:54 smithi172 ceph-mon[80431]: pgmap v1397: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:21:56.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:56 smithi017 ceph-mon[108970]: pgmap v1398: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:21:56.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:56 smithi172 ceph-mon[80431]: pgmap v1398: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:21:58.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:21:58 smithi017 ceph-mon[108970]: pgmap v1399: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:21:58.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:21:58 smithi172 ceph-mon[80431]: pgmap v1399: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:22:00.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:22:00 smithi017 ceph-mon[108970]: pgmap v1400: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:22:00.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:22:00 smithi172 ceph-mon[80431]: pgmap v1400: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:22:02.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:22:02 smithi017 ceph-mon[108970]: pgmap v1401: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:22:02.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:22:02 smithi172 ceph-mon[80431]: pgmap v1401: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:22:04.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:22:04 smithi017 ceph-mon[108970]: pgmap v1402: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:22:04.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:22:04 smithi172 ceph-mon[80431]: pgmap v1402: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-20T19:22:06.195 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:22:06 smithi172 ceph-mon[80431]: pgmap v1403: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:22:06.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:22:06 smithi017 ceph-mon[108970]: pgmap v1403: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-20T19:22:07.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:22:07 smithi017 ceph-mon[108970]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:22:07.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:22:07 smithi172 ceph-mon[80431]: from='mgr.14754 172.21.15.17:0/3061063952' entity='mgr.smithi017.xusjwd' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-20T19:22:08.385 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:22:08 smithi017 ceph-mon[108970]: pgmap v1404: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:22:08.445 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:22:08 smithi172 ceph-mon[80431]: pgmap v1404: 65 pgs: 65 active+clean; 245 MiB data, 954 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-20T19:22:09.031 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-20T19:22:09.032 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-20T19:22:09.033 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-20T19:22:09.051 INFO:tasks.cephadm:Teardown begin 2024-09-20T19:22:09.051 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/cephadm.py", line 2374, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-20T19:22:09.053 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-20T19:22:09.088 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-20T19:22:09.123 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-20T19:22:09.123 DEBUG:teuthology.orchestra.run.smithi017:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-20T19:22:09.147 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-20T19:22:09.182 INFO:tasks.cephadm:Stopping all daemons... 2024-09-20T19:22:09.182 INFO:tasks.cephadm.mon.smithi017:Stopping mon.smithi017... 2024-09-20T19:22:09.182 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-7a27d282-777d-11ef-baf5-efdc52797490@mon.smithi017 2024-09-20T19:22:09.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:22:09 smithi017 systemd[1]: Stopping Ceph mon.smithi017 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T19:22:09.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:22:09 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T19:22:09.500+0000 7fd081215640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi017 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:22:09.886 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:22:09 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017[108966]: 2024-09-20T19:22:09.500+0000 7fd081215640 -1 mon.smithi017@0(leader) e2 *** Got Signal Terminated *** 2024-09-20T19:22:09.886 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:22:09 smithi017 podman[159539]: 2024-09-20 19:22:09.664851645 +0000 UTC m=+0.273479348 container died 27c3175c63570ca1308ace62eb1ddbb526742e40080f44340943727d5ac5ac1f (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-09-20T19:22:10.558 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:22:10 smithi017 podman[159539]: 2024-09-20 19:22:10.251411419 +0000 UTC m=+0.860039163 container cleanup 27c3175c63570ca1308ace62eb1ddbb526742e40080f44340943727d5ac5ac1f (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux ) 2024-09-20T19:22:10.559 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:22:10 smithi017 bash[159539]: ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017 2024-09-20T19:22:10.559 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Sep 20 19:22:10 smithi017 podman[159554]: 2024-09-20 19:22:10.478161274 +0000 UTC m=+0.806672463 container remove 27c3175c63570ca1308ace62eb1ddbb526742e40080f44340943727d5ac5ac1f (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi017, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-20T19:22:10.630 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7a27d282-777d-11ef-baf5-efdc52797490@mon.smithi017.service' 2024-09-20T19:22:10.674 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T19:22:10.674 INFO:tasks.cephadm.mon.smithi017:Stopped mon.smithi017 2024-09-20T19:22:10.674 INFO:tasks.cephadm.mon.smithi172:Stopping mon.smithi172... 2024-09-20T19:22:10.674 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-7a27d282-777d-11ef-baf5-efdc52797490@mon.smithi172 2024-09-20T19:22:10.980 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:22:10 smithi172 systemd[1]: Stopping Ceph mon.smithi172 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T19:22:11.358 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:22:11 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi172[80427]: 2024-09-20T19:22:11.007+0000 7f8367edc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi172 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:22:11.358 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:22:11 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi172[80427]: 2024-09-20T19:22:11.007+0000 7f8367edc640 -1 mon.smithi172@1(peon) e2 *** Got Signal Terminated *** 2024-09-20T19:22:11.358 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:22:11 smithi172 podman[113653]: 2024-09-20 19:22:11.07918848 +0000 UTC m=+0.204228664 container died 4be383715faa51bf34c490a931c31af9fd43681044cd95f26a6e0a6dd98e4ce6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi172, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T19:22:11.695 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:22:11 smithi172 podman[113653]: 2024-09-20 19:22:11.558568177 +0000 UTC m=+0.683608350 container cleanup 4be383715faa51bf34c490a931c31af9fd43681044cd95f26a6e0a6dd98e4ce6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi172, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-20T19:22:11.695 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Sep 20 19:22:11 smithi172 bash[113653]: ceph-7a27d282-777d-11ef-baf5-efdc52797490-mon-smithi172 2024-09-20T19:22:11.992 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7a27d282-777d-11ef-baf5-efdc52797490@mon.smithi172.service' 2024-09-20T19:22:12.040 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T19:22:12.040 INFO:tasks.cephadm.mon.smithi172:Stopped mon.smithi172 2024-09-20T19:22:12.040 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-20T19:22:12.040 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.0 2024-09-20T19:22:12.385 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 19:22:12 smithi017 systemd[1]: Stopping Ceph osd.0 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T19:22:12.885 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 19:22:12 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0[117206]: 2024-09-20T19:22:12.472+0000 7f9bd433e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:22:12.886 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 19:22:12 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0[117206]: 2024-09-20T19:22:12.472+0000 7f9bd433e640 -1 osd.0 80 *** Got signal Terminated *** 2024-09-20T19:22:12.886 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 19:22:12 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0[117206]: 2024-09-20T19:22:12.472+0000 7f9bd433e640 -1 osd.0 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:22:18.307 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 19:22:18 smithi017 podman[159674]: 2024-09-20 19:22:18.019187834 +0000 UTC m=+5.768747219 container died 86f4bf02274aa92605ac5d080bcb5b839502e9620204ef012e6d6b92a2f47fe6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-20T19:22:18.635 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 19:22:18 smithi017 podman[159674]: 2024-09-20 19:22:18.406888295 +0000 UTC m=+6.156447678 container cleanup 86f4bf02274aa92605ac5d080bcb5b839502e9620204ef012e6d6b92a2f47fe6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T19:22:18.636 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 19:22:18 smithi017 bash[159674]: ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0 2024-09-20T19:22:19.075 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 19:22:18 smithi017 podman[159688]: 2024-09-20 19:22:18.716778898 +0000 UTC m=+0.689608011 container remove 86f4bf02274aa92605ac5d080bcb5b839502e9620204ef012e6d6b92a2f47fe6 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T19:22:19.345 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 19:22:19 smithi017 podman[159778]: 2024-09-20 19:22:19.076310619 +0000 UTC m=+0.104795076 container create 309f06415f53587d7c0d0258464ca73ffb105e829bbfdcf30cc102a0aa8e38d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-20T19:22:19.345 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 19:22:19 smithi017 podman[159778]: 2024-09-20 19:22:18.988396408 +0000 UTC m=+0.016880878 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:22:19.345 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 19:22:19 smithi017 podman[159778]: 2024-09-20 19:22:19.345925838 +0000 UTC m=+0.374410298 container init 309f06415f53587d7c0d0258464ca73ffb105e829bbfdcf30cc102a0aa8e38d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-20T19:22:19.636 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 19:22:19 smithi017 podman[159778]: 2024-09-20 19:22:19.349956442 +0000 UTC m=+0.378440907 container start 309f06415f53587d7c0d0258464ca73ffb105e829bbfdcf30cc102a0aa8e38d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-20T19:22:19.636 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 19:22:19 smithi017 podman[159778]: 2024-09-20 19:22:19.437506675 +0000 UTC m=+0.465991140 container attach 309f06415f53587d7c0d0258464ca73ffb105e829bbfdcf30cc102a0aa8e38d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T19:22:19.636 INFO:journalctl@ceph.osd.0.smithi017.stdout:Sep 20 19:22:19 smithi017 podman[159778]: 2024-09-20 19:22:19.551759815 +0000 UTC m=+0.580244270 container died 309f06415f53587d7c0d0258464ca73ffb105e829bbfdcf30cc102a0aa8e38d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:22:20.302 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.0.service' 2024-09-20T19:22:20.347 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T19:22:20.347 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-20T19:22:20.347 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-20T19:22:20.347 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.1 2024-09-20T19:22:20.627 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 19:22:20 smithi017 systemd[1]: Stopping Ceph osd.1 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T19:22:20.885 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 19:22:20 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1[122436]: 2024-09-20T19:22:20.737+0000 7ff0e8734640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:22:20.886 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 19:22:20 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1[122436]: 2024-09-20T19:22:20.737+0000 7ff0e8734640 -1 osd.1 80 *** Got signal Terminated *** 2024-09-20T19:22:20.886 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 19:22:20 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1[122436]: 2024-09-20T19:22:20.737+0000 7ff0e8734640 -1 osd.1 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:22:26.386 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 19:22:26 smithi017 podman[159880]: 2024-09-20 19:22:26.153231435 +0000 UTC m=+5.565799625 container died 9e34b5153d0a30363106f809c30abdb881d488a4514d9f1448b184f8ce8911dc (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:22:27.130 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 19:22:26 smithi017 podman[159880]: 2024-09-20 19:22:26.845643759 +0000 UTC m=+6.258211949 container cleanup 9e34b5153d0a30363106f809c30abdb881d488a4514d9f1448b184f8ce8911dc (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2) 2024-09-20T19:22:27.130 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 19:22:26 smithi017 bash[159880]: ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1 2024-09-20T19:22:27.385 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 19:22:27 smithi017 podman[159906]: 2024-09-20 19:22:27.130368584 +0000 UTC m=+0.969539394 container remove 9e34b5153d0a30363106f809c30abdb881d488a4514d9f1448b184f8ce8911dc (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2) 2024-09-20T19:22:27.742 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 19:22:27 smithi017 podman[159998]: 2024-09-20 19:22:27.39412888 +0000 UTC m=+0.016742942 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:22:27.742 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 19:22:27 smithi017 podman[159998]: 2024-09-20 19:22:27.498212054 +0000 UTC m=+0.120826144 container create 5f04c04570c938f02f6daa4033fb9bab42714b3878a39fd10775b4a88093f398 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-20T19:22:27.742 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 19:22:27 smithi017 podman[159998]: 2024-09-20 19:22:27.742866869 +0000 UTC m=+0.365480931 container init 5f04c04570c938f02f6daa4033fb9bab42714b3878a39fd10775b4a88093f398 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-20T19:22:28.135 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 19:22:27 smithi017 podman[159998]: 2024-09-20 19:22:27.746482784 +0000 UTC m=+0.369096832 container start 5f04c04570c938f02f6daa4033fb9bab42714b3878a39fd10775b4a88093f398 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0) 2024-09-20T19:22:28.136 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 19:22:27 smithi017 podman[159998]: 2024-09-20 19:22:27.817583989 +0000 UTC m=+0.440198051 container attach 5f04c04570c938f02f6daa4033fb9bab42714b3878a39fd10775b4a88093f398 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-20T19:22:28.136 INFO:journalctl@ceph.osd.1.smithi017.stdout:Sep 20 19:22:27 smithi017 podman[159998]: 2024-09-20 19:22:27.943661475 +0000 UTC m=+0.566275529 container died 5f04c04570c938f02f6daa4033fb9bab42714b3878a39fd10775b4a88093f398 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-20T19:22:28.774 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.1.service' 2024-09-20T19:22:28.823 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T19:22:28.823 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-20T19:22:28.823 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-20T19:22:28.823 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.2 2024-09-20T19:22:29.126 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 19:22:28 smithi017 systemd[1]: Stopping Ceph osd.2 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T19:22:29.386 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 19:22:29 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2[128293]: 2024-09-20T19:22:29.125+0000 7fd48ca6b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:22:29.386 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 19:22:29 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2[128293]: 2024-09-20T19:22:29.125+0000 7fd48ca6b640 -1 osd.2 80 *** Got signal Terminated *** 2024-09-20T19:22:29.386 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 19:22:29 smithi017 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2[128293]: 2024-09-20T19:22:29.125+0000 7fd48ca6b640 -1 osd.2 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:22:34.818 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 19:22:34 smithi017 podman[160102]: 2024-09-20 19:22:34.533327375 +0000 UTC m=+5.511031465 container died 608ec433a002c9f5834b880f999b9f2a6026d8cd58a59223e5e6e19e03ce13aa (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, io.buildah.version=1.37.2) 2024-09-20T19:22:35.135 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 19:22:34 smithi017 podman[160102]: 2024-09-20 19:22:34.917156879 +0000 UTC m=+5.894860955 container cleanup 608ec433a002c9f5834b880f999b9f2a6026d8cd58a59223e5e6e19e03ce13aa (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-20T19:22:35.135 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 19:22:34 smithi017 bash[160102]: ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2 2024-09-20T19:22:35.540 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 19:22:35 smithi017 podman[160118]: 2024-09-20 19:22:35.193580969 +0000 UTC m=+0.657935665 container remove 608ec433a002c9f5834b880f999b9f2a6026d8cd58a59223e5e6e19e03ce13aa (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-20T19:22:35.808 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 19:22:35 smithi017 podman[160207]: 2024-09-20 19:22:35.44376878 +0000 UTC m=+0.017047736 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:22:35.808 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 19:22:35 smithi017 podman[160207]: 2024-09-20 19:22:35.677926904 +0000 UTC m=+0.251205879 container create e221054fef94485ea72c2a384ecde642cc064bc518a354f5861548338f0703a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-20T19:22:36.170 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 19:22:35 smithi017 podman[160207]: 2024-09-20 19:22:35.897111168 +0000 UTC m=+0.470390117 container init e221054fef94485ea72c2a384ecde642cc064bc518a354f5861548338f0703a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T19:22:36.170 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 19:22:35 smithi017 podman[160207]: 2024-09-20 19:22:35.900778434 +0000 UTC m=+0.474057373 container start e221054fef94485ea72c2a384ecde642cc064bc518a354f5861548338f0703a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:22:36.170 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 19:22:35 smithi017 podman[160207]: 2024-09-20 19:22:35.971965761 +0000 UTC m=+0.545244705 container attach e221054fef94485ea72c2a384ecde642cc064bc518a354f5861548338f0703a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-deactivate, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-20T19:22:36.170 INFO:journalctl@ceph.osd.2.smithi017.stdout:Sep 20 19:22:36 smithi017 podman[160207]: 2024-09-20 19:22:36.102095087 +0000 UTC m=+0.675374030 container died e221054fef94485ea72c2a384ecde642cc064bc518a354f5861548338f0703a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-20T19:22:36.687 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.2.service' 2024-09-20T19:22:36.730 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T19:22:36.730 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-20T19:22:36.730 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-20T19:22:36.730 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.3 2024-09-20T19:22:37.020 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 19:22:36 smithi172 systemd[1]: Stopping Ceph osd.3 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T19:22:37.445 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 19:22:37 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3[88407]: 2024-09-20T19:22:37.020+0000 7ff67839c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:22:37.445 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 19:22:37 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3[88407]: 2024-09-20T19:22:37.020+0000 7ff67839c640 -1 osd.3 80 *** Got signal Terminated *** 2024-09-20T19:22:37.445 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 19:22:37 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3[88407]: 2024-09-20T19:22:37.020+0000 7ff67839c640 -1 osd.3 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:22:39.833 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:39 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:39.560+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:40.194 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:39 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T19:22:39.833+0000 7f50bf1d5640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:16.754803+0000 front 2024-09-20T19:22:16.754869+0000 (oldest deadline 2024-09-20T19:22:39.654771+0000) 2024-09-20T19:22:40.784 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:40 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:40.513+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:41.194 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:40 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T19:22:40.784+0000 7f50bf1d5640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:16.754803+0000 front 2024-09-20T19:22:16.754869+0000 (oldest deadline 2024-09-20T19:22:39.654771+0000) 2024-09-20T19:22:41.195 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 19:22:40 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3[88407]: 2024-09-20T19:22:40.792+0000 7ff6749b1640 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:17.383749+0000 front 2024-09-20T19:22:17.383769+0000 (oldest deadline 2024-09-20T19:22:40.283633+0000) 2024-09-20T19:22:41.754 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:41 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:41.563+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:42.195 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 19:22:41 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3[88407]: 2024-09-20T19:22:41.768+0000 7ff6749b1640 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:17.383749+0000 front 2024-09-20T19:22:17.383769+0000 (oldest deadline 2024-09-20T19:22:40.283633+0000) 2024-09-20T19:22:42.195 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:41 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T19:22:41.754+0000 7f50bf1d5640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:16.754803+0000 front 2024-09-20T19:22:16.754869+0000 (oldest deadline 2024-09-20T19:22:39.654771+0000) 2024-09-20T19:22:42.695 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 19:22:42 smithi172 podman[113787]: 2024-09-20 19:22:42.398142649 +0000 UTC m=+5.471663187 container died f7f0c8354238b854cde88b2bd95896eba9eb169c486d59850ed318843b2e2e6a (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-20T19:22:42.695 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:42 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:42.583+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:42.963 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 19:22:42 smithi172 podman[113787]: 2024-09-20 19:22:42.786969252 +0000 UTC m=+5.860489800 container cleanup f7f0c8354238b854cde88b2bd95896eba9eb169c486d59850ed318843b2e2e6a (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:22:42.963 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 19:22:42 smithi172 bash[113787]: ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3 2024-09-20T19:22:42.963 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:42 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T19:22:42.758+0000 7f50bf1d5640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:16.754803+0000 front 2024-09-20T19:22:16.754869+0000 (oldest deadline 2024-09-20T19:22:39.654771+0000) 2024-09-20T19:22:43.365 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 19:22:42 smithi172 podman[113805]: 2024-09-20 19:22:42.96320503 +0000 UTC m=+0.561957222 container remove f7f0c8354238b854cde88b2bd95896eba9eb169c486d59850ed318843b2e2e6a (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T19:22:43.633 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:43 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:43.605+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:43.633 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 19:22:43 smithi172 podman[113896]: 2024-09-20 19:22:43.268203941 +0000 UTC m=+0.016172962 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:22:43.633 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 19:22:43 smithi172 podman[113896]: 2024-09-20 19:22:43.389103267 +0000 UTC m=+0.137072282 container create ae5fdf1de13a52b2708594ddb421f19f98259046f9852c3258d1c101d1a94d36 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-20T19:22:43.633 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 19:22:43 smithi172 podman[113896]: 2024-09-20 19:22:43.633598505 +0000 UTC m=+0.381567526 container init ae5fdf1de13a52b2708594ddb421f19f98259046f9852c3258d1c101d1a94d36 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T19:22:43.944 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:43 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T19:22:43.741+0000 7f50bf1d5640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:16.754803+0000 front 2024-09-20T19:22:16.754869+0000 (oldest deadline 2024-09-20T19:22:39.654771+0000) 2024-09-20T19:22:43.945 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 19:22:43 smithi172 podman[113896]: 2024-09-20 19:22:43.637313698 +0000 UTC m=+0.385282719 container start ae5fdf1de13a52b2708594ddb421f19f98259046f9852c3258d1c101d1a94d36 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-20T19:22:43.945 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 19:22:43 smithi172 podman[113896]: 2024-09-20 19:22:43.725062848 +0000 UTC m=+0.473031863 container attach ae5fdf1de13a52b2708594ddb421f19f98259046f9852c3258d1c101d1a94d36 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-20T19:22:43.945 INFO:journalctl@ceph.osd.3.smithi172.stdout:Sep 20 19:22:43 smithi172 podman[113896]: 2024-09-20 19:22:43.821620226 +0000 UTC m=+0.569589242 container died ae5fdf1de13a52b2708594ddb421f19f98259046f9852c3258d1c101d1a94d36 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T19:22:44.501 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.3.service' 2024-09-20T19:22:44.543 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T19:22:44.543 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-20T19:22:44.543 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-20T19:22:44.543 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.4 2024-09-20T19:22:44.770 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:44 smithi172 systemd[1]: Stopping Ceph osd.4 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T19:22:44.770 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:44 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:44.640+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:45.195 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:44 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T19:22:44.769+0000 7f50bf1d5640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:16.754803+0000 front 2024-09-20T19:22:16.754869+0000 (oldest deadline 2024-09-20T19:22:39.654771+0000) 2024-09-20T19:22:45.195 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:44 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T19:22:44.917+0000 7f50c6bc8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:22:45.195 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:44 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T19:22:44.917+0000 7f50c6bc8640 -1 osd.4 80 *** Got signal Terminated *** 2024-09-20T19:22:45.195 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:44 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T19:22:44.917+0000 7f50c6bc8640 -1 osd.4 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:22:45.945 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:45 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T19:22:45.798+0000 7f50bf1d5640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:16.754803+0000 front 2024-09-20T19:22:16.754869+0000 (oldest deadline 2024-09-20T19:22:39.654771+0000) 2024-09-20T19:22:45.945 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:45 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:45.625+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:46.829 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:46 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:46.639+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:47.194 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:46 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T19:22:46.830+0000 7f50bf1d5640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:16.754803+0000 front 2024-09-20T19:22:16.754869+0000 (oldest deadline 2024-09-20T19:22:39.654771+0000) 2024-09-20T19:22:47.946 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:47 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:47.621+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:47.946 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:47 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T19:22:47.848+0000 7f50bf1d5640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:16.754803+0000 front 2024-09-20T19:22:16.754869+0000 (oldest deadline 2024-09-20T19:22:39.654771+0000) 2024-09-20T19:22:48.944 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:48 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T19:22:48.847+0000 7f50bf1d5640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:16.754803+0000 front 2024-09-20T19:22:16.754869+0000 (oldest deadline 2024-09-20T19:22:39.654771+0000) 2024-09-20T19:22:48.945 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:48 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:48.645+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:48.945 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:48 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:48.645+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-09-20T19:22:24.487709+0000 front 2024-09-20T19:22:24.487612+0000 (oldest deadline 2024-09-20T19:22:47.987448+0000) 2024-09-20T19:22:49.945 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:49 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T19:22:49.800+0000 7f50bf1d5640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:16.754803+0000 front 2024-09-20T19:22:16.754869+0000 (oldest deadline 2024-09-20T19:22:39.654771+0000) 2024-09-20T19:22:49.945 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:49 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4[93118]: 2024-09-20T19:22:49.800+0000 7f50bf1d5640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-09-20T19:22:20.155583+0000 front 2024-09-20T19:22:20.155565+0000 (oldest deadline 2024-09-20T19:22:49.555920+0000) 2024-09-20T19:22:49.945 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:49 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:49.629+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:49.945 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:49 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:49.629+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-09-20T19:22:24.487709+0000 front 2024-09-20T19:22:24.487612+0000 (oldest deadline 2024-09-20T19:22:47.987448+0000) 2024-09-20T19:22:50.710 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:50 smithi172 podman[114000]: 2024-09-20 19:22:50.450575152 +0000 UTC m=+5.650509729 container died 621ed127d3879defe8b49e474cd7b7a057ffff04a8fa400a2c8ce585a0d7b2b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-20T19:22:50.710 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:50 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:50.598+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:50.710 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:50 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:50.598+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-09-20T19:22:24.487709+0000 front 2024-09-20T19:22:24.487612+0000 (oldest deadline 2024-09-20T19:22:47.987448+0000) 2024-09-20T19:22:51.118 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:50 smithi172 podman[114000]: 2024-09-20 19:22:50.800932158 +0000 UTC m=+6.000866773 container cleanup 621ed127d3879defe8b49e474cd7b7a057ffff04a8fa400a2c8ce585a0d7b2b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-20T19:22:51.118 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:50 smithi172 bash[114000]: ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4 2024-09-20T19:22:51.444 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:51 smithi172 podman[114027]: 2024-09-20 19:22:51.118953691 +0000 UTC m=+0.669176256 container remove 621ed127d3879defe8b49e474cd7b7a057ffff04a8fa400a2c8ce585a0d7b2b2 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-20T19:22:51.738 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:51 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:51.614+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:51.738 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:51 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:51.614+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-09-20T19:22:24.487709+0000 front 2024-09-20T19:22:24.487612+0000 (oldest deadline 2024-09-20T19:22:47.987448+0000) 2024-09-20T19:22:51.738 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:51 smithi172 podman[114112]: 2024-09-20 19:22:51.377748618 +0000 UTC m=+0.015719705 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:22:51.739 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:51 smithi172 podman[114112]: 2024-09-20 19:22:51.50329824 +0000 UTC m=+0.141269361 container create 1231629bc449bf4383ddbc4f3524e46ceba6a6ca11fb09d0de3b78b41e7874ef (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-deactivate, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-20T19:22:51.739 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:51 smithi172 podman[114112]: 2024-09-20 19:22:51.739085822 +0000 UTC m=+0.377056908 container init 1231629bc449bf4383ddbc4f3524e46ceba6a6ca11fb09d0de3b78b41e7874ef (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-20T19:22:52.195 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:51 smithi172 podman[114112]: 2024-09-20 19:22:51.742596416 +0000 UTC m=+0.380567492 container start 1231629bc449bf4383ddbc4f3524e46ceba6a6ca11fb09d0de3b78b41e7874ef (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-20T19:22:52.195 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:51 smithi172 podman[114112]: 2024-09-20 19:22:51.822282898 +0000 UTC m=+0.460253989 container attach 1231629bc449bf4383ddbc4f3524e46ceba6a6ca11fb09d0de3b78b41e7874ef (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:22:52.195 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 20 19:22:51 smithi172 podman[114112]: 2024-09-20 19:22:51.941113644 +0000 UTC m=+0.579084721 container died 1231629bc449bf4383ddbc4f3524e46ceba6a6ca11fb09d0de3b78b41e7874ef (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-20-1028-88deadb) 2024-09-20T19:22:52.543 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.4.service' 2024-09-20T19:22:52.584 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T19:22:52.584 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-20T19:22:52.585 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-20T19:22:52.585 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.5 2024-09-20T19:22:52.928 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:52 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:52.629+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:52.928 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:52 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:52.629+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-09-20T19:22:24.487709+0000 front 2024-09-20T19:22:24.487612+0000 (oldest deadline 2024-09-20T19:22:47.987448+0000) 2024-09-20T19:22:52.928 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:52 smithi172 systemd[1]: Stopping Ceph osd.5 for 7a27d282-777d-11ef-baf5-efdc52797490... 2024-09-20T19:22:52.929 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:52 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:52.928+0000 7f94dfad2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-20T19:22:52.929 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:52 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:52.928+0000 7f94dfad2640 -1 osd.5 80 *** Got signal Terminated *** 2024-09-20T19:22:53.194 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:52 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:52.928+0000 7f94dfad2640 -1 osd.5 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-20T19:22:53.944 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:53 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:53.623+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:53.945 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:53 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:53.623+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-09-20T19:22:24.487709+0000 front 2024-09-20T19:22:24.487612+0000 (oldest deadline 2024-09-20T19:22:47.987448+0000) 2024-09-20T19:22:54.944 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:54 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:54.637+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:54.945 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:54 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:54.637+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-09-20T19:22:24.487709+0000 front 2024-09-20T19:22:24.487612+0000 (oldest deadline 2024-09-20T19:22:47.987448+0000) 2024-09-20T19:22:55.944 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:55 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:55.651+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:55.945 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:55 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:55.651+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-09-20T19:22:24.487709+0000 front 2024-09-20T19:22:24.487612+0000 (oldest deadline 2024-09-20T19:22:47.987448+0000) 2024-09-20T19:22:56.944 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:56 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:56.691+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:56.945 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:56 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:56.691+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-09-20T19:22:24.487709+0000 front 2024-09-20T19:22:24.487612+0000 (oldest deadline 2024-09-20T19:22:47.987448+0000) 2024-09-20T19:22:57.944 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:57 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:57.672+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-09-20T19:22:13.986475+0000 front 2024-09-20T19:22:13.986350+0000 (oldest deadline 2024-09-20T19:22:38.686346+0000) 2024-09-20T19:22:57.945 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:57 smithi172 ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5[97849]: 2024-09-20T19:22:57.672+0000 7f94dc0e7640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-09-20T19:22:24.487709+0000 front 2024-09-20T19:22:24.487612+0000 (oldest deadline 2024-09-20T19:22:47.987448+0000) 2024-09-20T19:22:58.444 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:58 smithi172 podman[114216]: 2024-09-20 19:22:58.260678821 +0000 UTC m=+5.439249784 container died 6047a709a06ac59af0964e8793a50e2876edbd2510b1b84ad11ef744e08b4d16 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-20T19:22:58.778 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:58 smithi172 podman[114216]: 2024-09-20 19:22:58.602799387 +0000 UTC m=+5.781370340 container cleanup 6047a709a06ac59af0964e8793a50e2876edbd2510b1b84ad11ef744e08b4d16 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-20T19:22:58.779 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:58 smithi172 bash[114216]: ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5 2024-09-20T19:22:59.194 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:58 smithi172 podman[114245]: 2024-09-20 19:22:58.779166097 +0000 UTC m=+0.517486614 container remove 6047a709a06ac59af0964e8793a50e2876edbd2510b1b84ad11ef744e08b4d16 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-20T19:22:59.498 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:59 smithi172 podman[114333]: 2024-09-20 19:22:59.108547429 +0000 UTC m=+0.016061070 image pull 441f9a3fe51528ef653b21f42e9d884db6124a0c7d482e865382bdfdb9ec979c quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2 2024-09-20T19:22:59.499 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:59 smithi172 podman[114333]: 2024-09-20 19:22:59.221612489 +0000 UTC m=+0.129126124 container create 67dc375858a969909f9cc2c3d748516b2e3baef0ed8b659e921a7bca4f27edd5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-deactivate, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-09-20T19:22:59.499 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:59 smithi172 podman[114333]: 2024-09-20 19:22:59.49943913 +0000 UTC m=+0.406952782 container init 67dc375858a969909f9cc2c3d748516b2e3baef0ed8b659e921a7bca4f27edd5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-20T19:22:59.945 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:59 smithi172 podman[114333]: 2024-09-20 19:22:59.502717652 +0000 UTC m=+0.410231295 container start 67dc375858a969909f9cc2c3d748516b2e3baef0ed8b659e921a7bca4f27edd5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-20T19:22:59.945 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:59 smithi172 podman[114333]: 2024-09-20 19:22:59.599442825 +0000 UTC m=+0.506956484 container attach 67dc375858a969909f9cc2c3d748516b2e3baef0ed8b659e921a7bca4f27edd5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-20T19:22:59.945 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 20 19:22:59 smithi172 podman[114333]: 2024-09-20 19:22:59.694240391 +0000 UTC m=+0.601754028 container died 67dc375858a969909f9cc2c3d748516b2e3baef0ed8b659e921a7bca4f27edd5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8a1a6edbc97129e01d4344a6578add33aaab808082c84049bd2e48e1f97b80d2, name=ceph-7a27d282-777d-11ef-baf5-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-20-1028-88deadb, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-20T19:23:00.304 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7a27d282-777d-11ef-baf5-efdc52797490@osd.5.service' 2024-09-20T19:23:00.344 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-20T19:23:00.345 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-20T19:23:00.345 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7a27d282-777d-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-20T19:23:00.558 INFO:teuthology.orchestra.run.smithi017.stdout:Deleting cluster with fsid: 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T19:23:05.093 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[76345]: fuse finished with error 0 and tester_r 0 2024-09-20T19:23:22.787 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7a27d282-777d-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-20T19:23:22.989 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T19:23:38.300 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-20T19:23:38.333 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-20T19:23:38.361 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-20T19:23:38.363 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912681/remote/smithi017/crash 2024-09-20T19:23:38.363 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash -- . 2024-09-20T19:23:38.406 INFO:teuthology.orchestra.run.smithi017.stderr:tar: /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-20T19:23:38.406 INFO:teuthology.orchestra.run.smithi017.stderr:tar: Error is not recoverable: exiting now 2024-09-20T19:23:38.408 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912681/remote/smithi172/crash 2024-09-20T19:23:38.409 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash -- . 2024-09-20T19:23:38.433 INFO:teuthology.orchestra.run.smithi172.stderr:tar: /var/lib/ceph/7a27d282-777d-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-20T19:23:38.433 INFO:teuthology.orchestra.run.smithi172.stderr:tar: Error is not recoverable: exiting now 2024-09-20T19:23:38.434 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-20T19:23:38.435 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-20T19:23:38.489 INFO:teuthology.orchestra.run.smithi017.stdout:2024-09-20T18:50:00.000308+0000 mon.smithi017 (mon.0) 557 : cluster [ERR] fs cephfs is offline because no MDS is active for it. 2024-09-20T19:23:38.489 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-20T19:23:38.489 INFO:tasks.cephadm:Compressing logs... 2024-09-20T19:23:38.489 DEBUG:teuthology.orchestra.run.smithi017:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-20T19:23:38.532 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-20T19:23:38.555 INFO:teuthology.orchestra.run.smithi017.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-20T19:23:38.555 INFO:teuthology.orchestra.run.smithi017.stderr:: No such file or directory 2024-09-20T19:23:38.555 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi017.xhlvpy.log 2024-09-20T19:23:38.556 INFO:teuthology.orchestra.run.smithi017.stderr:gzip/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.0.log: -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-20T19:23:38.556 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi017.xhlvpy.log: gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-20T19:23:38.556 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mon.smithi017.log 2024-09-20T19:23:38.557 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.1.log: /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-20T19:23:38.558 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mon.smithi017.log: gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-20T19:23:38.558 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mgr.smithi017.xusjwd.log 2024-09-20T19:23:38.559 INFO:teuthology.orchestra.run.smithi172.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-20T19:23:38.559 INFO:teuthology.orchestra.run.smithi172.stderr:: No such file or directory 2024-09-20T19:23:38.559 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi172.log 2024-09-20T19:23:38.559 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-20T19:23:38.559 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.1.log: gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-20T19:23:38.559 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi172.log: /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-20T19:23:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.cephadm.log: 86.3% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-20T19:23:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi017.log 2024-09-20T19:23:38.565 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mgr.smithi017.xusjwd.log: 91.4% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-20T19:23:38.566 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-20T19:23:38.566 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.4.log: /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-20T19:23:38.567 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.log 2024-09-20T19:23:38.567 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mgr.smithi172.jczphg.log 2024-09-20T19:23:38.567 INFO:teuthology.orchestra.run.smithi172.stderr: 84.9% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-20T19:23:38.567 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi172.mugtlk.log 2024-09-20T19:23:38.567 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mgr.smithi172.jczphg.log: 94.5% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi172.log.gz 2024-09-20T19:23:38.567 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi172.liatxm.log 2024-09-20T19:23:38.567 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi172.mugtlk.log: 91.5% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-20T19:23:38.567 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mon.smithi172.log 2024-09-20T19:23:38.567 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi172.liatxm.log: 89.6% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-20T19:23:38.567 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-20T19:23:38.575 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mon.smithi172.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-20T19:23:38.579 INFO:teuthology.orchestra.run.smithi017.stderr: 91.3% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-20T19:23:38.580 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-20T19:23:38.580 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi017.log: gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.log 2024-09-20T19:23:38.585 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.2.log: 94.4% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-client.ceph-exporter.smithi017.log.gz 2024-09-20T19:23:38.586 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi017.puqizo.log 2024-09-20T19:23:38.592 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.log: 89.6% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-20T19:23:38.593 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-20T19:23:38.594 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.3.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-20T19:23:38.596 INFO:teuthology.orchestra.run.smithi172.stderr: 91.3% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-20T19:23:38.605 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi017.puqizo.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-20T19:23:38.620 INFO:teuthology.orchestra.run.smithi172.stderr: 90.0% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mgr.smithi172.jczphg.log.gz 2024-09-20T19:23:38.673 INFO:teuthology.orchestra.run.smithi172.stderr: 94.6% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi172.liatxm.log.gz 2024-09-20T19:23:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-20T19:23:39.296 INFO:teuthology.orchestra.run.smithi017.stderr: 90.1% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mgr.smithi017.xusjwd.log.gz 2024-09-20T19:23:39.467 INFO:teuthology.orchestra.run.smithi172.stderr: 92.5% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mon.smithi172.log.gz 2024-09-20T19:23:41.028 INFO:teuthology.orchestra.run.smithi017.stderr: 89.9% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mon.smithi017.log.gz 2024-09-20T19:23:42.680 INFO:teuthology.orchestra.run.smithi172.stderr: 93.8% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-20T19:23:43.953 INFO:teuthology.orchestra.run.smithi172.stderr: 93.8% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-20T19:23:45.016 INFO:teuthology.orchestra.run.smithi172.stderr: 93.8% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-20T19:23:45.527 INFO:teuthology.orchestra.run.smithi017.stderr: 93.7% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-20T19:23:45.648 INFO:teuthology.orchestra.run.smithi172.stderr: 94.8% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi172.mugtlk.log.gz 2024-09-20T19:23:45.866 INFO:teuthology.orchestra.run.smithi017.stderr: 93.6% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-20T19:23:46.675 INFO:teuthology.orchestra.run.smithi017.stderr: 93.7% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-20T19:23:48.260 INFO:teuthology.orchestra.run.smithi017.stderr: 94.8% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi017.xhlvpy.log.gz 2024-09-20T19:23:53.766 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-20T19:23:53.766 INFO:teuthology.orchestra.run.smithi172.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-20T19:23:53.767 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-20T19:23:53.767 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m15.221s 2024-09-20T19:23:53.767 INFO:teuthology.orchestra.run.smithi172.stderr:user 0m38.128s 2024-09-20T19:23:53.768 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m1.178s 2024-09-20T19:23:54.517 INFO:teuthology.orchestra.run.smithi017.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-20T19:25:29.225 INFO:teuthology.orchestra.run.smithi017.stderr: 93.0% -- replaced with /var/log/ceph/7a27d282-777d-11ef-baf5-efdc52797490/ceph-mds.cephfs.smithi017.puqizo.log.gz 2024-09-20T19:25:29.227 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-20T19:25:29.227 INFO:teuthology.orchestra.run.smithi017.stderr:real 1m50.682s 2024-09-20T19:25:29.227 INFO:teuthology.orchestra.run.smithi017.stderr:user 2m36.366s 2024-09-20T19:25:29.227 INFO:teuthology.orchestra.run.smithi017.stderr:sys 0m4.527s 2024-09-20T19:25:29.228 INFO:tasks.cephadm:Archiving logs... 2024-09-20T19:25:29.228 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912681/remote/smithi017/log 2024-09-20T19:25:29.229 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-20T19:25:49.936 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912681/remote/smithi172/log 2024-09-20T19:25:49.937 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-20T19:25:54.803 INFO:tasks.cephadm:Removing cluster... 2024-09-20T19:25:54.803 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7a27d282-777d-11ef-baf5-efdc52797490 --force 2024-09-20T19:25:55.017 INFO:teuthology.orchestra.run.smithi017.stdout:Deleting cluster with fsid: 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T19:25:55.441 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7a27d282-777d-11ef-baf5-efdc52797490 --force 2024-09-20T19:25:55.635 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 7a27d282-777d-11ef-baf5-efdc52797490 2024-09-20T19:25:55.918 INFO:tasks.cephadm:Removing cephadm ... 2024-09-20T19:25:55.919 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-20T19:25:55.936 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-20T19:25:55.952 INFO:tasks.cephadm:Teardown complete 2024-09-20T19:25:55.952 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-20T19:25:55.963 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-20T19:25:55.964 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-20T19:25:55.964 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-20T19:25:55.979 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-20T19:25:56.068 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-20T19:25:56.078 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-20T19:25:56.078 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T19:25:56.081 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-20T19:25:56.095 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-09-20T19:25:56.095 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-20T19:25:56.100 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-20T19:25:56.100 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-09-20T19:25:56.100 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv01.front.sepia.ceph.com 3 7 377 116 +311us[ +482us] +/- 43ms 2024-09-20T19:25:56.101 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 +716us[ +716us] +/- 40ms 2024-09-20T19:25:56.101 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 240 -1856us[-1684us] +/- 80ms 2024-09-20T19:25:56.101 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T19:25:56.101 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-20T19:25:56.101 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-20T19:25:56.101 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv01.front.sepia.ceph.com 3 7 377 43 +354us[ +487us] +/- 44ms 2024-09-20T19:25:56.101 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 +756us[ +756us] +/- 40ms 2024-09-20T19:25:56.101 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 44 -1843us[-1710us] +/- 83ms 2024-09-20T19:25:56.101 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-20T19:25:56.101 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-20T19:25:56.162 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-20T19:25:56.163 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-20T19:25:56.215 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-20T19:25:56.300 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-20T19:25:56.374 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-20T19:25:56.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T19:25:56.406 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-20T19:25:56.433 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T19:25:56.434 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-20T19:25:56.445 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-20T19:25:56.517 INFO:teuthology.task.internal:Duration was 4124.303003 seconds 2024-09-20T19:25:56.518 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-20T19:25:56.618 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-20T19:25:56.618 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-20T19:25:56.621 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-20T19:25:56.660 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-20T19:25:56.661 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-20T19:25:57.176 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-20T19:25:57.176 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2024-09-20T19:25:57.176 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-20T19:25:57.239 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-09-20T19:25:57.240 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-20T19:25:57.265 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-20T19:25:57.266 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-20T19:25:57.282 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-20T19:25:57.333 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-20T19:25:57.334 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-20T19:25:57.352 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-20T19:25:58.591 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-20T19:25:58.603 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-20T19:25:58.603 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-20T19:25:58.629 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-20T19:25:58.658 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-20T19:25:58.746 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-20T19:25:58.749 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-20T19:25:58.771 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2024-09-20T19:25:58.775 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-09-20T19:25:59.058 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-20T19:25:59.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T19:25:59.074 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-20T19:25:59.117 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T19:25:59.118 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-20T19:25:59.131 INFO:teuthology.task.internal:Transferring archived files... 2024-09-20T19:25:59.131 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912681/remote/smithi017 2024-09-20T19:25:59.132 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-20T19:25:59.189 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-20_12:24:58-orch:cephadm-wip-guits-main-2024-09-20-1028-distro-default-smithi/7912681/remote/smithi172 2024-09-20T19:25:59.190 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-20T19:25:59.233 INFO:teuthology.task.internal:Removing archive directory... 2024-09-20T19:25:59.233 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-20T19:25:59.236 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-20T19:25:59.283 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-20T19:25:59.295 INFO:teuthology.task.internal:Not uploading archives. 2024-09-20T19:25:59.295 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-20T19:25:59.364 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-20T19:25:59.365 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-20T19:25:59.367 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-20T19:25:59.381 INFO:teuthology.orchestra.run.smithi017.stdout: 265324 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 20 19:25 /home/ubuntu/cephtest 2024-09-20T19:25:59.381 INFO:teuthology.orchestra.run.smithi017.stdout: 531308 4 d--------- 2 ubuntu ubuntu 4096 Sep 20 18:33 /home/ubuntu/cephtest/mnt.0 2024-09-20T19:25:59.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-20T19:25:59.382 INFO:teuthology.orchestra.run.smithi017.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-20T19:25:59.382 INFO:teuthology.orchestra.run.smithi017.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-20T19:25:59.383 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_88deadb8082f4a33832e228ccefc59cedba158a5/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi017 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-20T19:25:59.383 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-20T19:25:59.508 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-20T19:25:59.635 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-20T19:25:59.637 INFO:teuthology.run:Summary data: description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 4124.303003311157 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_gabrioux@teuthology status: fail success: false 2024-09-20T19:25:59.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-20T19:25:59.728 INFO:teuthology.run:FAIL